-- Logs begin at Sun 2022-10-16 00:10:41 UTC, end at Sun 2022-10-16 02:40:41 UTC. -- Oct 16 00:44:30.261918 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Oct 16 00:44:30.272759 n-d-master-1 devstack@keystone.service[81792]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 16 00:44:30.274893 n-d-master-1 devstack@keystone.service[81792]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 16 00:44:30 2022] *** Oct 16 00:44:30.274893 n-d-master-1 devstack@keystone.service[81792]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 16 00:44:30.274893 n-d-master-1 devstack@keystone.service[81792]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 16 00:44:30.274893 n-d-master-1 devstack@keystone.service[81792]: nodename: n-d-master-1 Oct 16 00:44:30.274893 n-d-master-1 devstack@keystone.service[81792]: machine: x86_64 Oct 16 00:44:30.274893 n-d-master-1 devstack@keystone.service[81792]: clock source: unix Oct 16 00:44:30.274893 n-d-master-1 devstack@keystone.service[81792]: pcre jit disabled Oct 16 00:44:30.274893 n-d-master-1 devstack@keystone.service[81792]: detected number of CPU cores: 4 Oct 16 00:44:30.274893 n-d-master-1 devstack@keystone.service[81792]: current working directory: / Oct 16 00:44:30.274893 n-d-master-1 devstack@keystone.service[81792]: detected binary path: /usr/bin/uwsgi-core Oct 16 00:44:30.275535 n-d-master-1 devstack@keystone.service[81792]: your processes number limit is 47680 Oct 16 00:44:30.275535 n-d-master-1 devstack@keystone.service[81792]: your memory page size is 4096 bytes Oct 16 00:44:30.275535 n-d-master-1 devstack@keystone.service[81792]: detected max file descriptor number: 2048 Oct 16 00:44:30.275535 n-d-master-1 devstack@keystone.service[81792]: lock engine: pthread robust mutexes Oct 16 00:44:30.275535 n-d-master-1 devstack@keystone.service[81792]: thunder lock: enabled Oct 16 00:44:30.275535 n-d-master-1 devstack@keystone.service[81792]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 16 00:44:30.275535 n-d-master-1 devstack@keystone.service[81792]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 16 00:44:30.314232 n-d-master-1 devstack@keystone.service[81792]: Python main interpreter initialized at 0x55b8fcb6a9c0 Oct 16 00:44:30.314232 n-d-master-1 devstack@keystone.service[81792]: python threads support enabled Oct 16 00:44:30.314232 n-d-master-1 devstack@keystone.service[81792]: your server socket listen backlog is limited to 100 connections Oct 16 00:44:30.314232 n-d-master-1 devstack@keystone.service[81792]: your mercy for graceful operations on workers is 90 seconds Oct 16 00:44:30.314545 n-d-master-1 devstack@keystone.service[81792]: mapped 403077 bytes (393 KB) for 2 cores Oct 16 00:44:30.314634 n-d-master-1 devstack@keystone.service[81792]: *** Operational MODE: preforking *** Oct 16 00:44:30.314887 n-d-master-1 devstack@keystone.service[81792]: *** uWSGI is running in multiple interpreter mode *** Oct 16 00:44:30.314887 n-d-master-1 devstack@keystone.service[81792]: spawned uWSGI master process (pid: 81792) Oct 16 00:44:30.315087 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Oct 16 00:44:30.319014 n-d-master-1 devstack@keystone.service[81792]: spawned uWSGI worker 1 (pid: 81804, cores: 1) Oct 16 00:44:30.319014 n-d-master-1 devstack@keystone.service[81792]: spawned uWSGI worker 2 (pid: 81805, cores: 1) Oct 16 00:44:30.319014 n-d-master-1 devstack@keystone.service[81792]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 16 00:44:34.593718 n-d-master-1 devstack@keystone.service[81805]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:44:34.593718 n-d-master-1 devstack@keystone.service[81805]: from cryptography.utils import int_from_bytes Oct 16 00:44:34.594495 n-d-master-1 devstack@keystone.service[81804]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:44:34.594495 n-d-master-1 devstack@keystone.service[81804]: from cryptography.utils import int_from_bytes Oct 16 00:44:34.594966 n-d-master-1 devstack@keystone.service[81805]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:44:34.594966 n-d-master-1 devstack@keystone.service[81805]: from cryptography.utils import int_from_bytes Oct 16 00:44:34.595097 n-d-master-1 devstack@keystone.service[81804]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:44:34.595097 n-d-master-1 devstack@keystone.service[81804]: from cryptography.utils import int_from_bytes Oct 16 00:44:34.645574 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:44:34.645777 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:44:34.646010 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] command line args: [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:44:34.646113 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:44:34.646180 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:44:34.646245 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:44:34.646423 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] command line args: [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:44:34.646517 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ================================================================================ {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:44:34.646649 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] admin_token = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.646725 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:44:34.646791 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ================================================================================ {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:44:34.646955 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] config_dir = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.647123 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] admin_token = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.647201 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.647266 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] config_source = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.647322 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] config_dir = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.647481 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] debug = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.647563 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.647633 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.649953 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] config_source = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.649953 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] debug = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650101 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650183 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650275 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650341 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650404 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650485 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650545 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650608 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650666 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650727 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650789 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] log_config_append = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650789 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650889 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.650889 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] log_config_append = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651022 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] log_dir = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651078 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651139 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] log_file = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651200 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] log_dir = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651200 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] log_file = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651307 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651365 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651419 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651479 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651541 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651603 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651667 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651727 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651789 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651853 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651910 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.651973 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.652037 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.652110 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.652167 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.652223 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.652287 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.652354 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.652412 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.652472 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.652529 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.653202 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.653416 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.653623 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.653791 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.654023 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.654186 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.654684 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.654684 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.655066 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.655229 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.655418 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.655658 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] publish_errors = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.655818 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] publish_errors = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.656011 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.656205 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.656392 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.656627 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.656795 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.656991 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.657178 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.657412 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.657609 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.657780 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.657975 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] standard_threads = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.658170 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] standard_threads = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.658340 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.658481 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.658651 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.658778 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.658778 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.659065 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.659065 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] use_journal = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.659366 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] use_journal = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.659502 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] use_json = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.659662 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] use_json = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.659799 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] use_stderr = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.659932 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] use_stderr = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.659932 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] use_syslog = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.660725 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] use_syslog = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.661417 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.661573 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:44:34.661704 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.661704 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.661941 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.662078 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.662205 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.662331 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.662456 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.662581 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.662713 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.662851 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.663043 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.663192 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.663325 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.663451 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.663576 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.663710 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.663843 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.663975 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.664101 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.664226 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.664350 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.664486 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.664620 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.664789 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.664916 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.665051 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.665182 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.665317 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.665449 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.665576 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.665706 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.665833 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.665958 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.666092 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.666092 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.666334 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.666334 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.666577 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.666577 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.666934 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.666934 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.667195 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.667320 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.667450 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.667583 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.667717 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.667844 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.667977 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.668104 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.668229 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.668362 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.668489 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.668624 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.668750 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.668874 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.669000 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.669133 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.669264 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.669396 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.669523 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.669653 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.669783 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.669918 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.670050 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.670183 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.670320 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.670451 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.670451 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.670701 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.670828 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.670998 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.671133 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.671259 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.671384 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.671520 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.671647 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.671772 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.671896 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.672059 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.672252 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.672389 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.672516 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.672641 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.672765 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.672896 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.673023 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.673225 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.673362 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.673527 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.673660 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.673787 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.673787 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.674089 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.674089 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.674467 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.674599 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.674768 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.674903 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.675103 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.675249 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.675379 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.675505 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.675629 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.675755 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.677008 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.677151 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.677151 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.677404 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.677541 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.677668 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.677806 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.677939 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.678067 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.678234 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.678371 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.678371 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.678621 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.678747 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.678874 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.679044 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.679173 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.679310 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.679310 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.679558 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.679558 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.679805 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.679939 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.680074 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.680210 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.680362 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.680518 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.680648 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.680787 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.680914 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.681041 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.681176 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.681304 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.681431 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.681557 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.681685 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.681817 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.681953 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.681953 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.682150 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.682211 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.682268 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.682489 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.682649 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.682734 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.682835 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.682939 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.683014 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.683094 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.683180 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.683253 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.683322 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.683391 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.683460 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.683528 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.683605 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.683677 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.683782 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.683877 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.683971 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.684066 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.684168 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.684265 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.684359 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.684454 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.684547 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.684547 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.684730 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.684868 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.684972 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.685105 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.685221 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.685296 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.685370 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.685441 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.685510 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.685624 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.685699 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.685812 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.685964 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.686082 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.686157 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.686270 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.686344 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.686466 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.686553 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.686632 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.686711 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.686833 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.686958 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.687035 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.687150 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.687241 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.687315 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.687430 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.687511 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.687588 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.687704 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.687790 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.687863 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.687977 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.688052 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.688165 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.688246 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.688325 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.688440 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.688515 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.688627 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.688702 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.688841 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.external = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.688925 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.688998 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.689124 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.external = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.689247 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.689325 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.689439 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.689515 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.689628 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.password = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.689711 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.689784 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.token = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.689859 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.password = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.689931 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.690016 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.token = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.690094 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.690173 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.690245 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.690314 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.690384 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.690454 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.690524 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.690601 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.690674 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.690745 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.690815 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.691158 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.691235 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.691364 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.691449 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.691652 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.692051 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.692127 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.692198 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.692279 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.692352 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.692423 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.692493 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.692562 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.692682 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.692767 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.692840 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.692911 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.692988 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.693060 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.693130 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.693209 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.693281 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.693351 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.693422 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.693496 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.693675 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.693763 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.693919 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.693998 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.694171 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.694252 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.694414 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.694501 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.694655 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.694734 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.694910 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.695003 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.695169 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.695258 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.695416 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.695494 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.695650 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.695728 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.695876 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.695962 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.696125 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.696204 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.696363 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.696441 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.696601 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.696680 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.696838 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.696914 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.697086 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.697163 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.697325 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.697403 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.697562 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.697639 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.697796 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.697872 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.698045 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.698126 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.698282 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.698359 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.698514 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.698592 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.698751 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.698834 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.699004 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.699087 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.699240 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.699317 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.699479 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.699560 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.699727 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.699805 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.699959 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.700036 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.700194 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.700274 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.700422 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.700499 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.700654 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.700732 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.700902 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.700980 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.701144 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.701221 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.701390 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.701469 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.701636 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.701714 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.701876 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.701953 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.702137 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.702221 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.702375 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.702453 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.702606 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.702683 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.702835 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.702911 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.703098 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.703218 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.703333 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.703446 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.703559 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.703674 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.703797 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.703913 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.704027 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.704141 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.704299 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.704414 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.704536 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.704652 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.704767 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.704880 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.704994 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.705107 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.705229 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.705379 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.705493 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.705606 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.705720 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.705834 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.705955 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.706071 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.706184 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.706297 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.706441 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.706555 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.706677 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.706794 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.706908 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.707127 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.707300 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.707496 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.707602 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.707698 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.707813 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.707927 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.708047 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.708171 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.708287 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.708401 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.708514 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.708628 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.708741 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.708863 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.708978 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.709091 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.709205 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.709319 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.709438 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.709561 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.709676 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.709790 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.709908 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.710022 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.710135 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.710260 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.710383 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.710499 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.710612 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.710726 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.710839 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.710979 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.711097 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.711217 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.711333 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.711446 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.711559 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.711680 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.711795 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.711908 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.712023 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.712136 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.712250 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.712372 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.712487 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.712600 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.712713 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.712827 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.712939 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.713062 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.713176 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.713289 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.713403 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.713515 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.713628 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.713750 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.713865 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.713979 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.714093 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.714206 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.714319 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.714445 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.714561 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.714675 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.714788 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.714902 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.715040 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.715170 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.715286 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.715400 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.715513 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.715627 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.715740 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.715862 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.715977 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.716096 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.716210 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.716324 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.716437 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.716558 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.716680 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.716795 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.716909 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.717022 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.717141 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.717264 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.717380 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.717493 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.717606 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.717720 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.717839 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.717962 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.718077 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.718197 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.718313 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.718427 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.718547 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.718670 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.718785 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.718899 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.719083 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.719196 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.719310 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.719437 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.719556 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.719556 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.719770 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.719890 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.720004 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.720126 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.720242 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.720355 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.720470 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.720583 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.720696 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.720883 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.721000 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.721114 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] role.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.721228 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] role.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.721341 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] role.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.721455 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] role.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.721577 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.721693 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.721807 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.721920 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.722035 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.722157 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.722274 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.722388 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.722503 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.723131 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.723375 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.723848 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.723969 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.724083 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.724197 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.724312 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.724426 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.724548 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.724666 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.724780 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.724894 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.725008 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.725122 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.725244 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.725361 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.725475 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.725589 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.725703 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.725817 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.725939 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.726055 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.726169 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.726282 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.726397 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.726511 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.726633 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.726751 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.726864 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.727029 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.727144 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.727259 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.727386 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.727504 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.727618 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.727733 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.727846 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.727968 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.728083 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.728204 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.728320 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.728434 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.728548 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.728670 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.728787 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.728901 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.729015 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.729129 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.729242 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.729364 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.729479 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.729593 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.729706 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.729854 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.729967 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.730092 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.730210 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.730325 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] token.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.730438 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] token.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.730551 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.730665 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.730786 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.730903 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.731038 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.731152 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.731265 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.731379 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.731504 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.731621 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.731735 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.731849 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.731964 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.732077 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.732199 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.732315 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.732429 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.732542 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.732656 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.732769 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.732891 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.733008 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.733121 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.733235 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.733349 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.733462 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.733585 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.733701 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.733815 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.733938 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.734067 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.734191 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.734307 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.734421 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.734536 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.connection = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.734658 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.connection = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.734775 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.734775 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.735004 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.735120 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.735234 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.735361 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.735478 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.735592 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.735706 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.735820 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.735933 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.736055 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.736180 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.736296 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.736410 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.736524 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.736638 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.736760 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.736876 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.736990 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.737104 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.737219 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.737333 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.737456 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.737572 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.737687 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.737800 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.737914 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.738027 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.738149 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.738330 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.738943 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.739073 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.739190 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.739307 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.739436 n-d-master-1 devstack@keystone.service[81805]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:44:34.739554 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:44:34.739554 n-d-master-1 devstack@keystone.service[81804]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:44:34.766790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.767032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.767141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.767263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.767347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.767484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.776258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.776440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.805560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.805729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.805816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.805961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.859579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.859740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.908576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.908808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.909157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:34.909394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.064380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.064616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.064838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.064928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.065060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.065156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.065283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.065367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.065495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.065577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.065712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.065931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.088837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.089070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.089166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.089300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.089392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.089525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.089608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.089744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.089825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.089960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.090044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.090176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.090257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.090406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.101440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.101675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.115138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.115246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.115323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.115396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.115539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.115623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.115768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.115849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.115988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.116081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.116206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.116287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.116421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.116502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:44:35.133780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.133988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.134073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 16 00:44:35.134201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 16 00:44:35.134329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.134535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 16 00:44:35.134630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.134736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 16 00:44:35.134817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.135049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.135132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.135316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.135398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.135579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.135660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.135843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.145215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.145496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.145580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.145771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.145854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.146059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.146159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.146394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.153025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.153344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.156190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.156481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.156564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.156769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.156849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.157049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.157128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.157332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.157413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.157599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.157681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.157860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.157949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.158133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.158213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.158403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.158482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.158672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.158753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.158968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.159122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.159250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.182560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.182965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.184053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.184343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.184426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.184703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.189001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.189292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.189374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.189580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.189662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.189875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.195908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.196202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.196283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.196535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.201803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.202106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.202189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.202399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.202481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.202690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.202780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.202998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.203082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.203280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.203361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.203553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.203636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.203825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.203948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.204097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.219278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.219562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.220027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.220310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.224087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.224623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.227304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.227607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.227811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.228113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.231747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.232247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.234795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.235320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.237988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.238404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.238521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.238824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.238904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.239140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.239223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.239423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.239505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.239705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.239794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.239992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.256184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.256474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.256560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.256749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.256832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.257021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.257109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.257352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.263871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.264182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.265428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.265745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.266990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.267274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.267356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.267558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.270179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.270375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.270460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.270662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.270745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.270983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.271080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.271280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.271431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.271669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.282779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.283002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.283088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.283292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.283374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.283580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.283674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.283873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.284002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.284262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.284343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.284564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.284648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.284849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.300380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.300746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.303959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.304189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.306847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.307087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.308404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.308590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.309869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.310044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.310197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.310330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.310545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.310729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.317076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.317224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.318538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.318678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.321458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.321588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.321859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.321987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.322153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.322277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.322437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.322557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.330194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.330305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.330491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.330589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.330781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.330870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.337687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.337786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:44:35.337978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.338123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.338260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.338342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.338547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.338627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.338819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.338901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.339120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.339212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.339395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.339490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.339684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.339773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.339954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.340045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.340230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.340313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.340509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.340591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.340771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.340854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.341036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.341117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.341329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.341410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:44:35.375970 n-d-master-1 devstack@keystone.service[81805]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b8fcb6a9c0 pid: 81805 (default app) Oct 16 00:44:35.376372 n-d-master-1 devstack@keystone.service[81804]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b8fcb6a9c0 pid: 81804 (default app) Oct 16 00:44:35.379201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caae19a-531b-4ec3-99a6-6cc6809c6601 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:35.379570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caae19a-531b-4ec3-99a6-6cc6809c6601 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:35.379848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caae19a-531b-4ec3-99a6-6cc6809c6601 None None] PATH_INFO: `/v3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:35.383981 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Sun Oct 16 00:44:35 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:42.236841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53b8d4-701a-4346-9e9f-e429ab490895 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:42.237358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53b8d4-701a-4346-9e9f-e429ab490895 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:42.237358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53b8d4-701a-4346-9e9f-e429ab490895 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:42.241920 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:44:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:42.247185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a7cd5-c87b-43f8-a9d4-1d23e3232d54 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:42.247641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a7cd5-c87b-43f8-a9d4-1d23e3232d54 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:42.247779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a7cd5-c87b-43f8-a9d4-1d23e3232d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:42.318731 n-d-master-1 devstack@keystone.service[81805]: INFO dbcounter [None req-343a7cd5-c87b-43f8-a9d4-1d23e3232d54 None None] Registered counter for database keystone Oct 16 00:44:42.337740 n-d-master-1 devstack@keystone.service[81805]: DEBUG oslo_db.sqlalchemy.engines [None req-343a7cd5-c87b-43f8-a9d4-1d23e3232d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:44:42.344251 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writer thread running {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:44:42.522323 n-d-master-1 devstack@keystone.service[81805]: DEBUG passlib.handlers.bcrypt [None req-343a7cd5-c87b-43f8-a9d4-1d23e3232d54 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81805) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 16 00:44:42.522632 n-d-master-1 devstack@keystone.service[81805]: DEBUG passlib.handlers.bcrypt [None req-343a7cd5-c87b-43f8-a9d4-1d23e3232d54 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81805) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 16 00:44:42.581053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-343a7cd5-c87b-43f8-a9d4-1d23e3232d54 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:42.582736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-343a7cd5-c87b-43f8-a9d4-1d23e3232d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:42.708438 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:44:43.173503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53b8d4-701a-4346-9e9f-e429ab490895 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:43.243221 n-d-master-1 devstack@keystone.service[81804]: INFO dbcounter [None req-8d53b8d4-701a-4346-9e9f-e429ab490895 None None] Registered counter for database keystone Oct 16 00:44:43.264555 n-d-master-1 devstack@keystone.service[81804]: DEBUG oslo_db.sqlalchemy.engines [None req-8d53b8d4-701a-4346-9e9f-e429ab490895 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:44:43.270841 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writer thread running {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:44:43.389383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53b8d4-701a-4346-9e9f-e429ab490895 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:43.393616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948af51f-4b82-462f-aee7-7871ec1b869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:43.394258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948af51f-4b82-462f-aee7-7871ec1b869c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:43.394538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948af51f-4b82-462f-aee7-7871ec1b869c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:43.394895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948af51f-4b82-462f-aee7-7871ec1b869c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:43.403046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948af51f-4b82-462f-aee7-7871ec1b869c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:43.454666 n-d-master-1 devstack@keystone.service[81804]: WARNING keystone.common.rbac_enforcer.enforcer [None req-948af51f-4b82-462f-aee7-7871ec1b869c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 16 00:44:43.454971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948af51f-4b82-462f-aee7-7871ec1b869c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:43.464254 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Sun Oct 16 00:44:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:44:43.470267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a7cd5-c87b-43f8-a9d4-1d23e3232d54 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:43.487314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a7cd5-c87b-43f8-a9d4-1d23e3232d54 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:43.492387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd43685-671a-439b-9bc1-6397290f0c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:43.493472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd43685-671a-439b-9bc1-6397290f0c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:43.493751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd43685-671a-439b-9bc1-6397290f0c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:43.494021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd43685-671a-439b-9bc1-6397290f0c05 admin admin] PATH_INFO: `/v3/projects/660cf62d7ad1499c81cc23908b4bdde4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:43.495625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd43685-671a-439b-9bc1-6397290f0c05 admin admin] RBAC: Authorizing `identity:get_project(project_id=660cf62d7ad1499c81cc23908b4bdde4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:43.547909 n-d-master-1 devstack@keystone.service[81805]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2fd43685-671a-439b-9bc1-6397290f0c05 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 16 00:44:43.548259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd43685-671a-439b-9bc1-6397290f0c05 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:43.553389 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Sun Oct 16 00:44:43 2022] GET /identity/v3/projects/660cf62d7ad1499c81cc23908b4bdde4 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:45.706305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddacb1-678f-4027-a6a0-b66b9ad57b34 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:45.706906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddacb1-678f-4027-a6a0-b66b9ad57b34 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:45.707081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddacb1-678f-4027-a6a0-b66b9ad57b34 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:45.711176 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:44:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:45.716649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66117349-f5b7-4b59-8721-4db186d2a679 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:45.717060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66117349-f5b7-4b59-8721-4db186d2a679 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:45.717206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66117349-f5b7-4b59-8721-4db186d2a679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:45.737279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-66117349-f5b7-4b59-8721-4db186d2a679 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:45.739421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-66117349-f5b7-4b59-8721-4db186d2a679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:45.747242 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:44:46.017685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddacb1-678f-4027-a6a0-b66b9ad57b34 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:46.030378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddacb1-678f-4027-a6a0-b66b9ad57b34 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:46.034504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929dc23-5595-4a36-8caa-20f3b642c070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:46.035178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929dc23-5595-4a36-8caa-20f3b642c070 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:46.035455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929dc23-5595-4a36-8caa-20f3b642c070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:46.035727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929dc23-5595-4a36-8caa-20f3b642c070 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:46.043201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929dc23-5595-4a36-8caa-20f3b642c070 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:46.044965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929dc23-5595-4a36-8caa-20f3b642c070 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:46.054187 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Sun Oct 16 00:44:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 00:44:46.059643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66117349-f5b7-4b59-8721-4db186d2a679 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:46.069589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66117349-f5b7-4b59-8721-4db186d2a679 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:46.073834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917d989-b807-4684-bba2-599937b5980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:46.074446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917d989-b807-4684-bba2-599937b5980a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:46.074723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917d989-b807-4684-bba2-599937b5980a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:46.075028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917d989-b807-4684-bba2-599937b5980a admin admin] PATH_INFO: `/v3/users/1fe17027043247a5ba6d4296eb07bb32` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:46.076320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917d989-b807-4684-bba2-599937b5980a admin admin] RBAC: Authorizing `identity:get_user(user_id=1fe17027043247a5ba6d4296eb07bb32)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:46.078155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917d989-b807-4684-bba2-599937b5980a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:46.079681 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Sun Oct 16 00:44:46 2022] GET /identity/v3/users/1fe17027043247a5ba6d4296eb07bb32 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:48.252322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032380-fd61-44cf-b553-d8f0e201e7cb None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.252869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032380-fd61-44cf-b553-d8f0e201e7cb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.252869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032380-fd61-44cf-b553-d8f0e201e7cb None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.254455 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:48.259538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79a2f3-a3cc-40d5-998a-bb5f01f67ca2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.259964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79a2f3-a3cc-40d5-998a-bb5f01f67ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.260088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79a2f3-a3cc-40d5-998a-bb5f01f67ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.278724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-df79a2f3-a3cc-40d5-998a-bb5f01f67ca2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:48.280215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-df79a2f3-a3cc-40d5-998a-bb5f01f67ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:48.322055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b91296-fd65-4f6c-961b-247e16a9e8b7 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.322336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b91296-fd65-4f6c-961b-247e16a9e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.322611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b91296-fd65-4f6c-961b-247e16a9e8b7 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.323948 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:48.328932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037185e-2395-4346-af16-1a93eaa27267 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.329213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037185e-2395-4346-af16-1a93eaa27267 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.329486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037185e-2395-4346-af16-1a93eaa27267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.366964 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:48.372456 n-d-master-1 devstack@keystone.service[81804]: DEBUG passlib.handlers.bcrypt [None req-6037185e-2395-4346-af16-1a93eaa27267 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81804) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 16 00:44:48.372863 n-d-master-1 devstack@keystone.service[81804]: DEBUG passlib.handlers.bcrypt [None req-6037185e-2395-4346-af16-1a93eaa27267 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81804) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 16 00:44:48.422290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6037185e-2395-4346-af16-1a93eaa27267 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:48.423908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6037185e-2395-4346-af16-1a93eaa27267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:48.520891 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:44:48.631291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79a2f3-a3cc-40d5-998a-bb5f01f67ca2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.656695 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:48.736997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79a2f3-a3cc-40d5-998a-bb5f01f67ca2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:48.771099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa838fc-bd49-491d-92cc-c36092be03cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.771653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa838fc-bd49-491d-92cc-c36092be03cb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.771934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa838fc-bd49-491d-92cc-c36092be03cb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.772209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa838fc-bd49-491d-92cc-c36092be03cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.783507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa838fc-bd49-491d-92cc-c36092be03cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:48.786218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037185e-2395-4346-af16-1a93eaa27267 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-6aa838fc-bd49-491d-92cc-c36092be03cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:48.792507 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:48.793471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:48.794324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:48.794324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:48.794324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:48.794324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:48.794324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:48.794324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:48.794324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:48.794324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:48.794324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:48.794324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:48.794324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:48.794324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:44:48.794324 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:48.801010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa838fc-bd49-491d-92cc-c36092be03cb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.882848 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:48.886353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037185e-2395-4346-af16-1a93eaa27267 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:48.888661 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:48.902746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa838fc-bd49-491d-92cc-c36092be03cb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:48.925614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e227fc3-81d4-4b71-81a1-9c5c0bf12424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.926565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e227fc3-81d4-4b71-81a1-9c5c0bf12424 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.926849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e227fc3-81d4-4b71-81a1-9c5c0bf12424 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.927154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e227fc3-81d4-4b71-81a1-9c5c0bf12424 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.928121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e227fc3-81d4-4b71-81a1-9c5c0bf12424 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:48.929558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e227fc3-81d4-4b71-81a1-9c5c0bf12424 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:48.935639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892c0c4-9d88-41af-9d42-2f81d7a95e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.936598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892c0c4-9d88-41af-9d42-2f81d7a95e16 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.936878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892c0c4-9d88-41af-9d42-2f81d7a95e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.937147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892c0c4-9d88-41af-9d42-2f81d7a95e16 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.937805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892c0c4-9d88-41af-9d42-2f81d7a95e16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:48.938104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892c0c4-9d88-41af-9d42-2f81d7a95e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:48.939645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892c0c4-9d88-41af-9d42-2f81d7a95e16 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:48.941633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.sql.core [None req-0e227fc3-81d4-4b71-81a1-9c5c0bf12424 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:44:48.941633 n-d-master-1 devstack@keystone.service[81804]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:44:48.941633 n-d-master-1 devstack@keystone.service[81804]: [parameters: {'id': '536adf26a7a2475895b2504397c3fc7a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 00:44:48.941633 n-d-master-1 devstack@keystone.service[81804]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81804) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:44:48.951970 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:48.957777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892c0c4-9d88-41af-9d42-2f81d7a95e16 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-0e227fc3-81d4-4b71-81a1-9c5c0bf12424 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:44:48.960708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application result.read() Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 16 00:44:48.961496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application yield resource Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise self.value Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application session.commit() Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:44:48.962403 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:44:48.963316 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:44:48.964243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application result.read() Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:44:48.964988 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [parameters: {'id': '536adf26a7a2475895b2504397c3fc7a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 16 00:44:48.965782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:48.966493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 8/16] 10.222.0.39 () {60 vars in 1137 bytes} [Sun Oct 16 00:44:48 2022] POST /identity/v3/domains => generated 190 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:48.967738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e227fc3-81d4-4b71-81a1-9c5c0bf12424 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:49.059341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892c0c4-9d88-41af-9d42-2f81d7a95e16 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:49.068266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e227fc3-81d4-4b71-81a1-9c5c0bf12424 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:49.093294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44f5aa-48d1-44fc-9175-e648264b3dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:49.094216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44f5aa-48d1-44fc-9175-e648264b3dca None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.094496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44f5aa-48d1-44fc-9175-e648264b3dca None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.094763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44f5aa-48d1-44fc-9175-e648264b3dca None admin] PATH_INFO: `/v3/users/1fe17027043247a5ba6d4296eb07bb32` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.095936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44f5aa-48d1-44fc-9175-e648264b3dca None admin] RBAC: Authorizing `identity:get_user(user_id=1fe17027043247a5ba6d4296eb07bb32)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:49.097911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44f5aa-48d1-44fc-9175-e648264b3dca None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:49.099669 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/users/1fe17027043247a5ba6d4296eb07bb32 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:49.101721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12552f1-c9df-4c64-b0d0-8a4441a06dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:49.102648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12552f1-c9df-4c64-b0d0-8a4441a06dba None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.103031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12552f1-c9df-4c64-b0d0-8a4441a06dba None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.103371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12552f1-c9df-4c64-b0d0-8a4441a06dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.104843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44f5aa-48d1-44fc-9175-e648264b3dca None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:49.119008 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:49.123288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12552f1-c9df-4c64-b0d0-8a4441a06dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:49.124798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12552f1-c9df-4c64-b0d0-8a4441a06dba None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e12552f1-c9df-4c64-b0d0-8a4441a06dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:49.140578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:49.141435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:49.142442 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:49.142442 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:49.142442 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:44:49.142442 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:49.147860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12552f1-c9df-4c64-b0d0-8a4441a06dba None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:49.169990 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:49.204275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44f5aa-48d1-44fc-9175-e648264b3dca None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:49.238272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5436d4-e9dc-46f6-82c2-556efce48979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:49.238904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5436d4-e9dc-46f6-82c2-556efce48979 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.239206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5436d4-e9dc-46f6-82c2-556efce48979 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.239478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5436d4-e9dc-46f6-82c2-556efce48979 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.240603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5436d4-e9dc-46f6-82c2-556efce48979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:49.242049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5436d4-e9dc-46f6-82c2-556efce48979 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:49.243615 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:49.248731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12552f1-c9df-4c64-b0d0-8a4441a06dba None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:49.249288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5436d4-e9dc-46f6-82c2-556efce48979 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:49.285584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddd77d-378d-40d9-bd8d-17b16d2d7ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:49.286103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddd77d-378d-40d9-bd8d-17b16d2d7ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.286175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddd77d-378d-40d9-bd8d-17b16d2d7ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.286445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddd77d-378d-40d9-bd8d-17b16d2d7ae6 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.287107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddd77d-378d-40d9-bd8d-17b16d2d7ae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:49.287407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddd77d-378d-40d9-bd8d-17b16d2d7ae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:49.288781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddd77d-378d-40d9-bd8d-17b16d2d7ae6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:49.305853 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:49.333124 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:49.354834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5436d4-e9dc-46f6-82c2-556efce48979 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:49.392196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31836c09-80c0-429e-80ac-46f1bee962c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:49.392873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836c09-80c0-429e-80ac-46f1bee962c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.393156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836c09-80c0-429e-80ac-46f1bee962c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.393436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836c09-80c0-429e-80ac-46f1bee962c6 None admin] PATH_INFO: `/v3/domains/default/users/1fe17027043247a5ba6d4296eb07bb32/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.395829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31836c09-80c0-429e-80ac-46f1bee962c6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1fe17027043247a5ba6d4296eb07bb32, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:49.397333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31836c09-80c0-429e-80ac-46f1bee962c6 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:49.513035 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 11/21] 10.222.0.39 () {58 vars in 1361 bytes} [Sun Oct 16 00:44:49 2022] PUT /identity/v3/domains/default/users/1fe17027043247a5ba6d4296eb07bb32/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:44:51.879584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba09cd-edbd-4665-b565-fd14b12426b0 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.880062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba09cd-edbd-4665-b565-fd14b12426b0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.880062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba09cd-edbd-4665-b565-fd14b12426b0 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.881677 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:51.887272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084e18b-0e94-4361-aec2-d264903f2a89 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.887672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084e18b-0e94-4361-aec2-d264903f2a89 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.887838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084e18b-0e94-4361-aec2-d264903f2a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.912006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7084e18b-0e94-4361-aec2-d264903f2a89 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:51.913508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7084e18b-0e94-4361-aec2-d264903f2a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:51.931867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9389f2b-cc39-427c-9605-598645275e1a None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.932144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9389f2b-cc39-427c-9605-598645275e1a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.932407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9389f2b-cc39-427c-9605-598645275e1a None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.933710 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 12/23] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:51.938749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326f8ff-e132-41ce-9920-43e62808b9f0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.939406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326f8ff-e132-41ce-9920-43e62808b9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.939679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326f8ff-e132-41ce-9920-43e62808b9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.972205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4326f8ff-e132-41ce-9920-43e62808b9f0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:51.973490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4326f8ff-e132-41ce-9920-43e62808b9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:52.003117 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 12/24] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:52.083673 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 13/25] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:44:52.267647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c90e4-6f8b-49b0-8b08-6dac8a528eb1 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:52.268253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c90e4-6f8b-49b0-8b08-6dac8a528eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:52.268727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c90e4-6f8b-49b0-8b08-6dac8a528eb1 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:52.273212 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 13/26] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:44:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:52.278572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460093a-b640-40e2-80f2-7de4e737e2ba None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:52.279398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460093a-b640-40e2-80f2-7de4e737e2ba None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:52.279885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460093a-b640-40e2-80f2-7de4e737e2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:52.307961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e460093a-b640-40e2-80f2-7de4e737e2ba None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:52.309491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e460093a-b640-40e2-80f2-7de4e737e2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:52.313402 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:52.395308 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 14/27] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:52.517877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c90e4-6f8b-49b0-8b08-6dac8a528eb1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:52.551641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460093a-b640-40e2-80f2-7de4e737e2ba None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:52.660892 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:52.728759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c90e4-6f8b-49b0-8b08-6dac8a528eb1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:52.755034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460093a-b640-40e2-80f2-7de4e737e2ba None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:52.782631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdb1e1-ff27-4144-948b-f4fb50c56e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:52.783260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdb1e1-ff27-4144-948b-f4fb50c56e83 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:52.785054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdb1e1-ff27-4144-948b-f4fb50c56e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:52.785054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdb1e1-ff27-4144-948b-f4fb50c56e83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:52.815948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdb1e1-ff27-4144-948b-f4fb50c56e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:52.817558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207b94f-d2fc-4b3c-a3e8-42934c08688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:52.818405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207b94f-d2fc-4b3c-a3e8-42934c08688d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:52.818892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207b94f-d2fc-4b3c-a3e8-42934c08688d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:52.819484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207b94f-d2fc-4b3c-a3e8-42934c08688d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-05fdb1e1-ff27-4144-948b-f4fb50c56e83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:52.829766 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:52.830614 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:52.831940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:52.831940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:52.831940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:52.831940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:52.831940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:52.831940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:52.831940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:52.831940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:52.831940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:52.831940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:52.831940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:52.831940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:44:52.834408 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 14/28] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:52.841040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdb1e1-ff27-4144-948b-f4fb50c56e83 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:52.846594 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:52.853258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207b94f-d2fc-4b3c-a3e8-42934c08688d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:52.855164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207b94f-d2fc-4b3c-a3e8-42934c08688d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-6207b94f-d2fc-4b3c-a3e8-42934c08688d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:52.871196 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:52.872128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:52.872909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:52.872909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:52.872909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:44:52.874753 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 15/29] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:52.875797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207b94f-d2fc-4b3c-a3e8-42934c08688d None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:52.959363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdb1e1-ff27-4144-948b-f4fb50c56e83 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:52.990539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207b94f-d2fc-4b3c-a3e8-42934c08688d None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:52.991465 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:52.997349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef49c0-1ad8-496c-8aac-7d4f2758e70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:52.998001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef49c0-1ad8-496c-8aac-7d4f2758e70c None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:52.998672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef49c0-1ad8-496c-8aac-7d4f2758e70c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:52.999479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef49c0-1ad8-496c-8aac-7d4f2758e70c None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.000589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef49c0-1ad8-496c-8aac-7d4f2758e70c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:53.002781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef49c0-1ad8-496c-8aac-7d4f2758e70c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:53.023107 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 15/30] 10.222.0.39 () {60 vars in 1131 bytes} [Sun Oct 16 00:44:52 2022] POST /identity/v3/roles => generated 219 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:53.025251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1a3b0-16bf-4a02-9362-81228ae1a1d6 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.025671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1a3b0-16bf-4a02-9362-81228ae1a1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.026051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1a3b0-16bf-4a02-9362-81228ae1a1d6 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.031010 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 16/31] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:44:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:53.032231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1a3b0-16bf-4a02-9362-81228ae1a1d6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:53.048445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe5f12-8baa-4db7-8619-9c379e1ad34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:53.049290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe5f12-8baa-4db7-8619-9c379e1ad34a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.049703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe5f12-8baa-4db7-8619-9c379e1ad34a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.050771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe5f12-8baa-4db7-8619-9c379e1ad34a None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.051657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe5f12-8baa-4db7-8619-9c379e1ad34a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:53.054954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe5f12-8baa-4db7-8619-9c379e1ad34a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:53.054954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe5f12-8baa-4db7-8619-9c379e1ad34a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:53.072221 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 16/32] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:53.073649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e002-a1cc-44b7-9d64-c07a84213c4b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.074101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e002-a1cc-44b7-9d64-c07a84213c4b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.074643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e002-a1cc-44b7-9d64-c07a84213c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.097454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4ad0e002-a1cc-44b7-9d64-c07a84213c4b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:53.099022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4ad0e002-a1cc-44b7-9d64-c07a84213c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:53.181035 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:53.216763 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 17/33] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:53.217951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e002-a1cc-44b7-9d64-c07a84213c4b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:53.260207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1a3b0-16bf-4a02-9362-81228ae1a1d6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:53.327780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093529d-a693-442f-b25f-3d6f15fda14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:53.328745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093529d-a693-442f-b25f-3d6f15fda14b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.329242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093529d-a693-442f-b25f-3d6f15fda14b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.329719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093529d-a693-442f-b25f-3d6f15fda14b None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.330661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093529d-a693-442f-b25f-3d6f15fda14b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:53.331299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093529d-a693-442f-b25f-3d6f15fda14b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:53.333005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093529d-a693-442f-b25f-3d6f15fda14b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:53.355374 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 17/34] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:53.361363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093529d-a693-442f-b25f-3d6f15fda14b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:53.433370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e002-a1cc-44b7-9d64-c07a84213c4b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:53.447650 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:53.506859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea112749-9c3e-4132-b43a-79a43fe91bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:53.508051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea112749-9c3e-4132-b43a-79a43fe91bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.508330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea112749-9c3e-4132-b43a-79a43fe91bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.508604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea112749-9c3e-4132-b43a-79a43fe91bf0 None admin] PATH_INFO: `/v3/users/1fe17027043247a5ba6d4296eb07bb32` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.510154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea112749-9c3e-4132-b43a-79a43fe91bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=1fe17027043247a5ba6d4296eb07bb32)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:53.511833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea112749-9c3e-4132-b43a-79a43fe91bf0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:53.514941 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 18/35] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:44:53 2022] GET /identity/v3/users/1fe17027043247a5ba6d4296eb07bb32 => generated 247 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:53.515060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f70b-01c6-4fd1-a2ef-6195f0e3bd2b None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.515293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f70b-01c6-4fd1-a2ef-6195f0e3bd2b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.515564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f70b-01c6-4fd1-a2ef-6195f0e3bd2b None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.517981 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:53.524876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003f70b-01c6-4fd1-a2ef-6195f0e3bd2b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:53.533945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093529d-a693-442f-b25f-3d6f15fda14b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:53.585695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b969311-f590-4669-87a8-1230b46bd16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:53.586662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b969311-f590-4669-87a8-1230b46bd16b None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.587169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b969311-f590-4669-87a8-1230b46bd16b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.587655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b969311-f590-4669-87a8-1230b46bd16b None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.588461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b969311-f590-4669-87a8-1230b46bd16b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:53.590282 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:53.591023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b969311-f590-4669-87a8-1230b46bd16b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:53.631426 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:44:53 2022] POST /identity/v3/projects => generated 301 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:53.633012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be9f4e-cbe3-4997-88f3-b0bbf4b4a396 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.633329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be9f4e-cbe3-4997-88f3-b0bbf4b4a396 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.633605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be9f4e-cbe3-4997-88f3-b0bbf4b4a396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.649811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003f70b-01c6-4fd1-a2ef-6195f0e3bd2b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:53.697820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08050bce-28d4-466b-9da5-f82f04a819da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:53.698908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08050bce-28d4-466b-9da5-f82f04a819da None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.699564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08050bce-28d4-466b-9da5-f82f04a819da None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.700041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08050bce-28d4-466b-9da5-f82f04a819da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.701601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08050bce-28d4-466b-9da5-f82f04a819da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:53.703357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08050bce-28d4-466b-9da5-f82f04a819da None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:53.705747 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:53.707681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08050bce-28d4-466b-9da5-f82f04a819da None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:53.775142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-70be9f4e-cbe3-4997-88f3-b0bbf4b4a396 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:53.776409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-70be9f4e-cbe3-4997-88f3-b0bbf4b4a396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:53.836850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08050bce-28d4-466b-9da5-f82f04a819da None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:53.857010 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 19/39] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:53.858315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be9f4e-cbe3-4997-88f3-b0bbf4b4a396 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:53.864479 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:53.877766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b44894-b7c9-4366-a715-47810fd88657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:53.879622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b44894-b7c9-4366-a715-47810fd88657 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:53.879928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b44894-b7c9-4366-a715-47810fd88657 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:53.880202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b44894-b7c9-4366-a715-47810fd88657 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:53.883142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b44894-b7c9-4366-a715-47810fd88657 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:53.883142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b44894-b7c9-4366-a715-47810fd88657 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:53.901040 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:53.981797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be9f4e-cbe3-4997-88f3-b0bbf4b4a396 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:54.010998 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1131 bytes} [Sun Oct 16 00:44:53 2022] POST /identity/v3/roles => generated 225 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:54.010998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6be92-5917-4c3a-9ffe-2325e1d99952 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.010998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6be92-5917-4c3a-9ffe-2325e1d99952 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.010998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6be92-5917-4c3a-9ffe-2325e1d99952 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.011680 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 22/41] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:54.017611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffaab3-812a-43a5-9697-b00772a3cbc5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.017897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffaab3-812a-43a5-9697-b00772a3cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.018179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffaab3-812a-43a5-9697-b00772a3cbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.025376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea9cfc-8ab0-4360-9304-989b20238101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:54.026379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea9cfc-8ab0-4360-9304-989b20238101 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.026832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea9cfc-8ab0-4360-9304-989b20238101 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.027310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea9cfc-8ab0-4360-9304-989b20238101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.028242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea9cfc-8ab0-4360-9304-989b20238101 None admin] RBAC: Adding query filter params (role.id=3b2c8c93a1c54611871c4299008b2abf, scope.domain.id=default, user.id=1fe17027043247a5ba6d4296eb07bb32) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:54.028748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea9cfc-8ab0-4360-9304-989b20238101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:54.030782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea9cfc-8ab0-4360-9304-989b20238101 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:54.039602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-94ffaab3-812a-43a5-9697-b00772a3cbc5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:54.040485 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 20/42] 10.222.0.39 () {56 vars in 1322 bytes} [Sun Oct 16 00:44:53 2022] GET /identity/v3/role_assignments?user.id=1fe17027043247a5ba6d4296eb07bb32&scope.domain.id=default&role.id=3b2c8c93a1c54611871c4299008b2abf => generated 530 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:54.041371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-94ffaab3-812a-43a5-9697-b00772a3cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:54.122830 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 23/43] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:44:54.135405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea9cfc-8ab0-4360-9304-989b20238101 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:54.255020 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:54.261888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea9cfc-8ab0-4360-9304-989b20238101 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:54.297798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c848e-cc29-478b-9fd1-c0ab926403dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:54.298406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c848e-cc29-478b-9fd1-c0ab926403dd None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.298729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c848e-cc29-478b-9fd1-c0ab926403dd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.299031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c848e-cc29-478b-9fd1-c0ab926403dd None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.299702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c848e-cc29-478b-9fd1-c0ab926403dd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:54.301643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c848e-cc29-478b-9fd1-c0ab926403dd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:54.318460 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 21/44] 10.222.0.39 () {60 vars in 1131 bytes} [Sun Oct 16 00:44:54 2022] POST /identity/v3/roles => generated 223 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:54.404657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffaab3-812a-43a5-9697-b00772a3cbc5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:54.507520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffaab3-812a-43a5-9697-b00772a3cbc5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:54.518231 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:54.543530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0646946-2a32-4aad-9bfd-17e41f4ae1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:54.544166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646946-2a32-4aad-9bfd-17e41f4ae1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.544449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646946-2a32-4aad-9bfd-17e41f4ae1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.544721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646946-2a32-4aad-9bfd-17e41f4ae1e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.545842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0646946-2a32-4aad-9bfd-17e41f4ae1e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:54.547451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0646946-2a32-4aad-9bfd-17e41f4ae1e1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:54.549016 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 24/45] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:54.555192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c848e-cc29-478b-9fd1-c0ab926403dd None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:54.655197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c848e-cc29-478b-9fd1-c0ab926403dd None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:54.687921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd319b0-d297-4394-924c-0ee9bd2e55a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:54.688515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd319b0-d297-4394-924c-0ee9bd2e55a2 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.688794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd319b0-d297-4394-924c-0ee9bd2e55a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.689063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd319b0-d297-4394-924c-0ee9bd2e55a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.689706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd319b0-d297-4394-924c-0ee9bd2e55a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:54.692163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd319b0-d297-4394-924c-0ee9bd2e55a2 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:54.717829 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 22/46] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:44:54 2022] POST /identity/v3/projects => generated 312 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:56.861633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df13fe1-c856-4fed-b448-3f1fb432bbbc None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.862118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df13fe1-c856-4fed-b448-3f1fb432bbbc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.862118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df13fe1-c856-4fed-b448-3f1fb432bbbc None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.863501 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 25/47] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:56.868857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b4d11-0340-4c2d-ae7e-0a234cae8841 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.869227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b4d11-0340-4c2d-ae7e-0a234cae8841 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.869407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b4d11-0340-4c2d-ae7e-0a234cae8841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.887929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-956b4d11-0340-4c2d-ae7e-0a234cae8841 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:56.889109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-956b4d11-0340-4c2d-ae7e-0a234cae8841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:56.891025 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:56.955617 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 23/48] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:44:57.228293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df13fe1-c856-4fed-b448-3f1fb432bbbc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:57.327310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df13fe1-c856-4fed-b448-3f1fb432bbbc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:57.358935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3633a8-0c2e-4692-9647-9d635c5defd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:57.359558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3633a8-0c2e-4692-9647-9d635c5defd3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:57.359834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3633a8-0c2e-4692-9647-9d635c5defd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:57.360101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3633a8-0c2e-4692-9647-9d635c5defd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:57.361180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3633a8-0c2e-4692-9647-9d635c5defd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:57.363335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3633a8-0c2e-4692-9647-9d635c5defd3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:57.364911 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 26/49] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:57.370502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b4d11-0340-4c2d-ae7e-0a234cae8841 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:57.465895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b4d11-0340-4c2d-ae7e-0a234cae8841 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:57.498463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992312ee-4c65-42da-88f8-35e4be5ca0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:57.499027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992312ee-4c65-42da-88f8-35e4be5ca0b8 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:57.499311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992312ee-4c65-42da-88f8-35e4be5ca0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:57.499584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992312ee-4c65-42da-88f8-35e4be5ca0b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:57.500222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992312ee-4c65-42da-88f8-35e4be5ca0b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:57.501658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992312ee-4c65-42da-88f8-35e4be5ca0b8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:57.511220 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:57.527785 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 24/50] 10.222.0.39 () {60 vars in 1140 bytes} [Sun Oct 16 00:44:57 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:59.696697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ac89a-852d-40f2-ad1b-9cab28cc254b None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:59.697224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ac89a-852d-40f2-ad1b-9cab28cc254b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:59.697224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ac89a-852d-40f2-ad1b-9cab28cc254b None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:59.698570 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 27/51] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:59.703677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4e42b-9a21-4c19-9ae5-3bf0a93d6be1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:59.704064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4e42b-9a21-4c19-9ae5-3bf0a93d6be1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:59.704233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4e42b-9a21-4c19-9ae5-3bf0a93d6be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:59.722953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1ee4e42b-9a21-4c19-9ae5-3bf0a93d6be1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:59.724126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1ee4e42b-9a21-4c19-9ae5-3bf0a93d6be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:59.787708 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 25/52] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:00.061567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ac89a-852d-40f2-ad1b-9cab28cc254b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:00.107868 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:00.160842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ac89a-852d-40f2-ad1b-9cab28cc254b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:00.194420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4de1b-d618-4d5c-b3ab-22ab176ac6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:00.195059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4de1b-d618-4d5c-b3ab-22ab176ac6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:00.195338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4de1b-d618-4d5c-b3ab-22ab176ac6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:00.195608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4de1b-d618-4d5c-b3ab-22ab176ac6e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:00.196694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4de1b-d618-4d5c-b3ab-22ab176ac6e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:00.198120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4de1b-d618-4d5c-b3ab-22ab176ac6e4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:00.199682 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 28/53] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:00.205119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4e42b-9a21-4c19-9ae5-3bf0a93d6be1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:00.299247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4e42b-9a21-4c19-9ae5-3bf0a93d6be1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:00.319234 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:00.333371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987e799-f3de-487b-b9c9-483ba5aa09bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:00.333975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987e799-f3de-487b-b9c9-483ba5aa09bc None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:00.334256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987e799-f3de-487b-b9c9-483ba5aa09bc None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:00.334527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987e799-f3de-487b-b9c9-483ba5aa09bc None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:00.335203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987e799-f3de-487b-b9c9-483ba5aa09bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:00.336647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987e799-f3de-487b-b9c9-483ba5aa09bc None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:00.362013 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 26/54] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:00 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:03.668419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aa8a3-b02c-4bdd-b9a4-77dc7d7e310a None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.668934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aa8a3-b02c-4bdd-b9a4-77dc7d7e310a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.669007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aa8a3-b02c-4bdd-b9a4-77dc7d7e310a None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.670385 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 29/55] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:03.683852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db9cec-c5ef-4cdc-ac8e-b69d46e86280 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.684825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db9cec-c5ef-4cdc-ac8e-b69d46e86280 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.685296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db9cec-c5ef-4cdc-ac8e-b69d46e86280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.715925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-69db9cec-c5ef-4cdc-ac8e-b69d46e86280 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:03.717449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-69db9cec-c5ef-4cdc-ac8e-b69d46e86280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:03.812310 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 27/56] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:03.832271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cc4ce-badb-4d38-a378-9e68d2d2565c None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.832907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cc4ce-badb-4d38-a378-9e68d2d2565c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.833383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cc4ce-badb-4d38-a378-9e68d2d2565c None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.834951 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 30/57] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:03.840315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169be6b7-8b63-4804-852e-e46b19ffba38 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.840604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169be6b7-8b63-4804-852e-e46b19ffba38 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.840934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169be6b7-8b63-4804-852e-e46b19ffba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.867233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-169be6b7-8b63-4804-852e-e46b19ffba38 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:03.868447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-169be6b7-8b63-4804-852e-e46b19ffba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:03.910948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62dbd5-c554-4c2d-b1c1-b8aa67548409 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.911572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62dbd5-c554-4c2d-b1c1-b8aa67548409 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.912122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62dbd5-c554-4c2d-b1c1-b8aa67548409 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.913653 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 31/58] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:03.918642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a8275-3b6c-4920-8d00-7ba72017c46e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.919449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a8275-3b6c-4920-8d00-7ba72017c46e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.919929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a8275-3b6c-4920-8d00-7ba72017c46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.941059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0c8a8275-3b6c-4920-8d00-7ba72017c46e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:03.942621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0c8a8275-3b6c-4920-8d00-7ba72017c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:03.984871 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 28/59] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:45:04.016119 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 32/60] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:45:04.111378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169be6b7-8b63-4804-852e-e46b19ffba38 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:04.156763 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:04.276243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169be6b7-8b63-4804-852e-e46b19ffba38 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:04.349935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a8275-3b6c-4920-8d00-7ba72017c46e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:04.351103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0998fa5-9ee0-4600-a8e7-111d0d564062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:04.351769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998fa5-9ee0-4600-a8e7-111d0d564062 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.352071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998fa5-9ee0-4600-a8e7-111d0d564062 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.352341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998fa5-9ee0-4600-a8e7-111d0d564062 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.371666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0998fa5-9ee0-4600-a8e7-111d0d564062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c0998fa5-9ee0-4600-a8e7-111d0d564062 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:04.378960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:04.379814 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:04.380570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:04.380570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:04.380570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:04.380570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:04.380570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:04.380570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:04.380570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:04.380570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:04.380570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:04.380570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:04.380570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:04.380570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:04.383356 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 29/61] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:04.385561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d16ada-62ed-4225-861f-d727fec84162 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.386068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d16ada-62ed-4225-861f-d727fec84162 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.386543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d16ada-62ed-4225-861f-d727fec84162 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.388267 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 30/62] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:04.389247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d16ada-62ed-4225-861f-d727fec84162 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:04.425067 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:04.491687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a8275-3b6c-4920-8d00-7ba72017c46e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:04.503326 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:04.510525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d16ada-62ed-4225-861f-d727fec84162 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:04.537108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee05b2-e1c6-41a1-a3c2-3c5c9858006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:04.537744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee05b2-e1c6-41a1-a3c2-3c5c9858006b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.539034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee05b2-e1c6-41a1-a3c2-3c5c9858006b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.539328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee05b2-e1c6-41a1-a3c2-3c5c9858006b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.548187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24c8e1-5b28-4457-b8fe-e06398a918ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:04.548809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24c8e1-5b28-4457-b8fe-e06398a918ad None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.549091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24c8e1-5b28-4457-b8fe-e06398a918ad None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.549365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24c8e1-5b28-4457-b8fe-e06398a918ad None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.550410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24c8e1-5b28-4457-b8fe-e06398a918ad None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:04.550720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24c8e1-5b28-4457-b8fe-e06398a918ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:04.552241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24c8e1-5b28-4457-b8fe-e06398a918ad None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:04.553832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee05b2-e1c6-41a1-a3c2-3c5c9858006b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:04.561675 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 31/63] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:04.563753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b16f3-91a8-4f8a-8df0-584df5d5fb48 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.564243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b16f3-91a8-4f8a-8df0-584df5d5fb48 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.565067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b16f3-91a8-4f8a-8df0-584df5d5fb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.587092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-314b16f3-91a8-4f8a-8df0-584df5d5fb48 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:04.588327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-314b16f3-91a8-4f8a-8df0-584df5d5fb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-51ee05b2-e1c6-41a1-a3c2-3c5c9858006b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:04.665435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:04.666424 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 33/64] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:45:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:04.667810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a76d4-dce9-44d9-a07d-a8749f3fe8d8 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.669001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a76d4-dce9-44d9-a07d-a8749f3fe8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.669001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a76d4-dce9-44d9-a07d-a8749f3fe8d8 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.669635 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 34/65] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:04.671111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a76d4-dce9-44d9-a07d-a8749f3fe8d8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:04.690006 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 32/66] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:04.691422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b16f3-91a8-4f8a-8df0-584df5d5fb48 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:04.789137 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:04.800059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a76d4-dce9-44d9-a07d-a8749f3fe8d8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:04.803714 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:04.804588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b16f3-91a8-4f8a-8df0-584df5d5fb48 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:04.844214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2b7d1-faf8-4670-ae10-1d8e5fb698b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:04.844412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdab4c-472f-43fd-b5e7-c079164b3caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:04.844850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdab4c-472f-43fd-b5e7-c079164b3caa None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.844949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2b7d1-faf8-4670-ae10-1d8e5fb698b0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.845124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2b7d1-faf8-4670-ae10-1d8e5fb698b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.845215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdab4c-472f-43fd-b5e7-c079164b3caa None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.845393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdab4c-472f-43fd-b5e7-c079164b3caa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.845483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2b7d1-faf8-4670-ae10-1d8e5fb698b0 None admin] PATH_INFO: `/v3/users/364bdc673dbe40e4a5943306e9aa4cc5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.859079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdab4c-472f-43fd-b5e7-c079164b3caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:04.859963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2b7d1-faf8-4670-ae10-1d8e5fb698b0 None admin] RBAC: Authorizing `identity:get_user(user_id=364bdc673dbe40e4a5943306e9aa4cc5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:04.862583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2b7d1-faf8-4670-ae10-1d8e5fb698b0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:04.864483 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 33/67] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:04 2022] GET /identity/v3/users/364bdc673dbe40e4a5943306e9aa4cc5 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-97bdab4c-472f-43fd-b5e7-c079164b3caa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:04.864768 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:04.871063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:04.871814 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:04.871814 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:04.871814 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:04.871814 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:04.871814 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:04.871814 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:04.871814 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:04.871814 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:04.871814 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:04.871814 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:04.871814 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:04.871814 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:04.872407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2b7d1-faf8-4670-ae10-1d8e5fb698b0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:04.872481 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 35/68] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:04.872811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db47edf-9ff7-4cbd-8f75-85965e545ee6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.873100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db47edf-9ff7-4cbd-8f75-85965e545ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.873373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db47edf-9ff7-4cbd-8f75-85965e545ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.891635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4db47edf-9ff7-4cbd-8f75-85965e545ee6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:04.892836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4db47edf-9ff7-4cbd-8f75-85965e545ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:04.970631 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 36/69] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:04.971514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db47edf-9ff7-4cbd-8f75-85965e545ee6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.005355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2b7d1-faf8-4670-ae10-1d8e5fb698b0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.045094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9e9e7-cf4a-402a-8128-20d53e080dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.045709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9e9e7-cf4a-402a-8128-20d53e080dca None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.045994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9e9e7-cf4a-402a-8128-20d53e080dca None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.046266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9e9e7-cf4a-402a-8128-20d53e080dca None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.046946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9e9e7-cf4a-402a-8128-20d53e080dca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:05.047262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9e9e7-cf4a-402a-8128-20d53e080dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.048630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9e9e7-cf4a-402a-8128-20d53e080dca None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.057949 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 34/70] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:05.063913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9e9e7-cf4a-402a-8128-20d53e080dca None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.077113 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:05.078977 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:05.091810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db47edf-9ff7-4cbd-8f75-85965e545ee6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.132057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7338b7-4fa4-42b2-aaa4-a3e671cb6f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.133013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7338b7-4fa4-42b2-aaa4-a3e671cb6f34 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.133604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7338b7-4fa4-42b2-aaa4-a3e671cb6f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.133888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7338b7-4fa4-42b2-aaa4-a3e671cb6f34 None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.135107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7338b7-4fa4-42b2-aaa4-a3e671cb6f34 None admin] RBAC: Authorizing `identity:get_project(project_id=c1774c4e131e4cd592c124840e1bacb5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.137229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7338b7-4fa4-42b2-aaa4-a3e671cb6f34 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.138957 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 37/71] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:04 2022] GET /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:05.144024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7338b7-4fa4-42b2-aaa4-a3e671cb6f34 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.175850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9e9e7-cf4a-402a-8128-20d53e080dca None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.212959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d16dfc-fe67-413f-983a-dbb6001cbed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.213565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d16dfc-fe67-413f-983a-dbb6001cbed6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.213847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d16dfc-fe67-413f-983a-dbb6001cbed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.214121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d16dfc-fe67-413f-983a-dbb6001cbed6 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.214774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d16dfc-fe67-413f-983a-dbb6001cbed6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:05.215108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d16dfc-fe67-413f-983a-dbb6001cbed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.216471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d16dfc-fe67-413f-983a-dbb6001cbed6 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.224675 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 35/72] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:05.228699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d16dfc-fe67-413f-983a-dbb6001cbed6 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.252242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7338b7-4fa4-42b2-aaa4-a3e671cb6f34 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.294003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01be4c-5fe3-4179-b5be-de9714cac7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.294633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01be4c-5fe3-4179-b5be-de9714cac7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.294942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01be4c-5fe3-4179-b5be-de9714cac7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.295216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01be4c-5fe3-4179-b5be-de9714cac7c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.305359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01be4c-5fe3-4179-b5be-de9714cac7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:05.306940 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-0a01be4c-5fe3-4179-b5be-de9714cac7c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:05.310593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:05.311651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 38/73] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:05.312492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01be4c-5fe3-4179-b5be-de9714cac7c7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.339197 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:05.344015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d16dfc-fe67-413f-983a-dbb6001cbed6 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.376618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882498c0-838d-4468-aeb5-ccb55a518b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.377256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882498c0-838d-4468-aeb5-ccb55a518b12 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.377521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882498c0-838d-4468-aeb5-ccb55a518b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.378328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882498c0-838d-4468-aeb5-ccb55a518b12 None admin] PATH_INFO: `/v3/users/1fe17027043247a5ba6d4296eb07bb32` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.379553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882498c0-838d-4468-aeb5-ccb55a518b12 None admin] RBAC: Authorizing `identity:get_user(user_id=1fe17027043247a5ba6d4296eb07bb32)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.380988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882498c0-838d-4468-aeb5-ccb55a518b12 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.382538 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 36/74] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:05 2022] GET /identity/v3/users/1fe17027043247a5ba6d4296eb07bb32 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:05.387834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882498c0-838d-4468-aeb5-ccb55a518b12 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.415010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01be4c-5fe3-4179-b5be-de9714cac7c7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.449783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a62b1-7354-4e73-8d6d-d6ee950812be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.450444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a62b1-7354-4e73-8d6d-d6ee950812be None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.450736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a62b1-7354-4e73-8d6d-d6ee950812be None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.451037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a62b1-7354-4e73-8d6d-d6ee950812be None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5/users/364bdc673dbe40e4a5943306e9aa4cc5/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.452983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a62b1-7354-4e73-8d6d-d6ee950812be None admin] RBAC: Authorizing `identity:create_grant(project_id=c1774c4e131e4cd592c124840e1bacb5, user_id=364bdc673dbe40e4a5943306e9aa4cc5, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.454440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a62b1-7354-4e73-8d6d-d6ee950812be None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.469877 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 39/75] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:05 2022] PUT /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5/users/364bdc673dbe40e4a5943306e9aa4cc5/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:05.479216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a62b1-7354-4e73-8d6d-d6ee950812be None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.492396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882498c0-838d-4468-aeb5-ccb55a518b12 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.533219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083aec0-1221-485b-818e-8d054de1cd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.535125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083aec0-1221-485b-818e-8d054de1cd79 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.535440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083aec0-1221-485b-818e-8d054de1cd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.535722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083aec0-1221-485b-818e-8d054de1cd79 None admin] PATH_INFO: `/v3/users/364bdc673dbe40e4a5943306e9aa4cc5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.536997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083aec0-1221-485b-818e-8d054de1cd79 None admin] RBAC: Authorizing `identity:get_user(user_id=364bdc673dbe40e4a5943306e9aa4cc5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.538502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083aec0-1221-485b-818e-8d054de1cd79 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.544959 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 37/76] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:05 2022] GET /identity/v3/users/364bdc673dbe40e4a5943306e9aa4cc5 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:05.544959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083aec0-1221-485b-818e-8d054de1cd79 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.553056 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:05.591691 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:05.616441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a62b1-7354-4e73-8d6d-d6ee950812be None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.657954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f8abf-a31f-4ee2-8887-44bc052faea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.658738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8abf-a31f-4ee2-8887-44bc052faea3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.659290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8abf-a31f-4ee2-8887-44bc052faea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.659820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8abf-a31f-4ee2-8887-44bc052faea3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.660910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f8abf-a31f-4ee2-8887-44bc052faea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.662366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f8abf-a31f-4ee2-8887-44bc052faea3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.664140 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 40/77] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:05.664741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f8abf-a31f-4ee2-8887-44bc052faea3 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.665572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083aec0-1221-485b-818e-8d054de1cd79 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.702314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b053fc8-4fd3-4783-b07a-a49300cff096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.703280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b053fc8-4fd3-4783-b07a-a49300cff096 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.703566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b053fc8-4fd3-4783-b07a-a49300cff096 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.704704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b053fc8-4fd3-4783-b07a-a49300cff096 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.705369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b053fc8-4fd3-4783-b07a-a49300cff096 None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:05.706228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b053fc8-4fd3-4783-b07a-a49300cff096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.707758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b053fc8-4fd3-4783-b07a-a49300cff096 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.716312 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 38/78] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:05.719852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b053fc8-4fd3-4783-b07a-a49300cff096 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.778398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f8abf-a31f-4ee2-8887-44bc052faea3 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.791970 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:05.816116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bca28-7c20-44b7-a9da-73e11fb4de4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.816734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bca28-7c20-44b7-a9da-73e11fb4de4a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.817014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bca28-7c20-44b7-a9da-73e11fb4de4a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.817293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bca28-7c20-44b7-a9da-73e11fb4de4a None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.818427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bca28-7c20-44b7-a9da-73e11fb4de4a None admin] RBAC: Authorizing `identity:get_project(project_id=c1774c4e131e4cd592c124840e1bacb5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.819901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bca28-7c20-44b7-a9da-73e11fb4de4a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.821684 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 41/79] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:05 2022] GET /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:05.824395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bca28-7c20-44b7-a9da-73e11fb4de4a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.831542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b053fc8-4fd3-4783-b07a-a49300cff096 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.850851 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:05.870864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef28184-09bb-4487-8111-dc7ac5cbbf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.871536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef28184-09bb-4487-8111-dc7ac5cbbf5e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.871811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef28184-09bb-4487-8111-dc7ac5cbbf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.872078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef28184-09bb-4487-8111-dc7ac5cbbf5e None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.873581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef28184-09bb-4487-8111-dc7ac5cbbf5e None admin] RBAC: Authorizing `identity:get_project(project_id=c1774c4e131e4cd592c124840e1bacb5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.875417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef28184-09bb-4487-8111-dc7ac5cbbf5e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:05.877522 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 39/80] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:05 2022] GET /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:05.878951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef28184-09bb-4487-8111-dc7ac5cbbf5e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:05.943971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bca28-7c20-44b7-a9da-73e11fb4de4a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.985708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca47176-1743-45f9-a054-3d8e525dd470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:05.986283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef28184-09bb-4487-8111-dc7ac5cbbf5e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:05.986388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca47176-1743-45f9-a054-3d8e525dd470 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:05.986580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca47176-1743-45f9-a054-3d8e525dd470 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:05.986846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca47176-1743-45f9-a054-3d8e525dd470 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:05.988371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca47176-1743-45f9-a054-3d8e525dd470 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:05.989822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca47176-1743-45f9-a054-3d8e525dd470 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:06.019736 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 42/81] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:05 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:06.020470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca47176-1743-45f9-a054-3d8e525dd470 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:06.032223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cb8b0-798a-4b66-ad13-b6dff46395b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:06.033227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cb8b0-798a-4b66-ad13-b6dff46395b8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:06.033762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cb8b0-798a-4b66-ad13-b6dff46395b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:06.034994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cb8b0-798a-4b66-ad13-b6dff46395b8 None admin] PATH_INFO: `/v3/users/364bdc673dbe40e4a5943306e9aa4cc5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:06.036523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cb8b0-798a-4b66-ad13-b6dff46395b8 None admin] RBAC: Authorizing `identity:get_user(user_id=364bdc673dbe40e4a5943306e9aa4cc5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:06.038389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cb8b0-798a-4b66-ad13-b6dff46395b8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:06.040367 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 40/82] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:05 2022] GET /identity/v3/users/364bdc673dbe40e4a5943306e9aa4cc5 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:06.046289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cb8b0-798a-4b66-ad13-b6dff46395b8 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:06.061364 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:06.119352 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:06.151608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca47176-1743-45f9-a054-3d8e525dd470 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:06.193561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fac8ab-6e0e-4a6f-82f1-d1dea03d8b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:06.194213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fac8ab-6e0e-4a6f-82f1-d1dea03d8b56 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:06.194554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fac8ab-6e0e-4a6f-82f1-d1dea03d8b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:06.194841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fac8ab-6e0e-4a6f-82f1-d1dea03d8b56 None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5/users/1fe17027043247a5ba6d4296eb07bb32/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:06.197012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fac8ab-6e0e-4a6f-82f1-d1dea03d8b56 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1774c4e131e4cd592c124840e1bacb5, user_id=1fe17027043247a5ba6d4296eb07bb32, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:06.198488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fac8ab-6e0e-4a6f-82f1-d1dea03d8b56 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:06.209662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cb8b0-798a-4b66-ad13-b6dff46395b8 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:06.217769 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 43/83] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:06 2022] PUT /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5/users/1fe17027043247a5ba6d4296eb07bb32/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:06.218764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fac8ab-6e0e-4a6f-82f1-d1dea03d8b56 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:06.262228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefb463-7f7f-4565-9681-ecbd1e050a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:06.263632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefb463-7f7f-4565-9681-ecbd1e050a1e None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:06.264383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefb463-7f7f-4565-9681-ecbd1e050a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:06.265344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefb463-7f7f-4565-9681-ecbd1e050a1e None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5/users/364bdc673dbe40e4a5943306e9aa4cc5/roles/2ff561b5b0d24a468ca2bfa7d0788bd2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:06.268773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefb463-7f7f-4565-9681-ecbd1e050a1e None admin] RBAC: Authorizing `identity:create_grant(project_id=c1774c4e131e4cd592c124840e1bacb5, user_id=364bdc673dbe40e4a5943306e9aa4cc5, role_id=2ff561b5b0d24a468ca2bfa7d0788bd2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:06.272535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefb463-7f7f-4565-9681-ecbd1e050a1e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:06.292987 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 41/84] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:06 2022] PUT /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5/users/364bdc673dbe40e4a5943306e9aa4cc5/roles/2ff561b5b0d24a468ca2bfa7d0788bd2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:06.365594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fac8ab-6e0e-4a6f-82f1-d1dea03d8b56 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:06.411207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550da3ec-f47a-4218-aafc-2716b4f30626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:06.411873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550da3ec-f47a-4218-aafc-2716b4f30626 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:06.412219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550da3ec-f47a-4218-aafc-2716b4f30626 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:06.412500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550da3ec-f47a-4218-aafc-2716b4f30626 None admin] PATH_INFO: `/v3/projects/43a48dad561c4e15b76d9a00649452e2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:06.413756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550da3ec-f47a-4218-aafc-2716b4f30626 None admin] RBAC: Authorizing `identity:get_project(project_id=43a48dad561c4e15b76d9a00649452e2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:06.415536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550da3ec-f47a-4218-aafc-2716b4f30626 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:06.417690 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 44/85] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:06 2022] GET /identity/v3/projects/43a48dad561c4e15b76d9a00649452e2 => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:06.423434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefb463-7f7f-4565-9681-ecbd1e050a1e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:06.513273 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:06.560687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefb463-7f7f-4565-9681-ecbd1e050a1e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:06.599032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc26e7d-638e-4ade-ae9b-e7249315b8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:06.599704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc26e7d-638e-4ade-ae9b-e7249315b8ae None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:06.599984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc26e7d-638e-4ade-ae9b-e7249315b8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:06.600317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc26e7d-638e-4ade-ae9b-e7249315b8ae None admin] PATH_INFO: `/v3/projects/43a48dad561c4e15b76d9a00649452e2/users/364bdc673dbe40e4a5943306e9aa4cc5/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:06.602309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc26e7d-638e-4ade-ae9b-e7249315b8ae None admin] RBAC: Authorizing `identity:create_grant(project_id=43a48dad561c4e15b76d9a00649452e2, user_id=364bdc673dbe40e4a5943306e9aa4cc5, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:06.603832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc26e7d-638e-4ade-ae9b-e7249315b8ae None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:06.620280 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 42/86] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:06 2022] PUT /identity/v3/projects/43a48dad561c4e15b76d9a00649452e2/users/364bdc673dbe40e4a5943306e9aa4cc5/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:08.016534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562d5a4-66ce-4649-9752-47bd8cce4363 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.017504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562d5a4-66ce-4649-9752-47bd8cce4363 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.017983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562d5a4-66ce-4649-9752-47bd8cce4363 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.019800 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 45/87] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:08.025673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227845-2958-4001-a4f1-745a9a246815 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.026630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227845-2958-4001-a4f1-745a9a246815 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.027144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227845-2958-4001-a4f1-745a9a246815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.053108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-78227845-2958-4001-a4f1-745a9a246815 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:08.054354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-78227845-2958-4001-a4f1-745a9a246815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:08.141204 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 43/88] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:08.671406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562d5a4-66ce-4649-9752-47bd8cce4363 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:08.675484 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:08.808871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562d5a4-66ce-4649-9752-47bd8cce4363 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:08.855705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164bc8a-4180-4e63-9079-e150d5dfc9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:08.856261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164bc8a-4180-4e63-9079-e150d5dfc9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.856546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164bc8a-4180-4e63-9079-e150d5dfc9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.856827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164bc8a-4180-4e63-9079-e150d5dfc9e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.871777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164bc8a-4180-4e63-9079-e150d5dfc9e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-8164bc8a-4180-4e63-9079-e150d5dfc9e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:08.877013 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:08.878499 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:08.879298 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:08.879298 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:08.879298 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:08.879298 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:08.879298 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:08.879298 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:08.879298 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:08.879298 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:08.879298 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:08.879298 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:08.879298 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:08.879298 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:08.879298 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 46/89] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:08.884686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227845-2958-4001-a4f1-745a9a246815 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:08.937965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192a7a7-db5f-47e3-9b41-83e087444ed9 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.938575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192a7a7-db5f-47e3-9b41-83e087444ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.939112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192a7a7-db5f-47e3-9b41-83e087444ed9 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.941294 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 47/90] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:08.952213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa6836-163e-495a-98fa-b73bf6c804d0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:08.952754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa6836-163e-495a-98fa-b73bf6c804d0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:08.953232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa6836-163e-495a-98fa-b73bf6c804d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:08.999525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9daa6836-163e-495a-98fa-b73bf6c804d0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:09.000732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9daa6836-163e-495a-98fa-b73bf6c804d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:09.059550 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:09.121639 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:09.148722 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 48/91] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:09.170682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227845-2958-4001-a4f1-745a9a246815 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:09.220700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da05f2-b4ef-4ff4-bddc-cd8eaa4411e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:09.221830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da05f2-b4ef-4ff4-bddc-cd8eaa4411e9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.222111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da05f2-b4ef-4ff4-bddc-cd8eaa4411e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.222564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da05f2-b4ef-4ff4-bddc-cd8eaa4411e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.223260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da05f2-b4ef-4ff4-bddc-cd8eaa4411e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:09.223562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da05f2-b4ef-4ff4-bddc-cd8eaa4411e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:09.224934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da05f2-b4ef-4ff4-bddc-cd8eaa4411e9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:09.237993 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 44/92] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:09.243668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa6836-163e-495a-98fa-b73bf6c804d0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.371151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa6836-163e-495a-98fa-b73bf6c804d0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:09.418547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21ee06-c884-4e49-b311-793ea213f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:09.419571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21ee06-c884-4e49-b311-793ea213f97e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.420051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21ee06-c884-4e49-b311-793ea213f97e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.420541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21ee06-c884-4e49-b311-793ea213f97e None admin] PATH_INFO: `/v3/users/364bdc673dbe40e4a5943306e9aa4cc5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.423606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21ee06-c884-4e49-b311-793ea213f97e None admin] RBAC: Authorizing `identity:get_user(user_id=364bdc673dbe40e4a5943306e9aa4cc5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:09.425624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21ee06-c884-4e49-b311-793ea213f97e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:09.427484 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 49/93] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:09 2022] GET /identity/v3/users/364bdc673dbe40e4a5943306e9aa4cc5 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:09.436096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da05f2-b4ef-4ff4-bddc-cd8eaa4411e9 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.578733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21ee06-c884-4e49-b311-793ea213f97e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.605918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da05f2-b4ef-4ff4-bddc-cd8eaa4411e9 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:09.638274 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:09.663962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621b57a-98db-4b4c-b775-64a0d094d391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:09.664574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621b57a-98db-4b4c-b775-64a0d094d391 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.664853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621b57a-98db-4b4c-b775-64a0d094d391 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.665128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621b57a-98db-4b4c-b775-64a0d094d391 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.685037 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:09.736088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621b57a-98db-4b4c-b775-64a0d094d391 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:09.738217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621b57a-98db-4b4c-b775-64a0d094d391 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:09.739329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21ee06-c884-4e49-b311-793ea213f97e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:09.780748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2f5ce-4091-4bf5-82c5-98b021540b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:09.781607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2f5ce-4091-4bf5-82c5-98b021540b72 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.782020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2f5ce-4091-4bf5-82c5-98b021540b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.782424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2f5ce-4091-4bf5-82c5-98b021540b72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.794091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2f5ce-4091-4bf5-82c5-98b021540b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-52f2f5ce-4091-4bf5-82c5-98b021540b72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:09.799365 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:09.800856 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:09.801759 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:09.801759 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:09.801759 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:09.801759 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:09.801759 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:09.801759 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:09.801759 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:09.801759 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:09.801759 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:09.801759 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:09.801759 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:09.801759 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:09.804068 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 50/94] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:09.806237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433784a-39af-43b3-ac85-c00214dbe2c9 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.806738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433784a-39af-43b3-ac85-c00214dbe2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.807239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433784a-39af-43b3-ac85-c00214dbe2c9 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.809384 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 51/95] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:09.810675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9b8d0-1b94-4726-9f95-71686cb47604 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.811175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9b8d0-1b94-4726-9f95-71686cb47604 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.811651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9b8d0-1b94-4726-9f95-71686cb47604 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.813231 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 52/96] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:09.814097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9b8d0-1b94-4726-9f95-71686cb47604 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.861705 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 45/97] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:45:09.861705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45571e1b-0182-4ffe-be06-e3e7ce331606 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.861705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45571e1b-0182-4ffe-be06-e3e7ce331606 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.861705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45571e1b-0182-4ffe-be06-e3e7ce331606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.883398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-45571e1b-0182-4ffe-be06-e3e7ce331606 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:09.884679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-45571e1b-0182-4ffe-be06-e3e7ce331606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:09.899336 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:09.929671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9b8d0-1b94-4726-9f95-71686cb47604 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:09.954331 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:09.969699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e58b8-4882-4d6f-bee3-0259e2a2f521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:09.969927 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 46/98] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:09.970779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e58b8-4882-4d6f-bee3-0259e2a2f521 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.971259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e58b8-4882-4d6f-bee3-0259e2a2f521 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.971507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc68bf-4734-4dd0-8d0c-ec681c588b84 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:09.972219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e58b8-4882-4d6f-bee3-0259e2a2f521 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.972333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc68bf-4734-4dd0-8d0c-ec681c588b84 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:09.972333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc68bf-4734-4dd0-8d0c-ec681c588b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:09.972639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e58b8-4882-4d6f-bee3-0259e2a2f521 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:09.973046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e58b8-4882-4d6f-bee3-0259e2a2f521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:09.974873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e58b8-4882-4d6f-bee3-0259e2a2f521 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:09.984553 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 53/99] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:09.990671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e58b8-4882-4d6f-bee3-0259e2a2f521 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:09.992484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3cfc68bf-4734-4dd0-8d0c-ec681c588b84 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:09.993684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3cfc68bf-4734-4dd0-8d0c-ec681c588b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:10.104473 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 47/100] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:10.105354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc68bf-4734-4dd0-8d0c-ec681c588b84 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:10.167749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e58b8-4882-4d6f-bee3-0259e2a2f521 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.219696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b5e58-efa9-4376-b83c-76e4f2162b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.220552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b5e58-efa9-4376-b83c-76e4f2162b7f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.220969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b5e58-efa9-4376-b83c-76e4f2162b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.221554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b5e58-efa9-4376-b83c-76e4f2162b7f None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.222182 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:10.223457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b5e58-efa9-4376-b83c-76e4f2162b7f None admin] RBAC: Authorizing `identity:get_project(project_id=c1774c4e131e4cd592c124840e1bacb5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:10.225115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b5e58-efa9-4376-b83c-76e4f2162b7f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:10.227243 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 54/101] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:09 2022] GET /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:10.228784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec29cc-0a26-4bb1-be17-094f35134fbd None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.229212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec29cc-0a26-4bb1-be17-094f35134fbd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.229625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec29cc-0a26-4bb1-be17-094f35134fbd None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.231271 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 55/102] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:10.232665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3a823-15b3-499d-96cc-90a4f36d1585 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.233088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3a823-15b3-499d-96cc-90a4f36d1585 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.233521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3a823-15b3-499d-96cc-90a4f36d1585 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.234841 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 56/103] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:10.240294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3a823-15b3-499d-96cc-90a4f36d1585 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:10.256292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc68bf-4734-4dd0-8d0c-ec681c588b84 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.295161 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:10.298844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcb5d5-2201-4cfe-a851-266a3f2a902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.299899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb5d5-2201-4cfe-a851-266a3f2a902f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.300692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb5d5-2201-4cfe-a851-266a3f2a902f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.301109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb5d5-2201-4cfe-a851-266a3f2a902f None admin] PATH_INFO: `/v3/users/364bdc673dbe40e4a5943306e9aa4cc5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.303115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcb5d5-2201-4cfe-a851-266a3f2a902f None admin] RBAC: Authorizing `identity:get_user(user_id=364bdc673dbe40e4a5943306e9aa4cc5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:10.304763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcb5d5-2201-4cfe-a851-266a3f2a902f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:10.306707 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 48/104] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/users/364bdc673dbe40e4a5943306e9aa4cc5 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:10.307971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df728-b82a-4deb-bb6a-6301d98d0a09 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.308252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df728-b82a-4deb-bb6a-6301d98d0a09 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.308527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df728-b82a-4deb-bb6a-6301d98d0a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.328293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-530df728-b82a-4deb-bb6a-6301d98d0a09 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:10.329609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-530df728-b82a-4deb-bb6a-6301d98d0a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:10.354323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3a823-15b3-499d-96cc-90a4f36d1585 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.390068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b587c83-b4cd-466a-aca2-e03661731784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.390678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b587c83-b4cd-466a-aca2-e03661731784 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.390982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b587c83-b4cd-466a-aca2-e03661731784 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.391259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b587c83-b4cd-466a-aca2-e03661731784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.391985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b587c83-b4cd-466a-aca2-e03661731784 None admin] RBAC: Adding query filter params (role.id=b432183c244e40e0be2fdb9f5c438e77, scope.project.id=c1774c4e131e4cd592c124840e1bacb5, user.id=364bdc673dbe40e4a5943306e9aa4cc5) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:10.392293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b587c83-b4cd-466a-aca2-e03661731784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:10.393753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b587c83-b4cd-466a-aca2-e03661731784 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:10.410945 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 57/105] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/role_assignments?user.id=364bdc673dbe40e4a5943306e9aa4cc5&scope.project.id=c1774c4e131e4cd592c124840e1bacb5&role.id=b432183c244e40e0be2fdb9f5c438e77 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:10.410945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d052b-c49b-4277-91e7-80f0c197ab61 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.410945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d052b-c49b-4277-91e7-80f0c197ab61 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.410945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d052b-c49b-4277-91e7-80f0c197ab61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.422041 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 49/106] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:10.423126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530df728-b82a-4deb-bb6a-6301d98d0a09 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:10.426703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-869d052b-c49b-4277-91e7-80f0c197ab61 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:10.429131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-869d052b-c49b-4277-91e7-80f0c197ab61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:10.517479 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:10.522700 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 58/107] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:10.527803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d052b-c49b-4277-91e7-80f0c197ab61 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:10.580982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530df728-b82a-4deb-bb6a-6301d98d0a09 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.618555 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:10.625511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2b440-8829-434a-a444-b7f17fe0fac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.626478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2b440-8829-434a-a444-b7f17fe0fac7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.627039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2b440-8829-434a-a444-b7f17fe0fac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.628031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2b440-8829-434a-a444-b7f17fe0fac7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.644718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2b440-8829-434a-a444-b7f17fe0fac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-2ec2b440-8829-434a-a444-b7f17fe0fac7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:10.649635 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:10.650501 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:10.651299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:10.651299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:10.651299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:10.651299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:10.651299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:10.651299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:10.651299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:10.651299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:10.651299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:10.651299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:10.651299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:10.651299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:10.655142 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 50/108] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:10.656003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2b440-8829-434a-a444-b7f17fe0fac7 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:10.698617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d052b-c49b-4277-91e7-80f0c197ab61 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.743634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af5367-4be1-4a78-9a9c-54c2b15ce6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.744399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af5367-4be1-4a78-9a9c-54c2b15ce6ab None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.744602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af5367-4be1-4a78-9a9c-54c2b15ce6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.744874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af5367-4be1-4a78-9a9c-54c2b15ce6ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.790522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2b440-8829-434a-a444-b7f17fe0fac7 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.817197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af5367-4be1-4a78-9a9c-54c2b15ce6ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:10.818675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af5367-4be1-4a78-9a9c-54c2b15ce6ab None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:10.826277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d92fb6-c161-4500-a4f8-54e55ecd48b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.826922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d92fb6-c161-4500-a4f8-54e55ecd48b3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.827225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d92fb6-c161-4500-a4f8-54e55ecd48b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.827499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d92fb6-c161-4500-a4f8-54e55ecd48b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.829320 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:10.838710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d92fb6-c161-4500-a4f8-54e55ecd48b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-17d92fb6-c161-4500-a4f8-54e55ecd48b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:10.843490 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:10.844353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 51/109] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:10.847624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d92fb6-c161-4500-a4f8-54e55ecd48b3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:10.863139 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:10.917393 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 59/110] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:45:10.918231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af5367-4be1-4a78-9a9c-54c2b15ce6ab None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:10.947453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d92fb6-c161-4500-a4f8-54e55ecd48b3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:10.979913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467012d-a44d-4232-92ea-c6077adec718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:10.980553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467012d-a44d-4232-92ea-c6077adec718 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:10.980832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467012d-a44d-4232-92ea-c6077adec718 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:10.981101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467012d-a44d-4232-92ea-c6077adec718 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:10.981759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467012d-a44d-4232-92ea-c6077adec718 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:10.982065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467012d-a44d-4232-92ea-c6077adec718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:10.983475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467012d-a44d-4232-92ea-c6077adec718 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:10.991826 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 52/111] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:10.994026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467012d-a44d-4232-92ea-c6077adec718 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.015290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af5367-4be1-4a78-9a9c-54c2b15ce6ab None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.048226 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:11.049198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fac46-d846-45ad-b703-27d2002d85bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.050341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fac46-d846-45ad-b703-27d2002d85bd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.050700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fac46-d846-45ad-b703-27d2002d85bd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.051013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fac46-d846-45ad-b703-27d2002d85bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.052181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fac46-d846-45ad-b703-27d2002d85bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.053652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fac46-d846-45ad-b703-27d2002d85bd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.055289 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 60/112] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:11.056044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fac46-d846-45ad-b703-27d2002d85bd None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.070704 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:11.099321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467012d-a44d-4232-92ea-c6077adec718 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.132183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a48f08-a872-499e-9910-b72183735358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.132809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a48f08-a872-499e-9910-b72183735358 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.133091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a48f08-a872-499e-9910-b72183735358 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.133365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a48f08-a872-499e-9910-b72183735358 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.143521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a48f08-a872-499e-9910-b72183735358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-98a48f08-a872-499e-9910-b72183735358 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:11.148752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:11.149620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 53/113] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:11.151508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a48f08-a872-499e-9910-b72183735358 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.157356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fac46-d846-45ad-b703-27d2002d85bd None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.192878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc9a81-ce96-4f3b-b0b7-6c41f12f9f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.193512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc9a81-ce96-4f3b-b0b7-6c41f12f9f68 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.193732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc9a81-ce96-4f3b-b0b7-6c41f12f9f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.194000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc9a81-ce96-4f3b-b0b7-6c41f12f9f68 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.194653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc9a81-ce96-4f3b-b0b7-6c41f12f9f68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:11.194983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc9a81-ce96-4f3b-b0b7-6c41f12f9f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.196341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc9a81-ce96-4f3b-b0b7-6c41f12f9f68 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.204725 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 61/114] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:11.205493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc9a81-ce96-4f3b-b0b7-6c41f12f9f68 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.256848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a48f08-a872-499e-9910-b72183735358 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.272690 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:11.278834 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:11.291407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f282760-e332-49ea-8b1f-49c506f6c51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.292033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f282760-e332-49ea-8b1f-49c506f6c51c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.292309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f282760-e332-49ea-8b1f-49c506f6c51c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.292585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f282760-e332-49ea-8b1f-49c506f6c51c None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.293695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f282760-e332-49ea-8b1f-49c506f6c51c None admin] RBAC: Authorizing `identity:get_project(project_id=c1774c4e131e4cd592c124840e1bacb5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.295279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f282760-e332-49ea-8b1f-49c506f6c51c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.296806 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 54/115] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:11 2022] GET /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:11.301854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f282760-e332-49ea-8b1f-49c506f6c51c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.304875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc9a81-ce96-4f3b-b0b7-6c41f12f9f68 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.338136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571375a-bfe5-4381-a0de-ee67fd4da428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.338761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571375a-bfe5-4381-a0de-ee67fd4da428 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.339076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571375a-bfe5-4381-a0de-ee67fd4da428 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.339354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571375a-bfe5-4381-a0de-ee67fd4da428 None admin] PATH_INFO: `/v3/users/1fe17027043247a5ba6d4296eb07bb32` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.340747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571375a-bfe5-4381-a0de-ee67fd4da428 None admin] RBAC: Authorizing `identity:get_user(user_id=1fe17027043247a5ba6d4296eb07bb32)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.341905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571375a-bfe5-4381-a0de-ee67fd4da428 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.343660 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 62/116] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:11 2022] GET /identity/v3/users/1fe17027043247a5ba6d4296eb07bb32 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:11.348868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571375a-bfe5-4381-a0de-ee67fd4da428 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.399634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f282760-e332-49ea-8b1f-49c506f6c51c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.431793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f75519-a9e6-4a2f-9db0-3d713025a9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.432393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f75519-a9e6-4a2f-9db0-3d713025a9a7 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.432675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f75519-a9e6-4a2f-9db0-3d713025a9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.432947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f75519-a9e6-4a2f-9db0-3d713025a9a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.433600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f75519-a9e6-4a2f-9db0-3d713025a9a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.435065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f75519-a9e6-4a2f-9db0-3d713025a9a7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.445264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571375a-bfe5-4381-a0de-ee67fd4da428 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.462219 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 55/117] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:45:11 2022] POST /identity/v3/projects => generated 302 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:11.467137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f75519-a9e6-4a2f-9db0-3d713025a9a7 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.493478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e34378-be5e-4b3a-89d6-7d3f00268ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.494110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e34378-be5e-4b3a-89d6-7d3f00268ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.494396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e34378-be5e-4b3a-89d6-7d3f00268ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.494671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e34378-be5e-4b3a-89d6-7d3f00268ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.495392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e34378-be5e-4b3a-89d6-7d3f00268ec8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:11.495702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e34378-be5e-4b3a-89d6-7d3f00268ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.497133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e34378-be5e-4b3a-89d6-7d3f00268ec8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.506645 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 63/118] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:11.507865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e34378-be5e-4b3a-89d6-7d3f00268ec8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.508458 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:11.513030 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:11.589094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f75519-a9e6-4a2f-9db0-3d713025a9a7 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.627141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a5948-59ba-43a3-a09b-04ce630717ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.627774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a5948-59ba-43a3-a09b-04ce630717ee None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.628055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a5948-59ba-43a3-a09b-04ce630717ee None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.628330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a5948-59ba-43a3-a09b-04ce630717ee None admin] PATH_INFO: `/v3/users/a0249c47643841f09a888b135e0fa893` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.640501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e34378-be5e-4b3a-89d6-7d3f00268ec8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.642287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a5948-59ba-43a3-a09b-04ce630717ee None admin] RBAC: Authorizing `identity:get_user(user_id=a0249c47643841f09a888b135e0fa893)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.644576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a5948-59ba-43a3-a09b-04ce630717ee None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.646341 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 56/119] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:11 2022] GET /identity/v3/users/a0249c47643841f09a888b135e0fa893 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:11.647142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a5948-59ba-43a3-a09b-04ce630717ee None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.680409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6edb37-b33b-41d1-850c-3da86db13b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.681028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6edb37-b33b-41d1-850c-3da86db13b94 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.681370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6edb37-b33b-41d1-850c-3da86db13b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.681652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6edb37-b33b-41d1-850c-3da86db13b94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.682377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6edb37-b33b-41d1-850c-3da86db13b94 None admin] RBAC: Adding query filter params (role.id=2ff561b5b0d24a468ca2bfa7d0788bd2, scope.project.id=c1774c4e131e4cd592c124840e1bacb5, user.id=364bdc673dbe40e4a5943306e9aa4cc5) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:11.682692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6edb37-b33b-41d1-850c-3da86db13b94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.684193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6edb37-b33b-41d1-850c-3da86db13b94 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.690766 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 64/120] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:11 2022] GET /identity/v3/role_assignments?user.id=364bdc673dbe40e4a5943306e9aa4cc5&scope.project.id=c1774c4e131e4cd592c124840e1bacb5&role.id=2ff561b5b0d24a468ca2bfa7d0788bd2 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:11.695978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6edb37-b33b-41d1-850c-3da86db13b94 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.756015 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:11.763756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a5948-59ba-43a3-a09b-04ce630717ee None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.777445 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:11.817984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6edb37-b33b-41d1-850c-3da86db13b94 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:11.820406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f84b4-5531-45fb-87ad-ac0856a66bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.821045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f84b4-5531-45fb-87ad-ac0856a66bda None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.821340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f84b4-5531-45fb-87ad-ac0856a66bda None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.822631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f84b4-5531-45fb-87ad-ac0856a66bda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.875315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34658da-9879-4113-9354-10f5a6fda9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:11.876080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34658da-9879-4113-9354-10f5a6fda9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:11.876409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34658da-9879-4113-9354-10f5a6fda9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:11.876685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34658da-9879-4113-9354-10f5a6fda9f0 None admin] PATH_INFO: `/v3/users/364bdc673dbe40e4a5943306e9aa4cc5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:11.878547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34658da-9879-4113-9354-10f5a6fda9f0 None admin] RBAC: Authorizing `identity:get_user(user_id=364bdc673dbe40e4a5943306e9aa4cc5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.880234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34658da-9879-4113-9354-10f5a6fda9f0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:11.882159 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 65/121] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:11 2022] GET /identity/v3/users/364bdc673dbe40e4a5943306e9aa4cc5 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:11.883046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34658da-9879-4113-9354-10f5a6fda9f0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:11.907443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f84b4-5531-45fb-87ad-ac0856a66bda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:11.909349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f84b4-5531-45fb-87ad-ac0856a66bda None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:12.013944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34658da-9879-4113-9354-10f5a6fda9f0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:12.019309 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:12.026793 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 57/122] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:45:12.031964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f84b4-5531-45fb-87ad-ac0856a66bda None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:12.050418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494416e-1aee-4578-bcfe-d73d03b8b505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:12.051088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494416e-1aee-4578-bcfe-d73d03b8b505 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.051375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494416e-1aee-4578-bcfe-d73d03b8b505 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.051654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494416e-1aee-4578-bcfe-d73d03b8b505 None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.052785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494416e-1aee-4578-bcfe-d73d03b8b505 None admin] RBAC: Authorizing `identity:get_project(project_id=c1774c4e131e4cd592c124840e1bacb5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:12.054299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494416e-1aee-4578-bcfe-d73d03b8b505 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:12.060900 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 66/123] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:11 2022] GET /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:12.061617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494416e-1aee-4578-bcfe-d73d03b8b505 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:12.066528 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:12.135133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f84b4-5531-45fb-87ad-ac0856a66bda None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:12.169706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdb44d-842e-4178-a8c0-77f3e1b067f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:12.170320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb44d-842e-4178-a8c0-77f3e1b067f3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.170599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb44d-842e-4178-a8c0-77f3e1b067f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.170871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb44d-842e-4178-a8c0-77f3e1b067f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.171185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494416e-1aee-4578-bcfe-d73d03b8b505 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:12.212128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a5649-117f-4d07-9c60-34b4d499a9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:12.212936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5649-117f-4d07-9c60-34b4d499a9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.213218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5649-117f-4d07-9c60-34b4d499a9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.213554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5649-117f-4d07-9c60-34b4d499a9c3 None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.214801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a5649-117f-4d07-9c60-34b4d499a9c3 None admin] RBAC: Authorizing `identity:get_project(project_id=c1774c4e131e4cd592c124840e1bacb5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:12.216379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a5649-117f-4d07-9c60-34b4d499a9c3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:12.219116 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 67/124] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:12 2022] GET /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:12.219737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a5649-117f-4d07-9c60-34b4d499a9c3 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:12.240300 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:12.250314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdb44d-842e-4178-a8c0-77f3e1b067f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:12.251811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdb44d-842e-4178-a8c0-77f3e1b067f3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:12.295901 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:12.328342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a5649-117f-4d07-9c60-34b4d499a9c3 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:12.354670 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 58/125] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:45:12.359980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdb44d-842e-4178-a8c0-77f3e1b067f3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:12.364999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e375ba-87d7-4cc8-82a6-b4283d31ed10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:12.365689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e375ba-87d7-4cc8-82a6-b4283d31ed10 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.365975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e375ba-87d7-4cc8-82a6-b4283d31ed10 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.366252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e375ba-87d7-4cc8-82a6-b4283d31ed10 None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5/users/a0249c47643841f09a888b135e0fa893/roles/f4e5fecce17c4ed8bd87bf7405840365` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.368198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e375ba-87d7-4cc8-82a6-b4283d31ed10 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1774c4e131e4cd592c124840e1bacb5, user_id=a0249c47643841f09a888b135e0fa893, role_id=f4e5fecce17c4ed8bd87bf7405840365)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:12.369646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e375ba-87d7-4cc8-82a6-b4283d31ed10 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:12.395045 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 68/126] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:12 2022] PUT /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5/users/a0249c47643841f09a888b135e0fa893/roles/f4e5fecce17c4ed8bd87bf7405840365 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:12.395045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e375ba-87d7-4cc8-82a6-b4283d31ed10 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:12.502752 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:12.512504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdb44d-842e-4178-a8c0-77f3e1b067f3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:12.534303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e375ba-87d7-4cc8-82a6-b4283d31ed10 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:12.559122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87748b6-3019-4d10-92a5-0b6344a84778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:12.559758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87748b6-3019-4d10-92a5-0b6344a84778 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.560040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87748b6-3019-4d10-92a5-0b6344a84778 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.560402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87748b6-3019-4d10-92a5-0b6344a84778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.561044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87748b6-3019-4d10-92a5-0b6344a84778 None admin] RBAC: Adding query filter params (role.id=3b2c8c93a1c54611871c4299008b2abf, scope.project.id=c1774c4e131e4cd592c124840e1bacb5, user.id=1fe17027043247a5ba6d4296eb07bb32) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:12.561356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87748b6-3019-4d10-92a5-0b6344a84778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:12.562830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87748b6-3019-4d10-92a5-0b6344a84778 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:12.570216 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 59/127] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:12 2022] GET /identity/v3/role_assignments?user.id=1fe17027043247a5ba6d4296eb07bb32&scope.project.id=c1774c4e131e4cd592c124840e1bacb5&role.id=3b2c8c93a1c54611871c4299008b2abf => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:12.579512 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:12.591878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba444f-f29e-4ef8-8162-1e357e814c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:12.592539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba444f-f29e-4ef8-8162-1e357e814c74 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.592823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba444f-f29e-4ef8-8162-1e357e814c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.593097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba444f-f29e-4ef8-8162-1e357e814c74 None admin] PATH_INFO: `/v3/projects/43a48dad561c4e15b76d9a00649452e2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.594309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba444f-f29e-4ef8-8162-1e357e814c74 None admin] RBAC: Authorizing `identity:get_project(project_id=43a48dad561c4e15b76d9a00649452e2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:12.595935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba444f-f29e-4ef8-8162-1e357e814c74 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:12.597858 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 69/128] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:12 2022] GET /identity/v3/projects/43a48dad561c4e15b76d9a00649452e2 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:12.603777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87748b6-3019-4d10-92a5-0b6344a84778 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:12.723965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87748b6-3019-4d10-92a5-0b6344a84778 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:12.761957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805c599-79cb-4190-af41-1c356c9cec61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:12.762576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805c599-79cb-4190-af41-1c356c9cec61 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:12.762860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805c599-79cb-4190-af41-1c356c9cec61 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:12.763166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805c599-79cb-4190-af41-1c356c9cec61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:12.763893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805c599-79cb-4190-af41-1c356c9cec61 None admin] RBAC: Adding query filter params (role.id=b432183c244e40e0be2fdb9f5c438e77, scope.project.id=43a48dad561c4e15b76d9a00649452e2, user.id=364bdc673dbe40e4a5943306e9aa4cc5) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:12.764203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805c599-79cb-4190-af41-1c356c9cec61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:12.765648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805c599-79cb-4190-af41-1c356c9cec61 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:12.772333 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 60/129] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:12 2022] GET /identity/v3/role_assignments?user.id=364bdc673dbe40e4a5943306e9aa4cc5&scope.project.id=43a48dad561c4e15b76d9a00649452e2&role.id=b432183c244e40e0be2fdb9f5c438e77 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:13.697027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718e451-d9b3-420a-9156-b99588483830 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:13.697533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718e451-d9b3-420a-9156-b99588483830 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:13.697649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718e451-d9b3-420a-9156-b99588483830 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:13.698979 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 70/130] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:13.704213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc82c3-eed1-4370-977a-7cf9fceb7502 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:13.704615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc82c3-eed1-4370-977a-7cf9fceb7502 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:13.704776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc82c3-eed1-4370-977a-7cf9fceb7502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:13.723241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d6bc82c3-eed1-4370-977a-7cf9fceb7502 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:13.724429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d6bc82c3-eed1-4370-977a-7cf9fceb7502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:13.741090 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:13.791549 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 61/131] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:14.063076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718e451-d9b3-420a-9156-b99588483830 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:14.162088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718e451-d9b3-420a-9156-b99588483830 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:14.195777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9409183-8958-46b1-9c63-71ddf9ec917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:14.196404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9409183-8958-46b1-9c63-71ddf9ec917f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:14.196685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9409183-8958-46b1-9c63-71ddf9ec917f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:14.196958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9409183-8958-46b1-9c63-71ddf9ec917f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:14.198053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9409183-8958-46b1-9c63-71ddf9ec917f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:14.199532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9409183-8958-46b1-9c63-71ddf9ec917f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:14.201103 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 71/132] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:14.206602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc82c3-eed1-4370-977a-7cf9fceb7502 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:14.303433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc82c3-eed1-4370-977a-7cf9fceb7502 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:14.336535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd65d3-f366-41bd-93d6-4433fbf4aaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:14.337074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd65d3-f366-41bd-93d6-4433fbf4aaac None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:14.337351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd65d3-f366-41bd-93d6-4433fbf4aaac None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:14.337622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd65d3-f366-41bd-93d6-4433fbf4aaac None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:14.338272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd65d3-f366-41bd-93d6-4433fbf4aaac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:14.339736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd65d3-f366-41bd-93d6-4433fbf4aaac None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:14.361106 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 62/133] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:14 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:14.626499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea8c4-347f-4f17-90db-028c59108995 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:14.626719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea8c4-347f-4f17-90db-028c59108995 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:14.627026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea8c4-347f-4f17-90db-028c59108995 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:14.628569 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 72/134] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:14.633825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948bef3-a39e-403b-9d18-7d7b2c6ebf65 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:14.634113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948bef3-a39e-403b-9d18-7d7b2c6ebf65 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:14.634390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948bef3-a39e-403b-9d18-7d7b2c6ebf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:14.653439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7948bef3-a39e-403b-9d18-7d7b2c6ebf65 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:14.654860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7948bef3-a39e-403b-9d18-7d7b2c6ebf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:14.656976 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:14.730056 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 63/135] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:15.001465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea8c4-347f-4f17-90db-028c59108995 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:15.071760 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:15.108886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea8c4-347f-4f17-90db-028c59108995 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:15.144063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02078cef-01e5-4e04-9525-5203625a9fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:15.144703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02078cef-01e5-4e04-9525-5203625a9fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:15.144981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02078cef-01e5-4e04-9525-5203625a9fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:15.145253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02078cef-01e5-4e04-9525-5203625a9fa7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:15.156160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02078cef-01e5-4e04-9525-5203625a9fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-02078cef-01e5-4e04-9525-5203625a9fa7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:15.161438 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:15.162299 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:15.163944 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:15.163944 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:15.163944 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:15.163944 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:15.163944 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:15.163944 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:15.163944 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:15.163944 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:15.163944 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:15.163944 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:15.163944 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:15.163944 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:15.163944 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 73/136] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:15.168614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948bef3-a39e-403b-9d18-7d7b2c6ebf65 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:15.270089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948bef3-a39e-403b-9d18-7d7b2c6ebf65 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:15.305817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb82bfa-dfe3-46bb-acb4-21b1a0e7844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:15.306501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb82bfa-dfe3-46bb-acb4-21b1a0e7844a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:15.306840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb82bfa-dfe3-46bb-acb4-21b1a0e7844a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:15.307145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb82bfa-dfe3-46bb-acb4-21b1a0e7844a None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:15.307815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb82bfa-dfe3-46bb-acb4-21b1a0e7844a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:15.308119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb82bfa-dfe3-46bb-acb4-21b1a0e7844a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:15.309505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb82bfa-dfe3-46bb-acb4-21b1a0e7844a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:15.315714 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:15.318728 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 64/137] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:15.324643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02078cef-01e5-4e04-9525-5203625a9fa7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:15.434882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02078cef-01e5-4e04-9525-5203625a9fa7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:15.461408 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:15.469923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dbc84-82e2-4a74-9cd5-da27c4fc16e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:15.470544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dbc84-82e2-4a74-9cd5-da27c4fc16e2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:15.470895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dbc84-82e2-4a74-9cd5-da27c4fc16e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:15.471138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dbc84-82e2-4a74-9cd5-da27c4fc16e2 None admin] PATH_INFO: `/v3/users/a0249c47643841f09a888b135e0fa893` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:15.472381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9dbc84-82e2-4a74-9cd5-da27c4fc16e2 None admin] RBAC: Authorizing `identity:get_user(user_id=a0249c47643841f09a888b135e0fa893)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:15.473918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9dbc84-82e2-4a74-9cd5-da27c4fc16e2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:15.475813 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 74/138] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:15 2022] GET /identity/v3/users/a0249c47643841f09a888b135e0fa893 => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:15.481227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb82bfa-dfe3-46bb-acb4-21b1a0e7844a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:15.588841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb82bfa-dfe3-46bb-acb4-21b1a0e7844a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:15.627373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024e157-de53-42e8-bfc5-be45b2c5c584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:15.628533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024e157-de53-42e8-bfc5-be45b2c5c584 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:15.629034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024e157-de53-42e8-bfc5-be45b2c5c584 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:15.629516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024e157-de53-42e8-bfc5-be45b2c5c584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:15.696338 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:15.698641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024e157-de53-42e8-bfc5-be45b2c5c584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:15.700733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024e157-de53-42e8-bfc5-be45b2c5c584 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:15.802546 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 65/139] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:45:15.812039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dbc84-82e2-4a74-9cd5-da27c4fc16e2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:15.920294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dbc84-82e2-4a74-9cd5-da27c4fc16e2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:15.954064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ef176-cce6-4dd5-857b-f1b2ee4956bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:15.954693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ef176-cce6-4dd5-857b-f1b2ee4956bc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:15.954996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ef176-cce6-4dd5-857b-f1b2ee4956bc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:15.955273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ef176-cce6-4dd5-857b-f1b2ee4956bc None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:15.956455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ef176-cce6-4dd5-857b-f1b2ee4956bc None admin] RBAC: Authorizing `identity:get_project(project_id=c1774c4e131e4cd592c124840e1bacb5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:15.957896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ef176-cce6-4dd5-857b-f1b2ee4956bc None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:15.959740 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 75/140] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:15 2022] GET /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:15.965661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024e157-de53-42e8-bfc5-be45b2c5c584 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:16.063597 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:16.067463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024e157-de53-42e8-bfc5-be45b2c5c584 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:16.103600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da18f9a-1fde-4ecd-b7d5-37397bf4c031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:16.104216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da18f9a-1fde-4ecd-b7d5-37397bf4c031 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:16.104499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da18f9a-1fde-4ecd-b7d5-37397bf4c031 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:16.104769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da18f9a-1fde-4ecd-b7d5-37397bf4c031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:16.105482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da18f9a-1fde-4ecd-b7d5-37397bf4c031 None admin] RBAC: Adding query filter params (role.id=f4e5fecce17c4ed8bd87bf7405840365, scope.project.id=c1774c4e131e4cd592c124840e1bacb5, user.id=a0249c47643841f09a888b135e0fa893) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:16.105788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da18f9a-1fde-4ecd-b7d5-37397bf4c031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:16.107317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da18f9a-1fde-4ecd-b7d5-37397bf4c031 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:16.114011 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 66/141] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:15 2022] GET /identity/v3/role_assignments?user.id=a0249c47643841f09a888b135e0fa893&scope.project.id=c1774c4e131e4cd592c124840e1bacb5&role.id=f4e5fecce17c4ed8bd87bf7405840365 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:16.718305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937abbf-b5b3-450e-8636-677452ce0265 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:16.718848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937abbf-b5b3-450e-8636-677452ce0265 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:16.718848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937abbf-b5b3-450e-8636-677452ce0265 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:16.720445 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 76/142] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:16.727397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707df68-3d17-4ecf-a3be-cc4e0f9adbdf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:16.727702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707df68-3d17-4ecf-a3be-cc4e0f9adbdf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:16.727964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707df68-3d17-4ecf-a3be-cc4e0f9adbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:16.748801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3707df68-3d17-4ecf-a3be-cc4e0f9adbdf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:16.749975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3707df68-3d17-4ecf-a3be-cc4e0f9adbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:16.823108 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 67/143] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:16.839350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad371-d5e2-4dad-b304-4b1ddefdcfc9 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:16.839639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad371-d5e2-4dad-b304-4b1ddefdcfc9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:16.839912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad371-d5e2-4dad-b304-4b1ddefdcfc9 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:16.841362 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 77/144] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:16.846375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f247e-fa94-4506-8173-d2d2d4575bf3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:16.846665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f247e-fa94-4506-8173-d2d2d4575bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:16.846963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f247e-fa94-4506-8173-d2d2d4575bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:16.865353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5d1f247e-fa94-4506-8173-d2d2d4575bf3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:16.866518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5d1f247e-fa94-4506-8173-d2d2d4575bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:16.901437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af680e-afdd-47b6-886e-3e9e38dd7031 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:16.901759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af680e-afdd-47b6-886e-3e9e38dd7031 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:16.902020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af680e-afdd-47b6-886e-3e9e38dd7031 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:16.903397 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 78/145] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:16.908328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067394a8-37c9-477b-b1b4-c76210f8519d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:16.909178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067394a8-37c9-477b-b1b4-c76210f8519d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:16.909455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067394a8-37c9-477b-b1b4-c76210f8519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:16.927320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-067394a8-37c9-477b-b1b4-c76210f8519d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:16.928472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-067394a8-37c9-477b-b1b4-c76210f8519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:16.934807 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 68/146] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:16.989090 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:16.997499 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 79/147] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:45:17.100061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f247e-fa94-4506-8173-d2d2d4575bf3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:17.125220 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:17.201687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067394a8-37c9-477b-b1b4-c76210f8519d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:17.203268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f247e-fa94-4506-8173-d2d2d4575bf3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:17.241437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642e2cf-c656-4b51-8898-b9eb34e3718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:17.242443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642e2cf-c656-4b51-8898-b9eb34e3718a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:17.242955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642e2cf-c656-4b51-8898-b9eb34e3718a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:17.243437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642e2cf-c656-4b51-8898-b9eb34e3718a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:17.257454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642e2cf-c656-4b51-8898-b9eb34e3718a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-3642e2cf-c656-4b51-8898-b9eb34e3718a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:17.264464 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:17.265334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:17.266280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:17.266280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:17.266280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:17.266280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:17.266280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:17.266280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:17.266280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:17.266280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:17.266280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:17.266280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:17.266280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:17.266280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:17.266280 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 69/148] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:17.272214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642e2cf-c656-4b51-8898-b9eb34e3718a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:17.306207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067394a8-37c9-477b-b1b4-c76210f8519d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:17.339771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ff39f-27cc-445c-91c3-49d56b379a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:17.340398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ff39f-27cc-445c-91c3-49d56b379a0f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:17.340678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ff39f-27cc-445c-91c3-49d56b379a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:17.340949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ff39f-27cc-445c-91c3-49d56b379a0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:17.342038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ff39f-27cc-445c-91c3-49d56b379a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:17.343530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ff39f-27cc-445c-91c3-49d56b379a0f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:17.345092 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 80/149] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:17.345842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ff39f-27cc-445c-91c3-49d56b379a0f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:17.356954 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:17.373260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642e2cf-c656-4b51-8898-b9eb34e3718a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:17.406982 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:17.407259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b7feb-3b21-495a-b926-95d816da3ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:17.407890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b7feb-3b21-495a-b926-95d816da3ebc None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:17.408219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b7feb-3b21-495a-b926-95d816da3ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:17.408432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b7feb-3b21-495a-b926-95d816da3ebc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:17.419018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b7feb-3b21-495a-b926-95d816da3ebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-249b7feb-3b21-495a-b926-95d816da3ebc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:17.423784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:17.425025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 70/150] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:17.427748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b7feb-3b21-495a-b926-95d816da3ebc None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:17.449527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ff39f-27cc-445c-91c3-49d56b379a0f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:17.482971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc2f0a-9a46-4385-8a5f-c1aa4e1ea18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:17.483582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc2f0a-9a46-4385-8a5f-c1aa4e1ea18b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:17.483857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc2f0a-9a46-4385-8a5f-c1aa4e1ea18b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:17.484127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc2f0a-9a46-4385-8a5f-c1aa4e1ea18b None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:17.484784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc2f0a-9a46-4385-8a5f-c1aa4e1ea18b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:17.485085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc2f0a-9a46-4385-8a5f-c1aa4e1ea18b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:17.486473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc2f0a-9a46-4385-8a5f-c1aa4e1ea18b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:17.495005 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 81/151] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:17.495795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc2f0a-9a46-4385-8a5f-c1aa4e1ea18b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:17.525125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b7feb-3b21-495a-b926-95d816da3ebc None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:17.561394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e2c36-f8b6-4958-bd98-703d7975f1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:17.562010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e2c36-f8b6-4958-bd98-703d7975f1ab None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:17.562291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e2c36-f8b6-4958-bd98-703d7975f1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:17.562564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e2c36-f8b6-4958-bd98-703d7975f1ab None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:17.563249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e2c36-f8b6-4958-bd98-703d7975f1ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:17.564743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e2c36-f8b6-4958-bd98-703d7975f1ab None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:17.582018 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:17.587018 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 71/152] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:17 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:17.588727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e2c36-f8b6-4958-bd98-703d7975f1ab None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:17.604802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc2f0a-9a46-4385-8a5f-c1aa4e1ea18b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:17.633841 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:17.647951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb6c38-6220-41e6-88fd-b80519c7569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:17.648573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb6c38-6220-41e6-88fd-b80519c7569c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:17.648850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb6c38-6220-41e6-88fd-b80519c7569c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:17.649121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb6c38-6220-41e6-88fd-b80519c7569c None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:17.649803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb6c38-6220-41e6-88fd-b80519c7569c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:17.650112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb6c38-6220-41e6-88fd-b80519c7569c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:17.651577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb6c38-6220-41e6-88fd-b80519c7569c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:17.660986 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 82/153] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:17.666814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb6c38-6220-41e6-88fd-b80519c7569c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:17.706600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e2c36-f8b6-4958-bd98-703d7975f1ab None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:17.743583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d25aa-390f-48bc-b438-58cf640f0ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:17.744238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d25aa-390f-48bc-b438-58cf640f0ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:17.744516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d25aa-390f-48bc-b438-58cf640f0ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:17.744790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d25aa-390f-48bc-b438-58cf640f0ac6 None admin] PATH_INFO: `/v3/users/d15c6e1224674e87b85270f7df6aac36` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:17.760534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d25aa-390f-48bc-b438-58cf640f0ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=d15c6e1224674e87b85270f7df6aac36)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:17.762027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d25aa-390f-48bc-b438-58cf640f0ac6 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:17.763774 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 72/154] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:17 2022] GET /identity/v3/users/d15c6e1224674e87b85270f7df6aac36 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:17.771122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d25aa-390f-48bc-b438-58cf640f0ac6 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:17.785711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb6c38-6220-41e6-88fd-b80519c7569c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:17.828045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b687-1d62-4f42-9727-d76262914f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:17.828683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b687-1d62-4f42-9727-d76262914f99 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:17.828964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b687-1d62-4f42-9727-d76262914f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:17.829243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b687-1d62-4f42-9727-d76262914f99 None admin] PATH_INFO: `/v3/users/d15c6e1224674e87b85270f7df6aac36` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:17.830600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2b687-1d62-4f42-9727-d76262914f99 None admin] RBAC: Authorizing `identity:get_user(user_id=d15c6e1224674e87b85270f7df6aac36)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:17.832571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2b687-1d62-4f42-9727-d76262914f99 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:17.835466 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 83/155] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:17 2022] GET /identity/v3/users/d15c6e1224674e87b85270f7df6aac36 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:17.839673 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:17.841028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b687-1d62-4f42-9727-d76262914f99 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:17.890436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d25aa-390f-48bc-b438-58cf640f0ac6 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:17.913801 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:17.944399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e725092-ec89-4b37-afd3-ff4ca65af959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:17.945075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e725092-ec89-4b37-afd3-ff4ca65af959 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:17.945351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e725092-ec89-4b37-afd3-ff4ca65af959 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:17.945622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e725092-ec89-4b37-afd3-ff4ca65af959 None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:17.946754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e725092-ec89-4b37-afd3-ff4ca65af959 None admin] RBAC: Authorizing `identity:get_project(project_id=1d68000826204dbf8bb077d105c52771)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:17.948392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e725092-ec89-4b37-afd3-ff4ca65af959 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:17.950040 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 73/156] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:17 2022] GET /identity/v3/projects/1d68000826204dbf8bb077d105c52771 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:17.956002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e725092-ec89-4b37-afd3-ff4ca65af959 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:17.974686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b687-1d62-4f42-9727-d76262914f99 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:18.016744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577b37f-edb2-4874-aabe-1400a8f540e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:18.017430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577b37f-edb2-4874-aabe-1400a8f540e9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:18.017647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577b37f-edb2-4874-aabe-1400a8f540e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:18.018114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577b37f-edb2-4874-aabe-1400a8f540e9 None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:18.019503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577b37f-edb2-4874-aabe-1400a8f540e9 None admin] RBAC: Authorizing `identity:get_project(project_id=1d68000826204dbf8bb077d105c52771)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:18.021143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577b37f-edb2-4874-aabe-1400a8f540e9 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:18.022973 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 84/157] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:17 2022] GET /identity/v3/projects/1d68000826204dbf8bb077d105c52771 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:18.029422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577b37f-edb2-4874-aabe-1400a8f540e9 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:18.098157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e725092-ec89-4b37-afd3-ff4ca65af959 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:18.137603 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:18.148902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577b37f-edb2-4874-aabe-1400a8f540e9 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:18.152434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49958b86-a450-479d-8e54-9460a7183756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:18.153327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49958b86-a450-479d-8e54-9460a7183756 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:18.153779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49958b86-a450-479d-8e54-9460a7183756 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:18.154486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49958b86-a450-479d-8e54-9460a7183756 None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771/users/d15c6e1224674e87b85270f7df6aac36/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:18.156653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49958b86-a450-479d-8e54-9460a7183756 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d68000826204dbf8bb077d105c52771, user_id=d15c6e1224674e87b85270f7df6aac36, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:18.159336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49958b86-a450-479d-8e54-9460a7183756 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:18.177007 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:18.179139 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 74/158] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:17 2022] PUT /identity/v3/projects/1d68000826204dbf8bb077d105c52771/users/d15c6e1224674e87b85270f7df6aac36/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:18.198183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002d802-bc27-4e00-9061-4029f65734a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:18.199276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d802-bc27-4e00-9061-4029f65734a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:18.199823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d802-bc27-4e00-9061-4029f65734a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:18.200282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d802-bc27-4e00-9061-4029f65734a7 None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771/users/d15c6e1224674e87b85270f7df6aac36/roles/2ff561b5b0d24a468ca2bfa7d0788bd2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:18.203009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002d802-bc27-4e00-9061-4029f65734a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d68000826204dbf8bb077d105c52771, user_id=d15c6e1224674e87b85270f7df6aac36, role_id=2ff561b5b0d24a468ca2bfa7d0788bd2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:18.204946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002d802-bc27-4e00-9061-4029f65734a7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:18.231110 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 85/159] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:18 2022] PUT /identity/v3/projects/1d68000826204dbf8bb077d105c52771/users/d15c6e1224674e87b85270f7df6aac36/roles/2ff561b5b0d24a468ca2bfa7d0788bd2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:19.913473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade2917-dee8-4748-9e75-055d6230a9af None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:19.913972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade2917-dee8-4748-9e75-055d6230a9af None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:19.913972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade2917-dee8-4748-9e75-055d6230a9af None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:19.915315 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 75/160] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:19.920403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb9960-df00-4df2-bd2a-dffff341c353 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:19.920810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb9960-df00-4df2-bd2a-dffff341c353 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:19.920986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb9960-df00-4df2-bd2a-dffff341c353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:19.940184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e6eb9960-df00-4df2-bd2a-dffff341c353 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:19.941371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e6eb9960-df00-4df2-bd2a-dffff341c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:19.987899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c5fc5-1647-4347-a1aa-f01bc722d70d None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:19.988406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c5fc5-1647-4347-a1aa-f01bc722d70d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:19.988520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c5fc5-1647-4347-a1aa-f01bc722d70d None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:19.990110 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 76/161] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:19.995218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdf8f9-e491-42c1-874e-c9406fe785cf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:19.995502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdf8f9-e491-42c1-874e-c9406fe785cf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:19.995778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdf8f9-e491-42c1-874e-c9406fe785cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.013817 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 86/162] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:20.020749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-63fdf8f9-e491-42c1-874e-c9406fe785cf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:20.022097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-63fdf8f9-e491-42c1-874e-c9406fe785cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:20.092504 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 77/163] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:45:20.289334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb9960-df00-4df2-bd2a-dffff341c353 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:20.383591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdf8f9-e491-42c1-874e-c9406fe785cf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:20.401656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb9960-df00-4df2-bd2a-dffff341c353 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:20.417420 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:20.441974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a456354-a914-4ce5-8126-19a02defb3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:20.442609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a456354-a914-4ce5-8126-19a02defb3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.442883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a456354-a914-4ce5-8126-19a02defb3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.443179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a456354-a914-4ce5-8126-19a02defb3b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.454070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a456354-a914-4ce5-8126-19a02defb3b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-7a456354-a914-4ce5-8126-19a02defb3b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:20.459470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:20.460521 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:20.461333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:20.461333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:20.461333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:20.461333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:20.461333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:20.461333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:20.461333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:20.461333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:20.461333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:20.461333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:20.461333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:20.461333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:20.461333 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 87/164] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:20.462470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcba0b9-6376-4bfd-acce-e1af7f84c2f0 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.462470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcba0b9-6376-4bfd-acce-e1af7f84c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.462642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcba0b9-6376-4bfd-acce-e1af7f84c2f0 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.464991 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 88/165] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:20.468018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a25f-6def-45a5-9db8-03eb4db923fd None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.468298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a25f-6def-45a5-9db8-03eb4db923fd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.468844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a25f-6def-45a5-9db8-03eb4db923fd None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.470493 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 89/166] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:20.471970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02a25f-6def-45a5-9db8-03eb4db923fd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:20.488558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdf8f9-e491-42c1-874e-c9406fe785cf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:20.504589 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:20.524228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51eda02-96fa-4d21-bc91-17a51f8b6cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:20.524859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eda02-96fa-4d21-bc91-17a51f8b6cfe None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.525140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eda02-96fa-4d21-bc91-17a51f8b6cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.525412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eda02-96fa-4d21-bc91-17a51f8b6cfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.526507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51eda02-96fa-4d21-bc91-17a51f8b6cfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:20.527990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51eda02-96fa-4d21-bc91-17a51f8b6cfe None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:20.530000 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 78/167] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:20.530956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd94e8-d774-4c18-8504-319ef4c6f383 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.531248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd94e8-d774-4c18-8504-319ef4c6f383 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.531520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd94e8-d774-4c18-8504-319ef4c6f383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.548791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bffd94e8-d774-4c18-8504-319ef4c6f383 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:20.550493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bffd94e8-d774-4c18-8504-319ef4c6f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:20.581502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02a25f-6def-45a5-9db8-03eb4db923fd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:20.615256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc17761-cdfd-4985-9cc8-e1bc8534a175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:20.615853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc17761-cdfd-4985-9cc8-e1bc8534a175 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.616125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc17761-cdfd-4985-9cc8-e1bc8534a175 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.616390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc17761-cdfd-4985-9cc8-e1bc8534a175 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.616879 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 79/168] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:20.617062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc17761-cdfd-4985-9cc8-e1bc8534a175 None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:20.617335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc17761-cdfd-4985-9cc8-e1bc8534a175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:20.618255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957d042-0e23-4264-b87b-083cceca915d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.618542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957d042-0e23-4264-b87b-083cceca915d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.618702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc17761-cdfd-4985-9cc8-e1bc8534a175 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:20.618798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957d042-0e23-4264-b87b-083cceca915d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.626967 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 90/169] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:20.626967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc17761-cdfd-4985-9cc8-e1bc8534a175 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:20.643481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2957d042-0e23-4264-b87b-083cceca915d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:20.644692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2957d042-0e23-4264-b87b-083cceca915d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:20.664992 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:20.714373 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 80/170] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:20.715857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957d042-0e23-4264-b87b-083cceca915d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:20.737826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc17761-cdfd-4985-9cc8-e1bc8534a175 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:20.775486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1d0b1-a649-4bd3-b2eb-bb623f561183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:20.776790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1d0b1-a649-4bd3-b2eb-bb623f561183 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.777255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1d0b1-a649-4bd3-b2eb-bb623f561183 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.778031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1d0b1-a649-4bd3-b2eb-bb623f561183 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.779376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1d0b1-a649-4bd3-b2eb-bb623f561183 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:20.780629 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:20.781786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1d0b1-a649-4bd3-b2eb-bb623f561183 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:20.809749 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 91/171] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:20 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:20.843770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957d042-0e23-4264-b87b-083cceca915d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:20.883464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fff1c-2d9f-4cea-9d7f-0631930c4cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:20.884384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fff1c-2d9f-4cea-9d7f-0631930c4cca None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:20.884835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fff1c-2d9f-4cea-9d7f-0631930c4cca None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:20.885244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fff1c-2d9f-4cea-9d7f-0631930c4cca None admin] PATH_INFO: `/v3/users/49608256027140a58f181ac2b4ee999e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:20.892200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1d0b1-a649-4bd3-b2eb-bb623f561183 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:20.902519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fff1c-2d9f-4cea-9d7f-0631930c4cca None admin] RBAC: Authorizing `identity:get_user(user_id=49608256027140a58f181ac2b4ee999e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:20.905028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fff1c-2d9f-4cea-9d7f-0631930c4cca None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:20.907668 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 81/172] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:20 2022] GET /identity/v3/users/49608256027140a58f181ac2b4ee999e => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:20.913685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fff1c-2d9f-4cea-9d7f-0631930c4cca None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:21.010038 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:21.025207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1d0b1-a649-4bd3-b2eb-bb623f561183 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:21.049932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fff1c-2d9f-4cea-9d7f-0631930c4cca None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:21.051584 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:21.063329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be2535-b9cd-407a-ba7d-caf6819b5505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:21.063929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be2535-b9cd-407a-ba7d-caf6819b5505 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:21.064406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be2535-b9cd-407a-ba7d-caf6819b5505 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:21.065214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be2535-b9cd-407a-ba7d-caf6819b5505 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:21.078290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be2535-b9cd-407a-ba7d-caf6819b5505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-45be2535-b9cd-407a-ba7d-caf6819b5505 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:21.083764 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:21.084636 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:21.085651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:21.085651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:21.085651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:21.085651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:21.085651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:21.085651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:21.085651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:21.085651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:21.085651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:21.085651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:21.085651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:21.085651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:21.085651 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 92/173] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:21.086530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be2535-b9cd-407a-ba7d-caf6819b5505 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:21.092317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acc042-368b-47c2-ad95-6479cfd2cb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:21.092967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acc042-368b-47c2-ad95-6479cfd2cb3d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:21.093250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acc042-368b-47c2-ad95-6479cfd2cb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:21.093556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acc042-368b-47c2-ad95-6479cfd2cb3d None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:21.094905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acc042-368b-47c2-ad95-6479cfd2cb3d None admin] RBAC: Authorizing `identity:get_project(project_id=1d68000826204dbf8bb077d105c52771)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:21.097262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acc042-368b-47c2-ad95-6479cfd2cb3d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:21.098747 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 82/174] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:20 2022] GET /identity/v3/projects/1d68000826204dbf8bb077d105c52771 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:21.100209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acc042-368b-47c2-ad95-6479cfd2cb3d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:21.217909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be2535-b9cd-407a-ba7d-caf6819b5505 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:21.233278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acc042-368b-47c2-ad95-6479cfd2cb3d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:21.262624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ed2bd-5fef-405c-8e15-087386cb8a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:21.263350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ed2bd-5fef-405c-8e15-087386cb8a51 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:21.263635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ed2bd-5fef-405c-8e15-087386cb8a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:21.263909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ed2bd-5fef-405c-8e15-087386cb8a51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:21.269639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e3f54-7239-426a-b038-662f0c5ed9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:21.270255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e3f54-7239-426a-b038-662f0c5ed9be None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:21.270531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e3f54-7239-426a-b038-662f0c5ed9be None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:21.270802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e3f54-7239-426a-b038-662f0c5ed9be None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:21.271557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e3f54-7239-426a-b038-662f0c5ed9be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:21.271858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e3f54-7239-426a-b038-662f0c5ed9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:21.273525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e3f54-7239-426a-b038-662f0c5ed9be None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:21.276378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ed2bd-5fef-405c-8e15-087386cb8a51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:21.282628 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 83/175] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-9d4ed2bd-5fef-405c-8e15-087386cb8a51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:21.282774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:21.284184 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:21.284952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:21.284952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:21.284952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:21.284952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:21.284952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:21.284952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:21.284952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:21.284952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:21.284952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:21.284952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:21.284952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:21.284952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:21.285532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e3f54-7239-426a-b038-662f0c5ed9be None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:21.288178 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 93/176] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:21.293446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ed2bd-5fef-405c-8e15-087386cb8a51 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:21.310018 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:21.335401 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:21.413691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ed2bd-5fef-405c-8e15-087386cb8a51 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:21.431113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e3f54-7239-426a-b038-662f0c5ed9be None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:21.449655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3bfcc-df3a-403b-8a55-33e23c727afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:21.450636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3bfcc-df3a-403b-8a55-33e23c727afc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:21.451168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3bfcc-df3a-403b-8a55-33e23c727afc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:21.451644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3bfcc-df3a-403b-8a55-33e23c727afc None admin] PATH_INFO: `/v3/users/d15c6e1224674e87b85270f7df6aac36` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:21.452968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3bfcc-df3a-403b-8a55-33e23c727afc None admin] RBAC: Authorizing `identity:get_user(user_id=d15c6e1224674e87b85270f7df6aac36)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:21.454633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3bfcc-df3a-403b-8a55-33e23c727afc None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:21.457173 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 94/177] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:21 2022] GET /identity/v3/users/d15c6e1224674e87b85270f7df6aac36 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:21.458224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3bfcc-df3a-403b-8a55-33e23c727afc None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:21.485280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d2901-be21-4fd8-856b-53a5c9e46ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:21.486279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d2901-be21-4fd8-856b-53a5c9e46ff7 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:21.486782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d2901-be21-4fd8-856b-53a5c9e46ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:21.487095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d2901-be21-4fd8-856b-53a5c9e46ff7 None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771/users/49608256027140a58f181ac2b4ee999e/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:21.489815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d2901-be21-4fd8-856b-53a5c9e46ff7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d68000826204dbf8bb077d105c52771, user_id=49608256027140a58f181ac2b4ee999e, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:21.491723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d2901-be21-4fd8-856b-53a5c9e46ff7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:21.510636 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 84/178] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:21 2022] PUT /identity/v3/projects/1d68000826204dbf8bb077d105c52771/users/49608256027140a58f181ac2b4ee999e/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:21.511511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d2901-be21-4fd8-856b-53a5c9e46ff7 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:21.553143 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:21.582365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3bfcc-df3a-403b-8a55-33e23c727afc None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:21.622667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb40e-ac58-4f8b-9de9-db045348867a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:21.623476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb40e-ac58-4f8b-9de9-db045348867a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:21.623873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb40e-ac58-4f8b-9de9-db045348867a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:21.624279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb40e-ac58-4f8b-9de9-db045348867a None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:21.625088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcb40e-ac58-4f8b-9de9-db045348867a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:21.625467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcb40e-ac58-4f8b-9de9-db045348867a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:21.627017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcb40e-ac58-4f8b-9de9-db045348867a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:21.633358 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:21.637998 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 95/179] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:21.644275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb40e-ac58-4f8b-9de9-db045348867a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:21.645859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d2901-be21-4fd8-856b-53a5c9e46ff7 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:21.686869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a01d1f-9778-4cd4-8f25-601482df599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:21.687933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a01d1f-9778-4cd4-8f25-601482df599c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:21.688463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a01d1f-9778-4cd4-8f25-601482df599c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:21.689007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a01d1f-9778-4cd4-8f25-601482df599c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:21.763490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb40e-ac58-4f8b-9de9-db045348867a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:21.789430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a01d1f-9778-4cd4-8f25-601482df599c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:21.792287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a01d1f-9778-4cd4-8f25-601482df599c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:21.804794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ef529-2337-43fe-804c-613819d34b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:21.805586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ef529-2337-43fe-804c-613819d34b31 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:21.805982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ef529-2337-43fe-804c-613819d34b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:21.806357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ef529-2337-43fe-804c-613819d34b31 None admin] PATH_INFO: `/v3/users/d15c6e1224674e87b85270f7df6aac36` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:21.807771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ef529-2337-43fe-804c-613819d34b31 None admin] RBAC: Authorizing `identity:get_user(user_id=d15c6e1224674e87b85270f7df6aac36)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:21.809439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ef529-2337-43fe-804c-613819d34b31 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:21.811720 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 96/180] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:21 2022] GET /identity/v3/users/d15c6e1224674e87b85270f7df6aac36 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:21.817973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ef529-2337-43fe-804c-613819d34b31 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:21.831957 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:21.906640 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:21.921331 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 85/181] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:45:21.928784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a01d1f-9778-4cd4-8f25-601482df599c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:21.950972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ef529-2337-43fe-804c-613819d34b31 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:21.998250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739418c5-3063-42f3-beeb-2c03b28ebd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:21.999348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739418c5-3063-42f3-beeb-2c03b28ebd69 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:21.999871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739418c5-3063-42f3-beeb-2c03b28ebd69 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:22.000377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739418c5-3063-42f3-beeb-2c03b28ebd69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:22.086590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739418c5-3063-42f3-beeb-2c03b28ebd69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:22.089354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739418c5-3063-42f3-beeb-2c03b28ebd69 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:22.101662 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:22.153045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a01d1f-9778-4cd4-8f25-601482df599c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:22.212884 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 97/182] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 16 00:45:22.220631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739418c5-3063-42f3-beeb-2c03b28ebd69 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:22.239500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab3a8d-66ef-4bb8-a3ff-aa962fd6324c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:22.240138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab3a8d-66ef-4bb8-a3ff-aa962fd6324c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:22.240413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab3a8d-66ef-4bb8-a3ff-aa962fd6324c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:22.240683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab3a8d-66ef-4bb8-a3ff-aa962fd6324c None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:22.243136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab3a8d-66ef-4bb8-a3ff-aa962fd6324c None admin] RBAC: Authorizing `identity:get_project(project_id=1d68000826204dbf8bb077d105c52771)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:22.244598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab3a8d-66ef-4bb8-a3ff-aa962fd6324c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:22.246232 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 86/183] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:21 2022] GET /identity/v3/projects/1d68000826204dbf8bb077d105c52771 => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:22.253877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab3a8d-66ef-4bb8-a3ff-aa962fd6324c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:22.363995 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:22.410138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739418c5-3063-42f3-beeb-2c03b28ebd69 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:22.433874 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:22.439914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab3a8d-66ef-4bb8-a3ff-aa962fd6324c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:22.481192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f0fc5-b3cc-416f-b2c9-c68977481478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:22.481712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f0fc5-b3cc-416f-b2c9-c68977481478 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:22.481994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f0fc5-b3cc-416f-b2c9-c68977481478 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:22.482265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f0fc5-b3cc-416f-b2c9-c68977481478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:22.483020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f0fc5-b3cc-416f-b2c9-c68977481478 None admin] RBAC: Adding query filter params (role.id=3b2c8c93a1c54611871c4299008b2abf, scope.project.id=1d68000826204dbf8bb077d105c52771, user.id=d15c6e1224674e87b85270f7df6aac36) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:22.483326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f0fc5-b3cc-416f-b2c9-c68977481478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:22.485456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f0fc5-b3cc-416f-b2c9-c68977481478 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:22.492250 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 87/184] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:22 2022] GET /identity/v3/role_assignments?user.id=d15c6e1224674e87b85270f7df6aac36&scope.project.id=1d68000826204dbf8bb077d105c52771&role.id=3b2c8c93a1c54611871c4299008b2abf => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:22.495636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43534c06-91ee-45ac-955b-4ff35d1c2dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:22.496271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534c06-91ee-45ac-955b-4ff35d1c2dfe None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:22.496547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534c06-91ee-45ac-955b-4ff35d1c2dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:22.496811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534c06-91ee-45ac-955b-4ff35d1c2dfe None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:22.497990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43534c06-91ee-45ac-955b-4ff35d1c2dfe None admin] RBAC: Authorizing `identity:get_project(project_id=1d68000826204dbf8bb077d105c52771)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:22.499511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43534c06-91ee-45ac-955b-4ff35d1c2dfe None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:22.501300 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 98/185] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:22 2022] GET /identity/v3/projects/1d68000826204dbf8bb077d105c52771 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:22.508857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f0fc5-b3cc-416f-b2c9-c68977481478 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:22.633002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f0fc5-b3cc-416f-b2c9-c68977481478 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:22.671417 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:22.687055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27268672-bc26-46cf-8ade-c2b4cce494e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:22.687669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27268672-bc26-46cf-8ade-c2b4cce494e9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:22.687942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27268672-bc26-46cf-8ade-c2b4cce494e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:22.688209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27268672-bc26-46cf-8ade-c2b4cce494e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:22.688929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27268672-bc26-46cf-8ade-c2b4cce494e9 None admin] RBAC: Adding query filter params (role.id=2ff561b5b0d24a468ca2bfa7d0788bd2, scope.project.id=1d68000826204dbf8bb077d105c52771, user.id=d15c6e1224674e87b85270f7df6aac36) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:22.689230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27268672-bc26-46cf-8ade-c2b4cce494e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:22.691933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27268672-bc26-46cf-8ade-c2b4cce494e9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:22.704014 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 88/186] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:22 2022] GET /identity/v3/role_assignments?user.id=d15c6e1224674e87b85270f7df6aac36&scope.project.id=1d68000826204dbf8bb077d105c52771&role.id=2ff561b5b0d24a468ca2bfa7d0788bd2 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:23.369308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df13b0d-7569-4363-978b-e26a8a4c2bcc None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:23.369819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df13b0d-7569-4363-978b-e26a8a4c2bcc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:23.369893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df13b0d-7569-4363-978b-e26a8a4c2bcc None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:23.371248 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 99/187] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:23.376206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7ea94-8e31-41cd-abb8-ab0488a771d1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:23.376601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7ea94-8e31-41cd-abb8-ab0488a771d1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:23.376774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7ea94-8e31-41cd-abb8-ab0488a771d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:23.397665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-09d7ea94-8e31-41cd-abb8-ab0488a771d1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:23.398877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-09d7ea94-8e31-41cd-abb8-ab0488a771d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:23.471728 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 89/188] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:23.521782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2824e2-90ba-43a2-81d1-0719a70d4697 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:23.522061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2824e2-90ba-43a2-81d1-0719a70d4697 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:23.522341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2824e2-90ba-43a2-81d1-0719a70d4697 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:23.523873 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 100/189] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:23.529165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e24e4-9e56-4a3a-8256-536abfaec7f2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:23.529461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e24e4-9e56-4a3a-8256-536abfaec7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:23.529736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e24e4-9e56-4a3a-8256-536abfaec7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:23.548671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3a5e24e4-9e56-4a3a-8256-536abfaec7f2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:23.549991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a5e24e4-9e56-4a3a-8256-536abfaec7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:23.627069 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 90/190] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:23.748016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2824e2-90ba-43a2-81d1-0719a70d4697 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:23.855530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2824e2-90ba-43a2-81d1-0719a70d4697 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:23.896996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcca0d-c477-4e74-8131-445c7c80ae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:23.897542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcca0d-c477-4e74-8131-445c7c80ae08 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:23.897813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcca0d-c477-4e74-8131-445c7c80ae08 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:23.898079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcca0d-c477-4e74-8131-445c7c80ae08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:23.908634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcca0d-c477-4e74-8131-445c7c80ae08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-69bcca0d-c477-4e74-8131-445c7c80ae08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:23.913649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:23.914825 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:23.917110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:23.917110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:23.917110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:23.917110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:23.917110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:23.917110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:23.917110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:23.917110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:23.917110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:23.917110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:23.917110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:23.917110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:23.917110 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 101/191] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:23.919809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e24e4-9e56-4a3a-8256-536abfaec7f2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:23.925299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcca0d-c477-4e74-8131-445c7c80ae08 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:23.970738 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:23.977503 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:24.029845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e24e4-9e56-4a3a-8256-536abfaec7f2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:24.049041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcca0d-c477-4e74-8131-445c7c80ae08 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:24.067471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae0b1a-798e-459a-b276-b016f369d8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:24.068165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae0b1a-798e-459a-b276-b016f369d8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.068453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae0b1a-798e-459a-b276-b016f369d8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.068730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae0b1a-798e-459a-b276-b016f369d8d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.069897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae0b1a-798e-459a-b276-b016f369d8d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:24.071406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae0b1a-798e-459a-b276-b016f369d8d7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:24.072991 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 91/192] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:24.078260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae0b1a-798e-459a-b276-b016f369d8d7 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:24.102886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f38d0f-0fc6-46d1-9114-a784e87459fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:24.103835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f38d0f-0fc6-46d1-9114-a784e87459fc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.104284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f38d0f-0fc6-46d1-9114-a784e87459fc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.104696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f38d0f-0fc6-46d1-9114-a784e87459fc None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.105496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f38d0f-0fc6-46d1-9114-a784e87459fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:24.105939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f38d0f-0fc6-46d1-9114-a784e87459fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:24.107505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f38d0f-0fc6-46d1-9114-a784e87459fc None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:24.116798 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 102/193] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:24.122202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f38d0f-0fc6-46d1-9114-a784e87459fc None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:24.183715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae0b1a-798e-459a-b276-b016f369d8d7 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:24.199786 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:24.217654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274bc9a-e736-4c52-9542-c76f18e02cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:24.218252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274bc9a-e736-4c52-9542-c76f18e02cd4 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.218525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274bc9a-e736-4c52-9542-c76f18e02cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.218794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274bc9a-e736-4c52-9542-c76f18e02cd4 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.219490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274bc9a-e736-4c52-9542-c76f18e02cd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:24.220911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274bc9a-e736-4c52-9542-c76f18e02cd4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:24.222175 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:24.226439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f38d0f-0fc6-46d1-9114-a784e87459fc None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:24.242358 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 92/194] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:24 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:45:24.243578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce437c62-53f4-4ca2-aace-b85ab748d2be None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.243859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce437c62-53f4-4ca2-aace-b85ab748d2be None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.244128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce437c62-53f4-4ca2-aace-b85ab748d2be None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.245471 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 93/195] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:24.256815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44da1e-7b7d-4cc0-9906-581f76cf9969 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.257273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44da1e-7b7d-4cc0-9906-581f76cf9969 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.257556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44da1e-7b7d-4cc0-9906-581f76cf9969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.266117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795ac18-50b1-45ae-9f06-54cbea409688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:24.266767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795ac18-50b1-45ae-9f06-54cbea409688 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.267390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795ac18-50b1-45ae-9f06-54cbea409688 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.267706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795ac18-50b1-45ae-9f06-54cbea409688 None admin] PATH_INFO: `/v3/users/772232fd8df64756baef7fbf1af7fcb1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.278135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fd44da1e-7b7d-4cc0-9906-581f76cf9969 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:24.279678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fd44da1e-7b7d-4cc0-9906-581f76cf9969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:24.287780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795ac18-50b1-45ae-9f06-54cbea409688 None admin] RBAC: Authorizing `identity:get_user(user_id=772232fd8df64756baef7fbf1af7fcb1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:24.289869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795ac18-50b1-45ae-9f06-54cbea409688 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:24.296880 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 103/196] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:24 2022] GET /identity/v3/users/772232fd8df64756baef7fbf1af7fcb1 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:24.298134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795ac18-50b1-45ae-9f06-54cbea409688 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:24.403181 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 94/197] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:45:24.451683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795ac18-50b1-45ae-9f06-54cbea409688 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:24.494902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a338261-1af0-44da-ad77-29cada274646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:24.495600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a338261-1af0-44da-ad77-29cada274646 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.495882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a338261-1af0-44da-ad77-29cada274646 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.496154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a338261-1af0-44da-ad77-29cada274646 None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.497381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a338261-1af0-44da-ad77-29cada274646 None admin] RBAC: Authorizing `identity:get_project(project_id=1d68000826204dbf8bb077d105c52771)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:24.499449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a338261-1af0-44da-ad77-29cada274646 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:24.504082 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 104/198] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:24 2022] GET /identity/v3/projects/1d68000826204dbf8bb077d105c52771 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:24.509558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44da1e-7b7d-4cc0-9906-581f76cf9969 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:24.663300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44da1e-7b7d-4cc0-9906-581f76cf9969 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:24.665341 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:24.698253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a338261-1af0-44da-ad77-29cada274646 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:24.713730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c0424-9562-47f4-b4e1-3f54b81a82d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:24.714759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c0424-9562-47f4-b4e1-3f54b81a82d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.715347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c0424-9562-47f4-b4e1-3f54b81a82d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.715570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c0424-9562-47f4-b4e1-3f54b81a82d3 None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771/users/772232fd8df64756baef7fbf1af7fcb1/roles/f4e5fecce17c4ed8bd87bf7405840365` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.717867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c0424-9562-47f4-b4e1-3f54b81a82d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d68000826204dbf8bb077d105c52771, user_id=772232fd8df64756baef7fbf1af7fcb1, role_id=f4e5fecce17c4ed8bd87bf7405840365)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:24.719816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c0424-9562-47f4-b4e1-3f54b81a82d3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:24.732323 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:24.735462 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 95/199] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:24 2022] PUT /identity/v3/projects/1d68000826204dbf8bb077d105c52771/users/772232fd8df64756baef7fbf1af7fcb1/roles/f4e5fecce17c4ed8bd87bf7405840365 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:24.826102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a338261-1af0-44da-ad77-29cada274646 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:24.866791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272ab44-1970-44f5-8786-c68818566475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:24.867461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272ab44-1970-44f5-8786-c68818566475 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:24.867789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272ab44-1970-44f5-8786-c68818566475 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:24.868057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272ab44-1970-44f5-8786-c68818566475 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:24.881479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272ab44-1970-44f5-8786-c68818566475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b272ab44-1970-44f5-8786-c68818566475 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:24.886406 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:24.887322 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:24.888100 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:24.888100 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:24.888100 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:24.888100 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:24.888100 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:24.888100 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:24.888100 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:24.888100 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:24.888100 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:24.888100 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:24.888100 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:24.888100 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:24.892684 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 105/200] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:24.897904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c0424-9562-47f4-b4e1-3f54b81a82d3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:25.012651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c0424-9562-47f4-b4e1-3f54b81a82d3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:25.047514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c726c-cc66-41a3-9e77-50cf874becdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:25.048494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c726c-cc66-41a3-9e77-50cf874becdd None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:25.049527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c726c-cc66-41a3-9e77-50cf874becdd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:25.049995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c726c-cc66-41a3-9e77-50cf874becdd None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:25.050966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c726c-cc66-41a3-9e77-50cf874becdd None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:25.051467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c726c-cc66-41a3-9e77-50cf874becdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:25.053040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c726c-cc66-41a3-9e77-50cf874becdd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:25.061802 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 96/201] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:25.068391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272ab44-1970-44f5-8786-c68818566475 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:25.160689 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:25.177445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272ab44-1970-44f5-8786-c68818566475 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:25.213302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac764ce-a760-4352-9692-d37e3fd22895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:25.213935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac764ce-a760-4352-9692-d37e3fd22895 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:25.214211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac764ce-a760-4352-9692-d37e3fd22895 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:25.214481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac764ce-a760-4352-9692-d37e3fd22895 None admin] PATH_INFO: `/v3/users/49608256027140a58f181ac2b4ee999e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:25.215608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac764ce-a760-4352-9692-d37e3fd22895 None admin] RBAC: Authorizing `identity:get_user(user_id=49608256027140a58f181ac2b4ee999e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:25.217119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac764ce-a760-4352-9692-d37e3fd22895 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:25.223021 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 106/202] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:25 2022] GET /identity/v3/users/49608256027140a58f181ac2b4ee999e => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:25.225998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c726c-cc66-41a3-9e77-50cf874becdd None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:25.253153 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:25.333612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c726c-cc66-41a3-9e77-50cf874becdd None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:25.369118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab975238-00a5-4fce-a9ee-1f2d662aec7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:25.369728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab975238-00a5-4fce-a9ee-1f2d662aec7c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:25.370001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab975238-00a5-4fce-a9ee-1f2d662aec7c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:25.370325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab975238-00a5-4fce-a9ee-1f2d662aec7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:25.448271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab975238-00a5-4fce-a9ee-1f2d662aec7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:25.449722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab975238-00a5-4fce-a9ee-1f2d662aec7c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:25.476473 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:25.561823 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 97/203] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:45:25.567641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac764ce-a760-4352-9692-d37e3fd22895 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:25.669708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac764ce-a760-4352-9692-d37e3fd22895 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:25.704130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fece6-d872-43b2-ab9a-f20e64b2da9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:25.704763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fece6-d872-43b2-ab9a-f20e64b2da9b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:25.705036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fece6-d872-43b2-ab9a-f20e64b2da9b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:25.706068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fece6-d872-43b2-ab9a-f20e64b2da9b None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:25.707359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fece6-d872-43b2-ab9a-f20e64b2da9b None admin] RBAC: Authorizing `identity:get_project(project_id=1d68000826204dbf8bb077d105c52771)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:25.708853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fece6-d872-43b2-ab9a-f20e64b2da9b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:25.715063 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 107/204] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:25 2022] GET /identity/v3/projects/1d68000826204dbf8bb077d105c52771 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:25.717106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab975238-00a5-4fce-a9ee-1f2d662aec7c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:25.818552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab975238-00a5-4fce-a9ee-1f2d662aec7c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:25.843045 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:25.855319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c5740-7ab6-429f-826b-5c83251426fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:25.855933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5740-7ab6-429f-826b-5c83251426fd None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:25.856214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5740-7ab6-429f-826b-5c83251426fd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:25.856487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5740-7ab6-429f-826b-5c83251426fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:25.857211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c5740-7ab6-429f-826b-5c83251426fd None admin] RBAC: Adding query filter params (role.id=b432183c244e40e0be2fdb9f5c438e77, scope.project.id=1d68000826204dbf8bb077d105c52771, user.id=49608256027140a58f181ac2b4ee999e) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:25.857520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c5740-7ab6-429f-826b-5c83251426fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:25.858982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c5740-7ab6-429f-826b-5c83251426fd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:25.865904 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 98/205] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:25 2022] GET /identity/v3/role_assignments?user.id=49608256027140a58f181ac2b4ee999e&scope.project.id=1d68000826204dbf8bb077d105c52771&role.id=b432183c244e40e0be2fdb9f5c438e77 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:26.723330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c1357-2978-489d-90e2-e4e1acbee53d None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:26.723854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c1357-2978-489d-90e2-e4e1acbee53d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:26.723854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c1357-2978-489d-90e2-e4e1acbee53d None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:26.725236 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 108/206] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:26.730678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ffc7b-fac6-4126-93df-3f9909d778a2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:26.731234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ffc7b-fac6-4126-93df-3f9909d778a2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:26.731318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ffc7b-fac6-4126-93df-3f9909d778a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:26.751683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a39ffc7b-fac6-4126-93df-3f9909d778a2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:26.753499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a39ffc7b-fac6-4126-93df-3f9909d778a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:26.827027 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 99/207] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:45:26.861875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ed28e-5242-480f-a751-e2536993a8a9 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:26.862262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ed28e-5242-480f-a751-e2536993a8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:26.862566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ed28e-5242-480f-a751-e2536993a8a9 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:26.863919 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 109/208] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:26.869178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cbd53-5233-4337-bc84-5608f0a04ce3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:26.869473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cbd53-5233-4337-bc84-5608f0a04ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:26.869749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cbd53-5233-4337-bc84-5608f0a04ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:26.888581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1a7cbd53-5233-4337-bc84-5608f0a04ce3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:26.889753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1a7cbd53-5233-4337-bc84-5608f0a04ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:26.962428 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 100/209] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:27.028538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ff90c-c355-48d7-98b4-f569f7846f57 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.028821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ff90c-c355-48d7-98b4-f569f7846f57 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.029512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ff90c-c355-48d7-98b4-f569f7846f57 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.030851 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 110/210] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:27.036581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55699891-bd8a-4c79-bbb3-99bd3b0cd1cd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.036872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55699891-bd8a-4c79-bbb3-99bd3b0cd1cd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.037153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55699891-bd8a-4c79-bbb3-99bd3b0cd1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.054806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-55699891-bd8a-4c79-bbb3-99bd3b0cd1cd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:27.056009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-55699891-bd8a-4c79-bbb3-99bd3b0cd1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:27.098449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ff90c-c355-48d7-98b4-f569f7846f57 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:27.100826 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:27.121743 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:27.125956 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 101/211] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:27.203843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ff90c-c355-48d7-98b4-f569f7846f57 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:27.237567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca1b31-8517-4bd8-bedf-3855411b9c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:27.238186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca1b31-8517-4bd8-bedf-3855411b9c1f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.238466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca1b31-8517-4bd8-bedf-3855411b9c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.238736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca1b31-8517-4bd8-bedf-3855411b9c1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.238846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55699891-bd8a-4c79-bbb3-99bd3b0cd1cd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:27.248925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca1b31-8517-4bd8-bedf-3855411b9c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-53ca1b31-8517-4bd8-bedf-3855411b9c1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:27.254244 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:27.255251 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:27.256156 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:27.256156 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:27.256156 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:27.256156 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:27.256156 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:27.256156 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:27.256156 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:27.256156 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:27.256156 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:27.256156 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:27.256156 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:27.256156 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:27.256156 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 111/212] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:27.261034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca1b31-8517-4bd8-bedf-3855411b9c1f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:27.340457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55699891-bd8a-4c79-bbb3-99bd3b0cd1cd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:27.343895 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:27.364672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca1b31-8517-4bd8-bedf-3855411b9c1f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:27.377072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24232780-544a-47bb-9615-90a979f2997e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:27.377871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24232780-544a-47bb-9615-90a979f2997e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.378145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24232780-544a-47bb-9615-90a979f2997e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.378413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24232780-544a-47bb-9615-90a979f2997e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.379647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24232780-544a-47bb-9615-90a979f2997e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:27.381024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24232780-544a-47bb-9615-90a979f2997e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:27.382758 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 102/213] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:27.388040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24232780-544a-47bb-9615-90a979f2997e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:27.402954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37b1b9-35fe-42be-8419-913e1a0d4c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:27.403579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37b1b9-35fe-42be-8419-913e1a0d4c23 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.403858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37b1b9-35fe-42be-8419-913e1a0d4c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.404381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37b1b9-35fe-42be-8419-913e1a0d4c23 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.405035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37b1b9-35fe-42be-8419-913e1a0d4c23 None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:27.405335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37b1b9-35fe-42be-8419-913e1a0d4c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:27.406707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37b1b9-35fe-42be-8419-913e1a0d4c23 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:27.414740 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 112/214] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:27.415588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37b1b9-35fe-42be-8419-913e1a0d4c23 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:27.438559 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:27.490704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24232780-544a-47bb-9615-90a979f2997e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:27.513726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37b1b9-35fe-42be-8419-913e1a0d4c23 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:27.523094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e7026-7195-4ac8-805d-dee50c0bbd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:27.523691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e7026-7195-4ac8-805d-dee50c0bbd4e None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.523964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e7026-7195-4ac8-805d-dee50c0bbd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.524241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e7026-7195-4ac8-805d-dee50c0bbd4e None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.524875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e7026-7195-4ac8-805d-dee50c0bbd4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:27.526345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e7026-7195-4ac8-805d-dee50c0bbd4e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:27.549092 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 103/215] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:27 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:45:27.549914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e7026-7195-4ac8-805d-dee50c0bbd4e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:27.550129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037aafc-bd34-4223-a27f-ee278ffa980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:27.550828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037aafc-bd34-4223-a27f-ee278ffa980f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.551128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037aafc-bd34-4223-a27f-ee278ffa980f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.551398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037aafc-bd34-4223-a27f-ee278ffa980f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.564005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037aafc-bd34-4223-a27f-ee278ffa980f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-7037aafc-bd34-4223-a27f-ee278ffa980f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:27.570333 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:27.571458 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:27.572395 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:27.572395 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:27.572395 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:27.572395 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:27.572395 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:27.572395 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:27.572395 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:27.572395 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:27.572395 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:27.572395 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:27.572395 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:27.572395 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:27.574661 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 113/216] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:27.581810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037aafc-bd34-4223-a27f-ee278ffa980f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:27.585117 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:27.669374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e7026-7195-4ac8-805d-dee50c0bbd4e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:27.671430 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:27.699758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037aafc-bd34-4223-a27f-ee278ffa980f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:27.709194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b206bd7-1fc9-4ba6-bfbe-6922387e1f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:27.709841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b206bd7-1fc9-4ba6-bfbe-6922387e1f36 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.710115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b206bd7-1fc9-4ba6-bfbe-6922387e1f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.710393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b206bd7-1fc9-4ba6-bfbe-6922387e1f36 None admin] PATH_INFO: `/v3/users/92365f2388f64270b35162ef9568bddf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.725775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b206bd7-1fc9-4ba6-bfbe-6922387e1f36 None admin] RBAC: Authorizing `identity:get_user(user_id=92365f2388f64270b35162ef9568bddf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:27.727370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b206bd7-1fc9-4ba6-bfbe-6922387e1f36 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:27.728937 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 104/217] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:27 2022] GET /identity/v3/users/92365f2388f64270b35162ef9568bddf => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:27.735330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b206bd7-1fc9-4ba6-bfbe-6922387e1f36 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:27.739580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b44cd3-6d4f-49b2-ac16-c2f69cdcc049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:27.740930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b44cd3-6d4f-49b2-ac16-c2f69cdcc049 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.740930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b44cd3-6d4f-49b2-ac16-c2f69cdcc049 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.740930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b44cd3-6d4f-49b2-ac16-c2f69cdcc049 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.741365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b44cd3-6d4f-49b2-ac16-c2f69cdcc049 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:27.741690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b44cd3-6d4f-49b2-ac16-c2f69cdcc049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:27.743139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b44cd3-6d4f-49b2-ac16-c2f69cdcc049 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:27.754370 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 114/218] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:27.760542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b44cd3-6d4f-49b2-ac16-c2f69cdcc049 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:27.838245 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:27.855708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b206bd7-1fc9-4ba6-bfbe-6922387e1f36 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:27.885049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b44cd3-6d4f-49b2-ac16-c2f69cdcc049 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:27.895527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42352fe-b944-4e8d-8bec-b5b6ead3ee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:27.896257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42352fe-b944-4e8d-8bec-b5b6ead3ee06 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.896531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42352fe-b944-4e8d-8bec-b5b6ead3ee06 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.896798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42352fe-b944-4e8d-8bec-b5b6ead3ee06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.897514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42352fe-b944-4e8d-8bec-b5b6ead3ee06 None admin] RBAC: Adding query filter params (role.id=b432183c244e40e0be2fdb9f5c438e77, user.id=92365f2388f64270b35162ef9568bddf, scope.system=all) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:27.897936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42352fe-b944-4e8d-8bec-b5b6ead3ee06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:27.899418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42352fe-b944-4e8d-8bec-b5b6ead3ee06 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:27.905412 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 105/219] 10.222.0.39 () {56 vars in 1308 bytes} [Sun Oct 16 00:45:27 2022] GET /identity/v3/role_assignments?user.id=92365f2388f64270b35162ef9568bddf&scope.system=all&role.id=b432183c244e40e0be2fdb9f5c438e77 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:27.929619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47559d2-0123-40a7-8c76-4fd4b3168769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:27.930198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47559d2-0123-40a7-8c76-4fd4b3168769 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:27.930481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47559d2-0123-40a7-8c76-4fd4b3168769 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:27.930765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47559d2-0123-40a7-8c76-4fd4b3168769 None admin] PATH_INFO: `/v3/users/772232fd8df64756baef7fbf1af7fcb1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:27.933325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47559d2-0123-40a7-8c76-4fd4b3168769 None admin] RBAC: Authorizing `identity:get_user(user_id=772232fd8df64756baef7fbf1af7fcb1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:27.934815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47559d2-0123-40a7-8c76-4fd4b3168769 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:27.936836 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 115/220] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:27 2022] GET /identity/v3/users/772232fd8df64756baef7fbf1af7fcb1 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:27.944104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42352fe-b944-4e8d-8bec-b5b6ead3ee06 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:27.974910 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:28.060906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42352fe-b944-4e8d-8bec-b5b6ead3ee06 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:28.099244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534da17-6985-4d6d-9a48-dac9e2d352d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:28.099863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534da17-6985-4d6d-9a48-dac9e2d352d1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:28.100138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534da17-6985-4d6d-9a48-dac9e2d352d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:28.100408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534da17-6985-4d6d-9a48-dac9e2d352d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:28.186485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534da17-6985-4d6d-9a48-dac9e2d352d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:28.187964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534da17-6985-4d6d-9a48-dac9e2d352d1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:28.215732 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:28.303596 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 106/221] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:45:28.309481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47559d2-0123-40a7-8c76-4fd4b3168769 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:28.416458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47559d2-0123-40a7-8c76-4fd4b3168769 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:28.447907 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:28.454003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645afe2-193e-4f46-a725-46e893c7d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:28.454980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645afe2-193e-4f46-a725-46e893c7d32d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:28.455495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645afe2-193e-4f46-a725-46e893c7d32d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:28.455969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645afe2-193e-4f46-a725-46e893c7d32d None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:28.457416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645afe2-193e-4f46-a725-46e893c7d32d None admin] RBAC: Authorizing `identity:get_project(project_id=1d68000826204dbf8bb077d105c52771)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:28.459099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645afe2-193e-4f46-a725-46e893c7d32d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:28.461266 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 116/222] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:28 2022] GET /identity/v3/projects/1d68000826204dbf8bb077d105c52771 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:28.467460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534da17-6985-4d6d-9a48-dac9e2d352d1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:28.576401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534da17-6985-4d6d-9a48-dac9e2d352d1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:28.602588 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:28.614643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5eda2-d568-4895-9735-2bdb022b9b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:28.615331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5eda2-d568-4895-9735-2bdb022b9b09 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:28.615616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5eda2-d568-4895-9735-2bdb022b9b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:28.615894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5eda2-d568-4895-9735-2bdb022b9b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:28.616620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5eda2-d568-4895-9735-2bdb022b9b09 None admin] RBAC: Adding query filter params (role.id=f4e5fecce17c4ed8bd87bf7405840365, scope.project.id=1d68000826204dbf8bb077d105c52771, user.id=772232fd8df64756baef7fbf1af7fcb1) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:28.616930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5eda2-d568-4895-9735-2bdb022b9b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:28.618427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5eda2-d568-4895-9735-2bdb022b9b09 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:28.624938 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 107/223] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:28 2022] GET /identity/v3/role_assignments?user.id=772232fd8df64756baef7fbf1af7fcb1&scope.project.id=1d68000826204dbf8bb077d105c52771&role.id=f4e5fecce17c4ed8bd87bf7405840365 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:29.925585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4c409-ba3d-49f8-a18b-e93328fcbf1f None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:29.926104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4c409-ba3d-49f8-a18b-e93328fcbf1f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:29.926104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4c409-ba3d-49f8-a18b-e93328fcbf1f None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:29.930988 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 117/224] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:29.935714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da6dce-f5ab-4a0f-b78c-f9b4cb72faf4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:29.936240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da6dce-f5ab-4a0f-b78c-f9b4cb72faf4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:29.936240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da6dce-f5ab-4a0f-b78c-f9b4cb72faf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:29.955015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b0da6dce-f5ab-4a0f-b78c-f9b4cb72faf4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:29.956668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b0da6dce-f5ab-4a0f-b78c-f9b4cb72faf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:30.029447 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 108/225] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:30.037254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930f723-009d-412d-82d2-8987e534211d None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.037543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930f723-009d-412d-82d2-8987e534211d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.037822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930f723-009d-412d-82d2-8987e534211d None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.039311 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 118/226] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:30.044195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2df9-5903-40ec-a8a7-8dcecbdcfccb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.044482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2df9-5903-40ec-a8a7-8dcecbdcfccb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.044755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2df9-5903-40ec-a8a7-8dcecbdcfccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.062526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-147c2df9-5903-40ec-a8a7-8dcecbdcfccb None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:30.063708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-147c2df9-5903-40ec-a8a7-8dcecbdcfccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:30.113089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9181a7-c223-4310-8b9b-a39a7bf63411 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.113620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9181a7-c223-4310-8b9b-a39a7bf63411 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.113906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9181a7-c223-4310-8b9b-a39a7bf63411 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.115726 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 119/227] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:30.124394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94d345-8aa1-41cb-8275-abc8b16aa68d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.124933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94d345-8aa1-41cb-8275-abc8b16aa68d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.125133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94d345-8aa1-41cb-8275-abc8b16aa68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.134966 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 109/228] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:45:30.144924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ae94d345-8aa1-41cb-8275-abc8b16aa68d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:30.146131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ae94d345-8aa1-41cb-8275-abc8b16aa68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:30.215411 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 120/229] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:45:30.308259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c2df9-5903-40ec-a8a7-8dcecbdcfccb None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.359801 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:30.406116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94d345-8aa1-41cb-8275-abc8b16aa68d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.412840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c2df9-5903-40ec-a8a7-8dcecbdcfccb None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:30.447987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ac45d-9a53-4f63-92f8-720c068e8f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:30.448615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ac45d-9a53-4f63-92f8-720c068e8f9f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.448888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ac45d-9a53-4f63-92f8-720c068e8f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.449161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ac45d-9a53-4f63-92f8-720c068e8f9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.459818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ac45d-9a53-4f63-92f8-720c068e8f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-595ac45d-9a53-4f63-92f8-720c068e8f9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:30.464596 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:30.465531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:30.466364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:30.466364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:30.466364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:30.466364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:30.466364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:30.466364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:30.466364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:30.466364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:30.466364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:30.466364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:30.466364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:30.466364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:30.466364 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 110/230] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:30.471381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ac45d-9a53-4f63-92f8-720c068e8f9f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.510706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94d345-8aa1-41cb-8275-abc8b16aa68d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:30.539502 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:30.545887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f5070-00ed-43a0-aeab-b271accad1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:30.546519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f5070-00ed-43a0-aeab-b271accad1ad None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.546797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f5070-00ed-43a0-aeab-b271accad1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.547099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f5070-00ed-43a0-aeab-b271accad1ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.548199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f5070-00ed-43a0-aeab-b271accad1ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:30.550147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f5070-00ed-43a0-aeab-b271accad1ad None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:30.551752 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 121/231] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:30.556299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f5070-00ed-43a0-aeab-b271accad1ad None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.573226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ac45d-9a53-4f63-92f8-720c068e8f9f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:30.582805 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:30.607242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efd7c7-fc33-41d0-91c7-55744e8fdf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:30.607845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efd7c7-fc33-41d0-91c7-55744e8fdf87 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.608119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efd7c7-fc33-41d0-91c7-55744e8fdf87 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.608386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efd7c7-fc33-41d0-91c7-55744e8fdf87 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.609037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efd7c7-fc33-41d0-91c7-55744e8fdf87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:30.609333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efd7c7-fc33-41d0-91c7-55744e8fdf87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:30.610712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efd7c7-fc33-41d0-91c7-55744e8fdf87 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:30.618673 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 111/232] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:30.619473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efd7c7-fc33-41d0-91c7-55744e8fdf87 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.660133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f5070-00ed-43a0-aeab-b271accad1ad None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:30.693630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962d09d-90ad-4d00-a877-ed37e8cf0b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:30.694289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962d09d-90ad-4d00-a877-ed37e8cf0b03 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.694566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962d09d-90ad-4d00-a877-ed37e8cf0b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.694832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962d09d-90ad-4d00-a877-ed37e8cf0b03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.704886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962d09d-90ad-4d00-a877-ed37e8cf0b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-5962d09d-90ad-4d00-a877-ed37e8cf0b03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:30.710247 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:30.711155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 122/233] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:30.712139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962d09d-90ad-4d00-a877-ed37e8cf0b03 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.719069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efd7c7-fc33-41d0-91c7-55744e8fdf87 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:30.751623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4d13d-2afe-44f1-9753-b0b115d86d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:30.752896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4d13d-2afe-44f1-9753-b0b115d86d73 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.753041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4d13d-2afe-44f1-9753-b0b115d86d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.753309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4d13d-2afe-44f1-9753-b0b115d86d73 None admin] PATH_INFO: `/v3/groups` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.753923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4d13d-2afe-44f1-9753-b0b115d86d73 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:30.755392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4d13d-2afe-44f1-9753-b0b115d86d73 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:30.772183 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:30.773662 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 112/234] 10.222.0.39 () {60 vars in 1134 bytes} [Sun Oct 16 00:45:30 2022] POST /identity/v3/groups => generated 229 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:30.775998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4d13d-2afe-44f1-9753-b0b115d86d73 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.809066 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:30.822573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962d09d-90ad-4d00-a877-ed37e8cf0b03 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:30.862852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfef23-c0ee-4e4b-b08b-aa9c9f534f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:30.863532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfef23-c0ee-4e4b-b08b-aa9c9f534f55 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.863812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfef23-c0ee-4e4b-b08b-aa9c9f534f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.864085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfef23-c0ee-4e4b-b08b-aa9c9f534f55 None admin] PATH_INFO: `/v3/users/60550dd494c743849abb8de89b82c8a1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.879996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfef23-c0ee-4e4b-b08b-aa9c9f534f55 None admin] RBAC: Authorizing `identity:get_user(user_id=60550dd494c743849abb8de89b82c8a1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:30.881485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfef23-c0ee-4e4b-b08b-aa9c9f534f55 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:30.883237 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 123/235] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/users/60550dd494c743849abb8de89b82c8a1 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:30.889122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfef23-c0ee-4e4b-b08b-aa9c9f534f55 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:30.891917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4d13d-2afe-44f1-9753-b0b115d86d73 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:30.928802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16c04b-7a7d-4fd2-bf3d-e8c8467217ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:30.929431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16c04b-7a7d-4fd2-bf3d-e8c8467217ba None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:30.929711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16c04b-7a7d-4fd2-bf3d-e8c8467217ba None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:30.929984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16c04b-7a7d-4fd2-bf3d-e8c8467217ba None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:30.930657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16c04b-7a7d-4fd2-bf3d-e8c8467217ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:30.930986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16c04b-7a7d-4fd2-bf3d-e8c8467217ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:30.932412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16c04b-7a7d-4fd2-bf3d-e8c8467217ba None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:30.941963 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 113/236] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:30.947673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16c04b-7a7d-4fd2-bf3d-e8c8467217ba None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:31.006479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfef23-c0ee-4e4b-b08b-aa9c9f534f55 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:31.025796 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:31.046803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e06d73-2302-4318-9462-647013476fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:31.047604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e06d73-2302-4318-9462-647013476fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:31.047877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e06d73-2302-4318-9462-647013476fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:31.048436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e06d73-2302-4318-9462-647013476fc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:31.049690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e06d73-2302-4318-9462-647013476fc8 None admin] RBAC: Adding query filter params (role.id=f4e5fecce17c4ed8bd87bf7405840365, user.id=60550dd494c743849abb8de89b82c8a1, scope.system=all) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:31.050004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e06d73-2302-4318-9462-647013476fc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:31.051935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e06d73-2302-4318-9462-647013476fc8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:31.055302 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:31.057003 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 124/237] 10.222.0.39 () {56 vars in 1308 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/role_assignments?user.id=60550dd494c743849abb8de89b82c8a1&scope.system=all&role.id=f4e5fecce17c4ed8bd87bf7405840365 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:31.067144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16c04b-7a7d-4fd2-bf3d-e8c8467217ba None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:31.104678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5477451-4ce0-425a-9516-3646f1a8999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:31.105322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5477451-4ce0-425a-9516-3646f1a8999e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:31.105603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5477451-4ce0-425a-9516-3646f1a8999e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:31.105877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5477451-4ce0-425a-9516-3646f1a8999e None admin] PATH_INFO: `/v3/users/92365f2388f64270b35162ef9568bddf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:31.107086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5477451-4ce0-425a-9516-3646f1a8999e None admin] RBAC: Authorizing `identity:get_user(user_id=92365f2388f64270b35162ef9568bddf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:31.108584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5477451-4ce0-425a-9516-3646f1a8999e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:31.110462 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 114/238] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:30 2022] GET /identity/v3/users/92365f2388f64270b35162ef9568bddf => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:31.116892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e06d73-2302-4318-9462-647013476fc8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:31.226774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e06d73-2302-4318-9462-647013476fc8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:31.262393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a1c12-a138-4d18-b767-a0b716470e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:31.262977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a1c12-a138-4d18-b767-a0b716470e58 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:31.263254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a1c12-a138-4d18-b767-a0b716470e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:31.263523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a1c12-a138-4d18-b767-a0b716470e58 None admin] PATH_INFO: `/v3/system/users/92365f2388f64270b35162ef9568bddf/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:31.264915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a1c12-a138-4d18-b767-a0b716470e58 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=92365f2388f64270b35162ef9568bddf, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:31.266280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a1c12-a138-4d18-b767-a0b716470e58 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:31.276203 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 125/239] 10.222.0.39 () {58 vars in 1334 bytes} [Sun Oct 16 00:45:31 2022] PUT /identity/v3/system/users/92365f2388f64270b35162ef9568bddf/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:32.978653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15844cb-1b31-4102-8c30-2d749b4728bd None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:32.979224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15844cb-1b31-4102-8c30-2d749b4728bd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:32.979224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15844cb-1b31-4102-8c30-2d749b4728bd None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:32.980891 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 115/240] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:32.986045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de31538-343a-4cb9-9bdb-b02b401ac6c4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:32.986749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de31538-343a-4cb9-9bdb-b02b401ac6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:32.986749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de31538-343a-4cb9-9bdb-b02b401ac6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.004795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4de31538-343a-4cb9-9bdb-b02b401ac6c4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:33.005967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4de31538-343a-4cb9-9bdb-b02b401ac6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:33.046154 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:33.075107 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 126/241] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:33.231849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f730fa-09a5-4e86-a824-9294e33de853 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.232127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f730fa-09a5-4e86-a824-9294e33de853 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.232328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f730fa-09a5-4e86-a824-9294e33de853 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.233816 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 116/242] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:33.239573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec00dc-bfa3-4c17-a115-98dae70e9d98 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.239863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec00dc-bfa3-4c17-a115-98dae70e9d98 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.240138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec00dc-bfa3-4c17-a115-98dae70e9d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.259396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-28ec00dc-bfa3-4c17-a115-98dae70e9d98 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:33.260571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-28ec00dc-bfa3-4c17-a115-98dae70e9d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:33.331054 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 127/243] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:33.345396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f730fa-09a5-4e86-a824-9294e33de853 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:33.438821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0254e-5553-4ca1-8228-37e8ed0e289d None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.439180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0254e-5553-4ca1-8228-37e8ed0e289d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.439488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0254e-5553-4ca1-8228-37e8ed0e289d None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.441978 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 128/244] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:33.447052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9de8e7-87f7-441a-a7b7-314cdca5ba49 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.447332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9de8e7-87f7-441a-a7b7-314cdca5ba49 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.447601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9de8e7-87f7-441a-a7b7-314cdca5ba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.450604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f730fa-09a5-4e86-a824-9294e33de853 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:33.468128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5f9de8e7-87f7-441a-a7b7-314cdca5ba49 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:33.469303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5f9de8e7-87f7-441a-a7b7-314cdca5ba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:33.490131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7b779-4958-4f90-bf31-528acbdf79f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:33.490688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7b779-4958-4f90-bf31-528acbdf79f2 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.490984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7b779-4958-4f90-bf31-528acbdf79f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.491255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7b779-4958-4f90-bf31-528acbdf79f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.492335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7b779-4958-4f90-bf31-528acbdf79f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:33.493755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7b779-4958-4f90-bf31-528acbdf79f2 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:33.495491 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 117/245] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:33.501112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7b779-4958-4f90-bf31-528acbdf79f2 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:33.535124 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:33.559069 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 129/246] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:45:33.601426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9de8e7-87f7-441a-a7b7-314cdca5ba49 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:33.613641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7b779-4958-4f90-bf31-528acbdf79f2 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:33.638577 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:33.647383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdbbdf-4e38-4f16-abe4-ebb3218aac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:33.647987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdbbdf-4e38-4f16-abe4-ebb3218aac81 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.648262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdbbdf-4e38-4f16-abe4-ebb3218aac81 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.648534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdbbdf-4e38-4f16-abe4-ebb3218aac81 None admin] PATH_INFO: `/v3/groups` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.649154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdbbdf-4e38-4f16-abe4-ebb3218aac81 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:33.650572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdbbdf-4e38-4f16-abe4-ebb3218aac81 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:33.666586 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 118/247] 10.222.0.39 () {60 vars in 1134 bytes} [Sun Oct 16 00:45:33 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:45:33.716386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9de8e7-87f7-441a-a7b7-314cdca5ba49 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:33.754506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53932c5-6073-4403-9b0a-3532f33e25bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:33.755415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53932c5-6073-4403-9b0a-3532f33e25bf None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.755858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53932c5-6073-4403-9b0a-3532f33e25bf None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.756269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53932c5-6073-4403-9b0a-3532f33e25bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.767972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53932c5-6073-4403-9b0a-3532f33e25bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-c53932c5-6073-4403-9b0a-3532f33e25bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:33.773095 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:33.774195 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:33.775176 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:33.775176 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:33.775176 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:33.775176 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:33.775176 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:33.775176 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:33.775176 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:33.775176 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:33.775176 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:33.775176 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:33.775176 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:33.775176 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:33.777174 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 130/248] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:33.784530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdbbdf-4e38-4f16-abe4-ebb3218aac81 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:33.826198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53932c5-6073-4403-9b0a-3532f33e25bf None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:33.883715 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:33.900791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdbbdf-4e38-4f16-abe4-ebb3218aac81 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:33.932476 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:33.943309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53932c5-6073-4403-9b0a-3532f33e25bf None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:33.943846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff53f0-0b33-47df-8273-68ec2f80257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:33.944461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff53f0-0b33-47df-8273-68ec2f80257a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.944737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff53f0-0b33-47df-8273-68ec2f80257a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.945007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff53f0-0b33-47df-8273-68ec2f80257a None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:33.945665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff53f0-0b33-47df-8273-68ec2f80257a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:33.945962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff53f0-0b33-47df-8273-68ec2f80257a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:33.947373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff53f0-0b33-47df-8273-68ec2f80257a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:33.958212 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 119/249] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:33.965636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff53f0-0b33-47df-8273-68ec2f80257a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:33.987298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97151f8-1002-44e3-8e6a-59c85e8305a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:33.987928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97151f8-1002-44e3-8e6a-59c85e8305a6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:33.988237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97151f8-1002-44e3-8e6a-59c85e8305a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:33.988483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97151f8-1002-44e3-8e6a-59c85e8305a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.001350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97151f8-1002-44e3-8e6a-59c85e8305a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f97151f8-1002-44e3-8e6a-59c85e8305a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:34.006750 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:34.007673 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:34.008454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:34.008454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:34.008454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:34.008454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:34.008454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:34.008454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:34.008454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:34.008454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:34.008454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:34.008454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:34.008454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:34.008454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:34.008454 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 131/250] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:34.015731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97151f8-1002-44e3-8e6a-59c85e8305a6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:34.089706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff53f0-0b33-47df-8273-68ec2f80257a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.132393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698833e-87e5-437a-ab42-e0fd0f7f706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.133035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698833e-87e5-437a-ab42-e0fd0f7f706d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.133323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698833e-87e5-437a-ab42-e0fd0f7f706d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.133576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698833e-87e5-437a-ab42-e0fd0f7f706d None admin] PATH_INFO: `/v3/users/60550dd494c743849abb8de89b82c8a1` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.134790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698833e-87e5-437a-ab42-e0fd0f7f706d None admin] RBAC: Authorizing `identity:get_user(user_id=60550dd494c743849abb8de89b82c8a1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:34.136302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698833e-87e5-437a-ab42-e0fd0f7f706d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:34.138189 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 120/251] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:33 2022] GET /identity/v3/users/60550dd494c743849abb8de89b82c8a1 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:34.144799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698833e-87e5-437a-ab42-e0fd0f7f706d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:34.145807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97151f8-1002-44e3-8e6a-59c85e8305a6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.171312 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:34.195021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bbc92-b7f8-45ce-99a6-e17c8950cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.195658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bbc92-b7f8-45ce-99a6-e17c8950cae9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.195939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bbc92-b7f8-45ce-99a6-e17c8950cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.196238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bbc92-b7f8-45ce-99a6-e17c8950cae9 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.196940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bbc92-b7f8-45ce-99a6-e17c8950cae9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:34.197246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bbc92-b7f8-45ce-99a6-e17c8950cae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:34.198899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bbc92-b7f8-45ce-99a6-e17c8950cae9 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:34.211395 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 132/252] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:34.216090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bbc92-b7f8-45ce-99a6-e17c8950cae9 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:34.241628 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:34.269608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698833e-87e5-437a-ab42-e0fd0f7f706d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.312457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788a8ea-0f5c-4a74-892f-35e0f620731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.314018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788a8ea-0f5c-4a74-892f-35e0f620731e None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.315129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788a8ea-0f5c-4a74-892f-35e0f620731e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.315535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788a8ea-0f5c-4a74-892f-35e0f620731e None admin] PATH_INFO: `/v3/system/users/60550dd494c743849abb8de89b82c8a1/roles/f4e5fecce17c4ed8bd87bf7405840365` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.317019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788a8ea-0f5c-4a74-892f-35e0f620731e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=60550dd494c743849abb8de89b82c8a1, role_id=f4e5fecce17c4ed8bd87bf7405840365)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:34.318938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788a8ea-0f5c-4a74-892f-35e0f620731e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:34.333000 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 121/253] 10.222.0.39 () {58 vars in 1334 bytes} [Sun Oct 16 00:45:34 2022] PUT /identity/v3/system/users/60550dd494c743849abb8de89b82c8a1/roles/f4e5fecce17c4ed8bd87bf7405840365 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:34.352714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bbc92-b7f8-45ce-99a6-e17c8950cae9 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.396291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db7e71-915b-4d52-a1e2-1949235544de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.397085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db7e71-915b-4d52-a1e2-1949235544de None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.397369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db7e71-915b-4d52-a1e2-1949235544de None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.397641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db7e71-915b-4d52-a1e2-1949235544de None admin] PATH_INFO: `/v3/users/92365f2388f64270b35162ef9568bddf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.398816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db7e71-915b-4d52-a1e2-1949235544de None admin] RBAC: Authorizing `identity:get_user(user_id=92365f2388f64270b35162ef9568bddf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:34.400329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db7e71-915b-4d52-a1e2-1949235544de None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:34.407053 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 133/254] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:34 2022] GET /identity/v3/users/92365f2388f64270b35162ef9568bddf => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:34.409940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788a8ea-0f5c-4a74-892f-35e0f620731e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:34.504893 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:34.527179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788a8ea-0f5c-4a74-892f-35e0f620731e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:34.569658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb477d-325c-4df4-9470-e88fd05eaaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:34.570275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb477d-325c-4df4-9470-e88fd05eaaef None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:34.570545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb477d-325c-4df4-9470-e88fd05eaaef None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:34.570810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb477d-325c-4df4-9470-e88fd05eaaef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:34.571559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb477d-325c-4df4-9470-e88fd05eaaef None admin] RBAC: Adding query filter params (role.id=b432183c244e40e0be2fdb9f5c438e77, user.id=92365f2388f64270b35162ef9568bddf, scope.system=all) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:34.571863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb477d-325c-4df4-9470-e88fd05eaaef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:34.573331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb477d-325c-4df4-9470-e88fd05eaaef None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:34.589703 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 122/255] 10.222.0.39 () {56 vars in 1308 bytes} [Sun Oct 16 00:45:34 2022] GET /identity/v3/role_assignments?user.id=92365f2388f64270b35162ef9568bddf&scope.system=all&role.id=b432183c244e40e0be2fdb9f5c438e77 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:36.063841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c90b82-305a-4ed9-b0c0-8b8411797e51 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:36.065760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c90b82-305a-4ed9-b0c0-8b8411797e51 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:36.065760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c90b82-305a-4ed9-b0c0-8b8411797e51 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:36.066600 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 134/256] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:36.071819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6052420-7406-4190-bdbc-3b01c4f9cdc6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:36.072255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6052420-7406-4190-bdbc-3b01c4f9cdc6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:36.072432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6052420-7406-4190-bdbc-3b01c4f9cdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:36.099903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b6052420-7406-4190-bdbc-3b01c4f9cdc6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:36.101172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b6052420-7406-4190-bdbc-3b01c4f9cdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:36.181637 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 123/257] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:45:36.585006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800933-c348-4089-a0f3-746900890029 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:36.585351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800933-c348-4089-a0f3-746900890029 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:36.585552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800933-c348-4089-a0f3-746900890029 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:36.587137 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 135/258] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:36.592585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808ee14-25c0-452e-bd87-2af89ef62d1e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:36.593208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808ee14-25c0-452e-bd87-2af89ef62d1e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:36.593675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808ee14-25c0-452e-bd87-2af89ef62d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:36.624188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2808ee14-25c0-452e-bd87-2af89ef62d1e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:36.625700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2808ee14-25c0-452e-bd87-2af89ef62d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:36.638611 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 124/259] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:45:36.709018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f800933-c348-4089-a0f3-746900890029 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:36.726164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f800933-c348-4089-a0f3-746900890029 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:36.730896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e49e-45f3-489b-9484-33e784a1ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:36.731786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e49e-45f3-489b-9484-33e784a1ee60 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:36.732254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e49e-45f3-489b-9484-33e784a1ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:36.732716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e49e-45f3-489b-9484-33e784a1ee60 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:36.747519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1e49e-45f3-489b-9484-33e784a1ee60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-0be1e49e-45f3-489b-9484-33e784a1ee60 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:36.753708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:36.754546 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:36.755355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:36.755355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:36.755355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:36.755355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:36.755355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:36.755355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:36.755355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:36.755355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:36.755355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:36.755355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:36.755355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:36.755355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:36.760548 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 136/260] 10.222.0.39 () {56 vars in 1120 bytes} [Sun Oct 16 00:45:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:36.763214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808ee14-25c0-452e-bd87-2af89ef62d1e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:36.773919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808ee14-25c0-452e-bd87-2af89ef62d1e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:36.783533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7cd4a-13ca-4628-ba93-ab06ea146bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:36.785046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7cd4a-13ca-4628-ba93-ab06ea146bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:36.785532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7cd4a-13ca-4628-ba93-ab06ea146bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:36.785991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7cd4a-13ca-4628-ba93-ab06ea146bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:36.786856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7cd4a-13ca-4628-ba93-ab06ea146bb9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:36.787363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7cd4a-13ca-4628-ba93-ab06ea146bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:36.789463 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-0db7cd4a-13ca-4628-ba93-ab06ea146bb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:45:36.789463 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 00:45:36.789463 n-d-master-1 devstack@keystone.service[81805]: Oct 16 00:45:36.790672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7cd4a-13ca-4628-ba93-ab06ea146bb9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:36.803765 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 125/261] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Oct 16 00:45:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:36.808872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e49e-45f3-489b-9484-33e784a1ee60 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:36.820349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e49e-45f3-489b-9484-33e784a1ee60 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:36.828066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0b898-7573-49bd-811a-8ecffe010ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:36.828915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0b898-7573-49bd-811a-8ecffe010ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:36.829404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0b898-7573-49bd-811a-8ecffe010ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:36.830145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0b898-7573-49bd-811a-8ecffe010ea8 admin admin] PATH_INFO: `/v3/groups/f00d0ae485d64eefa2912b41043978fe` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:36.838157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0b898-7573-49bd-811a-8ecffe010ea8 admin admin] RBAC: Authorizing `identity:get_group(group_id=f00d0ae485d64eefa2912b41043978fe)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:36.840188 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-02b0b898-7573-49bd-811a-8ecffe010ea8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:45:36.840188 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 00:45:36.840188 n-d-master-1 devstack@keystone.service[81804]: Oct 16 00:45:36.841835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0b898-7573-49bd-811a-8ecffe010ea8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:36.844063 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 137/262] 10.222.0.39 () {56 vars in 1201 bytes} [Sun Oct 16 00:45:36 2022] GET /identity/v3/groups/f00d0ae485d64eefa2912b41043978fe => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:36.849985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7cd4a-13ca-4628-ba93-ab06ea146bb9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:36.864939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7cd4a-13ca-4628-ba93-ab06ea146bb9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:36.874538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a5945-cc46-4efe-a739-c502c67b5ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:36.875216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a5945-cc46-4efe-a739-c502c67b5ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:36.875496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a5945-cc46-4efe-a739-c502c67b5ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:36.875770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a5945-cc46-4efe-a739-c502c67b5ca5 admin admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:36.876953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a5945-cc46-4efe-a739-c502c67b5ca5 admin admin] RBAC: Authorizing `identity:get_project(project_id=c1774c4e131e4cd592c124840e1bacb5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:36.879070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a5945-cc46-4efe-a739-c502c67b5ca5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:36.880719 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 126/263] 10.222.0.39 () {56 vars in 1207 bytes} [Sun Oct 16 00:45:36 2022] GET /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:36.886463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0b898-7573-49bd-811a-8ecffe010ea8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:36.898590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0b898-7573-49bd-811a-8ecffe010ea8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:36.903492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fabe0-c553-4e79-ba68-c43e4ea4f8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:36.904705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fabe0-c553-4e79-ba68-c43e4ea4f8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:36.905177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fabe0-c553-4e79-ba68-c43e4ea4f8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:36.905690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fabe0-c553-4e79-ba68-c43e4ea4f8cc admin admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5/groups/f00d0ae485d64eefa2912b41043978fe/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:36.910759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fabe0-c553-4e79-ba68-c43e4ea4f8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1774c4e131e4cd592c124840e1bacb5, group_id=f00d0ae485d64eefa2912b41043978fe, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:36.912146 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-676fabe0-c553-4e79-ba68-c43e4ea4f8cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:45:36.912146 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 00:45:36.912146 n-d-master-1 devstack@keystone.service[81804]: Oct 16 00:45:36.914661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fabe0-c553-4e79-ba68-c43e4ea4f8cc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:36.934322 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 138/264] 10.222.0.39 () {58 vars in 1463 bytes} [Sun Oct 16 00:45:36 2022] PUT /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5/groups/f00d0ae485d64eefa2912b41043978fe/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:37.135829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a5945-cc46-4efe-a739-c502c67b5ca5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:37.148637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a5945-cc46-4efe-a739-c502c67b5ca5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:37.219636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f7278-5c62-43d4-9170-bccf190b2e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:37.220284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f7278-5c62-43d4-9170-bccf190b2e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:37.220612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f7278-5c62-43d4-9170-bccf190b2e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:37.220866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f7278-5c62-43d4-9170-bccf190b2e93 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:37.238666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f7278-5c62-43d4-9170-bccf190b2e93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f78f7278-5c62-43d4-9170-bccf190b2e93 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:37.243767 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:37.244696 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:37.245903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:37.245903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:37.245903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:37.245903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:37.245903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:37.245903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:37.245903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:37.245903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:37.245903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:37.245903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:37.245903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:37.245903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:37.245903 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 127/265] 10.222.0.39 () {56 vars in 1135 bytes} [Sun Oct 16 00:45:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:37.251234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fabe0-c553-4e79-ba68-c43e4ea4f8cc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:37.267121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fabe0-c553-4e79-ba68-c43e4ea4f8cc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:37.278415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25df1c-5898-4a1c-9481-7fdfd0d300e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:37.279703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25df1c-5898-4a1c-9481-7fdfd0d300e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:37.280177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25df1c-5898-4a1c-9481-7fdfd0d300e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:37.280684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25df1c-5898-4a1c-9481-7fdfd0d300e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:37.281564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25df1c-5898-4a1c-9481-7fdfd0d300e2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:37.282089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25df1c-5898-4a1c-9481-7fdfd0d300e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:37.283455 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-9e25df1c-5898-4a1c-9481-7fdfd0d300e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:45:37.283455 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 00:45:37.283455 n-d-master-1 devstack@keystone.service[81804]: Oct 16 00:45:37.284792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25df1c-5898-4a1c-9481-7fdfd0d300e2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:37.299427 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 139/266] 10.222.0.39 () {56 vars in 1132 bytes} [Sun Oct 16 00:45:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:37.305034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f7278-5c62-43d4-9170-bccf190b2e93 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:37.319381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f7278-5c62-43d4-9170-bccf190b2e93 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:37.324264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f07902-7695-4b1e-9e7d-0c62c35a7928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:37.324885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f07902-7695-4b1e-9e7d-0c62c35a7928 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:37.325159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f07902-7695-4b1e-9e7d-0c62c35a7928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:37.325425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f07902-7695-4b1e-9e7d-0c62c35a7928 admin admin] PATH_INFO: `/v3/groups/f00d0ae485d64eefa2912b41043978fe` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:37.326513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f07902-7695-4b1e-9e7d-0c62c35a7928 admin admin] RBAC: Authorizing `identity:get_group(group_id=f00d0ae485d64eefa2912b41043978fe)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:37.327593 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-f0f07902-7695-4b1e-9e7d-0c62c35a7928 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:45:37.327593 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 00:45:37.327593 n-d-master-1 devstack@keystone.service[81805]: Oct 16 00:45:37.328770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f07902-7695-4b1e-9e7d-0c62c35a7928 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:37.331536 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 128/267] 10.222.0.39 () {56 vars in 1201 bytes} [Sun Oct 16 00:45:37 2022] GET /identity/v3/groups/f00d0ae485d64eefa2912b41043978fe => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:37.337001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25df1c-5898-4a1c-9481-7fdfd0d300e2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:37.347956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25df1c-5898-4a1c-9481-7fdfd0d300e2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:37.354352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a1fe2-9a72-43c3-8097-99b092afe43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:37.355319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a1fe2-9a72-43c3-8097-99b092afe43a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:37.355826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a1fe2-9a72-43c3-8097-99b092afe43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:37.356309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a1fe2-9a72-43c3-8097-99b092afe43a admin admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:37.359179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a1fe2-9a72-43c3-8097-99b092afe43a admin admin] RBAC: Authorizing `identity:get_project(project_id=c1774c4e131e4cd592c124840e1bacb5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:37.362105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a1fe2-9a72-43c3-8097-99b092afe43a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:37.364114 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 140/268] 10.222.0.39 () {56 vars in 1207 bytes} [Sun Oct 16 00:45:37 2022] GET /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:37.369896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f07902-7695-4b1e-9e7d-0c62c35a7928 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:37.375341 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:37.382117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f07902-7695-4b1e-9e7d-0c62c35a7928 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:37.387892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f07b8-b622-40c5-b0a3-771f57843ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:37.388987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f07b8-b622-40c5-b0a3-771f57843ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:37.389530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f07b8-b622-40c5-b0a3-771f57843ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:37.389995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f07b8-b622-40c5-b0a3-771f57843ea6 admin admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5/groups/f00d0ae485d64eefa2912b41043978fe/roles/2ff561b5b0d24a468ca2bfa7d0788bd2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:37.392565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f07b8-b622-40c5-b0a3-771f57843ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1774c4e131e4cd592c124840e1bacb5, group_id=f00d0ae485d64eefa2912b41043978fe, role_id=2ff561b5b0d24a468ca2bfa7d0788bd2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:37.394156 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-d94f07b8-b622-40c5-b0a3-771f57843ea6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:45:37.394156 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 00:45:37.394156 n-d-master-1 devstack@keystone.service[81805]: Oct 16 00:45:37.396605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f07b8-b622-40c5-b0a3-771f57843ea6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:37.417158 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 129/269] 10.222.0.39 () {58 vars in 1463 bytes} [Sun Oct 16 00:45:37 2022] PUT /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5/groups/f00d0ae485d64eefa2912b41043978fe/roles/2ff561b5b0d24a468ca2bfa7d0788bd2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:37.549461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bac72-b570-428d-aadb-6319db5da983 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:37.550610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bac72-b570-428d-aadb-6319db5da983 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:37.551140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bac72-b570-428d-aadb-6319db5da983 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:37.552955 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 141/270] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:37.562945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e421ba-d16f-4be3-a06a-bf5c5bff934f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:37.562945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e421ba-d16f-4be3-a06a-bf5c5bff934f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:37.562945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e421ba-d16f-4be3-a06a-bf5c5bff934f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:37.587997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e0e421ba-d16f-4be3-a06a-bf5c5bff934f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:37.589203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e0e421ba-d16f-4be3-a06a-bf5c5bff934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:37.602614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ea6eb-2aa7-49e5-8960-b0b7754ce06a None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:37.603249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ea6eb-2aa7-49e5-8960-b0b7754ce06a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:37.603805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ea6eb-2aa7-49e5-8960-b0b7754ce06a None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:37.605735 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 142/271] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:37.618600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4620ac-4cea-4830-a521-373ed7795b78 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:37.619238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4620ac-4cea-4830-a521-373ed7795b78 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:37.619709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4620ac-4cea-4830-a521-373ed7795b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:37.648165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ad4620ac-4cea-4830-a521-373ed7795b78 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:37.649680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ad4620ac-4cea-4830-a521-373ed7795b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:37.699321 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:37.701777 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 130/272] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:37.722377 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 143/273] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 16 00:45:38.014796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e421ba-d16f-4be3-a06a-bf5c5bff934f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:38.132917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4620ac-4cea-4830-a521-373ed7795b78 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:38.140644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e421ba-d16f-4be3-a06a-bf5c5bff934f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:38.151564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4620ac-4cea-4830-a521-373ed7795b78 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:38.161543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53165e5c-f190-40a6-aec9-b172b2fb25df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:38.162183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53165e5c-f190-40a6-aec9-b172b2fb25df admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:38.162524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53165e5c-f190-40a6-aec9-b172b2fb25df admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:38.162804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53165e5c-f190-40a6-aec9-b172b2fb25df admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:38.164909 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:38.182274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f4eab-ec30-4032-86e8-57bf800b59cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:38.183348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4eab-ec30-4032-86e8-57bf800b59cb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:38.183666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4eab-ec30-4032-86e8-57bf800b59cb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:38.183936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4eab-ec30-4032-86e8-57bf800b59cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:38.184251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53165e5c-f190-40a6-aec9-b172b2fb25df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-53165e5c-f190-40a6-aec9-b172b2fb25df admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:38.195135 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:38.196062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:38.196844 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:38.196844 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:38.196844 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:38.196844 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:38.196844 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:38.196844 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:38.196844 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:38.196844 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:38.196844 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:38.196844 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:38.196844 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:38.196844 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:38.197439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f4eab-ec30-4032-86e8-57bf800b59cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:38.197509 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 144/274] 10.222.0.39 () {56 vars in 1120 bytes} [Sun Oct 16 00:45:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:38.202545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53165e5c-f190-40a6-aec9-b172b2fb25df admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f95f4eab-ec30-4032-86e8-57bf800b59cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:38.202725 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:38.203794 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:38.204724 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:38.204724 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:38.204724 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:38.204724 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:38.204724 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:38.204724 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:38.204724 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:38.204724 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:38.204724 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:38.204724 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:38.204724 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:45:38.204724 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:38.204724 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 131/275] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:38.214079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f4eab-ec30-4032-86e8-57bf800b59cb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:38.222719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53165e5c-f190-40a6-aec9-b172b2fb25df admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:38.231448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd7689-1e9f-4b6b-ba46-aa874b2eb373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:38.232359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd7689-1e9f-4b6b-ba46-aa874b2eb373 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:38.232647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd7689-1e9f-4b6b-ba46-aa874b2eb373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:38.232921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd7689-1e9f-4b6b-ba46-aa874b2eb373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:38.233590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd7689-1e9f-4b6b-ba46-aa874b2eb373 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:38.233897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd7689-1e9f-4b6b-ba46-aa874b2eb373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:38.235551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd7689-1e9f-4b6b-ba46-aa874b2eb373 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:38.250400 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 145/276] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Oct 16 00:45:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:38.256232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd7689-1e9f-4b6b-ba46-aa874b2eb373 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:38.268732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd7689-1e9f-4b6b-ba46-aa874b2eb373 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:38.273777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f2c91-750c-4f96-9f05-655182259178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:38.275456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2c91-750c-4f96-9f05-655182259178 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:38.275729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2c91-750c-4f96-9f05-655182259178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:38.276055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2c91-750c-4f96-9f05-655182259178 admin admin] PATH_INFO: `/v3/groups/f00d0ae485d64eefa2912b41043978fe` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:38.277255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f2c91-750c-4f96-9f05-655182259178 admin admin] RBAC: Authorizing `identity:get_group(group_id=f00d0ae485d64eefa2912b41043978fe)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:38.279603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f2c91-750c-4f96-9f05-655182259178 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:38.282039 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 146/277] 10.222.0.39 () {56 vars in 1201 bytes} [Sun Oct 16 00:45:38 2022] GET /identity/v3/groups/f00d0ae485d64eefa2912b41043978fe => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:38.283954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5544-7394-40cd-915f-ce2efa38cb56 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:38.284299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5544-7394-40cd-915f-ce2efa38cb56 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:38.284576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5544-7394-40cd-915f-ce2efa38cb56 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:38.286315 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 147/278] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:38.292515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956809-a3c7-4c9f-8b08-99207e7c69c8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:38.292807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956809-a3c7-4c9f-8b08-99207e7c69c8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:38.293217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956809-a3c7-4c9f-8b08-99207e7c69c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:38.316595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9b956809-a3c7-4c9f-8b08-99207e7c69c8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:38.317811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9b956809-a3c7-4c9f-8b08-99207e7c69c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:38.336237 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 148/279] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:45:38.337085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956809-a3c7-4c9f-8b08-99207e7c69c8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:38.358880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956809-a3c7-4c9f-8b08-99207e7c69c8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:38.370606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0ade9-1b5b-443d-88c7-17829dae59a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:38.371275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0ade9-1b5b-443d-88c7-17829dae59a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:38.371553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0ade9-1b5b-443d-88c7-17829dae59a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:38.371823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0ade9-1b5b-443d-88c7-17829dae59a3 admin admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:38.375288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0ade9-1b5b-443d-88c7-17829dae59a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d68000826204dbf8bb077d105c52771)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:38.377591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0ade9-1b5b-443d-88c7-17829dae59a3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:38.379798 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 149/280] 10.222.0.39 () {56 vars in 1207 bytes} [Sun Oct 16 00:45:38 2022] GET /identity/v3/projects/1d68000826204dbf8bb077d105c52771 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:38.386364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0ade9-1b5b-443d-88c7-17829dae59a3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:38.398980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0ade9-1b5b-443d-88c7-17829dae59a3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:38.406237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ebf68-79dd-4e18-afea-30c7b519fa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:38.407119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ebf68-79dd-4e18-afea-30c7b519fa42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:38.407230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ebf68-79dd-4e18-afea-30c7b519fa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:38.407561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ebf68-79dd-4e18-afea-30c7b519fa42 admin admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771/groups/f00d0ae485d64eefa2912b41043978fe/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:38.408643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f4eab-ec30-4032-86e8-57bf800b59cb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:38.413914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ebf68-79dd-4e18-afea-30c7b519fa42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d68000826204dbf8bb077d105c52771, group_id=f00d0ae485d64eefa2912b41043978fe, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:38.416969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ebf68-79dd-4e18-afea-30c7b519fa42 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:38.447316 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 150/281] 10.222.0.39 () {58 vars in 1463 bytes} [Sun Oct 16 00:45:38 2022] PUT /identity/v3/projects/1d68000826204dbf8bb077d105c52771/groups/f00d0ae485d64eefa2912b41043978fe/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:45:38.474652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdbed8-e1e0-4e80-bbc7-c920746ccafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:38.475322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdbed8-e1e0-4e80-bbc7-c920746ccafd None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:38.475596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdbed8-e1e0-4e80-bbc7-c920746ccafd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:38.475862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdbed8-e1e0-4e80-bbc7-c920746ccafd None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:38.476543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdbed8-e1e0-4e80-bbc7-c920746ccafd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:38.476841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdbed8-e1e0-4e80-bbc7-c920746ccafd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:38.478279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdbed8-e1e0-4e80-bbc7-c920746ccafd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:38.491829 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 132/282] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:38.497646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ebf68-79dd-4e18-afea-30c7b519fa42 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:38.684520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ebf68-79dd-4e18-afea-30c7b519fa42 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:38.727009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad370272-1172-42d6-87cd-d42b0f7e6877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:38.727645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad370272-1172-42d6-87cd-d42b0f7e6877 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:38.727925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad370272-1172-42d6-87cd-d42b0f7e6877 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:38.728199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad370272-1172-42d6-87cd-d42b0f7e6877 None admin] PATH_INFO: `/v3/users/60550dd494c743849abb8de89b82c8a1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:38.729341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad370272-1172-42d6-87cd-d42b0f7e6877 None admin] RBAC: Authorizing `identity:get_user(user_id=60550dd494c743849abb8de89b82c8a1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:38.730910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad370272-1172-42d6-87cd-d42b0f7e6877 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:38.732578 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 151/283] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:38 2022] GET /identity/v3/users/60550dd494c743849abb8de89b82c8a1 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:38.739122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdbed8-e1e0-4e80-bbc7-c920746ccafd None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:38.822329 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:38.885428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad370272-1172-42d6-87cd-d42b0f7e6877 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:38.895206 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:38.901039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdbed8-e1e0-4e80-bbc7-c920746ccafd None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:38.968249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad824fed-c438-4a50-aa24-3610b6c674ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:38.968869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad824fed-c438-4a50-aa24-3610b6c674ad None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:38.969145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad824fed-c438-4a50-aa24-3610b6c674ad None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:38.969416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad824fed-c438-4a50-aa24-3610b6c674ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:38.970139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad824fed-c438-4a50-aa24-3610b6c674ad None admin] RBAC: Adding query filter params (role.id=f4e5fecce17c4ed8bd87bf7405840365, user.id=60550dd494c743849abb8de89b82c8a1, scope.system=all) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:38.971007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad824fed-c438-4a50-aa24-3610b6c674ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:38.972628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad824fed-c438-4a50-aa24-3610b6c674ad None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:38.994439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad370272-1172-42d6-87cd-d42b0f7e6877 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:38.999101 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 133/284] 10.222.0.39 () {56 vars in 1308 bytes} [Sun Oct 16 00:45:38 2022] GET /identity/v3/role_assignments?user.id=60550dd494c743849abb8de89b82c8a1&scope.system=all&role.id=f4e5fecce17c4ed8bd87bf7405840365 => generated 510 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:39.002454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93529f4-c57f-48d6-a7a9-ed309218b484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:39.003135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93529f4-c57f-48d6-a7a9-ed309218b484 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:39.003408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93529f4-c57f-48d6-a7a9-ed309218b484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:39.003680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93529f4-c57f-48d6-a7a9-ed309218b484 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:39.019592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93529f4-c57f-48d6-a7a9-ed309218b484 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f93529f4-c57f-48d6-a7a9-ed309218b484 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:39.025179 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:39.027640 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:39.029790 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:39.029790 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:39.029790 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:39.029790 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:39.029790 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:39.029790 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:39.029790 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:39.029790 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:39.029790 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:39.029790 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:39.029790 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:39.029790 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:39.029790 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 152/285] 10.222.0.39 () {56 vars in 1135 bytes} [Sun Oct 16 00:45:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:39.034956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad824fed-c438-4a50-aa24-3610b6c674ad None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:39.047944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad824fed-c438-4a50-aa24-3610b6c674ad None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:39.052764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27c29d-9158-4c37-9df9-c492d15a81cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:39.053367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27c29d-9158-4c37-9df9-c492d15a81cc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:39.053645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27c29d-9158-4c37-9df9-c492d15a81cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:39.053918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27c29d-9158-4c37-9df9-c492d15a81cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:39.054583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27c29d-9158-4c37-9df9-c492d15a81cc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:39.054880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27c29d-9158-4c37-9df9-c492d15a81cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:39.056579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27c29d-9158-4c37-9df9-c492d15a81cc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:39.068331 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 134/286] 10.222.0.39 () {56 vars in 1132 bytes} [Sun Oct 16 00:45:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:39.073925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93529f4-c57f-48d6-a7a9-ed309218b484 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:39.088936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93529f4-c57f-48d6-a7a9-ed309218b484 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:39.099470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec65956-f262-4d94-8dca-f95e534ca4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:39.100194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec65956-f262-4d94-8dca-f95e534ca4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:39.100478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec65956-f262-4d94-8dca-f95e534ca4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:39.100747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec65956-f262-4d94-8dca-f95e534ca4c8 admin admin] PATH_INFO: `/v3/groups/f00d0ae485d64eefa2912b41043978fe` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:39.107667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec65956-f262-4d94-8dca-f95e534ca4c8 admin admin] RBAC: Authorizing `identity:get_group(group_id=f00d0ae485d64eefa2912b41043978fe)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:39.109638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec65956-f262-4d94-8dca-f95e534ca4c8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:39.111527 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 153/287] 10.222.0.39 () {56 vars in 1201 bytes} [Sun Oct 16 00:45:39 2022] GET /identity/v3/groups/f00d0ae485d64eefa2912b41043978fe => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:39.117955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27c29d-9158-4c37-9df9-c492d15a81cc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:39.132522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27c29d-9158-4c37-9df9-c492d15a81cc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:39.143641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bdc7e-c224-4ba3-bff1-2b8a1fad5d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:39.145068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bdc7e-c224-4ba3-bff1-2b8a1fad5d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:39.145558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bdc7e-c224-4ba3-bff1-2b8a1fad5d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:39.146016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bdc7e-c224-4ba3-bff1-2b8a1fad5d43 admin admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:39.151691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bdc7e-c224-4ba3-bff1-2b8a1fad5d43 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d68000826204dbf8bb077d105c52771)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:39.154271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bdc7e-c224-4ba3-bff1-2b8a1fad5d43 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:39.156524 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 135/288] 10.222.0.39 () {56 vars in 1207 bytes} [Sun Oct 16 00:45:39 2022] GET /identity/v3/projects/1d68000826204dbf8bb077d105c52771 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:39.163179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec65956-f262-4d94-8dca-f95e534ca4c8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:39.177168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec65956-f262-4d94-8dca-f95e534ca4c8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:39.186628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb40c37-4c44-4016-8751-4d8e9db5463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:39.187343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb40c37-4c44-4016-8751-4d8e9db5463a admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:39.187627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb40c37-4c44-4016-8751-4d8e9db5463a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:39.187897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb40c37-4c44-4016-8751-4d8e9db5463a admin admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771/groups/f00d0ae485d64eefa2912b41043978fe/roles/2ff561b5b0d24a468ca2bfa7d0788bd2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:39.190523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb40c37-4c44-4016-8751-4d8e9db5463a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d68000826204dbf8bb077d105c52771, group_id=f00d0ae485d64eefa2912b41043978fe, role_id=2ff561b5b0d24a468ca2bfa7d0788bd2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:39.193281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb40c37-4c44-4016-8751-4d8e9db5463a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:39.210357 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 154/289] 10.222.0.39 () {58 vars in 1463 bytes} [Sun Oct 16 00:45:39 2022] PUT /identity/v3/projects/1d68000826204dbf8bb077d105c52771/groups/f00d0ae485d64eefa2912b41043978fe/roles/2ff561b5b0d24a468ca2bfa7d0788bd2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:39.659297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7464c1-bccd-42ea-8df7-b76603200282 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:39.659620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7464c1-bccd-42ea-8df7-b76603200282 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:39.659840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7464c1-bccd-42ea-8df7-b76603200282 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:39.661491 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 136/290] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:39.667533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fa7e5-1f1b-413d-8f7d-49053cf2a48d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:39.668016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fa7e5-1f1b-413d-8f7d-49053cf2a48d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:39.668099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fa7e5-1f1b-413d-8f7d-49053cf2a48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:39.687953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-891fa7e5-1f1b-413d-8f7d-49053cf2a48d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:39.690398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-891fa7e5-1f1b-413d-8f7d-49053cf2a48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:39.753304 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 155/291] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:45:40.032311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7464c1-bccd-42ea-8df7-b76603200282 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:40.046026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7464c1-bccd-42ea-8df7-b76603200282 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:40.054740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a37e7e-3093-4cf8-9dfe-1c7bb05baccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:40.055638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37e7e-3093-4cf8-9dfe-1c7bb05baccb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:40.056106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37e7e-3093-4cf8-9dfe-1c7bb05baccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:40.056565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37e7e-3093-4cf8-9dfe-1c7bb05baccb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:40.072145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a37e7e-3093-4cf8-9dfe-1c7bb05baccb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-54a37e7e-3093-4cf8-9dfe-1c7bb05baccb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:40.077360 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:40.078203 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:40.079030 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:40.079030 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:40.079030 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:40.079030 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:40.079030 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:40.079030 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:40.079030 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:40.079030 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:40.079030 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:40.079030 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:40.079030 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:40.079030 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:40.082700 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 137/292] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Oct 16 00:45:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:40.088293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fa7e5-1f1b-413d-8f7d-49053cf2a48d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:40.102150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fa7e5-1f1b-413d-8f7d-49053cf2a48d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:40.106853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977625a-eb31-4bff-84b7-d0bd653d6281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:40.107689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977625a-eb31-4bff-84b7-d0bd653d6281 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:40.108156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977625a-eb31-4bff-84b7-d0bd653d6281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:40.108612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977625a-eb31-4bff-84b7-d0bd653d6281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:40.109470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977625a-eb31-4bff-84b7-d0bd653d6281 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:40.109974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977625a-eb31-4bff-84b7-d0bd653d6281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:40.115843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977625a-eb31-4bff-84b7-d0bd653d6281 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:40.125348 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 156/293] 10.222.0.39 () {56 vars in 1120 bytes} [Sun Oct 16 00:45:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:40.130708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a37e7e-3093-4cf8-9dfe-1c7bb05baccb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:40.144936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a37e7e-3093-4cf8-9dfe-1c7bb05baccb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:40.154883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6770d62-a01b-4f77-a007-0a873276d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:40.155756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6770d62-a01b-4f77-a007-0a873276d00a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:40.156222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6770d62-a01b-4f77-a007-0a873276d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:40.156696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6770d62-a01b-4f77-a007-0a873276d00a admin admin] PATH_INFO: `/v3/groups/a4ca4f43050d4096a8999c4dc3bb6cad` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:40.164176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6770d62-a01b-4f77-a007-0a873276d00a admin admin] RBAC: Authorizing `identity:get_group(group_id=a4ca4f43050d4096a8999c4dc3bb6cad)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:40.166330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6770d62-a01b-4f77-a007-0a873276d00a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:40.168171 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 138/294] 10.222.0.39 () {56 vars in 1201 bytes} [Sun Oct 16 00:45:40 2022] GET /identity/v3/groups/a4ca4f43050d4096a8999c4dc3bb6cad => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:40.175331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977625a-eb31-4bff-84b7-d0bd653d6281 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:40.192764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977625a-eb31-4bff-84b7-d0bd653d6281 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:40.203495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75f046-3f22-4e41-8bc6-12b1e3d839ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:40.204368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75f046-3f22-4e41-8bc6-12b1e3d839ec admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:40.205517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75f046-3f22-4e41-8bc6-12b1e3d839ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:40.205992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75f046-3f22-4e41-8bc6-12b1e3d839ec admin admin] PATH_INFO: `/v3/projects/660cf62d7ad1499c81cc23908b4bdde4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:40.207382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75f046-3f22-4e41-8bc6-12b1e3d839ec admin admin] RBAC: Authorizing `identity:get_project(project_id=660cf62d7ad1499c81cc23908b4bdde4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:40.209472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75f046-3f22-4e41-8bc6-12b1e3d839ec admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:40.211629 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 157/295] 10.222.0.39 () {56 vars in 1207 bytes} [Sun Oct 16 00:45:40 2022] GET /identity/v3/projects/660cf62d7ad1499c81cc23908b4bdde4 => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:40.217373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6770d62-a01b-4f77-a007-0a873276d00a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:40.231034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6770d62-a01b-4f77-a007-0a873276d00a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:40.236871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a5e98-4797-4aa9-b0f1-d8d9cc0f1179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:40.237871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a5e98-4797-4aa9-b0f1-d8d9cc0f1179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:40.238338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a5e98-4797-4aa9-b0f1-d8d9cc0f1179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:40.238808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a5e98-4797-4aa9-b0f1-d8d9cc0f1179 admin admin] PATH_INFO: `/v3/projects/660cf62d7ad1499c81cc23908b4bdde4/groups/a4ca4f43050d4096a8999c4dc3bb6cad/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:40.240892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a5e98-4797-4aa9-b0f1-d8d9cc0f1179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=660cf62d7ad1499c81cc23908b4bdde4, group_id=a4ca4f43050d4096a8999c4dc3bb6cad, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:40.243753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a5e98-4797-4aa9-b0f1-d8d9cc0f1179 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:40.272406 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 139/296] 10.222.0.39 () {58 vars in 1463 bytes} [Sun Oct 16 00:45:40 2022] PUT /identity/v3/projects/660cf62d7ad1499c81cc23908b4bdde4/groups/a4ca4f43050d4096a8999c4dc3bb6cad/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:45:40.468815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f17865-2d60-4f14-97f4-2c9b1976c790 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:40.469499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f17865-2d60-4f14-97f4-2c9b1976c790 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:40.469975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f17865-2d60-4f14-97f4-2c9b1976c790 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:40.472832 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 158/297] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:40.478849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1fe36-0886-49b6-ba9f-caf104515a14 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:40.479471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1fe36-0886-49b6-ba9f-caf104515a14 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:40.479934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1fe36-0886-49b6-ba9f-caf104515a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:40.500304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5cb1fe36-0886-49b6-ba9f-caf104515a14 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:40.502030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5cb1fe36-0886-49b6-ba9f-caf104515a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:40.576690 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:40.599572 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 140/298] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:40.890503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f17865-2d60-4f14-97f4-2c9b1976c790 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:40.974133 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:41.029330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a567fae-e4c8-4d2b-972d-1e043e3dd888 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:41.030003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a567fae-e4c8-4d2b-972d-1e043e3dd888 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:41.030488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a567fae-e4c8-4d2b-972d-1e043e3dd888 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:41.031742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f17865-2d60-4f14-97f4-2c9b1976c790 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:41.032454 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 141/299] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:41.038278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2da93-f7a2-491e-b981-22f96b8606a4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:41.038808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2da93-f7a2-491e-b981-22f96b8606a4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:41.039317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2da93-f7a2-491e-b981-22f96b8606a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:41.059998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a2b2da93-f7a2-491e-b981-22f96b8606a4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:41.061589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a2b2da93-f7a2-491e-b981-22f96b8606a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:41.104265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fb11c-7f4f-4e48-965d-43cddc751db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:41.104903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fb11c-7f4f-4e48-965d-43cddc751db1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:41.105184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fb11c-7f4f-4e48-965d-43cddc751db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:41.105451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fb11c-7f4f-4e48-965d-43cddc751db1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:41.124687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fb11c-7f4f-4e48-965d-43cddc751db1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-334fb11c-7f4f-4e48-965d-43cddc751db1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:41.131620 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:41.132536 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:41.133933 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:41.133933 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:41.133933 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:41.133933 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:41.133933 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:41.133933 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:41.133933 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:41.133933 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:41.133933 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:41.133933 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:41.133933 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:41.133933 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:41.133933 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 159/300] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:41.140726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fb11c-7f4f-4e48-965d-43cddc751db1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:41.141598 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 142/301] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:45:41.275336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fb11c-7f4f-4e48-965d-43cddc751db1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:41.296938 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:41.312256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845e333-802d-4dd3-ba93-a3aa38a2325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:41.312866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845e333-802d-4dd3-ba93-a3aa38a2325c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:41.313144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845e333-802d-4dd3-ba93-a3aa38a2325c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:41.313412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845e333-802d-4dd3-ba93-a3aa38a2325c None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:41.314614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845e333-802d-4dd3-ba93-a3aa38a2325c None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:41.318960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845e333-802d-4dd3-ba93-a3aa38a2325c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:41.318960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845e333-802d-4dd3-ba93-a3aa38a2325c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:41.326987 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 160/302] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:41.333602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2da93-f7a2-491e-b981-22f96b8606a4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:41.470755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2da93-f7a2-491e-b981-22f96b8606a4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:41.488517 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:41.512596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84546af-a2a1-472e-a3fc-186b4490476f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:41.513215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84546af-a2a1-472e-a3fc-186b4490476f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:41.513493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84546af-a2a1-472e-a3fc-186b4490476f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:41.513762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84546af-a2a1-472e-a3fc-186b4490476f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:41.521868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845e333-802d-4dd3-ba93-a3aa38a2325c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:41.633555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84546af-a2a1-472e-a3fc-186b4490476f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:41.635063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84546af-a2a1-472e-a3fc-186b4490476f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:41.715352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845e333-802d-4dd3-ba93-a3aa38a2325c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:41.762748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137c645-5414-4aee-9e26-2fcc5e60e516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:41.763805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137c645-5414-4aee-9e26-2fcc5e60e516 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:41.764284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137c645-5414-4aee-9e26-2fcc5e60e516 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:41.764812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137c645-5414-4aee-9e26-2fcc5e60e516 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:41.780199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137c645-5414-4aee-9e26-2fcc5e60e516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e137c645-5414-4aee-9e26-2fcc5e60e516 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:41.786718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:41.787669 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:41.788454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:41.788454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:41.788454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:41.788454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:41.788454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:41.788454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:41.788454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:41.788454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:41.788454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:41.788454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:41.788454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:41.788454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:41.790939 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 161/303] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:41.792344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199c5da-7741-4556-961f-b224d74a6e7a None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:41.792772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199c5da-7741-4556-961f-b224d74a6e7a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:41.793254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199c5da-7741-4556-961f-b224d74a6e7a None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:41.795097 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 162/304] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:41.799794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199c5da-7741-4556-961f-b224d74a6e7a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:41.815848 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 143/305] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 16 00:45:41.817335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0993e1-c0fa-48d5-8e99-9e748465a491 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:41.817717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0993e1-c0fa-48d5-8e99-9e748465a491 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:41.818085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0993e1-c0fa-48d5-8e99-9e748465a491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:41.837107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1e0993e1-c0fa-48d5-8e99-9e748465a491 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:41.839080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1e0993e1-c0fa-48d5-8e99-9e748465a491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:41.855543 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:41.858261 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:41.946082 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 144/306] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:41.947326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0993e1-c0fa-48d5-8e99-9e748465a491 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:41.950189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199c5da-7741-4556-961f-b224d74a6e7a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:42.000982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f7cdd-3dd6-4056-ae93-c491d126d706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:42.002126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f7cdd-3dd6-4056-ae93-c491d126d706 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:42.002404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f7cdd-3dd6-4056-ae93-c491d126d706 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:42.002672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f7cdd-3dd6-4056-ae93-c491d126d706 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:42.003363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f7cdd-3dd6-4056-ae93-c491d126d706 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:42.003671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f7cdd-3dd6-4056-ae93-c491d126d706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:42.005053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f7cdd-3dd6-4056-ae93-c491d126d706 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:42.024575 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 163/307] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:42.030389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f7cdd-3dd6-4056-ae93-c491d126d706 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:42.151468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0993e1-c0fa-48d5-8e99-9e748465a491 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:42.199374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b78b6-155e-4039-890a-33a867e9511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:42.200018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b78b6-155e-4039-890a-33a867e9511b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:42.200292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b78b6-155e-4039-890a-33a867e9511b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:42.200558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b78b6-155e-4039-890a-33a867e9511b None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:42.202439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b78b6-155e-4039-890a-33a867e9511b None admin] RBAC: Authorizing `identity:get_project(project_id=c1774c4e131e4cd592c124840e1bacb5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:42.203910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b78b6-155e-4039-890a-33a867e9511b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:42.205757 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 145/308] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:41 2022] GET /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:42.212704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b78b6-155e-4039-890a-33a867e9511b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:42.217668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f7cdd-3dd6-4056-ae93-c491d126d706 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:42.228609 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:42.243265 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:42.285772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8f0af-445e-43b4-bd7e-443aefa217c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:42.286298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8f0af-445e-43b4-bd7e-443aefa217c7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:42.286566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8f0af-445e-43b4-bd7e-443aefa217c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:42.286830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8f0af-445e-43b4-bd7e-443aefa217c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:42.371087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b78b6-155e-4039-890a-33a867e9511b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:42.372797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8f0af-445e-43b4-bd7e-443aefa217c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:42.374263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8f0af-445e-43b4-bd7e-443aefa217c7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:42.419687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea61c1-1d50-45e9-9778-b87ec6e77a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:42.420330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea61c1-1d50-45e9-9778-b87ec6e77a74 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:42.420604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea61c1-1d50-45e9-9778-b87ec6e77a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:42.420869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea61c1-1d50-45e9-9778-b87ec6e77a74 None admin] PATH_INFO: `/v3/groups/f00d0ae485d64eefa2912b41043978fe` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:42.422845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea61c1-1d50-45e9-9778-b87ec6e77a74 None admin] RBAC: Authorizing `identity:get_group(group_id=f00d0ae485d64eefa2912b41043978fe)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:42.425017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea61c1-1d50-45e9-9778-b87ec6e77a74 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:42.427533 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 146/309] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Oct 16 00:45:42 2022] GET /identity/v3/groups/f00d0ae485d64eefa2912b41043978fe => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:42.428559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea61c1-1d50-45e9-9778-b87ec6e77a74 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:42.495948 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 164/310] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 16 00:45:42.496885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8f0af-445e-43b4-bd7e-443aefa217c7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:42.501177 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:42.541671 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:42.576880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea61c1-1d50-45e9-9778-b87ec6e77a74 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:42.621580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8f0af-445e-43b4-bd7e-443aefa217c7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:42.625883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443863e9-d4c2-49b8-a929-af550f882b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:42.626797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443863e9-d4c2-49b8-a929-af550f882b79 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:42.627275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443863e9-d4c2-49b8-a929-af550f882b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:42.627685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443863e9-d4c2-49b8-a929-af550f882b79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:42.640641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443863e9-d4c2-49b8-a929-af550f882b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-443863e9-d4c2-49b8-a929-af550f882b79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:42.647726 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:42.648830 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 147/311] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:42.649929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443863e9-d4c2-49b8-a929-af550f882b79 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:42.665979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c47e0e-06f0-474a-a3c6-22a9a6dbf079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:42.666591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c47e0e-06f0-474a-a3c6-22a9a6dbf079 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:42.667023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c47e0e-06f0-474a-a3c6-22a9a6dbf079 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:42.667297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c47e0e-06f0-474a-a3c6-22a9a6dbf079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:42.668014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c47e0e-06f0-474a-a3c6-22a9a6dbf079 None admin] RBAC: Adding query filter params (group.id=f00d0ae485d64eefa2912b41043978fe, role.id=b432183c244e40e0be2fdb9f5c438e77, scope.project.id=c1774c4e131e4cd592c124840e1bacb5) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:42.668422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c47e0e-06f0-474a-a3c6-22a9a6dbf079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:42.669846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c47e0e-06f0-474a-a3c6-22a9a6dbf079 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:42.677426 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 165/312] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Oct 16 00:45:42 2022] GET /identity/v3/role_assignments?group.id=f00d0ae485d64eefa2912b41043978fe&scope.project.id=c1774c4e131e4cd592c124840e1bacb5&role.id=b432183c244e40e0be2fdb9f5c438e77 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:42.678633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7649b-a20a-4be2-b2e9-6f6d1ec52d06 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:42.678952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7649b-a20a-4be2-b2e9-6f6d1ec52d06 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:42.679205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7649b-a20a-4be2-b2e9-6f6d1ec52d06 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:42.680816 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 166/313] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:42.682568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7649b-a20a-4be2-b2e9-6f6d1ec52d06 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:42.778229 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:42.799780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443863e9-d4c2-49b8-a929-af550f882b79 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:42.832257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7649b-a20a-4be2-b2e9-6f6d1ec52d06 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:42.852921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd610e-e780-422b-9452-646e2343381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:42.853997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd610e-e780-422b-9452-646e2343381b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:42.854481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd610e-e780-422b-9452-646e2343381b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:42.854979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd610e-e780-422b-9452-646e2343381b None admin] PATH_INFO: `/v3/projects/c1774c4e131e4cd592c124840e1bacb5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:42.856492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd610e-e780-422b-9452-646e2343381b None admin] RBAC: Authorizing `identity:get_project(project_id=c1774c4e131e4cd592c124840e1bacb5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:42.858194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd610e-e780-422b-9452-646e2343381b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:42.860350 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 148/314] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:42 2022] GET /identity/v3/projects/c1774c4e131e4cd592c124840e1bacb5 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:42.863684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd652-6e16-4915-8eaa-159cfdba629b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:42.864243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd652-6e16-4915-8eaa-159cfdba629b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:42.864746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd652-6e16-4915-8eaa-159cfdba629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:42.878895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cf7c8-24e3-4782-89bf-2ad285d9063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:42.879550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cf7c8-24e3-4782-89bf-2ad285d9063e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:42.879828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cf7c8-24e3-4782-89bf-2ad285d9063e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:42.880098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cf7c8-24e3-4782-89bf-2ad285d9063e None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:42.881198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cf7c8-24e3-4782-89bf-2ad285d9063e None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:42.881198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cf7c8-24e3-4782-89bf-2ad285d9063e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:42.882518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cf7c8-24e3-4782-89bf-2ad285d9063e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:42.887858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3a7fd652-6e16-4915-8eaa-159cfdba629b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:42.889372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a7fd652-6e16-4915-8eaa-159cfdba629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:42.894795 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:42.898222 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 167/315] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:45:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:42.899116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cf7c8-24e3-4782-89bf-2ad285d9063e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:43.016051 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 149/316] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:43.016821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fd652-6e16-4915-8eaa-159cfdba629b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:43.063129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cf7c8-24e3-4782-89bf-2ad285d9063e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:43.095436 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:43.103495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ce1b-13f5-4519-a13c-2dd4db09cf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:43.104506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ce1b-13f5-4519-a13c-2dd4db09cf32 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:43.104959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ce1b-13f5-4519-a13c-2dd4db09cf32 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:43.105401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ce1b-13f5-4519-a13c-2dd4db09cf32 None admin] PATH_INFO: `/v3/groups/f00d0ae485d64eefa2912b41043978fe` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:43.106696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680ce1b-13f5-4519-a13c-2dd4db09cf32 None admin] RBAC: Authorizing `identity:get_group(group_id=f00d0ae485d64eefa2912b41043978fe)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:43.109568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680ce1b-13f5-4519-a13c-2dd4db09cf32 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:43.111987 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 168/317] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Oct 16 00:45:42 2022] GET /identity/v3/groups/f00d0ae485d64eefa2912b41043978fe => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:43.120296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ce1b-13f5-4519-a13c-2dd4db09cf32 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:43.153416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fd652-6e16-4915-8eaa-159cfdba629b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:43.204653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf397395-7249-4db2-b3c5-afad6c8d92b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:43.205340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397395-7249-4db2-b3c5-afad6c8d92b4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:43.205340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397395-7249-4db2-b3c5-afad6c8d92b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:43.205517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397395-7249-4db2-b3c5-afad6c8d92b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:43.217334 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:43.272560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ce1b-13f5-4519-a13c-2dd4db09cf32 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:43.290452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf397395-7249-4db2-b3c5-afad6c8d92b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:43.292249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf397395-7249-4db2-b3c5-afad6c8d92b4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:43.326496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b2fe3-6527-4e6c-9cd0-14e4c50fa434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:43.327105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2fe3-6527-4e6c-9cd0-14e4c50fa434 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:43.327379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2fe3-6527-4e6c-9cd0-14e4c50fa434 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:43.327702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2fe3-6527-4e6c-9cd0-14e4c50fa434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:43.328424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b2fe3-6527-4e6c-9cd0-14e4c50fa434 None admin] RBAC: Adding query filter params (group.id=f00d0ae485d64eefa2912b41043978fe, role.id=2ff561b5b0d24a468ca2bfa7d0788bd2, scope.project.id=c1774c4e131e4cd592c124840e1bacb5) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:43.328729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b2fe3-6527-4e6c-9cd0-14e4c50fa434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:43.331713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b2fe3-6527-4e6c-9cd0-14e4c50fa434 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:43.336562 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 169/318] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Oct 16 00:45:43 2022] GET /identity/v3/role_assignments?group.id=f00d0ae485d64eefa2912b41043978fe&scope.project.id=c1774c4e131e4cd592c124840e1bacb5&role.id=2ff561b5b0d24a468ca2bfa7d0788bd2 => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:43.338371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab80c6d-c939-42e4-993e-2c6c2371d4f0 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:43.338660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab80c6d-c939-42e4-993e-2c6c2371d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:43.338954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab80c6d-c939-42e4-993e-2c6c2371d4f0 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:43.340749 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 170/319] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:43.343746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab80c6d-c939-42e4-993e-2c6c2371d4f0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:43.421333 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 150/320] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:45:43.422614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5741-b147-4546-aece-152e7233c022 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:43.422903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5741-b147-4546-aece-152e7233c022 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:43.427572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5741-b147-4546-aece-152e7233c022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:43.430337 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:43.451768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f71d5741-b147-4546-aece-152e7233c022 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:43.452822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f71d5741-b147-4546-aece-152e7233c022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:43.487765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab80c6d-c939-42e4-993e-2c6c2371d4f0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:43.494219 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:43.540057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f3319-02a9-42b8-ba3f-a24a1d0a99ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:43.540697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f3319-02a9-42b8-ba3f-a24a1d0a99ee None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:43.540976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f3319-02a9-42b8-ba3f-a24a1d0a99ee None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:43.541248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f3319-02a9-42b8-ba3f-a24a1d0a99ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:43.549362 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 151/321] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:43.550439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d5741-b147-4546-aece-152e7233c022 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:43.558584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f3319-02a9-42b8-ba3f-a24a1d0a99ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-761f3319-02a9-42b8-ba3f-a24a1d0a99ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:43.566030 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:43.566900 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:43.568065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:43.568065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:43.568065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:43.568065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:43.568065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:43.568065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:43.568065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:43.568065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:43.568065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:43.568065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:43.568065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:43.568065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:43.568065 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 171/322] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:43.573271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f3319-02a9-42b8-ba3f-a24a1d0a99ee None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:43.688425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d5741-b147-4546-aece-152e7233c022 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:43.711145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f3319-02a9-42b8-ba3f-a24a1d0a99ee None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:43.731447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56029f58-7239-49d7-95da-6d77ebcb9f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:43.732094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56029f58-7239-49d7-95da-6d77ebcb9f83 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:43.732376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56029f58-7239-49d7-95da-6d77ebcb9f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:43.732648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56029f58-7239-49d7-95da-6d77ebcb9f83 None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:43.734213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56029f58-7239-49d7-95da-6d77ebcb9f83 None admin] RBAC: Authorizing `identity:get_project(project_id=1d68000826204dbf8bb077d105c52771)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:43.735711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56029f58-7239-49d7-95da-6d77ebcb9f83 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:43.736682 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:43.737687 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 152/323] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:43 2022] GET /identity/v3/projects/1d68000826204dbf8bb077d105c52771 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:43.743874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56029f58-7239-49d7-95da-6d77ebcb9f83 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:43.759577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc8536-195c-4c30-a055-6f6b2571d76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:43.760064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc8536-195c-4c30-a055-6f6b2571d76d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:43.760411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc8536-195c-4c30-a055-6f6b2571d76d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:43.760689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc8536-195c-4c30-a055-6f6b2571d76d None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:43.761627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc8536-195c-4c30-a055-6f6b2571d76d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:43.761947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc8536-195c-4c30-a055-6f6b2571d76d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:43.765227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc8536-195c-4c30-a055-6f6b2571d76d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:43.776424 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 172/324] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:43.782437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc8536-195c-4c30-a055-6f6b2571d76d None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:43.792199 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:43.875058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56029f58-7239-49d7-95da-6d77ebcb9f83 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:43.902328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc8536-195c-4c30-a055-6f6b2571d76d None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:43.911789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624951d3-06dd-4e6c-9ae3-839e62cd33cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:43.912427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624951d3-06dd-4e6c-9ae3-839e62cd33cb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:43.912708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624951d3-06dd-4e6c-9ae3-839e62cd33cb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:43.912977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624951d3-06dd-4e6c-9ae3-839e62cd33cb None admin] PATH_INFO: `/v3/groups/f00d0ae485d64eefa2912b41043978fe` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:43.914088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624951d3-06dd-4e6c-9ae3-839e62cd33cb None admin] RBAC: Authorizing `identity:get_group(group_id=f00d0ae485d64eefa2912b41043978fe)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:43.915600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624951d3-06dd-4e6c-9ae3-839e62cd33cb None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:43.921908 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 153/325] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Oct 16 00:45:43 2022] GET /identity/v3/groups/f00d0ae485d64eefa2912b41043978fe => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:43.921908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624951d3-06dd-4e6c-9ae3-839e62cd33cb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:43.949797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3655233-8ca5-45ec-a1db-dead00d2544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:43.950401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3655233-8ca5-45ec-a1db-dead00d2544a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:43.950634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3655233-8ca5-45ec-a1db-dead00d2544a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:43.951818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3655233-8ca5-45ec-a1db-dead00d2544a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:44.010437 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:44.028012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3655233-8ca5-45ec-a1db-dead00d2544a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:44.029726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3655233-8ca5-45ec-a1db-dead00d2544a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:44.036580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624951d3-06dd-4e6c-9ae3-839e62cd33cb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:44.040757 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:44.076363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77d19b-f27e-4de6-91c1-64ecfcba4df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:44.076998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77d19b-f27e-4de6-91c1-64ecfcba4df8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:44.077275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77d19b-f27e-4de6-91c1-64ecfcba4df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:44.077542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77d19b-f27e-4de6-91c1-64ecfcba4df8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:44.091576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77d19b-f27e-4de6-91c1-64ecfcba4df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-cc77d19b-f27e-4de6-91c1-64ecfcba4df8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:44.097126 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:44.098084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:44.098939 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:44.098939 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:44.098939 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:44.098939 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:44.098939 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:44.098939 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:44.098939 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:44.098939 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:44.098939 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:44.098939 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:44.098939 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:44.098939 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:44.098939 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 154/326] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:45:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:44.099585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77d19b-f27e-4de6-91c1-64ecfcba4df8 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:44.159135 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 173/327] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 16 00:45:44.160375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3655233-8ca5-45ec-a1db-dead00d2544a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:44.227756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77d19b-f27e-4de6-91c1-64ecfcba4df8 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:44.265986 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:44.272278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8fb42-1782-4945-b740-55bb7dfea379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:44.272886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8fb42-1782-4945-b740-55bb7dfea379 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:44.273157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8fb42-1782-4945-b740-55bb7dfea379 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:44.273421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8fb42-1782-4945-b740-55bb7dfea379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:44.274143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8fb42-1782-4945-b740-55bb7dfea379 None admin] RBAC: Adding query filter params (group.id=f00d0ae485d64eefa2912b41043978fe, role.id=b432183c244e40e0be2fdb9f5c438e77, scope.project.id=1d68000826204dbf8bb077d105c52771) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:44.274445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8fb42-1782-4945-b740-55bb7dfea379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:44.275904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8fb42-1782-4945-b740-55bb7dfea379 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:44.283308 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 155/328] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Oct 16 00:45:44 2022] GET /identity/v3/role_assignments?group.id=f00d0ae485d64eefa2912b41043978fe&scope.project.id=1d68000826204dbf8bb077d105c52771&role.id=b432183c244e40e0be2fdb9f5c438e77 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:44.284382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8fb42-1782-4945-b740-55bb7dfea379 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:44.285052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3655233-8ca5-45ec-a1db-dead00d2544a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:44.330795 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:44.346097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bda35-358e-454e-bbaf-1eaa23a49071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:44.346794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bda35-358e-454e-bbaf-1eaa23a49071 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:44.347154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bda35-358e-454e-bbaf-1eaa23a49071 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:44.347427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bda35-358e-454e-bbaf-1eaa23a49071 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:44.348168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bda35-358e-454e-bbaf-1eaa23a49071 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:44.348476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bda35-358e-454e-bbaf-1eaa23a49071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:44.349927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bda35-358e-454e-bbaf-1eaa23a49071 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:44.361649 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 174/329] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:44.368007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bda35-358e-454e-bbaf-1eaa23a49071 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:44.428213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8fb42-1782-4945-b740-55bb7dfea379 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:44.464767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96f6c6-d786-43bf-9493-afb1c4f2e923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:44.465396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96f6c6-d786-43bf-9493-afb1c4f2e923 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:44.465670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96f6c6-d786-43bf-9493-afb1c4f2e923 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:44.465937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96f6c6-d786-43bf-9493-afb1c4f2e923 None admin] PATH_INFO: `/v3/projects/1d68000826204dbf8bb077d105c52771` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:44.467073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96f6c6-d786-43bf-9493-afb1c4f2e923 None admin] RBAC: Authorizing `identity:get_project(project_id=1d68000826204dbf8bb077d105c52771)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:44.468522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96f6c6-d786-43bf-9493-afb1c4f2e923 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:44.470145 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 156/330] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:44 2022] GET /identity/v3/projects/1d68000826204dbf8bb077d105c52771 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:44.476494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96f6c6-d786-43bf-9493-afb1c4f2e923 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:44.490779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bda35-358e-454e-bbaf-1eaa23a49071 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:44.533605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44580eb2-ebf2-4ca6-b200-baba4ac97c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:44.534215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44580eb2-ebf2-4ca6-b200-baba4ac97c7a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:44.534657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44580eb2-ebf2-4ca6-b200-baba4ac97c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:44.534953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44580eb2-ebf2-4ca6-b200-baba4ac97c7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:44.557990 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:44.594896 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:44.601866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96f6c6-d786-43bf-9493-afb1c4f2e923 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:44.629424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44580eb2-ebf2-4ca6-b200-baba4ac97c7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:44.631014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44580eb2-ebf2-4ca6-b200-baba4ac97c7a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:44.639691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c937a74-fc9b-4d03-9038-8bc86e5afb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:44.640322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c937a74-fc9b-4d03-9038-8bc86e5afb5d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:44.640595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c937a74-fc9b-4d03-9038-8bc86e5afb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:44.640863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c937a74-fc9b-4d03-9038-8bc86e5afb5d None admin] PATH_INFO: `/v3/groups/f00d0ae485d64eefa2912b41043978fe` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:44.641960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c937a74-fc9b-4d03-9038-8bc86e5afb5d None admin] RBAC: Authorizing `identity:get_group(group_id=f00d0ae485d64eefa2912b41043978fe)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:44.644724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c937a74-fc9b-4d03-9038-8bc86e5afb5d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:44.646607 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 157/331] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Oct 16 00:45:44 2022] GET /identity/v3/groups/f00d0ae485d64eefa2912b41043978fe => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:44.652870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c937a74-fc9b-4d03-9038-8bc86e5afb5d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:44.741248 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 175/332] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:45:44.745802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44580eb2-ebf2-4ca6-b200-baba4ac97c7a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:44.758258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c937a74-fc9b-4d03-9038-8bc86e5afb5d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:44.791124 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:44.792054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7f56a-0bc9-40b9-902e-58f6b9d62cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:44.793059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7f56a-0bc9-40b9-902e-58f6b9d62cda None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:44.793606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7f56a-0bc9-40b9-902e-58f6b9d62cda None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:44.793914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7f56a-0bc9-40b9-902e-58f6b9d62cda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:44.794762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7f56a-0bc9-40b9-902e-58f6b9d62cda None admin] RBAC: Adding query filter params (group.id=f00d0ae485d64eefa2912b41043978fe, role.id=2ff561b5b0d24a468ca2bfa7d0788bd2, scope.project.id=1d68000826204dbf8bb077d105c52771) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:44.795102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7f56a-0bc9-40b9-902e-58f6b9d62cda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:44.796506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7f56a-0bc9-40b9-902e-58f6b9d62cda None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:44.802473 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 158/333] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Oct 16 00:45:44 2022] GET /identity/v3/role_assignments?group.id=f00d0ae485d64eefa2912b41043978fe&scope.project.id=1d68000826204dbf8bb077d105c52771&role.id=2ff561b5b0d24a468ca2bfa7d0788bd2 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:44.846435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44580eb2-ebf2-4ca6-b200-baba4ac97c7a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:44.883510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54a142-453b-4d6e-b7fc-cbd359be31fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:44.884140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54a142-453b-4d6e-b7fc-cbd359be31fa None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:44.884421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54a142-453b-4d6e-b7fc-cbd359be31fa None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:44.884688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54a142-453b-4d6e-b7fc-cbd359be31fa None admin] PATH_INFO: `/v3/projects/660cf62d7ad1499c81cc23908b4bdde4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:44.885844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54a142-453b-4d6e-b7fc-cbd359be31fa None admin] RBAC: Authorizing `identity:get_project(project_id=660cf62d7ad1499c81cc23908b4bdde4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:44.887319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54a142-453b-4d6e-b7fc-cbd359be31fa None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:44.888974 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 176/334] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:44 2022] GET /identity/v3/projects/660cf62d7ad1499c81cc23908b4bdde4 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:44.895670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7f56a-0bc9-40b9-902e-58f6b9d62cda None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:44.925019 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:45.004878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7f56a-0bc9-40b9-902e-58f6b9d62cda None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:45.039369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe7cf7-12e7-4b69-b9b0-67f329e9265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:45.039995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe7cf7-12e7-4b69-b9b0-67f329e9265c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:45.040265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe7cf7-12e7-4b69-b9b0-67f329e9265c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:45.040529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe7cf7-12e7-4b69-b9b0-67f329e9265c None admin] PATH_INFO: `/v3/groups/a4ca4f43050d4096a8999c4dc3bb6cad` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:45.041614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe7cf7-12e7-4b69-b9b0-67f329e9265c None admin] RBAC: Authorizing `identity:get_group(group_id=a4ca4f43050d4096a8999c4dc3bb6cad)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:45.043096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe7cf7-12e7-4b69-b9b0-67f329e9265c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:45.044639 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 159/335] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Oct 16 00:45:44 2022] GET /identity/v3/groups/a4ca4f43050d4096a8999c4dc3bb6cad => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:45.051640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54a142-453b-4d6e-b7fc-cbd359be31fa None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:45.155177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54a142-453b-4d6e-b7fc-cbd359be31fa None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:45.169410 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:45.191183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384bb33-ea72-4210-ba9d-93d29332fb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:45.191776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384bb33-ea72-4210-ba9d-93d29332fb9a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:45.192054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384bb33-ea72-4210-ba9d-93d29332fb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:45.192323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384bb33-ea72-4210-ba9d-93d29332fb9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:45.193035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384bb33-ea72-4210-ba9d-93d29332fb9a None admin] RBAC: Adding query filter params (group.id=a4ca4f43050d4096a8999c4dc3bb6cad, role.id=3b2c8c93a1c54611871c4299008b2abf, scope.project.id=660cf62d7ad1499c81cc23908b4bdde4) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:45.193342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384bb33-ea72-4210-ba9d-93d29332fb9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:45.194771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384bb33-ea72-4210-ba9d-93d29332fb9a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:45.200299 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 177/336] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Oct 16 00:45:45 2022] GET /identity/v3/role_assignments?group.id=a4ca4f43050d4096a8999c4dc3bb6cad&scope.project.id=660cf62d7ad1499c81cc23908b4bdde4&role.id=3b2c8c93a1c54611871c4299008b2abf => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:47.897915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11267c-9eb6-4fea-95fe-3bf8567a4030 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:47.898949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11267c-9eb6-4fea-95fe-3bf8567a4030 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:47.899446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11267c-9eb6-4fea-95fe-3bf8567a4030 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:47.900983 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 160/337] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:47.906584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6424f-98a5-40c9-92c1-eaaa096d82ea None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:47.907407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6424f-98a5-40c9-92c1-eaaa096d82ea None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:47.909009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6424f-98a5-40c9-92c1-eaaa096d82ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:47.935881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-22a6424f-98a5-40c9-92c1-eaaa096d82ea None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:47.937411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22a6424f-98a5-40c9-92c1-eaaa096d82ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:48.034535 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 178/338] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:48.036909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040471a-bc93-45e9-bafb-f5ca286b449d None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:48.037409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040471a-bc93-45e9-bafb-f5ca286b449d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:48.037885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040471a-bc93-45e9-bafb-f5ca286b449d None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:48.039431 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 161/339] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:48.044661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924c3e6-655e-4c46-9fc9-bb3c71fa8438 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:48.045158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924c3e6-655e-4c46-9fc9-bb3c71fa8438 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:48.045634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924c3e6-655e-4c46-9fc9-bb3c71fa8438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:48.075870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b924c3e6-655e-4c46-9fc9-bb3c71fa8438 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:48.077405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b924c3e6-655e-4c46-9fc9-bb3c71fa8438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:48.166023 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 179/340] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:48.313349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040471a-bc93-45e9-bafb-f5ca286b449d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:48.373324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752f64b-4d52-4447-b7e4-d28f183bdd1d None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:48.373868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752f64b-4d52-4447-b7e4-d28f183bdd1d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:48.374375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752f64b-4d52-4447-b7e4-d28f183bdd1d None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:48.375974 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 180/341] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:48.386942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a775-b11a-47c4-8140-09391306d46c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:48.387228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a775-b11a-47c4-8140-09391306d46c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:48.387504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a775-b11a-47c4-8140-09391306d46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:48.422650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5d89a775-b11a-47c4-8140-09391306d46c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:48.424322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5d89a775-b11a-47c4-8140-09391306d46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:48.474960 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:48.480979 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:48.481236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040471a-bc93-45e9-bafb-f5ca286b449d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:48.547563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7196c40-f9ba-445e-92c0-1fcf8e2d8a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:48.548734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7196c40-f9ba-445e-92c0-1fcf8e2d8a88 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:48.549004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7196c40-f9ba-445e-92c0-1fcf8e2d8a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:48.549272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7196c40-f9ba-445e-92c0-1fcf8e2d8a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:48.550067 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 181/342] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:45:48.574363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7196c40-f9ba-445e-92c0-1fcf8e2d8a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:48.575986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7196c40-f9ba-445e-92c0-1fcf8e2d8a88 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:48.586000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89a775-b11a-47c4-8140-09391306d46c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c7196c40-f9ba-445e-92c0-1fcf8e2d8a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:48.602513 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:48.603551 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:48.604472 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:48.604472 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:48.604472 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:48.606548 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 162/343] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:48.612632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7196c40-f9ba-445e-92c0-1fcf8e2d8a88 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:48.766749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7196c40-f9ba-445e-92c0-1fcf8e2d8a88 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:48.775953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89a775-b11a-47c4-8140-09391306d46c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:48.812552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721762d-ca94-49b5-8bb1-84a89162c21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:48.813547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721762d-ca94-49b5-8bb1-84a89162c21e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:48.814587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721762d-ca94-49b5-8bb1-84a89162c21e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:48.815108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721762d-ca94-49b5-8bb1-84a89162c21e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:48.826193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721762d-ca94-49b5-8bb1-84a89162c21e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:48.828072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721762d-ca94-49b5-8bb1-84a89162c21e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:48.830816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe339844-608e-4703-9e26-65dbad801985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:48.831533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe339844-608e-4703-9e26-65dbad801985 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:48.831925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe339844-608e-4703-9e26-65dbad801985 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:48.832199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe339844-608e-4703-9e26-65dbad801985 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:48.832831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe339844-608e-4703-9e26-65dbad801985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:48.833134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe339844-608e-4703-9e26-65dbad801985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:48.834504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe339844-608e-4703-9e26-65dbad801985 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3721762d-ca94-49b5-8bb1-84a89162c21e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:48.844335 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:48.845245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:48.846777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:48.846777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:48.846777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:48.846777 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 182/344] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:48.848165 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 163/345] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:45:48.848274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bc33c-8150-4ea7-a53f-378d985a68cc None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:48.848274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bc33c-8150-4ea7-a53f-378d985a68cc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:48.848274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bc33c-8150-4ea7-a53f-378d985a68cc None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:48.848508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe339844-608e-4703-9e26-65dbad801985 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:48.850191 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 183/346] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:48.851578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bc33c-8150-4ea7-a53f-378d985a68cc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:48.863171 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:48.874947 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:48.961494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bc33c-8150-4ea7-a53f-378d985a68cc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:48.962278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe339844-608e-4703-9e26-65dbad801985 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:48.997133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38db65-d1db-46b4-a2e1-9d553ba4e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:48.997732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38db65-d1db-46b4-a2e1-9d553ba4e70b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:48.998020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38db65-d1db-46b4-a2e1-9d553ba4e70b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:48.998292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38db65-d1db-46b4-a2e1-9d553ba4e70b None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:48.999019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38db65-d1db-46b4-a2e1-9d553ba4e70b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:48.999325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38db65-d1db-46b4-a2e1-9d553ba4e70b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:49.000152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bf339-27a7-4def-864f-4d57ab4bd197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:49.000757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38db65-d1db-46b4-a2e1-9d553ba4e70b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:49.000853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bf339-27a7-4def-864f-4d57ab4bd197 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:49.001055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bf339-27a7-4def-864f-4d57ab4bd197 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:49.001358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bf339-27a7-4def-864f-4d57ab4bd197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:49.012907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bf339-27a7-4def-864f-4d57ab4bd197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:49.014361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bf339-27a7-4def-864f-4d57ab4bd197 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:49.018189 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 184/347] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:49.019190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38db65-d1db-46b4-a2e1-9d553ba4e70b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-eb9bf339-27a7-4def-864f-4d57ab4bd197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:49.030196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:49.031137 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:49.037341 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:49.037341 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:49.037341 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:49.037341 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 164/348] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:49.037341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929b477-66b5-417f-9d7e-12bcf79b8abf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:49.037341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929b477-66b5-417f-9d7e-12bcf79b8abf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:49.037341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929b477-66b5-417f-9d7e-12bcf79b8abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:49.053613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9929b477-66b5-417f-9d7e-12bcf79b8abf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:49.054950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9929b477-66b5-417f-9d7e-12bcf79b8abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:49.103750 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:49.115013 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:49.134943 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 165/349] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:49.135306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38db65-d1db-46b4-a2e1-9d553ba4e70b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:49.135426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929b477-66b5-417f-9d7e-12bcf79b8abf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:49.171971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3c5a6-0a6e-4c03-9ada-c5dcafda35ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:49.172663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3c5a6-0a6e-4c03-9ada-c5dcafda35ac None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:49.173069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3c5a6-0a6e-4c03-9ada-c5dcafda35ac None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:49.173534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3c5a6-0a6e-4c03-9ada-c5dcafda35ac None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:49.174260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3c5a6-0a6e-4c03-9ada-c5dcafda35ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:49.177072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3c5a6-0a6e-4c03-9ada-c5dcafda35ac None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:49.202309 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 185/350] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:49 2022] POST /identity/v3/users => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:49.203170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3c5a6-0a6e-4c03-9ada-c5dcafda35ac None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:49.245178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929b477-66b5-417f-9d7e-12bcf79b8abf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:49.283812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870fd06-5914-4a24-b8a1-9e739f10e017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:49.284256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870fd06-5914-4a24-b8a1-9e739f10e017 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:49.284536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870fd06-5914-4a24-b8a1-9e739f10e017 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:49.284806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870fd06-5914-4a24-b8a1-9e739f10e017 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:49.285472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870fd06-5914-4a24-b8a1-9e739f10e017 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:49.287103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870fd06-5914-4a24-b8a1-9e739f10e017 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:49.315895 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 166/351] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:49 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:49.356098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3c5a6-0a6e-4c03-9ada-c5dcafda35ac None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:49.399422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0665e24-ef57-4cf4-b457-032b2369ad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:49.400256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0665e24-ef57-4cf4-b457-032b2369ad69 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:49.400544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0665e24-ef57-4cf4-b457-032b2369ad69 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:49.400819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0665e24-ef57-4cf4-b457-032b2369ad69 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:49.401495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0665e24-ef57-4cf4-b457-032b2369ad69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:49.401804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0665e24-ef57-4cf4-b457-032b2369ad69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:49.403353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0665e24-ef57-4cf4-b457-032b2369ad69 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:49.406589 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:49.410937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e913a-af04-4ae8-b650-c08e0d80b4e1 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:49.411247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e913a-af04-4ae8-b650-c08e0d80b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:49.411522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e913a-af04-4ae8-b650-c08e0d80b4e1 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:49.413171 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 167/352] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:49.419469 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 186/353] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:49.424060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f34e9f-e619-4609-8ed1-6a35aab3d97f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:49.424365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f34e9f-e619-4609-8ed1-6a35aab3d97f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:49.424615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f34e9f-e619-4609-8ed1-6a35aab3d97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:49.426389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0665e24-ef57-4cf4-b457-032b2369ad69 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:49.467205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f8f34e9f-e619-4609-8ed1-6a35aab3d97f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:49.468429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f8f34e9f-e619-4609-8ed1-6a35aab3d97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:49.541353 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:49.569103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0665e24-ef57-4cf4-b457-032b2369ad69 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:49.580659 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 168/354] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:49.583835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f34e9f-e619-4609-8ed1-6a35aab3d97f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:49.610985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001220f-fd81-41ce-85bd-6169eb08f054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:49.612053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001220f-fd81-41ce-85bd-6169eb08f054 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:49.613008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001220f-fd81-41ce-85bd-6169eb08f054 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:49.613008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001220f-fd81-41ce-85bd-6169eb08f054 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:49.613277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001220f-fd81-41ce-85bd-6169eb08f054 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:49.614824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001220f-fd81-41ce-85bd-6169eb08f054 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:49.640340 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 187/355] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:49 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:45:49.723703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f34e9f-e619-4609-8ed1-6a35aab3d97f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:49.770309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcdaab-77fd-426b-90ea-f1435860bb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:49.770982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcdaab-77fd-426b-90ea-f1435860bb80 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:49.771264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcdaab-77fd-426b-90ea-f1435860bb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:49.771532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcdaab-77fd-426b-90ea-f1435860bb80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:49.783646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcdaab-77fd-426b-90ea-f1435860bb80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:49.785007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcdaab-77fd-426b-90ea-f1435860bb80 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-91bcdaab-77fd-426b-90ea-f1435860bb80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:49.810122 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:49.811108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:49.812363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:49.812363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:49.812363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:49.812363 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 169/356] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:49.819489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001220f-fd81-41ce-85bd-6169eb08f054 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:49.884792 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:49.913127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcdaab-77fd-426b-90ea-f1435860bb80 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:49.939931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001220f-fd81-41ce-85bd-6169eb08f054 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:49.951302 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:49.981621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972e989-af23-4337-9f47-736d51eb6def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:49.982213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972e989-af23-4337-9f47-736d51eb6def None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:49.982497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972e989-af23-4337-9f47-736d51eb6def None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:49.982771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972e989-af23-4337-9f47-736d51eb6def None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:49.983454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972e989-af23-4337-9f47-736d51eb6def None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:49.983757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972e989-af23-4337-9f47-736d51eb6def None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:49.985140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972e989-af23-4337-9f47-736d51eb6def None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:49.999530 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 188/357] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:50.005788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972e989-af23-4337-9f47-736d51eb6def None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:50.043665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcdaab-77fd-426b-90ea-f1435860bb80 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:50.085406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5a8c5-df90-4b5e-b2b6-55d1da4bf398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:50.086103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5a8c5-df90-4b5e-b2b6-55d1da4bf398 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:50.086497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5a8c5-df90-4b5e-b2b6-55d1da4bf398 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:50.086866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5a8c5-df90-4b5e-b2b6-55d1da4bf398 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:50.087793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5a8c5-df90-4b5e-b2b6-55d1da4bf398 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:50.089381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5a8c5-df90-4b5e-b2b6-55d1da4bf398 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:50.109147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.sql.core [None req-e6f5a8c5-df90-4b5e-b2b6-55d1da4bf398 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 16 00:45:50.109147 n-d-master-1 devstack@keystone.service[81805]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 16 00:45:50.109147 n-d-master-1 devstack@keystone.service[81805]: [parameters: {'id': '5df13f08025a422ea19431916d8a73e0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 16 00:45:50.109147 n-d-master-1 devstack@keystone.service[81805]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81805) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:45:50.132577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972e989-af23-4337-9f47-736d51eb6def None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e6f5a8c5-df90-4b5e-b2b6-55d1da4bf398 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result.read() Oct 16 00:45:50.133435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return ref.to_dict() Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:45:50.134314 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application yield resource Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise self.value Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application session.commit() Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:45:50.135657 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:45:50.136623 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:45:50.137486 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result.read() Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:45:50.138269 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [parameters: {'id': '5df13f08025a422ea19431916d8a73e0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:50.140064 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 16 00:45:50.142082 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:50.144382 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 170/358] 10.222.0.39 () {60 vars in 1131 bytes} [Sun Oct 16 00:45:49 2022] POST /identity/v3/roles => generated 144 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:50.145610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5a8c5-df90-4b5e-b2b6-55d1da4bf398 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:50.169198 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:50.216947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502dd6d-013a-4d07-b72e-373891e100b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:50.217617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502dd6d-013a-4d07-b72e-373891e100b7 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:50.217898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502dd6d-013a-4d07-b72e-373891e100b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:50.218167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502dd6d-013a-4d07-b72e-373891e100b7 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:50.218831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502dd6d-013a-4d07-b72e-373891e100b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:50.221082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502dd6d-013a-4d07-b72e-373891e100b7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:50.258225 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 189/359] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:50 2022] POST /identity/v3/users => generated 249 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:50.285804 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:50.295302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5a8c5-df90-4b5e-b2b6-55d1da4bf398 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:50.350255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09782c4e-4436-4dbe-982c-a90aa6b65dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:50.350872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09782c4e-4436-4dbe-982c-a90aa6b65dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:50.351221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09782c4e-4436-4dbe-982c-a90aa6b65dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:50.351487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09782c4e-4436-4dbe-982c-a90aa6b65dd8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:50.368060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09782c4e-4436-4dbe-982c-a90aa6b65dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-09782c4e-4436-4dbe-982c-a90aa6b65dd8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:50.373642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:50.374608 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:50.375451 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:50.375451 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:50.375451 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:50.375451 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:50.375451 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:50.375451 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:50.375451 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:50.375451 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:50.375451 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:50.375451 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:50.375451 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:45:50.375451 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:50.375451 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 171/360] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:45:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:50.381992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502dd6d-013a-4d07-b72e-373891e100b7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:50.525809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502dd6d-013a-4d07-b72e-373891e100b7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:50.564434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06573ae-28fd-4186-a694-df356218f1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:50.565042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06573ae-28fd-4186-a694-df356218f1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:50.565319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06573ae-28fd-4186-a694-df356218f1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:50.565592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06573ae-28fd-4186-a694-df356218f1d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:50.566259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06573ae-28fd-4186-a694-df356218f1d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:50.566559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06573ae-28fd-4186-a694-df356218f1d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:50.568029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06573ae-28fd-4186-a694-df356218f1d1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:50.576855 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 190/361] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:51.961867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61728ea3-319f-435e-b5f6-9eec128afea3 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:51.962363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61728ea3-319f-435e-b5f6-9eec128afea3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:51.962363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61728ea3-319f-435e-b5f6-9eec128afea3 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:51.963692 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 172/362] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:51.968919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fae353-0fa5-49a2-9e98-d018ad352b90 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:51.969294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fae353-0fa5-49a2-9e98-d018ad352b90 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:51.969546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fae353-0fa5-49a2-9e98-d018ad352b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:51.989074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-51fae353-0fa5-49a2-9e98-d018ad352b90 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:51.990372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-51fae353-0fa5-49a2-9e98-d018ad352b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:52.014203 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:52.070410 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 191/363] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:52.237932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea3718-3d32-4245-a268-7529abdac65d None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:52.238111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea3718-3d32-4245-a268-7529abdac65d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:52.238392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea3718-3d32-4245-a268-7529abdac65d None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:52.239755 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 173/364] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:52.244910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b308-479e-4126-b887-aedb0d9681b6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:52.245203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b308-479e-4126-b887-aedb0d9681b6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:52.245477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b308-479e-4126-b887-aedb0d9681b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:52.268932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c994b308-479e-4126-b887-aedb0d9681b6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:52.270125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c994b308-479e-4126-b887-aedb0d9681b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:52.352534 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 192/365] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:52.473435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea3718-3d32-4245-a268-7529abdac65d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:52.531521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ac0b6-b64d-4a3d-8014-acffb4157c40 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:52.531800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ac0b6-b64d-4a3d-8014-acffb4157c40 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:52.531993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ac0b6-b64d-4a3d-8014-acffb4157c40 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:52.533582 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 193/366] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:52.538552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2426cf7-a4f8-4ca3-aa11-15c58b29874a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:52.538868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2426cf7-a4f8-4ca3-aa11-15c58b29874a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:52.539130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2426cf7-a4f8-4ca3-aa11-15c58b29874a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:52.572604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c2426cf7-a4f8-4ca3-aa11-15c58b29874a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:52.574091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c2426cf7-a4f8-4ca3-aa11-15c58b29874a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:52.613703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea3718-3d32-4245-a268-7529abdac65d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:52.680904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7330c0-1689-4e84-85b7-2859bbc9b788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:52.682951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7330c0-1689-4e84-85b7-2859bbc9b788 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:52.683456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7330c0-1689-4e84-85b7-2859bbc9b788 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:52.685139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7330c0-1689-4e84-85b7-2859bbc9b788 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:52.705132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7330c0-1689-4e84-85b7-2859bbc9b788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:52.705567 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 194/367] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:45:52.706683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2426cf7-a4f8-4ca3-aa11-15c58b29874a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-2e7330c0-1689-4e84-85b7-2859bbc9b788 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:52.710751 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:52.711930 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:52.712958 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:52.712958 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:52.712958 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:52.712958 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:52.712958 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:52.712958 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:52.712958 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:52.712958 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:52.712958 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:52.712958 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:52.712958 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:52.712958 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:52.712958 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 174/368] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:45:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:52.722026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7330c0-1689-4e84-85b7-2859bbc9b788 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:52.733007 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:52.756435 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:52.816679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2426cf7-a4f8-4ca3-aa11-15c58b29874a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:52.856582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b4c0f-1cd4-4f32-9124-da781aa49c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:52.857583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4c0f-1cd4-4f32-9124-da781aa49c8f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:52.858067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4c0f-1cd4-4f32-9124-da781aa49c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:52.858535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4c0f-1cd4-4f32-9124-da781aa49c8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:52.870055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b4c0f-1cd4-4f32-9124-da781aa49c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-687b4c0f-1cd4-4f32-9124-da781aa49c8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:52.875411 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:52.876893 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:52.877924 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:52.877924 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:52.877924 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:52.877924 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:52.877924 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:52.877924 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:52.877924 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:52.877924 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:52.877924 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:52.877924 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:52.877924 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:52.877924 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:52.880695 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 195/369] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:45:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:52.888890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b4c0f-1cd4-4f32-9124-da781aa49c8f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:52.946545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7330c0-1689-4e84-85b7-2859bbc9b788 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:52.998090 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:53.015223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b4c0f-1cd4-4f32-9124-da781aa49c8f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:53.020356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca65fdf-26d4-4a7c-817c-c82a0a1727d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:53.021041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca65fdf-26d4-4a7c-817c-c82a0a1727d3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.021387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca65fdf-26d4-4a7c-817c-c82a0a1727d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.021724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca65fdf-26d4-4a7c-817c-c82a0a1727d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.022455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca65fdf-26d4-4a7c-817c-c82a0a1727d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:53.022825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca65fdf-26d4-4a7c-817c-c82a0a1727d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:53.024315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca65fdf-26d4-4a7c-817c-c82a0a1727d3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:53.034234 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 175/370] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:45:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:53.035271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca65fdf-26d4-4a7c-817c-c82a0a1727d3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:53.055079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50799b-f012-48dc-894f-bd7a06b216ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:53.055920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50799b-f012-48dc-894f-bd7a06b216ef None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.056343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50799b-f012-48dc-894f-bd7a06b216ef None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.056742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50799b-f012-48dc-894f-bd7a06b216ef None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.057567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50799b-f012-48dc-894f-bd7a06b216ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:53.058006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50799b-f012-48dc-894f-bd7a06b216ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:53.059544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50799b-f012-48dc-894f-bd7a06b216ef None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:53.069787 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 196/371] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:45:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:53.071242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50799b-f012-48dc-894f-bd7a06b216ef None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:53.143292 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:53.151289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca65fdf-26d4-4a7c-817c-c82a0a1727d3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:53.196127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826cbc1-d4df-4d7b-b200-be90e4897a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:53.196587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50799b-f012-48dc-894f-bd7a06b216ef None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:53.197050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826cbc1-d4df-4d7b-b200-be90e4897a76 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.197419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826cbc1-d4df-4d7b-b200-be90e4897a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.197794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826cbc1-d4df-4d7b-b200-be90e4897a76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.212059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826cbc1-d4df-4d7b-b200-be90e4897a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-a826cbc1-d4df-4d7b-b200-be90e4897a76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:53.216921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:53.217816 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:53.218671 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:53.218671 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:53.218671 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:53.218671 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:53.218671 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:53.218671 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:53.218671 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:53.218671 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:53.218671 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:53.218671 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:53.218671 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:53.218671 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:53.223611 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 176/372] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:45:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:53.224274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826cbc1-d4df-4d7b-b200-be90e4897a76 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:53.234098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa808a6-e3ad-44ac-8d46-077423e53fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:53.234719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa808a6-e3ad-44ac-8d46-077423e53fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.235021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa808a6-e3ad-44ac-8d46-077423e53fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.235294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa808a6-e3ad-44ac-8d46-077423e53fb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.246361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa808a6-e3ad-44ac-8d46-077423e53fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:53.247992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa808a6-e3ad-44ac-8d46-077423e53fb3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:53.250775 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-dfa808a6-e3ad-44ac-8d46-077423e53fb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:53.270123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:53.271168 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:53.272028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:53.272028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:53.272028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:53.272840 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 197/373] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:53.274249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf887b2-bb7e-4c10-93be-e1a20bdc5de9 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.274533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf887b2-bb7e-4c10-93be-e1a20bdc5de9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.274802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf887b2-bb7e-4c10-93be-e1a20bdc5de9 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.276540 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 198/374] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:53.276982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf887b2-bb7e-4c10-93be-e1a20bdc5de9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:53.343411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826cbc1-d4df-4d7b-b200-be90e4897a76 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:53.379914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20337cc-6f97-4d2e-a141-2ae31561f17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:53.380548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20337cc-6f97-4d2e-a141-2ae31561f17a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.380845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20337cc-6f97-4d2e-a141-2ae31561f17a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.381088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20337cc-6f97-4d2e-a141-2ae31561f17a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.383042 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:53.392901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20337cc-6f97-4d2e-a141-2ae31561f17a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:53.394354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20337cc-6f97-4d2e-a141-2ae31561f17a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:53.402852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf887b2-bb7e-4c10-93be-e1a20bdc5de9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e20337cc-6f97-4d2e-a141-2ae31561f17a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:53.409689 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:53.410572 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:53.412275 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:53.412275 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:53.412275 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:53.412275 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 177/375] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:53.412275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20337cc-6f97-4d2e-a141-2ae31561f17a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:53.439056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098d51c-d8a5-4745-806d-895129af88dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:53.439792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098d51c-d8a5-4745-806d-895129af88dc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.440071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098d51c-d8a5-4745-806d-895129af88dc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.440347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098d51c-d8a5-4745-806d-895129af88dc None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.440995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098d51c-d8a5-4745-806d-895129af88dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:53.441294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098d51c-d8a5-4745-806d-895129af88dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:53.442647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098d51c-d8a5-4745-806d-895129af88dc None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:53.450489 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 199/376] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:45:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:53.451714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87477f49-1cff-4f52-920d-3e6dc8f5b515 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.452000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87477f49-1cff-4f52-920d-3e6dc8f5b515 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.452269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87477f49-1cff-4f52-920d-3e6dc8f5b515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.469292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-87477f49-1cff-4f52-920d-3e6dc8f5b515 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:53.471192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-87477f49-1cff-4f52-920d-3e6dc8f5b515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:53.515077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20337cc-6f97-4d2e-a141-2ae31561f17a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:53.521593 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:53.538701 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 200/377] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:53.540103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422cdb-70cd-43d4-85f7-0ed6da2bc659 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.540390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422cdb-70cd-43d4-85f7-0ed6da2bc659 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.540664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422cdb-70cd-43d4-85f7-0ed6da2bc659 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.541888 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 201/378] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:53.542566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d422cdb-70cd-43d4-85f7-0ed6da2bc659 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:53.560736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1db91-4b97-42bf-a442-9dfbe21cb42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:53.561637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1db91-4b97-42bf-a442-9dfbe21cb42a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.561637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1db91-4b97-42bf-a442-9dfbe21cb42a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.562042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1db91-4b97-42bf-a442-9dfbe21cb42a None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.562602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1db91-4b97-42bf-a442-9dfbe21cb42a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:53.563050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1db91-4b97-42bf-a442-9dfbe21cb42a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:53.564434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1db91-4b97-42bf-a442-9dfbe21cb42a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:53.576614 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 178/379] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:53.577240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1db91-4b97-42bf-a442-9dfbe21cb42a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:53.624819 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:53.656894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d422cdb-70cd-43d4-85f7-0ed6da2bc659 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:53.682308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1db91-4b97-42bf-a442-9dfbe21cb42a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:53.692851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52659d-0124-4147-923b-d1fbb8de59ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:53.693723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52659d-0124-4147-923b-d1fbb8de59ae None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.694198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52659d-0124-4147-923b-d1fbb8de59ae None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.694663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52659d-0124-4147-923b-d1fbb8de59ae None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.695510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52659d-0124-4147-923b-d1fbb8de59ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:53.696002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52659d-0124-4147-923b-d1fbb8de59ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:53.697433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52659d-0124-4147-923b-d1fbb8de59ae None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:53.712916 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 202/380] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:53.712916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1e3be-62a3-4b03-a031-ce29db2cf233 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.712916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1e3be-62a3-4b03-a031-ce29db2cf233 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.712916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1e3be-62a3-4b03-a031-ce29db2cf233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.722384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09aef0-a6e7-4fbc-b5a8-0ce4ddadd09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:53.723064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09aef0-a6e7-4fbc-b5a8-0ce4ddadd09f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.723341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09aef0-a6e7-4fbc-b5a8-0ce4ddadd09f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.723609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09aef0-a6e7-4fbc-b5a8-0ce4ddadd09f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.729734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-79e1e3be-62a3-4b03-a031-ce29db2cf233 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:53.731360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79e1e3be-62a3-4b03-a031-ce29db2cf233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:53.733667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09aef0-a6e7-4fbc-b5a8-0ce4ddadd09f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:53.735149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09aef0-a6e7-4fbc-b5a8-0ce4ddadd09f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-fa09aef0-a6e7-4fbc-b5a8-0ce4ddadd09f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:53.751019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:53.752531 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:53.753355 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:53.753355 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:53.753355 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:53.753355 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 179/381] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:53.753564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09aef0-a6e7-4fbc-b5a8-0ce4ddadd09f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:53.783456 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:53.809360 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 203/382] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:53.810196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1e3be-62a3-4b03-a031-ce29db2cf233 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:53.869607 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:53.873882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09aef0-a6e7-4fbc-b5a8-0ce4ddadd09f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:53.910533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bb1d5-ee1b-4ea5-aa50-7edd4d7020ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:53.911127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bb1d5-ee1b-4ea5-aa50-7edd4d7020ab None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.911422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bb1d5-ee1b-4ea5-aa50-7edd4d7020ab None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.911668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bb1d5-ee1b-4ea5-aa50-7edd4d7020ab None admin] PATH_INFO: `/v3/users/glance` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.919749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bb1d5-ee1b-4ea5-aa50-7edd4d7020ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:53.921180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bb1d5-ee1b-4ea5-aa50-7edd4d7020ab None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:53.921765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1e3be-62a3-4b03-a031-ce29db2cf233 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-494bb1d5-ee1b-4ea5-aa50-7edd4d7020ab None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:45:53.934448 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:53.935389 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:53.936342 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:53.936342 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:53.936342 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:45:53.936342 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:45:53.936342 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:45:53.936342 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:45:53.936342 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:45:53.936342 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:45:53.936342 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 16 00:45:53.936342 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:53.936342 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 180/383] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:53.936342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bb1d5-ee1b-4ea5-aa50-7edd4d7020ab None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:53.962421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87c005-b266-4b8c-bf46-a479fa585eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:53.963132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87c005-b266-4b8c-bf46-a479fa585eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:53.963406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87c005-b266-4b8c-bf46-a479fa585eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:53.963670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87c005-b266-4b8c-bf46-a479fa585eb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:53.971693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87c005-b266-4b8c-bf46-a479fa585eb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:53.973120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87c005-b266-4b8c-bf46-a479fa585eb8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-df87c005-b266-4b8c-bf46-a479fa585eb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:45:53.986578 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:53.987520 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:53.993194 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:53.993194 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:53.993194 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:45:53.993194 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:45:53.993194 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:45:53.993194 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:45:53.993194 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:45:53.993194 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:45:53.993194 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:45:53.993194 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:53.993194 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 204/384] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Oct 16 00:45:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:53.993194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87c005-b266-4b8c-bf46-a479fa585eb8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:54.029456 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:54.048666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bb1d5-ee1b-4ea5-aa50-7edd4d7020ab None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:54.084220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352f8b6-4b25-4f21-94a2-6aaacc8094d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:54.084831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352f8b6-4b25-4f21-94a2-6aaacc8094d3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:54.085110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352f8b6-4b25-4f21-94a2-6aaacc8094d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:54.085379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352f8b6-4b25-4f21-94a2-6aaacc8094d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:54.086018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352f8b6-4b25-4f21-94a2-6aaacc8094d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:54.086322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352f8b6-4b25-4f21-94a2-6aaacc8094d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:54.087742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352f8b6-4b25-4f21-94a2-6aaacc8094d3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:54.094902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87c005-b266-4b8c-bf46-a479fa585eb8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:54.099810 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 181/385] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:54.100601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352f8b6-4b25-4f21-94a2-6aaacc8094d3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:54.119613 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:54.130030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d5a28-c154-4b6d-aedd-2aa2450209c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:54.130657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5a28-c154-4b6d-aedd-2aa2450209c9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:54.130964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5a28-c154-4b6d-aedd-2aa2450209c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:54.131240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5a28-c154-4b6d-aedd-2aa2450209c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:54.141776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d5a28-c154-4b6d-aedd-2aa2450209c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-693d5a28-c154-4b6d-aedd-2aa2450209c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:54.147723 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:54.148602 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:54.149386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:54.149386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:54.149386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:54.149386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:54.149386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:54.149386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:54.149386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:54.149386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:54.149386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:54.149386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:54.149386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:54.149386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:54.149386 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 205/386] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:45:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:54.150064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d5a28-c154-4b6d-aedd-2aa2450209c9 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:54.205242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352f8b6-4b25-4f21-94a2-6aaacc8094d3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:54.237509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dbd9b-2560-49f4-8e73-e9686017a200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:54.238111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dbd9b-2560-49f4-8e73-e9686017a200 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:54.238382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dbd9b-2560-49f4-8e73-e9686017a200 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:54.238646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dbd9b-2560-49f4-8e73-e9686017a200 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:54.239385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dbd9b-2560-49f4-8e73-e9686017a200 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:54.239685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dbd9b-2560-49f4-8e73-e9686017a200 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:54.241085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dbd9b-2560-49f4-8e73-e9686017a200 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:54.241661 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:54.247680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d5a28-c154-4b6d-aedd-2aa2450209c9 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:54.281122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cd79e-4d57-4bcb-a47e-a1b9d1345dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:54.281726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cd79e-4d57-4bcb-a47e-a1b9d1345dfc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:54.282004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cd79e-4d57-4bcb-a47e-a1b9d1345dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:54.282276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cd79e-4d57-4bcb-a47e-a1b9d1345dfc None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:54.283068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cd79e-4d57-4bcb-a47e-a1b9d1345dfc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:54.283364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cd79e-4d57-4bcb-a47e-a1b9d1345dfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:54.284803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cd79e-4d57-4bcb-a47e-a1b9d1345dfc None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:54.285064 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 182/387] 10.222.0.39 () {56 vars in 1137 bytes} [Sun Oct 16 00:45:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:54.285902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dbd9b-2560-49f4-8e73-e9686017a200 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:54.324784 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 206/388] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Oct 16 00:45:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:54.326825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cd79e-4d57-4bcb-a47e-a1b9d1345dfc None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:54.362012 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:54.384281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dbd9b-2560-49f4-8e73-e9686017a200 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:54.419574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937ab1f-ba0a-4c4f-b189-87be583915d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:54.420203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937ab1f-ba0a-4c4f-b189-87be583915d1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:54.420483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937ab1f-ba0a-4c4f-b189-87be583915d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:54.420755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937ab1f-ba0a-4c4f-b189-87be583915d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:54.425464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cd79e-4d57-4bcb-a47e-a1b9d1345dfc None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:54.431507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937ab1f-ba0a-4c4f-b189-87be583915d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:54.432952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937ab1f-ba0a-4c4f-b189-87be583915d1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-9937ab1f-ba0a-4c4f-b189-87be583915d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:54.447108 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:54.448024 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:54.448849 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:54.448849 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:54.448849 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:54.448849 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 183/389] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:54.449084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937ab1f-ba0a-4c4f-b189-87be583915d1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:54.462494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca027b-89c4-432d-86c4-9014ef025113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:54.463086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca027b-89c4-432d-86c4-9014ef025113 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:54.463363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca027b-89c4-432d-86c4-9014ef025113 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:54.463629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca027b-89c4-432d-86c4-9014ef025113 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:54.471121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca027b-89c4-432d-86c4-9014ef025113 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:54.472558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca027b-89c4-432d-86c4-9014ef025113 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-15ca027b-89c4-432d-86c4-9014ef025113 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:45:54.483804 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:54.484876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:54.486124 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:54.486124 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:54.486124 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:45:54.486124 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:45:54.486124 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:45:54.486124 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:45:54.486124 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:45:54.486124 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:45:54.486124 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:45:54.486124 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:54.486124 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 207/390] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:54.486124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca027b-89c4-432d-86c4-9014ef025113 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:54.504406 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:54.551506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937ab1f-ba0a-4c4f-b189-87be583915d1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:54.577033 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:54.585652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68bbe0-0108-443e-bb0b-c4d91133d592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:54.586257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68bbe0-0108-443e-bb0b-c4d91133d592 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:54.586783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68bbe0-0108-443e-bb0b-c4d91133d592 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:54.586783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68bbe0-0108-443e-bb0b-c4d91133d592 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:54.587472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68bbe0-0108-443e-bb0b-c4d91133d592 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:54.587770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68bbe0-0108-443e-bb0b-c4d91133d592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:54.589143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68bbe0-0108-443e-bb0b-c4d91133d592 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:54.595798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca027b-89c4-432d-86c4-9014ef025113 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:54.597867 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 184/391] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:45:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:54.598648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68bbe0-0108-443e-bb0b-c4d91133d592 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:54.630715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380907-9354-4e67-8c02-9474ec39459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:54.631418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380907-9354-4e67-8c02-9474ec39459b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:54.631691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380907-9354-4e67-8c02-9474ec39459b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:54.631955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380907-9354-4e67-8c02-9474ec39459b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:54.642818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb380907-9354-4e67-8c02-9474ec39459b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:54.644307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb380907-9354-4e67-8c02-9474ec39459b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-fb380907-9354-4e67-8c02-9474ec39459b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:54.658312 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:54.659245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:54.660110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:54.660110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:54.660110 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:54.660110 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 208/392] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:54.660319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380907-9354-4e67-8c02-9474ec39459b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:54.703773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68bbe0-0108-443e-bb0b-c4d91133d592 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:54.724196 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:54.737925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1548c-ef91-4f08-9d1e-f4e7955ec122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:54.738778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1548c-ef91-4f08-9d1e-f4e7955ec122 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:54.739086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1548c-ef91-4f08-9d1e-f4e7955ec122 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:54.739357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1548c-ef91-4f08-9d1e-f4e7955ec122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:54.749584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1548c-ef91-4f08-9d1e-f4e7955ec122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:54.751031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1548c-ef91-4f08-9d1e-f4e7955ec122 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:54.758844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380907-9354-4e67-8c02-9474ec39459b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f0a1548c-ef91-4f08-9d1e-f4e7955ec122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:54.765333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:54.766241 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:54.767833 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:54.767833 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:54.767833 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:54.767833 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 185/393] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:54.767833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1548c-ef91-4f08-9d1e-f4e7955ec122 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:54.796050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953edcc4-1ebe-4675-9783-b46ae4f67f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:54.796639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953edcc4-1ebe-4675-9783-b46ae4f67f3f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:54.796910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953edcc4-1ebe-4675-9783-b46ae4f67f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:54.797179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953edcc4-1ebe-4675-9783-b46ae4f67f3f None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:54.797831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953edcc4-1ebe-4675-9783-b46ae4f67f3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:54.798154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953edcc4-1ebe-4675-9783-b46ae4f67f3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:54.799563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953edcc4-1ebe-4675-9783-b46ae4f67f3f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:54.810296 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:54.811687 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 209/394] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:54.812409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953edcc4-1ebe-4675-9783-b46ae4f67f3f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:54.867747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1548c-ef91-4f08-9d1e-f4e7955ec122 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:54.902515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27f784-f4f2-445c-9f99-7ebb45299f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:54.903145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27f784-f4f2-445c-9f99-7ebb45299f0c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:54.903420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27f784-f4f2-445c-9f99-7ebb45299f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:54.903685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27f784-f4f2-445c-9f99-7ebb45299f0c None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:54.904649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27f784-f4f2-445c-9f99-7ebb45299f0c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:54.904947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27f784-f4f2-445c-9f99-7ebb45299f0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:54.906365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27f784-f4f2-445c-9f99-7ebb45299f0c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:54.909468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953edcc4-1ebe-4675-9783-b46ae4f67f3f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:54.923021 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 186/395] 10.222.0.39 () {56 vars in 1137 bytes} [Sun Oct 16 00:45:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:54.923871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27f784-f4f2-445c-9f99-7ebb45299f0c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:54.940026 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:54.949282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f236ca-9b71-49e4-9bea-1bd6c608eb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:54.949894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f236ca-9b71-49e4-9bea-1bd6c608eb9a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:54.950165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f236ca-9b71-49e4-9bea-1bd6c608eb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:54.950430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f236ca-9b71-49e4-9bea-1bd6c608eb9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:54.960755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f236ca-9b71-49e4-9bea-1bd6c608eb9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:54.962181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f236ca-9b71-49e4-9bea-1bd6c608eb9a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-c1f236ca-9b71-49e4-9bea-1bd6c608eb9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:54.976710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:54.977582 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:54.978430 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:54.978430 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:54.978430 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:54.978430 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 210/396] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:54.978646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f236ca-9b71-49e4-9bea-1bd6c608eb9a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:55.021922 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:55.025275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27f784-f4f2-445c-9f99-7ebb45299f0c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:55.059382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fa247-8021-41f2-a18b-59d81fd3db79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:55.059980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa247-8021-41f2-a18b-59d81fd3db79 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:55.060235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa247-8021-41f2-a18b-59d81fd3db79 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:55.060499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa247-8021-41f2-a18b-59d81fd3db79 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:55.061631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fa247-8021-41f2-a18b-59d81fd3db79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:55.061921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fa247-8021-41f2-a18b-59d81fd3db79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:55.063312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fa247-8021-41f2-a18b-59d81fd3db79 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:55.075100 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 187/397] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:55.075854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fa247-8021-41f2-a18b-59d81fd3db79 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:55.076679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f236ca-9b71-49e4-9bea-1bd6c608eb9a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:55.111658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797447f-45f0-4862-853c-020b95fc6baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:55.112251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797447f-45f0-4862-853c-020b95fc6baf None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:55.112525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797447f-45f0-4862-853c-020b95fc6baf None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:55.112788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797447f-45f0-4862-853c-020b95fc6baf None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:55.113411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797447f-45f0-4862-853c-020b95fc6baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:55.113707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797447f-45f0-4862-853c-020b95fc6baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:55.115089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797447f-45f0-4862-853c-020b95fc6baf None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:55.126872 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 211/398] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:55.127893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797447f-45f0-4862-853c-020b95fc6baf None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:55.166507 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:55.175432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fa247-8021-41f2-a18b-59d81fd3db79 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:55.209584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc842b-422f-4611-95dd-99f1e4108e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:55.210187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc842b-422f-4611-95dd-99f1e4108e3e None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:55.210458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc842b-422f-4611-95dd-99f1e4108e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:55.210724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc842b-422f-4611-95dd-99f1e4108e3e None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:55.211377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc842b-422f-4611-95dd-99f1e4108e3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:55.212822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc842b-422f-4611-95dd-99f1e4108e3e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:55.224854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797447f-45f0-4862-853c-020b95fc6baf None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:55.232922 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 188/399] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:45:55 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:45:55.233656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc842b-422f-4611-95dd-99f1e4108e3e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:55.253705 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:55.273287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b68c8c-682c-4aa9-bf80-af277b3fe5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:55.273925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68c8c-682c-4aa9-bf80-af277b3fe5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:55.274204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68c8c-682c-4aa9-bf80-af277b3fe5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:55.274477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68c8c-682c-4aa9-bf80-af277b3fe5c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:55.288337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b68c8c-682c-4aa9-bf80-af277b3fe5c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:55.289951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b68c8c-682c-4aa9-bf80-af277b3fe5c2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-02b68c8c-682c-4aa9-bf80-af277b3fe5c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:55.306871 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:55.307891 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:55.308739 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:55.308739 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:55.308739 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:55.308739 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 212/400] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:55.309852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b68c8c-682c-4aa9-bf80-af277b3fe5c2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:55.361729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc842b-422f-4611-95dd-99f1e4108e3e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:55.399190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a578f-1959-4a84-b038-e92fc9d7bc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:55.399904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a578f-1959-4a84-b038-e92fc9d7bc26 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:55.400175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a578f-1959-4a84-b038-e92fc9d7bc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:55.400447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a578f-1959-4a84-b038-e92fc9d7bc26 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:55.401085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a578f-1959-4a84-b038-e92fc9d7bc26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:55.401600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a578f-1959-4a84-b038-e92fc9d7bc26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:55.402765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a578f-1959-4a84-b038-e92fc9d7bc26 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:55.416300 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:55.417115 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 189/401] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:55.418145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a578f-1959-4a84-b038-e92fc9d7bc26 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:55.431964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b68c8c-682c-4aa9-bf80-af277b3fe5c2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:55.471117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfbf9d-1429-4ac5-9e7d-2736449daa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:55.471749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfbf9d-1429-4ac5-9e7d-2736449daa4a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:55.472308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfbf9d-1429-4ac5-9e7d-2736449daa4a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:55.472593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfbf9d-1429-4ac5-9e7d-2736449daa4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:55.480376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfbf9d-1429-4ac5-9e7d-2736449daa4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:55.482406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfbf9d-1429-4ac5-9e7d-2736449daa4a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3fbfbf9d-1429-4ac5-9e7d-2736449daa4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:45:55.495711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:55.496781 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:55.497785 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:45:55.497785 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:45:55.497785 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:45:55.497785 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:45:55.497785 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:45:55.497785 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:45:55.497785 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:55.497785 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:55.497785 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 213/402] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:55.499744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfbf9d-1429-4ac5-9e7d-2736449daa4a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:55.501919 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:55.527780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a578f-1959-4a84-b038-e92fc9d7bc26 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:55.570727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c2cf2-a96e-4947-8462-415695bddf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:55.571865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c2cf2-a96e-4947-8462-415695bddf77 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:55.572472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c2cf2-a96e-4947-8462-415695bddf77 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:55.572811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c2cf2-a96e-4947-8462-415695bddf77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:55.582261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c2cf2-a96e-4947-8462-415695bddf77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:55.583740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c2cf2-a96e-4947-8462-415695bddf77 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-458c2cf2-a96e-4947-8462-415695bddf77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:45:55.596665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:55.597712 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:55.599019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:45:55.599019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:45:55.599019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:45:55.599019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:45:55.599019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:45:55.599019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:45:55.599019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:55.599019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:55.602484 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 190/403] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:55.603368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c2cf2-a96e-4947-8462-415695bddf77 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:55.612829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfbf9d-1429-4ac5-9e7d-2736449daa4a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:55.647650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea36c30-a806-435b-895a-44476517ea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:55.648242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea36c30-a806-435b-895a-44476517ea75 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:55.648516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea36c30-a806-435b-895a-44476517ea75 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:55.648782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea36c30-a806-435b-895a-44476517ea75 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:55.649408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea36c30-a806-435b-895a-44476517ea75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:55.649703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea36c30-a806-435b-895a-44476517ea75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:55.651094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea36c30-a806-435b-895a-44476517ea75 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:55.664125 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 214/404] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:55.665262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea36c30-a806-435b-895a-44476517ea75 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:55.679866 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:55.712037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c2cf2-a96e-4947-8462-415695bddf77 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:55.749026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d5975-cebd-45c3-84c5-573ad5a49828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:55.749603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d5975-cebd-45c3-84c5-573ad5a49828 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:55.749879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d5975-cebd-45c3-84c5-573ad5a49828 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:55.750146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d5975-cebd-45c3-84c5-573ad5a49828 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:55.753410 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:55.760164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d5975-cebd-45c3-84c5-573ad5a49828 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:55.762355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d5975-cebd-45c3-84c5-573ad5a49828 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:55.774244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea36c30-a806-435b-895a-44476517ea75 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-ea4d5975-cebd-45c3-84c5-573ad5a49828 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:45:55.775918 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:55.776784 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:55.777665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:55.777665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:55.777665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:45:55.777665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:45:55.777665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:45:55.777665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:45:55.777665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:45:55.777665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:45:55.777665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 16 00:45:55.777665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:55.777665 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 191/405] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:45:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:55.778230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d5975-cebd-45c3-84c5-573ad5a49828 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:55.821935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769841e-8804-40c2-91ff-5bdbf255f557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:55.822876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769841e-8804-40c2-91ff-5bdbf255f557 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:55.823183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769841e-8804-40c2-91ff-5bdbf255f557 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:55.823456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769841e-8804-40c2-91ff-5bdbf255f557 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:55.824449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769841e-8804-40c2-91ff-5bdbf255f557 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:55.824751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769841e-8804-40c2-91ff-5bdbf255f557 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:55.826191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769841e-8804-40c2-91ff-5bdbf255f557 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:55.849948 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 215/406] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:55.849948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769841e-8804-40c2-91ff-5bdbf255f557 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:55.886508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d5975-cebd-45c3-84c5-573ad5a49828 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:55.922511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbeb5a-e027-4fe6-b2e2-0b02f93e032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:55.922738 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:55.923175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbeb5a-e027-4fe6-b2e2-0b02f93e032c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:55.923451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbeb5a-e027-4fe6-b2e2-0b02f93e032c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:55.923721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbeb5a-e027-4fe6-b2e2-0b02f93e032c None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:55.924437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbeb5a-e027-4fe6-b2e2-0b02f93e032c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:55.924731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbeb5a-e027-4fe6-b2e2-0b02f93e032c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:55.926263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbeb5a-e027-4fe6-b2e2-0b02f93e032c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:55.944009 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 192/407] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:55.944009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbeb5a-e027-4fe6-b2e2-0b02f93e032c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:55.964010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769841e-8804-40c2-91ff-5bdbf255f557 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:56.002568 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:56.004205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b8e57-aebd-4429-bad6-b7f4c496939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:56.004893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b8e57-aebd-4429-bad6-b7f4c496939e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:56.005168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b8e57-aebd-4429-bad6-b7f4c496939e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:56.005433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b8e57-aebd-4429-bad6-b7f4c496939e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:56.012223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b8e57-aebd-4429-bad6-b7f4c496939e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:56.013841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b8e57-aebd-4429-bad6-b7f4c496939e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-9f6b8e57-aebd-4429-bad6-b7f4c496939e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:45:56.025649 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:56.026497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:56.032676 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:45:56.032676 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:45:56.032676 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:45:56.032676 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:45:56.032676 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:45:56.032676 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:45:56.032676 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:56.032676 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:56.032676 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 216/408] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:56.032676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b8e57-aebd-4429-bad6-b7f4c496939e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:56.051888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbeb5a-e027-4fe6-b2e2-0b02f93e032c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:56.087147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebd90b-3776-428d-9569-a8a92ce4f715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:56.088228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebd90b-3776-428d-9569-a8a92ce4f715 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:56.088557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebd90b-3776-428d-9569-a8a92ce4f715 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:56.088828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebd90b-3776-428d-9569-a8a92ce4f715 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:56.089692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebd90b-3776-428d-9569-a8a92ce4f715 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:56.089995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebd90b-3776-428d-9569-a8a92ce4f715 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:56.091506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebd90b-3776-428d-9569-a8a92ce4f715 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:56.114898 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 193/409] 10.222.0.39 () {56 vars in 1139 bytes} [Sun Oct 16 00:45:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:56.114898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebd90b-3776-428d-9569-a8a92ce4f715 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:56.145019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b8e57-aebd-4429-bad6-b7f4c496939e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:56.176453 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:56.185063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275bbf3-141e-480f-a5c6-a89b935a3d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:56.185737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275bbf3-141e-480f-a5c6-a89b935a3d19 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:56.186026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275bbf3-141e-480f-a5c6-a89b935a3d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:56.186294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275bbf3-141e-480f-a5c6-a89b935a3d19 None admin] PATH_INFO: `/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/afb30ad752234d8c9f12302b0b69666b/roles/b8b6732605964de6aedfe2a3cf507d03` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:56.201733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275bbf3-141e-480f-a5c6-a89b935a3d19 None admin] RBAC: Authorizing `identity:create_grant(project_id=2efc56617bd54471a648f03215b3bfb1, user_id=afb30ad752234d8c9f12302b0b69666b, role_id=b8b6732605964de6aedfe2a3cf507d03)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:56.203708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275bbf3-141e-480f-a5c6-a89b935a3d19 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:56.226950 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 217/410] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:56 2022] PUT /identity/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/afb30ad752234d8c9f12302b0b69666b/roles/b8b6732605964de6aedfe2a3cf507d03 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:56.226950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275bbf3-141e-480f-a5c6-a89b935a3d19 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:56.227245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebd90b-3776-428d-9569-a8a92ce4f715 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:56.244895 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:56.268609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c289932-fa1a-447d-8c9a-3cfb330ffe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:56.269192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c289932-fa1a-447d-8c9a-3cfb330ffe38 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:56.269475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c289932-fa1a-447d-8c9a-3cfb330ffe38 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:56.269749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c289932-fa1a-447d-8c9a-3cfb330ffe38 None admin] PATH_INFO: `/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/a065cd54fd8745ca99f35405c711ffac/roles/b8b6732605964de6aedfe2a3cf507d03` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:56.288970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c289932-fa1a-447d-8c9a-3cfb330ffe38 None admin] RBAC: Authorizing `identity:create_grant(project_id=2efc56617bd54471a648f03215b3bfb1, user_id=a065cd54fd8745ca99f35405c711ffac, role_id=b8b6732605964de6aedfe2a3cf507d03)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:56.290608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c289932-fa1a-447d-8c9a-3cfb330ffe38 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:56.309872 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 194/411] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:56 2022] PUT /identity/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/a065cd54fd8745ca99f35405c711ffac/roles/b8b6732605964de6aedfe2a3cf507d03 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:56.311118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c289932-fa1a-447d-8c9a-3cfb330ffe38 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:56.363633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275bbf3-141e-480f-a5c6-a89b935a3d19 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:56.434467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6e82b-e0d9-4702-9ccc-8c416d0b5f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:56.435121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6e82b-e0d9-4702-9ccc-8c416d0b5f61 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:56.435397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6e82b-e0d9-4702-9ccc-8c416d0b5f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:56.435674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6e82b-e0d9-4702-9ccc-8c416d0b5f61 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:56.436649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6e82b-e0d9-4702-9ccc-8c416d0b5f61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:56.437021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6e82b-e0d9-4702-9ccc-8c416d0b5f61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:56.447241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6e82b-e0d9-4702-9ccc-8c416d0b5f61 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:56.477514 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 218/412] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:45:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:56.483578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6e82b-e0d9-4702-9ccc-8c416d0b5f61 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:56.489083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c289932-fa1a-447d-8c9a-3cfb330ffe38 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:56.540752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725c9ad-1b5f-4e17-93c7-0df4a3636f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:56.540933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725c9ad-1b5f-4e17-93c7-0df4a3636f80 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:56.541167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725c9ad-1b5f-4e17-93c7-0df4a3636f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:56.541633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725c9ad-1b5f-4e17-93c7-0df4a3636f80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:56.543174 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:56.556026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725c9ad-1b5f-4e17-93c7-0df4a3636f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:56.557194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725c9ad-1b5f-4e17-93c7-0df4a3636f80 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-2725c9ad-1b5f-4e17-93c7-0df4a3636f80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:56.577774 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:56.578701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:56.580343 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:56.580343 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:56.580343 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:56.580343 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 195/413] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:56.587990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725c9ad-1b5f-4e17-93c7-0df4a3636f80 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:56.636439 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:56.656403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6e82b-e0d9-4702-9ccc-8c416d0b5f61 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:56.714469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e5d57-9475-4c59-aa4f-ddb1198684c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:56.716698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e5d57-9475-4c59-aa4f-ddb1198684c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:56.717829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e5d57-9475-4c59-aa4f-ddb1198684c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:56.718382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e5d57-9475-4c59-aa4f-ddb1198684c1 None admin] PATH_INFO: `/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/2536755baf5d4916bdc5942d5a1ace99/roles/b8b6732605964de6aedfe2a3cf507d03` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:56.753079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e5d57-9475-4c59-aa4f-ddb1198684c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2efc56617bd54471a648f03215b3bfb1, user_id=2536755baf5d4916bdc5942d5a1ace99, role_id=b8b6732605964de6aedfe2a3cf507d03)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:56.754859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e5d57-9475-4c59-aa4f-ddb1198684c1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:56.777542 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 219/414] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:56 2022] PUT /identity/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/2536755baf5d4916bdc5942d5a1ace99/roles/b8b6732605964de6aedfe2a3cf507d03 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:56.800860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725c9ad-1b5f-4e17-93c7-0df4a3636f80 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:56.839293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8343b9c-5b87-4f1b-a989-9299f81e05ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:56.840228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8343b9c-5b87-4f1b-a989-9299f81e05ef None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:56.840704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8343b9c-5b87-4f1b-a989-9299f81e05ef None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:56.841237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8343b9c-5b87-4f1b-a989-9299f81e05ef None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:56.842122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8343b9c-5b87-4f1b-a989-9299f81e05ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:56.842618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8343b9c-5b87-4f1b-a989-9299f81e05ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:56.844337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8343b9c-5b87-4f1b-a989-9299f81e05ef None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:56.860020 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 196/415] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:56.867498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e5d57-9475-4c59-aa4f-ddb1198684c1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:56.987323 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:56.993368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e5d57-9475-4c59-aa4f-ddb1198684c1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:57.034115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06e448-4a5d-4536-89be-6d8996f1a7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:57.034749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06e448-4a5d-4536-89be-6d8996f1a7ad None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:57.035049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06e448-4a5d-4536-89be-6d8996f1a7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:57.035321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06e448-4a5d-4536-89be-6d8996f1a7ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:57.042410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06e448-4a5d-4536-89be-6d8996f1a7ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:57.044008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06e448-4a5d-4536-89be-6d8996f1a7ad None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-1e06e448-4a5d-4536-89be-6d8996f1a7ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:45:57.056960 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:57.057791 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:57.058603 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:45:57.058603 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:45:57.058603 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:45:57.058603 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:45:57.058603 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:45:57.058603 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:45:57.058603 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:45:57.058603 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:57.058603 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 220/416] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:45:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:57.065979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8343b9c-5b87-4f1b-a989-9299f81e05ef None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:57.214612 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:57.248832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8343b9c-5b87-4f1b-a989-9299f81e05ef None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:57.300791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea4609-1bc4-4bb9-9bf0-66f02bbcbd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:57.301447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea4609-1bc4-4bb9-9bf0-66f02bbcbd8d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:57.301727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea4609-1bc4-4bb9-9bf0-66f02bbcbd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:57.301995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea4609-1bc4-4bb9-9bf0-66f02bbcbd8d None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:57.302735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea4609-1bc4-4bb9-9bf0-66f02bbcbd8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:57.303065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea4609-1bc4-4bb9-9bf0-66f02bbcbd8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:57.304644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea4609-1bc4-4bb9-9bf0-66f02bbcbd8d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:57.321050 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 197/417] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:45:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:57.331956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06e448-4a5d-4536-89be-6d8996f1a7ad None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:57.479352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06e448-4a5d-4536-89be-6d8996f1a7ad None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:57.535107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa7571-87ca-4f3f-b394-2005821e7771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:57.535766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa7571-87ca-4f3f-b394-2005821e7771 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:57.536044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa7571-87ca-4f3f-b394-2005821e7771 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:57.536316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa7571-87ca-4f3f-b394-2005821e7771 None admin] PATH_INFO: `/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/e0d6b7f81a7f4ba3a299acca4b7d4bfb/roles/b8b6732605964de6aedfe2a3cf507d03` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:57.567536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa7571-87ca-4f3f-b394-2005821e7771 None admin] RBAC: Authorizing `identity:create_grant(project_id=2efc56617bd54471a648f03215b3bfb1, user_id=e0d6b7f81a7f4ba3a299acca4b7d4bfb, role_id=b8b6732605964de6aedfe2a3cf507d03)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:57.572275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa7571-87ca-4f3f-b394-2005821e7771 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:57.590590 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:57.595089 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 221/418] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:57 2022] PUT /identity/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/e0d6b7f81a7f4ba3a299acca4b7d4bfb/roles/b8b6732605964de6aedfe2a3cf507d03 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:57.634637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa1444-76fc-495d-8893-78fc5d6948e7 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:57.634991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa1444-76fc-495d-8893-78fc5d6948e7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:57.635251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa1444-76fc-495d-8893-78fc5d6948e7 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:57.636919 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 198/419] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:57.642595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a577749-94d9-4f55-bd5e-df559209b710 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:57.642872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a577749-94d9-4f55-bd5e-df559209b710 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:57.643174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a577749-94d9-4f55-bd5e-df559209b710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:57.664435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7a577749-94d9-4f55-bd5e-df559209b710 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:57.665687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7a577749-94d9-4f55-bd5e-df559209b710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:57.743774 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 222/420] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:58.030876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa1444-76fc-495d-8893-78fc5d6948e7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:58.142444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa1444-76fc-495d-8893-78fc5d6948e7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:58.183189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5059d-8fb7-47ae-9139-bc4ec9edc2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:58.184175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5059d-8fb7-47ae-9139-bc4ec9edc2fe None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:58.184759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5059d-8fb7-47ae-9139-bc4ec9edc2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:58.185280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5059d-8fb7-47ae-9139-bc4ec9edc2fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:58.193506 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:58.205756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5059d-8fb7-47ae-9139-bc4ec9edc2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-68d5059d-8fb7-47ae-9139-bc4ec9edc2fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:58.210607 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:58.211521 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:58.212296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:58.212296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:58.212296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:58.212296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:58.212296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:58.212296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:58.212296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:58.212296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:58.212296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:58.212296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:58.212296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:58.212296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:58.215228 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 199/421] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:45:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:58.221367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a577749-94d9-4f55-bd5e-df559209b710 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:58.381032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a577749-94d9-4f55-bd5e-df559209b710 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:58.413885 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:58.420540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60a1f5-eb74-4c6c-9a82-93e14ed64047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:58.421146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60a1f5-eb74-4c6c-9a82-93e14ed64047 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:58.421423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60a1f5-eb74-4c6c-9a82-93e14ed64047 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:58.421693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60a1f5-eb74-4c6c-9a82-93e14ed64047 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:58.422349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60a1f5-eb74-4c6c-9a82-93e14ed64047 None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:58.422649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60a1f5-eb74-4c6c-9a82-93e14ed64047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:58.424682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60a1f5-eb74-4c6c-9a82-93e14ed64047 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:58.442250 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 223/422] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:45:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:58.447562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5059d-8fb7-47ae-9139-bc4ec9edc2fe None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:58.572429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5059d-8fb7-47ae-9139-bc4ec9edc2fe None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:58.617414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6e529-b4c6-4e06-87ad-8117653f081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:58.618287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6e529-b4c6-4e06-87ad-8117653f081f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:58.618744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6e529-b4c6-4e06-87ad-8117653f081f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:58.619190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6e529-b4c6-4e06-87ad-8117653f081f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:58.633628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6e529-b4c6-4e06-87ad-8117653f081f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:58.635280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6e529-b4c6-4e06-87ad-8117653f081f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-eed6e529-b4c6-4e06-87ad-8117653f081f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:58.650384 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:58.651518 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:58.652579 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:58.652579 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:58.652579 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:58.653979 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 200/423] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:58.660624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60a1f5-eb74-4c6c-9a82-93e14ed64047 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:58.794712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60a1f5-eb74-4c6c-9a82-93e14ed64047 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:58.840497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff91d2-35b6-45f8-8b3d-edc1f00a2817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:58.841349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff91d2-35b6-45f8-8b3d-edc1f00a2817 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:58.841766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff91d2-35b6-45f8-8b3d-edc1f00a2817 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:58.842172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff91d2-35b6-45f8-8b3d-edc1f00a2817 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:58.842995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff91d2-35b6-45f8-8b3d-edc1f00a2817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:58.843452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff91d2-35b6-45f8-8b3d-edc1f00a2817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:58.845114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff91d2-35b6-45f8-8b3d-edc1f00a2817 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:58.864654 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 224/424] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:58.870247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6e529-b4c6-4e06-87ad-8117653f081f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:58.876779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e470-335a-4f91-bca3-294cbc03b5e5 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:58.877063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e470-335a-4f91-bca3-294cbc03b5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:58.877325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e470-335a-4f91-bca3-294cbc03b5e5 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:58.878629 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 225/425] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:58.885990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b503f-f832-4e1a-bd0f-f8ed2e0d4f18 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:58.886213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b503f-f832-4e1a-bd0f-f8ed2e0d4f18 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:58.886451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b503f-f832-4e1a-bd0f-f8ed2e0d4f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:58.905451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-474b503f-f832-4e1a-bd0f-f8ed2e0d4f18 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:58.906712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-474b503f-f832-4e1a-bd0f-f8ed2e0d4f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:58.955553 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:58.991397 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:59.031960 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 226/426] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:59.032652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6e529-b4c6-4e06-87ad-8117653f081f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:59.098046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a0125-0343-4333-a67a-4cf912f5f985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:59.098666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a0125-0343-4333-a67a-4cf912f5f985 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.098960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a0125-0343-4333-a67a-4cf912f5f985 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.099228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a0125-0343-4333-a67a-4cf912f5f985 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.115653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a0125-0343-4333-a67a-4cf912f5f985 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:59.117101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a0125-0343-4333-a67a-4cf912f5f985 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-990a0125-0343-4333-a67a-4cf912f5f985 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:45:59.129190 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:59.130085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:59.131560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:59.131560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:59.131560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:45:59.131560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:45:59.131560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:45:59.131560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:45:59.131560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:45:59.131560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:45:59.131560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:45:59.131560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:59.131560 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 201/427] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:45:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:59.135942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b503f-f832-4e1a-bd0f-f8ed2e0d4f18 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:59.202590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aa34f-8174-491c-9a11-bb86c3c71a13 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.202879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aa34f-8174-491c-9a11-bb86c3c71a13 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.203068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aa34f-8174-491c-9a11-bb86c3c71a13 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.204420 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 202/428] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:45:59.210069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26d69-9814-43a6-99f7-3d85d4a2c070 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.210345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26d69-9814-43a6-99f7-3d85d4a2c070 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.210999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26d69-9814-43a6-99f7-3d85d4a2c070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.242508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-45a26d69-9814-43a6-99f7-3d85d4a2c070 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:59.243726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-45a26d69-9814-43a6-99f7-3d85d4a2c070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:59.307402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b503f-f832-4e1a-bd0f-f8ed2e0d4f18 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:59.377307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9290867-9489-4fec-be3d-82edd1f06ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:59.377928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9290867-9489-4fec-be3d-82edd1f06ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.378208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9290867-9489-4fec-be3d-82edd1f06ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.378479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9290867-9489-4fec-be3d-82edd1f06ea0 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.379235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9290867-9489-4fec-be3d-82edd1f06ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:59.379542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9290867-9489-4fec-be3d-82edd1f06ea0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:59.380981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9290867-9489-4fec-be3d-82edd1f06ea0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:59.383200 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 203/429] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:45:59.390367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a26d69-9814-43a6-99f7-3d85d4a2c070 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:59.407177 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 227/430] 10.222.0.39 () {56 vars in 1135 bytes} [Sun Oct 16 00:45:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:59.414878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9290867-9489-4fec-be3d-82edd1f06ea0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:59.455462 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:59.506111 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:59.554947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a26d69-9814-43a6-99f7-3d85d4a2c070 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:59.621419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9290867-9489-4fec-be3d-82edd1f06ea0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:59.627498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ff77a-7e42-46f6-a4cb-9ab8f50948b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:59.628135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff77a-7e42-46f6-a4cb-9ab8f50948b6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.628411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff77a-7e42-46f6-a4cb-9ab8f50948b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.628679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff77a-7e42-46f6-a4cb-9ab8f50948b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.649833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ff77a-7e42-46f6-a4cb-9ab8f50948b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-712ff77a-7e42-46f6-a4cb-9ab8f50948b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:59.654940 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:59.655810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:59.657048 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:59.657048 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:59.657048 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:59.657048 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:59.657048 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:59.657048 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:59.657048 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:59.657048 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:59.657048 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:59.657048 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:59.657048 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:59.657048 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:45:59.657048 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 204/431] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:45:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:59.664420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ff77a-7e42-46f6-a4cb-9ab8f50948b6 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:59.695539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb65f0e-3bce-478d-b99a-fe792d5344a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:59.696177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb65f0e-3bce-478d-b99a-fe792d5344a2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.696457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb65f0e-3bce-478d-b99a-fe792d5344a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.696820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb65f0e-3bce-478d-b99a-fe792d5344a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.713203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb65f0e-3bce-478d-b99a-fe792d5344a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:59.714571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb65f0e-3bce-478d-b99a-fe792d5344a2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-bdb65f0e-3bce-478d-b99a-fe792d5344a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:45:59.729692 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:59.730634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:45:59.731527 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:45:59.731527 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:45:59.731527 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:59.735388 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 228/432] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:45:59.736889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb65f0e-3bce-478d-b99a-fe792d5344a2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:59.781653 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:59.786110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ff77a-7e42-46f6-a4cb-9ab8f50948b6 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:59.822255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628150b5-40b4-4f4d-8902-cfdd0a339771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:59.823001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628150b5-40b4-4f4d-8902-cfdd0a339771 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.823353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628150b5-40b4-4f4d-8902-cfdd0a339771 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.823633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628150b5-40b4-4f4d-8902-cfdd0a339771 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.824292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628150b5-40b4-4f4d-8902-cfdd0a339771 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:59.824594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628150b5-40b4-4f4d-8902-cfdd0a339771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:59.825965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628150b5-40b4-4f4d-8902-cfdd0a339771 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:59.834728 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:59.835055 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 205/433] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:45:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:59.836479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d5644-0da4-4bd5-924e-41b6c3a56aa4 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.836935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d5644-0da4-4bd5-924e-41b6c3a56aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.837277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d5644-0da4-4bd5-924e-41b6c3a56aa4 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.838702 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 206/434] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:59.839777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d5644-0da4-4bd5-924e-41b6c3a56aa4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:59.849804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb65f0e-3bce-478d-b99a-fe792d5344a2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:59.886468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c3482-6977-44bb-8dbf-22c3c8ba361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:59.887121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c3482-6977-44bb-8dbf-22c3c8ba361c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.887401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c3482-6977-44bb-8dbf-22c3c8ba361c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.887688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c3482-6977-44bb-8dbf-22c3c8ba361c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.902441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c3482-6977-44bb-8dbf-22c3c8ba361c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-c05c3482-6977-44bb-8dbf-22c3c8ba361c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:59.909412 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:59.910326 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 229/435] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:45:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:59.911793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c3482-6977-44bb-8dbf-22c3c8ba361c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:59.956947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d5644-0da4-4bd5-924e-41b6c3a56aa4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:59.993226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcb4fe-6f73-4513-be7e-ef2b61b52285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:59.994101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb4fe-6f73-4513-be7e-ef2b61b52285 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.994554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb4fe-6f73-4513-be7e-ef2b61b52285 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.995043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb4fe-6f73-4513-be7e-ef2b61b52285 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.995865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcb4fe-6f73-4513-be7e-ef2b61b52285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:59.996339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcb4fe-6f73-4513-be7e-ef2b61b52285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:59.997866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcb4fe-6f73-4513-be7e-ef2b61b52285 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.009407 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 207/436] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:00.010869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c84fef-6389-4a66-9f10-f9ad78e7d7e1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.011198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c84fef-6389-4a66-9f10-f9ad78e7d7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.011459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c84fef-6389-4a66-9f10-f9ad78e7d7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.026291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c3482-6977-44bb-8dbf-22c3c8ba361c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.029741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-61c84fef-6389-4a66-9f10-f9ad78e7d7e1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:00.030982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-61c84fef-6389-4a66-9f10-f9ad78e7d7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:00.047588 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:00.067340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e33d23-a8ff-449c-a767-99ec406ecc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.067969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e33d23-a8ff-449c-a767-99ec406ecc46 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.068246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e33d23-a8ff-449c-a767-99ec406ecc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.068516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e33d23-a8ff-449c-a767-99ec406ecc46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.082860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e33d23-a8ff-449c-a767-99ec406ecc46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.084543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e33d23-a8ff-449c-a767-99ec406ecc46 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-53e33d23-a8ff-449c-a767-99ec406ecc46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:00.099744 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:00.100832 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:00.101701 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:00.101701 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:00.101701 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:00.101701 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 230/437] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:00.101924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e33d23-a8ff-449c-a767-99ec406ecc46 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.106540 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:00.115660 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 208/438] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:46:00.115660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c84fef-6389-4a66-9f10-f9ad78e7d7e1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.206496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e33d23-a8ff-449c-a767-99ec406ecc46 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.244332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c5ea5-f5e9-4658-a292-aa6e5a1514c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.244853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c5ea5-f5e9-4658-a292-aa6e5a1514c5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.245132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c5ea5-f5e9-4658-a292-aa6e5a1514c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.245406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c5ea5-f5e9-4658-a292-aa6e5a1514c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.246065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c5ea5-f5e9-4658-a292-aa6e5a1514c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:00.246369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c5ea5-f5e9-4658-a292-aa6e5a1514c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.247786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c5ea5-f5e9-4658-a292-aa6e5a1514c5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.251531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c84fef-6389-4a66-9f10-f9ad78e7d7e1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.256169 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 231/439] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:00.256816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c5ea5-f5e9-4658-a292-aa6e5a1514c5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.298625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206632d6-0fde-48ae-bc68-5efa6493b9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.299831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206632d6-0fde-48ae-bc68-5efa6493b9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.300119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206632d6-0fde-48ae-bc68-5efa6493b9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.300393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206632d6-0fde-48ae-bc68-5efa6493b9b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.309985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206632d6-0fde-48ae-bc68-5efa6493b9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.311577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206632d6-0fde-48ae-bc68-5efa6493b9b0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.327266 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-206632d6-0fde-48ae-bc68-5efa6493b9b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:00.327718 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:00.328543 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:00.329426 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:00.329426 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:00.329426 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:00.329426 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:00.329426 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:00.329426 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:00.329426 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:00.329426 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:00.329426 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 209/440] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:00.330332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206632d6-0fde-48ae-bc68-5efa6493b9b0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.348895 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:00.368023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c5ea5-f5e9-4658-a292-aa6e5a1514c5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.403060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c97b2-8d17-4e9a-aeeb-19cabc81cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.403665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c97b2-8d17-4e9a-aeeb-19cabc81cc95 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.403945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c97b2-8d17-4e9a-aeeb-19cabc81cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.404473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c97b2-8d17-4e9a-aeeb-19cabc81cc95 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.405107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c97b2-8d17-4e9a-aeeb-19cabc81cc95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:00.405408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c97b2-8d17-4e9a-aeeb-19cabc81cc95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.406770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c97b2-8d17-4e9a-aeeb-19cabc81cc95 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.418656 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 232/441] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:00.420004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe535f6-8b87-41b5-8ed4-a54eab6f0463 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.420288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe535f6-8b87-41b5-8ed4-a54eab6f0463 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.420558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe535f6-8b87-41b5-8ed4-a54eab6f0463 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.421745 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 233/442] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:00.422425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe535f6-8b87-41b5-8ed4-a54eab6f0463 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.446770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206632d6-0fde-48ae-bc68-5efa6493b9b0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.478581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cb438-470a-430e-bf8a-a247cda200d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.479258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cb438-470a-430e-bf8a-a247cda200d3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.479530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cb438-470a-430e-bf8a-a247cda200d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.479799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cb438-470a-430e-bf8a-a247cda200d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.490780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cb438-470a-430e-bf8a-a247cda200d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.492243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cb438-470a-430e-bf8a-a247cda200d3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-617cb438-470a-430e-bf8a-a247cda200d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:00.506873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:00.507967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:00.508960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:00.508960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:00.508960 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:00.508960 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 210/443] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:00.508960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cb438-470a-430e-bf8a-a247cda200d3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.525462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe535f6-8b87-41b5-8ed4-a54eab6f0463 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.552401 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:00.565428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cc01f-d2d5-4461-93f1-82fe16a51f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.566026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc01f-d2d5-4461-93f1-82fe16a51f3b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.566299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc01f-d2d5-4461-93f1-82fe16a51f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.566563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc01f-d2d5-4461-93f1-82fe16a51f3b None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.567275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cc01f-d2d5-4461-93f1-82fe16a51f3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:00.567576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cc01f-d2d5-4461-93f1-82fe16a51f3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.568083 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:00.568994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cc01f-d2d5-4461-93f1-82fe16a51f3b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.581069 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 234/444] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:00.581852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cc01f-d2d5-4461-93f1-82fe16a51f3b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.607431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cb438-470a-430e-bf8a-a247cda200d3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.640192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaa96c-ba29-4f42-9831-d8417b100e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.640809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaa96c-ba29-4f42-9831-d8417b100e3a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.641084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaa96c-ba29-4f42-9831-d8417b100e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.641351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaa96c-ba29-4f42-9831-d8417b100e3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.651369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaa96c-ba29-4f42-9831-d8417b100e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-fccaa96c-ba29-4f42-9831-d8417b100e3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:00.656747 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:00.658333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:00.659276 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:00.659276 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:00.659276 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:00.659276 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:00.659276 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:00.659276 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:00.659276 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:00.659276 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:00.659276 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:00.659276 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:00.659276 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:00.659276 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:00.663264 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 211/445] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:00.664315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e44da-6908-4ba5-b519-a9c9b663caa5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.664595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e44da-6908-4ba5-b519-a9c9b663caa5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.664867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e44da-6908-4ba5-b519-a9c9b663caa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.683136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-de5e44da-6908-4ba5-b519-a9c9b663caa5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:00.683325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cc01f-d2d5-4461-93f1-82fe16a51f3b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.684341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-de5e44da-6908-4ba5-b519-a9c9b663caa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:00.718050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a7bc7-315f-481f-b70f-1c95a0a88b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.718666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a7bc7-315f-481f-b70f-1c95a0a88b9a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.718968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a7bc7-315f-481f-b70f-1c95a0a88b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.719247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a7bc7-315f-481f-b70f-1c95a0a88b9a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.726717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a7bc7-315f-481f-b70f-1c95a0a88b9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.728193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a7bc7-315f-481f-b70f-1c95a0a88b9a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-fa8a7bc7-315f-481f-b70f-1c95a0a88b9a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:00.739419 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:00.740484 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:00.741379 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:00.741379 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:00.741379 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:00.741379 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:00.741379 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:00.741379 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:00.741379 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:00.741379 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:00.741379 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 16 00:46:00.741379 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:00.741379 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 235/446] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:00.741379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a7bc7-315f-481f-b70f-1c95a0a88b9a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.754143 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 212/447] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:46:00.754977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e44da-6908-4ba5-b519-a9c9b663caa5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.793259 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:00.816580 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:00.854125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a7bc7-315f-481f-b70f-1c95a0a88b9a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.864939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e44da-6908-4ba5-b519-a9c9b663caa5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.891152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4b762-1ec1-4b2a-9a75-390574ccb028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.892425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4b762-1ec1-4b2a-9a75-390574ccb028 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.892767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4b762-1ec1-4b2a-9a75-390574ccb028 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.893107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4b762-1ec1-4b2a-9a75-390574ccb028 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.893804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4b762-1ec1-4b2a-9a75-390574ccb028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:00.894219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4b762-1ec1-4b2a-9a75-390574ccb028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.895663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4b762-1ec1-4b2a-9a75-390574ccb028 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.900771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad3456-0e27-4994-a57c-6b93c4ede8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.901500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad3456-0e27-4994-a57c-6b93c4ede8b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.901851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad3456-0e27-4994-a57c-6b93c4ede8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.902199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad3456-0e27-4994-a57c-6b93c4ede8b9 None admin] PATH_INFO: `/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/ef8c6c33c3504949876d496a5213494d/roles/b8b6732605964de6aedfe2a3cf507d03` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.912869 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 236/448] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:00.912869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4b762-1ec1-4b2a-9a75-390574ccb028 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.920111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad3456-0e27-4994-a57c-6b93c4ede8b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2efc56617bd54471a648f03215b3bfb1, user_id=ef8c6c33c3504949876d496a5213494d, role_id=b8b6732605964de6aedfe2a3cf507d03)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.921674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad3456-0e27-4994-a57c-6b93c4ede8b9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.935732 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 213/449] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:46:00 2022] PUT /identity/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/ef8c6c33c3504949876d496a5213494d/roles/b8b6732605964de6aedfe2a3cf507d03 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:46:00.936515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad3456-0e27-4994-a57c-6b93c4ede8b9 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:01.038464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4b762-1ec1-4b2a-9a75-390574ccb028 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:01.046799 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:01.077816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad3456-0e27-4994-a57c-6b93c4ede8b9 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:01.079632 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:01.082813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d0109-ff1e-4c34-8e8d-afa56ad3b95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:01.083470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d0109-ff1e-4c34-8e8d-afa56ad3b95a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:01.083750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d0109-ff1e-4c34-8e8d-afa56ad3b95a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:01.084020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d0109-ff1e-4c34-8e8d-afa56ad3b95a None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:01.084685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d0109-ff1e-4c34-8e8d-afa56ad3b95a None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:01.084986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d0109-ff1e-4c34-8e8d-afa56ad3b95a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:01.086417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d0109-ff1e-4c34-8e8d-afa56ad3b95a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:01.097278 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 237/450] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:01.098351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d0109-ff1e-4c34-8e8d-afa56ad3b95a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:01.123902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61bbfb-23d3-45c8-9a26-ce0725a0669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:01.124509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61bbfb-23d3-45c8-9a26-ce0725a0669d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:01.124784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61bbfb-23d3-45c8-9a26-ce0725a0669d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:01.125051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61bbfb-23d3-45c8-9a26-ce0725a0669d None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:01.125771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61bbfb-23d3-45c8-9a26-ce0725a0669d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:01.126103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61bbfb-23d3-45c8-9a26-ce0725a0669d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:01.129040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61bbfb-23d3-45c8-9a26-ce0725a0669d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:01.150975 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 214/451] 10.222.0.39 () {56 vars in 1137 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:01.150975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61bbfb-23d3-45c8-9a26-ce0725a0669d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:01.206929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d0109-ff1e-4c34-8e8d-afa56ad3b95a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:01.240493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eae01c-39fd-4be0-8445-c8e21e23c71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:01.241101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae01c-39fd-4be0-8445-c8e21e23c71f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:01.241375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae01c-39fd-4be0-8445-c8e21e23c71f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:01.241642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae01c-39fd-4be0-8445-c8e21e23c71f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:01.248941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eae01c-39fd-4be0-8445-c8e21e23c71f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:01.250366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eae01c-39fd-4be0-8445-c8e21e23c71f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:01.259011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61bbfb-23d3-45c8-9a26-ce0725a0669d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-77eae01c-39fd-4be0-8445-c8e21e23c71f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:01.261267 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:01.262305 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:01.263435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:01.263435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:01.263435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:01.263435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:01.263435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:01.263435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:01.263435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:01.263435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:01.263435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:46:01.263435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:01.263435 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 238/452] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Oct 16 00:46:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:01.264492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eae01c-39fd-4be0-8445-c8e21e23c71f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:01.301194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fbdaf-bcf9-42fc-a5dd-4e8b77270946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:01.301396 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:01.301964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fbdaf-bcf9-42fc-a5dd-4e8b77270946 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:01.302373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fbdaf-bcf9-42fc-a5dd-4e8b77270946 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:01.302907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fbdaf-bcf9-42fc-a5dd-4e8b77270946 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:01.313028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fbdaf-bcf9-42fc-a5dd-4e8b77270946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f79fbdaf-bcf9-42fc-a5dd-4e8b77270946 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:01.318025 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:01.319155 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:01.320130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:01.320130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:01.320130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:01.320130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:01.320130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:01.320130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:01.320130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:01.320130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:01.320130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:01.320130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:01.320130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:01.320130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:01.324046 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 215/453] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:46:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:01.325059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fbdaf-bcf9-42fc-a5dd-4e8b77270946 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:01.347235 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:01.385295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eae01c-39fd-4be0-8445-c8e21e23c71f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:01.422715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd2fe5-4085-4c4e-872d-32b227f095dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:01.423542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2fe5-4085-4c4e-872d-32b227f095dc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:01.423725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2fe5-4085-4c4e-872d-32b227f095dc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:01.423991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2fe5-4085-4c4e-872d-32b227f095dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:01.433151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fbdaf-bcf9-42fc-a5dd-4e8b77270946 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:01.434643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd2fe5-4085-4c4e-872d-32b227f095dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:01.436145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd2fe5-4085-4c4e-872d-32b227f095dc None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-30fd2fe5-4085-4c4e-872d-32b227f095dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:01.451280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:01.452451 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:01.453500 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:01.453500 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:01.453500 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:01.457250 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 239/454] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:01.458067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd2fe5-4085-4c4e-872d-32b227f095dc None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:01.471568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46659722-6839-433e-8fa9-ad7026bfbc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:01.472308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46659722-6839-433e-8fa9-ad7026bfbc57 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:01.472693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46659722-6839-433e-8fa9-ad7026bfbc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:01.472971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46659722-6839-433e-8fa9-ad7026bfbc57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:01.540867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46659722-6839-433e-8fa9-ad7026bfbc57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:01.542327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46659722-6839-433e-8fa9-ad7026bfbc57 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:01.550860 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:01.567307 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:01.580889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd2fe5-4085-4c4e-872d-32b227f095dc None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:01.616177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a5c81-7723-4f59-9ce8-ca9930e3fa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:01.616782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a5c81-7723-4f59-9ce8-ca9930e3fa94 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:01.617062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a5c81-7723-4f59-9ce8-ca9930e3fa94 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:01.617336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a5c81-7723-4f59-9ce8-ca9930e3fa94 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:01.618202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a5c81-7723-4f59-9ce8-ca9930e3fa94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:01.618379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a5c81-7723-4f59-9ce8-ca9930e3fa94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:01.619843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a5c81-7723-4f59-9ce8-ca9930e3fa94 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:01.643416 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 240/455] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Oct 16 00:46:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:01.643416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a5c81-7723-4f59-9ce8-ca9930e3fa94 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:01.660344 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 216/456] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:46:01.660344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46659722-6839-433e-8fa9-ad7026bfbc57 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:01.753952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a5c81-7723-4f59-9ce8-ca9930e3fa94 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:01.763811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46659722-6839-433e-8fa9-ad7026bfbc57 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:01.784872 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:01.791026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059ecf9-f96d-4878-8b7e-6b44aaf46676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:01.791656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059ecf9-f96d-4878-8b7e-6b44aaf46676 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:01.792020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059ecf9-f96d-4878-8b7e-6b44aaf46676 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:01.792292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059ecf9-f96d-4878-8b7e-6b44aaf46676 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:01.792944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059ecf9-f96d-4878-8b7e-6b44aaf46676 None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:01.793250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059ecf9-f96d-4878-8b7e-6b44aaf46676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:01.794762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059ecf9-f96d-4878-8b7e-6b44aaf46676 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:01.800818 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:01.800945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f633b-1799-47a3-b96a-7bdbc8e157b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:01.801315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f633b-1799-47a3-b96a-7bdbc8e157b5 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:01.801685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f633b-1799-47a3-b96a-7bdbc8e157b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:01.802094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f633b-1799-47a3-b96a-7bdbc8e157b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:01.802763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f633b-1799-47a3-b96a-7bdbc8e157b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:01.803095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f633b-1799-47a3-b96a-7bdbc8e157b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:01.804536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f633b-1799-47a3-b96a-7bdbc8e157b5 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:01.809712 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 241/457] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:46:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:01.810624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059ecf9-f96d-4878-8b7e-6b44aaf46676 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:01.821304 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 217/458] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:01.821304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f633b-1799-47a3-b96a-7bdbc8e157b5 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:01.920181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059ecf9-f96d-4878-8b7e-6b44aaf46676 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:01.932724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f633b-1799-47a3-b96a-7bdbc8e157b5 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:01.957022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7adfaa-b998-419f-8304-f916f29c7728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:01.957763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7adfaa-b998-419f-8304-f916f29c7728 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:01.958239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7adfaa-b998-419f-8304-f916f29c7728 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:01.958608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7adfaa-b998-419f-8304-f916f29c7728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:01.975753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778dfcd-37ea-4ecd-af1c-00cf66eb5491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:01.976379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778dfcd-37ea-4ecd-af1c-00cf66eb5491 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:01.976652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778dfcd-37ea-4ecd-af1c-00cf66eb5491 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:01.976916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778dfcd-37ea-4ecd-af1c-00cf66eb5491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:01.989488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778dfcd-37ea-4ecd-af1c-00cf66eb5491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:01.991067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778dfcd-37ea-4ecd-af1c-00cf66eb5491 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-2778dfcd-37ea-4ecd-af1c-00cf66eb5491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:02.005396 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:02.006466 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:02.007357 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:02.007357 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:02.007357 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:02.007357 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 218/459] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:02.007690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778dfcd-37ea-4ecd-af1c-00cf66eb5491 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:02.040041 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:02.041596 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:02.043263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7adfaa-b998-419f-8304-f916f29c7728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:02.044984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7adfaa-b998-419f-8304-f916f29c7728 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:02.113948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778dfcd-37ea-4ecd-af1c-00cf66eb5491 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:02.150587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453249b-e99c-4f97-beaf-4b6fa3db25d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:02.151262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453249b-e99c-4f97-beaf-4b6fa3db25d9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:02.151546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453249b-e99c-4f97-beaf-4b6fa3db25d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:02.151820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453249b-e99c-4f97-beaf-4b6fa3db25d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:02.160260 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 242/460] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:46:02.161250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7adfaa-b998-419f-8304-f916f29c7728 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:02.168267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453249b-e99c-4f97-beaf-4b6fa3db25d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:02.169737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453249b-e99c-4f97-beaf-4b6fa3db25d9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-5453249b-e99c-4f97-beaf-4b6fa3db25d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:02.185390 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:02.186328 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:02.189253 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:02.189253 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:02.189253 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:02.189253 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 219/461] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:02.189253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453249b-e99c-4f97-beaf-4b6fa3db25d9 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:02.269786 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:02.272735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7adfaa-b998-419f-8304-f916f29c7728 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:02.276038 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:02.293050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453249b-e99c-4f97-beaf-4b6fa3db25d9 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:02.308445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0f18b-eb55-41fa-8813-dc086a85f8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:02.309064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0f18b-eb55-41fa-8813-dc086a85f8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:02.309336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0f18b-eb55-41fa-8813-dc086a85f8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:02.309619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0f18b-eb55-41fa-8813-dc086a85f8c3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:02.317581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0f18b-eb55-41fa-8813-dc086a85f8c3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:02.319036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0f18b-eb55-41fa-8813-dc086a85f8c3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:02.328543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17102519-3570-4f7b-9d38-a5f8e765719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:02.329809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17102519-3570-4f7b-9d38-a5f8e765719f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:02.330201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17102519-3570-4f7b-9d38-a5f8e765719f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:02.330541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17102519-3570-4f7b-9d38-a5f8e765719f None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b9a0f18b-eb55-41fa-8813-dc086a85f8c3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:02.330777 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:02.336466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:02.337589 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:02.337589 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:02.337589 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:02.337589 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:02.337589 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:02.337589 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:02.337589 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:02.337589 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:02.337589 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:46:02.337589 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:02.338205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17102519-3570-4f7b-9d38-a5f8e765719f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:02.338287 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 243/462] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:46:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:02.338432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17102519-3570-4f7b-9d38-a5f8e765719f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:02.338515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0f18b-eb55-41fa-8813-dc086a85f8c3 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:02.338593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17102519-3570-4f7b-9d38-a5f8e765719f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:02.350731 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 220/463] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:02.351573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17102519-3570-4f7b-9d38-a5f8e765719f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:02.450772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17102519-3570-4f7b-9d38-a5f8e765719f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:02.454085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0f18b-eb55-41fa-8813-dc086a85f8c3 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:02.492040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdd38e-4bb3-4b7a-a9af-987ae0282525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:02.492240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98acf3-f02e-4fd9-ae2e-056cfe7785d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:02.492661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98acf3-f02e-4fd9-ae2e-056cfe7785d0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:02.492941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98acf3-f02e-4fd9-ae2e-056cfe7785d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:02.493030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdd38e-4bb3-4b7a-a9af-987ae0282525 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:02.493212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98acf3-f02e-4fd9-ae2e-056cfe7785d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:02.493511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdd38e-4bb3-4b7a-a9af-987ae0282525 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:02.493914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdd38e-4bb3-4b7a-a9af-987ae0282525 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:02.494607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdd38e-4bb3-4b7a-a9af-987ae0282525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:02.495057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdd38e-4bb3-4b7a-a9af-987ae0282525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:02.496425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdd38e-4bb3-4b7a-a9af-987ae0282525 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:02.504335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98acf3-f02e-4fd9-ae2e-056cfe7785d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:02.505791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98acf3-f02e-4fd9-ae2e-056cfe7785d0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:02.512573 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 221/464] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:02.512573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdd38e-4bb3-4b7a-a9af-987ae0282525 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:02.514896 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-1f98acf3-f02e-4fd9-ae2e-056cfe7785d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:02.527122 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:02.528226 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:02.529863 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:02.529863 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:02.529863 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:02.533893 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 244/465] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:02.534758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98acf3-f02e-4fd9-ae2e-056cfe7785d0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:02.554687 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:02.628205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdd38e-4bb3-4b7a-a9af-987ae0282525 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:02.661486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98acf3-f02e-4fd9-ae2e-056cfe7785d0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:02.666857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12876a0-81a0-4122-98bf-51e8135cf7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:02.667570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12876a0-81a0-4122-98bf-51e8135cf7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:02.667922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12876a0-81a0-4122-98bf-51e8135cf7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:02.668263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12876a0-81a0-4122-98bf-51e8135cf7a9 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:02.669578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12876a0-81a0-4122-98bf-51e8135cf7a9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:02.669958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12876a0-81a0-4122-98bf-51e8135cf7a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:02.672399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12876a0-81a0-4122-98bf-51e8135cf7a9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:02.692962 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 222/466] 10.222.0.39 () {56 vars in 1137 bytes} [Sun Oct 16 00:46:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:02.693946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12876a0-81a0-4122-98bf-51e8135cf7a9 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:02.703403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47adabb-d26a-45c9-b2ba-41df0d69770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:02.704062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47adabb-d26a-45c9-b2ba-41df0d69770e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:02.704441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47adabb-d26a-45c9-b2ba-41df0d69770e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:02.704717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47adabb-d26a-45c9-b2ba-41df0d69770e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:02.711662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47adabb-d26a-45c9-b2ba-41df0d69770e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:02.713097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47adabb-d26a-45c9-b2ba-41df0d69770e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-c47adabb-d26a-45c9-b2ba-41df0d69770e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:02.724291 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:02.725310 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:02.731349 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:02.731349 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:02.731349 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:02.731349 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:02.731349 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:02.731349 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:02.731349 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:02.731349 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:02.731349 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 245/467] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:02.731349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47adabb-d26a-45c9-b2ba-41df0d69770e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:02.767573 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:02.803726 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:02.812201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12876a0-81a0-4122-98bf-51e8135cf7a9 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:02.836628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47adabb-d26a-45c9-b2ba-41df0d69770e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:02.848900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b3c63-1b90-490d-a19c-b754c236ebf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:02.849531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b3c63-1b90-490d-a19c-b754c236ebf0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:02.849811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b3c63-1b90-490d-a19c-b754c236ebf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:02.850088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b3c63-1b90-490d-a19c-b754c236ebf0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:02.859620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b3c63-1b90-490d-a19c-b754c236ebf0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:02.861622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b3c63-1b90-490d-a19c-b754c236ebf0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f34b3c63-1b90-490d-a19c-b754c236ebf0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:02.873305 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:02.874222 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:02.875949 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:02.875949 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:02.875949 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:02.875949 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:02.875949 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:02.875949 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:02.875949 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:02.875949 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:02.875949 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 16 00:46:02.875949 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:02.875949 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 223/468] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:46:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:02.875949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b3c63-1b90-490d-a19c-b754c236ebf0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:02.883920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfac6b7-54a6-4af0-8c98-e65ac863bcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:02.884678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfac6b7-54a6-4af0-8c98-e65ac863bcef None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:02.884953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfac6b7-54a6-4af0-8c98-e65ac863bcef None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:02.885220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfac6b7-54a6-4af0-8c98-e65ac863bcef None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:02.885879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfac6b7-54a6-4af0-8c98-e65ac863bcef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:02.886334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfac6b7-54a6-4af0-8c98-e65ac863bcef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:02.887821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfac6b7-54a6-4af0-8c98-e65ac863bcef None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:02.905605 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 246/469] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:02.905605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfac6b7-54a6-4af0-8c98-e65ac863bcef None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:02.983724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b3c63-1b90-490d-a19c-b754c236ebf0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:03.007975 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:03.019333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfac6b7-54a6-4af0-8c98-e65ac863bcef None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:03.023139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52d10d-a0e6-4a1f-87e8-288c4b07e77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:03.023773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52d10d-a0e6-4a1f-87e8-288c4b07e77e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.024048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52d10d-a0e6-4a1f-87e8-288c4b07e77e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.024314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52d10d-a0e6-4a1f-87e8-288c4b07e77e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.053604 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:03.059518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41b828-d934-4f81-9d54-856d643cf7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:03.060135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b828-d934-4f81-9d54-856d643cf7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.060416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b828-d934-4f81-9d54-856d643cf7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.060688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b828-d934-4f81-9d54-856d643cf7d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.061369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41b828-d934-4f81-9d54-856d643cf7d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:03.061675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41b828-d934-4f81-9d54-856d643cf7d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:03.063981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41b828-d934-4f81-9d54-856d643cf7d4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:03.075815 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 247/470] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:03.076490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41b828-d934-4f81-9d54-856d643cf7d4 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:03.103503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52d10d-a0e6-4a1f-87e8-288c4b07e77e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:03.105265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52d10d-a0e6-4a1f-87e8-288c4b07e77e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:03.176593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41b828-d934-4f81-9d54-856d643cf7d4 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:03.204829 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 224/471] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:46:03.209734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52d10d-a0e6-4a1f-87e8-288c4b07e77e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:03.215594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc797a94-8007-4a3a-9042-d4ba5f38f4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:03.216199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc797a94-8007-4a3a-9042-d4ba5f38f4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.216475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc797a94-8007-4a3a-9042-d4ba5f38f4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.216741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc797a94-8007-4a3a-9042-d4ba5f38f4a8 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.217459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc797a94-8007-4a3a-9042-d4ba5f38f4a8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:03.217763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc797a94-8007-4a3a-9042-d4ba5f38f4a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:03.219214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc797a94-8007-4a3a-9042-d4ba5f38f4a8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:03.227991 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:03.238121 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 248/472] 10.222.0.39 () {56 vars in 1139 bytes} [Sun Oct 16 00:46:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:03.238685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc797a94-8007-4a3a-9042-d4ba5f38f4a8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:03.287157 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:03.302529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52d10d-a0e6-4a1f-87e8-288c4b07e77e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:03.336440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc797a94-8007-4a3a-9042-d4ba5f38f4a8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:03.338066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02a993-b213-484d-800e-37230d354887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:03.338688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02a993-b213-484d-800e-37230d354887 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.338989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02a993-b213-484d-800e-37230d354887 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.339267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02a993-b213-484d-800e-37230d354887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.345702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02a993-b213-484d-800e-37230d354887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:03.347169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02a993-b213-484d-800e-37230d354887 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-fe02a993-b213-484d-800e-37230d354887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:03.357925 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:03.358945 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:03.359978 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:03.359978 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:03.359978 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:03.359978 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:03.359978 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:03.359978 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:03.359978 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:03.359978 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:03.359978 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 225/473] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:03.364104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56165549-3031-4e21-ad27-970f8a555323 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.364562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56165549-3031-4e21-ad27-970f8a555323 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.364839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56165549-3031-4e21-ad27-970f8a555323 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.366094 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 226/474] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:03.366894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56165549-3031-4e21-ad27-970f8a555323 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:03.369767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce782d40-d441-4cfc-a785-af230b5358b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:03.370492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce782d40-d441-4cfc-a785-af230b5358b3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.370774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce782d40-d441-4cfc-a785-af230b5358b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.371092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce782d40-d441-4cfc-a785-af230b5358b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.371806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce782d40-d441-4cfc-a785-af230b5358b3 None admin] RBAC: Adding query filter params (role.id=b8b6732605964de6aedfe2a3cf507d03, scope.project.id=2efc56617bd54471a648f03215b3bfb1, user.id=afb30ad752234d8c9f12302b0b69666b) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:03.372111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce782d40-d441-4cfc-a785-af230b5358b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:03.373538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce782d40-d441-4cfc-a785-af230b5358b3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:03.379262 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 249/475] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:03 2022] GET /identity/v3/role_assignments?user.id=afb30ad752234d8c9f12302b0b69666b&scope.project.id=2efc56617bd54471a648f03215b3bfb1&role.id=b8b6732605964de6aedfe2a3cf507d03 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:03.380039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce782d40-d441-4cfc-a785-af230b5358b3 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:03.459585 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:03.481692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56165549-3031-4e21-ad27-970f8a555323 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:03.508247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce782d40-d441-4cfc-a785-af230b5358b3 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:03.523986 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:03.529482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121cac7-d9e1-4973-b034-b3ad9306cddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:03.530142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121cac7-d9e1-4973-b034-b3ad9306cddf None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.530421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121cac7-d9e1-4973-b034-b3ad9306cddf None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.530694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121cac7-d9e1-4973-b034-b3ad9306cddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.545262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121cac7-d9e1-4973-b034-b3ad9306cddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:03.546789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121cac7-d9e1-4973-b034-b3ad9306cddf None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:03.553088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26a7ec-e55b-4719-a4e7-8abcfffc1ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:03.553088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26a7ec-e55b-4719-a4e7-8abcfffc1ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.553088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26a7ec-e55b-4719-a4e7-8abcfffc1ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.553487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26a7ec-e55b-4719-a4e7-8abcfffc1ba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-3121cac7-d9e1-4973-b034-b3ad9306cddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:03.564085 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:03.565132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:03.566150 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:03.566150 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:03.566150 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:03.566150 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 227/476] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:03.566150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121cac7-d9e1-4973-b034-b3ad9306cddf None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:03.644780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26a7ec-e55b-4719-a4e7-8abcfffc1ba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:03.646242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26a7ec-e55b-4719-a4e7-8abcfffc1ba1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:03.685784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121cac7-d9e1-4973-b034-b3ad9306cddf None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:03.724276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318b1f8-ade3-4203-b9af-d9ce5575967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:03.724876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318b1f8-ade3-4203-b9af-d9ce5575967d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.725150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318b1f8-ade3-4203-b9af-d9ce5575967d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.725411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318b1f8-ade3-4203-b9af-d9ce5575967d None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.726085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318b1f8-ade3-4203-b9af-d9ce5575967d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:03.726385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318b1f8-ade3-4203-b9af-d9ce5575967d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:03.727821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318b1f8-ade3-4203-b9af-d9ce5575967d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:03.729422 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:03.741862 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 228/477] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:03.743001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc4a25-4f09-402c-aab4-a2d99ee8c043 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.743316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc4a25-4f09-402c-aab4-a2d99ee8c043 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.743588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc4a25-4f09-402c-aab4-a2d99ee8c043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.757787 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 250/478] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:46:03.758608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26a7ec-e55b-4719-a4e7-8abcfffc1ba1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:03.765890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0cfc4a25-4f09-402c-aab4-a2d99ee8c043 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:03.767144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0cfc4a25-4f09-402c-aab4-a2d99ee8c043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:03.774200 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:03.837619 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 229/479] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:46:03.838700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc4a25-4f09-402c-aab4-a2d99ee8c043 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:03.873500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26a7ec-e55b-4719-a4e7-8abcfffc1ba1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:03.913536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847085a-2787-4911-8b48-d883035084ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:03.914601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847085a-2787-4911-8b48-d883035084ae None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.914884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847085a-2787-4911-8b48-d883035084ae None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.915193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847085a-2787-4911-8b48-d883035084ae None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.915840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847085a-2787-4911-8b48-d883035084ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:03.916142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847085a-2787-4911-8b48-d883035084ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:03.917514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847085a-2787-4911-8b48-d883035084ae None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:03.938293 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 251/480] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:03.938293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847085a-2787-4911-8b48-d883035084ae None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:03.988934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc4a25-4f09-402c-aab4-a2d99ee8c043 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.019416 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:04.031617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30546b45-ac77-43e8-b55a-39cbc24963cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.033036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30546b45-ac77-43e8-b55a-39cbc24963cc None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.033623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30546b45-ac77-43e8-b55a-39cbc24963cc None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.034091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30546b45-ac77-43e8-b55a-39cbc24963cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.035046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30546b45-ac77-43e8-b55a-39cbc24963cc None admin] RBAC: Adding query filter params (role.id=b8b6732605964de6aedfe2a3cf507d03, scope.project.id=2efc56617bd54471a648f03215b3bfb1, user.id=a065cd54fd8745ca99f35405c711ffac) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:04.035549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30546b45-ac77-43e8-b55a-39cbc24963cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:04.037165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30546b45-ac77-43e8-b55a-39cbc24963cc None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:04.042028 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:04.043931 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 230/481] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:03 2022] GET /identity/v3/role_assignments?user.id=a065cd54fd8745ca99f35405c711ffac&scope.project.id=2efc56617bd54471a648f03215b3bfb1&role.id=b8b6732605964de6aedfe2a3cf507d03 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:04.045039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30546b45-ac77-43e8-b55a-39cbc24963cc None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.076580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847085a-2787-4911-8b48-d883035084ae None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.134649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09f289-f441-4304-a36a-1e3b59a21164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.135815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09f289-f441-4304-a36a-1e3b59a21164 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.136319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09f289-f441-4304-a36a-1e3b59a21164 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.136788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09f289-f441-4304-a36a-1e3b59a21164 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.165990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09f289-f441-4304-a36a-1e3b59a21164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:04.168155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09f289-f441-4304-a36a-1e3b59a21164 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:04.199174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30546b45-ac77-43e8-b55a-39cbc24963cc None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-bc09f289-f441-4304-a36a-1e3b59a21164 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:04.209125 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:04.210086 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:04.210908 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:04.210908 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:04.210908 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:04.213056 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 252/482] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:04.218667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09f289-f441-4304-a36a-1e3b59a21164 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.241611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec378019-2084-444a-bda9-601c8963900f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.242334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec378019-2084-444a-bda9-601c8963900f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.242618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec378019-2084-444a-bda9-601c8963900f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.242890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec378019-2084-444a-bda9-601c8963900f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.252808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec378019-2084-444a-bda9-601c8963900f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:04.254684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec378019-2084-444a-bda9-601c8963900f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-ec378019-2084-444a-bda9-601c8963900f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:04.273218 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:04.275560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:04.276474 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:04.276474 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:04.276474 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:04.276474 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:04.276474 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:04.276474 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:04.276474 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:04.276474 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:04.276474 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 231/483] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:04.280264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec378019-2084-444a-bda9-601c8963900f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.343594 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:04.399000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09f289-f441-4304-a36a-1e3b59a21164 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.423964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec378019-2084-444a-bda9-601c8963900f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.430248 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:04.443367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14004e2-1aa5-4609-803e-edbc21ec9f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.444132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14004e2-1aa5-4609-803e-edbc21ec9f9a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.444501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14004e2-1aa5-4609-803e-edbc21ec9f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.444868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14004e2-1aa5-4609-803e-edbc21ec9f9a None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.445618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14004e2-1aa5-4609-803e-edbc21ec9f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:04.446014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14004e2-1aa5-4609-803e-edbc21ec9f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:04.447509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14004e2-1aa5-4609-803e-edbc21ec9f9a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:04.462148 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 253/484] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:04.463176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14004e2-1aa5-4609-803e-edbc21ec9f9a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.476267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9a53a-736e-410f-9e6c-0d556fe3731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.476914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9a53a-736e-410f-9e6c-0d556fe3731c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.477233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9a53a-736e-410f-9e6c-0d556fe3731c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.477971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9a53a-736e-410f-9e6c-0d556fe3731c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.494735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9a53a-736e-410f-9e6c-0d556fe3731c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-41f9a53a-736e-410f-9e6c-0d556fe3731c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:04.503372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:04.504419 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:04.506065 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:04.506065 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:04.506065 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:04.506065 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:04.506065 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:04.506065 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:04.506065 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:04.506065 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:04.506065 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:04.506065 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:04.506065 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:04.506065 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:04.506065 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 232/485] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:04.507015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9a53a-736e-410f-9e6c-0d556fe3731c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.599233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14004e2-1aa5-4609-803e-edbc21ec9f9a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.642601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf8fa5-37f9-4b0b-939d-cf0631c34159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.643310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf8fa5-37f9-4b0b-939d-cf0631c34159 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.643585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf8fa5-37f9-4b0b-939d-cf0631c34159 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.643865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf8fa5-37f9-4b0b-939d-cf0631c34159 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.644485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf8fa5-37f9-4b0b-939d-cf0631c34159 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:04.644792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf8fa5-37f9-4b0b-939d-cf0631c34159 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:04.646648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf8fa5-37f9-4b0b-939d-cf0631c34159 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:04.653349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9a53a-736e-410f-9e6c-0d556fe3731c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.662231 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 254/486] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:04.663112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf8fa5-37f9-4b0b-939d-cf0631c34159 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.670435 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:04.705891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e79568-0c0d-4a2f-9559-9f56b94116a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.706704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e79568-0c0d-4a2f-9559-9f56b94116a1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.707104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e79568-0c0d-4a2f-9559-9f56b94116a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.707524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e79568-0c0d-4a2f-9559-9f56b94116a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.715361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e79568-0c0d-4a2f-9559-9f56b94116a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:04.717962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e79568-0c0d-4a2f-9559-9f56b94116a1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:04.728238 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c5e79568-0c0d-4a2f-9559-9f56b94116a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:04.735382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:04.737469 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:04.738334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:04.738334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:04.738334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:04.738334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:04.738334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:04.738334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:04.738334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:04.738334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:04.740820 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 233/487] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:04.741965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e79568-0c0d-4a2f-9559-9f56b94116a1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.801281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf8fa5-37f9-4b0b-939d-cf0631c34159 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.834625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0d070-54f4-415b-b913-6364219eb16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.835252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0d070-54f4-415b-b913-6364219eb16e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.835529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0d070-54f4-415b-b913-6364219eb16e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.835802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0d070-54f4-415b-b913-6364219eb16e None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.836463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0d070-54f4-415b-b913-6364219eb16e None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:04.836769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0d070-54f4-415b-b913-6364219eb16e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:04.838146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0d070-54f4-415b-b913-6364219eb16e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:04.848750 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 255/488] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:04.849620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0d070-54f4-415b-b913-6364219eb16e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.881378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e79568-0c0d-4a2f-9559-9f56b94116a1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.918288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fab84-cdf7-46bd-9d60-f67902d383f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.919027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fab84-cdf7-46bd-9d60-f67902d383f0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.919310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fab84-cdf7-46bd-9d60-f67902d383f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.919577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fab84-cdf7-46bd-9d60-f67902d383f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.920359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fab84-cdf7-46bd-9d60-f67902d383f0 None admin] RBAC: Adding query filter params (role.id=b8b6732605964de6aedfe2a3cf507d03, scope.project.id=2efc56617bd54471a648f03215b3bfb1, user.id=2536755baf5d4916bdc5942d5a1ace99) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:04.920663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fab84-cdf7-46bd-9d60-f67902d383f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:04.922264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fab84-cdf7-46bd-9d60-f67902d383f0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:04.929992 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 234/489] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/role_assignments?user.id=2536755baf5d4916bdc5942d5a1ace99&scope.project.id=2efc56617bd54471a648f03215b3bfb1&role.id=b8b6732605964de6aedfe2a3cf507d03 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:04.930904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fab84-cdf7-46bd-9d60-f67902d383f0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.969611 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:04.990645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0d070-54f4-415b-b913-6364219eb16e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.012645 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:05.074094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2eff3-62f9-4ebc-8303-1f65186acd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.074716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2eff3-62f9-4ebc-8303-1f65186acd4c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.075157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2eff3-62f9-4ebc-8303-1f65186acd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.075435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2eff3-62f9-4ebc-8303-1f65186acd4c None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.076148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2eff3-62f9-4ebc-8303-1f65186acd4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:05.076455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2eff3-62f9-4ebc-8303-1f65186acd4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:05.077918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2eff3-62f9-4ebc-8303-1f65186acd4c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:05.115297 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 256/490] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:05.119330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2eff3-62f9-4ebc-8303-1f65186acd4c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:05.125772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fab84-cdf7-46bd-9d60-f67902d383f0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.181428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c805f4e-33c8-4bf3-8eda-243fcf8879e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.182244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c805f4e-33c8-4bf3-8eda-243fcf8879e1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.182528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c805f4e-33c8-4bf3-8eda-243fcf8879e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.182803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c805f4e-33c8-4bf3-8eda-243fcf8879e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.197305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c805f4e-33c8-4bf3-8eda-243fcf8879e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:05.198589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c805f4e-33c8-4bf3-8eda-243fcf8879e1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-1c805f4e-33c8-4bf3-8eda-243fcf8879e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:05.215063 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:05.215999 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:05.216824 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:05.216824 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:05.216824 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:05.216824 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 235/491] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:05.226819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c805f4e-33c8-4bf3-8eda-243fcf8879e1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:05.267930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2eff3-62f9-4ebc-8303-1f65186acd4c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.309319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026f7a5-148b-445c-b408-8af3fb3f0a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.309930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026f7a5-148b-445c-b408-8af3fb3f0a19 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.310207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026f7a5-148b-445c-b408-8af3fb3f0a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.310474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026f7a5-148b-445c-b408-8af3fb3f0a19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.311485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026f7a5-148b-445c-b408-8af3fb3f0a19 None admin] RBAC: Adding query filter params (role.id=b8b6732605964de6aedfe2a3cf507d03, scope.project.id=2efc56617bd54471a648f03215b3bfb1, user.id=e0d6b7f81a7f4ba3a299acca4b7d4bfb) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:05.311799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026f7a5-148b-445c-b408-8af3fb3f0a19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:05.314546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026f7a5-148b-445c-b408-8af3fb3f0a19 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:05.325953 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 257/492] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:05 2022] GET /identity/v3/role_assignments?user.id=e0d6b7f81a7f4ba3a299acca4b7d4bfb&scope.project.id=2efc56617bd54471a648f03215b3bfb1&role.id=b8b6732605964de6aedfe2a3cf507d03 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:05.346568 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:05.370121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c805f4e-33c8-4bf3-8eda-243fcf8879e1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.419224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541efde-f59e-4b8e-8d34-2d9adcc8b67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.420227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541efde-f59e-4b8e-8d34-2d9adcc8b67a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.420670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541efde-f59e-4b8e-8d34-2d9adcc8b67a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.421175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541efde-f59e-4b8e-8d34-2d9adcc8b67a None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.421959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541efde-f59e-4b8e-8d34-2d9adcc8b67a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:05.422402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541efde-f59e-4b8e-8d34-2d9adcc8b67a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:05.424213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541efde-f59e-4b8e-8d34-2d9adcc8b67a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:05.443367 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 236/493] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:05.449131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026f7a5-148b-445c-b408-8af3fb3f0a19 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:05.491925 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:05.566948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026f7a5-148b-445c-b408-8af3fb3f0a19 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.608555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72189-95f2-4383-b394-19bc7a02273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.609185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72189-95f2-4383-b394-19bc7a02273f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.609488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72189-95f2-4383-b394-19bc7a02273f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.609728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72189-95f2-4383-b394-19bc7a02273f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.622723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d72189-95f2-4383-b394-19bc7a02273f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:05.624193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d72189-95f2-4383-b394-19bc7a02273f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-81d72189-95f2-4383-b394-19bc7a02273f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:05.637615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:05.638588 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:05.639538 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:05.639538 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:05.639538 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:05.639538 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:05.639538 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:05.639538 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:05.639538 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:05.639538 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:05.639538 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:46:05.639538 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:05.639538 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 258/494] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:46:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:05.652086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541efde-f59e-4b8e-8d34-2d9adcc8b67a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:05.766563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541efde-f59e-4b8e-8d34-2d9adcc8b67a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.803444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d5105-65ac-4172-8240-0dd30e730287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.804043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d5105-65ac-4172-8240-0dd30e730287 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.804317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d5105-65ac-4172-8240-0dd30e730287 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.804578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d5105-65ac-4172-8240-0dd30e730287 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.805302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d5105-65ac-4172-8240-0dd30e730287 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:05.805601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d5105-65ac-4172-8240-0dd30e730287 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:05.807072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d5105-65ac-4172-8240-0dd30e730287 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:05.826979 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 237/495] 10.222.0.39 () {56 vars in 1135 bytes} [Sun Oct 16 00:46:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:05.833258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72189-95f2-4383-b394-19bc7a02273f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:05.931422 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:05.942466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72189-95f2-4383-b394-19bc7a02273f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.950738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693da5c-fe30-4152-85fc-a91fb32f21dd None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.951044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693da5c-fe30-4152-85fc-a91fb32f21dd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.951849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693da5c-fe30-4152-85fc-a91fb32f21dd None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.953997 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 238/496] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:46:05.958651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee00a5-98ac-4919-bf75-6162d6240b22 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.958956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee00a5-98ac-4919-bf75-6162d6240b22 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.959226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee00a5-98ac-4919-bf75-6162d6240b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.965882 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:05.994944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-deee00a5-98ac-4919-bf75-6162d6240b22 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:05.994944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-deee00a5-98ac-4919-bf75-6162d6240b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:05.995215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1226ff-0a55-4e81-8891-e61f5d4b2f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.995215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1226ff-0a55-4e81-8891-e61f5d4b2f07 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.995215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1226ff-0a55-4e81-8891-e61f5d4b2f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.995215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1226ff-0a55-4e81-8891-e61f5d4b2f07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:06.127239 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 239/497] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:46:06.130894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1226ff-0a55-4e81-8891-e61f5d4b2f07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:06.132552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1226ff-0a55-4e81-8891-e61f5d4b2f07 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:06.228094 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:06.243429 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 259/498] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:46:06.248792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee00a5-98ac-4919-bf75-6162d6240b22 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:06.403376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee00a5-98ac-4919-bf75-6162d6240b22 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:06.443128 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:06.447988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fe8c3-08d5-47ca-a335-a75bd71fd23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:06.448623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fe8c3-08d5-47ca-a335-a75bd71fd23a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:06.448899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fe8c3-08d5-47ca-a335-a75bd71fd23a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:06.449295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fe8c3-08d5-47ca-a335-a75bd71fd23a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:06.464030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fe8c3-08d5-47ca-a335-a75bd71fd23a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:06.465488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fe8c3-08d5-47ca-a335-a75bd71fd23a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-1a2fe8c3-08d5-47ca-a335-a75bd71fd23a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:06.485259 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:06.486723 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:06.487656 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:06.487656 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:06.487656 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:06.487656 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 240/499] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:06.492651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1226ff-0a55-4e81-8891-e61f5d4b2f07 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:06.507186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fe8c3-08d5-47ca-a335-a75bd71fd23a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:06.633150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fe8c3-08d5-47ca-a335-a75bd71fd23a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:06.657003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1226ff-0a55-4e81-8891-e61f5d4b2f07 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:06.693042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffa13b-0de2-4da4-bb04-b7797780a84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:06.694008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffa13b-0de2-4da4-bb04-b7797780a84c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:06.694291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffa13b-0de2-4da4-bb04-b7797780a84c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:06.694815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffa13b-0de2-4da4-bb04-b7797780a84c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:06.700187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda91e7-e4b0-4ac1-bd60-08b25a904dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:06.700855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda91e7-e4b0-4ac1-bd60-08b25a904dab None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:06.701195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda91e7-e4b0-4ac1-bd60-08b25a904dab None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:06.701530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda91e7-e4b0-4ac1-bd60-08b25a904dab None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:06.702301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda91e7-e4b0-4ac1-bd60-08b25a904dab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:06.702691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda91e7-e4b0-4ac1-bd60-08b25a904dab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:06.704222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda91e7-e4b0-4ac1-bd60-08b25a904dab None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:06.707693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffa13b-0de2-4da4-bb04-b7797780a84c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:06.709212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffa13b-0de2-4da4-bb04-b7797780a84c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:06.719081 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 260/500] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:06.722047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39b147-c4ad-4feb-836d-f8e4175ec23b None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:06.722371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39b147-c4ad-4feb-836d-f8e4175ec23b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:06.722604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39b147-c4ad-4feb-836d-f8e4175ec23b None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:06.724174 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 261/501] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:06.724876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39b147-c4ad-4feb-836d-f8e4175ec23b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-1cffa13b-0de2-4da4-bb04-b7797780a84c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:06.732502 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:06.733921 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:06.734820 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:06.734820 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:06.734820 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:06.737637 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 241/502] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:06.739166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190daa5-2f4e-438d-bbc7-9acfac6f36b1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:06.739645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190daa5-2f4e-438d-bbc7-9acfac6f36b1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:06.740120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190daa5-2f4e-438d-bbc7-9acfac6f36b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:06.759200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9190daa5-2f4e-438d-bbc7-9acfac6f36b1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:06.760348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9190daa5-2f4e-438d-bbc7-9acfac6f36b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:06.794702 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:06.807215 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:06.860943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39b147-c4ad-4feb-836d-f8e4175ec23b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:06.861763 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 242/503] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:46:06.862782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190daa5-2f4e-438d-bbc7-9acfac6f36b1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:06.907763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38d363-36f9-4126-a7ff-2d52265445d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:06.908552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d363-36f9-4126-a7ff-2d52265445d1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:06.908864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d363-36f9-4126-a7ff-2d52265445d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:06.909238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d363-36f9-4126-a7ff-2d52265445d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:06.918306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38d363-36f9-4126-a7ff-2d52265445d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:06.920090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38d363-36f9-4126-a7ff-2d52265445d1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-5c38d363-36f9-4126-a7ff-2d52265445d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:06.937243 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:06.938162 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:06.939318 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:06.939318 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:06.939318 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:06.939318 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:06.939318 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:06.939318 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:06.939318 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:06.939318 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:06.939318 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 262/504] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:06.948516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38d363-36f9-4126-a7ff-2d52265445d1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:06.994014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190daa5-2f4e-438d-bbc7-9acfac6f36b1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:07.080881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabd736-aafd-4eb7-a20b-a44b31a580a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:07.081491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabd736-aafd-4eb7-a20b-a44b31a580a5 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:07.081766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabd736-aafd-4eb7-a20b-a44b31a580a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:07.082039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabd736-aafd-4eb7-a20b-a44b31a580a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:07.082679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabd736-aafd-4eb7-a20b-a44b31a580a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:07.083003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabd736-aafd-4eb7-a20b-a44b31a580a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:07.084391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabd736-aafd-4eb7-a20b-a44b31a580a5 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:07.090960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38d363-36f9-4126-a7ff-2d52265445d1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:07.109298 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 243/505] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:07.117976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabd736-aafd-4eb7-a20b-a44b31a580a5 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:07.118433 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:07.139327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e05ed-bef0-4485-87e2-b26e7a53bbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:07.139994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e05ed-bef0-4485-87e2-b26e7a53bbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:07.140279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e05ed-bef0-4485-87e2-b26e7a53bbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:07.140556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e05ed-bef0-4485-87e2-b26e7a53bbb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:07.141298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e05ed-bef0-4485-87e2-b26e7a53bbb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:07.142152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e05ed-bef0-4485-87e2-b26e7a53bbb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:07.143627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e05ed-bef0-4485-87e2-b26e7a53bbb6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:07.156793 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 263/506] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:07.165504 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:07.167991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e05ed-bef0-4485-87e2-b26e7a53bbb6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:07.245301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabd736-aafd-4eb7-a20b-a44b31a580a5 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:07.284924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2b09c-9608-4cbe-a9f0-88b127609f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:07.285602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2b09c-9608-4cbe-a9f0-88b127609f0c None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:07.285888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2b09c-9608-4cbe-a9f0-88b127609f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:07.286162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2b09c-9608-4cbe-a9f0-88b127609f0c None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:07.286906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2b09c-9608-4cbe-a9f0-88b127609f0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:07.288494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2b09c-9608-4cbe-a9f0-88b127609f0c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:07.313854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e05ed-bef0-4485-87e2-b26e7a53bbb6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:07.314722 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 244/507] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:46:07 2022] POST /identity/v3/users => generated 254 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:07.323745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2b09c-9608-4cbe-a9f0-88b127609f0c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:07.394079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088874a1-e5cf-4bde-8e55-2de5ae3897e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:07.394702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088874a1-e5cf-4bde-8e55-2de5ae3897e1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:07.395065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088874a1-e5cf-4bde-8e55-2de5ae3897e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:07.395344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088874a1-e5cf-4bde-8e55-2de5ae3897e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:07.396784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088874a1-e5cf-4bde-8e55-2de5ae3897e1 None admin] RBAC: Adding query filter params (role.id=b8b6732605964de6aedfe2a3cf507d03, scope.project.id=2efc56617bd54471a648f03215b3bfb1, user.id=ef8c6c33c3504949876d496a5213494d) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:07.397295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088874a1-e5cf-4bde-8e55-2de5ae3897e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:07.398975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088874a1-e5cf-4bde-8e55-2de5ae3897e1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:07.406886 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 264/508] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:07 2022] GET /identity/v3/role_assignments?user.id=ef8c6c33c3504949876d496a5213494d&scope.project.id=2efc56617bd54471a648f03215b3bfb1&role.id=b8b6732605964de6aedfe2a3cf507d03 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:07.491349 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:07.522289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2b09c-9608-4cbe-a9f0-88b127609f0c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:07.587367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf7006-649e-4a07-9c73-e7c8c900327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:07.588044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7006-649e-4a07-9c73-e7c8c900327b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:07.588322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7006-649e-4a07-9c73-e7c8c900327b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:07.588593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7006-649e-4a07-9c73-e7c8c900327b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:07.607283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf7006-649e-4a07-9c73-e7c8c900327b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-0bcf7006-649e-4a07-9c73-e7c8c900327b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:07.613299 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:07.615536 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:07.617557 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:07.617557 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:07.617557 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:07.617557 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:07.617557 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:07.617557 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:07.617557 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:07.617557 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:07.617557 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:07.617557 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:07.617557 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:07.617557 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:07.617557 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 245/509] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:46:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:07.620713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088874a1-e5cf-4bde-8e55-2de5ae3897e1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:07.664428 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:07.725111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fde54-d6e1-4ba3-8638-7f04e602ee38 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:07.725684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fde54-d6e1-4ba3-8638-7f04e602ee38 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:07.725684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fde54-d6e1-4ba3-8638-7f04e602ee38 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:07.727348 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 246/510] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:07.734359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad904a-cdaf-4558-87c3-1aadd8b39bf6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:07.734636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad904a-cdaf-4558-87c3-1aadd8b39bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:07.734910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad904a-cdaf-4558-87c3-1aadd8b39bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:07.743541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088874a1-e5cf-4bde-8e55-2de5ae3897e1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:07.768356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-59ad904a-cdaf-4558-87c3-1aadd8b39bf6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:07.769953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-59ad904a-cdaf-4558-87c3-1aadd8b39bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:07.781292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8921fb-fac1-4a66-be85-c7888dec90d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:07.781837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8921fb-fac1-4a66-be85-c7888dec90d7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:07.782115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8921fb-fac1-4a66-be85-c7888dec90d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:07.782487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8921fb-fac1-4a66-be85-c7888dec90d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:07.783345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8921fb-fac1-4a66-be85-c7888dec90d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:07.783651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8921fb-fac1-4a66-be85-c7888dec90d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:07.785477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8921fb-fac1-4a66-be85-c7888dec90d7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:07.795501 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 265/511] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:46:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:07.802064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8921fb-fac1-4a66-be85-c7888dec90d7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:07.886469 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 247/512] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:46:07.922267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8921fb-fac1-4a66-be85-c7888dec90d7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:07.925412 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:07.966814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4de43-f05c-4e65-954e-804ae5b1a9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:07.967481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4de43-f05c-4e65-954e-804ae5b1a9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:07.967761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4de43-f05c-4e65-954e-804ae5b1a9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:07.968034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4de43-f05c-4e65-954e-804ae5b1a9d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:07.979968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4de43-f05c-4e65-954e-804ae5b1a9d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:07.981485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4de43-f05c-4e65-954e-804ae5b1a9d5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-41d4de43-f05c-4e65-954e-804ae5b1a9d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:07.996453 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:07.997615 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:07.998709 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:07.998709 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:07.998709 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:08.002418 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 266/513] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:08.003799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad904a-cdaf-4558-87c3-1aadd8b39bf6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:08.077205 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:08.108060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad904a-cdaf-4558-87c3-1aadd8b39bf6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:08.161819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235053b0-8486-4e19-b562-ba8cf9ad7468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:08.162435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235053b0-8486-4e19-b562-ba8cf9ad7468 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.162712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235053b0-8486-4e19-b562-ba8cf9ad7468 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.163003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235053b0-8486-4e19-b562-ba8cf9ad7468 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.163639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235053b0-8486-4e19-b562-ba8cf9ad7468 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:08.163979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235053b0-8486-4e19-b562-ba8cf9ad7468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:08.165403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235053b0-8486-4e19-b562-ba8cf9ad7468 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:08.183977 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 248/514] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:08.190291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4de43-f05c-4e65-954e-804ae5b1a9d5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:08.301246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4de43-f05c-4e65-954e-804ae5b1a9d5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:08.313168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235053b0-8486-4e19-b562-ba8cf9ad7468 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:08.373204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe0e31-81e2-41af-97f5-7438badfd9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:08.374136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe0e31-81e2-41af-97f5-7438badfd9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.374606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe0e31-81e2-41af-97f5-7438badfd9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.375076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe0e31-81e2-41af-97f5-7438badfd9e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.392959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe0e31-81e2-41af-97f5-7438badfd9e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:08.394706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe0e31-81e2-41af-97f5-7438badfd9e2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-acfe0e31-81e2-41af-97f5-7438badfd9e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:08.411634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:08.412606 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:08.413532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:08.413532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:08.413532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:08.413532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:08.413532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:08.413532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:08.413532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:08.413532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:08.413532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:46:08.413532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:08.420512 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 267/515] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Oct 16 00:46:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:08.420512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528da3e-c87c-43de-9c11-e247e9fcdace None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.420512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528da3e-c87c-43de-9c11-e247e9fcdace None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.420768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528da3e-c87c-43de-9c11-e247e9fcdace None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.421965 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 268/516] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:08.422498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528da3e-c87c-43de-9c11-e247e9fcdace None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:08.455530 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:08.471517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235053b0-8486-4e19-b562-ba8cf9ad7468 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:08.511773 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:08.520406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fdac2-b6e5-4d4b-8fea-4c85da29b10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:08.521261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fdac2-b6e5-4d4b-8fea-4c85da29b10e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.521681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fdac2-b6e5-4d4b-8fea-4c85da29b10e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.522094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fdac2-b6e5-4d4b-8fea-4c85da29b10e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.522812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fdac2-b6e5-4d4b-8fea-4c85da29b10e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:08.524808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fdac2-b6e5-4d4b-8fea-4c85da29b10e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-a86fdac2-b6e5-4d4b-8fea-4c85da29b10e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:08.539665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:08.540851 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:46:08.541837 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:08.544227 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 249/517] 10.222.0.39 () {56 vars in 1129 bytes} [Sun Oct 16 00:46:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:08.545546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172fd17-93d6-438d-b4ee-372d1d96e0aa None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.546013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172fd17-93d6-438d-b4ee-372d1d96e0aa None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.546551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172fd17-93d6-438d-b4ee-372d1d96e0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.569925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c172fd17-93d6-438d-b4ee-372d1d96e0aa None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:08.571444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c172fd17-93d6-438d-b4ee-372d1d96e0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:08.571558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528da3e-c87c-43de-9c11-e247e9fcdace None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:08.614031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79b050-9694-40c6-86d2-10c6ef07514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:08.615635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79b050-9694-40c6-86d2-10c6ef07514b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.615926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79b050-9694-40c6-86d2-10c6ef07514b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.616202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79b050-9694-40c6-86d2-10c6ef07514b None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.616934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79b050-9694-40c6-86d2-10c6ef07514b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:08.617242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79b050-9694-40c6-86d2-10c6ef07514b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:08.618731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79b050-9694-40c6-86d2-10c6ef07514b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:08.647110 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 269/518] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Oct 16 00:46:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:08.647110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79b050-9694-40c6-86d2-10c6ef07514b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:08.662535 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 250/519] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:46:08.664396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172fd17-93d6-438d-b4ee-372d1d96e0aa None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:08.726842 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:08.808794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79b050-9694-40c6-86d2-10c6ef07514b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:08.811255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172fd17-93d6-438d-b4ee-372d1d96e0aa None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:08.839454 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:08.850365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f365d-fa3e-45b0-87b0-d0aed5eb1dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:08.851045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f365d-fa3e-45b0-87b0-d0aed5eb1dbb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.851325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f365d-fa3e-45b0-87b0-d0aed5eb1dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.851595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f365d-fa3e-45b0-87b0-d0aed5eb1dbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.866010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f365d-fa3e-45b0-87b0-d0aed5eb1dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:08.867505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f365d-fa3e-45b0-87b0-d0aed5eb1dbb None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:08.886609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff10cc-8477-419a-a700-07ae4603a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:08.887247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff10cc-8477-419a-a700-07ae4603a444 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.887524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff10cc-8477-419a-a700-07ae4603a444 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.887797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff10cc-8477-419a-a700-07ae4603a444 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.889582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff10cc-8477-419a-a700-07ae4603a444 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:08.889892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff10cc-8477-419a-a700-07ae4603a444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:08.892715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff10cc-8477-419a-a700-07ae4603a444 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-265f365d-fa3e-45b0-87b0-d0aed5eb1dbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:08.898468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:08.899402 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:08.900288 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:08.900288 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:08.900288 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:08.900939 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 251/520] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:08.906973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f365d-fa3e-45b0-87b0-d0aed5eb1dbb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:08.910112 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 270/521] 10.222.0.39 () {56 vars in 1124 bytes} [Sun Oct 16 00:46:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:08.924020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff10cc-8477-419a-a700-07ae4603a444 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:09.049415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff10cc-8477-419a-a700-07ae4603a444 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:09.052187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f365d-fa3e-45b0-87b0-d0aed5eb1dbb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:09.080247 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:09.085586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cd788-c2f6-4186-a595-cf4d33ac962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:09.086267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cd788-c2f6-4186-a595-cf4d33ac962a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.086753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cd788-c2f6-4186-a595-cf4d33ac962a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.087251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cd788-c2f6-4186-a595-cf4d33ac962a None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.088180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cd788-c2f6-4186-a595-cf4d33ac962a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:09.088543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cd788-c2f6-4186-a595-cf4d33ac962a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:09.091064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f783a5-bb52-41bf-8d0a-d66bcaccb238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:09.091543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cd788-c2f6-4186-a595-cf4d33ac962a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:09.091653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f783a5-bb52-41bf-8d0a-d66bcaccb238 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.091941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f783a5-bb52-41bf-8d0a-d66bcaccb238 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.092213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f783a5-bb52-41bf-8d0a-d66bcaccb238 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.092949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f783a5-bb52-41bf-8d0a-d66bcaccb238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:09.093257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f783a5-bb52-41bf-8d0a-d66bcaccb238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:09.095333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f783a5-bb52-41bf-8d0a-d66bcaccb238 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:09.098315 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 271/522] 10.222.0.39 () {56 vars in 1124 bytes} [Sun Oct 16 00:46:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:09.099129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cd788-c2f6-4186-a595-cf4d33ac962a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:09.124676 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 252/523] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:09.130452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f783a5-bb52-41bf-8d0a-d66bcaccb238 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:09.193346 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:09.305137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f783a5-bb52-41bf-8d0a-d66bcaccb238 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:09.309987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cd788-c2f6-4186-a595-cf4d33ac962a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:09.356641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda68c0f-dc84-461e-8631-2633eba9d6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:09.357378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda68c0f-dc84-461e-8631-2633eba9d6dd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.357655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda68c0f-dc84-461e-8631-2633eba9d6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.357921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda68c0f-dc84-461e-8631-2633eba9d6dd None admin] PATH_INFO: `/v3/services/network` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.358185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcdd56-88f8-4c0f-a90d-f6ef4da04ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:09.358495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda68c0f-dc84-461e-8631-2633eba9d6dd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:09.358818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcdd56-88f8-4c0f-a90d-f6ef4da04ceb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.359141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcdd56-88f8-4c0f-a90d-f6ef4da04ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.359408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcdd56-88f8-4c0f-a90d-f6ef4da04ceb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.359898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda68c0f-dc84-461e-8631-2633eba9d6dd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:09.367801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcdd56-88f8-4c0f-a90d-f6ef4da04ceb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:09.369308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcdd56-88f8-4c0f-a90d-f6ef4da04ceb None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-fda68c0f-dc84-461e-8631-2633eba9d6dd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:09.373113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:09.374107 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:09.375563 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 272/524] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:09 2022] GET /identity/v3/services/network => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:09.380609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda68c0f-dc84-461e-8631-2633eba9d6dd None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c1fcdd56-88f8-4c0f-a90d-f6ef4da04ceb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:09.387840 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:09.389962 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:09.392819 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:09.392819 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:09.392819 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:09.392819 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:09.392819 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:09.392819 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:09.392819 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:09.392819 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:09.392819 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 253/525] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:09.396502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcdd56-88f8-4c0f-a90d-f6ef4da04ceb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:09.491442 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:09.534491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda68c0f-dc84-461e-8631-2633eba9d6dd None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:09.583203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7b955-8bcf-42a4-8f39-e5753cf29f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:09.583904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7b955-8bcf-42a4-8f39-e5753cf29f52 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.584256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7b955-8bcf-42a4-8f39-e5753cf29f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.584599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7b955-8bcf-42a4-8f39-e5753cf29f52 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.585357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7b955-8bcf-42a4-8f39-e5753cf29f52 None admin] RBAC: Adding query filter params (name=network) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:09.585724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7b955-8bcf-42a4-8f39-e5753cf29f52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:09.587235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7b955-8bcf-42a4-8f39-e5753cf29f52 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:09.592901 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 273/526] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Oct 16 00:46:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:09.599774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7b955-8bcf-42a4-8f39-e5753cf29f52 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:09.639146 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:09.652807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcdd56-88f8-4c0f-a90d-f6ef4da04ceb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:09.716848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7b955-8bcf-42a4-8f39-e5753cf29f52 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:09.754934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfded5-c087-4115-9df9-e4f6b94766fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:09.755276 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:09.755708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfded5-c087-4115-9df9-e4f6b94766fc None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.755871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfded5-c087-4115-9df9-e4f6b94766fc None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.756080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfded5-c087-4115-9df9-e4f6b94766fc None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.756874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfded5-c087-4115-9df9-e4f6b94766fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:09.757179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfded5-c087-4115-9df9-e4f6b94766fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:09.758597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfded5-c087-4115-9df9-e4f6b94766fc None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:09.763587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc99a63-b7d1-437c-92e6-7a0c544dbd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:09.764987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc99a63-b7d1-437c-92e6-7a0c544dbd03 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.765469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc99a63-b7d1-437c-92e6-7a0c544dbd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.765951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc99a63-b7d1-437c-92e6-7a0c544dbd03 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.767099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc99a63-b7d1-437c-92e6-7a0c544dbd03 None admin] RBAC: Adding query filter params (type=network) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:09.767934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc99a63-b7d1-437c-92e6-7a0c544dbd03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:09.777175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc99a63-b7d1-437c-92e6-7a0c544dbd03 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:09.777369 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 254/527] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:09.779782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfded5-c087-4115-9df9-e4f6b94766fc None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:09.787539 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 274/528] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Oct 16 00:46:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:09.838236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e15820-7ac7-485e-985c-ba144990a2c6 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.838584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e15820-7ac7-485e-985c-ba144990a2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.838781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e15820-7ac7-485e-985c-ba144990a2c6 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.840468 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 275/529] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:46:09.846603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19efcaf-05b5-44d6-92a9-934a55f765fc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.846932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19efcaf-05b5-44d6-92a9-934a55f765fc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.847182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19efcaf-05b5-44d6-92a9-934a55f765fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.885044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f19efcaf-05b5-44d6-92a9-934a55f765fc None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:09.886260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f19efcaf-05b5-44d6-92a9-934a55f765fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:09.940242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfded5-c087-4115-9df9-e4f6b94766fc None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:09.994990 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 276/530] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:46:10.002820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec296bc-cf4a-41ee-8dd7-7415ab88e8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:10.003801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec296bc-cf4a-41ee-8dd7-7415ab88e8a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:10.004280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec296bc-cf4a-41ee-8dd7-7415ab88e8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:10.004752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec296bc-cf4a-41ee-8dd7-7415ab88e8a8 None admin] PATH_INFO: `/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/a065cd54fd8745ca99f35405c711ffac/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:10.006907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec296bc-cf4a-41ee-8dd7-7415ab88e8a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2efc56617bd54471a648f03215b3bfb1, user_id=a065cd54fd8745ca99f35405c711ffac, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:10.008709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec296bc-cf4a-41ee-8dd7-7415ab88e8a8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:10.025481 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 255/531] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:46:09 2022] PUT /identity/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/a065cd54fd8745ca99f35405c711ffac/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:46:10.262251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70d70-5e1e-44bc-8d03-762c38fe41ef None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:10.262777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70d70-5e1e-44bc-8d03-762c38fe41ef None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:10.263081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70d70-5e1e-44bc-8d03-762c38fe41ef None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:10.264410 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 277/532] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:10.273594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15074e94-d474-4bc6-acc2-cdb1c23f7ba6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:10.273594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15074e94-d474-4bc6-acc2-cdb1c23f7ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:10.273594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15074e94-d474-4bc6-acc2-cdb1c23f7ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:10.291037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-15074e94-d474-4bc6-acc2-cdb1c23f7ba6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:10.292536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-15074e94-d474-4bc6-acc2-cdb1c23f7ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:10.307323 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:10.354685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae70d70-5e1e-44bc-8d03-762c38fe41ef None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:10.379071 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 256/533] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:46:10.494092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae70d70-5e1e-44bc-8d03-762c38fe41ef None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:10.515500 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:10.539598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c88c9-c2a6-4606-aa25-fedf1970202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:10.540607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c88c9-c2a6-4606-aa25-fedf1970202d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:10.541082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c88c9-c2a6-4606-aa25-fedf1970202d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:10.541552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c88c9-c2a6-4606-aa25-fedf1970202d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:10.564979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c88c9-c2a6-4606-aa25-fedf1970202d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e26c88c9-c2a6-4606-aa25-fedf1970202d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:10.570134 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:10.571371 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:10.572216 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:10.572216 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:10.572216 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:10.572216 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:10.572216 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:10.572216 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:10.572216 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:10.572216 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:10.572216 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:10.572216 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:10.572216 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:10.572216 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:10.574749 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 278/534] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:46:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:10.581952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15074e94-d474-4bc6-acc2-cdb1c23f7ba6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:10.702889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c88c9-c2a6-4606-aa25-fedf1970202d None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:10.718303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15074e94-d474-4bc6-acc2-cdb1c23f7ba6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:10.774488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fd84c-9140-436c-a4ce-bfd9226cbae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:10.775477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fd84c-9140-436c-a4ce-bfd9226cbae1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:10.775954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fd84c-9140-436c-a4ce-bfd9226cbae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:10.776516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fd84c-9140-436c-a4ce-bfd9226cbae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:10.777539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fd84c-9140-436c-a4ce-bfd9226cbae1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:10.778053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fd84c-9140-436c-a4ce-bfd9226cbae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:10.779896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fd84c-9140-436c-a4ce-bfd9226cbae1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:10.797055 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 257/535] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:46:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:10.802671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fd84c-9140-436c-a4ce-bfd9226cbae1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:10.819097 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:10.824593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c88c9-c2a6-4606-aa25-fedf1970202d None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:10.881796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c3594-fef7-4f0d-8aac-451e2449a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:10.882512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c3594-fef7-4f0d-8aac-451e2449a393 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:10.882795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c3594-fef7-4f0d-8aac-451e2449a393 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:10.883108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c3594-fef7-4f0d-8aac-451e2449a393 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:10.903301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c3594-fef7-4f0d-8aac-451e2449a393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-1e3c3594-fef7-4f0d-8aac-451e2449a393 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:10.909435 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:10.910398 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:10.911841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:10.911841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:10.911841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:10.911841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:10.911841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:10.911841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:10.911841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:10.911841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:10.911841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:10.911841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:10.911841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:10.911841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:10.912481 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 279/536] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:46:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:10.917284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c3594-fef7-4f0d-8aac-451e2449a393 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:10.974587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fd84c-9140-436c-a4ce-bfd9226cbae1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:10.993119 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:11.019276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cc754-cdd8-4005-8379-137bf98aa666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:11.020140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cc754-cdd8-4005-8379-137bf98aa666 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.020600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cc754-cdd8-4005-8379-137bf98aa666 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.021047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cc754-cdd8-4005-8379-137bf98aa666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.034826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cc754-cdd8-4005-8379-137bf98aa666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:11.036909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cc754-cdd8-4005-8379-137bf98aa666 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-8e6cc754-cdd8-4005-8379-137bf98aa666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:11.055478 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:11.056591 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:11.057471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:11.057471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:11.057471 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:11.060206 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 258/537] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:11.065737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cc754-cdd8-4005-8379-137bf98aa666 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:11.100096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c3594-fef7-4f0d-8aac-451e2449a393 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:11.149910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cbe55-3394-4e2d-ba4d-96418c3cd167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:11.150523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cbe55-3394-4e2d-ba4d-96418c3cd167 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.150798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cbe55-3394-4e2d-ba4d-96418c3cd167 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.151316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cbe55-3394-4e2d-ba4d-96418c3cd167 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.151986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cbe55-3394-4e2d-ba4d-96418c3cd167 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:11.152289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cbe55-3394-4e2d-ba4d-96418c3cd167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:11.153646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cbe55-3394-4e2d-ba4d-96418c3cd167 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:11.170863 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 280/538] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:46:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:11.177224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cbe55-3394-4e2d-ba4d-96418c3cd167 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:11.203846 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:11.291898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cc754-cdd8-4005-8379-137bf98aa666 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:11.311829 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:11.316704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cbe55-3394-4e2d-ba4d-96418c3cd167 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:11.357394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5649f4a-7d20-415a-a0d1-7f79019250f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:11.359488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5649f4a-7d20-415a-a0d1-7f79019250f5 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.359768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5649f4a-7d20-415a-a0d1-7f79019250f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.360035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5649f4a-7d20-415a-a0d1-7f79019250f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.360918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5649f4a-7d20-415a-a0d1-7f79019250f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:11.361214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5649f4a-7d20-415a-a0d1-7f79019250f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:11.362591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5649f4a-7d20-415a-a0d1-7f79019250f5 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:11.379466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570f782-7872-4d67-86c3-2a64928daf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:11.380123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570f782-7872-4d67-86c3-2a64928daf2e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.381265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570f782-7872-4d67-86c3-2a64928daf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.381542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570f782-7872-4d67-86c3-2a64928daf2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.390340 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 259/539] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:11.396301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5649f4a-7d20-415a-a0d1-7f79019250f5 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:11.408879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570f782-7872-4d67-86c3-2a64928daf2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:11.410402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570f782-7872-4d67-86c3-2a64928daf2e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e570f782-7872-4d67-86c3-2a64928daf2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:11.437063 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:11.438147 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:11.439650 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:11.439650 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:11.439650 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:11.439650 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 281/540] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:11.444478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570f782-7872-4d67-86c3-2a64928daf2e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:11.584834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5649f4a-7d20-415a-a0d1-7f79019250f5 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:11.608783 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:11.625659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14750d-05a2-460a-afaf-d6d16b0cc912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:11.627506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14750d-05a2-460a-afaf-d6d16b0cc912 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.628147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14750d-05a2-460a-afaf-d6d16b0cc912 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.630153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570f782-7872-4d67-86c3-2a64928daf2e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:11.630723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14750d-05a2-460a-afaf-d6d16b0cc912 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.647769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14750d-05a2-460a-afaf-d6d16b0cc912 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:11.651639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14750d-05a2-460a-afaf-d6d16b0cc912 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-cb14750d-05a2-460a-afaf-d6d16b0cc912 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:11.677377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:11.678374 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:11.679340 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:11.679340 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:11.679340 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:11.679340 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:11.679340 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:11.679340 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:11.679340 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:11.679340 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:11.679340 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:46:11.679340 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:11.682545 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 260/541] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Oct 16 00:46:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:11.689184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14750d-05a2-460a-afaf-d6d16b0cc912 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:11.716435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775a7e0-3d8f-43d9-acad-564f95ff6648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:11.717050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775a7e0-3d8f-43d9-acad-564f95ff6648 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.717335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775a7e0-3d8f-43d9-acad-564f95ff6648 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.717576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775a7e0-3d8f-43d9-acad-564f95ff6648 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.718212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775a7e0-3d8f-43d9-acad-564f95ff6648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:11.718509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775a7e0-3d8f-43d9-acad-564f95ff6648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:11.720031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775a7e0-3d8f-43d9-acad-564f95ff6648 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:11.745147 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 282/542] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:11.755124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775a7e0-3d8f-43d9-acad-564f95ff6648 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:11.775896 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:11.832207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14750d-05a2-460a-afaf-d6d16b0cc912 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:11.874047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775a7e0-3d8f-43d9-acad-564f95ff6648 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:11.874630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3356f-4252-4bee-90db-603a8ff1d7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:11.875429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3356f-4252-4bee-90db-603a8ff1d7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.875707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3356f-4252-4bee-90db-603a8ff1d7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.876052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3356f-4252-4bee-90db-603a8ff1d7a7 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.876945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3356f-4252-4bee-90db-603a8ff1d7a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:11.877260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3356f-4252-4bee-90db-603a8ff1d7a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:11.878803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3356f-4252-4bee-90db-603a8ff1d7a7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:11.903665 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 261/543] 10.222.0.39 () {56 vars in 1149 bytes} [Sun Oct 16 00:46:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:11.903665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30308c00-46c7-4536-98ee-5f704ad5e15f None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.903665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30308c00-46c7-4536-98ee-5f704ad5e15f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.903665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30308c00-46c7-4536-98ee-5f704ad5e15f None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.907601 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 262/544] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:11.908668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30308c00-46c7-4536-98ee-5f704ad5e15f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:11.924079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021328c-276c-4883-ac31-eaec917b8439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:11.925206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021328c-276c-4883-ac31-eaec917b8439 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.925666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021328c-276c-4883-ac31-eaec917b8439 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.926165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021328c-276c-4883-ac31-eaec917b8439 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.934258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021328c-276c-4883-ac31-eaec917b8439 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:11.936246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021328c-276c-4883-ac31-eaec917b8439 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b021328c-276c-4883-ac31-eaec917b8439 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:11.949826 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:11.950855 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:11.951923 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:11.951923 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:11.951923 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:11.951923 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:11.951923 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:11.951923 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:11.951923 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:11.951923 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:11.951923 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:46:11.951923 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:11.954997 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 283/545] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:46:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:11.956419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb496a-5a32-41d8-a775-7525adad28a6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:11.957362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb496a-5a32-41d8-a775-7525adad28a6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:11.958285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb496a-5a32-41d8-a775-7525adad28a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:11.969504 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:11.981137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-87eb496a-5a32-41d8-a775-7525adad28a6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:11.982737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-87eb496a-5a32-41d8-a775-7525adad28a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:12.053287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30308c00-46c7-4536-98ee-5f704ad5e15f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:12.054860 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 284/546] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:46:12.055997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb496a-5a32-41d8-a775-7525adad28a6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:12.060474 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:12.123388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4034343-9a38-4995-8111-79ee93d9dc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:12.123930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4034343-9a38-4995-8111-79ee93d9dc6c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.124200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4034343-9a38-4995-8111-79ee93d9dc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.124461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4034343-9a38-4995-8111-79ee93d9dc6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.138966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4034343-9a38-4995-8111-79ee93d9dc6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:12.138966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4034343-9a38-4995-8111-79ee93d9dc6c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f4034343-9a38-4995-8111-79ee93d9dc6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:12.157685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:12.158994 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:12.160112 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:12.160112 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:12.160112 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:12.168243 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 263/547] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:12.177017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4034343-9a38-4995-8111-79ee93d9dc6c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:12.236585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb496a-5a32-41d8-a775-7525adad28a6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:12.295966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b25a9-469a-4fcf-b9b8-2be42bc29694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:12.296632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b25a9-469a-4fcf-b9b8-2be42bc29694 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.296911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b25a9-469a-4fcf-b9b8-2be42bc29694 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.297177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b25a9-469a-4fcf-b9b8-2be42bc29694 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.298420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b25a9-469a-4fcf-b9b8-2be42bc29694 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:12.298724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b25a9-469a-4fcf-b9b8-2be42bc29694 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:12.300179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b25a9-469a-4fcf-b9b8-2be42bc29694 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:12.341386 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 285/548] 10.222.0.39 () {56 vars in 1135 bytes} [Sun Oct 16 00:46:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:12.347862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b25a9-469a-4fcf-b9b8-2be42bc29694 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:12.348598 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:12.368563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4034343-9a38-4995-8111-79ee93d9dc6c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:12.428966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc7793-eb1f-4c90-9ba7-90613e58fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:12.429972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc7793-eb1f-4c90-9ba7-90613e58fda0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.430452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc7793-eb1f-4c90-9ba7-90613e58fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.431007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc7793-eb1f-4c90-9ba7-90613e58fda0 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.431751 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:12.432745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc7793-eb1f-4c90-9ba7-90613e58fda0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:12.433417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc7793-eb1f-4c90-9ba7-90613e58fda0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:12.435145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc7793-eb1f-4c90-9ba7-90613e58fda0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:12.454666 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 264/549] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:12.456038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc7793-eb1f-4c90-9ba7-90613e58fda0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:12.482223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b25a9-469a-4fcf-b9b8-2be42bc29694 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:12.521054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08f800-5206-405b-b28d-f7a4026a84d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:12.521700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f800-5206-405b-b28d-f7a4026a84d8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.521976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f800-5206-405b-b28d-f7a4026a84d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.522246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f800-5206-405b-b28d-f7a4026a84d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.534005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08f800-5206-405b-b28d-f7a4026a84d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:12.535472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08f800-5206-405b-b28d-f7a4026a84d8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-cd08f800-5206-405b-b28d-f7a4026a84d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:12.553108 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:12.554078 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:12.554992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:12.554992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:12.554992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:12.559106 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 286/550] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:12.560030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08f800-5206-405b-b28d-f7a4026a84d8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:12.577673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc7793-eb1f-4c90-9ba7-90613e58fda0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:12.614239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b773b82-8376-4696-8cae-6208077874fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:12.614840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b773b82-8376-4696-8cae-6208077874fc None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.615145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b773b82-8376-4696-8cae-6208077874fc None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.615419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b773b82-8376-4696-8cae-6208077874fc None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.616062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b773b82-8376-4696-8cae-6208077874fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:12.617419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b773b82-8376-4696-8cae-6208077874fc None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:12.642946 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 265/551] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:46:12 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:12.642946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b773b82-8376-4696-8cae-6208077874fc None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:12.664112 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:12.701952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08f800-5206-405b-b28d-f7a4026a84d8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:12.723224 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:12.777110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a78df6-e7b2-4bde-83a4-5ff439062993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:12.778220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a78df6-e7b2-4bde-83a4-5ff439062993 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.778537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a78df6-e7b2-4bde-83a4-5ff439062993 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.778863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a78df6-e7b2-4bde-83a4-5ff439062993 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.779621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b773b82-8376-4696-8cae-6208077874fc None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:12.790357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a78df6-e7b2-4bde-83a4-5ff439062993 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:12.792918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a78df6-e7b2-4bde-83a4-5ff439062993 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-41a78df6-e7b2-4bde-83a4-5ff439062993 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:12.810753 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:12.811805 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:12.812670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:12.812670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:12.812670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:12.812670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:12.812670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:12.812670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:12.812670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:12.812670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:12.818235 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 287/552] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:12.818235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bed42-38d8-47cc-b695-4ac93bbb00d6 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.818235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bed42-38d8-47cc-b695-4ac93bbb00d6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.818235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bed42-38d8-47cc-b695-4ac93bbb00d6 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.823021 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 288/553] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:12.825062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bed42-38d8-47cc-b695-4ac93bbb00d6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:12.826074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b47b34-ec0b-48ce-9149-5fcff9ffd304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:12.826699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b47b34-ec0b-48ce-9149-5fcff9ffd304 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.827014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b47b34-ec0b-48ce-9149-5fcff9ffd304 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.827289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b47b34-ec0b-48ce-9149-5fcff9ffd304 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.827938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b47b34-ec0b-48ce-9149-5fcff9ffd304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:12.828239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b47b34-ec0b-48ce-9149-5fcff9ffd304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:12.829699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b47b34-ec0b-48ce-9149-5fcff9ffd304 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:12.846146 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 266/554] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:12.848355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffa470-1c58-4bdb-9a06-99560ed3e336 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.848765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffa470-1c58-4bdb-9a06-99560ed3e336 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.849136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffa470-1c58-4bdb-9a06-99560ed3e336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.869760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4dffa470-1c58-4bdb-9a06-99560ed3e336 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:12.872133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4dffa470-1c58-4bdb-9a06-99560ed3e336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:12.946392 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:12.951578 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 267/555] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:46:12.951951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bed42-38d8-47cc-b695-4ac93bbb00d6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:12.953251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffa470-1c58-4bdb-9a06-99560ed3e336 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:12.993628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82097bbe-4006-4d68-a4fb-7287957fcc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:12.994259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82097bbe-4006-4d68-a4fb-7287957fcc27 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.994545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82097bbe-4006-4d68-a4fb-7287957fcc27 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.994834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82097bbe-4006-4d68-a4fb-7287957fcc27 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.995536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82097bbe-4006-4d68-a4fb-7287957fcc27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:12.995838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82097bbe-4006-4d68-a4fb-7287957fcc27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:12.997365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82097bbe-4006-4d68-a4fb-7287957fcc27 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:13.010067 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 289/556] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:13.011516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016a40f-175f-4bdd-a747-e3d30dfefeed None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:13.011855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016a40f-175f-4bdd-a747-e3d30dfefeed None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:13.012132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016a40f-175f-4bdd-a747-e3d30dfefeed None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:13.013475 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 290/557] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:13.019211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016a40f-175f-4bdd-a747-e3d30dfefeed None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:13.050321 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:13.079679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffa470-1c58-4bdb-9a06-99560ed3e336 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:13.115062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509403f-bc35-4b49-8796-e4c92f2640b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:13.115692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509403f-bc35-4b49-8796-e4c92f2640b4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:13.115967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509403f-bc35-4b49-8796-e4c92f2640b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:13.116287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509403f-bc35-4b49-8796-e4c92f2640b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:13.123295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509403f-bc35-4b49-8796-e4c92f2640b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:13.124729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509403f-bc35-4b49-8796-e4c92f2640b4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-2509403f-bc35-4b49-8796-e4c92f2640b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:13.136456 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:13.137446 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:13.138334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:13.138334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:13.138334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:13.138334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:13.138334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:13.138334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:13.138334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:13.138334 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:13.138334 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 268/558] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:13.139229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d6884-10d4-4718-9d00-ba291b7299f4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:13.139533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d6884-10d4-4718-9d00-ba291b7299f4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:13.139808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d6884-10d4-4718-9d00-ba291b7299f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:13.152813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016a40f-175f-4bdd-a747-e3d30dfefeed None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:13.163296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8c1d6884-10d4-4718-9d00-ba291b7299f4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:13.164867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8c1d6884-10d4-4718-9d00-ba291b7299f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:13.191299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd81f4a-b9b9-4a6b-9fbc-8cea5ee00a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:13.191987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd81f4a-b9b9-4a6b-9fbc-8cea5ee00a0f None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:13.192264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd81f4a-b9b9-4a6b-9fbc-8cea5ee00a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:13.192600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd81f4a-b9b9-4a6b-9fbc-8cea5ee00a0f None admin] PATH_INFO: `/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/3c8b1dd3162b4d05a253780a140042ff/roles/b8b6732605964de6aedfe2a3cf507d03` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:13.208371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd81f4a-b9b9-4a6b-9fbc-8cea5ee00a0f None admin] RBAC: Authorizing `identity:create_grant(project_id=2efc56617bd54471a648f03215b3bfb1, user_id=3c8b1dd3162b4d05a253780a140042ff, role_id=b8b6732605964de6aedfe2a3cf507d03)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:13.209736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd81f4a-b9b9-4a6b-9fbc-8cea5ee00a0f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:13.225751 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 291/559] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:46:13 2022] PUT /identity/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/3c8b1dd3162b4d05a253780a140042ff/roles/b8b6732605964de6aedfe2a3cf507d03 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:46:13.226690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd81f4a-b9b9-4a6b-9fbc-8cea5ee00a0f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:13.228052 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:13.245501 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 269/560] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:46:13.252759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d6884-10d4-4718-9d00-ba291b7299f4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:13.391303 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:13.425231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d6884-10d4-4718-9d00-ba291b7299f4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:13.440822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd81f4a-b9b9-4a6b-9fbc-8cea5ee00a0f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:13.465278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0566af-42e9-4c01-b7d2-324ee691649a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:13.465909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0566af-42e9-4c01-b7d2-324ee691649a None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:13.466296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0566af-42e9-4c01-b7d2-324ee691649a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:13.466649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0566af-42e9-4c01-b7d2-324ee691649a None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:13.467410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0566af-42e9-4c01-b7d2-324ee691649a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:13.468903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0566af-42e9-4c01-b7d2-324ee691649a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:13.488208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b2cbf-cbea-4737-95be-fd2821437477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:13.489141 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 270/561] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:46:13 2022] POST /identity/v3/services => generated 240 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:13.489360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b2cbf-cbea-4737-95be-fd2821437477 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:13.489913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b2cbf-cbea-4737-95be-fd2821437477 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:13.490400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b2cbf-cbea-4737-95be-fd2821437477 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:13.491348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b2cbf-cbea-4737-95be-fd2821437477 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:13.491764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b2cbf-cbea-4737-95be-fd2821437477 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:13.493342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b2cbf-cbea-4737-95be-fd2821437477 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:13.511239 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 292/562] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:13.519209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0566af-42e9-4c01-b7d2-324ee691649a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:13.582680 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:13.648235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0566af-42e9-4c01-b7d2-324ee691649a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:13.682880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b2cbf-cbea-4737-95be-fd2821437477 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:13.690944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5885d4-cbf6-42a6-b081-c977db927c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:13.691670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5885d4-cbf6-42a6-b081-c977db927c32 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:13.691949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5885d4-cbf6-42a6-b081-c977db927c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:13.692257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5885d4-cbf6-42a6-b081-c977db927c32 None admin] PATH_INFO: `/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/ef8c6c33c3504949876d496a5213494d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:13.695423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5885d4-cbf6-42a6-b081-c977db927c32 None admin] RBAC: Authorizing `identity:create_grant(project_id=2efc56617bd54471a648f03215b3bfb1, user_id=ef8c6c33c3504949876d496a5213494d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:13.696890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5885d4-cbf6-42a6-b081-c977db927c32 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:13.718458 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 271/563] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:46:13 2022] PUT /identity/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/ef8c6c33c3504949876d496a5213494d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:46:13.819593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b2cbf-cbea-4737-95be-fd2821437477 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:13.858289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd75b2a-d8b1-4563-8b21-4c2d7e213d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:13.858946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd75b2a-d8b1-4563-8b21-4c2d7e213d5e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:13.859225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd75b2a-d8b1-4563-8b21-4c2d7e213d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:13.859488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd75b2a-d8b1-4563-8b21-4c2d7e213d5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:13.868339 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:13.874257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd75b2a-d8b1-4563-8b21-4c2d7e213d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-8bd75b2a-d8b1-4563-8b21-4c2d7e213d5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:13.879708 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:13.880679 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:13.881760 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:13.881760 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:13.881760 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:13.881760 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:13.881760 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:13.881760 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:13.881760 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:13.881760 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:13.881760 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:13.881760 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:13.881760 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:13.881760 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:13.881760 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 293/564] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:46:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:13.887046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5885d4-cbf6-42a6-b081-c977db927c32 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:14.005074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5885d4-cbf6-42a6-b081-c977db927c32 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:14.007588 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:14.050563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca69ae-1cca-4161-ae1b-24128640fcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:14.051234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca69ae-1cca-4161-ae1b-24128640fcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:14.051515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca69ae-1cca-4161-ae1b-24128640fcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:14.051805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca69ae-1cca-4161-ae1b-24128640fcf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:14.052491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca69ae-1cca-4161-ae1b-24128640fcf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:14.052815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca69ae-1cca-4161-ae1b-24128640fcf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:14.054182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca69ae-1cca-4161-ae1b-24128640fcf9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:14.063421 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 272/565] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:46:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:14.069614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd75b2a-d8b1-4563-8b21-4c2d7e213d5e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:14.231662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd75b2a-d8b1-4563-8b21-4c2d7e213d5e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:14.289644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc37797-c1c1-4d15-83d9-09eedca7db2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:14.290244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc37797-c1c1-4d15-83d9-09eedca7db2f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:14.290528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc37797-c1c1-4d15-83d9-09eedca7db2f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:14.290800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc37797-c1c1-4d15-83d9-09eedca7db2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:14.311859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc37797-c1c1-4d15-83d9-09eedca7db2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:14.313833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc37797-c1c1-4d15-83d9-09eedca7db2f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-6cc37797-c1c1-4d15-83d9-09eedca7db2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:14.334113 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:14.335165 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:14.336680 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:14.336680 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:14.336680 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:14.336680 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 294/566] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:14.344263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca69ae-1cca-4161-ae1b-24128640fcf9 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:14.472686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca69ae-1cca-4161-ae1b-24128640fcf9 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:14.507789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d8071-06db-4e76-84f0-71f4460d65c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:14.508538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d8071-06db-4e76-84f0-71f4460d65c1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:14.508867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d8071-06db-4e76-84f0-71f4460d65c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:14.509140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d8071-06db-4e76-84f0-71f4460d65c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:14.509769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d8071-06db-4e76-84f0-71f4460d65c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:14.510066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d8071-06db-4e76-84f0-71f4460d65c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:14.511448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d8071-06db-4e76-84f0-71f4460d65c1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:14.527640 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 273/567] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:14.533504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc37797-c1c1-4d15-83d9-09eedca7db2f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:14.610684 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:14.684348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc37797-c1c1-4d15-83d9-09eedca7db2f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:14.731719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962d516-73be-482d-b6d2-d9e317ad1ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:14.732371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962d516-73be-482d-b6d2-d9e317ad1ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:14.732658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962d516-73be-482d-b6d2-d9e317ad1ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:14.732988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962d516-73be-482d-b6d2-d9e317ad1ef4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:14.741592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962d516-73be-482d-b6d2-d9e317ad1ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:14.743227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962d516-73be-482d-b6d2-d9e317ad1ef4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-1962d516-73be-482d-b6d2-d9e317ad1ef4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:14.755239 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:14.756211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:14.757599 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:14.757599 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:14.757599 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:14.757599 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:14.757599 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:14.757599 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:14.757599 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:14.757599 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:14.757599 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:46:14.757599 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:14.757599 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 295/568] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Oct 16 00:46:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:14.762125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d8071-06db-4e76-84f0-71f4460d65c1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:14.825866 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:14.936456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d8071-06db-4e76-84f0-71f4460d65c1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:14.988179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf038e-2d94-44b7-89bf-a4a976be18ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:14.988790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf038e-2d94-44b7-89bf-a4a976be18ee None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:14.989069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf038e-2d94-44b7-89bf-a4a976be18ee None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:14.989343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf038e-2d94-44b7-89bf-a4a976be18ee None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:14.990071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf038e-2d94-44b7-89bf-a4a976be18ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:14.990378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf038e-2d94-44b7-89bf-a4a976be18ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:14.991824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf038e-2d94-44b7-89bf-a4a976be18ee None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:15.013943 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 274/569] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Oct 16 00:46:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:15.019791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962d516-73be-482d-b6d2-d9e317ad1ef4 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:15.172489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962d516-73be-482d-b6d2-d9e317ad1ef4 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:15.188393 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:15.218236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e7d16-4392-4efa-b903-b9dbe7afc5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:15.218836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7d16-4392-4efa-b903-b9dbe7afc5ba None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:15.219140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7d16-4392-4efa-b903-b9dbe7afc5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:15.219409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7d16-4392-4efa-b903-b9dbe7afc5ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:15.307932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e7d16-4392-4efa-b903-b9dbe7afc5ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:15.309374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e7d16-4392-4efa-b903-b9dbe7afc5ba None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:15.441956 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 296/570] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:46:15.447432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf038e-2d94-44b7-89bf-a4a976be18ee None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:15.454950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95eda-3678-4eab-84e8-12286c7f8550 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:15.454950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95eda-3678-4eab-84e8-12286c7f8550 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:15.454950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95eda-3678-4eab-84e8-12286c7f8550 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:15.456237 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 297/571] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:46:15.462692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa016f4c-98e8-4345-ba07-0372529d4f36 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:15.463255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa016f4c-98e8-4345-ba07-0372529d4f36 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:15.463730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa016f4c-98e8-4345-ba07-0372529d4f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:15.483645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-aa016f4c-98e8-4345-ba07-0372529d4f36 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:15.486169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aa016f4c-98e8-4345-ba07-0372529d4f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:15.491458 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:15.565249 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 298/572] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:15.670296 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:15.686310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf038e-2d94-44b7-89bf-a4a976be18ee None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:15.721579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1996e-2475-49ba-ade2-c796421f0774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:15.722130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1996e-2475-49ba-ade2-c796421f0774 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:15.722406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1996e-2475-49ba-ade2-c796421f0774 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:15.722677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1996e-2475-49ba-ade2-c796421f0774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:15.736821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1996e-2475-49ba-ade2-c796421f0774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:15.738264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1996e-2475-49ba-ade2-c796421f0774 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-43b1996e-2475-49ba-ade2-c796421f0774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:15.759138 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:15.760279 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:15.761737 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:15.761737 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:15.761737 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:15.761737 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 275/573] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:15.765699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa016f4c-98e8-4345-ba07-0372529d4f36 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:15.913648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa016f4c-98e8-4345-ba07-0372529d4f36 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:15.957943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0b8c5-03ed-4682-a58c-5a04d530736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:15.958968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0b8c5-03ed-4682-a58c-5a04d530736d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:15.959502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0b8c5-03ed-4682-a58c-5a04d530736d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:15.960026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0b8c5-03ed-4682-a58c-5a04d530736d None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:15.960919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0b8c5-03ed-4682-a58c-5a04d530736d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:15.961437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0b8c5-03ed-4682-a58c-5a04d530736d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:15.962984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1996e-2475-49ba-ade2-c796421f0774 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:15.963773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0b8c5-03ed-4682-a58c-5a04d530736d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:15.977470 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:15.981031 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 299/574] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:15.982307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df4b67-d6fe-4ec1-bc48-5404b963cdd5 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:15.986308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df4b67-d6fe-4ec1-bc48-5404b963cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:15.986638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df4b67-d6fe-4ec1-bc48-5404b963cdd5 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:15.988271 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 300/575] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:15.991899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df4b67-d6fe-4ec1-bc48-5404b963cdd5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:16.099270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1996e-2475-49ba-ade2-c796421f0774 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:16.105354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df4b67-d6fe-4ec1-bc48-5404b963cdd5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:16.144835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b84e1-a0b6-489a-b80c-733cbb848e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:16.145446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c03c11-aa07-421b-9517-7d680eceae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:16.146071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03c11-aa07-421b-9517-7d680eceae45 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.146302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b84e1-a0b6-489a-b80c-733cbb848e1b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.146416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03c11-aa07-421b-9517-7d680eceae45 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.146599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03c11-aa07-421b-9517-7d680eceae45 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.147108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b84e1-a0b6-489a-b80c-733cbb848e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.147234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c03c11-aa07-421b-9517-7d680eceae45 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:16.147701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b84e1-a0b6-489a-b80c-733cbb848e1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.148613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c03c11-aa07-421b-9517-7d680eceae45 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:16.151910 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:16.157141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b84e1-a0b6-489a-b80c-733cbb848e1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:16.159220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b84e1-a0b6-489a-b80c-733cbb848e1b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-11c03c11-aa07-421b-9517-7d680eceae45 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:16.160946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:16.161971 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:46:16.162946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:16.167153 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 276/576] 10.222.0.39 () {56 vars in 1129 bytes} [Sun Oct 16 00:46:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:16.168905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefbfd0-3bf1-4f4e-b983-baa48cec1cee None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.169182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefbfd0-3bf1-4f4e-b983-baa48cec1cee None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.169451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefbfd0-3bf1-4f4e-b983-baa48cec1cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-1e8b84e1-a0b6-489a-b80c-733cbb848e1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:16.180303 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:16.181876 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:16.182994 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:16.182994 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:16.182994 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:16.182994 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:16.182994 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:16.182994 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:16.182994 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:16.182994 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:16.186492 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 301/577] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:16.189244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b84e1-a0b6-489a-b80c-733cbb848e1b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:16.196372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-edefbfd0-3bf1-4f4e-b983-baa48cec1cee None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:16.197337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-edefbfd0-3bf1-4f4e-b983-baa48cec1cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:16.269964 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 277/578] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:16.270869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefbfd0-3bf1-4f4e-b983-baa48cec1cee None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:16.271926 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:16.334034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b84e1-a0b6-489a-b80c-733cbb848e1b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:16.374063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa446c7-658a-4bd1-a0b1-55cdb0a12cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:16.374990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa446c7-658a-4bd1-a0b1-55cdb0a12cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.375446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa446c7-658a-4bd1-a0b1-55cdb0a12cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.376500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa446c7-658a-4bd1-a0b1-55cdb0a12cf0 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.377333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa446c7-658a-4bd1-a0b1-55cdb0a12cf0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:16.377809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa446c7-658a-4bd1-a0b1-55cdb0a12cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:16.379547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa446c7-658a-4bd1-a0b1-55cdb0a12cf0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:16.385284 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 302/579] 10.222.0.39 () {56 vars in 1124 bytes} [Sun Oct 16 00:46:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:16.386691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a417276-2e05-4b34-a915-bc7b1dcc5241 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.387350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a417276-2e05-4b34-a915-bc7b1dcc5241 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.387800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a417276-2e05-4b34-a915-bc7b1dcc5241 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.389271 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 303/580] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:16.390439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a417276-2e05-4b34-a915-bc7b1dcc5241 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:16.408163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefbfd0-3bf1-4f4e-b983-baa48cec1cee None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:16.447308 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:16.454779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff207c-b3dc-4e89-a8d5-3a3aedc8263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:16.455968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff207c-b3dc-4e89-a8d5-3a3aedc8263a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.456277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff207c-b3dc-4e89-a8d5-3a3aedc8263a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.456552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff207c-b3dc-4e89-a8d5-3a3aedc8263a None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.457441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff207c-b3dc-4e89-a8d5-3a3aedc8263a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:16.457892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff207c-b3dc-4e89-a8d5-3a3aedc8263a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:16.459587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff207c-b3dc-4e89-a8d5-3a3aedc8263a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:16.475920 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 278/581] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:16.481939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba6a32-0abd-47d9-b90f-d55c74c05c6b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.482224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba6a32-0abd-47d9-b90f-d55c74c05c6b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.482492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba6a32-0abd-47d9-b90f-d55c74c05c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.500601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9fba6a32-0abd-47d9-b90f-d55c74c05c6b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:16.502530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9fba6a32-0abd-47d9-b90f-d55c74c05c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:16.519559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a417276-2e05-4b34-a915-bc7b1dcc5241 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:16.558531 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:16.575793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae19585-13b4-4db1-a9a6-44bdb5107522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:16.576419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae19585-13b4-4db1-a9a6-44bdb5107522 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.576698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae19585-13b4-4db1-a9a6-44bdb5107522 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.576967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae19585-13b4-4db1-a9a6-44bdb5107522 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.577622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae19585-13b4-4db1-a9a6-44bdb5107522 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:16.578016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae19585-13b4-4db1-a9a6-44bdb5107522 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:16.579494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae19585-13b4-4db1-a9a6-44bdb5107522 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:16.588483 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 304/582] 10.222.0.39 () {56 vars in 1124 bytes} [Sun Oct 16 00:46:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:16.588483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae19585-13b4-4db1-a9a6-44bdb5107522 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:16.593004 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 279/583] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:16.594102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba6a32-0abd-47d9-b90f-d55c74c05c6b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:16.704414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba6a32-0abd-47d9-b90f-d55c74c05c6b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:16.713530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae19585-13b4-4db1-a9a6-44bdb5107522 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:16.729670 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:16.748570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aba79c-111e-4311-bbcf-413d35eb2a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:16.749172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aba79c-111e-4311-bbcf-413d35eb2a0d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.749453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aba79c-111e-4311-bbcf-413d35eb2a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.749621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd15f8-f76e-41c0-b0a9-b4279187088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:16.749742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aba79c-111e-4311-bbcf-413d35eb2a0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.750427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aba79c-111e-4311-bbcf-413d35eb2a0d None admin] RBAC: Adding query filter params (role.id=3b2c8c93a1c54611871c4299008b2abf, scope.project.id=2efc56617bd54471a648f03215b3bfb1, user.id=a065cd54fd8745ca99f35405c711ffac) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:16.750647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd15f8-f76e-41c0-b0a9-b4279187088f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.750782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aba79c-111e-4311-bbcf-413d35eb2a0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:16.751214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd15f8-f76e-41c0-b0a9-b4279187088f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.751640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd15f8-f76e-41c0-b0a9-b4279187088f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.752576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aba79c-111e-4311-bbcf-413d35eb2a0d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:16.758524 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 305/584] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:16 2022] GET /identity/v3/role_assignments?user.id=a065cd54fd8745ca99f35405c711ffac&scope.project.id=2efc56617bd54471a648f03215b3bfb1&role.id=3b2c8c93a1c54611871c4299008b2abf => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:16.759353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aba79c-111e-4311-bbcf-413d35eb2a0d None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:16.773132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd15f8-f76e-41c0-b0a9-b4279187088f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-85cd15f8-f76e-41c0-b0a9-b4279187088f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:16.778363 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:16.779934 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:16.781034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:16.781034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:16.781034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:16.781034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:16.781034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:16.781034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:16.781034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:16.781034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:16.781034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:16.781034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:16.781034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:16.781034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:16.788598 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 280/585] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:46:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:16.788598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e17379-1e62-42b3-988b-9703f99dbe3b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.788598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e17379-1e62-42b3-988b-9703f99dbe3b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.788598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e17379-1e62-42b3-988b-9703f99dbe3b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.788598 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 281/586] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:16.793673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e17379-1e62-42b3-988b-9703f99dbe3b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:16.850807 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:16.909532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aba79c-111e-4311-bbcf-413d35eb2a0d None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:16.921726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e17379-1e62-42b3-988b-9703f99dbe3b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:16.948216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe35790-430b-467f-a0b3-89031ff51571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:16.949567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe35790-430b-467f-a0b3-89031ff51571 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.950011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe35790-430b-467f-a0b3-89031ff51571 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.950507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe35790-430b-467f-a0b3-89031ff51571 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.951191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe35790-430b-467f-a0b3-89031ff51571 None admin] RBAC: Adding query filter params (interface=public, service_id=cef880e45d2641809444d0e0410eb1e4, region_id=RegionOne) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:16.951636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe35790-430b-467f-a0b3-89031ff51571 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:16.953358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe35790-430b-467f-a0b3-89031ff51571 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:16.961888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8e43e-bc6d-45f8-b8df-c3019ded4496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:16.962493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8e43e-bc6d-45f8-b8df-c3019ded4496 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.962771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8e43e-bc6d-45f8-b8df-c3019ded4496 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.963075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8e43e-bc6d-45f8-b8df-c3019ded4496 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.963610 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 306/587] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Oct 16 00:46:16 2022] GET /identity/v3/endpoints?service_id=cef880e45d2641809444d0e0410eb1e4&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:16.963807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8e43e-bc6d-45f8-b8df-c3019ded4496 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:16.964164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8e43e-bc6d-45f8-b8df-c3019ded4496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:16.964356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d5f0f-e1c8-4ece-bd18-b1713aa99320 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:16.964642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d5f0f-e1c8-4ece-bd18-b1713aa99320 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:16.964941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d5f0f-e1c8-4ece-bd18-b1713aa99320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:16.965529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8e43e-bc6d-45f8-b8df-c3019ded4496 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:16.974651 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 282/588] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:46:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:16.975611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8e43e-bc6d-45f8-b8df-c3019ded4496 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:16.987955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8b6d5f0f-e1c8-4ece-bd18-b1713aa99320 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:16.989186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8b6d5f0f-e1c8-4ece-bd18-b1713aa99320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:17.022706 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:17.067071 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 307/589] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:17.067933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d5f0f-e1c8-4ece-bd18-b1713aa99320 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:17.098325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8e43e-bc6d-45f8-b8df-c3019ded4496 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:17.136277 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:17.136557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de66c83-e41d-476f-8110-4283f9517340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:17.137598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de66c83-e41d-476f-8110-4283f9517340 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:17.137864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de66c83-e41d-476f-8110-4283f9517340 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:17.138350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de66c83-e41d-476f-8110-4283f9517340 None admin] PATH_INFO: `/v3/services/network` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:17.138752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de66c83-e41d-476f-8110-4283f9517340 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:17.140755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de66c83-e41d-476f-8110-4283f9517340 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-6de66c83-e41d-476f-8110-4283f9517340 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:17.150880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:17.151974 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:17.152848 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 283/590] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:16 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:17.153656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de66c83-e41d-476f-8110-4283f9517340 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:17.203667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d5f0f-e1c8-4ece-bd18-b1713aa99320 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:17.239548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cd0ef-8595-4aa7-82a1-018edc78ac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:17.239927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cd0ef-8595-4aa7-82a1-018edc78ac66 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:17.240200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cd0ef-8595-4aa7-82a1-018edc78ac66 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:17.240465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cd0ef-8595-4aa7-82a1-018edc78ac66 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:17.241124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cd0ef-8595-4aa7-82a1-018edc78ac66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:17.242562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cd0ef-8595-4aa7-82a1-018edc78ac66 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:17.255386 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 308/591] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Oct 16 00:46:17 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:17.256367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cd0ef-8595-4aa7-82a1-018edc78ac66 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:17.281427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de66c83-e41d-476f-8110-4283f9517340 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:17.291249 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:17.357480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b1233-c571-447c-ad84-94f401965860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:17.358142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b1233-c571-447c-ad84-94f401965860 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:17.358415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b1233-c571-447c-ad84-94f401965860 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:17.358680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b1233-c571-447c-ad84-94f401965860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:17.373109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b1233-c571-447c-ad84-94f401965860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:17.374892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b1233-c571-447c-ad84-94f401965860 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-353b1233-c571-447c-ad84-94f401965860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:17.396386 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:17.397383 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:17.398272 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:17.398272 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:17.398272 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:17.398272 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 284/592] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:17.398498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b1233-c571-447c-ad84-94f401965860 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:17.429997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cd0ef-8595-4aa7-82a1-018edc78ac66 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:17.443640 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:17.476916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8410392-c810-4043-b5a4-ffee4c98b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:17.477521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410392-c810-4043-b5a4-ffee4c98b4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:17.477813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410392-c810-4043-b5a4-ffee4c98b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:17.478069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410392-c810-4043-b5a4-ffee4c98b4d7 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:17.478693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8410392-c810-4043-b5a4-ffee4c98b4d7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:17.479461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8410392-c810-4043-b5a4-ffee4c98b4d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:17.480480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8410392-c810-4043-b5a4-ffee4c98b4d7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:17.493749 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 309/593] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Oct 16 00:46:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:17.494658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8410392-c810-4043-b5a4-ffee4c98b4d7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:17.530628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b1233-c571-447c-ad84-94f401965860 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:17.576257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55ef77-fcca-4e72-a544-55c62296f193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:17.577030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ef77-fcca-4e72-a544-55c62296f193 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:17.577321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ef77-fcca-4e72-a544-55c62296f193 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:17.577590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ef77-fcca-4e72-a544-55c62296f193 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:17.590776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55ef77-fcca-4e72-a544-55c62296f193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-4d55ef77-fcca-4e72-a544-55c62296f193 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:17.597560 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:17.598495 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:17.599372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:17.599372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:17.599372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:17.599372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:17.599372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:17.599372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:17.599372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:17.599372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:17.599372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:17.599372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:17.599372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:17.599372 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:17.603026 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 285/594] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:46:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:17.604064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55ef77-fcca-4e72-a544-55c62296f193 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:17.622341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8410392-c810-4043-b5a4-ffee4c98b4d7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:17.630088 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:17.666567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e677fe-1f78-46dc-9e2e-fa4fa4b7e400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:17.667142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e677fe-1f78-46dc-9e2e-fa4fa4b7e400 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:17.667424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e677fe-1f78-46dc-9e2e-fa4fa4b7e400 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:17.667696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e677fe-1f78-46dc-9e2e-fa4fa4b7e400 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:17.668724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e677fe-1f78-46dc-9e2e-fa4fa4b7e400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:17.669033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e677fe-1f78-46dc-9e2e-fa4fa4b7e400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:17.670399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e677fe-1f78-46dc-9e2e-fa4fa4b7e400 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:17.684936 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 310/595] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:17.685767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e677fe-1f78-46dc-9e2e-fa4fa4b7e400 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:17.726385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55ef77-fcca-4e72-a544-55c62296f193 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:17.727641 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:17.764643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1747a47-2fbd-48c3-aadd-e2ba77ff0486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:17.765698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1747a47-2fbd-48c3-aadd-e2ba77ff0486 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:17.766178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1747a47-2fbd-48c3-aadd-e2ba77ff0486 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:17.767462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1747a47-2fbd-48c3-aadd-e2ba77ff0486 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:17.768293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1747a47-2fbd-48c3-aadd-e2ba77ff0486 None admin] RBAC: Adding query filter params (type=network) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:17.768811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1747a47-2fbd-48c3-aadd-e2ba77ff0486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:17.770385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1747a47-2fbd-48c3-aadd-e2ba77ff0486 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:17.777057 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 286/596] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Oct 16 00:46:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:17.778106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1747a47-2fbd-48c3-aadd-e2ba77ff0486 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:17.808918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e677fe-1f78-46dc-9e2e-fa4fa4b7e400 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:17.851723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad84ff-117b-4618-be44-cce21563871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:17.852367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad84ff-117b-4618-be44-cce21563871c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:17.852648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad84ff-117b-4618-be44-cce21563871c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:17.852920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad84ff-117b-4618-be44-cce21563871c None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:17.853680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad84ff-117b-4618-be44-cce21563871c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:17.853991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad84ff-117b-4618-be44-cce21563871c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:17.855649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad84ff-117b-4618-be44-cce21563871c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:17.869700 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 311/597] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:46:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:17.870582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad84ff-117b-4618-be44-cce21563871c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:17.871684 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:17.893161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1747a47-2fbd-48c3-aadd-e2ba77ff0486 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:17.929531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dc63a-e54c-4914-a303-2f547648e6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:17.930473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dc63a-e54c-4914-a303-2f547648e6fe None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:17.930990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dc63a-e54c-4914-a303-2f547648e6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:17.931481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dc63a-e54c-4914-a303-2f547648e6fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:17.939813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dc63a-e54c-4914-a303-2f547648e6fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:17.941549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dc63a-e54c-4914-a303-2f547648e6fe None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-ed0dc63a-e54c-4914-a303-2f547648e6fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:17.956721 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:17.957722 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:17.958678 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:17.958678 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:17.958678 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:17.958678 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:17.958678 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:17.958678 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:17.958678 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:17.958678 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:17.958678 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:46:17.958678 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:17.961675 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 287/598] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Oct 16 00:46:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:17.963147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dc63a-e54c-4914-a303-2f547648e6fe None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:17.982134 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:17.990828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad84ff-117b-4618-be44-cce21563871c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:18.036957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e4422-1ae6-4e5b-bc02-cd27d3f615d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:18.038538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e4422-1ae6-4e5b-bc02-cd27d3f615d3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:18.039055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e4422-1ae6-4e5b-bc02-cd27d3f615d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:18.039529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e4422-1ae6-4e5b-bc02-cd27d3f615d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:18.040424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e4422-1ae6-4e5b-bc02-cd27d3f615d3 None admin] RBAC: Adding query filter params (interface=public, service_id=0eff0366907541f2bf3243f05ae4c5f0, region_id=RegionOne) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:18.040949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e4422-1ae6-4e5b-bc02-cd27d3f615d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:18.042595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e4422-1ae6-4e5b-bc02-cd27d3f615d3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:18.049530 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 312/599] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Oct 16 00:46:17 2022] GET /identity/v3/endpoints?service_id=0eff0366907541f2bf3243f05ae4c5f0&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:18.050728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e4422-1ae6-4e5b-bc02-cd27d3f615d3 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:18.084613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dc63a-e54c-4914-a303-2f547648e6fe None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:18.122348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb09ca-8220-4874-9c95-f93185349274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:18.123022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb09ca-8220-4874-9c95-f93185349274 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:18.123304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb09ca-8220-4874-9c95-f93185349274 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:18.123578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb09ca-8220-4874-9c95-f93185349274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:18.135824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb09ca-8220-4874-9c95-f93185349274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:18.137381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb09ca-8220-4874-9c95-f93185349274 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:18.139304 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-0cdb09ca-8220-4874-9c95-f93185349274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:18.154869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:18.155906 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:18.156805 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:18.156805 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:18.156805 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:18.161440 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 288/600] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:18.162298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb09ca-8220-4874-9c95-f93185349274 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:18.178585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e4422-1ae6-4e5b-bc02-cd27d3f615d3 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:18.223646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e238aac-25e2-4b72-a19a-93a8433272e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:18.224264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e238aac-25e2-4b72-a19a-93a8433272e1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:18.224264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e238aac-25e2-4b72-a19a-93a8433272e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:18.224584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e238aac-25e2-4b72-a19a-93a8433272e1 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:18.225334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e238aac-25e2-4b72-a19a-93a8433272e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:18.225716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e238aac-25e2-4b72-a19a-93a8433272e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:18.227142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e238aac-25e2-4b72-a19a-93a8433272e1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:18.245381 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 313/601] 10.222.0.39 () {56 vars in 1149 bytes} [Sun Oct 16 00:46:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:18.246059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e238aac-25e2-4b72-a19a-93a8433272e1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:18.265509 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:18.303090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb09ca-8220-4874-9c95-f93185349274 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:18.340409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc49f7e-525e-4aae-a9e7-1512a596382d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:18.341108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc49f7e-525e-4aae-a9e7-1512a596382d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:18.341755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc49f7e-525e-4aae-a9e7-1512a596382d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:18.341755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc49f7e-525e-4aae-a9e7-1512a596382d None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:18.342475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc49f7e-525e-4aae-a9e7-1512a596382d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:18.343956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc49f7e-525e-4aae-a9e7-1512a596382d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:18.349853 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 289/602] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Oct 16 00:46:18 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:18.351032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc49f7e-525e-4aae-a9e7-1512a596382d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:18.366098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e238aac-25e2-4b72-a19a-93a8433272e1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:18.418621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b023c2-68d6-4320-9c99-a8f6377e4fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:18.419605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b023c2-68d6-4320-9c99-a8f6377e4fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:18.421377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b023c2-68d6-4320-9c99-a8f6377e4fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:18.422656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b023c2-68d6-4320-9c99-a8f6377e4fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:18.423567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b023c2-68d6-4320-9c99-a8f6377e4fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:18.423878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b023c2-68d6-4320-9c99-a8f6377e4fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:18.427768 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:18.428873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b023c2-68d6-4320-9c99-a8f6377e4fb0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:18.458793 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 314/603] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:18.464474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b023c2-68d6-4320-9c99-a8f6377e4fb0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:18.486368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc49f7e-525e-4aae-a9e7-1512a596382d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:18.528089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7e693-7b37-468d-bccd-eb49979e27ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:18.529467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7e693-7b37-468d-bccd-eb49979e27ed None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:18.529947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7e693-7b37-468d-bccd-eb49979e27ed None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:18.530441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7e693-7b37-468d-bccd-eb49979e27ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:18.619012 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:18.619324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7e693-7b37-468d-bccd-eb49979e27ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:18.621134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7e693-7b37-468d-bccd-eb49979e27ed None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:18.652197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b023c2-68d6-4320-9c99-a8f6377e4fb0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:18.690418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b28087-3e53-4d6a-9a57-7bd7c7980b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:18.691083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28087-3e53-4d6a-9a57-7bd7c7980b14 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:18.691365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28087-3e53-4d6a-9a57-7bd7c7980b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:18.691636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28087-3e53-4d6a-9a57-7bd7c7980b14 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:18.695300 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:18.699923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b28087-3e53-4d6a-9a57-7bd7c7980b14 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:18.701370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b28087-3e53-4d6a-9a57-7bd7c7980b14 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-41b28087-3e53-4d6a-9a57-7bd7c7980b14 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:18.714713 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:18.715762 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:18.717330 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:18.717330 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:18.717330 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:18.717330 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:18.717330 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:18.717330 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:18.717330 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:18.717330 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:18.717330 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:46:18.717330 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:18.717330 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 315/604] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:46:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:18.722759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b28087-3e53-4d6a-9a57-7bd7c7980b14 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:18.745918 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 290/605] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:46:18.755551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7e693-7b37-468d-bccd-eb49979e27ed None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:18.834666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b28087-3e53-4d6a-9a57-7bd7c7980b14 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:18.870452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9282aa-1fc5-47b4-b637-6aa82646d55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:18.871085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9282aa-1fc5-47b4-b637-6aa82646d55f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:18.871371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9282aa-1fc5-47b4-b637-6aa82646d55f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:18.871651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9282aa-1fc5-47b4-b637-6aa82646d55f None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:18.872379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9282aa-1fc5-47b4-b637-6aa82646d55f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:18.872689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9282aa-1fc5-47b4-b637-6aa82646d55f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:18.874114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9282aa-1fc5-47b4-b637-6aa82646d55f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:18.883499 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:18.894258 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 316/606] 10.222.0.39 () {56 vars in 1135 bytes} [Sun Oct 16 00:46:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:18.899769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9282aa-1fc5-47b4-b637-6aa82646d55f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:18.961681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7e693-7b37-468d-bccd-eb49979e27ed None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.009587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9282aa-1fc5-47b4-b637-6aa82646d55f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.043618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960dcc8-633b-478a-a4c5-c2922c9ffac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.044320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960dcc8-633b-478a-a4c5-c2922c9ffac6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.044597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960dcc8-633b-478a-a4c5-c2922c9ffac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.044912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960dcc8-633b-478a-a4c5-c2922c9ffac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.048608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245db74-46b8-4e6c-b446-e997cb487f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.049214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245db74-46b8-4e6c-b446-e997cb487f29 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.049493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245db74-46b8-4e6c-b446-e997cb487f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.049766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245db74-46b8-4e6c-b446-e997cb487f29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.061273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960dcc8-633b-478a-a4c5-c2922c9ffac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:19.062760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960dcc8-633b-478a-a4c5-c2922c9ffac6 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f960dcc8-633b-478a-a4c5-c2922c9ffac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:19.093701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:19.094862 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:19.096324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:19.096324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:19.096324 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:19.096324 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 291/607] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:19.097600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a4de3-474b-42a0-b218-250e74cec5d4 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.097600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a4de3-474b-42a0-b218-250e74cec5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.097600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a4de3-474b-42a0-b218-250e74cec5d4 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.098952 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 292/608] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:19.101880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a4de3-474b-42a0-b218-250e74cec5d4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:19.119380 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:19.120935 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:19.128847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245db74-46b8-4e6c-b446-e997cb487f29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:19.130480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245db74-46b8-4e6c-b446-e997cb487f29 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:19.217922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a4de3-474b-42a0-b218-250e74cec5d4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.240778 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 317/609] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 16 00:46:19.242672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbba72-8bae-452a-b9c0-b330a352e128 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.243161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbba72-8bae-452a-b9c0-b330a352e128 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.243579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbba72-8bae-452a-b9c0-b330a352e128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.255462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966de4e-a618-40ac-b8e5-f11ab02283a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.256075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966de4e-a618-40ac-b8e5-f11ab02283a7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.256350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966de4e-a618-40ac-b8e5-f11ab02283a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.256621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966de4e-a618-40ac-b8e5-f11ab02283a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.257319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966de4e-a618-40ac-b8e5-f11ab02283a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:19.258071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966de4e-a618-40ac-b8e5-f11ab02283a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:19.259114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966de4e-a618-40ac-b8e5-f11ab02283a7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:19.264405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-54bbba72-8bae-452a-b9c0-b330a352e128 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:19.265843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-54bbba72-8bae-452a-b9c0-b330a352e128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:19.278110 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 293/610] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:19.278110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966de4e-a618-40ac-b8e5-f11ab02283a7 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:19.341677 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 318/611] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:19.342823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbba72-8bae-452a-b9c0-b330a352e128 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:19.371134 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:19.371323 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:19.388725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966de4e-a618-40ac-b8e5-f11ab02283a7 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.425292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca196b-3a78-40f0-aea0-e521f3ba76d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.426291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca196b-3a78-40f0-aea0-e521f3ba76d0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.426769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca196b-3a78-40f0-aea0-e521f3ba76d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.427338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca196b-3a78-40f0-aea0-e521f3ba76d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.439212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca196b-3a78-40f0-aea0-e521f3ba76d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:19.441051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca196b-3a78-40f0-aea0-e521f3ba76d0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-abca196b-3a78-40f0-aea0-e521f3ba76d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:19.458798 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:19.459832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:19.460755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:19.460755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:19.460755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:19.462964 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 294/612] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:19.468518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca196b-3a78-40f0-aea0-e521f3ba76d0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:19.560499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbba72-8bae-452a-b9c0-b330a352e128 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.639913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cec809-037c-4932-a5c3-d2a0b04e29c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.640906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cec809-037c-4932-a5c3-d2a0b04e29c1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.641425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cec809-037c-4932-a5c3-d2a0b04e29c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.641886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cec809-037c-4932-a5c3-d2a0b04e29c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.650329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cec809-037c-4932-a5c3-d2a0b04e29c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:19.652303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cec809-037c-4932-a5c3-d2a0b04e29c1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:19.656032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca196b-3a78-40f0-aea0-e521f3ba76d0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-63cec809-037c-4932-a5c3-d2a0b04e29c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:19.665497 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:19.666425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:19.667346 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:19.667346 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:19.667346 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:19.667346 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:19.667346 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:19.667346 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:19.667346 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:19.667346 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:19.669401 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 319/613] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:19.670441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cec809-037c-4932-a5c3-d2a0b04e29c1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:19.694117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607bfa3-1c2d-44f1-9b09-652100fb9731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.694811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607bfa3-1c2d-44f1-9b09-652100fb9731 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.695192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607bfa3-1c2d-44f1-9b09-652100fb9731 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.695536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607bfa3-1c2d-44f1-9b09-652100fb9731 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.696334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607bfa3-1c2d-44f1-9b09-652100fb9731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:19.696722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607bfa3-1c2d-44f1-9b09-652100fb9731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:19.698259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607bfa3-1c2d-44f1-9b09-652100fb9731 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:19.708101 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:19.711729 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 295/614] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:19.712933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607bfa3-1c2d-44f1-9b09-652100fb9731 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:19.764915 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:19.783722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cec809-037c-4932-a5c3-d2a0b04e29c1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.816953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607bfa3-1c2d-44f1-9b09-652100fb9731 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.822895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0db0dd-afc8-4679-a07a-3e853e321411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.824049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0db0dd-afc8-4679-a07a-3e853e321411 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.824430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0db0dd-afc8-4679-a07a-3e853e321411 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.824803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0db0dd-afc8-4679-a07a-3e853e321411 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.825828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0db0dd-afc8-4679-a07a-3e853e321411 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:19.827635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0db0dd-afc8-4679-a07a-3e853e321411 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-7b0db0dd-afc8-4679-a07a-3e853e321411 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:19.837130 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:19.838205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:19.839112 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 320/615] 10.222.0.39 () {56 vars in 1132 bytes} [Sun Oct 16 00:46:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:19.839897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd9ae9-dbff-48c1-a70c-96878bf56edf None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.839897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd9ae9-dbff-48c1-a70c-96878bf56edf None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.839897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd9ae9-dbff-48c1-a70c-96878bf56edf None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.841293 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 321/616] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:19.841857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd9ae9-dbff-48c1-a70c-96878bf56edf None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:19.861788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db4bb8-5783-4d4d-be43-a6c9fe94d021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.862724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db4bb8-5783-4d4d-be43-a6c9fe94d021 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.863464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db4bb8-5783-4d4d-be43-a6c9fe94d021 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.863880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db4bb8-5783-4d4d-be43-a6c9fe94d021 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.864718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db4bb8-5783-4d4d-be43-a6c9fe94d021 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:19.865158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db4bb8-5783-4d4d-be43-a6c9fe94d021 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:19.867433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db4bb8-5783-4d4d-be43-a6c9fe94d021 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:19.884890 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 296/617] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:19.884890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db4bb8-5783-4d4d-be43-a6c9fe94d021 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:19.930594 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:19.959258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd9ae9-dbff-48c1-a70c-96878bf56edf None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.998942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7125953-02b2-4dbe-b16d-b223fbd04fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.998942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7125953-02b2-4dbe-b16d-b223fbd04fcb None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.998942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7125953-02b2-4dbe-b16d-b223fbd04fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.998942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7125953-02b2-4dbe-b16d-b223fbd04fcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:20.000510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db4bb8-5783-4d4d-be43-a6c9fe94d021 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:20.004508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7125953-02b2-4dbe-b16d-b223fbd04fcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:20.005953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7125953-02b2-4dbe-b16d-b223fbd04fcb None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-d7125953-02b2-4dbe-b16d-b223fbd04fcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:20.020321 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:20.021405 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:20.022473 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:20.022473 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:20.022473 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:20.022473 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:20.022473 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:20.022473 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:20.022473 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:20.022473 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:20.026228 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 322/618] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:20.027845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3e3e7-4b74-4304-953a-ef900d9fc183 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:20.028126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3e3e7-4b74-4304-953a-ef900d9fc183 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:20.028401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3e3e7-4b74-4304-953a-ef900d9fc183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:20.040098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da046e93-fada-4a86-bb93-7251d5727586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:20.040699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da046e93-fada-4a86-bb93-7251d5727586 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:20.040973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da046e93-fada-4a86-bb93-7251d5727586 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:20.041241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da046e93-fada-4a86-bb93-7251d5727586 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:20.041858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da046e93-fada-4a86-bb93-7251d5727586 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:20.042576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da046e93-fada-4a86-bb93-7251d5727586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:20.044055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da046e93-fada-4a86-bb93-7251d5727586 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:20.047715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c4c3e3e7-4b74-4304-953a-ef900d9fc183 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:20.049198 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 297/619] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Oct 16 00:46:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:20.049312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c4c3e3e7-4b74-4304-953a-ef900d9fc183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:20.053290 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:20.054643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da046e93-fada-4a86-bb93-7251d5727586 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:20.123638 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 323/620] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:20.124413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3e3e7-4b74-4304-953a-ef900d9fc183 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:20.171894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da046e93-fada-4a86-bb93-7251d5727586 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:20.180151 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:20.211670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86943dd1-193a-4198-9c07-a1b3b4c21616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:20.212351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86943dd1-193a-4198-9c07-a1b3b4c21616 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:20.212689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86943dd1-193a-4198-9c07-a1b3b4c21616 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:20.213018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86943dd1-193a-4198-9c07-a1b3b4c21616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:20.213793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86943dd1-193a-4198-9c07-a1b3b4c21616 None admin] RBAC: Adding query filter params (role.id=b8b6732605964de6aedfe2a3cf507d03, scope.project.id=2efc56617bd54471a648f03215b3bfb1, user.id=3c8b1dd3162b4d05a253780a140042ff) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:20.214164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86943dd1-193a-4198-9c07-a1b3b4c21616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:20.215742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86943dd1-193a-4198-9c07-a1b3b4c21616 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:20.231365 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 298/621] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:20 2022] GET /identity/v3/role_assignments?user.id=3c8b1dd3162b4d05a253780a140042ff&scope.project.id=2efc56617bd54471a648f03215b3bfb1&role.id=b8b6732605964de6aedfe2a3cf507d03 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:20.232443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86943dd1-193a-4198-9c07-a1b3b4c21616 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:20.277291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3e3e7-4b74-4304-953a-ef900d9fc183 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:20.349112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2bcf5-a69e-4954-ba95-463856fc4f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:20.350006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2bcf5-a69e-4954-ba95-463856fc4f27 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:20.350491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2bcf5-a69e-4954-ba95-463856fc4f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:20.350978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2bcf5-a69e-4954-ba95-463856fc4f27 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:20.351820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2bcf5-a69e-4954-ba95-463856fc4f27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:20.352291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2bcf5-a69e-4954-ba95-463856fc4f27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:20.353943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2bcf5-a69e-4954-ba95-463856fc4f27 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:20.365697 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:20.371975 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 324/622] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:20.379948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2bcf5-a69e-4954-ba95-463856fc4f27 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:20.457365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86943dd1-193a-4198-9c07-a1b3b4c21616 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:20.505267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f35922-b93d-4231-ba7a-fa6aa950a230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:20.505876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f35922-b93d-4231-ba7a-fa6aa950a230 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:20.506152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f35922-b93d-4231-ba7a-fa6aa950a230 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:20.506854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f35922-b93d-4231-ba7a-fa6aa950a230 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:20.507558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f35922-b93d-4231-ba7a-fa6aa950a230 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:20.507861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f35922-b93d-4231-ba7a-fa6aa950a230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:20.509598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f35922-b93d-4231-ba7a-fa6aa950a230 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:20.517402 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 299/623] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Oct 16 00:46:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:20.518177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f35922-b93d-4231-ba7a-fa6aa950a230 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:20.536789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2bcf5-a69e-4954-ba95-463856fc4f27 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:20.571397 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:20.592720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0541ec-a7ce-4f39-a6e8-f93d170b12d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:20.594004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0541ec-a7ce-4f39-a6e8-f93d170b12d3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:20.594525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0541ec-a7ce-4f39-a6e8-f93d170b12d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:20.595475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0541ec-a7ce-4f39-a6e8-f93d170b12d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:20.596517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0541ec-a7ce-4f39-a6e8-f93d170b12d3 None admin] RBAC: Adding query filter params (role.id=3b2c8c93a1c54611871c4299008b2abf, scope.project.id=2efc56617bd54471a648f03215b3bfb1, user.id=ef8c6c33c3504949876d496a5213494d) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:20.596966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0541ec-a7ce-4f39-a6e8-f93d170b12d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:20.599485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0541ec-a7ce-4f39-a6e8-f93d170b12d3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:20.607680 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 325/624] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:20 2022] GET /identity/v3/role_assignments?user.id=ef8c6c33c3504949876d496a5213494d&scope.project.id=2efc56617bd54471a648f03215b3bfb1&role.id=3b2c8c93a1c54611871c4299008b2abf => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:20.655562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f35922-b93d-4231-ba7a-fa6aa950a230 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:20.702688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf70cd0-0918-41b5-ad5a-bca36ae2b498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:20.703687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70cd0-0918-41b5-ad5a-bca36ae2b498 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:20.704749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70cd0-0918-41b5-ad5a-bca36ae2b498 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:20.705167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70cd0-0918-41b5-ad5a-bca36ae2b498 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:20.705926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf70cd0-0918-41b5-ad5a-bca36ae2b498 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:20.707516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf70cd0-0918-41b5-ad5a-bca36ae2b498 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-aaf70cd0-0918-41b5-ad5a-bca36ae2b498 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:20.719575 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:20.721332 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:46:20.722364 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:20.724621 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 300/625] 10.222.0.39 () {56 vars in 1129 bytes} [Sun Oct 16 00:46:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:20.731284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0541ec-a7ce-4f39-a6e8-f93d170b12d3 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:20.824363 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:20.873716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0541ec-a7ce-4f39-a6e8-f93d170b12d3 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:20.911949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd5784-0ba6-4a84-8c3b-d04867996983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:20.912487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd5784-0ba6-4a84-8c3b-d04867996983 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:20.912762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd5784-0ba6-4a84-8c3b-d04867996983 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:20.913030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd5784-0ba6-4a84-8c3b-d04867996983 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:20.913670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd5784-0ba6-4a84-8c3b-d04867996983 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:20.913970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd5784-0ba6-4a84-8c3b-d04867996983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:20.915436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd5784-0ba6-4a84-8c3b-d04867996983 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:20.921015 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 326/626] 10.222.0.39 () {56 vars in 1124 bytes} [Sun Oct 16 00:46:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:20.927179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf70cd0-0918-41b5-ad5a-bca36ae2b498 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:21.038843 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:21.044575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf70cd0-0918-41b5-ad5a-bca36ae2b498 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:21.068381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34586f13-502c-450a-9e41-ff51be4ff3fd None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:21.068700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34586f13-502c-450a-9e41-ff51be4ff3fd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:21.068932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34586f13-502c-450a-9e41-ff51be4ff3fd None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:21.070518 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 327/627] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:21.076109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1f234-a829-4888-9420-511e5a10862d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:21.076388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1f234-a829-4888-9420-511e5a10862d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:21.076661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1f234-a829-4888-9420-511e5a10862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:21.088385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e923a-6e25-445b-ae51-47ee4fc7f894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:21.088999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e923a-6e25-445b-ae51-47ee4fc7f894 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:21.089276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e923a-6e25-445b-ae51-47ee4fc7f894 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:21.089549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e923a-6e25-445b-ae51-47ee4fc7f894 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:21.090173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e923a-6e25-445b-ae51-47ee4fc7f894 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:21.090474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e923a-6e25-445b-ae51-47ee4fc7f894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:21.091874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e923a-6e25-445b-ae51-47ee4fc7f894 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:21.107118 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 301/628] 10.222.0.39 () {56 vars in 1124 bytes} [Sun Oct 16 00:46:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:21.108108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-baf1f234-a829-4888-9420-511e5a10862d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:21.109363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-baf1f234-a829-4888-9420-511e5a10862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:21.112992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e923a-6e25-445b-ae51-47ee4fc7f894 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:21.202704 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 328/629] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:21.289062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e923a-6e25-445b-ae51-47ee4fc7f894 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:21.337494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db73e0-a0fe-429a-9325-a6087d370205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:21.338198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db73e0-a0fe-429a-9325-a6087d370205 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:21.338477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db73e0-a0fe-429a-9325-a6087d370205 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:21.338746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db73e0-a0fe-429a-9325-a6087d370205 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:21.339438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db73e0-a0fe-429a-9325-a6087d370205 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:21.340803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db73e0-a0fe-429a-9325-a6087d370205 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:21.370612 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 302/630] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 00:46:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:46:21.553573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1f234-a829-4888-9420-511e5a10862d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:21.633325 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:21.685287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1f234-a829-4888-9420-511e5a10862d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:21.732451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6ea11-7e2a-4cd0-8ae5-55021eb08ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:21.733097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6ea11-7e2a-4cd0-8ae5-55021eb08ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:21.733368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6ea11-7e2a-4cd0-8ae5-55021eb08ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:21.733638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6ea11-7e2a-4cd0-8ae5-55021eb08ad4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:21.734210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6ea11-7e2a-4cd0-8ae5-55021eb08ad4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:21.736362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6ea11-7e2a-4cd0-8ae5-55021eb08ad4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-4ad6ea11-7e2a-4cd0-8ae5-55021eb08ad4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:21.746955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:21.747952 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:21.748769 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 329/631] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:21 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:21.756027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db73e0-a0fe-429a-9325-a6087d370205 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:21.783859 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:21.869561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db73e0-a0fe-429a-9325-a6087d370205 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:21.903678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28d453-c994-4222-ac4a-f13bfa6fe1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:21.904611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28d453-c994-4222-ac4a-f13bfa6fe1fe None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:21.904888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28d453-c994-4222-ac4a-f13bfa6fe1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:21.905162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28d453-c994-4222-ac4a-f13bfa6fe1fe None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:21.905780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28d453-c994-4222-ac4a-f13bfa6fe1fe None admin] RBAC: Adding query filter params (name=network) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:21.906078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28d453-c994-4222-ac4a-f13bfa6fe1fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:21.908014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28d453-c994-4222-ac4a-f13bfa6fe1fe None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:21.913034 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 303/632] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Oct 16 00:46:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:21.924087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6ea11-7e2a-4cd0-8ae5-55021eb08ad4 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:22.052264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6ea11-7e2a-4cd0-8ae5-55021eb08ad4 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:22.070464 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:22.090588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fab694-ef38-48fc-b180-421457ed875a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:22.091218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fab694-ef38-48fc-b180-421457ed875a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:22.091494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fab694-ef38-48fc-b180-421457ed875a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:22.091765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fab694-ef38-48fc-b180-421457ed875a None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:22.092441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fab694-ef38-48fc-b180-421457ed875a None admin] RBAC: Adding query filter params (type=network) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:22.092753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fab694-ef38-48fc-b180-421457ed875a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:22.094125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fab694-ef38-48fc-b180-421457ed875a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:22.099890 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 330/633] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Oct 16 00:46:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:22.108156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28d453-c994-4222-ac4a-f13bfa6fe1fe None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:22.202818 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:22.222771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28d453-c994-4222-ac4a-f13bfa6fe1fe None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:22.268553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b7103-81e7-4c95-b92c-ac249be3db8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:22.269163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b7103-81e7-4c95-b92c-ac249be3db8b None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:22.269440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b7103-81e7-4c95-b92c-ac249be3db8b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:22.269708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b7103-81e7-4c95-b92c-ac249be3db8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:22.270361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b7103-81e7-4c95-b92c-ac249be3db8b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:22.271745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b7103-81e7-4c95-b92c-ac249be3db8b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:22.295040 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 304/634] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 00:46:22 2022] POST /identity/v3/endpoints => generated 337 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:23.090173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e41b73-f53d-4c18-b738-a994db76c449 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:23.090700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e41b73-f53d-4c18-b738-a994db76c449 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:23.090700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e41b73-f53d-4c18-b738-a994db76c449 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:23.092331 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 331/635] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:23.097655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eab40c-541b-4f47-a1f6-6c63452d4ada None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:23.097942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eab40c-541b-4f47-a1f6-6c63452d4ada None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:23.098213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eab40c-541b-4f47-a1f6-6c63452d4ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:23.119584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f5eab40c-541b-4f47-a1f6-6c63452d4ada None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:23.120767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f5eab40c-541b-4f47-a1f6-6c63452d4ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:23.152470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2481812-3e16-49a5-8e6a-e5dde7ecc91c None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:23.152745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2481812-3e16-49a5-8e6a-e5dde7ecc91c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:23.153009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2481812-3e16-49a5-8e6a-e5dde7ecc91c None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:23.154704 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 332/636] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:23.160836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8c2f-1cc2-489c-8dda-867034bb176e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:23.161352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8c2f-1cc2-489c-8dda-867034bb176e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:23.161883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8c2f-1cc2-489c-8dda-867034bb176e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:23.180103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3dcf8c2f-1cc2-489c-8dda-867034bb176e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:23.182357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3dcf8c2f-1cc2-489c-8dda-867034bb176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:23.208094 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 305/637] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:23.257412 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 333/638] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:23.425266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c30d7-1175-4574-9131-8ecce7366345 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:23.425611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c30d7-1175-4574-9131-8ecce7366345 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:23.425716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c30d7-1175-4574-9131-8ecce7366345 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:23.427306 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 306/639] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:23.434964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea96fd-814e-4b89-8974-40a0c1e0bce4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:23.434964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea96fd-814e-4b89-8974-40a0c1e0bce4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:23.434964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea96fd-814e-4b89-8974-40a0c1e0bce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:23.452579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-56ea96fd-814e-4b89-8974-40a0c1e0bce4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:23.453804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-56ea96fd-814e-4b89-8974-40a0c1e0bce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:23.490100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c30d7-1175-4574-9131-8ecce7366345 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:23.531984 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 334/640] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:23.545494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea96fd-814e-4b89-8974-40a0c1e0bce4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:23.559950 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:23.606461 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:23.607274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c30d7-1175-4574-9131-8ecce7366345 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:23.646903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035bc0e-174c-4b1d-91a7-56d3f0c437b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:23.648020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035bc0e-174c-4b1d-91a7-56d3f0c437b2 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:23.648526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035bc0e-174c-4b1d-91a7-56d3f0c437b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:23.649060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035bc0e-174c-4b1d-91a7-56d3f0c437b2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:23.661288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035bc0e-174c-4b1d-91a7-56d3f0c437b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-1035bc0e-174c-4b1d-91a7-56d3f0c437b2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:23.666869 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:23.667810 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:23.668665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:23.668665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:23.668665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:23.668665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:23.668665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:23.668665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:23.668665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:23.668665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:23.668665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:23.668665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:23.668665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:46:23.668665 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:23.677086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea96fd-814e-4b89-8974-40a0c1e0bce4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:23.677405 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 307/641] 10.222.0.39 () {56 vars in 1120 bytes} [Sun Oct 16 00:46:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:23.678481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035bc0e-174c-4b1d-91a7-56d3f0c437b2 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:23.714901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171821e-d24d-4a98-9f0e-f471ea89344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:23.715671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171821e-d24d-4a98-9f0e-f471ea89344c None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:23.716067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171821e-d24d-4a98-9f0e-f471ea89344c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:23.716740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171821e-d24d-4a98-9f0e-f471ea89344c None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:23.717758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171821e-d24d-4a98-9f0e-f471ea89344c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:23.719230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171821e-d24d-4a98-9f0e-f471ea89344c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:23.746945 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 335/642] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:46:23 2022] POST /identity/v3/services => generated 269 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:46:23.812904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035bc0e-174c-4b1d-91a7-56d3f0c437b2 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:23.817324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171821e-d24d-4a98-9f0e-f471ea89344c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:23.850238 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:23.874726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b1b72-9161-4226-822d-bfab1f030de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:23.875522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b1b72-9161-4226-822d-bfab1f030de9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:23.876341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b1b72-9161-4226-822d-bfab1f030de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:23.877527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b1b72-9161-4226-822d-bfab1f030de9 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:23.878225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b1b72-9161-4226-822d-bfab1f030de9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:23.878526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b1b72-9161-4226-822d-bfab1f030de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:23.879967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b1b72-9161-4226-822d-bfab1f030de9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:23.894257 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 308/643] 10.222.0.39 () {56 vars in 1115 bytes} [Sun Oct 16 00:46:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:23.900693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b1b72-9161-4226-822d-bfab1f030de9 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:23.946669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171821e-d24d-4a98-9f0e-f471ea89344c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:23.949052 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:23.993617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fbc7-772c-44b3-8fa9-d02121ffd854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:23.994251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fbc7-772c-44b3-8fa9-d02121ffd854 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:23.994528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fbc7-772c-44b3-8fa9-d02121ffd854 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:23.994799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fbc7-772c-44b3-8fa9-d02121ffd854 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:23.995523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5fbc7-772c-44b3-8fa9-d02121ffd854 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:23.996995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5fbc7-772c-44b3-8fa9-d02121ffd854 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-1ce5fbc7-772c-44b3-8fa9-d02121ffd854 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:24.007828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:24.008857 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:24.009694 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 336/644] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Oct 16 00:46:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:24.015266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fbc7-772c-44b3-8fa9-d02121ffd854 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:24.036549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b1b72-9161-4226-822d-bfab1f030de9 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:24.073279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6041a42-a73b-4974-bdfb-d1f685cfc5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:24.074066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6041a42-a73b-4974-bdfb-d1f685cfc5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:24.074352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6041a42-a73b-4974-bdfb-d1f685cfc5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:24.075206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6041a42-a73b-4974-bdfb-d1f685cfc5b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:24.087153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6041a42-a73b-4974-bdfb-d1f685cfc5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:24.089001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6041a42-a73b-4974-bdfb-d1f685cfc5b5 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-d6041a42-a73b-4974-bdfb-d1f685cfc5b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:24.104450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:24.105417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:24.106296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:24.106296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:24.106296 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:24.106296 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 309/645] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:24.107466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43a4cf-a98d-45f8-9c65-239176a57fc9 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:24.107466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43a4cf-a98d-45f8-9c65-239176a57fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:24.107466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43a4cf-a98d-45f8-9c65-239176a57fc9 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:24.108638 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 310/646] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:24.113931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43a4cf-a98d-45f8-9c65-239176a57fc9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:24.140062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fbc7-772c-44b3-8fa9-d02121ffd854 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:24.151290 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:24.178674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29209dd-bb74-4965-bf62-0c085f103eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:24.179314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29209dd-bb74-4965-bf62-0c085f103eca None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:24.179590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29209dd-bb74-4965-bf62-0c085f103eca None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:24.179863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29209dd-bb74-4965-bf62-0c085f103eca None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:24.180716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29209dd-bb74-4965-bf62-0c085f103eca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:24.181066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29209dd-bb74-4965-bf62-0c085f103eca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:24.182520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29209dd-bb74-4965-bf62-0c085f103eca None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:24.187429 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 337/647] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Oct 16 00:46:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:24.193318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854e7a3-e603-46ad-a244-f8420f18b388 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:24.193606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854e7a3-e603-46ad-a244-f8420f18b388 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:24.193887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854e7a3-e603-46ad-a244-f8420f18b388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:24.213110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4854e7a3-e603-46ad-a244-f8420f18b388 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:24.214372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4854e7a3-e603-46ad-a244-f8420f18b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:24.227936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43a4cf-a98d-45f8-9c65-239176a57fc9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:24.239439 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:24.271073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738c514-5fa1-4034-b522-fe2ebacb8398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:24.271737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738c514-5fa1-4034-b522-fe2ebacb8398 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:24.272016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738c514-5fa1-4034-b522-fe2ebacb8398 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:24.272795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738c514-5fa1-4034-b522-fe2ebacb8398 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:24.273709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738c514-5fa1-4034-b522-fe2ebacb8398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:24.274023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738c514-5fa1-4034-b522-fe2ebacb8398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:24.275968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738c514-5fa1-4034-b522-fe2ebacb8398 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:24.288377 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 338/648] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:24 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:24.289318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854e7a3-e603-46ad-a244-f8420f18b388 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:24.301618 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 311/649] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:24.303300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738c514-5fa1-4034-b522-fe2ebacb8398 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:24.420347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854e7a3-e603-46ad-a244-f8420f18b388 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:24.429102 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:24.439508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738c514-5fa1-4034-b522-fe2ebacb8398 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:24.461171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de393f-791e-445e-aa1e-9433388b7990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:24.462532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de393f-791e-445e-aa1e-9433388b7990 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:24.463202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de393f-791e-445e-aa1e-9433388b7990 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:24.463760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de393f-791e-445e-aa1e-9433388b7990 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:24.464845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de393f-791e-445e-aa1e-9433388b7990 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:24.465345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de393f-791e-445e-aa1e-9433388b7990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:24.467481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de393f-791e-445e-aa1e-9433388b7990 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:24.474258 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 339/650] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Oct 16 00:46:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:24.482960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdadf6f-d24a-4681-bd56-274a6b60a677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:24.482960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdadf6f-d24a-4681-bd56-274a6b60a677 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:24.482960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdadf6f-d24a-4681-bd56-274a6b60a677 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:24.482960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdadf6f-d24a-4681-bd56-274a6b60a677 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:24.490831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdadf6f-d24a-4681-bd56-274a6b60a677 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:24.492485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdadf6f-d24a-4681-bd56-274a6b60a677 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-2cdadf6f-d24a-4681-bd56-274a6b60a677 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:24.506855 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:24.507903 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:24.509185 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:24.509185 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:24.509185 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:24.509185 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:24.509185 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:24.509185 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:24.509185 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:24.509185 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:24.509185 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:46:24.509185 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:24.509185 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 312/651] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Oct 16 00:46:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:24.515974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de393f-791e-445e-aa1e-9433388b7990 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:24.553155 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:24.558383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdadf6f-d24a-4681-bd56-274a6b60a677 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:24.673566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de393f-791e-445e-aa1e-9433388b7990 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:24.679968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdadf6f-d24a-4681-bd56-274a6b60a677 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:24.719889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96195cbd-4f5d-473b-ac3b-8ea6a00afade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:24.721086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96195cbd-4f5d-473b-ac3b-8ea6a00afade None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:24.722070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96195cbd-4f5d-473b-ac3b-8ea6a00afade None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:24.722564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96195cbd-4f5d-473b-ac3b-8ea6a00afade None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:24.723535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96195cbd-4f5d-473b-ac3b-8ea6a00afade None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:24.724053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96195cbd-4f5d-473b-ac3b-8ea6a00afade None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:24.725519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed451e77-da5f-491c-a094-7d1a23f8793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:24.726613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed451e77-da5f-491c-a094-7d1a23f8793b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:24.726613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed451e77-da5f-491c-a094-7d1a23f8793b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:24.726814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed451e77-da5f-491c-a094-7d1a23f8793b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:24.727779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed451e77-da5f-491c-a094-7d1a23f8793b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:24.728284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96195cbd-4f5d-473b-ac3b-8ea6a00afade None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:24.731401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed451e77-da5f-491c-a094-7d1a23f8793b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-ed451e77-da5f-491c-a094-7d1a23f8793b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:24.758212 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:24.760858 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:24.761795 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 313/653] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:46:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:24.763242 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 340/653] 10.222.0.39 () {56 vars in 1149 bytes} [Sun Oct 16 00:46:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:24.763758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed451e77-da5f-491c-a094-7d1a23f8793b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:24.764871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96195cbd-4f5d-473b-ac3b-8ea6a00afade None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:24.800102 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:24.904133 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:24.929219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed451e77-da5f-491c-a094-7d1a23f8793b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:24.943463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96195cbd-4f5d-473b-ac3b-8ea6a00afade None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:24.987612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edeb057-2232-4879-b5c9-b0ad3800ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:24.988311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edeb057-2232-4879-b5c9-b0ad3800ebc5 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:24.988589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edeb057-2232-4879-b5c9-b0ad3800ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:24.988895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edeb057-2232-4879-b5c9-b0ad3800ebc5 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:24.989556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edeb057-2232-4879-b5c9-b0ad3800ebc5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:24.990090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edeb057-2232-4879-b5c9-b0ad3800ebc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:24.992132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edeb057-2232-4879-b5c9-b0ad3800ebc5 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:24.997792 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 314/654] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:46:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:25.003172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9604df0-4c04-48ef-b69b-b5edaddf38ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:25.003362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edeb057-2232-4879-b5c9-b0ad3800ebc5 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:25.004283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9604df0-4c04-48ef-b69b-b5edaddf38ca None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:25.004764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9604df0-4c04-48ef-b69b-b5edaddf38ca None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:25.005250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9604df0-4c04-48ef-b69b-b5edaddf38ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:25.020798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9604df0-4c04-48ef-b69b-b5edaddf38ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:25.024766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9604df0-4c04-48ef-b69b-b5edaddf38ca None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-d9604df0-4c04-48ef-b69b-b5edaddf38ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:25.055280 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:25.056257 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:25.057133 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:25.057133 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:25.057133 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:25.066578 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 341/655] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:25.069236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9604df0-4c04-48ef-b69b-b5edaddf38ca None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:25.149409 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:25.200997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edeb057-2232-4879-b5c9-b0ad3800ebc5 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:25.209105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9604df0-4c04-48ef-b69b-b5edaddf38ca None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:25.244557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dc558-b28c-48b7-8ef9-978602b807c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:25.245085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dc558-b28c-48b7-8ef9-978602b807c2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:25.245367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dc558-b28c-48b7-8ef9-978602b807c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:25.245646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dc558-b28c-48b7-8ef9-978602b807c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:25.246285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dc558-b28c-48b7-8ef9-978602b807c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:25.246592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dc558-b28c-48b7-8ef9-978602b807c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:25.248577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dc558-b28c-48b7-8ef9-978602b807c2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:25.250397 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:25.269353 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 342/656] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:25.276589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dc558-b28c-48b7-8ef9-978602b807c2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:25.293566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31023cf-d3cd-4684-8f06-045e54f6f878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:25.294180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31023cf-d3cd-4684-8f06-045e54f6f878 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:25.294459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31023cf-d3cd-4684-8f06-045e54f6f878 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:25.294732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31023cf-d3cd-4684-8f06-045e54f6f878 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:25.295385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31023cf-d3cd-4684-8f06-045e54f6f878 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:25.295689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31023cf-d3cd-4684-8f06-045e54f6f878 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:25.297063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31023cf-d3cd-4684-8f06-045e54f6f878 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:25.311477 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 315/657] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:46:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:25.406028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dc558-b28c-48b7-8ef9-978602b807c2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:25.448134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac33d12-0dcd-4206-b392-ad01f1f96351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:25.448776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac33d12-0dcd-4206-b392-ad01f1f96351 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:25.449054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac33d12-0dcd-4206-b392-ad01f1f96351 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:25.449321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac33d12-0dcd-4206-b392-ad01f1f96351 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:25.457351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac33d12-0dcd-4206-b392-ad01f1f96351 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:25.458815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac33d12-0dcd-4206-b392-ad01f1f96351 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-aac33d12-0dcd-4206-b392-ad01f1f96351 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:25.472151 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:25.473288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:25.474703 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:25.474703 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:25.474703 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:25.474703 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:25.474703 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:25.474703 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:25.474703 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:25.474703 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:25.474703 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 343/658] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:25.479360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31023cf-d3cd-4684-8f06-045e54f6f878 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:25.605790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31023cf-d3cd-4684-8f06-045e54f6f878 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:25.641884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536f02a-d141-4da9-9467-6b52122b043b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:25.642789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536f02a-d141-4da9-9467-6b52122b043b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:25.643274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536f02a-d141-4da9-9467-6b52122b043b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:25.643756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536f02a-d141-4da9-9467-6b52122b043b None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:25.644618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536f02a-d141-4da9-9467-6b52122b043b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:25.645105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536f02a-d141-4da9-9467-6b52122b043b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:25.646735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536f02a-d141-4da9-9467-6b52122b043b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:25.661525 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 316/659] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:25.667581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac33d12-0dcd-4206-b392-ad01f1f96351 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:25.727722 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:25.778838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac33d12-0dcd-4206-b392-ad01f1f96351 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:25.814750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7b4b9-59f6-409f-aa7e-8aa6e7aa5caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:25.815354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7b4b9-59f6-409f-aa7e-8aa6e7aa5caf None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:25.815632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7b4b9-59f6-409f-aa7e-8aa6e7aa5caf None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:25.815903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7b4b9-59f6-409f-aa7e-8aa6e7aa5caf None admin] PATH_INFO: `/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/3c8b1dd3162b4d05a253780a140042ff/roles/f04b28f80580457f9482238091b5a522` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:25.818070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7b4b9-59f6-409f-aa7e-8aa6e7aa5caf None admin] RBAC: Authorizing `identity:create_grant(project_id=2efc56617bd54471a648f03215b3bfb1, user_id=3c8b1dd3162b4d05a253780a140042ff, role_id=f04b28f80580457f9482238091b5a522)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:25.819529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7b4b9-59f6-409f-aa7e-8aa6e7aa5caf None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:25.834327 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 344/660] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:46:25 2022] PUT /identity/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/3c8b1dd3162b4d05a253780a140042ff/roles/f04b28f80580457f9482238091b5a522 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:46:26.116768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501185a-4d03-4e5d-a965-a9ceb944a1ac None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:26.116967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501185a-4d03-4e5d-a965-a9ceb944a1ac None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:26.117234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501185a-4d03-4e5d-a965-a9ceb944a1ac None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:26.118745 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 317/661] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:26.124100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8501-b659-4c3e-9204-87e5a88f59a3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:26.124386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8501-b659-4c3e-9204-87e5a88f59a3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:26.124660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8501-b659-4c3e-9204-87e5a88f59a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:26.145115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dc0b8501-b659-4c3e-9204-87e5a88f59a3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:26.146299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dc0b8501-b659-4c3e-9204-87e5a88f59a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:26.217160 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 345/662] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:26 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:26.500265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501185a-4d03-4e5d-a965-a9ceb944a1ac None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:26.510387 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:26.611971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501185a-4d03-4e5d-a965-a9ceb944a1ac None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:26.647633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c75d97-1ee1-42a1-8451-718f346113e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:26.648262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c75d97-1ee1-42a1-8451-718f346113e1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:26.648540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c75d97-1ee1-42a1-8451-718f346113e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:26.648808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c75d97-1ee1-42a1-8451-718f346113e1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:26.649379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c75d97-1ee1-42a1-8451-718f346113e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:26.650738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c75d97-1ee1-42a1-8451-718f346113e1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-29c75d97-1ee1-42a1-8451-718f346113e1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:26.660468 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:26.661408 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:26.662382 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 318/663] 10.222.0.39 () {56 vars in 1132 bytes} [Sun Oct 16 00:46:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:26.667498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b8501-b659-4c3e-9204-87e5a88f59a3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:26.752831 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:26.782639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b8501-b659-4c3e-9204-87e5a88f59a3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:26.817691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baa71f-82de-4b45-8b30-a7afc081c309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:26.818300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baa71f-82de-4b45-8b30-a7afc081c309 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:26.818574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baa71f-82de-4b45-8b30-a7afc081c309 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:26.818839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baa71f-82de-4b45-8b30-a7afc081c309 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:26.819534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47baa71f-82de-4b45-8b30-a7afc081c309 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:26.819838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47baa71f-82de-4b45-8b30-a7afc081c309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:26.821206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47baa71f-82de-4b45-8b30-a7afc081c309 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:26.826296 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 346/664] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Oct 16 00:46:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:26.826486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aced0-9be0-499f-acb5-4bda8ddf2356 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:26.826663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aced0-9be0-499f-acb5-4bda8ddf2356 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:26.826943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aced0-9be0-499f-acb5-4bda8ddf2356 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:26.828605 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 319/665] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:26.832059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baa71f-82de-4b45-8b30-a7afc081c309 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:26.834638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0d507-1f60-4d22-bffb-3c90773138f3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:26.834960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0d507-1f60-4d22-bffb-3c90773138f3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:26.835248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0d507-1f60-4d22-bffb-3c90773138f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:26.856198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-72c0d507-1f60-4d22-bffb-3c90773138f3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:26.857626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-72c0d507-1f60-4d22-bffb-3c90773138f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:26.929870 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:26.942632 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 320/666] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:26 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:26.950150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baa71f-82de-4b45-8b30-a7afc081c309 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:26.960323 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:26.985614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a7a96-11ad-4500-be02-89ca4bb0efe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:26.986214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a7a96-11ad-4500-be02-89ca4bb0efe0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:26.986498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a7a96-11ad-4500-be02-89ca4bb0efe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:26.986757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a7a96-11ad-4500-be02-89ca4bb0efe0 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:26.987424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a7a96-11ad-4500-be02-89ca4bb0efe0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:26.987726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a7a96-11ad-4500-be02-89ca4bb0efe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:26.989097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a7a96-11ad-4500-be02-89ca4bb0efe0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:26.994203 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 347/667] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Oct 16 00:46:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:26.999608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0d507-1f60-4d22-bffb-3c90773138f3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:27.104544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0d507-1f60-4d22-bffb-3c90773138f3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:27.139489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2077711-65e2-4fd1-b64e-29f46d2ceec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:27.140147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2077711-65e2-4fd1-b64e-29f46d2ceec4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:27.140427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2077711-65e2-4fd1-b64e-29f46d2ceec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:27.140698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2077711-65e2-4fd1-b64e-29f46d2ceec4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:27.141491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2077711-65e2-4fd1-b64e-29f46d2ceec4 None admin] RBAC: Adding query filter params (interface=public, service_id=492f3aaf4e584e71998a3be8c5a79c35, region_id=RegionOne) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:27.141798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2077711-65e2-4fd1-b64e-29f46d2ceec4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:27.143187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2077711-65e2-4fd1-b64e-29f46d2ceec4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:27.151362 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 321/668] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Oct 16 00:46:26 2022] GET /identity/v3/endpoints?service_id=492f3aaf4e584e71998a3be8c5a79c35&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:27.160045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a7a96-11ad-4500-be02-89ca4bb0efe0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:27.243847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2077711-65e2-4fd1-b64e-29f46d2ceec4 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:27.265168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a7a96-11ad-4500-be02-89ca4bb0efe0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:27.304102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c780cf4-38bc-400d-8819-13de9d9821d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:27.304697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c780cf4-38bc-400d-8819-13de9d9821d1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:27.304976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c780cf4-38bc-400d-8819-13de9d9821d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:27.305289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c780cf4-38bc-400d-8819-13de9d9821d1 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:27.305877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c780cf4-38bc-400d-8819-13de9d9821d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:27.307343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c780cf4-38bc-400d-8819-13de9d9821d1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:27.319220 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 348/669] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Oct 16 00:46:27 2022] GET /identity/v3/services => generated 1029 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:46:27.329363 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:27.382152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2077711-65e2-4fd1-b64e-29f46d2ceec4 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:27.420923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad6bce-8340-4cef-adc4-58a938c894c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:27.421542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad6bce-8340-4cef-adc4-58a938c894c0 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:27.421819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad6bce-8340-4cef-adc4-58a938c894c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:27.422090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad6bce-8340-4cef-adc4-58a938c894c0 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:27.423067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad6bce-8340-4cef-adc4-58a938c894c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:27.424426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad6bce-8340-4cef-adc4-58a938c894c0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:27.442400 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 322/670] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:46:27 2022] POST /identity/v3/services => generated 241 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:46:27.696481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336ea0a-5e23-4d59-b155-f0556fc7703b None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:27.696675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336ea0a-5e23-4d59-b155-f0556fc7703b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:27.696935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336ea0a-5e23-4d59-b155-f0556fc7703b None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:27.698535 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 349/671] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:27.703941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa4dc8-be83-4fdc-ab26-8a79f1789eeb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:27.704410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa4dc8-be83-4fdc-ab26-8a79f1789eeb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:27.704517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa4dc8-be83-4fdc-ab26-8a79f1789eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:27.723246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7dfa4dc8-be83-4fdc-ab26-8a79f1789eeb None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:27.724435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7dfa4dc8-be83-4fdc-ab26-8a79f1789eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:27.803558 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 323/672] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:27 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:28.082202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336ea0a-5e23-4d59-b155-f0556fc7703b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:28.121915 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:28.188825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad529922-3f73-4432-aac9-930f1c3e0bff None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:28.189160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad529922-3f73-4432-aac9-930f1c3e0bff None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:28.189564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad529922-3f73-4432-aac9-930f1c3e0bff None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:28.191271 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 324/673] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:46:28.196379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9faaa-eaa6-476c-8931-45638dc1bb41 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:28.196664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9faaa-eaa6-476c-8931-45638dc1bb41 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:28.196940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9faaa-eaa6-476c-8931-45638dc1bb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:28.201931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336ea0a-5e23-4d59-b155-f0556fc7703b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:28.216231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-68d9faaa-eaa6-476c-8931-45638dc1bb41 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:28.217472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-68d9faaa-eaa6-476c-8931-45638dc1bb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:28.242899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647ca13-5d1e-4ae2-8576-f51752241030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:28.244030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647ca13-5d1e-4ae2-8576-f51752241030 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:28.244519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647ca13-5d1e-4ae2-8576-f51752241030 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:28.245020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647ca13-5d1e-4ae2-8576-f51752241030 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:28.245909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647ca13-5d1e-4ae2-8576-f51752241030 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:28.247844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647ca13-5d1e-4ae2-8576-f51752241030 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:28.265527 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 350/674] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:46:28 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:28.269778 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:28.310616 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 325/675] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:28.596233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647ca13-5d1e-4ae2-8576-f51752241030 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:28.702288 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:28.709104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647ca13-5d1e-4ae2-8576-f51752241030 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:28.747460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03b8f3-1a8c-4a14-b92b-be9c84ff57ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:28.748094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03b8f3-1a8c-4a14-b92b-be9c84ff57ff None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:28.748371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03b8f3-1a8c-4a14-b92b-be9c84ff57ff None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:28.748642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03b8f3-1a8c-4a14-b92b-be9c84ff57ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:28.760107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03b8f3-1a8c-4a14-b92b-be9c84ff57ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-fd03b8f3-1a8c-4a14-b92b-be9c84ff57ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:28.765765 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:28.767314 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:28.768418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:28.768418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:28.768418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:28.768418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:28.768418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:28.768418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:28.768418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:28.768418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:28.768418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:28.768418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:28.768418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:46:28.768418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:28.768418 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 351/676] 10.222.0.39 () {56 vars in 1120 bytes} [Sun Oct 16 00:46:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:28.775587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9faaa-eaa6-476c-8931-45638dc1bb41 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:28.883946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9faaa-eaa6-476c-8931-45638dc1bb41 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:28.919311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a35ad0-2a0c-4480-9b75-ad7b982f6d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:28.919921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a35ad0-2a0c-4480-9b75-ad7b982f6d30 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:28.920196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a35ad0-2a0c-4480-9b75-ad7b982f6d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:28.920464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a35ad0-2a0c-4480-9b75-ad7b982f6d30 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:28.921118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a35ad0-2a0c-4480-9b75-ad7b982f6d30 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:28.921416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a35ad0-2a0c-4480-9b75-ad7b982f6d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:28.923346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a35ad0-2a0c-4480-9b75-ad7b982f6d30 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:28.931920 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 326/677] 10.222.0.39 () {56 vars in 1115 bytes} [Sun Oct 16 00:46:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:28.937807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03b8f3-1a8c-4a14-b92b-be9c84ff57ff None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:29.040213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03b8f3-1a8c-4a14-b92b-be9c84ff57ff None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:29.075324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25096bf-9f2d-4008-88d0-6b19457b0e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:29.075941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25096bf-9f2d-4008-88d0-6b19457b0e7a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:29.076215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25096bf-9f2d-4008-88d0-6b19457b0e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:29.076480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25096bf-9f2d-4008-88d0-6b19457b0e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:29.087876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25096bf-9f2d-4008-88d0-6b19457b0e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:29.089318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25096bf-9f2d-4008-88d0-6b19457b0e7a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e25096bf-9f2d-4008-88d0-6b19457b0e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:29.103697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:29.104689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:29.105872 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:29.105872 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:29.105872 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:29.105872 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 352/678] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:29.112995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a35ad0-2a0c-4480-9b75-ad7b982f6d30 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:29.155319 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:29.219834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a35ad0-2a0c-4480-9b75-ad7b982f6d30 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:29.261839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc0e92-ddb1-4a77-aa59-38212b36ae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:29.262410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc0e92-ddb1-4a77-aa59-38212b36ae34 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:29.262691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc0e92-ddb1-4a77-aa59-38212b36ae34 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:29.262993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc0e92-ddb1-4a77-aa59-38212b36ae34 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:29.263627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc0e92-ddb1-4a77-aa59-38212b36ae34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:29.263930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc0e92-ddb1-4a77-aa59-38212b36ae34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:29.265281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc0e92-ddb1-4a77-aa59-38212b36ae34 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:29.279001 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 327/679] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:29.285062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25096bf-9f2d-4008-88d0-6b19457b0e7a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:29.298609 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:29.393065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25096bf-9f2d-4008-88d0-6b19457b0e7a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:29.428122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798737-518c-4f52-bf35-c3b2c600c9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:29.428659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798737-518c-4f52-bf35-c3b2c600c9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:29.428929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798737-518c-4f52-bf35-c3b2c600c9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:29.429194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798737-518c-4f52-bf35-c3b2c600c9d6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:29.436612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86798737-518c-4f52-bf35-c3b2c600c9d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:29.438620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86798737-518c-4f52-bf35-c3b2c600c9d6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-86798737-518c-4f52-bf35-c3b2c600c9d6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:29.449983 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:29.450937 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:29.452068 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:29.452068 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:29.452068 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:29.452068 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:29.452068 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:29.452068 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:29.452068 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:29.452068 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:29.452068 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:46:29.452068 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:29.452068 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 353/680] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Oct 16 00:46:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:29.459050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc0e92-ddb1-4a77-aa59-38212b36ae34 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:29.575890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc0e92-ddb1-4a77-aa59-38212b36ae34 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:29.577523 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:29.603033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236d94-578e-4eee-8ab4-1f7dc92414c2 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:29.603312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236d94-578e-4eee-8ab4-1f7dc92414c2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:29.603773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236d94-578e-4eee-8ab4-1f7dc92414c2 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:29.605486 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 354/681] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:29.612516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9222-bedd-4ae5-890a-f030c84c80f4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:29.612971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9222-bedd-4ae5-890a-f030c84c80f4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:29.613086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502661a-cad6-46aa-bbaa-f8bb1568a63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:29.613517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9222-bedd-4ae5-890a-f030c84c80f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:29.613629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502661a-cad6-46aa-bbaa-f8bb1568a63f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:29.613965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502661a-cad6-46aa-bbaa-f8bb1568a63f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:29.614202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502661a-cad6-46aa-bbaa-f8bb1568a63f None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:29.614830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502661a-cad6-46aa-bbaa-f8bb1568a63f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:29.615173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502661a-cad6-46aa-bbaa-f8bb1568a63f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:29.616581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502661a-cad6-46aa-bbaa-f8bb1568a63f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:29.633839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b5fc9222-bedd-4ae5-890a-f030c84c80f4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:29.635418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b5fc9222-bedd-4ae5-890a-f030c84c80f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:29.635659 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 328/682] 10.222.0.39 () {56 vars in 1149 bytes} [Sun Oct 16 00:46:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:29.646691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502661a-cad6-46aa-bbaa-f8bb1568a63f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:29.708264 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:29.717717 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 355/683] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:29.763961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502661a-cad6-46aa-bbaa-f8bb1568a63f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:29.789908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d63c8c-43e6-4055-82cd-42f0293bef6c None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:29.790232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d63c8c-43e6-4055-82cd-42f0293bef6c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:29.790450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d63c8c-43e6-4055-82cd-42f0293bef6c None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:29.792263 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 356/684] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:46:29.800159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ebd97-cbea-4c29-8a25-afbcfe2a9b1d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:29.800636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ebd97-cbea-4c29-8a25-afbcfe2a9b1d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:29.801002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ebd97-cbea-4c29-8a25-afbcfe2a9b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:29.804447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749e2a1-faf4-4fa0-8e0a-bc5e7f0e672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:29.805569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749e2a1-faf4-4fa0-8e0a-bc5e7f0e672d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:29.805995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749e2a1-faf4-4fa0-8e0a-bc5e7f0e672d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:29.806411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749e2a1-faf4-4fa0-8e0a-bc5e7f0e672d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:29.820320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6c1ebd97-cbea-4c29-8a25-afbcfe2a9b1d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:29.821884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c1ebd97-cbea-4c29-8a25-afbcfe2a9b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:29.833429 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:29.878789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749e2a1-faf4-4fa0-8e0a-bc5e7f0e672d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:29.880509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749e2a1-faf4-4fa0-8e0a-bc5e7f0e672d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:29.915831 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 357/685] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:29.984987 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 329/686] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:29 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:46:29.994952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ebd97-cbea-4c29-8a25-afbcfe2a9b1d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:30.005443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749e2a1-faf4-4fa0-8e0a-bc5e7f0e672d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:30.079583 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:30.095619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ebd97-cbea-4c29-8a25-afbcfe2a9b1d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:30.122891 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:30.132114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fac289-fe06-40bc-b43a-2d4fa368f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:30.132775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fac289-fe06-40bc-b43a-2d4fa368f63c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.133053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fac289-fe06-40bc-b43a-2d4fa368f63c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.133321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fac289-fe06-40bc-b43a-2d4fa368f63c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.134262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749e2a1-faf4-4fa0-8e0a-bc5e7f0e672d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:30.144034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fac289-fe06-40bc-b43a-2d4fa368f63c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:30.145484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fac289-fe06-40bc-b43a-2d4fa368f63c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-a5fac289-fe06-40bc-b43a-2d4fa368f63c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:30.161409 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:30.162370 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:30.163289 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:30.163289 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:30.163289 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:30.167324 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 358/687] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:30.168510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fac289-fe06-40bc-b43a-2d4fa368f63c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:30.179815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db0d17-ad99-4d1e-9f28-08a8b2dc1a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:30.180754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db0d17-ad99-4d1e-9f28-08a8b2dc1a07 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.181672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db0d17-ad99-4d1e-9f28-08a8b2dc1a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.182142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db0d17-ad99-4d1e-9f28-08a8b2dc1a07 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.183376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db0d17-ad99-4d1e-9f28-08a8b2dc1a07 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:30.185883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db0d17-ad99-4d1e-9f28-08a8b2dc1a07 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-68db0d17-ad99-4d1e-9f28-08a8b2dc1a07 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:30.199594 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:30.200552 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:46:30.201416 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:30.209388 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 330/688] 10.222.0.39 () {56 vars in 1132 bytes} [Sun Oct 16 00:46:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:30.210650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db0d17-ad99-4d1e-9f28-08a8b2dc1a07 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:30.288169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fac289-fe06-40bc-b43a-2d4fa368f63c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:30.323950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecce09c-0e8e-4af8-b3c6-b01b84a902aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:30.324845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecce09c-0e8e-4af8-b3c6-b01b84a902aa None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.324991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db0d17-ad99-4d1e-9f28-08a8b2dc1a07 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:30.325446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecce09c-0e8e-4af8-b3c6-b01b84a902aa None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.325866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecce09c-0e8e-4af8-b3c6-b01b84a902aa None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.326743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecce09c-0e8e-4af8-b3c6-b01b84a902aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:30.327409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecce09c-0e8e-4af8-b3c6-b01b84a902aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:30.329307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecce09c-0e8e-4af8-b3c6-b01b84a902aa None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:30.348059 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 359/689] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:30.348059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecce09c-0e8e-4af8-b3c6-b01b84a902aa None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:30.351970 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:30.368950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097b1d2-d386-46f3-bafb-4dea67919ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:30.369684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097b1d2-d386-46f3-bafb-4dea67919ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.370084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097b1d2-d386-46f3-bafb-4dea67919ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.370429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097b1d2-d386-46f3-bafb-4dea67919ef1 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.371616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097b1d2-d386-46f3-bafb-4dea67919ef1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:30.371925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097b1d2-d386-46f3-bafb-4dea67919ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:30.373574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097b1d2-d386-46f3-bafb-4dea67919ef1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:30.383794 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 331/690] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Oct 16 00:46:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:30.383794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097b1d2-d386-46f3-bafb-4dea67919ef1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:30.397760 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:30.467160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecce09c-0e8e-4af8-b3c6-b01b84a902aa None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:30.497792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097b1d2-d386-46f3-bafb-4dea67919ef1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:30.508291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85dffc-7bfc-4837-af47-2a48c57e9694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:30.509056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85dffc-7bfc-4837-af47-2a48c57e9694 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.509328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85dffc-7bfc-4837-af47-2a48c57e9694 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.509592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85dffc-7bfc-4837-af47-2a48c57e9694 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.510178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85dffc-7bfc-4837-af47-2a48c57e9694 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:30.511614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85dffc-7bfc-4837-af47-2a48c57e9694 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-9c85dffc-7bfc-4837-af47-2a48c57e9694 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:30.521237 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:30.522288 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:30.523561 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 360/691] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Oct 16 00:46:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:30.524353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85dffc-7bfc-4837-af47-2a48c57e9694 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:30.541166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5a73-11a4-4f39-9b06-e7bdfccb8aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:30.541702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5a73-11a4-4f39-9b06-e7bdfccb8aad None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.542014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5a73-11a4-4f39-9b06-e7bdfccb8aad None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.542244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5a73-11a4-4f39-9b06-e7bdfccb8aad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.554654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea5a73-11a4-4f39-9b06-e7bdfccb8aad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:30.556280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea5a73-11a4-4f39-9b06-e7bdfccb8aad None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-69ea5a73-11a4-4f39-9b06-e7bdfccb8aad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:30.568511 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:30.569580 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:30.570679 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:30.570679 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:30.570679 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:30.570679 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:30.570679 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:30.570679 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:30.570679 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:30.570679 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:30.571792 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 332/692] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:30.577245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5a73-11a4-4f39-9b06-e7bdfccb8aad None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:30.626273 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:30.637032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85dffc-7bfc-4837-af47-2a48c57e9694 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:30.639343 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:30.673407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de758b2-1b89-4a4e-8a52-0d8c870534ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:30.674006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de758b2-1b89-4a4e-8a52-0d8c870534ce None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.674284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de758b2-1b89-4a4e-8a52-0d8c870534ce None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.674553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de758b2-1b89-4a4e-8a52-0d8c870534ce None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.675209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de758b2-1b89-4a4e-8a52-0d8c870534ce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:30.675511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de758b2-1b89-4a4e-8a52-0d8c870534ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:30.676864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de758b2-1b89-4a4e-8a52-0d8c870534ce None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:30.681168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5a73-11a4-4f39-9b06-e7bdfccb8aad None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:30.681494 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 361/693] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Oct 16 00:46:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:30.682261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de758b2-1b89-4a4e-8a52-0d8c870534ce None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:30.714650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35641f-51b3-45c7-af42-fe337bb8ae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:30.715287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35641f-51b3-45c7-af42-fe337bb8ae70 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.715561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35641f-51b3-45c7-af42-fe337bb8ae70 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.715828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35641f-51b3-45c7-af42-fe337bb8ae70 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.716441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35641f-51b3-45c7-af42-fe337bb8ae70 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:30.716742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35641f-51b3-45c7-af42-fe337bb8ae70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:30.718092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35641f-51b3-45c7-af42-fe337bb8ae70 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:30.723359 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 333/694] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Oct 16 00:46:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:30.724481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234283eb-ffc6-4f6a-a019-87d98b8f9b15 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.724760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234283eb-ffc6-4f6a-a019-87d98b8f9b15 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.725027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234283eb-ffc6-4f6a-a019-87d98b8f9b15 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.727079 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 334/695] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:30.727079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234283eb-ffc6-4f6a-a019-87d98b8f9b15 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:30.783969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de758b2-1b89-4a4e-8a52-0d8c870534ce None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:30.816988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525d989-40c3-4c0d-919b-fa82f90f5254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:30.817586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525d989-40c3-4c0d-919b-fa82f90f5254 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.817864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525d989-40c3-4c0d-919b-fa82f90f5254 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.818135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525d989-40c3-4c0d-919b-fa82f90f5254 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.818813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525d989-40c3-4c0d-919b-fa82f90f5254 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:30.819150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525d989-40c3-4c0d-919b-fa82f90f5254 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:30.820564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525d989-40c3-4c0d-919b-fa82f90f5254 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:30.828369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234283eb-ffc6-4f6a-a019-87d98b8f9b15 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:30.832154 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 362/696] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:30.832949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525d989-40c3-4c0d-919b-fa82f90f5254 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:30.837891 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:30.861539 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:30.863709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfe9ac-0e77-4ece-8e20-c5b07482b7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:30.864336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfe9ac-0e77-4ece-8e20-c5b07482b7bd None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.864588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfe9ac-0e77-4ece-8e20-c5b07482b7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.864871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfe9ac-0e77-4ece-8e20-c5b07482b7bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.865512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfe9ac-0e77-4ece-8e20-c5b07482b7bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:30.866874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfe9ac-0e77-4ece-8e20-c5b07482b7bd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:30.885487 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 335/697] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 00:46:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:30.886680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4145536-5cb3-4493-8de5-fc509bf90d56 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.886993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4145536-5cb3-4493-8de5-fc509bf90d56 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.887601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4145536-5cb3-4493-8de5-fc509bf90d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.907438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e4145536-5cb3-4493-8de5-fc509bf90d56 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:30.908736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e4145536-5cb3-4493-8de5-fc509bf90d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:30.944155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525d989-40c3-4c0d-919b-fa82f90f5254 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:30.992339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf0df-1570-4cc1-a944-6522070b3cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:31.003159 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 336/698] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:31.003371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf0df-1570-4cc1-a944-6522070b3cff None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:31.003371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf0df-1570-4cc1-a944-6522070b3cff None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:31.003371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf0df-1570-4cc1-a944-6522070b3cff None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:31.003628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4145536-5cb3-4493-8de5-fc509bf90d56 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:31.003711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cf0df-1570-4cc1-a944-6522070b3cff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:31.003711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cf0df-1570-4cc1-a944-6522070b3cff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:31.003711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cf0df-1570-4cc1-a944-6522070b3cff None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:31.014713 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 363/699] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Oct 16 00:46:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:31.015837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf0df-1570-4cc1-a944-6522070b3cff None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:31.114520 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:31.121889 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:31.130423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4145536-5cb3-4493-8de5-fc509bf90d56 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:31.137942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf0df-1570-4cc1-a944-6522070b3cff None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:31.169937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703017b7-0cb9-4245-8fac-81d8116db2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:31.170710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703017b7-0cb9-4245-8fac-81d8116db2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:31.171140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703017b7-0cb9-4245-8fac-81d8116db2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:31.171515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703017b7-0cb9-4245-8fac-81d8116db2d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:31.172364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703017b7-0cb9-4245-8fac-81d8116db2d3 None admin] RBAC: Adding query filter params (role.id=f04b28f80580457f9482238091b5a522, scope.project.id=2efc56617bd54471a648f03215b3bfb1, user.id=3c8b1dd3162b4d05a253780a140042ff) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:31.173272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703017b7-0cb9-4245-8fac-81d8116db2d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:31.174898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703017b7-0cb9-4245-8fac-81d8116db2d3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:31.179741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7563b3-8050-4250-990d-90f5525788a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:31.180342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7563b3-8050-4250-990d-90f5525788a6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:31.180619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7563b3-8050-4250-990d-90f5525788a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:31.180888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7563b3-8050-4250-990d-90f5525788a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:31.181634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7563b3-8050-4250-990d-90f5525788a6 None admin] RBAC: Adding query filter params (interface=public, service_id=4315b84be62a44998965d02e5cf90ab8, region_id=RegionOne) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:31.181937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7563b3-8050-4250-990d-90f5525788a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:31.182257 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 337/700] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:30 2022] GET /identity/v3/role_assignments?user.id=3c8b1dd3162b4d05a253780a140042ff&scope.project.id=2efc56617bd54471a648f03215b3bfb1&role.id=f04b28f80580457f9482238091b5a522 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:31.183404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7563b3-8050-4250-990d-90f5525788a6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:31.191152 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 364/701] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Oct 16 00:46:31 2022] GET /identity/v3/endpoints?service_id=4315b84be62a44998965d02e5cf90ab8&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:31.199062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703017b7-0cb9-4245-8fac-81d8116db2d3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:31.291993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7563b3-8050-4250-990d-90f5525788a6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:31.325525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703017b7-0cb9-4245-8fac-81d8116db2d3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:31.384732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72b039-04ea-4f68-b057-a45a622aa47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:31.385354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b039-04ea-4f68-b057-a45a622aa47b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:31.385630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b039-04ea-4f68-b057-a45a622aa47b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:31.385899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b039-04ea-4f68-b057-a45a622aa47b None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:31.386511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72b039-04ea-4f68-b057-a45a622aa47b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:31.388301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72b039-04ea-4f68-b057-a45a622aa47b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:31.395975 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 338/702] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Oct 16 00:46:31 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:46:31.432331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7563b3-8050-4250-990d-90f5525788a6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:31.475391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bb087-8f63-497b-b246-54b6df49ee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:31.476033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bb087-8f63-497b-b246-54b6df49ee88 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:31.476309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bb087-8f63-497b-b246-54b6df49ee88 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:31.476578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bb087-8f63-497b-b246-54b6df49ee88 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:31.477161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bb087-8f63-497b-b246-54b6df49ee88 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:31.478555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bb087-8f63-497b-b246-54b6df49ee88 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-226bb087-8f63-497b-b246-54b6df49ee88 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:31.488386 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:31.489487 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:31.490340 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 365/703] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:46:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:31.495713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72b039-04ea-4f68-b057-a45a622aa47b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:31.517141 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:31.617403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72b039-04ea-4f68-b057-a45a622aa47b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:31.654033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72a16c-92ff-4fb2-a278-b8b7219fe7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:31.655153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72a16c-92ff-4fb2-a278-b8b7219fe7db None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:31.655591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72a16c-92ff-4fb2-a278-b8b7219fe7db None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:31.656023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72a16c-92ff-4fb2-a278-b8b7219fe7db None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:31.657369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72a16c-92ff-4fb2-a278-b8b7219fe7db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:31.657820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72a16c-92ff-4fb2-a278-b8b7219fe7db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:31.659356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72a16c-92ff-4fb2-a278-b8b7219fe7db None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:31.664679 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 339/704] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:46:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:31.670444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bb087-8f63-497b-b246-54b6df49ee88 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:31.690666 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:31.776460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bb087-8f63-497b-b246-54b6df49ee88 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:31.811687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb3e8b-1964-4e95-a9ec-72fdef2c54cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:31.812285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb3e8b-1964-4e95-a9ec-72fdef2c54cd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:31.812561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb3e8b-1964-4e95-a9ec-72fdef2c54cd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:31.812830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb3e8b-1964-4e95-a9ec-72fdef2c54cd None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:31.813485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb3e8b-1964-4e95-a9ec-72fdef2c54cd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:31.813969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb3e8b-1964-4e95-a9ec-72fdef2c54cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:31.815370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb3e8b-1964-4e95-a9ec-72fdef2c54cd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:31.820583 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 366/705] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:46:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:31.826665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72a16c-92ff-4fb2-a278-b8b7219fe7db None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:31.920551 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:31.943865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72a16c-92ff-4fb2-a278-b8b7219fe7db None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:31.980084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b01d4-fbd6-4036-8c99-82658d8865c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:31.980699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b01d4-fbd6-4036-8c99-82658d8865c5 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:31.980974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b01d4-fbd6-4036-8c99-82658d8865c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:31.981244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b01d4-fbd6-4036-8c99-82658d8865c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:31.981940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b01d4-fbd6-4036-8c99-82658d8865c5 None admin] RBAC: Adding query filter params (interface=public, service_id=c6cad8a9ddad4f94a6334373b3aa265d, region_id=RegionOne) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:31.982246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b01d4-fbd6-4036-8c99-82658d8865c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:31.983627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b01d4-fbd6-4036-8c99-82658d8865c5 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:31.989437 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 340/706] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Oct 16 00:46:31 2022] GET /identity/v3/endpoints?service_id=c6cad8a9ddad4f94a6334373b3aa265d&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:31.995159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb3e8b-1964-4e95-a9ec-72fdef2c54cd None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:32.081098 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:32.101623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb3e8b-1964-4e95-a9ec-72fdef2c54cd None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:32.137865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3b8b0-f201-47ca-a043-55baa642ab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:32.138526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3b8b0-f201-47ca-a043-55baa642ab89 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:32.138809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3b8b0-f201-47ca-a043-55baa642ab89 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:32.139127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3b8b0-f201-47ca-a043-55baa642ab89 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:32.139770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3b8b0-f201-47ca-a043-55baa642ab89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:32.141327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3b8b0-f201-47ca-a043-55baa642ab89 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:32.155070 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 367/707] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Oct 16 00:46:31 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:46:33.226197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9a209-20bd-45b8-b74c-3577280a0b12 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:33.226720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9a209-20bd-45b8-b74c-3577280a0b12 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:33.226720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9a209-20bd-45b8-b74c-3577280a0b12 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:33.228348 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 341/708] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:33.233468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ff4a9-23b8-4e9f-9e98-95a94ebe05e2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:33.233875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ff4a9-23b8-4e9f-9e98-95a94ebe05e2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:33.234047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ff4a9-23b8-4e9f-9e98-95a94ebe05e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:33.253000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7b3ff4a9-23b8-4e9f-9e98-95a94ebe05e2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:33.254169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7b3ff4a9-23b8-4e9f-9e98-95a94ebe05e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:33.321613 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 368/709] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:33.499980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34251c-529f-401c-b8dc-c622fa5e1a43 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:33.500321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34251c-529f-401c-b8dc-c622fa5e1a43 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:33.500553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34251c-529f-401c-b8dc-c622fa5e1a43 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:33.502249 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 342/710] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:33.507756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef7519-f59b-4f90-91ce-5e581f0475c1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:33.508271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef7519-f59b-4f90-91ce-5e581f0475c1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:33.508813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef7519-f59b-4f90-91ce-5e581f0475c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:33.529708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-79ef7519-f59b-4f90-91ce-5e581f0475c1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:33.530874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79ef7519-f59b-4f90-91ce-5e581f0475c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:33.598448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34251c-529f-401c-b8dc-c622fa5e1a43 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:33.601920 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 369/711] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:33.711873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34251c-529f-401c-b8dc-c622fa5e1a43 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:33.748600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05586ea1-6e78-4e20-bcc6-d12b700884bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:33.749478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05586ea1-6e78-4e20-bcc6-d12b700884bf None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:33.749904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05586ea1-6e78-4e20-bcc6-d12b700884bf None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:33.750367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05586ea1-6e78-4e20-bcc6-d12b700884bf None admin] PATH_INFO: `/v3/services/compute` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:33.751190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05586ea1-6e78-4e20-bcc6-d12b700884bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:33.752680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05586ea1-6e78-4e20-bcc6-d12b700884bf None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-05586ea1-6e78-4e20-bcc6-d12b700884bf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:33.762018 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:33.763242 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:46:33.764268 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:33.766649 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 343/712] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:33.772867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef7519-f59b-4f90-91ce-5e581f0475c1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:33.783265 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:33.796455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61302ea6-f9ae-46a4-86e6-465e454da474 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:33.796742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61302ea6-f9ae-46a4-86e6-465e454da474 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:33.796994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61302ea6-f9ae-46a4-86e6-465e454da474 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:33.798849 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 344/713] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:46:33.805684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84b28-0ff2-46a9-81e9-5e1e35f17bad None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:33.806211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84b28-0ff2-46a9-81e9-5e1e35f17bad None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:33.806843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84b28-0ff2-46a9-81e9-5e1e35f17bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:33.831046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-11c84b28-0ff2-46a9-81e9-5e1e35f17bad None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:33.832934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-11c84b28-0ff2-46a9-81e9-5e1e35f17bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:33.836447 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:33.900030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef7519-f59b-4f90-91ce-5e581f0475c1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:33.919288 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 345/714] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:33.920973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84b28-0ff2-46a9-81e9-5e1e35f17bad None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:33.938532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfd034-ad49-4058-ac8f-548945e0aac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:33.939165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfd034-ad49-4058-ac8f-548945e0aac2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:33.939448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfd034-ad49-4058-ac8f-548945e0aac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:33.939719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfd034-ad49-4058-ac8f-548945e0aac2 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:33.940353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfd034-ad49-4058-ac8f-548945e0aac2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:33.940659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfd034-ad49-4058-ac8f-548945e0aac2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:33.942827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfd034-ad49-4058-ac8f-548945e0aac2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:33.952914 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 370/715] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Oct 16 00:46:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:33.953925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfd034-ad49-4058-ac8f-548945e0aac2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:34.035683 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:34.038801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84b28-0ff2-46a9-81e9-5e1e35f17bad None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:34.075582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d99f40-87b2-4277-898b-48750419f7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:34.076386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d99f40-87b2-4277-898b-48750419f7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:34.076499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfd034-ad49-4058-ac8f-548945e0aac2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:34.076672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d99f40-87b2-4277-898b-48750419f7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:34.077059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d99f40-87b2-4277-898b-48750419f7c7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:34.077748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d99f40-87b2-4277-898b-48750419f7c7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:34.080737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d99f40-87b2-4277-898b-48750419f7c7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-55d99f40-87b2-4277-898b-48750419f7c7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:34.089658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:34.090861 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:46:34.091953 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:34.097601 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 346/716] 10.222.0.39 () {56 vars in 1105 bytes} [Sun Oct 16 00:46:33 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:34.098477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d99f40-87b2-4277-898b-48750419f7c7 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:34.102266 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:34.120202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724a82c-ecd2-41a6-a513-7c1b83bda7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:34.121097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724a82c-ecd2-41a6-a513-7c1b83bda7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:34.121586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724a82c-ecd2-41a6-a513-7c1b83bda7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:34.122063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724a82c-ecd2-41a6-a513-7c1b83bda7f8 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:34.122939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724a82c-ecd2-41a6-a513-7c1b83bda7f8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:34.123447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724a82c-ecd2-41a6-a513-7c1b83bda7f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:34.125069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724a82c-ecd2-41a6-a513-7c1b83bda7f8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:34.130865 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 371/717] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Oct 16 00:46:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:34.192401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724a82c-ecd2-41a6-a513-7c1b83bda7f8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:34.218509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d99f40-87b2-4277-898b-48750419f7c7 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:34.256917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34608e-f6f5-40df-9e68-2d0dd535a571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:34.257582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34608e-f6f5-40df-9e68-2d0dd535a571 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:34.257805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34608e-f6f5-40df-9e68-2d0dd535a571 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:34.258082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34608e-f6f5-40df-9e68-2d0dd535a571 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:34.258717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34608e-f6f5-40df-9e68-2d0dd535a571 None admin] RBAC: Adding query filter params (name=image) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:34.259056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34608e-f6f5-40df-9e68-2d0dd535a571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:34.260446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34608e-f6f5-40df-9e68-2d0dd535a571 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:34.270719 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 347/718] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:34.271853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34608e-f6f5-40df-9e68-2d0dd535a571 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:34.336388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724a82c-ecd2-41a6-a513-7c1b83bda7f8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:34.357115 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:34.384224 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:34.391353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995866d-8df1-44d9-b275-7453d5ba13c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:34.392482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995866d-8df1-44d9-b275-7453d5ba13c0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:34.392988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995866d-8df1-44d9-b275-7453d5ba13c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:34.393608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995866d-8df1-44d9-b275-7453d5ba13c0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:34.395077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995866d-8df1-44d9-b275-7453d5ba13c0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:34.397097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995866d-8df1-44d9-b275-7453d5ba13c0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3995866d-8df1-44d9-b275-7453d5ba13c0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:34.408532 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:34.409670 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:34.410736 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:34.411667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34608e-f6f5-40df-9e68-2d0dd535a571 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:34.413052 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 372/719] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Oct 16 00:46:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:34.414523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0bd2e-5580-4e1a-82a9-55929eb142bd None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:34.414979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0bd2e-5580-4e1a-82a9-55929eb142bd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:34.415404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0bd2e-5580-4e1a-82a9-55929eb142bd None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:34.416907 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 373/720] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:34.424178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0bd2e-5580-4e1a-82a9-55929eb142bd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:34.449895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5e8f0-8d11-487e-8594-603a0c83c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:34.450520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e8f0-8d11-487e-8594-603a0c83c869 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:34.450881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e8f0-8d11-487e-8594-603a0c83c869 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:34.451649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e8f0-8d11-487e-8594-603a0c83c869 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:34.451830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5e8f0-8d11-487e-8594-603a0c83c869 None admin] RBAC: Adding query filter params (type=image) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:34.452096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5e8f0-8d11-487e-8594-603a0c83c869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:34.453691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5e8f0-8d11-487e-8594-603a0c83c869 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:34.458874 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 348/721] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:34.460159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee9a5d-f117-4a72-96be-5574348e32f8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:34.460446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee9a5d-f117-4a72-96be-5574348e32f8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:34.460716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee9a5d-f117-4a72-96be-5574348e32f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:34.489104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2fee9a5d-f117-4a72-96be-5574348e32f8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:34.490416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2fee9a5d-f117-4a72-96be-5574348e32f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:34.574057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0bd2e-5580-4e1a-82a9-55929eb142bd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:34.592055 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 349/722] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:34.623010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bc557-5919-4f57-8771-332c382c5a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:34.624096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bc557-5919-4f57-8771-332c382c5a94 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:34.624569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bc557-5919-4f57-8771-332c382c5a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:34.625063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bc557-5919-4f57-8771-332c382c5a94 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:34.626719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bc557-5919-4f57-8771-332c382c5a94 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:34.627290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bc557-5919-4f57-8771-332c382c5a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:34.628971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bc557-5919-4f57-8771-332c382c5a94 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:34.635283 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 374/723] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Oct 16 00:46:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:34.644568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee9a5d-f117-4a72-96be-5574348e32f8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:34.717380 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:34.757624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee9a5d-f117-4a72-96be-5574348e32f8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:34.792741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2403f84-2684-4133-b307-7dcfa1b35b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:34.793346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2403f84-2684-4133-b307-7dcfa1b35b76 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:34.793621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2403f84-2684-4133-b307-7dcfa1b35b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:34.793894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2403f84-2684-4133-b307-7dcfa1b35b76 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:34.794513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2403f84-2684-4133-b307-7dcfa1b35b76 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:34.794812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2403f84-2684-4133-b307-7dcfa1b35b76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:34.796203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2403f84-2684-4133-b307-7dcfa1b35b76 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:34.806205 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 350/724] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Oct 16 00:46:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:34.807701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bc557-5919-4f57-8771-332c382c5a94 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:34.870699 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:34.885806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2403f84-2684-4133-b307-7dcfa1b35b76 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:34.919683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bc557-5919-4f57-8771-332c382c5a94 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:34.967437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db877a85-44b5-4110-9bc2-44b21bfd69bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:34.968040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db877a85-44b5-4110-9bc2-44b21bfd69bf None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:34.968315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db877a85-44b5-4110-9bc2-44b21bfd69bf None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:34.968683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db877a85-44b5-4110-9bc2-44b21bfd69bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:34.969391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db877a85-44b5-4110-9bc2-44b21bfd69bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:34.971502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db877a85-44b5-4110-9bc2-44b21bfd69bf None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:34.999691 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 375/725] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 00:46:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:46:35.029815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2403f84-2684-4133-b307-7dcfa1b35b76 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:35.062176 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:35.080434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c40240-05fa-452a-8a27-0ada41c759f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:35.081093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c40240-05fa-452a-8a27-0ada41c759f5 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:35.081378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c40240-05fa-452a-8a27-0ada41c759f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:35.081695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c40240-05fa-452a-8a27-0ada41c759f5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:35.082288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c40240-05fa-452a-8a27-0ada41c759f5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:35.083724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c40240-05fa-452a-8a27-0ada41c759f5 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-11c40240-05fa-452a-8a27-0ada41c759f5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:35.093604 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:35.095473 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:35.096422 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 351/726] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:46:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:35.106896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db877a85-44b5-4110-9bc2-44b21bfd69bf None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:35.218599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db877a85-44b5-4110-9bc2-44b21bfd69bf None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:35.236407 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:35.257027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115da4e-a8dc-43df-9889-360b7119fe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:35.257636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115da4e-a8dc-43df-9889-360b7119fe3c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:35.257915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115da4e-a8dc-43df-9889-360b7119fe3c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:35.258189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115da4e-a8dc-43df-9889-360b7119fe3c None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:35.258817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115da4e-a8dc-43df-9889-360b7119fe3c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:35.259149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115da4e-a8dc-43df-9889-360b7119fe3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:35.260508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115da4e-a8dc-43df-9889-360b7119fe3c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:35.265675 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 376/727] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:46:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:35.272395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c40240-05fa-452a-8a27-0ada41c759f5 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:35.374825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c40240-05fa-452a-8a27-0ada41c759f5 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:35.411385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f0e84-0c06-4bb7-8a4c-15430bd6517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:35.412400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f0e84-0c06-4bb7-8a4c-15430bd6517c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:35.412956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f0e84-0c06-4bb7-8a4c-15430bd6517c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:35.413432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f0e84-0c06-4bb7-8a4c-15430bd6517c None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:35.414255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f0e84-0c06-4bb7-8a4c-15430bd6517c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:35.414759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f0e84-0c06-4bb7-8a4c-15430bd6517c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:35.416406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f0e84-0c06-4bb7-8a4c-15430bd6517c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:35.421961 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 352/728] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Oct 16 00:46:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:35.428022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115da4e-a8dc-43df-9889-360b7119fe3c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:35.538880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115da4e-a8dc-43df-9889-360b7119fe3c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:35.576470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d8dcd-a3d1-4d22-aa51-55db446a30e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:35.577358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d8dcd-a3d1-4d22-aa51-55db446a30e1 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:35.577783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d8dcd-a3d1-4d22-aa51-55db446a30e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:35.578199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d8dcd-a3d1-4d22-aa51-55db446a30e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:35.579669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d8dcd-a3d1-4d22-aa51-55db446a30e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:35.581352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d8dcd-a3d1-4d22-aa51-55db446a30e1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:35.604238 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 377/729] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 00:46:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:36.430492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcdb22-3b50-4886-860c-94da6295d97e None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:36.431044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcdb22-3b50-4886-860c-94da6295d97e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:36.431044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcdb22-3b50-4886-860c-94da6295d97e None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:36.432652 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 353/730] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:36.437961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662b67-40a6-4e16-8e3a-0b870a662871 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:36.438382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662b67-40a6-4e16-8e3a-0b870a662871 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:36.438555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662b67-40a6-4e16-8e3a-0b870a662871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:36.458290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b2662b67-40a6-4e16-8e3a-0b870a662871 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:36.459504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b2662b67-40a6-4e16-8e3a-0b870a662871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:36.491682 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:36.543871 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 378/731] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:36.785022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822d1b8-184b-4800-9688-9e2658dea12c None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:36.785693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822d1b8-184b-4800-9688-9e2658dea12c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:36.786200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822d1b8-184b-4800-9688-9e2658dea12c None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:36.788022 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 354/732] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:36.793477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17429cbb-91ba-4a67-bb5e-920ce9503cc2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:36.793766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17429cbb-91ba-4a67-bb5e-920ce9503cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:36.794045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17429cbb-91ba-4a67-bb5e-920ce9503cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:36.813044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-17429cbb-91ba-4a67-bb5e-920ce9503cc2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:36.814209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-17429cbb-91ba-4a67-bb5e-920ce9503cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:36.818509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822d1b8-184b-4800-9688-9e2658dea12c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:36.876207 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:36.899699 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 379/733] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:36.936549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822d1b8-184b-4800-9688-9e2658dea12c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:36.972478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e7a29-7f1f-4fc7-9dfd-43af0f742fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:36.973083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e7a29-7f1f-4fc7-9dfd-43af0f742fa3 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:36.973357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e7a29-7f1f-4fc7-9dfd-43af0f742fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:36.973684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e7a29-7f1f-4fc7-9dfd-43af0f742fa3 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:36.974339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e7a29-7f1f-4fc7-9dfd-43af0f742fa3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:36.975792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e7a29-7f1f-4fc7-9dfd-43af0f742fa3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:36.992889 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 355/734] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:46:36 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:46:37.181095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17429cbb-91ba-4a67-bb5e-920ce9503cc2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:37.282642 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:37.293277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17429cbb-91ba-4a67-bb5e-920ce9503cc2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:37.307795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447da2a-ffc5-45f4-bafa-831cc749b2e9 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:37.308082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447da2a-ffc5-45f4-bafa-831cc749b2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:37.308361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447da2a-ffc5-45f4-bafa-831cc749b2e9 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:37.311004 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 356/735] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:46:37.315950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d944d9-21d5-43f1-95cd-423534fb9562 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:37.316232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d944d9-21d5-43f1-95cd-423534fb9562 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:37.316497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d944d9-21d5-43f1-95cd-423534fb9562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:37.335466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-26d944d9-21d5-43f1-95cd-423534fb9562 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:37.337611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-26d944d9-21d5-43f1-95cd-423534fb9562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:37.338116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd45c60-c8e8-4bab-b457-3a1c7ec9efdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:37.338892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd45c60-c8e8-4bab-b457-3a1c7ec9efdf None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:37.339369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd45c60-c8e8-4bab-b457-3a1c7ec9efdf None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:37.339800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd45c60-c8e8-4bab-b457-3a1c7ec9efdf None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:37.340601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd45c60-c8e8-4bab-b457-3a1c7ec9efdf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:37.341957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd45c60-c8e8-4bab-b457-3a1c7ec9efdf None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:37.358863 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 380/736] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:46:37 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:37.429039 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 357/737] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:37 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:37.708229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd45c60-c8e8-4bab-b457-3a1c7ec9efdf None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:37.819141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd45c60-c8e8-4bab-b457-3a1c7ec9efdf None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:37.855471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654a97b-8c16-4f43-a0b5-65ad6790e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:37.856154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654a97b-8c16-4f43-a0b5-65ad6790e852 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:37.856433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654a97b-8c16-4f43-a0b5-65ad6790e852 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:37.856700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654a97b-8c16-4f43-a0b5-65ad6790e852 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:37.857281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654a97b-8c16-4f43-a0b5-65ad6790e852 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:37.858632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654a97b-8c16-4f43-a0b5-65ad6790e852 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-5654a97b-8c16-4f43-a0b5-65ad6790e852 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:37.867830 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:37.868836 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:37.869686 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:37.873317 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 381/738] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Oct 16 00:46:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:37.875567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d944d9-21d5-43f1-95cd-423534fb9562 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:37.911654 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:37.921518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894742-cadf-4762-b8df-9320a0c392ec None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:37.921847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894742-cadf-4762-b8df-9320a0c392ec None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:37.922124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894742-cadf-4762-b8df-9320a0c392ec None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:37.923658 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 382/739] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:37.928581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c23447-e7dc-4c07-84b5-d906f9d820f7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:37.928866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c23447-e7dc-4c07-84b5-d906f9d820f7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:37.929160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c23447-e7dc-4c07-84b5-d906f9d820f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:37.948113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-07c23447-e7dc-4c07-84b5-d906f9d820f7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:37.949420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-07c23447-e7dc-4c07-84b5-d906f9d820f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:37.958107 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:37.989038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d944d9-21d5-43f1-95cd-423534fb9562 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:38.028945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7287b4-6272-43b5-a159-6fcfd0f83d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:38.030179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7287b4-6272-43b5-a159-6fcfd0f83d67 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:38.030686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7287b4-6272-43b5-a159-6fcfd0f83d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:38.031199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7287b4-6272-43b5-a159-6fcfd0f83d67 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:38.032231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7287b4-6272-43b5-a159-6fcfd0f83d67 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:38.032908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7287b4-6272-43b5-a159-6fcfd0f83d67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:38.034495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7287b4-6272-43b5-a159-6fcfd0f83d67 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:38.034678 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 383/740] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:37 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:38.040528 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 358/741] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Oct 16 00:46:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:38.048736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c23447-e7dc-4c07-84b5-d906f9d820f7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:38.149302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c23447-e7dc-4c07-84b5-d906f9d820f7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:38.189604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1bf69-1425-4df9-a57e-767040cac4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:38.190328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1bf69-1425-4df9-a57e-767040cac4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:38.190608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1bf69-1425-4df9-a57e-767040cac4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:38.190882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1bf69-1425-4df9-a57e-767040cac4d2 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:38.191551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1bf69-1425-4df9-a57e-767040cac4d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:38.191858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1bf69-1425-4df9-a57e-767040cac4d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:38.193219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1bf69-1425-4df9-a57e-767040cac4d2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:38.198511 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 384/742] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Oct 16 00:46:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:38.204446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7287b4-6272-43b5-a159-6fcfd0f83d67 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:38.305394 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:38.307912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7287b4-6272-43b5-a159-6fcfd0f83d67 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:38.334185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1bf69-1425-4df9-a57e-767040cac4d2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:38.346572 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:38.358965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac3aa0-e9c4-4f75-8d69-0c82fa70fc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:38.358965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac3aa0-e9c4-4f75-8d69-0c82fa70fc53 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:38.358965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac3aa0-e9c4-4f75-8d69-0c82fa70fc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:38.358965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac3aa0-e9c4-4f75-8d69-0c82fa70fc53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:38.359408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac3aa0-e9c4-4f75-8d69-0c82fa70fc53 None admin] RBAC: Adding query filter params (interface=admin, service_id=4315b84be62a44998965d02e5cf90ab8, region_id=RegionOne) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:38.359408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac3aa0-e9c4-4f75-8d69-0c82fa70fc53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:38.360730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac3aa0-e9c4-4f75-8d69-0c82fa70fc53 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:38.366709 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 359/743] 10.222.0.39 () {56 vars in 1249 bytes} [Sun Oct 16 00:46:38 2022] GET /identity/v3/endpoints?service_id=4315b84be62a44998965d02e5cf90ab8&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:38.372304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac3aa0-e9c4-4f75-8d69-0c82fa70fc53 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:38.458506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1bf69-1425-4df9-a57e-767040cac4d2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:38.495358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac3aa0-e9c4-4f75-8d69-0c82fa70fc53 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:38.497814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556c994-ae22-4160-a47d-17c518b5fd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:38.498900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556c994-ae22-4160-a47d-17c518b5fd75 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:38.498900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556c994-ae22-4160-a47d-17c518b5fd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:38.499181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556c994-ae22-4160-a47d-17c518b5fd75 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:38.499764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556c994-ae22-4160-a47d-17c518b5fd75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:38.501725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556c994-ae22-4160-a47d-17c518b5fd75 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:38.504369 n-d-master-1 devstack@keystone.service[81804]: WARNING keystone.server.flask.common [None req-f556c994-ae22-4160-a47d-17c518b5fd75 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 16 00:46:38.524579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.sql.core [None req-f556c994-ae22-4160-a47d-17c518b5fd75 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 16 00:46:38.524579 n-d-master-1 devstack@keystone.service[81804]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:46:38.524579 n-d-master-1 devstack@keystone.service[81804]: [parameters: {'id': '2c0e4f0b73ef4db78275171a106eb9e3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 16 00:46:38.524579 n-d-master-1 devstack@keystone.service[81804]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81804) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:46:38.533567 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f556c994-ae22-4160-a47d-17c518b5fd75 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c0e4f0b73ef4db78275171a106eb9e3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c0e4f0b73ef4db78275171a106eb9e3. Oct 16 00:46:38.533567 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:38.533567 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:46:38.533567 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:46:38.533567 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:46:38.533567 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:46:38.533567 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:46:38.533567 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:46:38.533567 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:46:38.533567 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:46:38.533567 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:46:38.533567 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:46:38.533567 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application result.read() Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 16 00:46:38.534384 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application yield resource Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise self.value Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application session.commit() Oct 16 00:46:38.535417 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:46:38.536817 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:46:38.537718 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application result.read() Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:46:38.539369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [parameters: {'id': '2c0e4f0b73ef4db78275171a106eb9e3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:38.541892 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:38.543818 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:38.546022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:38.546022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 16 00:46:38.546022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 16 00:46:38.546022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:38.546022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:38.546022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 16 00:46:38.546022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 16 00:46:38.546022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c0e4f0b73ef4db78275171a106eb9e3. Oct 16 00:46:38.546022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:38.546022 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 385/744] 10.222.0.39 () {60 vars in 1140 bytes} [Sun Oct 16 00:46:38 2022] POST /identity/v3/projects => generated 262 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:38.546022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556c994-ae22-4160-a47d-17c518b5fd75 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:38.553019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012f2ae-80af-4038-a825-ebf570be84cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:38.553879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012f2ae-80af-4038-a825-ebf570be84cb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:38.554432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012f2ae-80af-4038-a825-ebf570be84cb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:38.554897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012f2ae-80af-4038-a825-ebf570be84cb None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:38.555826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012f2ae-80af-4038-a825-ebf570be84cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:38.557462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012f2ae-80af-4038-a825-ebf570be84cb None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:38.575196 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 360/745] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Oct 16 00:46:38 2022] GET /identity/v3/services => generated 1957 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:46:38.612983 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:38.658426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556c994-ae22-4160-a47d-17c518b5fd75 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:38.696749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5145c-5862-4272-9b22-f22b80cd7bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:38.697401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5145c-5862-4272-9b22-f22b80cd7bda None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:38.697682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5145c-5862-4272-9b22-f22b80cd7bda None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:38.697953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5145c-5862-4272-9b22-f22b80cd7bda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:38.706486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5145c-5862-4272-9b22-f22b80cd7bda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:38.708273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5145c-5862-4272-9b22-f22b80cd7bda None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-a5e5145c-5862-4272-9b22-f22b80cd7bda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:38.721573 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:38.722490 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:38.724020 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:38.724020 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:38.724020 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:38.724020 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:38.724020 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:38.724020 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:38.724020 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:38.724020 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:38.727060 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 386/746] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:38.729018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012f2ae-80af-4038-a825-ebf570be84cb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:38.761308 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:38.841229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012f2ae-80af-4038-a825-ebf570be84cb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:38.878130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae9da1-5032-423d-ac7e-ea7e9f5d0398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:38.879650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae9da1-5032-423d-ac7e-ea7e9f5d0398 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:38.879938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae9da1-5032-423d-ac7e-ea7e9f5d0398 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:38.880213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae9da1-5032-423d-ac7e-ea7e9f5d0398 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:38.880876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae9da1-5032-423d-ac7e-ea7e9f5d0398 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:38.881180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae9da1-5032-423d-ac7e-ea7e9f5d0398 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:38.882613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae9da1-5032-423d-ac7e-ea7e9f5d0398 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:38.900802 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 361/747] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Oct 16 00:46:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:39.366598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf340f4-c757-488b-8363-f7fc00bc6eb6 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:39.367313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf340f4-c757-488b-8363-f7fc00bc6eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:39.367810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf340f4-c757-488b-8363-f7fc00bc6eb6 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:39.372421 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 387/748] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:39.378362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e316e26-57bf-4a51-bcb7-6d49ec74f4c3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:39.378951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e316e26-57bf-4a51-bcb7-6d49ec74f4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:39.379424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e316e26-57bf-4a51-bcb7-6d49ec74f4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:39.399576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0e316e26-57bf-4a51-bcb7-6d49ec74f4c3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:39.401083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0e316e26-57bf-4a51-bcb7-6d49ec74f4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:39.592142 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 362/749] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:39 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:39.666271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c924e6-2cbd-4199-93d5-4b5530f5822c None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:39.666554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c924e6-2cbd-4199-93d5-4b5530f5822c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:39.666736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c924e6-2cbd-4199-93d5-4b5530f5822c None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:39.668361 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 388/750] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:39.674679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc496e-5b32-41db-895d-2ce0b10b44e5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:39.675002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc496e-5b32-41db-895d-2ce0b10b44e5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:39.675276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc496e-5b32-41db-895d-2ce0b10b44e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:39.693605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dbfc496e-5b32-41db-895d-2ce0b10b44e5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:39.694787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dbfc496e-5b32-41db-895d-2ce0b10b44e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:39.708652 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:39.764271 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 363/751] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:39 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:39.876838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c924e6-2cbd-4199-93d5-4b5530f5822c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:39.982774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c924e6-2cbd-4199-93d5-4b5530f5822c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:40.006300 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:40.017905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a68d94-0f9b-49f1-bd7e-4a3b59acd4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:40.018520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a68d94-0f9b-49f1-bd7e-4a3b59acd4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:40.018844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a68d94-0f9b-49f1-bd7e-4a3b59acd4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:40.019141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a68d94-0f9b-49f1-bd7e-4a3b59acd4d5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:40.019753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a68d94-0f9b-49f1-bd7e-4a3b59acd4d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:40.021103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a68d94-0f9b-49f1-bd7e-4a3b59acd4d5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-89a68d94-0f9b-49f1-bd7e-4a3b59acd4d5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:40.030136 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:40.031351 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:40.032235 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 389/752] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:40.037573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc496e-5b32-41db-895d-2ce0b10b44e5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:40.046895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a68d94-0f9b-49f1-bd7e-4a3b59acd4d5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:40.151104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc496e-5b32-41db-895d-2ce0b10b44e5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:40.155809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a68d94-0f9b-49f1-bd7e-4a3b59acd4d5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:40.187735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2de84-c08e-4a81-8d01-3b7da7392723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:40.188918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2de84-c08e-4a81-8d01-3b7da7392723 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:40.189321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2de84-c08e-4a81-8d01-3b7da7392723 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:40.189591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2de84-c08e-4a81-8d01-3b7da7392723 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:40.190223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2de84-c08e-4a81-8d01-3b7da7392723 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:40.190529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2de84-c08e-4a81-8d01-3b7da7392723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:40.191922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2de84-c08e-4a81-8d01-3b7da7392723 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:40.196991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994ac38-496f-458b-af02-31cb7a80e3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:40.197212 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 364/753] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Oct 16 00:46:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:40.197621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994ac38-496f-458b-af02-31cb7a80e3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:40.197904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994ac38-496f-458b-af02-31cb7a80e3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:40.198156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994ac38-496f-458b-af02-31cb7a80e3e8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:40.198730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994ac38-496f-458b-af02-31cb7a80e3e8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:40.205477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994ac38-496f-458b-af02-31cb7a80e3e8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:40.205622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2de84-c08e-4a81-8d01-3b7da7392723 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3994ac38-496f-458b-af02-31cb7a80e3e8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:40.209445 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:40.210434 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:46:40.211327 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:40.215486 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 390/754] 10.222.0.39 () {56 vars in 1105 bytes} [Sun Oct 16 00:46:40 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:40.216423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994ac38-496f-458b-af02-31cb7a80e3e8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:40.230457 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:40.273072 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:40.321183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2de84-c08e-4a81-8d01-3b7da7392723 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:40.339668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994ac38-496f-458b-af02-31cb7a80e3e8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:40.357988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b402b7-ecef-4f92-92a7-4522e7d6eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:40.358596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b402b7-ecef-4f92-92a7-4522e7d6eac4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:40.358873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b402b7-ecef-4f92-92a7-4522e7d6eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:40.359188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b402b7-ecef-4f92-92a7-4522e7d6eac4 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:40.360423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b402b7-ecef-4f92-92a7-4522e7d6eac4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:40.360727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b402b7-ecef-4f92-92a7-4522e7d6eac4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:40.362175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b402b7-ecef-4f92-92a7-4522e7d6eac4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:40.372608 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 365/755] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Oct 16 00:46:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:40.373881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b402b7-ecef-4f92-92a7-4522e7d6eac4 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:40.380334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d018dd6-7942-4b74-bc3b-78b167ba4421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:40.381136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d018dd6-7942-4b74-bc3b-78b167ba4421 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:40.381579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d018dd6-7942-4b74-bc3b-78b167ba4421 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:40.381993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d018dd6-7942-4b74-bc3b-78b167ba4421 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:40.382763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d018dd6-7942-4b74-bc3b-78b167ba4421 None admin] RBAC: Adding query filter params (name=image) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:40.383233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d018dd6-7942-4b74-bc3b-78b167ba4421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:40.384786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d018dd6-7942-4b74-bc3b-78b167ba4421 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:40.391031 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 391/756] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:40.400081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d018dd6-7942-4b74-bc3b-78b167ba4421 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:40.472465 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:40.507882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b402b7-ecef-4f92-92a7-4522e7d6eac4 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:40.511386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d018dd6-7942-4b74-bc3b-78b167ba4421 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:40.527055 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:40.556454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cb2ca-1f84-4303-b5c1-ad63bcdaca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:40.557386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cb2ca-1f84-4303-b5c1-ad63bcdaca53 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:40.557875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cb2ca-1f84-4303-b5c1-ad63bcdaca53 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:40.558430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cb2ca-1f84-4303-b5c1-ad63bcdaca53 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:40.559298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cb2ca-1f84-4303-b5c1-ad63bcdaca53 None admin] RBAC: Adding query filter params (type=image) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:40.559814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cb2ca-1f84-4303-b5c1-ad63bcdaca53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:40.561914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cb2ca-1f84-4303-b5c1-ad63bcdaca53 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:40.564843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6608f-3965-4711-85e8-5bed82953846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:40.565887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6608f-3965-4711-85e8-5bed82953846 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:40.566231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6608f-3965-4711-85e8-5bed82953846 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:40.566588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6608f-3965-4711-85e8-5bed82953846 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:40.567632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6608f-3965-4711-85e8-5bed82953846 None admin] RBAC: Adding query filter params (interface=public, service_id=a50833f163894c40b7e917e47c95eb16, region_id=RegionOne) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:40.568005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6608f-3965-4711-85e8-5bed82953846 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:40.573750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6608f-3965-4711-85e8-5bed82953846 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:40.574238 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 392/757] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:40.575492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cb2ca-1f84-4303-b5c1-ad63bcdaca53 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:40.580431 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 366/758] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Oct 16 00:46:40 2022] GET /identity/v3/endpoints?service_id=a50833f163894c40b7e917e47c95eb16&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:40.581561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6608f-3965-4711-85e8-5bed82953846 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:40.690522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cb2ca-1f84-4303-b5c1-ad63bcdaca53 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:40.694855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6608f-3965-4711-85e8-5bed82953846 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:40.735106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e512b7-cb59-4a1e-b915-51b51e674abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:40.735720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e512b7-cb59-4a1e-b915-51b51e674abb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:40.736047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e512b7-cb59-4a1e-b915-51b51e674abb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:40.736295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890a85d-7f47-4040-8bb2-fc6bda796212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:40.736425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e512b7-cb59-4a1e-b915-51b51e674abb None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:40.736902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e512b7-cb59-4a1e-b915-51b51e674abb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:40.737409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890a85d-7f47-4040-8bb2-fc6bda796212 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:40.737892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890a85d-7f47-4040-8bb2-fc6bda796212 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:40.738265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e512b7-cb59-4a1e-b915-51b51e674abb None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:40.738557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890a85d-7f47-4040-8bb2-fc6bda796212 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:40.739465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890a85d-7f47-4040-8bb2-fc6bda796212 None admin] RBAC: Adding query filter params (interface=public, service_id=bc1ba11bf4604e2abf47e7f24f35430b, region_id=RegionOne) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:40.740012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890a85d-7f47-4040-8bb2-fc6bda796212 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:40.741559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890a85d-7f47-4040-8bb2-fc6bda796212 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:40.747281 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 393/759] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Oct 16 00:46:40 2022] GET /identity/v3/endpoints?service_id=bc1ba11bf4604e2abf47e7f24f35430b&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:40.752451 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 367/760] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Oct 16 00:46:40 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:46:40.753860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890a85d-7f47-4040-8bb2-fc6bda796212 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:40.814690 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:40.882237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890a85d-7f47-4040-8bb2-fc6bda796212 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:40.888364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8e33b-8cef-4770-9f80-874fc1576c09 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:40.888677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8e33b-8cef-4770-9f80-874fc1576c09 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:40.888911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8e33b-8cef-4770-9f80-874fc1576c09 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:40.890419 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 368/761] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:46:40.896432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fc521-5c3b-4aad-9cc2-0dea4655d22d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:40.896751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fc521-5c3b-4aad-9cc2-0dea4655d22d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:40.896971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fc521-5c3b-4aad-9cc2-0dea4655d22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:40.912334 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:40.917904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fa6fc521-5c3b-4aad-9cc2-0dea4655d22d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:40.919262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fa6fc521-5c3b-4aad-9cc2-0dea4655d22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:40.929028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1512e2f-cb60-4621-bd30-5dc10d9e31df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:40.929714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1512e2f-cb60-4621-bd30-5dc10d9e31df None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:40.930039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1512e2f-cb60-4621-bd30-5dc10d9e31df None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:40.930316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1512e2f-cb60-4621-bd30-5dc10d9e31df None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:40.930951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1512e2f-cb60-4621-bd30-5dc10d9e31df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:40.932388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1512e2f-cb60-4621-bd30-5dc10d9e31df None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:40.943858 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 394/762] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Oct 16 00:46:40 2022] GET /identity/v3/services => generated 1957 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:46:41.007556 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 369/763] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:40 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:41.257016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d51b8-0233-473a-a650-dcca25c7ee04 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:41.257384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d51b8-0233-473a-a650-dcca25c7ee04 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:41.257490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d51b8-0233-473a-a650-dcca25c7ee04 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:41.258971 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 395/764] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:41.264363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf062e-b457-40e7-a0f7-8077763b8d14 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:41.264825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf062e-b457-40e7-a0f7-8077763b8d14 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:41.264905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf062e-b457-40e7-a0f7-8077763b8d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:41.281383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d51b8-0233-473a-a650-dcca25c7ee04 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:41.284991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-81bf062e-b457-40e7-a0f7-8077763b8d14 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:41.286166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-81bf062e-b457-40e7-a0f7-8077763b8d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:41.357690 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 370/765] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:41 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:41.394764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d51b8-0233-473a-a650-dcca25c7ee04 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:41.401943 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:41.431094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdea1a-0872-42bd-9d63-9380a7cc3376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:41.431721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdea1a-0872-42bd-9d63-9380a7cc3376 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:41.431998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdea1a-0872-42bd-9d63-9380a7cc3376 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:41.432267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdea1a-0872-42bd-9d63-9380a7cc3376 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:41.432845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdea1a-0872-42bd-9d63-9380a7cc3376 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:41.434208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdea1a-0872-42bd-9d63-9380a7cc3376 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f8fdea1a-0872-42bd-9d63-9380a7cc3376 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:41.443657 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:41.444651 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:41.445493 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 396/766] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Oct 16 00:46:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:41.450970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf062e-b457-40e7-a0f7-8077763b8d14 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:41.520208 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:41.561021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf062e-b457-40e7-a0f7-8077763b8d14 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:41.596182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d11ea1-facc-4bcd-8e90-1f22550968e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:41.596797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11ea1-facc-4bcd-8e90-1f22550968e5 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:41.597071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11ea1-facc-4bcd-8e90-1f22550968e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:41.597342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11ea1-facc-4bcd-8e90-1f22550968e5 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:41.597968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d11ea1-facc-4bcd-8e90-1f22550968e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:41.598268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d11ea1-facc-4bcd-8e90-1f22550968e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:41.599729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d11ea1-facc-4bcd-8e90-1f22550968e5 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:41.605209 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 371/767] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Oct 16 00:46:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:41.611067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdea1a-0872-42bd-9d63-9380a7cc3376 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:41.642229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d11ea1-facc-4bcd-8e90-1f22550968e5 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:41.721904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdea1a-0872-42bd-9d63-9380a7cc3376 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:41.749409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d11ea1-facc-4bcd-8e90-1f22550968e5 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:41.763043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba718d8-9e0b-4ec0-bd63-240abc84ff64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:41.763678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba718d8-9e0b-4ec0-bd63-240abc84ff64 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:41.763960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba718d8-9e0b-4ec0-bd63-240abc84ff64 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:41.764232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba718d8-9e0b-4ec0-bd63-240abc84ff64 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:41.764886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba718d8-9e0b-4ec0-bd63-240abc84ff64 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:41.765191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba718d8-9e0b-4ec0-bd63-240abc84ff64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:41.767181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba718d8-9e0b-4ec0-bd63-240abc84ff64 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:41.778889 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 397/768] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Oct 16 00:46:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:41.780044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba718d8-9e0b-4ec0-bd63-240abc84ff64 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:41.794331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfd537-83cb-4b07-916b-f62e54496f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:41.795360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfd537-83cb-4b07-916b-f62e54496f7a None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:41.795903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfd537-83cb-4b07-916b-f62e54496f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:41.796371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfd537-83cb-4b07-916b-f62e54496f7a None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:41.797917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfd537-83cb-4b07-916b-f62e54496f7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:41.799685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfd537-83cb-4b07-916b-f62e54496f7a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:41.802679 n-d-master-1 devstack@keystone.service[81805]: WARNING keystone.server.flask.common [None req-5bbfd537-83cb-4b07-916b-f62e54496f7a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 16 00:46:41.807399 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:41.816725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.sql.core [None req-5bbfd537-83cb-4b07-916b-f62e54496f7a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 16 00:46:41.816725 n-d-master-1 devstack@keystone.service[81805]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 16 00:46:41.816725 n-d-master-1 devstack@keystone.service[81805]: [parameters: {'user_id': '4c2db39ac7fb49aa898fab59166bb2f0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 16 00:46:41.816725 n-d-master-1 devstack@keystone.service[81805]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81805) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:46:41.823906 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-5bbfd537-83cb-4b07-916b-f62e54496f7a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result.read() Oct 16 00:46:41.825956 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:46:41.826967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application yield resource Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise self.value Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application session.commit() Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:46:41.829098 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:46:41.830000 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:46:41.830868 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result.read() Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:46:41.831752 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [parameters: {'user_id': '4c2db39ac7fb49aa898fab59166bb2f0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:41.832583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 16 00:46:41.833368 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 16 00:46:41.834271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 16 00:46:41.834271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 16 00:46:41.834271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:46:41.834271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:46:41.834271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 16 00:46:41.834271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:41.834271 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 372/769] 10.222.0.39 () {60 vars in 1131 bytes} [Sun Oct 16 00:46:41 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:41.834271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfd537-83cb-4b07-916b-f62e54496f7a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:41.918449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba718d8-9e0b-4ec0-bd63-240abc84ff64 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:41.943372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfd537-83cb-4b07-916b-f62e54496f7a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:41.962576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86719cef-3b6d-460c-8f3b-72eb00e3e5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:41.963517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86719cef-3b6d-460c-8f3b-72eb00e3e5de None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:41.964003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86719cef-3b6d-460c-8f3b-72eb00e3e5de None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:41.964485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86719cef-3b6d-460c-8f3b-72eb00e3e5de None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:41.965889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86719cef-3b6d-460c-8f3b-72eb00e3e5de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:41.967972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86719cef-3b6d-460c-8f3b-72eb00e3e5de None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:41.980453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6ba63-9848-4d2c-ab7a-cf51dc95a78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:41.981144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6ba63-9848-4d2c-ab7a-cf51dc95a78f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:41.981453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6ba63-9848-4d2c-ab7a-cf51dc95a78f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:41.981730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6ba63-9848-4d2c-ab7a-cf51dc95a78f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:41.994860 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 398/770] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 00:46:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:41.998211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6ba63-9848-4d2c-ab7a-cf51dc95a78f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:42.000050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6ba63-9848-4d2c-ab7a-cf51dc95a78f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-eef6ba63-9848-4d2c-ab7a-cf51dc95a78f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:42.014504 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:42.015583 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:42.016642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:42.016642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:42.016642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:42.016642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:42.016642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:42.016642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:42.016642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:42.016642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:42.016642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:46:42.016642 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:42.016642 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 373/771] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:46:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:42.021735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86719cef-3b6d-460c-8f3b-72eb00e3e5de None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:42.128880 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:42.147151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86719cef-3b6d-460c-8f3b-72eb00e3e5de None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:42.186638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f66d47-d94e-4d13-a363-3a87ddf95e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:42.187428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f66d47-d94e-4d13-a363-3a87ddf95e50 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:42.187728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f66d47-d94e-4d13-a363-3a87ddf95e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:42.188088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f66d47-d94e-4d13-a363-3a87ddf95e50 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:42.188793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f66d47-d94e-4d13-a363-3a87ddf95e50 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:42.189094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f66d47-d94e-4d13-a363-3a87ddf95e50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:42.190523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f66d47-d94e-4d13-a363-3a87ddf95e50 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:42.229263 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 399/772] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Oct 16 00:46:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:43.132476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cf6b4-6202-4326-9005-1b7cdc9bc8f4 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:43.133117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cf6b4-6202-4326-9005-1b7cdc9bc8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:43.133117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cf6b4-6202-4326-9005-1b7cdc9bc8f4 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:43.137163 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 374/773] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:43.142999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09279c1e-3816-4bd9-8be5-59e879b62ac7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:43.143423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09279c1e-3816-4bd9-8be5-59e879b62ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:43.143622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09279c1e-3816-4bd9-8be5-59e879b62ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:43.153389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fd475-61e7-493a-8f8f-4b1573120621 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:43.153709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fd475-61e7-493a-8f8f-4b1573120621 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:43.153948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fd475-61e7-493a-8f8f-4b1573120621 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:43.155566 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 375/774] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:46:43.161027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae008c1-ffda-45fc-a636-0dadf0056336 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:43.161309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae008c1-ffda-45fc-a636-0dadf0056336 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:43.161579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae008c1-ffda-45fc-a636-0dadf0056336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:43.162692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-09279c1e-3816-4bd9-8be5-59e879b62ac7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:43.164233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-09279c1e-3816-4bd9-8be5-59e879b62ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:43.179876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1ae008c1-ffda-45fc-a636-0dadf0056336 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:43.181392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1ae008c1-ffda-45fc-a636-0dadf0056336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:43.234145 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:43.238970 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 400/775] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:43 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:43.256657 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 376/776] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:43 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:43.509756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09279c1e-3816-4bd9-8be5-59e879b62ac7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:43.521634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae008c1-ffda-45fc-a636-0dadf0056336 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:43.602198 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:43.627823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09279c1e-3816-4bd9-8be5-59e879b62ac7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:43.630748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae008c1-ffda-45fc-a636-0dadf0056336 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:43.668086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc99b23-2f5e-4c3a-8521-9031e1386019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:43.668307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df3b92-55b3-4444-9da5-e3d3af4df204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:43.668712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc99b23-2f5e-4c3a-8521-9031e1386019 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:43.668828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df3b92-55b3-4444-9da5-e3d3af4df204 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:43.669008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc99b23-2f5e-4c3a-8521-9031e1386019 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:43.669110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df3b92-55b3-4444-9da5-e3d3af4df204 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:43.669268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc99b23-2f5e-4c3a-8521-9031e1386019 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:43.669365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df3b92-55b3-4444-9da5-e3d3af4df204 None admin] PATH_INFO: `/v3/services/image` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:43.669817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc99b23-2f5e-4c3a-8521-9031e1386019 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:43.669917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df3b92-55b3-4444-9da5-e3d3af4df204 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:43.671189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc99b23-2f5e-4c3a-8521-9031e1386019 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:43.671302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df3b92-55b3-4444-9da5-e3d3af4df204 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-cfc99b23-2f5e-4c3a-8521-9031e1386019 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:43.680834 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:43.681909 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:46:43.682831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e5df3b92-55b3-4444-9da5-e3d3af4df204 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:43.683733 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:43.684618 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:46:43.685434 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:43.686162 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 401/777] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:43.687871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc99b23-2f5e-4c3a-8521-9031e1386019 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:43.691457 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 377/778] 10.222.0.39 () {56 vars in 1105 bytes} [Sun Oct 16 00:46:43 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:43.692295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df3b92-55b3-4444-9da5-e3d3af4df204 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:43.741077 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:43.800949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df3b92-55b3-4444-9da5-e3d3af4df204 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:43.805823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc99b23-2f5e-4c3a-8521-9031e1386019 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:43.835660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029e136-e2d2-408e-983e-20f408720ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:43.836261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029e136-e2d2-408e-983e-20f408720ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:43.836532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029e136-e2d2-408e-983e-20f408720ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:43.836799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029e136-e2d2-408e-983e-20f408720ac7 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:43.837413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029e136-e2d2-408e-983e-20f408720ac7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:43.837740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029e136-e2d2-408e-983e-20f408720ac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:43.839115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029e136-e2d2-408e-983e-20f408720ac7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:43.844961 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 378/779] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:43.845974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211382a-d336-4c01-bf25-d44ec604e9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:43.846785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211382a-d336-4c01-bf25-d44ec604e9cc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:43.847282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211382a-d336-4c01-bf25-d44ec604e9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:43.847756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211382a-d336-4c01-bf25-d44ec604e9cc None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:43.848845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211382a-d336-4c01-bf25-d44ec604e9cc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:43.849337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211382a-d336-4c01-bf25-d44ec604e9cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:43.850906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211382a-d336-4c01-bf25-d44ec604e9cc None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:43.851251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029e136-e2d2-408e-983e-20f408720ac7 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:43.861239 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 402/780] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Oct 16 00:46:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:43.862124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211382a-d336-4c01-bf25-d44ec604e9cc None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:43.873583 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:43.961098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029e136-e2d2-408e-983e-20f408720ac7 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:43.971327 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:43.976573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211382a-d336-4c01-bf25-d44ec604e9cc None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:43.996849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a3f0e-541b-40d9-9dc1-f123d0b506b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:43.997868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a3f0e-541b-40d9-9dc1-f123d0b506b0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:43.998148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a3f0e-541b-40d9-9dc1-f123d0b506b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:43.998417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a3f0e-541b-40d9-9dc1-f123d0b506b0 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:43.999217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a3f0e-541b-40d9-9dc1-f123d0b506b0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:43.999520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a3f0e-541b-40d9-9dc1-f123d0b506b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:44.001106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a3f0e-541b-40d9-9dc1-f123d0b506b0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:44.006190 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 379/781] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:44.011391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf7cae-6d3b-4d2b-9445-847c3bfd2187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:44.011732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a3f0e-541b-40d9-9dc1-f123d0b506b0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:44.011996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf7cae-6d3b-4d2b-9445-847c3bfd2187 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:44.012275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf7cae-6d3b-4d2b-9445-847c3bfd2187 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:44.012631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf7cae-6d3b-4d2b-9445-847c3bfd2187 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:44.013179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf7cae-6d3b-4d2b-9445-847c3bfd2187 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:44.013480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf7cae-6d3b-4d2b-9445-847c3bfd2187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:44.014961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf7cae-6d3b-4d2b-9445-847c3bfd2187 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:44.024906 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 403/782] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Oct 16 00:46:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:44.025858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf7cae-6d3b-4d2b-9445-847c3bfd2187 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:44.101785 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:44.129737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a3f0e-541b-40d9-9dc1-f123d0b506b0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:44.139668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf7cae-6d3b-4d2b-9445-847c3bfd2187 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:44.166015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b843a75-4556-4da7-bb0e-8091100d911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:44.166749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b843a75-4556-4da7-bb0e-8091100d911e None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:44.167121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b843a75-4556-4da7-bb0e-8091100d911e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:44.167480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b843a75-4556-4da7-bb0e-8091100d911e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:44.168213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b843a75-4556-4da7-bb0e-8091100d911e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:44.169629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b843a75-4556-4da7-bb0e-8091100d911e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:44.175596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603f4e0-4717-47d9-ad41-d00020b0222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:44.176203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603f4e0-4717-47d9-ad41-d00020b0222f None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:44.176482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603f4e0-4717-47d9-ad41-d00020b0222f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:44.176752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603f4e0-4717-47d9-ad41-d00020b0222f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:44.177415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603f4e0-4717-47d9-ad41-d00020b0222f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:44.178761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603f4e0-4717-47d9-ad41-d00020b0222f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:44.193442 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 380/783] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 00:46:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:44.203126 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 404/784] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 00:46:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:44.220017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b68535-42da-4701-9909-1acd10df81a6 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:44.220399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b68535-42da-4701-9909-1acd10df81a6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:44.220770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b68535-42da-4701-9909-1acd10df81a6 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:44.222496 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 381/785] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:44.228795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53f9ba-24ea-4a8e-85dc-15a116ddc4c1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:44.229549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53f9ba-24ea-4a8e-85dc-15a116ddc4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:44.230064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53f9ba-24ea-4a8e-85dc-15a116ddc4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:44.252490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0b53f9ba-24ea-4a8e-85dc-15a116ddc4c1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:44.254252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0b53f9ba-24ea-4a8e-85dc-15a116ddc4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:44.347560 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 405/786] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:44.620955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b68535-42da-4701-9909-1acd10df81a6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:44.650688 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:44.730244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b68535-42da-4701-9909-1acd10df81a6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:44.764067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182c06-e082-42c0-8ff6-7a6b5b405233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:44.764699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182c06-e082-42c0-8ff6-7a6b5b405233 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:44.764972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182c06-e082-42c0-8ff6-7a6b5b405233 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:44.765237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182c06-e082-42c0-8ff6-7a6b5b405233 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:44.767030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182c06-e082-42c0-8ff6-7a6b5b405233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:44.768368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182c06-e082-42c0-8ff6-7a6b5b405233 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:44.770136 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 382/787] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:44.775666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53f9ba-24ea-4a8e-85dc-15a116ddc4c1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:44.829953 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:44.879007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53f9ba-24ea-4a8e-85dc-15a116ddc4c1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:44.913193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112937ed-92b8-4f77-8de5-1614216f74b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:44.913797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112937ed-92b8-4f77-8de5-1614216f74b4 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:44.914073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112937ed-92b8-4f77-8de5-1614216f74b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:44.914342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112937ed-92b8-4f77-8de5-1614216f74b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:44.915020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112937ed-92b8-4f77-8de5-1614216f74b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:44.916446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112937ed-92b8-4f77-8de5-1614216f74b4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:44.950942 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 406/788] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:46:44 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:46.388537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e307-0488-4dcd-98aa-ea3d4d12623f None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:46.389084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e307-0488-4dcd-98aa-ea3d4d12623f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:46.389084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e307-0488-4dcd-98aa-ea3d4d12623f None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:46.390641 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 383/789] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:46.396320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac45193-61c8-4dd3-bc76-8f721ca07090 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:46.396871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac45193-61c8-4dd3-bc76-8f721ca07090 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:46.396871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac45193-61c8-4dd3-bc76-8f721ca07090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:46.415898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-eac45193-61c8-4dd3-bc76-8f721ca07090 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:46.417065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eac45193-61c8-4dd3-bc76-8f721ca07090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:46.482457 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 407/790] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:46.494607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a81996-5fcb-4ad1-b21a-a7c12c39a22c None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:46.494992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a81996-5fcb-4ad1-b21a-a7c12c39a22c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:46.495334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a81996-5fcb-4ad1-b21a-a7c12c39a22c None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:46.496952 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 384/791] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:46.502044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed9ac4-3dd8-4ca4-abe9-55a32ba133a0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:46.502333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed9ac4-3dd8-4ca4-abe9-55a32ba133a0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:46.502603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed9ac4-3dd8-4ca4-abe9-55a32ba133a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:46.525097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-73ed9ac4-3dd8-4ca4-abe9-55a32ba133a0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:46.526276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-73ed9ac4-3dd8-4ca4-abe9-55a32ba133a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:46.562465 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:46.605729 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 408/792] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:46.748760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a81996-5fcb-4ad1-b21a-a7c12c39a22c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:46.845467 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:46.853468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a81996-5fcb-4ad1-b21a-a7c12c39a22c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:46.874552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed9ac4-3dd8-4ca4-abe9-55a32ba133a0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:46.888418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751501c-f747-4140-a65f-27a5b68ef691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:46.889019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751501c-f747-4140-a65f-27a5b68ef691 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:46.889294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751501c-f747-4140-a65f-27a5b68ef691 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:46.889584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751501c-f747-4140-a65f-27a5b68ef691 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:46.890234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751501c-f747-4140-a65f-27a5b68ef691 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:46.892289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751501c-f747-4140-a65f-27a5b68ef691 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:46.900042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.sql.core [None req-4751501c-f747-4140-a65f-27a5b68ef691 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:46:46.900042 n-d-master-1 devstack@keystone.service[81805]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:46:46.900042 n-d-master-1 devstack@keystone.service[81805]: [parameters: {'id': 'ca69cad2334a4830a34ba3a089068682', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 00:46:46.900042 n-d-master-1 devstack@keystone.service[81805]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81805) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-4751501c-f747-4140-a65f-27a5b68ef691 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:46:46.908459 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result.read() Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 16 00:46:46.909346 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application yield resource Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise self.value Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application session.commit() Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:46:46.910318 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:46:46.911280 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:46:46.912224 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result.read() Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:46:46.913013 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [parameters: {'id': 'ca69cad2334a4830a34ba3a089068682', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 16 00:46:46.913943 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:46.914762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 385/793] 10.222.0.39 () {60 vars in 1137 bytes} [Sun Oct 16 00:46:46 2022] POST /identity/v3/domains => generated 190 bytes in 161 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:46.916067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751501c-f747-4140-a65f-27a5b68ef691 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:46.989695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed9ac4-3dd8-4ca4-abe9-55a32ba133a0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:47.014399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751501c-f747-4140-a65f-27a5b68ef691 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:47.025391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c6237-034c-4854-b9fd-ecd44abea219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:47.026025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c6237-034c-4854-b9fd-ecd44abea219 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:47.026306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c6237-034c-4854-b9fd-ecd44abea219 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:47.026579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c6237-034c-4854-b9fd-ecd44abea219 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:47.037465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c6237-034c-4854-b9fd-ecd44abea219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-257c6237-034c-4854-b9fd-ecd44abea219 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:47.042241 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:47.043373 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:47.044220 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:47.044220 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:47.044220 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:47.044220 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:47.044220 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:47.044220 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:47.044220 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:47.044220 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:47.044220 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:47.044220 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:47.044220 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:46:47.044220 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:47.044220 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 409/794] 10.222.0.39 () {56 vars in 1120 bytes} [Sun Oct 16 00:46:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:47.050234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c6237-034c-4854-b9fd-ecd44abea219 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:47.053767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254b595-8c28-4d2c-b4d2-4d148bc0da6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:47.054406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b595-8c28-4d2c-b4d2-4d148bc0da6f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:47.054750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b595-8c28-4d2c-b4d2-4d148bc0da6f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:47.055086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b595-8c28-4d2c-b4d2-4d148bc0da6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:47.066069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254b595-8c28-4d2c-b4d2-4d148bc0da6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:47.067550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254b595-8c28-4d2c-b4d2-4d148bc0da6f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:47.075683 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f254b595-8c28-4d2c-b4d2-4d148bc0da6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:47.083832 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:47.084951 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:47.085852 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:47.085852 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:47.085852 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:47.085852 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 386/795] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:47.091514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254b595-8c28-4d2c-b4d2-4d148bc0da6f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:47.109173 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:47.163862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c6237-034c-4854-b9fd-ecd44abea219 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:47.198578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254b595-8c28-4d2c-b4d2-4d148bc0da6f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:47.206615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372da7d-1cd1-4286-80e6-febdfed2cadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:47.207258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372da7d-1cd1-4286-80e6-febdfed2cadb None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:47.207541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372da7d-1cd1-4286-80e6-febdfed2cadb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:47.207815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372da7d-1cd1-4286-80e6-febdfed2cadb None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:47.208480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372da7d-1cd1-4286-80e6-febdfed2cadb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:47.208782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372da7d-1cd1-4286-80e6-febdfed2cadb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:47.210163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372da7d-1cd1-4286-80e6-febdfed2cadb None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:47.218288 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 410/796] 10.222.0.39 () {56 vars in 1115 bytes} [Sun Oct 16 00:46:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:47.219524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85c2b9-4ee1-4483-911f-741da1d29dcc None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:47.219801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85c2b9-4ee1-4483-911f-741da1d29dcc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:47.220075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85c2b9-4ee1-4483-911f-741da1d29dcc None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:47.221268 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 411/797] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:47.224211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85c2b9-4ee1-4483-911f-741da1d29dcc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:47.237157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3260f7-7169-494c-a485-40f4647cc0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:47.237761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3260f7-7169-494c-a485-40f4647cc0cb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:47.238036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3260f7-7169-494c-a485-40f4647cc0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:47.238299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3260f7-7169-494c-a485-40f4647cc0cb None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:47.238942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3260f7-7169-494c-a485-40f4647cc0cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:47.239246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3260f7-7169-494c-a485-40f4647cc0cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:47.240594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3260f7-7169-494c-a485-40f4647cc0cb None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:47.252977 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 387/798] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:47.254128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3d9c1-b753-4740-9091-a6f7e9e9223a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:47.254403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3d9c1-b753-4740-9091-a6f7e9e9223a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:47.254670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3d9c1-b753-4740-9091-a6f7e9e9223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:47.274473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-adc3d9c1-b753-4740-9091-a6f7e9e9223a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:47.275771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-adc3d9c1-b753-4740-9091-a6f7e9e9223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:47.336524 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:47.351345 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 388/799] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:47.364453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85c2b9-4ee1-4483-911f-741da1d29dcc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:47.403468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78af62-c3d2-4987-8959-7f14c144d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:47.404174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78af62-c3d2-4987-8959-7f14c144d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:47.404443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78af62-c3d2-4987-8959-7f14c144d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:47.404893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78af62-c3d2-4987-8959-7f14c144d8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:47.417506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78af62-c3d2-4987-8959-7f14c144d8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:47.419001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78af62-c3d2-4987-8959-7f14c144d8d6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3f78af62-c3d2-4987-8959-7f14c144d8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:47.436205 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:47.437160 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:47.438245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:47.438245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:47.438245 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:47.438245 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 412/800] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:47.443166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3d9c1-b753-4740-9091-a6f7e9e9223a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:47.445699 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:47.553375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3d9c1-b753-4740-9091-a6f7e9e9223a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:47.589951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fee48-54e0-487f-9bff-f9215ea2fe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:47.590563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fee48-54e0-487f-9bff-f9215ea2fe79 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:47.590841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fee48-54e0-487f-9bff-f9215ea2fe79 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:47.591157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fee48-54e0-487f-9bff-f9215ea2fe79 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:47.591819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fee48-54e0-487f-9bff-f9215ea2fe79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:47.592119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fee48-54e0-487f-9bff-f9215ea2fe79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:47.593484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fee48-54e0-487f-9bff-f9215ea2fe79 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:47.605239 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 389/801] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:47.610970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78af62-c3d2-4987-8959-7f14c144d8d6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:47.629812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fee48-54e0-487f-9bff-f9215ea2fe79 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:47.690183 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:47.712105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78af62-c3d2-4987-8959-7f14c144d8d6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:47.730387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fee48-54e0-487f-9bff-f9215ea2fe79 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:47.745746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f872da-d598-4f6b-b11a-459e176098aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:47.746363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f872da-d598-4f6b-b11a-459e176098aa None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:47.746641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f872da-d598-4f6b-b11a-459e176098aa None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:47.746932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f872da-d598-4f6b-b11a-459e176098aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:47.754450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f872da-d598-4f6b-b11a-459e176098aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:47.755928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f872da-d598-4f6b-b11a-459e176098aa None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:47.757624 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:47.764960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcb4bb-264b-4f82-96c2-3769924303b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:47.765678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb4bb-264b-4f82-96c2-3769924303b9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:47.766652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb4bb-264b-4f82-96c2-3769924303b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:47.766947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb4bb-264b-4f82-96c2-3769924303b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:47.768201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcb4bb-264b-4f82-96c2-3769924303b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-00f872da-d598-4f6b-b11a-459e176098aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:47.768925 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:47.770004 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:47.771077 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:47.771077 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:47.771077 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:47.771077 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:47.771077 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:47.771077 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:47.771077 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:47.771077 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:47.771077 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:46:47.771077 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:47.771652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcb4bb-264b-4f82-96c2-3769924303b9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:47.771731 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 413/802] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Oct 16 00:46:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:47.771800 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 390/803] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:47.775808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f872da-d598-4f6b-b11a-459e176098aa None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:47.776565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcb4bb-264b-4f82-96c2-3769924303b9 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:47.873813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f872da-d598-4f6b-b11a-459e176098aa None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:47.874014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcb4bb-264b-4f82-96c2-3769924303b9 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:47.901588 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:47.908493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d0b7e-8f35-431d-9456-04cbd0af5cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:47.909092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0b7e-8f35-431d-9456-04cbd0af5cc8 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:47.909344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb37126-3136-4826-a3d9-47a345c59c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:47.909468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0b7e-8f35-431d-9456-04cbd0af5cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:47.909625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0b7e-8f35-431d-9456-04cbd0af5cc8 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:47.909931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb37126-3136-4826-a3d9-47a345c59c70 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:47.910205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb37126-3136-4826-a3d9-47a345c59c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:47.910294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d0b7e-8f35-431d-9456-04cbd0af5cc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:47.910472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb37126-3136-4826-a3d9-47a345c59c70 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:47.911210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb37126-3136-4826-a3d9-47a345c59c70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:47.911510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb37126-3136-4826-a3d9-47a345c59c70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:47.911699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d0b7e-8f35-431d-9456-04cbd0af5cc8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:47.912892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb37126-3136-4826-a3d9-47a345c59c70 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:47.930191 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 414/804] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Oct 16 00:46:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:47.935908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb37126-3136-4826-a3d9-47a345c59c70 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:47.937283 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 391/805] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:46:47 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:46:47.995904 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:48.042107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb37126-3136-4826-a3d9-47a345c59c70 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:48.077954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fcae6-9e14-4391-b1cd-0115ad89867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:48.078654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fcae6-9e14-4391-b1cd-0115ad89867e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:48.079071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fcae6-9e14-4391-b1cd-0115ad89867e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:48.079342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fcae6-9e14-4391-b1cd-0115ad89867e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:48.090180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fcae6-9e14-4391-b1cd-0115ad89867e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:48.091672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fcae6-9e14-4391-b1cd-0115ad89867e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-7d7fcae6-9e14-4391-b1cd-0115ad89867e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:48.107540 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:48.108568 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:48.109470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:48.109470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:48.109470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:48.109470 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 415/806] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:48.115398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d0b7e-8f35-431d-9456-04cbd0af5cc8 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:48.216175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d0b7e-8f35-431d-9456-04cbd0af5cc8 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:48.249066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357b6f7-7cc5-4b72-98d3-eb44fb4ac869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:48.249660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357b6f7-7cc5-4b72-98d3-eb44fb4ac869 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:48.249931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357b6f7-7cc5-4b72-98d3-eb44fb4ac869 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:48.250405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357b6f7-7cc5-4b72-98d3-eb44fb4ac869 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:48.251184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357b6f7-7cc5-4b72-98d3-eb44fb4ac869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:48.251485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357b6f7-7cc5-4b72-98d3-eb44fb4ac869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:48.252834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357b6f7-7cc5-4b72-98d3-eb44fb4ac869 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:48.264269 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 392/807] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:48.270302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fcae6-9e14-4391-b1cd-0115ad89867e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:48.366861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fcae6-9e14-4391-b1cd-0115ad89867e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:48.375264 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:48.399837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f9579-8a83-41d6-9f1b-c3a40a1de658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:48.400453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f9579-8a83-41d6-9f1b-c3a40a1de658 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:48.400727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f9579-8a83-41d6-9f1b-c3a40a1de658 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:48.400996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f9579-8a83-41d6-9f1b-c3a40a1de658 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:48.408382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f9579-8a83-41d6-9f1b-c3a40a1de658 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:48.409819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f9579-8a83-41d6-9f1b-c3a40a1de658 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e86f9579-8a83-41d6-9f1b-c3a40a1de658 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:48.420652 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:48.421688 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:48.422647 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:48.422647 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:48.422647 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:48.422647 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:48.422647 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:48.422647 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:48.422647 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:48.422647 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:48.422647 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 416/808] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:48.427521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357b6f7-7cc5-4b72-98d3-eb44fb4ac869 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:48.473216 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:48.527313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357b6f7-7cc5-4b72-98d3-eb44fb4ac869 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:48.566450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bc521-3656-41fa-9edd-2f1bf9fc02c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:48.567078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bc521-3656-41fa-9edd-2f1bf9fc02c4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:48.567352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bc521-3656-41fa-9edd-2f1bf9fc02c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:48.567614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bc521-3656-41fa-9edd-2f1bf9fc02c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:48.568283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bc521-3656-41fa-9edd-2f1bf9fc02c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:48.568579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bc521-3656-41fa-9edd-2f1bf9fc02c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:48.569984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bc521-3656-41fa-9edd-2f1bf9fc02c4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:48.581553 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 393/809] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:48.587441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f9579-8a83-41d6-9f1b-c3a40a1de658 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:48.683462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f9579-8a83-41d6-9f1b-c3a40a1de658 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:48.716117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8561-5a26-44c4-bd52-aac40e173453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:48.716760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8561-5a26-44c4-bd52-aac40e173453 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:48.717033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8561-5a26-44c4-bd52-aac40e173453 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:48.717301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8561-5a26-44c4-bd52-aac40e173453 None admin] PATH_INFO: `/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/a065cd54fd8745ca99f35405c711ffac/roles/f04b28f80580457f9482238091b5a522` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:48.719966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab8561-5a26-44c4-bd52-aac40e173453 None admin] RBAC: Authorizing `identity:create_grant(project_id=2efc56617bd54471a648f03215b3bfb1, user_id=a065cd54fd8745ca99f35405c711ffac, role_id=f04b28f80580457f9482238091b5a522)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:48.721386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab8561-5a26-44c4-bd52-aac40e173453 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:48.733544 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 417/810] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:46:48 2022] PUT /identity/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/a065cd54fd8745ca99f35405c711ffac/roles/f04b28f80580457f9482238091b5a522 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:46:50.128835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6cfee-3836-4489-a783-4533e1577b03 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:50.129366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6cfee-3836-4489-a783-4533e1577b03 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:50.129366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6cfee-3836-4489-a783-4533e1577b03 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:50.130694 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 394/811] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:50.135984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfe8da-7464-48c4-9271-6d3cd5f296be None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:50.136421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfe8da-7464-48c4-9271-6d3cd5f296be None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:50.136604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfe8da-7464-48c4-9271-6d3cd5f296be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:50.154253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-afbfe8da-7464-48c4-9271-6d3cd5f296be None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:50.155710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-afbfe8da-7464-48c4-9271-6d3cd5f296be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:50.179051 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:50.225088 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 418/812] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:50.494561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6cfee-3836-4489-a783-4533e1577b03 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:50.599071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6cfee-3836-4489-a783-4533e1577b03 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:50.606080 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:50.632872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930359c9-22db-459e-a8d5-c0590bf37ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:50.633496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930359c9-22db-459e-a8d5-c0590bf37ede None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:50.633773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930359c9-22db-459e-a8d5-c0590bf37ede None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:50.634045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930359c9-22db-459e-a8d5-c0590bf37ede None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:50.644588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930359c9-22db-459e-a8d5-c0590bf37ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-930359c9-22db-459e-a8d5-c0590bf37ede None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:50.649312 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:50.650388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:50.651274 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:50.651274 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:50.651274 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:50.651274 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:50.651274 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:50.651274 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:50.651274 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:50.651274 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:50.651274 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:50.651274 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:50.651274 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:50.651274 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:50.651274 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 395/813] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:46:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:50.657035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfe8da-7464-48c4-9271-6d3cd5f296be None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:50.754480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfe8da-7464-48c4-9271-6d3cd5f296be None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:50.791005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12bbc0-9234-4552-8535-af8f3b9711a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:50.791616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12bbc0-9234-4552-8535-af8f3b9711a1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:50.791896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12bbc0-9234-4552-8535-af8f3b9711a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:50.792169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12bbc0-9234-4552-8535-af8f3b9711a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:50.792830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12bbc0-9234-4552-8535-af8f3b9711a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:50.793132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12bbc0-9234-4552-8535-af8f3b9711a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:50.794483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12bbc0-9234-4552-8535-af8f3b9711a1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:50.803079 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 419/814] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:46:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:50.808846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930359c9-22db-459e-a8d5-c0590bf37ede None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:50.875168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f2e9f-67db-4aef-b83e-112af8974d39 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:50.876031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f2e9f-67db-4aef-b83e-112af8974d39 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:50.876311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f2e9f-67db-4aef-b83e-112af8974d39 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:50.877649 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 420/815] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:46:50.882512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f8117-45f0-4772-95e7-d97f5ef31851 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:50.882795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f8117-45f0-4772-95e7-d97f5ef31851 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:50.883102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f8117-45f0-4772-95e7-d97f5ef31851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:50.900933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-232f8117-45f0-4772-95e7-d97f5ef31851 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:50.902121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-232f8117-45f0-4772-95e7-d97f5ef31851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:50.908601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930359c9-22db-459e-a8d5-c0590bf37ede None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:50.916794 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:50.943235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878a503-27bd-46b4-bd92-e9e9fc0b9531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:50.943859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a503-27bd-46b4-bd92-e9e9fc0b9531 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:50.944140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a503-27bd-46b4-bd92-e9e9fc0b9531 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:50.944412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a503-27bd-46b4-bd92-e9e9fc0b9531 None admin] PATH_INFO: `/v3/users/f032466175bd4355995451d97a045192` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:50.957382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878a503-27bd-46b4-bd92-e9e9fc0b9531 None admin] RBAC: Authorizing `identity:get_user(user_id=f032466175bd4355995451d97a045192)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:50.958805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878a503-27bd-46b4-bd92-e9e9fc0b9531 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:50.960420 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 396/816] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:46:50 2022] GET /identity/v3/users/f032466175bd4355995451d97a045192 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:50.966147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878a503-27bd-46b4-bd92-e9e9fc0b9531 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:50.970462 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 421/817] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:50.991076 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:51.063300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878a503-27bd-46b4-bd92-e9e9fc0b9531 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:51.096556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b689bff-0f06-474d-91d7-6f7fb57eebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:51.097166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b689bff-0f06-474d-91d7-6f7fb57eebed None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:51.097438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b689bff-0f06-474d-91d7-6f7fb57eebed None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:51.097703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b689bff-0f06-474d-91d7-6f7fb57eebed None admin] PATH_INFO: `/v3/projects/04b6b36de53f44228bfa48b10ec36c1b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:51.098782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b689bff-0f06-474d-91d7-6f7fb57eebed None admin] RBAC: Authorizing `identity:get_project(project_id=04b6b36de53f44228bfa48b10ec36c1b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:51.100226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b689bff-0f06-474d-91d7-6f7fb57eebed None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:51.101803 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 397/818] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:46:50 2022] GET /identity/v3/projects/04b6b36de53f44228bfa48b10ec36c1b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:51.107665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f8117-45f0-4772-95e7-d97f5ef31851 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:51.204191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f8117-45f0-4772-95e7-d97f5ef31851 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:51.237721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f5f40-b30c-49fa-9033-566a107c3554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:51.238368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f5f40-b30c-49fa-9033-566a107c3554 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:51.238646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f5f40-b30c-49fa-9033-566a107c3554 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:51.238943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f5f40-b30c-49fa-9033-566a107c3554 None admin] PATH_INFO: `/v3/projects/04b6b36de53f44228bfa48b10ec36c1b/users/f032466175bd4355995451d97a045192/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:51.240332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b689bff-0f06-474d-91d7-6f7fb57eebed None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:51.240817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f5f40-b30c-49fa-9033-566a107c3554 None admin] RBAC: Authorizing `identity:create_grant(project_id=04b6b36de53f44228bfa48b10ec36c1b, user_id=f032466175bd4355995451d97a045192, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:51.242241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f5f40-b30c-49fa-9033-566a107c3554 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:51.255608 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 422/819] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:46:51 2022] PUT /identity/v3/projects/04b6b36de53f44228bfa48b10ec36c1b/users/f032466175bd4355995451d97a045192/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:46:51.342159 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:51.353246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b689bff-0f06-474d-91d7-6f7fb57eebed None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:51.388498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddd1d0-e0b3-4bf2-bd1f-bc48fd9976a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:51.389141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddd1d0-e0b3-4bf2-bd1f-bc48fd9976a1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:51.389419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddd1d0-e0b3-4bf2-bd1f-bc48fd9976a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:51.389689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddd1d0-e0b3-4bf2-bd1f-bc48fd9976a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:51.401637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ddd1d0-e0b3-4bf2-bd1f-bc48fd9976a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-87ddd1d0-e0b3-4bf2-bd1f-bc48fd9976a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:51.407827 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:51.408823 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:51.409838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:51.409838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:51.409838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:51.409838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:51.409838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:51.409838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:51.409838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:51.409838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:51.409838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:51.409838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:51.409838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:46:51.409838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:51.409838 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 398/820] 10.222.0.39 () {56 vars in 1120 bytes} [Sun Oct 16 00:46:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:51.415181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f5f40-b30c-49fa-9033-566a107c3554 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:51.428220 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:51.514083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f5f40-b30c-49fa-9033-566a107c3554 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:51.548079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616feb4-0e66-4e6e-90ae-70c903786e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:51.548682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616feb4-0e66-4e6e-90ae-70c903786e0c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:51.548952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616feb4-0e66-4e6e-90ae-70c903786e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:51.549224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616feb4-0e66-4e6e-90ae-70c903786e0c None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:51.549870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616feb4-0e66-4e6e-90ae-70c903786e0c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:51.550169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616feb4-0e66-4e6e-90ae-70c903786e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:51.551549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616feb4-0e66-4e6e-90ae-70c903786e0c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:51.564554 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 423/821] 10.222.0.39 () {56 vars in 1115 bytes} [Sun Oct 16 00:46:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:51.566014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddd1d0-e0b3-4bf2-bd1f-bc48fd9976a1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:51.663861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddd1d0-e0b3-4bf2-bd1f-bc48fd9976a1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:51.696802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174bab1-85e9-49b8-9414-cd7bd9790024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:51.697452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174bab1-85e9-49b8-9414-cd7bd9790024 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:51.697727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174bab1-85e9-49b8-9414-cd7bd9790024 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:51.697994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174bab1-85e9-49b8-9414-cd7bd9790024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:51.708476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174bab1-85e9-49b8-9414-cd7bd9790024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:51.709902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174bab1-85e9-49b8-9414-cd7bd9790024 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e174bab1-85e9-49b8-9414-cd7bd9790024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:51.724097 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:51.725100 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:51.725981 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:51.725981 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:51.725981 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:51.725981 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 399/822] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:51.731069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616feb4-0e66-4e6e-90ae-70c903786e0c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:51.799101 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:51.830215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616feb4-0e66-4e6e-90ae-70c903786e0c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:51.862045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a822a-b781-46e4-b332-4b1b3a7598e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:51.862634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a822a-b781-46e4-b332-4b1b3a7598e3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:51.862911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a822a-b781-46e4-b332-4b1b3a7598e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:51.863209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a822a-b781-46e4-b332-4b1b3a7598e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:51.863835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a822a-b781-46e4-b332-4b1b3a7598e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:51.864135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a822a-b781-46e4-b332-4b1b3a7598e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:51.865485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a822a-b781-46e4-b332-4b1b3a7598e3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:51.877507 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 424/823] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:51.883188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174bab1-85e9-49b8-9414-cd7bd9790024 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:51.886884 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:51.981455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174bab1-85e9-49b8-9414-cd7bd9790024 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:52.014076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207dbeb-6040-4981-a3a1-db5f6a8a3954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:52.014694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207dbeb-6040-4981-a3a1-db5f6a8a3954 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:52.014994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207dbeb-6040-4981-a3a1-db5f6a8a3954 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:52.015262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207dbeb-6040-4981-a3a1-db5f6a8a3954 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:52.022994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207dbeb-6040-4981-a3a1-db5f6a8a3954 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:52.024425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207dbeb-6040-4981-a3a1-db5f6a8a3954 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-2207dbeb-6040-4981-a3a1-db5f6a8a3954 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:52.036243 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:52.042183 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:52.043237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:52.043237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:52.043237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:52.043237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:52.043237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:52.043237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:52.043237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:52.043237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:52.043237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:46:52.043237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:52.043237 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 400/824] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Oct 16 00:46:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:52.043947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a822a-b781-46e4-b332-4b1b3a7598e3 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:52.142444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a822a-b781-46e4-b332-4b1b3a7598e3 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:52.171670 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:52.178372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee34b5f-c085-4d6d-8a2e-8004928f4ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:52.178994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34b5f-c085-4d6d-8a2e-8004928f4ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:52.179275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34b5f-c085-4d6d-8a2e-8004928f4ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:52.179545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34b5f-c085-4d6d-8a2e-8004928f4ff2 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:52.180740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee34b5f-c085-4d6d-8a2e-8004928f4ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:52.181045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee34b5f-c085-4d6d-8a2e-8004928f4ff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:52.182454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee34b5f-c085-4d6d-8a2e-8004928f4ff2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:52.199427 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 425/825] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Oct 16 00:46:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:52.205686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207dbeb-6040-4981-a3a1-db5f6a8a3954 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:52.266281 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:52.304533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207dbeb-6040-4981-a3a1-db5f6a8a3954 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:52.337023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fa7de-e7eb-47e2-b0ff-751adeeafd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:52.337618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fa7de-e7eb-47e2-b0ff-751adeeafd8a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:52.337895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fa7de-e7eb-47e2-b0ff-751adeeafd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:52.338165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fa7de-e7eb-47e2-b0ff-751adeeafd8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:52.403209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fa7de-e7eb-47e2-b0ff-751adeeafd8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:52.404905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fa7de-e7eb-47e2-b0ff-751adeeafd8a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:52.462660 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:52.500905 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 401/826] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:46:52.506641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee34b5f-c085-4d6d-8a2e-8004928f4ff2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:52.614993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee34b5f-c085-4d6d-8a2e-8004928f4ff2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:52.648608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5384e83-4a7f-498a-8cc1-0e6d25ac5dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:52.649222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5384e83-4a7f-498a-8cc1-0e6d25ac5dcd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:52.649494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5384e83-4a7f-498a-8cc1-0e6d25ac5dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:52.649759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5384e83-4a7f-498a-8cc1-0e6d25ac5dcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:52.660613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5384e83-4a7f-498a-8cc1-0e6d25ac5dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:52.662021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5384e83-4a7f-498a-8cc1-0e6d25ac5dcd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f5384e83-4a7f-498a-8cc1-0e6d25ac5dcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:52.676898 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:52.677992 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:52.679301 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:52.679301 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:52.679301 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:52.682625 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 426/827] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:52.683803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fa7de-e7eb-47e2-b0ff-751adeeafd8a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:52.778599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fa7de-e7eb-47e2-b0ff-751adeeafd8a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:52.811754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90c03-10c0-4361-854f-8028eb4d12de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:52.812284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90c03-10c0-4361-854f-8028eb4d12de None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:52.812559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90c03-10c0-4361-854f-8028eb4d12de None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:52.812828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90c03-10c0-4361-854f-8028eb4d12de None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:52.813450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe90c03-10c0-4361-854f-8028eb4d12de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:52.813747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe90c03-10c0-4361-854f-8028eb4d12de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:52.815135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe90c03-10c0-4361-854f-8028eb4d12de None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:52.826007 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 402/828] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:52.831970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5384e83-4a7f-498a-8cc1-0e6d25ac5dcd None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:52.873999 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:52.932903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5384e83-4a7f-498a-8cc1-0e6d25ac5dcd None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:52.965817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6a77e-ea92-4790-81f5-08b8fb2def9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:52.966437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6a77e-ea92-4790-81f5-08b8fb2def9e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:52.966717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6a77e-ea92-4790-81f5-08b8fb2def9e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:52.967011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6a77e-ea92-4790-81f5-08b8fb2def9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:52.973507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6a77e-ea92-4790-81f5-08b8fb2def9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:52.974939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6a77e-ea92-4790-81f5-08b8fb2def9e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-44b6a77e-ea92-4790-81f5-08b8fb2def9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:52.986492 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:52.987593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:52.988488 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:52.988488 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:52.988488 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:52.988488 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:52.988488 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:52.988488 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:52.988488 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:52.988488 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:46:52.988488 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 427/829] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:52.993396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90c03-10c0-4361-854f-8028eb4d12de None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:53.019235 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:53.092903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90c03-10c0-4361-854f-8028eb4d12de None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:53.125037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d3538-b502-4415-9d6e-b208875d29d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:53.126186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d3538-b502-4415-9d6e-b208875d29d9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:53.126459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d3538-b502-4415-9d6e-b208875d29d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:53.126725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d3538-b502-4415-9d6e-b208875d29d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:53.127433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d3538-b502-4415-9d6e-b208875d29d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:53.127733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d3538-b502-4415-9d6e-b208875d29d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:53.129139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d3538-b502-4415-9d6e-b208875d29d9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:53.140901 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 403/830] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:53.146896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6a77e-ea92-4790-81f5-08b8fb2def9e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:53.245720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6a77e-ea92-4790-81f5-08b8fb2def9e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:53.247228 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:53.279529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b6c19-d302-40aa-8c5b-c744de4ac6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:53.280399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b6c19-d302-40aa-8c5b-c744de4ac6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:53.280670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b6c19-d302-40aa-8c5b-c744de4ac6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:53.280935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b6c19-d302-40aa-8c5b-c744de4ac6c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:53.282196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b6c19-d302-40aa-8c5b-c744de4ac6c3 None admin] RBAC: Adding query filter params (role.id=f04b28f80580457f9482238091b5a522, scope.project.id=2efc56617bd54471a648f03215b3bfb1, user.id=a065cd54fd8745ca99f35405c711ffac) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:53.282509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b6c19-d302-40aa-8c5b-c744de4ac6c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:53.284156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b6c19-d302-40aa-8c5b-c744de4ac6c3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:53.290812 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 428/831] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:53 2022] GET /identity/v3/role_assignments?user.id=a065cd54fd8745ca99f35405c711ffac&scope.project.id=2efc56617bd54471a648f03215b3bfb1&role.id=f04b28f80580457f9482238091b5a522 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:53.412707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e543b-161d-4039-82e5-3d7771c138dc None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:53.413222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e543b-161d-4039-82e5-3d7771c138dc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:53.413222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e543b-161d-4039-82e5-3d7771c138dc None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:53.414499 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 404/832] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:53.420269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d37fb-367a-4824-be06-35ee714a5dc4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:53.420551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d37fb-367a-4824-be06-35ee714a5dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:53.420822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d37fb-367a-4824-be06-35ee714a5dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:53.440227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-074d37fb-367a-4824-be06-35ee714a5dc4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:53.441432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-074d37fb-367a-4824-be06-35ee714a5dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:53.508491 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 429/833] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:53.776145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e543b-161d-4039-82e5-3d7771c138dc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:53.864396 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:53.882972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e543b-161d-4039-82e5-3d7771c138dc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:53.918141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4bf29-bd23-4cad-a67d-68ac72339051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:53.918772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4bf29-bd23-4cad-a67d-68ac72339051 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:53.919083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4bf29-bd23-4cad-a67d-68ac72339051 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:53.919353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4bf29-bd23-4cad-a67d-68ac72339051 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:53.929452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4bf29-bd23-4cad-a67d-68ac72339051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-33f4bf29-bd23-4cad-a67d-68ac72339051 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:53.934164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:53.935292 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:53.936435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:53.936435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:53.936435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:53.936435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:53.936435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:53.936435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:53.936435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:53.936435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:53.936435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:53.936435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:53.936435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:53.936435 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:46:53.936435 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 405/834] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:46:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:53.943325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d37fb-367a-4824-be06-35ee714a5dc4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:54.040228 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:54.046270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d37fb-367a-4824-be06-35ee714a5dc4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:54.083672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4d484-3e11-40bd-9997-52b12f4b2e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:54.084278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d484-3e11-40bd-9997-52b12f4b2e06 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:54.084554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d484-3e11-40bd-9997-52b12f4b2e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:54.084825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d484-3e11-40bd-9997-52b12f4b2e06 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:54.085479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4d484-3e11-40bd-9997-52b12f4b2e06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:54.085779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4d484-3e11-40bd-9997-52b12f4b2e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:54.087190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4d484-3e11-40bd-9997-52b12f4b2e06 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:54.097875 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 430/835] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:46:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:54.103991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4bf29-bd23-4cad-a67d-68ac72339051 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:54.207789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4bf29-bd23-4cad-a67d-68ac72339051 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:54.241725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fabce9-a2ab-43c8-8196-cb9513a3e63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:54.242342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fabce9-a2ab-43c8-8196-cb9513a3e63f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:54.242616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fabce9-a2ab-43c8-8196-cb9513a3e63f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:54.242884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fabce9-a2ab-43c8-8196-cb9513a3e63f None admin] PATH_INFO: `/v3/users/f032466175bd4355995451d97a045192` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:54.244005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fabce9-a2ab-43c8-8196-cb9513a3e63f None admin] RBAC: Authorizing `identity:get_user(user_id=f032466175bd4355995451d97a045192)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:54.245419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fabce9-a2ab-43c8-8196-cb9513a3e63f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:54.246968 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 406/836] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:46:54 2022] GET /identity/v3/users/f032466175bd4355995451d97a045192 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:54.252983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4d484-3e11-40bd-9997-52b12f4b2e06 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:54.350260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4d484-3e11-40bd-9997-52b12f4b2e06 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:54.382144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509e27-7043-455b-a1b8-db74581bd1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:54.382726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509e27-7043-455b-a1b8-db74581bd1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:54.383038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509e27-7043-455b-a1b8-db74581bd1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:54.383311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509e27-7043-455b-a1b8-db74581bd1f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:54.410247 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:54.449654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa509e27-7043-455b-a1b8-db74581bd1f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:54.451114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa509e27-7043-455b-a1b8-db74581bd1f0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:54.547112 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 431/837] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:46:54.552791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fabce9-a2ab-43c8-8196-cb9513a3e63f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:54.567281 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:54.649740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fabce9-a2ab-43c8-8196-cb9513a3e63f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:54.681570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d4597-662b-4c23-a972-d8bd8a32accf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:54.682182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d4597-662b-4c23-a972-d8bd8a32accf None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:54.682458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d4597-662b-4c23-a972-d8bd8a32accf None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:54.682725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d4597-662b-4c23-a972-d8bd8a32accf None admin] PATH_INFO: `/v3/projects/04b6b36de53f44228bfa48b10ec36c1b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:54.683840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d4597-662b-4c23-a972-d8bd8a32accf None admin] RBAC: Authorizing `identity:get_project(project_id=04b6b36de53f44228bfa48b10ec36c1b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:54.685248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d4597-662b-4c23-a972-d8bd8a32accf None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:54.686829 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 407/838] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:46:54 2022] GET /identity/v3/projects/04b6b36de53f44228bfa48b10ec36c1b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:54.693494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509e27-7043-455b-a1b8-db74581bd1f0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:54.748658 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:54.789510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509e27-7043-455b-a1b8-db74581bd1f0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:54.821930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b1118-70bb-49c1-949e-e78d67d0586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:54.822512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b1118-70bb-49c1-949e-e78d67d0586d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:54.822784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b1118-70bb-49c1-949e-e78d67d0586d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:54.823080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b1118-70bb-49c1-949e-e78d67d0586d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:54.823783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b1118-70bb-49c1-949e-e78d67d0586d None admin] RBAC: Adding query filter params (role.id=3b2c8c93a1c54611871c4299008b2abf, scope.project.id=04b6b36de53f44228bfa48b10ec36c1b, user.id=f032466175bd4355995451d97a045192) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:54.824083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b1118-70bb-49c1-949e-e78d67d0586d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:54.825477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b1118-70bb-49c1-949e-e78d67d0586d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:54.831619 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 432/839] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:54 2022] GET /identity/v3/role_assignments?user.id=f032466175bd4355995451d97a045192&scope.project.id=04b6b36de53f44228bfa48b10ec36c1b&role.id=3b2c8c93a1c54611871c4299008b2abf => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:56.971838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693e47-9c56-42e8-82e5-dbc0706018a6 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:56.972339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693e47-9c56-42e8-82e5-dbc0706018a6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:56.972339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693e47-9c56-42e8-82e5-dbc0706018a6 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:56.973624 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 408/840] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:56.978780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5f1de-405a-410c-a531-902c5fde6d50 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:56.979190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5f1de-405a-410c-a531-902c5fde6d50 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:56.979361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5f1de-405a-410c-a531-902c5fde6d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:56.996915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-52c5f1de-405a-410c-a531-902c5fde6d50 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:56.998067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-52c5f1de-405a-410c-a531-902c5fde6d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:57.061140 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 433/841] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:46:57.331140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da693e47-9c56-42e8-82e5-dbc0706018a6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:57.409643 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:57.429834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da693e47-9c56-42e8-82e5-dbc0706018a6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:57.462617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac46cf-6d2d-4720-841e-19ac0ea30cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:57.463255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac46cf-6d2d-4720-841e-19ac0ea30cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:57.463564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac46cf-6d2d-4720-841e-19ac0ea30cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:57.463834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac46cf-6d2d-4720-841e-19ac0ea30cf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:57.464928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac46cf-6d2d-4720-841e-19ac0ea30cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:57.466345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac46cf-6d2d-4720-841e-19ac0ea30cf8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:57.467894 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 409/842] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:57.474364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5f1de-405a-410c-a531-902c5fde6d50 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:57.524158 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:57.570375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5f1de-405a-410c-a531-902c5fde6d50 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:57.604046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c99968-5262-404a-bca3-3a27d967a9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:57.604573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c99968-5262-404a-bca3-3a27d967a9a5 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:57.604847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c99968-5262-404a-bca3-3a27d967a9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:57.605115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c99968-5262-404a-bca3-3a27d967a9a5 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:57.605759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c99968-5262-404a-bca3-3a27d967a9a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:57.607192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c99968-5262-404a-bca3-3a27d967a9a5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:57.629250 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 434/843] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:46:57 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:59.783361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afbd13-e6a6-4601-8b46-378e618a3859 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:59.783883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afbd13-e6a6-4601-8b46-378e618a3859 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:59.783883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afbd13-e6a6-4601-8b46-378e618a3859 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:59.785225 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 410/844] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:59.790449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfd336-5a56-4964-9a28-0e5569be3c8e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:59.790846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfd336-5a56-4964-9a28-0e5569be3c8e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:59.791019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfd336-5a56-4964-9a28-0e5569be3c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:59.809070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-74cfd336-5a56-4964-9a28-0e5569be3c8e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:59.810309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-74cfd336-5a56-4964-9a28-0e5569be3c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:59.874204 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 435/845] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:00.144980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afbd13-e6a6-4601-8b46-378e618a3859 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:00.245213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afbd13-e6a6-4601-8b46-378e618a3859 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:00.277623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd1d9c-21d1-41c6-8631-ff952b9f2525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:00.278261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd1d9c-21d1-41c6-8631-ff952b9f2525 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:00.278537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd1d9c-21d1-41c6-8631-ff952b9f2525 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:00.278806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd1d9c-21d1-41c6-8631-ff952b9f2525 None admin] PATH_INFO: `/v3/roles/2ff561b5b0d24a468ca2bfa7d0788bd2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:00.280451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd1d9c-21d1-41c6-8631-ff952b9f2525 None admin] RBAC: Authorizing `identity:get_role(role_id=2ff561b5b0d24a468ca2bfa7d0788bd2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:00.282406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd1d9c-21d1-41c6-8631-ff952b9f2525 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:00.283728 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 411/846] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:47:00 2022] GET /identity/v3/roles/2ff561b5b0d24a468ca2bfa7d0788bd2 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:00.289511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfd336-5a56-4964-9a28-0e5569be3c8e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:00.326333 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:00.384316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfd336-5a56-4964-9a28-0e5569be3c8e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:00.418050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19d5ff-9bd6-42de-bdba-47f8d4625f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:00.418605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d5ff-9bd6-42de-bdba-47f8d4625f80 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:00.418880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d5ff-9bd6-42de-bdba-47f8d4625f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:00.419183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d5ff-9bd6-42de-bdba-47f8d4625f80 None admin] PATH_INFO: `/v3/users/640f83d23acc44bbb32927c419823ca6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:00.431740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19d5ff-9bd6-42de-bdba-47f8d4625f80 None admin] RBAC: Authorizing `identity:get_user(user_id=640f83d23acc44bbb32927c419823ca6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:00.433152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19d5ff-9bd6-42de-bdba-47f8d4625f80 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:00.434770 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 436/847] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:47:00 2022] GET /identity/v3/users/640f83d23acc44bbb32927c419823ca6 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:00.440659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd1d9c-21d1-41c6-8631-ff952b9f2525 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:00.459075 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:00.537849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd1d9c-21d1-41c6-8631-ff952b9f2525 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:00.571365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23888d-319c-45c9-807a-4f551d3f4293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:00.571990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23888d-319c-45c9-807a-4f551d3f4293 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:00.572268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23888d-319c-45c9-807a-4f551d3f4293 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:00.572537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23888d-319c-45c9-807a-4f551d3f4293 None admin] PATH_INFO: `/v3/projects/04b6b36de53f44228bfa48b10ec36c1b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:00.573633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23888d-319c-45c9-807a-4f551d3f4293 None admin] RBAC: Authorizing `identity:get_project(project_id=04b6b36de53f44228bfa48b10ec36c1b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:00.575082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23888d-319c-45c9-807a-4f551d3f4293 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:00.576688 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 412/848] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:47:00 2022] GET /identity/v3/projects/04b6b36de53f44228bfa48b10ec36c1b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:00.583556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19d5ff-9bd6-42de-bdba-47f8d4625f80 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:00.673921 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:00.679706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19d5ff-9bd6-42de-bdba-47f8d4625f80 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:00.712608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a457a83-0af3-43da-94a0-59cf07c48601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:00.713245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a457a83-0af3-43da-94a0-59cf07c48601 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:00.713523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a457a83-0af3-43da-94a0-59cf07c48601 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:00.713795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a457a83-0af3-43da-94a0-59cf07c48601 None admin] PATH_INFO: `/v3/projects/04b6b36de53f44228bfa48b10ec36c1b/users/640f83d23acc44bbb32927c419823ca6/roles/2ff561b5b0d24a468ca2bfa7d0788bd2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:00.715970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a457a83-0af3-43da-94a0-59cf07c48601 None admin] RBAC: Authorizing `identity:create_grant(project_id=04b6b36de53f44228bfa48b10ec36c1b, user_id=640f83d23acc44bbb32927c419823ca6, role_id=2ff561b5b0d24a468ca2bfa7d0788bd2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:00.717376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a457a83-0af3-43da-94a0-59cf07c48601 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:00.729278 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 437/849] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:47:00 2022] PUT /identity/v3/projects/04b6b36de53f44228bfa48b10ec36c1b/users/640f83d23acc44bbb32927c419823ca6/roles/2ff561b5b0d24a468ca2bfa7d0788bd2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:47:02.854279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80802924-5222-4549-af84-137c2bcbb79e None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:02.854824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80802924-5222-4549-af84-137c2bcbb79e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:02.854824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80802924-5222-4549-af84-137c2bcbb79e None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:02.856089 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 413/850] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:02.862113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398185-df48-45b4-b6d3-35993d40482f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:02.862525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398185-df48-45b4-b6d3-35993d40482f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:02.862660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398185-df48-45b4-b6d3-35993d40482f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:02.881140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-22398185-df48-45b4-b6d3-35993d40482f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:02.882301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22398185-df48-45b4-b6d3-35993d40482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:02.948236 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 438/851] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:03.222466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80802924-5222-4549-af84-137c2bcbb79e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:03.305202 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:03.322058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80802924-5222-4549-af84-137c2bcbb79e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:03.354293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb5791-a92d-432c-87b2-e3a94d6cdde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:03.354908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb5791-a92d-432c-87b2-e3a94d6cdde3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:03.355223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb5791-a92d-432c-87b2-e3a94d6cdde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:03.355498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb5791-a92d-432c-87b2-e3a94d6cdde3 None admin] PATH_INFO: `/v3/roles/2ff561b5b0d24a468ca2bfa7d0788bd2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:03.356868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb5791-a92d-432c-87b2-e3a94d6cdde3 None admin] RBAC: Authorizing `identity:get_role(role_id=2ff561b5b0d24a468ca2bfa7d0788bd2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:03.358224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb5791-a92d-432c-87b2-e3a94d6cdde3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:03.360093 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 414/852] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:47:03 2022] GET /identity/v3/roles/2ff561b5b0d24a468ca2bfa7d0788bd2 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:03.365990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22398185-df48-45b4-b6d3-35993d40482f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:03.446254 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:03.461446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22398185-df48-45b4-b6d3-35993d40482f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:03.493618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896671e-5d38-4394-bd8f-64dc4d8985c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:03.494160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896671e-5d38-4394-bd8f-64dc4d8985c6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:03.494434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896671e-5d38-4394-bd8f-64dc4d8985c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:03.494700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896671e-5d38-4394-bd8f-64dc4d8985c6 None admin] PATH_INFO: `/v3/users/640f83d23acc44bbb32927c419823ca6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:03.495818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896671e-5d38-4394-bd8f-64dc4d8985c6 None admin] RBAC: Authorizing `identity:get_user(user_id=640f83d23acc44bbb32927c419823ca6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:03.497215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896671e-5d38-4394-bd8f-64dc4d8985c6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:03.498747 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 439/853] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:47:03 2022] GET /identity/v3/users/640f83d23acc44bbb32927c419823ca6 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:03.505137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb5791-a92d-432c-87b2-e3a94d6cdde3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:03.602364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb5791-a92d-432c-87b2-e3a94d6cdde3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:03.635211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072a849-5df1-4ef4-9f58-cfcf81114303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:03.635808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072a849-5df1-4ef4-9f58-cfcf81114303 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:03.636086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072a849-5df1-4ef4-9f58-cfcf81114303 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:03.636360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072a849-5df1-4ef4-9f58-cfcf81114303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:03.657173 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:03.701402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072a849-5df1-4ef4-9f58-cfcf81114303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:03.702842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072a849-5df1-4ef4-9f58-cfcf81114303 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:03.796653 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 415/854] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:47:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:47:03.803321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896671e-5d38-4394-bd8f-64dc4d8985c6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:03.897928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896671e-5d38-4394-bd8f-64dc4d8985c6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:03.931425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b577e-d060-42ce-8fcf-6bb5f552c824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:03.932026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b577e-d060-42ce-8fcf-6bb5f552c824 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:03.932302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b577e-d060-42ce-8fcf-6bb5f552c824 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:03.932572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b577e-d060-42ce-8fcf-6bb5f552c824 None admin] PATH_INFO: `/v3/projects/04b6b36de53f44228bfa48b10ec36c1b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:03.933654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b577e-d060-42ce-8fcf-6bb5f552c824 None admin] RBAC: Authorizing `identity:get_project(project_id=04b6b36de53f44228bfa48b10ec36c1b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:03.935089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b577e-d060-42ce-8fcf-6bb5f552c824 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:03.936665 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 440/855] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:47:03 2022] GET /identity/v3/projects/04b6b36de53f44228bfa48b10ec36c1b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:03.943608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072a849-5df1-4ef4-9f58-cfcf81114303 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:03.993817 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:04.039443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072a849-5df1-4ef4-9f58-cfcf81114303 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:04.071942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d128b5-1aec-4979-9163-654b498d3261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:04.072472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d128b5-1aec-4979-9163-654b498d3261 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:04.072749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d128b5-1aec-4979-9163-654b498d3261 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:04.073019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d128b5-1aec-4979-9163-654b498d3261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:04.073724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d128b5-1aec-4979-9163-654b498d3261 None admin] RBAC: Adding query filter params (role.id=2ff561b5b0d24a468ca2bfa7d0788bd2, scope.project.id=04b6b36de53f44228bfa48b10ec36c1b, user.id=640f83d23acc44bbb32927c419823ca6) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:04.074028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d128b5-1aec-4979-9163-654b498d3261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:04.075478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d128b5-1aec-4979-9163-654b498d3261 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:04.081475 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 416/856] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:47:03 2022] GET /identity/v3/role_assignments?user.id=640f83d23acc44bbb32927c419823ca6&scope.project.id=04b6b36de53f44228bfa48b10ec36c1b&role.id=2ff561b5b0d24a468ca2bfa7d0788bd2 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:06.223599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758789e-9199-4d97-8c61-9ba29ce675ee None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:06.224441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758789e-9199-4d97-8c61-9ba29ce675ee None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:06.224441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758789e-9199-4d97-8c61-9ba29ce675ee None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:06.225446 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 441/857] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:06.230834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ca403-7635-4af5-973f-41ae4f4d12bf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:06.231298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ca403-7635-4af5-973f-41ae4f4d12bf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:06.231389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ca403-7635-4af5-973f-41ae4f4d12bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:06.255468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e32ca403-7635-4af5-973f-41ae4f4d12bf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:06.256637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e32ca403-7635-4af5-973f-41ae4f4d12bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:06.326556 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 417/858] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:06.622941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758789e-9199-4d97-8c61-9ba29ce675ee None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:06.651296 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:06.740305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758789e-9199-4d97-8c61-9ba29ce675ee None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:06.776889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad065b3-b769-487f-934e-721596a1ce25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:06.777514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad065b3-b769-487f-934e-721596a1ce25 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:06.777787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad065b3-b769-487f-934e-721596a1ce25 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:06.778116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad065b3-b769-487f-934e-721596a1ce25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:06.779754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad065b3-b769-487f-934e-721596a1ce25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:06.782051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad065b3-b769-487f-934e-721596a1ce25 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:06.783651 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 442/859] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:06.790137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ca403-7635-4af5-973f-41ae4f4d12bf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:06.840062 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:06.897566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ca403-7635-4af5-973f-41ae4f4d12bf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:06.931745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e7b5a-a49c-42ec-8225-feee60d413b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:06.932346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e7b5a-a49c-42ec-8225-feee60d413b5 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:06.932623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e7b5a-a49c-42ec-8225-feee60d413b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:06.932895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e7b5a-a49c-42ec-8225-feee60d413b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:06.933548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e7b5a-a49c-42ec-8225-feee60d413b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:06.935000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e7b5a-a49c-42ec-8225-feee60d413b5 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:06.961711 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 418/860] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:47:06 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:47:09.146001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16a85-c219-4a69-919a-db7ea2091de0 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:09.146602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16a85-c219-4a69-919a-db7ea2091de0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:09.146602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16a85-c219-4a69-919a-db7ea2091de0 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:09.147907 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 443/861] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:09.153120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dccc0-10b9-4bd7-88d1-732164d50b43 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:09.153556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dccc0-10b9-4bd7-88d1-732164d50b43 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:09.153666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dccc0-10b9-4bd7-88d1-732164d50b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:09.172691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3f9dccc0-10b9-4bd7-88d1-732164d50b43 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:09.173850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3f9dccc0-10b9-4bd7-88d1-732164d50b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:09.238348 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 419/862] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:09.502269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d16a85-c219-4a69-919a-db7ea2091de0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:09.592115 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:09.603414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d16a85-c219-4a69-919a-db7ea2091de0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:09.636291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090357f-6493-47c0-bad8-73e92bf402c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:09.636895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090357f-6493-47c0-bad8-73e92bf402c9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:09.637170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090357f-6493-47c0-bad8-73e92bf402c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:09.637466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090357f-6493-47c0-bad8-73e92bf402c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:09.638537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090357f-6493-47c0-bad8-73e92bf402c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:09.639976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090357f-6493-47c0-bad8-73e92bf402c9 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:09.642503 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 444/863] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:47:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:09.648223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dccc0-10b9-4bd7-88d1-732164d50b43 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:09.675310 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:09.745743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dccc0-10b9-4bd7-88d1-732164d50b43 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:09.779352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a77ca6-1e4f-4eea-afe3-b02b4636e254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:09.780138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a77ca6-1e4f-4eea-afe3-b02b4636e254 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:09.780417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a77ca6-1e4f-4eea-afe3-b02b4636e254 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:09.780683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a77ca6-1e4f-4eea-afe3-b02b4636e254 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:09.781833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a77ca6-1e4f-4eea-afe3-b02b4636e254 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:09.783282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a77ca6-1e4f-4eea-afe3-b02b4636e254 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:09.802857 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 420/864] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:47:09 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:47:11.967439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a6554-364d-4980-bc06-4cadbbd200e1 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:11.967961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a6554-364d-4980-bc06-4cadbbd200e1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:11.967961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a6554-364d-4980-bc06-4cadbbd200e1 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:11.969208 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 445/865] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:11.974372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ee024-f1bb-4809-9c8d-11246bab5157 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:11.974791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ee024-f1bb-4809-9c8d-11246bab5157 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:11.974939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ee024-f1bb-4809-9c8d-11246bab5157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:11.992544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-437ee024-f1bb-4809-9c8d-11246bab5157 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:11.993716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-437ee024-f1bb-4809-9c8d-11246bab5157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:12.057764 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 421/866] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:12.328800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a6554-364d-4980-bc06-4cadbbd200e1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:12.427687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a6554-364d-4980-bc06-4cadbbd200e1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:12.461041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea8a18-d92b-4fba-b113-fd094f64ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:12.461680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea8a18-d92b-4fba-b113-fd094f64ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:12.462016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea8a18-d92b-4fba-b113-fd094f64ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:12.462288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea8a18-d92b-4fba-b113-fd094f64ffe4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:12.472624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea8a18-d92b-4fba-b113-fd094f64ffe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-abea8a18-d92b-4fba-b113-fd094f64ffe4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:47:12.477355 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:12.478469 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:12.479746 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:12.479746 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:12.479746 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:12.479746 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:12.479746 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:47:12.479746 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:47:12.479746 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:47:12.479746 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:47:12.479746 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:47:12.479746 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:47:12.479746 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:47:12.479746 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:47:12.479746 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 446/867] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:47:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:12.484898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ee024-f1bb-4809-9c8d-11246bab5157 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:12.499493 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:12.582045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ee024-f1bb-4809-9c8d-11246bab5157 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:12.615182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8fc95-5b25-44cb-902e-33097be3d764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:12.615780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8fc95-5b25-44cb-902e-33097be3d764 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:12.616059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8fc95-5b25-44cb-902e-33097be3d764 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:12.616331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8fc95-5b25-44cb-902e-33097be3d764 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:12.616985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8fc95-5b25-44cb-902e-33097be3d764 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:12.617288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8fc95-5b25-44cb-902e-33097be3d764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:12.618643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8fc95-5b25-44cb-902e-33097be3d764 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:12.627230 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 422/868] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:47:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:12.633097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea8a18-d92b-4fba-b113-fd094f64ffe4 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:12.651953 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:12.730224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea8a18-d92b-4fba-b113-fd094f64ffe4 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:12.764390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb1ade-a835-458e-b62e-d075e15b14b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:12.765002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb1ade-a835-458e-b62e-d075e15b14b6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:12.765282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb1ade-a835-458e-b62e-d075e15b14b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:12.765676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb1ade-a835-458e-b62e-d075e15b14b6 None admin] PATH_INFO: `/v3/users/c86775446ab6468ea91dba3577668973` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:12.778323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb1ade-a835-458e-b62e-d075e15b14b6 None admin] RBAC: Authorizing `identity:get_user(user_id=c86775446ab6468ea91dba3577668973)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:12.779783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb1ade-a835-458e-b62e-d075e15b14b6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:12.782419 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 447/869] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:47:12 2022] GET /identity/v3/users/c86775446ab6468ea91dba3577668973 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:12.788050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8fc95-5b25-44cb-902e-33097be3d764 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:12.864476 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:12.888786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8fc95-5b25-44cb-902e-33097be3d764 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:12.923742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44919c70-1512-46d4-ae0c-e348950755ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:12.924363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44919c70-1512-46d4-ae0c-e348950755ea None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:12.924642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44919c70-1512-46d4-ae0c-e348950755ea None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:12.924914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44919c70-1512-46d4-ae0c-e348950755ea None admin] PATH_INFO: `/v3/projects/0160eea723d5466ab281b4678192e116` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:12.926021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44919c70-1512-46d4-ae0c-e348950755ea None admin] RBAC: Authorizing `identity:get_project(project_id=0160eea723d5466ab281b4678192e116)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:12.927488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44919c70-1512-46d4-ae0c-e348950755ea None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:12.929086 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 423/870] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:47:12 2022] GET /identity/v3/projects/0160eea723d5466ab281b4678192e116 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:12.934999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb1ade-a835-458e-b62e-d075e15b14b6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:13.007612 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:13.029889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb1ade-a835-458e-b62e-d075e15b14b6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:13.062721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05360cb-d9b7-4387-854b-6e5c9e25cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:13.063381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05360cb-d9b7-4387-854b-6e5c9e25cd7d None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:13.063657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05360cb-d9b7-4387-854b-6e5c9e25cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:13.063924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05360cb-d9b7-4387-854b-6e5c9e25cd7d None admin] PATH_INFO: `/v3/projects/0160eea723d5466ab281b4678192e116/users/c86775446ab6468ea91dba3577668973/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:13.065785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05360cb-d9b7-4387-854b-6e5c9e25cd7d None admin] RBAC: Authorizing `identity:create_grant(project_id=0160eea723d5466ab281b4678192e116, user_id=c86775446ab6468ea91dba3577668973, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:13.067210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05360cb-d9b7-4387-854b-6e5c9e25cd7d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:13.080225 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 448/871] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:47:12 2022] PUT /identity/v3/projects/0160eea723d5466ab281b4678192e116/users/c86775446ab6468ea91dba3577668973/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:47:15.200026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fad1bd-e3e0-4d5a-8e7f-ceaf60a0ab08 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:15.200655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fad1bd-e3e0-4d5a-8e7f-ceaf60a0ab08 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:15.200655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fad1bd-e3e0-4d5a-8e7f-ceaf60a0ab08 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:15.202228 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 424/872] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:47:15.208942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335a0ed-f81a-42f0-8249-ecf56dcc8b92 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:15.209394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335a0ed-f81a-42f0-8249-ecf56dcc8b92 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:15.209493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335a0ed-f81a-42f0-8249-ecf56dcc8b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:15.227158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4335a0ed-f81a-42f0-8249-ecf56dcc8b92 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:15.228323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4335a0ed-f81a-42f0-8249-ecf56dcc8b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:15.292576 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 449/873] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:15.562164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fad1bd-e3e0-4d5a-8e7f-ceaf60a0ab08 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:15.661042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fad1bd-e3e0-4d5a-8e7f-ceaf60a0ab08 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:15.693541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb9cc7-2fd2-4756-859c-aeb3c3bf3a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:15.694152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9cc7-2fd2-4756-859c-aeb3c3bf3a3a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:15.694429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9cc7-2fd2-4756-859c-aeb3c3bf3a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:15.694699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9cc7-2fd2-4756-859c-aeb3c3bf3a3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:15.705093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb9cc7-2fd2-4756-859c-aeb3c3bf3a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-d6bb9cc7-2fd2-4756-859c-aeb3c3bf3a3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:47:15.709873 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:15.711034 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:15.711946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:15.711946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:15.711946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:15.711946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:15.711946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:47:15.711946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:47:15.711946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:47:15.711946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:47:15.711946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:47:15.711946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:47:15.711946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:47:15.711946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:47:15.711946 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 425/874] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:47:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:15.716862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335a0ed-f81a-42f0-8249-ecf56dcc8b92 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:15.779242 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:15.813344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335a0ed-f81a-42f0-8249-ecf56dcc8b92 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:15.846338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c504635-8de5-435d-b531-2c724c7001aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:15.846949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c504635-8de5-435d-b531-2c724c7001aa None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:15.847232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c504635-8de5-435d-b531-2c724c7001aa None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:15.847506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c504635-8de5-435d-b531-2c724c7001aa None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:15.848159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c504635-8de5-435d-b531-2c724c7001aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:15.848464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c504635-8de5-435d-b531-2c724c7001aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:15.849822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c504635-8de5-435d-b531-2c724c7001aa None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:15.857470 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 450/875] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:47:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:15.863252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb9cc7-2fd2-4756-859c-aeb3c3bf3a3a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:15.868241 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:15.961482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb9cc7-2fd2-4756-859c-aeb3c3bf3a3a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:15.994065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b3324-b8fd-4f3a-9550-dfb0587bd449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:15.994676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3324-b8fd-4f3a-9550-dfb0587bd449 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:15.994976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3324-b8fd-4f3a-9550-dfb0587bd449 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:15.995248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3324-b8fd-4f3a-9550-dfb0587bd449 None admin] PATH_INFO: `/v3/users/c86775446ab6468ea91dba3577668973` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:15.996338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b3324-b8fd-4f3a-9550-dfb0587bd449 None admin] RBAC: Authorizing `identity:get_user(user_id=c86775446ab6468ea91dba3577668973)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:15.997753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b3324-b8fd-4f3a-9550-dfb0587bd449 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:15.999315 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 426/876] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:47:15 2022] GET /identity/v3/users/c86775446ab6468ea91dba3577668973 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:16.005713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c504635-8de5-435d-b531-2c724c7001aa None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:16.100811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c504635-8de5-435d-b531-2c724c7001aa None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:16.126214 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:16.134110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe421b9-fef9-47e8-80bd-53770ddead1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:16.134696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe421b9-fef9-47e8-80bd-53770ddead1e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:16.135008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe421b9-fef9-47e8-80bd-53770ddead1e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:16.135283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe421b9-fef9-47e8-80bd-53770ddead1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:16.199596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe421b9-fef9-47e8-80bd-53770ddead1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:16.201023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe421b9-fef9-47e8-80bd-53770ddead1e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:16.293723 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 451/877] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:47:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:47:16.300220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b3324-b8fd-4f3a-9550-dfb0587bd449 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:16.367617 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:16.397670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b3324-b8fd-4f3a-9550-dfb0587bd449 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:16.429647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadd884-e661-4adf-8f9c-be78d7c772a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:16.430258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadd884-e661-4adf-8f9c-be78d7c772a0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:16.430531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadd884-e661-4adf-8f9c-be78d7c772a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:16.430797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadd884-e661-4adf-8f9c-be78d7c772a0 None admin] PATH_INFO: `/v3/projects/0160eea723d5466ab281b4678192e116` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:16.431943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadd884-e661-4adf-8f9c-be78d7c772a0 None admin] RBAC: Authorizing `identity:get_project(project_id=0160eea723d5466ab281b4678192e116)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:16.433349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadd884-e661-4adf-8f9c-be78d7c772a0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:16.434935 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 427/878] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:47:16 2022] GET /identity/v3/projects/0160eea723d5466ab281b4678192e116 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:16.441600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe421b9-fef9-47e8-80bd-53770ddead1e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:16.468145 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:16.539153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe421b9-fef9-47e8-80bd-53770ddead1e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:16.573367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece477d-40d8-4b7d-805e-fcc7a888d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:16.573961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece477d-40d8-4b7d-805e-fcc7a888d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:16.574236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece477d-40d8-4b7d-805e-fcc7a888d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:16.574543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece477d-40d8-4b7d-805e-fcc7a888d9e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:16.575278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece477d-40d8-4b7d-805e-fcc7a888d9e3 None admin] RBAC: Adding query filter params (role.id=3b2c8c93a1c54611871c4299008b2abf, scope.project.id=0160eea723d5466ab281b4678192e116, user.id=c86775446ab6468ea91dba3577668973) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:16.575584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece477d-40d8-4b7d-805e-fcc7a888d9e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:16.577017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece477d-40d8-4b7d-805e-fcc7a888d9e3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:16.583453 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 452/879] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:47:16 2022] GET /identity/v3/role_assignments?user.id=c86775446ab6468ea91dba3577668973&scope.project.id=0160eea723d5466ab281b4678192e116&role.id=3b2c8c93a1c54611871c4299008b2abf => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:18.724654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74890a57-9b70-4b8a-8188-4148d55ce1a6 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:18.725171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74890a57-9b70-4b8a-8188-4148d55ce1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:18.725171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74890a57-9b70-4b8a-8188-4148d55ce1a6 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:18.726508 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 428/880] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:18.731880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21b480-bb5c-44b2-8a20-ec7320ec246e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:18.732275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21b480-bb5c-44b2-8a20-ec7320ec246e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:18.732424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21b480-bb5c-44b2-8a20-ec7320ec246e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:18.750548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ad21b480-bb5c-44b2-8a20-ec7320ec246e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:18.751744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ad21b480-bb5c-44b2-8a20-ec7320ec246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:18.816332 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 453/881] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:19.084946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74890a57-9b70-4b8a-8188-4148d55ce1a6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:19.182786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74890a57-9b70-4b8a-8188-4148d55ce1a6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:19.215434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7825c5-b8f5-48a9-8a42-036018262a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:19.216022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7825c5-b8f5-48a9-8a42-036018262a93 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:19.216298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7825c5-b8f5-48a9-8a42-036018262a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:19.216567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7825c5-b8f5-48a9-8a42-036018262a93 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:19.217225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7825c5-b8f5-48a9-8a42-036018262a93 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:19.219169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7825c5-b8f5-48a9-8a42-036018262a93 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:19.228908 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:19.235508 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 429/882] 10.222.0.39 () {60 vars in 1138 bytes} [Sun Oct 16 00:47:19 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:47:21.395970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061e2f-8d09-47a2-bd05-aabeec9fbb13 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:21.396542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061e2f-8d09-47a2-bd05-aabeec9fbb13 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:21.396542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061e2f-8d09-47a2-bd05-aabeec9fbb13 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:21.397842 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 454/883] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:21.403146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ba534-42e8-43ca-99ec-1061d600700b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:21.403531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ba534-42e8-43ca-99ec-1061d600700b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:21.403702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ba534-42e8-43ca-99ec-1061d600700b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:21.422388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-878ba534-42e8-43ca-99ec-1061d600700b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:21.423597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-878ba534-42e8-43ca-99ec-1061d600700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:21.487353 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 430/884] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:21.757128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77061e2f-8d09-47a2-bd05-aabeec9fbb13 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:21.780866 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:21.855368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77061e2f-8d09-47a2-bd05-aabeec9fbb13 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:21.887730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf47d5-e443-47c3-b0ed-4143ac04b1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:21.888336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf47d5-e443-47c3-b0ed-4143ac04b1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:21.888613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf47d5-e443-47c3-b0ed-4143ac04b1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:21.888883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf47d5-e443-47c3-b0ed-4143ac04b1a5 None admin] PATH_INFO: `/v3/domains/571a57c745cf4d609caf88e6f4b29893` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:21.899230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf47d5-e443-47c3-b0ed-4143ac04b1a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=571a57c745cf4d609caf88e6f4b29893)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:21.900648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf47d5-e443-47c3-b0ed-4143ac04b1a5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:21.902181 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 455/885] 10.222.0.39 () {56 vars in 1183 bytes} [Sun Oct 16 00:47:21 2022] GET /identity/v3/domains/571a57c745cf4d609caf88e6f4b29893 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:21.908691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ba534-42e8-43ca-99ec-1061d600700b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:22.003946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ba534-42e8-43ca-99ec-1061d600700b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:22.032376 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:22.038293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccad45-8826-4e36-8f88-cb44d90fadf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:22.038886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccad45-8826-4e36-8f88-cb44d90fadf0 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:22.039196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccad45-8826-4e36-8f88-cb44d90fadf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:22.039468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccad45-8826-4e36-8f88-cb44d90fadf0 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:22.040108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccad45-8826-4e36-8f88-cb44d90fadf0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:22.041518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccad45-8826-4e36-8f88-cb44d90fadf0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:22.067472 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 431/886] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:47:21 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:47:24.223446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414cfba-89ce-4a63-b566-9cdd4bb15c5e None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:24.223999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414cfba-89ce-4a63-b566-9cdd4bb15c5e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:24.223999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414cfba-89ce-4a63-b566-9cdd4bb15c5e None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:24.225299 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 456/887] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:24.230589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d344b-57ca-4b00-bda6-f4bebd5d2589 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:24.230998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d344b-57ca-4b00-bda6-f4bebd5d2589 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:24.231166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d344b-57ca-4b00-bda6-f4bebd5d2589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:24.250315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8c8d344b-57ca-4b00-bda6-f4bebd5d2589 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:24.251509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8c8d344b-57ca-4b00-bda6-f4bebd5d2589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:24.315116 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 432/888] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:24.583113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414cfba-89ce-4a63-b566-9cdd4bb15c5e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:24.664809 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:24.683917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414cfba-89ce-4a63-b566-9cdd4bb15c5e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:24.715886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4dc00a-5525-4a19-b51e-7a5936050b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:24.716491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dc00a-5525-4a19-b51e-7a5936050b26 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:24.716764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dc00a-5525-4a19-b51e-7a5936050b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:24.717026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dc00a-5525-4a19-b51e-7a5936050b26 None admin] PATH_INFO: `/v3/domains/571a57c745cf4d609caf88e6f4b29893` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:24.718200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4dc00a-5525-4a19-b51e-7a5936050b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=571a57c745cf4d609caf88e6f4b29893)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:24.720335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4dc00a-5525-4a19-b51e-7a5936050b26 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:24.721875 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 457/889] 10.222.0.39 () {56 vars in 1183 bytes} [Sun Oct 16 00:47:24 2022] GET /identity/v3/domains/571a57c745cf4d609caf88e6f4b29893 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:24.727663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d344b-57ca-4b00-bda6-f4bebd5d2589 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:24.823759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d344b-57ca-4b00-bda6-f4bebd5d2589 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:24.836514 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:24.859040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc091ba-730c-4bb8-9f24-3d83c84fded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:24.860240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc091ba-730c-4bb8-9f24-3d83c84fded4 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:24.860518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc091ba-730c-4bb8-9f24-3d83c84fded4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:24.860787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc091ba-730c-4bb8-9f24-3d83c84fded4 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:24.861421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc091ba-730c-4bb8-9f24-3d83c84fded4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:24.862832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc091ba-730c-4bb8-9f24-3d83c84fded4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:24.882797 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 433/890] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:47:24 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:47:27.103032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca8739-81fa-4bc2-b1d8-402677fb108a None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:27.103580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca8739-81fa-4bc2-b1d8-402677fb108a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:27.103580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca8739-81fa-4bc2-b1d8-402677fb108a None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:27.104898 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 458/891] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:27.110379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899ac5-c828-461c-8bf5-dc2511af23cc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:27.110756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899ac5-c828-461c-8bf5-dc2511af23cc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:27.110954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899ac5-c828-461c-8bf5-dc2511af23cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:27.129007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b8899ac5-c828-461c-8bf5-dc2511af23cc None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:27.130212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b8899ac5-c828-461c-8bf5-dc2511af23cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:27.194295 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 434/892] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:27.461058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca8739-81fa-4bc2-b1d8-402677fb108a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:27.560019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca8739-81fa-4bc2-b1d8-402677fb108a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:27.592437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd1e31-0f35-4bb2-9a33-2d655911d8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:27.593049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1e31-0f35-4bb2-9a33-2d655911d8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:27.593328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1e31-0f35-4bb2-9a33-2d655911d8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:27.593601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1e31-0f35-4bb2-9a33-2d655911d8f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:27.603680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd1e31-0f35-4bb2-9a33-2d655911d8f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e3cd1e31-0f35-4bb2-9a33-2d655911d8f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:47:27.608375 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:27.610080 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:27.611153 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:27.611153 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:27.611153 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:27.611153 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:27.611153 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:47:27.611153 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:47:27.611153 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:47:27.611153 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:47:27.611153 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:47:27.611153 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:47:27.611153 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:47:27.611153 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:47:27.611153 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 459/893] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:47:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:27.616169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8899ac5-c828-461c-8bf5-dc2511af23cc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:27.713752 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:27.717518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8899ac5-c828-461c-8bf5-dc2511af23cc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:27.752218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32465e-5187-4a9d-a3e6-9c9b41538553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:27.752814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32465e-5187-4a9d-a3e6-9c9b41538553 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:27.753093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32465e-5187-4a9d-a3e6-9c9b41538553 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:27.753363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32465e-5187-4a9d-a3e6-9c9b41538553 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:27.754012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32465e-5187-4a9d-a3e6-9c9b41538553 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:27.754314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32465e-5187-4a9d-a3e6-9c9b41538553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:27.755734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32465e-5187-4a9d-a3e6-9c9b41538553 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:27.763455 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 435/894] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:47:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:27.769225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd1e31-0f35-4bb2-9a33-2d655911d8f8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:27.782657 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:27.872612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd1e31-0f35-4bb2-9a33-2d655911d8f8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:27.908546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215363db-8b4f-4dae-86bf-c53862e662fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:27.910674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215363db-8b4f-4dae-86bf-c53862e662fd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:27.911011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215363db-8b4f-4dae-86bf-c53862e662fd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:27.911289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215363db-8b4f-4dae-86bf-c53862e662fd None admin] PATH_INFO: `/v3/users/dba02c1fcadc4b99b9181c9e33248165` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:27.928413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215363db-8b4f-4dae-86bf-c53862e662fd None admin] RBAC: Authorizing `identity:get_user(user_id=dba02c1fcadc4b99b9181c9e33248165)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:27.929869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215363db-8b4f-4dae-86bf-c53862e662fd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:27.931521 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 460/895] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:47:27 2022] GET /identity/v3/users/dba02c1fcadc4b99b9181c9e33248165 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:27.938261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32465e-5187-4a9d-a3e6-9c9b41538553 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:28.035926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32465e-5187-4a9d-a3e6-9c9b41538553 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:28.067710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe08518-eba2-4f9b-944d-34d70de51165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:28.068330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe08518-eba2-4f9b-944d-34d70de51165 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:28.068607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe08518-eba2-4f9b-944d-34d70de51165 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:28.068878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe08518-eba2-4f9b-944d-34d70de51165 None admin] PATH_INFO: `/v3/projects/60f0814992f6408db3a68097a75f6759` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:28.069978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe08518-eba2-4f9b-944d-34d70de51165 None admin] RBAC: Authorizing `identity:get_project(project_id=60f0814992f6408db3a68097a75f6759)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:28.071432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe08518-eba2-4f9b-944d-34d70de51165 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:28.073029 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 436/896] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:47:27 2022] GET /identity/v3/projects/60f0814992f6408db3a68097a75f6759 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:28.079519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215363db-8b4f-4dae-86bf-c53862e662fd None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:28.144229 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:28.179496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215363db-8b4f-4dae-86bf-c53862e662fd None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:28.231261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d8398-7913-4446-b3bb-5a164c74c9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:28.231949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d8398-7913-4446-b3bb-5a164c74c9ae None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:28.232247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d8398-7913-4446-b3bb-5a164c74c9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:28.232659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d8398-7913-4446-b3bb-5a164c74c9ae None admin] PATH_INFO: `/v3/projects/60f0814992f6408db3a68097a75f6759/users/dba02c1fcadc4b99b9181c9e33248165/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:28.235269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d8398-7913-4446-b3bb-5a164c74c9ae None admin] RBAC: Authorizing `identity:create_grant(project_id=60f0814992f6408db3a68097a75f6759, user_id=dba02c1fcadc4b99b9181c9e33248165, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:28.236747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d8398-7913-4446-b3bb-5a164c74c9ae None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:28.254310 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 461/897] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:47:28 2022] PUT /identity/v3/projects/60f0814992f6408db3a68097a75f6759/users/dba02c1fcadc4b99b9181c9e33248165/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:47:30.403609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8b063-e016-4d1e-a6a8-ad63ea355ac4 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:30.404166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8b063-e016-4d1e-a6a8-ad63ea355ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:30.404166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8b063-e016-4d1e-a6a8-ad63ea355ac4 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:30.405745 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 437/898] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:30.411075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9712dd-9a46-4f70-8c30-9280756a39eb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:30.411477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9712dd-9a46-4f70-8c30-9280756a39eb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:30.411629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9712dd-9a46-4f70-8c30-9280756a39eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:30.429664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9f9712dd-9a46-4f70-8c30-9280756a39eb None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:30.430828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9f9712dd-9a46-4f70-8c30-9280756a39eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:30.494068 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 462/899] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:47:30.766838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8b063-e016-4d1e-a6a8-ad63ea355ac4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:30.794424 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:30.865141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8b063-e016-4d1e-a6a8-ad63ea355ac4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:30.899493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72820e-3978-419a-806e-7597473c0239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:30.900104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72820e-3978-419a-806e-7597473c0239 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:30.900378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72820e-3978-419a-806e-7597473c0239 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:30.900644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72820e-3978-419a-806e-7597473c0239 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:30.910899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72820e-3978-419a-806e-7597473c0239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-ce72820e-3978-419a-806e-7597473c0239 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:47:30.915523 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:47:30.916599 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:47:30.917620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:47:30.917620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:47:30.917620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:47:30.917620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:47:30.917620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:47:30.917620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:47:30.917620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:47:30.917620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:47:30.917620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:47:30.917620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:47:30.917620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:47:30.917620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:47:30.917620 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 438/900] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:47:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:47:30.922678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9712dd-9a46-4f70-8c30-9280756a39eb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:30.978021 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:31.018522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9712dd-9a46-4f70-8c30-9280756a39eb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:31.051046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05c76c-26e3-4cf9-9bc2-76f75149ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:31.051634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05c76c-26e3-4cf9-9bc2-76f75149ad93 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:31.051908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05c76c-26e3-4cf9-9bc2-76f75149ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:31.052177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05c76c-26e3-4cf9-9bc2-76f75149ad93 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:31.052824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05c76c-26e3-4cf9-9bc2-76f75149ad93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:31.053123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05c76c-26e3-4cf9-9bc2-76f75149ad93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:31.054468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05c76c-26e3-4cf9-9bc2-76f75149ad93 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:31.062068 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 463/901] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:47:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:47:31.067827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72820e-3978-419a-806e-7597473c0239 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:31.152025 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:31.164810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72820e-3978-419a-806e-7597473c0239 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:31.196993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffb899-6440-4c72-8bf1-de7b912a55cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:31.197608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffb899-6440-4c72-8bf1-de7b912a55cd None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:31.197884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffb899-6440-4c72-8bf1-de7b912a55cd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:31.198153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffb899-6440-4c72-8bf1-de7b912a55cd None admin] PATH_INFO: `/v3/users/dba02c1fcadc4b99b9181c9e33248165` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:31.199315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffb899-6440-4c72-8bf1-de7b912a55cd None admin] RBAC: Authorizing `identity:get_user(user_id=dba02c1fcadc4b99b9181c9e33248165)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:31.200733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffb899-6440-4c72-8bf1-de7b912a55cd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:31.202275 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 439/902] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Oct 16 00:47:31 2022] GET /identity/v3/users/dba02c1fcadc4b99b9181c9e33248165 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:31.208503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05c76c-26e3-4cf9-9bc2-76f75149ad93 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:31.303888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05c76c-26e3-4cf9-9bc2-76f75149ad93 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:31.322211 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:31.336754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0332e3c-8af4-49a4-85c5-cb608b5b568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:31.337344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0332e3c-8af4-49a4-85c5-cb608b5b568b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:31.337619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0332e3c-8af4-49a4-85c5-cb608b5b568b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:31.337886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0332e3c-8af4-49a4-85c5-cb608b5b568b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:31.401536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0332e3c-8af4-49a4-85c5-cb608b5b568b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:31.403045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0332e3c-8af4-49a4-85c5-cb608b5b568b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:31.496413 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 464/903] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:47:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:47:31.502777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffb899-6440-4c72-8bf1-de7b912a55cd None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:31.602431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffb899-6440-4c72-8bf1-de7b912a55cd None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:31.634695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b46927-8318-4fb7-883d-08e734a3faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:31.635336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46927-8318-4fb7-883d-08e734a3faaf None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:31.635620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46927-8318-4fb7-883d-08e734a3faaf None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:31.635889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46927-8318-4fb7-883d-08e734a3faaf None admin] PATH_INFO: `/v3/projects/60f0814992f6408db3a68097a75f6759` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:31.636973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b46927-8318-4fb7-883d-08e734a3faaf None admin] RBAC: Authorizing `identity:get_project(project_id=60f0814992f6408db3a68097a75f6759)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:31.638383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b46927-8318-4fb7-883d-08e734a3faaf None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:31.639998 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 440/904] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Oct 16 00:47:31 2022] GET /identity/v3/projects/60f0814992f6408db3a68097a75f6759 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:31.646600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0332e3c-8af4-49a4-85c5-cb608b5b568b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:31.667273 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:31.744284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0332e3c-8af4-49a4-85c5-cb608b5b568b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:31.777221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d9ecf-639a-486a-96fb-a105bdda0522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:31.777809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d9ecf-639a-486a-96fb-a105bdda0522 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:31.778087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d9ecf-639a-486a-96fb-a105bdda0522 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:31.778356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d9ecf-639a-486a-96fb-a105bdda0522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:31.779093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d9ecf-639a-486a-96fb-a105bdda0522 None admin] RBAC: Adding query filter params (role.id=3b2c8c93a1c54611871c4299008b2abf, scope.project.id=60f0814992f6408db3a68097a75f6759, user.id=dba02c1fcadc4b99b9181c9e33248165) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:47:31.779400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d9ecf-639a-486a-96fb-a105bdda0522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:31.781108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d9ecf-639a-486a-96fb-a105bdda0522 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:31.786674 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 465/905] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:47:31 2022] GET /identity/v3/role_assignments?user.id=dba02c1fcadc4b99b9181c9e33248165&scope.project.id=60f0814992f6408db3a68097a75f6759&role.id=3b2c8c93a1c54611871c4299008b2abf => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:47:41.631070 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:41.784134 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=58 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:27.454976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6ef75-d5b3-4bba-a761-9fbee7015f5d None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:27.454976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6ef75-d5b3-4bba-a761-9fbee7015f5d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:27.454976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6ef75-d5b3-4bba-a761-9fbee7015f5d None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:27.457223 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 441/906] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:48:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:27.463558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202ee19-33f5-4fbd-b865-a474dd47b443 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:27.464098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202ee19-33f5-4fbd-b865-a474dd47b443 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:27.464098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202ee19-33f5-4fbd-b865-a474dd47b443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:27.489820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1202ee19-33f5-4fbd-b865-a474dd47b443 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:27.491160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1202ee19-33f5-4fbd-b865-a474dd47b443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:27.598456 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 466/907] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:48:27.918841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6ef75-d5b3-4bba-a761-9fbee7015f5d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:28.036389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6ef75-d5b3-4bba-a761-9fbee7015f5d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:28.074441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2379f-2a57-4ee6-9501-8b9f02663617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:28.075117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2379f-2a57-4ee6-9501-8b9f02663617 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:28.075402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2379f-2a57-4ee6-9501-8b9f02663617 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:28.075677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2379f-2a57-4ee6-9501-8b9f02663617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:28.086877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2379f-2a57-4ee6-9501-8b9f02663617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:28.088587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2379f-2a57-4ee6-9501-8b9f02663617 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e0d2379f-2a57-4ee6-9501-8b9f02663617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:48:28.105131 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:28.106256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:48:28.107307 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:48:28.107307 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:28.107307 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:48:28.107307 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 442/908] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:48:28.112577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202ee19-33f5-4fbd-b865-a474dd47b443 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:28.241683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202ee19-33f5-4fbd-b865-a474dd47b443 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:28.276685 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:28.282800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff0c0b-7593-4558-9b90-881a51da2102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:28.283471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff0c0b-7593-4558-9b90-881a51da2102 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:28.283751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff0c0b-7593-4558-9b90-881a51da2102 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:28.284020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff0c0b-7593-4558-9b90-881a51da2102 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:28.284664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff0c0b-7593-4558-9b90-881a51da2102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:28.284969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff0c0b-7593-4558-9b90-881a51da2102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:28.286336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff0c0b-7593-4558-9b90-881a51da2102 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:28.306954 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 467/909] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:28.309321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2379f-2a57-4ee6-9501-8b9f02663617 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:28.379360 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:28.444590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2379f-2a57-4ee6-9501-8b9f02663617 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:28.494259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1afa62-f6ae-4bdb-bf16-3ef808051361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:28.494994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1afa62-f6ae-4bdb-bf16-3ef808051361 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:28.495378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1afa62-f6ae-4bdb-bf16-3ef808051361 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:28.495748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1afa62-f6ae-4bdb-bf16-3ef808051361 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:28.496504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1afa62-f6ae-4bdb-bf16-3ef808051361 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:28.498035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1afa62-f6ae-4bdb-bf16-3ef808051361 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:28.538953 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 443/910] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Oct 16 00:48:28 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:48:31.019608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61b99-b1e7-43aa-8466-7ff479ea59d4 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:31.020264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61b99-b1e7-43aa-8466-7ff479ea59d4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:31.020264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61b99-b1e7-43aa-8466-7ff479ea59d4 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:31.021651 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 468/911] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:31.029874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba53036-3ec8-4126-bb10-007ceb778545 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:31.031138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba53036-3ec8-4126-bb10-007ceb778545 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:31.031138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba53036-3ec8-4126-bb10-007ceb778545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:31.051673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7ba53036-3ec8-4126-bb10-007ceb778545 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:31.053263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7ba53036-3ec8-4126-bb10-007ceb778545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:31.143014 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 444/912] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:48:31.419934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f61b99-b1e7-43aa-8466-7ff479ea59d4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:31.571773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f61b99-b1e7-43aa-8466-7ff479ea59d4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:31.617155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b061ae-75c1-4764-9575-7e3b136587fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:31.621080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b061ae-75c1-4764-9575-7e3b136587fc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:31.621080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b061ae-75c1-4764-9575-7e3b136587fc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:31.621080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b061ae-75c1-4764-9575-7e3b136587fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:31.629463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b061ae-75c1-4764-9575-7e3b136587fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-51b061ae-75c1-4764-9575-7e3b136587fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:48:31.634183 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:31.635169 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:31.636062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:31.636062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:31.636062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:31.636062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:31.636062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:48:31.636062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:48:31.636062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:48:31.636062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:48:31.636062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:48:31.636062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:48:31.636062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:48:31.636062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:31.636062 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 469/913] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:48:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:31.641600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba53036-3ec8-4126-bb10-007ceb778545 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:31.711317 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:31.797925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba53036-3ec8-4126-bb10-007ceb778545 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:31.837655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023b5a1-9549-48f0-b032-b02fa96ab422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:31.838272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023b5a1-9549-48f0-b032-b02fa96ab422 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:31.838678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023b5a1-9549-48f0-b032-b02fa96ab422 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:31.838973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023b5a1-9549-48f0-b032-b02fa96ab422 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:31.839758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023b5a1-9549-48f0-b032-b02fa96ab422 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:31.840075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023b5a1-9549-48f0-b032-b02fa96ab422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:31.841652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023b5a1-9549-48f0-b032-b02fa96ab422 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:31.854281 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 445/914] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:48:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:31.859537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b061ae-75c1-4764-9575-7e3b136587fc None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:31.937580 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:32.009134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b061ae-75c1-4764-9575-7e3b136587fc None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:32.047288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f3ab6-66f4-47a0-b087-b30a3a74d015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:32.047964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f3ab6-66f4-47a0-b087-b30a3a74d015 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:32.048213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f3ab6-66f4-47a0-b087-b30a3a74d015 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:32.048508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f3ab6-66f4-47a0-b087-b30a3a74d015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:32.060561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f3ab6-66f4-47a0-b087-b30a3a74d015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:32.062564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f3ab6-66f4-47a0-b087-b30a3a74d015 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-5e8f3ab6-66f4-47a0-b087-b30a3a74d015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:48:32.079689 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:32.080896 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:48:32.081949 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:48:32.081949 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:32.081949 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:32.083375 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 470/915] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:48:32.089188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023b5a1-9549-48f0-b032-b02fa96ab422 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:32.198023 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:32.201237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023b5a1-9549-48f0-b032-b02fa96ab422 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:32.243795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70192f-7916-4daf-b6c6-6fa3d42b21ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:32.244628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70192f-7916-4daf-b6c6-6fa3d42b21ca None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:32.244897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70192f-7916-4daf-b6c6-6fa3d42b21ca None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:32.245196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70192f-7916-4daf-b6c6-6fa3d42b21ca None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:32.245942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70192f-7916-4daf-b6c6-6fa3d42b21ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:32.246249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70192f-7916-4daf-b6c6-6fa3d42b21ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:32.247799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70192f-7916-4daf-b6c6-6fa3d42b21ca None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:32.265162 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 446/916] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:32.270723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f3ab6-66f4-47a0-b087-b30a3a74d015 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:32.519817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f3ab6-66f4-47a0-b087-b30a3a74d015 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:32.521525 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:32.568027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625729bc-16c7-470c-bdbc-d110f0672157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:32.568886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625729bc-16c7-470c-bdbc-d110f0672157 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:32.569334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625729bc-16c7-470c-bdbc-d110f0672157 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:32.569589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625729bc-16c7-470c-bdbc-d110f0672157 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:32.577891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625729bc-16c7-470c-bdbc-d110f0672157 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:32.579613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625729bc-16c7-470c-bdbc-d110f0672157 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-625729bc-16c7-470c-bdbc-d110f0672157 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:48:32.591811 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:32.592840 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:32.594466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:32.594466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:32.594466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:48:32.594466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:48:32.594466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:48:32.594466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:48:32.594466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:48:32.594466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:48:32.594466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:48:32.594466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:32.598783 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 471/917] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:48:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:48:32.599874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70192f-7916-4daf-b6c6-6fa3d42b21ca None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:32.707519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70192f-7916-4daf-b6c6-6fa3d42b21ca None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:32.743492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929896be-68a4-4d7d-9e4b-b476b9e7ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:32.744087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929896be-68a4-4d7d-9e4b-b476b9e7ff86 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:32.744364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929896be-68a4-4d7d-9e4b-b476b9e7ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:32.744628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929896be-68a4-4d7d-9e4b-b476b9e7ff86 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:32.745329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929896be-68a4-4d7d-9e4b-b476b9e7ff86 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:32.745631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929896be-68a4-4d7d-9e4b-b476b9e7ff86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:32.747076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929896be-68a4-4d7d-9e4b-b476b9e7ff86 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:32.767495 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 447/918] 10.222.0.39 () {56 vars in 1143 bytes} [Sun Oct 16 00:48:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:48:32.773150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625729bc-16c7-470c-bdbc-d110f0672157 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:32.886533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625729bc-16c7-470c-bdbc-d110f0672157 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:32.922509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d09e80-6fb5-4073-85f7-499e2a8ee635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:32.923198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d09e80-6fb5-4073-85f7-499e2a8ee635 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:32.923590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d09e80-6fb5-4073-85f7-499e2a8ee635 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:32.923773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d09e80-6fb5-4073-85f7-499e2a8ee635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:32.934847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d09e80-6fb5-4073-85f7-499e2a8ee635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:32.936601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d09e80-6fb5-4073-85f7-499e2a8ee635 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b1d09e80-6fb5-4073-85f7-499e2a8ee635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:48:32.955211 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:32.956227 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:48:32.957128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:48:32.957128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:32.957128 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:32.961738 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 472/919] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:32.962274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929896be-68a4-4d7d-9e4b-b476b9e7ff86 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:32.983060 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:33.073974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929896be-68a4-4d7d-9e4b-b476b9e7ff86 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:33.119030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f1b94-0500-43fb-8bab-c363179224d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:33.119721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f1b94-0500-43fb-8bab-c363179224d7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:33.120060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f1b94-0500-43fb-8bab-c363179224d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:33.120423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f1b94-0500-43fb-8bab-c363179224d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:33.121429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f1b94-0500-43fb-8bab-c363179224d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:33.121957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f1b94-0500-43fb-8bab-c363179224d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:33.124031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f1b94-0500-43fb-8bab-c363179224d7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:33.136437 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 448/920] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:33.142841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d09e80-6fb5-4073-85f7-499e2a8ee635 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:33.162671 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:33.280342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d09e80-6fb5-4073-85f7-499e2a8ee635 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:33.321351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd227aa-c68c-48f1-a3a7-345b576fb910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:33.322011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd227aa-c68c-48f1-a3a7-345b576fb910 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:33.322345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd227aa-c68c-48f1-a3a7-345b576fb910 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:33.322621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd227aa-c68c-48f1-a3a7-345b576fb910 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:33.330625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd227aa-c68c-48f1-a3a7-345b576fb910 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:33.332601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd227aa-c68c-48f1-a3a7-345b576fb910 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-edd227aa-c68c-48f1-a3a7-345b576fb910 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:48:33.344454 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:33.345369 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:33.351150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:48:33.351150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:48:33.351150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:48:33.351150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:48:33.351150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:48:33.351150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:48:33.351150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:48:33.351150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:33.351150 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 473/921] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:48:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:48:33.351672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f1b94-0500-43fb-8bab-c363179224d7 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:33.453768 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:33.489241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f1b94-0500-43fb-8bab-c363179224d7 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:33.529386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462274b-bb73-4288-8ce8-2325ba095622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:33.529964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462274b-bb73-4288-8ce8-2325ba095622 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:33.530235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462274b-bb73-4288-8ce8-2325ba095622 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:33.530580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462274b-bb73-4288-8ce8-2325ba095622 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:33.531366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462274b-bb73-4288-8ce8-2325ba095622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:33.531928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462274b-bb73-4288-8ce8-2325ba095622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:33.533326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462274b-bb73-4288-8ce8-2325ba095622 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:33.545184 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 449/922] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:48:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:33.551898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd227aa-c68c-48f1-a3a7-345b576fb910 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:33.645539 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:33.674659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd227aa-c68c-48f1-a3a7-345b576fb910 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:33.711854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23eda07-d01c-4a07-ab91-78265acdf0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:33.712510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eda07-d01c-4a07-ab91-78265acdf0d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:33.712788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eda07-d01c-4a07-ab91-78265acdf0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:33.713061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eda07-d01c-4a07-ab91-78265acdf0d2 None admin] PATH_INFO: `/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/2bd64951d9864572a117f9433aeaef63/roles/b8b6732605964de6aedfe2a3cf507d03` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:33.729372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23eda07-d01c-4a07-ab91-78265acdf0d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2efc56617bd54471a648f03215b3bfb1, user_id=2bd64951d9864572a117f9433aeaef63, role_id=b8b6732605964de6aedfe2a3cf507d03)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:33.730860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23eda07-d01c-4a07-ab91-78265acdf0d2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:33.743291 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 474/923] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:48:33 2022] PUT /identity/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/2bd64951d9864572a117f9433aeaef63/roles/b8b6732605964de6aedfe2a3cf507d03 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:48:36.016743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15137958-8180-4c6b-a03b-9e0cb3ee61d8 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:36.017254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15137958-8180-4c6b-a03b-9e0cb3ee61d8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:36.017254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15137958-8180-4c6b-a03b-9e0cb3ee61d8 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:36.018448 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 450/924] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:48:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:36.024136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd5d2d-4c0c-4c0f-b97c-a6f83b57077d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:36.024602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd5d2d-4c0c-4c0f-b97c-a6f83b57077d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:36.024724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd5d2d-4c0c-4c0f-b97c-a6f83b57077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:36.044748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-50fd5d2d-4c0c-4c0f-b97c-a6f83b57077d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:36.045923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-50fd5d2d-4c0c-4c0f-b97c-a6f83b57077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:36.116417 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 475/925] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:48:36.412127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15137958-8180-4c6b-a03b-9e0cb3ee61d8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:36.528076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15137958-8180-4c6b-a03b-9e0cb3ee61d8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:36.571197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3baba9-f38a-47b9-a273-2b002c59c50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:36.571792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3baba9-f38a-47b9-a273-2b002c59c50f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:36.572066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3baba9-f38a-47b9-a273-2b002c59c50f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:36.572334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3baba9-f38a-47b9-a273-2b002c59c50f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:36.580199 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:36.584654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3baba9-f38a-47b9-a273-2b002c59c50f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-bd3baba9-f38a-47b9-a273-2b002c59c50f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:48:36.589870 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:36.591184 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:36.592336 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:36.592336 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:36.592336 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:36.592336 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:36.592336 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:48:36.592336 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:48:36.592336 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:48:36.592336 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:48:36.592336 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:48:36.592336 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:48:36.592336 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:48:36.592336 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:48:36.592336 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 451/926] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Oct 16 00:48:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:36.597729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd5d2d-4c0c-4c0f-b97c-a6f83b57077d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:36.657704 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:36.704495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd5d2d-4c0c-4c0f-b97c-a6f83b57077d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:36.744972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962209a-fa14-49c4-9a7f-b1f296d6b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:36.745603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962209a-fa14-49c4-9a7f-b1f296d6b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:36.745975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962209a-fa14-49c4-9a7f-b1f296d6b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:36.746448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962209a-fa14-49c4-9a7f-b1f296d6b8a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:36.747285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962209a-fa14-49c4-9a7f-b1f296d6b8a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:36.747608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962209a-fa14-49c4-9a7f-b1f296d6b8a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:36.749447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962209a-fa14-49c4-9a7f-b1f296d6b8a7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:36.759055 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 476/927] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Oct 16 00:48:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:36.765458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3baba9-f38a-47b9-a273-2b002c59c50f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:36.872330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3baba9-f38a-47b9-a273-2b002c59c50f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:36.909613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa2070-a8c9-48c2-aa9e-0b81a029c537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:36.910242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa2070-a8c9-48c2-aa9e-0b81a029c537 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:36.910515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa2070-a8c9-48c2-aa9e-0b81a029c537 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:36.910786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa2070-a8c9-48c2-aa9e-0b81a029c537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:36.921246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa2070-a8c9-48c2-aa9e-0b81a029c537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:36.922642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa2070-a8c9-48c2-aa9e-0b81a029c537 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f5fa2070-a8c9-48c2-aa9e-0b81a029c537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:48:36.938110 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:36.939284 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:48:36.940301 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:48:36.940301 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:36.940301 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:48:36.940301 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 452/928] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:36.945150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962209a-fa14-49c4-9a7f-b1f296d6b8a7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:37.061873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962209a-fa14-49c4-9a7f-b1f296d6b8a7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:37.083308 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:37.104157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e971a5-f625-464a-a0c1-4ea633ea3bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:37.104782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e971a5-f625-464a-a0c1-4ea633ea3bcb None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:37.105132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e971a5-f625-464a-a0c1-4ea633ea3bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:37.105447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e971a5-f625-464a-a0c1-4ea633ea3bcb None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:37.106122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e971a5-f625-464a-a0c1-4ea633ea3bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:37.106431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e971a5-f625-464a-a0c1-4ea633ea3bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:37.108052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e971a5-f625-464a-a0c1-4ea633ea3bcb None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:37.119943 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 477/929] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:37.126276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa2070-a8c9-48c2-aa9e-0b81a029c537 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:37.185190 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:37.243325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa2070-a8c9-48c2-aa9e-0b81a029c537 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:37.283744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d15409-7a8a-4cc4-89a0-657144612dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:37.284512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d15409-7a8a-4cc4-89a0-657144612dcd None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:37.284860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d15409-7a8a-4cc4-89a0-657144612dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:37.285170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d15409-7a8a-4cc4-89a0-657144612dcd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:37.293959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d15409-7a8a-4cc4-89a0-657144612dcd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:37.295583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d15409-7a8a-4cc4-89a0-657144612dcd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-b1d15409-7a8a-4cc4-89a0-657144612dcd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:48:37.307879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:37.309151 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:37.310577 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:37.310577 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:37.310577 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:48:37.310577 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:48:37.310577 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:48:37.310577 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:48:37.310577 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:48:37.310577 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:48:37.310577 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:48:37.310577 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:48:37.314287 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 453/930] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:48:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:37.315515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e971a5-f625-464a-a0c1-4ea633ea3bcb None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:37.424968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e971a5-f625-464a-a0c1-4ea633ea3bcb None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:37.465595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d3dd7-0584-4669-a58d-7f1b720d2474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:37.466268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d3dd7-0584-4669-a58d-7f1b720d2474 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:37.466609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d3dd7-0584-4669-a58d-7f1b720d2474 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:37.466881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d3dd7-0584-4669-a58d-7f1b720d2474 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:37.467745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d3dd7-0584-4669-a58d-7f1b720d2474 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:37.468686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d3dd7-0584-4669-a58d-7f1b720d2474 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:37.470218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d3dd7-0584-4669-a58d-7f1b720d2474 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:37.489365 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 478/931] 10.222.0.39 () {56 vars in 1143 bytes} [Sun Oct 16 00:48:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:37.495173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d15409-7a8a-4cc4-89a0-657144612dcd None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:37.615781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d15409-7a8a-4cc4-89a0-657144612dcd None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:37.628269 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:37.657508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821542e-bd46-4542-bda3-daf7a1729f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:37.658326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821542e-bd46-4542-bda3-daf7a1729f27 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:37.658621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821542e-bd46-4542-bda3-daf7a1729f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:37.659003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821542e-bd46-4542-bda3-daf7a1729f27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:37.731771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821542e-bd46-4542-bda3-daf7a1729f27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:37.733254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821542e-bd46-4542-bda3-daf7a1729f27 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:37.840785 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 454/932] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:48:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:48:37.847217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d3dd7-0584-4669-a58d-7f1b720d2474 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:37.885616 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:37.953876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d3dd7-0584-4669-a58d-7f1b720d2474 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:37.993051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a987af-aca6-4a0f-a2c8-e8d6af8abab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:37.993737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a987af-aca6-4a0f-a2c8-e8d6af8abab8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:37.994061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a987af-aca6-4a0f-a2c8-e8d6af8abab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:37.994370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a987af-aca6-4a0f-a2c8-e8d6af8abab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:38.005843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a987af-aca6-4a0f-a2c8-e8d6af8abab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:38.007397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a987af-aca6-4a0f-a2c8-e8d6af8abab8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e3a987af-aca6-4a0f-a2c8-e8d6af8abab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:48:38.022393 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:38.023565 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:48:38.024623 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:48:38.024623 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:38.024623 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:38.027227 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 479/933] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:48:38.029253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821542e-bd46-4542-bda3-daf7a1729f27 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:38.041694 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:38.136748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821542e-bd46-4542-bda3-daf7a1729f27 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:38.175440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31c000-30b9-46fd-aa67-374b8ed2b617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:38.176119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31c000-30b9-46fd-aa67-374b8ed2b617 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:38.176419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31c000-30b9-46fd-aa67-374b8ed2b617 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:38.176717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31c000-30b9-46fd-aa67-374b8ed2b617 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:38.177422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31c000-30b9-46fd-aa67-374b8ed2b617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:38.177726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31c000-30b9-46fd-aa67-374b8ed2b617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:38.179245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31c000-30b9-46fd-aa67-374b8ed2b617 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:38.191671 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 455/934] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:38.198094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a987af-aca6-4a0f-a2c8-e8d6af8abab8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:38.301368 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:38.316980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a987af-aca6-4a0f-a2c8-e8d6af8abab8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:38.354413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe63b86-89d8-4146-94f1-444a9441b562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:38.355173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe63b86-89d8-4146-94f1-444a9441b562 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:38.355580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe63b86-89d8-4146-94f1-444a9441b562 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:38.355864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe63b86-89d8-4146-94f1-444a9441b562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:38.363970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe63b86-89d8-4146-94f1-444a9441b562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:38.366666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe63b86-89d8-4146-94f1-444a9441b562 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-6fe63b86-89d8-4146-94f1-444a9441b562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:48:38.378626 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:38.385062 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:38.386225 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:48:38.386225 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:48:38.386225 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:48:38.386225 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:48:38.386225 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:48:38.386225 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:48:38.386225 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:48:38.386225 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:38.386225 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 480/935] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:48:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:38.388001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31c000-30b9-46fd-aa67-374b8ed2b617 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:38.461701 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:38.498122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31c000-30b9-46fd-aa67-374b8ed2b617 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:38.536426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514eb27f-856d-4a11-b6e0-b1a5689e5870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:38.537012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eb27f-856d-4a11-b6e0-b1a5689e5870 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:38.537288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eb27f-856d-4a11-b6e0-b1a5689e5870 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:38.537559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eb27f-856d-4a11-b6e0-b1a5689e5870 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:38.538235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514eb27f-856d-4a11-b6e0-b1a5689e5870 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:38.538539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514eb27f-856d-4a11-b6e0-b1a5689e5870 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:38.540055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514eb27f-856d-4a11-b6e0-b1a5689e5870 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:38.554046 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 456/936] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:48:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:38.560350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe63b86-89d8-4146-94f1-444a9441b562 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:38.679624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe63b86-89d8-4146-94f1-444a9441b562 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:38.718350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577a03f-1caa-4969-90a9-8399fcdd4982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:38.719345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577a03f-1caa-4969-90a9-8399fcdd4982 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:38.719657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577a03f-1caa-4969-90a9-8399fcdd4982 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:38.719977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577a03f-1caa-4969-90a9-8399fcdd4982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:38.720719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577a03f-1caa-4969-90a9-8399fcdd4982 None admin] RBAC: Adding query filter params (role.id=b8b6732605964de6aedfe2a3cf507d03, scope.project.id=2efc56617bd54471a648f03215b3bfb1, user.id=2bd64951d9864572a117f9433aeaef63) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:38.721034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577a03f-1caa-4969-90a9-8399fcdd4982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:38.722671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577a03f-1caa-4969-90a9-8399fcdd4982 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:38.728708 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 481/937] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:48:38 2022] GET /identity/v3/role_assignments?user.id=2bd64951d9864572a117f9433aeaef63&scope.project.id=2efc56617bd54471a648f03215b3bfb1&role.id=b8b6732605964de6aedfe2a3cf507d03 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:41.139657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fd80f-3a2c-410b-b10e-5488145204de None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:41.140303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fd80f-3a2c-410b-b10e-5488145204de None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:41.140303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fd80f-3a2c-410b-b10e-5488145204de None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:41.141694 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 457/938] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:41.147501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01271a-01de-4df3-8a83-4590ae8d88da None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:41.147951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01271a-01de-4df3-8a83-4590ae8d88da None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:41.148043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01271a-01de-4df3-8a83-4590ae8d88da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:41.168151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4e01271a-01de-4df3-8a83-4590ae8d88da None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:41.169425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4e01271a-01de-4df3-8a83-4590ae8d88da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:41.173002 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:41.252894 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 482/939] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:48:41.521741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fd80f-3a2c-410b-b10e-5488145204de None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:41.636790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fd80f-3a2c-410b-b10e-5488145204de None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:41.667538 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:41.674353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6fb32-dbfc-4ae1-ab2c-812a1356efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:41.675112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6fb32-dbfc-4ae1-ab2c-812a1356efa7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:41.675277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6fb32-dbfc-4ae1-ab2c-812a1356efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:41.675540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6fb32-dbfc-4ae1-ab2c-812a1356efa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:41.685574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6fb32-dbfc-4ae1-ab2c-812a1356efa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-bba6fb32-dbfc-4ae1-ab2c-812a1356efa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:48:41.690738 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:41.691745 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:41.692821 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:41.692821 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:41.692821 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:41.692821 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:41.692821 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:48:41.692821 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:48:41.692821 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:48:41.692821 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:48:41.692821 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:48:41.692821 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:48:41.692821 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:48:41.692821 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:48:41.692821 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 458/940] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:48:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:48:41.697956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01271a-01de-4df3-8a83-4590ae8d88da None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:41.805268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01271a-01de-4df3-8a83-4590ae8d88da None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:41.842154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5672507-7fe8-415f-b7e4-be1baa6901e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:41.842770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5672507-7fe8-415f-b7e4-be1baa6901e1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:41.844311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5672507-7fe8-415f-b7e4-be1baa6901e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:41.844587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5672507-7fe8-415f-b7e4-be1baa6901e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:41.845275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5672507-7fe8-415f-b7e4-be1baa6901e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:41.845619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5672507-7fe8-415f-b7e4-be1baa6901e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:41.846988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5672507-7fe8-415f-b7e4-be1baa6901e1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:41.855438 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 483/941] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:48:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:48:41.861600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6fb32-dbfc-4ae1-ab2c-812a1356efa7 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:41.968574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6fb32-dbfc-4ae1-ab2c-812a1356efa7 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:42.007584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2389b-d3d1-4992-b4b9-b3f9382f4b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:42.008366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2389b-d3d1-4992-b4b9-b3f9382f4b0b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:42.008736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2389b-d3d1-4992-b4b9-b3f9382f4b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:42.009095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2389b-d3d1-4992-b4b9-b3f9382f4b0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:42.020877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2389b-d3d1-4992-b4b9-b3f9382f4b0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:42.022399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2389b-d3d1-4992-b4b9-b3f9382f4b0b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-d1e2389b-d3d1-4992-b4b9-b3f9382f4b0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:48:42.038433 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:42.039624 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:48:42.040641 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:48:42.040641 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:42.040641 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:48:42.040641 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 459/942] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:42.045911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5672507-7fe8-415f-b7e4-be1baa6901e1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:42.049192 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:42.172282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5672507-7fe8-415f-b7e4-be1baa6901e1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:42.220871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc604a4-6951-4c9f-8020-ee8dea6d1058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:42.221539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc604a4-6951-4c9f-8020-ee8dea6d1058 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:42.221756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc604a4-6951-4c9f-8020-ee8dea6d1058 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:42.222034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc604a4-6951-4c9f-8020-ee8dea6d1058 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:42.222683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc604a4-6951-4c9f-8020-ee8dea6d1058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:42.223028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc604a4-6951-4c9f-8020-ee8dea6d1058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:42.224434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc604a4-6951-4c9f-8020-ee8dea6d1058 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:42.241709 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 484/943] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:42.247853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2389b-d3d1-4992-b4b9-b3f9382f4b0b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:42.298040 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:42.360811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2389b-d3d1-4992-b4b9-b3f9382f4b0b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:42.395781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a1502-3587-4368-9e99-f14bfb5b94c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:42.396403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a1502-3587-4368-9e99-f14bfb5b94c2 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:42.396673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a1502-3587-4368-9e99-f14bfb5b94c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:42.396936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a1502-3587-4368-9e99-f14bfb5b94c2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:42.404634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a1502-3587-4368-9e99-f14bfb5b94c2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:42.406733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a1502-3587-4368-9e99-f14bfb5b94c2 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-df3a1502-3587-4368-9e99-f14bfb5b94c2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:48:42.419841 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:42.421548 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:42.422754 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:42.422754 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:42.422754 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:48:42.422754 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:48:42.422754 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:48:42.422754 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:48:42.422754 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:48:42.422754 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:48:42.422754 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:48:42.422754 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:48:42.426964 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 460/944] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:48:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:42.428028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc604a4-6951-4c9f-8020-ee8dea6d1058 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:42.500581 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:42.542560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc604a4-6951-4c9f-8020-ee8dea6d1058 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:42.588066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6a213-ebae-4929-9bdb-2b340a9da8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:42.588672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a213-ebae-4929-9bdb-2b340a9da8da None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:42.588955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a213-ebae-4929-9bdb-2b340a9da8da None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:42.589220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a213-ebae-4929-9bdb-2b340a9da8da None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:42.589939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6a213-ebae-4929-9bdb-2b340a9da8da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:42.590248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6a213-ebae-4929-9bdb-2b340a9da8da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:42.591883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6a213-ebae-4929-9bdb-2b340a9da8da None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:42.611737 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 485/945] 10.222.0.39 () {56 vars in 1143 bytes} [Sun Oct 16 00:48:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:42.617602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a1502-3587-4368-9e99-f14bfb5b94c2 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:42.721046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a1502-3587-4368-9e99-f14bfb5b94c2 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:42.722517 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:42.758499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9adb4d-e413-4be3-9303-8b20bc921fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:42.759137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9adb4d-e413-4be3-9303-8b20bc921fab None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:42.759412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9adb4d-e413-4be3-9303-8b20bc921fab None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:42.759678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9adb4d-e413-4be3-9303-8b20bc921fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:42.770778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9adb4d-e413-4be3-9303-8b20bc921fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:42.772241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9adb4d-e413-4be3-9303-8b20bc921fab None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-8c9adb4d-e413-4be3-9303-8b20bc921fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:48:42.788287 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:42.789476 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:48:42.790701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:48:42.790701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:42.790701 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:48:42.790701 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 461/946] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:42.795280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6a213-ebae-4929-9bdb-2b340a9da8da None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:42.909633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6a213-ebae-4929-9bdb-2b340a9da8da None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:42.932931 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:42.951532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcff1c-546a-422b-8535-784a46dd0fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:42.952173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcff1c-546a-422b-8535-784a46dd0fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:42.953078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcff1c-546a-422b-8535-784a46dd0fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:42.953358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcff1c-546a-422b-8535-784a46dd0fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:42.953994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcff1c-546a-422b-8535-784a46dd0fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:42.954300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcff1c-546a-422b-8535-784a46dd0fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:42.955744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcff1c-546a-422b-8535-784a46dd0fe6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:42.969513 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 486/947] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:42.977008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9adb4d-e413-4be3-9303-8b20bc921fab None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:43.091394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9adb4d-e413-4be3-9303-8b20bc921fab None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:43.130107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7cb9-52de-4ec2-8d80-b1627ed1b9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:43.130816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7cb9-52de-4ec2-8d80-b1627ed1b9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:43.131119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7cb9-52de-4ec2-8d80-b1627ed1b9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:43.131401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7cb9-52de-4ec2-8d80-b1627ed1b9c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:43.141655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc7cb9-52de-4ec2-8d80-b1627ed1b9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:43.143793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc7cb9-52de-4ec2-8d80-b1627ed1b9c0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c9bc7cb9-52de-4ec2-8d80-b1627ed1b9c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:48:43.159128 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:43.160293 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:43.161462 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:48:43.161462 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:48:43.161462 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:48:43.161462 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:48:43.161462 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:48:43.161462 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:48:43.161462 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:48:43.161462 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:48:43.161462 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 462/948] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:43.166479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcff1c-546a-422b-8535-784a46dd0fe6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:43.289018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcff1c-546a-422b-8535-784a46dd0fe6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:43.326131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12526a7f-85f0-4205-b2a0-664a9034f98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:43.326789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12526a7f-85f0-4205-b2a0-664a9034f98d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:43.327723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12526a7f-85f0-4205-b2a0-664a9034f98d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:43.328465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12526a7f-85f0-4205-b2a0-664a9034f98d None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:43.329339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12526a7f-85f0-4205-b2a0-664a9034f98d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:43.329648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12526a7f-85f0-4205-b2a0-664a9034f98d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:43.331092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12526a7f-85f0-4205-b2a0-664a9034f98d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:43.345478 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 487/949] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:48:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:43.351669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7cb9-52de-4ec2-8d80-b1627ed1b9c0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:43.368341 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:43.460942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7cb9-52de-4ec2-8d80-b1627ed1b9c0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:43.502426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f570a30-d4d4-41c5-9b7e-b314c1f0e0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:43.503122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570a30-d4d4-41c5-9b7e-b314c1f0e0af None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:43.503405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570a30-d4d4-41c5-9b7e-b314c1f0e0af None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:43.503673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570a30-d4d4-41c5-9b7e-b314c1f0e0af None admin] PATH_INFO: `/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/2bd64951d9864572a117f9433aeaef63/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:43.505807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f570a30-d4d4-41c5-9b7e-b314c1f0e0af None admin] RBAC: Authorizing `identity:create_grant(project_id=2efc56617bd54471a648f03215b3bfb1, user_id=2bd64951d9864572a117f9433aeaef63, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:43.507590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f570a30-d4d4-41c5-9b7e-b314c1f0e0af None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:43.522869 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 463/950] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Oct 16 00:48:43 2022] PUT /identity/v3/projects/2efc56617bd54471a648f03215b3bfb1/users/2bd64951d9864572a117f9433aeaef63/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:48:46.097008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0376f41-45b4-407f-a75f-32f947ee4707 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:46.097601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0376f41-45b4-407f-a75f-32f947ee4707 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:46.097601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0376f41-45b4-407f-a75f-32f947ee4707 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:46.099042 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 488/951] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:46.105119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2d69d-4c42-4c69-9205-782b1f2d4a7d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:46.105593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2d69d-4c42-4c69-9205-782b1f2d4a7d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:46.105705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2d69d-4c42-4c69-9205-782b1f2d4a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:46.128662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-89d2d69d-4c42-4c69-9205-782b1f2d4a7d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:46.130243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-89d2d69d-4c42-4c69-9205-782b1f2d4a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:46.206253 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 464/952] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:48:46.546893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0376f41-45b4-407f-a75f-32f947ee4707 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:46.597902 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:46.663567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0376f41-45b4-407f-a75f-32f947ee4707 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:46.701463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18416ed-6c49-46e4-9b80-efcc657aea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:46.702054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18416ed-6c49-46e4-9b80-efcc657aea45 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:46.702418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18416ed-6c49-46e4-9b80-efcc657aea45 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:46.702748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18416ed-6c49-46e4-9b80-efcc657aea45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:46.713031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18416ed-6c49-46e4-9b80-efcc657aea45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e18416ed-6c49-46e4-9b80-efcc657aea45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:48:46.717693 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:46.719831 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:46.721126 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:46.721126 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:46.721126 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:46.721126 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:46.721126 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:48:46.721126 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:48:46.721126 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:48:46.721126 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:48:46.721126 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:48:46.721126 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:48:46.721126 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:48:46.721126 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:46.721126 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 489/953] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Oct 16 00:48:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:46.727399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2d69d-4c42-4c69-9205-782b1f2d4a7d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:46.730695 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:46.838419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2d69d-4c42-4c69-9205-782b1f2d4a7d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:46.876597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831bfea-2dbb-4320-8d6b-5de9c003b928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:46.877234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831bfea-2dbb-4320-8d6b-5de9c003b928 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:46.877549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831bfea-2dbb-4320-8d6b-5de9c003b928 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:46.877802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831bfea-2dbb-4320-8d6b-5de9c003b928 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:46.878420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831bfea-2dbb-4320-8d6b-5de9c003b928 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:46.878720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831bfea-2dbb-4320-8d6b-5de9c003b928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:46.880346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831bfea-2dbb-4320-8d6b-5de9c003b928 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:46.889040 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 465/954] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Oct 16 00:48:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:46.895616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18416ed-6c49-46e4-9b80-efcc657aea45 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:47.006881 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:47.010513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18416ed-6c49-46e4-9b80-efcc657aea45 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:47.047327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64b34d-7e52-482c-8e34-0ae5a6133305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:47.047957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64b34d-7e52-482c-8e34-0ae5a6133305 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:47.048237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64b34d-7e52-482c-8e34-0ae5a6133305 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:47.048487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64b34d-7e52-482c-8e34-0ae5a6133305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:47.059841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64b34d-7e52-482c-8e34-0ae5a6133305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:47.061461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64b34d-7e52-482c-8e34-0ae5a6133305 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-bb64b34d-7e52-482c-8e34-0ae5a6133305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:48:47.077470 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:47.078524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:48:47.079456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:48:47.079456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:47.079456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:47.079906 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 490/955] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:47.086234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831bfea-2dbb-4320-8d6b-5de9c003b928 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:47.158062 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:47.194898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831bfea-2dbb-4320-8d6b-5de9c003b928 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:47.237513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cec6af-eca1-4319-afa0-d5e21da013d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:47.238096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cec6af-eca1-4319-afa0-d5e21da013d3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:47.238394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cec6af-eca1-4319-afa0-d5e21da013d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:47.238631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cec6af-eca1-4319-afa0-d5e21da013d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:47.239300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cec6af-eca1-4319-afa0-d5e21da013d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:47.239616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cec6af-eca1-4319-afa0-d5e21da013d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:47.241042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cec6af-eca1-4319-afa0-d5e21da013d3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:47.253500 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 466/956] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:48:47.261153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64b34d-7e52-482c-8e34-0ae5a6133305 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:47.375699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64b34d-7e52-482c-8e34-0ae5a6133305 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:47.411990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db139b3-5469-4634-b1fd-8f2e5966633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:47.412534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db139b3-5469-4634-b1fd-8f2e5966633a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:47.412806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db139b3-5469-4634-b1fd-8f2e5966633a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:47.413071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db139b3-5469-4634-b1fd-8f2e5966633a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:47.421854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db139b3-5469-4634-b1fd-8f2e5966633a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:47.423300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db139b3-5469-4634-b1fd-8f2e5966633a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-2db139b3-5469-4634-b1fd-8f2e5966633a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:48:47.435281 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:47.436496 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:47.438116 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:47.438116 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:47.438116 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:48:47.438116 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:48:47.438116 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:48:47.438116 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:48:47.438116 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:48:47.438116 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:48:47.438116 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:48:47.438116 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:47.438116 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 491/957] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:48:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:47.442654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cec6af-eca1-4319-afa0-d5e21da013d3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:47.547306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cec6af-eca1-4319-afa0-d5e21da013d3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:47.576703 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:47.586524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945d29-c6e9-4a36-a5a4-3e774629ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:47.587175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945d29-c6e9-4a36-a5a4-3e774629ff7d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:47.587451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945d29-c6e9-4a36-a5a4-3e774629ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:47.587719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945d29-c6e9-4a36-a5a4-3e774629ff7d None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:47.588451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75945d29-c6e9-4a36-a5a4-3e774629ff7d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:47.588754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75945d29-c6e9-4a36-a5a4-3e774629ff7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:47.590216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75945d29-c6e9-4a36-a5a4-3e774629ff7d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:47.614356 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 467/958] 10.222.0.39 () {56 vars in 1143 bytes} [Sun Oct 16 00:48:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:47.615849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db139b3-5469-4634-b1fd-8f2e5966633a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:47.631511 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:47.720500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db139b3-5469-4634-b1fd-8f2e5966633a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:47.754581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b6554-dac9-4e29-a797-296c69338493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:47.755230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b6554-dac9-4e29-a797-296c69338493 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:47.755514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b6554-dac9-4e29-a797-296c69338493 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:47.755787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b6554-dac9-4e29-a797-296c69338493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:47.824902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b6554-dac9-4e29-a797-296c69338493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:47.826331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b6554-dac9-4e29-a797-296c69338493 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:47.840343 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:47.931016 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 492/959] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Oct 16 00:48:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:48:47.937255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945d29-c6e9-4a36-a5a4-3e774629ff7d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:48.032222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945d29-c6e9-4a36-a5a4-3e774629ff7d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:48.064182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41e4c4-b587-4b9a-a5f3-e503e19f5263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:48.064781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41e4c4-b587-4b9a-a5f3-e503e19f5263 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:48.065054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41e4c4-b587-4b9a-a5f3-e503e19f5263 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:48.065320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41e4c4-b587-4b9a-a5f3-e503e19f5263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:48.074694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41e4c4-b587-4b9a-a5f3-e503e19f5263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:48.076137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41e4c4-b587-4b9a-a5f3-e503e19f5263 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-af41e4c4-b587-4b9a-a5f3-e503e19f5263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:48:48.090706 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:48.091838 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:48:48.093223 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:48:48.093223 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:48:48.093223 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:48:48.093223 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 468/960] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:48.097533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b6554-dac9-4e29-a797-296c69338493 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:48.193113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b6554-dac9-4e29-a797-296c69338493 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:48.208880 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:48.233262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94132a0e-89ac-4157-9c78-c0341f4e3bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:48.234432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94132a0e-89ac-4157-9c78-c0341f4e3bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:48.234842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94132a0e-89ac-4157-9c78-c0341f4e3bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:48.235214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94132a0e-89ac-4157-9c78-c0341f4e3bb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:48.235942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94132a0e-89ac-4157-9c78-c0341f4e3bb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:48.236298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94132a0e-89ac-4157-9c78-c0341f4e3bb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:48.238031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94132a0e-89ac-4157-9c78-c0341f4e3bb2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:48.252193 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 493/961] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Oct 16 00:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:48.257857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41e4c4-b587-4b9a-a5f3-e503e19f5263 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:48.292059 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:48.354028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41e4c4-b587-4b9a-a5f3-e503e19f5263 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:48.387170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c42354-2908-461f-b555-657fd3c7f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:48.387780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42354-2908-461f-b555-657fd3c7f1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:48.388058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42354-2908-461f-b555-657fd3c7f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:48.388327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42354-2908-461f-b555-657fd3c7f1c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:48.395240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c42354-2908-461f-b555-657fd3c7f1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:48.396664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c42354-2908-461f-b555-657fd3c7f1c8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e4c42354-2908-461f-b555-657fd3c7f1c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:48:48.408321 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:48.409391 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:48.410302 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:48:48.410302 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:48:48.410302 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:48:48.410302 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:48:48.410302 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:48:48.410302 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:48:48.410302 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:48:48.410302 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 00:48:48.410302 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 469/962] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Oct 16 00:48:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:48.415280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94132a0e-89ac-4157-9c78-c0341f4e3bb2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:48.509699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94132a0e-89ac-4157-9c78-c0341f4e3bb2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:48.542523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d43926-dbac-4a40-972d-6a6c049eebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:48.543088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d43926-dbac-4a40-972d-6a6c049eebf2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:48.543361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d43926-dbac-4a40-972d-6a6c049eebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:48.543633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d43926-dbac-4a40-972d-6a6c049eebf2 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:48.544306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d43926-dbac-4a40-972d-6a6c049eebf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:48.544608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d43926-dbac-4a40-972d-6a6c049eebf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:48.546050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d43926-dbac-4a40-972d-6a6c049eebf2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:48.557873 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 494/963] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Oct 16 00:48:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:48.564277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c42354-2908-461f-b555-657fd3c7f1c8 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:48.654605 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:48.661109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c42354-2908-461f-b555-657fd3c7f1c8 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:48.693916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f64eeb-2528-4e18-abdb-3be44316c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:48.694491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64eeb-2528-4e18-abdb-3be44316c241 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:48.694769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64eeb-2528-4e18-abdb-3be44316c241 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:48.695082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64eeb-2528-4e18-abdb-3be44316c241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:48.695770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f64eeb-2528-4e18-abdb-3be44316c241 None admin] RBAC: Adding query filter params (role.id=3b2c8c93a1c54611871c4299008b2abf, scope.project.id=2efc56617bd54471a648f03215b3bfb1, user.id=2bd64951d9864572a117f9433aeaef63) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:48.696082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f64eeb-2528-4e18-abdb-3be44316c241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:48.697491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f64eeb-2528-4e18-abdb-3be44316c241 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:48.703157 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 470/964] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Oct 16 00:48:48 2022] GET /identity/v3/role_assignments?user.id=2bd64951d9864572a117f9433aeaef63&scope.project.id=2efc56617bd54471a648f03215b3bfb1&role.id=3b2c8c93a1c54611871c4299008b2abf => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:50.842954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ccd4-4594-4f21-b03b-f5e3d7785cba None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:50.843455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ccd4-4594-4f21-b03b-f5e3d7785cba None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:50.843455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ccd4-4594-4f21-b03b-f5e3d7785cba None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:50.844703 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 495/965] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:50.849916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae327-a605-4528-86e7-dfb97fa67ac9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:50.850354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae327-a605-4528-86e7-dfb97fa67ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:50.850448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae327-a605-4528-86e7-dfb97fa67ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:50.869801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-248ae327-a605-4528-86e7-dfb97fa67ac9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:50.871039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-248ae327-a605-4528-86e7-dfb97fa67ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:50.935600 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 471/966] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:48:51.207019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65ccd4-4594-4f21-b03b-f5e3d7785cba None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:51.244175 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:51.320016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65ccd4-4594-4f21-b03b-f5e3d7785cba None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:51.351497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ecfba-cba5-44ef-bb63-e8bfa4ac9130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:51.352111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ecfba-cba5-44ef-bb63-e8bfa4ac9130 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:51.352385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ecfba-cba5-44ef-bb63-e8bfa4ac9130 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:51.352651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ecfba-cba5-44ef-bb63-e8bfa4ac9130 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:51.353216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ecfba-cba5-44ef-bb63-e8bfa4ac9130 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:51.354557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ecfba-cba5-44ef-bb63-e8bfa4ac9130 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b85ecfba-cba5-44ef-bb63-e8bfa4ac9130 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:51.363425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:51.364634 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:51.365697 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 496/967] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Oct 16 00:48:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:51.370820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ae327-a605-4528-86e7-dfb97fa67ac9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:51.457136 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:51.466727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ae327-a605-4528-86e7-dfb97fa67ac9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:51.499644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d817-f807-42e7-992c-24b6015592b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:51.500230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d817-f807-42e7-992c-24b6015592b9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:51.500506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d817-f807-42e7-992c-24b6015592b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:51.500775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d817-f807-42e7-992c-24b6015592b9 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:51.501393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66d817-f807-42e7-992c-24b6015592b9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:51.501692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66d817-f807-42e7-992c-24b6015592b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:51.503078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66d817-f807-42e7-992c-24b6015592b9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:51.507769 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 472/968] 10.222.0.39 () {56 vars in 1116 bytes} [Sun Oct 16 00:48:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:51.513532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ecfba-cba5-44ef-bb63-e8bfa4ac9130 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:51.607274 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:51.613349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ecfba-cba5-44ef-bb63-e8bfa4ac9130 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:51.646449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b3ea2-3f5d-4f57-831f-22e498a1a215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:51.647074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b3ea2-3f5d-4f57-831f-22e498a1a215 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:51.647356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b3ea2-3f5d-4f57-831f-22e498a1a215 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:51.647626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b3ea2-3f5d-4f57-831f-22e498a1a215 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:51.648245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b3ea2-3f5d-4f57-831f-22e498a1a215 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:51.648547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b3ea2-3f5d-4f57-831f-22e498a1a215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:51.649895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b3ea2-3f5d-4f57-831f-22e498a1a215 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:51.654119 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 497/969] 10.222.0.39 () {56 vars in 1116 bytes} [Sun Oct 16 00:48:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:53.801165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4c237-51ac-4dd9-9991-388980a5c493 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:53.801710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4c237-51ac-4dd9-9991-388980a5c493 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:53.801825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4c237-51ac-4dd9-9991-388980a5c493 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:53.803191 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 473/970] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:53.808214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c81982-ad06-4d71-aab7-f412b9423e30 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:53.808630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c81982-ad06-4d71-aab7-f412b9423e30 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:53.808736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c81982-ad06-4d71-aab7-f412b9423e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:53.827111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-36c81982-ad06-4d71-aab7-f412b9423e30 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:53.828361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-36c81982-ad06-4d71-aab7-f412b9423e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:53.891033 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 498/971] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:48:54.163266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4c237-51ac-4dd9-9991-388980a5c493 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:54.283779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4c237-51ac-4dd9-9991-388980a5c493 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:54.316441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf68f3c-7e0a-40fe-b6f8-0bc9582c8311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:54.317030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf68f3c-7e0a-40fe-b6f8-0bc9582c8311 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:54.317301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf68f3c-7e0a-40fe-b6f8-0bc9582c8311 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:54.317568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf68f3c-7e0a-40fe-b6f8-0bc9582c8311 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:54.318197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf68f3c-7e0a-40fe-b6f8-0bc9582c8311 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:54.319571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf68f3c-7e0a-40fe-b6f8-0bc9582c8311 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:54.333978 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 474/972] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Oct 16 00:48:54 2022] POST /identity/v3/services => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:48:56.478302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d7cbd-1b6e-417e-80b3-419cffaef12d None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:56.478873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d7cbd-1b6e-417e-80b3-419cffaef12d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:56.478873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d7cbd-1b6e-417e-80b3-419cffaef12d None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:56.480181 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 499/973] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:56.486063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace2e5-c52a-4497-b9e8-e672e2ea3950 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:56.486502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace2e5-c52a-4497-b9e8-e672e2ea3950 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:56.486593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace2e5-c52a-4497-b9e8-e672e2ea3950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:56.504285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8eace2e5-c52a-4497-b9e8-e672e2ea3950 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:56.505454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8eace2e5-c52a-4497-b9e8-e672e2ea3950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:56.514290 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:56.579134 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 475/974] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:48:56.851934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d7cbd-1b6e-417e-80b3-419cffaef12d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:56.940819 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:56.951561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d7cbd-1b6e-417e-80b3-419cffaef12d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:56.995730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f679c34-1842-4137-ba8d-79b03ca263ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:56.996340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f679c34-1842-4137-ba8d-79b03ca263ed None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:56.996610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f679c34-1842-4137-ba8d-79b03ca263ed None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:56.996872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f679c34-1842-4137-ba8d-79b03ca263ed None admin] PATH_INFO: `/v3/services/placement` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:56.997427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f679c34-1842-4137-ba8d-79b03ca263ed None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:56.998778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f679c34-1842-4137-ba8d-79b03ca263ed None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-4f679c34-1842-4137-ba8d-79b03ca263ed None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:48:57.008021 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:48:57.009164 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:48:57.010035 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 500/975] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Oct 16 00:48:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:48:57.015370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eace2e5-c52a-4497-b9e8-e672e2ea3950 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:57.112416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eace2e5-c52a-4497-b9e8-e672e2ea3950 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:57.144778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c93c0e-634a-4233-92cc-7dedff65f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:57.145369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c93c0e-634a-4233-92cc-7dedff65f4df None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:57.145644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c93c0e-634a-4233-92cc-7dedff65f4df None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:57.145909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c93c0e-634a-4233-92cc-7dedff65f4df None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:57.146516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c93c0e-634a-4233-92cc-7dedff65f4df None admin] RBAC: Adding query filter params (name=placement) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:57.146813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c93c0e-634a-4233-92cc-7dedff65f4df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:57.148194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c93c0e-634a-4233-92cc-7dedff65f4df None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:57.153047 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 476/976] 10.222.0.39 () {56 vars in 1116 bytes} [Sun Oct 16 00:48:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:57.159911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f679c34-1842-4137-ba8d-79b03ca263ed None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:57.280199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f679c34-1842-4137-ba8d-79b03ca263ed None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:57.317375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548942cc-5af0-4642-8dc6-b28571184a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:57.317976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548942cc-5af0-4642-8dc6-b28571184a58 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:57.318253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548942cc-5af0-4642-8dc6-b28571184a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:57.318523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548942cc-5af0-4642-8dc6-b28571184a58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:57.319255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548942cc-5af0-4642-8dc6-b28571184a58 None admin] RBAC: Adding query filter params (interface=public, service_id=d940dc4dac1d4c4ca6fcaa75e8f728fe, region_id=RegionOne) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:48:57.319562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548942cc-5af0-4642-8dc6-b28571184a58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:57.320913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548942cc-5af0-4642-8dc6-b28571184a58 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:57.325883 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 501/977] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Oct 16 00:48:57 2022] GET /identity/v3/endpoints?service_id=d940dc4dac1d4c4ca6fcaa75e8f728fe&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:48:57.331805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c93c0e-634a-4233-92cc-7dedff65f4df None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:57.337237 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:57.429743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c93c0e-634a-4233-92cc-7dedff65f4df None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:57.461788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a3b65-f53e-4a2a-bda9-c46db2f7b917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:57.462380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a3b65-f53e-4a2a-bda9-c46db2f7b917 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:57.462659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a3b65-f53e-4a2a-bda9-c46db2f7b917 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:57.462950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a3b65-f53e-4a2a-bda9-c46db2f7b917 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:57.463548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a3b65-f53e-4a2a-bda9-c46db2f7b917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:57.464897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a3b65-f53e-4a2a-bda9-c46db2f7b917 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:57.471480 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 477/978] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Oct 16 00:48:57 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:48:59.610383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52089a25-21b0-4986-8d08-d7edcab707e5 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:59.610849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52089a25-21b0-4986-8d08-d7edcab707e5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:59.610986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52089a25-21b0-4986-8d08-d7edcab707e5 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:59.612270 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 502/979] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:59.617437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5407b-5ca3-4352-af3f-1886a726810f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:59.617825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5407b-5ca3-4352-af3f-1886a726810f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:59.617981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5407b-5ca3-4352-af3f-1886a726810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:59.636896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f1d5407b-5ca3-4352-af3f-1886a726810f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:59.638054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f1d5407b-5ca3-4352-af3f-1886a726810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:59.697007 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:59.702935 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 478/980] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:48:59.966713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52089a25-21b0-4986-8d08-d7edcab707e5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:59.986254 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:00.065190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52089a25-21b0-4986-8d08-d7edcab707e5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:00.097197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24f907-bcef-4bd6-a580-5255156443a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:00.097801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24f907-bcef-4bd6-a580-5255156443a4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:00.098070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24f907-bcef-4bd6-a580-5255156443a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:00.098332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24f907-bcef-4bd6-a580-5255156443a4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:00.098888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24f907-bcef-4bd6-a580-5255156443a4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:00.100244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24f907-bcef-4bd6-a580-5255156443a4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3b24f907-bcef-4bd6-a580-5255156443a4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:49:00.108848 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:49:00.109999 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 00:49:00.110841 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 503/981] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Oct 16 00:48:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:49:00.115905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5407b-5ca3-4352-af3f-1886a726810f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:00.215532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5407b-5ca3-4352-af3f-1886a726810f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:00.259453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b07c64-d577-4e75-9daf-63b35fa95169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:00.259990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b07c64-d577-4e75-9daf-63b35fa95169 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:00.260266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b07c64-d577-4e75-9daf-63b35fa95169 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:00.260563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b07c64-d577-4e75-9daf-63b35fa95169 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:00.261147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b07c64-d577-4e75-9daf-63b35fa95169 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:49:00.261445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b07c64-d577-4e75-9daf-63b35fa95169 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:00.262834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b07c64-d577-4e75-9daf-63b35fa95169 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:00.268167 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 479/982] 10.222.0.39 () {56 vars in 1116 bytes} [Sun Oct 16 00:49:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:49:00.275601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24f907-bcef-4bd6-a580-5255156443a4 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:00.354342 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:00.372280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24f907-bcef-4bd6-a580-5255156443a4 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:00.404793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ce542-6bea-4634-8e3a-b25502519000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:00.405405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce542-6bea-4634-8e3a-b25502519000 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:00.405685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce542-6bea-4634-8e3a-b25502519000 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:00.405952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce542-6bea-4634-8e3a-b25502519000 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:00.406600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ce542-6bea-4634-8e3a-b25502519000 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:00.408235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ce542-6bea-4634-8e3a-b25502519000 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:00.426869 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 504/983] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 00:49:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:49:10.265382 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=69 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:10.422805 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:05.212261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fb503-e196-4322-a5c6-54dc9cce7de4 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:05.212736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fb503-e196-4322-a5c6-54dc9cce7de4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:05.212814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fb503-e196-4322-a5c6-54dc9cce7de4 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:05.218171 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 480/984] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:50:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:05.219753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660591d-6999-4548-9004-ffe58b6edd44 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:05.220150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660591d-6999-4548-9004-ffe58b6edd44 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:05.220240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660591d-6999-4548-9004-ffe58b6edd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:05.349484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c660591d-6999-4548-9004-ffe58b6edd44 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:05.350861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c660591d-6999-4548-9004-ffe58b6edd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:05.462387 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 505/985] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:50:05.762269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c1282-fe5e-4f87-89ff-476507186fc6 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:05.762548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c1282-fe5e-4f87-89ff-476507186fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:05.762995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c1282-fe5e-4f87-89ff-476507186fc6 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:05.765141 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 481/986] 10.222.0.39 () {54 vars in 964 bytes} [Sun Oct 16 00:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:05.771809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78b034-f0a5-42ec-b041-9d2f021e186d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:05.772099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78b034-f0a5-42ec-b041-9d2f021e186d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:05.772372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78b034-f0a5-42ec-b041-9d2f021e186d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:05.853298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fb78b034-f0a5-42ec-b041-9d2f021e186d None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:05.854506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fb78b034-f0a5-42ec-b041-9d2f021e186d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:05.876705 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:05.935561 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 506/987] 10.222.0.39 () {58 vars in 1061 bytes} [Sun Oct 16 00:50:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:05.948287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c1282-fe5e-4f87-89ff-476507186fc6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:05.950283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e81c1282-fe5e-4f87-89ff-476507186fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:06.068556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c1282-fe5e-4f87-89ff-476507186fc6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:06.151544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732d12a-926b-4315-93b4-8b8632a6f3ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:06.152164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732d12a-926b-4315-93b4-8b8632a6f3ae service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:06.152436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732d12a-926b-4315-93b4-8b8632a6f3ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:06.152702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732d12a-926b-4315-93b4-8b8632a6f3ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:06.154426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e732d12a-926b-4315-93b4-8b8632a6f3ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:06.216800 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:06.285514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732d12a-926b-4315-93b4-8b8632a6f3ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:06.287236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732d12a-926b-4315-93b4-8b8632a6f3ae service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:06.313102 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 482/988] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:08.859979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199adaa7-41ef-4769-9e5c-7d43de62dfe2 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:08.860485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199adaa7-41ef-4769-9e5c-7d43de62dfe2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:08.860485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199adaa7-41ef-4769-9e5c-7d43de62dfe2 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:08.861998 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 507/989] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:08.867552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f6fb-86b5-4d1e-93fe-b459553e3b63 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:08.868014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f6fb-86b5-4d1e-93fe-b459553e3b63 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:08.868111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f6fb-86b5-4d1e-93fe-b459553e3b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:08.948577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d3b7f6fb-86b5-4d1e-93fe-b459553e3b63 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:08.949789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d3b7f6fb-86b5-4d1e-93fe-b459553e3b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:09.050714 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 483/990] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:09.349467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521eb9e5-b32a-42fb-acbb-2399136d8466 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:09.349774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521eb9e5-b32a-42fb-acbb-2399136d8466 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:09.350046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521eb9e5-b32a-42fb-acbb-2399136d8466 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:09.351423 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 508/991] 10.222.0.39 () {54 vars in 964 bytes} [Sun Oct 16 00:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:09.357111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c30ff6-3990-4bd4-829c-eb9f17ec1d9d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:09.357544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c30ff6-3990-4bd4-829c-eb9f17ec1d9d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:09.357660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c30ff6-3990-4bd4-829c-eb9f17ec1d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:09.370434 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:09.435421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-11c30ff6-3990-4bd4-829c-eb9f17ec1d9d None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:09.436644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-11c30ff6-3990-4bd4-829c-eb9f17ec1d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:09.515852 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 484/992] 10.222.0.39 () {58 vars in 1061 bytes} [Sun Oct 16 00:50:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:09.524879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521eb9e5-b32a-42fb-acbb-2399136d8466 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:09.526366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-521eb9e5-b32a-42fb-acbb-2399136d8466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:09.633621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521eb9e5-b32a-42fb-acbb-2399136d8466 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:09.704280 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:09.706540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343cf58-7e5f-4a8c-a23d-4920b86b0909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:09.707391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343cf58-7e5f-4a8c-a23d-4920b86b0909 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:09.707855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343cf58-7e5f-4a8c-a23d-4920b86b0909 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:09.708310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343cf58-7e5f-4a8c-a23d-4920b86b0909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:09.709909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1343cf58-7e5f-4a8c-a23d-4920b86b0909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:09.818293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343cf58-7e5f-4a8c-a23d-4920b86b0909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:09.819752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343cf58-7e5f-4a8c-a23d-4920b86b0909 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:09.838161 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 509/993] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:12.501255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263018e6-0580-4d87-a6f6-b5cece707b29 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:12.501819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263018e6-0580-4d87-a6f6-b5cece707b29 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:12.501819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263018e6-0580-4d87-a6f6-b5cece707b29 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:12.503153 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 485/994] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:12.508558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ed8d2-7a77-4295-bf5a-add0001fae35 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:12.508978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ed8d2-7a77-4295-bf5a-add0001fae35 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:12.509077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ed8d2-7a77-4295-bf5a-add0001fae35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:12.576286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-265ed8d2-7a77-4295-bf5a-add0001fae35 None None] MFA Rules not processed for user `364bdc673dbe40e4a5943306e9aa4cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:12.577980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-265ed8d2-7a77-4295-bf5a-add0001fae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:12.628831 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:12.672592 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 510/995] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:12 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:12.956197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263018e6-0580-4d87-a6f6-b5cece707b29 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:12.957707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-263018e6-0580-4d87-a6f6-b5cece707b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:13.058818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263018e6-0580-4d87-a6f6-b5cece707b29 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:13.062231 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:13.134465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb99694-9780-45ac-8dda-baecc3664251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:13.135095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb99694-9780-45ac-8dda-baecc3664251 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:13.135374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb99694-9780-45ac-8dda-baecc3664251 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:13.135642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb99694-9780-45ac-8dda-baecc3664251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:13.137207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9eb99694-9780-45ac-8dda-baecc3664251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:13.243356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb99694-9780-45ac-8dda-baecc3664251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:13.244719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb99694-9780-45ac-8dda-baecc3664251 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:13.262684 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 486/996] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:15.945026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247c9ff-08b0-4c88-908a-a49f101d6dec None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:15.945536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247c9ff-08b0-4c88-908a-a49f101d6dec None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:15.945536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247c9ff-08b0-4c88-908a-a49f101d6dec None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:15.946816 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 511/997] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:15.952801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c28486-9e1e-4ebc-802b-479f847263c5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:15.953235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c28486-9e1e-4ebc-802b-479f847263c5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:15.953376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c28486-9e1e-4ebc-802b-479f847263c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:15.993735 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:16.019384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-04c28486-9e1e-4ebc-802b-479f847263c5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:16.020567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-04c28486-9e1e-4ebc-802b-479f847263c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:16.115066 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 487/998] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:16.400253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247c9ff-08b0-4c88-908a-a49f101d6dec None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:16.401767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c247c9ff-08b0-4c88-908a-a49f101d6dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:16.503183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247c9ff-08b0-4c88-908a-a49f101d6dec None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:16.576831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca325c-9ee9-4cf7-9959-304a8bdfcbfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:16.578039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca325c-9ee9-4cf7-9959-304a8bdfcbfc service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:16.578315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca325c-9ee9-4cf7-9959-304a8bdfcbfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:16.578585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca325c-9ee9-4cf7-9959-304a8bdfcbfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:16.580194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-67ca325c-9ee9-4cf7-9959-304a8bdfcbfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:16.587101 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:16.689917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca325c-9ee9-4cf7-9959-304a8bdfcbfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:16.691298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca325c-9ee9-4cf7-9959-304a8bdfcbfc service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:16.709957 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 512/999] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:19.555667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153df88-180b-47df-ae04-730e67324e81 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:19.556260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153df88-180b-47df-ae04-730e67324e81 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:19.556260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153df88-180b-47df-ae04-730e67324e81 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:19.558494 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 488/1000] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:19.564024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa4ef-7f99-42d5-8501-4f635d3ca71f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:19.564560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa4ef-7f99-42d5-8501-4f635d3ca71f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:19.564560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa4ef-7f99-42d5-8501-4f635d3ca71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:19.637704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0bdaa4ef-7f99-42d5-8501-4f635d3ca71f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:19.638949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0bdaa4ef-7f99-42d5-8501-4f635d3ca71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:19.700792 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:19.741644 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 513/1001] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:20.023177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153df88-180b-47df-ae04-730e67324e81 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:20.024706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b153df88-180b-47df-ae04-730e67324e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:20.129109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153df88-180b-47df-ae04-730e67324e81 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:20.142074 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:20.205248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce159002-e512-4239-9dd8-9fa4af2f2b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:20.205981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce159002-e512-4239-9dd8-9fa4af2f2b44 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:20.206261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce159002-e512-4239-9dd8-9fa4af2f2b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:20.206618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce159002-e512-4239-9dd8-9fa4af2f2b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:20.208337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ce159002-e512-4239-9dd8-9fa4af2f2b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:20.318247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce159002-e512-4239-9dd8-9fa4af2f2b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:20.319704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce159002-e512-4239-9dd8-9fa4af2f2b44 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:20.338227 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 489/1002] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:22.548079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98249-1c01-4f1b-8d69-421a3407f61a None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:22.548642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98249-1c01-4f1b-8d69-421a3407f61a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:22.548642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98249-1c01-4f1b-8d69-421a3407f61a None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:22.550099 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 514/1003] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:22.555474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be1d0d-0014-45bd-b92c-2869911f58e6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:22.555891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be1d0d-0014-45bd-b92c-2869911f58e6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:22.556079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be1d0d-0014-45bd-b92c-2869911f58e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:22.604440 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:22.624156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a2be1d0d-0014-45bd-b92c-2869911f58e6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:22.625357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a2be1d0d-0014-45bd-b92c-2869911f58e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:22.726596 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 490/1004] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:23.005621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98249-1c01-4f1b-8d69-421a3407f61a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:23.007256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-82d98249-1c01-4f1b-8d69-421a3407f61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:23.111744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98249-1c01-4f1b-8d69-421a3407f61a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:23.184242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082510e-bd55-4e71-877d-f5395e8bcd02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:23.184843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082510e-bd55-4e71-877d-f5395e8bcd02 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:23.185119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082510e-bd55-4e71-877d-f5395e8bcd02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:23.185386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082510e-bd55-4e71-877d-f5395e8bcd02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:23.187518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3082510e-bd55-4e71-877d-f5395e8bcd02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:23.205538 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:23.299680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082510e-bd55-4e71-877d-f5395e8bcd02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:23.301161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082510e-bd55-4e71-877d-f5395e8bcd02 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:23.319784 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 515/1005] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:25.555988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f8bae-b153-41ee-ba64-2a470b41c049 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:25.556506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f8bae-b153-41ee-ba64-2a470b41c049 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:25.556506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f8bae-b153-41ee-ba64-2a470b41c049 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:25.557863 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 491/1006] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:25.564908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb72598-08a5-4bc4-bbba-262fd89af479 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:25.565331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb72598-08a5-4bc4-bbba-262fd89af479 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:25.565567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb72598-08a5-4bc4-bbba-262fd89af479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:25.630979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dfb72598-08a5-4bc4-bbba-262fd89af479 None None] MFA Rules not processed for user `364bdc673dbe40e4a5943306e9aa4cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:25.632212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dfb72598-08a5-4bc4-bbba-262fd89af479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:25.698085 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:25.731075 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 516/1007] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:25 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:26.016287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f8bae-b153-41ee-ba64-2a470b41c049 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:26.017933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-042f8bae-b153-41ee-ba64-2a470b41c049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:26.130150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f8bae-b153-41ee-ba64-2a470b41c049 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:26.151036 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:26.206172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72e3eb-2e84-47d9-8c56-b51380dec28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:26.206693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72e3eb-2e84-47d9-8c56-b51380dec28c service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:26.206989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72e3eb-2e84-47d9-8c56-b51380dec28c service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:26.207260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72e3eb-2e84-47d9-8c56-b51380dec28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:26.208819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0a72e3eb-2e84-47d9-8c56-b51380dec28c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:26.319856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72e3eb-2e84-47d9-8c56-b51380dec28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:26.321279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72e3eb-2e84-47d9-8c56-b51380dec28c service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:26.339011 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 492/1008] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:28.790890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954ab38-17f6-45df-a3e1-7b7ede396c6c None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:28.791365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954ab38-17f6-45df-a3e1-7b7ede396c6c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:28.791480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954ab38-17f6-45df-a3e1-7b7ede396c6c None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:28.792815 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 517/1009] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:28.798724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02660e1-5c5a-4afb-a2db-1fd72688a82e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:28.799190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02660e1-5c5a-4afb-a2db-1fd72688a82e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:28.799361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02660e1-5c5a-4afb-a2db-1fd72688a82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:28.862691 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:28.865665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d02660e1-5c5a-4afb-a2db-1fd72688a82e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:28.867517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d02660e1-5c5a-4afb-a2db-1fd72688a82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:28.961804 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 493/1010] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:29.243431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954ab38-17f6-45df-a3e1-7b7ede396c6c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:29.244987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4954ab38-17f6-45df-a3e1-7b7ede396c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:29.347628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954ab38-17f6-45df-a3e1-7b7ede396c6c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:29.420294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79399726-2714-4e87-9fac-9613f1f1ce3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:29.422025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79399726-2714-4e87-9fac-9613f1f1ce3d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:29.422310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79399726-2714-4e87-9fac-9613f1f1ce3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:29.422578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79399726-2714-4e87-9fac-9613f1f1ce3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:29.424179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79399726-2714-4e87-9fac-9613f1f1ce3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:29.450373 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:29.533010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79399726-2714-4e87-9fac-9613f1f1ce3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:29.534378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79399726-2714-4e87-9fac-9613f1f1ce3d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:29.560601 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 518/1011] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:31.760249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9ae76-f460-4436-bec5-67647b3a6a9e None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:31.760822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9ae76-f460-4436-bec5-67647b3a6a9e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:31.760822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9ae76-f460-4436-bec5-67647b3a6a9e None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:31.762119 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 494/1012] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:31.767836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9290a6-9f39-4ce0-ba4c-d81eaa2c95ef None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:31.768243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9290a6-9f39-4ce0-ba4c-d81eaa2c95ef None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:31.768381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9290a6-9f39-4ce0-ba4c-d81eaa2c95ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:31.833480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0b9290a6-9f39-4ce0-ba4c-d81eaa2c95ef None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:31.834596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0b9290a6-9f39-4ce0-ba4c-d81eaa2c95ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:31.907729 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:31.930562 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 519/1013] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:32.222663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9ae76-f460-4436-bec5-67647b3a6a9e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:32.224216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f1c9ae76-f460-4436-bec5-67647b3a6a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:32.324387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9ae76-f460-4436-bec5-67647b3a6a9e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:32.352618 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:32.396734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7fa26-2be2-4c07-a67f-e0163cda92fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:32.397331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7fa26-2be2-4c07-a67f-e0163cda92fe service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:32.397607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7fa26-2be2-4c07-a67f-e0163cda92fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:32.397879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7fa26-2be2-4c07-a67f-e0163cda92fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:32.399483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-64c7fa26-2be2-4c07-a67f-e0163cda92fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:32.506070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7fa26-2be2-4c07-a67f-e0163cda92fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:32.507449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7fa26-2be2-4c07-a67f-e0163cda92fe service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:32.525216 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 495/1014] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:35.004165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ed972-aca7-49c6-b951-9ce4c760e017 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:35.004672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ed972-aca7-49c6-b951-9ce4c760e017 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:35.004672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ed972-aca7-49c6-b951-9ce4c760e017 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:35.005941 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 520/1015] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:35.011140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0e673-9ac3-4718-86a1-be095049e8b8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:35.011519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0e673-9ac3-4718-86a1-be095049e8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:35.011694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0e673-9ac3-4718-86a1-be095049e8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:35.076391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f6b0e673-9ac3-4718-86a1-be095049e8b8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:35.078357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f6b0e673-9ac3-4718-86a1-be095049e8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:35.086543 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:35.173653 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 496/1016] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:35.459192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ed972-aca7-49c6-b951-9ce4c760e017 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:35.460738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d12ed972-aca7-49c6-b951-9ce4c760e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:35.565629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ed972-aca7-49c6-b951-9ce4c760e017 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:35.641619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82879e0-5044-4bfb-a0dd-cc1556d25cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:35.642215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82879e0-5044-4bfb-a0dd-cc1556d25cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:35.642493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82879e0-5044-4bfb-a0dd-cc1556d25cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:35.642765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82879e0-5044-4bfb-a0dd-cc1556d25cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:35.644382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d82879e0-5044-4bfb-a0dd-cc1556d25cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:35.679400 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:35.752719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82879e0-5044-4bfb-a0dd-cc1556d25cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:35.754147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82879e0-5044-4bfb-a0dd-cc1556d25cb2 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:35.771924 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 521/1017] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:39.822277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29372e0-7299-4003-8b86-17dd6dcd1576 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:39.822797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29372e0-7299-4003-8b86-17dd6dcd1576 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:39.822797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29372e0-7299-4003-8b86-17dd6dcd1576 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:39.824174 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 497/1018] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:39.829637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2aa69a-9c80-4dca-ac9f-391ce932d8a8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:39.830049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2aa69a-9c80-4dca-ac9f-391ce932d8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:39.830189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2aa69a-9c80-4dca-ac9f-391ce932d8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:39.897298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1f2aa69a-9c80-4dca-ac9f-391ce932d8a8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:39.898501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1f2aa69a-9c80-4dca-ac9f-391ce932d8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:39.985597 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:39.996780 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 522/1019] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:40.284369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29372e0-7299-4003-8b86-17dd6dcd1576 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:40.286153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e29372e0-7299-4003-8b86-17dd6dcd1576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:40.390507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29372e0-7299-4003-8b86-17dd6dcd1576 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:40.429779 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:40.465638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86548a94-1f06-44be-b832-0e4ba5926f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:40.466246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548a94-1f06-44be-b832-0e4ba5926f11 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:40.466520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548a94-1f06-44be-b832-0e4ba5926f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:40.466786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548a94-1f06-44be-b832-0e4ba5926f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:40.469037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-86548a94-1f06-44be-b832-0e4ba5926f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:40.581408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86548a94-1f06-44be-b832-0e4ba5926f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:40.582877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86548a94-1f06-44be-b832-0e4ba5926f11 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:40.601516 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 498/1020] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:43.398951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e689e-fcfd-470b-8a86-fcc38d25107e None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:43.399519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e689e-fcfd-470b-8a86-fcc38d25107e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:43.399519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e689e-fcfd-470b-8a86-fcc38d25107e None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:43.400903 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 523/1021] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:43.406679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fca5b-aa15-4780-9164-6940614885b9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:43.407144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fca5b-aa15-4780-9164-6940614885b9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:43.407377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fca5b-aa15-4780-9164-6940614885b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:43.472363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-664fca5b-aa15-4780-9164-6940614885b9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:43.473545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-664fca5b-aa15-4780-9164-6940614885b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:43.492399 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:43.576890 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 499/1022] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:43.865860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e689e-fcfd-470b-8a86-fcc38d25107e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:43.867410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9a0e689e-fcfd-470b-8a86-fcc38d25107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:43.977654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e689e-fcfd-470b-8a86-fcc38d25107e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:44.051390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d1a5f-522b-4c12-8a70-81e326110ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:44.051986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d1a5f-522b-4c12-8a70-81e326110ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:44.052260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d1a5f-522b-4c12-8a70-81e326110ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:44.052527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d1a5f-522b-4c12-8a70-81e326110ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:44.054077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fc2d1a5f-522b-4c12-8a70-81e326110ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:44.097013 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:44.164655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d1a5f-522b-4c12-8a70-81e326110ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:44.166074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d1a5f-522b-4c12-8a70-81e326110ea4 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:44.184984 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 524/1023] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:48.915754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eedfc-79b3-4e5e-8820-f27c28c9bf6a None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:48.916316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eedfc-79b3-4e5e-8820-f27c28c9bf6a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:48.916316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eedfc-79b3-4e5e-8820-f27c28c9bf6a None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:48.917639 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 500/1024] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:48.923281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24792510-6f5f-4f16-b26a-85859a0ce72e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:48.923762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24792510-6f5f-4f16-b26a-85859a0ce72e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:48.923862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24792510-6f5f-4f16-b26a-85859a0ce72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:48.994364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-24792510-6f5f-4f16-b26a-85859a0ce72e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:48.995647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-24792510-6f5f-4f16-b26a-85859a0ce72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:49.094613 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:49.097107 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 525/1025] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:49.378257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eedfc-79b3-4e5e-8820-f27c28c9bf6a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:49.379806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ed0eedfc-79b3-4e5e-8820-f27c28c9bf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:49.480683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eedfc-79b3-4e5e-8820-f27c28c9bf6a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:49.527026 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:49.553707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3455439-86ac-4335-b847-e5d4dc743f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:49.554310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3455439-86ac-4335-b847-e5d4dc743f16 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:49.554585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3455439-86ac-4335-b847-e5d4dc743f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:49.554854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3455439-86ac-4335-b847-e5d4dc743f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:49.556479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f3455439-86ac-4335-b847-e5d4dc743f16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:49.663725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3455439-86ac-4335-b847-e5d4dc743f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:49.665060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3455439-86ac-4335-b847-e5d4dc743f16 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:49.683440 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 501/1026] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:54.615105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231bb74-c797-4b08-b4d6-d3cbc80abc0e None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:54.615105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231bb74-c797-4b08-b4d6-d3cbc80abc0e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:54.615105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231bb74-c797-4b08-b4d6-d3cbc80abc0e None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:54.615105 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 526/1027] 10.222.0.39 () {54 vars in 921 bytes} [Sun Oct 16 00:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:54.623404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0b4cf-3e14-4501-b449-99dd61cd0ab0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:54.624347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0b4cf-3e14-4501-b449-99dd61cd0ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:54.624822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0b4cf-3e14-4501-b449-99dd61cd0ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:54.732164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6fa0b4cf-3e14-4501-b449-99dd61cd0ab0 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:54.733726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6fa0b4cf-3e14-4501-b449-99dd61cd0ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:54.761806 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:54.915001 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 502/1028] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 00:50:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:59.231644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c66f9-a549-44e6-84e4-5f42ec11dad0 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:59.232207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c66f9-a549-44e6-84e4-5f42ec11dad0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:59.232444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c66f9-a549-44e6-84e4-5f42ec11dad0 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:59.234595 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 527/1029] 10.222.0.39 () {54 vars in 921 bytes} [Sun Oct 16 00:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:59.239877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988735bb-73b1-4194-92cd-d9582e5de30e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:59.240308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988735bb-73b1-4194-92cd-d9582e5de30e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:59.240415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988735bb-73b1-4194-92cd-d9582e5de30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:59.319447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-988735bb-73b1-4194-92cd-d9582e5de30e None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:59.320634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-988735bb-73b1-4194-92cd-d9582e5de30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:59.395886 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:59.440639 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 503/1030] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 00:50:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:00.628906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2361c0-be0a-47b6-a37b-f83466157e38 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:00.629344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2361c0-be0a-47b6-a37b-f83466157e38 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:00.629462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2361c0-be0a-47b6-a37b-f83466157e38 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:00.630783 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 528/1031] 10.222.0.39 () {54 vars in 921 bytes} [Sun Oct 16 00:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:00.636077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9963-cf15-44e2-bb55-779fafd963b7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:00.636486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9963-cf15-44e2-bb55-779fafd963b7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:00.636628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9963-cf15-44e2-bb55-779fafd963b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:00.713806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e96e9963-cf15-44e2-bb55-779fafd963b7 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:00.715059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e96e9963-cf15-44e2-bb55-779fafd963b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:00.821729 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 504/1032] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 00:51:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:04.560253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e1b5-1e2c-4563-9581-5e93d3128cfd None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:04.561749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e1b5-1e2c-4563-9581-5e93d3128cfd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:04.562272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e1b5-1e2c-4563-9581-5e93d3128cfd None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:04.564052 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 529/1033] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:04.569726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf79b4-6bfc-4875-a3f4-25181bebcaf1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:04.570189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf79b4-6bfc-4875-a3f4-25181bebcaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:04.570281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf79b4-6bfc-4875-a3f4-25181bebcaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:04.609374 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:04.647928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bdaf79b4-6bfc-4875-a3f4-25181bebcaf1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:04.649153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bdaf79b4-6bfc-4875-a3f4-25181bebcaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:04.754956 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 505/1034] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:05.074390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eddc5-8750-4e2d-a440-1953b8810452 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:05.075381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eddc5-8750-4e2d-a440-1953b8810452 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:05.076114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eddc5-8750-4e2d-a440-1953b8810452 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:05.080340 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 530/1035] 10.222.0.39 () {54 vars in 961 bytes} [Sun Oct 16 00:51:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:05.090984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ccd92-2708-4df3-af00-898dbc9efd4e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:05.092029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ccd92-2708-4df3-af00-898dbc9efd4e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:05.093174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ccd92-2708-4df3-af00-898dbc9efd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:05.187365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-264ccd92-2708-4df3-af00-898dbc9efd4e None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:05.188539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-264ccd92-2708-4df3-af00-898dbc9efd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:05.241947 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:05.320660 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 506/1036] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Oct 16 00:51:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:05.329529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859eddc5-8750-4e2d-a440-1953b8810452 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:05.331449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-859eddc5-8750-4e2d-a440-1953b8810452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:05.486732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859eddc5-8750-4e2d-a440-1953b8810452 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:05.571326 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:05.613892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f0153-9cae-4961-a6a1-14896d98acc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:05.614505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f0153-9cae-4961-a6a1-14896d98acc4 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:05.614782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f0153-9cae-4961-a6a1-14896d98acc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:05.615088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f0153-9cae-4961-a6a1-14896d98acc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:05.616658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-744f0153-9cae-4961-a6a1-14896d98acc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:05.718579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f0153-9cae-4961-a6a1-14896d98acc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:05.720367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f0153-9cae-4961-a6a1-14896d98acc4 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:05.740986 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 531/1037] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:08.155974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9e84-5815-4830-95ff-9d95ef3449c4 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:08.156542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9e84-5815-4830-95ff-9d95ef3449c4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:08.156542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9e84-5815-4830-95ff-9d95ef3449c4 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:08.158169 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 507/1038] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:08.163437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d552b-b204-4a81-a961-bc14065efb88 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:08.163856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d552b-b204-4a81-a961-bc14065efb88 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:08.164075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d552b-b204-4a81-a961-bc14065efb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:08.243049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a77d552b-b204-4a81-a961-bc14065efb88 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:08.244361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a77d552b-b204-4a81-a961-bc14065efb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:08.284351 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:08.348642 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 532/1039] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:08.638643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf9e84-5815-4830-95ff-9d95ef3449c4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:08.640715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1acf9e84-5815-4830-95ff-9d95ef3449c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:08.821193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf9e84-5815-4830-95ff-9d95ef3449c4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:08.833585 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:08.964262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a82c8-4439-413f-8131-4433bbaf345b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:08.964868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a82c8-4439-413f-8131-4433bbaf345b service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:08.965143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a82c8-4439-413f-8131-4433bbaf345b service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:08.965408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a82c8-4439-413f-8131-4433bbaf345b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:08.967171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1d2a82c8-4439-413f-8131-4433bbaf345b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:09.068124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a82c8-4439-413f-8131-4433bbaf345b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:09.069735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a82c8-4439-413f-8131-4433bbaf345b service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:09.094877 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 508/1040] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:11.668571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508060e9-5f0d-4c10-9823-f0ea52c5dc08 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:11.669674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508060e9-5f0d-4c10-9823-f0ea52c5dc08 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:11.670234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508060e9-5f0d-4c10-9823-f0ea52c5dc08 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:11.672123 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 533/1041] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:11.677051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947894cd-2cbb-444e-8a32-e449f173f1c2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:11.677475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947894cd-2cbb-444e-8a32-e449f173f1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:11.677575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947894cd-2cbb-444e-8a32-e449f173f1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:11.693000 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:11.754902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-947894cd-2cbb-444e-8a32-e449f173f1c2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:11.757323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-947894cd-2cbb-444e-8a32-e449f173f1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:11.889753 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 509/1042] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:12.185498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba75d-e3c3-411b-9bc2-84cbd7c3d603 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:12.185955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba75d-e3c3-411b-9bc2-84cbd7c3d603 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:12.186897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba75d-e3c3-411b-9bc2-84cbd7c3d603 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:12.188591 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 534/1043] 10.222.0.39 () {54 vars in 961 bytes} [Sun Oct 16 00:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:12.195198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10da59-c861-43a0-80ea-ee307dc54ed5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:12.195639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10da59-c861-43a0-80ea-ee307dc54ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:12.196173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10da59-c861-43a0-80ea-ee307dc54ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:12.281356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6a10da59-c861-43a0-80ea-ee307dc54ed5 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:12.282807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6a10da59-c861-43a0-80ea-ee307dc54ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:12.337295 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:12.441846 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 510/1044] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Oct 16 00:51:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:12.450179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba75d-e3c3-411b-9bc2-84cbd7c3d603 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:12.453370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0ffba75d-e3c3-411b-9bc2-84cbd7c3d603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:12.665946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba75d-e3c3-411b-9bc2-84cbd7c3d603 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:12.691360 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:12.821131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ae87-04af-46f8-b9e2-35a661c0ac9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:12.822018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ae87-04af-46f8-b9e2-35a661c0ac9e service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:12.822432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ae87-04af-46f8-b9e2-35a661c0ac9e service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:12.822841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ae87-04af-46f8-b9e2-35a661c0ac9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:12.824987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1e10ae87-04af-46f8-b9e2-35a661c0ac9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:12.932126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10ae87-04af-46f8-b9e2-35a661c0ac9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:12.933715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10ae87-04af-46f8-b9e2-35a661c0ac9e service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:12.954429 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 535/1045] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:15.523580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadc402-ea5f-4f9e-bc38-a8681d0dcafa None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:15.524117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadc402-ea5f-4f9e-bc38-a8681d0dcafa None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:15.524358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadc402-ea5f-4f9e-bc38-a8681d0dcafa None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:15.529595 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 511/1046] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:15.532135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4859b1-d3e2-48f7-b22d-6ec60db505ec None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:15.533008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4859b1-d3e2-48f7-b22d-6ec60db505ec None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:15.533488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4859b1-d3e2-48f7-b22d-6ec60db505ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:15.572429 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:15.615651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-db4859b1-d3e2-48f7-b22d-6ec60db505ec None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:15.617336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-db4859b1-d3e2-48f7-b22d-6ec60db505ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:15.730949 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 536/1047] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:16.084454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadc402-ea5f-4f9e-bc38-a8681d0dcafa None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:16.085988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3cadc402-ea5f-4f9e-bc38-a8681d0dcafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:16.302672 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:16.315328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadc402-ea5f-4f9e-bc38-a8681d0dcafa None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:16.472940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d030aa4-caa4-44e8-bedd-5648277c75d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:16.473456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d030aa4-caa4-44e8-bedd-5648277c75d8 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:16.473734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d030aa4-caa4-44e8-bedd-5648277c75d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:16.474002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d030aa4-caa4-44e8-bedd-5648277c75d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:16.475626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6d030aa4-caa4-44e8-bedd-5648277c75d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:16.582772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d030aa4-caa4-44e8-bedd-5648277c75d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:16.584348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d030aa4-caa4-44e8-bedd-5648277c75d8 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:16.602804 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:16.607220 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 512/1048] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:16.630320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa48c84-b2a1-49d5-9880-a39dc5c44f99 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:16.630876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa48c84-b2a1-49d5-9880-a39dc5c44f99 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:16.630876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa48c84-b2a1-49d5-9880-a39dc5c44f99 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:16.632479 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 537/1049] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:16.643227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15fe1e-9f73-4169-a3dc-b684aea27766 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:16.643511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15fe1e-9f73-4169-a3dc-b684aea27766 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:16.643780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15fe1e-9f73-4169-a3dc-b684aea27766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:16.723846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2e15fe1e-9f73-4169-a3dc-b684aea27766 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:16.724974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2e15fe1e-9f73-4169-a3dc-b684aea27766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:16.851933 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 513/1050] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:51:17.181597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce16adc-5fa2-4f4f-ba8c-2f1729a99924 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:17.181597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce16adc-5fa2-4f4f-ba8c-2f1729a99924 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:17.181597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce16adc-5fa2-4f4f-ba8c-2f1729a99924 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:17.182865 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 538/1051] 10.222.0.39 () {54 vars in 963 bytes} [Sun Oct 16 00:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:17.187937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdfb27-b142-4c2d-95b4-51e328e528a7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:17.188220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdfb27-b142-4c2d-95b4-51e328e528a7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:17.188493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdfb27-b142-4c2d-95b4-51e328e528a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:17.272107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-81cdfb27-b142-4c2d-95b4-51e328e528a7 None None] MFA Rules not processed for user `2536755baf5d4916bdc5942d5a1ace99`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:17.273412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-81cdfb27-b142-4c2d-95b4-51e328e528a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:17.297214 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:17.360558 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 514/1052] 10.222.0.39 () {58 vars in 1060 bytes} [Sun Oct 16 00:51:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:17.368214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce16adc-5fa2-4f4f-ba8c-2f1729a99924 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:17.369837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fce16adc-5fa2-4f4f-ba8c-2f1729a99924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:17.480760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce16adc-5fa2-4f4f-ba8c-2f1729a99924 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:17.485346 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:17.568927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa526d-620a-4879-aff0-481a3c00bf96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:17.569873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa526d-620a-4879-aff0-481a3c00bf96 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:17.570158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa526d-620a-4879-aff0-481a3c00bf96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:17.570444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa526d-620a-4879-aff0-481a3c00bf96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:17.572389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-60fa526d-620a-4879-aff0-481a3c00bf96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:17.687495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa526d-620a-4879-aff0-481a3c00bf96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:17.689076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa526d-620a-4879-aff0-481a3c00bf96 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:17.708057 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 539/1053] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:18.852671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d0660-b64a-4ab6-961e-0c8fae4ae97b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:18.853226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d0660-b64a-4ab6-961e-0c8fae4ae97b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:18.853226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d0660-b64a-4ab6-961e-0c8fae4ae97b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:18.854534 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 515/1054] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:18.860434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cfe61-f016-484c-bc6b-6628f51c26f3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:18.860864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cfe61-f016-484c-bc6b-6628f51c26f3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:18.860982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cfe61-f016-484c-bc6b-6628f51c26f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:18.905856 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:18.928807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-124cfe61-f016-484c-bc6b-6628f51c26f3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:18.930005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-124cfe61-f016-484c-bc6b-6628f51c26f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:19.039649 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 540/1055] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:51:19.336239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d0660-b64a-4ab6-961e-0c8fae4ae97b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:19.337887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8d1d0660-b64a-4ab6-961e-0c8fae4ae97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:19.503229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d0660-b64a-4ab6-961e-0c8fae4ae97b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:19.532656 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:19.635368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d0351-2a79-485e-9ab5-2776157c03f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:19.636162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d0351-2a79-485e-9ab5-2776157c03f7 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:19.636440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d0351-2a79-485e-9ab5-2776157c03f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:19.636707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d0351-2a79-485e-9ab5-2776157c03f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:19.638333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0e2d0351-2a79-485e-9ab5-2776157c03f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:19.747928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d0351-2a79-485e-9ab5-2776157c03f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:19.749567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d0351-2a79-485e-9ab5-2776157c03f7 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:19.770582 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 516/1056] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:22.071376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547dd4d-0abd-44f9-956d-6d723e784ab0 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:22.072449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547dd4d-0abd-44f9-956d-6d723e784ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:22.072951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547dd4d-0abd-44f9-956d-6d723e784ab0 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:22.079317 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 541/1057] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:22.080756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05959b-c9a1-4b5c-8d26-56b4ee2a9cc4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:22.081182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05959b-c9a1-4b5c-8d26-56b4ee2a9cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:22.081364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05959b-c9a1-4b5c-8d26-56b4ee2a9cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:22.128617 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:22.158012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ce05959b-c9a1-4b5c-8d26-56b4ee2a9cc4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:22.159497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ce05959b-c9a1-4b5c-8d26-56b4ee2a9cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:22.266291 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 517/1058] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:51:22.556823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547dd4d-0abd-44f9-956d-6d723e784ab0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:22.558565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e547dd4d-0abd-44f9-956d-6d723e784ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:22.676874 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:22.720926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547dd4d-0abd-44f9-956d-6d723e784ab0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:22.858631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56481cd0-5051-45db-87ae-3a0667bfd130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:22.859885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56481cd0-5051-45db-87ae-3a0667bfd130 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:22.860274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56481cd0-5051-45db-87ae-3a0667bfd130 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:22.860547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56481cd0-5051-45db-87ae-3a0667bfd130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:22.862171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-56481cd0-5051-45db-87ae-3a0667bfd130 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:22.948753 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:22.966338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56481cd0-5051-45db-87ae-3a0667bfd130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:22.968711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56481cd0-5051-45db-87ae-3a0667bfd130 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:22.987871 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 542/1059] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:25.320199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beb5c5-d414-4d37-836c-58ca5cd4a2da None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:25.320773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beb5c5-d414-4d37-836c-58ca5cd4a2da None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:25.320773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beb5c5-d414-4d37-836c-58ca5cd4a2da None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:25.322218 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 518/1060] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:25.327886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c565-8363-433c-8ad7-5eca58ae8e3d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:25.328306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c565-8363-433c-8ad7-5eca58ae8e3d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:25.328482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c565-8363-433c-8ad7-5eca58ae8e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:25.398114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8898c565-8363-433c-8ad7-5eca58ae8e3d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:25.399506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8898c565-8363-433c-8ad7-5eca58ae8e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:25.506999 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 543/1061] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:25.815570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7beb5c5-d414-4d37-836c-58ca5cd4a2da None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:25.817065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e7beb5c5-d414-4d37-836c-58ca5cd4a2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:25.921540 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:25.964317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7beb5c5-d414-4d37-836c-58ca5cd4a2da None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:26.090177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccd7d1-ecc2-43f7-ad8c-dc4cb6e33618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:26.090811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccd7d1-ecc2-43f7-ad8c-dc4cb6e33618 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:26.091078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccd7d1-ecc2-43f7-ad8c-dc4cb6e33618 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:26.091345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccd7d1-ecc2-43f7-ad8c-dc4cb6e33618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:26.093098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bcccd7d1-ecc2-43f7-ad8c-dc4cb6e33618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:26.165879 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:26.190377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccd7d1-ecc2-43f7-ad8c-dc4cb6e33618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:26.192002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccd7d1-ecc2-43f7-ad8c-dc4cb6e33618 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:26.211883 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 519/1062] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:28.395246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb85b35-b033-4eb6-8645-21029ef91d33 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:28.395918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb85b35-b033-4eb6-8645-21029ef91d33 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:28.395918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb85b35-b033-4eb6-8645-21029ef91d33 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:28.397208 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 544/1063] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:51:28.403269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc9af4-1588-4ba9-81bb-e9269e9289b0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:28.403876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc9af4-1588-4ba9-81bb-e9269e9289b0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:28.403876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc9af4-1588-4ba9-81bb-e9269e9289b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:28.470974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3edc9af4-1588-4ba9-81bb-e9269e9289b0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:28.472096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3edc9af4-1588-4ba9-81bb-e9269e9289b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:28.575260 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 520/1064] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:28.883653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb85b35-b033-4eb6-8645-21029ef91d33 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:28.885185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9cb85b35-b033-4eb6-8645-21029ef91d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:28.947330 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:29.061067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb85b35-b033-4eb6-8645-21029ef91d33 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:29.196527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785094a-7ef0-4422-a12d-8c4f65926842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:29.197267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785094a-7ef0-4422-a12d-8c4f65926842 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:29.197613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785094a-7ef0-4422-a12d-8c4f65926842 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:29.197954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785094a-7ef0-4422-a12d-8c4f65926842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:29.200053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9785094a-7ef0-4422-a12d-8c4f65926842 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:29.217927 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:29.300852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785094a-7ef0-4422-a12d-8c4f65926842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:29.302435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785094a-7ef0-4422-a12d-8c4f65926842 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:29.321036 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 545/1065] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:31.696798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76531e-5a9c-43f9-bd63-67d84dd4e7c8 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:31.697462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76531e-5a9c-43f9-bd63-67d84dd4e7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:31.697462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76531e-5a9c-43f9-bd63-67d84dd4e7c8 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:31.698875 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 521/1066] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:31.704467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19608821-e792-4980-baf0-2d04aaac68c6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:31.704907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19608821-e792-4980-baf0-2d04aaac68c6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:31.705047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19608821-e792-4980-baf0-2d04aaac68c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:31.774792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-19608821-e792-4980-baf0-2d04aaac68c6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:31.776109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-19608821-e792-4980-baf0-2d04aaac68c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:31.896743 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:31.909037 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 546/1067] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:32.198374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76531e-5a9c-43f9-bd63-67d84dd4e7c8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:32.199922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dc76531e-5a9c-43f9-bd63-67d84dd4e7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:32.252407 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:32.346043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76531e-5a9c-43f9-bd63-67d84dd4e7c8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:32.457681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023ed1a-4129-485b-b69b-e34235715dfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:32.458199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ed1a-4129-485b-b69b-e34235715dfb service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:32.458471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ed1a-4129-485b-b69b-e34235715dfb service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:32.458737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ed1a-4129-485b-b69b-e34235715dfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:32.460332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0023ed1a-4129-485b-b69b-e34235715dfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:32.472498 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:32.550694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023ed1a-4129-485b-b69b-e34235715dfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:32.552314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023ed1a-4129-485b-b69b-e34235715dfb service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:32.571874 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 522/1068] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:33.436888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544140d-2517-426f-b043-e1ebe20990d1 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:33.436888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544140d-2517-426f-b043-e1ebe20990d1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:33.437523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544140d-2517-426f-b043-e1ebe20990d1 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:33.438561 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 547/1069] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:33.443943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a04180-8a28-4e9e-8ba8-28efe5b072a6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:33.444357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a04180-8a28-4e9e-8ba8-28efe5b072a6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:33.444520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a04180-8a28-4e9e-8ba8-28efe5b072a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:33.514197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-18a04180-8a28-4e9e-8ba8-28efe5b072a6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:33.516010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-18a04180-8a28-4e9e-8ba8-28efe5b072a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:33.608175 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:33.620882 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 523/1070] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:33.934396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01e5d1-ed74-42c8-953d-b82e6237e619 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:33.934688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01e5d1-ed74-42c8-953d-b82e6237e619 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:33.935003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01e5d1-ed74-42c8-953d-b82e6237e619 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:33.936926 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 548/1071] 10.222.0.39 () {54 vars in 962 bytes} [Sun Oct 16 00:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:33.942506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91633bcd-37cf-4b4b-850b-bf42b7f192d5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:33.942882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91633bcd-37cf-4b4b-850b-bf42b7f192d5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:33.943296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91633bcd-37cf-4b4b-850b-bf42b7f192d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:34.021675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-91633bcd-37cf-4b4b-850b-bf42b7f192d5 None None] MFA Rules not processed for user `afb30ad752234d8c9f12302b0b69666b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:34.022974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-91633bcd-37cf-4b4b-850b-bf42b7f192d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:34.101991 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 524/1072] 10.222.0.39 () {58 vars in 1059 bytes} [Sun Oct 16 00:51:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:34.112093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01e5d1-ed74-42c8-953d-b82e6237e619 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:34.113673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c01e5d1-ed74-42c8-953d-b82e6237e619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:34.221149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01e5d1-ed74-42c8-953d-b82e6237e619 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:34.296534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c3a72-44c0-4f60-8212-291e3a598278 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:34.297234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3a72-44c0-4f60-8212-291e3a598278 service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:34.297504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3a72-44c0-4f60-8212-291e3a598278 service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:34.297768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3a72-44c0-4f60-8212-291e3a598278 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:34.299350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b59c3a72-44c0-4f60-8212-291e3a598278 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:34.344087 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:34.411765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c3a72-44c0-4f60-8212-291e3a598278 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:34.413199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c3a72-44c0-4f60-8212-291e3a598278 service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:34.431868 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 549/1073] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:34.756106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6c0dc-2e38-45c8-bf59-1c6e2f2781f3 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:34.756738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6c0dc-2e38-45c8-bf59-1c6e2f2781f3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:34.756738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6c0dc-2e38-45c8-bf59-1c6e2f2781f3 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:34.758251 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 525/1074] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:34.764065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52322dcc-8b4c-4ee3-8d56-77020bd3ac5f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:34.765130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52322dcc-8b4c-4ee3-8d56-77020bd3ac5f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:34.765643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52322dcc-8b4c-4ee3-8d56-77020bd3ac5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:34.846254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-52322dcc-8b4c-4ee3-8d56-77020bd3ac5f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:34.847635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-52322dcc-8b4c-4ee3-8d56-77020bd3ac5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:34.947406 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:34.949641 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 550/1075] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:35.194113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae131-3306-4222-845e-99b1535d11fb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:35.194575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae131-3306-4222-845e-99b1535d11fb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:35.194944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae131-3306-4222-845e-99b1535d11fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:35.249451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52322dcc-8b4c-4ee3-8d56-77020bd3ac5f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:35.250788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-52322dcc-8b4c-4ee3-8d56-77020bd3ac5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:35.264387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d47ae131-3306-4222-845e-99b1535d11fb None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:35.266128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d47ae131-3306-4222-845e-99b1535d11fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:35.303357 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:35.362695 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 526/1076] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 00:51:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:35.368182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52322dcc-8b4c-4ee3-8d56-77020bd3ac5f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:35.407660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280a9f1-a618-4bbc-b940-5fd7bbac4260 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:35.408028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280a9f1-a618-4bbc-b940-5fd7bbac4260 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:35.408417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280a9f1-a618-4bbc-b940-5fd7bbac4260 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:35.409826 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 527/1077] 10.222.0.39 () {54 vars in 943 bytes} [Sun Oct 16 00:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:51:35.416779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62f6fb-6b20-4034-8283-3f0145914ae7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:35.417174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62f6fb-6b20-4034-8283-3f0145914ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:35.417511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62f6fb-6b20-4034-8283-3f0145914ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:35.481705 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:35.488709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8558c3b-93b6-4bf8-9fd2-8c15c3600035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:35.489330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8558c3b-93b6-4bf8-9fd2-8c15c3600035 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:35.489605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8558c3b-93b6-4bf8-9fd2-8c15c3600035 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:35.489875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8558c3b-93b6-4bf8-9fd2-8c15c3600035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:35.491498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f8558c3b-93b6-4bf8-9fd2-8c15c3600035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:35.497868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ce62f6fb-6b20-4034-8283-3f0145914ae7 None None] MFA Rules not processed for user `ef8c6c33c3504949876d496a5213494d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:35.499556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ce62f6fb-6b20-4034-8283-3f0145914ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:35.586257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8558c3b-93b6-4bf8-9fd2-8c15c3600035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:35.587906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8558c3b-93b6-4bf8-9fd2-8c15c3600035 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:35.605932 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 551/1078] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:51:35.610548 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 528/1079] 10.222.0.39 () {58 vars in 1040 bytes} [Sun Oct 16 00:51:35 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:35.620302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8558c3b-93b6-4bf8-9fd2-8c15c3600035 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:35.621686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f8558c3b-93b6-4bf8-9fd2-8c15c3600035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:35.721659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8558c3b-93b6-4bf8-9fd2-8c15c3600035 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:35.763102 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:35.838746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876ead7-09fc-4f21-b5b0-0657a8c20a93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:35.839506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876ead7-09fc-4f21-b5b0-0657a8c20a93 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:35.839637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876ead7-09fc-4f21-b5b0-0657a8c20a93 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:35.839902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876ead7-09fc-4f21-b5b0-0657a8c20a93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:35.841530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4876ead7-09fc-4f21-b5b0-0657a8c20a93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:35.930943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876ead7-09fc-4f21-b5b0-0657a8c20a93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:35.932424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876ead7-09fc-4f21-b5b0-0657a8c20a93 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:35.941556 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 552/1080] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 00:51:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:51:37.844874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eb144-2858-47da-9eaa-d35dc323fb5e None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:37.845432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eb144-2858-47da-9eaa-d35dc323fb5e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:37.845432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eb144-2858-47da-9eaa-d35dc323fb5e None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:37.847168 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 529/1081] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:37.852375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce5723-60bd-41e3-b254-c3934ecd32e2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:37.853226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce5723-60bd-41e3-b254-c3934ecd32e2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:37.853505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce5723-60bd-41e3-b254-c3934ecd32e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:37.930989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-62ce5723-60bd-41e3-b254-c3934ecd32e2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:37.932550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-62ce5723-60bd-41e3-b254-c3934ecd32e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:37.951358 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:38.054946 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 553/1082] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:51:38.345135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82eb144-2858-47da-9eaa-d35dc323fb5e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:38.346985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b82eb144-2858-47da-9eaa-d35dc323fb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:38.351160 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:38.509052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82eb144-2858-47da-9eaa-d35dc323fb5e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:38.601822 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:38.644228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611309b-7609-4faa-9ec0-e12aa415bf0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:38.646901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611309b-7609-4faa-9ec0-e12aa415bf0a service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:38.647200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611309b-7609-4faa-9ec0-e12aa415bf0a service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:38.647472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611309b-7609-4faa-9ec0-e12aa415bf0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:38.649261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4611309b-7609-4faa-9ec0-e12aa415bf0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:38.753552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611309b-7609-4faa-9ec0-e12aa415bf0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:38.755311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611309b-7609-4faa-9ec0-e12aa415bf0a service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:38.774505 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 530/1083] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:40.981392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7287a-6478-45a7-8549-85045f304e7f None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:40.981917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7287a-6478-45a7-8549-85045f304e7f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:40.981917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7287a-6478-45a7-8549-85045f304e7f None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:40.983899 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 554/1084] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:51:40.989197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79899707-60f6-4216-a781-db935c5d3c09 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:40.989639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79899707-60f6-4216-a781-db935c5d3c09 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:40.989738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79899707-60f6-4216-a781-db935c5d3c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:41.064902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-79899707-60f6-4216-a781-db935c5d3c09 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:41.064902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-79899707-60f6-4216-a781-db935c5d3c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:41.108845 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:41.202967 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 531/1085] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:51:41.507519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7287a-6478-45a7-8549-85045f304e7f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:51:41.509031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a5b7287a-6478-45a7-8549-85045f304e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:41.676112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7287a-6478-45a7-8549-85045f304e7f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:51:41.678903 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:41.800957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ceae1-41a9-488f-8207-4bbb77544531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:51:41.801560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ceae1-41a9-488f-8207-4bbb77544531 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:41.801830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ceae1-41a9-488f-8207-4bbb77544531 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:41.802098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ceae1-41a9-488f-8207-4bbb77544531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:41.803785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dd7ceae1-41a9-488f-8207-4bbb77544531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:41.909255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ceae1-41a9-488f-8207-4bbb77544531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:51:41.911236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ceae1-41a9-488f-8207-4bbb77544531 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:51:41.934843 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 555/1086] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:51.196612 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=25 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:51.932184 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:59.073773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74627b-3b25-4616-98fc-8c4d44c8f44e None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:59.074346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74627b-3b25-4616-98fc-8c4d44c8f44e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:59.074346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74627b-3b25-4616-98fc-8c4d44c8f44e None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:59.075739 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 532/1087] 10.222.0.39 () {54 vars in 918 bytes} [Sun Oct 16 00:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:59.081448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d2803-b109-4fb7-a01d-031c94642062 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:59.081917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d2803-b109-4fb7-a01d-031c94642062 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:59.082028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d2803-b109-4fb7-a01d-031c94642062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:59.157829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-309d2803-b109-4fb7-a01d-031c94642062 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:59.159042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-309d2803-b109-4fb7-a01d-031c94642062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:59.263037 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 556/1088] 10.222.0.39 () {58 vars in 1015 bytes} [Sun Oct 16 00:51:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:51:59.278105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9f8a-527e-4841-bd44-a5a3bf63f094 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:59.278382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9f8a-527e-4841-bd44-a5a3bf63f094 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:59.278648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9f8a-527e-4841-bd44-a5a3bf63f094 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:59.280006 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 533/1089] 10.222.0.39 () {54 vars in 918 bytes} [Sun Oct 16 00:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:51:59.284586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac107a-c26e-41f5-a8d5-4c19380e5651 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:51:59.284871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac107a-c26e-41f5-a8d5-4c19380e5651 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:51:59.285144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac107a-c26e-41f5-a8d5-4c19380e5651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:51:59.356663 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:59.359889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a8ac107a-c26e-41f5-a8d5-4c19380e5651 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:51:59.361624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a8ac107a-c26e-41f5-a8d5-4c19380e5651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:51:59.476628 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 557/1090] 10.222.0.39 () {58 vars in 1015 bytes} [Sun Oct 16 00:51:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:02.040938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4abf3f-81cf-4c98-8b31-3231dd0563bf None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:02.041494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4abf3f-81cf-4c98-8b31-3231dd0563bf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:02.041494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4abf3f-81cf-4c98-8b31-3231dd0563bf None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:02.042715 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 534/1091] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:02.048618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6928-283a-4a2e-a45e-903c74937091 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:02.049045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6928-283a-4a2e-a45e-903c74937091 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:02.049156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6928-283a-4a2e-a45e-903c74937091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:02.116522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-403d6928-283a-4a2e-a45e-903c74937091 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:02.117726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-403d6928-283a-4a2e-a45e-903c74937091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:02.173719 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:02.215409 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 558/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:02.506439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4abf3f-81cf-4c98-8b31-3231dd0563bf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:02.508103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ed4abf3f-81cf-4c98-8b31-3231dd0563bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:02.654547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4abf3f-81cf-4c98-8b31-3231dd0563bf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:02.727648 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:02.767631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f5727-a515-4734-9cd0-61083b847782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:02.768166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f5727-a515-4734-9cd0-61083b847782 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:02.768438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f5727-a515-4734-9cd0-61083b847782 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:02.768704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f5727-a515-4734-9cd0-61083b847782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:02.770269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8e5f5727-a515-4734-9cd0-61083b847782 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:02.857813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f5727-a515-4734-9cd0-61083b847782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:02.860446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f5727-a515-4734-9cd0-61083b847782 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:02.878571 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 535/1093] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:04.038182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a0164-47ee-4977-8c5c-5f74d363f931 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:04.038719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a0164-47ee-4977-8c5c-5f74d363f931 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:04.038719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a0164-47ee-4977-8c5c-5f74d363f931 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:04.040070 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 559/1094] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:04.046585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64689bf6-b523-4287-8b26-3441c85c15fc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:04.047019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64689bf6-b523-4287-8b26-3441c85c15fc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:04.047132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64689bf6-b523-4287-8b26-3441c85c15fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:04.122740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-64689bf6-b523-4287-8b26-3441c85c15fc None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:04.123996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-64689bf6-b523-4287-8b26-3441c85c15fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:04.150316 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:04.222082 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 536/1095] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:04.381441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a0164-47ee-4977-8c5c-5f74d363f931 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:04.382873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9f3a0164-47ee-4977-8c5c-5f74d363f931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:04.528446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a0164-47ee-4977-8c5c-5f74d363f931 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:04.569768 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:04.642467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2992297-2b0f-4cd7-bf63-86ee00c077ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:04.643019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992297-2b0f-4cd7-bf63-86ee00c077ae service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:04.643293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992297-2b0f-4cd7-bf63-86ee00c077ae service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:04.643554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992297-2b0f-4cd7-bf63-86ee00c077ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:04.645152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c2992297-2b0f-4cd7-bf63-86ee00c077ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:04.734640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2992297-2b0f-4cd7-bf63-86ee00c077ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:04.736321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2992297-2b0f-4cd7-bf63-86ee00c077ae service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:04.754557 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 560/1096] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:05.884468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db1be-6fe7-4444-bcfa-91207f2f39bb None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:05.885021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db1be-6fe7-4444-bcfa-91207f2f39bb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:05.885021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db1be-6fe7-4444-bcfa-91207f2f39bb None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:05.886262 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 537/1097] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:05.892525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880463d-51d8-44bc-be8c-cb9ec29de326 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:05.892992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880463d-51d8-44bc-be8c-cb9ec29de326 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:05.893098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880463d-51d8-44bc-be8c-cb9ec29de326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:05.948370 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:05.971345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c880463d-51d8-44bc-be8c-cb9ec29de326 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:05.972535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c880463d-51d8-44bc-be8c-cb9ec29de326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:06.067507 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 561/1098] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:06.219392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5db1be-6fe7-4444-bcfa-91207f2f39bb None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:06.220885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8c5db1be-6fe7-4444-bcfa-91207f2f39bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:06.363950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5db1be-6fe7-4444-bcfa-91207f2f39bb None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:06.376167 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:06.476650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8830c-37a0-4fbc-b51b-abe514679bdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:06.477173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8830c-37a0-4fbc-b51b-abe514679bdd service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:06.477453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8830c-37a0-4fbc-b51b-abe514679bdd service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:06.477720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8830c-37a0-4fbc-b51b-abe514679bdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:06.479345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8dd8830c-37a0-4fbc-b51b-abe514679bdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:06.569892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8830c-37a0-4fbc-b51b-abe514679bdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:06.571519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8830c-37a0-4fbc-b51b-abe514679bdd service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:06.589609 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 538/1099] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:07.712350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e74c0-9aeb-4e7b-967d-00ecc367d5f7 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:07.712921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e74c0-9aeb-4e7b-967d-00ecc367d5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:07.712921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e74c0-9aeb-4e7b-967d-00ecc367d5f7 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:07.714213 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 562/1100] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:07.720529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61813b1-2d85-4631-9bb8-0b02f9217166 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:07.720982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61813b1-2d85-4631-9bb8-0b02f9217166 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:07.721360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61813b1-2d85-4631-9bb8-0b02f9217166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:07.741295 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:07.798431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e61813b1-2d85-4631-9bb8-0b02f9217166 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:07.799667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e61813b1-2d85-4631-9bb8-0b02f9217166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:07.894345 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 539/1101] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:08.047351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e74c0-9aeb-4e7b-967d-00ecc367d5f7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:08.049146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-729e74c0-9aeb-4e7b-967d-00ecc367d5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:08.160789 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:08.197102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e74c0-9aeb-4e7b-967d-00ecc367d5f7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:08.309606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc1ce9-44bd-48f1-956e-07a8cbdfda36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:08.310208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc1ce9-44bd-48f1-956e-07a8cbdfda36 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:08.310489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc1ce9-44bd-48f1-956e-07a8cbdfda36 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:08.310758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc1ce9-44bd-48f1-956e-07a8cbdfda36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:08.312878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79fc1ce9-44bd-48f1-956e-07a8cbdfda36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:08.389319 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:08.403387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc1ce9-44bd-48f1-956e-07a8cbdfda36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:08.405048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc1ce9-44bd-48f1-956e-07a8cbdfda36 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:08.423303 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 563/1102] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:52:09.625984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282882ed-3bbf-4b77-b3cc-b9827763ac6b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:09.626581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282882ed-3bbf-4b77-b3cc-b9827763ac6b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:09.626581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282882ed-3bbf-4b77-b3cc-b9827763ac6b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:09.627922 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 540/1103] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:09.634682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ab7bb-f35e-478b-a656-8863df265346 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:09.635224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ab7bb-f35e-478b-a656-8863df265346 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:09.635224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ab7bb-f35e-478b-a656-8863df265346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:09.719822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-123ab7bb-f35e-478b-a656-8863df265346 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:09.721449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-123ab7bb-f35e-478b-a656-8863df265346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:09.824081 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 564/1104] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:09.975350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282882ed-3bbf-4b77-b3cc-b9827763ac6b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:09.976959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-282882ed-3bbf-4b77-b3cc-b9827763ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:10.061562 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:10.124917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282882ed-3bbf-4b77-b3cc-b9827763ac6b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:10.237634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3500432-c5d1-4bbb-ba89-335462c021e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:10.238238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3500432-c5d1-4bbb-ba89-335462c021e6 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:10.238524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3500432-c5d1-4bbb-ba89-335462c021e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:10.238790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3500432-c5d1-4bbb-ba89-335462c021e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:10.240439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c3500432-c5d1-4bbb-ba89-335462c021e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:10.289181 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:10.331634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3500432-c5d1-4bbb-ba89-335462c021e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:10.333248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3500432-c5d1-4bbb-ba89-335462c021e6 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:10.351807 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 541/1105] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:11.414838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b592ae3-4967-4ebf-a115-d038814ddf5e None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:11.415498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b592ae3-4967-4ebf-a115-d038814ddf5e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:11.415498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b592ae3-4967-4ebf-a115-d038814ddf5e None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:11.416812 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 565/1106] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:11.423096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c73c8-3b38-4690-9cb6-e594828da054 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:11.423558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c73c8-3b38-4690-9cb6-e594828da054 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:11.423668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c73c8-3b38-4690-9cb6-e594828da054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:11.498617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4f0c73c8-3b38-4690-9cb6-e594828da054 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:11.500450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4f0c73c8-3b38-4690-9cb6-e594828da054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:11.596219 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 542/1107] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:11.745040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b592ae3-4967-4ebf-a115-d038814ddf5e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:11.746517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4b592ae3-4967-4ebf-a115-d038814ddf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:11.795120 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:11.893070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b592ae3-4967-4ebf-a115-d038814ddf5e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:12.009960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80ef74-2c78-4346-9144-87bb4faa09c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:12.010473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80ef74-2c78-4346-9144-87bb4faa09c2 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:12.010750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80ef74-2c78-4346-9144-87bb4faa09c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:12.011049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80ef74-2c78-4346-9144-87bb4faa09c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:12.012630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4b80ef74-2c78-4346-9144-87bb4faa09c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:12.019558 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:12.102599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80ef74-2c78-4346-9144-87bb4faa09c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:12.104213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80ef74-2c78-4346-9144-87bb4faa09c2 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:12.122276 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 566/1108] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:52:13.178005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a067eb-c5a8-434e-b284-5d2c66034425 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:13.178571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a067eb-c5a8-434e-b284-5d2c66034425 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:13.178571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a067eb-c5a8-434e-b284-5d2c66034425 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:13.179956 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 543/1109] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:13.186463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ef157-eb88-4963-a291-d037d19452dc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:13.187047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ef157-eb88-4963-a291-d037d19452dc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:13.187047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ef157-eb88-4963-a291-d037d19452dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:13.263214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a97ef157-eb88-4963-a291-d037d19452dc None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:13.264903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a97ef157-eb88-4963-a291-d037d19452dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:13.330655 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:13.359901 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 567/1110] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:13.512159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a067eb-c5a8-434e-b284-5d2c66034425 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:13.513560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-15a067eb-c5a8-434e-b284-5d2c66034425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:13.532116 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:13.661667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a067eb-c5a8-434e-b284-5d2c66034425 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:13.747204 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:13.772752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47996b-b298-4100-909f-d1e3b4767a38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:13.773286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47996b-b298-4100-909f-d1e3b4767a38 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:13.773562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47996b-b298-4100-909f-d1e3b4767a38 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:13.773830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47996b-b298-4100-909f-d1e3b4767a38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:13.775433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ff47996b-b298-4100-909f-d1e3b4767a38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:13.865313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47996b-b298-4100-909f-d1e3b4767a38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:13.866928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47996b-b298-4100-909f-d1e3b4767a38 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:13.884699 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 544/1111] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:14.930054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eda4d-1426-4ccd-b863-08916caf47d2 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:14.930598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eda4d-1426-4ccd-b863-08916caf47d2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:14.930598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eda4d-1426-4ccd-b863-08916caf47d2 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:14.931870 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 568/1112] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:14.938664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97b7cd-9009-4b9d-baab-dfcf8f009f3e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:14.939128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97b7cd-9009-4b9d-baab-dfcf8f009f3e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:14.939272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97b7cd-9009-4b9d-baab-dfcf8f009f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:15.017391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6b97b7cd-9009-4b9d-baab-dfcf8f009f3e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:15.018584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6b97b7cd-9009-4b9d-baab-dfcf8f009f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:15.058255 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:15.112545 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 545/1113] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:52:15.264939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617eda4d-1426-4ccd-b863-08916caf47d2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:15.266437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-617eda4d-1426-4ccd-b863-08916caf47d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:15.408095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617eda4d-1426-4ccd-b863-08916caf47d2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:15.461769 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:15.520202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6ed07-bbbe-443e-93ae-74b07da527f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:15.520724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6ed07-bbbe-443e-93ae-74b07da527f7 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:15.520997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6ed07-bbbe-443e-93ae-74b07da527f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:15.521270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6ed07-bbbe-443e-93ae-74b07da527f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:15.522844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d5f6ed07-bbbe-443e-93ae-74b07da527f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:15.613459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6ed07-bbbe-443e-93ae-74b07da527f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:15.615062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6ed07-bbbe-443e-93ae-74b07da527f7 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:15.633637 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 569/1114] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:16.677033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e631de-13e7-4eb8-ac35-f20775987f7b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:16.677613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e631de-13e7-4eb8-ac35-f20775987f7b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:16.677613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e631de-13e7-4eb8-ac35-f20775987f7b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:16.678966 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 546/1115] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:16.685290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0959d-a8e3-4633-872e-596c22872f5d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:16.685718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0959d-a8e3-4633-872e-596c22872f5d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:16.685833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0959d-a8e3-4633-872e-596c22872f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:16.760421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-98e0959d-a8e3-4633-872e-596c22872f5d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:16.761633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-98e0959d-a8e3-4633-872e-596c22872f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:16.763658 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:16.857904 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 570/1116] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:17.009113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e631de-13e7-4eb8-ac35-f20775987f7b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:17.010671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-91e631de-13e7-4eb8-ac35-f20775987f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:17.154620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e631de-13e7-4eb8-ac35-f20775987f7b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:17.181704 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:17.269923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e7d16-4098-4e3c-9aa9-bab10d1bb529 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:17.270526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7d16-4098-4e3c-9aa9-bab10d1bb529 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:17.270801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7d16-4098-4e3c-9aa9-bab10d1bb529 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:17.271104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7d16-4098-4e3c-9aa9-bab10d1bb529 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:17.272680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fd7e7d16-4098-4e3c-9aa9-bab10d1bb529 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:17.372440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e7d16-4098-4e3c-9aa9-bab10d1bb529 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:17.374531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e7d16-4098-4e3c-9aa9-bab10d1bb529 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:17.392751 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 547/1117] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:19.457918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea600-845e-45f2-a736-ca1b8f6121e5 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:19.458589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea600-845e-45f2-a736-ca1b8f6121e5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:19.458589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea600-845e-45f2-a736-ca1b8f6121e5 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:19.459839 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 571/1118] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:19.465049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6245-6f7a-4787-adbc-29cd041a37ee None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:19.465484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6245-6f7a-4787-adbc-29cd041a37ee None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:19.465609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6245-6f7a-4787-adbc-29cd041a37ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:19.506862 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:19.532960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-608c6245-6f7a-4787-adbc-29cd041a37ee None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:19.534165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-608c6245-6f7a-4787-adbc-29cd041a37ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:19.631032 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 548/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:19.915839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea600-845e-45f2-a736-ca1b8f6121e5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:19.917362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-babea600-845e-45f2-a736-ca1b8f6121e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:20.019528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea600-845e-45f2-a736-ca1b8f6121e5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:20.052277 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:20.094658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14a8ab-5b81-4c86-a094-a5c25970d2e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:20.095315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14a8ab-5b81-4c86-a094-a5c25970d2e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:20.095589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14a8ab-5b81-4c86-a094-a5c25970d2e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:20.095851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14a8ab-5b81-4c86-a094-a5c25970d2e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:20.097417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dd14a8ab-5b81-4c86-a094-a5c25970d2e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:20.210301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14a8ab-5b81-4c86-a094-a5c25970d2e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:20.211672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14a8ab-5b81-4c86-a094-a5c25970d2e6 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:20.230837 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 572/1120] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:22.534615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc712b-ec47-4021-b711-efa76da3abc0 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:22.536545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc712b-ec47-4021-b711-efa76da3abc0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:22.536545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc712b-ec47-4021-b711-efa76da3abc0 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:22.536753 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 549/1121] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:22.542268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490393-256e-4862-a7d4-75d2cb3a4300 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:22.542691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490393-256e-4862-a7d4-75d2cb3a4300 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:22.542822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490393-256e-4862-a7d4-75d2cb3a4300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:22.608902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f5490393-256e-4862-a7d4-75d2cb3a4300 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:22.610109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f5490393-256e-4862-a7d4-75d2cb3a4300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:22.622617 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:22.708147 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 573/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:52:22.994550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc712b-ec47-4021-b711-efa76da3abc0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:22.996116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d6bc712b-ec47-4021-b711-efa76da3abc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:23.098744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc712b-ec47-4021-b711-efa76da3abc0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:23.111671 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:23.172621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cb61f-25ec-4d28-9f58-73fbc6873de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:23.173223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cb61f-25ec-4d28-9f58-73fbc6873de2 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:23.173498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cb61f-25ec-4d28-9f58-73fbc6873de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:23.173775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cb61f-25ec-4d28-9f58-73fbc6873de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:23.175380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8e1cb61f-25ec-4d28-9f58-73fbc6873de2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:23.284712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cb61f-25ec-4d28-9f58-73fbc6873de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:23.286058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cb61f-25ec-4d28-9f58-73fbc6873de2 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:23.303658 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 550/1123] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:25.783202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd00947-1714-4cdf-87d4-12082eb9de17 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:25.783732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd00947-1714-4cdf-87d4-12082eb9de17 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:25.783732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd00947-1714-4cdf-87d4-12082eb9de17 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:25.785160 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 574/1124] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:25.790523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffab19-f134-4ef8-8242-e47bb64231e6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:25.790971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffab19-f134-4ef8-8242-e47bb64231e6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:25.791091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffab19-f134-4ef8-8242-e47bb64231e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:25.838249 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:25.857611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fbffab19-f134-4ef8-8242-e47bb64231e6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:25.859444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fbffab19-f134-4ef8-8242-e47bb64231e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:25.956901 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 551/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:52:26.250657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd00947-1714-4cdf-87d4-12082eb9de17 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:26.252263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bcd00947-1714-4cdf-87d4-12082eb9de17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:26.354932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd00947-1714-4cdf-87d4-12082eb9de17 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:26.395103 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:26.430392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e092454-c035-4435-8a4c-8bb26b49683f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:26.430938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092454-c035-4435-8a4c-8bb26b49683f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:26.431220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092454-c035-4435-8a4c-8bb26b49683f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:26.431490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092454-c035-4435-8a4c-8bb26b49683f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:26.433057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5e092454-c035-4435-8a4c-8bb26b49683f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:26.542559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e092454-c035-4435-8a4c-8bb26b49683f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:26.544010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e092454-c035-4435-8a4c-8bb26b49683f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:26.563192 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 575/1126] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:28.848491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e801-9806-4354-9663-b58e0674573e None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:28.849474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e801-9806-4354-9663-b58e0674573e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:28.849991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e801-9806-4354-9663-b58e0674573e None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:28.851368 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 552/1127] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:28.856801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ad809-99e7-499f-8081-b27e99c5a33d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:28.857234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ad809-99e7-499f-8081-b27e99c5a33d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:28.857343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ad809-99e7-499f-8081-b27e99c5a33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:28.923001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2e5ad809-99e7-499f-8081-b27e99c5a33d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:28.924197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2e5ad809-99e7-499f-8081-b27e99c5a33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:28.945071 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:29.022344 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 576/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:29.314475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556e801-9806-4354-9663-b58e0674573e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:29.316051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f556e801-9806-4354-9663-b58e0674573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:29.417865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556e801-9806-4354-9663-b58e0674573e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:29.439044 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:29.492233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37ae3f-59bd-45ad-9915-cdbde7d1afbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:29.492834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37ae3f-59bd-45ad-9915-cdbde7d1afbe service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:29.493110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37ae3f-59bd-45ad-9915-cdbde7d1afbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:29.493378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37ae3f-59bd-45ad-9915-cdbde7d1afbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:29.495042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9f37ae3f-59bd-45ad-9915-cdbde7d1afbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:29.606068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37ae3f-59bd-45ad-9915-cdbde7d1afbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:29.607526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37ae3f-59bd-45ad-9915-cdbde7d1afbe service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:29.625072 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 553/1129] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:31.840330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9210c72-32bb-4a3b-a4b0-3a823c8058a0 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:31.840845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9210c72-32bb-4a3b-a4b0-3a823c8058a0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:31.840845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9210c72-32bb-4a3b-a4b0-3a823c8058a0 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:31.842140 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 577/1130] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:31.847611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8f278-c55b-448f-b733-b6270a7e68ba None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:31.848044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8f278-c55b-448f-b733-b6270a7e68ba None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:31.848147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8f278-c55b-448f-b733-b6270a7e68ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:31.910762 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:31.914377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7bd8f278-c55b-448f-b733-b6270a7e68ba None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:31.915794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7bd8f278-c55b-448f-b733-b6270a7e68ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:32.012233 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 554/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:32.310418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9210c72-32bb-4a3b-a4b0-3a823c8058a0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:32.312657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e9210c72-32bb-4a3b-a4b0-3a823c8058a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:32.414529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9210c72-32bb-4a3b-a4b0-3a823c8058a0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:32.464492 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:32.489100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cd500-8717-4343-9e48-d9e682fd213a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:32.489699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cd500-8717-4343-9e48-d9e682fd213a service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:32.489976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cd500-8717-4343-9e48-d9e682fd213a service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:32.490242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cd500-8717-4343-9e48-d9e682fd213a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:32.491851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-de2cd500-8717-4343-9e48-d9e682fd213a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:32.601628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cd500-8717-4343-9e48-d9e682fd213a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:32.603090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cd500-8717-4343-9e48-d9e682fd213a service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:32.621833 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 578/1132] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:34.825052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99155a6c-67c5-49a1-96d3-87ede9a5fe42 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:34.825581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99155a6c-67c5-49a1-96d3-87ede9a5fe42 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:34.825581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99155a6c-67c5-49a1-96d3-87ede9a5fe42 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:34.827101 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 555/1133] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:34.832486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738f35a-03f2-4d9f-aed4-d995f0bb3264 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:34.832919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738f35a-03f2-4d9f-aed4-d995f0bb3264 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:34.833040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738f35a-03f2-4d9f-aed4-d995f0bb3264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:34.899602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5738f35a-03f2-4d9f-aed4-d995f0bb3264 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:34.900795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5738f35a-03f2-4d9f-aed4-d995f0bb3264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:34.930373 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:35.001034 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 579/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:35.296825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99155a6c-67c5-49a1-96d3-87ede9a5fe42 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:35.298406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-99155a6c-67c5-49a1-96d3-87ede9a5fe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:35.401715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99155a6c-67c5-49a1-96d3-87ede9a5fe42 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:35.431466 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:35.476852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cbef7-ee06-4e70-a06d-a17a90d4f5b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:35.477445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cbef7-ee06-4e70-a06d-a17a90d4f5b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:35.477717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cbef7-ee06-4e70-a06d-a17a90d4f5b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:35.477985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cbef7-ee06-4e70-a06d-a17a90d4f5b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:35.479569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c17cbef7-ee06-4e70-a06d-a17a90d4f5b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:35.590465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cbef7-ee06-4e70-a06d-a17a90d4f5b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:35.591908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cbef7-ee06-4e70-a06d-a17a90d4f5b0 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:35.609998 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 556/1135] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:37.808432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c79027-217b-41cb-8db6-85180117e396 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:37.809000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c79027-217b-41cb-8db6-85180117e396 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:37.809000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c79027-217b-41cb-8db6-85180117e396 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:37.810362 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 580/1136] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:37.816543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b25057-31e5-4547-b981-5655b3f0df08 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:37.816978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b25057-31e5-4547-b981-5655b3f0df08 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:37.817086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b25057-31e5-4547-b981-5655b3f0df08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:37.881979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-48b25057-31e5-4547-b981-5655b3f0df08 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:37.883202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-48b25057-31e5-4547-b981-5655b3f0df08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:37.891511 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:37.978377 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 557/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:38.269034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c79027-217b-41cb-8db6-85180117e396 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:38.270547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d3c79027-217b-41cb-8db6-85180117e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:38.370669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c79027-217b-41cb-8db6-85180117e396 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:38.426614 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:38.445216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5e168-404c-4d46-b4ab-73f5508b4607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:38.445813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5e168-404c-4d46-b4ab-73f5508b4607 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:38.446091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5e168-404c-4d46-b4ab-73f5508b4607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:38.446361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5e168-404c-4d46-b4ab-73f5508b4607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:38.447975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b3b5e168-404c-4d46-b4ab-73f5508b4607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:38.557736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5e168-404c-4d46-b4ab-73f5508b4607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:38.559184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5e168-404c-4d46-b4ab-73f5508b4607 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:38.577570 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 581/1138] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:40.782115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e74704-cbc1-4a8f-9e75-a95d6dec7b8b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:40.782674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e74704-cbc1-4a8f-9e75-a95d6dec7b8b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:40.782674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e74704-cbc1-4a8f-9e75-a95d6dec7b8b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:40.784009 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 558/1139] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:40.789623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c8b18-6957-44db-8ab7-26fb13139ee4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:40.790051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c8b18-6957-44db-8ab7-26fb13139ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:40.790159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c8b18-6957-44db-8ab7-26fb13139ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:40.853729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-df3c8b18-6957-44db-8ab7-26fb13139ee4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:40.854828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-df3c8b18-6957-44db-8ab7-26fb13139ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:40.893278 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:40.949866 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 582/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:41.230369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e74704-cbc1-4a8f-9e75-a95d6dec7b8b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:41.231923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b2e74704-cbc1-4a8f-9e75-a95d6dec7b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:41.334627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e74704-cbc1-4a8f-9e75-a95d6dec7b8b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:41.373478 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:41.409058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d801e-6a7a-44ea-98d6-f1e3a5b24571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:41.409653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d801e-6a7a-44ea-98d6-f1e3a5b24571 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:41.409927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d801e-6a7a-44ea-98d6-f1e3a5b24571 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:41.410194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d801e-6a7a-44ea-98d6-f1e3a5b24571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:41.411781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d66d801e-6a7a-44ea-98d6-f1e3a5b24571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:41.519281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d801e-6a7a-44ea-98d6-f1e3a5b24571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:41.520618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d801e-6a7a-44ea-98d6-f1e3a5b24571 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:41.539468 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 559/1141] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:43.674895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811d9a-453d-41c4-b6b1-185ab8844da3 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:43.675490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811d9a-453d-41c4-b6b1-185ab8844da3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:43.675490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811d9a-453d-41c4-b6b1-185ab8844da3 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:43.676823 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 583/1142] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:43.682243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ff65c-8890-485d-8317-c491d3716e72 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:43.682676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ff65c-8890-485d-8317-c491d3716e72 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:43.682784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ff65c-8890-485d-8317-c491d3716e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:43.746889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ae4ff65c-8890-485d-8317-c491d3716e72 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:43.748411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ae4ff65c-8890-485d-8317-c491d3716e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:43.766208 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:43.844778 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 560/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:44.128673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811d9a-453d-41c4-b6b1-185ab8844da3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:44.130178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e5811d9a-453d-41c4-b6b1-185ab8844da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:44.234592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811d9a-453d-41c4-b6b1-185ab8844da3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:44.303353 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:44.310352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596920d-8b57-489e-88bb-03de5cb28e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:44.311070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596920d-8b57-489e-88bb-03de5cb28e6a service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:44.311342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596920d-8b57-489e-88bb-03de5cb28e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:44.311610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596920d-8b57-489e-88bb-03de5cb28e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:44.313190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c596920d-8b57-489e-88bb-03de5cb28e6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:44.421829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596920d-8b57-489e-88bb-03de5cb28e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:44.423221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596920d-8b57-489e-88bb-03de5cb28e6a service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:44.442336 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 584/1144] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:46.599089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf17f2-594b-4065-beca-842245b8ed4f None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:46.599603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf17f2-594b-4065-beca-842245b8ed4f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:46.599720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf17f2-594b-4065-beca-842245b8ed4f None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:46.600963 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 561/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:46.606147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244c506-8f48-4db6-a06d-a02875ba65c4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:46.606589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244c506-8f48-4db6-a06d-a02875ba65c4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:46.606694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244c506-8f48-4db6-a06d-a02875ba65c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:46.672916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c244c506-8f48-4db6-a06d-a02875ba65c4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:46.674098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c244c506-8f48-4db6-a06d-a02875ba65c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:46.721115 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:46.769025 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 585/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:47.055524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf17f2-594b-4065-beca-842245b8ed4f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:47.057065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cedf17f2-594b-4065-beca-842245b8ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:47.159125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf17f2-594b-4065-beca-842245b8ed4f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:47.207195 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:47.234840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e20910-dbbe-49c4-98c4-8591f0ebb805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:47.235470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20910-dbbe-49c4-98c4-8591f0ebb805 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:47.235743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20910-dbbe-49c4-98c4-8591f0ebb805 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:47.236007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20910-dbbe-49c4-98c4-8591f0ebb805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:47.237575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-72e20910-dbbe-49c4-98c4-8591f0ebb805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:47.344529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e20910-dbbe-49c4-98c4-8591f0ebb805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:47.345990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e20910-dbbe-49c4-98c4-8591f0ebb805 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:47.364828 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 562/1147] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:56.767583 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=22 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:57.362652 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=66 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:07.757540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee6d2d-c50f-44bd-935c-ae98c6af8165 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:07.758110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee6d2d-c50f-44bd-935c-ae98c6af8165 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:07.758110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee6d2d-c50f-44bd-935c-ae98c6af8165 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:07.759462 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 586/1148] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:53:07.764900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805b3da-21fd-4fe9-97a2-5c022a63783a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:07.765307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805b3da-21fd-4fe9-97a2-5c022a63783a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:07.765429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805b3da-21fd-4fe9-97a2-5c022a63783a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:07.830743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d805b3da-21fd-4fe9-97a2-5c022a63783a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:07.831904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d805b3da-21fd-4fe9-97a2-5c022a63783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:07.928816 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 563/1149] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:08.229496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763df7-b97f-42ab-bf59-425bce1cc90e None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:08.229777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763df7-b97f-42ab-bf59-425bce1cc90e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:08.230048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763df7-b97f-42ab-bf59-425bce1cc90e None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:08.232067 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 587/1150] 10.222.0.39 () {54 vars in 962 bytes} [Sun Oct 16 00:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:53:08.237288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aaea1-b5d5-4498-b853-78c69acc92e8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:08.237580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aaea1-b5d5-4498-b853-78c69acc92e8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:08.237855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aaea1-b5d5-4498-b853-78c69acc92e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:08.313665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-819aaea1-b5d5-4498-b853-78c69acc92e8 None None] MFA Rules not processed for user `afb30ad752234d8c9f12302b0b69666b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:08.314848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-819aaea1-b5d5-4498-b853-78c69acc92e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:08.342095 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:08.396974 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 564/1151] 10.222.0.39 () {58 vars in 1059 bytes} [Sun Oct 16 00:53:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:08.405437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6763df7-b97f-42ab-bf59-425bce1cc90e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:08.406933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a6763df7-b97f-42ab-bf59-425bce1cc90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:08.510436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6763df7-b97f-42ab-bf59-425bce1cc90e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:08.583413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f97cde-4566-49b0-b679-f03a8ded0e54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:08.584013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f97cde-4566-49b0-b679-f03a8ded0e54 service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:08.584287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f97cde-4566-49b0-b679-f03a8ded0e54 service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:08.584555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f97cde-4566-49b0-b679-f03a8ded0e54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:08.586121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79f97cde-4566-49b0-b679-f03a8ded0e54 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:08.639342 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:08.693213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f97cde-4566-49b0-b679-f03a8ded0e54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:08.694632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f97cde-4566-49b0-b679-f03a8ded0e54 service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:08.714624 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 588/1152] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:53:11.100268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcff7b2-c637-4541-81c1-923a70d909b9 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:11.100843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcff7b2-c637-4541-81c1-923a70d909b9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:11.100843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcff7b2-c637-4541-81c1-923a70d909b9 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:11.102182 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 565/1153] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:53:11.108089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac2fe9-ecc5-4533-83e2-9f4d4933e1ce None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:11.108522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac2fe9-ecc5-4533-83e2-9f4d4933e1ce None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:11.108620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac2fe9-ecc5-4533-83e2-9f4d4933e1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:11.174319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6cac2fe9-ecc5-4533-83e2-9f4d4933e1ce None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:11.175525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6cac2fe9-ecc5-4533-83e2-9f4d4933e1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:11.272530 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 589/1154] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:11.547436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcff7b2-c637-4541-81c1-923a70d909b9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:11.548966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0fcff7b2-c637-4541-81c1-923a70d909b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:11.675954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcff7b2-c637-4541-81c1-923a70d909b9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:11.724033 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:11.769772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d8488-2946-432d-a7f7-ea36128146a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:11.770369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d8488-2946-432d-a7f7-ea36128146a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:11.770639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d8488-2946-432d-a7f7-ea36128146a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:11.770898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d8488-2946-432d-a7f7-ea36128146a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:11.771546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d8488-2946-432d-a7f7-ea36128146a5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:11.772642 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-e40d8488-2946-432d-a7f7-ea36128146a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:53:11.772642 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 00:53:11.772642 n-d-master-1 devstack@keystone.service[81805]: Oct 16 00:53:11.773779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d8488-2946-432d-a7f7-ea36128146a5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:11.792796 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 566/1155] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Oct 16 00:53:11 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:53:13.979005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcc8c5-0455-4783-9239-5bd1d2d2d9a6 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:13.979534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcc8c5-0455-4783-9239-5bd1d2d2d9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:13.979534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcc8c5-0455-4783-9239-5bd1d2d2d9a6 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:13.980833 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 590/1156] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:53:13.987299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3e92-2dc3-428b-8ded-707fd4a3304c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:13.987711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3e92-2dc3-428b-8ded-707fd4a3304c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:13.987850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3e92-2dc3-428b-8ded-707fd4a3304c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:14.053061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6a2a3e92-2dc3-428b-8ded-707fd4a3304c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:14.054255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6a2a3e92-2dc3-428b-8ded-707fd4a3304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:14.149747 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 567/1157] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:14.448537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcc8c5-0455-4783-9239-5bd1d2d2d9a6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:14.450197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8cbcc8c5-0455-4783-9239-5bd1d2d2d9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:14.460009 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:14.596644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcc8c5-0455-4783-9239-5bd1d2d2d9a6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:14.675037 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:14.707737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215287f-d673-4e45-b6dc-58f38119a64f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:14.708254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215287f-d673-4e45-b6dc-58f38119a64f service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:14.708531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215287f-d673-4e45-b6dc-58f38119a64f service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:14.708797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215287f-d673-4e45-b6dc-58f38119a64f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:14.710366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a215287f-d673-4e45-b6dc-58f38119a64f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:14.801533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215287f-d673-4e45-b6dc-58f38119a64f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:14.803225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215287f-d673-4e45-b6dc-58f38119a64f service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:14.821203 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 591/1158] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:53:17.171019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42844c76-4979-4543-96ce-0f8a451fbbbe None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:17.171528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42844c76-4979-4543-96ce-0f8a451fbbbe None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:17.171528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42844c76-4979-4543-96ce-0f8a451fbbbe None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:17.172848 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 568/1159] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:53:17.178374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f86ec7-32ab-428a-ab3b-b3259de94ded None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:17.178781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f86ec7-32ab-428a-ab3b-b3259de94ded None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:17.178939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f86ec7-32ab-428a-ab3b-b3259de94ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:17.245451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-84f86ec7-32ab-428a-ab3b-b3259de94ded None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:17.247501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-84f86ec7-32ab-428a-ab3b-b3259de94ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:17.292697 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:17.343814 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 592/1160] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:17.629014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42844c76-4979-4543-96ce-0f8a451fbbbe None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:17.630533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-42844c76-4979-4543-96ce-0f8a451fbbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:17.654783 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:17.735115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42844c76-4979-4543-96ce-0f8a451fbbbe None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:17.807905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530454e-af5b-471a-8679-1972b5fb64ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:17.808498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530454e-af5b-471a-8679-1972b5fb64ea service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:17.808773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530454e-af5b-471a-8679-1972b5fb64ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:17.809684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530454e-af5b-471a-8679-1972b5fb64ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:17.811597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b530454e-af5b-471a-8679-1972b5fb64ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:17.883432 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:17.919241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530454e-af5b-471a-8679-1972b5fb64ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:17.920657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530454e-af5b-471a-8679-1972b5fb64ea service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:17.938257 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 569/1161] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:53:20.160264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db1c42-ef28-45db-94f7-edcc1053a0c8 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:20.160806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db1c42-ef28-45db-94f7-edcc1053a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:20.160806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db1c42-ef28-45db-94f7-edcc1053a0c8 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:20.162124 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 593/1162] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:53:20.167530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03ae66-5b4b-400a-8ea9-e8b0fb11efe0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:20.167949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03ae66-5b4b-400a-8ea9-e8b0fb11efe0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:20.168087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03ae66-5b4b-400a-8ea9-e8b0fb11efe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:20.237399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2b03ae66-5b4b-400a-8ea9-e8b0fb11efe0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:20.238599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2b03ae66-5b4b-400a-8ea9-e8b0fb11efe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:20.332650 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 570/1163] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:20.635658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db1c42-ef28-45db-94f7-edcc1053a0c8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:20.638277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b1db1c42-ef28-45db-94f7-edcc1053a0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:20.741093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db1c42-ef28-45db-94f7-edcc1053a0c8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:20.813430 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:20.814895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92171cc-e599-4ccd-9988-7c0a8149fca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:20.815521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92171cc-e599-4ccd-9988-7c0a8149fca6 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:20.815972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92171cc-e599-4ccd-9988-7c0a8149fca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:20.816393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92171cc-e599-4ccd-9988-7c0a8149fca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:20.818127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d92171cc-e599-4ccd-9988-7c0a8149fca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:20.926040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92171cc-e599-4ccd-9988-7c0a8149fca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:20.927498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92171cc-e599-4ccd-9988-7c0a8149fca6 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:20.945523 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 594/1164] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:53:23.271929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385d6f7-e6d9-4df4-afee-6f87a4fe7e81 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:23.272495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385d6f7-e6d9-4df4-afee-6f87a4fe7e81 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:23.272495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385d6f7-e6d9-4df4-afee-6f87a4fe7e81 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:23.273812 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 571/1165] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:53:23.280122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd49fcc-6da2-441e-9243-bbed7ddf23c4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:23.280555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd49fcc-6da2-441e-9243-bbed7ddf23c4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:23.280665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd49fcc-6da2-441e-9243-bbed7ddf23c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:23.347575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-efd49fcc-6da2-441e-9243-bbed7ddf23c4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:23.348699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-efd49fcc-6da2-441e-9243-bbed7ddf23c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:23.400033 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:23.444983 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 595/1166] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:23.738646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385d6f7-e6d9-4df4-afee-6f87a4fe7e81 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:23.740214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e385d6f7-e6d9-4df4-afee-6f87a4fe7e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:23.775836 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:23.843653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385d6f7-e6d9-4df4-afee-6f87a4fe7e81 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:23.920817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc2618-338e-444d-b2c8-b1dcd5e44923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:23.921422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc2618-338e-444d-b2c8-b1dcd5e44923 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:23.921702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc2618-338e-444d-b2c8-b1dcd5e44923 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:23.921974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc2618-338e-444d-b2c8-b1dcd5e44923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:23.923600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cfdc2618-338e-444d-b2c8-b1dcd5e44923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:24.002800 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:24.032277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc2618-338e-444d-b2c8-b1dcd5e44923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:24.033712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc2618-338e-444d-b2c8-b1dcd5e44923 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:24.052020 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 572/1167] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:53:26.447291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7df90d-659f-41ad-b510-4d80257c36f0 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:26.447873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7df90d-659f-41ad-b510-4d80257c36f0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:26.447873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7df90d-659f-41ad-b510-4d80257c36f0 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:26.449176 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 596/1168] 10.222.0.39 () {54 vars in 927 bytes} [Sun Oct 16 00:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:53:26.454832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157b1f6-0f8f-4716-8826-d99a6a1f7167 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:26.455287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157b1f6-0f8f-4716-8826-d99a6a1f7167 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:26.455399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157b1f6-0f8f-4716-8826-d99a6a1f7167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:26.522571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e157b1f6-0f8f-4716-8826-d99a6a1f7167 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:26.523782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e157b1f6-0f8f-4716-8826-d99a6a1f7167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:26.632304 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 573/1169] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Oct 16 00:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:53:26.923775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7df90d-659f-41ad-b510-4d80257c36f0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:26.925297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ed7df90d-659f-41ad-b510-4d80257c36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:27.026537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7df90d-659f-41ad-b510-4d80257c36f0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:27.098154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12edc7-2278-4feb-b531-8729a7d99db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:27.098747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12edc7-2278-4feb-b531-8729a7d99db0 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:27.099051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12edc7-2278-4feb-b531-8729a7d99db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:27.099322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12edc7-2278-4feb-b531-8729a7d99db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:27.100888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5a12edc7-2278-4feb-b531-8729a7d99db0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:27.109933 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:27.209607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12edc7-2278-4feb-b531-8729a7d99db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:27.211087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12edc7-2278-4feb-b531-8729a7d99db0 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:27.229637 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 597/1170] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:53:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:53:36.630756 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=82 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:37.227454 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=50 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:40.253887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b103e-e003-43f2-ab50-56974a628a47 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:40.254517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b103e-e003-43f2-ab50-56974a628a47 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:40.254517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b103e-e003-43f2-ab50-56974a628a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:40.329912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-744b103e-e003-43f2-ab50-56974a628a47 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:54:40.331146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-744b103e-e003-43f2-ab50-56974a628a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:40.426235 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 574/1171] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 00:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:54:40.434975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b0ca6-d726-478e-8ddf-f3c2a3a08989 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:40.435486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b0ca6-d726-478e-8ddf-f3c2a3a08989 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:40.435591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b0ca6-d726-478e-8ddf-f3c2a3a08989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:40.514314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e77b0ca6-d726-478e-8ddf-f3c2a3a08989 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:54:40.515465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e77b0ca6-d726-478e-8ddf-f3c2a3a08989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:40.610730 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 598/1172] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 00:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:54:40.615427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b103e-e003-43f2-ab50-56974a628a47 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:40.616618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-744b103e-e003-43f2-ab50-56974a628a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:40.628669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b103e-e003-43f2-ab50-56974a628a47 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:40.689618 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:40.722033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d6d30-56c4-4889-9927-e7437d846629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:40.722638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d6d30-56c4-4889-9927-e7437d846629 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:40.722944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d6d30-56c4-4889-9927-e7437d846629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:40.723212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d6d30-56c4-4889-9927-e7437d846629 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:40.723845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d6d30-56c4-4889-9927-e7437d846629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:54:40.724151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d6d30-56c4-4889-9927-e7437d846629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:40.725167 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-921d6d30-56c4-4889-9927-e7437d846629 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:54:40.725167 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 00:54:40.725167 n-d-master-1 devstack@keystone.service[81805]: Oct 16 00:54:40.726047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d6d30-56c4-4889-9927-e7437d846629 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:40.738223 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 575/1173] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 00:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:54:40.748395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b0ca6-d726-478e-8ddf-f3c2a3a08989 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:40.757680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b0ca6-d726-478e-8ddf-f3c2a3a08989 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:40.821932 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:40.855895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6e500-acac-4361-88ff-03246a8d8f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:40.856492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6e500-acac-4361-88ff-03246a8d8f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:40.856768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6e500-acac-4361-88ff-03246a8d8f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:40.857038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6e500-acac-4361-88ff-03246a8d8f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:40.857671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6e500-acac-4361-88ff-03246a8d8f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:40.858779 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-63b6e500-acac-4361-88ff-03246a8d8f64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:54:40.858779 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 00:54:40.858779 n-d-master-1 devstack@keystone.service[81804]: Oct 16 00:54:40.859992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6e500-acac-4361-88ff-03246a8d8f64 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:40.916200 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 599/1174] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 00:54:40 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:54:40.920341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d6d30-56c4-4889-9927-e7437d846629 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:40.921825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-921d6d30-56c4-4889-9927-e7437d846629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:40.955326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d6d30-56c4-4889-9927-e7437d846629 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:41.048851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93249faa-71c8-4879-a2fc-ee36a29ac5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:41.049455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249faa-71c8-4879-a2fc-ee36a29ac5ad admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:41.049740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249faa-71c8-4879-a2fc-ee36a29ac5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:41.050009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249faa-71c8-4879-a2fc-ee36a29ac5ad admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:41.050640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93249faa-71c8-4879-a2fc-ee36a29ac5ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:41.051687 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-93249faa-71c8-4879-a2fc-ee36a29ac5ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:54:41.051687 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 00:54:41.051687 n-d-master-1 devstack@keystone.service[81805]: Oct 16 00:54:41.052887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93249faa-71c8-4879-a2fc-ee36a29ac5ad admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:41.094728 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 576/1175] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 00:54:40 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:54:41.098795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6e500-acac-4361-88ff-03246a8d8f64 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:41.100387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-63b6e500-acac-4361-88ff-03246a8d8f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:41.161581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6e500-acac-4361-88ff-03246a8d8f64 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:41.245267 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:41.256235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0baadcb-0975-41fb-a2f9-d4d696216f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:41.256838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0baadcb-0975-41fb-a2f9-d4d696216f4a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:41.257111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0baadcb-0975-41fb-a2f9-d4d696216f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:41.257374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0baadcb-0975-41fb-a2f9-d4d696216f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:41.257999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0baadcb-0975-41fb-a2f9-d4d696216f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:41.259699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0baadcb-0975-41fb-a2f9-d4d696216f4a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:41.271776 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 600/1176] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 00:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:54:41.276579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93249faa-71c8-4879-a2fc-ee36a29ac5ad admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:41.278062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-93249faa-71c8-4879-a2fc-ee36a29ac5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:41.289871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93249faa-71c8-4879-a2fc-ee36a29ac5ad admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:41.315262 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:41.384675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d82a6-9591-4ede-8466-ad0aeb441c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:41.385264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d82a6-9591-4ede-8466-ad0aeb441c62 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:41.385537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d82a6-9591-4ede-8466-ad0aeb441c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:41.385802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d82a6-9591-4ede-8466-ad0aeb441c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:41.386426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d82a6-9591-4ede-8466-ad0aeb441c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:41.388040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d82a6-9591-4ede-8466-ad0aeb441c62 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:41.400355 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 577/1177] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 00:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:54:41.404513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0baadcb-0975-41fb-a2f9-d4d696216f4a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:41.406027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f0baadcb-0975-41fb-a2f9-d4d696216f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:41.439593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0baadcb-0975-41fb-a2f9-d4d696216f4a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:41.533571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632becc5-1729-4ccf-8db8-d615c494dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:41.534220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632becc5-1729-4ccf-8db8-d615c494dd76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:41.534505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632becc5-1729-4ccf-8db8-d615c494dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:41.534777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632becc5-1729-4ccf-8db8-d615c494dd76 admin admin] PATH_INFO: `/v3/projects/65804463ea01493db4006f9d34cc4129/users/2220ea0294e34346975cfa797624c8f7/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:41.558038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632becc5-1729-4ccf-8db8-d615c494dd76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65804463ea01493db4006f9d34cc4129, user_id=2220ea0294e34346975cfa797624c8f7, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:41.560714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632becc5-1729-4ccf-8db8-d615c494dd76 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:41.586800 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 601/1178] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 00:54:41 2022] PUT /identity/v3/projects/65804463ea01493db4006f9d34cc4129/users/2220ea0294e34346975cfa797624c8f7/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:54:41.598203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b78a7-cdda-4414-bbb3-bcaa3f087eb9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:41.598490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b78a7-cdda-4414-bbb3-bcaa3f087eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:41.598762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b78a7-cdda-4414-bbb3-bcaa3f087eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:41.656255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d20b78a7-cdda-4414-bbb3-bcaa3f087eb9 None None] MFA Rules not processed for user `2220ea0294e34346975cfa797624c8f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:54:41.657477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d20b78a7-cdda-4414-bbb3-bcaa3f087eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:41.733136 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 578/1179] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 00:54:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:54:41.746485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4d46b-2e51-40f1-95ef-840aa3ddb67f None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:41.746766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4d46b-2e51-40f1-95ef-840aa3ddb67f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:41.747076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4d46b-2e51-40f1-95ef-840aa3ddb67f None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:41.748437 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 602/1180] 10.222.0.39 () {54 vars in 963 bytes} [Sun Oct 16 00:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:54:41.753237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee5522-b177-4a65-aa27-7c46d46a2e84 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:41.753521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee5522-b177-4a65-aa27-7c46d46a2e84 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:41.753791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee5522-b177-4a65-aa27-7c46d46a2e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:41.785912 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:41.830443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d5ee5522-b177-4a65-aa27-7c46d46a2e84 None None] MFA Rules not processed for user `2536755baf5d4916bdc5942d5a1ace99`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:54:41.831651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d5ee5522-b177-4a65-aa27-7c46d46a2e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:41.905341 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 579/1181] 10.222.0.39 () {58 vars in 1060 bytes} [Sun Oct 16 00:54:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:54:41.913430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4d46b-2e51-40f1-95ef-840aa3ddb67f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:41.914941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-85d4d46b-2e51-40f1-95ef-840aa3ddb67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:41.964749 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:42.018403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4d46b-2e51-40f1-95ef-840aa3ddb67f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:42.090777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202c8aa-3ddb-4b32-9eeb-4091f86469fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:42.091428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202c8aa-3ddb-4b32-9eeb-4091f86469fb service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:42.091708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202c8aa-3ddb-4b32-9eeb-4091f86469fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:42.091976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202c8aa-3ddb-4b32-9eeb-4091f86469fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:42.093552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b202c8aa-3ddb-4b32-9eeb-4091f86469fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:42.190784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202c8aa-3ddb-4b32-9eeb-4091f86469fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:42.192178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202c8aa-3ddb-4b32-9eeb-4091f86469fb service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:42.195629 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:42.210604 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 603/1182] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:54:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:54:42.256417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e078b1-80f8-4926-bebd-b9d2756be0cd None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:42.256708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e078b1-80f8-4926-bebd-b9d2756be0cd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:42.256986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e078b1-80f8-4926-bebd-b9d2756be0cd None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:42.258272 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 580/1183] 10.222.0.39 () {52 vars in 830 bytes} [Sun Oct 16 00:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:54:42.262720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202c8aa-3ddb-4b32-9eeb-4091f86469fb service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:42.263970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b202c8aa-3ddb-4b32-9eeb-4091f86469fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:42.363384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202c8aa-3ddb-4b32-9eeb-4091f86469fb service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:42.454658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:42.455315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:42.455496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:42.455756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] PATH_INFO: `/v3/users/2220ea0294e34346975cfa797624c8f7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:42.468809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] RBAC: Authorizing `identity:delete_user(user_id=2220ea0294e34346975cfa797624c8f7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:42.469820 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:54:42.469820 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 00:54:42.469820 n-d-master-1 devstack@keystone.service[81804]: Oct 16 00:54:42.471048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:42.480709 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:42.537361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2220ea0294e34346975cfa797624c8f7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:54:42.537796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2220ea0294e34346975cfa797624c8f7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:54:42.561174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2220ea0294e34346975cfa797624c8f7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:54:42.570576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2220ea0294e34346975cfa797624c8f7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:54:42.571389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2220ea0294e34346975cfa797624c8f7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:54:42.592225 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 604/1184] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 00:54:42 2022] DELETE /identity/v3/users/2220ea0294e34346975cfa797624c8f7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:54:42.596549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b165-8d91-465f-8390-448437fa065e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:42.597012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b165-8d91-465f-8390-448437fa065e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:42.597155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b165-8d91-465f-8390-448437fa065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:42.653169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1b16b165-8d91-465f-8390-448437fa065e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:54:42.654350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1b16b165-8d91-465f-8390-448437fa065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:42.728837 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:42.741726 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 581/1185] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 00:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:54:42.751348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:42.752557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:42.851816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a0e69-cc16-481f-a62e-dae6325a95da admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:42.905288 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:42.926310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43490a-3718-49c9-8f09-6b3df6687d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:42.926910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43490a-3718-49c9-8f09-6b3df6687d7a service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:42.927207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43490a-3718-49c9-8f09-6b3df6687d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:42.927473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43490a-3718-49c9-8f09-6b3df6687d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:42.929035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cb43490a-3718-49c9-8f09-6b3df6687d7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:43.037822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43490a-3718-49c9-8f09-6b3df6687d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:43.039196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43490a-3718-49c9-8f09-6b3df6687d7a service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:43.058297 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 605/1186] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:54:43.403343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16b165-8d91-465f-8390-448437fa065e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:43.404619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1b16b165-8d91-465f-8390-448437fa065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:43.416716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16b165-8d91-465f-8390-448437fa065e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:43.513416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b10ec-52ad-4355-a968-4ca271023567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:43.514043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b10ec-52ad-4355-a968-4ca271023567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:43.514321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b10ec-52ad-4355-a968-4ca271023567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:43.514586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b10ec-52ad-4355-a968-4ca271023567 admin admin] PATH_INFO: `/v3/projects/65804463ea01493db4006f9d34cc4129` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:43.525428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b10ec-52ad-4355-a968-4ca271023567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65804463ea01493db4006f9d34cc4129)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:43.526441 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-096b10ec-52ad-4355-a968-4ca271023567 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:54:43.526441 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 00:54:43.526441 n-d-master-1 devstack@keystone.service[81805]: Oct 16 00:54:43.527660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b10ec-52ad-4355-a968-4ca271023567 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:43.587001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-096b10ec-52ad-4355-a968-4ca271023567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65804463ea01493db4006f9d34cc4129', 'request_id': 'req-096b10ec-52ad-4355-a968-4ca271023567'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:54:43.600838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-096b10ec-52ad-4355-a968-4ca271023567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65804463ea01493db4006f9d34cc4129', 'request_id': 'req-096b10ec-52ad-4355-a968-4ca271023567'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:54:43.611325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-096b10ec-52ad-4355-a968-4ca271023567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65804463ea01493db4006f9d34cc4129', 'request_id': 'req-096b10ec-52ad-4355-a968-4ca271023567'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:54:43.633113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-096b10ec-52ad-4355-a968-4ca271023567 admin admin] The token cache is being invalidate because project 65804463ea01493db4006f9d34cc4129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:54:43.633395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-096b10ec-52ad-4355-a968-4ca271023567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:54:43.633897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-096b10ec-52ad-4355-a968-4ca271023567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:54:43.635672 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 582/1187] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 00:54:43 2022] DELETE /identity/v3/projects/65804463ea01493db4006f9d34cc4129 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:54:53.055317 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=62 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:53.631118 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:58.650024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dcf91-45d2-4f3c-a131-e0a08bd44a0d None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:58.650586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dcf91-45d2-4f3c-a131-e0a08bd44a0d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:58.650586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dcf91-45d2-4f3c-a131-e0a08bd44a0d None None] PATH_INFO: `/v3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:58.651906 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 606/1188] 10.222.0.27 () {54 vars in 925 bytes} [Sun Oct 16 00:57:58 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:57:58.658045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca29d6-a88a-49b6-a984-b52173a8d891 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:58.658502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca29d6-a88a-49b6-a984-b52173a8d891 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:58.658601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca29d6-a88a-49b6-a984-b52173a8d891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:58.741190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4dca29d6-a88a-49b6-a984-b52173a8d891 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:58.742389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4dca29d6-a88a-49b6-a984-b52173a8d891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:58.855377 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 583/1189] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Oct 16 00:57:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:07.315829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506f8ea-551e-4986-ba9d-11db03be4503 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:07.316367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506f8ea-551e-4986-ba9d-11db03be4503 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:07.316642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506f8ea-551e-4986-ba9d-11db03be4503 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:07.317964 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 607/1190] 10.222.0.39 () {54 vars in 961 bytes} [Sun Oct 16 00:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:58:07.322819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834f455-6f87-4cc7-8d46-cf15c09fe78b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:07.323279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834f455-6f87-4cc7-8d46-cf15c09fe78b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:07.323415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834f455-6f87-4cc7-8d46-cf15c09fe78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:07.344257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a834f455-6f87-4cc7-8d46-cf15c09fe78b None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:07.345456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a834f455-6f87-4cc7-8d46-cf15c09fe78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:07.354676 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 584/1191] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Oct 16 00:58:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:07.362199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506f8ea-551e-4986-ba9d-11db03be4503 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:07.377151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506f8ea-551e-4986-ba9d-11db03be4503 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:07.382031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7851c-0727-4cc1-affb-d343798a2d6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:07.382614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7851c-0727-4cc1-affb-d343798a2d6b service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:07.382892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7851c-0727-4cc1-affb-d343798a2d6b service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:07.383217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7851c-0727-4cc1-affb-d343798a2d6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:07.391272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7851c-0727-4cc1-affb-d343798a2d6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:07.392832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7851c-0727-4cc1-affb-d343798a2d6b service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:07.402645 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 608/1192] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:58:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:58:07.741390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28368bc4-6023-4278-a0c6-db17ae79afd7 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:07.741683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28368bc4-6023-4278-a0c6-db17ae79afd7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:07.742010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28368bc4-6023-4278-a0c6-db17ae79afd7 None None] PATH_INFO: `/v3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:07.743388 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 585/1193] 10.222.0.45 () {54 vars in 925 bytes} [Sun Oct 16 00:58:07 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:58:07.771907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c86dba-4ac4-4b6f-acbd-5a9f096f20a5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:07.772190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c86dba-4ac4-4b6f-acbd-5a9f096f20a5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:07.772459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c86dba-4ac4-4b6f-acbd-5a9f096f20a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:07.793004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-20c86dba-4ac4-4b6f-acbd-5a9f096f20a5 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:07.794204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-20c86dba-4ac4-4b6f-acbd-5a9f096f20a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:07.803313 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 609/1194] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Oct 16 00:58:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:58:16.884162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28368bc4-6023-4278-a0c6-db17ae79afd7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:16.899150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28368bc4-6023-4278-a0c6-db17ae79afd7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:16.904085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008851c-80dd-4b91-9066-68be9a508197 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:16.904704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008851c-80dd-4b91-9066-68be9a508197 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:16.905030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008851c-80dd-4b91-9066-68be9a508197 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:16.905301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008851c-80dd-4b91-9066-68be9a508197 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:16.914122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008851c-80dd-4b91-9066-68be9a508197 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:16.915737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008851c-80dd-4b91-9066-68be9a508197 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:16.925380 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 586/1195] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:58:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:58:17.787512 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=9 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:26.921297 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=83 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:31.680532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2aa4a-7dfa-4c92-908f-9341df5a303d None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:31.681110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2aa4a-7dfa-4c92-908f-9341df5a303d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:31.681110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2aa4a-7dfa-4c92-908f-9341df5a303d None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:31.682410 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 610/1196] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:58:31.687628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96059338-24ba-4505-a80f-aede1fb5e505 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:31.688059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96059338-24ba-4505-a80f-aede1fb5e505 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:31.688265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96059338-24ba-4505-a80f-aede1fb5e505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:31.749687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-96059338-24ba-4505-a80f-aede1fb5e505 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:31.750866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-96059338-24ba-4505-a80f-aede1fb5e505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:31.827970 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 587/1197] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:31.983712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2aa4a-7dfa-4c92-908f-9341df5a303d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:31.985408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e6c2aa4a-7dfa-4c92-908f-9341df5a303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:32.094053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2aa4a-7dfa-4c92-908f-9341df5a303d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:32.099823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345e445-94ff-4aed-b0e3-2da27e9d8f67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:32.100417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345e445-94ff-4aed-b0e3-2da27e9d8f67 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:32.100692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345e445-94ff-4aed-b0e3-2da27e9d8f67 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:32.100995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345e445-94ff-4aed-b0e3-2da27e9d8f67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:32.108923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345e445-94ff-4aed-b0e3-2da27e9d8f67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:32.110491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345e445-94ff-4aed-b0e3-2da27e9d8f67 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:32.120720 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 611/1198] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:58:33.211394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd80a2d-3721-4324-81bf-3fbc2c768cd1 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:33.211954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd80a2d-3721-4324-81bf-3fbc2c768cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:33.211954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd80a2d-3721-4324-81bf-3fbc2c768cd1 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:33.213208 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 588/1199] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:58:33.219376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80167a3-04b6-48d2-b873-8d27de51ebfe None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:33.219841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80167a3-04b6-48d2-b873-8d27de51ebfe None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:33.219949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80167a3-04b6-48d2-b873-8d27de51ebfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:33.240040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d80167a3-04b6-48d2-b873-8d27de51ebfe None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:33.241222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d80167a3-04b6-48d2-b873-8d27de51ebfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:33.249636 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 612/1200] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:33.404427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd80a2d-3721-4324-81bf-3fbc2c768cd1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:33.419418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd80a2d-3721-4324-81bf-3fbc2c768cd1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:33.424852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fee32-7575-4311-a9dd-44d7d55265a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:33.425442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fee32-7575-4311-a9dd-44d7d55265a6 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:33.425725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fee32-7575-4311-a9dd-44d7d55265a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:33.426002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fee32-7575-4311-a9dd-44d7d55265a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:33.434579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fee32-7575-4311-a9dd-44d7d55265a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:33.436195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fee32-7575-4311-a9dd-44d7d55265a6 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:33.445469 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 589/1201] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:58:37.328339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2053c17-b4fa-4fdb-8125-9bf85e55e973 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:37.328884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2053c17-b4fa-4fdb-8125-9bf85e55e973 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:37.328884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2053c17-b4fa-4fdb-8125-9bf85e55e973 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:37.330234 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 613/1202] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:58:37.336582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c441-fbca-4884-89c6-015534b9614f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:37.337011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c441-fbca-4884-89c6-015534b9614f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:37.337121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c441-fbca-4884-89c6-015534b9614f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:37.356545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e1c2c441-fbca-4884-89c6-015534b9614f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:37.357722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e1c2c441-fbca-4884-89c6-015534b9614f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:37.366008 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 590/1203] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:37.656043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2053c17-b4fa-4fdb-8125-9bf85e55e973 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:37.657758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f2053c17-b4fa-4fdb-8125-9bf85e55e973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:37.736167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2053c17-b4fa-4fdb-8125-9bf85e55e973 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:37.740321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40982ac-66e6-4d43-a033-1af628879eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:37.740916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40982ac-66e6-4d43-a033-1af628879eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:37.741197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40982ac-66e6-4d43-a033-1af628879eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:37.741468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40982ac-66e6-4d43-a033-1af628879eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:37.750258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40982ac-66e6-4d43-a033-1af628879eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:37.751712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40982ac-66e6-4d43-a033-1af628879eb8 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:37.761111 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 614/1204] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:58:39.932049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5391e8-f82d-40ee-a9da-0d2d483bc44c None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:39.932560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5391e8-f82d-40ee-a9da-0d2d483bc44c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:39.932560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5391e8-f82d-40ee-a9da-0d2d483bc44c None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:39.933890 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 591/1205] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:58:39.939390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f3232-a278-4c2b-af71-5cc784b9369e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:39.939841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f3232-a278-4c2b-af71-5cc784b9369e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:39.939985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f3232-a278-4c2b-af71-5cc784b9369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:39.960646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7f5f3232-a278-4c2b-af71-5cc784b9369e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:39.961826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7f5f3232-a278-4c2b-af71-5cc784b9369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:39.969543 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 615/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:40.267461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5391e8-f82d-40ee-a9da-0d2d483bc44c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:40.278881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5391e8-f82d-40ee-a9da-0d2d483bc44c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:40.282466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa54dc-63cf-4168-986c-70fe5f011a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:40.283087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa54dc-63cf-4168-986c-70fe5f011a45 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:40.283367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa54dc-63cf-4168-986c-70fe5f011a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:40.283645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa54dc-63cf-4168-986c-70fe5f011a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:40.292578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa54dc-63cf-4168-986c-70fe5f011a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:40.293998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa54dc-63cf-4168-986c-70fe5f011a45 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:40.303594 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 592/1207] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 00:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:58:49.955446 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:50.299114 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=65 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:31.597933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf97e0-9372-4982-a13a-043362008f77 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:31.598731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf97e0-9372-4982-a13a-043362008f77 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:31.598731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf97e0-9372-4982-a13a-043362008f77 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:31.600383 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 616/1208] 10.222.0.39 () {54 vars in 921 bytes} [Sun Oct 16 00:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:59:31.605700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1f4c5-5fbb-4e82-b750-0339e4e8e028 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:31.606217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1f4c5-5fbb-4e82-b750-0339e4e8e028 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:31.606321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1f4c5-5fbb-4e82-b750-0339e4e8e028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:31.627092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2cc1f4c5-5fbb-4e82-b750-0339e4e8e028 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:59:31.628306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2cc1f4c5-5fbb-4e82-b750-0339e4e8e028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:31.637632 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 593/1209] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 00:59:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:59:41.622107 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:03.698007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0225aa-625e-4e52-8767-b5cc8f34426d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:03.698601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0225aa-625e-4e52-8767-b5cc8f34426d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:03.698601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0225aa-625e-4e52-8767-b5cc8f34426d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:03.731947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9a0225aa-625e-4e52-8767-b5cc8f34426d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:03.733170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9a0225aa-625e-4e52-8767-b5cc8f34426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:03.745801 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 617/1210] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:00:03.757773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827d587-155b-483c-846c-a87331b23905 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:03.758350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827d587-155b-483c-846c-a87331b23905 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:03.758350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827d587-155b-483c-846c-a87331b23905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:03.773798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d9dcd-1ab2-4ef2-90e2-b057ca78763b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:03.774055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d9dcd-1ab2-4ef2-90e2-b057ca78763b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:03.774333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d9dcd-1ab2-4ef2-90e2-b057ca78763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:03.789564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e827d587-155b-483c-846c-a87331b23905 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:03.791052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e827d587-155b-483c-846c-a87331b23905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:03.814478 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 594/1211] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:03.815952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401106-f987-480f-9934-cce44ba9b849 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:03.816744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401106-f987-480f-9934-cce44ba9b849 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:03.817013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401106-f987-480f-9934-cce44ba9b849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:03.832213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3f0d9dcd-1ab2-4ef2-90e2-b057ca78763b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:03.833438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3f0d9dcd-1ab2-4ef2-90e2-b057ca78763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:03.845621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2e401106-f987-480f-9934-cce44ba9b849 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:03.847227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2e401106-f987-480f-9934-cce44ba9b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:03.858900 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 618/1212] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:03.860030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034ba00-dd72-4fc4-b150-76fc61c38b06 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:03.860502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034ba00-dd72-4fc4-b150-76fc61c38b06 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:03.860799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034ba00-dd72-4fc4-b150-76fc61c38b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:03.868271 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 595/1213] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:03.869599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2379071-ec68-4ba5-9804-fcb5a69b6f19 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:03.869946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2379071-ec68-4ba5-9804-fcb5a69b6f19 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:03.870224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2379071-ec68-4ba5-9804-fcb5a69b6f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:03.886284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c034ba00-dd72-4fc4-b150-76fc61c38b06 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:03.887583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c034ba00-dd72-4fc4-b150-76fc61c38b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:03.898959 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 619/1214] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:03.900027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf5ed5-f39a-482d-821b-10bd40c34f46 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:03.900312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf5ed5-f39a-482d-821b-10bd40c34f46 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:03.900583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf5ed5-f39a-482d-821b-10bd40c34f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:03.902463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c2379071-ec68-4ba5-9804-fcb5a69b6f19 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:03.903848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c2379071-ec68-4ba5-9804-fcb5a69b6f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:03.916761 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 596/1215] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:03.917983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563de2c2-d882-41aa-98dd-f9e28ca98fcd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:03.918257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563de2c2-d882-41aa-98dd-f9e28ca98fcd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:03.918528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563de2c2-d882-41aa-98dd-f9e28ca98fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:03.933040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-57cf5ed5-f39a-482d-821b-10bd40c34f46 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:03.934278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-57cf5ed5-f39a-482d-821b-10bd40c34f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:03.947390 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 620/1216] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:03.948610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf5ed5-f39a-482d-821b-10bd40c34f46 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:03.960351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-563de2c2-d882-41aa-98dd-f9e28ca98fcd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:03.961586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-563de2c2-d882-41aa-98dd-f9e28ca98fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:03.961855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf5ed5-f39a-482d-821b-10bd40c34f46 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:03.967494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403eef3-6a8d-42fc-9334-3b4a748a1732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:03.968237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403eef3-6a8d-42fc-9334-3b4a748a1732 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:03.968528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403eef3-6a8d-42fc-9334-3b4a748a1732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:03.968848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403eef3-6a8d-42fc-9334-3b4a748a1732 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:03.969448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403eef3-6a8d-42fc-9334-3b4a748a1732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:03.969763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403eef3-6a8d-42fc-9334-3b4a748a1732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:03.970425 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 597/1217] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:03.970755 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-e403eef3-6a8d-42fc-9334-3b4a748a1732 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:00:03.970755 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:00:03.970755 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:00:03.971679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6691c-e18b-4567-94eb-03b51164f742 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:03.971816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403eef3-6a8d-42fc-9334-3b4a748a1732 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:03.971989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6691c-e18b-4567-94eb-03b51164f742 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:03.972837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6691c-e18b-4567-94eb-03b51164f742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:03.989245 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 621/1218] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:03.991596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d544a52-9811-4b58-806f-64152c538434 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:03.991896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d544a52-9811-4b58-806f-64152c538434 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:03.992183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d544a52-9811-4b58-806f-64152c538434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.001489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9ec6691c-e18b-4567-94eb-03b51164f742 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:04.004386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9ec6691c-e18b-4567-94eb-03b51164f742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:04.021384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8d544a52-9811-4b58-806f-64152c538434 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:04.021615 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 598/1219] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:04.022527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8d544a52-9811-4b58-806f-64152c538434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:04.025725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6691c-e18b-4567-94eb-03b51164f742 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.030961 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 622/1220] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:04.035171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c999f-2566-4390-82f8-3f741660b234 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.035171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c999f-2566-4390-82f8-3f741660b234 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.035171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c999f-2566-4390-82f8-3f741660b234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.036882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6691c-e18b-4567-94eb-03b51164f742 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.042826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d601d-4581-420e-9941-919dcc683a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.043482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d601d-4581-420e-9941-919dcc683a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.044681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d601d-4581-420e-9941-919dcc683a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.044963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d601d-4581-420e-9941-919dcc683a75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.045910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d601d-4581-420e-9941-919dcc683a75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:04.046039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d601d-4581-420e-9941-919dcc683a75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.047747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d601d-4581-420e-9941-919dcc683a75 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.055975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-df1c999f-2566-4390-82f8-3f741660b234 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:04.057637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-df1c999f-2566-4390-82f8-3f741660b234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:04.061746 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 599/1221] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:04.063035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6cd35-1cfe-4442-b957-f639d5009340 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.063465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6cd35-1cfe-4442-b957-f639d5009340 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.063880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6cd35-1cfe-4442-b957-f639d5009340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.069322 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 623/1222] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:04.070526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f945ba4-aeb8-4e7b-8908-d7351163a7cc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.070810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f945ba4-aeb8-4e7b-8908-d7351163a7cc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.071112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f945ba4-aeb8-4e7b-8908-d7351163a7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.088525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-14c6cd35-1cfe-4442-b957-f639d5009340 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:04.089721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-14c6cd35-1cfe-4442-b957-f639d5009340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:04.093598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6f945ba4-aeb8-4e7b-8908-d7351163a7cc None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:04.094768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6f945ba4-aeb8-4e7b-8908-d7351163a7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:04.099330 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 600/1223] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:04.100093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6cd35-1cfe-4442-b957-f639d5009340 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.110742 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 624/1224] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:04.111870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50a0b8-efe7-497b-82f8-a5e9edfd885b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.112153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50a0b8-efe7-497b-82f8-a5e9edfd885b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.112424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50a0b8-efe7-497b-82f8-a5e9edfd885b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.116260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6cd35-1cfe-4442-b957-f639d5009340 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.124691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06eb0b1-d2f9-406b-881b-5db1454f6b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.125295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eb0b1-d2f9-406b-881b-5db1454f6b04 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.125576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eb0b1-d2f9-406b-881b-5db1454f6b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.125848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eb0b1-d2f9-406b-881b-5db1454f6b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.126503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06eb0b1-d2f9-406b-881b-5db1454f6b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.127614 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-c06eb0b1-d2f9-406b-881b-5db1454f6b04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:00:04.127614 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:00:04.127614 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:00:04.128938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06eb0b1-d2f9-406b-881b-5db1454f6b04 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.132437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9d50a0b8-efe7-497b-82f8-a5e9edfd885b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:04.133700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d50a0b8-efe7-497b-82f8-a5e9edfd885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:04.141991 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 625/1225] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:04.143595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50a0b8-efe7-497b-82f8-a5e9edfd885b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.157257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50a0b8-efe7-497b-82f8-a5e9edfd885b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.166417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2284cd8-9eb3-477f-83d8-ae35f1802fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.167074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2284cd8-9eb3-477f-83d8-ae35f1802fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.167352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2284cd8-9eb3-477f-83d8-ae35f1802fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.167743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2284cd8-9eb3-477f-83d8-ae35f1802fcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.168245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2284cd8-9eb3-477f-83d8-ae35f1802fcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:04.168546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2284cd8-9eb3-477f-83d8-ae35f1802fcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.170237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2284cd8-9eb3-477f-83d8-ae35f1802fcb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.176944 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 601/1226] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:04.178628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea31c6-8239-4e5f-9b6f-a7ea6833bc37 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.178628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea31c6-8239-4e5f-9b6f-a7ea6833bc37 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.178867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea31c6-8239-4e5f-9b6f-a7ea6833bc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.191804 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 626/1227] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:04.191804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2284cd8-9eb3-477f-83d8-ae35f1802fcb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.196716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2284cd8-9eb3-477f-83d8-ae35f1802fcb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.202892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8eea31c6-8239-4e5f-9b6f-a7ea6833bc37 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:04.204763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8eea31c6-8239-4e5f-9b6f-a7ea6833bc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:04.255329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847bb71-4ddb-417d-8328-c29984498295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.255987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847bb71-4ddb-417d-8328-c29984498295 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.256294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847bb71-4ddb-417d-8328-c29984498295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.256567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847bb71-4ddb-417d-8328-c29984498295 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.257204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847bb71-4ddb-417d-8328-c29984498295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.259116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847bb71-4ddb-417d-8328-c29984498295 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.265844 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 602/1228] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:04.266675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea31c6-8239-4e5f-9b6f-a7ea6833bc37 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.276205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea31c6-8239-4e5f-9b6f-a7ea6833bc37 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.281533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb927d-9819-4b8f-884e-7f9878af2949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.282134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb927d-9819-4b8f-884e-7f9878af2949 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.282411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb927d-9819-4b8f-884e-7f9878af2949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.282681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb927d-9819-4b8f-884e-7f9878af2949 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.283340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb927d-9819-4b8f-884e-7f9878af2949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:04.283637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb927d-9819-4b8f-884e-7f9878af2949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.286339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb927d-9819-4b8f-884e-7f9878af2949 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.288771 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 627/1229] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:04.289717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847bb71-4ddb-417d-8328-c29984498295 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.309449 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 603/1230] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:04.309449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb927d-9819-4b8f-884e-7f9878af2949 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.319564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb927d-9819-4b8f-884e-7f9878af2949 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.351762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847bb71-4ddb-417d-8328-c29984498295 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.356268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916b4bb-04c9-4933-b090-c1e33f0d2776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.357016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916b4bb-04c9-4933-b090-c1e33f0d2776 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.357292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916b4bb-04c9-4933-b090-c1e33f0d2776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.357696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916b4bb-04c9-4933-b090-c1e33f0d2776 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.358550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916b4bb-04c9-4933-b090-c1e33f0d2776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:04.358893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916b4bb-04c9-4933-b090-c1e33f0d2776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.360680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916b4bb-04c9-4933-b090-c1e33f0d2776 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.370079 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:04.373764 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 628/1231] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:04.375420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b776ce1-0fb1-4403-9082-951c544de40d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.376130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b776ce1-0fb1-4403-9082-951c544de40d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.376547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b776ce1-0fb1-4403-9082-951c544de40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.383405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212ab60-8e7d-4659-8f7d-432493215b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.384022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212ab60-8e7d-4659-8f7d-432493215b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.384298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212ab60-8e7d-4659-8f7d-432493215b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.384565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212ab60-8e7d-4659-8f7d-432493215b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.385203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212ab60-8e7d-4659-8f7d-432493215b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:04.385517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212ab60-8e7d-4659-8f7d-432493215b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.387197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212ab60-8e7d-4659-8f7d-432493215b44 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.394590 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:04.399496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9b776ce1-0fb1-4403-9082-951c544de40d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:04.400704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9b776ce1-0fb1-4403-9082-951c544de40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:04.407910 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 604/1232] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:04.407910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212ab60-8e7d-4659-8f7d-432493215b44 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.409495 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 629/1233] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:04.411061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b776ce1-0fb1-4403-9082-951c544de40d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.416837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212ab60-8e7d-4659-8f7d-432493215b44 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.420840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b776ce1-0fb1-4403-9082-951c544de40d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.422705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c9a3c-c707-4ae8-8a09-59c440aab037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.423374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c9a3c-c707-4ae8-8a09-59c440aab037 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.423680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c9a3c-c707-4ae8-8a09-59c440aab037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.423975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c9a3c-c707-4ae8-8a09-59c440aab037 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.424638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c9a3c-c707-4ae8-8a09-59c440aab037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.425858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d21f6c-5269-40b0-a772-f570cd662550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.426247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d21f6c-5269-40b0-a772-f570cd662550 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.426554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d21f6c-5269-40b0-a772-f570cd662550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.426694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c9a3c-c707-4ae8-8a09-59c440aab037 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.426815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d21f6c-5269-40b0-a772-f570cd662550 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.427686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d21f6c-5269-40b0-a772-f570cd662550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.429599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d21f6c-5269-40b0-a772-f570cd662550 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.449963 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 605/1234] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:04.450980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c9a3c-c707-4ae8-8a09-59c440aab037 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.463900 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 630/1235] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:04.464074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c9a3c-c707-4ae8-8a09-59c440aab037 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.464183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d21f6c-5269-40b0-a772-f570cd662550 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.520459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d115375-0978-4369-b153-2f027877e68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.521065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d115375-0978-4369-b153-2f027877e68c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.521342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d115375-0978-4369-b153-2f027877e68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.521610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d115375-0978-4369-b153-2f027877e68c admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.522244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d115375-0978-4369-b153-2f027877e68c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:04.522544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d115375-0978-4369-b153-2f027877e68c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.524241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d115375-0978-4369-b153-2f027877e68c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.525720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d21f6c-5269-40b0-a772-f570cd662550 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.530333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681f04d-f7e1-4d00-9a69-779b693f2e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.530960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681f04d-f7e1-4d00-9a69-779b693f2e60 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.531243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681f04d-f7e1-4d00-9a69-779b693f2e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.531517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681f04d-f7e1-4d00-9a69-779b693f2e60 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.532145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681f04d-f7e1-4d00-9a69-779b693f2e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.533267 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-9681f04d-f7e1-4d00-9a69-779b693f2e60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:00:04.533267 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:00:04.533267 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:00:04.534489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681f04d-f7e1-4d00-9a69-779b693f2e60 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.535727 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 606/1236] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:04.536580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d115375-0978-4369-b153-2f027877e68c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.546953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d115375-0978-4369-b153-2f027877e68c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.555063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490a53f-298d-44a0-9322-f04ed040652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.559151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490a53f-298d-44a0-9322-f04ed040652f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.559151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490a53f-298d-44a0-9322-f04ed040652f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.559151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490a53f-298d-44a0-9322-f04ed040652f admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.559151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490a53f-298d-44a0-9322-f04ed040652f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.559151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490a53f-298d-44a0-9322-f04ed040652f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.561926 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 631/1237] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:04.562717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681f04d-f7e1-4d00-9a69-779b693f2e60 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.573210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681f04d-f7e1-4d00-9a69-779b693f2e60 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.577881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2127d6-59aa-49dc-b01c-4274abfdf19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.578475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2127d6-59aa-49dc-b01c-4274abfdf19a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.578751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2127d6-59aa-49dc-b01c-4274abfdf19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.579058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2127d6-59aa-49dc-b01c-4274abfdf19a admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.579679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2127d6-59aa-49dc-b01c-4274abfdf19a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.581601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2127d6-59aa-49dc-b01c-4274abfdf19a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.588631 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 607/1238] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:04.589624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490a53f-298d-44a0-9322-f04ed040652f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.610495 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 632/1239] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/projects => generated 395 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:04.611673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2127d6-59aa-49dc-b01c-4274abfdf19a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.662218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490a53f-298d-44a0-9322-f04ed040652f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.678070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2127d6-59aa-49dc-b01c-4274abfdf19a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.682794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829cb2d-064f-4d40-9313-1ef10c14b048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.683432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829cb2d-064f-4d40-9313-1ef10c14b048 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.683706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829cb2d-064f-4d40-9313-1ef10c14b048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.683980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829cb2d-064f-4d40-9313-1ef10c14b048 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.684641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829cb2d-064f-4d40-9313-1ef10c14b048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:04.684944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829cb2d-064f-4d40-9313-1ef10c14b048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.686548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829cb2d-064f-4d40-9313-1ef10c14b048 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.698337 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 633/1240] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:04.699403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829cb2d-064f-4d40-9313-1ef10c14b048 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.709528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829cb2d-064f-4d40-9313-1ef10c14b048 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.714364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c08645-f977-41a9-9455-fd240edebd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.714892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c08645-f977-41a9-9455-fd240edebd29 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.715204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c08645-f977-41a9-9455-fd240edebd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.715477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c08645-f977-41a9-9455-fd240edebd29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.716253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c08645-f977-41a9-9455-fd240edebd29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.717850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c08645-f977-41a9-9455-fd240edebd29 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.721678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534c822-b779-403a-9288-b53ed8c25545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.722816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534c822-b779-403a-9288-b53ed8c25545 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.723122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534c822-b779-403a-9288-b53ed8c25545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.723471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534c822-b779-403a-9288-b53ed8c25545 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.724099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534c822-b779-403a-9288-b53ed8c25545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.726031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534c822-b779-403a-9288-b53ed8c25545 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.733040 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 634/1241] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:04.733215 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:04.733326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c08645-f977-41a9-9455-fd240edebd29 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.741192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c08645-f977-41a9-9455-fd240edebd29 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.746363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63d580-9204-49b6-8626-753377ee334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.747188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63d580-9204-49b6-8626-753377ee334f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.747515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63d580-9204-49b6-8626-753377ee334f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.747797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63d580-9204-49b6-8626-753377ee334f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.748475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63d580-9204-49b6-8626-753377ee334f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.750611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63d580-9204-49b6-8626-753377ee334f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.756555 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 608/1242] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/projects => generated 399 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:04.757528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534c822-b779-403a-9288-b53ed8c25545 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.774056 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 635/1243] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:04.775183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63d580-9204-49b6-8626-753377ee334f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.782750 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:04.787861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63d580-9204-49b6-8626-753377ee334f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.824240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534c822-b779-403a-9288-b53ed8c25545 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.829126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd8c34-19d6-4efb-b0fa-3441a7aa2430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.829738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd8c34-19d6-4efb-b0fa-3441a7aa2430 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.830012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd8c34-19d6-4efb-b0fa-3441a7aa2430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.830292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd8c34-19d6-4efb-b0fa-3441a7aa2430 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.830951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd8c34-19d6-4efb-b0fa-3441a7aa2430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.833524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd8c34-19d6-4efb-b0fa-3441a7aa2430 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.845444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dce64-bab1-414f-b482-fb6cda6f1d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.846047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dce64-bab1-414f-b482-fb6cda6f1d7c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.846322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dce64-bab1-414f-b482-fb6cda6f1d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.846590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dce64-bab1-414f-b482-fb6cda6f1d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.847447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dce64-bab1-414f-b482-fb6cda6f1d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.849349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dce64-bab1-414f-b482-fb6cda6f1d7c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.860456 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 636/1244] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:04.861642 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 609/1245] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:04.862607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd8c34-19d6-4efb-b0fa-3441a7aa2430 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.864091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dce64-bab1-414f-b482-fb6cda6f1d7c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.873645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dce64-bab1-414f-b482-fb6cda6f1d7c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.929487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd8c34-19d6-4efb-b0fa-3441a7aa2430 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.934147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fcc7-f0bd-4a73-a2fb-9f2b65ae21f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.934753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fcc7-f0bd-4a73-a2fb-9f2b65ae21f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.935061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fcc7-f0bd-4a73-a2fb-9f2b65ae21f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.935328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fcc7-f0bd-4a73-a2fb-9f2b65ae21f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.935957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707fcc7-f0bd-4a73-a2fb-9f2b65ae21f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.937857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707fcc7-f0bd-4a73-a2fb-9f2b65ae21f1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.938776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12578681-13d3-4c98-9fed-003648c33efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.939463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12578681-13d3-4c98-9fed-003648c33efe admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.939767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12578681-13d3-4c98-9fed-003648c33efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.940110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12578681-13d3-4c98-9fed-003648c33efe admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.940740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12578681-13d3-4c98-9fed-003648c33efe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.942891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12578681-13d3-4c98-9fed-003648c33efe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.961964 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 610/1246] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:04.962952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fcc7-f0bd-4a73-a2fb-9f2b65ae21f1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.966066 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 637/1247] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:04.969670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12578681-13d3-4c98-9fed-003648c33efe admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:04.973447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fcc7-f0bd-4a73-a2fb-9f2b65ae21f1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.978908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77d455-e6df-45d9-9932-29599b5fbd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.979560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77d455-e6df-45d9-9932-29599b5fbd90 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.979840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77d455-e6df-45d9-9932-29599b5fbd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.979974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12578681-13d3-4c98-9fed-003648c33efe admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:04.980112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77d455-e6df-45d9-9932-29599b5fbd90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.980735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77d455-e6df-45d9-9932-29599b5fbd90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.982622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77d455-e6df-45d9-9932-29599b5fbd90 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:04.984644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6b295-6f21-4c94-9ad3-ecd25efd5aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:04.985236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6b295-6f21-4c94-9ad3-ecd25efd5aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:04.985537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6b295-6f21-4c94-9ad3-ecd25efd5aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:04.985804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6b295-6f21-4c94-9ad3-ecd25efd5aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:04.986429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6b295-6f21-4c94-9ad3-ecd25efd5aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:04.988168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6b295-6f21-4c94-9ad3-ecd25efd5aa4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.004083 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 638/1248] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.004083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6b295-6f21-4c94-9ad3-ecd25efd5aa4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.014656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6b295-6f21-4c94-9ad3-ecd25efd5aa4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.022424 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 611/1249] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:04 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:05.022561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a49d30-6034-4155-9d27-a3476ebb7a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.022715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77d455-e6df-45d9-9932-29599b5fbd90 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.022820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a49d30-6034-4155-9d27-a3476ebb7a84 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.022820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a49d30-6034-4155-9d27-a3476ebb7a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.022820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a49d30-6034-4155-9d27-a3476ebb7a84 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.022820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a49d30-6034-4155-9d27-a3476ebb7a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.023518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a49d30-6034-4155-9d27-a3476ebb7a84 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.046074 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 639/1250] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:05 2022] POST /identity/v3/users => generated 300 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:05.049244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a49d30-6034-4155-9d27-a3476ebb7a84 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.056425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a49d30-6034-4155-9d27-a3476ebb7a84 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.066644 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:05.087720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77d455-e6df-45d9-9932-29599b5fbd90 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.092285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaba044-cc6f-430a-bc50-f5a4b1b2a4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.092891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaba044-cc6f-430a-bc50-f5a4b1b2a4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.093166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaba044-cc6f-430a-bc50-f5a4b1b2a4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.093434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaba044-cc6f-430a-bc50-f5a4b1b2a4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.094067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaba044-cc6f-430a-bc50-f5a4b1b2a4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.095677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaba044-cc6f-430a-bc50-f5a4b1b2a4a7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.105963 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 612/1251] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.106557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaba044-cc6f-430a-bc50-f5a4b1b2a4a7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.116173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaba044-cc6f-430a-bc50-f5a4b1b2a4a7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.116329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62282d14-42b5-4c21-ae0b-af303c01001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.116809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282d14-42b5-4c21-ae0b-af303c01001c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.117168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282d14-42b5-4c21-ae0b-af303c01001c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.117355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282d14-42b5-4c21-ae0b-af303c01001c admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.118019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62282d14-42b5-4c21-ae0b-af303c01001c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.119645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62282d14-42b5-4c21-ae0b-af303c01001c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.120704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57985797-79ee-4600-b2a8-3bf0dad9feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.121274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985797-79ee-4600-b2a8-3bf0dad9feb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.121546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985797-79ee-4600-b2a8-3bf0dad9feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.121817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985797-79ee-4600-b2a8-3bf0dad9feb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.122282 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:05.122426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57985797-79ee-4600-b2a8-3bf0dad9feb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.124362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57985797-79ee-4600-b2a8-3bf0dad9feb8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.132252 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 640/1252] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.133178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62282d14-42b5-4c21-ae0b-af303c01001c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.144436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62282d14-42b5-4c21-ae0b-af303c01001c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.149381 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 613/1253] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:05 2022] POST /identity/v3/users => generated 291 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:05.149665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79657e47-dce8-4ce5-879c-bab043c8ef36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.150064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57985797-79ee-4600-b2a8-3bf0dad9feb8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.150565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657e47-dce8-4ce5-879c-bab043c8ef36 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.151000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657e47-dce8-4ce5-879c-bab043c8ef36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.151338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657e47-dce8-4ce5-879c-bab043c8ef36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.152158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79657e47-dce8-4ce5-879c-bab043c8ef36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.153970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79657e47-dce8-4ce5-879c-bab043c8ef36 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.162124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57985797-79ee-4600-b2a8-3bf0dad9feb8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.164922 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 641/1254] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.166072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79657e47-dce8-4ce5-879c-bab043c8ef36 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.167104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e136a-f0bd-40c0-aaa8-1b8705a16972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.167704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e136a-f0bd-40c0-aaa8-1b8705a16972 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.168151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e136a-f0bd-40c0-aaa8-1b8705a16972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.168312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e136a-f0bd-40c0-aaa8-1b8705a16972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.168948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e136a-f0bd-40c0-aaa8-1b8705a16972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.170544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e136a-f0bd-40c0-aaa8-1b8705a16972 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.176643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79657e47-dce8-4ce5-879c-bab043c8ef36 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.181170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dbb88-695e-4c56-98c4-bf99fb5c1bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.181805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dbb88-695e-4c56-98c4-bf99fb5c1bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.182091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dbb88-695e-4c56-98c4-bf99fb5c1bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.182322 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 614/1255] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.182429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dbb88-695e-4c56-98c4-bf99fb5c1bbc admin admin] PATH_INFO: `/v3/projects/4e9880e0613c4f87a00daf04c040edb0/users/b01de0795d2f472ab35e08f4651c19ae/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.183180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e136a-f0bd-40c0-aaa8-1b8705a16972 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.194027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e136a-f0bd-40c0-aaa8-1b8705a16972 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.197339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dbb88-695e-4c56-98c4-bf99fb5c1bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9880e0613c4f87a00daf04c040edb0, user_id=b01de0795d2f472ab35e08f4651c19ae, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.198575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9a361-d1aa-4dec-9f57-5f5924503fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.199205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9a361-d1aa-4dec-9f57-5f5924503fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.199480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9a361-d1aa-4dec-9f57-5f5924503fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.199746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9a361-d1aa-4dec-9f57-5f5924503fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.200355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9a361-d1aa-4dec-9f57-5f5924503fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.200691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dbb88-695e-4c56-98c4-bf99fb5c1bbc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.202218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9a361-d1aa-4dec-9f57-5f5924503fb6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.215260 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 642/1256] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:05 2022] PUT /identity/v3/projects/4e9880e0613c4f87a00daf04c040edb0/users/b01de0795d2f472ab35e08f4651c19ae/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:05.216055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dbb88-695e-4c56-98c4-bf99fb5c1bbc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.231405 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 615/1257] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:05 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:05.232173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9a361-d1aa-4dec-9f57-5f5924503fb6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.242906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9a361-d1aa-4dec-9f57-5f5924503fb6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.280983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dbb88-695e-4c56-98c4-bf99fb5c1bbc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.285807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc2b07-3bd7-4c7f-9341-c385fa7772b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.286489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc2b07-3bd7-4c7f-9341-c385fa7772b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.286836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc2b07-3bd7-4c7f-9341-c385fa7772b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.287135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc2b07-3bd7-4c7f-9341-c385fa7772b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.287762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc2b07-3bd7-4c7f-9341-c385fa7772b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.289415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc2b07-3bd7-4c7f-9341-c385fa7772b6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.299640 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 643/1258] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.300964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc2b07-3bd7-4c7f-9341-c385fa7772b6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.304516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10569f-faa2-43aa-a1eb-2dc2d40fc0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.305212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10569f-faa2-43aa-a1eb-2dc2d40fc0eb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.305563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10569f-faa2-43aa-a1eb-2dc2d40fc0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.305911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10569f-faa2-43aa-a1eb-2dc2d40fc0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.306634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10569f-faa2-43aa-a1eb-2dc2d40fc0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.308478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10569f-faa2-43aa-a1eb-2dc2d40fc0eb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.311964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc2b07-3bd7-4c7f-9341-c385fa7772b6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.317990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd9fe9-9057-4f6a-9e90-0a4c8ae70ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.319049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd9fe9-9057-4f6a-9e90-0a4c8ae70ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.319343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd9fe9-9057-4f6a-9e90-0a4c8ae70ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.319608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd9fe9-9057-4f6a-9e90-0a4c8ae70ba9 admin admin] PATH_INFO: `/v3/projects/56c1848299c34a9a8e9385b69e888b93/users/1acb785884fb4e33a9275f5db7575daa/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.323987 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 616/1259] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.323987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10569f-faa2-43aa-a1eb-2dc2d40fc0eb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.333865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10569f-faa2-43aa-a1eb-2dc2d40fc0eb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.339891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63786630-9857-44a5-92f2-89cd19e89205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.340686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63786630-9857-44a5-92f2-89cd19e89205 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.341024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63786630-9857-44a5-92f2-89cd19e89205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.341391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63786630-9857-44a5-92f2-89cd19e89205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.341850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd9fe9-9057-4f6a-9e90-0a4c8ae70ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c1848299c34a9a8e9385b69e888b93, user_id=1acb785884fb4e33a9275f5db7575daa, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.342149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63786630-9857-44a5-92f2-89cd19e89205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.343977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63786630-9857-44a5-92f2-89cd19e89205 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.344670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd9fe9-9057-4f6a-9e90-0a4c8ae70ba9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.356659 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 617/1260] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.357473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63786630-9857-44a5-92f2-89cd19e89205 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.359959 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 644/1261] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:05 2022] PUT /identity/v3/projects/56c1848299c34a9a8e9385b69e888b93/users/1acb785884fb4e33a9275f5db7575daa/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:05.360840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd9fe9-9057-4f6a-9e90-0a4c8ae70ba9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.368727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63786630-9857-44a5-92f2-89cd19e89205 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.424940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd9fe9-9057-4f6a-9e90-0a4c8ae70ba9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.426815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7dffb-b15f-4438-9343-93ab72469f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.427455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7dffb-b15f-4438-9343-93ab72469f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.427733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7dffb-b15f-4438-9343-93ab72469f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.428006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7dffb-b15f-4438-9343-93ab72469f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.428636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7dffb-b15f-4438-9343-93ab72469f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.429967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d914bcb-8178-495f-8335-7a5f9d4ce6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.430217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7dffb-b15f-4438-9343-93ab72469f87 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.430561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d914bcb-8178-495f-8335-7a5f9d4ce6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.430837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d914bcb-8178-495f-8335-7a5f9d4ce6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.431141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d914bcb-8178-495f-8335-7a5f9d4ce6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.431767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d914bcb-8178-495f-8335-7a5f9d4ce6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.433334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d914bcb-8178-495f-8335-7a5f9d4ce6bf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.440213 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 618/1262] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.441572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceaadb-fe67-45a2-a82c-2f4888042459 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.441967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceaadb-fe67-45a2-a82c-2f4888042459 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.442241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceaadb-fe67-45a2-a82c-2f4888042459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.442945 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 645/1263] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.444072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d914bcb-8178-495f-8335-7a5f9d4ce6bf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.453793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d914bcb-8178-495f-8335-7a5f9d4ce6bf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.459490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b54345-9a97-4b4c-ad94-24baae4b80d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.460075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b54345-9a97-4b4c-ad94-24baae4b80d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.460349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b54345-9a97-4b4c-ad94-24baae4b80d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.460618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b54345-9a97-4b4c-ad94-24baae4b80d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.461236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b54345-9a97-4b4c-ad94-24baae4b80d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.462805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b54345-9a97-4b4c-ad94-24baae4b80d8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.463350 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:05.473395 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 646/1264] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.474195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b54345-9a97-4b4c-ad94-24baae4b80d8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.477252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-faceaadb-fe67-45a2-a82c-2f4888042459 None None] MFA Rules not processed for user `b01de0795d2f472ab35e08f4651c19ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:05.478591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-faceaadb-fe67-45a2-a82c-2f4888042459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:05.483692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b54345-9a97-4b4c-ad94-24baae4b80d8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.488958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4911cb-e331-47df-9a29-ac8ef806c92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.489532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4911cb-e331-47df-9a29-ac8ef806c92b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.489811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4911cb-e331-47df-9a29-ac8ef806c92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.490081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4911cb-e331-47df-9a29-ac8ef806c92b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.490699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4911cb-e331-47df-9a29-ac8ef806c92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.492293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4911cb-e331-47df-9a29-ac8ef806c92b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.502353 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 647/1265] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.503127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4911cb-e331-47df-9a29-ac8ef806c92b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.513194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4911cb-e331-47df-9a29-ac8ef806c92b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.517685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd74ee-7e83-42e3-a3ac-6f8f7ad47d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.518304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd74ee-7e83-42e3-a3ac-6f8f7ad47d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.518598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd74ee-7e83-42e3-a3ac-6f8f7ad47d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.518855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd74ee-7e83-42e3-a3ac-6f8f7ad47d03 admin admin] PATH_INFO: `/v3/projects/38c7831284884cc0b1f2ff9822cc5aea/users/5000f1b310334c199e95e71621e60870/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.523023 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:05.534488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd74ee-7e83-42e3-a3ac-6f8f7ad47d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c7831284884cc0b1f2ff9822cc5aea, user_id=5000f1b310334c199e95e71621e60870, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.537617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd74ee-7e83-42e3-a3ac-6f8f7ad47d03 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.548782 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 619/1266] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:05.552503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faceaadb-fe67-45a2-a82c-2f4888042459 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.554883 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 648/1267] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:05 2022] PUT /identity/v3/projects/38c7831284884cc0b1f2ff9822cc5aea/users/5000f1b310334c199e95e71621e60870/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:05.563562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faceaadb-fe67-45a2-a82c-2f4888042459 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.564889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8e264-8b82-4c26-9add-18ffcd9b61cc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.565223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8e264-8b82-4c26-9add-18ffcd9b61cc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.565543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8e264-8b82-4c26-9add-18ffcd9b61cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.594067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-74d8e264-8b82-4c26-9add-18ffcd9b61cc None None] MFA Rules not processed for user `1acb785884fb4e33a9275f5db7575daa`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:05.595335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-74d8e264-8b82-4c26-9add-18ffcd9b61cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:05.621728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec4976-54ac-495a-ac00-2004bc144753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.622336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec4976-54ac-495a-ac00-2004bc144753 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.622620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec4976-54ac-495a-ac00-2004bc144753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.622891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec4976-54ac-495a-ac00-2004bc144753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.623561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec4976-54ac-495a-ac00-2004bc144753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.625156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec4976-54ac-495a-ac00-2004bc144753 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.635747 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 620/1268] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.636519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec4976-54ac-495a-ac00-2004bc144753 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.645765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec4976-54ac-495a-ac00-2004bc144753 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.650317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f73133-29bb-4a30-8e1c-b7baa977d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.650971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73133-29bb-4a30-8e1c-b7baa977d9fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.651252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73133-29bb-4a30-8e1c-b7baa977d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.651526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73133-29bb-4a30-8e1c-b7baa977d9fa admin admin] PATH_INFO: `/v3/projects/4afeba85d0bc4d87ba15ccf94db80957/users/b9794779bff74483839f7102a1344d59/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.664374 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 649/1269] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:05.665193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8e264-8b82-4c26-9add-18ffcd9b61cc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.670313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f73133-29bb-4a30-8e1c-b7baa977d9fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4afeba85d0bc4d87ba15ccf94db80957, user_id=b9794779bff74483839f7102a1344d59, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.673009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f73133-29bb-4a30-8e1c-b7baa977d9fa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.675407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8e264-8b82-4c26-9add-18ffcd9b61cc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.680654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98294bdd-6007-4137-9a22-a44cf16e86ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.681445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98294bdd-6007-4137-9a22-a44cf16e86ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.681729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98294bdd-6007-4137-9a22-a44cf16e86ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.682000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98294bdd-6007-4137-9a22-a44cf16e86ea admin admin] PATH_INFO: `/v3/projects/ca0b8c6c9299455a8aa6948a29bb8bdc/users/a1f5ae583afa408f83f73552816433ee/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.686663 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 621/1270] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:05 2022] PUT /identity/v3/projects/4afeba85d0bc4d87ba15ccf94db80957/users/b9794779bff74483839f7102a1344d59/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:05.687505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f73133-29bb-4a30-8e1c-b7baa977d9fa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.703998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98294bdd-6007-4137-9a22-a44cf16e86ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0b8c6c9299455a8aa6948a29bb8bdc, user_id=a1f5ae583afa408f83f73552816433ee, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.706787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98294bdd-6007-4137-9a22-a44cf16e86ea admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.719729 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 650/1271] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:05 2022] PUT /identity/v3/projects/ca0b8c6c9299455a8aa6948a29bb8bdc/users/a1f5ae583afa408f83f73552816433ee/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:05.720732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98294bdd-6007-4137-9a22-a44cf16e86ea admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.760013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f73133-29bb-4a30-8e1c-b7baa977d9fa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.772691 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:05.783807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98294bdd-6007-4137-9a22-a44cf16e86ea admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.789276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d14008-2eb3-4acc-8b9e-36cf004e0708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.790029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d14008-2eb3-4acc-8b9e-36cf004e0708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.790645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d14008-2eb3-4acc-8b9e-36cf004e0708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.790940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d14008-2eb3-4acc-8b9e-36cf004e0708 admin admin] PATH_INFO: `/v3/projects/09fc95edb31e4dfaa01af9203dad7289/users/782a58482ac54dfbbae0e71cd1c76b7a/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.806539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d14008-2eb3-4acc-8b9e-36cf004e0708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09fc95edb31e4dfaa01af9203dad7289, user_id=782a58482ac54dfbbae0e71cd1c76b7a, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.809230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d14008-2eb3-4acc-8b9e-36cf004e0708 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.819727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5209ed-796c-4e5e-8379-940695b56c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.820343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5209ed-796c-4e5e-8379-940695b56c76 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.820622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5209ed-796c-4e5e-8379-940695b56c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.820890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5209ed-796c-4e5e-8379-940695b56c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.821556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5209ed-796c-4e5e-8379-940695b56c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.821967 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 651/1272] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:05 2022] PUT /identity/v3/projects/09fc95edb31e4dfaa01af9203dad7289/users/782a58482ac54dfbbae0e71cd1c76b7a/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:05.822738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d14008-2eb3-4acc-8b9e-36cf004e0708 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.823262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5209ed-796c-4e5e-8379-940695b56c76 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.840225 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 622/1273] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:05.842283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0af70-4f0d-4600-8498-ddd6c8730434 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.842573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0af70-4f0d-4600-8498-ddd6c8730434 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.842847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0af70-4f0d-4600-8498-ddd6c8730434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.868992 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:05.872419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-49d0af70-4f0d-4600-8498-ddd6c8730434 None None] MFA Rules not processed for user `5000f1b310334c199e95e71621e60870`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:05.874223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-49d0af70-4f0d-4600-8498-ddd6c8730434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:05.897966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d14008-2eb3-4acc-8b9e-36cf004e0708 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:05.902693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0adbd1-3f2c-427b-9b93-ec7aab59d819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:05.903331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0adbd1-3f2c-427b-9b93-ec7aab59d819 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:05.903610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0adbd1-3f2c-427b-9b93-ec7aab59d819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:05.903880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0adbd1-3f2c-427b-9b93-ec7aab59d819 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:05.904532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0adbd1-3f2c-427b-9b93-ec7aab59d819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:05.906526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0adbd1-3f2c-427b-9b93-ec7aab59d819 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:05.933815 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 652/1274] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:05 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:05.934853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0adbd1-3f2c-427b-9b93-ec7aab59d819 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.942745 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 623/1275] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:05.943443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0af70-4f0d-4600-8498-ddd6c8730434 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:05.953925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0af70-4f0d-4600-8498-ddd6c8730434 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.001985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0adbd1-3f2c-427b-9b93-ec7aab59d819 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.007630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966afca-92bb-4eea-a25f-4b6d15979883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.008403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966afca-92bb-4eea-a25f-4b6d15979883 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.008914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966afca-92bb-4eea-a25f-4b6d15979883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.009259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966afca-92bb-4eea-a25f-4b6d15979883 admin admin] PATH_INFO: `/v3/projects/74772adf0afa4a77a1ad7ab6b551dd5a/users/83b1d20aa5bb4ef7b3655c9cc7e43f7d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.011154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec57b7-f614-4c38-a518-518127261ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.011706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec57b7-f614-4c38-a518-518127261ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.011983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec57b7-f614-4c38-a518-518127261ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.012253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec57b7-f614-4c38-a518-518127261ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.012877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec57b7-f614-4c38-a518-518127261ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.014785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec57b7-f614-4c38-a518-518127261ca8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.025356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966afca-92bb-4eea-a25f-4b6d15979883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74772adf0afa4a77a1ad7ab6b551dd5a, user_id=83b1d20aa5bb4ef7b3655c9cc7e43f7d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.028975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966afca-92bb-4eea-a25f-4b6d15979883 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.041807 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 624/1276] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:05 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:06.043161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19103d-1f09-4f07-9024-470e4dd34fa0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.043744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19103d-1f09-4f07-9024-470e4dd34fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.043886 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 653/1277] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:05 2022] PUT /identity/v3/projects/74772adf0afa4a77a1ad7ab6b551dd5a/users/83b1d20aa5bb4ef7b3655c9cc7e43f7d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:06.045009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5457-1845-4bfa-a776-8c1ed13584dd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.045301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5457-1845-4bfa-a776-8c1ed13584dd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.045567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5457-1845-4bfa-a776-8c1ed13584dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.053019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19103d-1f09-4f07-9024-470e4dd34fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.073517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dedf5457-1845-4bfa-a776-8c1ed13584dd None None] MFA Rules not processed for user `a1f5ae583afa408f83f73552816433ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:06.074742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dedf5457-1845-4bfa-a776-8c1ed13584dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:06.083628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ef19103d-1f09-4f07-9024-470e4dd34fa0 None None] MFA Rules not processed for user `b9794779bff74483839f7102a1344d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:06.084877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef19103d-1f09-4f07-9024-470e4dd34fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:06.102350 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:06.140876 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 654/1278] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:06.146158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9355f30-ee1f-44bc-8488-5739c7364448 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.146523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9355f30-ee1f-44bc-8488-5739c7364448 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.146875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9355f30-ee1f-44bc-8488-5739c7364448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.152344 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 625/1279] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:06.153212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19103d-1f09-4f07-9024-470e4dd34fa0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.177938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b9355f30-ee1f-44bc-8488-5739c7364448 None None] MFA Rules not processed for user `782a58482ac54dfbbae0e71cd1c76b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:06.179189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b9355f30-ee1f-44bc-8488-5739c7364448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:06.198401 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:06.216005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19103d-1f09-4f07-9024-470e4dd34fa0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.220650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a28c8c-ee98-4911-aedb-6f7db663682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.221304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a28c8c-ee98-4911-aedb-6f7db663682b admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.221583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a28c8c-ee98-4911-aedb-6f7db663682b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.221857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a28c8c-ee98-4911-aedb-6f7db663682b admin admin] PATH_INFO: `/v3/projects/3786a93a69454bfa9dc490a4006b8a60/users/5044e3245cbf4cbdaa5ac6cb174aeabe/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.236723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a28c8c-ee98-4911-aedb-6f7db663682b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3786a93a69454bfa9dc490a4006b8a60, user_id=5044e3245cbf4cbdaa5ac6cb174aeabe, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.240450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a28c8c-ee98-4911-aedb-6f7db663682b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.246293 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 655/1280] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:06.247099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9355f30-ee1f-44bc-8488-5739c7364448 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.255200 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 626/1281] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:06 2022] PUT /identity/v3/projects/3786a93a69454bfa9dc490a4006b8a60/users/5044e3245cbf4cbdaa5ac6cb174aeabe/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:06.256050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a28c8c-ee98-4911-aedb-6f7db663682b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.268862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9355f30-ee1f-44bc-8488-5739c7364448 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.321261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a28c8c-ee98-4911-aedb-6f7db663682b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.326157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc977b6-6831-4f66-80cb-a4d97470a2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.326765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc977b6-6831-4f66-80cb-a4d97470a2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.327122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc977b6-6831-4f66-80cb-a4d97470a2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.327426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc977b6-6831-4f66-80cb-a4d97470a2e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.327887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac48713-5c13-41d7-965c-be6578c97f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.328133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc977b6-6831-4f66-80cb-a4d97470a2e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.328626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac48713-5c13-41d7-965c-be6578c97f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.328972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac48713-5c13-41d7-965c-be6578c97f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.329310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac48713-5c13-41d7-965c-be6578c97f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.329999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac48713-5c13-41d7-965c-be6578c97f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.330103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc977b6-6831-4f66-80cb-a4d97470a2e0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.332219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac48713-5c13-41d7-965c-be6578c97f8c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.355044 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 656/1282] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:06.355863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac48713-5c13-41d7-965c-be6578c97f8c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.360008 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 627/1283] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:06.360008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a9b45-2293-4fb9-abc7-aba034071072 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.360008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a9b45-2293-4fb9-abc7-aba034071072 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.360008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a9b45-2293-4fb9-abc7-aba034071072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.367314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac48713-5c13-41d7-965c-be6578c97f8c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.389241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-531a9b45-2293-4fb9-abc7-aba034071072 None None] MFA Rules not processed for user `83b1d20aa5bb4ef7b3655c9cc7e43f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:06.390574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-531a9b45-2293-4fb9-abc7-aba034071072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:06.403622 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:06.426277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2b05-edfc-4456-bb8e-6501f5e94066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.426896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2b05-edfc-4456-bb8e-6501f5e94066 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.427198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2b05-edfc-4456-bb8e-6501f5e94066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.427471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2b05-edfc-4456-bb8e-6501f5e94066 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.428102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df2b05-edfc-4456-bb8e-6501f5e94066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.430030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df2b05-edfc-4456-bb8e-6501f5e94066 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.453286 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 657/1284] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:06.453893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2b05-edfc-4456-bb8e-6501f5e94066 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.459075 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 628/1285] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:06.460984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a9b45-2293-4fb9-abc7-aba034071072 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.464494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2b05-edfc-4456-bb8e-6501f5e94066 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.469786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d248c81-9c12-4323-a6dd-29e9ff3b4921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.470389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d248c81-9c12-4323-a6dd-29e9ff3b4921 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.470692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d248c81-9c12-4323-a6dd-29e9ff3b4921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.470995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d248c81-9c12-4323-a6dd-29e9ff3b4921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.471631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d248c81-9c12-4323-a6dd-29e9ff3b4921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.472998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a9b45-2293-4fb9-abc7-aba034071072 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.474180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d248c81-9c12-4323-a6dd-29e9ff3b4921 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.477936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f9385-a646-487c-8094-559056c13b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.478570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f9385-a646-487c-8094-559056c13b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.478848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f9385-a646-487c-8094-559056c13b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.479149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f9385-a646-487c-8094-559056c13b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.479781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f9385-a646-487c-8094-559056c13b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.481706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f9385-a646-487c-8094-559056c13b64 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.502029 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 658/1286] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:06.502996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d248c81-9c12-4323-a6dd-29e9ff3b4921 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.510908 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 629/1287] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:06.512311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7852370-ee07-49b7-beae-54061b4d3cff None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.512666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7852370-ee07-49b7-beae-54061b4d3cff None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.513484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7852370-ee07-49b7-beae-54061b4d3cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.525331 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:06.542772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d7852370-ee07-49b7-beae-54061b4d3cff None None] MFA Rules not processed for user `5044e3245cbf4cbdaa5ac6cb174aeabe`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:06.544035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d7852370-ee07-49b7-beae-54061b4d3cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:06.576026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d248c81-9c12-4323-a6dd-29e9ff3b4921 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.611829 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 630/1288] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:06.613503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7852370-ee07-49b7-beae-54061b4d3cff None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.636399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a36f50-9b14-42dc-9ae6-7c56a672289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.637028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a36f50-9b14-42dc-9ae6-7c56a672289d admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.637301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a36f50-9b14-42dc-9ae6-7c56a672289d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.637569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a36f50-9b14-42dc-9ae6-7c56a672289d admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.638616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a36f50-9b14-42dc-9ae6-7c56a672289d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.641094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a36f50-9b14-42dc-9ae6-7c56a672289d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.669941 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 659/1289] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/projects => generated 399 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:06.671197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a36f50-9b14-42dc-9ae6-7c56a672289d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.681367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7852370-ee07-49b7-beae-54061b4d3cff None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.710154 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:06.735187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a36f50-9b14-42dc-9ae6-7c56a672289d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.739511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80626ca6-9a67-4ba1-8131-8bb15522c2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.740128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80626ca6-9a67-4ba1-8131-8bb15522c2cb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.740409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80626ca6-9a67-4ba1-8131-8bb15522c2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.740683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80626ca6-9a67-4ba1-8131-8bb15522c2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.740895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f2384-9ce9-4e2b-a99e-86a6caa1142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.741323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80626ca6-9a67-4ba1-8131-8bb15522c2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.741573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f2384-9ce9-4e2b-a99e-86a6caa1142f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.741874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f2384-9ce9-4e2b-a99e-86a6caa1142f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.742244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f2384-9ce9-4e2b-a99e-86a6caa1142f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.742899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f2384-9ce9-4e2b-a99e-86a6caa1142f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.743031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80626ca6-9a67-4ba1-8131-8bb15522c2cb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.745090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f2384-9ce9-4e2b-a99e-86a6caa1142f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.752788 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 631/1290] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:06.754209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80626ca6-9a67-4ba1-8131-8bb15522c2cb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.764197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80626ca6-9a67-4ba1-8131-8bb15522c2cb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.768815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf64c6-d598-4f6c-bf9f-d609c6850ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.769581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf64c6-d598-4f6c-bf9f-d609c6850ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.769886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf64c6-d598-4f6c-bf9f-d609c6850ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.770129 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 660/1291] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:06.770241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf64c6-d598-4f6c-bf9f-d609c6850ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.770739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf64c6-d598-4f6c-bf9f-d609c6850ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.771046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f2384-9ce9-4e2b-a99e-86a6caa1142f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.772372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf64c6-d598-4f6c-bf9f-d609c6850ab0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.787190 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 632/1292] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:06.787344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf64c6-d598-4f6c-bf9f-d609c6850ab0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.798432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf64c6-d598-4f6c-bf9f-d609c6850ab0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.805133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b27d7-4741-4398-a1f8-e77f161fe928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.805820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b27d7-4741-4398-a1f8-e77f161fe928 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.806416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b27d7-4741-4398-a1f8-e77f161fe928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.806416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b27d7-4741-4398-a1f8-e77f161fe928 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.807256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b27d7-4741-4398-a1f8-e77f161fe928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.809615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b27d7-4741-4398-a1f8-e77f161fe928 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.822952 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:06.835749 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 633/1293] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:06.835912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b27d7-4741-4398-a1f8-e77f161fe928 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.839254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f2384-9ce9-4e2b-a99e-86a6caa1142f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.843329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9311d48-435e-4518-af27-e1865ee3dce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.844100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9311d48-435e-4518-af27-e1865ee3dce7 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.844734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9311d48-435e-4518-af27-e1865ee3dce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.844734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9311d48-435e-4518-af27-e1865ee3dce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.849139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b27d7-4741-4398-a1f8-e77f161fe928 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.853856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fffab-39be-4e02-8f37-1c2d31419ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.854438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fffab-39be-4e02-8f37-1c2d31419ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.854723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fffab-39be-4e02-8f37-1c2d31419ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.855040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fffab-39be-4e02-8f37-1c2d31419ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.855662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fffab-39be-4e02-8f37-1c2d31419ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.857778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fffab-39be-4e02-8f37-1c2d31419ac6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.881949 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 634/1294] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/users => generated 303 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:06.881949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fffab-39be-4e02-8f37-1c2d31419ac6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.890182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fffab-39be-4e02-8f37-1c2d31419ac6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:06.895444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa70b5d-9568-4ab6-a616-086fcccf3723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:06.896107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa70b5d-9568-4ab6-a616-086fcccf3723 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:06.896394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa70b5d-9568-4ab6-a616-086fcccf3723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:06.896666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa70b5d-9568-4ab6-a616-086fcccf3723 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:06.898974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa70b5d-9568-4ab6-a616-086fcccf3723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.899337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa70b5d-9568-4ab6-a616-086fcccf3723 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.913721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9311d48-435e-4518-af27-e1865ee3dce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:06.915794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9311d48-435e-4518-af27-e1865ee3dce7 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:06.931466 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 661/1295] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:06.932395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9311d48-435e-4518-af27-e1865ee3dce7 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.941490 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 635/1296] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:06.943535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa70b5d-9568-4ab6-a616-086fcccf3723 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:06.944221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9311d48-435e-4518-af27-e1865ee3dce7 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.014726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa70b5d-9568-4ab6-a616-086fcccf3723 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.016287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ad689-d88a-4b97-bf58-fe8d65f7acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.017049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ad689-d88a-4b97-bf58-fe8d65f7acf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.017400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ad689-d88a-4b97-bf58-fe8d65f7acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.017751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ad689-d88a-4b97-bf58-fe8d65f7acf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.018688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ad689-d88a-4b97-bf58-fe8d65f7acf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.020454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fd389-fe01-4aca-9aaa-3a499a349e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.021316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fd389-fe01-4aca-9aaa-3a499a349e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.021662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fd389-fe01-4aca-9aaa-3a499a349e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.022002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fd389-fe01-4aca-9aaa-3a499a349e24 admin admin] PATH_INFO: `/v3/projects/937e361ce901423a958ae619d74c6369/users/74d6cb950d4e4bf0ae32a4be90617aaf/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.022664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ad689-d88a-4b97-bf58-fe8d65f7acf8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.037805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fd389-fe01-4aca-9aaa-3a499a349e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=937e361ce901423a958ae619d74c6369, user_id=74d6cb950d4e4bf0ae32a4be90617aaf, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.040917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fd389-fe01-4aca-9aaa-3a499a349e24 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.048351 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 662/1297] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:06 2022] POST /identity/v3/users => generated 306 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:07.049159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ad689-d88a-4b97-bf58-fe8d65f7acf8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.058624 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 636/1298] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:06 2022] PUT /identity/v3/projects/937e361ce901423a958ae619d74c6369/users/74d6cb950d4e4bf0ae32a4be90617aaf/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:07.059457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fd389-fe01-4aca-9aaa-3a499a349e24 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.063551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ad689-d88a-4b97-bf58-fe8d65f7acf8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.118027 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:07.133576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09697d95-ae09-45ee-83f9-0f1f33072fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.134183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09697d95-ae09-45ee-83f9-0f1f33072fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.134641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09697d95-ae09-45ee-83f9-0f1f33072fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.134941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09697d95-ae09-45ee-83f9-0f1f33072fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.135581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09697d95-ae09-45ee-83f9-0f1f33072fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.138405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09697d95-ae09-45ee-83f9-0f1f33072fe8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.140413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fd389-fe01-4aca-9aaa-3a499a349e24 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.146528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e311503-451f-4469-a151-04159eeb4712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.147038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e311503-451f-4469-a151-04159eeb4712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.147420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e311503-451f-4469-a151-04159eeb4712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.147795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e311503-451f-4469-a151-04159eeb4712 admin admin] PATH_INFO: `/v3/projects/249ca78aa43342399d247b104578ef3e/users/c57a7676eb79402a99986d82623a68f6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.148392 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 663/1299] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:07.149062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09697d95-ae09-45ee-83f9-0f1f33072fe8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.158747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09697d95-ae09-45ee-83f9-0f1f33072fe8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.166087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e311503-451f-4469-a151-04159eeb4712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249ca78aa43342399d247b104578ef3e, user_id=c57a7676eb79402a99986d82623a68f6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.166284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75eb9e-6b25-4ee1-a08a-d2f8d560119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.166826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75eb9e-6b25-4ee1-a08a-d2f8d560119b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.167287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75eb9e-6b25-4ee1-a08a-d2f8d560119b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.167539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75eb9e-6b25-4ee1-a08a-d2f8d560119b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.168166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75eb9e-6b25-4ee1-a08a-d2f8d560119b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.169573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e311503-451f-4469-a151-04159eeb4712 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.169752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75eb9e-6b25-4ee1-a08a-d2f8d560119b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.183590 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 664/1300] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:07.187185 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 637/1301] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:07 2022] PUT /identity/v3/projects/249ca78aa43342399d247b104578ef3e/users/c57a7676eb79402a99986d82623a68f6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:07.187288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75eb9e-6b25-4ee1-a08a-d2f8d560119b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.187392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e311503-451f-4469-a151-04159eeb4712 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.201970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75eb9e-6b25-4ee1-a08a-d2f8d560119b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.207299 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:07.264558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e311503-451f-4469-a151-04159eeb4712 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.269886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3e25-78ac-4dd4-afbf-f04679d50476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.270581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3e25-78ac-4dd4-afbf-f04679d50476 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.270811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18d97d-6d6e-4a57-8bc6-83489f3afdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.270982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3e25-78ac-4dd4-afbf-f04679d50476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.271184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3e25-78ac-4dd4-afbf-f04679d50476 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.271466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18d97d-6d6e-4a57-8bc6-83489f3afdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.271858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18d97d-6d6e-4a57-8bc6-83489f3afdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.271979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f3e25-78ac-4dd4-afbf-f04679d50476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.272201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18d97d-6d6e-4a57-8bc6-83489f3afdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.272921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18d97d-6d6e-4a57-8bc6-83489f3afdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.273944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f3e25-78ac-4dd4-afbf-f04679d50476 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.274573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18d97d-6d6e-4a57-8bc6-83489f3afdd4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.286385 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 665/1302] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:07.287408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18d97d-6d6e-4a57-8bc6-83489f3afdd4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.298556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18d97d-6d6e-4a57-8bc6-83489f3afdd4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.306091 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 638/1303] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:07 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:07.306091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3e25-78ac-4dd4-afbf-f04679d50476 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.308158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650b34e-e9bd-464a-ab02-e76031431adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.308804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b34e-e9bd-464a-ab02-e76031431adf admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.309193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b34e-e9bd-464a-ab02-e76031431adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.309357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b34e-e9bd-464a-ab02-e76031431adf admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.309995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650b34e-e9bd-464a-ab02-e76031431adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.311653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650b34e-e9bd-464a-ab02-e76031431adf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.314716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3e25-78ac-4dd4-afbf-f04679d50476 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.320250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabdf7e-1bc0-48df-aeb4-c975fb96f332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.320843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabdf7e-1bc0-48df-aeb4-c975fb96f332 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.321123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabdf7e-1bc0-48df-aeb4-c975fb96f332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.321393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabdf7e-1bc0-48df-aeb4-c975fb96f332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.322031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabdf7e-1bc0-48df-aeb4-c975fb96f332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.325379 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 666/1304] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:07.325379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650b34e-e9bd-464a-ab02-e76031431adf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.325627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabdf7e-1bc0-48df-aeb4-c975fb96f332 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.333587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650b34e-e9bd-464a-ab02-e76031431adf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.335233 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 639/1305] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:07.336219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabdf7e-1bc0-48df-aeb4-c975fb96f332 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.338613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f768965-60f1-4658-a71a-539c12e4348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.339361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768965-60f1-4658-a71a-539c12e4348f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.339718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768965-60f1-4658-a71a-539c12e4348f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.340064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768965-60f1-4658-a71a-539c12e4348f admin admin] PATH_INFO: `/v3/projects/86bd15008d164dfda35668238445dda2/users/471f9ea16d854815885388c788eaab19/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.346176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabdf7e-1bc0-48df-aeb4-c975fb96f332 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.351087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169ae18-899e-42d6-aae2-0e2e0e4f8a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.351731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169ae18-899e-42d6-aae2-0e2e0e4f8a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.352012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169ae18-899e-42d6-aae2-0e2e0e4f8a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.352289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169ae18-899e-42d6-aae2-0e2e0e4f8a5c admin admin] PATH_INFO: `/v3/projects/8e6e094bd00a4234ae42efa5261d7263/users/f7c1729b5bb94681bd0ec0bbf10152b6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.356882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f768965-60f1-4658-a71a-539c12e4348f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bd15008d164dfda35668238445dda2, user_id=471f9ea16d854815885388c788eaab19, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.359561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f768965-60f1-4658-a71a-539c12e4348f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.368411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169ae18-899e-42d6-aae2-0e2e0e4f8a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6e094bd00a4234ae42efa5261d7263, user_id=f7c1729b5bb94681bd0ec0bbf10152b6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.371216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169ae18-899e-42d6-aae2-0e2e0e4f8a5c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.373818 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 667/1306] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:07 2022] PUT /identity/v3/projects/86bd15008d164dfda35668238445dda2/users/471f9ea16d854815885388c788eaab19/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:07.374612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f768965-60f1-4658-a71a-539c12e4348f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.387838 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 640/1307] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:07 2022] PUT /identity/v3/projects/8e6e094bd00a4234ae42efa5261d7263/users/f7c1729b5bb94681bd0ec0bbf10152b6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:07.388625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169ae18-899e-42d6-aae2-0e2e0e4f8a5c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.436691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f768965-60f1-4658-a71a-539c12e4348f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.451398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169ae18-899e-42d6-aae2-0e2e0e4f8a5c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.455967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583498a-e5ba-4240-88b3-c52277585a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.457156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583498a-e5ba-4240-88b3-c52277585a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.457549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583498a-e5ba-4240-88b3-c52277585a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.457818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583498a-e5ba-4240-88b3-c52277585a09 admin admin] PATH_INFO: `/v3/projects/37a10f4a46bc4cf987efd5db9700673c/users/e87e7bd1a4114926af6d6520e4a67b88/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.473997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583498a-e5ba-4240-88b3-c52277585a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a10f4a46bc4cf987efd5db9700673c, user_id=e87e7bd1a4114926af6d6520e4a67b88, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.477114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583498a-e5ba-4240-88b3-c52277585a09 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.490602 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 641/1308] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:07 2022] PUT /identity/v3/projects/37a10f4a46bc4cf987efd5db9700673c/users/e87e7bd1a4114926af6d6520e4a67b88/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:07.491465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583498a-e5ba-4240-88b3-c52277585a09 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.496434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43fc64-e3a5-458e-b3a8-e5222e4031fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.497043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43fc64-e3a5-458e-b3a8-e5222e4031fb admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.497324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43fc64-e3a5-458e-b3a8-e5222e4031fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.497597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43fc64-e3a5-458e-b3a8-e5222e4031fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.497750 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:07.498229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43fc64-e3a5-458e-b3a8-e5222e4031fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.499874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43fc64-e3a5-458e-b3a8-e5222e4031fb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.512887 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 668/1309] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:07.512887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43fc64-e3a5-458e-b3a8-e5222e4031fb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.521026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43fc64-e3a5-458e-b3a8-e5222e4031fb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.531981 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:07.561759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583498a-e5ba-4240-88b3-c52277585a09 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.567144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.567873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.568158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.568429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] PATH_INFO: `/v3/users/83b1d20aa5bb4ef7b3655c9cc7e43f7d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.569578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b1d20aa5bb4ef7b3655c9cc7e43f7d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.570842 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:00:07.570842 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:00:07.570842 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:00:07.571823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.587101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f41275-71b1-4139-ac39-9aedfe219018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.587833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f41275-71b1-4139-ac39-9aedfe219018 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.588212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f41275-71b1-4139-ac39-9aedfe219018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.588521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f41275-71b1-4139-ac39-9aedfe219018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.589156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f41275-71b1-4139-ac39-9aedfe219018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.590736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f41275-71b1-4139-ac39-9aedfe219018 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.601088 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 669/1310] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:07.601941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f41275-71b1-4139-ac39-9aedfe219018 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.614479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f41275-71b1-4139-ac39-9aedfe219018 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.619159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b7c05-2503-4875-bb90-0df3c02482e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.619869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b7c05-2503-4875-bb90-0df3c02482e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.620152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b7c05-2503-4875-bb90-0df3c02482e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.620426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b7c05-2503-4875-bb90-0df3c02482e8 admin admin] PATH_INFO: `/v3/projects/6457daceb34f434f8fb5e4e54953cf9b/users/62f80d17179149ac98c6137089aaa9f4/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.635383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b7c05-2503-4875-bb90-0df3c02482e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6457daceb34f434f8fb5e4e54953cf9b, user_id=62f80d17179149ac98c6137089aaa9f4, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.635672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b1d20aa5bb4ef7b3655c9cc7e43f7d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:07.636321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b1d20aa5bb4ef7b3655c9cc7e43f7d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:07.638235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b7c05-2503-4875-bb90-0df3c02482e8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.653258 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 670/1311] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:07 2022] PUT /identity/v3/projects/6457daceb34f434f8fb5e4e54953cf9b/users/62f80d17179149ac98c6137089aaa9f4/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:07.654092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b7c05-2503-4875-bb90-0df3c02482e8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.655665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2a2b7c05-2503-4875-bb90-0df3c02482e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:07.658860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b1d20aa5bb4ef7b3655c9cc7e43f7d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:07.668835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b1d20aa5bb4ef7b3655c9cc7e43f7d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:07.669842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b1d20aa5bb4ef7b3655c9cc7e43f7d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:07.686117 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 642/1312] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:07 2022] DELETE /identity/v3/users/83b1d20aa5bb4ef7b3655c9cc7e43f7d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:07.689320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.689320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:07.722981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b7c05-2503-4875-bb90-0df3c02482e8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.753155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9dedb-7930-4160-be0c-f48cadf87353 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.758573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df617d7-b8bb-43ce-b17c-78a50279d926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.759294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df617d7-b8bb-43ce-b17c-78a50279d926 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.759832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df617d7-b8bb-43ce-b17c-78a50279d926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.760011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df617d7-b8bb-43ce-b17c-78a50279d926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.760713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df617d7-b8bb-43ce-b17c-78a50279d926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.762337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df617d7-b8bb-43ce-b17c-78a50279d926 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.774260 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 643/1313] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:07.775255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df617d7-b8bb-43ce-b17c-78a50279d926 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.776902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9df617d7-b8bb-43ce-b17c-78a50279d926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:07.779803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649377ef-a434-492a-bbbd-f4e9dd928e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.780456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649377ef-a434-492a-bbbd-f4e9dd928e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.780742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649377ef-a434-492a-bbbd-f4e9dd928e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.781189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649377ef-a434-492a-bbbd-f4e9dd928e3d admin admin] PATH_INFO: `/v3/projects/937e361ce901423a958ae619d74c6369/users/74d6cb950d4e4bf0ae32a4be90617aaf/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.783221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649377ef-a434-492a-bbbd-f4e9dd928e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=937e361ce901423a958ae619d74c6369, user_id=74d6cb950d4e4bf0ae32a4be90617aaf, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.786156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649377ef-a434-492a-bbbd-f4e9dd928e3d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.789609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df617d7-b8bb-43ce-b17c-78a50279d926 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.794564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412a749-77bb-49b5-8578-ff470274ba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.795180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412a749-77bb-49b5-8578-ff470274ba0d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.795456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412a749-77bb-49b5-8578-ff470274ba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.795724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412a749-77bb-49b5-8578-ff470274ba0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.796852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412a749-77bb-49b5-8578-ff470274ba0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.798288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412a749-77bb-49b5-8578-ff470274ba0d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.803093 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 671/1314] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:07 2022] PUT /identity/v3/projects/937e361ce901423a958ae619d74c6369/users/74d6cb950d4e4bf0ae32a4be90617aaf/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:07.804118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649377ef-a434-492a-bbbd-f4e9dd928e3d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.806093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-649377ef-a434-492a-bbbd-f4e9dd928e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:07.809556 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 644/1315] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:07.810333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412a749-77bb-49b5-8578-ff470274ba0d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.812739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4412a749-77bb-49b5-8578-ff470274ba0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:07.825505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412a749-77bb-49b5-8578-ff470274ba0d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.829397 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:07.838482 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:07.875274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649377ef-a434-492a-bbbd-f4e9dd928e3d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.880615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e82b26-7b0d-44f3-a602-fac8039dec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.881221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e82b26-7b0d-44f3-a602-fac8039dec97 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.881507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e82b26-7b0d-44f3-a602-fac8039dec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.881775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e82b26-7b0d-44f3-a602-fac8039dec97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.882406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e82b26-7b0d-44f3-a602-fac8039dec97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.884114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e82b26-7b0d-44f3-a602-fac8039dec97 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.886753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558492f-6330-42cb-b097-e08b4c841093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.887453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558492f-6330-42cb-b097-e08b4c841093 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.887726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558492f-6330-42cb-b097-e08b4c841093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.887991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558492f-6330-42cb-b097-e08b4c841093 admin admin] PATH_INFO: `/v3/projects/249ca78aa43342399d247b104578ef3e/users/c57a7676eb79402a99986d82623a68f6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.890141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558492f-6330-42cb-b097-e08b4c841093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249ca78aa43342399d247b104578ef3e, user_id=c57a7676eb79402a99986d82623a68f6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.892776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558492f-6330-42cb-b097-e08b4c841093 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.894657 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 672/1316] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:07.895556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e82b26-7b0d-44f3-a602-fac8039dec97 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.897701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-51e82b26-7b0d-44f3-a602-fac8039dec97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:07.904511 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 645/1317] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:07 2022] PUT /identity/v3/projects/249ca78aa43342399d247b104578ef3e/users/c57a7676eb79402a99986d82623a68f6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:07.905606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558492f-6330-42cb-b097-e08b4c841093 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:07.907205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a558492f-6330-42cb-b097-e08b4c841093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:07.910879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e82b26-7b0d-44f3-a602-fac8039dec97 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.967513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a9016-48dc-451b-980c-22bb5b9fecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.968211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a9016-48dc-451b-980c-22bb5b9fecd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.968544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a9016-48dc-451b-980c-22bb5b9fecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.968822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a9016-48dc-451b-980c-22bb5b9fecd9 admin admin] PATH_INFO: `/v3/projects/e5a47c70f35a4133bf67777c116e4b31/users/04896641b85b423e9315ae9e7c0a84ca/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.973986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558492f-6330-42cb-b097-e08b4c841093 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:07.978604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39c969-9a2a-46f4-9da8-cf8b57358244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:07.979238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39c969-9a2a-46f4-9da8-cf8b57358244 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.979515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39c969-9a2a-46f4-9da8-cf8b57358244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.979785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39c969-9a2a-46f4-9da8-cf8b57358244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.980414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39c969-9a2a-46f4-9da8-cf8b57358244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.982015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39c969-9a2a-46f4-9da8-cf8b57358244 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.983533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a9016-48dc-451b-980c-22bb5b9fecd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a47c70f35a4133bf67777c116e4b31, user_id=04896641b85b423e9315ae9e7c0a84ca, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:07.986234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a9016-48dc-451b-980c-22bb5b9fecd9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:07.991901 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 646/1318] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:07.993195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca4b88-a95e-48a7-be22-5065021ccec7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:07.993486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca4b88-a95e-48a7-be22-5065021ccec7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:07.993757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca4b88-a95e-48a7-be22-5065021ccec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:07.999924 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 673/1319] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:07 2022] PUT /identity/v3/projects/e5a47c70f35a4133bf67777c116e4b31/users/04896641b85b423e9315ae9e7c0a84ca/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:08.000873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a9016-48dc-451b-980c-22bb5b9fecd9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:08.013444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-abca4b88-a95e-48a7-be22-5065021ccec7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:08.014661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-abca4b88-a95e-48a7-be22-5065021ccec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:08.063595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a9016-48dc-451b-980c-22bb5b9fecd9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:08.068950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586be4d9-5495-4265-9913-d41a3e68d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:08.069633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586be4d9-5495-4265-9913-d41a3e68d1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.069919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586be4d9-5495-4265-9913-d41a3e68d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.070207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586be4d9-5495-4265-9913-d41a3e68d1d6 admin admin] PATH_INFO: `/v3/projects/86bd15008d164dfda35668238445dda2/users/471f9ea16d854815885388c788eaab19/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.072374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586be4d9-5495-4265-9913-d41a3e68d1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bd15008d164dfda35668238445dda2, user_id=471f9ea16d854815885388c788eaab19, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:08.074427 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 647/1320] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:08.075088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586be4d9-5495-4265-9913-d41a3e68d1d6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:08.075833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1619037-ff2f-464a-95db-55f27c1a076c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.076121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1619037-ff2f-464a-95db-55f27c1a076c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.076395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1619037-ff2f-464a-95db-55f27c1a076c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.087053 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 674/1321] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:07 2022] PUT /identity/v3/projects/86bd15008d164dfda35668238445dda2/users/471f9ea16d854815885388c788eaab19/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:08.087857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586be4d9-5495-4265-9913-d41a3e68d1d6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:08.105085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c1619037-ff2f-464a-95db-55f27c1a076c None None] MFA Rules not processed for user `74d6cb950d4e4bf0ae32a4be90617aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:08.106300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c1619037-ff2f-464a-95db-55f27c1a076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:08.131691 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.137159 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.158057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586be4d9-5495-4265-9913-d41a3e68d1d6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:08.163652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c6141-403e-4b7b-a404-27362fa0ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:08.164314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c6141-403e-4b7b-a404-27362fa0ecdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.164590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c6141-403e-4b7b-a404-27362fa0ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.164864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c6141-403e-4b7b-a404-27362fa0ecdb admin admin] PATH_INFO: `/v3/projects/8e6e094bd00a4234ae42efa5261d7263/users/f7c1729b5bb94681bd0ec0bbf10152b6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.167017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c6141-403e-4b7b-a404-27362fa0ecdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6e094bd00a4234ae42efa5261d7263, user_id=f7c1729b5bb94681bd0ec0bbf10152b6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:08.169620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c6141-403e-4b7b-a404-27362fa0ecdb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:08.179699 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 648/1322] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:08.180530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1619037-ff2f-464a-95db-55f27c1a076c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:08.180974 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 675/1323] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:08 2022] PUT /identity/v3/projects/8e6e094bd00a4234ae42efa5261d7263/users/f7c1729b5bb94681bd0ec0bbf10152b6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:08.182176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed372-0b58-4d7f-b618-e2ab3db1d316 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.182462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed372-0b58-4d7f-b618-e2ab3db1d316 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.182754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed372-0b58-4d7f-b618-e2ab3db1d316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.196608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1619037-ff2f-464a-95db-55f27c1a076c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:08.227806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-de4ed372-0b58-4d7f-b618-e2ab3db1d316 None None] MFA Rules not processed for user `c57a7676eb79402a99986d82623a68f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:08.229689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-de4ed372-0b58-4d7f-b618-e2ab3db1d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:08.255366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05903ae-be4f-4d24-a9c5-4e31541d49b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:08.256030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05903ae-be4f-4d24-a9c5-4e31541d49b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.256317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05903ae-be4f-4d24-a9c5-4e31541d49b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.256603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05903ae-be4f-4d24-a9c5-4e31541d49b4 admin admin] PATH_INFO: `/v3/projects/37a10f4a46bc4cf987efd5db9700673c/users/e87e7bd1a4114926af6d6520e4a67b88/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.258460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05903ae-be4f-4d24-a9c5-4e31541d49b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a10f4a46bc4cf987efd5db9700673c, user_id=e87e7bd1a4114926af6d6520e4a67b88, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:08.261128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05903ae-be4f-4d24-a9c5-4e31541d49b4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:08.273447 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 649/1324] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:08 2022] PUT /identity/v3/projects/37a10f4a46bc4cf987efd5db9700673c/users/e87e7bd1a4114926af6d6520e4a67b88/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:08.274258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05903ae-be4f-4d24-a9c5-4e31541d49b4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:08.301257 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 676/1325] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:08.302092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ed372-0b58-4d7f-b618-e2ab3db1d316 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:08.311700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ed372-0b58-4d7f-b618-e2ab3db1d316 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:08.349516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05903ae-be4f-4d24-a9c5-4e31541d49b4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:08.354696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5002e-6660-4c64-9839-1c15ad9e6465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:08.355394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5002e-6660-4c64-9839-1c15ad9e6465 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.355694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5002e-6660-4c64-9839-1c15ad9e6465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.355953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5002e-6660-4c64-9839-1c15ad9e6465 admin admin] PATH_INFO: `/v3/projects/6457daceb34f434f8fb5e4e54953cf9b/users/62f80d17179149ac98c6137089aaa9f4/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.357869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5002e-6660-4c64-9839-1c15ad9e6465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6457daceb34f434f8fb5e4e54953cf9b, user_id=62f80d17179149ac98c6137089aaa9f4, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:08.360637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5002e-6660-4c64-9839-1c15ad9e6465 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:08.371484 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 650/1326] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:08 2022] PUT /identity/v3/projects/6457daceb34f434f8fb5e4e54953cf9b/users/62f80d17179149ac98c6137089aaa9f4/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:08.372288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5002e-6660-4c64-9839-1c15ad9e6465 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:08.373875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-79c5002e-6660-4c64-9839-1c15ad9e6465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:08.377114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178344e-c9d2-4ff5-a0ff-c102829bef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:08.377722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178344e-c9d2-4ff5-a0ff-c102829bef9b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.378005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178344e-c9d2-4ff5-a0ff-c102829bef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.378314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178344e-c9d2-4ff5-a0ff-c102829bef9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.379074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178344e-c9d2-4ff5-a0ff-c102829bef9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:08.380691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178344e-c9d2-4ff5-a0ff-c102829bef9b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:08.393821 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 677/1327] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:08.393821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7b24-3346-4726-b975-bcc153f184f7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.393821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7b24-3346-4726-b975-bcc153f184f7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.393821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7b24-3346-4726-b975-bcc153f184f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.421786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7aad7b24-3346-4726-b975-bcc153f184f7 None None] MFA Rules not processed for user `471f9ea16d854815885388c788eaab19`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:08.423031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7aad7b24-3346-4726-b975-bcc153f184f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:08.433977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5002e-6660-4c64-9839-1c15ad9e6465 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:08.438201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59661f64-d116-42d2-828e-f2daa5691b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:08.438799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59661f64-d116-42d2-828e-f2daa5691b3e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.439110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59661f64-d116-42d2-828e-f2daa5691b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.440214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59661f64-d116-42d2-828e-f2daa5691b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.446004 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.473528 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.500666 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 678/1328] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:08.502125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a4b8f-01fb-4f10-b9bc-89e3cadee580 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.502474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a4b8f-01fb-4f10-b9bc-89e3cadee580 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.502872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a4b8f-01fb-4f10-b9bc-89e3cadee580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.507334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59661f64-d116-42d2-828e-f2daa5691b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:08.508892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59661f64-d116-42d2-828e-f2daa5691b3e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:08.519623 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 651/1329] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:08.520980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0e237-5f57-42ae-878a-2ddb8081bbe7 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.521350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0e237-5f57-42ae-878a-2ddb8081bbe7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.521541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0e237-5f57-42ae-878a-2ddb8081bbe7 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.522959 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 652/1330] 10.222.0.39 () {54 vars in 961 bytes} [Sun Oct 16 01:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:08.528396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d7ff1-f75a-4f20-9c81-5f2d46f9de5e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.528687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d7ff1-f75a-4f20-9c81-5f2d46f9de5e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.528992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d7ff1-f75a-4f20-9c81-5f2d46f9de5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.539496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e35a4b8f-01fb-4f10-b9bc-89e3cadee580 None None] MFA Rules not processed for user `f7c1729b5bb94681bd0ec0bbf10152b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:08.541058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e35a4b8f-01fb-4f10-b9bc-89e3cadee580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:08.573087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7b8d7ff1-f75a-4f20-9c81-5f2d46f9de5e None None] MFA Rules not processed for user `e87e7bd1a4114926af6d6520e4a67b88`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:08.574382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b8d7ff1-f75a-4f20-9c81-5f2d46f9de5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:08.635685 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 679/1331] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:08.636915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7b74b-c6da-43f7-ab77-b9b9ed9c915b None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.637195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7b74b-c6da-43f7-ab77-b9b9ed9c915b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.637459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7b74b-c6da-43f7-ab77-b9b9ed9c915b None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.638849 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 680/1332] 10.222.0.39 () {54 vars in 961 bytes} [Sun Oct 16 01:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:08.640151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ea406-d446-4f81-bc32-63c8f52ca3fe None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.640628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ea406-d446-4f81-bc32-63c8f52ca3fe None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.640872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ea406-d446-4f81-bc32-63c8f52ca3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.669792 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 653/1333] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:08.671056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d7ff1-f75a-4f20-9c81-5f2d46f9de5e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:08.678225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a19ea406-d446-4f81-bc32-63c8f52ca3fe None None] MFA Rules not processed for user `62f80d17179149ac98c6137089aaa9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:08.679852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a19ea406-d446-4f81-bc32-63c8f52ca3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:08.685749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d7ff1-f75a-4f20-9c81-5f2d46f9de5e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:08.690496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbe16f-06f6-4000-b2a0-76cada2a9dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:08.691481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbe16f-06f6-4000-b2a0-76cada2a9dac admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.691892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbe16f-06f6-4000-b2a0-76cada2a9dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.692240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbe16f-06f6-4000-b2a0-76cada2a9dac admin admin] PATH_INFO: `/v3/projects/e5a47c70f35a4133bf67777c116e4b31/users/04896641b85b423e9315ae9e7c0a84ca/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.694457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbe16f-06f6-4000-b2a0-76cada2a9dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a47c70f35a4133bf67777c116e4b31, user_id=04896641b85b423e9315ae9e7c0a84ca, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:08.697182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbe16f-06f6-4000-b2a0-76cada2a9dac admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:08.712359 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 654/1334] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:08 2022] PUT /identity/v3/projects/e5a47c70f35a4133bf67777c116e4b31/users/04896641b85b423e9315ae9e7c0a84ca/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:08.723116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28eddc-7284-42b9-9be8-36d02f81ff20 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.723362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28eddc-7284-42b9-9be8-36d02f81ff20 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.723625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28eddc-7284-42b9-9be8-36d02f81ff20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.764433 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 681/1335] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:08.765892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32d4ae-7171-451f-ad22-3832fa7968fd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.766303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32d4ae-7171-451f-ad22-3832fa7968fd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.766677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32d4ae-7171-451f-ad22-3832fa7968fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.812235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fb32d4ae-7171-451f-ad22-3832fa7968fd None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:08.813456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fb32d4ae-7171-451f-ad22-3832fa7968fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:08.854031 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.883983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ba28eddc-7284-42b9-9be8-36d02f81ff20 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:08.885559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba28eddc-7284-42b9-9be8-36d02f81ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:08.900094 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 682/1336] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Oct 16 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:08.901107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32d4ae-7171-451f-ad22-3832fa7968fd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:08.955376 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.970062 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 655/1337] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Oct 16 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:08.971509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdd1c4-27bd-48f4-8d83-bafd94ff729c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.971795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdd1c4-27bd-48f4-8d83-bafd94ff729c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.972334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdd1c4-27bd-48f4-8d83-bafd94ff729c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.977198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32d4ae-7171-451f-ad22-3832fa7968fd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:08.982271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e635e-95c8-4350-b220-8f134224a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:08.982882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e635e-95c8-4350-b220-8f134224a05b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:08.983196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e635e-95c8-4350-b220-8f134224a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:08.983491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e635e-95c8-4350-b220-8f134224a05b admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:08.984122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e635e-95c8-4350-b220-8f134224a05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:08.986096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e635e-95c8-4350-b220-8f134224a05b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.001462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5acdd1c4-27bd-48f4-8d83-bafd94ff729c None None] MFA Rules not processed for user `04896641b85b423e9315ae9e7c0a84ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:09.002811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5acdd1c4-27bd-48f4-8d83-bafd94ff729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:09.021576 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 683/1338] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:08 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:09.021576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e635e-95c8-4350-b220-8f134224a05b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.021576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-254e635e-95c8-4350-b220-8f134224a05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:09.090759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e635e-95c8-4350-b220-8f134224a05b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.093150 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 656/1339] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:09.094011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdd1c4-27bd-48f4-8d83-bafd94ff729c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.100997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.101651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.101931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.102772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] PATH_INFO: `/v3/projects/74772adf0afa4a77a1ad7ab6b551dd5a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.104015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] RBAC: Authorizing `identity:delete_project(project_id=74772adf0afa4a77a1ad7ab6b551dd5a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.105110 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:00:09.105110 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:00:09.105110 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:00:09.106278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.107430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdd1c4-27bd-48f4-8d83-bafd94ff729c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.164829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74772adf0afa4a77a1ad7ab6b551dd5a', 'request_id': 'req-329d571f-948a-4574-9d3a-be9ccb1eb39b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:09.180013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74772adf0afa4a77a1ad7ab6b551dd5a', 'request_id': 'req-329d571f-948a-4574-9d3a-be9ccb1eb39b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:09.183427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c03476-3511-4dcb-9cb5-8120cffffe3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.183968 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:09.184663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c03476-3511-4dcb-9cb5-8120cffffe3d service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.185256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c03476-3511-4dcb-9cb5-8120cffffe3d service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.185651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c03476-3511-4dcb-9cb5-8120cffffe3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.190015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74772adf0afa4a77a1ad7ab6b551dd5a', 'request_id': 'req-329d571f-948a-4574-9d3a-be9ccb1eb39b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:09.211398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] The token cache is being invalidate because project 74772adf0afa4a77a1ad7ab6b551dd5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:09.211683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:09.212343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:09.213848 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 684/1340] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:09 2022] DELETE /identity/v3/projects/74772adf0afa4a77a1ad7ab6b551dd5a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:09.214603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.215909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:09.259814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c03476-3511-4dcb-9cb5-8120cffffe3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.261436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c03476-3511-4dcb-9cb5-8120cffffe3d service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.271149 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 657/1341] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:09.272251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c03476-3511-4dcb-9cb5-8120cffffe3d service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.282357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c03476-3511-4dcb-9cb5-8120cffffe3d service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.292965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d571f-948a-4574-9d3a-be9ccb1eb39b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.294824 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:09.299541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21955d6b-b719-479a-957e-2bf05dde89a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.301196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21955d6b-b719-479a-957e-2bf05dde89a3 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.301636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21955d6b-b719-479a-957e-2bf05dde89a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.302092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21955d6b-b719-479a-957e-2bf05dde89a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.303844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-21955d6b-b719-479a-957e-2bf05dde89a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:09.344124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e084e-7737-424e-9d4c-d61deba2b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.344847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e084e-7737-424e-9d4c-d61deba2b6da admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.345132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e084e-7737-424e-9d4c-d61deba2b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.345400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e084e-7737-424e-9d4c-d61deba2b6da admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.346017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e084e-7737-424e-9d4c-d61deba2b6da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.348987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e084e-7737-424e-9d4c-d61deba2b6da admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.371535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21955d6b-b719-479a-957e-2bf05dde89a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.375695 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 658/1342] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:09 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:09.375843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21955d6b-b719-479a-957e-2bf05dde89a3 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.375945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6ac1-ae19-4719-a065-3ec1bab62a9b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.375945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6ac1-ae19-4719-a065-3ec1bab62a9b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.375945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6ac1-ae19-4719-a065-3ec1bab62a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.385820 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 685/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:09.386498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21955d6b-b719-479a-957e-2bf05dde89a3 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.387879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-21955d6b-b719-479a-957e-2bf05dde89a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:09.396810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c9ef6ac1-ae19-4719-a065-3ec1bab62a9b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:09.397987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c9ef6ac1-ae19-4719-a065-3ec1bab62a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:09.402342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21955d6b-b719-479a-957e-2bf05dde89a3 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.407465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2336f0-8ed4-477b-8f64-b5d55421279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.408287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2336f0-8ed4-477b-8f64-b5d55421279e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.408758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2336f0-8ed4-477b-8f64-b5d55421279e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.409207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2336f0-8ed4-477b-8f64-b5d55421279e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.410759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2336f0-8ed4-477b-8f64-b5d55421279e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.412576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2336f0-8ed4-477b-8f64-b5d55421279e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.413190 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 659/1344] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:09.414482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44000a-56ce-4fbf-a017-055cd8b03c19 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.414778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44000a-56ce-4fbf-a017-055cd8b03c19 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.415079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44000a-56ce-4fbf-a017-055cd8b03c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.431156 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 686/1345] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:09.432428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2336f0-8ed4-477b-8f64-b5d55421279e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.440130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5d44000a-56ce-4fbf-a017-055cd8b03c19 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:09.442002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5d44000a-56ce-4fbf-a017-055cd8b03c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:09.448274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2336f0-8ed4-477b-8f64-b5d55421279e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.453627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223281e-dc1e-4c8c-a16a-dc9a8e0bd9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.454158 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 660/1346] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:09.454679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223281e-dc1e-4c8c-a16a-dc9a8e0bd9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.455026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44000a-56ce-4fbf-a017-055cd8b03c19 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.455397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223281e-dc1e-4c8c-a16a-dc9a8e0bd9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.455864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223281e-dc1e-4c8c-a16a-dc9a8e0bd9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.457560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223281e-dc1e-4c8c-a16a-dc9a8e0bd9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.459849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223281e-dc1e-4c8c-a16a-dc9a8e0bd9c8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.464302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44000a-56ce-4fbf-a017-055cd8b03c19 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.469413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd8af1-8478-4b6f-aa23-e576e5175f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.470074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd8af1-8478-4b6f-aa23-e576e5175f9c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.470277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd8af1-8478-4b6f-aa23-e576e5175f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.470550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd8af1-8478-4b6f-aa23-e576e5175f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.471268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd8af1-8478-4b6f-aa23-e576e5175f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:09.471570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd8af1-8478-4b6f-aa23-e576e5175f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.474064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd8af1-8478-4b6f-aa23-e576e5175f9c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.479746 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 687/1347] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:09.480947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223281e-dc1e-4c8c-a16a-dc9a8e0bd9c8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.487636 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 661/1348] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:09.493265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd8af1-8478-4b6f-aa23-e576e5175f9c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.498856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223281e-dc1e-4c8c-a16a-dc9a8e0bd9c8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.504686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe7467-ceee-47d8-8278-cc52e819e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.505340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7467-ceee-47d8-8278-cc52e819e79e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.505616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7467-ceee-47d8-8278-cc52e819e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.505898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7467-ceee-47d8-8278-cc52e819e79e admin admin] PATH_INFO: `/v3/projects/445b59e2270d43dcb4cdab573023a1ae/users/f9ad267ec0d6487486dd78d22c098318/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.507431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd8af1-8478-4b6f-aa23-e576e5175f9c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.513611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e94df2-ad20-4724-bd03-3e0c81dfbf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.514518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e94df2-ad20-4724-bd03-3e0c81dfbf25 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.515029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e94df2-ad20-4724-bd03-3e0c81dfbf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.515481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e94df2-ad20-4724-bd03-3e0c81dfbf25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.516356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e94df2-ad20-4724-bd03-3e0c81dfbf25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.518658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e94df2-ad20-4724-bd03-3e0c81dfbf25 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.542678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe7467-ceee-47d8-8278-cc52e819e79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=445b59e2270d43dcb4cdab573023a1ae, user_id=f9ad267ec0d6487486dd78d22c098318, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.542678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe7467-ceee-47d8-8278-cc52e819e79e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.565529 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 662/1349] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:09 2022] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:00:09.565529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e94df2-ad20-4724-bd03-3e0c81dfbf25 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.567989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e2e94df2-ad20-4724-bd03-3e0c81dfbf25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:09.568715 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 688/1350] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:09 2022] PUT /identity/v3/projects/445b59e2270d43dcb4cdab573023a1ae/users/f9ad267ec0d6487486dd78d22c098318/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:09.569465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe7467-ceee-47d8-8278-cc52e819e79e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.612050 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:09.650221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe7467-ceee-47d8-8278-cc52e819e79e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.664858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e94df2-ad20-4724-bd03-3e0c81dfbf25 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.672003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423ce84-9a89-45d3-9c9f-d716840e1a48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.672785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423ce84-9a89-45d3-9c9f-d716840e1a48 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.673111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423ce84-9a89-45d3-9c9f-d716840e1a48 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.673472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423ce84-9a89-45d3-9c9f-d716840e1a48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.676924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2423ce84-9a89-45d3-9c9f-d716840e1a48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:09.720432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b09b6-b8f7-478e-b209-d9b63f83bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.721070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b09b6-b8f7-478e-b209-d9b63f83bff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.721373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b09b6-b8f7-478e-b209-d9b63f83bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.721628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b09b6-b8f7-478e-b209-d9b63f83bff3 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.723355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b09b6-b8f7-478e-b209-d9b63f83bff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.725630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b09b6-b8f7-478e-b209-d9b63f83bff3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.735895 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:09.748270 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 689/1351] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:09 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:09.748628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423ce84-9a89-45d3-9c9f-d716840e1a48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.749688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118f8e9-12b6-4b20-97f9-fd82a3d4606b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.749967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118f8e9-12b6-4b20-97f9-fd82a3d4606b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.750234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118f8e9-12b6-4b20-97f9-fd82a3d4606b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.750479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423ce84-9a89-45d3-9c9f-d716840e1a48 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.760868 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 663/1352] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:09.762431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423ce84-9a89-45d3-9c9f-d716840e1a48 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.773410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423ce84-9a89-45d3-9c9f-d716840e1a48 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.779539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f312189-432a-4f2d-a98d-df7f1b50421f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.780230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f312189-432a-4f2d-a98d-df7f1b50421f service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.780438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8118f8e9-12b6-4b20-97f9-fd82a3d4606b None None] MFA Rules not processed for user `f9ad267ec0d6487486dd78d22c098318`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:09.780641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f312189-432a-4f2d-a98d-df7f1b50421f service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.780962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f312189-432a-4f2d-a98d-df7f1b50421f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.781641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8118f8e9-12b6-4b20-97f9-fd82a3d4606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:09.782946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5f312189-432a-4f2d-a98d-df7f1b50421f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:09.854138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f312189-432a-4f2d-a98d-df7f1b50421f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.855811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f312189-432a-4f2d-a98d-df7f1b50421f service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.857872 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 690/1353] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:09.858787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118f8e9-12b6-4b20-97f9-fd82a3d4606b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.866107 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 664/1354] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:09.868031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f312189-432a-4f2d-a98d-df7f1b50421f service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.870121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118f8e9-12b6-4b20-97f9-fd82a3d4606b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.874705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ef370-91dc-4e93-9290-1f6d1041738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.875339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef370-91dc-4e93-9290-1f6d1041738d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.875617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef370-91dc-4e93-9290-1f6d1041738d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.875889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef370-91dc-4e93-9290-1f6d1041738d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.876525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ef370-91dc-4e93-9290-1f6d1041738d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.878118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ef370-91dc-4e93-9290-1f6d1041738d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.881494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f312189-432a-4f2d-a98d-df7f1b50421f service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.887884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3f904-bae2-46b4-b465-fa4fa8a20053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.888644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3f904-bae2-46b4-b465-fa4fa8a20053 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.889158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3f904-bae2-46b4-b465-fa4fa8a20053 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.889402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3f904-bae2-46b4-b465-fa4fa8a20053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.891137 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 691/1355] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:09.891645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5ac3f904-bae2-46b4-b465-fa4fa8a20053 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:09.892980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ef370-91dc-4e93-9290-1f6d1041738d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.903677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ef370-91dc-4e93-9290-1f6d1041738d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.908639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8eb5b4-2af2-4bf6-921e-0f50a5bc187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.909350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eb5b4-2af2-4bf6-921e-0f50a5bc187d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.909514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eb5b4-2af2-4bf6-921e-0f50a5bc187d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.911035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eb5b4-2af2-4bf6-921e-0f50a5bc187d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.911678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8eb5b4-2af2-4bf6-921e-0f50a5bc187d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.951656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8eb5b4-2af2-4bf6-921e-0f50a5bc187d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.951656 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 692/1356] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:00:09.951656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8eb5b4-2af2-4bf6-921e-0f50a5bc187d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:09.968365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8eb5b4-2af2-4bf6-921e-0f50a5bc187d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:09.976510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b937f2e-30a8-4fc9-9a8a-3adce87e1915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:09.977111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b937f2e-30a8-4fc9-9a8a-3adce87e1915 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:09.977384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b937f2e-30a8-4fc9-9a8a-3adce87e1915 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:09.977651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b937f2e-30a8-4fc9-9a8a-3adce87e1915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:09.979426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5b937f2e-30a8-4fc9-9a8a-3adce87e1915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:09.983532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3f904-bae2-46b4-b465-fa4fa8a20053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:09.985152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3f904-bae2-46b4-b465-fa4fa8a20053 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:09.994984 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 665/1357] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:09.996022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3f904-bae2-46b4-b465-fa4fa8a20053 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:10.008665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3f904-bae2-46b4-b465-fa4fa8a20053 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:10.013663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d5db7-95e4-4844-890a-c2cc8b8a5aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:10.014503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d5db7-95e4-4844-890a-c2cc8b8a5aab admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.014797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d5db7-95e4-4844-890a-c2cc8b8a5aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.015245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d5db7-95e4-4844-890a-c2cc8b8a5aab admin admin] PATH_INFO: `/v3/projects/4b577048201d4ccf9f7a2b5ffd305a0e/users/5457b0edf69b4fbab251f3195569576c/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.016649 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:10.032627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d5db7-95e4-4844-890a-c2cc8b8a5aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b577048201d4ccf9f7a2b5ffd305a0e, user_id=5457b0edf69b4fbab251f3195569576c, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:10.035983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d5db7-95e4-4844-890a-c2cc8b8a5aab admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:10.062686 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 666/1358] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:09 2022] PUT /identity/v3/projects/4b577048201d4ccf9f7a2b5ffd305a0e/users/5457b0edf69b4fbab251f3195569576c/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:10.062887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b937f2e-30a8-4fc9-9a8a-3adce87e1915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:10.062887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b937f2e-30a8-4fc9-9a8a-3adce87e1915 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:10.065690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb746bfa-d8e2-4ee2-8884-85aea6656047 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.066520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb746bfa-d8e2-4ee2-8884-85aea6656047 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.067018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb746bfa-d8e2-4ee2-8884-85aea6656047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.079172 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 693/1359] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:10.085307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b937f2e-30a8-4fc9-9a8a-3adce87e1915 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:10.086764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5b937f2e-30a8-4fc9-9a8a-3adce87e1915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.103776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b937f2e-30a8-4fc9-9a8a-3adce87e1915 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:10.108035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fb746bfa-d8e2-4ee2-8884-85aea6656047 None None] MFA Rules not processed for user `5457b0edf69b4fbab251f3195569576c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:10.109375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fb746bfa-d8e2-4ee2-8884-85aea6656047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.177398 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:10.191419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:10.192148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.192653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.192999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] PATH_INFO: `/v3/users/1acb785884fb4e33a9275f5db7575daa` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.194503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1acb785884fb4e33a9275f5db7575daa)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:10.196625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:10.214152 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 667/1360] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:00:10.215155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb746bfa-d8e2-4ee2-8884-85aea6656047 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:10.263380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1acb785884fb4e33a9275f5db7575daa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:10.264094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1acb785884fb4e33a9275f5db7575daa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:10.277735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1acb785884fb4e33a9275f5db7575daa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:10.286707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1acb785884fb4e33a9275f5db7575daa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:10.287465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1acb785884fb4e33a9275f5db7575daa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:10.304096 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 694/1361] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:10 2022] DELETE /identity/v3/users/1acb785884fb4e33a9275f5db7575daa => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:00:10.305126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:10.311045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.323532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb746bfa-d8e2-4ee2-8884-85aea6656047 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:10.363112 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:10.391473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a820d76-1136-4e11-89a5-589e4d4bae05 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:10.398313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b214b33-61a3-4668-8166-5fcdc77da9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:10.398965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b214b33-61a3-4668-8166-5fcdc77da9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.399247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b214b33-61a3-4668-8166-5fcdc77da9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.399507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b214b33-61a3-4668-8166-5fcdc77da9e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.400139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b214b33-61a3-4668-8166-5fcdc77da9e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:10.402043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b214b33-61a3-4668-8166-5fcdc77da9e2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:10.402337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183c035-01c5-4827-b0d3-083ec39b4232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:10.403004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183c035-01c5-4827-b0d3-083ec39b4232 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.403539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183c035-01c5-4827-b0d3-083ec39b4232 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.403807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183c035-01c5-4827-b0d3-083ec39b4232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.405550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d183c035-01c5-4827-b0d3-083ec39b4232 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.435247 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 695/1362] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:10 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:10.436461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b214b33-61a3-4668-8166-5fcdc77da9e2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:10.438420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5b214b33-61a3-4668-8166-5fcdc77da9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.483802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183c035-01c5-4827-b0d3-083ec39b4232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:10.485787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183c035-01c5-4827-b0d3-083ec39b4232 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:10.495663 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 668/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:10.496903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23279809-51f9-4028-835f-30aec37f8061 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.497187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23279809-51f9-4028-835f-30aec37f8061 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.497457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23279809-51f9-4028-835f-30aec37f8061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.510547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b214b33-61a3-4668-8166-5fcdc77da9e2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:10.517080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:10.517879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.517989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-23279809-51f9-4028-835f-30aec37f8061 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:10.518329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.518690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] PATH_INFO: `/v3/users/5044e3245cbf4cbdaa5ac6cb174aeabe` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.520074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-23279809-51f9-4028-835f-30aec37f8061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.520692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5044e3245cbf4cbdaa5ac6cb174aeabe)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:10.522908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:10.536336 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 669/1364] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:10.536847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23279809-51f9-4028-835f-30aec37f8061 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:10.549011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23279809-51f9-4028-835f-30aec37f8061 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:10.555249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838285e-d44b-411e-a173-aac5d33f13fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:10.555867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838285e-d44b-411e-a173-aac5d33f13fb admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.556142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838285e-d44b-411e-a173-aac5d33f13fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.556408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838285e-d44b-411e-a173-aac5d33f13fb admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.557101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838285e-d44b-411e-a173-aac5d33f13fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:10.559047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838285e-d44b-411e-a173-aac5d33f13fb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:10.568022 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:10.587329 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 670/1365] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:10 2022] POST /identity/v3/users => generated 302 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:10.588948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8953fe-16ba-411c-9d29-787eddf4720f None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.589217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8953fe-16ba-411c-9d29-787eddf4720f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.589395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5044e3245cbf4cbdaa5ac6cb174aeabe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:10.589615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8953fe-16ba-411c-9d29-787eddf4720f None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.590199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5044e3245cbf4cbdaa5ac6cb174aeabe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:10.591128 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 671/1366] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:10.591789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8953fe-16ba-411c-9d29-787eddf4720f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:10.593711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef8953fe-16ba-411c-9d29-787eddf4720f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.605030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5044e3245cbf4cbdaa5ac6cb174aeabe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:10.613363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5044e3245cbf4cbdaa5ac6cb174aeabe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:10.614239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5044e3245cbf4cbdaa5ac6cb174aeabe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:10.629323 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 696/1367] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:10 2022] DELETE /identity/v3/users/5044e3245cbf4cbdaa5ac6cb174aeabe => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:10.630144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:10.631902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.662623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8953fe-16ba-411c-9d29-787eddf4720f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:10.687984 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:10.702959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13794a2-7cb9-49d6-9df6-883475d1022b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:10.709188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c46c3-f9aa-4370-b5ae-89ec4225f8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:10.709793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c46c3-f9aa-4370-b5ae-89ec4225f8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.710073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c46c3-f9aa-4370-b5ae-89ec4225f8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.710346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c46c3-f9aa-4370-b5ae-89ec4225f8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.711009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c46c3-f9aa-4370-b5ae-89ec4225f8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:10.712614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c46c3-f9aa-4370-b5ae-89ec4225f8c2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:10.721279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c341818-fc48-407e-82d4-e3093574cc04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:10.722613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341818-fc48-407e-82d4-e3093574cc04 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.722902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341818-fc48-407e-82d4-e3093574cc04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.723205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341818-fc48-407e-82d4-e3093574cc04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.724144 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 697/1368] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:10.725242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9c341818-fc48-407e-82d4-e3093574cc04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.728253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f31af-bd3e-4bc0-9d70-e965e1c8b762 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.728588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f31af-bd3e-4bc0-9d70-e965e1c8b762 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.728931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f31af-bd3e-4bc0-9d70-e965e1c8b762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.738456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c341818-fc48-407e-82d4-e3093574cc04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:10.739947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c341818-fc48-407e-82d4-e3093574cc04 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:10.748670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a38f31af-bd3e-4bc0-9d70-e965e1c8b762 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:10.749735 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 672/1369] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:10.749910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a38f31af-bd3e-4bc0-9d70-e965e1c8b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.750968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94e96-813b-43c7-acb9-2025de2d4004 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.751260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94e96-813b-43c7-acb9-2025de2d4004 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.751535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94e96-813b-43c7-acb9-2025de2d4004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.773631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-43a94e96-813b-43c7-acb9-2025de2d4004 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:10.775133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-43a94e96-813b-43c7-acb9-2025de2d4004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.783338 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 673/1370] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:10.784753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5e740-cc5a-4bfa-bba5-5468be0232a1 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.785045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5e740-cc5a-4bfa-bba5-5468be0232a1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.785318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5e740-cc5a-4bfa-bba5-5468be0232a1 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.786783 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 674/1371] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:10.793064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5e740-cc5a-4bfa-bba5-5468be0232a1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:10.808079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5e740-cc5a-4bfa-bba5-5468be0232a1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:10.814320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872f55f-c434-4d4d-a105-76017e06d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:10.815128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872f55f-c434-4d4d-a105-76017e06d2e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.815409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872f55f-c434-4d4d-a105-76017e06d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.815683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872f55f-c434-4d4d-a105-76017e06d2e2 admin admin] PATH_INFO: `/v3/projects/0e064fe295e64d5b98550de6d62766a5/users/9d41be8d632f4b89aee02b13b203ae13/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.828866 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 698/1372] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:10.829957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f31af-bd3e-4bc0-9d70-e965e1c8b762 None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:00:10.832084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a38f31af-bd3e-4bc0-9d70-e965e1c8b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.833892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872f55f-c434-4d4d-a105-76017e06d2e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e064fe295e64d5b98550de6d62766a5, user_id=9d41be8d632f4b89aee02b13b203ae13, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:10.837311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872f55f-c434-4d4d-a105-76017e06d2e2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:10.862019 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 675/1373] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:10 2022] PUT /identity/v3/projects/0e064fe295e64d5b98550de6d62766a5/users/9d41be8d632f4b89aee02b13b203ae13/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:10.863032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872f55f-c434-4d4d-a105-76017e06d2e2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:10.865302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d872f55f-c434-4d4d-a105-76017e06d2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.922242 n-d-master-1 devstack@keystone.service[81804]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-a38f31af-bd3e-4bc0-9d70-e965e1c8b762 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 16 01:00:10.922845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f31af-bd3e-4bc0-9d70-e965e1c8b762 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:10.924010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a38f31af-bd3e-4bc0-9d70-e965e1c8b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:10.942324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872f55f-c434-4d4d-a105-76017e06d2e2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:10.947120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80a39a-0860-475f-8155-1bdaa16e163c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:10.947868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80a39a-0860-475f-8155-1bdaa16e163c service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:10.948245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80a39a-0860-475f-8155-1bdaa16e163c service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:10.948615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80a39a-0860-475f-8155-1bdaa16e163c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:10.987054 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:11.020181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f31af-bd3e-4bc0-9d70-e965e1c8b762 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:11.023348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80a39a-0860-475f-8155-1bdaa16e163c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:11.025136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80a39a-0860-475f-8155-1bdaa16e163c service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:11.035892 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 676/1374] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:11.036657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80a39a-0860-475f-8155-1bdaa16e163c service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:11.038042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2b80a39a-0860-475f-8155-1bdaa16e163c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:11.046985 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:11.083616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2380e7d-72d2-464e-b5ad-af4b0003abc8 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e87e7bd1a4114926af6d6520e4a67b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37a10f4a46bc4cf987efd5db9700673c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:11.084252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2380e7d-72d2-464e-b5ad-af4b0003abc8 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.084535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2380e7d-72d2-464e-b5ad-af4b0003abc8 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.084800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2380e7d-72d2-464e-b5ad-af4b0003abc8 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] PATH_INFO: `/v3/projects/4afeba85d0bc4d87ba15ccf94db80957` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.085940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2380e7d-72d2-464e-b5ad-af4b0003abc8 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: Authorizing `identity:get_project(project_id=4afeba85d0bc4d87ba15ccf94db80957)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:11.088040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2380e7d-72d2-464e-b5ad-af4b0003abc8 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:11.089954 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 699/1375] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:00:10 2022] GET /identity/v3/projects/4afeba85d0bc4d87ba15ccf94db80957 => generated 395 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:11.090680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2380e7d-72d2-464e-b5ad-af4b0003abc8 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:11.104158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2380e7d-72d2-464e-b5ad-af4b0003abc8 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:11.109294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d266fc-9762-4a59-bdc0-38e05b7a9a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:11.110057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d266fc-9762-4a59-bdc0-38e05b7a9a9e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.110415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d266fc-9762-4a59-bdc0-38e05b7a9a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.110716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d266fc-9762-4a59-bdc0-38e05b7a9a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.111383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d266fc-9762-4a59-bdc0-38e05b7a9a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:11.114008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d266fc-9762-4a59-bdc0-38e05b7a9a9e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:11.122640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80a39a-0860-475f-8155-1bdaa16e163c service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:11.131672 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 700/1376] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:11.131761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7d5ab-0ae0-40ac-836f-943f7da5dff0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:11.131761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7d5ab-0ae0-40ac-836f-943f7da5dff0 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.132856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d266fc-9762-4a59-bdc0-38e05b7a9a9e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:11.135028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7d5ab-0ae0-40ac-836f-943f7da5dff0 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.135289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7d5ab-0ae0-40ac-836f-943f7da5dff0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.146598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7d5ab-0ae0-40ac-836f-943f7da5dff0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:11.147850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d266fc-9762-4a59-bdc0-38e05b7a9a9e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:11.148584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7d5ab-0ae0-40ac-836f-943f7da5dff0 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:11.153213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28610fc-a6d0-4db9-8d75-29f3a2fd4dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:11.154224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28610fc-a6d0-4db9-8d75-29f3a2fd4dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.154581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28610fc-a6d0-4db9-8d75-29f3a2fd4dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.154935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28610fc-a6d0-4db9-8d75-29f3a2fd4dcd admin admin] PATH_INFO: `/v3/projects/0e064fe295e64d5b98550de6d62766a5/users/9d41be8d632f4b89aee02b13b203ae13/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.157642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28610fc-a6d0-4db9-8d75-29f3a2fd4dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e064fe295e64d5b98550de6d62766a5, user_id=9d41be8d632f4b89aee02b13b203ae13, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:11.162295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28610fc-a6d0-4db9-8d75-29f3a2fd4dcd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:11.175173 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 677/1377] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:11.176539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7d5ab-0ae0-40ac-836f-943f7da5dff0 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:11.178360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e2f7d5ab-0ae0-40ac-836f-943f7da5dff0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:11.195328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7d5ab-0ae0-40ac-836f-943f7da5dff0 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:11.198376 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 701/1378] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:11 2022] PUT /identity/v3/projects/0e064fe295e64d5b98550de6d62766a5/users/9d41be8d632f4b89aee02b13b203ae13/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:11.213350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50f2c6-f26d-4815-893d-fe053ac71222 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.214187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50f2c6-f26d-4815-893d-fe053ac71222 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.214652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50f2c6-f26d-4815-893d-fe053ac71222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.281038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6b50f2c6-f26d-4815-893d-fe053ac71222 None None] MFA Rules not processed for user `9d41be8d632f4b89aee02b13b203ae13`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:11.282343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6b50f2c6-f26d-4815-893d-fe053ac71222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:11.285734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:11.286667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.287208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.287579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] PATH_INFO: `/v3/projects/56c1848299c34a9a8e9385b69e888b93` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.288911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c1848299c34a9a8e9385b69e888b93)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:11.291616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:11.372110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c1848299c34a9a8e9385b69e888b93', 'request_id': 'req-46af0042-41b0-40fe-8748-c568bad42fa8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.383795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c1848299c34a9a8e9385b69e888b93', 'request_id': 'req-46af0042-41b0-40fe-8748-c568bad42fa8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.397045 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:11.402939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c1848299c34a9a8e9385b69e888b93', 'request_id': 'req-46af0042-41b0-40fe-8748-c568bad42fa8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.410805 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 702/1379] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:11.416837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a2d2e-f33e-45f8-8eca-11fb69430b06 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.416837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a2d2e-f33e-45f8-8eca-11fb69430b06 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.416837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a2d2e-f33e-45f8-8eca-11fb69430b06 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.416837 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 703/1380] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:11.423620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05666b64-14c9-4058-a9a2-63f1b30401be None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.423911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05666b64-14c9-4058-a9a2-63f1b30401be None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.424186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05666b64-14c9-4058-a9a2-63f1b30401be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.426383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] The token cache is being invalidate because project 56c1848299c34a9a8e9385b69e888b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:11.427000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.428215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.430526 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 678/1381] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:11 2022] DELETE /identity/v3/projects/56c1848299c34a9a8e9385b69e888b93 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:11.431499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:00:11.434905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:11.447111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-05666b64-14c9-4058-a9a2-63f1b30401be None None] MFA Rules not processed for user `b01de0795d2f472ab35e08f4651c19ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:11.447733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05666b64-14c9-4058-a9a2-63f1b30401be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:11.513099 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 704/1382] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:11.514034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05666b64-14c9-4058-a9a2-63f1b30401be None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:11.515330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05666b64-14c9-4058-a9a2-63f1b30401be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:11.537280 n-d-master-1 devstack@keystone.service[81805]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 16 01:00:11.537587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:11.538843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:11.555945 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:11.583419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05666b64-14c9-4058-a9a2-63f1b30401be None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:11.587947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:11.588575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.588852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.589124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] PATH_INFO: `/v3/users/c57a7676eb79402a99986d82623a68f6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.590263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c57a7676eb79402a99986d82623a68f6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:11.592241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:11.613978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af0042-41b0-40fe-8748-c568bad42fa8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:11.619646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733c85b-8fa1-446a-91f4-c1949b6a0a3d tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e87e7bd1a4114926af6d6520e4a67b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37a10f4a46bc4cf987efd5db9700673c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:11.620346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c85b-8fa1-446a-91f4-c1949b6a0a3d tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.621457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c85b-8fa1-446a-91f4-c1949b6a0a3d tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.621745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c85b-8fa1-446a-91f4-c1949b6a0a3d tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] PATH_INFO: `/v3/projects/4afeba85d0bc4d87ba15ccf94db80957` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.623443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733c85b-8fa1-446a-91f4-c1949b6a0a3d tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: Authorizing `identity:get_project(project_id=4afeba85d0bc4d87ba15ccf94db80957)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:11.625730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733c85b-8fa1-446a-91f4-c1949b6a0a3d tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:11.627752 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 679/1383] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:00:11 2022] GET /identity/v3/projects/4afeba85d0bc4d87ba15ccf94db80957 => generated 395 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:11.629197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733c85b-8fa1-446a-91f4-c1949b6a0a3d tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:11.630967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f733c85b-8fa1-446a-91f4-c1949b6a0a3d tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:11.643071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c57a7676eb79402a99986d82623a68f6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.644866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c57a7676eb79402a99986d82623a68f6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.649205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733c85b-8fa1-446a-91f4-c1949b6a0a3d tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:11.657345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d3b5e-0d86-425d-affc-c32b6c6a77f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:11.658008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3b5e-0d86-425d-affc-c32b6c6a77f8 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.658339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3b5e-0d86-425d-affc-c32b6c6a77f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.658663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3b5e-0d86-425d-affc-c32b6c6a77f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.661441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-024d3b5e-0d86-425d-affc-c32b6c6a77f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:11.668475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c57a7676eb79402a99986d82623a68f6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.678635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c57a7676eb79402a99986d82623a68f6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.679714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c57a7676eb79402a99986d82623a68f6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.703681 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 705/1384] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:11 2022] DELETE /identity/v3/users/c57a7676eb79402a99986d82623a68f6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:11.705600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:11.708987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:11.776145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d3b5e-0d86-425d-affc-c32b6c6a77f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:11.777969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d3b5e-0d86-425d-affc-c32b6c6a77f8 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:11.791452 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 680/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:11 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:11.805164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38669-59b9-4189-807c-5806e70b0054 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:11.813150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d3b5e-0d86-425d-affc-c32b6c6a77f8 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:11.814879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-024d3b5e-0d86-425d-affc-c32b6c6a77f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:11.818411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:11.819430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.819430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.820140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] PATH_INFO: `/v3/projects/3786a93a69454bfa9dc490a4006b8a60` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.821368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3786a93a69454bfa9dc490a4006b8a60)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:11.823762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:11.835582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d3b5e-0d86-425d-affc-c32b6c6a77f8 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:11.840876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd42da-a02c-4fcd-bcd0-e395b7d72db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:11.841523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd42da-a02c-4fcd-bcd0-e395b7d72db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.841867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd42da-a02c-4fcd-bcd0-e395b7d72db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.842150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd42da-a02c-4fcd-bcd0-e395b7d72db5 admin admin] PATH_INFO: `/v3/users/5000f1b310334c199e95e71621e60870` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.843429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd42da-a02c-4fcd-bcd0-e395b7d72db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5000f1b310334c199e95e71621e60870)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:11.845515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd42da-a02c-4fcd-bcd0-e395b7d72db5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:11.861452 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:11.895099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3786a93a69454bfa9dc490a4006b8a60', 'request_id': 'req-42ec79ec-774c-4661-b067-69ee855c9e79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.902871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3786a93a69454bfa9dc490a4006b8a60', 'request_id': 'req-42ec79ec-774c-4661-b067-69ee855c9e79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.905591 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:11.909039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8dd42da-a02c-4fcd-bcd0-e395b7d72db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5000f1b310334c199e95e71621e60870'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.910000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8dd42da-a02c-4fcd-bcd0-e395b7d72db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5000f1b310334c199e95e71621e60870'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.914561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3786a93a69454bfa9dc490a4006b8a60', 'request_id': 'req-42ec79ec-774c-4661-b067-69ee855c9e79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.926092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8dd42da-a02c-4fcd-bcd0-e395b7d72db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5000f1b310334c199e95e71621e60870'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.930677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] The token cache is being invalidate because project 3786a93a69454bfa9dc490a4006b8a60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:11.931804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.932630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.934501 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 706/1386] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:11 2022] DELETE /identity/v3/projects/3786a93a69454bfa9dc490a4006b8a60 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:11.934934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8dd42da-a02c-4fcd-bcd0-e395b7d72db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5000f1b310334c199e95e71621e60870'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.936210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:11.937758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8dd42da-a02c-4fcd-bcd0-e395b7d72db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5000f1b310334c199e95e71621e60870'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:11.937916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:11.952851 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 681/1387] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:11 2022] DELETE /identity/v3/users/5000f1b310334c199e95e71621e60870 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:11.954424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd41328-b2c8-4367-8ea2-7fee986387ef None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:11.954836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd41328-b2c8-4367-8ea2-7fee986387ef None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:11.955276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd41328-b2c8-4367-8ea2-7fee986387ef None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:11.957582 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 682/1388] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:11.958313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd41328-b2c8-4367-8ea2-7fee986387ef None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:11.960017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5dd41328-b2c8-4367-8ea2-7fee986387ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.028126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec79ec-774c-4661-b067-69ee855c9e79 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:12.036761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd41328-b2c8-4367-8ea2-7fee986387ef None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:12.043985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284a0d9-eb94-4d28-a760-a4f4dd8a32de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:12.044726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284a0d9-eb94-4d28-a760-a4f4dd8a32de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.045097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284a0d9-eb94-4d28-a760-a4f4dd8a32de admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.045458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284a0d9-eb94-4d28-a760-a4f4dd8a32de admin admin] PATH_INFO: `/v3/users/04896641b85b423e9315ae9e7c0a84ca` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.048203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284a0d9-eb94-4d28-a760-a4f4dd8a32de admin admin] RBAC: Authorizing `identity:delete_user(user_id=04896641b85b423e9315ae9e7c0a84ca)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:12.051276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284a0d9-eb94-4d28-a760-a4f4dd8a32de admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:12.103914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2284a0d9-eb94-4d28-a760-a4f4dd8a32de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04896641b85b423e9315ae9e7c0a84ca'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.104768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2284a0d9-eb94-4d28-a760-a4f4dd8a32de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04896641b85b423e9315ae9e7c0a84ca'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.121671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2284a0d9-eb94-4d28-a760-a4f4dd8a32de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04896641b85b423e9315ae9e7c0a84ca'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.130996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2284a0d9-eb94-4d28-a760-a4f4dd8a32de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04896641b85b423e9315ae9e7c0a84ca'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.131724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2284a0d9-eb94-4d28-a760-a4f4dd8a32de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04896641b85b423e9315ae9e7c0a84ca'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.135170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62ffad-82f5-4c27-a4d3-571a72844c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:12.135940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62ffad-82f5-4c27-a4d3-571a72844c7b service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.136273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62ffad-82f5-4c27-a4d3-571a72844c7b service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.136608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62ffad-82f5-4c27-a4d3-571a72844c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.138430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ed62ffad-82f5-4c27-a4d3-571a72844c7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.153758 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 683/1389] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:11 2022] DELETE /identity/v3/users/04896641b85b423e9315ae9e7c0a84ca => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:12.164387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72457a62-1504-4079-8d80-54111dfa3453 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.164687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72457a62-1504-4079-8d80-54111dfa3453 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.164927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72457a62-1504-4079-8d80-54111dfa3453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.192208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-72457a62-1504-4079-8d80-54111dfa3453 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:12.193591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-72457a62-1504-4079-8d80-54111dfa3453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.198117 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:12.213116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62ffad-82f5-4c27-a4d3-571a72844c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:12.214931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62ffad-82f5-4c27-a4d3-571a72844c7b service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:12.226346 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 707/1390] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:12.227121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62ffad-82f5-4c27-a4d3-571a72844c7b service nova] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:00:12.228856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ed62ffad-82f5-4c27-a4d3-571a72844c7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.244204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62ffad-82f5-4c27-a4d3-571a72844c7b service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:12.245804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ed62ffad-82f5-4c27-a4d3-571a72844c7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.266490 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:12.267801 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 684/1391] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:12.268696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72457a62-1504-4079-8d80-54111dfa3453 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:12.275059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-72457a62-1504-4079-8d80-54111dfa3453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.291239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72457a62-1504-4079-8d80-54111dfa3453 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:12.297827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:12.298653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.299168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.299541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] PATH_INFO: `/v3/projects/249ca78aa43342399d247b104578ef3e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.304548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=249ca78aa43342399d247b104578ef3e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:12.304548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:12.361799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62ffad-82f5-4c27-a4d3-571a72844c7b service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:12.363397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249ca78aa43342399d247b104578ef3e', 'request_id': 'req-c7542362-a5b4-4d8d-9879-1e61db902ad7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.370615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249ca78aa43342399d247b104578ef3e', 'request_id': 'req-c7542362-a5b4-4d8d-9879-1e61db902ad7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.380188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249ca78aa43342399d247b104578ef3e', 'request_id': 'req-c7542362-a5b4-4d8d-9879-1e61db902ad7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.392695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] The token cache is being invalidate because project 249ca78aa43342399d247b104578ef3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:12.393098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.393848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.395695 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 685/1392] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:12 2022] DELETE /identity/v3/projects/249ca78aa43342399d247b104578ef3e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:12.399868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:12.401758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.438644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ab74f-e8e3-40a4-8ef7-bb7c581a26c0 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e87e7bd1a4114926af6d6520e4a67b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37a10f4a46bc4cf987efd5db9700673c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:12.439620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ab74f-e8e3-40a4-8ef7-bb7c581a26c0 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.440133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ab74f-e8e3-40a4-8ef7-bb7c581a26c0 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.440546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ab74f-e8e3-40a4-8ef7-bb7c581a26c0 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] PATH_INFO: `/v3/projects/4afeba85d0bc4d87ba15ccf94db80957` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.441932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ab74f-e8e3-40a4-8ef7-bb7c581a26c0 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: Authorizing `identity:get_project(project_id=4afeba85d0bc4d87ba15ccf94db80957)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:12.444103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ab74f-e8e3-40a4-8ef7-bb7c581a26c0 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:12.445919 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 708/1393] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:00:12 2022] GET /identity/v3/projects/4afeba85d0bc4d87ba15ccf94db80957 => generated 395 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:12.447238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbdb16-7920-41a9-857a-fd8a31266acb None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.447509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbdb16-7920-41a9-857a-fd8a31266acb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.447862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbdb16-7920-41a9-857a-fd8a31266acb None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.449451 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 709/1394] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:12.450672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c766f-e9e4-47f9-b415-e35a12f10ac7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.450970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c766f-e9e4-47f9-b415-e35a12f10ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.451247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c766f-e9e4-47f9-b415-e35a12f10ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.474802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-345c766f-e9e4-47f9-b415-e35a12f10ac7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:12.476123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-345c766f-e9e4-47f9-b415-e35a12f10ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.494222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7542362-a5b4-4d8d-9879-1e61db902ad7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:12.504090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ba7a6-4813-44db-9ad6-4083eaec3115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:12.504769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ba7a6-4813-44db-9ad6-4083eaec3115 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.505047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ba7a6-4813-44db-9ad6-4083eaec3115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.505313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ba7a6-4813-44db-9ad6-4083eaec3115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.507311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8f6ba7a6-4813-44db-9ad6-4083eaec3115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.551867 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 710/1395] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:12.553136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f4fd7-72f8-4b63-8709-1ec653e1f6b7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.553421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f4fd7-72f8-4b63-8709-1ec653e1f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.553693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f4fd7-72f8-4b63-8709-1ec653e1f6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.575610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-319f4fd7-72f8-4b63-8709-1ec653e1f6b7 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:12.576887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-319f4fd7-72f8-4b63-8709-1ec653e1f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.577201 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:12.598602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ba7a6-4813-44db-9ad6-4083eaec3115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:12.603226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ba7a6-4813-44db-9ad6-4083eaec3115 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:12.617719 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 686/1396] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:12.618738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ba7a6-4813-44db-9ad6-4083eaec3115 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:12.620949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8f6ba7a6-4813-44db-9ad6-4083eaec3115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.633778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ba7a6-4813-44db-9ad6-4083eaec3115 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:12.647029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:12.647676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.647949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.648214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] PATH_INFO: `/v3/projects/e5a47c70f35a4133bf67777c116e4b31` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.649333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a47c70f35a4133bf67777c116e4b31)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:12.651400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:12.661017 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:12.679250 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 711/1397] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:12.680727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f430b-f169-4282-aabc-c564db9159c0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.680999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f430b-f169-4282-aabc-c564db9159c0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.681356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f430b-f169-4282-aabc-c564db9159c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.709711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f89f430b-f169-4282-aabc-c564db9159c0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:12.711214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f89f430b-f169-4282-aabc-c564db9159c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.720171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a47c70f35a4133bf67777c116e4b31', 'request_id': 'req-585d44cd-69c7-4c1a-99ef-eb53987a341c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.731619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a47c70f35a4133bf67777c116e4b31', 'request_id': 'req-585d44cd-69c7-4c1a-99ef-eb53987a341c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.745706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a47c70f35a4133bf67777c116e4b31', 'request_id': 'req-585d44cd-69c7-4c1a-99ef-eb53987a341c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.765856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] The token cache is being invalidate because project e5a47c70f35a4133bf67777c116e4b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:12.766171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.766869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:12.769759 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 687/1398] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:12 2022] DELETE /identity/v3/projects/e5a47c70f35a4133bf67777c116e4b31 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:12.775022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:12.777968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.815933 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 712/1399] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:12.817784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759872c-e730-4fd6-9ffc-a57583c35633 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.818293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759872c-e730-4fd6-9ffc-a57583c35633 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.818769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759872c-e730-4fd6-9ffc-a57583c35633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.850123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5759872c-e730-4fd6-9ffc-a57583c35633 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:12.851820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5759872c-e730-4fd6-9ffc-a57583c35633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.864411 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 713/1400] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:12.865717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759872c-e730-4fd6-9ffc-a57583c35633 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:12.878869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759872c-e730-4fd6-9ffc-a57583c35633 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:12.891800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16c51-0149-4b16-841f-6386bf3ac278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:12.892840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16c51-0149-4b16-841f-6386bf3ac278 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.894054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16c51-0149-4b16-841f-6386bf3ac278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.894568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16c51-0149-4b16-841f-6386bf3ac278 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.896045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16c51-0149-4b16-841f-6386bf3ac278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:12.896495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16c51-0149-4b16-841f-6386bf3ac278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:12.898253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16c51-0149-4b16-841f-6386bf3ac278 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:12.909353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d44cd-69c7-4c1a-99ef-eb53987a341c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:12.914254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1e59f-38f2-49f7-aa3a-4152dbeb55ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:12.915780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1e59f-38f2-49f7-aa3a-4152dbeb55ad service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.916258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1e59f-38f2-49f7-aa3a-4152dbeb55ad service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.916876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1e59f-38f2-49f7-aa3a-4152dbeb55ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.917510 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 714/1401] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:12.918596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16c51-0149-4b16-841f-6386bf3ac278 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:12.921769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9db16c51-0149-4b16-841f-6386bf3ac278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.921878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c0e1e59f-38f2-49f7-aa3a-4152dbeb55ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:12.940400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16c51-0149-4b16-841f-6386bf3ac278 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:12.947759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daac691-a6ff-4367-ac99-3e2fd604b68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:12.948639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daac691-a6ff-4367-ac99-3e2fd604b68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:12.949126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daac691-a6ff-4367-ac99-3e2fd604b68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:12.949772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daac691-a6ff-4367-ac99-3e2fd604b68c admin admin] PATH_INFO: `/v3/users/5457b0edf69b4fbab251f3195569576c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:12.951225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daac691-a6ff-4367-ac99-3e2fd604b68c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5457b0edf69b4fbab251f3195569576c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:12.953284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daac691-a6ff-4367-ac99-3e2fd604b68c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:13.025434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9daac691-a6ff-4367-ac99-3e2fd604b68c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5457b0edf69b4fbab251f3195569576c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.026729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9daac691-a6ff-4367-ac99-3e2fd604b68c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5457b0edf69b4fbab251f3195569576c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.038286 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:13.043351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9daac691-a6ff-4367-ac99-3e2fd604b68c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5457b0edf69b4fbab251f3195569576c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.051972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9daac691-a6ff-4367-ac99-3e2fd604b68c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5457b0edf69b4fbab251f3195569576c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.052647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9daac691-a6ff-4367-ac99-3e2fd604b68c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5457b0edf69b4fbab251f3195569576c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.058530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1e59f-38f2-49f7-aa3a-4152dbeb55ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:13.060031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1e59f-38f2-49f7-aa3a-4152dbeb55ad service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:13.064888 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 715/1402] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:12 2022] DELETE /identity/v3/users/5457b0edf69b4fbab251f3195569576c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:13.066196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39bb40-8019-4718-8830-4a64afa07250 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.066484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39bb40-8019-4718-8830-4a64afa07250 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.066759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39bb40-8019-4718-8830-4a64afa07250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:13.072503 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 688/1403] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:13.073515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1e59f-38f2-49f7-aa3a-4152dbeb55ad service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:13.084634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1e59f-38f2-49f7-aa3a-4152dbeb55ad service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:13.087302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-be39bb40-8019-4718-8830-4a64afa07250 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:13.088513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-be39bb40-8019-4718-8830-4a64afa07250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:13.146076 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:13.147321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834beea-2b51-4954-bab0-a1f8448664c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:13.148152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834beea-2b51-4954-bab0-a1f8448664c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.148606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834beea-2b51-4954-bab0-a1f8448664c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.148977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834beea-2b51-4954-bab0-a1f8448664c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:13.149541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834beea-2b51-4954-bab0-a1f8448664c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:13.151802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834beea-2b51-4954-bab0-a1f8448664c9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:13.165277 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 716/1404] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:13.166401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39bb40-8019-4718-8830-4a64afa07250 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:13.167844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-be39bb40-8019-4718-8830-4a64afa07250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:13.181349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39bb40-8019-4718-8830-4a64afa07250 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:13.186268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f050f8-bb00-4bbb-8c09-665e56395912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:13.189889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f050f8-bb00-4bbb-8c09-665e56395912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.190008 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 689/1405] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:13 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:13.190098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f050f8-bb00-4bbb-8c09-665e56395912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.190098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f050f8-bb00-4bbb-8c09-665e56395912 admin admin] PATH_INFO: `/v3/projects/38c7831284884cc0b1f2ff9822cc5aea` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:13.190242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834beea-2b51-4954-bab0-a1f8448664c9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:13.190242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0834beea-2b51-4954-bab0-a1f8448664c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:13.190539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f050f8-bb00-4bbb-8c09-665e56395912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c7831284884cc0b1f2ff9822cc5aea)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:13.193240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f050f8-bb00-4bbb-8c09-665e56395912 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:13.248782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5f050f8-bb00-4bbb-8c09-665e56395912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c7831284884cc0b1f2ff9822cc5aea', 'request_id': 'req-d5f050f8-bb00-4bbb-8c09-665e56395912'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.256304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5f050f8-bb00-4bbb-8c09-665e56395912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c7831284884cc0b1f2ff9822cc5aea', 'request_id': 'req-d5f050f8-bb00-4bbb-8c09-665e56395912'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.264930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5f050f8-bb00-4bbb-8c09-665e56395912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c7831284884cc0b1f2ff9822cc5aea', 'request_id': 'req-d5f050f8-bb00-4bbb-8c09-665e56395912'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.274252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834beea-2b51-4954-bab0-a1f8448664c9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:13.278431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5f050f8-bb00-4bbb-8c09-665e56395912 admin admin] The token cache is being invalidate because project 38c7831284884cc0b1f2ff9822cc5aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:13.278757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5f050f8-bb00-4bbb-8c09-665e56395912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.279483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5f050f8-bb00-4bbb-8c09-665e56395912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.281037 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 717/1406] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:13 2022] DELETE /identity/v3/projects/38c7831284884cc0b1f2ff9822cc5aea => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:13.284313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a42f6-c710-4b5b-b97f-8c47c48dff42 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.284313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a42f6-c710-4b5b-b97f-8c47c48dff42 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.284313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a42f6-c710-4b5b-b97f-8c47c48dff42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:13.305231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-340a42f6-c710-4b5b-b97f-8c47c48dff42 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:13.306445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-340a42f6-c710-4b5b-b97f-8c47c48dff42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:13.351448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aeb61d-39fc-41a6-9fad-042ad5e92018 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:13.352493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aeb61d-39fc-41a6-9fad-042ad5e92018 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.352957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aeb61d-39fc-41a6-9fad-042ad5e92018 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.353508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aeb61d-39fc-41a6-9fad-042ad5e92018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:13.356456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-77aeb61d-39fc-41a6-9fad-042ad5e92018 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:13.367888 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:13.373833 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 718/1407] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:13.375084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a42f6-c710-4b5b-b97f-8c47c48dff42 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:13.376887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-340a42f6-c710-4b5b-b97f-8c47c48dff42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:13.390124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a42f6-c710-4b5b-b97f-8c47c48dff42 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:13.396197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82089de6-1fb2-4d10-a13d-ad5949475876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:13.396805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82089de6-1fb2-4d10-a13d-ad5949475876 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.397086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82089de6-1fb2-4d10-a13d-ad5949475876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.397405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82089de6-1fb2-4d10-a13d-ad5949475876 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:13.398059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82089de6-1fb2-4d10-a13d-ad5949475876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:13.398419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82089de6-1fb2-4d10-a13d-ad5949475876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:13.400068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82089de6-1fb2-4d10-a13d-ad5949475876 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:13.417772 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 719/1408] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:13.417772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82089de6-1fb2-4d10-a13d-ad5949475876 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:13.419120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-82089de6-1fb2-4d10-a13d-ad5949475876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:13.436228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82089de6-1fb2-4d10-a13d-ad5949475876 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:13.437745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55f03-7771-4c33-ad97-346c035721c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:13.438354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55f03-7771-4c33-ad97-346c035721c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.438643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55f03-7771-4c33-ad97-346c035721c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.438910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55f03-7771-4c33-ad97-346c035721c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:13.439624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff55f03-7771-4c33-ad97-346c035721c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:13.441732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff55f03-7771-4c33-ad97-346c035721c9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:13.442254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aeb61d-39fc-41a6-9fad-042ad5e92018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:13.444058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aeb61d-39fc-41a6-9fad-042ad5e92018 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:13.455859 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 690/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:13 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:13.457839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aeb61d-39fc-41a6-9fad-042ad5e92018 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:13.460195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-77aeb61d-39fc-41a6-9fad-042ad5e92018 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:13.468174 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 720/1410] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:13 2022] POST /identity/v3/users => generated 292 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:13.469014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55f03-7771-4c33-ad97-346c035721c9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:13.471027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5ff55f03-7771-4c33-ad97-346c035721c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:13.478214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aeb61d-39fc-41a6-9fad-042ad5e92018 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:13.481493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:13.482304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.482586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.482855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] PATH_INFO: `/v3/users/471f9ea16d854815885388c788eaab19` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:13.484066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=471f9ea16d854815885388c788eaab19)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:13.486474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:13.545268 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:13.567418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471f9ea16d854815885388c788eaab19'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.568327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471f9ea16d854815885388c788eaab19'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.568912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55f03-7771-4c33-ad97-346c035721c9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:13.573318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7963a3-b336-4fcb-8740-22badd1d9d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:13.573934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7963a3-b336-4fcb-8740-22badd1d9d95 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.574209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7963a3-b336-4fcb-8740-22badd1d9d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.574474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7963a3-b336-4fcb-8740-22badd1d9d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:13.576267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5e7963a3-b336-4fcb-8740-22badd1d9d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:13.591604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471f9ea16d854815885388c788eaab19'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.591757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7963a3-b336-4fcb-8740-22badd1d9d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:13.593160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7963a3-b336-4fcb-8740-22badd1d9d95 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:13.607464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471f9ea16d854815885388c788eaab19'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.608305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471f9ea16d854815885388c788eaab19'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:13.609872 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 721/1411] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:13.610850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7963a3-b336-4fcb-8740-22badd1d9d95 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:13.612329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5e7963a3-b336-4fcb-8740-22badd1d9d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:13.625814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7963a3-b336-4fcb-8740-22badd1d9d95 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:13.626839 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 691/1412] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:13 2022] DELETE /identity/v3/users/471f9ea16d854815885388c788eaab19 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:13.627920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:13.642861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:13.712953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f992e-2127-4863-86e7-e2b4e09e75c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:13.713886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f992e-2127-4863-86e7-e2b4e09e75c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.714272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f992e-2127-4863-86e7-e2b4e09e75c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.714635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f992e-2127-4863-86e7-e2b4e09e75c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:13.715518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f992e-2127-4863-86e7-e2b4e09e75c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:13.718184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f992e-2127-4863-86e7-e2b4e09e75c4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:13.811850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158bca2-11d9-4743-ade9-813d408ac731 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:13.812214 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 722/1413] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:13 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:13.814292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f29ac-3abd-43a8-9f7d-a77fe6220916 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.814859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f29ac-3abd-43a8-9f7d-a77fe6220916 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.815255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f29ac-3abd-43a8-9f7d-a77fe6220916 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:13.824535 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 723/1414] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:13.824535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f29ac-3abd-43a8-9f7d-a77fe6220916 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:13.845970 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:13.897490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb2c36-521a-4abe-9c00-32e2f0f9f6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:13.898440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb2c36-521a-4abe-9c00-32e2f0f9f6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.898720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb2c36-521a-4abe-9c00-32e2f0f9f6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.899039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb2c36-521a-4abe-9c00-32e2f0f9f6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:13.900212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb2c36-521a-4abe-9c00-32e2f0f9f6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:13.915117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb2c36-521a-4abe-9c00-32e2f0f9f6f4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:13.916141 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 692/1415] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:13.917140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb2c36-521a-4abe-9c00-32e2f0f9f6f4 admin admin] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:00:13.929970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fecb2c36-521a-4abe-9c00-32e2f0f9f6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:13.942311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f29ac-3abd-43a8-9f7d-a77fe6220916 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:13.949130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb06e3c-abe9-464a-ba50-3c53d85aa82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:13.949958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06e3c-abe9-464a-ba50-3c53d85aa82f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.950343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06e3c-abe9-464a-ba50-3c53d85aa82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.950717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06e3c-abe9-464a-ba50-3c53d85aa82f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:13.952326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb06e3c-abe9-464a-ba50-3c53d85aa82f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:13.955728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb06e3c-abe9-464a-ba50-3c53d85aa82f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:13.997032 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 724/1416] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:13 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:13.997032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdeeec-7ed3-49b0-a89d-ebe1bd1129d9 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:13.997032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdeeec-7ed3-49b0-a89d-ebe1bd1129d9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:13.997032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdeeec-7ed3-49b0-a89d-ebe1bd1129d9 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.000838 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 725/1417] 10.222.0.39 () {54 vars in 961 bytes} [Sun Oct 16 01:00:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:14.008209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdeeec-7ed3-49b0-a89d-ebe1bd1129d9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:14.022981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb2c36-521a-4abe-9c00-32e2f0f9f6f4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:14.024384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fecb2c36-521a-4abe-9c00-32e2f0f9f6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.042076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdeeec-7ed3-49b0-a89d-ebe1bd1129d9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:14.047907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e3327-7f53-492d-beb3-07ec741b18f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:14.048526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e3327-7f53-492d-beb3-07ec741b18f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.048806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e3327-7f53-492d-beb3-07ec741b18f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.049079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e3327-7f53-492d-beb3-07ec741b18f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.050987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e3327-7f53-492d-beb3-07ec741b18f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:14.052696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e3327-7f53-492d-beb3-07ec741b18f7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:14.070685 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 726/1418] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:14.071772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e3327-7f53-492d-beb3-07ec741b18f7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:14.073490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-451e3327-7f53-492d-beb3-07ec741b18f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.088403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e3327-7f53-492d-beb3-07ec741b18f7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:14.094455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:14.095180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.095457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.095837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] PATH_INFO: `/v3/projects/4b577048201d4ccf9f7a2b5ffd305a0e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.097605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b577048201d4ccf9f7a2b5ffd305a0e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:14.100190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:14.115088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb2c36-521a-4abe-9c00-32e2f0f9f6f4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:14.122273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40071-8ebe-4ddc-b560-0a2596aff073 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e87e7bd1a4114926af6d6520e4a67b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37a10f4a46bc4cf987efd5db9700673c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:14.123061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40071-8ebe-4ddc-b560-0a2596aff073 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.123383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40071-8ebe-4ddc-b560-0a2596aff073 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.123693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40071-8ebe-4ddc-b560-0a2596aff073 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] PATH_INFO: `/v3/projects/4afeba85d0bc4d87ba15ccf94db80957` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.124963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b40071-8ebe-4ddc-b560-0a2596aff073 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: Authorizing `identity:get_project(project_id=4afeba85d0bc4d87ba15ccf94db80957)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:14.127471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b40071-8ebe-4ddc-b560-0a2596aff073 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:14.129306 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 693/1419] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:00:13 2022] GET /identity/v3/projects/4afeba85d0bc4d87ba15ccf94db80957 => generated 395 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:14.129939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40071-8ebe-4ddc-b560-0a2596aff073 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:14.142966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40071-8ebe-4ddc-b560-0a2596aff073 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:14.151765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948145f2-90b3-4fc8-9ede-5b006309fad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:14.152384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948145f2-90b3-4fc8-9ede-5b006309fad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.152854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948145f2-90b3-4fc8-9ede-5b006309fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.153191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948145f2-90b3-4fc8-9ede-5b006309fad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.154072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948145f2-90b3-4fc8-9ede-5b006309fad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:14.156590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948145f2-90b3-4fc8-9ede-5b006309fad6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:14.163676 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:14.167277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b577048201d4ccf9f7a2b5ffd305a0e', 'request_id': 'req-3b60db9a-ed73-4f0f-b577-52af0cf201de'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.172794 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 694/1420] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:14.174171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323238-d942-4478-8e1e-e77bd1ccec43 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.174518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323238-d942-4478-8e1e-e77bd1ccec43 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.174740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323238-d942-4478-8e1e-e77bd1ccec43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.180500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b577048201d4ccf9f7a2b5ffd305a0e', 'request_id': 'req-3b60db9a-ed73-4f0f-b577-52af0cf201de'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.198460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b577048201d4ccf9f7a2b5ffd305a0e', 'request_id': 'req-3b60db9a-ed73-4f0f-b577-52af0cf201de'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.203476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-62323238-d942-4478-8e1e-e77bd1ccec43 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:14.204675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-62323238-d942-4478-8e1e-e77bd1ccec43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.217115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] The token cache is being invalidate because project 4b577048201d4ccf9f7a2b5ffd305a0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:14.217459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.218310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.219946 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 727/1421] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:14 2022] DELETE /identity/v3/projects/4b577048201d4ccf9f7a2b5ffd305a0e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:14.224067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:14.225464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.250997 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:14.270603 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 695/1422] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Oct 16 01:00:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:14.271261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62323238-d942-4478-8e1e-e77bd1ccec43 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:14.272814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-62323238-d942-4478-8e1e-e77bd1ccec43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.291450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60db9a-ed73-4f0f-b577-52af0cf201de admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:14.296126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d53316-ef7b-4e44-93c5-002bfa780b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:14.296785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d53316-ef7b-4e44-93c5-002bfa780b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.297062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d53316-ef7b-4e44-93c5-002bfa780b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.297336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d53316-ef7b-4e44-93c5-002bfa780b9b admin admin] PATH_INFO: `/v3/projects/c388114ccddd410a98d50e0a04d659ba/users/656af6e3a8db4e3e9a27011215309fb8/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.312214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d53316-ef7b-4e44-93c5-002bfa780b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c388114ccddd410a98d50e0a04d659ba, user_id=656af6e3a8db4e3e9a27011215309fb8, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:14.314865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d53316-ef7b-4e44-93c5-002bfa780b9b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:14.329451 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 728/1423] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:14 2022] PUT /identity/v3/projects/c388114ccddd410a98d50e0a04d659ba/users/656af6e3a8db4e3e9a27011215309fb8/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:14.330321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d53316-ef7b-4e44-93c5-002bfa780b9b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:14.332778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e7d53316-ef7b-4e44-93c5-002bfa780b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.339719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62323238-d942-4478-8e1e-e77bd1ccec43 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:14.397551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:14.397827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d53316-ef7b-4e44-93c5-002bfa780b9b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:14.398183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.398461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.398727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] PATH_INFO: `/v3/projects/86bd15008d164dfda35668238445dda2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.399855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86bd15008d164dfda35668238445dda2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:14.401783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:14.402530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1753c0-13ab-4a7a-a201-61f2f90e426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:14.403162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1753c0-13ab-4a7a-a201-61f2f90e426c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.403440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1753c0-13ab-4a7a-a201-61f2f90e426c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.403710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1753c0-13ab-4a7a-a201-61f2f90e426c admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.404340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1753c0-13ab-4a7a-a201-61f2f90e426c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:14.405919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1753c0-13ab-4a7a-a201-61f2f90e426c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:14.419975 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 729/1424] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:14.419975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abb761-f622-42a3-8252-849761567f49 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.419975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abb761-f622-42a3-8252-849761567f49 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.419975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abb761-f622-42a3-8252-849761567f49 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.419975 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 730/1425] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:14.420829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abb761-f622-42a3-8252-849761567f49 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:14.422350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b2abb761-f622-42a3-8252-849761567f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.439027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abb761-f622-42a3-8252-849761567f49 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:14.450822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86bd15008d164dfda35668238445dda2', 'request_id': 'req-af14407e-a122-496a-b102-23f0a0cb0ca1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.457936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86bd15008d164dfda35668238445dda2', 'request_id': 'req-af14407e-a122-496a-b102-23f0a0cb0ca1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.466012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86bd15008d164dfda35668238445dda2', 'request_id': 'req-af14407e-a122-496a-b102-23f0a0cb0ca1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.477081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] The token cache is being invalidate because project 86bd15008d164dfda35668238445dda2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:14.477368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.478025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.479555 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 696/1426] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:14 2022] DELETE /identity/v3/projects/86bd15008d164dfda35668238445dda2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:14.483898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:14.485623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.487274 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:14.497616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b76bb-f7c4-4e03-be5d-622989b5b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:14.498243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b76bb-f7c4-4e03-be5d-622989b5b62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.498517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b76bb-f7c4-4e03-be5d-622989b5b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.498787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b76bb-f7c4-4e03-be5d-622989b5b62b admin admin] PATH_INFO: `/v3/users/9d41be8d632f4b89aee02b13b203ae13` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.499938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b76bb-f7c4-4e03-be5d-622989b5b62b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d41be8d632f4b89aee02b13b203ae13)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:14.501842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b76bb-f7c4-4e03-be5d-622989b5b62b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:14.513924 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:14.553964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-602b76bb-f7c4-4e03-be5d-622989b5b62b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d41be8d632f4b89aee02b13b203ae13'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.554617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-602b76bb-f7c4-4e03-be5d-622989b5b62b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d41be8d632f4b89aee02b13b203ae13'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.564609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14407e-a122-496a-b102-23f0a0cb0ca1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:14.566959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-602b76bb-f7c4-4e03-be5d-622989b5b62b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d41be8d632f4b89aee02b13b203ae13'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.569751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19073345-7d05-41f6-a67e-f87c62b14273 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:14.570362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073345-7d05-41f6-a67e-f87c62b14273 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.570642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073345-7d05-41f6-a67e-f87c62b14273 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.570936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073345-7d05-41f6-a67e-f87c62b14273 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.572732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-19073345-7d05-41f6-a67e-f87c62b14273 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.574723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-602b76bb-f7c4-4e03-be5d-622989b5b62b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d41be8d632f4b89aee02b13b203ae13'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.575358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-602b76bb-f7c4-4e03-be5d-622989b5b62b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d41be8d632f4b89aee02b13b203ae13'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:14.584445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19073345-7d05-41f6-a67e-f87c62b14273 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:14.586023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19073345-7d05-41f6-a67e-f87c62b14273 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:14.587751 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 731/1427] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:14 2022] DELETE /identity/v3/users/9d41be8d632f4b89aee02b13b203ae13 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:14.588955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89ee6b-d7c5-41a2-9370-66bdedec0625 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.589233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89ee6b-d7c5-41a2-9370-66bdedec0625 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.589503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89ee6b-d7c5-41a2-9370-66bdedec0625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.600416 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 697/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:14.601182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19073345-7d05-41f6-a67e-f87c62b14273 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:14.602497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-19073345-7d05-41f6-a67e-f87c62b14273 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.616066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19073345-7d05-41f6-a67e-f87c62b14273 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:14.619466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4e89ee6b-d7c5-41a2-9370-66bdedec0625 None None] MFA Rules not processed for user `656af6e3a8db4e3e9a27011215309fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:14.621121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4e89ee6b-d7c5-41a2-9370-66bdedec0625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.700697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7259c4-c4d7-42ab-97f8-7d1f0db3951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:14.702499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7259c4-c4d7-42ab-97f8-7d1f0db3951c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.702838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7259c4-c4d7-42ab-97f8-7d1f0db3951c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.703143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7259c4-c4d7-42ab-97f8-7d1f0db3951c admin admin] PATH_INFO: `/v3/projects/d58c8c28f23b4e5f8d5ac48cc4a03424/users/c76c0ffa70e0426688d1e4f4ab6855e4/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.716183 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 732/1429] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:14.717378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89ee6b-d7c5-41a2-9370-66bdedec0625 None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:00:14.722787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7259c4-c4d7-42ab-97f8-7d1f0db3951c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58c8c28f23b4e5f8d5ac48cc4a03424, user_id=c76c0ffa70e0426688d1e4f4ab6855e4, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:14.724589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4e89ee6b-d7c5-41a2-9370-66bdedec0625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.726409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7259c4-c4d7-42ab-97f8-7d1f0db3951c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:14.744983 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 698/1430] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:14 2022] PUT /identity/v3/projects/d58c8c28f23b4e5f8d5ac48cc4a03424/users/c76c0ffa70e0426688d1e4f4ab6855e4/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:14.758483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d4850-e3f7-4ab6-9826-e415305e4513 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.759685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d4850-e3f7-4ab6-9826-e415305e4513 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.760376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d4850-e3f7-4ab6-9826-e415305e4513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.793403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e60d4850-e3f7-4ab6-9826-e415305e4513 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:14.795337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e60d4850-e3f7-4ab6-9826-e415305e4513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.811663 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:14.832643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89ee6b-d7c5-41a2-9370-66bdedec0625 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:14.834622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4e89ee6b-d7c5-41a2-9370-66bdedec0625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.879683 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 699/1431] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:14.887920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d4850-e3f7-4ab6-9826-e415305e4513 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:14.891029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e60d4850-e3f7-4ab6-9826-e415305e4513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:14.906820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d4850-e3f7-4ab6-9826-e415305e4513 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:14.921502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3007661-da96-41c7-bd6e-9c34bff68d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:14.922440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3007661-da96-41c7-bd6e-9c34bff68d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.923341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3007661-da96-41c7-bd6e-9c34bff68d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.923870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3007661-da96-41c7-bd6e-9c34bff68d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:14.924831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3007661-da96-41c7-bd6e-9c34bff68d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:14.927899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3007661-da96-41c7-bd6e-9c34bff68d36 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:14.953866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89ee6b-d7c5-41a2-9370-66bdedec0625 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:14.975979 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 700/1432] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:14 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:14.977771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f5721-e99d-4094-bded-4fab1680b400 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:14.978349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f5721-e99d-4094-bded-4fab1680b400 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:14.980261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f5721-e99d-4094-bded-4fab1680b400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.044183 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:15.047870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ab3f5721-e99d-4094-bded-4fab1680b400 None None] MFA Rules not processed for user `c76c0ffa70e0426688d1e4f4ab6855e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:15.050860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ab3f5721-e99d-4094-bded-4fab1680b400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:15.087208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481822b-7732-4dd5-8a4a-ab7ca143b7b1 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e87e7bd1a4114926af6d6520e4a67b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37a10f4a46bc4cf987efd5db9700673c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.087854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481822b-7732-4dd5-8a4a-ab7ca143b7b1 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.088137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481822b-7732-4dd5-8a4a-ab7ca143b7b1 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.088414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481822b-7732-4dd5-8a4a-ab7ca143b7b1 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] PATH_INFO: `/v3/projects/4afeba85d0bc4d87ba15ccf94db80957` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.089557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481822b-7732-4dd5-8a4a-ab7ca143b7b1 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: Authorizing `identity:get_project(project_id=4afeba85d0bc4d87ba15ccf94db80957)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.091715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481822b-7732-4dd5-8a4a-ab7ca143b7b1 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.093764 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 733/1433] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:00:14 2022] GET /identity/v3/projects/4afeba85d0bc4d87ba15ccf94db80957 => generated 395 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:15.095092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bc813-9c2c-4707-b44d-28429119bfeb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.095376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bc813-9c2c-4707-b44d-28429119bfeb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.095650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bc813-9c2c-4707-b44d-28429119bfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.121874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bc4bc813-9c2c-4707-b44d-28429119bfeb None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:15.127778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bc4bc813-9c2c-4707-b44d-28429119bfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:15.136682 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 701/1434] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:15.137632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f5721-e99d-4094-bded-4fab1680b400 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.216730 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 734/1435] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:15.218024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bc813-9c2c-4707-b44d-28429119bfeb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.221782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bc4bc813-9c2c-4707-b44d-28429119bfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:15.229072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f5721-e99d-4094-bded-4fab1680b400 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.234451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d986407-2b62-414a-9c2b-9a0305df65e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.235189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d986407-2b62-414a-9c2b-9a0305df65e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.235470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d986407-2b62-414a-9c2b-9a0305df65e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.235737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d986407-2b62-414a-9c2b-9a0305df65e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.236364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d986407-2b62-414a-9c2b-9a0305df65e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.238696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bc813-9c2c-4707-b44d-28429119bfeb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.238823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d986407-2b62-414a-9c2b-9a0305df65e2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.244699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.245441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.245839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.246225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] PATH_INFO: `/v3/projects/0e064fe295e64d5b98550de6d62766a5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.247677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e064fe295e64d5b98550de6d62766a5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.249844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.272676 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 702/1436] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:15 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:15.273650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d986407-2b62-414a-9c2b-9a0305df65e2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.285768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d986407-2b62-414a-9c2b-9a0305df65e2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.292771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da04728-2dbe-4a5d-9307-d1dd7a37aea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.293301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da04728-2dbe-4a5d-9307-d1dd7a37aea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.293579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da04728-2dbe-4a5d-9307-d1dd7a37aea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.293863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da04728-2dbe-4a5d-9307-d1dd7a37aea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.294492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da04728-2dbe-4a5d-9307-d1dd7a37aea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.296427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da04728-2dbe-4a5d-9307-d1dd7a37aea9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.306014 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:15.316725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e064fe295e64d5b98550de6d62766a5', 'request_id': 'req-c1367d2e-3da0-4c5c-be35-b572e5247d35'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:15.324071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e064fe295e64d5b98550de6d62766a5', 'request_id': 'req-c1367d2e-3da0-4c5c-be35-b572e5247d35'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:15.328645 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 703/1437] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:15 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:15.329841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da04728-2dbe-4a5d-9307-d1dd7a37aea9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.333837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e064fe295e64d5b98550de6d62766a5', 'request_id': 'req-c1367d2e-3da0-4c5c-be35-b572e5247d35'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:15.354083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] The token cache is being invalidate because project 0e064fe295e64d5b98550de6d62766a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:15.354365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:15.355078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:15.360796 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 735/1438] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:15 2022] DELETE /identity/v3/projects/0e064fe295e64d5b98550de6d62766a5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:15.360796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.361834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:15.401729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da04728-2dbe-4a5d-9307-d1dd7a37aea9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.407768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefe6b1-0bbf-4a7c-b3cf-a194cf9418f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.408527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefe6b1-0bbf-4a7c-b3cf-a194cf9418f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.408912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefe6b1-0bbf-4a7c-b3cf-a194cf9418f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.409284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefe6b1-0bbf-4a7c-b3cf-a194cf9418f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.410569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefe6b1-0bbf-4a7c-b3cf-a194cf9418f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:15.411119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefe6b1-0bbf-4a7c-b3cf-a194cf9418f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.412906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefe6b1-0bbf-4a7c-b3cf-a194cf9418f8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.427743 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 704/1439] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:15.429415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5d79-8bd1-4ce2-b668-a881e94459ba None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.429674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5d79-8bd1-4ce2-b668-a881e94459ba None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.430070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5d79-8bd1-4ce2-b668-a881e94459ba None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.431575 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 705/1440] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:15.432324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f5d79-8bd1-4ce2-b668-a881e94459ba None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.434086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b86f5d79-8bd1-4ce2-b668-a881e94459ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:15.446121 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:15.446388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1367d2e-3da0-4c5c-be35-b572e5247d35 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.451643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1671b-239a-4f0e-833d-3084eaf114ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.452260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1671b-239a-4f0e-833d-3084eaf114ee admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.452537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1671b-239a-4f0e-833d-3084eaf114ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.452802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1671b-239a-4f0e-833d-3084eaf114ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.453575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1671b-239a-4f0e-833d-3084eaf114ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.455146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f5d79-8bd1-4ce2-b668-a881e94459ba None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.455443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1671b-239a-4f0e-833d-3084eaf114ee admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.461292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bf924-8e38-4589-a878-e8697197369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.461910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bf924-8e38-4589-a878-e8697197369d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.462285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bf924-8e38-4589-a878-e8697197369d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.462562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bf924-8e38-4589-a878-e8697197369d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.463387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bf924-8e38-4589-a878-e8697197369d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.465319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bf924-8e38-4589-a878-e8697197369d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.469400 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 736/1441] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:15.469400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9721264-7c50-4773-86f5-f9e4adbb09eb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.469400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9721264-7c50-4773-86f5-f9e4adbb09eb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.469400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9721264-7c50-4773-86f5-f9e4adbb09eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.491780 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 706/1442] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:15 2022] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:15.492719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bf924-8e38-4589-a878-e8697197369d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.496565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a91bf924-8e38-4589-a878-e8697197369d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:15.496686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a9721264-7c50-4773-86f5-f9e4adbb09eb None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:15.497869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a9721264-7c50-4773-86f5-f9e4adbb09eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:15.506691 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 737/1443] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:15.507519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9721264-7c50-4773-86f5-f9e4adbb09eb None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:00:15.508770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a9721264-7c50-4773-86f5-f9e4adbb09eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:15.509872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bf924-8e38-4589-a878-e8697197369d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.515208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd2fbd-282a-404f-84b0-9da03295d18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.515826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd2fbd-282a-404f-84b0-9da03295d18f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.516113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd2fbd-282a-404f-84b0-9da03295d18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.516391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd2fbd-282a-404f-84b0-9da03295d18f admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.517026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd2fbd-282a-404f-84b0-9da03295d18f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.521730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd2fbd-282a-404f-84b0-9da03295d18f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.562117 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 707/1444] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:15 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:15.562117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd2fbd-282a-404f-84b0-9da03295d18f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.603902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9721264-7c50-4773-86f5-f9e4adbb09eb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.605146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a9721264-7c50-4773-86f5-f9e4adbb09eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:15.629442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd2fbd-282a-404f-84b0-9da03295d18f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.634297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e6c8e-081e-45be-9b32-39e3d96fc1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.634977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e6c8e-081e-45be-9b32-39e3d96fc1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.635258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e6c8e-081e-45be-9b32-39e3d96fc1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.635528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e6c8e-081e-45be-9b32-39e3d96fc1f8 admin admin] PATH_INFO: `/v3/projects/11045c23100f43a8b16b31c50c2456ff/users/f30c5a2958ce4d3c807f36eb12c6fa8a/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.652056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e6c8e-081e-45be-9b32-39e3d96fc1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11045c23100f43a8b16b31c50c2456ff, user_id=f30c5a2958ce4d3c807f36eb12c6fa8a, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.656131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e6c8e-081e-45be-9b32-39e3d96fc1f8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.667908 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:15.676214 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 708/1445] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:15 2022] PUT /identity/v3/projects/11045c23100f43a8b16b31c50c2456ff/users/f30c5a2958ce4d3c807f36eb12c6fa8a/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:15.677614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e6c8e-081e-45be-9b32-39e3d96fc1f8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.685656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9721264-7c50-4773-86f5-f9e4adbb09eb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.747296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e379fa-52bf-4ba2-80fd-3004b8c691fd tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e87e7bd1a4114926af6d6520e4a67b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37a10f4a46bc4cf987efd5db9700673c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.747781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e6c8e-081e-45be-9b32-39e3d96fc1f8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.747926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e379fa-52bf-4ba2-80fd-3004b8c691fd tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.748205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e379fa-52bf-4ba2-80fd-3004b8c691fd tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.748595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e379fa-52bf-4ba2-80fd-3004b8c691fd tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] PATH_INFO: `/v3/projects/445b59e2270d43dcb4cdab573023a1ae` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.749790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e379fa-52bf-4ba2-80fd-3004b8c691fd tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: Authorizing `identity:get_project(project_id=445b59e2270d43dcb4cdab573023a1ae)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.751942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e379fa-52bf-4ba2-80fd-3004b8c691fd tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.752487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f313cf5-7bf9-42d0-9f76-a2a2d44f28d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.753097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f313cf5-7bf9-42d0-9f76-a2a2d44f28d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.753973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f313cf5-7bf9-42d0-9f76-a2a2d44f28d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.754513 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 738/1446] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:00:15 2022] GET /identity/v3/projects/445b59e2270d43dcb4cdab573023a1ae => generated 393 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:15.754628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f313cf5-7bf9-42d0-9f76-a2a2d44f28d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.755375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f313cf5-7bf9-42d0-9f76-a2a2d44f28d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.755494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d929c-9388-402a-9fb4-e287924017df None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.755668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d929c-9388-402a-9fb4-e287924017df None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.755945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d929c-9388-402a-9fb4-e287924017df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.757056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f313cf5-7bf9-42d0-9f76-a2a2d44f28d9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.770364 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 709/1447] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:15.771886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f313cf5-7bf9-42d0-9f76-a2a2d44f28d9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.784039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f313cf5-7bf9-42d0-9f76-a2a2d44f28d9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.787332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6a7d929c-9388-402a-9fb4-e287924017df None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:15.788702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6a7d929c-9388-402a-9fb4-e287924017df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:15.791291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570454f4-4914-476f-922b-6638a562696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.791955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570454f4-4914-476f-922b-6638a562696d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.792401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570454f4-4914-476f-922b-6638a562696d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.792791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570454f4-4914-476f-922b-6638a562696d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.793521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570454f4-4914-476f-922b-6638a562696d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.795551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570454f4-4914-476f-922b-6638a562696d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.809223 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 739/1448] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:15.810823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d929c-9388-402a-9fb4-e287924017df None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.827216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d929c-9388-402a-9fb4-e287924017df None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.829088 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 710/1449] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:15 2022] POST /identity/v3/users => generated 295 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:15.830400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570454f4-4914-476f-922b-6638a562696d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.833441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7c4cf-8e1a-4c75-91c2-4395cc9b7327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.833728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7c4cf-8e1a-4c75-91c2-4395cc9b7327 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.834001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7c4cf-8e1a-4c75-91c2-4395cc9b7327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.834273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7c4cf-8e1a-4c75-91c2-4395cc9b7327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.834993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7c4cf-8e1a-4c75-91c2-4395cc9b7327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.837183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7c4cf-8e1a-4c75-91c2-4395cc9b7327 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.845962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570454f4-4914-476f-922b-6638a562696d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.854908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20137843-dc50-4999-b1d0-9b3dc3dbd58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.855772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20137843-dc50-4999-b1d0-9b3dc3dbd58b admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.856189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20137843-dc50-4999-b1d0-9b3dc3dbd58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.856566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20137843-dc50-4999-b1d0-9b3dc3dbd58b admin admin] PATH_INFO: `/v3/projects/9eec993c81b841ff8194a92d7b5a6878/users/506d51df24624b4396214acfd0c5e622/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.860457 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 740/1450] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:15.860457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7c4cf-8e1a-4c75-91c2-4395cc9b7327 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.881165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7c4cf-8e1a-4c75-91c2-4395cc9b7327 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.887680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38125a81-52cb-40e4-ae21-4f90718d1a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.888285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38125a81-52cb-40e4-ae21-4f90718d1a6c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.888561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38125a81-52cb-40e4-ae21-4f90718d1a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.888661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20137843-dc50-4999-b1d0-9b3dc3dbd58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eec993c81b841ff8194a92d7b5a6878, user_id=506d51df24624b4396214acfd0c5e622, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.888828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38125a81-52cb-40e4-ae21-4f90718d1a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.890095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38125a81-52cb-40e4-ae21-4f90718d1a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:15.890391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38125a81-52cb-40e4-ae21-4f90718d1a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.891819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20137843-dc50-4999-b1d0-9b3dc3dbd58b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.892190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38125a81-52cb-40e4-ae21-4f90718d1a6c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.909287 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 741/1452] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:15.909817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38125a81-52cb-40e4-ae21-4f90718d1a6c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.910524 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 711/1452] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:15 2022] PUT /identity/v3/projects/9eec993c81b841ff8194a92d7b5a6878/users/506d51df24624b4396214acfd0c5e622/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:15.911890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20137843-dc50-4999-b1d0-9b3dc3dbd58b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:15.916681 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:15.923238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38125a81-52cb-40e4-ae21-4f90718d1a6c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.983755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20137843-dc50-4999-b1d0-9b3dc3dbd58b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:15.989292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e5d4-5d8b-433d-812e-206e86a27f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.990075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e5d4-5d8b-433d-812e-206e86a27f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.990205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519d33-3cf2-44ea-9324-1de47d1f07a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:15.990651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e5d4-5d8b-433d-812e-206e86a27f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.990759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519d33-3cf2-44ea-9324-1de47d1f07a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:15.990867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e5d4-5d8b-433d-812e-206e86a27f66 admin admin] PATH_INFO: `/v3/projects/11045c23100f43a8b16b31c50c2456ff/users/f30c5a2958ce4d3c807f36eb12c6fa8a/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.991116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519d33-3cf2-44ea-9324-1de47d1f07a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:15.991596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519d33-3cf2-44ea-9324-1de47d1f07a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:15.992329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d519d33-3cf2-44ea-9324-1de47d1f07a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.993159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289e5d4-5d8b-433d-812e-206e86a27f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11045c23100f43a8b16b31c50c2456ff, user_id=f30c5a2958ce4d3c807f36eb12c6fa8a, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:15.994811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d519d33-3cf2-44ea-9324-1de47d1f07a8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:15.996759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289e5d4-5d8b-433d-812e-206e86a27f66 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:16.006700 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 742/1453] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:16.007448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519d33-3cf2-44ea-9324-1de47d1f07a8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:16.008526 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 712/1454] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:15 2022] PUT /identity/v3/projects/11045c23100f43a8b16b31c50c2456ff/users/f30c5a2958ce4d3c807f36eb12c6fa8a/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:16.011156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e5d4-5d8b-433d-812e-206e86a27f66 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:16.016318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8d519d33-3cf2-44ea-9324-1de47d1f07a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:16.029613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519d33-3cf2-44ea-9324-1de47d1f07a8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:16.086775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e5d4-5d8b-433d-812e-206e86a27f66 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:16.092365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7e82e-f77c-46cc-9d3f-76a332747fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:16.093202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7e82e-f77c-46cc-9d3f-76a332747fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.093573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7e82e-f77c-46cc-9d3f-76a332747fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.093850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7e82e-f77c-46cc-9d3f-76a332747fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.094631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7e82e-f77c-46cc-9d3f-76a332747fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:16.097756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7e82e-f77c-46cc-9d3f-76a332747fb3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:16.097890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183fb2b-4cfd-41d9-a04b-e465e630260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:16.098897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183fb2b-4cfd-41d9-a04b-e465e630260d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.099210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183fb2b-4cfd-41d9-a04b-e465e630260d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.099481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183fb2b-4cfd-41d9-a04b-e465e630260d admin admin] PATH_INFO: `/v3/users/b9794779bff74483839f7102a1344d59` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.100694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183fb2b-4cfd-41d9-a04b-e465e630260d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9794779bff74483839f7102a1344d59)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:16.102592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183fb2b-4cfd-41d9-a04b-e465e630260d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:16.113147 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 713/1455] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:16.113147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7e82e-f77c-46cc-9d3f-76a332747fb3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:16.114314 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:16.124663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7e82e-f77c-46cc-9d3f-76a332747fb3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:16.130216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d9e1f-6481-4c11-a999-183157283ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:16.130954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d9e1f-6481-4c11-a999-183157283ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.131140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d9e1f-6481-4c11-a999-183157283ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.131427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d9e1f-6481-4c11-a999-183157283ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.132148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d9e1f-6481-4c11-a999-183157283ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:16.134319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d9e1f-6481-4c11-a999-183157283ff2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:16.160951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1183fb2b-4cfd-41d9-a04b-e465e630260d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9794779bff74483839f7102a1344d59'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:16.161641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1183fb2b-4cfd-41d9-a04b-e465e630260d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9794779bff74483839f7102a1344d59'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:16.169055 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 714/1456] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:16 2022] POST /identity/v3/projects => generated 397 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:16.169718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d9e1f-6481-4c11-a999-183157283ff2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:16.171377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-958d9e1f-6481-4c11-a999-183157283ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:16.179169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1183fb2b-4cfd-41d9-a04b-e465e630260d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9794779bff74483839f7102a1344d59'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:16.188387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1183fb2b-4cfd-41d9-a04b-e465e630260d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9794779bff74483839f7102a1344d59'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:16.189211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1183fb2b-4cfd-41d9-a04b-e465e630260d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9794779bff74483839f7102a1344d59'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:16.209023 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 743/1457] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:16 2022] DELETE /identity/v3/users/b9794779bff74483839f7102a1344d59 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:16.209023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53683395-23fb-405a-9ecd-1e48bc9ee919 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.209023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53683395-23fb-405a-9ecd-1e48bc9ee919 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.209023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53683395-23fb-405a-9ecd-1e48bc9ee919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.244529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-53683395-23fb-405a-9ecd-1e48bc9ee919 None None] MFA Rules not processed for user `f30c5a2958ce4d3c807f36eb12c6fa8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:16.245722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-53683395-23fb-405a-9ecd-1e48bc9ee919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:16.254674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d9e1f-6481-4c11-a999-183157283ff2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:16.269504 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:16.320727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603e140-3ef7-4b48-9f44-108b80e6e607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:16.321335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e140-3ef7-4b48-9f44-108b80e6e607 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.321615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e140-3ef7-4b48-9f44-108b80e6e607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.321886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e140-3ef7-4b48-9f44-108b80e6e607 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.322533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603e140-3ef7-4b48-9f44-108b80e6e607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:16.324172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603e140-3ef7-4b48-9f44-108b80e6e607 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:16.333694 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 744/1458] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:16.334601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53683395-23fb-405a-9ecd-1e48bc9ee919 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:16.335944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-53683395-23fb-405a-9ecd-1e48bc9ee919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:16.336559 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 715/1459] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:16.340594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603e140-3ef7-4b48-9f44-108b80e6e607 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:16.342500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c603e140-3ef7-4b48-9f44-108b80e6e607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:16.351512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53683395-23fb-405a-9ecd-1e48bc9ee919 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:16.357196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603e140-3ef7-4b48-9f44-108b80e6e607 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:16.357848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f91f4a-5ea3-49f8-963b-9a698e61fb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:16.358783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f91f4a-5ea3-49f8-963b-9a698e61fb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.359242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f91f4a-5ea3-49f8-963b-9a698e61fb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.359673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f91f4a-5ea3-49f8-963b-9a698e61fb12 admin admin] PATH_INFO: `/v3/projects/9eec993c81b841ff8194a92d7b5a6878/users/506d51df24624b4396214acfd0c5e622/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.361971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36dc27-ee5c-4802-8402-6878b157ac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:16.362355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f91f4a-5ea3-49f8-963b-9a698e61fb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eec993c81b841ff8194a92d7b5a6878, user_id=506d51df24624b4396214acfd0c5e622, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:16.363223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36dc27-ee5c-4802-8402-6878b157ac16 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.363549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36dc27-ee5c-4802-8402-6878b157ac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.364092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36dc27-ee5c-4802-8402-6878b157ac16 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.364496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36dc27-ee5c-4802-8402-6878b157ac16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:16.366428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36dc27-ee5c-4802-8402-6878b157ac16 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:16.367222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f91f4a-5ea3-49f8-963b-9a698e61fb12 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:16.382979 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 745/1460] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:16 2022] PUT /identity/v3/projects/9eec993c81b841ff8194a92d7b5a6878/users/506d51df24624b4396214acfd0c5e622/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:16.384494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4894cb8-7325-460c-8b38-20515d206873 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.384937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4894cb8-7325-460c-8b38-20515d206873 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.385120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4894cb8-7325-460c-8b38-20515d206873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.396487 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 716/1461] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:16 2022] POST /identity/v3/users => generated 299 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:16.397590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36dc27-ee5c-4802-8402-6878b157ac16 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:16.411510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36dc27-ee5c-4802-8402-6878b157ac16 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:16.415225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d4894cb8-7325-460c-8b38-20515d206873 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:16.416961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d4894cb8-7325-460c-8b38-20515d206873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:16.483921 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:16.489742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8b757-4c84-4430-b6a7-9ddac7d2377e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:16.490511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8b757-4c84-4430-b6a7-9ddac7d2377e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.490862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8b757-4c84-4430-b6a7-9ddac7d2377e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.491226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8b757-4c84-4430-b6a7-9ddac7d2377e admin admin] PATH_INFO: `/v3/projects/fe180137bac444979f1b017028e2be7d/users/98e127ab527e4a1b9f18090223112cdb/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.498564 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 746/1462] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:16.500366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4894cb8-7325-460c-8b38-20515d206873 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:16.502307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d4894cb8-7325-460c-8b38-20515d206873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:16.517702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8b757-4c84-4430-b6a7-9ddac7d2377e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe180137bac444979f1b017028e2be7d, user_id=98e127ab527e4a1b9f18090223112cdb, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:16.521150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8b757-4c84-4430-b6a7-9ddac7d2377e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:16.536044 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 717/1463] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:16 2022] PUT /identity/v3/projects/fe180137bac444979f1b017028e2be7d/users/98e127ab527e4a1b9f18090223112cdb/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:16.537577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817afa91-9375-4c3b-a9bd-a2c395f0f3f4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.537934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817afa91-9375-4c3b-a9bd-a2c395f0f3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.538285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817afa91-9375-4c3b-a9bd-a2c395f0f3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.571166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-817afa91-9375-4c3b-a9bd-a2c395f0f3f4 None None] MFA Rules not processed for user `506d51df24624b4396214acfd0c5e622`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:16.572380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-817afa91-9375-4c3b-a9bd-a2c395f0f3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:16.588866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4894cb8-7325-460c-8b38-20515d206873 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:16.644892 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 718/1464] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:16.645657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817afa91-9375-4c3b-a9bd-a2c395f0f3f4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:16.650339 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:16.664801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2631b-5b8e-4c3a-9c80-36455864bc74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:16.665421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2631b-5b8e-4c3a-9c80-36455864bc74 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.665961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2631b-5b8e-4c3a-9c80-36455864bc74 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.666230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2631b-5b8e-4c3a-9c80-36455864bc74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.668046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1fc2631b-5b8e-4c3a-9c80-36455864bc74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:16.715857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817afa91-9375-4c3b-a9bd-a2c395f0f3f4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:16.727115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afae4d-7f65-498d-a77d-00098de35b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:16.727905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afae4d-7f65-498d-a77d-00098de35b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.728253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afae4d-7f65-498d-a77d-00098de35b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.728628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afae4d-7f65-498d-a77d-00098de35b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.729390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afae4d-7f65-498d-a77d-00098de35b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:16.732125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afae4d-7f65-498d-a77d-00098de35b2a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:16.741910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2631b-5b8e-4c3a-9c80-36455864bc74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:16.743702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2631b-5b8e-4c3a-9c80-36455864bc74 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:16.747401 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 719/1465] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:16.747401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afae4d-7f65-498d-a77d-00098de35b2a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:16.748187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f7afae4d-7f65-498d-a77d-00098de35b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:16.755737 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 747/1466] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:16.757216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2403-cc65-4a10-a728-b0fae670dab4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.757614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2403-cc65-4a10-a728-b0fae670dab4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.757893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2403-cc65-4a10-a728-b0fae670dab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.798014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-728e2403-cc65-4a10-a728-b0fae670dab4 None None] MFA Rules not processed for user `98e127ab527e4a1b9f18090223112cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:16.799845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-728e2403-cc65-4a10-a728-b0fae670dab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:16.837112 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:16.844753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afae4d-7f65-498d-a77d-00098de35b2a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:16.849716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124c8d4-8e6d-43f4-bf6d-35ecbe03269f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:16.850342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124c8d4-8e6d-43f4-bf6d-35ecbe03269f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.850614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124c8d4-8e6d-43f4-bf6d-35ecbe03269f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.850882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124c8d4-8e6d-43f4-bf6d-35ecbe03269f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.860832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124c8d4-8e6d-43f4-bf6d-35ecbe03269f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:16.862289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124c8d4-8e6d-43f4-bf6d-35ecbe03269f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:16.873412 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 720/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:16.874267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124c8d4-8e6d-43f4-bf6d-35ecbe03269f service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:16.886542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124c8d4-8e6d-43f4-bf6d-35ecbe03269f service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:16.892880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10b149-61fb-4fd9-87ef-35f0a2e9ddbe tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506d51df24624b4396214acfd0c5e622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9eec993c81b841ff8194a92d7b5a6878', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:16.893574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10b149-61fb-4fd9-87ef-35f0a2e9ddbe tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.894667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10b149-61fb-4fd9-87ef-35f0a2e9ddbe tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.895369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10b149-61fb-4fd9-87ef-35f0a2e9ddbe tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.895930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10b149-61fb-4fd9-87ef-35f0a2e9ddbe tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:16.896316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10b149-61fb-4fd9-87ef-35f0a2e9ddbe tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:16.898494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10b149-61fb-4fd9-87ef-35f0a2e9ddbe tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:16.907924 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 748/1468] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:16.907924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2403-cc65-4a10-a728-b0fae670dab4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:16.917127 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 721/1469] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:16.918860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10b149-61fb-4fd9-87ef-35f0a2e9ddbe tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:16.921778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4b10b149-61fb-4fd9-87ef-35f0a2e9ddbe tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:16.924004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2403-cc65-4a10-a728-b0fae670dab4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:16.930728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c17f26-2ef6-41b8-b01b-32dc329c89c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:16.931483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c17f26-2ef6-41b8-b01b-32dc329c89c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.931769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c17f26-2ef6-41b8-b01b-32dc329c89c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.932091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c17f26-2ef6-41b8-b01b-32dc329c89c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.933305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c17f26-2ef6-41b8-b01b-32dc329c89c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:16.936500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c17f26-2ef6-41b8-b01b-32dc329c89c5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:16.942112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10b149-61fb-4fd9-87ef-35f0a2e9ddbe tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:16.949132 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 749/1470] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:16.952872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:16.953486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9d8a0-6392-4d35-adf2-e3d0512a12e6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.953649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:16.953809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9d8a0-6392-4d35-adf2-e3d0512a12e6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.953959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:16.954123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9d8a0-6392-4d35-adf2-e3d0512a12e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.954208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] PATH_INFO: `/v3/users/656af6e3a8db4e3e9a27011215309fb8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:16.955605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=656af6e3a8db4e3e9a27011215309fb8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:16.959228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:17.028179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ffa9d8a0-6392-4d35-adf2-e3d0512a12e6 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:17.029437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ffa9d8a0-6392-4d35-adf2-e3d0512a12e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:17.032609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656af6e3a8db4e3e9a27011215309fb8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:17.033838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656af6e3a8db4e3e9a27011215309fb8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:17.051819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656af6e3a8db4e3e9a27011215309fb8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:17.069039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656af6e3a8db4e3e9a27011215309fb8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:17.070704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656af6e3a8db4e3e9a27011215309fb8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:17.107638 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 722/1471] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:16 2022] DELETE /identity/v3/users/656af6e3a8db4e3e9a27011215309fb8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:17.109093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:17.111726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:17.124148 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:17.141050 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 750/1472] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:17.142729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9d8a0-6392-4d35-adf2-e3d0512a12e6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:17.145639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ffa9d8a0-6392-4d35-adf2-e3d0512a12e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:17.177040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9d8a0-6392-4d35-adf2-e3d0512a12e6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:17.245306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e25a8-af7a-40aa-ba9e-7231878fb17f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:17.253650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb248ff1-9cb9-4437-a329-e72341e97a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:17.254379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb248ff1-9cb9-4437-a329-e72341e97a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:17.254686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb248ff1-9cb9-4437-a329-e72341e97a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:17.255010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb248ff1-9cb9-4437-a329-e72341e97a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:17.255867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb248ff1-9cb9-4437-a329-e72341e97a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:17.257884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb248ff1-9cb9-4437-a329-e72341e97a8c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:17.303878 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 723/1473] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:17 2022] POST /identity/v3/projects => generated 391 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:17.305415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb248ff1-9cb9-4437-a329-e72341e97a8c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:17.308315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fb248ff1-9cb9-4437-a329-e72341e97a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:17.323663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189273d8-4de6-484c-af37-18d058b877fa tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506d51df24624b4396214acfd0c5e622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9eec993c81b841ff8194a92d7b5a6878', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:17.324603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189273d8-4de6-484c-af37-18d058b877fa tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:17.325649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189273d8-4de6-484c-af37-18d058b877fa tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:17.325936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189273d8-4de6-484c-af37-18d058b877fa tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:17.328061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189273d8-4de6-484c-af37-18d058b877fa tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:17.335383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189273d8-4de6-484c-af37-18d058b877fa tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:17.391416 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 751/1474] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:17 2022] POST /identity/v3/projects => generated 371 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:17.392916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b90be6-af5b-48e1-9a80-ffc41236ad30 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:17.393207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b90be6-af5b-48e1-9a80-ffc41236ad30 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:17.393541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b90be6-af5b-48e1-9a80-ffc41236ad30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:17.416398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f1b90be6-af5b-48e1-9a80-ffc41236ad30 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:17.417556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f1b90be6-af5b-48e1-9a80-ffc41236ad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:17.423032 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:17.432028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb248ff1-9cb9-4437-a329-e72341e97a8c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:17.490796 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 752/1475] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:17.492012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b90be6-af5b-48e1-9a80-ffc41236ad30 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:17.501863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b90be6-af5b-48e1-9a80-ffc41236ad30 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:17.508105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045867e-bbb0-4687-b816-1d4244ece03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:17.509345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045867e-bbb0-4687-b816-1d4244ece03a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:17.509345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045867e-bbb0-4687-b816-1d4244ece03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:17.509615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045867e-bbb0-4687-b816-1d4244ece03a admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:17.510144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045867e-bbb0-4687-b816-1d4244ece03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:17.512128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045867e-bbb0-4687-b816-1d4244ece03a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:17.515942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9615c6-6cb5-4214-97d7-75474320b4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:17.516819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9615c6-6cb5-4214-97d7-75474320b4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:17.517233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9615c6-6cb5-4214-97d7-75474320b4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:17.518271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9615c6-6cb5-4214-97d7-75474320b4c0 admin admin] PATH_INFO: `/v3/projects/e9173928e9c94d31b8d2eca240e28d50/users/5f46ddd0268d44bfacff0400e3f38e7e/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:17.539267 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 753/1476] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:17 2022] POST /identity/v3/users => generated 302 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:17.540262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045867e-bbb0-4687-b816-1d4244ece03a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:17.543059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9045867e-bbb0-4687-b816-1d4244ece03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:17.543195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9615c6-6cb5-4214-97d7-75474320b4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9173928e9c94d31b8d2eca240e28d50, user_id=5f46ddd0268d44bfacff0400e3f38e7e, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:17.548463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9615c6-6cb5-4214-97d7-75474320b4c0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:17.560370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045867e-bbb0-4687-b816-1d4244ece03a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:17.569431 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 724/1477] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:17 2022] PUT /identity/v3/projects/e9173928e9c94d31b8d2eca240e28d50/users/5f46ddd0268d44bfacff0400e3f38e7e/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:17.570281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9615c6-6cb5-4214-97d7-75474320b4c0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:17.574223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-da9615c6-6cb5-4214-97d7-75474320b4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:17.605089 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:17.633544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:17.634204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:17.634468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:17.634744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] PATH_INFO: `/v3/projects/4afeba85d0bc4d87ba15ccf94db80957` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:17.635947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4afeba85d0bc4d87ba15ccf94db80957)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:17.637928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:17.695161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9615c6-6cb5-4214-97d7-75474320b4c0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:17.695714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4afeba85d0bc4d87ba15ccf94db80957', 'request_id': 'req-ae3ba378-f697-4c17-98bc-5c30f1658752'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:17.706167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4afeba85d0bc4d87ba15ccf94db80957', 'request_id': 'req-ae3ba378-f697-4c17-98bc-5c30f1658752'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:17.715601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4afeba85d0bc4d87ba15ccf94db80957', 'request_id': 'req-ae3ba378-f697-4c17-98bc-5c30f1658752'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:17.731111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] The token cache is being invalidate because project 4afeba85d0bc4d87ba15ccf94db80957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:17.731592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:17.732669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:17.734509 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 754/1478] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:17 2022] DELETE /identity/v3/projects/4afeba85d0bc4d87ba15ccf94db80957 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:17.735250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:17.737433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:17.771976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2946b-90bb-49dd-a174-553beaac4ad4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:17.773164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2946b-90bb-49dd-a174-553beaac4ad4 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:17.773164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2946b-90bb-49dd-a174-553beaac4ad4 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:17.773370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2946b-90bb-49dd-a174-553beaac4ad4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:17.774226 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:17.775750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2db2946b-90bb-49dd-a174-553beaac4ad4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:17.827573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ba378-f697-4c17-98bc-5c30f1658752 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:17.834530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d4089-7fef-4357-9e16-ea69930bac38 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506d51df24624b4396214acfd0c5e622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9eec993c81b841ff8194a92d7b5a6878', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:17.835703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d4089-7fef-4357-9e16-ea69930bac38 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:17.836170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d4089-7fef-4357-9e16-ea69930bac38 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:17.836508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d4089-7fef-4357-9e16-ea69930bac38 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:17.837233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d4089-7fef-4357-9e16-ea69930bac38 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:17.839748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d4089-7fef-4357-9e16-ea69930bac38 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:17.839748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d4089-7fef-4357-9e16-ea69930bac38 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:17.855353 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 755/1479] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:17.855353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d4089-7fef-4357-9e16-ea69930bac38 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:17.855617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2946b-90bb-49dd-a174-553beaac4ad4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:17.856926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2946b-90bb-49dd-a174-553beaac4ad4 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:17.857148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ee4d4089-7fef-4357-9e16-ea69930bac38 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:17.868290 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 725/1480] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:00:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:17.869714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2946b-90bb-49dd-a174-553beaac4ad4 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:17.871550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2db2946b-90bb-49dd-a174-553beaac4ad4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:17.932044 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:17.963425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d4089-7fef-4357-9e16-ea69930bac38 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:17.974153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9269ead-7aca-4737-8af5-4de2d42fbed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:17.975212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9269ead-7aca-4737-8af5-4de2d42fbed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:17.976087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9269ead-7aca-4737-8af5-4de2d42fbed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:17.976270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9269ead-7aca-4737-8af5-4de2d42fbed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:17.978321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b9269ead-7aca-4737-8af5-4de2d42fbed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:17.978704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2946b-90bb-49dd-a174-553beaac4ad4 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:17.983906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ab864-a5bd-4e6a-8f62-37453d376dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:17.984487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab864-a5bd-4e6a-8f62-37453d376dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:17.984862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab864-a5bd-4e6a-8f62-37453d376dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:17.985142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab864-a5bd-4e6a-8f62-37453d376dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:17.985785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ab864-a5bd-4e6a-8f62-37453d376dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:17.995110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ab864-a5bd-4e6a-8f62-37453d376dd8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:18.002644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9269ead-7aca-4737-8af5-4de2d42fbed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:18.005266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9269ead-7aca-4737-8af5-4de2d42fbed9 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:18.014130 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 726/1481] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:18.015616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869853fd-39e1-4ec9-8949-9c8e70a62791 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:18.015903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869853fd-39e1-4ec9-8949-9c8e70a62791 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:18.016175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869853fd-39e1-4ec9-8949-9c8e70a62791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:18.035163 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 756/1482] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:18.036182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9269ead-7aca-4737-8af5-4de2d42fbed9 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:18.042228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b9269ead-7aca-4737-8af5-4de2d42fbed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:18.046723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-869853fd-39e1-4ec9-8949-9c8e70a62791 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:18.048003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-869853fd-39e1-4ec9-8949-9c8e70a62791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:18.076969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9269ead-7aca-4737-8af5-4de2d42fbed9 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:18.097844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:18.098710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:18.098966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:18.099319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] PATH_INFO: `/v3/users/e87e7bd1a4114926af6d6520e4a67b88` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:18.101108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87e7bd1a4114926af6d6520e4a67b88)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:18.102852 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 727/1483] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:18.103214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:18.103939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869853fd-39e1-4ec9-8949-9c8e70a62791 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:18.106393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-869853fd-39e1-4ec9-8949-9c8e70a62791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:18.253098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87e7bd1a4114926af6d6520e4a67b88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:18.254943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87e7bd1a4114926af6d6520e4a67b88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:18.290983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87e7bd1a4114926af6d6520e4a67b88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:18.308193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87e7bd1a4114926af6d6520e4a67b88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:18.309379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87e7bd1a4114926af6d6520e4a67b88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:18.324887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869853fd-39e1-4ec9-8949-9c8e70a62791 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:18.338070 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 757/1484] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:18 2022] DELETE /identity/v3/users/e87e7bd1a4114926af6d6520e4a67b88 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:18.340949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:18.348685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:18.355102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db8d5c-771b-4568-9357-349b128c47a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:18.355739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db8d5c-771b-4568-9357-349b128c47a7 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:18.356018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db8d5c-771b-4568-9357-349b128c47a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:18.356290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db8d5c-771b-4568-9357-349b128c47a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:18.371670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d9db8d5c-771b-4568-9357-349b128c47a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:18.409101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db8d5c-771b-4568-9357-349b128c47a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:18.417139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db8d5c-771b-4568-9357-349b128c47a7 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:18.466084 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 728/1485] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:18.468495 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:18.473180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1845aeb-0f24-4079-8b26-fb8d5e2a91d1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:18.473533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1845aeb-0f24-4079-8b26-fb8d5e2a91d1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:18.474393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1845aeb-0f24-4079-8b26-fb8d5e2a91d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:18.598268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e1845aeb-0f24-4079-8b26-fb8d5e2a91d1 None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:18.599900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e1845aeb-0f24-4079-8b26-fb8d5e2a91d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:18.625907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bc025-4410-4f3c-9a95-a04fbcd16161 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:18.651445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4789d-f156-48be-ac62-8793fc4ee31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:18.652130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4789d-f156-48be-ac62-8793fc4ee31e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:18.652410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4789d-f156-48be-ac62-8793fc4ee31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:18.661395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4789d-f156-48be-ac62-8793fc4ee31e admin admin] PATH_INFO: `/v3/projects/a5d8a66f647e406a99aec5b6c818f756/users/351604bd0ecd4980b3b9b506adb99a36/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:18.692564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4789d-f156-48be-ac62-8793fc4ee31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d8a66f647e406a99aec5b6c818f756, user_id=351604bd0ecd4980b3b9b506adb99a36, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:18.698333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4789d-f156-48be-ac62-8793fc4ee31e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:18.712690 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 729/1486] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Oct 16 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:18.713996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1845aeb-0f24-4079-8b26-fb8d5e2a91d1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:18.725922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e1845aeb-0f24-4079-8b26-fb8d5e2a91d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:18.732780 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 758/1487] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:18 2022] PUT /identity/v3/projects/a5d8a66f647e406a99aec5b6c818f756/users/351604bd0ecd4980b3b9b506adb99a36/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:18.736649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b25998-1794-4dff-830f-a0804924c0d6 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:18.737046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b25998-1794-4dff-830f-a0804924c0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:18.737457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b25998-1794-4dff-830f-a0804924c0d6 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:18.742469 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 759/1488] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:18.743633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b25998-1794-4dff-830f-a0804924c0d6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:18.749329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-85b25998-1794-4dff-830f-a0804924c0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:18.752057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1845aeb-0f24-4079-8b26-fb8d5e2a91d1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:18.884928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f71a70-26a2-4e5a-9c64-368bc82ab0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:18.885797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71a70-26a2-4e5a-9c64-368bc82ab0aa service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:18.887066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71a70-26a2-4e5a-9c64-368bc82ab0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:18.888130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71a70-26a2-4e5a-9c64-368bc82ab0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:18.899323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-09f71a70-26a2-4e5a-9c64-368bc82ab0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:18.915394 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:18.936938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b25998-1794-4dff-830f-a0804924c0d6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:18.952844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:18.953351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:18.953757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:18.954298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] PATH_INFO: `/v3/projects/37a10f4a46bc4cf987efd5db9700673c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:18.958255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a10f4a46bc4cf987efd5db9700673c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:18.964941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:19.056602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f71a70-26a2-4e5a-9c64-368bc82ab0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:19.058564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f71a70-26a2-4e5a-9c64-368bc82ab0aa service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:19.074967 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 730/1489] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:19.076471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f71a70-26a2-4e5a-9c64-368bc82ab0aa service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:19.094277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f71a70-26a2-4e5a-9c64-368bc82ab0aa service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:19.096779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a10f4a46bc4cf987efd5db9700673c', 'request_id': 'req-fb2436a7-47ce-46db-b341-2c02b4814c8a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:19.115831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a10f4a46bc4cf987efd5db9700673c', 'request_id': 'req-fb2436a7-47ce-46db-b341-2c02b4814c8a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:19.140119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a10f4a46bc4cf987efd5db9700673c', 'request_id': 'req-fb2436a7-47ce-46db-b341-2c02b4814c8a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:19.182321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] The token cache is being invalidate because project 37a10f4a46bc4cf987efd5db9700673c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:19.182618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:19.189772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:19.197494 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 760/1490] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:18 2022] DELETE /identity/v3/projects/37a10f4a46bc4cf987efd5db9700673c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:19.199355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:00:19.203860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:19.218514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324055f2-e8ae-4559-9426-474b04cfb6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:19.219353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324055f2-e8ae-4559-9426-474b04cfb6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:19.219737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324055f2-e8ae-4559-9426-474b04cfb6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:19.220320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324055f2-e8ae-4559-9426-474b04cfb6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:19.221377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324055f2-e8ae-4559-9426-474b04cfb6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:19.224236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324055f2-e8ae-4559-9426-474b04cfb6d5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:19.240065 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 731/1491] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:19.241151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324055f2-e8ae-4559-9426-474b04cfb6d5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:19.244208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-324055f2-e8ae-4559-9426-474b04cfb6d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:19.328554 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:19.365279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324055f2-e8ae-4559-9426-474b04cfb6d5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:19.371942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bb017-fe41-4a79-820f-baf571a0ad13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:19.373362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bb017-fe41-4a79-820f-baf571a0ad13 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:19.373952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bb017-fe41-4a79-820f-baf571a0ad13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:19.374857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bb017-fe41-4a79-820f-baf571a0ad13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:19.379060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ec5bb017-fe41-4a79-820f-baf571a0ad13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:19.403476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bb017-fe41-4a79-820f-baf571a0ad13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:19.405230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:19.407030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:19.411189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bb017-fe41-4a79-820f-baf571a0ad13 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:19.444259 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 732/1492] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:19.447538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bb017-fe41-4a79-820f-baf571a0ad13 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:19.453846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ec5bb017-fe41-4a79-820f-baf571a0ad13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:19.496273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bb017-fe41-4a79-820f-baf571a0ad13 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:19.504092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:19.505351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:19.506247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:19.506674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] PATH_INFO: `/v3/projects/c388114ccddd410a98d50e0a04d659ba` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:19.508209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c388114ccddd410a98d50e0a04d659ba)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:19.511220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:19.584330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2436a7-47ce-46db-b341-2c02b4814c8a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:19.592276 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:19.621738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c388114ccddd410a98d50e0a04d659ba', 'request_id': 'req-e20e18ee-5ce8-49ac-99e6-4bda119ff095'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:19.642605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c388114ccddd410a98d50e0a04d659ba', 'request_id': 'req-e20e18ee-5ce8-49ac-99e6-4bda119ff095'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:19.665565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c388114ccddd410a98d50e0a04d659ba', 'request_id': 'req-e20e18ee-5ce8-49ac-99e6-4bda119ff095'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:19.697921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] The token cache is being invalidate because project c388114ccddd410a98d50e0a04d659ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:19.699135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:19.699997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:19.706974 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 733/1493] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:19 2022] DELETE /identity/v3/projects/c388114ccddd410a98d50e0a04d659ba => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:19.706974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:19.706974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:19.752546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b792d-c129-4cf7-82e0-9acdf92929de tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506d51df24624b4396214acfd0c5e622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9eec993c81b841ff8194a92d7b5a6878', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:19.753933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b792d-c129-4cf7-82e0-9acdf92929de tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:19.755529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b792d-c129-4cf7-82e0-9acdf92929de tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:19.755967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b792d-c129-4cf7-82e0-9acdf92929de tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] PATH_INFO: `/v3/projects/a919e52c25ae4e9ea96e13fbf2d16b39` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:19.764660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b792d-c129-4cf7-82e0-9acdf92929de tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorizing `identity:get_project(project_id=a919e52c25ae4e9ea96e13fbf2d16b39)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:19.771906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b792d-c129-4cf7-82e0-9acdf92929de tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:19.778344 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 761/1494] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:00:19 2022] GET /identity/v3/projects/a919e52c25ae4e9ea96e13fbf2d16b39 => generated 371 bytes in 581 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:19.779742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b792d-c129-4cf7-82e0-9acdf92929de tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:19.785070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ae9b792d-c129-4cf7-82e0-9acdf92929de tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:19.898300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e18ee-5ce8-49ac-99e6-4bda119ff095 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:19.915898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16cd29-5b17-459c-b9df-8c73cc908aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:19.917174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16cd29-5b17-459c-b9df-8c73cc908aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:19.918711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16cd29-5b17-459c-b9df-8c73cc908aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:19.918711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16cd29-5b17-459c-b9df-8c73cc908aef admin admin] PATH_INFO: `/v3/users/f9ad267ec0d6487486dd78d22c098318` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:19.921854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16cd29-5b17-459c-b9df-8c73cc908aef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ad267ec0d6487486dd78d22c098318)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:19.924766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16cd29-5b17-459c-b9df-8c73cc908aef admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:19.966971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b792d-c129-4cf7-82e0-9acdf92929de tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:19.984642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cb036-7623-4c1b-9b89-6423668b41c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:19.985664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cb036-7623-4c1b-9b89-6423668b41c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:19.986040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cb036-7623-4c1b-9b89-6423668b41c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:19.988548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cb036-7623-4c1b-9b89-6423668b41c8 admin admin] PATH_INFO: `/v3/projects/a5d8a66f647e406a99aec5b6c818f756/users/351604bd0ecd4980b3b9b506adb99a36/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:19.993392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cb036-7623-4c1b-9b89-6423668b41c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d8a66f647e406a99aec5b6c818f756, user_id=351604bd0ecd4980b3b9b506adb99a36, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:20.007414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cb036-7623-4c1b-9b89-6423668b41c8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:20.047524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6d16cd29-5b17-459c-b9df-8c73cc908aef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ad267ec0d6487486dd78d22c098318'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:20.051126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6d16cd29-5b17-459c-b9df-8c73cc908aef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ad267ec0d6487486dd78d22c098318'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:20.055102 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 762/1495] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:19 2022] PUT /identity/v3/projects/a5d8a66f647e406a99aec5b6c818f756/users/351604bd0ecd4980b3b9b506adb99a36/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:20.056154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cb036-7623-4c1b-9b89-6423668b41c8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:20.064921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-609cb036-7623-4c1b-9b89-6423668b41c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:20.084872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6d16cd29-5b17-459c-b9df-8c73cc908aef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ad267ec0d6487486dd78d22c098318'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:20.096475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6d16cd29-5b17-459c-b9df-8c73cc908aef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ad267ec0d6487486dd78d22c098318'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:20.099397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6d16cd29-5b17-459c-b9df-8c73cc908aef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ad267ec0d6487486dd78d22c098318'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:20.141708 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:20.151875 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 734/1496] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:19 2022] DELETE /identity/v3/users/f9ad267ec0d6487486dd78d22c098318 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:20.169033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98594bc5-2be6-4da7-8701-764d0e5917e6 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:20.169494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98594bc5-2be6-4da7-8701-764d0e5917e6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:20.170542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98594bc5-2be6-4da7-8701-764d0e5917e6 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:20.183645 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 735/1497] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:20 2022] GET /identity => generated 270 bytes in 34 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:20.188771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a0235-b38f-4406-984d-2d41e8c8d842 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:20.192951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a0235-b38f-4406-984d-2d41e8c8d842 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:20.192951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a0235-b38f-4406-984d-2d41e8c8d842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:20.216484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cb036-7623-4c1b-9b89-6423668b41c8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:20.275861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-787a0235-b38f-4406-984d-2d41e8c8d842 None None] MFA Rules not processed for user `351604bd0ecd4980b3b9b506adb99a36`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:20.277073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-787a0235-b38f-4406-984d-2d41e8c8d842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:20.331120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f420d06-0e13-4507-a12d-06adbfcc6251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:20.334330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f420d06-0e13-4507-a12d-06adbfcc6251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:20.334828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f420d06-0e13-4507-a12d-06adbfcc6251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:20.335380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f420d06-0e13-4507-a12d-06adbfcc6251 admin admin] PATH_INFO: `/v3/users/f30c5a2958ce4d3c807f36eb12c6fa8a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:20.336933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f420d06-0e13-4507-a12d-06adbfcc6251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30c5a2958ce4d3c807f36eb12c6fa8a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:20.340147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f420d06-0e13-4507-a12d-06adbfcc6251 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:20.369004 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:20.443938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3f420d06-0e13-4507-a12d-06adbfcc6251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30c5a2958ce4d3c807f36eb12c6fa8a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:20.444632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3f420d06-0e13-4507-a12d-06adbfcc6251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30c5a2958ce4d3c807f36eb12c6fa8a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:20.445610 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 736/1498] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:20.448257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a0235-b38f-4406-984d-2d41e8c8d842 None None] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:00:20.451191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-787a0235-b38f-4406-984d-2d41e8c8d842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:20.466809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3f420d06-0e13-4507-a12d-06adbfcc6251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30c5a2958ce4d3c807f36eb12c6fa8a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:20.482738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3f420d06-0e13-4507-a12d-06adbfcc6251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30c5a2958ce4d3c807f36eb12c6fa8a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:20.483477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3f420d06-0e13-4507-a12d-06adbfcc6251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30c5a2958ce4d3c807f36eb12c6fa8a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:20.510043 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 763/1499] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:20 2022] DELETE /identity/v3/users/f30c5a2958ce4d3c807f36eb12c6fa8a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:20.514403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89e38f-6d7c-48f6-96cf-818a84d5d15e None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:20.514695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89e38f-6d7c-48f6-96cf-818a84d5d15e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:20.515020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89e38f-6d7c-48f6-96cf-818a84d5d15e None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:20.518355 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 764/1500] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:20.525766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2db47-f2e9-4740-b979-c9f3265239d8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:20.526108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2db47-f2e9-4740-b979-c9f3265239d8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:20.526375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2db47-f2e9-4740-b979-c9f3265239d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:20.574273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c5f2db47-f2e9-4740-b979-c9f3265239d8 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:20.575676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c5f2db47-f2e9-4740-b979-c9f3265239d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:20.648918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a0235-b38f-4406-984d-2d41e8c8d842 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:20.652375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-787a0235-b38f-4406-984d-2d41e8c8d842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:20.661586 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:20.712680 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 765/1501] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:20.733128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2db47-f2e9-4740-b979-c9f3265239d8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:20.735185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c5f2db47-f2e9-4740-b979-c9f3265239d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:20.838105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a0235-b38f-4406-984d-2d41e8c8d842 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:20.893136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2db47-f2e9-4740-b979-c9f3265239d8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:20.901583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6e46b-4f17-400c-ad58-ab441d5c141b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:20.902589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6e46b-4f17-400c-ad58-ab441d5c141b service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:20.902873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6e46b-4f17-400c-ad58-ab441d5c141b service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:20.903174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6e46b-4f17-400c-ad58-ab441d5c141b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:20.927421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6e46b-4f17-400c-ad58-ab441d5c141b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:20.929270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6e46b-4f17-400c-ad58-ab441d5c141b service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:20.944042 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 766/1502] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:00:20.950229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6153ade-527e-45be-ab8a-fa91fba11c72 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506d51df24624b4396214acfd0c5e622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9eec993c81b841ff8194a92d7b5a6878', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:20.951709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153ade-527e-45be-ab8a-fa91fba11c72 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:20.952028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153ade-527e-45be-ab8a-fa91fba11c72 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:20.952301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153ade-527e-45be-ab8a-fa91fba11c72 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] PATH_INFO: `/v3/projects/a919e52c25ae4e9ea96e13fbf2d16b39` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:20.953595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6153ade-527e-45be-ab8a-fa91fba11c72 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorizing `identity:get_project(project_id=a919e52c25ae4e9ea96e13fbf2d16b39)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:20.956186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6153ade-527e-45be-ab8a-fa91fba11c72 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:20.964388 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 737/1503] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:00:20 2022] GET /identity/v3/projects/a919e52c25ae4e9ea96e13fbf2d16b39 => generated 371 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:21.096784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6e46b-4f17-400c-ad58-ab441d5c141b service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:21.100448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6153ade-527e-45be-ab8a-fa91fba11c72 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:21.101209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-52b6e46b-4f17-400c-ad58-ab441d5c141b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:21.104416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c6153ade-527e-45be-ab8a-fa91fba11c72 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:21.139165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6153ade-527e-45be-ab8a-fa91fba11c72 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:21.147230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6e46b-4f17-400c-ad58-ab441d5c141b service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:21.160493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4ee62-5ce4-441c-a322-a5eb80e8a8e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:21.161367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4ee62-5ce4-441c-a322-a5eb80e8a8e7 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:21.161798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4ee62-5ce4-441c-a322-a5eb80e8a8e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:21.162233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4ee62-5ce4-441c-a322-a5eb80e8a8e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:21.166425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9f00d-4cac-4840-925d-5e8ac056ff43 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506d51df24624b4396214acfd0c5e622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9eec993c81b841ff8194a92d7b5a6878', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:21.167318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f00d-4cac-4840-925d-5e8ac056ff43 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:21.167521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eae4ee62-5ce4-441c-a322-a5eb80e8a8e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:21.167990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f00d-4cac-4840-925d-5e8ac056ff43 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:21.168499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f00d-4cac-4840-925d-5e8ac056ff43 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:21.169419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9f00d-4cac-4840-925d-5e8ac056ff43 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:21.170637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9f00d-4cac-4840-925d-5e8ac056ff43 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:21.177706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9f00d-4cac-4840-925d-5e8ac056ff43 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:21.199171 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:21.215252 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 767/1504] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:21.218467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9f00d-4cac-4840-925d-5e8ac056ff43 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:21.254852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9f00d-4cac-4840-925d-5e8ac056ff43 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:21.291394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0ad16-dcb1-4187-a331-a7e5a995ce11 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506d51df24624b4396214acfd0c5e622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9eec993c81b841ff8194a92d7b5a6878', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:21.299068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0ad16-dcb1-4187-a331-a7e5a995ce11 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:21.329415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0ad16-dcb1-4187-a331-a7e5a995ce11 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:21.329621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0ad16-dcb1-4187-a331-a7e5a995ce11 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:21.330309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0ad16-dcb1-4187-a331-a7e5a995ce11 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:21.334818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4ee62-5ce4-441c-a322-a5eb80e8a8e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:21.337541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0ad16-dcb1-4187-a331-a7e5a995ce11 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:21.337725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4ee62-5ce4-441c-a322-a5eb80e8a8e7 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:21.383304 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 768/1505] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:21 2022] POST /identity/v3/users => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:00:21.383838 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 738/1506] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:21.387201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0ad16-dcb1-4187-a331-a7e5a995ce11 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:21.394195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4ee62-5ce4-441c-a322-a5eb80e8a8e7 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:21.398508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eae4ee62-5ce4-441c-a322-a5eb80e8a8e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:21.406258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0ad16-dcb1-4187-a331-a7e5a995ce11 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:21.417834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a7279-a64b-4c08-b302-58abc0112bc7 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506d51df24624b4396214acfd0c5e622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9eec993c81b841ff8194a92d7b5a6878', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:21.419667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a7279-a64b-4c08-b302-58abc0112bc7 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:21.419953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a7279-a64b-4c08-b302-58abc0112bc7 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:21.420223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a7279-a64b-4c08-b302-58abc0112bc7 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:21.423130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a7279-a64b-4c08-b302-58abc0112bc7 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:21.423446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a7279-a64b-4c08-b302-58abc0112bc7 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:21.425305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a7279-a64b-4c08-b302-58abc0112bc7 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:21.438980 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 769/1507] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:21.440305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad326f-8b05-4a06-bdbe-d43c7b136a22 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:21.441115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad326f-8b05-4a06-bdbe-d43c7b136a22 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:21.441510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad326f-8b05-4a06-bdbe-d43c7b136a22 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:21.443255 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 770/1508] 10.222.0.39 () {54 vars in 921 bytes} [Sun Oct 16 01:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:21.521330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c49eb-1ea2-4c85-8774-45b9efdc7764 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:21.522190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c49eb-1ea2-4c85-8774-45b9efdc7764 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:21.522747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c49eb-1ea2-4c85-8774-45b9efdc7764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:21.572038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-142c49eb-1ea2-4c85-8774-45b9efdc7764 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:21.573329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-142c49eb-1ea2-4c85-8774-45b9efdc7764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:21.602198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4ee62-5ce4-441c-a322-a5eb80e8a8e7 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:21.619809 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 771/1509] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:00:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:00:21.630003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:21.631238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:21.631733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:21.632766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637 admin admin] PATH_INFO: `/v3/projects/445b59e2270d43dcb4cdab573023a1ae` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:21.637526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=445b59e2270d43dcb4cdab573023a1ae)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:21.642399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:21.647612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8a5ea-86d2-44aa-8a83-cbd35aee9747 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:21.648254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8a5ea-86d2-44aa-8a83-cbd35aee9747 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:21.648684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8a5ea-86d2-44aa-8a83-cbd35aee9747 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:21.650884 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 772/1510] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 01:00:21.657724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8a5ea-86d2-44aa-8a83-cbd35aee9747 None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:00:21.675999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8a5ea-86d2-44aa-8a83-cbd35aee9747 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:21.691004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8a5ea-86d2-44aa-8a83-cbd35aee9747 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:21.698561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcfd21-78f3-4891-8825-1be2ffba858a tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506d51df24624b4396214acfd0c5e622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9eec993c81b841ff8194a92d7b5a6878', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:21.700213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcfd21-78f3-4891-8825-1be2ffba858a tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:21.700729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcfd21-78f3-4891-8825-1be2ffba858a tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:21.701281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcfd21-78f3-4891-8825-1be2ffba858a tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] PATH_INFO: `/v3/projects/a919e52c25ae4e9ea96e13fbf2d16b39` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:21.704148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcfd21-78f3-4891-8825-1be2ffba858a tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorizing `identity:get_project(project_id=a919e52c25ae4e9ea96e13fbf2d16b39)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:21.707444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcfd21-78f3-4891-8825-1be2ffba858a tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:21.726092 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 773/1511] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:00:21 2022] GET /identity/v3/projects/a919e52c25ae4e9ea96e13fbf2d16b39 => generated 371 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:00:21.806424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445b59e2270d43dcb4cdab573023a1ae', 'request_id': 'req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:21.858973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445b59e2270d43dcb4cdab573023a1ae', 'request_id': 'req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:21.876742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445b59e2270d43dcb4cdab573023a1ae', 'request_id': 'req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:21.905628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637 admin admin] The token cache is being invalidate because project 445b59e2270d43dcb4cdab573023a1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:21.905923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:21.911722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-628a117b-9ea8-4918-b1ca-3ea4c3d3b637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:21.923496 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 739/1512] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:21 2022] DELETE /identity/v3/projects/445b59e2270d43dcb4cdab573023a1ae => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:21.929939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419bb99-41f8-47e4-800b-998cf00bac81 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:21.930431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419bb99-41f8-47e4-800b-998cf00bac81 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:21.930851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419bb99-41f8-47e4-800b-998cf00bac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:22.013836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f419bb99-41f8-47e4-800b-998cf00bac81 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:22.015774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f419bb99-41f8-47e4-800b-998cf00bac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:22.177109 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 774/1513] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:22.186176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123ba6b-f010-4d69-b27d-766193a63216 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:22.186774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123ba6b-f010-4d69-b27d-766193a63216 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:22.187340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123ba6b-f010-4d69-b27d-766193a63216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:22.218522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419bb99-41f8-47e4-800b-998cf00bac81 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:22.221307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f419bb99-41f8-47e4-800b-998cf00bac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:22.250390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e123ba6b-f010-4d69-b27d-766193a63216 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:22.252302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e123ba6b-f010-4d69-b27d-766193a63216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:22.270063 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 740/1514] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:22.271745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228b92f-b837-45b5-9073-db789627c15b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:22.272255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228b92f-b837-45b5-9073-db789627c15b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:22.272742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228b92f-b837-45b5-9073-db789627c15b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:22.280906 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 741/1515] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:22.282211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228b92f-b837-45b5-9073-db789627c15b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:22.311388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228b92f-b837-45b5-9073-db789627c15b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:22.320773 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:22.327365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b173163-f980-4a3b-8a28-0929736a12b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:22.328018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b173163-f980-4a3b-8a28-0929736a12b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:22.328390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b173163-f980-4a3b-8a28-0929736a12b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:22.328687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b173163-f980-4a3b-8a28-0929736a12b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:22.329805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b173163-f980-4a3b-8a28-0929736a12b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:22.330108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b173163-f980-4a3b-8a28-0929736a12b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:22.332693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b173163-f980-4a3b-8a28-0929736a12b5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:22.375434 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 742/1516] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:22.376872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b173163-f980-4a3b-8a28-0929736a12b5 admin admin] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:00:22.382002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9b173163-f980-4a3b-8a28-0929736a12b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:22.438408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419bb99-41f8-47e4-800b-998cf00bac81 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:22.453371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57748884-7654-45cc-ab79-43bcee115a9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:22.454730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57748884-7654-45cc-ab79-43bcee115a9e service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:22.455102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57748884-7654-45cc-ab79-43bcee115a9e service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:22.455716 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:22.457614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57748884-7654-45cc-ab79-43bcee115a9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:22.462818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-57748884-7654-45cc-ab79-43bcee115a9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:22.515585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57748884-7654-45cc-ab79-43bcee115a9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:22.522174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57748884-7654-45cc-ab79-43bcee115a9e service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:22.567869 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 775/1517] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:22.569003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57748884-7654-45cc-ab79-43bcee115a9e service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:22.629008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57748884-7654-45cc-ab79-43bcee115a9e service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:22.629333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b173163-f980-4a3b-8a28-0929736a12b5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:22.654611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9b173163-f980-4a3b-8a28-0929736a12b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:22.659123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37bbcd-13c5-4776-bc48-a6ae7d022d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:22.660470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37bbcd-13c5-4776-bc48-a6ae7d022d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:22.661173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37bbcd-13c5-4776-bc48-a6ae7d022d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:22.662079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37bbcd-13c5-4776-bc48-a6ae7d022d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:22.663448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37bbcd-13c5-4776-bc48-a6ae7d022d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:22.667190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37bbcd-13c5-4776-bc48-a6ae7d022d25 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:22.758702 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 776/1518] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:22 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:22.758702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37bbcd-13c5-4776-bc48-a6ae7d022d25 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:22.765242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6d37bbcd-13c5-4776-bc48-a6ae7d022d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:22.910591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b173163-f980-4a3b-8a28-0929736a12b5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:22.929767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37bbcd-13c5-4776-bc48-a6ae7d022d25 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:22.936024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:22.937002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:22.937924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:22.938420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] PATH_INFO: `/v3/projects/11045c23100f43a8b16b31c50c2456ff` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:22.939887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] RBAC: Authorizing `identity:delete_project(project_id=11045c23100f43a8b16b31c50c2456ff)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:22.943414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:23.064289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11045c23100f43a8b16b31c50c2456ff', 'request_id': 'req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.081511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11045c23100f43a8b16b31c50c2456ff', 'request_id': 'req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.099865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11045c23100f43a8b16b31c50c2456ff', 'request_id': 'req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.116558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e9c7e-dcde-4408-96d4-c93a589825b2 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506d51df24624b4396214acfd0c5e622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9eec993c81b841ff8194a92d7b5a6878', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:23.117073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e9c7e-dcde-4408-96d4-c93a589825b2 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:23.118226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e9c7e-dcde-4408-96d4-c93a589825b2 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:23.118551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e9c7e-dcde-4408-96d4-c93a589825b2 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] PATH_INFO: `/v3/projects/a919e52c25ae4e9ea96e13fbf2d16b39` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:23.120756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e9c7e-dcde-4408-96d4-c93a589825b2 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorizing `identity:get_project(project_id=a919e52c25ae4e9ea96e13fbf2d16b39)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:23.122973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] The token cache is being invalidate because project 11045c23100f43a8b16b31c50c2456ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:23.123264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.127003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.127637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e9c7e-dcde-4408-96d4-c93a589825b2 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:23.134726 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 777/1519] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:22 2022] DELETE /identity/v3/projects/11045c23100f43a8b16b31c50c2456ff => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:23.140559 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 743/1520] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:00:22 2022] GET /identity/v3/projects/a919e52c25ae4e9ea96e13fbf2d16b39 => generated 371 bytes in 764 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:23.142445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e9c7e-dcde-4408-96d4-c93a589825b2 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:23.143200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:23.146320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:23.148489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5e2e9c7e-dcde-4408-96d4-c93a589825b2 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:23.193297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e9c7e-dcde-4408-96d4-c93a589825b2 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:23.201828 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:23.312060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2bbdd-e75d-43e3-b79d-2b6458a7e83d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:23.327417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786f46b-0692-4e53-ae9d-3f53c1d32da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:23.328072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786f46b-0692-4e53-ae9d-3f53c1d32da5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:23.328382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786f46b-0692-4e53-ae9d-3f53c1d32da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:23.328810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786f46b-0692-4e53-ae9d-3f53c1d32da5 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:23.329465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786f46b-0692-4e53-ae9d-3f53c1d32da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:23.335636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786f46b-0692-4e53-ae9d-3f53c1d32da5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:23.387717 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 778/1521] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:23 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:23.390145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3100d5-abc5-407a-85a4-4de4fc6e1307 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:23.391519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3100d5-abc5-407a-85a4-4de4fc6e1307 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:23.391800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3100d5-abc5-407a-85a4-4de4fc6e1307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:23.403228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:23.404287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:23.406810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:23.407349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] PATH_INFO: `/v3/users/98e127ab527e4a1b9f18090223112cdb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:23.410420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e127ab527e4a1b9f18090223112cdb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:23.416108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:23.434003 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:23.442936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ad3100d5-abc5-407a-85a4-4de4fc6e1307 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:23.445770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ad3100d5-abc5-407a-85a4-4de4fc6e1307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:23.469810 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 779/1522] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:23.469810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3100d5-abc5-407a-85a4-4de4fc6e1307 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:23.469810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ad3100d5-abc5-407a-85a4-4de4fc6e1307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:23.646472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e127ab527e4a1b9f18090223112cdb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.647358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e127ab527e4a1b9f18090223112cdb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.686762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e127ab527e4a1b9f18090223112cdb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.699109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e127ab527e4a1b9f18090223112cdb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.699943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e127ab527e4a1b9f18090223112cdb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.724233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3100d5-abc5-407a-85a4-4de4fc6e1307 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:23.734487 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 744/1523] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:23 2022] DELETE /identity/v3/users/98e127ab527e4a1b9f18090223112cdb => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:23.734487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:23.735499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:23.748337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a9f61-5451-4221-b2a7-2132050acb3f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506d51df24624b4396214acfd0c5e622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9eec993c81b841ff8194a92d7b5a6878', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:23.749071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a9f61-5451-4221-b2a7-2132050acb3f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:23.749672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a9f61-5451-4221-b2a7-2132050acb3f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:23.749991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a9f61-5451-4221-b2a7-2132050acb3f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] PATH_INFO: `/v3/users/b293bf2146324aafb53bf97aa3820c77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:23.777171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a9f61-5451-4221-b2a7-2132050acb3f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b293bf2146324aafb53bf97aa3820c77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:23.782659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a9f61-5451-4221-b2a7-2132050acb3f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:23.858755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5e133-03f2-4da7-a547-6995b0cd6bbb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:23.875796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7aa53-5a0e-47fc-abfb-945dbc6ae4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:23.877438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7aa53-5a0e-47fc-abfb-945dbc6ae4bd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:23.879463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7aa53-5a0e-47fc-abfb-945dbc6ae4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:23.880304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7aa53-5a0e-47fc-abfb-945dbc6ae4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:23.882550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7aa53-5a0e-47fc-abfb-945dbc6ae4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:23.886142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7aa53-5a0e-47fc-abfb-945dbc6ae4bd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:23.890836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d03a9f61-5451-4221-b2a7-2132050acb3f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b293bf2146324aafb53bf97aa3820c77'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.892525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d03a9f61-5451-4221-b2a7-2132050acb3f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b293bf2146324aafb53bf97aa3820c77'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.912747 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 745/1524] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:23.918063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98c29-df66-4e53-941d-4ee1df56bca6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:23.918589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98c29-df66-4e53-941d-4ee1df56bca6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:23.920013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98c29-df66-4e53-941d-4ee1df56bca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:23.926599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d03a9f61-5451-4221-b2a7-2132050acb3f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b293bf2146324aafb53bf97aa3820c77'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.942028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d03a9f61-5451-4221-b2a7-2132050acb3f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b293bf2146324aafb53bf97aa3820c77'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.943277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d03a9f61-5451-4221-b2a7-2132050acb3f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b293bf2146324aafb53bf97aa3820c77'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:23.971047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bcd98c29-df66-4e53-941d-4ee1df56bca6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:23.972822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bcd98c29-df66-4e53-941d-4ee1df56bca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:23.976394 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 780/1525] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:23 2022] DELETE /identity/v3/users/b293bf2146324aafb53bf97aa3820c77 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:23.976394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fba598-ede7-404b-b516-95465cff46aa None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:23.976394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fba598-ede7-404b-b516-95465cff46aa None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:23.976394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fba598-ede7-404b-b516-95465cff46aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:24.028865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-58fba598-ede7-404b-b516-95465cff46aa None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:24.036460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-58fba598-ede7-404b-b516-95465cff46aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:24.045137 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:24.157224 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 746/1526] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:24.162452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd98c29-df66-4e53-941d-4ee1df56bca6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:24.165709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bcd98c29-df66-4e53-941d-4ee1df56bca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:24.185928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd98c29-df66-4e53-941d-4ee1df56bca6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:24.200038 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 781/1527] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:24.200038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fba598-ede7-404b-b516-95465cff46aa None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:24.209872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-58fba598-ede7-404b-b516-95465cff46aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:24.213180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61a9e2-76d9-4b69-a440-6b8218d72f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:24.213704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61a9e2-76d9-4b69-a440-6b8218d72f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:24.213975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61a9e2-76d9-4b69-a440-6b8218d72f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:24.214238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61a9e2-76d9-4b69-a440-6b8218d72f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:24.214881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61a9e2-76d9-4b69-a440-6b8218d72f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:24.217326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61a9e2-76d9-4b69-a440-6b8218d72f83 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:24.258709 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 747/1528] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:24.263695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61a9e2-76d9-4b69-a440-6b8218d72f83 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:24.283781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61a9e2-76d9-4b69-a440-6b8218d72f83 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:24.293898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80714bb4-6e7d-48cb-a9f7-5e48e3391298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:24.295532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80714bb4-6e7d-48cb-a9f7-5e48e3391298 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:24.296386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80714bb4-6e7d-48cb-a9f7-5e48e3391298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:24.296991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80714bb4-6e7d-48cb-a9f7-5e48e3391298 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:24.298593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80714bb4-6e7d-48cb-a9f7-5e48e3391298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:24.299253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80714bb4-6e7d-48cb-a9f7-5e48e3391298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:24.302442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80714bb4-6e7d-48cb-a9f7-5e48e3391298 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:24.304642 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:24.337645 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 748/1529] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:24.337645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80714bb4-6e7d-48cb-a9f7-5e48e3391298 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:24.365943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80714bb4-6e7d-48cb-a9f7-5e48e3391298 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:24.383618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf088207-ed5b-439d-88a8-fd61e3cc8fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:24.384464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088207-ed5b-439d-88a8-fd61e3cc8fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:24.384879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088207-ed5b-439d-88a8-fd61e3cc8fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:24.385217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088207-ed5b-439d-88a8-fd61e3cc8fb0 admin admin] PATH_INFO: `/v3/projects/eb64fefce1ee479bb3a351f0a1542c9d/users/0f26dae5a83149c2ae454991118b6bab/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:24.401034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fba598-ede7-404b-b516-95465cff46aa None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:24.411671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf088207-ed5b-439d-88a8-fd61e3cc8fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb64fefce1ee479bb3a351f0a1542c9d, user_id=0f26dae5a83149c2ae454991118b6bab, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:24.413829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506d51df24624b4396214acfd0c5e622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9eec993c81b841ff8194a92d7b5a6878', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:24.414482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:24.414760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:24.415061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] PATH_INFO: `/v3/projects/a919e52c25ae4e9ea96e13fbf2d16b39` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:24.416946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf088207-ed5b-439d-88a8-fd61e3cc8fb0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:24.419229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a919e52c25ae4e9ea96e13fbf2d16b39)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:24.421161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:24.450191 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 749/1530] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:24 2022] PUT /identity/v3/projects/eb64fefce1ee479bb3a351f0a1542c9d/users/0f26dae5a83149c2ae454991118b6bab/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:24.454192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf088207-ed5b-439d-88a8-fd61e3cc8fb0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:24.465032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cf088207-ed5b-439d-88a8-fd61e3cc8fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:24.538732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a919e52c25ae4e9ea96e13fbf2d16b39', 'request_id': 'req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:24.553218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a919e52c25ae4e9ea96e13fbf2d16b39', 'request_id': 'req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:24.566323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a919e52c25ae4e9ea96e13fbf2d16b39', 'request_id': 'req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:24.593944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] The token cache is being invalidate because project a919e52c25ae4e9ea96e13fbf2d16b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:24.594581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:24.595593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:24.598764 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 782/1531] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:24 2022] DELETE /identity/v3/projects/a919e52c25ae4e9ea96e13fbf2d16b39 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:24.599811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:24.601365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:24.615176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf088207-ed5b-439d-88a8-fd61e3cc8fb0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:24.684974 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:24.721201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c592ed-b7d2-4e5c-92a5-0a52f8c1f91f tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:24.730355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1ab62-d168-49f7-b279-d79b734226a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:24.731082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1ab62-d168-49f7-b279-d79b734226a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:24.731500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1ab62-d168-49f7-b279-d79b734226a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:24.731845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1ab62-d168-49f7-b279-d79b734226a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:24.732574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1ab62-d168-49f7-b279-d79b734226a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:24.735402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1ab62-d168-49f7-b279-d79b734226a0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:24.746667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74d4ed-21b2-4d63-8c22-1a76f2ce6326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:24.747418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d4ed-21b2-4d63-8c22-1a76f2ce6326 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:24.747697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d4ed-21b2-4d63-8c22-1a76f2ce6326 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:24.747970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d4ed-21b2-4d63-8c22-1a76f2ce6326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:24.753230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bd74d4ed-21b2-4d63-8c22-1a76f2ce6326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:24.784955 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 783/1532] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:24 2022] POST /identity/v3/projects => generated 403 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:24.787305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b62e-4d7d-407a-86fb-3653d35724fa None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:24.788390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b62e-4d7d-407a-86fb-3653d35724fa None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:24.788940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b62e-4d7d-407a-86fb-3653d35724fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:24.808135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74d4ed-21b2-4d63-8c22-1a76f2ce6326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:24.809585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74d4ed-21b2-4d63-8c22-1a76f2ce6326 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:24.832907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7d85b62e-4d7d-407a-86fb-3653d35724fa None None] MFA Rules not processed for user `0f26dae5a83149c2ae454991118b6bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:24.834135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7d85b62e-4d7d-407a-86fb-3653d35724fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:24.860368 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 750/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:24.861246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74d4ed-21b2-4d63-8c22-1a76f2ce6326 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:24.864848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bd74d4ed-21b2-4d63-8c22-1a76f2ce6326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:24.890580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74d4ed-21b2-4d63-8c22-1a76f2ce6326 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:24.962488 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 784/1534] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:24.963424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85b62e-4d7d-407a-86fb-3653d35724fa None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:25.026036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:25.027125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:25.027540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:25.027951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] PATH_INFO: `/v3/users/c76c0ffa70e0426688d1e4f4ab6855e4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:25.029538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76c0ffa70e0426688d1e4f4ab6855e4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:25.032113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:25.110647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85b62e-4d7d-407a-86fb-3653d35724fa None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:25.116847 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:25.141757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76c0ffa70e0426688d1e4f4ab6855e4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:25.142988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76c0ffa70e0426688d1e4f4ab6855e4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:25.145580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05121df3-bd4a-458c-8335-9474afa56bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:25.146368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05121df3-bd4a-458c-8335-9474afa56bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:25.146762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05121df3-bd4a-458c-8335-9474afa56bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:25.147330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05121df3-bd4a-458c-8335-9474afa56bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:25.148498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05121df3-bd4a-458c-8335-9474afa56bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:25.150549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05121df3-bd4a-458c-8335-9474afa56bb5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:25.167218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76c0ffa70e0426688d1e4f4ab6855e4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:25.182698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76c0ffa70e0426688d1e4f4ab6855e4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:25.188963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76c0ffa70e0426688d1e4f4ab6855e4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:25.220719 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 785/1535] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:24 2022] POST /identity/v3/users => generated 302 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:25.223159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05121df3-bd4a-458c-8335-9474afa56bb5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:25.232194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05121df3-bd4a-458c-8335-9474afa56bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:25.246977 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 751/1536] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:24 2022] DELETE /identity/v3/users/c76c0ffa70e0426688d1e4f4ab6855e4 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:25.252071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:25.259729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:25.266985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05121df3-bd4a-458c-8335-9474afa56bb5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:25.451611 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:25.511062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5000504-7721-479b-bb17-86359b87fe3e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:25.517088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b220a-f588-4ca1-bde2-11fbd0c44083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:25.518468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b220a-f588-4ca1-bde2-11fbd0c44083 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:25.524024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b220a-f588-4ca1-bde2-11fbd0c44083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:25.524215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f275e-f315-4fbd-a610-a621c05facc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:25.524532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b220a-f588-4ca1-bde2-11fbd0c44083 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:25.524864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f275e-f315-4fbd-a610-a621c05facc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:25.525196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f275e-f315-4fbd-a610-a621c05facc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:25.525520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f275e-f315-4fbd-a610-a621c05facc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:25.525768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b220a-f588-4ca1-bde2-11fbd0c44083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:25.526249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f275e-f315-4fbd-a610-a621c05facc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:25.527892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b220a-f588-4ca1-bde2-11fbd0c44083 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:25.528390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f275e-f315-4fbd-a610-a621c05facc0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:25.564001 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 752/1537] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:25.566103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a9a03-7e82-4a37-853d-47da35346e6a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:25.567270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a9a03-7e82-4a37-853d-47da35346e6a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:25.571343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a9a03-7e82-4a37-853d-47da35346e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:25.610051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-eb5a9a03-7e82-4a37-853d-47da35346e6a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:25.613355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eb5a9a03-7e82-4a37-853d-47da35346e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:25.635012 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 786/1538] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:25 2022] POST /identity/v3/projects => generated 385 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:25.636024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b220a-f588-4ca1-bde2-11fbd0c44083 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:25.636499 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 753/1539] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:25.638502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a9a03-7e82-4a37-853d-47da35346e6a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:25.660883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a9a03-7e82-4a37-853d-47da35346e6a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:25.796692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b7ea0-99c4-4b60-8ba5-16f0e9e36035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:25.797383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b7ea0-99c4-4b60-8ba5-16f0e9e36035 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:25.797742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b7ea0-99c4-4b60-8ba5-16f0e9e36035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:25.797960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b7ea0-99c4-4b60-8ba5-16f0e9e36035 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:25.798562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b7ea0-99c4-4b60-8ba5-16f0e9e36035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:25.801543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b7ea0-99c4-4b60-8ba5-16f0e9e36035 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:25.820907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b220a-f588-4ca1-bde2-11fbd0c44083 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:25.841621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d20ba-f79d-4da7-a0da-87b59d5ccf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:25.842261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d20ba-f79d-4da7-a0da-87b59d5ccf52 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:25.842555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d20ba-f79d-4da7-a0da-87b59d5ccf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:25.842815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d20ba-f79d-4da7-a0da-87b59d5ccf52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:25.848056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d20ba-f79d-4da7-a0da-87b59d5ccf52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:25.851523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d20ba-f79d-4da7-a0da-87b59d5ccf52 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:25.869912 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 754/1540] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:25 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:25.871572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b7ea0-99c4-4b60-8ba5-16f0e9e36035 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:25.884779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c91b7ea0-99c4-4b60-8ba5-16f0e9e36035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:25.885226 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 787/1541] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:25.886212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d20ba-f79d-4da7-a0da-87b59d5ccf52 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:25.935332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d20ba-f79d-4da7-a0da-87b59d5ccf52 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:25.944141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647812d-d5e7-4244-b225-bc18806f0b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:25.945161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647812d-d5e7-4244-b225-bc18806f0b45 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:25.946580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647812d-d5e7-4244-b225-bc18806f0b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:25.947236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647812d-d5e7-4244-b225-bc18806f0b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:25.948448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647812d-d5e7-4244-b225-bc18806f0b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:25.951624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647812d-d5e7-4244-b225-bc18806f0b45 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:25.969263 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 788/1542] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:25.973640 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:25.974270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647812d-d5e7-4244-b225-bc18806f0b45 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:26.001376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647812d-d5e7-4244-b225-bc18806f0b45 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:26.010599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10685f38-89c0-487a-84d6-c533a6938705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:26.011927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10685f38-89c0-487a-84d6-c533a6938705 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:26.012435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10685f38-89c0-487a-84d6-c533a6938705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:26.012929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10685f38-89c0-487a-84d6-c533a6938705 admin admin] PATH_INFO: `/v3/projects/bdbebb3c197640f8b915a091c4277bc8/users/ea698e4b461143cfafb17befe69af2a5/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:26.038515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10685f38-89c0-487a-84d6-c533a6938705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdbebb3c197640f8b915a091c4277bc8, user_id=ea698e4b461143cfafb17befe69af2a5, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:26.042725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10685f38-89c0-487a-84d6-c533a6938705 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:26.065270 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 789/1543] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:25 2022] PUT /identity/v3/projects/bdbebb3c197640f8b915a091c4277bc8/users/ea698e4b461143cfafb17befe69af2a5/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:26.067571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10685f38-89c0-487a-84d6-c533a6938705 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:26.080351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b7ea0-99c4-4b60-8ba5-16f0e9e36035 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:26.178278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10685f38-89c0-487a-84d6-c533a6938705 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:26.185023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5925315-e46c-449f-a2f5-9bc3f8d9786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:26.186507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5925315-e46c-449f-a2f5-9bc3f8d9786b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:26.187427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5925315-e46c-449f-a2f5-9bc3f8d9786b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:26.187959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5925315-e46c-449f-a2f5-9bc3f8d9786b admin admin] PATH_INFO: `/v3/projects/78a6b8d6cc1c4d27a4aee51a8ac3db5a/users/7a91619b1a1946d08b8b448452326d76/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:26.214788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5925315-e46c-449f-a2f5-9bc3f8d9786b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a6b8d6cc1c4d27a4aee51a8ac3db5a, user_id=7a91619b1a1946d08b8b448452326d76, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:26.219701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5925315-e46c-449f-a2f5-9bc3f8d9786b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:26.249251 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 790/1544] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:26 2022] PUT /identity/v3/projects/78a6b8d6cc1c4d27a4aee51a8ac3db5a/users/7a91619b1a1946d08b8b448452326d76/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:26.251786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6015089-f977-4cdd-b768-24c32aef6f6d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:26.252418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6015089-f977-4cdd-b768-24c32aef6f6d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:26.252865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6015089-f977-4cdd-b768-24c32aef6f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:26.258871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f11d80-de71-40af-8b23-3ea0eb1da915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:26.260843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f11d80-de71-40af-8b23-3ea0eb1da915 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:26.261899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f11d80-de71-40af-8b23-3ea0eb1da915 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:26.262671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f11d80-de71-40af-8b23-3ea0eb1da915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:26.286314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f6015089-f977-4cdd-b768-24c32aef6f6d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:26.287725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f6015089-f977-4cdd-b768-24c32aef6f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:26.298422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f11d80-de71-40af-8b23-3ea0eb1da915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:26.303475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f11d80-de71-40af-8b23-3ea0eb1da915 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:26.321334 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:26.349875 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 755/1545] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:26.351056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f11d80-de71-40af-8b23-3ea0eb1da915 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:26.382541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f11d80-de71-40af-8b23-3ea0eb1da915 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:26.476483 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 791/1546] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:26.524285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6015089-f977-4cdd-b768-24c32aef6f6d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:26.526541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f6015089-f977-4cdd-b768-24c32aef6f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:26.584563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b13b2f-e5ee-428a-a123-140763765cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:26.593612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b13b2f-e5ee-428a-a123-140763765cfa admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:26.593722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b13b2f-e5ee-428a-a123-140763765cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:26.593923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b13b2f-e5ee-428a-a123-140763765cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:26.594673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b13b2f-e5ee-428a-a123-140763765cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:26.596258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b13b2f-e5ee-428a-a123-140763765cfa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:26.647792 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 756/1547] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:26.653092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b13b2f-e5ee-428a-a123-140763765cfa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:26.679213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b13b2f-e5ee-428a-a123-140763765cfa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:26.708859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2b5d0-cf54-414e-9daa-aa63032de748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:26.714622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2b5d0-cf54-414e-9daa-aa63032de748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:26.718468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2b5d0-cf54-414e-9daa-aa63032de748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:26.719062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2b5d0-cf54-414e-9daa-aa63032de748 admin admin] PATH_INFO: `/v3/projects/78a6b8d6cc1c4d27a4aee51a8ac3db5a/users/7a91619b1a1946d08b8b448452326d76/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:26.724313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2b5d0-cf54-414e-9daa-aa63032de748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a6b8d6cc1c4d27a4aee51a8ac3db5a, user_id=7a91619b1a1946d08b8b448452326d76, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:26.731732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2b5d0-cf54-414e-9daa-aa63032de748 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:26.800520 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 757/1548] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:26 2022] PUT /identity/v3/projects/78a6b8d6cc1c4d27a4aee51a8ac3db5a/users/7a91619b1a1946d08b8b448452326d76/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:00:26.802632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2b5d0-cf54-414e-9daa-aa63032de748 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:26.813818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-55b2b5d0-cf54-414e-9daa-aa63032de748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:26.814143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6015089-f977-4cdd-b768-24c32aef6f6d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:26.962576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c640b-8b13-499c-bdf6-ab6a69da9055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:26.963617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c640b-8b13-499c-bdf6-ab6a69da9055 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:26.963897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c640b-8b13-499c-bdf6-ab6a69da9055 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:26.964174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c640b-8b13-499c-bdf6-ab6a69da9055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:27.139095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c640b-8b13-499c-bdf6-ab6a69da9055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:27.146676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c640b-8b13-499c-bdf6-ab6a69da9055 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:27.156968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2b5d0-cf54-414e-9daa-aa63032de748 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:27.206195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:27.208915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:27.209975 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 792/1549] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:27.214181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c010d-70d7-40da-b239-e33caf5b406e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:27.215222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:27.215731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c010d-70d7-40da-b239-e33caf5b406e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:27.216859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c010d-70d7-40da-b239-e33caf5b406e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:27.217870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] PATH_INFO: `/v3/projects/fe180137bac444979f1b017028e2be7d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:27.227857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe180137bac444979f1b017028e2be7d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:27.237251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:27.274133 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:27.332111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b70c010d-70d7-40da-b239-e33caf5b406e None None] MFA Rules not processed for user `7a91619b1a1946d08b8b448452326d76`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:27.333912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b70c010d-70d7-40da-b239-e33caf5b406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:27.365764 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:27.403782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe180137bac444979f1b017028e2be7d', 'request_id': 'req-83ffddc2-ceb7-4bf8-aa45-104937d73a39'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:27.420353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe180137bac444979f1b017028e2be7d', 'request_id': 'req-83ffddc2-ceb7-4bf8-aa45-104937d73a39'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:27.441120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe180137bac444979f1b017028e2be7d', 'request_id': 'req-83ffddc2-ceb7-4bf8-aa45-104937d73a39'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:27.461650 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 793/1550] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:27.475518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c010d-70d7-40da-b239-e33caf5b406e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:27.477243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b70c010d-70d7-40da-b239-e33caf5b406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:27.478020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] The token cache is being invalidate because project fe180137bac444979f1b017028e2be7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:27.483425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:27.491161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:27.496702 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 758/1551] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:26 2022] DELETE /identity/v3/projects/fe180137bac444979f1b017028e2be7d => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:27.500670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:27.505348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:27.762304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c010d-70d7-40da-b239-e33caf5b406e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:27.765020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffddc2-ceb7-4bf8-aa45-104937d73a39 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:27.787343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:27.789250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:27.793216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:27.796135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] PATH_INFO: `/v3/users/351604bd0ecd4980b3b9b506adb99a36` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:27.801882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=351604bd0ecd4980b3b9b506adb99a36)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:27.813491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:27.992979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351604bd0ecd4980b3b9b506adb99a36'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:27.994152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351604bd0ecd4980b3b9b506adb99a36'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.021583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351604bd0ecd4980b3b9b506adb99a36'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.038428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c548ec-ce5f-4493-9efa-a9ef72998378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:28.040462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c548ec-ce5f-4493-9efa-a9ef72998378 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:28.040756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c548ec-ce5f-4493-9efa-a9ef72998378 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:28.042757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c548ec-ce5f-4493-9efa-a9ef72998378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:28.043477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351604bd0ecd4980b3b9b506adb99a36'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.044596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351604bd0ecd4980b3b9b506adb99a36'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.047224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-15c548ec-ce5f-4493-9efa-a9ef72998378 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:28.077318 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 759/1552] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:27 2022] DELETE /identity/v3/users/351604bd0ecd4980b3b9b506adb99a36 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:00:28.078824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:28.085285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:28.142230 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:28.204149 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:28.287524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f2d5-c803-4d5e-8744-69a973215d3a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:28.290546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c548ec-ce5f-4493-9efa-a9ef72998378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:28.294372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:28.295103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:28.295587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:28.296339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] PATH_INFO: `/v3/projects/d58c8c28f23b4e5f8d5ac48cc4a03424` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:28.297804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58c8c28f23b4e5f8d5ac48cc4a03424)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:28.298631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c548ec-ce5f-4493-9efa-a9ef72998378 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:28.300491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:28.344106 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 794/1553] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 869 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:28.378832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58c8c28f23b4e5f8d5ac48cc4a03424', 'request_id': 'req-5466e9cf-773c-4f9e-b030-4312c639dff1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.409146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58c8c28f23b4e5f8d5ac48cc4a03424', 'request_id': 'req-5466e9cf-773c-4f9e-b030-4312c639dff1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.440362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58c8c28f23b4e5f8d5ac48cc4a03424', 'request_id': 'req-5466e9cf-773c-4f9e-b030-4312c639dff1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.480656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] The token cache is being invalidate because project d58c8c28f23b4e5f8d5ac48cc4a03424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:28.482593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.484972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.489671 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 760/1554] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:28 2022] DELETE /identity/v3/projects/d58c8c28f23b4e5f8d5ac48cc4a03424 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:28.493662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c548ec-ce5f-4493-9efa-a9ef72998378 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:28.512044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c548ec-ce5f-4493-9efa-a9ef72998378 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:28.706954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:28.707659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:28.707870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:28.708310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] PATH_INFO: `/v3/users/506d51df24624b4396214acfd0c5e622` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:28.709548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=506d51df24624b4396214acfd0c5e622)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:28.717539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:28.826591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506d51df24624b4396214acfd0c5e622'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.828467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506d51df24624b4396214acfd0c5e622'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.860592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506d51df24624b4396214acfd0c5e622'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.883097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506d51df24624b4396214acfd0c5e622'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.883905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506d51df24624b4396214acfd0c5e622'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:28.932204 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 795/1555] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:28 2022] DELETE /identity/v3/users/506d51df24624b4396214acfd0c5e622 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:00:29.201968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:29.205507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:29.239036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466e9cf-773c-4f9e-b030-4312c639dff1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:29.354733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:29.356708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:29.438650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad3c77-618f-41fb-b81f-4feae506209a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:29.439653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad3c77-618f-41fb-b81f-4feae506209a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:29.442127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad3c77-618f-41fb-b81f-4feae506209a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:29.442351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad3c77-618f-41fb-b81f-4feae506209a admin admin] PATH_INFO: `/v3/users/0f26dae5a83149c2ae454991118b6bab` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:29.457816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad3c77-618f-41fb-b81f-4feae506209a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f26dae5a83149c2ae454991118b6bab)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:29.479548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad3c77-618f-41fb-b81f-4feae506209a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:29.492419 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:29.500892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee55e3-2399-4262-bd2f-c13c7b389a31 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:29.520310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c8697-31c0-4071-a318-892beee7477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:29.521163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c8697-31c0-4071-a318-892beee7477a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:29.521321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c8697-31c0-4071-a318-892beee7477a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:29.521591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c8697-31c0-4071-a318-892beee7477a admin admin] PATH_INFO: `/v3/projects/a5d8a66f647e406a99aec5b6c818f756` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:29.526041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c8697-31c0-4071-a318-892beee7477a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d8a66f647e406a99aec5b6c818f756)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:29.527874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c8697-31c0-4071-a318-892beee7477a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:29.654183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3ad3c77-618f-41fb-b81f-4feae506209a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f26dae5a83149c2ae454991118b6bab'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:29.654934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3ad3c77-618f-41fb-b81f-4feae506209a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f26dae5a83149c2ae454991118b6bab'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:29.659221 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:29.688467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3ad3c77-618f-41fb-b81f-4feae506209a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f26dae5a83149c2ae454991118b6bab'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:29.692497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4a9c8697-31c0-4071-a318-892beee7477a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d8a66f647e406a99aec5b6c818f756', 'request_id': 'req-4a9c8697-31c0-4071-a318-892beee7477a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:29.708687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4a9c8697-31c0-4071-a318-892beee7477a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d8a66f647e406a99aec5b6c818f756', 'request_id': 'req-4a9c8697-31c0-4071-a318-892beee7477a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:29.710034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3ad3c77-618f-41fb-b81f-4feae506209a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f26dae5a83149c2ae454991118b6bab'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:29.711273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3ad3c77-618f-41fb-b81f-4feae506209a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f26dae5a83149c2ae454991118b6bab'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:29.735358 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 761/1556] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:29 2022] DELETE /identity/v3/users/0f26dae5a83149c2ae454991118b6bab => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:29.735532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4a9c8697-31c0-4071-a318-892beee7477a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d8a66f647e406a99aec5b6c818f756', 'request_id': 'req-4a9c8697-31c0-4071-a318-892beee7477a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:29.736787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c457e-2565-4a31-84dc-ac77a01b6e17 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:29.736982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c457e-2565-4a31-84dc-ac77a01b6e17 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:29.737264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c457e-2565-4a31-84dc-ac77a01b6e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:29.761616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4a9c8697-31c0-4071-a318-892beee7477a admin admin] The token cache is being invalidate because project a5d8a66f647e406a99aec5b6c818f756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:29.761914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4a9c8697-31c0-4071-a318-892beee7477a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:29.763698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1b3c457e-2565-4a31-84dc-ac77a01b6e17 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:29.763984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4a9c8697-31c0-4071-a318-892beee7477a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:29.765522 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 796/1557] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:29 2022] DELETE /identity/v3/projects/a5d8a66f647e406a99aec5b6c818f756 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:00:29.769653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1b3c457e-2565-4a31-84dc-ac77a01b6e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:29.770869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b921fd-6c06-4705-9ded-f294bdebb677 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:29.771346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b921fd-6c06-4705-9ded-f294bdebb677 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:29.771627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b921fd-6c06-4705-9ded-f294bdebb677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:29.805719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-87b921fd-6c06-4705-9ded-f294bdebb677 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:29.807595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-87b921fd-6c06-4705-9ded-f294bdebb677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:29.862510 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 762/1558] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:00:29.884878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c457e-2565-4a31-84dc-ac77a01b6e17 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:29.886699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1b3c457e-2565-4a31-84dc-ac77a01b6e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:29.912376 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 797/1559] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:29.920843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1789-97aa-4cbd-bad1-39d3abbd3684 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:29.921129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1789-97aa-4cbd-bad1-39d3abbd3684 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:29.921413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1789-97aa-4cbd-bad1-39d3abbd3684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:29.990091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6ffc1789-97aa-4cbd-bad1-39d3abbd3684 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:29.991504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6ffc1789-97aa-4cbd-bad1-39d3abbd3684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:29.997207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c457e-2565-4a31-84dc-ac77a01b6e17 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:30.001292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a011ae7-374d-4d64-8d75-406476e9bfa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:30.001980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a011ae7-374d-4d64-8d75-406476e9bfa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:30.002261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a011ae7-374d-4d64-8d75-406476e9bfa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:30.002714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a011ae7-374d-4d64-8d75-406476e9bfa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:30.015792 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 798/1560] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:30.016874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc1789-97aa-4cbd-bad1-39d3abbd3684 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:30.017635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a011ae7-374d-4d64-8d75-406476e9bfa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:30.020637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a011ae7-374d-4d64-8d75-406476e9bfa2 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:30.028591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc1789-97aa-4cbd-bad1-39d3abbd3684 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:30.034327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c15b17-4881-421a-b54f-1468dfc49dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:30.037738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c15b17-4881-421a-b54f-1468dfc49dac admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:30.037738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c15b17-4881-421a-b54f-1468dfc49dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:30.037738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c15b17-4881-421a-b54f-1468dfc49dac admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:30.037738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c15b17-4881-421a-b54f-1468dfc49dac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:30.037738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c15b17-4881-421a-b54f-1468dfc49dac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:30.042290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c15b17-4881-421a-b54f-1468dfc49dac admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:30.043827 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 763/1561] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:30.078729 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 799/1562] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:30.080456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a011ae7-374d-4d64-8d75-406476e9bfa2 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:30.091749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a011ae7-374d-4d64-8d75-406476e9bfa2 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:30.098933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb92ae-7a80-4d5a-8c11-9b8893664f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:30.100007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb92ae-7a80-4d5a-8c11-9b8893664f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:30.100546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb92ae-7a80-4d5a-8c11-9b8893664f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:30.101129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb92ae-7a80-4d5a-8c11-9b8893664f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:30.102051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb92ae-7a80-4d5a-8c11-9b8893664f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:30.102288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c15b17-4881-421a-b54f-1468dfc49dac admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:30.104700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb92ae-7a80-4d5a-8c11-9b8893664f48 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:30.104830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-74c15b17-4881-421a-b54f-1468dfc49dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:30.133773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c15b17-4881-421a-b54f-1468dfc49dac admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:30.145874 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 764/1563] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:30 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:30.150146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb92ae-7a80-4d5a-8c11-9b8893664f48 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:30.154178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18111a6-e526-412e-b17e-acb9a436e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:30.155212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18111a6-e526-412e-b17e-acb9a436e3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:30.155495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18111a6-e526-412e-b17e-acb9a436e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:30.155970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18111a6-e526-412e-b17e-acb9a436e3e6 admin admin] PATH_INFO: `/v3/projects/9eec993c81b841ff8194a92d7b5a6878` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:30.157551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18111a6-e526-412e-b17e-acb9a436e3e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eec993c81b841ff8194a92d7b5a6878)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:30.159549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18111a6-e526-412e-b17e-acb9a436e3e6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:30.261908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f18111a6-e526-412e-b17e-acb9a436e3e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eec993c81b841ff8194a92d7b5a6878', 'request_id': 'req-f18111a6-e526-412e-b17e-acb9a436e3e6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:30.267979 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:30.275532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f18111a6-e526-412e-b17e-acb9a436e3e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eec993c81b841ff8194a92d7b5a6878', 'request_id': 'req-f18111a6-e526-412e-b17e-acb9a436e3e6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:30.290593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb92ae-7a80-4d5a-8c11-9b8893664f48 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:30.292866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f18111a6-e526-412e-b17e-acb9a436e3e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eec993c81b841ff8194a92d7b5a6878', 'request_id': 'req-f18111a6-e526-412e-b17e-acb9a436e3e6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:30.295849 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:30.313993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f18111a6-e526-412e-b17e-acb9a436e3e6 admin admin] The token cache is being invalidate because project 9eec993c81b841ff8194a92d7b5a6878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:30.314268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f18111a6-e526-412e-b17e-acb9a436e3e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:30.315333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f18111a6-e526-412e-b17e-acb9a436e3e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:30.320185 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 800/1564] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:30 2022] DELETE /identity/v3/projects/9eec993c81b841ff8194a92d7b5a6878 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:30.326685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc8506-9207-476b-a27e-a5fe84156371 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:30.327181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc8506-9207-476b-a27e-a5fe84156371 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:30.327295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc8506-9207-476b-a27e-a5fe84156371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:30.359761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9cdc8506-9207-476b-a27e-a5fe84156371 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:30.361400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9cdc8506-9207-476b-a27e-a5fe84156371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:30.418569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679934b-34aa-4cab-bbdb-e8dd3b2e0b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:30.419251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679934b-34aa-4cab-bbdb-e8dd3b2e0b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:30.419528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679934b-34aa-4cab-bbdb-e8dd3b2e0b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:30.424217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679934b-34aa-4cab-bbdb-e8dd3b2e0b44 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:30.424962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679934b-34aa-4cab-bbdb-e8dd3b2e0b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:30.435320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679934b-34aa-4cab-bbdb-e8dd3b2e0b44 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:30.499112 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 765/1565] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:30 2022] POST /identity/v3/users => generated 287 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:30.511884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679934b-34aa-4cab-bbdb-e8dd3b2e0b44 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:30.515626 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 801/1566] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:30.525788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f679934b-34aa-4cab-bbdb-e8dd3b2e0b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:30.526009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9bfde-cb31-4c88-a243-c7b6e81898c6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:30.526307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9bfde-cb31-4c88-a243-c7b6e81898c6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:30.526644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9bfde-cb31-4c88-a243-c7b6e81898c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:30.577285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679934b-34aa-4cab-bbdb-e8dd3b2e0b44 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:30.587995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf86c1-3a16-438c-aa93-943f14dc8f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:30.588623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf86c1-3a16-438c-aa93-943f14dc8f0f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:30.588898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf86c1-3a16-438c-aa93-943f14dc8f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:30.589167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf86c1-3a16-438c-aa93-943f14dc8f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:30.592909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf86c1-3a16-438c-aa93-943f14dc8f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:30.597649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf86c1-3a16-438c-aa93-943f14dc8f0f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:30.599073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b1e9bfde-cb31-4c88-a243-c7b6e81898c6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:30.600934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b1e9bfde-cb31-4c88-a243-c7b6e81898c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:30.614429 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 802/1567] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:30.619271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9bfde-cb31-4c88-a243-c7b6e81898c6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:30.639838 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 766/1568] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:30.641719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf86c1-3a16-438c-aa93-943f14dc8f0f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:30.650951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9bfde-cb31-4c88-a243-c7b6e81898c6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:30.669381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2ecd-2bc1-4a06-b3ad-2d244d4ffa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:30.670321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf86c1-3a16-438c-aa93-943f14dc8f0f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:30.670659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2ecd-2bc1-4a06-b3ad-2d244d4ffa98 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:30.671779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2ecd-2bc1-4a06-b3ad-2d244d4ffa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:30.672174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2ecd-2bc1-4a06-b3ad-2d244d4ffa98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:30.672947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee2ecd-2bc1-4a06-b3ad-2d244d4ffa98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:30.673872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee2ecd-2bc1-4a06-b3ad-2d244d4ffa98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:30.677275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee2ecd-2bc1-4a06-b3ad-2d244d4ffa98 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:30.683714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1df17-9624-4fd4-834e-34c749a306f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:30.685934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1df17-9624-4fd4-834e-34c749a306f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:30.687290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1df17-9624-4fd4-834e-34c749a306f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:30.687713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1df17-9624-4fd4-834e-34c749a306f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:30.688671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1df17-9624-4fd4-834e-34c749a306f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:30.694330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1df17-9624-4fd4-834e-34c749a306f0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:30.713355 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 803/1569] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:30.717724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2ecd-2bc1-4a06-b3ad-2d244d4ffa98 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:30.728708 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 767/1570] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:30.729990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1df17-9624-4fd4-834e-34c749a306f0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:30.740458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2ecd-2bc1-4a06-b3ad-2d244d4ffa98 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:30.751234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071575-77a3-458e-90d2-a17a6304f67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:30.752327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071575-77a3-458e-90d2-a17a6304f67c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:30.752599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1df17-9624-4fd4-834e-34c749a306f0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:30.753612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071575-77a3-458e-90d2-a17a6304f67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:30.753960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071575-77a3-458e-90d2-a17a6304f67c admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:30.754815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5071575-77a3-458e-90d2-a17a6304f67c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:30.758563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5071575-77a3-458e-90d2-a17a6304f67c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:30.765138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d23ea-f0c0-4872-bed7-9d5986e63fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:30.765807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d23ea-f0c0-4872-bed7-9d5986e63fec admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:30.766171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d23ea-f0c0-4872-bed7-9d5986e63fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:30.766708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d23ea-f0c0-4872-bed7-9d5986e63fec admin admin] PATH_INFO: `/v3/projects/f6556287cca54d74b4971ef3e666cc1e/users/f3b14e05c41648159d8ed97719c68862/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:30.808047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d23ea-f0c0-4872-bed7-9d5986e63fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6556287cca54d74b4971ef3e666cc1e, user_id=f3b14e05c41648159d8ed97719c68862, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:30.811892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d23ea-f0c0-4872-bed7-9d5986e63fec admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:30.828419 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 804/1571] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:30 2022] POST /identity/v3/projects => generated 407 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:00:30.833732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071575-77a3-458e-90d2-a17a6304f67c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:30.847846 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 768/1572] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:30 2022] PUT /identity/v3/projects/f6556287cca54d74b4971ef3e666cc1e/users/f3b14e05c41648159d8ed97719c68862/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:30.859121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16aea7-1792-463e-8b33-561d1c3dd300 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:30.859121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16aea7-1792-463e-8b33-561d1c3dd300 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:30.859347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16aea7-1792-463e-8b33-561d1c3dd300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:30.921166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4e16aea7-1792-463e-8b33-561d1c3dd300 None None] MFA Rules not processed for user `f3b14e05c41648159d8ed97719c68862`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:30.922400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4e16aea7-1792-463e-8b33-561d1c3dd300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:30.943856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071575-77a3-458e-90d2-a17a6304f67c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:31.069108 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:31.087029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8229690-39ba-4abc-88ec-c291f233a376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:31.087703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8229690-39ba-4abc-88ec-c291f233a376 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:31.088037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8229690-39ba-4abc-88ec-c291f233a376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:31.088416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8229690-39ba-4abc-88ec-c291f233a376 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:31.089017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8229690-39ba-4abc-88ec-c291f233a376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:31.093366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8229690-39ba-4abc-88ec-c291f233a376 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:31.098579 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 769/1573] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:31.101295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16aea7-1792-463e-8b33-561d1c3dd300 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:31.123320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16aea7-1792-463e-8b33-561d1c3dd300 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:31.129866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1e795-8ebd-4b5b-86ce-8658e0324b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:31.134607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1e795-8ebd-4b5b-86ce-8658e0324b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:31.138099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1e795-8ebd-4b5b-86ce-8658e0324b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:31.141434 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 805/1574] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:30 2022] POST /identity/v3/users => generated 304 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:31.141714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1e795-8ebd-4b5b-86ce-8658e0324b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:31.142621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1e795-8ebd-4b5b-86ce-8658e0324b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:31.146570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8229690-39ba-4abc-88ec-c291f233a376 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:31.147634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1e795-8ebd-4b5b-86ce-8658e0324b44 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:31.161178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8229690-39ba-4abc-88ec-c291f233a376 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:31.166510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48233b8d-866c-485f-a4cf-28af787cb236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:31.167614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48233b8d-866c-485f-a4cf-28af787cb236 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:31.167614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48233b8d-866c-485f-a4cf-28af787cb236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:31.167791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48233b8d-866c-485f-a4cf-28af787cb236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:31.168346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48233b8d-866c-485f-a4cf-28af787cb236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:31.170020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48233b8d-866c-485f-a4cf-28af787cb236 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:31.184929 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 806/1575] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:31.192800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48233b8d-866c-485f-a4cf-28af787cb236 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:31.218354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48233b8d-866c-485f-a4cf-28af787cb236 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:31.218579 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 770/1576] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:31 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:31.220224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1e795-8ebd-4b5b-86ce-8658e0324b44 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:31.246061 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:31.372753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cd495-5fa0-4f95-a996-dd2425d0447a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:31.374480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd495-5fa0-4f95-a996-dd2425d0447a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:31.374480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd495-5fa0-4f95-a996-dd2425d0447a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:31.374480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd495-5fa0-4f95-a996-dd2425d0447a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:31.377120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cd495-5fa0-4f95-a996-dd2425d0447a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:31.380352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cd495-5fa0-4f95-a996-dd2425d0447a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:31.388055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1e795-8ebd-4b5b-86ce-8658e0324b44 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:31.396974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0565f-31e4-48dc-877b-d8ebb540338d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:31.397855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0565f-31e4-48dc-877b-d8ebb540338d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:31.398296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0565f-31e4-48dc-877b-d8ebb540338d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:31.398989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0565f-31e4-48dc-877b-d8ebb540338d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:31.400480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0565f-31e4-48dc-877b-d8ebb540338d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:31.404332 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 807/1577] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:31.404332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0d213-c7aa-4fbe-8fa9-e051b8f4a194 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:31.404332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0d213-c7aa-4fbe-8fa9-e051b8f4a194 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:31.404332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0d213-c7aa-4fbe-8fa9-e051b8f4a194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:31.409866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0565f-31e4-48dc-877b-d8ebb540338d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:31.463300 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 771/1578] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:31 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:31.464641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0565f-31e4-48dc-877b-d8ebb540338d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:31.467064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6ac0d213-c7aa-4fbe-8fa9-e051b8f4a194 None None] MFA Rules not processed for user `5f46ddd0268d44bfacff0400e3f38e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:31.468017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bde0565f-31e4-48dc-877b-d8ebb540338d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:31.469503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6ac0d213-c7aa-4fbe-8fa9-e051b8f4a194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:31.483610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0565f-31e4-48dc-877b-d8ebb540338d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:31.490930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:31.491697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:31.492156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:31.492505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] PATH_INFO: `/v3/projects/eb64fefce1ee479bb3a351f0a1542c9d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:31.494952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb64fefce1ee479bb3a351f0a1542c9d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:31.497685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:31.613786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb64fefce1ee479bb3a351f0a1542c9d', 'request_id': 'req-b98f1e30-896e-47c9-8cad-44796416f24f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:31.624632 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 808/1579] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:31.624632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0d213-c7aa-4fbe-8fa9-e051b8f4a194 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:31.636485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb64fefce1ee479bb3a351f0a1542c9d', 'request_id': 'req-b98f1e30-896e-47c9-8cad-44796416f24f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:31.649043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0d213-c7aa-4fbe-8fa9-e051b8f4a194 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:31.653266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb64fefce1ee479bb3a351f0a1542c9d', 'request_id': 'req-b98f1e30-896e-47c9-8cad-44796416f24f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:31.676647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] The token cache is being invalidate because project eb64fefce1ee479bb3a351f0a1542c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:31.677916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:31.678811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:31.685295 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 772/1580] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:31 2022] DELETE /identity/v3/projects/eb64fefce1ee479bb3a351f0a1542c9d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:31.686444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:31.688613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:31.788221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e5c57-1374-4e83-89e1-96d0f59c0307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:31.789066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e5c57-1374-4e83-89e1-96d0f59c0307 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:31.790243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e5c57-1374-4e83-89e1-96d0f59c0307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:31.792018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e5c57-1374-4e83-89e1-96d0f59c0307 admin admin] PATH_INFO: `/v3/projects/38d14a9855064af18f59044a6c3c2b5a/users/389a27acbecb4855be681d36e2c7730e/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:31.802516 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:31.816066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f1e30-896e-47c9-8cad-44796416f24f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:31.825270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9011f6-3267-44cc-be4e-edc5b2cde1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:31.825963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9011f6-3267-44cc-be4e-edc5b2cde1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:31.826666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9011f6-3267-44cc-be4e-edc5b2cde1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:31.826666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9011f6-3267-44cc-be4e-edc5b2cde1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:31.827428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9011f6-3267-44cc-be4e-edc5b2cde1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:31.829216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9011f6-3267-44cc-be4e-edc5b2cde1d2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:31.830069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e5c57-1374-4e83-89e1-96d0f59c0307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d14a9855064af18f59044a6c3c2b5a, user_id=389a27acbecb4855be681d36e2c7730e, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:31.833779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e5c57-1374-4e83-89e1-96d0f59c0307 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:31.855152 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 773/1581] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:31.856364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9011f6-3267-44cc-be4e-edc5b2cde1d2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:31.858251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fb9011f6-3267-44cc-be4e-edc5b2cde1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:31.858532 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 809/1582] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:31 2022] PUT /identity/v3/projects/38d14a9855064af18f59044a6c3c2b5a/users/389a27acbecb4855be681d36e2c7730e/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:31.859541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e5c57-1374-4e83-89e1-96d0f59c0307 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:31.864608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3d7e5c57-1374-4e83-89e1-96d0f59c0307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:31.874855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9011f6-3267-44cc-be4e-edc5b2cde1d2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:31.897248 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:31.972089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e5c57-1374-4e83-89e1-96d0f59c0307 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:31.975452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e77309-b0c8-499a-be9f-3d94c6413b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:31.976257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e77309-b0c8-499a-be9f-3d94c6413b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:31.976542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e77309-b0c8-499a-be9f-3d94c6413b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:31.976817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e77309-b0c8-499a-be9f-3d94c6413b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:31.977462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e77309-b0c8-499a-be9f-3d94c6413b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:31.978894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5319a-1004-4533-8b1d-7047045091e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:31.979643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5319a-1004-4533-8b1d-7047045091e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:31.979927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5319a-1004-4533-8b1d-7047045091e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:31.980086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e77309-b0c8-499a-be9f-3d94c6413b05 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:31.980182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5319a-1004-4533-8b1d-7047045091e8 admin admin] PATH_INFO: `/v3/users/7a91619b1a1946d08b8b448452326d76` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:31.981356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5319a-1004-4533-8b1d-7047045091e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a91619b1a1946d08b8b448452326d76)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:31.986162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5319a-1004-4533-8b1d-7047045091e8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:32.032084 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 774/1583] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:31 2022] POST /identity/v3/projects => generated 397 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:32.032084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e77309-b0c8-499a-be9f-3d94c6413b05 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:32.120315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c2f5319a-1004-4533-8b1d-7047045091e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a91619b1a1946d08b8b448452326d76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:32.121239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c2f5319a-1004-4533-8b1d-7047045091e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a91619b1a1946d08b8b448452326d76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:32.147659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c2f5319a-1004-4533-8b1d-7047045091e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a91619b1a1946d08b8b448452326d76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:32.153993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e77309-b0c8-499a-be9f-3d94c6413b05 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:32.160361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e06fb8-ce30-4593-b241-52406b31e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:32.161134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e06fb8-ce30-4593-b241-52406b31e897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.161417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e06fb8-ce30-4593-b241-52406b31e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.161693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e06fb8-ce30-4593-b241-52406b31e897 admin admin] PATH_INFO: `/v3/projects/f1dc88035f18493d8c713b47a35517ea/users/6f6ea3b7518449b89a369107e12ee9cf/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.162383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c2f5319a-1004-4533-8b1d-7047045091e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a91619b1a1946d08b8b448452326d76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:32.164093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c2f5319a-1004-4533-8b1d-7047045091e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a91619b1a1946d08b8b448452326d76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:32.184584 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 810/1584] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:31 2022] DELETE /identity/v3/users/7a91619b1a1946d08b8b448452326d76 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:32.186159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5256c-9584-4d7f-b14d-317f903e8c9f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.186459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5256c-9584-4d7f-b14d-317f903e8c9f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.186768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5256c-9584-4d7f-b14d-317f903e8c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.189541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e06fb8-ce30-4593-b241-52406b31e897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1dc88035f18493d8c713b47a35517ea, user_id=6f6ea3b7518449b89a369107e12ee9cf, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:32.193230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e06fb8-ce30-4593-b241-52406b31e897 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:32.220132 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 775/1585] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:32 2022] PUT /identity/v3/projects/f1dc88035f18493d8c713b47a35517ea/users/6f6ea3b7518449b89a369107e12ee9cf/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:32.222234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e06fb8-ce30-4593-b241-52406b31e897 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:32.226341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b1e06fb8-ce30-4593-b241-52406b31e897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:32.231907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-61b5256c-9584-4d7f-b14d-317f903e8c9f None None] MFA Rules not processed for user `389a27acbecb4855be681d36e2c7730e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:32.235349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-61b5256c-9584-4d7f-b14d-317f903e8c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:32.354792 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:32.359993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e06fb8-ce30-4593-b241-52406b31e897 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:32.367897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa189c1-fb5b-478d-96a9-71a89f8b3eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:32.368598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa189c1-fb5b-478d-96a9-71a89f8b3eaf admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.368879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa189c1-fb5b-478d-96a9-71a89f8b3eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.369184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa189c1-fb5b-478d-96a9-71a89f8b3eaf admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.372961 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 811/1586] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:32 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:32.373758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa189c1-fb5b-478d-96a9-71a89f8b3eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:32.373859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5256c-9584-4d7f-b14d-317f903e8c9f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:32.373859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-61b5256c-9584-4d7f-b14d-317f903e8c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:32.374103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa189c1-fb5b-478d-96a9-71a89f8b3eaf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:32.388522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5256c-9584-4d7f-b14d-317f903e8c9f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:32.395530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33363ca8-29d4-4c3b-8390-20d11ed3664e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:32.396335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363ca8-29d4-4c3b-8390-20d11ed3664e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.396982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363ca8-29d4-4c3b-8390-20d11ed3664e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.397259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363ca8-29d4-4c3b-8390-20d11ed3664e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.399330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33363ca8-29d4-4c3b-8390-20d11ed3664e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:32.400983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33363ca8-29d4-4c3b-8390-20d11ed3664e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:32.405114 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 776/1587] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:32 2022] POST /identity/v3/users => generated 305 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:32.405114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa189c1-fb5b-478d-96a9-71a89f8b3eaf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:32.407426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2fa189c1-fb5b-478d-96a9-71a89f8b3eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:32.415052 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 812/1588] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:32.416188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33363ca8-29d4-4c3b-8390-20d11ed3664e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:32.422643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa189c1-fb5b-478d-96a9-71a89f8b3eaf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:32.429292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33363ca8-29d4-4c3b-8390-20d11ed3664e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:32.430002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3af9c2-31f4-4cec-9ecd-de64e5c64c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:32.430725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3af9c2-31f4-4cec-9ecd-de64e5c64c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.431137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3af9c2-31f4-4cec-9ecd-de64e5c64c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.431518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3af9c2-31f4-4cec-9ecd-de64e5c64c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.432260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3af9c2-31f4-4cec-9ecd-de64e5c64c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:32.434349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f06f-6736-4046-a551-63a29909e8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:32.434758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3af9c2-31f4-4cec-9ecd-de64e5c64c3d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:32.434997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f06f-6736-4046-a551-63a29909e8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.435284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f06f-6736-4046-a551-63a29909e8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.436084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f06f-6736-4046-a551-63a29909e8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.436344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94f06f-6736-4046-a551-63a29909e8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:32.437943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94f06f-6736-4046-a551-63a29909e8a4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:32.450306 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:32.461135 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 813/1589] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:32.461957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f06f-6736-4046-a551-63a29909e8a4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:32.476494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f06f-6736-4046-a551-63a29909e8a4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:32.482883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2a0cb-7b31-4373-8749-150f803e9707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:32.484209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2a0cb-7b31-4373-8749-150f803e9707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.484573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2a0cb-7b31-4373-8749-150f803e9707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.484919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2a0cb-7b31-4373-8749-150f803e9707 admin admin] PATH_INFO: `/v3/projects/f1dc88035f18493d8c713b47a35517ea/users/6f6ea3b7518449b89a369107e12ee9cf/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.487283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2a0cb-7b31-4373-8749-150f803e9707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1dc88035f18493d8c713b47a35517ea, user_id=6f6ea3b7518449b89a369107e12ee9cf, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:32.490878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2a0cb-7b31-4373-8749-150f803e9707 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:32.496372 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 777/1590] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:32 2022] POST /identity/v3/projects => generated 407 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:32.502489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3af9c2-31f4-4cec-9ecd-de64e5c64c3d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:32.508192 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 814/1591] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:32 2022] PUT /identity/v3/projects/f1dc88035f18493d8c713b47a35517ea/users/6f6ea3b7518449b89a369107e12ee9cf/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:32.509311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2a0cb-7b31-4373-8749-150f803e9707 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:32.643670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3af9c2-31f4-4cec-9ecd-de64e5c64c3d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:32.656775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2a0cb-7b31-4373-8749-150f803e9707 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:32.657689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a16cd-a210-4db4-ae9e-554622fb769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:32.658593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a16cd-a210-4db4-ae9e-554622fb769b admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.658976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a16cd-a210-4db4-ae9e-554622fb769b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.659369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a16cd-a210-4db4-ae9e-554622fb769b admin admin] PATH_INFO: `/v3/projects/68df95d36de0437291c869f75979ec31/users/ea5df25b228648a0aa6c10519e921d40/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.662466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e530943-5bbe-42af-9528-19b540261e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:32.663365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e530943-5bbe-42af-9528-19b540261e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.663648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e530943-5bbe-42af-9528-19b540261e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.663923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e530943-5bbe-42af-9528-19b540261e50 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.664722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e530943-5bbe-42af-9528-19b540261e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:32.666797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e530943-5bbe-42af-9528-19b540261e50 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:32.696822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a16cd-a210-4db4-ae9e-554622fb769b admin admin] RBAC: Authorizing `identity:create_grant(project_id=68df95d36de0437291c869f75979ec31, user_id=ea5df25b228648a0aa6c10519e921d40, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:32.699821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a16cd-a210-4db4-ae9e-554622fb769b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:32.707287 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 815/1592] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:32 2022] POST /identity/v3/users => generated 310 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:32.708994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3acda-62de-4f5e-ae58-c1e245dcb52b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.709569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3acda-62de-4f5e-ae58-c1e245dcb52b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.709991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3acda-62de-4f5e-ae58-c1e245dcb52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.732966 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 778/1593] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:32 2022] PUT /identity/v3/projects/68df95d36de0437291c869f75979ec31/users/ea5df25b228648a0aa6c10519e921d40/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:32.739793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a16cd-a210-4db4-ae9e-554622fb769b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:32.754867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c6f3acda-62de-4f5e-ae58-c1e245dcb52b None None] MFA Rules not processed for user `6f6ea3b7518449b89a369107e12ee9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:32.758400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c6f3acda-62de-4f5e-ae58-c1e245dcb52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:32.858132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a16cd-a210-4db4-ae9e-554622fb769b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:32.863870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f330689-ff5f-434c-8abc-28d1aec25752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:32.864554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f330689-ff5f-434c-8abc-28d1aec25752 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.864838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f330689-ff5f-434c-8abc-28d1aec25752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.865112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f330689-ff5f-434c-8abc-28d1aec25752 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.865766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f330689-ff5f-434c-8abc-28d1aec25752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:32.867432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f330689-ff5f-434c-8abc-28d1aec25752 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:32.883538 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 779/1594] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:32.884517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f330689-ff5f-434c-8abc-28d1aec25752 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:32.900969 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 816/1595] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:32.900969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3acda-62de-4f5e-ae58-c1e245dcb52b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:32.900969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c6f3acda-62de-4f5e-ae58-c1e245dcb52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:32.902351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f330689-ff5f-434c-8abc-28d1aec25752 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:32.907716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01297e-add2-48e9-9c2b-02777569f708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:32.908559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01297e-add2-48e9-9c2b-02777569f708 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.908941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01297e-add2-48e9-9c2b-02777569f708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.909379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01297e-add2-48e9-9c2b-02777569f708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.910092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01297e-add2-48e9-9c2b-02777569f708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:32.911939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01297e-add2-48e9-9c2b-02777569f708 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:32.915107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3acda-62de-4f5e-ae58-c1e245dcb52b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:32.920458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:32.921940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.923570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.924058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] PATH_INFO: `/v3/projects/78a6b8d6cc1c4d27a4aee51a8ac3db5a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.926378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a6b8d6cc1c4d27a4aee51a8ac3db5a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:32.929075 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 780/1596] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:32.929283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:32.933379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01297e-add2-48e9-9c2b-02777569f708 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:32.945436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01297e-add2-48e9-9c2b-02777569f708 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:32.951102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab119f-a6c3-4fc0-9467-8ad0ac8748c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:32.952011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab119f-a6c3-4fc0-9467-8ad0ac8748c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:32.952365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab119f-a6c3-4fc0-9467-8ad0ac8748c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:32.952916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab119f-a6c3-4fc0-9467-8ad0ac8748c7 admin admin] PATH_INFO: `/v3/projects/52c0bf770a544c53b1863f560eff3238/users/af02f53a4bee43b7bb630876ba0217c6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:32.983260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab119f-a6c3-4fc0-9467-8ad0ac8748c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c0bf770a544c53b1863f560eff3238, user_id=af02f53a4bee43b7bb630876ba0217c6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:32.986887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab119f-a6c3-4fc0-9467-8ad0ac8748c7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:32.993575 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:33.021124 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 781/1597] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:32 2022] PUT /identity/v3/projects/52c0bf770a544c53b1863f560eff3238/users/af02f53a4bee43b7bb630876ba0217c6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:33.024830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b815-6626-4412-bdb1-f8f6f05783c2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:33.025592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a6b8d6cc1c4d27a4aee51a8ac3db5a', 'request_id': 'req-ac595716-1f43-4ae4-8708-e5eca477d46a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:33.026123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b815-6626-4412-bdb1-f8f6f05783c2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:33.027603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b815-6626-4412-bdb1-f8f6f05783c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:33.048177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a6b8d6cc1c4d27a4aee51a8ac3db5a', 'request_id': 'req-ac595716-1f43-4ae4-8708-e5eca477d46a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:33.073628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a6b8d6cc1c4d27a4aee51a8ac3db5a', 'request_id': 'req-ac595716-1f43-4ae4-8708-e5eca477d46a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:33.080297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c245b815-6626-4412-bdb1-f8f6f05783c2 None None] MFA Rules not processed for user `f3b14e05c41648159d8ed97719c68862`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:33.083423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c245b815-6626-4412-bdb1-f8f6f05783c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:33.093467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] The token cache is being invalidate because project 78a6b8d6cc1c4d27a4aee51a8ac3db5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:33.094019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:33.096453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:33.098632 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 817/1598] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:32 2022] DELETE /identity/v3/projects/78a6b8d6cc1c4d27a4aee51a8ac3db5a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:33.104545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:33.107303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:33.184518 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:33.264180 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 782/1599] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:33.265179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245b815-6626-4412-bdb1-f8f6f05783c2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:33.267429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c245b815-6626-4412-bdb1-f8f6f05783c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:33.289716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac595716-1f43-4ae4-8708-e5eca477d46a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:33.353930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245b815-6626-4412-bdb1-f8f6f05783c2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:33.359226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aee99d-9864-43e9-9b93-b71d59ddfb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:33.359993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aee99d-9864-43e9-9b93-b71d59ddfb88 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:33.360341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aee99d-9864-43e9-9b93-b71d59ddfb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:33.360706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aee99d-9864-43e9-9b93-b71d59ddfb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:33.361616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aee99d-9864-43e9-9b93-b71d59ddfb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:33.363712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aee99d-9864-43e9-9b93-b71d59ddfb88 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:33.368633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cbb63-5cf4-4701-af8e-0d5fd5b8342b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:33.369305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cbb63-5cf4-4701-af8e-0d5fd5b8342b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:33.369581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cbb63-5cf4-4701-af8e-0d5fd5b8342b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:33.369974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cbb63-5cf4-4701-af8e-0d5fd5b8342b admin admin] PATH_INFO: `/v3/projects/68df95d36de0437291c869f75979ec31/users/ea5df25b228648a0aa6c10519e921d40/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:33.372261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cbb63-5cf4-4701-af8e-0d5fd5b8342b admin admin] RBAC: Authorizing `identity:create_grant(project_id=68df95d36de0437291c869f75979ec31, user_id=ea5df25b228648a0aa6c10519e921d40, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:33.379244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cbb63-5cf4-4701-af8e-0d5fd5b8342b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:33.384004 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 783/1600] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:33.389069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedb1e9-b518-4e55-bf95-db13bc27b3da None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:33.390090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedb1e9-b518-4e55-bf95-db13bc27b3da None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:33.390090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedb1e9-b518-4e55-bf95-db13bc27b3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:33.406775 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 818/1601] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:33 2022] PUT /identity/v3/projects/68df95d36de0437291c869f75979ec31/users/ea5df25b228648a0aa6c10519e921d40/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:33.408183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cbb63-5cf4-4701-af8e-0d5fd5b8342b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:33.410691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-979cbb63-5cf4-4701-af8e-0d5fd5b8342b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:33.427562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8bedb1e9-b518-4e55-bf95-db13bc27b3da None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:33.429448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8bedb1e9-b518-4e55-bf95-db13bc27b3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:33.494217 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:33.569200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cbb63-5cf4-4701-af8e-0d5fd5b8342b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:33.584278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24bc4f-ae37-42b0-b963-189353f4e77f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:33.587216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24bc4f-ae37-42b0-b963-189353f4e77f service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:33.587453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24bc4f-ae37-42b0-b963-189353f4e77f service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:33.587730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24bc4f-ae37-42b0-b963-189353f4e77f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:33.591809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1d24bc4f-ae37-42b0-b963-189353f4e77f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:33.593970 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 784/1602] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:33.596000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedb1e9-b518-4e55-bf95-db13bc27b3da None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:33.612255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedb1e9-b518-4e55-bf95-db13bc27b3da None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:33.620111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cea97-8370-44b0-bebb-a7fec7031a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:33.621462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cea97-8370-44b0-bebb-a7fec7031a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:33.622038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cea97-8370-44b0-bebb-a7fec7031a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:33.622608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cea97-8370-44b0-bebb-a7fec7031a19 admin admin] PATH_INFO: `/v3/projects/52c0bf770a544c53b1863f560eff3238/users/af02f53a4bee43b7bb630876ba0217c6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:33.625374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cea97-8370-44b0-bebb-a7fec7031a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c0bf770a544c53b1863f560eff3238, user_id=af02f53a4bee43b7bb630876ba0217c6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:33.628725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cea97-8370-44b0-bebb-a7fec7031a19 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:33.643279 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 785/1603] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:33 2022] PUT /identity/v3/projects/52c0bf770a544c53b1863f560eff3238/users/af02f53a4bee43b7bb630876ba0217c6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:33.645609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e7d28-f965-4007-a36a-faaff96c094b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:33.645987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e7d28-f965-4007-a36a-faaff96c094b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:33.646358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e7d28-f965-4007-a36a-faaff96c094b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:33.682353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-265e7d28-f965-4007-a36a-faaff96c094b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:33.685750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-265e7d28-f965-4007-a36a-faaff96c094b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:33.758893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24bc4f-ae37-42b0-b963-189353f4e77f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:33.761128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24bc4f-ae37-42b0-b963-189353f4e77f service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:33.772958 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 819/1604] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:33.774469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d61fe-811a-40ce-b212-cc2dd75ad06f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:33.774786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d61fe-811a-40ce-b212-cc2dd75ad06f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:33.775625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d61fe-811a-40ce-b212-cc2dd75ad06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:33.799804 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 786/1605] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:33.806731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e7d28-f965-4007-a36a-faaff96c094b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:33.822454 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:33.826965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e7d28-f965-4007-a36a-faaff96c094b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:33.836801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cc9d61fe-811a-40ce-b212-cc2dd75ad06f None None] MFA Rules not processed for user `af02f53a4bee43b7bb630876ba0217c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:33.837063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6400e-0d30-4de3-96dc-53235ae6d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:33.837752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6400e-0d30-4de3-96dc-53235ae6d731 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:33.838013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc9d61fe-811a-40ce-b212-cc2dd75ad06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:33.838121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6400e-0d30-4de3-96dc-53235ae6d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:33.838361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6400e-0d30-4de3-96dc-53235ae6d731 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:33.840477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6400e-0d30-4de3-96dc-53235ae6d731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:33.840845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6400e-0d30-4de3-96dc-53235ae6d731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:33.844126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6400e-0d30-4de3-96dc-53235ae6d731 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:33.886405 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 787/1606] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:00:33.889266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6400e-0d30-4de3-96dc-53235ae6d731 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:33.917101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6400e-0d30-4de3-96dc-53235ae6d731 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:33.936988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b6a39-2c6f-40a3-be88-06092ec0aea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:33.937760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b6a39-2c6f-40a3-be88-06092ec0aea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:33.937897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b6a39-2c6f-40a3-be88-06092ec0aea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:33.938383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b6a39-2c6f-40a3-be88-06092ec0aea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:33.939687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b6a39-2c6f-40a3-be88-06092ec0aea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:33.944256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b6a39-2c6f-40a3-be88-06092ec0aea0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:34.013536 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 788/1607] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:33 2022] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:34.020076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b6a39-2c6f-40a3-be88-06092ec0aea0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:34.031901 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 820/1608] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:34.040844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d61fe-811a-40ce-b212-cc2dd75ad06f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:34.058876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d61fe-811a-40ce-b212-cc2dd75ad06f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:34.157904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918aea2d-cfa0-4bbb-a51c-031da1e6a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:34.158729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aea2d-cfa0-4bbb-a51c-031da1e6a17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:34.159839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aea2d-cfa0-4bbb-a51c-031da1e6a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:34.160491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aea2d-cfa0-4bbb-a51c-031da1e6a17a admin admin] PATH_INFO: `/v3/users/389a27acbecb4855be681d36e2c7730e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:34.161702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918aea2d-cfa0-4bbb-a51c-031da1e6a17a admin admin] RBAC: Authorizing `identity:delete_user(user_id=389a27acbecb4855be681d36e2c7730e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:34.163934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918aea2d-cfa0-4bbb-a51c-031da1e6a17a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:34.207378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b6a39-2c6f-40a3-be88-06092ec0aea0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:34.212101 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:34.220936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3297-cf72-415b-aa98-0abf835e5503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:34.222445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3297-cf72-415b-aa98-0abf835e5503 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:34.223484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3297-cf72-415b-aa98-0abf835e5503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:34.224083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3297-cf72-415b-aa98-0abf835e5503 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:34.225067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa3297-cf72-415b-aa98-0abf835e5503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:34.230748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa3297-cf72-415b-aa98-0abf835e5503 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:34.275070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-918aea2d-cfa0-4bbb-a51c-031da1e6a17a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389a27acbecb4855be681d36e2c7730e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:34.276380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-918aea2d-cfa0-4bbb-a51c-031da1e6a17a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389a27acbecb4855be681d36e2c7730e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:34.283700 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 789/1609] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:34 2022] POST /identity/v3/users => generated 302 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:34.285309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3297-cf72-415b-aa98-0abf835e5503 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:34.287679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7afa3297-cf72-415b-aa98-0abf835e5503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:34.306065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3297-cf72-415b-aa98-0abf835e5503 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:34.307977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-918aea2d-cfa0-4bbb-a51c-031da1e6a17a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389a27acbecb4855be681d36e2c7730e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:34.313845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcdb5b-f589-4368-acd7-c80042016dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:34.316411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcdb5b-f589-4368-acd7-c80042016dca admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:34.316701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcdb5b-f589-4368-acd7-c80042016dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:34.316978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcdb5b-f589-4368-acd7-c80042016dca admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:34.317688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcdb5b-f589-4368-acd7-c80042016dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:34.320214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcdb5b-f589-4368-acd7-c80042016dca admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:34.330719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-918aea2d-cfa0-4bbb-a51c-031da1e6a17a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389a27acbecb4855be681d36e2c7730e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:34.332095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-918aea2d-cfa0-4bbb-a51c-031da1e6a17a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389a27acbecb4855be681d36e2c7730e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:34.356112 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 790/1610] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:34.357319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcdb5b-f589-4368-acd7-c80042016dca admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:34.363230 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 821/1611] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:34 2022] DELETE /identity/v3/users/389a27acbecb4855be681d36e2c7730e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:34.365243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75784f-f3e0-450b-8137-01816660ed06 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:34.365531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75784f-f3e0-450b-8137-01816660ed06 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:34.365805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75784f-f3e0-450b-8137-01816660ed06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:34.385932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcdb5b-f589-4368-acd7-c80042016dca admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:34.408107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6d75784f-f3e0-450b-8137-01816660ed06 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:34.409403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6d75784f-f3e0-450b-8137-01816660ed06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:34.570057 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 822/1612] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:00:34.576077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3bfbe-df09-4793-9079-01f0bd580398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:34.576769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3bfbe-df09-4793-9079-01f0bd580398 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:34.577054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3bfbe-df09-4793-9079-01f0bd580398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:34.577327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3bfbe-df09-4793-9079-01f0bd580398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:34.578032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3bfbe-df09-4793-9079-01f0bd580398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:34.580061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3bfbe-df09-4793-9079-01f0bd580398 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:34.593821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75784f-f3e0-450b-8137-01816660ed06 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:34.595577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6d75784f-f3e0-450b-8137-01816660ed06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:34.598316 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 791/1613] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:34.599379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3bfbe-df09-4793-9079-01f0bd580398 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:34.621829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3bfbe-df09-4793-9079-01f0bd580398 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:34.645460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378809c-7355-4535-8839-ed998fa4ee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:34.646072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378809c-7355-4535-8839-ed998fa4ee87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:34.646471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378809c-7355-4535-8839-ed998fa4ee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:34.646622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378809c-7355-4535-8839-ed998fa4ee87 admin admin] PATH_INFO: `/v3/projects/f7c109c5dd4f4be2b47d3c4d4bba3d5c/users/835264587c7f4e68ab1e8338b507e6c0/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:34.707557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378809c-7355-4535-8839-ed998fa4ee87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c109c5dd4f4be2b47d3c4d4bba3d5c, user_id=835264587c7f4e68ab1e8338b507e6c0, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:34.713632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378809c-7355-4535-8839-ed998fa4ee87 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:34.782999 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 792/1614] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:34 2022] PUT /identity/v3/projects/f7c109c5dd4f4be2b47d3c4d4bba3d5c/users/835264587c7f4e68ab1e8338b507e6c0/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:34.787144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397a7b5-53d1-4698-89e4-b4cebe4bf587 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:34.787438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397a7b5-53d1-4698-89e4-b4cebe4bf587 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:34.789004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397a7b5-53d1-4698-89e4-b4cebe4bf587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:34.799032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75784f-f3e0-450b-8137-01816660ed06 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:34.883706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e397a7b5-53d1-4698-89e4-b4cebe4bf587 None None] MFA Rules not processed for user `835264587c7f4e68ab1e8338b507e6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:34.885139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e397a7b5-53d1-4698-89e4-b4cebe4bf587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:34.935537 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:34.995348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e2918-8889-4c48-a922-1033bd937020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:34.996038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e2918-8889-4c48-a922-1033bd937020 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:34.997985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e2918-8889-4c48-a922-1033bd937020 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:34.998260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e2918-8889-4c48-a922-1033bd937020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:35.025835 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:35.158255 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 793/1615] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:35.164715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397a7b5-53d1-4698-89e4-b4cebe4bf587 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:35.246794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e2918-8889-4c48-a922-1033bd937020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:35.254598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e2918-8889-4c48-a922-1033bd937020 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:35.285862 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 823/1616] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:35.354619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397a7b5-53d1-4698-89e4-b4cebe4bf587 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:35.359687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bdd40-56e1-40ed-8347-d38e2b3d7b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:35.360669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bdd40-56e1-40ed-8347-d38e2b3d7b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:35.360669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bdd40-56e1-40ed-8347-d38e2b3d7b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:35.360922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bdd40-56e1-40ed-8347-d38e2b3d7b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:35.361570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bdd40-56e1-40ed-8347-d38e2b3d7b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:35.364178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bdd40-56e1-40ed-8347-d38e2b3d7b02 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:35.419031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e2918-8889-4c48-a922-1033bd937020 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:35.428207 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 794/1617] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:35 2022] POST /identity/v3/projects => generated 403 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:35.431952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e2918-8889-4c48-a922-1033bd937020 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:35.568010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa4efe-c0d3-4455-8158-be5eebcf9b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:35.568767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa4efe-c0d3-4455-8158-be5eebcf9b08 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:35.569020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa4efe-c0d3-4455-8158-be5eebcf9b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:35.569748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa4efe-c0d3-4455-8158-be5eebcf9b08 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:35.570388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa4efe-c0d3-4455-8158-be5eebcf9b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:35.572689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa4efe-c0d3-4455-8158-be5eebcf9b08 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:35.603794 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 824/1618] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:35 2022] POST /identity/v3/users => generated 308 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:35.606796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bdd40-56e1-40ed-8347-d38e2b3d7b02 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:35.621432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bdd40-56e1-40ed-8347-d38e2b3d7b02 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:35.635456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80949e49-e1b3-4b82-a1cb-d4cfdd7a035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:35.636482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80949e49-e1b3-4b82-a1cb-d4cfdd7a035d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:35.637064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80949e49-e1b3-4b82-a1cb-d4cfdd7a035d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:35.637540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80949e49-e1b3-4b82-a1cb-d4cfdd7a035d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:35.638438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80949e49-e1b3-4b82-a1cb-d4cfdd7a035d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:35.640685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80949e49-e1b3-4b82-a1cb-d4cfdd7a035d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:35.679077 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 795/1619] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:35.681635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa4efe-c0d3-4455-8158-be5eebcf9b08 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:35.724849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa4efe-c0d3-4455-8158-be5eebcf9b08 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:35.735383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcebdd6-cfd0-4a03-8f68-cf2d66e0d717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:35.735817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcebdd6-cfd0-4a03-8f68-cf2d66e0d717 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:35.736323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcebdd6-cfd0-4a03-8f68-cf2d66e0d717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:35.736627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcebdd6-cfd0-4a03-8f68-cf2d66e0d717 admin admin] PATH_INFO: `/v3/projects/293794b5b8284f03bdda4e3dd3c71929/users/d54d3e92ad06463188e86d49725acd8d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:35.762900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcebdd6-cfd0-4a03-8f68-cf2d66e0d717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293794b5b8284f03bdda4e3dd3c71929, user_id=d54d3e92ad06463188e86d49725acd8d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:35.767257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcebdd6-cfd0-4a03-8f68-cf2d66e0d717 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:35.793836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80949e49-e1b3-4b82-a1cb-d4cfdd7a035d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:35.799323 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 825/1620] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:35 2022] PUT /identity/v3/projects/293794b5b8284f03bdda4e3dd3c71929/users/d54d3e92ad06463188e86d49725acd8d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:35.806312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80949e49-e1b3-4b82-a1cb-d4cfdd7a035d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:35.907206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c252d64-db1a-497f-8a5f-55f06aa4980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:35.907846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c252d64-db1a-497f-8a5f-55f06aa4980b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:35.908128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c252d64-db1a-497f-8a5f-55f06aa4980b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:35.908401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c252d64-db1a-497f-8a5f-55f06aa4980b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:35.911227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c252d64-db1a-497f-8a5f-55f06aa4980b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:35.915457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c252d64-db1a-497f-8a5f-55f06aa4980b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:35.951426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcebdd6-cfd0-4a03-8f68-cf2d66e0d717 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:35.962362 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 796/1621] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:35.970646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcebdd6-cfd0-4a03-8f68-cf2d66e0d717 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:35.980472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62571b1-ec98-4e08-95fd-a148042120e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:35.982266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62571b1-ec98-4e08-95fd-a148042120e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:35.982788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62571b1-ec98-4e08-95fd-a148042120e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:35.983203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62571b1-ec98-4e08-95fd-a148042120e0 admin admin] PATH_INFO: `/v3/projects/293794b5b8284f03bdda4e3dd3c71929/users/d54d3e92ad06463188e86d49725acd8d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:35.986239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62571b1-ec98-4e08-95fd-a148042120e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293794b5b8284f03bdda4e3dd3c71929, user_id=d54d3e92ad06463188e86d49725acd8d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:35.991722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62571b1-ec98-4e08-95fd-a148042120e0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:36.015550 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 826/1622] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:35 2022] PUT /identity/v3/projects/293794b5b8284f03bdda4e3dd3c71929/users/d54d3e92ad06463188e86d49725acd8d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:36.020219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc925e2e-8d1a-4eef-a311-6f55d56d6edb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:36.020727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc925e2e-8d1a-4eef-a311-6f55d56d6edb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:36.021163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc925e2e-8d1a-4eef-a311-6f55d56d6edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:36.091678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fc925e2e-8d1a-4eef-a311-6f55d56d6edb None None] MFA Rules not processed for user `d54d3e92ad06463188e86d49725acd8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:36.094461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fc925e2e-8d1a-4eef-a311-6f55d56d6edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:36.140437 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:36.291224 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 797/1623] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:36.305455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62571b1-ec98-4e08-95fd-a148042120e0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:36.310204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c62571b1-ec98-4e08-95fd-a148042120e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:36.484282 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:36.527669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62571b1-ec98-4e08-95fd-a148042120e0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:36.544105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3012f5-bbcd-458f-8666-bdb438cb5011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:36.544743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3012f5-bbcd-458f-8666-bdb438cb5011 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:36.545609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3012f5-bbcd-458f-8666-bdb438cb5011 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:36.545893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3012f5-bbcd-458f-8666-bdb438cb5011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:36.570938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3012f5-bbcd-458f-8666-bdb438cb5011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:36.575132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3012f5-bbcd-458f-8666-bdb438cb5011 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:36.592362 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 827/1624] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:36 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:36.662438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc925e2e-8d1a-4eef-a311-6f55d56d6edb None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:36.664604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fc925e2e-8d1a-4eef-a311-6f55d56d6edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:36.696484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3012f5-bbcd-458f-8666-bdb438cb5011 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:36.697604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc925e2e-8d1a-4eef-a311-6f55d56d6edb None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:36.698016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d3012f5-bbcd-458f-8666-bdb438cb5011 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:36.705111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41d729-80f1-4fa3-821b-ec79242629c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:36.706731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41d729-80f1-4fa3-821b-ec79242629c6 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:36.717811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41d729-80f1-4fa3-821b-ec79242629c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:36.719520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41d729-80f1-4fa3-821b-ec79242629c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:36.842180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41d729-80f1-4fa3-821b-ec79242629c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:36.844480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41d729-80f1-4fa3-821b-ec79242629c6 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:36.856406 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 798/1625] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:36 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:36.866483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3012f5-bbcd-458f-8666-bdb438cb5011 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:36.871775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:36.872683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:36.873204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:36.873865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] PATH_INFO: `/v3/projects/38d14a9855064af18f59044a6c3c2b5a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:36.875576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d14a9855064af18f59044a6c3c2b5a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:36.878062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:36.990323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d14a9855064af18f59044a6c3c2b5a', 'request_id': 'req-6bae3001-6c54-4e01-8641-658c91b88fba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:36.997341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d14a9855064af18f59044a6c3c2b5a', 'request_id': 'req-6bae3001-6c54-4e01-8641-658c91b88fba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.013167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d14a9855064af18f59044a6c3c2b5a', 'request_id': 'req-6bae3001-6c54-4e01-8641-658c91b88fba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.031734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] The token cache is being invalidate because project 38d14a9855064af18f59044a6c3c2b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:37.033973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.036589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.038451 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 828/1626] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:36 2022] DELETE /identity/v3/projects/38d14a9855064af18f59044a6c3c2b5a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:37.043598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41d729-80f1-4fa3-821b-ec79242629c6 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:37.057950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41d729-80f1-4fa3-821b-ec79242629c6 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:37.275016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92c498-e4a6-4db0-8d00-3cee5f1d7af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:37.275743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92c498-e4a6-4db0-8d00-3cee5f1d7af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:37.276022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92c498-e4a6-4db0-8d00-3cee5f1d7af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:37.276294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92c498-e4a6-4db0-8d00-3cee5f1d7af0 admin admin] PATH_INFO: `/v3/users/af02f53a4bee43b7bb630876ba0217c6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:37.277650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92c498-e4a6-4db0-8d00-3cee5f1d7af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af02f53a4bee43b7bb630876ba0217c6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:37.279627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92c498-e4a6-4db0-8d00-3cee5f1d7af0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:37.394320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:37.395851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:37.397260 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:37.404026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4f92c498-e4a6-4db0-8d00-3cee5f1d7af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af02f53a4bee43b7bb630876ba0217c6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.405388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4f92c498-e4a6-4db0-8d00-3cee5f1d7af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af02f53a4bee43b7bb630876ba0217c6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.409779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae3001-6c54-4e01-8641-658c91b88fba admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:37.416726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:37.418144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:37.418618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:37.419306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] PATH_INFO: `/v3/users/835264587c7f4e68ab1e8338b507e6c0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:37.420721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=835264587c7f4e68ab1e8338b507e6c0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:37.423018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:37.446737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4f92c498-e4a6-4db0-8d00-3cee5f1d7af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af02f53a4bee43b7bb630876ba0217c6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.472192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4f92c498-e4a6-4db0-8d00-3cee5f1d7af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af02f53a4bee43b7bb630876ba0217c6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.473112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4f92c498-e4a6-4db0-8d00-3cee5f1d7af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af02f53a4bee43b7bb630876ba0217c6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.508947 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 799/1627] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:37 2022] DELETE /identity/v3/users/af02f53a4bee43b7bb630876ba0217c6 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:37.524042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835264587c7f4e68ab1e8338b507e6c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.524895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835264587c7f4e68ab1e8338b507e6c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.548311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835264587c7f4e68ab1e8338b507e6c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.549604 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:37.564158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835264587c7f4e68ab1e8338b507e6c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.569125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835264587c7f4e68ab1e8338b507e6c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:37.613201 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 829/1628] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:37 2022] DELETE /identity/v3/users/835264587c7f4e68ab1e8338b507e6c0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:00:37.627557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c3ac5-3214-46c0-9476-ae4c6faf0c6c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:37.627557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c3ac5-3214-46c0-9476-ae4c6faf0c6c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:37.627557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c3ac5-3214-46c0-9476-ae4c6faf0c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:37.668529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2f6c3ac5-3214-46c0-9476-ae4c6faf0c6c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:37.670645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2f6c3ac5-3214-46c0-9476-ae4c6faf0c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:37.944281 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 800/1629] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:37.991972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:37.993691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:38.222299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c23bd-eaaa-4b69-a08e-5dff46531a5f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:38.255637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593f173-6370-4c2f-af67-d54ee357ffe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:38.256289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f173-6370-4c2f-af67-d54ee357ffe4 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:38.257325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f173-6370-4c2f-af67-d54ee357ffe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:38.257657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f173-6370-4c2f-af67-d54ee357ffe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:38.283389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593f173-6370-4c2f-af67-d54ee357ffe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:38.289985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593f173-6370-4c2f-af67-d54ee357ffe4 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:38.307698 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 830/1630] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:38.677033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c3ac5-3214-46c0-9476-ae4c6faf0c6c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:38.679780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2f6c3ac5-3214-46c0-9476-ae4c6faf0c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:38.700636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c3ac5-3214-46c0-9476-ae4c6faf0c6c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:38.717771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3667b-e73d-4f36-b696-9acd794afe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:38.718562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3667b-e73d-4f36-b696-9acd794afe46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:38.719143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3667b-e73d-4f36-b696-9acd794afe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:38.719639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3667b-e73d-4f36-b696-9acd794afe46 admin admin] PATH_INFO: `/v3/projects/52c0bf770a544c53b1863f560eff3238` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:38.723370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3667b-e73d-4f36-b696-9acd794afe46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c0bf770a544c53b1863f560eff3238)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:38.725903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3667b-e73d-4f36-b696-9acd794afe46 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:38.874061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3ef3667b-e73d-4f36-b696-9acd794afe46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c0bf770a544c53b1863f560eff3238', 'request_id': 'req-3ef3667b-e73d-4f36-b696-9acd794afe46'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:38.901945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3ef3667b-e73d-4f36-b696-9acd794afe46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c0bf770a544c53b1863f560eff3238', 'request_id': 'req-3ef3667b-e73d-4f36-b696-9acd794afe46'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:38.920689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3ef3667b-e73d-4f36-b696-9acd794afe46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c0bf770a544c53b1863f560eff3238', 'request_id': 'req-3ef3667b-e73d-4f36-b696-9acd794afe46'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:38.947824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3ef3667b-e73d-4f36-b696-9acd794afe46 admin admin] The token cache is being invalidate because project 52c0bf770a544c53b1863f560eff3238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:38.948119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3ef3667b-e73d-4f36-b696-9acd794afe46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:38.949011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3ef3667b-e73d-4f36-b696-9acd794afe46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:38.951099 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 801/1631] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:38 2022] DELETE /identity/v3/projects/52c0bf770a544c53b1863f560eff3238 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:38.959266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a26b2-b331-42e5-a0e9-2e6d7b343840 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:38.959845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a26b2-b331-42e5-a0e9-2e6d7b343840 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:38.962272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a26b2-b331-42e5-a0e9-2e6d7b343840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:39.014014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fb2a26b2-b331-42e5-a0e9-2e6d7b343840 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:39.016263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fb2a26b2-b331-42e5-a0e9-2e6d7b343840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:39.175663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc6108-462d-4418-84e0-b526289b72db None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:39.176183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc6108-462d-4418-84e0-b526289b72db None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:39.176691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc6108-462d-4418-84e0-b526289b72db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:39.187202 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 831/1632] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:39.204174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5847ff5-747b-462a-9fd3-17ee1c812ece None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:39.205806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5847ff5-747b-462a-9fd3-17ee1c812ece None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:39.206443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5847ff5-747b-462a-9fd3-17ee1c812ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:39.245391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-96cc6108-462d-4418-84e0-b526289b72db None None] MFA Rules not processed for user `ea698e4b461143cfafb17befe69af2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:39.246906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-96cc6108-462d-4418-84e0-b526289b72db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:39.278250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d5847ff5-747b-462a-9fd3-17ee1c812ece None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:39.282047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d5847ff5-747b-462a-9fd3-17ee1c812ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:39.318660 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:39.328551 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 832/1633] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:39.329917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5847ff5-747b-462a-9fd3-17ee1c812ece None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:39.370804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5847ff5-747b-462a-9fd3-17ee1c812ece None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:39.388531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459bae3-47e2-47b4-8001-10e8edeeff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:39.389428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459bae3-47e2-47b4-8001-10e8edeeff14 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:39.389708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459bae3-47e2-47b4-8001-10e8edeeff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:39.389976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459bae3-47e2-47b4-8001-10e8edeeff14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:39.395731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459bae3-47e2-47b4-8001-10e8edeeff14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:39.396233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459bae3-47e2-47b4-8001-10e8edeeff14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:39.401257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459bae3-47e2-47b4-8001-10e8edeeff14 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:39.408625 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 802/1634] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:39 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:39.420044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc6108-462d-4418-84e0-b526289b72db None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:39.421509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-96cc6108-462d-4418-84e0-b526289b72db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:39.434045 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 833/1635] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:39.437874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459bae3-47e2-47b4-8001-10e8edeeff14 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:39.456820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc6108-462d-4418-84e0-b526289b72db None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:39.461191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795b199-ec45-4542-a613-d76739e4758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:39.461823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795b199-ec45-4542-a613-d76739e4758a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:39.462106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795b199-ec45-4542-a613-d76739e4758a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:39.462432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795b199-ec45-4542-a613-d76739e4758a admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:39.463230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795b199-ec45-4542-a613-d76739e4758a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:39.464512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459bae3-47e2-47b4-8001-10e8edeeff14 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:39.465198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795b199-ec45-4542-a613-d76739e4758a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:39.477167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5fab3-4636-4f9f-8062-d46984e90ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:39.477883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5fab3-4636-4f9f-8062-d46984e90ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:39.478162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5fab3-4636-4f9f-8062-d46984e90ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:39.478438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5fab3-4636-4f9f-8062-d46984e90ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:39.479103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5fab3-4636-4f9f-8062-d46984e90ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:39.481015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5fab3-4636-4f9f-8062-d46984e90ca9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:39.540278 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 803/1636] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:39 2022] POST /identity/v3/projects => generated 401 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:39.561515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795b199-ec45-4542-a613-d76739e4758a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:39.577495 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 834/1637] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:39 2022] POST /identity/v3/projects => generated 395 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:39.595792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5fab3-4636-4f9f-8062-d46984e90ca9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:39.717189 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:39.740379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795b199-ec45-4542-a613-d76739e4758a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:39.750575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5fab3-4636-4f9f-8062-d46984e90ca9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:39.758384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691636d6-5a91-4993-821d-c4c04c3bd91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:39.759394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691636d6-5a91-4993-821d-c4c04c3bd91d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:39.760246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691636d6-5a91-4993-821d-c4c04c3bd91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:39.761376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691636d6-5a91-4993-821d-c4c04c3bd91d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:39.762204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691636d6-5a91-4993-821d-c4c04c3bd91d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:39.764482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e5959-48d8-4ce4-bdf2-ec08a96465ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:39.768295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e5959-48d8-4ce4-bdf2-ec08a96465ea admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:39.769158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691636d6-5a91-4993-821d-c4c04c3bd91d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:39.769283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e5959-48d8-4ce4-bdf2-ec08a96465ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:39.773015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e5959-48d8-4ce4-bdf2-ec08a96465ea admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:39.773934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e5959-48d8-4ce4-bdf2-ec08a96465ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:39.776102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e5959-48d8-4ce4-bdf2-ec08a96465ea admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:39.814275 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 804/1638] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:39 2022] POST /identity/v3/users => generated 307 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:39.819822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691636d6-5a91-4993-821d-c4c04c3bd91d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:39.837777 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 835/1639] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:39 2022] POST /identity/v3/users => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:00:39.839609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e5959-48d8-4ce4-bdf2-ec08a96465ea admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:39.843844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691636d6-5a91-4993-821d-c4c04c3bd91d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:39.859617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e5959-48d8-4ce4-bdf2-ec08a96465ea admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:39.860058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17e6ee-2904-4982-b8b8-8659cfc72a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:39.860794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17e6ee-2904-4982-b8b8-8659cfc72a01 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:39.861148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17e6ee-2904-4982-b8b8-8659cfc72a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:39.861541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17e6ee-2904-4982-b8b8-8659cfc72a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:39.862826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17e6ee-2904-4982-b8b8-8659cfc72a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:39.868605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17e6ee-2904-4982-b8b8-8659cfc72a01 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:39.873858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bbaf6-53cc-46f0-b651-23e0f85cb45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:39.874511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bbaf6-53cc-46f0-b651-23e0f85cb45b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:39.874784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bbaf6-53cc-46f0-b651-23e0f85cb45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:39.875081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bbaf6-53cc-46f0-b651-23e0f85cb45b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:39.875743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bbaf6-53cc-46f0-b651-23e0f85cb45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:39.880495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bbaf6-53cc-46f0-b651-23e0f85cb45b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:39.912988 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 836/1640] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:00:39.914248 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 805/1641] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:39.915229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bbaf6-53cc-46f0-b651-23e0f85cb45b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:39.925610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17e6ee-2904-4982-b8b8-8659cfc72a01 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:39.938596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bbaf6-53cc-46f0-b651-23e0f85cb45b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:39.944976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17e6ee-2904-4982-b8b8-8659cfc72a01 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:39.952737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c3df6-3e73-42f0-ab84-2b3c31f8bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:39.955626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9fbf1-cf68-4962-8b34-548bfa6fca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:39.957285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9fbf1-cf68-4962-8b34-548bfa6fca8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:39.957569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9fbf1-cf68-4962-8b34-548bfa6fca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:39.957841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9fbf1-cf68-4962-8b34-548bfa6fca8c admin admin] PATH_INFO: `/v3/projects/9981cabbcf534912ae56b4319a05a44a/users/d0a0b0460f2f412eb3c47e66515bcfc3/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:39.970093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c3df6-3e73-42f0-ab84-2b3c31f8bdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:39.970516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c3df6-3e73-42f0-ab84-2b3c31f8bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:39.970969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c3df6-3e73-42f0-ab84-2b3c31f8bdf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:39.971945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c3df6-3e73-42f0-ab84-2b3c31f8bdf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:39.975279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c3df6-3e73-42f0-ab84-2b3c31f8bdf7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:39.990280 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 806/1642] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:40.003768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9fbf1-cf68-4962-8b34-548bfa6fca8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9981cabbcf534912ae56b4319a05a44a, user_id=d0a0b0460f2f412eb3c47e66515bcfc3, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:40.009593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9fbf1-cf68-4962-8b34-548bfa6fca8c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:40.010809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c3df6-3e73-42f0-ab84-2b3c31f8bdf7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:40.029982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c3df6-3e73-42f0-ab84-2b3c31f8bdf7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:40.038779 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 837/1643] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:39 2022] PUT /identity/v3/projects/9981cabbcf534912ae56b4319a05a44a/users/d0a0b0460f2f412eb3c47e66515bcfc3/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:40.044146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9fbf1-cf68-4962-8b34-548bfa6fca8c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:40.233770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611db17-3200-4bc5-8b7e-a11f8b107df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:40.234460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611db17-3200-4bc5-8b7e-a11f8b107df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:40.234740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611db17-3200-4bc5-8b7e-a11f8b107df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:40.237036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611db17-3200-4bc5-8b7e-a11f8b107df1 admin admin] PATH_INFO: `/v3/projects/9500f36a03e342caa2c0073b801da342/users/83743824a8004cec9913f112e21f319e/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:40.256396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9fbf1-cf68-4962-8b34-548bfa6fca8c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:40.272439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640014c-9a05-4333-941c-798597d8198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:40.274066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640014c-9a05-4333-941c-798597d8198a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:40.275550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640014c-9a05-4333-941c-798597d8198a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:40.276747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640014c-9a05-4333-941c-798597d8198a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:40.279906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640014c-9a05-4333-941c-798597d8198a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:40.285746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640014c-9a05-4333-941c-798597d8198a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:40.309246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611db17-3200-4bc5-8b7e-a11f8b107df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9500f36a03e342caa2c0073b801da342, user_id=83743824a8004cec9913f112e21f319e, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:40.323435 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 838/1644] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:40.323588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611db17-3200-4bc5-8b7e-a11f8b107df1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:40.332552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640014c-9a05-4333-941c-798597d8198a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:40.343298 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 807/1645] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:39 2022] PUT /identity/v3/projects/9500f36a03e342caa2c0073b801da342/users/83743824a8004cec9913f112e21f319e/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:40.355347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d143b-1cae-4556-9ee4-7f6e776b1ce8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:40.355903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d143b-1cae-4556-9ee4-7f6e776b1ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:40.356335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d143b-1cae-4556-9ee4-7f6e776b1ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:40.370675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640014c-9a05-4333-941c-798597d8198a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:40.372511 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:40.416463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d33d143b-1cae-4556-9ee4-7f6e776b1ce8 None None] MFA Rules not processed for user `83743824a8004cec9913f112e21f319e`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:40.429385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d33d143b-1cae-4556-9ee4-7f6e776b1ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:40.609687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70925584-7032-41bd-9abc-820dabd71631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:40.612047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70925584-7032-41bd-9abc-820dabd71631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:40.612047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70925584-7032-41bd-9abc-820dabd71631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:40.615474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70925584-7032-41bd-9abc-820dabd71631 admin admin] PATH_INFO: `/v3/projects/9981cabbcf534912ae56b4319a05a44a/users/d0a0b0460f2f412eb3c47e66515bcfc3/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:40.619202 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 808/1646] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:00:40.620070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70925584-7032-41bd-9abc-820dabd71631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9981cabbcf534912ae56b4319a05a44a, user_id=d0a0b0460f2f412eb3c47e66515bcfc3, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:40.624483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d143b-1cae-4556-9ee4-7f6e776b1ce8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:40.629369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70925584-7032-41bd-9abc-820dabd71631 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:40.663197 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 839/1647] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:40 2022] PUT /identity/v3/projects/9981cabbcf534912ae56b4319a05a44a/users/d0a0b0460f2f412eb3c47e66515bcfc3/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:40.674328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d143b-1cae-4556-9ee4-7f6e776b1ce8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:40.701286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f5988-069a-4822-9239-0450a899a425 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:40.701768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f5988-069a-4822-9239-0450a899a425 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:40.702437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f5988-069a-4822-9239-0450a899a425 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:40.709911 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 840/1648] 10.222.0.39 () {54 vars in 921 bytes} [Sun Oct 16 01:00:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:40.711299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f5988-069a-4822-9239-0450a899a425 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:40.714000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c37f5988-069a-4822-9239-0450a899a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:40.818974 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:40.868343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30707293-647d-4936-9627-b925a98e974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:40.868987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707293-647d-4936-9627-b925a98e974c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:40.869246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707293-647d-4936-9627-b925a98e974c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:40.869647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707293-647d-4936-9627-b925a98e974c admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:40.870208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30707293-647d-4936-9627-b925a98e974c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:40.872172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30707293-647d-4936-9627-b925a98e974c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:40.947676 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 809/1649] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:40 2022] POST /identity/v3/projects => generated 395 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:40.949067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6a9e0-f861-4ac9-bf38-9070e6ad9a94 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:40.949388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6a9e0-f861-4ac9-bf38-9070e6ad9a94 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:40.949687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6a9e0-f861-4ac9-bf38-9070e6ad9a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:40.975876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f5988-069a-4822-9239-0450a899a425 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:41.016635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4ea6a9e0-f861-4ac9-bf38-9070e6ad9a94 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:41.018081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4ea6a9e0-f861-4ac9-bf38-9070e6ad9a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:41.195295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:41.195945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:41.196229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:41.196498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] PATH_INFO: `/v3/projects/f7c109c5dd4f4be2b47d3c4d4bba3d5c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:41.197885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c109c5dd4f4be2b47d3c4d4bba3d5c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:41.199909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:41.224578 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 810/1650] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:00:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:41.225772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6a9e0-f861-4ac9-bf38-9070e6ad9a94 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:41.266790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6a9e0-f861-4ac9-bf38-9070e6ad9a94 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:41.289905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4429251-f73f-4aae-867a-c57780b3dfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:41.296888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429251-f73f-4aae-867a-c57780b3dfb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:41.296888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429251-f73f-4aae-867a-c57780b3dfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:41.296888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429251-f73f-4aae-867a-c57780b3dfb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:41.296888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4429251-f73f-4aae-867a-c57780b3dfb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:41.296888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4429251-f73f-4aae-867a-c57780b3dfb5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:41.306096 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:41.325590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c109c5dd4f4be2b47d3c4d4bba3d5c', 'request_id': 'req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:41.345349 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 811/1651] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:41 2022] POST /identity/v3/users => generated 304 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:41.346500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4429251-f73f-4aae-867a-c57780b3dfb5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:41.348745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c109c5dd4f4be2b47d3c4d4bba3d5c', 'request_id': 'req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:41.364189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4429251-f73f-4aae-867a-c57780b3dfb5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:41.364947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c109c5dd4f4be2b47d3c4d4bba3d5c', 'request_id': 'req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:41.386679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] The token cache is being invalidate because project f7c109c5dd4f4be2b47d3c4d4bba3d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:41.387001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:41.387765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:41.392861 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 841/1652] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:40 2022] DELETE /identity/v3/projects/f7c109c5dd4f4be2b47d3c4d4bba3d5c => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:41.393614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:41.398525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:41.485773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc15c1-c557-435c-ba02-fab3069c9844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:41.486826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc15c1-c557-435c-ba02-fab3069c9844 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:41.487424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc15c1-c557-435c-ba02-fab3069c9844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:41.491711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc15c1-c557-435c-ba02-fab3069c9844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:41.492777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc15c1-c557-435c-ba02-fab3069c9844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:41.495500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc15c1-c557-435c-ba02-fab3069c9844 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:41.527705 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 812/1653] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:41.527705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc15c1-c557-435c-ba02-fab3069c9844 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:41.541602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8cdc15c1-c557-435c-ba02-fab3069c9844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:41.592605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc15c1-c557-435c-ba02-fab3069c9844 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:41.594394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e323df2-61ef-4d31-8dc6-c1e381eb33e9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:41.604872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0be7a0-edef-4507-b9bc-195b56927c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:41.606021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0be7a0-edef-4507-b9bc-195b56927c42 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:41.606399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0be7a0-edef-4507-b9bc-195b56927c42 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:41.606568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0be7a0-edef-4507-b9bc-195b56927c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:41.609214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92919490-f845-4491-b9b7-5c925f1884e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:41.609871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92919490-f845-4491-b9b7-5c925f1884e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:41.610149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92919490-f845-4491-b9b7-5c925f1884e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:41.611259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fe0be7a0-edef-4507-b9bc-195b56927c42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:41.612655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92919490-f845-4491-b9b7-5c925f1884e8 admin admin] PATH_INFO: `/v3/users/d54d3e92ad06463188e86d49725acd8d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:41.614375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92919490-f845-4491-b9b7-5c925f1884e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54d3e92ad06463188e86d49725acd8d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:41.617426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92919490-f845-4491-b9b7-5c925f1884e8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:41.641390 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:41.649864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0be7a0-edef-4507-b9bc-195b56927c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:41.652025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0be7a0-edef-4507-b9bc-195b56927c42 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:41.684178 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 842/1654] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:41.685030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0be7a0-edef-4507-b9bc-195b56927c42 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:41.687873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fe0be7a0-edef-4507-b9bc-195b56927c42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:41.728588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0be7a0-edef-4507-b9bc-195b56927c42 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:41.757954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f0fa1-a747-4450-8225-eb984895783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:41.758989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f0fa1-a747-4450-8225-eb984895783c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:41.760176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-92919490-f845-4491-b9b7-5c925f1884e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54d3e92ad06463188e86d49725acd8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:41.760589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f0fa1-a747-4450-8225-eb984895783c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:41.761458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f0fa1-a747-4450-8225-eb984895783c admin admin] PATH_INFO: `/v3/projects/eeb96a4bbe3e40c3b5313c333184ac58/users/e31600965ff24cba9fc99222e70732b7/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:41.762007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-92919490-f845-4491-b9b7-5c925f1884e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54d3e92ad06463188e86d49725acd8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:41.802062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-92919490-f845-4491-b9b7-5c925f1884e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54d3e92ad06463188e86d49725acd8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:41.809211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f0fa1-a747-4450-8225-eb984895783c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb96a4bbe3e40c3b5313c333184ac58, user_id=e31600965ff24cba9fc99222e70732b7, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:41.814752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f0fa1-a747-4450-8225-eb984895783c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:41.822414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-92919490-f845-4491-b9b7-5c925f1884e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54d3e92ad06463188e86d49725acd8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:41.826683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-92919490-f845-4491-b9b7-5c925f1884e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54d3e92ad06463188e86d49725acd8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:41.854823 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 843/1655] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:41 2022] PUT /identity/v3/projects/eeb96a4bbe3e40c3b5313c333184ac58/users/e31600965ff24cba9fc99222e70732b7/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:41.855242 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 813/1656] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:41 2022] DELETE /identity/v3/users/d54d3e92ad06463188e86d49725acd8d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:41.856333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f0fa1-a747-4450-8225-eb984895783c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:41.859506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5b9f0fa1-a747-4450-8225-eb984895783c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:42.042974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f0fa1-a747-4450-8225-eb984895783c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:42.351590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a8eeb-7370-465b-82f9-d60fb0788758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:42.352557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a8eeb-7370-465b-82f9-d60fb0788758 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:42.352983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a8eeb-7370-465b-82f9-d60fb0788758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:42.353830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a8eeb-7370-465b-82f9-d60fb0788758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:42.356367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a8eeb-7370-465b-82f9-d60fb0788758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:42.358509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a8eeb-7370-465b-82f9-d60fb0788758 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:42.385194 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 844/1657] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:42.386822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92919490-f845-4491-b9b7-5c925f1884e8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:42.401415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92919490-f845-4491-b9b7-5c925f1884e8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:42.414019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faf40b-06e8-4c5d-aee1-1fd5cf7e41b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:42.420326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faf40b-06e8-4c5d-aee1-1fd5cf7e41b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:42.422476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faf40b-06e8-4c5d-aee1-1fd5cf7e41b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:42.422899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faf40b-06e8-4c5d-aee1-1fd5cf7e41b8 admin admin] PATH_INFO: `/v3/projects/eeb96a4bbe3e40c3b5313c333184ac58/users/e31600965ff24cba9fc99222e70732b7/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:42.429328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faf40b-06e8-4c5d-aee1-1fd5cf7e41b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb96a4bbe3e40c3b5313c333184ac58, user_id=e31600965ff24cba9fc99222e70732b7, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:42.435066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faf40b-06e8-4c5d-aee1-1fd5cf7e41b8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:42.472844 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 814/1658] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:42 2022] PUT /identity/v3/projects/eeb96a4bbe3e40c3b5313c333184ac58/users/e31600965ff24cba9fc99222e70732b7/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:00:42.484375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af540a9-f9f0-4f1d-bc83-85bd7f9c5514 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:42.484996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af540a9-f9f0-4f1d-bc83-85bd7f9c5514 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:42.490551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af540a9-f9f0-4f1d-bc83-85bd7f9c5514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:42.576358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2af540a9-f9f0-4f1d-bc83-85bd7f9c5514 None None] MFA Rules not processed for user `e31600965ff24cba9fc99222e70732b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:42.579717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2af540a9-f9f0-4f1d-bc83-85bd7f9c5514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:42.757048 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:42.777749 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 845/1659] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:42.789154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfc84f-804f-4f2e-82e5-183074488777 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:42.789924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfc84f-804f-4f2e-82e5-183074488777 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:42.790475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfc84f-804f-4f2e-82e5-183074488777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:42.848152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b5bfc84f-804f-4f2e-82e5-183074488777 None None] MFA Rules not processed for user `83743824a8004cec9913f112e21f319e`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:42.851523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b5bfc84f-804f-4f2e-82e5-183074488777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:42.986353 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:43.012430 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 815/1660] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:43.023350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af540a9-f9f0-4f1d-bc83-85bd7f9c5514 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:43.024891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2af540a9-f9f0-4f1d-bc83-85bd7f9c5514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:43.264946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af540a9-f9f0-4f1d-bc83-85bd7f9c5514 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:43.277390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a4749-4496-4ab1-b054-19f8ca653d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:43.278293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4749-4496-4ab1-b054-19f8ca653d8a service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:43.278715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4749-4496-4ab1-b054-19f8ca653d8a service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:43.279170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4749-4496-4ab1-b054-19f8ca653d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:43.281301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-696a4749-4496-4ab1-b054-19f8ca653d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:43.321415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a4749-4496-4ab1-b054-19f8ca653d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:43.323085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a4749-4496-4ab1-b054-19f8ca653d8a service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:43.346174 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 846/1661] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:43 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:43.890519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfc84f-804f-4f2e-82e5-183074488777 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:43.892045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b5bfc84f-804f-4f2e-82e5-183074488777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:43.959746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e2de6-6189-42b1-b0b5-da6b6c3b5ccd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:43.960312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e2de6-6189-42b1-b0b5-da6b6c3b5ccd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:43.960312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e2de6-6189-42b1-b0b5-da6b6c3b5ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:44.009789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f44e2de6-6189-42b1-b0b5-da6b6c3b5ccd None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:44.013957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f44e2de6-6189-42b1-b0b5-da6b6c3b5ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:44.101690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfc84f-804f-4f2e-82e5-183074488777 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:44.119354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397edad2-1ceb-4e22-bcaa-eac2a7448785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:44.120030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edad2-1ceb-4e22-bcaa-eac2a7448785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:44.120309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edad2-1ceb-4e22-bcaa-eac2a7448785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:44.120582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edad2-1ceb-4e22-bcaa-eac2a7448785 admin admin] PATH_INFO: `/v3/projects/293794b5b8284f03bdda4e3dd3c71929` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:44.133214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397edad2-1ceb-4e22-bcaa-eac2a7448785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=293794b5b8284f03bdda4e3dd3c71929)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:44.137106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397edad2-1ceb-4e22-bcaa-eac2a7448785 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:44.235752 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 847/1662] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Oct 16 01:00:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:00:44.333694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-397edad2-1ceb-4e22-bcaa-eac2a7448785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293794b5b8284f03bdda4e3dd3c71929', 'request_id': 'req-397edad2-1ceb-4e22-bcaa-eac2a7448785'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:44.341748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-397edad2-1ceb-4e22-bcaa-eac2a7448785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293794b5b8284f03bdda4e3dd3c71929', 'request_id': 'req-397edad2-1ceb-4e22-bcaa-eac2a7448785'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:44.355432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-397edad2-1ceb-4e22-bcaa-eac2a7448785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293794b5b8284f03bdda4e3dd3c71929', 'request_id': 'req-397edad2-1ceb-4e22-bcaa-eac2a7448785'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:44.369176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e2de6-6189-42b1-b0b5-da6b6c3b5ccd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:44.371204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f44e2de6-6189-42b1-b0b5-da6b6c3b5ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:44.396220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-397edad2-1ceb-4e22-bcaa-eac2a7448785 admin admin] The token cache is being invalidate because project 293794b5b8284f03bdda4e3dd3c71929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:44.396522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-397edad2-1ceb-4e22-bcaa-eac2a7448785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:44.398299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-397edad2-1ceb-4e22-bcaa-eac2a7448785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:44.401145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e2de6-6189-42b1-b0b5-da6b6c3b5ccd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:44.404524 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 816/1663] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:43 2022] DELETE /identity/v3/projects/293794b5b8284f03bdda4e3dd3c71929 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:44.405965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc533e7a-5e5a-434f-b0c7-f804b1b626b2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:44.406256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc533e7a-5e5a-434f-b0c7-f804b1b626b2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:44.406529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc533e7a-5e5a-434f-b0c7-f804b1b626b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:44.459894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dc533e7a-5e5a-434f-b0c7-f804b1b626b2 None None] MFA Rules not processed for user `ea5df25b228648a0aa6c10519e921d40`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:44.463236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dc533e7a-5e5a-434f-b0c7-f804b1b626b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:44.494018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be701bbe-4173-4296-bcb8-2aeb9d51f5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:44.494827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be701bbe-4173-4296-bcb8-2aeb9d51f5ea service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:44.496024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be701bbe-4173-4296-bcb8-2aeb9d51f5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:44.496373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be701bbe-4173-4296-bcb8-2aeb9d51f5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:44.498946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-be701bbe-4173-4296-bcb8-2aeb9d51f5ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:44.540068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be701bbe-4173-4296-bcb8-2aeb9d51f5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:44.552256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be701bbe-4173-4296-bcb8-2aeb9d51f5ea service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:44.576019 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 848/1664] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:44.585598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8094cb-fa3d-4826-9d01-41e88ec2dca4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:44.585940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8094cb-fa3d-4826-9d01-41e88ec2dca4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:44.586218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8094cb-fa3d-4826-9d01-41e88ec2dca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:44.615166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7d8094cb-fa3d-4826-9d01-41e88ec2dca4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:44.616556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7d8094cb-fa3d-4826-9d01-41e88ec2dca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:44.633383 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 817/1665] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:44.646298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446d001-649c-424d-8e69-7d69f38c8bed None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:44.646600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446d001-649c-424d-8e69-7d69f38c8bed None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:44.646860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446d001-649c-424d-8e69-7d69f38c8bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:44.677916 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:44.685006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9446d001-649c-424d-8e69-7d69f38c8bed None None] MFA Rules not processed for user `5f46ddd0268d44bfacff0400e3f38e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:44.686680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9446d001-649c-424d-8e69-7d69f38c8bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:44.706401 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:44.770545 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 849/1666] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:44.782547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1b0b7-8669-4465-8e0f-13079c0177a7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:44.783961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1b0b7-8669-4465-8e0f-13079c0177a7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:44.784830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1b0b7-8669-4465-8e0f-13079c0177a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:44.819725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-27f1b0b7-8669-4465-8e0f-13079c0177a7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:44.821626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-27f1b0b7-8669-4465-8e0f-13079c0177a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:44.834997 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 850/1667] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:44.838903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1b0b7-8669-4465-8e0f-13079c0177a7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:44.854288 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 818/1668] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:44.868417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1b0b7-8669-4465-8e0f-13079c0177a7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:44.874078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446d001-649c-424d-8e69-7d69f38c8bed None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:44.878773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9446d001-649c-424d-8e69-7d69f38c8bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:44.918742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b5c9f-c8a6-40a0-9a35-377935f7b9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:44.920394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5c9f-c8a6-40a0-9a35-377935f7b9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:44.920753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5c9f-c8a6-40a0-9a35-377935f7b9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:44.921030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5c9f-c8a6-40a0-9a35-377935f7b9e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:44.927711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b5c9f-c8a6-40a0-9a35-377935f7b9e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:44.928755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b5c9f-c8a6-40a0-9a35-377935f7b9e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:44.935243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b5c9f-c8a6-40a0-9a35-377935f7b9e2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:44.999361 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 851/1669] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:45.003227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b5c9f-c8a6-40a0-9a35-377935f7b9e2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:45.018229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446d001-649c-424d-8e69-7d69f38c8bed None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:45.028624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b5c9f-c8a6-40a0-9a35-377935f7b9e2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:45.043650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec333a0b-f414-42d9-9c6f-288bc53a5893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:45.044347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec333a0b-f414-42d9-9c6f-288bc53a5893 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:45.044890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec333a0b-f414-42d9-9c6f-288bc53a5893 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:45.045316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec333a0b-f414-42d9-9c6f-288bc53a5893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:45.048882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482dffd4-2157-49fe-907a-e199fc23279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:45.049575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dffd4-2157-49fe-907a-e199fc23279a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:45.050400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dffd4-2157-49fe-907a-e199fc23279a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:45.050710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dffd4-2157-49fe-907a-e199fc23279a admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:45.051320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ec333a0b-f414-42d9-9c6f-288bc53a5893 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:45.053009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482dffd4-2157-49fe-907a-e199fc23279a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:45.055123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482dffd4-2157-49fe-907a-e199fc23279a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:45.082310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec333a0b-f414-42d9-9c6f-288bc53a5893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:45.084267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec333a0b-f414-42d9-9c6f-288bc53a5893 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:45.107214 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 819/1670] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:44 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:45.119402 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 852/1671] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:45 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:45.123230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec333a0b-f414-42d9-9c6f-288bc53a5893 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:45.139845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec333a0b-f414-42d9-9c6f-288bc53a5893 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:45.298788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33992ff2-113c-4bbf-be2e-326c23f5502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:45.299587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33992ff2-113c-4bbf-be2e-326c23f5502c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:45.300142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33992ff2-113c-4bbf-be2e-326c23f5502c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:45.300507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33992ff2-113c-4bbf-be2e-326c23f5502c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:45.301540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33992ff2-113c-4bbf-be2e-326c23f5502c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:45.308046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33992ff2-113c-4bbf-be2e-326c23f5502c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:45.338476 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 820/1672] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:45 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:45.342308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482dffd4-2157-49fe-907a-e199fc23279a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:45.355821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482dffd4-2157-49fe-907a-e199fc23279a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:45.362519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec8650-7366-4ba0-a6b6-ffabf2396de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:45.363546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec8650-7366-4ba0-a6b6-ffabf2396de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:45.363888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec8650-7366-4ba0-a6b6-ffabf2396de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:45.364225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec8650-7366-4ba0-a6b6-ffabf2396de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:45.364940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec8650-7366-4ba0-a6b6-ffabf2396de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:45.368323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec8650-7366-4ba0-a6b6-ffabf2396de4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:45.392099 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 853/1673] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:45.396626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33992ff2-113c-4bbf-be2e-326c23f5502c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:45.423639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33992ff2-113c-4bbf-be2e-326c23f5502c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:45.429685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5713289-32f3-43da-b2ec-195b23a0a44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:45.430488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5713289-32f3-43da-b2ec-195b23a0a44d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:45.430888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5713289-32f3-43da-b2ec-195b23a0a44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:45.431330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5713289-32f3-43da-b2ec-195b23a0a44d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:45.433168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5713289-32f3-43da-b2ec-195b23a0a44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:45.435386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5713289-32f3-43da-b2ec-195b23a0a44d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:45.472691 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 821/1674] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:45.477002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec8650-7366-4ba0-a6b6-ffabf2396de4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:45.507735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec8650-7366-4ba0-a6b6-ffabf2396de4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:45.519622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6a1d5-3ab2-4595-8bf3-153c8772908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:45.520399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6a1d5-3ab2-4595-8bf3-153c8772908e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:45.520760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6a1d5-3ab2-4595-8bf3-153c8772908e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:45.521085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6a1d5-3ab2-4595-8bf3-153c8772908e admin admin] PATH_INFO: `/v3/projects/c0ea29a7b41e4d6788555e1c8e5d5124/users/30ca3998322a4f5f80b38e796a4659d9/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:45.562461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6a1d5-3ab2-4595-8bf3-153c8772908e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ea29a7b41e4d6788555e1c8e5d5124, user_id=30ca3998322a4f5f80b38e796a4659d9, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:45.566171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6a1d5-3ab2-4595-8bf3-153c8772908e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:45.585467 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 854/1675] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:45 2022] PUT /identity/v3/projects/c0ea29a7b41e4d6788555e1c8e5d5124/users/30ca3998322a4f5f80b38e796a4659d9/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:45.596523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82240f65-f837-490f-9e7d-f2a404376b2f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:45.597553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82240f65-f837-490f-9e7d-f2a404376b2f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:45.597953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82240f65-f837-490f-9e7d-f2a404376b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:45.641184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-82240f65-f837-490f-9e7d-f2a404376b2f None None] MFA Rules not processed for user `30ca3998322a4f5f80b38e796a4659d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:45.642737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-82240f65-f837-490f-9e7d-f2a404376b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:45.652016 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:45.752800 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 822/1676] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:45.757247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6a1d5-3ab2-4595-8bf3-153c8772908e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:45.839628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6a1d5-3ab2-4595-8bf3-153c8772908e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:45.844776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22d973-3eab-4e78-9b75-8e0100873962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:45.845605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22d973-3eab-4e78-9b75-8e0100873962 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:45.846007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22d973-3eab-4e78-9b75-8e0100873962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:45.846368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22d973-3eab-4e78-9b75-8e0100873962 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:45.847416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22d973-3eab-4e78-9b75-8e0100873962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:45.849748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22d973-3eab-4e78-9b75-8e0100873962 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:45.889732 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 855/1677] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:45 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:45.894897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82240f65-f837-490f-9e7d-f2a404376b2f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:45.918279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82240f65-f837-490f-9e7d-f2a404376b2f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:46.089095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53f444-18eb-4d03-98af-c55f576e6239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:46.090366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53f444-18eb-4d03-98af-c55f576e6239 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:46.090672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53f444-18eb-4d03-98af-c55f576e6239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:46.091623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53f444-18eb-4d03-98af-c55f576e6239 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:46.092463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53f444-18eb-4d03-98af-c55f576e6239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:46.094546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53f444-18eb-4d03-98af-c55f576e6239 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:46.136230 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 823/1678] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:45 2022] POST /identity/v3/users => generated 300 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:46.138684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22d973-3eab-4e78-9b75-8e0100873962 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:46.192530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22d973-3eab-4e78-9b75-8e0100873962 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:46.208813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccab61d-301c-42b5-99d5-2c2f6749518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:46.209713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccab61d-301c-42b5-99d5-2c2f6749518f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:46.210173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccab61d-301c-42b5-99d5-2c2f6749518f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:46.210678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccab61d-301c-42b5-99d5-2c2f6749518f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:46.211621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccab61d-301c-42b5-99d5-2c2f6749518f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:46.213453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccab61d-301c-42b5-99d5-2c2f6749518f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:46.268661 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 856/1679] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:46.270078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53f444-18eb-4d03-98af-c55f576e6239 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:46.292183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53f444-18eb-4d03-98af-c55f576e6239 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:46.302309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c40faa-5e8f-4466-b43f-765312a4706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:46.303062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c40faa-5e8f-4466-b43f-765312a4706d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:46.303347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c40faa-5e8f-4466-b43f-765312a4706d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:46.303622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c40faa-5e8f-4466-b43f-765312a4706d admin admin] PATH_INFO: `/v3/projects/77ca78acb642499a83a32544ea4d6c1b/users/deeb9768f9f04c8ba3fd946cc2186988/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:46.348799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c40faa-5e8f-4466-b43f-765312a4706d admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ca78acb642499a83a32544ea4d6c1b, user_id=deeb9768f9f04c8ba3fd946cc2186988, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:46.351926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c40faa-5e8f-4466-b43f-765312a4706d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:46.388786 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 824/1680] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:46 2022] PUT /identity/v3/projects/77ca78acb642499a83a32544ea4d6c1b/users/deeb9768f9f04c8ba3fd946cc2186988/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:00:46.392713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccab61d-301c-42b5-99d5-2c2f6749518f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:46.423483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccab61d-301c-42b5-99d5-2c2f6749518f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:46.491641 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:46.559194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0a7e4-a6a0-4bfa-81d7-f36119d8a33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:46.560478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a7e4-a6a0-4bfa-81d7-f36119d8a33a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:46.561541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a7e4-a6a0-4bfa-81d7-f36119d8a33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:46.562149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a7e4-a6a0-4bfa-81d7-f36119d8a33a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:46.563124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0a7e4-a6a0-4bfa-81d7-f36119d8a33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:46.565686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0a7e4-a6a0-4bfa-81d7-f36119d8a33a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:46.592930 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 857/1681] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:46.597508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c40faa-5e8f-4466-b43f-765312a4706d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:46.620393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c40faa-5e8f-4466-b43f-765312a4706d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:46.625381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc443b5f-e784-44fd-9749-e65e0e23e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:46.626053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc443b5f-e784-44fd-9749-e65e0e23e68b admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:46.626327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc443b5f-e784-44fd-9749-e65e0e23e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:46.626590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc443b5f-e784-44fd-9749-e65e0e23e68b admin admin] PATH_INFO: `/v3/projects/77ca78acb642499a83a32544ea4d6c1b/users/deeb9768f9f04c8ba3fd946cc2186988/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:46.628718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc443b5f-e784-44fd-9749-e65e0e23e68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ca78acb642499a83a32544ea4d6c1b, user_id=deeb9768f9f04c8ba3fd946cc2186988, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:46.631414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc443b5f-e784-44fd-9749-e65e0e23e68b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:46.649567 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 825/1682] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:46 2022] PUT /identity/v3/projects/77ca78acb642499a83a32544ea4d6c1b/users/deeb9768f9f04c8ba3fd946cc2186988/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:46.660274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f85e93-93af-4899-8452-3d7061b5e63a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:46.660860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f85e93-93af-4899-8452-3d7061b5e63a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:46.661132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f85e93-93af-4899-8452-3d7061b5e63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:46.704273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-98f85e93-93af-4899-8452-3d7061b5e63a None None] MFA Rules not processed for user `deeb9768f9f04c8ba3fd946cc2186988`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:46.705744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-98f85e93-93af-4899-8452-3d7061b5e63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:46.819901 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 858/1683] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:46.982763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0638ba-bfb1-4947-b9c9-131505ba8a97 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:46.983094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0638ba-bfb1-4947-b9c9-131505ba8a97 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:46.983374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0638ba-bfb1-4947-b9c9-131505ba8a97 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:46.984707 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 826/1684] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:46.990769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af21778-ac0c-409f-a9fd-edf8cd8624c2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:46.991118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af21778-ac0c-409f-a9fd-edf8cd8624c2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:46.991435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af21778-ac0c-409f-a9fd-edf8cd8624c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:47.012439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6af21778-ac0c-409f-a9fd-edf8cd8624c2 None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:47.013562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6af21778-ac0c-409f-a9fd-edf8cd8624c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:47.102848 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 859/1685] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:00:47.145042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0638ba-bfb1-4947-b9c9-131505ba8a97 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:47.148062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2e0638ba-bfb1-4947-b9c9-131505ba8a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:47.173601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0638ba-bfb1-4947-b9c9-131505ba8a97 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:47.181682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752cb75-c47c-45c8-87fb-dc57fa733f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:47.182349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752cb75-c47c-45c8-87fb-dc57fa733f50 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:47.182626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752cb75-c47c-45c8-87fb-dc57fa733f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:47.182897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752cb75-c47c-45c8-87fb-dc57fa733f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:47.204311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752cb75-c47c-45c8-87fb-dc57fa733f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:47.206656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752cb75-c47c-45c8-87fb-dc57fa733f50 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:47.218570 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 827/1686] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:47.626149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af21778-ac0c-409f-a9fd-edf8cd8624c2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:47.628430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6af21778-ac0c-409f-a9fd-edf8cd8624c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:47.768986 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:47.782641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af21778-ac0c-409f-a9fd-edf8cd8624c2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:47.794508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd444a6d-6dc5-4fa7-99d0-210b4a09941b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:47.795362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd444a6d-6dc5-4fa7-99d0-210b4a09941b service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:47.795827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd444a6d-6dc5-4fa7-99d0-210b4a09941b service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:47.796218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd444a6d-6dc5-4fa7-99d0-210b4a09941b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:47.810521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd444a6d-6dc5-4fa7-99d0-210b4a09941b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:47.813558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd444a6d-6dc5-4fa7-99d0-210b4a09941b service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:47.832580 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 860/1687] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:47 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:49.197404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752cb75-c47c-45c8-87fb-dc57fa733f50 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:49.214388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752cb75-c47c-45c8-87fb-dc57fa733f50 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:49.222194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739efcab-e410-448a-940d-6275e128df19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:49.223215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739efcab-e410-448a-940d-6275e128df19 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:49.223703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739efcab-e410-448a-940d-6275e128df19 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:49.224752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739efcab-e410-448a-940d-6275e128df19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:49.344465 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:49.395787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739efcab-e410-448a-940d-6275e128df19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:49.397524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739efcab-e410-448a-940d-6275e128df19 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:49.408384 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 828/1688] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:50.192510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd444a6d-6dc5-4fa7-99d0-210b4a09941b service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:50.337220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd444a6d-6dc5-4fa7-99d0-210b4a09941b service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:50.350480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:50.351166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:50.351445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:50.351717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] PATH_INFO: `/v3/users/30ca3998322a4f5f80b38e796a4659d9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:50.352879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ca3998322a4f5f80b38e796a4659d9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:50.354823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:50.450632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ca3998322a4f5f80b38e796a4659d9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:50.452671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ca3998322a4f5f80b38e796a4659d9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:50.481846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ca3998322a4f5f80b38e796a4659d9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:50.492651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ca3998322a4f5f80b38e796a4659d9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:50.493771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ca3998322a4f5f80b38e796a4659d9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:50.524439 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 861/1689] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:50 2022] DELETE /identity/v3/users/30ca3998322a4f5f80b38e796a4659d9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:50.526226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643abfc9-7731-4b17-8133-8875aa556d59 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:50.526726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643abfc9-7731-4b17-8133-8875aa556d59 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:50.526726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643abfc9-7731-4b17-8133-8875aa556d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:50.593890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-643abfc9-7731-4b17-8133-8875aa556d59 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:50.596040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-643abfc9-7731-4b17-8133-8875aa556d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:50.739440 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 829/1690] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:50.756697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:50.759054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:50.874120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5c6a7-c244-4981-8cd5-f066ec6886a5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:50.885801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc520a-522d-4c12-8355-e0014681cce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:50.888560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc520a-522d-4c12-8355-e0014681cce0 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:50.888975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc520a-522d-4c12-8355-e0014681cce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:50.889788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc520a-522d-4c12-8355-e0014681cce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:50.911549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc520a-522d-4c12-8355-e0014681cce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:50.913226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc520a-522d-4c12-8355-e0014681cce0 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:50.937690 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 862/1691] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:51.932377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643abfc9-7731-4b17-8133-8875aa556d59 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:51.934179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-643abfc9-7731-4b17-8133-8875aa556d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:51.974998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643abfc9-7731-4b17-8133-8875aa556d59 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:51.981491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:51.983263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:51.983445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:51.983896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] PATH_INFO: `/v3/projects/c0ea29a7b41e4d6788555e1c8e5d5124` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:51.986493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ea29a7b41e4d6788555e1c8e5d5124)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:51.990021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:52.139277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ea29a7b41e4d6788555e1c8e5d5124', 'request_id': 'req-a4eb97d6-27ea-4352-bf41-d84ae1286abc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:52.152249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ea29a7b41e4d6788555e1c8e5d5124', 'request_id': 'req-a4eb97d6-27ea-4352-bf41-d84ae1286abc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:52.164204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ea29a7b41e4d6788555e1c8e5d5124', 'request_id': 'req-a4eb97d6-27ea-4352-bf41-d84ae1286abc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:52.188103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] The token cache is being invalidate because project c0ea29a7b41e4d6788555e1c8e5d5124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:52.188103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:52.194644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:52.196678 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 830/1692] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:51 2022] DELETE /identity/v3/projects/c0ea29a7b41e4d6788555e1c8e5d5124 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:52.200479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc520a-522d-4c12-8355-e0014681cce0 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:52.218780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc520a-522d-4c12-8355-e0014681cce0 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:52.236187 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:52.328671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81877c2b-8bee-4c01-8a92-f33f45e5cc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:52.329838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81877c2b-8bee-4c01-8a92-f33f45e5cc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:52.330312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81877c2b-8bee-4c01-8a92-f33f45e5cc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:52.331032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81877c2b-8bee-4c01-8a92-f33f45e5cc11 admin admin] PATH_INFO: `/v3/users/deeb9768f9f04c8ba3fd946cc2186988` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:52.333010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81877c2b-8bee-4c01-8a92-f33f45e5cc11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deeb9768f9f04c8ba3fd946cc2186988)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:52.335753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81877c2b-8bee-4c01-8a92-f33f45e5cc11 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:52.417444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-81877c2b-8bee-4c01-8a92-f33f45e5cc11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deeb9768f9f04c8ba3fd946cc2186988'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:52.418889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-81877c2b-8bee-4c01-8a92-f33f45e5cc11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deeb9768f9f04c8ba3fd946cc2186988'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:52.432978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-81877c2b-8bee-4c01-8a92-f33f45e5cc11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deeb9768f9f04c8ba3fd946cc2186988'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:52.441333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-81877c2b-8bee-4c01-8a92-f33f45e5cc11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deeb9768f9f04c8ba3fd946cc2186988'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:52.442117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-81877c2b-8bee-4c01-8a92-f33f45e5cc11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deeb9768f9f04c8ba3fd946cc2186988'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:52.462328 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 863/1693] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:52 2022] DELETE /identity/v3/users/deeb9768f9f04c8ba3fd946cc2186988 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:53.290806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:53.292657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:53.313415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb97d6-27ea-4352-bf41-d84ae1286abc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:53.428562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559ef7a-5215-447c-a5bd-65393267276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:53.429340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559ef7a-5215-447c-a5bd-65393267276e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:53.429713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559ef7a-5215-447c-a5bd-65393267276e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:53.430206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559ef7a-5215-447c-a5bd-65393267276e admin admin] PATH_INFO: `/v3/projects/77ca78acb642499a83a32544ea4d6c1b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:53.431563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559ef7a-5215-447c-a5bd-65393267276e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ca78acb642499a83a32544ea4d6c1b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:53.434346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559ef7a-5215-447c-a5bd-65393267276e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:53.463963 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:53.514778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af505c-f87e-4ac8-b715-f712e77435c3 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:53.515349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af505c-f87e-4ac8-b715-f712e77435c3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:53.515349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af505c-f87e-4ac8-b715-f712e77435c3 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:53.516839 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 864/1694] 10.222.0.39 () {54 vars in 921 bytes} [Sun Oct 16 01:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:00:53.566199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5559ef7a-5215-447c-a5bd-65393267276e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ca78acb642499a83a32544ea4d6c1b', 'request_id': 'req-5559ef7a-5215-447c-a5bd-65393267276e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:53.576981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5559ef7a-5215-447c-a5bd-65393267276e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ca78acb642499a83a32544ea4d6c1b', 'request_id': 'req-5559ef7a-5215-447c-a5bd-65393267276e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:53.579145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711683a5-24cc-4172-9414-217da643f98a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:53.579455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711683a5-24cc-4172-9414-217da643f98a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:53.579732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711683a5-24cc-4172-9414-217da643f98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:53.588694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5559ef7a-5215-447c-a5bd-65393267276e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ca78acb642499a83a32544ea4d6c1b', 'request_id': 'req-5559ef7a-5215-447c-a5bd-65393267276e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:53.607279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5559ef7a-5215-447c-a5bd-65393267276e admin admin] The token cache is being invalidate because project 77ca78acb642499a83a32544ea4d6c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:53.607932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5559ef7a-5215-447c-a5bd-65393267276e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:53.608847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5559ef7a-5215-447c-a5bd-65393267276e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:53.610147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-711683a5-24cc-4172-9414-217da643f98a None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:53.613213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-711683a5-24cc-4172-9414-217da643f98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:53.614028 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 831/1695] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:53 2022] DELETE /identity/v3/projects/77ca78acb642499a83a32544ea4d6c1b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:53.620338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e378a-bf3e-4384-ba81-8265d9074577 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:53.620866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e378a-bf3e-4384-ba81-8265d9074577 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:53.621145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e378a-bf3e-4384-ba81-8265d9074577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:53.648428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b77e378a-bf3e-4384-ba81-8265d9074577 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:53.650358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b77e378a-bf3e-4384-ba81-8265d9074577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:53.718574 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 865/1696] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:00:53.782024 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 832/1697] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:53.791652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7d6b-978e-4f87-9783-c3018e633bd3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:53.792055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7d6b-978e-4f87-9783-c3018e633bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:53.792421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7d6b-978e-4f87-9783-c3018e633bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:53.817916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ffef7d6b-978e-4f87-9783-c3018e633bd3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:53.819430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ffef7d6b-978e-4f87-9783-c3018e633bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:53.837973 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 866/1698] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:53.844071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e378a-bf3e-4384-ba81-8265d9074577 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:53.860002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e378a-bf3e-4384-ba81-8265d9074577 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:53.872780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a8d7a-7bac-4ebc-95ae-b638d53ddfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:53.873414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a8d7a-7bac-4ebc-95ae-b638d53ddfbb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:53.873687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a8d7a-7bac-4ebc-95ae-b638d53ddfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:53.873949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a8d7a-7bac-4ebc-95ae-b638d53ddfbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:53.874678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a8d7a-7bac-4ebc-95ae-b638d53ddfbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:53.875003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a8d7a-7bac-4ebc-95ae-b638d53ddfbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:53.876657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a8d7a-7bac-4ebc-95ae-b638d53ddfbb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:53.910503 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 833/1699] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:00:53.912369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef7d6b-978e-4f87-9783-c3018e633bd3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:53.926377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef7d6b-978e-4f87-9783-c3018e633bd3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:53.931883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181bb46-521a-4b2c-9745-a64a3f99eb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:53.933298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181bb46-521a-4b2c-9745-a64a3f99eb70 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:53.933615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181bb46-521a-4b2c-9745-a64a3f99eb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:53.933867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181bb46-521a-4b2c-9745-a64a3f99eb70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:53.934536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181bb46-521a-4b2c-9745-a64a3f99eb70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:53.941754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181bb46-521a-4b2c-9745-a64a3f99eb70 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:53.966887 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:53.996738 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 867/1700] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:53 2022] POST /identity/v3/projects => generated 397 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:54.001219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a8d7a-7bac-4ebc-95ae-b638d53ddfbb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:54.013704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a8d7a-7bac-4ebc-95ae-b638d53ddfbb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:54.062010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181bb46-521a-4b2c-9745-a64a3f99eb70 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:54.064076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3181bb46-521a-4b2c-9745-a64a3f99eb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:54.188665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b94bfe-53ac-405c-91a1-713551582fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:54.189303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b94bfe-53ac-405c-91a1-713551582fef admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:54.189575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b94bfe-53ac-405c-91a1-713551582fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:54.189841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b94bfe-53ac-405c-91a1-713551582fef admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:54.190591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b94bfe-53ac-405c-91a1-713551582fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:54.199964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b94bfe-53ac-405c-91a1-713551582fef admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:54.243161 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 834/1701] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:54 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:54.247263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b94bfe-53ac-405c-91a1-713551582fef admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:54.277774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b94bfe-53ac-405c-91a1-713551582fef admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:54.288679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c53050-71f9-4bb2-9c6c-8f3859567b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:54.296098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c53050-71f9-4bb2-9c6c-8f3859567b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:54.299937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c53050-71f9-4bb2-9c6c-8f3859567b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:54.300413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c53050-71f9-4bb2-9c6c-8f3859567b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:54.301274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c53050-71f9-4bb2-9c6c-8f3859567b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:54.303996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181bb46-521a-4b2c-9745-a64a3f99eb70 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:54.310708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c53050-71f9-4bb2-9c6c-8f3859567b5d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:54.323030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6bc2e-9611-49f3-b05d-22500d506d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:54.323845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6bc2e-9611-49f3-b05d-22500d506d20 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:54.324188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6bc2e-9611-49f3-b05d-22500d506d20 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:54.325111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6bc2e-9611-49f3-b05d-22500d506d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:54.327629 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 835/1702] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:54.332000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c53050-71f9-4bb2-9c6c-8f3859567b5d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:54.343073 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:54.351038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6bc2e-9611-49f3-b05d-22500d506d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:54.352791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6bc2e-9611-49f3-b05d-22500d506d20 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:54.364215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c53050-71f9-4bb2-9c6c-8f3859567b5d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:54.371579 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 868/1703] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:00:54.375820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73813a-a8f5-4bd4-bbcf-04fbdb1e28cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:54.377100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73813a-a8f5-4bd4-bbcf-04fbdb1e28cd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:54.377584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73813a-a8f5-4bd4-bbcf-04fbdb1e28cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:54.378840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73813a-a8f5-4bd4-bbcf-04fbdb1e28cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:54.380256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73813a-a8f5-4bd4-bbcf-04fbdb1e28cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:54.382248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73813a-a8f5-4bd4-bbcf-04fbdb1e28cd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:54.404800 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 836/1704] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:00:54.408848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6bc2e-9611-49f3-b05d-22500d506d20 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:54.425920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6bc2e-9611-49f3-b05d-22500d506d20 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:54.437982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720400f9-2126-480c-b14a-6a8638eab806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:54.438860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720400f9-2126-480c-b14a-6a8638eab806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:54.439293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720400f9-2126-480c-b14a-6a8638eab806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:54.439674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720400f9-2126-480c-b14a-6a8638eab806 admin admin] PATH_INFO: `/v3/projects/1e819d14f3c4474591d4398574d803d0/users/ad1bfd5f2b494b6d995f2b2688d56b3d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:54.479257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720400f9-2126-480c-b14a-6a8638eab806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e819d14f3c4474591d4398574d803d0, user_id=ad1bfd5f2b494b6d995f2b2688d56b3d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:54.482195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720400f9-2126-480c-b14a-6a8638eab806 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:54.524675 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 869/1705] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:54 2022] PUT /identity/v3/projects/1e819d14f3c4474591d4398574d803d0/users/ad1bfd5f2b494b6d995f2b2688d56b3d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:54.525383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04652d-40f2-4b9f-b5c9-37049d150dd1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:54.525728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04652d-40f2-4b9f-b5c9-37049d150dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:54.526084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04652d-40f2-4b9f-b5c9-37049d150dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:54.623433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1f04652d-40f2-4b9f-b5c9-37049d150dd1 None None] MFA Rules not processed for user `ad1bfd5f2b494b6d995f2b2688d56b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:54.625234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1f04652d-40f2-4b9f-b5c9-37049d150dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:54.809361 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 837/1706] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:00:54.813658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720400f9-2126-480c-b14a-6a8638eab806 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:54.933566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720400f9-2126-480c-b14a-6a8638eab806 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:54.939818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb08a3b-399a-496c-a823-6b0d19943614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:54.940587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb08a3b-399a-496c-a823-6b0d19943614 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:54.941384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb08a3b-399a-496c-a823-6b0d19943614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:54.941671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb08a3b-399a-496c-a823-6b0d19943614 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:54.942326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb08a3b-399a-496c-a823-6b0d19943614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:54.944373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb08a3b-399a-496c-a823-6b0d19943614 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:54.976479 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 870/1707] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:54 2022] POST /identity/v3/projects => generated 395 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:00:54.980703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04652d-40f2-4b9f-b5c9-37049d150dd1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:54.993211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04652d-40f2-4b9f-b5c9-37049d150dd1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:55.084432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8ccf9-5b64-4546-984e-2a8eab83f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:55.085254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8ccf9-5b64-4546-984e-2a8eab83f28c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:55.085689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8ccf9-5b64-4546-984e-2a8eab83f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:55.086107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8ccf9-5b64-4546-984e-2a8eab83f28c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:55.086955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8ccf9-5b64-4546-984e-2a8eab83f28c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:55.089599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8ccf9-5b64-4546-984e-2a8eab83f28c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:55.134201 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 838/1708] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:54 2022] POST /identity/v3/users => generated 304 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:55.135096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb08a3b-399a-496c-a823-6b0d19943614 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:55.153068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb08a3b-399a-496c-a823-6b0d19943614 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:55.158715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6401cd6-da8a-449c-9db4-d99b29a7ec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:55.160542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6401cd6-da8a-449c-9db4-d99b29a7ec94 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:55.160691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6401cd6-da8a-449c-9db4-d99b29a7ec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:55.161035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6401cd6-da8a-449c-9db4-d99b29a7ec94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:55.161877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6401cd6-da8a-449c-9db4-d99b29a7ec94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:55.163654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6401cd6-da8a-449c-9db4-d99b29a7ec94 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:55.177410 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 871/1709] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:55.183071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8ccf9-5b64-4546-984e-2a8eab83f28c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:55.206868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8ccf9-5b64-4546-984e-2a8eab83f28c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:55.230986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bbb3d-759e-450c-8476-063d78501293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:55.232242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bbb3d-759e-450c-8476-063d78501293 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:55.233011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bbb3d-759e-450c-8476-063d78501293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:55.234004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bbb3d-759e-450c-8476-063d78501293 admin admin] PATH_INFO: `/v3/projects/a6c919608f584e728a6680e500be3fdf/users/0df403c0d8054d7fbdb1e55a8900c190/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:55.266425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bbb3d-759e-450c-8476-063d78501293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c919608f584e728a6680e500be3fdf, user_id=0df403c0d8054d7fbdb1e55a8900c190, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:55.274029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bbb3d-759e-450c-8476-063d78501293 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:55.293480 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 839/1710] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:55 2022] PUT /identity/v3/projects/a6c919608f584e728a6680e500be3fdf/users/0df403c0d8054d7fbdb1e55a8900c190/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:55.297401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6401cd6-da8a-449c-9db4-d99b29a7ec94 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:55.309002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6401cd6-da8a-449c-9db4-d99b29a7ec94 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:55.339691 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:55.401296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd8d8-388c-4597-b2db-e3c9033143e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:55.402668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd8d8-388c-4597-b2db-e3c9033143e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:55.403241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd8d8-388c-4597-b2db-e3c9033143e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:55.403619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd8d8-388c-4597-b2db-e3c9033143e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:55.404572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addd8d8-388c-4597-b2db-e3c9033143e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:55.406442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addd8d8-388c-4597-b2db-e3c9033143e2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:55.418372 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 872/1711] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:00:55.422818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bbb3d-759e-450c-8476-063d78501293 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:55.434962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bbb3d-759e-450c-8476-063d78501293 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:55.439934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a94b6c-da7e-49ca-8949-3bfef76861d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:55.441187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a94b6c-da7e-49ca-8949-3bfef76861d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:55.441770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a94b6c-da7e-49ca-8949-3bfef76861d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:55.442475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a94b6c-da7e-49ca-8949-3bfef76861d8 admin admin] PATH_INFO: `/v3/projects/a6c919608f584e728a6680e500be3fdf/users/0df403c0d8054d7fbdb1e55a8900c190/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:55.444070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a94b6c-da7e-49ca-8949-3bfef76861d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c919608f584e728a6680e500be3fdf, user_id=0df403c0d8054d7fbdb1e55a8900c190, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:55.446737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a94b6c-da7e-49ca-8949-3bfef76861d8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:55.459211 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 840/1712] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:00:55 2022] PUT /identity/v3/projects/a6c919608f584e728a6680e500be3fdf/users/0df403c0d8054d7fbdb1e55a8900c190/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:55.470799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e264de-2238-4776-a662-c847cd3fe7b7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:55.471329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e264de-2238-4776-a662-c847cd3fe7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:55.471759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e264de-2238-4776-a662-c847cd3fe7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:55.501533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-58e264de-2238-4776-a662-c847cd3fe7b7 None None] MFA Rules not processed for user `0df403c0d8054d7fbdb1e55a8900c190`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:55.502808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-58e264de-2238-4776-a662-c847cd3fe7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:55.587083 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 873/1713] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:55 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:55.601000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a94b6c-da7e-49ca-8949-3bfef76861d8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:55.603116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b8a94b6c-da7e-49ca-8949-3bfef76861d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:55.653076 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:55.716050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a94b6c-da7e-49ca-8949-3bfef76861d8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:55.723401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dc3ba-3e26-4a9c-b7ad-3926f20ed691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:55.724090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dc3ba-3e26-4a9c-b7ad-3926f20ed691 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:55.724411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dc3ba-3e26-4a9c-b7ad-3926f20ed691 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:55.724764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dc3ba-3e26-4a9c-b7ad-3926f20ed691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:55.797035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dc3ba-3e26-4a9c-b7ad-3926f20ed691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:55.799329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dc3ba-3e26-4a9c-b7ad-3926f20ed691 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:55.810235 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 841/1714] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:55.866053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e264de-2238-4776-a662-c847cd3fe7b7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:55.880085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e264de-2238-4776-a662-c847cd3fe7b7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:55.886333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139260f-db2c-413d-83c4-d43afb1a4a82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:55.886983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139260f-db2c-413d-83c4-d43afb1a4a82 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:55.887264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139260f-db2c-413d-83c4-d43afb1a4a82 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:55.887534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139260f-db2c-413d-83c4-d43afb1a4a82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:55.896743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139260f-db2c-413d-83c4-d43afb1a4a82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:55.898337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139260f-db2c-413d-83c4-d43afb1a4a82 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:55.908919 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 874/1715] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:55 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:56.154772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dc3ba-3e26-4a9c-b7ad-3926f20ed691 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:56.280848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dc3ba-3e26-4a9c-b7ad-3926f20ed691 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:56.285980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:56.287384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:56.287743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:56.288186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] PATH_INFO: `/v3/users/ad1bfd5f2b494b6d995f2b2688d56b3d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:56.289790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1bfd5f2b494b6d995f2b2688d56b3d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:56.292308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:56.366987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1bfd5f2b494b6d995f2b2688d56b3d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:56.367812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1bfd5f2b494b6d995f2b2688d56b3d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:56.386372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1bfd5f2b494b6d995f2b2688d56b3d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:56.401977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1bfd5f2b494b6d995f2b2688d56b3d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:56.402711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1bfd5f2b494b6d995f2b2688d56b3d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:56.406497 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:56.427920 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 842/1716] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:56 2022] DELETE /identity/v3/users/ad1bfd5f2b494b6d995f2b2688d56b3d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:56.431130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dc45b-bdd3-41f7-b776-fa05f50dc5d6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:56.431511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dc45b-bdd3-41f7-b776-fa05f50dc5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:56.431873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dc45b-bdd3-41f7-b776-fa05f50dc5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:56.453812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-271dc45b-bdd3-41f7-b776-fa05f50dc5d6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:56.455296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-271dc45b-bdd3-41f7-b776-fa05f50dc5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:56.530457 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 875/1717] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:00:56.551483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:56.553710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:56.647476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0215ab-0f09-4169-9473-1ae18ea5a7bd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:56.652042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788c5f8-c982-4661-8ef9-e04f3929f1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:56.653049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788c5f8-c982-4661-8ef9-e04f3929f1cc service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:56.653049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788c5f8-c982-4661-8ef9-e04f3929f1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:56.653265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788c5f8-c982-4661-8ef9-e04f3929f1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:56.666991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788c5f8-c982-4661-8ef9-e04f3929f1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:56.668458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788c5f8-c982-4661-8ef9-e04f3929f1cc service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:56.680211 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 843/1718] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:56.919378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a089de-545e-4524-a37d-dd9af6fac78a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:56.920375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a089de-545e-4524-a37d-dd9af6fac78a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:56.920845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a089de-545e-4524-a37d-dd9af6fac78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:56.964655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-40a089de-545e-4524-a37d-dd9af6fac78a None None] MFA Rules not processed for user `d0a0b0460f2f412eb3c47e66515bcfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:56.966170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-40a089de-545e-4524-a37d-dd9af6fac78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:57.008157 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:57.013782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9dd22-d3dd-4eea-8ed3-c7e2b1e40184 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:57.014341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9dd22-d3dd-4eea-8ed3-c7e2b1e40184 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:57.014882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9dd22-d3dd-4eea-8ed3-c7e2b1e40184 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:57.016338 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 844/1719] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 01:00:57.027270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c986c80-ad69-4834-98b6-5d139e3a4f39 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:57.027788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c986c80-ad69-4834-98b6-5d139e3a4f39 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:57.028271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c986c80-ad69-4834-98b6-5d139e3a4f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:57.065846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8c986c80-ad69-4834-98b6-5d139e3a4f39 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:57.067952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8c986c80-ad69-4834-98b6-5d139e3a4f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:57.116775 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 876/1720] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:57.172324 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 845/1721] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:00:57.198899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a089de-545e-4524-a37d-dd9af6fac78a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:57.201034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-40a089de-545e-4524-a37d-dd9af6fac78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:57.216871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c986c80-ad69-4834-98b6-5d139e3a4f39 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:57.220164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8c986c80-ad69-4834-98b6-5d139e3a4f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:57.244576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c986c80-ad69-4834-98b6-5d139e3a4f39 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:57.253395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461b42d-f225-4394-a8d0-d5f622c3e65b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:57.254568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461b42d-f225-4394-a8d0-d5f622c3e65b service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:57.257388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461b42d-f225-4394-a8d0-d5f622c3e65b service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:57.257738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461b42d-f225-4394-a8d0-d5f622c3e65b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:57.278682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461b42d-f225-4394-a8d0-d5f622c3e65b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:57.280519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461b42d-f225-4394-a8d0-d5f622c3e65b service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:57.307403 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 846/1722] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:57.336160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a089de-545e-4524-a37d-dd9af6fac78a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:57.345389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d2da4-d31f-4d1b-825c-b18ecbbce2aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:57.346042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d2da4-d31f-4d1b-825c-b18ecbbce2aa service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:57.346320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d2da4-d31f-4d1b-825c-b18ecbbce2aa service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:57.347189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d2da4-d31f-4d1b-825c-b18ecbbce2aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:57.350009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-376d2da4-d31f-4d1b-825c-b18ecbbce2aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:57.451217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d2da4-d31f-4d1b-825c-b18ecbbce2aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:57.458963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d2da4-d31f-4d1b-825c-b18ecbbce2aa service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:57.476553 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 877/1723] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:57 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:57.482801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461b42d-f225-4394-a8d0-d5f622c3e65b service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:57.484416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0461b42d-f225-4394-a8d0-d5f622c3e65b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:57.513587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461b42d-f225-4394-a8d0-d5f622c3e65b service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:57.513758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d2da4-d31f-4d1b-825c-b18ecbbce2aa service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:57.515776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-376d2da4-d31f-4d1b-825c-b18ecbbce2aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:57.520293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:57.521041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:57.521416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:57.521799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] PATH_INFO: `/v3/projects/1e819d14f3c4474591d4398574d803d0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:57.523121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e819d14f3c4474591d4398574d803d0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:57.525448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:57.531982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d2da4-d31f-4d1b-825c-b18ecbbce2aa service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:57.548322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2052b3c-af6d-4f6d-97ee-01f5d165d1ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:57.549290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2052b3c-af6d-4f6d-97ee-01f5d165d1ed service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:57.552640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2052b3c-af6d-4f6d-97ee-01f5d165d1ed service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:57.552957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2052b3c-af6d-4f6d-97ee-01f5d165d1ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:57.573791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2052b3c-af6d-4f6d-97ee-01f5d165d1ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:57.575456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2052b3c-af6d-4f6d-97ee-01f5d165d1ed service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:57.595247 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 878/1724] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:00:57 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:00:57.609781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e819d14f3c4474591d4398574d803d0', 'request_id': 'req-f12ccd08-6733-4395-9c83-41fdb76197d5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:57.618404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e819d14f3c4474591d4398574d803d0', 'request_id': 'req-f12ccd08-6733-4395-9c83-41fdb76197d5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:57.637910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e819d14f3c4474591d4398574d803d0', 'request_id': 'req-f12ccd08-6733-4395-9c83-41fdb76197d5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:57.655039 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:57.661078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] The token cache is being invalidate because project 1e819d14f3c4474591d4398574d803d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:57.662118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:57.663819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:57.666278 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 847/1725] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:57 2022] DELETE /identity/v3/projects/1e819d14f3c4474591d4398574d803d0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:57.670679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2052b3c-af6d-4f6d-97ee-01f5d165d1ed service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:57.687130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2052b3c-af6d-4f6d-97ee-01f5d165d1ed service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:57.763582 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:57.803609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f59edd-ef91-427e-9382-d56fd41f435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:57.804261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f59edd-ef91-427e-9382-d56fd41f435a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:57.804566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f59edd-ef91-427e-9382-d56fd41f435a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:57.804860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f59edd-ef91-427e-9382-d56fd41f435a admin admin] PATH_INFO: `/v3/users/0df403c0d8054d7fbdb1e55a8900c190` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:57.806019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f59edd-ef91-427e-9382-d56fd41f435a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df403c0d8054d7fbdb1e55a8900c190)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:57.808272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f59edd-ef91-427e-9382-d56fd41f435a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:57.897465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03f59edd-ef91-427e-9382-d56fd41f435a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df403c0d8054d7fbdb1e55a8900c190'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:57.898062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03f59edd-ef91-427e-9382-d56fd41f435a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df403c0d8054d7fbdb1e55a8900c190'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:57.923576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03f59edd-ef91-427e-9382-d56fd41f435a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df403c0d8054d7fbdb1e55a8900c190'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:57.936593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03f59edd-ef91-427e-9382-d56fd41f435a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df403c0d8054d7fbdb1e55a8900c190'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:57.937569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03f59edd-ef91-427e-9382-d56fd41f435a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df403c0d8054d7fbdb1e55a8900c190'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:57.976784 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 879/1726] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:00:57 2022] DELETE /identity/v3/users/0df403c0d8054d7fbdb1e55a8900c190 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:58.912769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:58.913778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:58.934677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ccd08-6733-4395-9c83-41fdb76197d5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:59.019532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfd022-baa6-45e9-9706-573ce794fa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:59.020537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfd022-baa6-45e9-9706-573ce794fa60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:59.020818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfd022-baa6-45e9-9706-573ce794fa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:59.021144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfd022-baa6-45e9-9706-573ce794fa60 admin admin] PATH_INFO: `/v3/projects/a6c919608f584e728a6680e500be3fdf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:59.022489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfd022-baa6-45e9-9706-573ce794fa60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c919608f584e728a6680e500be3fdf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:59.024504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfd022-baa6-45e9-9706-573ce794fa60 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:59.116984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fabfd022-baa6-45e9-9706-573ce794fa60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c919608f584e728a6680e500be3fdf', 'request_id': 'req-fabfd022-baa6-45e9-9706-573ce794fa60'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:59.128603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fabfd022-baa6-45e9-9706-573ce794fa60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c919608f584e728a6680e500be3fdf', 'request_id': 'req-fabfd022-baa6-45e9-9706-573ce794fa60'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:59.141030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fabfd022-baa6-45e9-9706-573ce794fa60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c919608f584e728a6680e500be3fdf', 'request_id': 'req-fabfd022-baa6-45e9-9706-573ce794fa60'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:59.158903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fabfd022-baa6-45e9-9706-573ce794fa60 admin admin] The token cache is being invalidate because project a6c919608f584e728a6680e500be3fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:00:59.159502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fabfd022-baa6-45e9-9706-573ce794fa60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:59.160315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fabfd022-baa6-45e9-9706-573ce794fa60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:00:59.162210 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 848/1727] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:00:58 2022] DELETE /identity/v3/projects/a6c919608f584e728a6680e500be3fdf => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:00:59.167729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552108dd-3d26-441b-abe5-fe5c21cdf197 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:59.168241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552108dd-3d26-441b-abe5-fe5c21cdf197 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:59.168352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552108dd-3d26-441b-abe5-fe5c21cdf197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:59.197842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-552108dd-3d26-441b-abe5-fe5c21cdf197 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:59.199719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-552108dd-3d26-441b-abe5-fe5c21cdf197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:59.376418 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 880/1728] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:59.386083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f37239-1276-482f-a4eb-0d0094a9cb6a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:59.386754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f37239-1276-482f-a4eb-0d0094a9cb6a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:59.387008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f37239-1276-482f-a4eb-0d0094a9cb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:59.430225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-79f37239-1276-482f-a4eb-0d0094a9cb6a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:59.432182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-79f37239-1276-482f-a4eb-0d0094a9cb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:59.459577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552108dd-3d26-441b-abe5-fe5c21cdf197 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:59.460104 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 849/1729] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:59.477678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552108dd-3d26-441b-abe5-fe5c21cdf197 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:59.492342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfdcdd-21cc-4503-a404-41cde80d9c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:59.493170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfdcdd-21cc-4503-a404-41cde80d9c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:59.493614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfdcdd-21cc-4503-a404-41cde80d9c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:59.493882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfdcdd-21cc-4503-a404-41cde80d9c37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:59.494608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfdcdd-21cc-4503-a404-41cde80d9c37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:00:59.494909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfdcdd-21cc-4503-a404-41cde80d9c37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:59.497418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfdcdd-21cc-4503-a404-41cde80d9c37 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:59.520923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f37239-1276-482f-a4eb-0d0094a9cb6a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:59.527997 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 881/1730] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:00:59.540799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f37239-1276-482f-a4eb-0d0094a9cb6a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:59.569305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df16ce5-c836-4a72-8c43-52fb4af123e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:59.574118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df16ce5-c836-4a72-8c43-52fb4af123e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:59.576913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df16ce5-c836-4a72-8c43-52fb4af123e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:59.577605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df16ce5-c836-4a72-8c43-52fb4af123e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:59.579716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df16ce5-c836-4a72-8c43-52fb4af123e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:59.585642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df16ce5-c836-4a72-8c43-52fb4af123e3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:59.691079 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 850/1731] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:00:59 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:59.695359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfdcdd-21cc-4503-a404-41cde80d9c37 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:59.709193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfdcdd-21cc-4503-a404-41cde80d9c37 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:59.812429 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:59.837697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c173590-2b25-434e-a84f-a2171e6396cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:59.838567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c173590-2b25-434e-a84f-a2171e6396cc admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:59.839027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c173590-2b25-434e-a84f-a2171e6396cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:59.840341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c173590-2b25-434e-a84f-a2171e6396cc admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:59.842523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c173590-2b25-434e-a84f-a2171e6396cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:59.846097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c173590-2b25-434e-a84f-a2171e6396cc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:00:59.871859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a29a8-95e6-4ccb-aeb5-c65424253542 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:59.872186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a29a8-95e6-4ccb-aeb5-c65424253542 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:59.872488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a29a8-95e6-4ccb-aeb5-c65424253542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:59.906140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cc3a29a8-95e6-4ccb-aeb5-c65424253542 None None] MFA Rules not processed for user `ea698e4b461143cfafb17befe69af2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:59.908788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cc3a29a8-95e6-4ccb-aeb5-c65424253542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:59.936629 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 882/1732] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:00:59 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:00:59.942423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c173590-2b25-434e-a84f-a2171e6396cc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:00:59.971130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c173590-2b25-434e-a84f-a2171e6396cc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:00:59.977767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76031fc-4e81-4ee4-ba77-a729f63aa736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:00:59.978590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76031fc-4e81-4ee4-ba77-a729f63aa736 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:59.979046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76031fc-4e81-4ee4-ba77-a729f63aa736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:59.980589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76031fc-4e81-4ee4-ba77-a729f63aa736 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:59.982172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76031fc-4e81-4ee4-ba77-a729f63aa736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:00:59.984950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76031fc-4e81-4ee4-ba77-a729f63aa736 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:00.008094 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 883/1733] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:00.009998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76031fc-4e81-4ee4-ba77-a729f63aa736 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:00.027096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76031fc-4e81-4ee4-ba77-a729f63aa736 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:00.052916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e874-383c-4e60-b5bc-21d5773d7647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:00.053558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e874-383c-4e60-b5bc-21d5773d7647 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:00.054243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e874-383c-4e60-b5bc-21d5773d7647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:00.054243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e874-383c-4e60-b5bc-21d5773d7647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:00.054840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3e874-383c-4e60-b5bc-21d5773d7647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:00.056600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3e874-383c-4e60-b5bc-21d5773d7647 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:00.080041 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 884/1734] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:00.081723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e874-383c-4e60-b5bc-21d5773d7647 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:00.085322 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 851/1735] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:01:00.086274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a29a8-95e6-4ccb-aeb5-c65424253542 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:00.089999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-50b3e874-383c-4e60-b5bc-21d5773d7647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:00.103461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a29a8-95e6-4ccb-aeb5-c65424253542 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:00.109012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee22cc-34d0-4d96-868c-131459e6bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:00.109649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee22cc-34d0-4d96-868c-131459e6bd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:00.109921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee22cc-34d0-4d96-868c-131459e6bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:00.110221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee22cc-34d0-4d96-868c-131459e6bd31 admin admin] PATH_INFO: `/v3/projects/a5680c7462944e9fa9887d076c380ec2/users/3ad1f48be9e94783a093c8806a39c3f0/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:00.118537 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:00.139863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee22cc-34d0-4d96-868c-131459e6bd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5680c7462944e9fa9887d076c380ec2, user_id=3ad1f48be9e94783a093c8806a39c3f0, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:00.144330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee22cc-34d0-4d96-868c-131459e6bd31 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:00.177122 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 852/1736] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:00 2022] PUT /identity/v3/projects/a5680c7462944e9fa9887d076c380ec2/users/3ad1f48be9e94783a093c8806a39c3f0/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:00.180628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4a331-945b-4129-a2c4-a2b79554ff2e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:00.181178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4a331-945b-4129-a2c4-a2b79554ff2e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:00.181774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4a331-945b-4129-a2c4-a2b79554ff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:00.253291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f9b4a331-945b-4129-a2c4-a2b79554ff2e None None] MFA Rules not processed for user `3ad1f48be9e94783a093c8806a39c3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:00.255542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f9b4a331-945b-4129-a2c4-a2b79554ff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:00.266473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e874-383c-4e60-b5bc-21d5773d7647 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:00.367633 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 853/1737] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:00.373737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4a331-945b-4129-a2c4-a2b79554ff2e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:00.388095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a6a8a-19e0-4b0c-b0c3-1c8e2c33a700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:00.389487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a6a8a-19e0-4b0c-b0c3-1c8e2c33a700 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:00.389880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a6a8a-19e0-4b0c-b0c3-1c8e2c33a700 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:00.390405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a6a8a-19e0-4b0c-b0c3-1c8e2c33a700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:00.392759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-476a6a8a-19e0-4b0c-b0c3-1c8e2c33a700 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:00.485223 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:00.504925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4a331-945b-4129-a2c4-a2b79554ff2e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:00.505573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a6a8a-19e0-4b0c-b0c3-1c8e2c33a700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:00.509737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a6a8a-19e0-4b0c-b0c3-1c8e2c33a700 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:00.519646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe1cac-c1e5-4c73-98bb-9d3bf850f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:00.520516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe1cac-c1e5-4c73-98bb-9d3bf850f115 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:00.520896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe1cac-c1e5-4c73-98bb-9d3bf850f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:00.522029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe1cac-c1e5-4c73-98bb-9d3bf850f115 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:00.524426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe1cac-c1e5-4c73-98bb-9d3bf850f115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:00.530347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe1cac-c1e5-4c73-98bb-9d3bf850f115 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:00.539566 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 885/1738] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:00.606428 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 854/1739] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:00 2022] POST /identity/v3/projects => generated 375 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:00.609865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a6a8a-19e0-4b0c-b0c3-1c8e2c33a700 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:00.627647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a6a8a-19e0-4b0c-b0c3-1c8e2c33a700 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:00.728716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd60228-32f1-4400-8b15-14a7d7b525e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:00.729448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60228-32f1-4400-8b15-14a7d7b525e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:00.729798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60228-32f1-4400-8b15-14a7d7b525e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:00.730136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60228-32f1-4400-8b15-14a7d7b525e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:00.730860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd60228-32f1-4400-8b15-14a7d7b525e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:00.734960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd60228-32f1-4400-8b15-14a7d7b525e2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:00.767053 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 886/1740] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:00 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:00.771640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe1cac-c1e5-4c73-98bb-9d3bf850f115 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:00.784839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe1cac-c1e5-4c73-98bb-9d3bf850f115 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:00.790221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa03610-9693-4ab9-9447-27884061d85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:00.790864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa03610-9693-4ab9-9447-27884061d85d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:00.791174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa03610-9693-4ab9-9447-27884061d85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:00.791691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa03610-9693-4ab9-9447-27884061d85d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:00.792690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa03610-9693-4ab9-9447-27884061d85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:00.794289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa03610-9693-4ab9-9447-27884061d85d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:00.807428 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 855/1741] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:00.811657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd60228-32f1-4400-8b15-14a7d7b525e2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:00.823872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd60228-32f1-4400-8b15-14a7d7b525e2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:00.833510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02be285-5e63-43d4-b5ae-a08588349568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:00.834417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02be285-5e63-43d4-b5ae-a08588349568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:00.834789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02be285-5e63-43d4-b5ae-a08588349568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:00.835236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02be285-5e63-43d4-b5ae-a08588349568 admin admin] PATH_INFO: `/v3/projects/7d4f859d03f8449492d3ffc835d19e0b/users/0fb0a35fa31a4e82bef6f8c9aca1acd6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:00.853583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02be285-5e63-43d4-b5ae-a08588349568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4f859d03f8449492d3ffc835d19e0b, user_id=0fb0a35fa31a4e82bef6f8c9aca1acd6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:00.856247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02be285-5e63-43d4-b5ae-a08588349568 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:00.874453 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 887/1742] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:00 2022] PUT /identity/v3/projects/7d4f859d03f8449492d3ffc835d19e0b/users/0fb0a35fa31a4e82bef6f8c9aca1acd6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:00.878911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa03610-9693-4ab9-9447-27884061d85d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:00.891770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa03610-9693-4ab9-9447-27884061d85d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:00.946833 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:00.964317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607b66f-109d-4192-8a87-e1b24ee72fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:00.964973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b66f-109d-4192-8a87-e1b24ee72fcc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:00.965419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b66f-109d-4192-8a87-e1b24ee72fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:00.965872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b66f-109d-4192-8a87-e1b24ee72fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:00.966619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607b66f-109d-4192-8a87-e1b24ee72fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:00.968500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607b66f-109d-4192-8a87-e1b24ee72fcc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:00.983747 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 856/1743] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:00.988810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02be285-5e63-43d4-b5ae-a08588349568 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:01.006620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02be285-5e63-43d4-b5ae-a08588349568 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:01.012674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9f0c5-4772-4bab-bf24-cf9dceed2a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:01.012900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9f0c5-4772-4bab-bf24-cf9dceed2a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:01.013170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9f0c5-4772-4bab-bf24-cf9dceed2a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:01.013441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9f0c5-4772-4bab-bf24-cf9dceed2a11 admin admin] PATH_INFO: `/v3/projects/7d4f859d03f8449492d3ffc835d19e0b/users/0fb0a35fa31a4e82bef6f8c9aca1acd6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:01.015824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9f0c5-4772-4bab-bf24-cf9dceed2a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4f859d03f8449492d3ffc835d19e0b, user_id=0fb0a35fa31a4e82bef6f8c9aca1acd6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:01.023652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9f0c5-4772-4bab-bf24-cf9dceed2a11 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:01.038957 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 888/1744] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:00 2022] PUT /identity/v3/projects/7d4f859d03f8449492d3ffc835d19e0b/users/0fb0a35fa31a4e82bef6f8c9aca1acd6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:01.050841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc72da6-f291-4dea-8d92-3ce78beddcc1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:01.051660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc72da6-f291-4dea-8d92-3ce78beddcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:01.051660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc72da6-f291-4dea-8d92-3ce78beddcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:01.107371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9bc72da6-f291-4dea-8d92-3ce78beddcc1 None None] MFA Rules not processed for user `0fb0a35fa31a4e82bef6f8c9aca1acd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:01.112538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9bc72da6-f291-4dea-8d92-3ce78beddcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:01.250709 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 857/1745] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:01.258270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9f0c5-4772-4bab-bf24-cf9dceed2a11 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:01.280099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9f0c5-4772-4bab-bf24-cf9dceed2a11 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:01.289150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e3c9d-ce7d-4e5f-8170-32f1fa36a744 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:01.290730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3c9d-ce7d-4e5f-8170-32f1fa36a744 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:01.291779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3c9d-ce7d-4e5f-8170-32f1fa36a744 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:01.291779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3c9d-ce7d-4e5f-8170-32f1fa36a744 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:01.294439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e3c9d-ce7d-4e5f-8170-32f1fa36a744 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:01.294792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e3c9d-ce7d-4e5f-8170-32f1fa36a744 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:01.298539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e3c9d-ce7d-4e5f-8170-32f1fa36a744 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:01.358551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc72da6-f291-4dea-8d92-3ce78beddcc1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:01.358905 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 889/1746] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:01.379082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc72da6-f291-4dea-8d92-3ce78beddcc1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:01.394841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d341a-944b-4252-aa3c-379c43af3da7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:01.395566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d341a-944b-4252-aa3c-379c43af3da7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:01.395874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d341a-944b-4252-aa3c-379c43af3da7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:01.396642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d341a-944b-4252-aa3c-379c43af3da7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:01.397300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d341a-944b-4252-aa3c-379c43af3da7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:01.400728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d341a-944b-4252-aa3c-379c43af3da7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:01.463072 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 858/1747] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:01 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:01.466672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e3c9d-ce7d-4e5f-8170-32f1fa36a744 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:01.487788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e3c9d-ce7d-4e5f-8170-32f1fa36a744 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:01.617017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9247981-374a-4ee8-9804-6c8d36b4934c tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:01.617645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247981-374a-4ee8-9804-6c8d36b4934c tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:01.617926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247981-374a-4ee8-9804-6c8d36b4934c tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:01.618228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247981-374a-4ee8-9804-6c8d36b4934c tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:01.618834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9247981-374a-4ee8-9804-6c8d36b4934c tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:01.619168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9247981-374a-4ee8-9804-6c8d36b4934c tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:01.620802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9247981-374a-4ee8-9804-6c8d36b4934c tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:01.643170 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 890/1748] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:01.990394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d341a-944b-4252-aa3c-379c43af3da7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:01.992925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-324d341a-944b-4252-aa3c-379c43af3da7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:02.080111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904bd55-4751-4f46-ac2a-4926d43c9f5f None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.080581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904bd55-4751-4f46-ac2a-4926d43c9f5f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.081259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904bd55-4751-4f46-ac2a-4926d43c9f5f None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:02.083223 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 891/1749] 10.222.0.39 () {54 vars in 921 bytes} [Sun Oct 16 01:01:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:02.094134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84997c-8e9b-4cd4-993f-3baa1bfca232 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.094587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84997c-8e9b-4cd4-993f-3baa1bfca232 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.095317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84997c-8e9b-4cd4-993f-3baa1bfca232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:02.109617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d341a-944b-4252-aa3c-379c43af3da7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:02.123170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fe951-39e8-4480-ac2a-5064d8ad00b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:02.124054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cc84997c-8e9b-4cd4-993f-3baa1bfca232 None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:02.124772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fe951-39e8-4480-ac2a-5064d8ad00b9 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.125402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fe951-39e8-4480-ac2a-5064d8ad00b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.125811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc84997c-8e9b-4cd4-993f-3baa1bfca232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:02.126395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fe951-39e8-4480-ac2a-5064d8ad00b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:02.140552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fe951-39e8-4480-ac2a-5064d8ad00b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:02.142604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fe951-39e8-4480-ac2a-5064d8ad00b9 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:02.154511 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:02.185643 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 859/1750] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:02.191564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f6f8-f71d-4f8d-9e26-a4f5ae56b182 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.191930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f6f8-f71d-4f8d-9e26-a4f5ae56b182 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.192277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f6f8-f71d-4f8d-9e26-a4f5ae56b182 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:02.193962 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 860/1751] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 01:01:02.199846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81f6f8-f71d-4f8d-9e26-a4f5ae56b182 None None] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:02.217033 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 892/1752] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:01:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:02.218735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81f6f8-f71d-4f8d-9e26-a4f5ae56b182 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:02.231498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81f6f8-f71d-4f8d-9e26-a4f5ae56b182 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:02.232128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84997c-8e9b-4cd4-993f-3baa1bfca232 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:02.233798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc84997c-8e9b-4cd4-993f-3baa1bfca232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:02.245591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84997c-8e9b-4cd4-993f-3baa1bfca232 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:02.247664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8041f0-e3f1-495a-8a1f-9e5a7ec4c096 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:02.248305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8041f0-e3f1-495a-8a1f-9e5a7ec4c096 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.248653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8041f0-e3f1-495a-8a1f-9e5a7ec4c096 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.248852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8041f0-e3f1-495a-8a1f-9e5a7ec4c096 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects/2834cc00471d467e997d8df2ff2dc3a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:02.250238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8041f0-e3f1-495a-8a1f-9e5a7ec4c096 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:get_project(project_id=2834cc00471d467e997d8df2ff2dc3a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:02.252521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8041f0-e3f1-495a-8a1f-9e5a7ec4c096 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:02.256253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681196a8-2132-4bcb-a79a-92519cf54610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:02.256967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681196a8-2132-4bcb-a79a-92519cf54610 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.257177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681196a8-2132-4bcb-a79a-92519cf54610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.257549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681196a8-2132-4bcb-a79a-92519cf54610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:02.263347 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 861/1753] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:02 2022] GET /identity/v3/projects/2834cc00471d467e997d8df2ff2dc3a0 => generated 371 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:01:02.271096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681196a8-2132-4bcb-a79a-92519cf54610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:02.273282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681196a8-2132-4bcb-a79a-92519cf54610 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:02.285204 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 893/1754] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:02.440902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8041f0-e3f1-495a-8a1f-9e5a7ec4c096 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:02.443424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-da8041f0-e3f1-495a-8a1f-9e5a7ec4c096 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:02.485209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a161d6c-d936-4097-b963-fb9775939c87 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.485713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a161d6c-d936-4097-b963-fb9775939c87 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.486416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a161d6c-d936-4097-b963-fb9775939c87 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:02.488495 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 894/1755] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:02.493929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a161d6c-d936-4097-b963-fb9775939c87 None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:02.509284 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:02.519677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a161d6c-d936-4097-b963-fb9775939c87 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:02.531495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a161d6c-d936-4097-b963-fb9775939c87 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:02.536962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c5681-7193-4432-8605-51332ceeac07 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:02.537589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c5681-7193-4432-8605-51332ceeac07 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.538005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c5681-7193-4432-8605-51332ceeac07 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.538536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c5681-7193-4432-8605-51332ceeac07 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects/2834cc00471d467e997d8df2ff2dc3a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:02.539847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c5681-7193-4432-8605-51332ceeac07 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:get_project(project_id=2834cc00471d467e997d8df2ff2dc3a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:02.542250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c5681-7193-4432-8605-51332ceeac07 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:02.544060 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 895/1756] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:02 2022] GET /identity/v3/projects/2834cc00471d467e997d8df2ff2dc3a0 => generated 371 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:02.581074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8041f0-e3f1-495a-8a1f-9e5a7ec4c096 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:02.593940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae833f-9cb6-493d-864d-0d6ece629a71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:02.594631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae833f-9cb6-493d-864d-0d6ece629a71 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.594846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae833f-9cb6-493d-864d-0d6ece629a71 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.595151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae833f-9cb6-493d-864d-0d6ece629a71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:02.598789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-efae833f-9cb6-493d-864d-0d6ece629a71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:02.613071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae833f-9cb6-493d-864d-0d6ece629a71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:02.615472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae833f-9cb6-493d-864d-0d6ece629a71 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:02.628825 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 862/1757] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:02.773412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c5681-7193-4432-8605-51332ceeac07 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:02.775435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0b7c5681-7193-4432-8605-51332ceeac07 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:02.803539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553f59f-56cd-4122-ad60-0c821bf0143b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.803825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553f59f-56cd-4122-ad60-0c821bf0143b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.804100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553f59f-56cd-4122-ad60-0c821bf0143b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:02.805441 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 863/1758] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:02.811117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553f59f-56cd-4122-ad60-0c821bf0143b None None] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:02.832798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553f59f-56cd-4122-ad60-0c821bf0143b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:02.868506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553f59f-56cd-4122-ad60-0c821bf0143b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:02.872714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c5681-7193-4432-8605-51332ceeac07 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:02.880040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:02.880991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.881434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.881849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] PATH_INFO: `/v3/users/a1f5ae583afa408f83f73552816433ee` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:02.883602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f5ae583afa408f83f73552816433ee)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:02.886763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:02.900703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfd107-995f-4573-9300-7c4fb890b9c6 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:02.901162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfd107-995f-4573-9300-7c4fb890b9c6 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.901445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfd107-995f-4573-9300-7c4fb890b9c6 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.901718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfd107-995f-4573-9300-7c4fb890b9c6 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects/2834cc00471d467e997d8df2ff2dc3a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:02.905147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfd107-995f-4573-9300-7c4fb890b9c6 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:get_project(project_id=2834cc00471d467e997d8df2ff2dc3a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:02.910568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfd107-995f-4573-9300-7c4fb890b9c6 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:02.917678 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 864/1759] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:02 2022] GET /identity/v3/projects/2834cc00471d467e997d8df2ff2dc3a0 => generated 371 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:02.929169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750319a8-8ecf-4fff-84f4-47cbf2cf1d2a None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.934241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750319a8-8ecf-4fff-84f4-47cbf2cf1d2a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.934480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750319a8-8ecf-4fff-84f4-47cbf2cf1d2a None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:02.936151 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 865/1760] 10.222.0.39 () {54 vars in 921 bytes} [Sun Oct 16 01:01:02 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:02.949028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a961c-4d43-42c3-b3b0-8795903b123a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:02.955269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a961c-4d43-42c3-b3b0-8795903b123a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:02.957002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a961c-4d43-42c3-b3b0-8795903b123a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:03.009631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-637a961c-4d43-42c3-b3b0-8795903b123a None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:03.011003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-637a961c-4d43-42c3-b3b0-8795903b123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:03.024413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f5ae583afa408f83f73552816433ee'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:03.027826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f5ae583afa408f83f73552816433ee'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:03.044127 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 866/1761] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:01:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:03.045054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a961c-4d43-42c3-b3b0-8795903b123a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:03.062839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-637a961c-4d43-42c3-b3b0-8795903b123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:03.063062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f5ae583afa408f83f73552816433ee'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:03.079584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f5ae583afa408f83f73552816433ee'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:03.082087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f5ae583afa408f83f73552816433ee'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:03.085010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a961c-4d43-42c3-b3b0-8795903b123a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:03.091540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72477f-54f8-445b-92fc-09f6c0ab620e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:03.103710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72477f-54f8-445b-92fc-09f6c0ab620e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:03.103955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72477f-54f8-445b-92fc-09f6c0ab620e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:03.104834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72477f-54f8-445b-92fc-09f6c0ab620e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects/2834cc00471d467e997d8df2ff2dc3a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:03.105901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72477f-54f8-445b-92fc-09f6c0ab620e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2834cc00471d467e997d8df2ff2dc3a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:03.108210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72477f-54f8-445b-92fc-09f6c0ab620e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:03.130482 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 896/1762] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:02 2022] DELETE /identity/v3/users/a1f5ae583afa408f83f73552816433ee => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:03.135311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:03.139788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:03.209650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e72477f-54f8-445b-92fc-09f6c0ab620e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2834cc00471d467e997d8df2ff2dc3a0', 'request_id': 'req-4e72477f-54f8-445b-92fc-09f6c0ab620e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:03.223220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e72477f-54f8-445b-92fc-09f6c0ab620e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2834cc00471d467e997d8df2ff2dc3a0', 'request_id': 'req-4e72477f-54f8-445b-92fc-09f6c0ab620e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:03.239898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e72477f-54f8-445b-92fc-09f6c0ab620e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2834cc00471d467e997d8df2ff2dc3a0', 'request_id': 'req-4e72477f-54f8-445b-92fc-09f6c0ab620e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:03.261623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e72477f-54f8-445b-92fc-09f6c0ab620e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] The token cache is being invalidate because project 2834cc00471d467e997d8df2ff2dc3a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:03.262071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e72477f-54f8-445b-92fc-09f6c0ab620e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:03.262988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e72477f-54f8-445b-92fc-09f6c0ab620e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:03.264846 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:03.267669 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 867/1763] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:03 2022] DELETE /identity/v3/projects/2834cc00471d467e997d8df2ff2dc3a0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:03.270395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff555-e602-43d7-bb9e-efadf1dc5ea3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:03.271625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff555-e602-43d7-bb9e-efadf1dc5ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:03.272250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff555-e602-43d7-bb9e-efadf1dc5ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:03.308876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-27aff555-e602-43d7-bb9e-efadf1dc5ea3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:03.310430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-27aff555-e602-43d7-bb9e-efadf1dc5ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:03.321294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb087848-0f5d-4a82-bb0d-b46ef6f49442 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:03.434907 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 868/1764] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:03.439570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2fd7c-25f5-432c-b88a-4fc9de28376e None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:03.439874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2fd7c-25f5-432c-b88a-4fc9de28376e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:03.441382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2fd7c-25f5-432c-b88a-4fc9de28376e None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:03.444323 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 869/1765] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:03.448810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2fd7c-25f5-432c-b88a-4fc9de28376e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:03.454323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d3a2fd7c-25f5-432c-b88a-4fc9de28376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:03.467093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efde884-e8a0-481f-a293-14e4dc002654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:03.468074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde884-e8a0-481f-a293-14e4dc002654 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:03.469878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde884-e8a0-481f-a293-14e4dc002654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:03.470539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde884-e8a0-481f-a293-14e4dc002654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:03.472859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2fd7c-25f5-432c-b88a-4fc9de28376e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:03.477060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3efde884-e8a0-481f-a293-14e4dc002654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:03.477646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91f6ac-4753-4f1a-b67c-2e5e1da61a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:03.478303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91f6ac-4753-4f1a-b67c-2e5e1da61a6e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:03.478604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91f6ac-4753-4f1a-b67c-2e5e1da61a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:03.478899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91f6ac-4753-4f1a-b67c-2e5e1da61a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:03.491172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91f6ac-4753-4f1a-b67c-2e5e1da61a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:03.492690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91f6ac-4753-4f1a-b67c-2e5e1da61a6e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:03.504899 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 870/1766] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:03.513221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91f6ac-4753-4f1a-b67c-2e5e1da61a6e service neutron] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:03.519875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0a91f6ac-4753-4f1a-b67c-2e5e1da61a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:03.539663 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:03.610573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efde884-e8a0-481f-a293-14e4dc002654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:03.612841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efde884-e8a0-481f-a293-14e4dc002654 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:03.631777 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 897/1767] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:03.695244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91f6ac-4753-4f1a-b67c-2e5e1da61a6e service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:03.696962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0a91f6ac-4753-4f1a-b67c-2e5e1da61a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:03.846980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91f6ac-4753-4f1a-b67c-2e5e1da61a6e service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:03.856960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c3f2c-248c-46f4-aafe-47b17a58e053 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:03.858106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c3f2c-248c-46f4-aafe-47b17a58e053 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:03.858588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c3f2c-248c-46f4-aafe-47b17a58e053 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:03.859173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c3f2c-248c-46f4-aafe-47b17a58e053 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects/a5680c7462944e9fa9887d076c380ec2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:03.860397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c3f2c-248c-46f4-aafe-47b17a58e053 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:get_project(project_id=a5680c7462944e9fa9887d076c380ec2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:03.863171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c3f2c-248c-46f4-aafe-47b17a58e053 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:03.865173 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 871/1768] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:03 2022] GET /identity/v3/projects/a5680c7462944e9fa9887d076c380ec2 => generated 373 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:03.885092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efde884-e8a0-481f-a293-14e4dc002654 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:03.901662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efde884-e8a0-481f-a293-14e4dc002654 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:03.917346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ee603-38d2-4a45-9d77-ef93efd585c8 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:03.918369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ee603-38d2-4a45-9d77-ef93efd585c8 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:03.919372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ee603-38d2-4a45-9d77-ef93efd585c8 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:03.919638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ee603-38d2-4a45-9d77-ef93efd585c8 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:03.920351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ee603-38d2-4a45-9d77-ef93efd585c8 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:03.920694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ee603-38d2-4a45-9d77-ef93efd585c8 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:03.922373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ee603-38d2-4a45-9d77-ef93efd585c8 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:03.949860 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 898/1769] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:03.955011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c3f2c-248c-46f4-aafe-47b17a58e053 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:03.972065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c3f2c-248c-46f4-aafe-47b17a58e053 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:03.979768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaa737-e638-4095-8092-f1f70b76b6a7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:03.980832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaa737-e638-4095-8092-f1f70b76b6a7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:03.981383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaa737-e638-4095-8092-f1f70b76b6a7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:03.981936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaa737-e638-4095-8092-f1f70b76b6a7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:03.983054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaa737-e638-4095-8092-f1f70b76b6a7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:03.986158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaa737-e638-4095-8092-f1f70b76b6a7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:04.019703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ee603-38d2-4a45-9d77-ef93efd585c8 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:04.021885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d46ee603-38d2-4a45-9d77-ef93efd585c8 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:04.067057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ee603-38d2-4a45-9d77-ef93efd585c8 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:04.078084 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 872/1770] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:03 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:04.084924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:04.085818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaa737-e638-4095-8092-f1f70b76b6a7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:04.087881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:04.088180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:04.088498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] PATH_INFO: `/v3/projects/ca0b8c6c9299455a8aa6948a29bb8bdc` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:04.098184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0b8c6c9299455a8aa6948a29bb8bdc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:04.103567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:04.198348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0b8c6c9299455a8aa6948a29bb8bdc', 'request_id': 'req-1637abb1-1a26-43e3-9997-396b44344747'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:04.219187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0b8c6c9299455a8aa6948a29bb8bdc', 'request_id': 'req-1637abb1-1a26-43e3-9997-396b44344747'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:04.243700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaa737-e638-4095-8092-f1f70b76b6a7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:04.244958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0b8c6c9299455a8aa6948a29bb8bdc', 'request_id': 'req-1637abb1-1a26-43e3-9997-396b44344747'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:04.260389 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:04.274422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] The token cache is being invalidate because project ca0b8c6c9299455a8aa6948a29bb8bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:04.275754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:04.277595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:04.283222 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 899/1771] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:04 2022] DELETE /identity/v3/projects/ca0b8c6c9299455a8aa6948a29bb8bdc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:04.288954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:04.295920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:04.304225 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:04.352477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9b266-27d7-4577-9cc7-857db7ed38c0 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:04.353115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9b266-27d7-4577-9cc7-857db7ed38c0 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:04.353495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9b266-27d7-4577-9cc7-857db7ed38c0 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:04.354048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9b266-27d7-4577-9cc7-857db7ed38c0 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:04.354797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9b266-27d7-4577-9cc7-857db7ed38c0 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:04.355146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9b266-27d7-4577-9cc7-857db7ed38c0 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:04.356988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9b266-27d7-4577-9cc7-857db7ed38c0 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:04.380365 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 873/1772] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:04.418049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637abb1-1a26-43e3-9997-396b44344747 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:04.423073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:04.423875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:04.424221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:04.424619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] PATH_INFO: `/v3/users/f7c1729b5bb94681bd0ec0bbf10152b6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:04.426011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c1729b5bb94681bd0ec0bbf10152b6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:04.428246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:04.489678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c1729b5bb94681bd0ec0bbf10152b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:04.490770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c1729b5bb94681bd0ec0bbf10152b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:04.507502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c1729b5bb94681bd0ec0bbf10152b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:04.515763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c1729b5bb94681bd0ec0bbf10152b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:04.516723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c1729b5bb94681bd0ec0bbf10152b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:04.535547 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 900/1773] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:04 2022] DELETE /identity/v3/users/f7c1729b5bb94681bd0ec0bbf10152b6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:01:04.686337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14958b7-a30e-4ca8-a67f-6d121a8729f8 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:04.686656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14958b7-a30e-4ca8-a67f-6d121a8729f8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:04.687018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14958b7-a30e-4ca8-a67f-6d121a8729f8 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:04.696171 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 874/1774] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:04 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:04.703187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:04.704638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:04.806063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:04.807388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:04.828366 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:04.937420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35274fc5-11ed-46a6-9a77-43504aaab480 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:04.943436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616e5cf-2a64-4e2e-95fa-ec20a315979e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:04.944095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616e5cf-2a64-4e2e-95fa-ec20a315979e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:04.944406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616e5cf-2a64-4e2e-95fa-ec20a315979e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:04.944678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616e5cf-2a64-4e2e-95fa-ec20a315979e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects/3d4186673bdf4f7fb86c2a95a8d44ae0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:04.945904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616e5cf-2a64-4e2e-95fa-ec20a315979e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:get_project(project_id=3d4186673bdf4f7fb86c2a95a8d44ae0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:04.948049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616e5cf-2a64-4e2e-95fa-ec20a315979e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:04.949853 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 901/1775] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:04 2022] GET /identity/v3/projects/3d4186673bdf4f7fb86c2a95a8d44ae0 => generated 369 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:04.967718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14958b7-a30e-4ca8-a67f-6d121a8729f8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:04.969891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f14958b7-a30e-4ca8-a67f-6d121a8729f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:05.105524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14958b7-a30e-4ca8-a67f-6d121a8729f8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:05.117105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c8992-dd5a-4265-afc1-e008feaec37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:05.117832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c8992-dd5a-4265-afc1-e008feaec37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.118190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c8992-dd5a-4265-afc1-e008feaec37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.118691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c8992-dd5a-4265-afc1-e008feaec37d admin admin] PATH_INFO: `/v3/projects/8e6e094bd00a4234ae42efa5261d7263` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.120418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c8992-dd5a-4265-afc1-e008feaec37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6e094bd00a4234ae42efa5261d7263)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:05.122973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c8992-dd5a-4265-afc1-e008feaec37d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:05.148140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616e5cf-2a64-4e2e-95fa-ec20a315979e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:05.166985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616e5cf-2a64-4e2e-95fa-ec20a315979e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:05.175698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802702a-c30a-46d7-9bd4-d1cd5cbd8463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:05.176412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802702a-c30a-46d7-9bd4-d1cd5cbd8463 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.176824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802702a-c30a-46d7-9bd4-d1cd5cbd8463 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.177173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802702a-c30a-46d7-9bd4-d1cd5cbd8463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.179442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d802702a-c30a-46d7-9bd4-d1cd5cbd8463 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:05.190194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c80c8992-dd5a-4265-afc1-e008feaec37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6e094bd00a4234ae42efa5261d7263', 'request_id': 'req-c80c8992-dd5a-4265-afc1-e008feaec37d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:05.199600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c80c8992-dd5a-4265-afc1-e008feaec37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6e094bd00a4234ae42efa5261d7263', 'request_id': 'req-c80c8992-dd5a-4265-afc1-e008feaec37d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:05.214196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c80c8992-dd5a-4265-afc1-e008feaec37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6e094bd00a4234ae42efa5261d7263', 'request_id': 'req-c80c8992-dd5a-4265-afc1-e008feaec37d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:05.227940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c80c8992-dd5a-4265-afc1-e008feaec37d admin admin] The token cache is being invalidate because project 8e6e094bd00a4234ae42efa5261d7263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:05.228298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c80c8992-dd5a-4265-afc1-e008feaec37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:05.229198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c80c8992-dd5a-4265-afc1-e008feaec37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:05.234443 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 875/1776] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:04 2022] DELETE /identity/v3/projects/8e6e094bd00a4234ae42efa5261d7263 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:05.236119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a112731-735d-4f23-881d-6be6139fd928 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.236473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a112731-735d-4f23-881d-6be6139fd928 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.236811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a112731-735d-4f23-881d-6be6139fd928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.263680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1a112731-735d-4f23-881d-6be6139fd928 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:05.265222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1a112731-735d-4f23-881d-6be6139fd928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:05.271726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802702a-c30a-46d7-9bd4-d1cd5cbd8463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:05.273352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802702a-c30a-46d7-9bd4-d1cd5cbd8463 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:05.283381 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 902/1777] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:05 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:01:05.284829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a64eac-724f-4402-a3c2-41b704c7cf74 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.285242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a64eac-724f-4402-a3c2-41b704c7cf74 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.285586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a64eac-724f-4402-a3c2-41b704c7cf74 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.287144 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 903/1778] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:05.295001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a64eac-724f-4402-a3c2-41b704c7cf74 None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:05.296877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-48a64eac-724f-4402-a3c2-41b704c7cf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:05.320404 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:05.339941 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 876/1779] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:01:05.350330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100da6-145e-46f3-bcb7-83b78c3494df None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.350852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100da6-145e-46f3-bcb7-83b78c3494df None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.351326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100da6-145e-46f3-bcb7-83b78c3494df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.379532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ac100da6-145e-46f3-bcb7-83b78c3494df None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:05.381100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ac100da6-145e-46f3-bcb7-83b78c3494df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:05.389282 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 877/1780] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:05.395924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac100da6-145e-46f3-bcb7-83b78c3494df None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:05.396782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a64eac-724f-4402-a3c2-41b704c7cf74 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:05.398051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-48a64eac-724f-4402-a3c2-41b704c7cf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:05.407116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac100da6-145e-46f3-bcb7-83b78c3494df None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:05.414071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00424b7e-bb48-4fcc-bda5-8d800484e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:05.414705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00424b7e-bb48-4fcc-bda5-8d800484e853 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.415002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00424b7e-bb48-4fcc-bda5-8d800484e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.415307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00424b7e-bb48-4fcc-bda5-8d800484e853 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.415952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00424b7e-bb48-4fcc-bda5-8d800484e853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:05.416304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00424b7e-bb48-4fcc-bda5-8d800484e853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:05.418189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00424b7e-bb48-4fcc-bda5-8d800484e853 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:05.435038 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 878/1781] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:05.437890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00424b7e-bb48-4fcc-bda5-8d800484e853 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:05.449298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00424b7e-bb48-4fcc-bda5-8d800484e853 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:05.451452 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:05.455137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d059371-32aa-4b5d-a5ae-5b6ec931d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:05.455750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d059371-32aa-4b5d-a5ae-5b6ec931d1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.456536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d059371-32aa-4b5d-a5ae-5b6ec931d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.456809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d059371-32aa-4b5d-a5ae-5b6ec931d1d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.457432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d059371-32aa-4b5d-a5ae-5b6ec931d1d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:05.459361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d059371-32aa-4b5d-a5ae-5b6ec931d1d8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:05.478886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a64eac-724f-4402-a3c2-41b704c7cf74 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:05.484941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0caaf2-8939-4739-a3c5-40fa2f2ccc45 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:05.485707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0caaf2-8939-4739-a3c5-40fa2f2ccc45 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.485993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0caaf2-8939-4739-a3c5-40fa2f2ccc45 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.486265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0caaf2-8939-4739-a3c5-40fa2f2ccc45 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects/3d4186673bdf4f7fb86c2a95a8d44ae0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.487483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0caaf2-8939-4739-a3c5-40fa2f2ccc45 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:get_project(project_id=3d4186673bdf4f7fb86c2a95a8d44ae0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:05.492218 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 879/1782] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:05 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:05.492598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0caaf2-8939-4739-a3c5-40fa2f2ccc45 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:05.493253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d059371-32aa-4b5d-a5ae-5b6ec931d1d8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:05.494968 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 904/1783] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:05 2022] GET /identity/v3/projects/3d4186673bdf4f7fb86c2a95a8d44ae0 => generated 369 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:01:05.542772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0caaf2-8939-4739-a3c5-40fa2f2ccc45 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:05.559418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0caaf2-8939-4739-a3c5-40fa2f2ccc45 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:05.580007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d059371-32aa-4b5d-a5ae-5b6ec931d1d8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:05.586658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72621c2e-d97e-49aa-b250-698716122d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:05.587464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72621c2e-d97e-49aa-b250-698716122d65 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.587749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72621c2e-d97e-49aa-b250-698716122d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.588021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72621c2e-d97e-49aa-b250-698716122d65 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.588660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72621c2e-d97e-49aa-b250-698716122d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:05.590613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72621c2e-d97e-49aa-b250-698716122d65 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:05.619966 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 880/1784] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:05 2022] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:05.624216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72621c2e-d97e-49aa-b250-698716122d65 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:05.625889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-72621c2e-d97e-49aa-b250-698716122d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:05.653383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82632c27-0a03-4576-a9ad-229d5504443f tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:05.654628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632c27-0a03-4576-a9ad-229d5504443f tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.654940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632c27-0a03-4576-a9ad-229d5504443f tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.655274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632c27-0a03-4576-a9ad-229d5504443f tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.655935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82632c27-0a03-4576-a9ad-229d5504443f tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:05.656246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82632c27-0a03-4576-a9ad-229d5504443f tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:05.658674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82632c27-0a03-4576-a9ad-229d5504443f tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:05.673712 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 905/1785] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:05.675239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82632c27-0a03-4576-a9ad-229d5504443f tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:05.687686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82632c27-0a03-4576-a9ad-229d5504443f tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:05.694529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9d890-af2b-4d3f-be0a-0eb7bf2174f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:05.695189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9d890-af2b-4d3f-be0a-0eb7bf2174f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.695470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9d890-af2b-4d3f-be0a-0eb7bf2174f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.695762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9d890-af2b-4d3f-be0a-0eb7bf2174f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.696406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9d890-af2b-4d3f-be0a-0eb7bf2174f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:05.698221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9d890-af2b-4d3f-be0a-0eb7bf2174f1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:05.714768 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 906/1786] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:05.715711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9d890-af2b-4d3f-be0a-0eb7bf2174f1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:05.728037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9d890-af2b-4d3f-be0a-0eb7bf2174f1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:05.731049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72621c2e-d97e-49aa-b250-698716122d65 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:05.734535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507ee94-f3a3-4130-8aaf-eba9c6e7c79a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:05.735358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507ee94-f3a3-4130-8aaf-eba9c6e7c79a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.735728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507ee94-f3a3-4130-8aaf-eba9c6e7c79a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.736117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507ee94-f3a3-4130-8aaf-eba9c6e7c79a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.737017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507ee94-f3a3-4130-8aaf-eba9c6e7c79a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:05.739315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae77f13-c089-4ade-9dd9-a7d9b946ac4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:05.739631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507ee94-f3a3-4130-8aaf-eba9c6e7c79a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:05.740151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae77f13-c089-4ade-9dd9-a7d9b946ac4b service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.740534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae77f13-c089-4ade-9dd9-a7d9b946ac4b service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.740926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae77f13-c089-4ade-9dd9-a7d9b946ac4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.750788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aae77f13-c089-4ade-9dd9-a7d9b946ac4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:05.767464 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 907/1787] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:05 2022] POST /identity/v3/users => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:05.768684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507ee94-f3a3-4130-8aaf-eba9c6e7c79a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:05.781215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507ee94-f3a3-4130-8aaf-eba9c6e7c79a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:05.787168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566663e-4209-440b-b985-86ea0c7d6afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:05.787800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566663e-4209-440b-b985-86ea0c7d6afd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.788302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566663e-4209-440b-b985-86ea0c7d6afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.788595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566663e-4209-440b-b985-86ea0c7d6afd admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.789226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566663e-4209-440b-b985-86ea0c7d6afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:05.790823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566663e-4209-440b-b985-86ea0c7d6afd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:05.807986 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 908/1788] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:05.809029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566663e-4209-440b-b985-86ea0c7d6afd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:05.820738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566663e-4209-440b-b985-86ea0c7d6afd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:05.821003 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:05.828585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37696c-6876-43f5-8282-d25f89b720c5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:05.829334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37696c-6876-43f5-8282-d25f89b720c5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.829915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37696c-6876-43f5-8282-d25f89b720c5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.830287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37696c-6876-43f5-8282-d25f89b720c5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.831146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37696c-6876-43f5-8282-d25f89b720c5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:05.831681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37696c-6876-43f5-8282-d25f89b720c5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:05.833710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37696c-6876-43f5-8282-d25f89b720c5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:05.848131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae77f13-c089-4ade-9dd9-a7d9b946ac4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:05.850163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae77f13-c089-4ade-9dd9-a7d9b946ac4b service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:05.852851 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 909/1789] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:05.853721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37696c-6876-43f5-8282-d25f89b720c5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:05.865792 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 881/1790] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:05.867379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37696c-6876-43f5-8282-d25f89b720c5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:05.872961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01535e-3b8a-4f7e-a156-474eb2e39c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:05.873989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01535e-3b8a-4f7e-a156-474eb2e39c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.874427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01535e-3b8a-4f7e-a156-474eb2e39c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.875003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01535e-3b8a-4f7e-a156-474eb2e39c91 admin admin] PATH_INFO: `/v3/projects/61deedbd92ca45e28838b513114952c8/users/7cf9dde9e1de4c7c8592ced74f618bed/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.900037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01535e-3b8a-4f7e-a156-474eb2e39c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61deedbd92ca45e28838b513114952c8, user_id=7cf9dde9e1de4c7c8592ced74f618bed, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:05.902880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01535e-3b8a-4f7e-a156-474eb2e39c91 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:05.930629 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 910/1791] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:05 2022] PUT /identity/v3/projects/61deedbd92ca45e28838b513114952c8/users/7cf9dde9e1de4c7c8592ced74f618bed/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:05.943544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745ae0f-938f-4f94-bc84-b8c4169f13a8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:05.943732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745ae0f-938f-4f94-bc84-b8c4169f13a8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:05.944003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745ae0f-938f-4f94-bc84-b8c4169f13a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:05.975926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3745ae0f-938f-4f94-bc84-b8c4169f13a8 None None] MFA Rules not processed for user `7cf9dde9e1de4c7c8592ced74f618bed`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:05.977200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3745ae0f-938f-4f94-bc84-b8c4169f13a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:06.061733 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 882/1792] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:06.066641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01535e-3b8a-4f7e-a156-474eb2e39c91 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:06.135424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01535e-3b8a-4f7e-a156-474eb2e39c91 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:06.145079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ff065-73a8-4881-a9e6-272e7fe5cf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:06.146241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ff065-73a8-4881-a9e6-272e7fe5cf05 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:06.146502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ff065-73a8-4881-a9e6-272e7fe5cf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:06.146846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ff065-73a8-4881-a9e6-272e7fe5cf05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:06.147725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ff065-73a8-4881-a9e6-272e7fe5cf05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:06.150790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ff065-73a8-4881-a9e6-272e7fe5cf05 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:06.158141 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:06.183632 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 911/1793] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:06 2022] POST /identity/v3/projects => generated 389 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:06.188020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745ae0f-938f-4f94-bc84-b8c4169f13a8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:06.200517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745ae0f-938f-4f94-bc84-b8c4169f13a8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:06.262459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40ddd8-d360-4882-972c-0c51725cfcb1 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:06.263147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40ddd8-d360-4882-972c-0c51725cfcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:06.264005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40ddd8-d360-4882-972c-0c51725cfcb1 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:06.267393 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 912/1794] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:06.275458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40ddd8-d360-4882-972c-0c51725cfcb1 None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:06.325317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff8988-5fbf-4592-89af-514932a9ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:06.326008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff8988-5fbf-4592-89af-514932a9ac20 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:06.326257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff8988-5fbf-4592-89af-514932a9ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:06.326522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff8988-5fbf-4592-89af-514932a9ac20 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:06.327130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff8988-5fbf-4592-89af-514932a9ac20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:06.333109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff8988-5fbf-4592-89af-514932a9ac20 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:06.365344 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 883/1795] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:06 2022] POST /identity/v3/users => generated 301 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:06.369342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff8988-5fbf-4592-89af-514932a9ac20 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:06.387021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff8988-5fbf-4592-89af-514932a9ac20 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:06.392499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc87ae-6886-4e48-bc23-5bbccc4e4b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:06.393200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc87ae-6886-4e48-bc23-5bbccc4e4b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:06.393594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc87ae-6886-4e48-bc23-5bbccc4e4b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:06.393961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc87ae-6886-4e48-bc23-5bbccc4e4b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:06.394674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc87ae-6886-4e48-bc23-5bbccc4e4b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:06.396567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc87ae-6886-4e48-bc23-5bbccc4e4b59 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:06.413961 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 884/1796] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:01:06.415048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc87ae-6886-4e48-bc23-5bbccc4e4b59 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:06.426208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc87ae-6886-4e48-bc23-5bbccc4e4b59 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:06.430171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40ddd8-d360-4882-972c-0c51725cfcb1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:06.432503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577cb66-528e-45e4-a05d-990540693efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:06.433346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577cb66-528e-45e4-a05d-990540693efe admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:06.434048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577cb66-528e-45e4-a05d-990540693efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:06.434530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577cb66-528e-45e4-a05d-990540693efe admin admin] PATH_INFO: `/v3/projects/ad22e1e5078f4f9ba7b9dbb0453bc86b/users/56c8dd2fb5e746918010a39000e8dcf8/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:06.454664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577cb66-528e-45e4-a05d-990540693efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad22e1e5078f4f9ba7b9dbb0453bc86b, user_id=56c8dd2fb5e746918010a39000e8dcf8, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:06.458380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577cb66-528e-45e4-a05d-990540693efe admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:06.476724 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 885/1797] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:06 2022] PUT /identity/v3/projects/ad22e1e5078f4f9ba7b9dbb0453bc86b/users/56c8dd2fb5e746918010a39000e8dcf8/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:06.486272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577cb66-528e-45e4-a05d-990540693efe admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:06.502378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40ddd8-d360-4882-972c-0c51725cfcb1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:06.516667 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:06.586319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322f289-c3e1-4e5d-b19e-b36245f51c74 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:06.587297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322f289-c3e1-4e5d-b19e-b36245f51c74 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:06.587778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322f289-c3e1-4e5d-b19e-b36245f51c74 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:06.588065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322f289-c3e1-4e5d-b19e-b36245f51c74 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects/3d4186673bdf4f7fb86c2a95a8d44ae0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:06.589729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322f289-c3e1-4e5d-b19e-b36245f51c74 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:get_project(project_id=3d4186673bdf4f7fb86c2a95a8d44ae0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:06.592189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322f289-c3e1-4e5d-b19e-b36245f51c74 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:06.594664 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 913/1798] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:06 2022] GET /identity/v3/projects/3d4186673bdf4f7fb86c2a95a8d44ae0 => generated 369 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:06.595541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577cb66-528e-45e4-a05d-990540693efe admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:06.602403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5e3ca-b82d-49e5-a76c-7a0efd5746f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:06.603228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5e3ca-b82d-49e5-a76c-7a0efd5746f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:06.604002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5e3ca-b82d-49e5-a76c-7a0efd5746f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:06.605618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5e3ca-b82d-49e5-a76c-7a0efd5746f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:06.605618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5e3ca-b82d-49e5-a76c-7a0efd5746f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:06.606541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5e3ca-b82d-49e5-a76c-7a0efd5746f0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:06.635818 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 886/1799] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:06.642643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322f289-c3e1-4e5d-b19e-b36245f51c74 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:06.663702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322f289-c3e1-4e5d-b19e-b36245f51c74 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:06.672026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed13115-b407-4e4c-9a96-97078ad4f7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:06.673084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed13115-b407-4e4c-9a96-97078ad4f7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:06.675123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed13115-b407-4e4c-9a96-97078ad4f7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:06.675727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed13115-b407-4e4c-9a96-97078ad4f7ed admin admin] PATH_INFO: `/v3/projects/ad22e1e5078f4f9ba7b9dbb0453bc86b/users/56c8dd2fb5e746918010a39000e8dcf8/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:06.678542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed13115-b407-4e4c-9a96-97078ad4f7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad22e1e5078f4f9ba7b9dbb0453bc86b, user_id=56c8dd2fb5e746918010a39000e8dcf8, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:06.682286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed13115-b407-4e4c-9a96-97078ad4f7ed admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:06.695438 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 914/1800] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:06 2022] PUT /identity/v3/projects/ad22e1e5078f4f9ba7b9dbb0453bc86b/users/56c8dd2fb5e746918010a39000e8dcf8/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:06.709160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d474070-3722-4ced-8d6a-c345a40aa5b9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:06.709413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d474070-3722-4ced-8d6a-c345a40aa5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:06.709625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d474070-3722-4ced-8d6a-c345a40aa5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:06.769596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9d474070-3722-4ced-8d6a-c345a40aa5b9 None None] MFA Rules not processed for user `56c8dd2fb5e746918010a39000e8dcf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:06.770827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9d474070-3722-4ced-8d6a-c345a40aa5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:06.877555 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 887/1801] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:06 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:06.889390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950275c2-8710-4f45-8303-5e123d85149c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:06.889673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950275c2-8710-4f45-8303-5e123d85149c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:06.889982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950275c2-8710-4f45-8303-5e123d85149c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:06.916471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-950275c2-8710-4f45-8303-5e123d85149c None None] MFA Rules not processed for user `7cf9dde9e1de4c7c8592ced74f618bed`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:06.918636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-950275c2-8710-4f45-8303-5e123d85149c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:06.937688 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:07.025049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25858-f047-46e7-a888-a31f5da0941d None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:07.025341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25858-f047-46e7-a888-a31f5da0941d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:07.025620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25858-f047-46e7-a888-a31f5da0941d None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:07.027278 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 888/1802] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:07.032168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b25858-f047-46e7-a888-a31f5da0941d None None] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:07.049786 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 915/1803] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:07.173943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b25858-f047-46e7-a888-a31f5da0941d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:07.235968 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:07.271634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b25858-f047-46e7-a888-a31f5da0941d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:07.279739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28f60e-62ac-4829-bbc2-28f0bd159cb5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:07.280421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28f60e-62ac-4829-bbc2-28f0bd159cb5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:07.280806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28f60e-62ac-4829-bbc2-28f0bd159cb5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:07.281087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28f60e-62ac-4829-bbc2-28f0bd159cb5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects/3d4186673bdf4f7fb86c2a95a8d44ae0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:07.282758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28f60e-62ac-4829-bbc2-28f0bd159cb5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:get_project(project_id=3d4186673bdf4f7fb86c2a95a8d44ae0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:07.285471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28f60e-62ac-4829-bbc2-28f0bd159cb5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:07.287352 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 889/1804] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:07 2022] GET /identity/v3/projects/3d4186673bdf4f7fb86c2a95a8d44ae0 => generated 369 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:07.322069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950275c2-8710-4f45-8303-5e123d85149c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:07.337958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950275c2-8710-4f45-8303-5e123d85149c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:07.352134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c9e4c-d733-42c5-881e-60c7fb7c2571 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:07.353008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9e4c-d733-42c5-881e-60c7fb7c2571 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:07.353514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9e4c-d733-42c5-881e-60c7fb7c2571 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:07.354033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9e4c-d733-42c5-881e-60c7fb7c2571 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/users/b4f1506fa73a49d6ac91d18c5753094e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:07.374614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28f60e-62ac-4829-bbc2-28f0bd159cb5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:07.385717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c9e4c-d733-42c5-881e-60c7fb7c2571 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b4f1506fa73a49d6ac91d18c5753094e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:07.387899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c9e4c-d733-42c5-881e-60c7fb7c2571 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:07.396741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28f60e-62ac-4829-bbc2-28f0bd159cb5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:07.405402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390675f-9385-4c33-a7da-b4ace484a4eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:07.406432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390675f-9385-4c33-a7da-b4ace484a4eb service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:07.406805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390675f-9385-4c33-a7da-b4ace484a4eb service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:07.407235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390675f-9385-4c33-a7da-b4ace484a4eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:07.417775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390675f-9385-4c33-a7da-b4ace484a4eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:07.420277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390675f-9385-4c33-a7da-b4ace484a4eb service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:07.435117 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 890/1805] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:07.460475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-758c9e4c-d733-42c5-881e-60c7fb7c2571 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f1506fa73a49d6ac91d18c5753094e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:07.461202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-758c9e4c-d733-42c5-881e-60c7fb7c2571 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f1506fa73a49d6ac91d18c5753094e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:07.475495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-758c9e4c-d733-42c5-881e-60c7fb7c2571 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f1506fa73a49d6ac91d18c5753094e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:07.484057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-758c9e4c-d733-42c5-881e-60c7fb7c2571 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f1506fa73a49d6ac91d18c5753094e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:07.484782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-758c9e4c-d733-42c5-881e-60c7fb7c2571 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f1506fa73a49d6ac91d18c5753094e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:07.500700 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 916/1806] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:07 2022] DELETE /identity/v3/users/b4f1506fa73a49d6ac91d18c5753094e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:07.504880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390675f-9385-4c33-a7da-b4ace484a4eb service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:07.518961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390675f-9385-4c33-a7da-b4ace484a4eb service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:07.596104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:07.597177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:07.597473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:07.597733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects/3d4186673bdf4f7fb86c2a95a8d44ae0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:07.598868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3d4186673bdf4f7fb86c2a95a8d44ae0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:07.600868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:07.667005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4186673bdf4f7fb86c2a95a8d44ae0', 'request_id': 'req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:07.674269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4186673bdf4f7fb86c2a95a8d44ae0', 'request_id': 'req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:07.683784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4186673bdf4f7fb86c2a95a8d44ae0', 'request_id': 'req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:07.695504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] The token cache is being invalidate because project 3d4186673bdf4f7fb86c2a95a8d44ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:07.695836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:07.696711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:07.698669 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 891/1807] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:07 2022] DELETE /identity/v3/projects/3d4186673bdf4f7fb86c2a95a8d44ae0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:08.314645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6055c7a-c261-418f-8af9-961d46edc28b None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:08.315207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6055c7a-c261-418f-8af9-961d46edc28b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:08.315398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6055c7a-c261-418f-8af9-961d46edc28b None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:08.317068 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 917/1808] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:08.322110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:08.323657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:08.385927 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:08.409368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:08.410867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:08.476696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ee31d-b59a-4640-ac67-7080c6f4bd28 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:08.481530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50d3a1-cf60-4b11-a8f5-83ff94482056 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:08.482167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d3a1-cf60-4b11-a8f5-83ff94482056 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:08.482448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d3a1-cf60-4b11-a8f5-83ff94482056 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:08.482743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d3a1-cf60-4b11-a8f5-83ff94482056 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects/a5680c7462944e9fa9887d076c380ec2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:08.483919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50d3a1-cf60-4b11-a8f5-83ff94482056 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:get_project(project_id=a5680c7462944e9fa9887d076c380ec2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:08.486099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50d3a1-cf60-4b11-a8f5-83ff94482056 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:08.488773 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 892/1809] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:08 2022] GET /identity/v3/projects/a5680c7462944e9fa9887d076c380ec2 => generated 373 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:01:08.964425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8741c4-afc3-4a9e-9371-f04cd31c8394 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:08.964702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8741c4-afc3-4a9e-9371-f04cd31c8394 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:08.964969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8741c4-afc3-4a9e-9371-f04cd31c8394 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:08.966292 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 918/1810] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:08.970796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50d3a1-cf60-4b11-a8f5-83ff94482056 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:08.984724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50d3a1-cf60-4b11-a8f5-83ff94482056 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:08.993934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50d3a1-cf60-4b11-a8f5-83ff94482056 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:08.998527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6de2be-66c0-46a3-a91f-febe7fef6b2a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:08.999255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6de2be-66c0-46a3-a91f-febe7fef6b2a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:08.999568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6de2be-66c0-46a3-a91f-febe7fef6b2a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:08.999841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6de2be-66c0-46a3-a91f-febe7fef6b2a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects/a5680c7462944e9fa9887d076c380ec2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:09.000950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6de2be-66c0-46a3-a91f-febe7fef6b2a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:get_project(project_id=a5680c7462944e9fa9887d076c380ec2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:09.003129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6de2be-66c0-46a3-a91f-febe7fef6b2a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:09.004817 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 893/1811] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:08 2022] GET /identity/v3/projects/a5680c7462944e9fa9887d076c380ec2 => generated 373 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:09.263953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2448d-beff-4644-a795-9261168ccb8d None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:09.264766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2448d-beff-4644-a795-9261168ccb8d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:09.265317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2448d-beff-4644-a795-9261168ccb8d None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:09.267778 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 919/1812] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:09.273725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6de2be-66c0-46a3-a91f-febe7fef6b2a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:09.292127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6de2be-66c0-46a3-a91f-febe7fef6b2a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:09.302028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6de2be-66c0-46a3-a91f-febe7fef6b2a tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:09.306759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592375c-3382-485f-83c7-10e534dff394 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb0a35fa31a4e82bef6f8c9aca1acd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d4f859d03f8449492d3ffc835d19e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:09.307420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592375c-3382-485f-83c7-10e534dff394 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:09.307703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592375c-3382-485f-83c7-10e534dff394 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:09.307974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592375c-3382-485f-83c7-10e534dff394 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] PATH_INFO: `/v3/projects/a5680c7462944e9fa9887d076c380ec2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:09.309086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592375c-3382-485f-83c7-10e534dff394 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorizing `identity:get_project(project_id=a5680c7462944e9fa9887d076c380ec2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:09.311161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592375c-3382-485f-83c7-10e534dff394 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:09.312941 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 894/1813] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:09 2022] GET /identity/v3/projects/a5680c7462944e9fa9887d076c380ec2 => generated 373 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:09.687273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2448d-beff-4644-a795-9261168ccb8d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:09.689756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-84d2448d-beff-4644-a795-9261168ccb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:09.734850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592375c-3382-485f-83c7-10e534dff394 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:09.738218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8592375c-3382-485f-83c7-10e534dff394 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:09.839501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2448d-beff-4644-a795-9261168ccb8d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:09.848602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d999ec0-d4d9-4f70-9d77-e7d18f4fa831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:09.849498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d999ec0-d4d9-4f70-9d77-e7d18f4fa831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:09.849959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d999ec0-d4d9-4f70-9d77-e7d18f4fa831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:09.850407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d999ec0-d4d9-4f70-9d77-e7d18f4fa831 admin admin] PATH_INFO: `/v3/users/3ad1f48be9e94783a093c8806a39c3f0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:09.852965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d999ec0-d4d9-4f70-9d77-e7d18f4fa831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad1f48be9e94783a093c8806a39c3f0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:09.855142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d999ec0-d4d9-4f70-9d77-e7d18f4fa831 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:09.892968 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:09.920646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592375c-3382-485f-83c7-10e534dff394 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:09.927198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25ce80-6fc8-416d-93c6-75e99abaf06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:09.927843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ce80-6fc8-416d-93c6-75e99abaf06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:09.928118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ce80-6fc8-416d-93c6-75e99abaf06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:09.928388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ce80-6fc8-416d-93c6-75e99abaf06c admin admin] PATH_INFO: `/v3/users/b01de0795d2f472ab35e08f4651c19ae` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:09.929554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25ce80-6fc8-416d-93c6-75e99abaf06c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01de0795d2f472ab35e08f4651c19ae)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:09.932075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25ce80-6fc8-416d-93c6-75e99abaf06c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:09.938442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6d999ec0-d4d9-4f70-9d77-e7d18f4fa831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad1f48be9e94783a093c8806a39c3f0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:09.942501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6d999ec0-d4d9-4f70-9d77-e7d18f4fa831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad1f48be9e94783a093c8806a39c3f0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:09.956454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6d999ec0-d4d9-4f70-9d77-e7d18f4fa831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad1f48be9e94783a093c8806a39c3f0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:09.967231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6d999ec0-d4d9-4f70-9d77-e7d18f4fa831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad1f48be9e94783a093c8806a39c3f0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:09.968521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6d999ec0-d4d9-4f70-9d77-e7d18f4fa831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad1f48be9e94783a093c8806a39c3f0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:09.991676 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 920/1814] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:09 2022] DELETE /identity/v3/users/3ad1f48be9e94783a093c8806a39c3f0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:09.993623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c774b-6e34-450e-b79a-1329073de893 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:09.994340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c774b-6e34-450e-b79a-1329073de893 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:09.995050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c774b-6e34-450e-b79a-1329073de893 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:10.000623 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 921/1815] 10.222.0.39 () {54 vars in 921 bytes} [Sun Oct 16 01:01:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:10.002193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6c398-e9b8-47b2-8e63-d7615a99a5b5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:10.003318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6c398-e9b8-47b2-8e63-d7615a99a5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:10.003974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6c398-e9b8-47b2-8e63-d7615a99a5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:10.020832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb25ce80-6fc8-416d-93c6-75e99abaf06c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01de0795d2f472ab35e08f4651c19ae'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:10.021443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb25ce80-6fc8-416d-93c6-75e99abaf06c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01de0795d2f472ab35e08f4651c19ae'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:10.038857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ffc6c398-e9b8-47b2-8e63-d7615a99a5b5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:10.040393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb25ce80-6fc8-416d-93c6-75e99abaf06c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01de0795d2f472ab35e08f4651c19ae'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:10.044457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ffc6c398-e9b8-47b2-8e63-d7615a99a5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:10.053284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb25ce80-6fc8-416d-93c6-75e99abaf06c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01de0795d2f472ab35e08f4651c19ae'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:10.054818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb25ce80-6fc8-416d-93c6-75e99abaf06c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01de0795d2f472ab35e08f4651c19ae'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:10.070748 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:10.086427 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 895/1816] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:09 2022] DELETE /identity/v3/users/b01de0795d2f472ab35e08f4651c19ae => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:01:10.087993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb88cd-19c6-4117-a976-3ce9a7246948 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:10.088468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb88cd-19c6-4117-a976-3ce9a7246948 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:10.088850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb88cd-19c6-4117-a976-3ce9a7246948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:10.120684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-93eb88cd-19c6-4117-a976-3ce9a7246948 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:10.122540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-93eb88cd-19c6-4117-a976-3ce9a7246948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:10.168968 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 922/1817] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:10.170455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1022e47-3014-4895-98d3-a0f2151fbad8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:10.170874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1022e47-3014-4895-98d3-a0f2151fbad8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:10.171199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1022e47-3014-4895-98d3-a0f2151fbad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:10.202660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f1022e47-3014-4895-98d3-a0f2151fbad8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:10.205359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f1022e47-3014-4895-98d3-a0f2151fbad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:10.240395 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 896/1818] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:01:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:10.241585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb88cd-19c6-4117-a976-3ce9a7246948 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:10.243217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-93eb88cd-19c6-4117-a976-3ce9a7246948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:10.294525 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 923/1819] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:10.295507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1022e47-3014-4895-98d3-a0f2151fbad8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:10.298452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f1022e47-3014-4895-98d3-a0f2151fbad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:10.346324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb88cd-19c6-4117-a976-3ce9a7246948 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:10.352381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba51920-f747-426f-b208-334c9badfc90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:10.353141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba51920-f747-426f-b208-334c9badfc90 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:10.353516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba51920-f747-426f-b208-334c9badfc90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:10.354011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba51920-f747-426f-b208-334c9badfc90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:10.359438 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:10.368263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba51920-f747-426f-b208-334c9badfc90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:10.370960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba51920-f747-426f-b208-334c9badfc90 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:10.376123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1022e47-3014-4895-98d3-a0f2151fbad8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:10.382306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63424994-ba07-4599-915d-bdc28165d2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:10.383487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63424994-ba07-4599-915d-bdc28165d2da service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:10.383949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63424994-ba07-4599-915d-bdc28165d2da service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:10.384371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63424994-ba07-4599-915d-bdc28165d2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:10.389382 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 897/1820] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:10.390684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba51920-f747-426f-b208-334c9badfc90 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:10.392688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aba51920-f747-426f-b208-334c9badfc90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:10.406678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba51920-f747-426f-b208-334c9badfc90 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:10.408097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63424994-ba07-4599-915d-bdc28165d2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:10.411656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63424994-ba07-4599-915d-bdc28165d2da service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:10.412227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa2fc0-4000-46cc-a900-ddc68def1d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:10.413043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa2fc0-4000-46cc-a900-ddc68def1d91 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:10.413395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa2fc0-4000-46cc-a900-ddc68def1d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:10.413750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa2fc0-4000-46cc-a900-ddc68def1d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:10.428730 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 924/1821] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:10.440459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa2fc0-4000-46cc-a900-ddc68def1d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:10.442515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa2fc0-4000-46cc-a900-ddc68def1d91 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:10.457718 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 898/1822] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:10.471086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf7e83-d6aa-44a4-8f42-333d61e77d9a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:10.472571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf7e83-d6aa-44a4-8f42-333d61e77d9a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:10.473034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf7e83-d6aa-44a4-8f42-333d61e77d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:10.500877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b2bf7e83-d6aa-44a4-8f42-333d61e77d9a None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:10.502343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b2bf7e83-d6aa-44a4-8f42-333d61e77d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:10.511684 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 925/1823] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:01:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:10.542485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa2fc0-4000-46cc-a900-ddc68def1d91 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:10.554115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa2fc0-4000-46cc-a900-ddc68def1d91 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:10.565414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967e9f2-6a14-40b3-bb47-d285f0dc1c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:10.566533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967e9f2-6a14-40b3-bb47-d285f0dc1c28 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:10.566533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967e9f2-6a14-40b3-bb47-d285f0dc1c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:10.566827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967e9f2-6a14-40b3-bb47-d285f0dc1c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:10.577139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967e9f2-6a14-40b3-bb47-d285f0dc1c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:10.578724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967e9f2-6a14-40b3-bb47-d285f0dc1c28 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:10.594041 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 899/1824] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:11.441969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf7e83-d6aa-44a4-8f42-333d61e77d9a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:11.443462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b2bf7e83-d6aa-44a4-8f42-333d61e77d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:11.475468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf7e83-d6aa-44a4-8f42-333d61e77d9a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:11.486249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:11.487975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:11.488400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:11.488684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] PATH_INFO: `/v3/projects/a5680c7462944e9fa9887d076c380ec2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:11.490556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5680c7462944e9fa9887d076c380ec2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:11.492558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:11.576779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5680c7462944e9fa9887d076c380ec2', 'request_id': 'req-4095d710-047b-4e53-b218-748a1807af3d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:11.586711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5680c7462944e9fa9887d076c380ec2', 'request_id': 'req-4095d710-047b-4e53-b218-748a1807af3d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:11.598996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5680c7462944e9fa9887d076c380ec2', 'request_id': 'req-4095d710-047b-4e53-b218-748a1807af3d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:11.613436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] The token cache is being invalidate because project a5680c7462944e9fa9887d076c380ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:11.614338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:11.618312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:11.624284 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 926/1825] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:11 2022] DELETE /identity/v3/projects/a5680c7462944e9fa9887d076c380ec2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:11.624886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967e9f2-6a14-40b3-bb47-d285f0dc1c28 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:11.640184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967e9f2-6a14-40b3-bb47-d285f0dc1c28 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:11.672749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:11.675395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:11.835999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095d710-047b-4e53-b218-748a1807af3d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:11.849939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:11.850606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:11.850890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:11.851237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] PATH_INFO: `/v3/projects/4e9880e0613c4f87a00daf04c040edb0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:11.854129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9880e0613c4f87a00daf04c040edb0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:11.858274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:11.868508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:11.869266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:11.869781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:11.878839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] PATH_INFO: `/v3/users/0fb0a35fa31a4e82bef6f8c9aca1acd6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:11.889502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb0a35fa31a4e82bef6f8c9aca1acd6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:11.907952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:11.926787 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:11.992761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9880e0613c4f87a00daf04c040edb0', 'request_id': 'req-999b2891-e37b-47c5-b840-3a4b8bc56acf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.010643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9880e0613c4f87a00daf04c040edb0', 'request_id': 'req-999b2891-e37b-47c5-b840-3a4b8bc56acf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.028045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9880e0613c4f87a00daf04c040edb0', 'request_id': 'req-999b2891-e37b-47c5-b840-3a4b8bc56acf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.036352 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:12.041287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb0a35fa31a4e82bef6f8c9aca1acd6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.042949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb0a35fa31a4e82bef6f8c9aca1acd6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.052396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] The token cache is being invalidate because project 4e9880e0613c4f87a00daf04c040edb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:12.053313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.054467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.056627 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 927/1826] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:11 2022] DELETE /identity/v3/projects/4e9880e0613c4f87a00daf04c040edb0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:01:12.060455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:12.064889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:12.072332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb0a35fa31a4e82bef6f8c9aca1acd6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.093666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb0a35fa31a4e82bef6f8c9aca1acd6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.095364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb0a35fa31a4e82bef6f8c9aca1acd6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.118613 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 900/1827] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:11 2022] DELETE /identity/v3/users/0fb0a35fa31a4e82bef6f8c9aca1acd6 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:12.163792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b2891-e37b-47c5-b840-3a4b8bc56acf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:12.273119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546b525-1733-4f1f-b5c7-6c964f199253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:12.273975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546b525-1733-4f1f-b5c7-6c964f199253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:12.274312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546b525-1733-4f1f-b5c7-6c964f199253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:12.274581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546b525-1733-4f1f-b5c7-6c964f199253 admin admin] PATH_INFO: `/v3/users/74d6cb950d4e4bf0ae32a4be90617aaf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:12.276059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546b525-1733-4f1f-b5c7-6c964f199253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d6cb950d4e4bf0ae32a4be90617aaf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:12.278138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546b525-1733-4f1f-b5c7-6c964f199253 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:12.337174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1546b525-1733-4f1f-b5c7-6c964f199253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d6cb950d4e4bf0ae32a4be90617aaf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.338112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1546b525-1733-4f1f-b5c7-6c964f199253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d6cb950d4e4bf0ae32a4be90617aaf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.374889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1546b525-1733-4f1f-b5c7-6c964f199253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d6cb950d4e4bf0ae32a4be90617aaf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.396671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1546b525-1733-4f1f-b5c7-6c964f199253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d6cb950d4e4bf0ae32a4be90617aaf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.397502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1546b525-1733-4f1f-b5c7-6c964f199253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d6cb950d4e4bf0ae32a4be90617aaf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.417268 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 928/1828] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:12 2022] DELETE /identity/v3/users/74d6cb950d4e4bf0ae32a4be90617aaf => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:01:12.516004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:12.518128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:12.536732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db256aab-b0a3-4231-b536-15fe38bba08b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:12.648056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:12.648840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:12.649199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:12.649542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] PATH_INFO: `/v3/users/83743824a8004cec9913f112e21f319e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:12.650963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] RBAC: Authorizing `identity:delete_user(user_id=83743824a8004cec9913f112e21f319e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:12.654398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:12.759837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83743824a8004cec9913f112e21f319e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.760712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83743824a8004cec9913f112e21f319e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.801709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83743824a8004cec9913f112e21f319e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.811457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83743824a8004cec9913f112e21f319e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.813146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83743824a8004cec9913f112e21f319e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:12.832254 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 901/1829] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:12 2022] DELETE /identity/v3/users/83743824a8004cec9913f112e21f319e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:12.836765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9331-a6d7-4b0c-ab3d-b6ce794c1695 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:12.837246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9331-a6d7-4b0c-ab3d-b6ce794c1695 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:12.837506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9331-a6d7-4b0c-ab3d-b6ce794c1695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:12.839694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:12.842339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:12.850331 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:12.885670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-79be9331-a6d7-4b0c-ab3d-b6ce794c1695 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:12.901048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79be9331-a6d7-4b0c-ab3d-b6ce794c1695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:12.930961 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:13.015416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9e987-8dd5-4b83-be2b-a940a158a88d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:13.023686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:13.024451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:13.024733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:13.025244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] PATH_INFO: `/v3/projects/937e361ce901423a958ae619d74c6369` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:13.026989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=937e361ce901423a958ae619d74c6369)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:13.028578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:13.032481 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 929/1830] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:13.082340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be9331-a6d7-4b0c-ab3d-b6ce794c1695 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:13.083820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79be9331-a6d7-4b0c-ab3d-b6ce794c1695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:13.129323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937e361ce901423a958ae619d74c6369', 'request_id': 'req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:13.142817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937e361ce901423a958ae619d74c6369', 'request_id': 'req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:13.177251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937e361ce901423a958ae619d74c6369', 'request_id': 'req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:13.192313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] The token cache is being invalidate because project 937e361ce901423a958ae619d74c6369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:13.192959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:13.194042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:13.197054 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 902/1831] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:12 2022] DELETE /identity/v3/projects/937e361ce901423a958ae619d74c6369 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:13.198209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:13.201931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:13.237039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be9331-a6d7-4b0c-ab3d-b6ce794c1695 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:13.322495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d36de-32c4-42d6-9d55-f1bd770d1a0c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:13.335625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa739076-7a8c-4a66-b8ad-5af769fe6da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:13.336847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa739076-7a8c-4a66-b8ad-5af769fe6da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:13.337143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa739076-7a8c-4a66-b8ad-5af769fe6da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:13.337875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa739076-7a8c-4a66-b8ad-5af769fe6da6 admin admin] PATH_INFO: `/v3/projects/7d4f859d03f8449492d3ffc835d19e0b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:13.339331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa739076-7a8c-4a66-b8ad-5af769fe6da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d4f859d03f8449492d3ffc835d19e0b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:13.347393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf3952-63b6-4f5f-bda7-efddc29e50a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:13.347597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa739076-7a8c-4a66-b8ad-5af769fe6da6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:13.348012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf3952-63b6-4f5f-bda7-efddc29e50a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:13.348290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf3952-63b6-4f5f-bda7-efddc29e50a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:13.349151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf3952-63b6-4f5f-bda7-efddc29e50a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:13.353697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c1cf3952-63b6-4f5f-bda7-efddc29e50a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:13.384878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf3952-63b6-4f5f-bda7-efddc29e50a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:13.386511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf3952-63b6-4f5f-bda7-efddc29e50a0 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:13.399168 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 930/1832] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:01:13.400672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944d1cd-b9c5-465b-9bfc-78d0fe7f1f85 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:13.401106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944d1cd-b9c5-465b-9bfc-78d0fe7f1f85 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:13.401520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944d1cd-b9c5-465b-9bfc-78d0fe7f1f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:13.409771 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:13.430156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa739076-7a8c-4a66-b8ad-5af769fe6da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4f859d03f8449492d3ffc835d19e0b', 'request_id': 'req-fa739076-7a8c-4a66-b8ad-5af769fe6da6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:13.440650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa739076-7a8c-4a66-b8ad-5af769fe6da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4f859d03f8449492d3ffc835d19e0b', 'request_id': 'req-fa739076-7a8c-4a66-b8ad-5af769fe6da6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:13.446454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8944d1cd-b9c5-465b-9bfc-78d0fe7f1f85 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:13.450063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8944d1cd-b9c5-465b-9bfc-78d0fe7f1f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:13.451798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa739076-7a8c-4a66-b8ad-5af769fe6da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4f859d03f8449492d3ffc835d19e0b', 'request_id': 'req-fa739076-7a8c-4a66-b8ad-5af769fe6da6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:13.482465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa739076-7a8c-4a66-b8ad-5af769fe6da6 admin admin] The token cache is being invalidate because project 7d4f859d03f8449492d3ffc835d19e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:13.482818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa739076-7a8c-4a66-b8ad-5af769fe6da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:13.484426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa739076-7a8c-4a66-b8ad-5af769fe6da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:13.493869 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 903/1833] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:13 2022] DELETE /identity/v3/projects/7d4f859d03f8449492d3ffc835d19e0b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:13.495815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fbe03-39f2-48ca-b1ad-22629953aefe None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:13.496110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fbe03-39f2-48ca-b1ad-22629953aefe None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:13.496378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fbe03-39f2-48ca-b1ad-22629953aefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:13.542114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ef6fbe03-39f2-48ca-b1ad-22629953aefe None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:13.568809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef6fbe03-39f2-48ca-b1ad-22629953aefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:13.594931 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 931/1834] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:13.607135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f10f7-d5df-42eb-8399-aca136d87b7e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:13.607446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f10f7-d5df-42eb-8399-aca136d87b7e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:13.607725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f10f7-d5df-42eb-8399-aca136d87b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:13.667575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-515f10f7-d5df-42eb-8399-aca136d87b7e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:13.668809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-515f10f7-d5df-42eb-8399-aca136d87b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:13.710320 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 932/1835] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:01:13.713036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f10f7-d5df-42eb-8399-aca136d87b7e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:13.728171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f10f7-d5df-42eb-8399-aca136d87b7e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:13.734901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a899c-efe9-4747-b2e1-4c5d6ec39164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:13.743009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a899c-efe9-4747-b2e1-4c5d6ec39164 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:13.743211 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 904/1836] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:13.743645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a899c-efe9-4747-b2e1-4c5d6ec39164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:13.743645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a899c-efe9-4747-b2e1-4c5d6ec39164 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:13.743645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a899c-efe9-4747-b2e1-4c5d6ec39164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:13.743645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a899c-efe9-4747-b2e1-4c5d6ec39164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:13.743645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a899c-efe9-4747-b2e1-4c5d6ec39164 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:13.750954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fd077-c40d-4e02-8a12-6bc63a9d98cc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:13.751237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fd077-c40d-4e02-8a12-6bc63a9d98cc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:13.751538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fd077-c40d-4e02-8a12-6bc63a9d98cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:13.753152 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:13.763161 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 933/1837] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:13.768702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a899c-efe9-4747-b2e1-4c5d6ec39164 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:13.785168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a899c-efe9-4747-b2e1-4c5d6ec39164 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:13.792299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44209df-ddb0-4b82-9cd8-3ae52345269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:13.792720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ae7fd077-c40d-4e02-8a12-6bc63a9d98cc None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:13.793401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44209df-ddb0-4b82-9cd8-3ae52345269e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:13.793960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44209df-ddb0-4b82-9cd8-3ae52345269e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:13.794405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44209df-ddb0-4b82-9cd8-3ae52345269e admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:13.794953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ae7fd077-c40d-4e02-8a12-6bc63a9d98cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:13.795506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44209df-ddb0-4b82-9cd8-3ae52345269e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:13.800125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44209df-ddb0-4b82-9cd8-3ae52345269e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:13.807226 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 905/1838] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:13.813804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fd077-c40d-4e02-8a12-6bc63a9d98cc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:13.827308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fd077-c40d-4e02-8a12-6bc63a9d98cc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:13.837613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eacb5-6e1c-4b81-b4c6-20074fd56fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:13.840041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eacb5-6e1c-4b81-b4c6-20074fd56fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:13.840419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eacb5-6e1c-4b81-b4c6-20074fd56fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:13.840923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eacb5-6e1c-4b81-b4c6-20074fd56fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:13.846123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eacb5-6e1c-4b81-b4c6-20074fd56fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:13.846821 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 934/1839] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:13 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:13.847913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eacb5-6e1c-4b81-b4c6-20074fd56fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:13.847913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eacb5-6e1c-4b81-b4c6-20074fd56fd1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:13.848506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44209df-ddb0-4b82-9cd8-3ae52345269e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:13.866180 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 906/1840] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:01:13.866180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eacb5-6e1c-4b81-b4c6-20074fd56fd1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:13.868511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d92eacb5-6e1c-4b81-b4c6-20074fd56fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:13.884743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eacb5-6e1c-4b81-b4c6-20074fd56fd1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:13.959529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44209df-ddb0-4b82-9cd8-3ae52345269e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:13.965226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df6e8a-a6d8-47c1-ba13-dbbb804b9854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:13.965836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df6e8a-a6d8-47c1-ba13-dbbb804b9854 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:13.966353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df6e8a-a6d8-47c1-ba13-dbbb804b9854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:13.966353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df6e8a-a6d8-47c1-ba13-dbbb804b9854 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:13.967038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df6e8a-a6d8-47c1-ba13-dbbb804b9854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:13.968948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df6e8a-a6d8-47c1-ba13-dbbb804b9854 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:14.010783 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 935/1841] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:13 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:14.010783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df6e8a-a6d8-47c1-ba13-dbbb804b9854 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:14.040172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df6e8a-a6d8-47c1-ba13-dbbb804b9854 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:14.047176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fd8fd-956e-499d-b557-52fa6901184c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:14.048613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd8fd-956e-499d-b557-52fa6901184c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.049028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd8fd-956e-499d-b557-52fa6901184c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.049383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd8fd-956e-499d-b557-52fa6901184c admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.050694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fd8fd-956e-499d-b557-52fa6901184c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:14.059843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fd8fd-956e-499d-b557-52fa6901184c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:14.084997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:14.086065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.086523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.087262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] PATH_INFO: `/v3/projects/9500f36a03e342caa2c0073b801da342` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.091610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9500f36a03e342caa2c0073b801da342)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:14.097901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:14.105485 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 936/1842] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:14 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:14.105485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fd8fd-956e-499d-b557-52fa6901184c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:14.173144 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:14.179081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9500f36a03e342caa2c0073b801da342', 'request_id': 'req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.185793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fd8fd-956e-499d-b557-52fa6901184c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:14.187055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9500f36a03e342caa2c0073b801da342', 'request_id': 'req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.195471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9500f36a03e342caa2c0073b801da342', 'request_id': 'req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.210879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] The token cache is being invalidate because project 9500f36a03e342caa2c0073b801da342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:14.211324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.212002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.213690 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 907/1843] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:13 2022] DELETE /identity/v3/projects/9500f36a03e342caa2c0073b801da342 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:01:14.214423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:14.215755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:14.247575 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:14.260847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3db937-6d12-451e-904c-ab504cd941fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:14.261609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3db937-6d12-451e-904c-ab504cd941fe admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.262608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3db937-6d12-451e-904c-ab504cd941fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.263104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3db937-6d12-451e-904c-ab504cd941fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.264282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3db937-6d12-451e-904c-ab504cd941fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:14.267144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3db937-6d12-451e-904c-ab504cd941fe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:14.285813 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 937/1844] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:14.285813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3db937-6d12-451e-904c-ab504cd941fe admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:14.287565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2f3db937-6d12-451e-904c-ab504cd941fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:14.296918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c4f1b-e2c9-43bc-99b4-d303d286f8c3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:14.303776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c076dae-0368-4600-8dc9-2ae66000fc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:14.304780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c076dae-0368-4600-8dc9-2ae66000fc88 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.305139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c076dae-0368-4600-8dc9-2ae66000fc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.305486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c076dae-0368-4600-8dc9-2ae66000fc88 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.306270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c076dae-0368-4600-8dc9-2ae66000fc88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:14.308488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c076dae-0368-4600-8dc9-2ae66000fc88 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:14.308883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3db937-6d12-451e-904c-ab504cd941fe admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:14.316718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:14.317489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.318179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.318527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] PATH_INFO: `/v3/users/e31600965ff24cba9fc99222e70732b7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.324248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31600965ff24cba9fc99222e70732b7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:14.327111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:14.352771 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 908/1845] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:14 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:14.352771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c076dae-0368-4600-8dc9-2ae66000fc88 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:14.354577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0c076dae-0368-4600-8dc9-2ae66000fc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:14.376297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c076dae-0368-4600-8dc9-2ae66000fc88 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:14.383112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5011a-ec26-46d4-bff7-81dea310ba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:14.384413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5011a-ec26-46d4-bff7-81dea310ba78 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.384724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5011a-ec26-46d4-bff7-81dea310ba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.385078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5011a-ec26-46d4-bff7-81dea310ba78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.385851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5011a-ec26-46d4-bff7-81dea310ba78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:14.387769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5011a-ec26-46d4-bff7-81dea310ba78 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:14.409694 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 909/1846] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:14.410590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5011a-ec26-46d4-bff7-81dea310ba78 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:14.426567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31600965ff24cba9fc99222e70732b7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.427466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31600965ff24cba9fc99222e70732b7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.436297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5011a-ec26-46d4-bff7-81dea310ba78 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:14.442633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f359b15-b0a6-415e-88dc-55a619f8cf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:14.443355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f359b15-b0a6-415e-88dc-55a619f8cf91 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.443642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f359b15-b0a6-415e-88dc-55a619f8cf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.443968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f359b15-b0a6-415e-88dc-55a619f8cf91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.444629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f359b15-b0a6-415e-88dc-55a619f8cf91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:14.446235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31600965ff24cba9fc99222e70732b7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.453088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f359b15-b0a6-415e-88dc-55a619f8cf91 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:14.459210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31600965ff24cba9fc99222e70732b7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.460045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31600965ff24cba9fc99222e70732b7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.471791 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 910/1847] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:14.471791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f359b15-b0a6-415e-88dc-55a619f8cf91 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:14.471791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6f359b15-b0a6-415e-88dc-55a619f8cf91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:14.482394 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 938/1848] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:14 2022] DELETE /identity/v3/users/e31600965ff24cba9fc99222e70732b7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:14.483425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:14.485713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f359b15-b0a6-415e-88dc-55a619f8cf91 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:14.486076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:14.554470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073592e-9402-4198-b633-390ae2d9eec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:14.555335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073592e-9402-4198-b633-390ae2d9eec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.556066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073592e-9402-4198-b633-390ae2d9eec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.556190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073592e-9402-4198-b633-390ae2d9eec4 admin admin] PATH_INFO: `/v3/projects/9f3af436ad7547f9ad68f3a51df88640/users/04190f3cb2af4b22bebc3bf193af5b66/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.588680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073592e-9402-4198-b633-390ae2d9eec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3af436ad7547f9ad68f3a51df88640, user_id=04190f3cb2af4b22bebc3bf193af5b66, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:14.589404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9171b-05ca-4929-9d7d-b5dfa5dd595e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:14.593511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073592e-9402-4198-b633-390ae2d9eec4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:14.594867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36748cb8-e433-4211-898d-5c926970c6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:14.595663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36748cb8-e433-4211-898d-5c926970c6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.596845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36748cb8-e433-4211-898d-5c926970c6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.597306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36748cb8-e433-4211-898d-5c926970c6ff admin admin] PATH_INFO: `/v3/users/782a58482ac54dfbbae0e71cd1c76b7a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.599046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36748cb8-e433-4211-898d-5c926970c6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=782a58482ac54dfbbae0e71cd1c76b7a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:14.601573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36748cb8-e433-4211-898d-5c926970c6ff admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:14.611840 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 911/1849] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:14 2022] PUT /identity/v3/projects/9f3af436ad7547f9ad68f3a51df88640/users/04190f3cb2af4b22bebc3bf193af5b66/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:14.613484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073592e-9402-4198-b633-390ae2d9eec4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:14.615370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d073592e-9402-4198-b633-390ae2d9eec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:14.656244 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:14.696887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36748cb8-e433-4211-898d-5c926970c6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782a58482ac54dfbbae0e71cd1c76b7a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.698348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36748cb8-e433-4211-898d-5c926970c6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782a58482ac54dfbbae0e71cd1c76b7a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.711682 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:14.713179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36748cb8-e433-4211-898d-5c926970c6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782a58482ac54dfbbae0e71cd1c76b7a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.727064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073592e-9402-4198-b633-390ae2d9eec4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:14.728232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36748cb8-e433-4211-898d-5c926970c6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782a58482ac54dfbbae0e71cd1c76b7a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.728924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36748cb8-e433-4211-898d-5c926970c6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782a58482ac54dfbbae0e71cd1c76b7a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.732470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16546d7-6e15-43f2-8d5d-3acfac6c35e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:14.733377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16546d7-6e15-43f2-8d5d-3acfac6c35e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.733731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16546d7-6e15-43f2-8d5d-3acfac6c35e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.734613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16546d7-6e15-43f2-8d5d-3acfac6c35e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.735357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16546d7-6e15-43f2-8d5d-3acfac6c35e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:14.737119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16546d7-6e15-43f2-8d5d-3acfac6c35e9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:14.743197 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 939/1850] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:14 2022] DELETE /identity/v3/users/782a58482ac54dfbbae0e71cd1c76b7a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:14.744537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506f6bc-4e6a-4245-960f-f359c3ae127f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.744892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506f6bc-4e6a-4245-960f-f359c3ae127f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.745231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506f6bc-4e6a-4245-960f-f359c3ae127f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.752276 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 912/1851] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:14.756743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7107df-7912-467f-be79-713ca4edb931 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.757022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7107df-7912-467f-be79-713ca4edb931 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.757292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7107df-7912-467f-be79-713ca4edb931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.783500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ba7107df-7912-467f-be79-713ca4edb931 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:14.785724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba7107df-7912-467f-be79-713ca4edb931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:14.789705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d506f6bc-4e6a-4245-960f-f359c3ae127f None None] MFA Rules not processed for user `04190f3cb2af4b22bebc3bf193af5b66`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:14.791190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d506f6bc-4e6a-4245-960f-f359c3ae127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:14.878255 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 913/1852] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:14.879545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7107df-7912-467f-be79-713ca4edb931 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:14.881030 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 940/1853] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:14.881474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba7107df-7912-467f-be79-713ca4edb931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:14.882450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506f6bc-4e6a-4245-960f-f359c3ae127f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:14.883962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d506f6bc-4e6a-4245-960f-f359c3ae127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:14.901019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506f6bc-4e6a-4245-960f-f359c3ae127f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:14.904777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7107df-7912-467f-be79-713ca4edb931 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:14.906951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:14.907736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.908091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.908368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] PATH_INFO: `/v3/projects/eeb96a4bbe3e40c3b5313c333184ac58` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.910336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb96a4bbe3e40c3b5313c333184ac58)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:14.912510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:14.912859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5b713-096c-4c72-b097-ba6d23ebbef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:14.913582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5b713-096c-4c72-b097-ba6d23ebbef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.914310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5b713-096c-4c72-b097-ba6d23ebbef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.914966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5b713-096c-4c72-b097-ba6d23ebbef3 admin admin] PATH_INFO: `/v3/projects/5267a09ec9a540a7a0400700f8bceb80/users/dd6cb0f17cf24e8cac44ff9ec732146a/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.935526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5b713-096c-4c72-b097-ba6d23ebbef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5267a09ec9a540a7a0400700f8bceb80, user_id=dd6cb0f17cf24e8cac44ff9ec732146a, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:14.938366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5b713-096c-4c72-b097-ba6d23ebbef3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:14.953901 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 914/1854] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:14 2022] PUT /identity/v3/projects/5267a09ec9a540a7a0400700f8bceb80/users/dd6cb0f17cf24e8cac44ff9ec732146a/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:14.954726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5b713-096c-4c72-b097-ba6d23ebbef3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:14.956512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-feb5b713-096c-4c72-b097-ba6d23ebbef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:14.968147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb96a4bbe3e40c3b5313c333184ac58', 'request_id': 'req-8e1924c6-8187-446c-b85e-3b78109ddcd6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.975778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb96a4bbe3e40c3b5313c333184ac58', 'request_id': 'req-8e1924c6-8187-446c-b85e-3b78109ddcd6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.984471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb96a4bbe3e40c3b5313c333184ac58', 'request_id': 'req-8e1924c6-8187-446c-b85e-3b78109ddcd6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.997137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] The token cache is being invalidate because project eeb96a4bbe3e40c3b5313c333184ac58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:14.997429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.998092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:14.999658 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 941/1855] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:14 2022] DELETE /identity/v3/projects/eeb96a4bbe3e40c3b5313c333184ac58 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:15.004068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.004068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:15.030209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5b713-096c-4c72-b097-ba6d23ebbef3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.079394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1924c6-8187-446c-b85e-3b78109ddcd6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.083307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31715a-409c-4583-9071-18cb266b2399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.083927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31715a-409c-4583-9071-18cb266b2399 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.084204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31715a-409c-4583-9071-18cb266b2399 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.084477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31715a-409c-4583-9071-18cb266b2399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.086485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ed31715a-409c-4583-9071-18cb266b2399 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:15.086958 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:15.097232 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:15.110815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d037fb7-688f-414f-b19a-841cdae62517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.111620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037fb7-688f-414f-b19a-841cdae62517 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.112724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037fb7-688f-414f-b19a-841cdae62517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.112724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037fb7-688f-414f-b19a-841cdae62517 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.113461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d037fb7-688f-414f-b19a-841cdae62517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.115473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d037fb7-688f-414f-b19a-841cdae62517 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.154534 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 915/1856] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:14 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:15.156015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f6844-4195-48b7-9fbd-a123f5b516ab None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.156305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f6844-4195-48b7-9fbd-a123f5b516ab None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.156613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f6844-4195-48b7-9fbd-a123f5b516ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.166581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31715a-409c-4583-9071-18cb266b2399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.168684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31715a-409c-4583-9071-18cb266b2399 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.181695 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 942/1857] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:15.183227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407243-22c9-41bc-a1e1-4356d2d2a480 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.183513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407243-22c9-41bc-a1e1-4356d2d2a480 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.183785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407243-22c9-41bc-a1e1-4356d2d2a480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.188700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-978f6844-4195-48b7-9fbd-a123f5b516ab None None] MFA Rules not processed for user `dd6cb0f17cf24e8cac44ff9ec732146a`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:15.189847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-978f6844-4195-48b7-9fbd-a123f5b516ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:15.206757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-22407243-22c9-41bc-a1e1-4356d2d2a480 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:15.208140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22407243-22c9-41bc-a1e1-4356d2d2a480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:15.273272 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 916/1858] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:15.274228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f6844-4195-48b7-9fbd-a123f5b516ab None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.275615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-978f6844-4195-48b7-9fbd-a123f5b516ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:15.281415 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 943/1859] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:15.282731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22407243-22c9-41bc-a1e1-4356d2d2a480 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.291030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22407243-22c9-41bc-a1e1-4356d2d2a480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:15.294079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f6844-4195-48b7-9fbd-a123f5b516ab None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.298818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902514ba-832e-409c-9c0e-db1102228bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.299649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902514ba-832e-409c-9c0e-db1102228bbf admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.299962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902514ba-832e-409c-9c0e-db1102228bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.301024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902514ba-832e-409c-9c0e-db1102228bbf admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.302275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902514ba-832e-409c-9c0e-db1102228bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.304250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902514ba-832e-409c-9c0e-db1102228bbf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.305707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22407243-22c9-41bc-a1e1-4356d2d2a480 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.312446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930428f-e0ca-4cc5-93f3-ad4154559a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.312864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930428f-e0ca-4cc5-93f3-ad4154559a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.313164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930428f-e0ca-4cc5-93f3-ad4154559a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.313444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930428f-e0ca-4cc5-93f3-ad4154559a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.314180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930428f-e0ca-4cc5-93f3-ad4154559a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.317450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930428f-e0ca-4cc5-93f3-ad4154559a1f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.333981 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 917/1860] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:15 2022] POST /identity/v3/users => generated 298 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:15.335862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d5339-97f8-4fc2-ae20-009168614317 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.336381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d5339-97f8-4fc2-ae20-009168614317 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.336835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d5339-97f8-4fc2-ae20-009168614317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.363507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-677d5339-97f8-4fc2-ae20-009168614317 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:15.364751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-677d5339-97f8-4fc2-ae20-009168614317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:15.367704 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 944/1861] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:15 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:15.368712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930428f-e0ca-4cc5-93f3-ad4154559a1f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.470455 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 918/1862] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:15.471018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930428f-e0ca-4cc5-93f3-ad4154559a1f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.475669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d5339-97f8-4fc2-ae20-009168614317 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.478010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97faf03-bfec-40c0-b2e0-bdf678b2cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.478692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97faf03-bfec-40c0-b2e0-bdf678b2cf77 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.479004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97faf03-bfec-40c0-b2e0-bdf678b2cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.479280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97faf03-bfec-40c0-b2e0-bdf678b2cf77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.479960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97faf03-bfec-40c0-b2e0-bdf678b2cf77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.481966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97faf03-bfec-40c0-b2e0-bdf678b2cf77 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.493721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d5339-97f8-4fc2-ae20-009168614317 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.504501 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 945/1863] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:15.504501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97faf03-bfec-40c0-b2e0-bdf678b2cf77 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.505512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e85349-4395-473d-a2aa-4ab111e9310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.506466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e85349-4395-473d-a2aa-4ab111e9310b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.507125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e85349-4395-473d-a2aa-4ab111e9310b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.507597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e85349-4395-473d-a2aa-4ab111e9310b admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.508557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e85349-4395-473d-a2aa-4ab111e9310b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.511756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e85349-4395-473d-a2aa-4ab111e9310b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.514386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97faf03-bfec-40c0-b2e0-bdf678b2cf77 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.519472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94138ed0-859a-420b-b91e-5001824d4398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.520131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94138ed0-859a-420b-b91e-5001824d4398 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.520416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94138ed0-859a-420b-b91e-5001824d4398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.520691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94138ed0-859a-420b-b91e-5001824d4398 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.521346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94138ed0-859a-420b-b91e-5001824d4398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:15.521653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94138ed0-859a-420b-b91e-5001824d4398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.523369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94138ed0-859a-420b-b91e-5001824d4398 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.541424 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 946/1864] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:15.542334 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 919/1865] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:15 2022] POST /identity/v3/users => generated 297 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:15.543424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94138ed0-859a-420b-b91e-5001824d4398 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.547200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e85349-4395-473d-a2aa-4ab111e9310b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.554720 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:15.560872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94138ed0-859a-420b-b91e-5001824d4398 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.563918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14eba9-e94c-4983-8b04-014b244db4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.564642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14eba9-e94c-4983-8b04-014b244db4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.566503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14eba9-e94c-4983-8b04-014b244db4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.566765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14eba9-e94c-4983-8b04-014b244db4e9 admin admin] PATH_INFO: `/v3/projects/63fb535d9e7b47268fcc0509ea68e32c/users/5813a6013aa04c57bc71c2ba65c363c2/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.568641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e85349-4395-473d-a2aa-4ab111e9310b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.573939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5a05d-6212-4698-b6c4-31aca236e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.574793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5a05d-6212-4698-b6c4-31aca236e7cc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.575112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5a05d-6212-4698-b6c4-31aca236e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.575411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5a05d-6212-4698-b6c4-31aca236e7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.576502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5a05d-6212-4698-b6c4-31aca236e7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.578574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5a05d-6212-4698-b6c4-31aca236e7cc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.587849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14eba9-e94c-4983-8b04-014b244db4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fb535d9e7b47268fcc0509ea68e32c, user_id=5813a6013aa04c57bc71c2ba65c363c2, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.590906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14eba9-e94c-4983-8b04-014b244db4e9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.597004 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 920/1866] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:01:15.597004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5a05d-6212-4698-b6c4-31aca236e7cc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.609659 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 947/1867] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:15 2022] PUT /identity/v3/projects/63fb535d9e7b47268fcc0509ea68e32c/users/5813a6013aa04c57bc71c2ba65c363c2/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:15.611198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14eba9-e94c-4983-8b04-014b244db4e9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.611286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5a05d-6212-4698-b6c4-31aca236e7cc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.623186 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:15.689558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c38795-ff4c-4385-844a-f655d9fa989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.690990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c38795-ff4c-4385-844a-f655d9fa989e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.691470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c38795-ff4c-4385-844a-f655d9fa989e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.691919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c38795-ff4c-4385-844a-f655d9fa989e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.693011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c38795-ff4c-4385-844a-f655d9fa989e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.695895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c38795-ff4c-4385-844a-f655d9fa989e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.719877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14eba9-e94c-4983-8b04-014b244db4e9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.726548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de76ab8-5b54-42a9-8c70-c0ca0bc67065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.727214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de76ab8-5b54-42a9-8c70-c0ca0bc67065 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.727526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de76ab8-5b54-42a9-8c70-c0ca0bc67065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.727791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de76ab8-5b54-42a9-8c70-c0ca0bc67065 admin admin] PATH_INFO: `/v3/projects/28bc2644be594aa08a5bbb29507b196c/users/e9ba2cd18e3642f19918ecce32965fb1/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.729778 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 921/1868] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:15 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:15.734966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c38795-ff4c-4385-844a-f655d9fa989e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.748206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de76ab8-5b54-42a9-8c70-c0ca0bc67065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28bc2644be594aa08a5bbb29507b196c, user_id=e9ba2cd18e3642f19918ecce32965fb1, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.751128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de76ab8-5b54-42a9-8c70-c0ca0bc67065 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.767772 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 948/1869] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:15 2022] PUT /identity/v3/projects/28bc2644be594aa08a5bbb29507b196c/users/e9ba2cd18e3642f19918ecce32965fb1/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:15.769996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de76ab8-5b54-42a9-8c70-c0ca0bc67065 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.808605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c38795-ff4c-4385-844a-f655d9fa989e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.841717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de76ab8-5b54-42a9-8c70-c0ca0bc67065 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.846620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d400e3f-6a7b-407c-8ede-1fed6d573132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.847275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d400e3f-6a7b-407c-8ede-1fed6d573132 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.847561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d400e3f-6a7b-407c-8ede-1fed6d573132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.847835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d400e3f-6a7b-407c-8ede-1fed6d573132 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.848469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d400e3f-6a7b-407c-8ede-1fed6d573132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.850393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d400e3f-6a7b-407c-8ede-1fed6d573132 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.875490 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 949/1870] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:15 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:15.876529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d400e3f-6a7b-407c-8ede-1fed6d573132 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.878676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ebe92-852a-40ea-bb5e-664e0a6fe904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.879472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ebe92-852a-40ea-bb5e-664e0a6fe904 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.879824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ebe92-852a-40ea-bb5e-664e0a6fe904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.880164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ebe92-852a-40ea-bb5e-664e0a6fe904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.880927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ebe92-852a-40ea-bb5e-664e0a6fe904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.882723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ebe92-852a-40ea-bb5e-664e0a6fe904 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.889668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d400e3f-6a7b-407c-8ede-1fed6d573132 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.898666 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 922/1871] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:15.898845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559dd7e-874e-495b-9012-23f71eb2e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.899155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ebe92-852a-40ea-bb5e-664e0a6fe904 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.899275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559dd7e-874e-495b-9012-23f71eb2e7fd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.899275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559dd7e-874e-495b-9012-23f71eb2e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.899275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559dd7e-874e-495b-9012-23f71eb2e7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.899275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559dd7e-874e-495b-9012-23f71eb2e7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.900722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559dd7e-874e-495b-9012-23f71eb2e7fd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.910780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ebe92-852a-40ea-bb5e-664e0a6fe904 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.915000 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 950/1872] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:15.915000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559dd7e-874e-495b-9012-23f71eb2e7fd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.919875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8db08-ab9e-4414-b79b-5d2c5c6be759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.920658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8db08-ab9e-4414-b79b-5d2c5c6be759 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.920938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8db08-ab9e-4414-b79b-5d2c5c6be759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.921228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8db08-ab9e-4414-b79b-5d2c5c6be759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.921882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8db08-ab9e-4414-b79b-5d2c5c6be759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.923581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8db08-ab9e-4414-b79b-5d2c5c6be759 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.931112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559dd7e-874e-495b-9012-23f71eb2e7fd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.937712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7f186-e2c4-45a5-8fd9-c0592e91cc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:15.938457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7f186-e2c4-45a5-8fd9-c0592e91cc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:15.938825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7f186-e2c4-45a5-8fd9-c0592e91cc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:15.939118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7f186-e2c4-45a5-8fd9-c0592e91cc77 admin admin] PATH_INFO: `/v3/projects/63fb535d9e7b47268fcc0509ea68e32c/users/5813a6013aa04c57bc71c2ba65c363c2/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:15.941045 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 923/1873] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:15.941584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7f186-e2c4-45a5-8fd9-c0592e91cc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fb535d9e7b47268fcc0509ea68e32c, user_id=5813a6013aa04c57bc71c2ba65c363c2, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:15.941940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8db08-ab9e-4414-b79b-5d2c5c6be759 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.944971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7f186-e2c4-45a5-8fd9-c0592e91cc77 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:15.954500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8db08-ab9e-4414-b79b-5d2c5c6be759 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:15.966884 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 951/1874] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:15 2022] PUT /identity/v3/projects/63fb535d9e7b47268fcc0509ea68e32c/users/5813a6013aa04c57bc71c2ba65c363c2/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:15.966884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7f186-e2c4-45a5-8fd9-c0592e91cc77 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:15.997715 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:16.015149 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:16.036505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75145c18-ef05-4636-bc1e-fca35846d523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:16.037286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75145c18-ef05-4636-bc1e-fca35846d523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:16.038090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75145c18-ef05-4636-bc1e-fca35846d523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:16.038373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75145c18-ef05-4636-bc1e-fca35846d523 admin admin] PATH_INFO: `/v3/projects/28bc2644be594aa08a5bbb29507b196c/users/e9ba2cd18e3642f19918ecce32965fb1/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:16.046594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75145c18-ef05-4636-bc1e-fca35846d523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28bc2644be594aa08a5bbb29507b196c, user_id=e9ba2cd18e3642f19918ecce32965fb1, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:16.049293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75145c18-ef05-4636-bc1e-fca35846d523 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:16.057460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7f186-e2c4-45a5-8fd9-c0592e91cc77 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:16.073145 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 924/1875] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:15 2022] PUT /identity/v3/projects/28bc2644be594aa08a5bbb29507b196c/users/e9ba2cd18e3642f19918ecce32965fb1/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:16.073145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209f9e4-09ee-4ca4-a3dd-e721b5d51650 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:16.073145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209f9e4-09ee-4ca4-a3dd-e721b5d51650 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:16.073145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209f9e4-09ee-4ca4-a3dd-e721b5d51650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:16.098779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e209f9e4-09ee-4ca4-a3dd-e721b5d51650 None None] MFA Rules not processed for user `5813a6013aa04c57bc71c2ba65c363c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:16.100044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e209f9e4-09ee-4ca4-a3dd-e721b5d51650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:16.150135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533726a2-2619-4c35-ad1c-691a443f6d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:16.150730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533726a2-2619-4c35-ad1c-691a443f6d4e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:16.150997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533726a2-2619-4c35-ad1c-691a443f6d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:16.151294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533726a2-2619-4c35-ad1c-691a443f6d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:16.152131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533726a2-2619-4c35-ad1c-691a443f6d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:16.155023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533726a2-2619-4c35-ad1c-691a443f6d4e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:16.169611 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 952/1876] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:16.178433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6522545-4376-4f69-9f46-ecfe70155a54 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:16.184141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6522545-4376-4f69-9f46-ecfe70155a54 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:16.184797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6522545-4376-4f69-9f46-ecfe70155a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:16.188408 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 925/1877] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:16.189253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209f9e4-09ee-4ca4-a3dd-e721b5d51650 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:16.202004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209f9e4-09ee-4ca4-a3dd-e721b5d51650 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:16.208163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af2a25-cd25-4e8a-b974-063095022b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:16.208852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af2a25-cd25-4e8a-b974-063095022b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:16.209132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af2a25-cd25-4e8a-b974-063095022b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:16.209405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af2a25-cd25-4e8a-b974-063095022b96 admin admin] PATH_INFO: `/v3/projects/5a5af1e6e5fa46bc9bfa0aa213204ac4/users/fb4ac632e9e84d6eacd7bb276a93de52/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:16.234297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af2a25-cd25-4e8a-b974-063095022b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5af1e6e5fa46bc9bfa0aa213204ac4, user_id=fb4ac632e9e84d6eacd7bb276a93de52, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:16.239861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af2a25-cd25-4e8a-b974-063095022b96 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:16.264252 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 926/1878] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:16 2022] PUT /identity/v3/projects/5a5af1e6e5fa46bc9bfa0aa213204ac4/users/fb4ac632e9e84d6eacd7bb276a93de52/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:16.265647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af2a25-cd25-4e8a-b974-063095022b96 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:16.266042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f6522545-4376-4f69-9f46-ecfe70155a54 None None] MFA Rules not processed for user `e9ba2cd18e3642f19918ecce32965fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:16.267511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f6522545-4376-4f69-9f46-ecfe70155a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:16.277632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-03af2a25-cd25-4e8a-b974-063095022b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:16.378735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af2a25-cd25-4e8a-b974-063095022b96 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:16.388187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184560db-b4fe-4697-b8b3-4f6ab15ff6a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:16.389591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184560db-b4fe-4697-b8b3-4f6ab15ff6a6 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:16.391199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184560db-b4fe-4697-b8b3-4f6ab15ff6a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:16.391672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184560db-b4fe-4697-b8b3-4f6ab15ff6a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:16.397851 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 953/1879] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:16.399543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dd1c4-283f-4418-b370-1198fcee7531 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:16.399834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dd1c4-283f-4418-b370-1198fcee7531 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:16.400111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dd1c4-283f-4418-b370-1198fcee7531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:16.439179 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:16.445978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c44dd1c4-283f-4418-b370-1198fcee7531 None None] MFA Rules not processed for user `fb4ac632e9e84d6eacd7bb276a93de52`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:16.448361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c44dd1c4-283f-4418-b370-1198fcee7531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:16.500311 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:16.502455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184560db-b4fe-4697-b8b3-4f6ab15ff6a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:16.505048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184560db-b4fe-4697-b8b3-4f6ab15ff6a6 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:16.517690 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 927/1880] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:16.518700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184560db-b4fe-4697-b8b3-4f6ab15ff6a6 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:16.520605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-184560db-b4fe-4697-b8b3-4f6ab15ff6a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:16.526815 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 954/1881] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:16.527768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dd1c4-283f-4418-b370-1198fcee7531 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:16.645817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dd1c4-283f-4418-b370-1198fcee7531 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:16.651872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd40b51-50e7-459b-9b82-99a2d9058830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:16.652497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd40b51-50e7-459b-9b82-99a2d9058830 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:16.652883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd40b51-50e7-459b-9b82-99a2d9058830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:16.653241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd40b51-50e7-459b-9b82-99a2d9058830 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:16.653973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd40b51-50e7-459b-9b82-99a2d9058830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:16.655919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd40b51-50e7-459b-9b82-99a2d9058830 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:16.672446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184560db-b4fe-4697-b8b3-4f6ab15ff6a6 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:16.678947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:16.679995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:16.680401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:16.682346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] PATH_INFO: `/v3/projects/09fc95edb31e4dfaa01af9203dad7289` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:16.683497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09fc95edb31e4dfaa01af9203dad7289)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:16.686700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:16.706299 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 955/1882] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:16 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:16.710992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd40b51-50e7-459b-9b82-99a2d9058830 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:16.763905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09fc95edb31e4dfaa01af9203dad7289', 'request_id': 'req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:16.774605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09fc95edb31e4dfaa01af9203dad7289', 'request_id': 'req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:16.785756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09fc95edb31e4dfaa01af9203dad7289', 'request_id': 'req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:16.800610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd40b51-50e7-459b-9b82-99a2d9058830 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:16.803369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] The token cache is being invalidate because project 09fc95edb31e4dfaa01af9203dad7289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:16.803720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:16.804439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:16.806132 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 928/1883] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:16 2022] DELETE /identity/v3/projects/09fc95edb31e4dfaa01af9203dad7289 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:16.807050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:16.808500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:16.872130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a6277-2032-4f67-bcd0-9fe1b9f9a581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:16.872873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a6277-2032-4f67-bcd0-9fe1b9f9a581 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:16.873221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a6277-2032-4f67-bcd0-9fe1b9f9a581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:16.873555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a6277-2032-4f67-bcd0-9fe1b9f9a581 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:16.875229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a6277-2032-4f67-bcd0-9fe1b9f9a581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:16.877234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a6277-2032-4f67-bcd0-9fe1b9f9a581 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:16.886471 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:16.923960 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 956/1884] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:16 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:16.928288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a6277-2032-4f67-bcd0-9fe1b9f9a581 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:16.931802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b26a6277-2032-4f67-bcd0-9fe1b9f9a581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:16.952225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a6277-2032-4f67-bcd0-9fe1b9f9a581 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:16.964418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:16.964882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16e012-c3cf-4ff6-aa7c-ddc694a9bf27 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:16.964994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:16.965212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:16.965478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] PATH_INFO: `/v3/users/62f80d17179149ac98c6137089aaa9f4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:16.966901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f80d17179149ac98c6137089aaa9f4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:16.969344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:16.974070 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:16.986095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d6499-b981-4e8e-825d-2b6e7c5dd74f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:16.986457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d6499-b981-4e8e-825d-2b6e7c5dd74f service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:16.986742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d6499-b981-4e8e-825d-2b6e7c5dd74f service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:16.987215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d6499-b981-4e8e-825d-2b6e7c5dd74f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:16.989258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6f5d6499-b981-4e8e-825d-2b6e7c5dd74f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:17.037627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f80d17179149ac98c6137089aaa9f4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:17.038364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f80d17179149ac98c6137089aaa9f4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:17.055608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f80d17179149ac98c6137089aaa9f4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:17.067158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f80d17179149ac98c6137089aaa9f4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:17.068097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f80d17179149ac98c6137089aaa9f4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:17.078896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d6499-b981-4e8e-825d-2b6e7c5dd74f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:17.080589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d6499-b981-4e8e-825d-2b6e7c5dd74f service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:17.088270 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 957/1885] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:16 2022] DELETE /identity/v3/users/62f80d17179149ac98c6137089aaa9f4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:17.089151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:17.091306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:17.109239 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 929/1886] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:17.116095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ce550-f005-4e94-8cfa-fe0b469413be None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:17.116728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ce550-f005-4e94-8cfa-fe0b469413be None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:17.123423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ce550-f005-4e94-8cfa-fe0b469413be None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:17.126589 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 930/1887] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:17 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 01:01:17.133682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ce550-f005-4e94-8cfa-fe0b469413be None None] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:17.136117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c02ce550-f005-4e94-8cfa-fe0b469413be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:17.186654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c891-add3-4c92-a669-2248f91f1b1d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:17.194716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cf623-1994-4099-9ff3-f3c04673fbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:17.195980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cf623-1994-4099-9ff3-f3c04673fbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:17.196412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cf623-1994-4099-9ff3-f3c04673fbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:17.196829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cf623-1994-4099-9ff3-f3c04673fbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:17.197694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cf623-1994-4099-9ff3-f3c04673fbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:17.200703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cf623-1994-4099-9ff3-f3c04673fbb9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:17.233012 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 958/1888] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:17.243676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ce550-f005-4e94-8cfa-fe0b469413be None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:17.244875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cf623-1994-4099-9ff3-f3c04673fbb9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:17.245002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c02ce550-f005-4e94-8cfa-fe0b469413be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:17.247330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ca6cf623-1994-4099-9ff3-f3c04673fbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:17.291273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cf623-1994-4099-9ff3-f3c04673fbb9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:17.298946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d8fea-f708-4dbe-87dd-8ceef92d794a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:17.300686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d8fea-f708-4dbe-87dd-8ceef92d794a service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:17.301251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d8fea-f708-4dbe-87dd-8ceef92d794a service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:17.301719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d8fea-f708-4dbe-87dd-8ceef92d794a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:17.304551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-017d8fea-f708-4dbe-87dd-8ceef92d794a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:17.374645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ce550-f005-4e94-8cfa-fe0b469413be None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:17.379657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac89d2-5185-422e-8d3d-b477bcafb53f tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9ba2cd18e3642f19918ecce32965fb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28bc2644be594aa08a5bbb29507b196c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:17.380309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac89d2-5185-422e-8d3d-b477bcafb53f tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:17.380597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac89d2-5185-422e-8d3d-b477bcafb53f tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:17.380882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac89d2-5185-422e-8d3d-b477bcafb53f tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] PATH_INFO: `/v3/projects/5267a09ec9a540a7a0400700f8bceb80` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:17.382026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac89d2-5185-422e-8d3d-b477bcafb53f tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorizing `identity:get_project(project_id=5267a09ec9a540a7a0400700f8bceb80)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:17.384162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac89d2-5185-422e-8d3d-b477bcafb53f tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:17.385871 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 931/1889] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:17 2022] GET /identity/v3/projects/5267a09ec9a540a7a0400700f8bceb80 => generated 381 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:17.397522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac89d2-5185-422e-8d3d-b477bcafb53f tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:17.415217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d8fea-f708-4dbe-87dd-8ceef92d794a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:17.417067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d8fea-f708-4dbe-87dd-8ceef92d794a service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:17.422781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac89d2-5185-422e-8d3d-b477bcafb53f tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:17.429947 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 959/1890] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:17.437093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca3158-8cd6-4377-98a1-0b2f4a4611fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:17.438155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca3158-8cd6-4377-98a1-0b2f4a4611fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:17.438529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca3158-8cd6-4377-98a1-0b2f4a4611fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:17.438909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca3158-8cd6-4377-98a1-0b2f4a4611fc admin admin] PATH_INFO: `/v3/projects/b637cd2136a94c98a0e692308b9c4479/users/080ec1cbb5854dc7b3db62197886c3c8/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:17.481258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca3158-8cd6-4377-98a1-0b2f4a4611fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b637cd2136a94c98a0e692308b9c4479, user_id=080ec1cbb5854dc7b3db62197886c3c8, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:17.484974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca3158-8cd6-4377-98a1-0b2f4a4611fc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:17.488430 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:17.497641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f56cb-5e0f-4247-a858-07fc75ae36e6 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:17.498172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f56cb-5e0f-4247-a858-07fc75ae36e6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:17.498491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f56cb-5e0f-4247-a858-07fc75ae36e6 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:17.500692 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 960/1891] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:17.507206 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 932/1892] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:17 2022] PUT /identity/v3/projects/b637cd2136a94c98a0e692308b9c4479/users/080ec1cbb5854dc7b3db62197886c3c8/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:17.511005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca3158-8cd6-4377-98a1-0b2f4a4611fc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:17.511138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f56cb-5e0f-4247-a858-07fc75ae36e6 None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:17.540520 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:17.622902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f56cb-5e0f-4247-a858-07fc75ae36e6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:17.631825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca3158-8cd6-4377-98a1-0b2f4a4611fc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:17.637936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971c546-faa1-4e50-9acc-b50072f6108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:17.639616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971c546-faa1-4e50-9acc-b50072f6108f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:17.640099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971c546-faa1-4e50-9acc-b50072f6108f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:17.640715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971c546-faa1-4e50-9acc-b50072f6108f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:17.641602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971c546-faa1-4e50-9acc-b50072f6108f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:17.644924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971c546-faa1-4e50-9acc-b50072f6108f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:17.661192 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 933/1893] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:17.664726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971c546-faa1-4e50-9acc-b50072f6108f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:17.699441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971c546-faa1-4e50-9acc-b50072f6108f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:17.723766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7310e-1ace-4e0d-814c-6cbedb2f1e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:17.726534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7310e-1ace-4e0d-814c-6cbedb2f1e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:17.726886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7310e-1ace-4e0d-814c-6cbedb2f1e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:17.727461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7310e-1ace-4e0d-814c-6cbedb2f1e0f admin admin] PATH_INFO: `/v3/projects/b637cd2136a94c98a0e692308b9c4479/users/080ec1cbb5854dc7b3db62197886c3c8/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:17.730506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7310e-1ace-4e0d-814c-6cbedb2f1e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b637cd2136a94c98a0e692308b9c4479, user_id=080ec1cbb5854dc7b3db62197886c3c8, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:17.732117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f56cb-5e0f-4247-a858-07fc75ae36e6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:17.740165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38511f9-e224-4dab-9097-8c0f6d323cb5 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9ba2cd18e3642f19918ecce32965fb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28bc2644be594aa08a5bbb29507b196c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:17.740867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38511f9-e224-4dab-9097-8c0f6d323cb5 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:17.741150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38511f9-e224-4dab-9097-8c0f6d323cb5 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:17.741482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38511f9-e224-4dab-9097-8c0f6d323cb5 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] PATH_INFO: `/v3/projects/5267a09ec9a540a7a0400700f8bceb80` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:17.742777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38511f9-e224-4dab-9097-8c0f6d323cb5 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorizing `identity:get_project(project_id=5267a09ec9a540a7a0400700f8bceb80)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:17.744895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38511f9-e224-4dab-9097-8c0f6d323cb5 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:17.747055 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 961/1894] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:17 2022] GET /identity/v3/projects/5267a09ec9a540a7a0400700f8bceb80 => generated 381 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:17.747859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38511f9-e224-4dab-9097-8c0f6d323cb5 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:17.749544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b38511f9-e224-4dab-9097-8c0f6d323cb5 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:17.764866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38511f9-e224-4dab-9097-8c0f6d323cb5 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:17.766989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7310e-1ace-4e0d-814c-6cbedb2f1e0f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:17.770755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab28f4f-b926-46b9-8679-c91db519a2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:17.771534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab28f4f-b926-46b9-8679-c91db519a2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:17.771883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab28f4f-b926-46b9-8679-c91db519a2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:17.772230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab28f4f-b926-46b9-8679-c91db519a2ca admin admin] PATH_INFO: `/v3/projects/6457daceb34f434f8fb5e4e54953cf9b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:17.773559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab28f4f-b926-46b9-8679-c91db519a2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6457daceb34f434f8fb5e4e54953cf9b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:17.775810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab28f4f-b926-46b9-8679-c91db519a2ca admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:17.801279 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 934/1895] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:17 2022] PUT /identity/v3/projects/b637cd2136a94c98a0e692308b9c4479/users/080ec1cbb5854dc7b3db62197886c3c8/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:01:17.811811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1309f3-f2b8-4e52-938f-efcd89ccada9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:17.812564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1309f3-f2b8-4e52-938f-efcd89ccada9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:17.813163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1309f3-f2b8-4e52-938f-efcd89ccada9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:17.858145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eab28f4f-b926-46b9-8679-c91db519a2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6457daceb34f434f8fb5e4e54953cf9b', 'request_id': 'req-eab28f4f-b926-46b9-8679-c91db519a2ca'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:17.869351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eab28f4f-b926-46b9-8679-c91db519a2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6457daceb34f434f8fb5e4e54953cf9b', 'request_id': 'req-eab28f4f-b926-46b9-8679-c91db519a2ca'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:17.880502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eab28f4f-b926-46b9-8679-c91db519a2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6457daceb34f434f8fb5e4e54953cf9b', 'request_id': 'req-eab28f4f-b926-46b9-8679-c91db519a2ca'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:17.896947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2b1309f3-f2b8-4e52-938f-efcd89ccada9 None None] MFA Rules not processed for user `080ec1cbb5854dc7b3db62197886c3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:17.898856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2b1309f3-f2b8-4e52-938f-efcd89ccada9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:17.910766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eab28f4f-b926-46b9-8679-c91db519a2ca admin admin] The token cache is being invalidate because project 6457daceb34f434f8fb5e4e54953cf9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:17.911108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eab28f4f-b926-46b9-8679-c91db519a2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:17.911796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eab28f4f-b926-46b9-8679-c91db519a2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:17.918330 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 962/1896] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:17 2022] DELETE /identity/v3/projects/6457daceb34f434f8fb5e4e54953cf9b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:17.919849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814dda3-a151-4dbc-9777-cbf507cca28e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:17.920125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814dda3-a151-4dbc-9777-cbf507cca28e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:17.920996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814dda3-a151-4dbc-9777-cbf507cca28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:17.945738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c814dda3-a151-4dbc-9777-cbf507cca28e None None] MFA Rules not processed for user `dd6cb0f17cf24e8cac44ff9ec732146a`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:17.948287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c814dda3-a151-4dbc-9777-cbf507cca28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:17.991055 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:18.030338 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 963/1897] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:18.031618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb496d3-9fcc-4706-9deb-5bee682b862e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:18.031836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb496d3-9fcc-4706-9deb-5bee682b862e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:18.032243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb496d3-9fcc-4706-9deb-5bee682b862e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:18.048886 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 935/1898] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:18.048886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1309f3-f2b8-4e52-938f-efcd89ccada9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:18.048886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2b1309f3-f2b8-4e52-938f-efcd89ccada9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:18.067024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-edb496d3-9fcc-4706-9deb-5bee682b862e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:18.067024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-edb496d3-9fcc-4706-9deb-5bee682b862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:18.140823 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:18.148198 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 964/1899] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:18.149607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d38da7-4956-4677-9966-d41063cfeaf5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:18.149900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d38da7-4956-4677-9966-d41063cfeaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:18.150178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d38da7-4956-4677-9966-d41063cfeaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:18.175744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-48d38da7-4956-4677-9966-d41063cfeaf5 None None] MFA Rules not processed for user `fb4ac632e9e84d6eacd7bb276a93de52`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:18.177191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-48d38da7-4956-4677-9966-d41063cfeaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:18.179885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1309f3-f2b8-4e52-938f-efcd89ccada9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:18.190781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a0186-3b34-4da0-bbe7-063ccd1d29e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:18.191450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a0186-3b34-4da0-bbe7-063ccd1d29e2 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:18.191857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a0186-3b34-4da0-bbe7-063ccd1d29e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:18.191987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a0186-3b34-4da0-bbe7-063ccd1d29e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:18.194056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-655a0186-3b34-4da0-bbe7-063ccd1d29e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:18.209346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a0186-3b34-4da0-bbe7-063ccd1d29e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:18.212609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a0186-3b34-4da0-bbe7-063ccd1d29e2 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:18.225557 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 936/1900] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:01:18.226900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f085fe1-010a-4fa4-a7ba-21afec8b01d6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:18.227222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f085fe1-010a-4fa4-a7ba-21afec8b01d6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:18.227706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f085fe1-010a-4fa4-a7ba-21afec8b01d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:18.251425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1f085fe1-010a-4fa4-a7ba-21afec8b01d6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:18.253695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1f085fe1-010a-4fa4-a7ba-21afec8b01d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:18.269385 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 937/1901] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:18.283940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f085fe1-010a-4fa4-a7ba-21afec8b01d6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:18.314037 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 965/1902] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:18.314435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f085fe1-010a-4fa4-a7ba-21afec8b01d6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:18.321683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4290fdd-739c-4386-8d28-1ac3a0c29261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:18.322488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4290fdd-739c-4386-8d28-1ac3a0c29261 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:18.323089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4290fdd-739c-4386-8d28-1ac3a0c29261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:18.323419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4290fdd-739c-4386-8d28-1ac3a0c29261 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:18.324136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4290fdd-739c-4386-8d28-1ac3a0c29261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:18.324444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4290fdd-739c-4386-8d28-1ac3a0c29261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:18.326613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4290fdd-739c-4386-8d28-1ac3a0c29261 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:18.351434 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 938/1903] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:01:18.355502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d38da7-4956-4677-9966-d41063cfeaf5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:18.392436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d38da7-4956-4677-9966-d41063cfeaf5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:18.406371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828021c-5a6e-4edc-81b4-844ac5a42d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:18.407275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828021c-5a6e-4edc-81b4-844ac5a42d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:18.407638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828021c-5a6e-4edc-81b4-844ac5a42d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:18.409348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828021c-5a6e-4edc-81b4-844ac5a42d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:18.409348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828021c-5a6e-4edc-81b4-844ac5a42d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:18.412838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828021c-5a6e-4edc-81b4-844ac5a42d14 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:18.460068 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 966/1904] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:18 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:18.465153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4290fdd-739c-4386-8d28-1ac3a0c29261 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:18.475913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4290fdd-739c-4386-8d28-1ac3a0c29261 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:18.591156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb320f-6f08-4c5a-a024-4798b60a7c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:18.592815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb320f-6f08-4c5a-a024-4798b60a7c16 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:18.593706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb320f-6f08-4c5a-a024-4798b60a7c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:18.599752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb320f-6f08-4c5a-a024-4798b60a7c16 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:18.605580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb320f-6f08-4c5a-a024-4798b60a7c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:18.608614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb320f-6f08-4c5a-a024-4798b60a7c16 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:18.664377 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 939/1905] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:18 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:18.668773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828021c-5a6e-4edc-81b4-844ac5a42d14 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:18.680756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828021c-5a6e-4edc-81b4-844ac5a42d14 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:18.696226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c142ec7-76a1-4294-86d0-cc12abf608ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:18.696754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c142ec7-76a1-4294-86d0-cc12abf608ab admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:18.697510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c142ec7-76a1-4294-86d0-cc12abf608ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:18.697510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c142ec7-76a1-4294-86d0-cc12abf608ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:18.698073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c142ec7-76a1-4294-86d0-cc12abf608ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:18.699723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c142ec7-76a1-4294-86d0-cc12abf608ab admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:18.708906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb320f-6f08-4c5a-a024-4798b60a7c16 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:18.713109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-43cb320f-6f08-4c5a-a024-4798b60a7c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:18.718727 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 967/1906] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:18.719903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c142ec7-76a1-4294-86d0-cc12abf608ab admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:18.721946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1c142ec7-76a1-4294-86d0-cc12abf608ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:18.734626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb320f-6f08-4c5a-a024-4798b60a7c16 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:18.744876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:18.745900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:18.746403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:18.746891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] PATH_INFO: `/v3/users/04190f3cb2af4b22bebc3bf193af5b66` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:18.749027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] RBAC: Authorizing `identity:delete_user(user_id=04190f3cb2af4b22bebc3bf193af5b66)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:18.751520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:18.810498 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:18.843873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c142ec7-76a1-4294-86d0-cc12abf608ab admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:18.851426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599b9fc-942f-458a-9ef5-1fd1acfdbfa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:18.852171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599b9fc-942f-458a-9ef5-1fd1acfdbfa6 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:18.852331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599b9fc-942f-458a-9ef5-1fd1acfdbfa6 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:18.853182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599b9fc-942f-458a-9ef5-1fd1acfdbfa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:18.854949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04190f3cb2af4b22bebc3bf193af5b66'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:18.855668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04190f3cb2af4b22bebc3bf193af5b66'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:18.858495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8599b9fc-942f-458a-9ef5-1fd1acfdbfa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:18.887355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04190f3cb2af4b22bebc3bf193af5b66'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:18.901752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04190f3cb2af4b22bebc3bf193af5b66'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:18.903007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04190f3cb2af4b22bebc3bf193af5b66'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:18.935272 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 940/1907] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:18 2022] DELETE /identity/v3/users/04190f3cb2af4b22bebc3bf193af5b66 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:18.936674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:18.941251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:18.990097 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:19.017442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599b9fc-942f-458a-9ef5-1fd1acfdbfa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:19.017442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599b9fc-942f-458a-9ef5-1fd1acfdbfa6 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:19.033071 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 968/1908] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:19.034730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f4d4e-731f-4cd3-9ed9-9f8536b6c63f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:19.035042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f4d4e-731f-4cd3-9ed9-9f8536b6c63f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:19.035315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f4d4e-731f-4cd3-9ed9-9f8536b6c63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:19.037224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e9640-8e29-4466-ad53-4bd79f8aa69e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:19.046648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0c2a1-e52f-4019-b401-8e2050179091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:19.049359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0c2a1-e52f-4019-b401-8e2050179091 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:19.051351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0c2a1-e52f-4019-b401-8e2050179091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:19.052987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0c2a1-e52f-4019-b401-8e2050179091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:19.056906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0c2a1-e52f-4019-b401-8e2050179091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:19.060077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0c2a1-e52f-4019-b401-8e2050179091 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:19.077536 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 941/1909] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:19.078617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0c2a1-e52f-4019-b401-8e2050179091 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:19.091111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0c2a1-e52f-4019-b401-8e2050179091 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:19.099392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ebee2-a5ec-4fc0-9165-ba2ffc818c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:19.100158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ebee2-a5ec-4fc0-9165-ba2ffc818c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:19.100520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ebee2-a5ec-4fc0-9165-ba2ffc818c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:19.100892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ebee2-a5ec-4fc0-9165-ba2ffc818c73 admin admin] PATH_INFO: `/v3/projects/a0d11ee6626d4880a518d6eabf565d84/users/7000f45b2a3b4c6a988dd72e0c92aa23/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:19.110028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7c3f4d4e-731f-4cd3-9ed9-9f8536b6c63f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:19.111301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7c3f4d4e-731f-4cd3-9ed9-9f8536b6c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:19.138952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ebee2-a5ec-4fc0-9165-ba2ffc818c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d11ee6626d4880a518d6eabf565d84, user_id=7000f45b2a3b4c6a988dd72e0c92aa23, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:19.143128 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 969/1910] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:19.152798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ebee2-a5ec-4fc0-9165-ba2ffc818c73 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:19.159827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f4d4e-731f-4cd3-9ed9-9f8536b6c63f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:19.163003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7c3f4d4e-731f-4cd3-9ed9-9f8536b6c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:19.206693 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 942/1911] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:19 2022] PUT /identity/v3/projects/a0d11ee6626d4880a518d6eabf565d84/users/7000f45b2a3b4c6a988dd72e0c92aa23/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:19.211459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658c2e7-db63-4ec2-83d7-21189584c3d5 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:19.211682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658c2e7-db63-4ec2-83d7-21189584c3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:19.211966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658c2e7-db63-4ec2-83d7-21189584c3d5 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:19.213593 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 943/1912] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:19.218585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff8dbe-9163-429e-844f-f16b206d6f8d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:19.218874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff8dbe-9163-429e-844f-f16b206d6f8d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:19.219198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff8dbe-9163-429e-844f-f16b206d6f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:19.259968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6aff8dbe-9163-429e-844f-f16b206d6f8d None None] MFA Rules not processed for user `7000f45b2a3b4c6a988dd72e0c92aa23`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:19.261203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6aff8dbe-9163-429e-844f-f16b206d6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:19.285387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f4d4e-731f-4cd3-9ed9-9f8536b6c63f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:19.359136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517eacf-afea-465b-8c4d-35b93ed3f239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:19.359762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517eacf-afea-465b-8c4d-35b93ed3f239 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:19.363170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517eacf-afea-465b-8c4d-35b93ed3f239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:19.363170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517eacf-afea-465b-8c4d-35b93ed3f239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:19.433669 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:19.438760 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 944/1913] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:19.443861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff8dbe-9163-429e-844f-f16b206d6f8d None None] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:19.445849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517eacf-afea-465b-8c4d-35b93ed3f239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:19.447513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517eacf-afea-465b-8c4d-35b93ed3f239 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:19.447684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6aff8dbe-9163-429e-844f-f16b206d6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:19.458317 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 970/1914] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:01:19.459263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517eacf-afea-465b-8c4d-35b93ed3f239 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:19.469825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517eacf-afea-465b-8c4d-35b93ed3f239 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:19.475582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f3368-f50e-4342-9582-793e7bd85372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:19.476156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3368-f50e-4342-9582-793e7bd85372 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:19.476500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3368-f50e-4342-9582-793e7bd85372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:19.476839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3368-f50e-4342-9582-793e7bd85372 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:19.477545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f3368-f50e-4342-9582-793e7bd85372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:19.480126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f3368-f50e-4342-9582-793e7bd85372 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:19.521234 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 971/1915] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:19 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:19.528086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f3368-f50e-4342-9582-793e7bd85372 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:19.602272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff8dbe-9163-429e-844f-f16b206d6f8d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:19.603886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6aff8dbe-9163-429e-844f-f16b206d6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:19.640073 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:19.652191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f3368-f50e-4342-9582-793e7bd85372 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:19.663612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c1caa-c84c-4d43-b491-f2f27a424bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:19.664386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c1caa-c84c-4d43-b491-f2f27a424bfd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:19.665250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c1caa-c84c-4d43-b491-f2f27a424bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:19.665363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c1caa-c84c-4d43-b491-f2f27a424bfd admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:19.666274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c1caa-c84c-4d43-b491-f2f27a424bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:19.668850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c1caa-c84c-4d43-b491-f2f27a424bfd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:19.715473 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 972/1916] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:19 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:19.717216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff8dbe-9163-429e-844f-f16b206d6f8d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:19.719219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c1caa-c84c-4d43-b491-f2f27a424bfd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:19.735922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c1caa-c84c-4d43-b491-f2f27a424bfd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:19.743253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5949b-957b-4fda-8835-d4d7cac8cabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:19.743815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5949b-957b-4fda-8835-d4d7cac8cabd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:19.744083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5949b-957b-4fda-8835-d4d7cac8cabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:19.744357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5949b-957b-4fda-8835-d4d7cac8cabd admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:19.745145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5949b-957b-4fda-8835-d4d7cac8cabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:19.746762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5949b-957b-4fda-8835-d4d7cac8cabd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:19.759465 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 973/1917] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:19.763293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5949b-957b-4fda-8835-d4d7cac8cabd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:19.777419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5949b-957b-4fda-8835-d4d7cac8cabd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:19.791150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecf753-e267-4fa2-876a-3ef033a8998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:19.792118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecf753-e267-4fa2-876a-3ef033a8998d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:19.792407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecf753-e267-4fa2-876a-3ef033a8998d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:19.792680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecf753-e267-4fa2-876a-3ef033a8998d admin admin] PATH_INFO: `/v3/projects/7aa8cdaf694648d985c75921b6a43816/users/dde801ec66f4431492865e8cac8d89a1/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:19.817930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b36d9-9991-4210-90ba-89f8737c14cb tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9ba2cd18e3642f19918ecce32965fb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28bc2644be594aa08a5bbb29507b196c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:19.818601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b36d9-9991-4210-90ba-89f8737c14cb tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:19.818886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b36d9-9991-4210-90ba-89f8737c14cb tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:19.819716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b36d9-9991-4210-90ba-89f8737c14cb tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] PATH_INFO: `/v3/projects/5267a09ec9a540a7a0400700f8bceb80` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:19.820566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b36d9-9991-4210-90ba-89f8737c14cb tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorizing `identity:get_project(project_id=5267a09ec9a540a7a0400700f8bceb80)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:19.821576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecf753-e267-4fa2-876a-3ef033a8998d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa8cdaf694648d985c75921b6a43816, user_id=dde801ec66f4431492865e8cac8d89a1, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:19.822710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b36d9-9991-4210-90ba-89f8737c14cb tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:19.826068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecf753-e267-4fa2-876a-3ef033a8998d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:19.838575 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 945/1918] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:19 2022] GET /identity/v3/projects/5267a09ec9a540a7a0400700f8bceb80 => generated 381 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:19.871198 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 974/1919] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:19 2022] PUT /identity/v3/projects/7aa8cdaf694648d985c75921b6a43816/users/dde801ec66f4431492865e8cac8d89a1/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:01:19.875149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b36d9-9991-4210-90ba-89f8737c14cb tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:19.893008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b36d9-9991-4210-90ba-89f8737c14cb tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:19.978275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec25d6-adfd-4645-9f3b-9708fa6bf6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:19.979106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec25d6-adfd-4645-9f3b-9708fa6bf6dc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:19.979446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec25d6-adfd-4645-9f3b-9708fa6bf6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:19.979781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec25d6-adfd-4645-9f3b-9708fa6bf6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:19.981371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec25d6-adfd-4645-9f3b-9708fa6bf6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:19.983543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec25d6-adfd-4645-9f3b-9708fa6bf6dc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:19.997326 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 946/1920] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:01:20.001509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecf753-e267-4fa2-876a-3ef033a8998d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:20.019840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecf753-e267-4fa2-876a-3ef033a8998d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:20.032370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86556da-597f-447d-8377-6e11735ad406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:20.035028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86556da-597f-447d-8377-6e11735ad406 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:20.035484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86556da-597f-447d-8377-6e11735ad406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:20.035881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86556da-597f-447d-8377-6e11735ad406 admin admin] PATH_INFO: `/v3/projects/7aa8cdaf694648d985c75921b6a43816/users/dde801ec66f4431492865e8cac8d89a1/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:20.040613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86556da-597f-447d-8377-6e11735ad406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa8cdaf694648d985c75921b6a43816, user_id=dde801ec66f4431492865e8cac8d89a1, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:20.054430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86556da-597f-447d-8377-6e11735ad406 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:20.074630 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 975/1921] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:20 2022] PUT /identity/v3/projects/7aa8cdaf694648d985c75921b6a43816/users/dde801ec66f4431492865e8cac8d89a1/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:20.086592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5d7fb-19ed-44d9-951a-845a907256a7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:20.086882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5d7fb-19ed-44d9-951a-845a907256a7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:20.087182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5d7fb-19ed-44d9-951a-845a907256a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:20.123790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-23e5d7fb-19ed-44d9-951a-845a907256a7 None None] MFA Rules not processed for user `dde801ec66f4431492865e8cac8d89a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:20.125420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-23e5d7fb-19ed-44d9-951a-845a907256a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:20.213346 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:20.230752 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 947/1922] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:20.670787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86556da-597f-447d-8377-6e11735ad406 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:20.672635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d86556da-597f-447d-8377-6e11735ad406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:20.759855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86556da-597f-447d-8377-6e11735ad406 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:20.766581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:20.767328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:20.767670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:20.768010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] PATH_INFO: `/v3/projects/9f3af436ad7547f9ad68f3a51df88640` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:20.769563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3af436ad7547f9ad68f3a51df88640)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:20.771885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:20.793773 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:20.810592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e86e6-5db6-4736-8086-fca6bad8ba50 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:20.810882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e86e6-5db6-4736-8086-fca6bad8ba50 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:20.811188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e86e6-5db6-4736-8086-fca6bad8ba50 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:20.812545 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 948/1923] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:20.822648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e86e6-5db6-4736-8086-fca6bad8ba50 None None] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:20.824814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c89e86e6-5db6-4736-8086-fca6bad8ba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:20.865338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3af436ad7547f9ad68f3a51df88640', 'request_id': 'req-83694e43-6858-45cd-b227-174876fbb5e2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:20.872880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3af436ad7547f9ad68f3a51df88640', 'request_id': 'req-83694e43-6858-45cd-b227-174876fbb5e2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:20.884640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3af436ad7547f9ad68f3a51df88640', 'request_id': 'req-83694e43-6858-45cd-b227-174876fbb5e2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:20.904249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] The token cache is being invalidate because project 9f3af436ad7547f9ad68f3a51df88640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:20.904572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:20.906258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:20.908883 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 976/1924] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:20 2022] DELETE /identity/v3/projects/9f3af436ad7547f9ad68f3a51df88640 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:20.913965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:20.917413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:20.957144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e86e6-5db6-4736-8086-fca6bad8ba50 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:21.040785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83694e43-6858-45cd-b227-174876fbb5e2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:21.057217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e86e6-5db6-4736-8086-fca6bad8ba50 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:21.058818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63400cd-b6e9-45a7-831f-30e9958372aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:21.060120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63400cd-b6e9-45a7-831f-30e9958372aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:21.060548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63400cd-b6e9-45a7-831f-30e9958372aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:21.060961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63400cd-b6e9-45a7-831f-30e9958372aa admin admin] PATH_INFO: `/v3/users/5813a6013aa04c57bc71c2ba65c363c2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:21.063075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63400cd-b6e9-45a7-831f-30e9958372aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5813a6013aa04c57bc71c2ba65c363c2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:21.067177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63400cd-b6e9-45a7-831f-30e9958372aa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:21.142220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f63400cd-b6e9-45a7-831f-30e9958372aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5813a6013aa04c57bc71c2ba65c363c2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:21.144696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f63400cd-b6e9-45a7-831f-30e9958372aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5813a6013aa04c57bc71c2ba65c363c2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:21.159154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29f2f5-50a4-48da-8c64-aad6e97614a6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9ba2cd18e3642f19918ecce32965fb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28bc2644be594aa08a5bbb29507b196c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:21.160204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29f2f5-50a4-48da-8c64-aad6e97614a6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:21.160351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29f2f5-50a4-48da-8c64-aad6e97614a6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:21.170241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f63400cd-b6e9-45a7-831f-30e9958372aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5813a6013aa04c57bc71c2ba65c363c2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:21.173545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29f2f5-50a4-48da-8c64-aad6e97614a6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] PATH_INFO: `/v3/projects/5267a09ec9a540a7a0400700f8bceb80` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:21.178089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29f2f5-50a4-48da-8c64-aad6e97614a6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorizing `identity:get_project(project_id=5267a09ec9a540a7a0400700f8bceb80)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:21.182414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f63400cd-b6e9-45a7-831f-30e9958372aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5813a6013aa04c57bc71c2ba65c363c2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:21.183308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f63400cd-b6e9-45a7-831f-30e9958372aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5813a6013aa04c57bc71c2ba65c363c2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:21.185326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29f2f5-50a4-48da-8c64-aad6e97614a6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:21.202806 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 949/1925] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:20 2022] GET /identity/v3/projects/5267a09ec9a540a7a0400700f8bceb80 => generated 381 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:01:21.205381 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 977/1926] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:20 2022] DELETE /identity/v3/users/5813a6013aa04c57bc71c2ba65c363c2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:21.235311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29f2f5-50a4-48da-8c64-aad6e97614a6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:21.238255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0f29f2f5-50a4-48da-8c64-aad6e97614a6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:21.328505 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:21.408674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29f2f5-50a4-48da-8c64-aad6e97614a6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:21.497064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f1dac-9fa5-467f-b59b-09054a17065e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:21.497695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f1dac-9fa5-467f-b59b-09054a17065e service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:21.497976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f1dac-9fa5-467f-b59b-09054a17065e service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:21.498249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f1dac-9fa5-467f-b59b-09054a17065e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:21.500298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-370f1dac-9fa5-467f-b59b-09054a17065e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:21.571134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f1dac-9fa5-467f-b59b-09054a17065e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:21.572768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f1dac-9fa5-467f-b59b-09054a17065e service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:21.583112 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 950/1927] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:21.624695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53ecf2-0008-4d09-9809-12bad8e7c241 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:21.625048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53ecf2-0008-4d09-9809-12bad8e7c241 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:21.625320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53ecf2-0008-4d09-9809-12bad8e7c241 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:21.627029 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 978/1928] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:21.632608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f1dac-9fa5-467f-b59b-09054a17065e service nova] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:21.637619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9602a-7c72-48a6-89f3-5a316b176300 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:21.637898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9602a-7c72-48a6-89f3-5a316b176300 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:21.638170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9602a-7c72-48a6-89f3-5a316b176300 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:21.639655 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 979/1929] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 01:01:21.644383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9602a-7c72-48a6-89f3-5a316b176300 None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:21.644857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f1dac-9fa5-467f-b59b-09054a17065e service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:21.646127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2fc9602a-7c72-48a6-89f3-5a316b176300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:21.646408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-370f1dac-9fa5-467f-b59b-09054a17065e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:21.666589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9602a-7c72-48a6-89f3-5a316b176300 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:21.678466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9602a-7c72-48a6-89f3-5a316b176300 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:21.683678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95069ee-07a1-4235-bc71-213d14236be5 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde801ec66f4431492865e8cac8d89a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa8cdaf694648d985c75921b6a43816', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:21.684135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95069ee-07a1-4235-bc71-213d14236be5 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:21.684453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95069ee-07a1-4235-bc71-213d14236be5 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:21.685864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95069ee-07a1-4235-bc71-213d14236be5 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] PATH_INFO: `/v3/projects/a0d11ee6626d4880a518d6eabf565d84` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:21.685980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95069ee-07a1-4235-bc71-213d14236be5 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] RBAC: Authorizing `identity:get_project(project_id=a0d11ee6626d4880a518d6eabf565d84)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:21.688981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95069ee-07a1-4235-bc71-213d14236be5 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:21.691321 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 980/1930] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:21 2022] GET /identity/v3/projects/a0d11ee6626d4880a518d6eabf565d84 => generated 377 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:01:21.724951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f1dac-9fa5-467f-b59b-09054a17065e service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:21.729965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f6a6c-89e5-4e05-af56-eec331b27525 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9ba2cd18e3642f19918ecce32965fb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28bc2644be594aa08a5bbb29507b196c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:21.731379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f6a6c-89e5-4e05-af56-eec331b27525 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:21.731846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f6a6c-89e5-4e05-af56-eec331b27525 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:21.732236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f6a6c-89e5-4e05-af56-eec331b27525 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] PATH_INFO: `/v3/projects/5267a09ec9a540a7a0400700f8bceb80` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:21.733766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f6a6c-89e5-4e05-af56-eec331b27525 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorizing `identity:get_project(project_id=5267a09ec9a540a7a0400700f8bceb80)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:21.736667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95069ee-07a1-4235-bc71-213d14236be5 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:21.736810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f6a6c-89e5-4e05-af56-eec331b27525 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:21.737801 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 951/1931] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:21 2022] GET /identity/v3/projects/5267a09ec9a540a7a0400700f8bceb80 => generated 381 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:21.750504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95069ee-07a1-4235-bc71-213d14236be5 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:21.759872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86190b33-341b-4016-9333-da71a88e77a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:21.760532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86190b33-341b-4016-9333-da71a88e77a9 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:21.760808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86190b33-341b-4016-9333-da71a88e77a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:21.761082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86190b33-341b-4016-9333-da71a88e77a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:21.763068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-86190b33-341b-4016-9333-da71a88e77a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:21.767605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f6a6c-89e5-4e05-af56-eec331b27525 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:21.770772 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:21.772024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eb4f6a6c-89e5-4e05-af56-eec331b27525 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:21.794611 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:21.857370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86190b33-341b-4016-9333-da71a88e77a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:21.859048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86190b33-341b-4016-9333-da71a88e77a9 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:21.870129 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 981/1932] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:01:21.871278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f6a6c-89e5-4e05-af56-eec331b27525 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:21.871507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4f58f-d7e1-41b2-8aac-c591e1c5134f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:21.871739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4f58f-d7e1-41b2-8aac-c591e1c5134f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:21.872190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4f58f-d7e1-41b2-8aac-c591e1c5134f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:21.876290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfe736-43d8-476b-8e3b-b8568ee20458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:21.876919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfe736-43d8-476b-8e3b-b8568ee20458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:21.877229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfe736-43d8-476b-8e3b-b8568ee20458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:21.877454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfe736-43d8-476b-8e3b-b8568ee20458 admin admin] PATH_INFO: `/v3/projects/63fb535d9e7b47268fcc0509ea68e32c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:21.878962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfe736-43d8-476b-8e3b-b8568ee20458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63fb535d9e7b47268fcc0509ea68e32c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:21.881221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfe736-43d8-476b-8e3b-b8568ee20458 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:21.898383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-daa4f58f-d7e1-41b2-8aac-c591e1c5134f None None] MFA Rules not processed for user `dd6cb0f17cf24e8cac44ff9ec732146a`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:21.899938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-daa4f58f-d7e1-41b2-8aac-c591e1c5134f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:21.954856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74bfe736-43d8-476b-8e3b-b8568ee20458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63fb535d9e7b47268fcc0509ea68e32c', 'request_id': 'req-74bfe736-43d8-476b-8e3b-b8568ee20458'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:21.962352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74bfe736-43d8-476b-8e3b-b8568ee20458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63fb535d9e7b47268fcc0509ea68e32c', 'request_id': 'req-74bfe736-43d8-476b-8e3b-b8568ee20458'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:21.970779 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 982/1933] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:21.972785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74bfe736-43d8-476b-8e3b-b8568ee20458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63fb535d9e7b47268fcc0509ea68e32c', 'request_id': 'req-74bfe736-43d8-476b-8e3b-b8568ee20458'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:21.973121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4d346-c27c-4ab5-9341-4ce63922eb7e None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:21.973416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4d346-c27c-4ab5-9341-4ce63922eb7e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:21.973678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4d346-c27c-4ab5-9341-4ce63922eb7e None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:21.975488 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 983/1934] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:21.980261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4d346-c27c-4ab5-9341-4ce63922eb7e None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:21.989084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74bfe736-43d8-476b-8e3b-b8568ee20458 admin admin] The token cache is being invalidate because project 63fb535d9e7b47268fcc0509ea68e32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:21.989451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74bfe736-43d8-476b-8e3b-b8568ee20458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:21.990128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74bfe736-43d8-476b-8e3b-b8568ee20458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:21.992828 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 952/1935] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:21 2022] DELETE /identity/v3/projects/63fb535d9e7b47268fcc0509ea68e32c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:21.997266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71af172-5169-454b-8b6d-f72a77c2203d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:21.997984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71af172-5169-454b-8b6d-f72a77c2203d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:21.997984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71af172-5169-454b-8b6d-f72a77c2203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.028304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b71af172-5169-454b-8b6d-f72a77c2203d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:22.029620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b71af172-5169-454b-8b6d-f72a77c2203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:22.079898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4d346-c27c-4ab5-9341-4ce63922eb7e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:22.108269 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 953/1936] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:01:22.118469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b8a2-570a-48ce-843b-e4ac50c20551 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.118770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b8a2-570a-48ce-843b-e4ac50c20551 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.119101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b8a2-570a-48ce-843b-e4ac50c20551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.135073 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:22.142745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-18e9b8a2-570a-48ce-843b-e4ac50c20551 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:22.144359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-18e9b8a2-570a-48ce-843b-e4ac50c20551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:22.153409 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 954/1937] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:22.154070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4d346-c27c-4ab5-9341-4ce63922eb7e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:22.157339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9b8a2-570a-48ce-843b-e4ac50c20551 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:22.160326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4778d-2794-4cd8-bd18-c91c560ea6e1 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde801ec66f4431492865e8cac8d89a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa8cdaf694648d985c75921b6a43816', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:22.161093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4778d-2794-4cd8-bd18-c91c560ea6e1 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.161447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4778d-2794-4cd8-bd18-c91c560ea6e1 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.161942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4778d-2794-4cd8-bd18-c91c560ea6e1 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] PATH_INFO: `/v3/projects/a0d11ee6626d4880a518d6eabf565d84` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.163173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4778d-2794-4cd8-bd18-c91c560ea6e1 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] RBAC: Authorizing `identity:get_project(project_id=a0d11ee6626d4880a518d6eabf565d84)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:22.165288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4778d-2794-4cd8-bd18-c91c560ea6e1 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:22.167621 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 984/1938] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:21 2022] GET /identity/v3/projects/a0d11ee6626d4880a518d6eabf565d84 => generated 377 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:22.168207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9b8a2-570a-48ce-843b-e4ac50c20551 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:22.173933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3714e8-8bae-48db-98f6-d6e5b035a6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:22.175430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3714e8-8bae-48db-98f6-d6e5b035a6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.175430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3714e8-8bae-48db-98f6-d6e5b035a6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.175430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3714e8-8bae-48db-98f6-d6e5b035a6b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.175925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3714e8-8bae-48db-98f6-d6e5b035a6b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:22.176233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3714e8-8bae-48db-98f6-d6e5b035a6b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:22.177821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3714e8-8bae-48db-98f6-d6e5b035a6b5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:22.198850 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 955/1939] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:01:22.199738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4778d-2794-4cd8-bd18-c91c560ea6e1 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:22.212133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4778d-2794-4cd8-bd18-c91c560ea6e1 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:22.217288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b8e1c-042c-4eb2-91da-456c02bb5717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:22.218028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8e1c-042c-4eb2-91da-456c02bb5717 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.218409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8e1c-042c-4eb2-91da-456c02bb5717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.218783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8e1c-042c-4eb2-91da-456c02bb5717 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.219554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b8e1c-042c-4eb2-91da-456c02bb5717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:22.222203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b8e1c-042c-4eb2-91da-456c02bb5717 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:22.255676 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 985/1940] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:22 2022] POST /identity/v3/projects => generated 409 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:22.256866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3714e8-8bae-48db-98f6-d6e5b035a6b5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:22.267518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3714e8-8bae-48db-98f6-d6e5b035a6b5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:22.287220 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:22.342849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510ac4d-2123-494c-86a3-a5dac8afc996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:22.343524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510ac4d-2123-494c-86a3-a5dac8afc996 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.343800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510ac4d-2123-494c-86a3-a5dac8afc996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.344070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510ac4d-2123-494c-86a3-a5dac8afc996 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.344702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510ac4d-2123-494c-86a3-a5dac8afc996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:22.346949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510ac4d-2123-494c-86a3-a5dac8afc996 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:22.379947 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 956/1941] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:22 2022] POST /identity/v3/users => generated 305 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:22.381267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b8e1c-042c-4eb2-91da-456c02bb5717 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:22.392352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b8e1c-042c-4eb2-91da-456c02bb5717 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:22.397850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e1f5b-736a-4c9d-bb3b-8d1d81ed6862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:22.398573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e1f5b-736a-4c9d-bb3b-8d1d81ed6862 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.398984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e1f5b-736a-4c9d-bb3b-8d1d81ed6862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.399441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e1f5b-736a-4c9d-bb3b-8d1d81ed6862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.400099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e1f5b-736a-4c9d-bb3b-8d1d81ed6862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:22.401992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e1f5b-736a-4c9d-bb3b-8d1d81ed6862 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:22.419922 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 986/1942] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:22.422013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510ac4d-2123-494c-86a3-a5dac8afc996 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:22.433292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510ac4d-2123-494c-86a3-a5dac8afc996 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:22.438458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b821a5-8565-4c40-bfc6-4a92285c06c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:22.439139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b821a5-8565-4c40-bfc6-4a92285c06c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.439419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b821a5-8565-4c40-bfc6-4a92285c06c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.441212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b821a5-8565-4c40-bfc6-4a92285c06c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.441728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b821a5-8565-4c40-bfc6-4a92285c06c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:22.443566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b821a5-8565-4c40-bfc6-4a92285c06c0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:22.473194 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 957/1943] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:22.474022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741f15-fa6f-42e5-9097-5602e11d3182 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.474370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741f15-fa6f-42e5-9097-5602e11d3182 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.474707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741f15-fa6f-42e5-9097-5602e11d3182 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.476212 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 987/1944] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:22.477879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b821a5-8565-4c40-bfc6-4a92285c06c0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:22.481284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90741f15-fa6f-42e5-9097-5602e11d3182 None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:22.483295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-90741f15-fa6f-42e5-9097-5602e11d3182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:22.502026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b821a5-8565-4c40-bfc6-4a92285c06c0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:22.507929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c401e86-55a9-4a81-a97d-17de11576770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:22.508605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c401e86-55a9-4a81-a97d-17de11576770 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.508887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c401e86-55a9-4a81-a97d-17de11576770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.509155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c401e86-55a9-4a81-a97d-17de11576770 admin admin] PATH_INFO: `/v3/projects/914ef2056b2c46de8a01372e1a071f50/users/2449bc319a574b8f8ac34ec117a3e4d9/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.527196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c401e86-55a9-4a81-a97d-17de11576770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914ef2056b2c46de8a01372e1a071f50, user_id=2449bc319a574b8f8ac34ec117a3e4d9, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:22.530215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c401e86-55a9-4a81-a97d-17de11576770 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:22.563281 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 958/1945] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:22 2022] PUT /identity/v3/projects/914ef2056b2c46de8a01372e1a071f50/users/2449bc319a574b8f8ac34ec117a3e4d9/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:22.574120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f7328-f42b-4e57-bdd0-846cd4f1097d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.574404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f7328-f42b-4e57-bdd0-846cd4f1097d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.574693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f7328-f42b-4e57-bdd0-846cd4f1097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.599870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90741f15-fa6f-42e5-9097-5602e11d3182 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:22.603486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-90741f15-fa6f-42e5-9097-5602e11d3182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:22.607219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-273f7328-f42b-4e57-bdd0-846cd4f1097d None None] MFA Rules not processed for user `2449bc319a574b8f8ac34ec117a3e4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:22.608401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-273f7328-f42b-4e57-bdd0-846cd4f1097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:22.690666 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 959/1946] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:22 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:22.695365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f7328-f42b-4e57-bdd0-846cd4f1097d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:22.701295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90741f15-fa6f-42e5-9097-5602e11d3182 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:22.764063 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:22.786510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f7328-f42b-4e57-bdd0-846cd4f1097d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:22.787056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040de74-8747-4f76-a82e-f8bdceaa830c tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9ba2cd18e3642f19918ecce32965fb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28bc2644be594aa08a5bbb29507b196c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:22.787833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040de74-8747-4f76-a82e-f8bdceaa830c tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.788133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040de74-8747-4f76-a82e-f8bdceaa830c tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.788415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040de74-8747-4f76-a82e-f8bdceaa830c tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] PATH_INFO: `/v3/projects/5267a09ec9a540a7a0400700f8bceb80` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.792224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ae28b-2f74-47fe-bb7b-d05a2aee4629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:22.793061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ae28b-2f74-47fe-bb7b-d05a2aee4629 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.793518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ae28b-2f74-47fe-bb7b-d05a2aee4629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.793966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ae28b-2f74-47fe-bb7b-d05a2aee4629 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.795036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ae28b-2f74-47fe-bb7b-d05a2aee4629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:22.797127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ae28b-2f74-47fe-bb7b-d05a2aee4629 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:22.805751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040de74-8747-4f76-a82e-f8bdceaa830c tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorizing `identity:get_project(project_id=5267a09ec9a540a7a0400700f8bceb80)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:22.807928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040de74-8747-4f76-a82e-f8bdceaa830c tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:22.809754 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 988/1947] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:22 2022] GET /identity/v3/projects/5267a09ec9a540a7a0400700f8bceb80 => generated 381 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:01:22.812997 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:22.852140 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 960/1948] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:22 2022] POST /identity/v3/projects => generated 407 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:22.854702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040de74-8747-4f76-a82e-f8bdceaa830c tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:22.869559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040de74-8747-4f76-a82e-f8bdceaa830c tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:22.974636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a42a-a710-4c6c-8715-4c2c41fdf38e None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.974979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a42a-a710-4c6c-8715-4c2c41fdf38e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.975235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a42a-a710-4c6c-8715-4c2c41fdf38e None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.976566 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 961/1949] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:22.979125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee1ae8-6c38-40fa-bdca-81b68655d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:22.979741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee1ae8-6c38-40fa-bdca-81b68655d4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:22.980020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee1ae8-6c38-40fa-bdca-81b68655d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:22.980291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee1ae8-6c38-40fa-bdca-81b68655d4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:22.981225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee1ae8-6c38-40fa-bdca-81b68655d4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:22.981818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a42a-a710-4c6c-8715-4c2c41fdf38e None None] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:22.983402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee1ae8-6c38-40fa-bdca-81b68655d4c6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:23.021836 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 989/1950] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:22 2022] POST /identity/v3/users => generated 310 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:23.026997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee1ae8-6c38-40fa-bdca-81b68655d4c6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:23.053894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee1ae8-6c38-40fa-bdca-81b68655d4c6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:23.060798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed5c38-770b-41af-a326-f5e89f06d9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:23.061412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed5c38-770b-41af-a326-f5e89f06d9ba admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:23.061691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed5c38-770b-41af-a326-f5e89f06d9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:23.061961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed5c38-770b-41af-a326-f5e89f06d9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:23.062699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed5c38-770b-41af-a326-f5e89f06d9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:23.064324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed5c38-770b-41af-a326-f5e89f06d9ba admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:23.077355 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 990/1951] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:23.082411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed5c38-770b-41af-a326-f5e89f06d9ba admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:23.094356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed5c38-770b-41af-a326-f5e89f06d9ba admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:23.100877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cc00e-583c-4f89-ab3a-cebd7ba88310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:23.101671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cc00e-583c-4f89-ab3a-cebd7ba88310 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:23.102224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cc00e-583c-4f89-ab3a-cebd7ba88310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:23.102582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cc00e-583c-4f89-ab3a-cebd7ba88310 admin admin] PATH_INFO: `/v3/projects/53b379ac62c349109ec9613e2e938f6e/users/e78527760c384f85b7709522c1c0f14b/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:23.124572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cc00e-583c-4f89-ab3a-cebd7ba88310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b379ac62c349109ec9613e2e938f6e, user_id=e78527760c384f85b7709522c1c0f14b, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:23.128764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a42a-a710-4c6c-8715-4c2c41fdf38e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:23.129282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cc00e-583c-4f89-ab3a-cebd7ba88310 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:23.149436 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 991/1952] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:23 2022] PUT /identity/v3/projects/53b379ac62c349109ec9613e2e938f6e/users/e78527760c384f85b7709522c1c0f14b/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:23.153848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cc00e-583c-4f89-ab3a-cebd7ba88310 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:23.208688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a42a-a710-4c6c-8715-4c2c41fdf38e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:23.233425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cc00e-583c-4f89-ab3a-cebd7ba88310 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:23.242346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80617b0-5507-4b8f-961f-2ef24c08889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:23.243669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80617b0-5507-4b8f-961f-2ef24c08889d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:23.244321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80617b0-5507-4b8f-961f-2ef24c08889d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:23.244896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80617b0-5507-4b8f-961f-2ef24c08889d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:23.245831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80617b0-5507-4b8f-961f-2ef24c08889d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:23.249209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80617b0-5507-4b8f-961f-2ef24c08889d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:23.263685 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 992/1953] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:23.265513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80617b0-5507-4b8f-961f-2ef24c08889d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:23.277505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2f1ec-a481-4aaf-8a04-6440a652fcb6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9ba2cd18e3642f19918ecce32965fb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28bc2644be594aa08a5bbb29507b196c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:23.278163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f1ec-a481-4aaf-8a04-6440a652fcb6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:23.278386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80617b0-5507-4b8f-961f-2ef24c08889d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:23.278533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f1ec-a481-4aaf-8a04-6440a652fcb6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:23.278705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f1ec-a481-4aaf-8a04-6440a652fcb6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] PATH_INFO: `/v3/projects/5267a09ec9a540a7a0400700f8bceb80` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:23.281021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2f1ec-a481-4aaf-8a04-6440a652fcb6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorizing `identity:get_project(project_id=5267a09ec9a540a7a0400700f8bceb80)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:23.283480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2f1ec-a481-4aaf-8a04-6440a652fcb6 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:23.285624 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 962/1954] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:22 2022] GET /identity/v3/projects/5267a09ec9a540a7a0400700f8bceb80 => generated 381 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:01:23.288076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543b7e8-f2ac-4660-81d3-6915c29e256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:23.288728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543b7e8-f2ac-4660-81d3-6915c29e256b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:23.289009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543b7e8-f2ac-4660-81d3-6915c29e256b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:23.289312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543b7e8-f2ac-4660-81d3-6915c29e256b admin admin] PATH_INFO: `/v3/projects/53b379ac62c349109ec9613e2e938f6e/users/e78527760c384f85b7709522c1c0f14b/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:23.291333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543b7e8-f2ac-4660-81d3-6915c29e256b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b379ac62c349109ec9613e2e938f6e, user_id=e78527760c384f85b7709522c1c0f14b, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:23.294224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543b7e8-f2ac-4660-81d3-6915c29e256b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:23.306630 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 993/1955] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:23 2022] PUT /identity/v3/projects/53b379ac62c349109ec9613e2e938f6e/users/e78527760c384f85b7709522c1c0f14b/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:23.318401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93739a2b-8b5b-4d82-be4e-142de283ca88 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:23.318828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93739a2b-8b5b-4d82-be4e-142de283ca88 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:23.319207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93739a2b-8b5b-4d82-be4e-142de283ca88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:23.346466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999c42f-3f4d-48ae-ba77-c54aac2c1725 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:23.347746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999c42f-3f4d-48ae-ba77-c54aac2c1725 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:23.348298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999c42f-3f4d-48ae-ba77-c54aac2c1725 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:23.349844 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 994/1956] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:01:23.351007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-93739a2b-8b5b-4d82-be4e-142de283ca88 None None] MFA Rules not processed for user `e78527760c384f85b7709522c1c0f14b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:23.352319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-93739a2b-8b5b-4d82-be4e-142de283ca88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:23.355541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999c42f-3f4d-48ae-ba77-c54aac2c1725 None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:23.380749 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:23.423325 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:23.466168 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 963/1957] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:23 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:23.470460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999c42f-3f4d-48ae-ba77-c54aac2c1725 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:23.536242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999c42f-3f4d-48ae-ba77-c54aac2c1725 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:23.541252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cdcfe-61fd-4ae5-8f56-6b884f920082 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9ba2cd18e3642f19918ecce32965fb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28bc2644be594aa08a5bbb29507b196c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:23.542147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cdcfe-61fd-4ae5-8f56-6b884f920082 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:23.542437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cdcfe-61fd-4ae5-8f56-6b884f920082 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:23.543151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cdcfe-61fd-4ae5-8f56-6b884f920082 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] PATH_INFO: `/v3/projects/5267a09ec9a540a7a0400700f8bceb80` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:23.546997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cdcfe-61fd-4ae5-8f56-6b884f920082 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorizing `identity:get_project(project_id=5267a09ec9a540a7a0400700f8bceb80)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:23.546997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cdcfe-61fd-4ae5-8f56-6b884f920082 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:23.547833 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 995/1958] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:23 2022] GET /identity/v3/projects/5267a09ec9a540a7a0400700f8bceb80 => generated 381 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:01:23.664062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93739a2b-8b5b-4d82-be4e-142de283ca88 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:23.665892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-93739a2b-8b5b-4d82-be4e-142de283ca88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:23.668471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cdcfe-61fd-4ae5-8f56-6b884f920082 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:23.685192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cdcfe-61fd-4ae5-8f56-6b884f920082 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:23.691553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bfb56-3046-448d-923b-8d0f56c46426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:23.692628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bfb56-3046-448d-923b-8d0f56c46426 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:23.693418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bfb56-3046-448d-923b-8d0f56c46426 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:23.693906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bfb56-3046-448d-923b-8d0f56c46426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:23.704434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bfb56-3046-448d-923b-8d0f56c46426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:23.706327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bfb56-3046-448d-923b-8d0f56c46426 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:23.716388 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 996/1959] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:23 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:23.720883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121d1ec-f5cf-43f9-a341-abe63bca6504 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:23.721170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121d1ec-f5cf-43f9-a341-abe63bca6504 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:23.722702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121d1ec-f5cf-43f9-a341-abe63bca6504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:23.746565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5121d1ec-f5cf-43f9-a341-abe63bca6504 None None] MFA Rules not processed for user `dd6cb0f17cf24e8cac44ff9ec732146a`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:23.747589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93739a2b-8b5b-4d82-be4e-142de283ca88 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:23.747828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5121d1ec-f5cf-43f9-a341-abe63bca6504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:23.752135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5d13c-0035-49a6-8ddd-3a26308b44d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:23.753710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5d13c-0035-49a6-8ddd-3a26308b44d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:23.753993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5d13c-0035-49a6-8ddd-3a26308b44d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:23.754262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5d13c-0035-49a6-8ddd-3a26308b44d1 admin admin] PATH_INFO: `/v3/users/7000f45b2a3b4c6a988dd72e0c92aa23` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:23.755463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5d13c-0035-49a6-8ddd-3a26308b44d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7000f45b2a3b4c6a988dd72e0c92aa23)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:23.757365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5d13c-0035-49a6-8ddd-3a26308b44d1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:23.809936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e8a5d13c-0035-49a6-8ddd-3a26308b44d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7000f45b2a3b4c6a988dd72e0c92aa23'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:23.810684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e8a5d13c-0035-49a6-8ddd-3a26308b44d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7000f45b2a3b4c6a988dd72e0c92aa23'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:23.813887 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 997/1960] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:23.814735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121d1ec-f5cf-43f9-a341-abe63bca6504 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:23.819682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5121d1ec-f5cf-43f9-a341-abe63bca6504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:23.828615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e8a5d13c-0035-49a6-8ddd-3a26308b44d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7000f45b2a3b4c6a988dd72e0c92aa23'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:23.836239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121d1ec-f5cf-43f9-a341-abe63bca6504 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:23.839211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e8a5d13c-0035-49a6-8ddd-3a26308b44d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7000f45b2a3b4c6a988dd72e0c92aa23'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:23.843728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2e2d0-b16f-4a9a-8c72-d27d32f09756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:23.844343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2e2d0-b16f-4a9a-8c72-d27d32f09756 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:23.844621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2e2d0-b16f-4a9a-8c72-d27d32f09756 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:23.844887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2e2d0-b16f-4a9a-8c72-d27d32f09756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:23.847056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e8a5d13c-0035-49a6-8ddd-3a26308b44d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7000f45b2a3b4c6a988dd72e0c92aa23'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:23.847245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-71a2e2d0-b16f-4a9a-8c72-d27d32f09756 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:23.862943 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 964/1961] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:23 2022] DELETE /identity/v3/users/7000f45b2a3b4c6a988dd72e0c92aa23 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:23.867448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455842b8-ba71-428f-87ee-8bfb5a8ecd56 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:23.870492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455842b8-ba71-428f-87ee-8bfb5a8ecd56 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:23.870492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455842b8-ba71-428f-87ee-8bfb5a8ecd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:23.888408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-455842b8-ba71-428f-87ee-8bfb5a8ecd56 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:23.890129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-455842b8-ba71-428f-87ee-8bfb5a8ecd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:23.927901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2e2d0-b16f-4a9a-8c72-d27d32f09756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:23.929765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2e2d0-b16f-4a9a-8c72-d27d32f09756 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:23.933647 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:23.943238 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 998/1962] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:23 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:23.978405 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 965/1963] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:01:24.021400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2e2d0-b16f-4a9a-8c72-d27d32f09756 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:24.022851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-71a2e2d0-b16f-4a9a-8c72-d27d32f09756 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:24.030783 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:24.064520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455842b8-ba71-428f-87ee-8bfb5a8ecd56 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:24.066127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-455842b8-ba71-428f-87ee-8bfb5a8ecd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:24.124155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2e2d0-b16f-4a9a-8c72-d27d32f09756 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:24.156771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455842b8-ba71-428f-87ee-8bfb5a8ecd56 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:24.165479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221355f0-4e38-4958-b97f-8c2eba131c89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:24.166161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221355f0-4e38-4958-b97f-8c2eba131c89 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:24.166451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221355f0-4e38-4958-b97f-8c2eba131c89 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:24.166752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221355f0-4e38-4958-b97f-8c2eba131c89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:24.169034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-221355f0-4e38-4958-b97f-8c2eba131c89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:24.196985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e56128-2b2e-46a1-b67c-48a86c34e74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:24.207750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e56128-2b2e-46a1-b67c-48a86c34e74e service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:24.208122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e56128-2b2e-46a1-b67c-48a86c34e74e service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:24.208290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e56128-2b2e-46a1-b67c-48a86c34e74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:24.218721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e56128-2b2e-46a1-b67c-48a86c34e74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:24.220126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e56128-2b2e-46a1-b67c-48a86c34e74e service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:24.231558 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 999/1964] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:24.242408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221355f0-4e38-4958-b97f-8c2eba131c89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:24.244117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221355f0-4e38-4958-b97f-8c2eba131c89 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:24.254573 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 966/1965] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:24 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:01:25.154346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e56128-2b2e-46a1-b67c-48a86c34e74e service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:25.156439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05e56128-2b2e-46a1-b67c-48a86c34e74e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:25.184087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e56128-2b2e-46a1-b67c-48a86c34e74e service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:25.197805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a894fb-2038-4303-8065-54558ec9490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:25.198539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a894fb-2038-4303-8065-54558ec9490d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:25.198883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a894fb-2038-4303-8065-54558ec9490d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:25.199256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a894fb-2038-4303-8065-54558ec9490d admin admin] PATH_INFO: `/v3/projects/a0d11ee6626d4880a518d6eabf565d84` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:25.200469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a894fb-2038-4303-8065-54558ec9490d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d11ee6626d4880a518d6eabf565d84)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:25.202437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a894fb-2038-4303-8065-54558ec9490d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:25.284964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75a894fb-2038-4303-8065-54558ec9490d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d11ee6626d4880a518d6eabf565d84', 'request_id': 'req-75a894fb-2038-4303-8065-54558ec9490d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.292551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75a894fb-2038-4303-8065-54558ec9490d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d11ee6626d4880a518d6eabf565d84', 'request_id': 'req-75a894fb-2038-4303-8065-54558ec9490d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.304836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75a894fb-2038-4303-8065-54558ec9490d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d11ee6626d4880a518d6eabf565d84', 'request_id': 'req-75a894fb-2038-4303-8065-54558ec9490d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.322522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75a894fb-2038-4303-8065-54558ec9490d admin admin] The token cache is being invalidate because project a0d11ee6626d4880a518d6eabf565d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:25.322877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75a894fb-2038-4303-8065-54558ec9490d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.323520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75a894fb-2038-4303-8065-54558ec9490d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.330941 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1000/1966] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:25 2022] DELETE /identity/v3/projects/a0d11ee6626d4880a518d6eabf565d84 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:25.331303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221355f0-4e38-4958-b97f-8c2eba131c89 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:25.363132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221355f0-4e38-4958-b97f-8c2eba131c89 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:25.435067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:25.436615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:25.436615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:25.436615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] PATH_INFO: `/v3/users/dde801ec66f4431492865e8cac8d89a1` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:25.437830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde801ec66f4431492865e8cac8d89a1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:25.440202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:25.455327 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:25.523961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde801ec66f4431492865e8cac8d89a1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.525081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde801ec66f4431492865e8cac8d89a1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.569194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e5747-0ed2-4fb8-8874-85d220f07ad7 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:25.569465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde801ec66f4431492865e8cac8d89a1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.569591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e5747-0ed2-4fb8-8874-85d220f07ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:25.570149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e5747-0ed2-4fb8-8874-85d220f07ad7 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:25.571806 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1001/1967] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 01:01:25.579515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e5747-0ed2-4fb8-8874-85d220f07ad7 None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:01:25.582784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-048e5747-0ed2-4fb8-8874-85d220f07ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:25.585663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde801ec66f4431492865e8cac8d89a1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.586501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde801ec66f4431492865e8cac8d89a1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.609351 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 967/1968] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:25 2022] DELETE /identity/v3/users/dde801ec66f4431492865e8cac8d89a1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:25.630072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:25.632962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:25.720025 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:25.734593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e394a-7a05-419a-8dbd-813718f1774b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:25.741529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57885622-f85e-41e1-a0cb-9619c50748ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:25.742177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57885622-f85e-41e1-a0cb-9619c50748ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:25.742518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57885622-f85e-41e1-a0cb-9619c50748ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:25.742776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57885622-f85e-41e1-a0cb-9619c50748ff admin admin] PATH_INFO: `/v3/users/2449bc319a574b8f8ac34ec117a3e4d9` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:25.744161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57885622-f85e-41e1-a0cb-9619c50748ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=2449bc319a574b8f8ac34ec117a3e4d9)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:25.746398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57885622-f85e-41e1-a0cb-9619c50748ff admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:25.797963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e5747-0ed2-4fb8-8874-85d220f07ad7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:25.806102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-048e5747-0ed2-4fb8-8874-85d220f07ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:25.855721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-57885622-f85e-41e1-a0cb-9619c50748ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2449bc319a574b8f8ac34ec117a3e4d9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.858806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-57885622-f85e-41e1-a0cb-9619c50748ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2449bc319a574b8f8ac34ec117a3e4d9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.884333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-57885622-f85e-41e1-a0cb-9619c50748ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2449bc319a574b8f8ac34ec117a3e4d9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.898285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-57885622-f85e-41e1-a0cb-9619c50748ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2449bc319a574b8f8ac34ec117a3e4d9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.900234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-57885622-f85e-41e1-a0cb-9619c50748ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2449bc319a574b8f8ac34ec117a3e4d9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:25.935128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e5747-0ed2-4fb8-8874-85d220f07ad7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:25.956210 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 968/1969] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:25 2022] DELETE /identity/v3/users/2449bc319a574b8f8ac34ec117a3e4d9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:25.958178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a51b-d931-4c43-a407-2716bad63542 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:25.958466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a51b-d931-4c43-a407-2716bad63542 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:25.958786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a51b-d931-4c43-a407-2716bad63542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:26.010957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3a17a51b-d931-4c43-a407-2716bad63542 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:26.013986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a17a51b-d931-4c43-a407-2716bad63542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:26.020079 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:26.086063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cddb38-8d8a-4519-8187-38c2fab8efdf tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9ba2cd18e3642f19918ecce32965fb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28bc2644be594aa08a5bbb29507b196c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:26.088940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cddb38-8d8a-4519-8187-38c2fab8efdf tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:26.089297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cddb38-8d8a-4519-8187-38c2fab8efdf tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:26.089501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cddb38-8d8a-4519-8187-38c2fab8efdf tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] PATH_INFO: `/v3/projects/5267a09ec9a540a7a0400700f8bceb80` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:26.090869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cddb38-8d8a-4519-8187-38c2fab8efdf tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorizing `identity:get_project(project_id=5267a09ec9a540a7a0400700f8bceb80)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:26.094005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cddb38-8d8a-4519-8187-38c2fab8efdf tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:26.103701 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1002/1970] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:01:25 2022] GET /identity/v3/projects/5267a09ec9a540a7a0400700f8bceb80 => generated 381 bytes in 519 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:01:26.152656 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 969/1971] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:26.163294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cddb38-8d8a-4519-8187-38c2fab8efdf tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:26.165762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a2cddb38-8d8a-4519-8187-38c2fab8efdf tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:26.273620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cddb38-8d8a-4519-8187-38c2fab8efdf tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:26.331601 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:26.338961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95bc2e-7fec-4b39-b474-5ad6d34dfa30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:26.340035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95bc2e-7fec-4b39-b474-5ad6d34dfa30 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:26.340726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95bc2e-7fec-4b39-b474-5ad6d34dfa30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:26.341246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95bc2e-7fec-4b39-b474-5ad6d34dfa30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:26.361492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95bc2e-7fec-4b39-b474-5ad6d34dfa30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:26.365967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95bc2e-7fec-4b39-b474-5ad6d34dfa30 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:26.397670 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1003/1972] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:26.573647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17a51b-d931-4c43-a407-2716bad63542 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:26.575242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a17a51b-d931-4c43-a407-2716bad63542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:26.611260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17a51b-d931-4c43-a407-2716bad63542 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:26.619634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:26.620471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:26.621298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:26.621653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] PATH_INFO: `/v3/projects/7aa8cdaf694648d985c75921b6a43816` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:26.623168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aa8cdaf694648d985c75921b6a43816)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:26.625742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:26.742321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95bc2e-7fec-4b39-b474-5ad6d34dfa30 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:26.748726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4e95bc2e-7fec-4b39-b474-5ad6d34dfa30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:26.766995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa8cdaf694648d985c75921b6a43816', 'request_id': 'req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:26.783365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa8cdaf694648d985c75921b6a43816', 'request_id': 'req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:26.792705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95bc2e-7fec-4b39-b474-5ad6d34dfa30 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:26.804187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa8cdaf694648d985c75921b6a43816', 'request_id': 'req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:26.831663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] The token cache is being invalidate because project 7aa8cdaf694648d985c75921b6a43816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:26.832372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:26.832919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:26.834903 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 970/1973] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:26 2022] DELETE /identity/v3/projects/7aa8cdaf694648d985c75921b6a43816 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:26.835893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:26.844808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:26.872584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323e196-7253-407d-8a88-4acafe3738b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:26.873224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323e196-7253-407d-8a88-4acafe3738b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:26.873498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323e196-7253-407d-8a88-4acafe3738b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:26.873866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323e196-7253-407d-8a88-4acafe3738b6 admin admin] PATH_INFO: `/v3/projects/914ef2056b2c46de8a01372e1a071f50` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:26.875153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323e196-7253-407d-8a88-4acafe3738b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914ef2056b2c46de8a01372e1a071f50)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:26.877458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323e196-7253-407d-8a88-4acafe3738b6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:26.933822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f7784-6cf9-4c95-81bb-2280f0aae6e7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:26.935840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b323e196-7253-407d-8a88-4acafe3738b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914ef2056b2c46de8a01372e1a071f50', 'request_id': 'req-b323e196-7253-407d-8a88-4acafe3738b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:26.943764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b323e196-7253-407d-8a88-4acafe3738b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914ef2056b2c46de8a01372e1a071f50', 'request_id': 'req-b323e196-7253-407d-8a88-4acafe3738b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:26.952881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b323e196-7253-407d-8a88-4acafe3738b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914ef2056b2c46de8a01372e1a071f50', 'request_id': 'req-b323e196-7253-407d-8a88-4acafe3738b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:26.968387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b323e196-7253-407d-8a88-4acafe3738b6 admin admin] The token cache is being invalidate because project 914ef2056b2c46de8a01372e1a071f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:26.968808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b323e196-7253-407d-8a88-4acafe3738b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:26.970409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b323e196-7253-407d-8a88-4acafe3738b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:26.973757 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1004/1974] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:26 2022] DELETE /identity/v3/projects/914ef2056b2c46de8a01372e1a071f50 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:26.977753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75e09-7d33-469b-9f85-904419073b48 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:26.977753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75e09-7d33-469b-9f85-904419073b48 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:26.977753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75e09-7d33-469b-9f85-904419073b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:26.980406 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:27.010293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ca644-9aff-4177-9130-06763b0f84f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:27.010293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca644-9aff-4177-9130-06763b0f84f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:27.010293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca644-9aff-4177-9130-06763b0f84f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:27.010293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca644-9aff-4177-9130-06763b0f84f2 admin admin] PATH_INFO: `/v3/users/dd6cb0f17cf24e8cac44ff9ec732146a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:27.010756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ca644-9aff-4177-9130-06763b0f84f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd6cb0f17cf24e8cac44ff9ec732146a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:27.010756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ca644-9aff-4177-9130-06763b0f84f2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:27.023639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-11a75e09-7d33-469b-9f85-904419073b48 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:27.024947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-11a75e09-7d33-469b-9f85-904419073b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:27.054168 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1005/1975] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:27.057589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a75e09-7d33-469b-9f85-904419073b48 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:27.057737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-11a75e09-7d33-469b-9f85-904419073b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:27.083517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a75e09-7d33-469b-9f85-904419073b48 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:27.089290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd313b7-d9f8-4fa1-bdb8-8958e77166c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:27.089847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd313b7-d9f8-4fa1-bdb8-8958e77166c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:27.090123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd313b7-d9f8-4fa1-bdb8-8958e77166c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:27.090526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd313b7-d9f8-4fa1-bdb8-8958e77166c5 admin admin] PATH_INFO: `/v3/users/e78527760c384f85b7709522c1c0f14b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:27.091819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd313b7-d9f8-4fa1-bdb8-8958e77166c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78527760c384f85b7709522c1c0f14b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:27.094741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd313b7-d9f8-4fa1-bdb8-8958e77166c5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:27.118427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-907ca644-9aff-4177-9130-06763b0f84f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd6cb0f17cf24e8cac44ff9ec732146a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.119218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-907ca644-9aff-4177-9130-06763b0f84f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd6cb0f17cf24e8cac44ff9ec732146a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.145267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-907ca644-9aff-4177-9130-06763b0f84f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd6cb0f17cf24e8cac44ff9ec732146a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.157552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-907ca644-9aff-4177-9130-06763b0f84f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd6cb0f17cf24e8cac44ff9ec732146a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.158332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-907ca644-9aff-4177-9130-06763b0f84f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd6cb0f17cf24e8cac44ff9ec732146a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.169598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3bd313b7-d9f8-4fa1-bdb8-8958e77166c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78527760c384f85b7709522c1c0f14b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.170474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3bd313b7-d9f8-4fa1-bdb8-8958e77166c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78527760c384f85b7709522c1c0f14b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.179511 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 971/1976] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:26 2022] DELETE /identity/v3/users/dd6cb0f17cf24e8cac44ff9ec732146a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:27.183108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7228fda-7844-4969-8a55-33448eb82823 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:27.183610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7228fda-7844-4969-8a55-33448eb82823 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:27.184195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7228fda-7844-4969-8a55-33448eb82823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:27.191701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3bd313b7-d9f8-4fa1-bdb8-8958e77166c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78527760c384f85b7709522c1c0f14b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.194422 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:27.208457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3bd313b7-d9f8-4fa1-bdb8-8958e77166c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78527760c384f85b7709522c1c0f14b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.209146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3bd313b7-d9f8-4fa1-bdb8-8958e77166c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78527760c384f85b7709522c1c0f14b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.230274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b7228fda-7844-4969-8a55-33448eb82823 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:27.231577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b7228fda-7844-4969-8a55-33448eb82823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:27.232560 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1006/1977] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:27 2022] DELETE /identity/v3/users/e78527760c384f85b7709522c1c0f14b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:27.234398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258de20-dbb7-480a-b9ea-6689d78a33f0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:27.234800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258de20-dbb7-480a-b9ea-6689d78a33f0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:27.235221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258de20-dbb7-480a-b9ea-6689d78a33f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:27.260797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1258de20-dbb7-480a-b9ea-6689d78a33f0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:27.262206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1258de20-dbb7-480a-b9ea-6689d78a33f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:27.353331 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1007/1978] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:27.368594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258de20-dbb7-480a-b9ea-6689d78a33f0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:27.370730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1258de20-dbb7-480a-b9ea-6689d78a33f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:27.401852 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 972/1979] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:27.403592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bfcde-3f87-42ce-a218-e409906a3c7e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:27.403881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bfcde-3f87-42ce-a218-e409906a3c7e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:27.404262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bfcde-3f87-42ce-a218-e409906a3c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:27.428706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3f4bfcde-3f87-42ce-a218-e409906a3c7e None None] MFA Rules not processed for user `5f46ddd0268d44bfacff0400e3f38e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:27.430166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3f4bfcde-3f87-42ce-a218-e409906a3c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:27.451426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258de20-dbb7-480a-b9ea-6689d78a33f0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:27.457121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc76374-e2a9-4ed6-8a15-192227a579fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:27.458186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc76374-e2a9-4ed6-8a15-192227a579fd service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:27.458573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc76374-e2a9-4ed6-8a15-192227a579fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:27.458967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc76374-e2a9-4ed6-8a15-192227a579fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:27.471044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc76374-e2a9-4ed6-8a15-192227a579fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:27.471965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc76374-e2a9-4ed6-8a15-192227a579fd service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:27.493995 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1008/1980] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:27.500048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc76374-e2a9-4ed6-8a15-192227a579fd service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:27.516063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc76374-e2a9-4ed6-8a15-192227a579fd service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:27.521266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5574e0-00ad-45fd-b8ab-e67edd4d131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:27.522284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5574e0-00ad-45fd-b8ab-e67edd4d131a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:27.522670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5574e0-00ad-45fd-b8ab-e67edd4d131a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:27.523223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5574e0-00ad-45fd-b8ab-e67edd4d131a admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:27.523987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5574e0-00ad-45fd-b8ab-e67edd4d131a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:27.524471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5574e0-00ad-45fd-b8ab-e67edd4d131a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:27.526187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5574e0-00ad-45fd-b8ab-e67edd4d131a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:27.535771 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 973/1981] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:27.543611 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1009/1982] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:27.548221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bfcde-3f87-42ce-a218-e409906a3c7e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:27.557608 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:27.564787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bfcde-3f87-42ce-a218-e409906a3c7e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:27.573093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385cf96-2373-4f83-bb33-36572e0839a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:27.574722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385cf96-2373-4f83-bb33-36572e0839a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:27.575419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385cf96-2373-4f83-bb33-36572e0839a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:27.576342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385cf96-2373-4f83-bb33-36572e0839a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:27.577759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385cf96-2373-4f83-bb33-36572e0839a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:27.581138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385cf96-2373-4f83-bb33-36572e0839a3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:27.626898 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 974/1983] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:27 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:27.631233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5574e0-00ad-45fd-b8ab-e67edd4d131a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:27.647810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5574e0-00ad-45fd-b8ab-e67edd4d131a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:27.735679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ccf6b-90ff-48b6-9bd3-ca1c22c93e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:27.736339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ccf6b-90ff-48b6-9bd3-ca1c22c93e5c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:27.736613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ccf6b-90ff-48b6-9bd3-ca1c22c93e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:27.737428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ccf6b-90ff-48b6-9bd3-ca1c22c93e5c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:27.738082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ccf6b-90ff-48b6-9bd3-ca1c22c93e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:27.740059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ccf6b-90ff-48b6-9bd3-ca1c22c93e5c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:27.778811 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1010/1984] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:27 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:27.782998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385cf96-2373-4f83-bb33-36572e0839a3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:27.801329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ccf6b-90ff-48b6-9bd3-ca1c22c93e5c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:27.804058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385cf96-2373-4f83-bb33-36572e0839a3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:27.806083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-df1ccf6b-90ff-48b6-9bd3-ca1c22c93e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:27.816024 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:27.820918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703175e7-9c10-43af-ae87-c5c1a87c55b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:27.821553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703175e7-9c10-43af-ae87-c5c1a87c55b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:27.822351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703175e7-9c10-43af-ae87-c5c1a87c55b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:27.822351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703175e7-9c10-43af-ae87-c5c1a87c55b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:27.822730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703175e7-9c10-43af-ae87-c5c1a87c55b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:27.824813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703175e7-9c10-43af-ae87-c5c1a87c55b5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:27.830956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ccf6b-90ff-48b6-9bd3-ca1c22c93e5c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:27.844324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e9c64-3f9c-455e-9e90-ba95548436f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:27.845068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e9c64-3f9c-455e-9e90-ba95548436f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:27.845407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e9c64-3f9c-455e-9e90-ba95548436f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:27.845754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e9c64-3f9c-455e-9e90-ba95548436f9 admin admin] PATH_INFO: `/v3/projects/53b379ac62c349109ec9613e2e938f6e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:27.847678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e9c64-3f9c-455e-9e90-ba95548436f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b379ac62c349109ec9613e2e938f6e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:27.853029 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 975/1985] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:27.853165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e9c64-3f9c-455e-9e90-ba95548436f9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:27.855403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703175e7-9c10-43af-ae87-c5c1a87c55b5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:27.901720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703175e7-9c10-43af-ae87-c5c1a87c55b5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:27.910504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b566af-938d-4859-819a-981dc4ff573a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:27.911282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b566af-938d-4859-819a-981dc4ff573a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:27.911657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b566af-938d-4859-819a-981dc4ff573a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:27.912001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b566af-938d-4859-819a-981dc4ff573a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:27.912722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b566af-938d-4859-819a-981dc4ff573a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:27.914419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b566af-938d-4859-819a-981dc4ff573a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:27.921156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-768e9c64-3f9c-455e-9e90-ba95548436f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b379ac62c349109ec9613e2e938f6e', 'request_id': 'req-768e9c64-3f9c-455e-9e90-ba95548436f9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.929705 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 976/1986] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:27.929902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-768e9c64-3f9c-455e-9e90-ba95548436f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b379ac62c349109ec9613e2e938f6e', 'request_id': 'req-768e9c64-3f9c-455e-9e90-ba95548436f9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.930958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b566af-938d-4859-819a-981dc4ff573a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:27.939568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-768e9c64-3f9c-455e-9e90-ba95548436f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b379ac62c349109ec9613e2e938f6e', 'request_id': 'req-768e9c64-3f9c-455e-9e90-ba95548436f9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.942951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b566af-938d-4859-819a-981dc4ff573a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:27.959323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-768e9c64-3f9c-455e-9e90-ba95548436f9 admin admin] The token cache is being invalidate because project 53b379ac62c349109ec9613e2e938f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:27.959849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-768e9c64-3f9c-455e-9e90-ba95548436f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.960673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-768e9c64-3f9c-455e-9e90-ba95548436f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:27.962730 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1011/1987] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:27 2022] DELETE /identity/v3/projects/53b379ac62c349109ec9613e2e938f6e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:01:27.967278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336306-2dbe-458d-b8d3-ec0e8bfde824 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:27.968030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336306-2dbe-458d-b8d3-ec0e8bfde824 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:27.968429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336306-2dbe-458d-b8d3-ec0e8bfde824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:27.992823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5f336306-2dbe-458d-b8d3-ec0e8bfde824 None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:27.994339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5f336306-2dbe-458d-b8d3-ec0e8bfde824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:28.021058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ac413-80b5-4cbc-8eb0-cd7ad8732040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:28.022601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ac413-80b5-4cbc-8eb0-cd7ad8732040 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:28.022863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ac413-80b5-4cbc-8eb0-cd7ad8732040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:28.023158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ac413-80b5-4cbc-8eb0-cd7ad8732040 admin admin] PATH_INFO: `/v3/projects/4160d27bdc5a4fc485ef5565f3ccff83/users/674e0c4469b24aa5a31d944a223fbfbc/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:28.051399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ac413-80b5-4cbc-8eb0-cd7ad8732040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4160d27bdc5a4fc485ef5565f3ccff83, user_id=674e0c4469b24aa5a31d944a223fbfbc, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:28.057057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ac413-80b5-4cbc-8eb0-cd7ad8732040 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:28.080273 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1012/1988] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:01:28.082452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac1d43-9eb8-4d9c-8009-5a36b9c24d8b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:28.082717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac1d43-9eb8-4d9c-8009-5a36b9c24d8b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:28.083032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac1d43-9eb8-4d9c-8009-5a36b9c24d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:28.085989 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 977/1989] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:27 2022] PUT /identity/v3/projects/4160d27bdc5a4fc485ef5565f3ccff83/users/674e0c4469b24aa5a31d944a223fbfbc/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:28.087787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ac413-80b5-4cbc-8eb0-cd7ad8732040 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:28.090312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a33ac413-80b5-4cbc-8eb0-cd7ad8732040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:28.116166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-77ac1d43-9eb8-4d9c-8009-5a36b9c24d8b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:28.117499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-77ac1d43-9eb8-4d9c-8009-5a36b9c24d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:28.179182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ac413-80b5-4cbc-8eb0-cd7ad8732040 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:28.181273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:28.181921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:28.182256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:28.182531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] PATH_INFO: `/v3/projects/5267a09ec9a540a7a0400700f8bceb80` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:28.183754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5267a09ec9a540a7a0400700f8bceb80)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:28.185820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:28.221990 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1013/1990] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:28.223216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15547c-5a2f-4c66-aef4-faebab4ef9af None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:28.223499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15547c-5a2f-4c66-aef4-faebab4ef9af None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:28.223768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15547c-5a2f-4c66-aef4-faebab4ef9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:28.242200 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:28.247982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5267a09ec9a540a7a0400700f8bceb80', 'request_id': 'req-3692bc37-9a4b-4b2a-88de-fdf4b909492a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:28.255904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2e15547c-5a2f-4c66-aef4-faebab4ef9af None None] MFA Rules not processed for user `674e0c4469b24aa5a31d944a223fbfbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:28.257112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2e15547c-5a2f-4c66-aef4-faebab4ef9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:28.259253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5267a09ec9a540a7a0400700f8bceb80', 'request_id': 'req-3692bc37-9a4b-4b2a-88de-fdf4b909492a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:28.268217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5267a09ec9a540a7a0400700f8bceb80', 'request_id': 'req-3692bc37-9a4b-4b2a-88de-fdf4b909492a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:28.282726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] The token cache is being invalidate because project 5267a09ec9a540a7a0400700f8bceb80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:28.283054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:28.284306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:28.286718 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 978/1991] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:28 2022] DELETE /identity/v3/projects/5267a09ec9a540a7a0400700f8bceb80 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:28.288784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:28.290211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:28.290791 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:28.336569 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1014/1992] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:28.341608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce3950-ecd0-4332-bc53-a05109ded2c6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:28.341896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce3950-ecd0-4332-bc53-a05109ded2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:28.342171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce3950-ecd0-4332-bc53-a05109ded2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:28.359007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692bc37-9a4b-4b2a-88de-fdf4b909492a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:28.378122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-44ce3950-ecd0-4332-bc53-a05109ded2c6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:28.379054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2ddca-a1f2-462c-86b5-072ce27ff315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:28.379698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-44ce3950-ecd0-4332-bc53-a05109ded2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:28.379819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2ddca-a1f2-462c-86b5-072ce27ff315 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:28.380213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2ddca-a1f2-462c-86b5-072ce27ff315 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:28.380596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2ddca-a1f2-462c-86b5-072ce27ff315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:28.386693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3fd2ddca-a1f2-462c-86b5-072ce27ff315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:28.400564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2ddca-a1f2-462c-86b5-072ce27ff315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:28.402129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2ddca-a1f2-462c-86b5-072ce27ff315 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:28.413295 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 979/1993] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:28.414130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2ddca-a1f2-462c-86b5-072ce27ff315 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:28.416935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3fd2ddca-a1f2-462c-86b5-072ce27ff315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:28.467930 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1015/1994] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:28.472765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce3950-ecd0-4332-bc53-a05109ded2c6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:28.474349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-44ce3950-ecd0-4332-bc53-a05109ded2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:28.490008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce3950-ecd0-4332-bc53-a05109ded2c6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:28.495996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390002d5-99d0-4ffe-a0d4-d0acacdb7efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:28.496553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390002d5-99d0-4ffe-a0d4-d0acacdb7efd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:28.496973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390002d5-99d0-4ffe-a0d4-d0acacdb7efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:28.497248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390002d5-99d0-4ffe-a0d4-d0acacdb7efd admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:28.497939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390002d5-99d0-4ffe-a0d4-d0acacdb7efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:28.499955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390002d5-99d0-4ffe-a0d4-d0acacdb7efd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:28.519667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2ddca-a1f2-462c-86b5-072ce27ff315 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:28.525560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:28.526223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:28.526497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:28.526837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] PATH_INFO: `/v3/users/e9ba2cd18e3642f19918ecce32965fb1` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:28.528091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ba2cd18e3642f19918ecce32965fb1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:28.530700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:28.544375 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1016/1995] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:28 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:28.545348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390002d5-99d0-4ffe-a0d4-d0acacdb7efd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:28.600136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ba2cd18e3642f19918ecce32965fb1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:28.600957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ba2cd18e3642f19918ecce32965fb1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:28.617913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ba2cd18e3642f19918ecce32965fb1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:28.621455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390002d5-99d0-4ffe-a0d4-d0acacdb7efd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:28.626953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ba2cd18e3642f19918ecce32965fb1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:28.628008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98c37c-ba8f-4d04-9dd7-33ca2c472f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:28.628154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ba2cd18e3642f19918ecce32965fb1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:28.628251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98c37c-ba8f-4d04-9dd7-33ca2c472f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:28.628559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98c37c-ba8f-4d04-9dd7-33ca2c472f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:28.628832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98c37c-ba8f-4d04-9dd7-33ca2c472f70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:28.629484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98c37c-ba8f-4d04-9dd7-33ca2c472f70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:28.629790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98c37c-ba8f-4d04-9dd7-33ca2c472f70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:28.631462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98c37c-ba8f-4d04-9dd7-33ca2c472f70 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:28.634214 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:28.645933 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 980/1997] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:28 2022] DELETE /identity/v3/users/e9ba2cd18e3642f19918ecce32965fb1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:28.647101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:28.648668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:28.649870 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1017/1997] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:28.650480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98c37c-ba8f-4d04-9dd7-33ca2c472f70 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:28.652254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5b98c37c-ba8f-4d04-9dd7-33ca2c472f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:28.666552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98c37c-ba8f-4d04-9dd7-33ca2c472f70 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:28.735015 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:28.735855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d5a8a-a4f6-4bd5-80ad-616c878259f2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:28.742858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cd46b-4803-41a4-91af-431b0e46ed5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:28.743714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd46b-4803-41a4-91af-431b0e46ed5e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:28.744162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd46b-4803-41a4-91af-431b0e46ed5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:28.744417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd46b-4803-41a4-91af-431b0e46ed5e admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:28.746026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cd46b-4803-41a4-91af-431b0e46ed5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:28.748362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cd46b-4803-41a4-91af-431b0e46ed5e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:28.769467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086e8de-20dd-44c8-ac81-998657e98b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:28.770108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086e8de-20dd-44c8-ac81-998657e98b77 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:28.770385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086e8de-20dd-44c8-ac81-998657e98b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:28.770712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086e8de-20dd-44c8-ac81-998657e98b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:28.771427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086e8de-20dd-44c8-ac81-998657e98b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:28.773621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086e8de-20dd-44c8-ac81-998657e98b77 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:28.778012 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 981/1998] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:28 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:28.781734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cd46b-4803-41a4-91af-431b0e46ed5e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:28.797987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cd46b-4803-41a4-91af-431b0e46ed5e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:28.821849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3df5-2368-4780-be23-74ca14a50f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:28.822606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3df5-2368-4780-be23-74ca14a50f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:28.823120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3df5-2368-4780-be23-74ca14a50f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:28.823402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3df5-2368-4780-be23-74ca14a50f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:28.824230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd3df5-2368-4780-be23-74ca14a50f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:28.826105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd3df5-2368-4780-be23-74ca14a50f06 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:28.841795 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 982/1999] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:28.845612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3df5-2368-4780-be23-74ca14a50f06 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:28.853612 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1018/2000] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:28 2022] POST /identity/v3/projects => generated 411 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:28.857361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086e8de-20dd-44c8-ac81-998657e98b77 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:28.861434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3df5-2368-4780-be23-74ca14a50f06 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:28.956498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086e8de-20dd-44c8-ac81-998657e98b77 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:28.975078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b9f46-c0a0-4197-9293-ed7baf437516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:28.975732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b9f46-c0a0-4197-9293-ed7baf437516 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:28.976086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b9f46-c0a0-4197-9293-ed7baf437516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:28.976310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b9f46-c0a0-4197-9293-ed7baf437516 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:28.977013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b9f46-c0a0-4197-9293-ed7baf437516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:28.985208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b9f46-c0a0-4197-9293-ed7baf437516 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:29.016538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ff770-90d7-47f9-beb2-7ecb5833902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:29.017401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff770-90d7-47f9-beb2-7ecb5833902a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.017833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff770-90d7-47f9-beb2-7ecb5833902a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.018163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff770-90d7-47f9-beb2-7ecb5833902a admin admin] PATH_INFO: `/v3/projects/38d17be0b8d24e79abd0099cd5e5a58b/users/1418cbf3e69f4c1cb7646bb2a9216d68/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.038979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ff770-90d7-47f9-beb2-7ecb5833902a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d17be0b8d24e79abd0099cd5e5a58b, user_id=1418cbf3e69f4c1cb7646bb2a9216d68, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:29.043051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ff770-90d7-47f9-beb2-7ecb5833902a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:29.084792 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 983/2001] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:28 2022] PUT /identity/v3/projects/38d17be0b8d24e79abd0099cd5e5a58b/users/1418cbf3e69f4c1cb7646bb2a9216d68/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:29.084911 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1019/2002] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:28 2022] POST /identity/v3/users => generated 306 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:29.084994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ff770-90d7-47f9-beb2-7ecb5833902a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:29.084994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-db7ff770-90d7-47f9-beb2-7ecb5833902a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:29.085775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b9f46-c0a0-4197-9293-ed7baf437516 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:29.098288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b9f46-c0a0-4197-9293-ed7baf437516 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:29.161337 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:29.163480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d3adb-b305-476c-9007-5f18d633f72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:29.164093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d3adb-b305-476c-9007-5f18d633f72e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.164371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d3adb-b305-476c-9007-5f18d633f72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.164643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d3adb-b305-476c-9007-5f18d633f72e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.165280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d3adb-b305-476c-9007-5f18d633f72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:29.166889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d3adb-b305-476c-9007-5f18d633f72e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:29.168350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ff770-90d7-47f9-beb2-7ecb5833902a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:29.176594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:29.177260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.177737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.178184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5 admin admin] PATH_INFO: `/v3/projects/28bc2644be594aa08a5bbb29507b196c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.179565 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1020/2003] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:29.180116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28bc2644be594aa08a5bbb29507b196c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:29.180390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d3adb-b305-476c-9007-5f18d633f72e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:29.182277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:29.195818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d3adb-b305-476c-9007-5f18d633f72e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:29.201171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc20160-a130-482a-932f-7c9ef69f58f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:29.201729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20160-a130-482a-932f-7c9ef69f58f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.202014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20160-a130-482a-932f-7c9ef69f58f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.202289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20160-a130-482a-932f-7c9ef69f58f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.203000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc20160-a130-482a-932f-7c9ef69f58f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:29.204733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc20160-a130-482a-932f-7c9ef69f58f7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:29.219244 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1021/2004] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:29.220587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc20160-a130-482a-932f-7c9ef69f58f7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:29.233507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc20160-a130-482a-932f-7c9ef69f58f7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:29.239568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550b199-9231-4487-b98b-2edf7e0d1358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:29.240282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b199-9231-4487-b98b-2edf7e0d1358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.240565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b199-9231-4487-b98b-2edf7e0d1358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.240838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b199-9231-4487-b98b-2edf7e0d1358 admin admin] PATH_INFO: `/v3/projects/38d17be0b8d24e79abd0099cd5e5a58b/users/1418cbf3e69f4c1cb7646bb2a9216d68/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.243042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550b199-9231-4487-b98b-2edf7e0d1358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d17be0b8d24e79abd0099cd5e5a58b, user_id=1418cbf3e69f4c1cb7646bb2a9216d68, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:29.245794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550b199-9231-4487-b98b-2edf7e0d1358 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:29.251464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28bc2644be594aa08a5bbb29507b196c', 'request_id': 'req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:29.260399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28bc2644be594aa08a5bbb29507b196c', 'request_id': 'req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:29.267006 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1022/2005] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:29 2022] PUT /identity/v3/projects/38d17be0b8d24e79abd0099cd5e5a58b/users/1418cbf3e69f4c1cb7646bb2a9216d68/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:29.268879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550b199-9231-4487-b98b-2edf7e0d1358 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:29.282958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28bc2644be594aa08a5bbb29507b196c', 'request_id': 'req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:29.299204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5 admin admin] The token cache is being invalidate because project 28bc2644be594aa08a5bbb29507b196c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:29.300016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:29.300786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-61dc40f0-cb54-4ccb-a97b-f9b0287484c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:29.303082 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 984/2006] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:29 2022] DELETE /identity/v3/projects/28bc2644be594aa08a5bbb29507b196c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:29.304528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efc7bf-06fa-4973-bf88-164bdd817a8c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.304809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efc7bf-06fa-4973-bf88-164bdd817a8c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.305082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efc7bf-06fa-4973-bf88-164bdd817a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.312574 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:29.349760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550b199-9231-4487-b98b-2edf7e0d1358 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:29.354868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c32c37-b3a8-4a95-8e1a-8d1e6b64deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:29.355690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c32c37-b3a8-4a95-8e1a-8d1e6b64deb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.355975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c32c37-b3a8-4a95-8e1a-8d1e6b64deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.356249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c32c37-b3a8-4a95-8e1a-8d1e6b64deb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.357026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c32c37-b3a8-4a95-8e1a-8d1e6b64deb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:29.358557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d7efc7bf-06fa-4973-bf88-164bdd817a8c None None] MFA Rules not processed for user `1418cbf3e69f4c1cb7646bb2a9216d68`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:29.358779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c32c37-b3a8-4a95-8e1a-8d1e6b64deb4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:29.359809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d7efc7bf-06fa-4973-bf88-164bdd817a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:29.369984 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1023/2007] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:29.372019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011550d6-54e7-4abd-8357-cd0a259ee7f1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.372307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011550d6-54e7-4abd-8357-cd0a259ee7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.372581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011550d6-54e7-4abd-8357-cd0a259ee7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.409532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-011550d6-54e7-4abd-8357-cd0a259ee7f1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:29.411033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-011550d6-54e7-4abd-8357-cd0a259ee7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:29.420746 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1024/2008] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:29.421764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011550d6-54e7-4abd-8357-cd0a259ee7f1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:29.423235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-011550d6-54e7-4abd-8357-cd0a259ee7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:29.435563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011550d6-54e7-4abd-8357-cd0a259ee7f1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:29.440950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfca253-62c3-44ed-9f7f-799e57613972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:29.447191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfca253-62c3-44ed-9f7f-799e57613972 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.447697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfca253-62c3-44ed-9f7f-799e57613972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.448615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfca253-62c3-44ed-9f7f-799e57613972 admin admin] PATH_INFO: `/v3/projects/80a75c141a604c8e835745f0452854b6/users/23c825fb97f145bdb04d32e89242edca/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.458952 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 985/2009] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:29.458952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32578bea-3879-473a-be61-40173f1f7c74 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.458952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32578bea-3879-473a-be61-40173f1f7c74 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.458952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32578bea-3879-473a-be61-40173f1f7c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.474110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfca253-62c3-44ed-9f7f-799e57613972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a75c141a604c8e835745f0452854b6, user_id=23c825fb97f145bdb04d32e89242edca, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:29.477009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfca253-62c3-44ed-9f7f-799e57613972 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:29.485774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-32578bea-3879-473a-be61-40173f1f7c74 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:29.487161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-32578bea-3879-473a-be61-40173f1f7c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:29.492577 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1025/2010] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:29 2022] PUT /identity/v3/projects/80a75c141a604c8e835745f0452854b6/users/23c825fb97f145bdb04d32e89242edca/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:29.495142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfca253-62c3-44ed-9f7f-799e57613972 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:29.496471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3dfca253-62c3-44ed-9f7f-799e57613972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:29.595441 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 986/2011] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:29.595441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f757959-5ef6-46aa-94a3-f834e2bccc46 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.595441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f757959-5ef6-46aa-94a3-f834e2bccc46 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.595441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f757959-5ef6-46aa-94a3-f834e2bccc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.606226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfca253-62c3-44ed-9f7f-799e57613972 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:29.612303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3be06-7a9b-4cd1-acd1-9f695260d337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:29.613003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3be06-7a9b-4cd1-acd1-9f695260d337 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.613280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3be06-7a9b-4cd1-acd1-9f695260d337 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.613552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3be06-7a9b-4cd1-acd1-9f695260d337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.622045 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:29.625079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2f757959-5ef6-46aa-94a3-f834e2bccc46 None None] MFA Rules not processed for user `23c825fb97f145bdb04d32e89242edca`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:29.628162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2f757959-5ef6-46aa-94a3-f834e2bccc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:29.687090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3be06-7a9b-4cd1-acd1-9f695260d337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:29.688936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3be06-7a9b-4cd1-acd1-9f695260d337 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:29.701546 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1026/2012] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:29.702418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3be06-7a9b-4cd1-acd1-9f695260d337 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:29.704840 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 987/2013] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:29 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:29.709371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f757959-5ef6-46aa-94a3-f834e2bccc46 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:29.715019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3be06-7a9b-4cd1-acd1-9f695260d337 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:29.722410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f757959-5ef6-46aa-94a3-f834e2bccc46 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:29.727519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a86d6d-ec57-47b8-80af-0a55c3cc34ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:29.729323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a86d6d-ec57-47b8-80af-0a55c3cc34ca admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.731136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a86d6d-ec57-47b8-80af-0a55c3cc34ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.731413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a86d6d-ec57-47b8-80af-0a55c3cc34ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.732275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a86d6d-ec57-47b8-80af-0a55c3cc34ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:29.732540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59987e5-351a-41d5-af7f-e9f4e8db910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:29.733376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59987e5-351a-41d5-af7f-e9f4e8db910e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.733659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59987e5-351a-41d5-af7f-e9f4e8db910e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.733926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59987e5-351a-41d5-af7f-e9f4e8db910e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.734563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59987e5-351a-41d5-af7f-e9f4e8db910e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:29.736572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59987e5-351a-41d5-af7f-e9f4e8db910e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:29.739133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a86d6d-ec57-47b8-80af-0a55c3cc34ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:29.741484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a86d6d-ec57-47b8-80af-0a55c3cc34ca admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:29.766792 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1027/2014] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:29.767973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a86d6d-ec57-47b8-80af-0a55c3cc34ca admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:29.772047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-67a86d6d-ec57-47b8-80af-0a55c3cc34ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:29.794331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a86d6d-ec57-47b8-80af-0a55c3cc34ca admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:29.796542 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 988/2015] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:29 2022] POST /identity/v3/projects => generated 411 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:29.797439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59987e5-351a-41d5-af7f-e9f4e8db910e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:29.808204 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:29.891799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59987e5-351a-41d5-af7f-e9f4e8db910e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:29.898744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75701e6f-e453-4c61-9c91-d77cd83d159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:29.899485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75701e6f-e453-4c61-9c91-d77cd83d159f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.899768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75701e6f-e453-4c61-9c91-d77cd83d159f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.900040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75701e6f-e453-4c61-9c91-d77cd83d159f admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.900741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75701e6f-e453-4c61-9c91-d77cd83d159f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:29.901052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d3ba8-1ba9-4e2a-9b4a-19b607c6d275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:29.901665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3ba8-1ba9-4e2a-9b4a-19b607c6d275 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:29.901944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3ba8-1ba9-4e2a-9b4a-19b607c6d275 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:29.902217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3ba8-1ba9-4e2a-9b4a-19b607c6d275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:29.902653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75701e6f-e453-4c61-9c91-d77cd83d159f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:29.904123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-761d3ba8-1ba9-4e2a-9b4a-19b607c6d275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:29.932736 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 989/2016] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:29 2022] POST /identity/v3/projects => generated 395 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:29.933007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75701e6f-e453-4c61-9c91-d77cd83d159f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:29.978741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d3ba8-1ba9-4e2a-9b4a-19b607c6d275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:29.980330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d3ba8-1ba9-4e2a-9b4a-19b607c6d275 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:29.993111 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1028/2017] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:29.993683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d3ba8-1ba9-4e2a-9b4a-19b607c6d275 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.005849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d3ba8-1ba9-4e2a-9b4a-19b607c6d275 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:30.006459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75701e6f-e453-4c61-9c91-d77cd83d159f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:30.012244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a405a0-abf5-4d18-9c79-88aa2017b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:30.012498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa2e46-5ba2-4cf2-add8-35cae0969b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:30.012877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a405a0-abf5-4d18-9c79-88aa2017b1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.012999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa2e46-5ba2-4cf2-add8-35cae0969b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.013161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa2e46-5ba2-4cf2-add8-35cae0969b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.013268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a405a0-abf5-4d18-9c79-88aa2017b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.013746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa2e46-5ba2-4cf2-add8-35cae0969b86 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.013863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a405a0-abf5-4d18-9c79-88aa2017b1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.014071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa2e46-5ba2-4cf2-add8-35cae0969b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:30.014174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a405a0-abf5-4d18-9c79-88aa2017b1b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:30.016485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a405a0-abf5-4d18-9c79-88aa2017b1b9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:30.019858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa2e46-5ba2-4cf2-add8-35cae0969b86 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:30.040884 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:30.044165 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1029/2018] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:29 2022] POST /identity/v3/users => generated 298 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:30.048924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a405a0-abf5-4d18-9c79-88aa2017b1b9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.061341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a405a0-abf5-4d18-9c79-88aa2017b1b9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:30.062976 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 990/2019] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:29 2022] POST /identity/v3/users => generated 312 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:30.063903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa2e46-5ba2-4cf2-add8-35cae0969b86 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.067032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb2ada-b976-4ccf-9d86-9607cf0a47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:30.078952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb2ada-b976-4ccf-9d86-9607cf0a47fe admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.078952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb2ada-b976-4ccf-9d86-9607cf0a47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.078952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb2ada-b976-4ccf-9d86-9607cf0a47fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.078952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb2ada-b976-4ccf-9d86-9607cf0a47fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:30.079354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa2e46-5ba2-4cf2-add8-35cae0969b86 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:30.079435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb2ada-b976-4ccf-9d86-9607cf0a47fe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:30.087468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96303ef5-736a-447c-88b3-f5d0cc1a4d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:30.087468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303ef5-736a-447c-88b3-f5d0cc1a4d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.087468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303ef5-736a-447c-88b3-f5d0cc1a4d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.087468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303ef5-736a-447c-88b3-f5d0cc1a4d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.087836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96303ef5-736a-447c-88b3-f5d0cc1a4d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:30.088665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96303ef5-736a-447c-88b3-f5d0cc1a4d20 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:30.097546 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1030/2020] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:30.103009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb2ada-b976-4ccf-9d86-9607cf0a47fe admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.107145 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 991/2021] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:30.108803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96303ef5-736a-447c-88b3-f5d0cc1a4d20 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.115105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb2ada-b976-4ccf-9d86-9607cf0a47fe admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:30.121943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96303ef5-736a-447c-88b3-f5d0cc1a4d20 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:30.131727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dd4bf-05b6-4f8c-ac06-92621e76ac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:30.132375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f123e-95e0-453b-afb9-7bba417b63c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:30.132932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dd4bf-05b6-4f8c-ac06-92621e76ac8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.133078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f123e-95e0-453b-afb9-7bba417b63c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.133253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f123e-95e0-453b-afb9-7bba417b63c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.133503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f123e-95e0-453b-afb9-7bba417b63c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.134079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dd4bf-05b6-4f8c-ac06-92621e76ac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.134246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f123e-95e0-453b-afb9-7bba417b63c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:30.134790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dd4bf-05b6-4f8c-ac06-92621e76ac8c admin admin] PATH_INFO: `/v3/projects/8e6c7aa43aae479fb846e1639baf2e3f/users/399d975fe48049e5b187b69037315629/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.135744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f123e-95e0-453b-afb9-7bba417b63c2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:30.162158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dd4bf-05b6-4f8c-ac06-92621e76ac8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6c7aa43aae479fb846e1639baf2e3f, user_id=399d975fe48049e5b187b69037315629, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:30.165068 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1031/2022] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:01:30.168344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dd4bf-05b6-4f8c-ac06-92621e76ac8c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:30.171903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f123e-95e0-453b-afb9-7bba417b63c2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.192477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f123e-95e0-453b-afb9-7bba417b63c2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:30.198171 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 992/2023] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:30 2022] PUT /identity/v3/projects/8e6c7aa43aae479fb846e1639baf2e3f/users/399d975fe48049e5b187b69037315629/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:01:30.206945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dd4bf-05b6-4f8c-ac06-92621e76ac8c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.320990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a8376-768c-4c23-af18-6930a9def368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:30.322111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a8376-768c-4c23-af18-6930a9def368 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.323281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a8376-768c-4c23-af18-6930a9def368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.323589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a8376-768c-4c23-af18-6930a9def368 admin admin] PATH_INFO: `/v3/projects/e48f2ef261914d849e20edb861c30b20/users/fc40f12d9bee4f26adb09753b5590bf8/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.342082 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:30.345691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a8376-768c-4c23-af18-6930a9def368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48f2ef261914d849e20edb861c30b20, user_id=fc40f12d9bee4f26adb09753b5590bf8, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:30.350729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a8376-768c-4c23-af18-6930a9def368 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:30.372880 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1032/2024] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:30 2022] PUT /identity/v3/projects/e48f2ef261914d849e20edb861c30b20/users/fc40f12d9bee4f26adb09753b5590bf8/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:30.388803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e73ab-aaaa-40ed-a062-236667b1b5ed None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.389076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e73ab-aaaa-40ed-a062-236667b1b5ed None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.389483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e73ab-aaaa-40ed-a062-236667b1b5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.396197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dd4bf-05b6-4f8c-ac06-92621e76ac8c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:30.458649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7c2e73ab-aaaa-40ed-a062-236667b1b5ed None None] MFA Rules not processed for user `fc40f12d9bee4f26adb09753b5590bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:30.459776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7c2e73ab-aaaa-40ed-a062-236667b1b5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:30.528308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad814c1-3a9c-4ff9-9e8c-c9830f8b58eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:30.528939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad814c1-3a9c-4ff9-9e8c-c9830f8b58eb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.529219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad814c1-3a9c-4ff9-9e8c-c9830f8b58eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.529490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad814c1-3a9c-4ff9-9e8c-c9830f8b58eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.534602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad814c1-3a9c-4ff9-9e8c-c9830f8b58eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:30.538873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad814c1-3a9c-4ff9-9e8c-c9830f8b58eb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:30.554541 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 993/2025] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:30.556749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad814c1-3a9c-4ff9-9e8c-c9830f8b58eb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.566207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aad814c1-3a9c-4ff9-9e8c-c9830f8b58eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:30.574853 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1033/2026] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:30 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:30.576347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e73ab-aaaa-40ed-a062-236667b1b5ed None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.593996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e73ab-aaaa-40ed-a062-236667b1b5ed None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:30.595803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad814c1-3a9c-4ff9-9e8c-c9830f8b58eb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:30.608197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008b503-1e17-41f3-9293-bfe17290fda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:30.608904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008b503-1e17-41f3-9293-bfe17290fda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.609177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008b503-1e17-41f3-9293-bfe17290fda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.609464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008b503-1e17-41f3-9293-bfe17290fda7 admin admin] PATH_INFO: `/v3/projects/8e6c7aa43aae479fb846e1639baf2e3f/users/399d975fe48049e5b187b69037315629/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.611601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008b503-1e17-41f3-9293-bfe17290fda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6c7aa43aae479fb846e1639baf2e3f, user_id=399d975fe48049e5b187b69037315629, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:30.611718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246325d-22a7-458f-bed4-c43ec90fb794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:30.613658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246325d-22a7-458f-bed4-c43ec90fb794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.614035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246325d-22a7-458f-bed4-c43ec90fb794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.615055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246325d-22a7-458f-bed4-c43ec90fb794 admin admin] PATH_INFO: `/v3/users/674e0c4469b24aa5a31d944a223fbfbc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.615279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008b503-1e17-41f3-9293-bfe17290fda7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:30.617684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246325d-22a7-458f-bed4-c43ec90fb794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=674e0c4469b24aa5a31d944a223fbfbc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:30.621603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246325d-22a7-458f-bed4-c43ec90fb794 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:30.644368 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1034/2027] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:30 2022] PUT /identity/v3/projects/8e6c7aa43aae479fb846e1639baf2e3f/users/399d975fe48049e5b187b69037315629/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:30.645119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008b503-1e17-41f3-9293-bfe17290fda7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.685309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9246325d-22a7-458f-bed4-c43ec90fb794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674e0c4469b24aa5a31d944a223fbfbc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:30.687518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9246325d-22a7-458f-bed4-c43ec90fb794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674e0c4469b24aa5a31d944a223fbfbc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:30.703358 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:30.712546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9246325d-22a7-458f-bed4-c43ec90fb794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674e0c4469b24aa5a31d944a223fbfbc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:30.728150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9246325d-22a7-458f-bed4-c43ec90fb794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674e0c4469b24aa5a31d944a223fbfbc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:30.728841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9246325d-22a7-458f-bed4-c43ec90fb794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674e0c4469b24aa5a31d944a223fbfbc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:30.741171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008b503-1e17-41f3-9293-bfe17290fda7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:30.748800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69dcd7-daed-4ff0-8ce9-9aabfac34c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:30.749006 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 994/2028] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:30 2022] DELETE /identity/v3/users/674e0c4469b24aa5a31d944a223fbfbc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:30.749101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69dcd7-daed-4ff0-8ce9-9aabfac34c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.749101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69dcd7-daed-4ff0-8ce9-9aabfac34c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.749101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69dcd7-daed-4ff0-8ce9-9aabfac34c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.749320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53698509-822d-4b4d-8c8c-c51a03631eec None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.749320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53698509-822d-4b4d-8c8c-c51a03631eec None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.749320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53698509-822d-4b4d-8c8c-c51a03631eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.749517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69dcd7-daed-4ff0-8ce9-9aabfac34c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:30.750693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69dcd7-daed-4ff0-8ce9-9aabfac34c63 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:30.787302 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1035/2029] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:30 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:30.787302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8aee6-8755-4221-a996-625dc13e1137 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.787302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8aee6-8755-4221-a996-625dc13e1137 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.787302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8aee6-8755-4221-a996-625dc13e1137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.792651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-53698509-822d-4b4d-8c8c-c51a03631eec None None] MFA Rules not processed for user `399d975fe48049e5b187b69037315629`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:30.794698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-53698509-822d-4b4d-8c8c-c51a03631eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:30.808042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dee8aee6-8755-4221-a996-625dc13e1137 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:30.809368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dee8aee6-8755-4221-a996-625dc13e1137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:30.873448 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:30.889043 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 995/2030] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:30 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:30.893988 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1036/2031] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:30.895233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53698509-822d-4b4d-8c8c-c51a03631eec None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.896958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-53698509-822d-4b4d-8c8c-c51a03631eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:30.900404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8aee6-8755-4221-a996-625dc13e1137 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.901759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dee8aee6-8755-4221-a996-625dc13e1137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:30.912913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53698509-822d-4b4d-8c8c-c51a03631eec None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:30.918975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53aaf5-591e-49c5-bb5f-651f50d38daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:30.919592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53aaf5-591e-49c5-bb5f-651f50d38daf admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.919867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53aaf5-591e-49c5-bb5f-651f50d38daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.920135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53aaf5-591e-49c5-bb5f-651f50d38daf admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.920768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53aaf5-591e-49c5-bb5f-651f50d38daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:30.922686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53aaf5-591e-49c5-bb5f-651f50d38daf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:30.949490 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 996/2032] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:30 2022] POST /identity/v3/users => generated 303 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:30.953603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53aaf5-591e-49c5-bb5f-651f50d38daf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.955320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dd53aaf5-591e-49c5-bb5f-651f50d38daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:30.998955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8aee6-8755-4221-a996-625dc13e1137 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:31.006427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccda96-ffc4-4c28-b086-57d9431e7352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:31.007449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccda96-ffc4-4c28-b086-57d9431e7352 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.007566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccda96-ffc4-4c28-b086-57d9431e7352 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.007831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccda96-ffc4-4c28-b086-57d9431e7352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.020308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbccda96-ffc4-4c28-b086-57d9431e7352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:31.022348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbccda96-ffc4-4c28-b086-57d9431e7352 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:31.028047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53aaf5-591e-49c5-bb5f-651f50d38daf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:31.035189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222959cc-67d0-49c3-947e-6ee3520d850b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:31.035884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222959cc-67d0-49c3-947e-6ee3520d850b service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.036164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222959cc-67d0-49c3-947e-6ee3520d850b service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.036280 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1037/2033] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:30 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:01:31.036521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222959cc-67d0-49c3-947e-6ee3520d850b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.037436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccda96-ffc4-4c28-b086-57d9431e7352 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:31.048008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222959cc-67d0-49c3-947e-6ee3520d850b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:31.049554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222959cc-67d0-49c3-947e-6ee3520d850b service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:31.051354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccda96-ffc4-4c28-b086-57d9431e7352 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:31.057122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c072d5-87ac-4a9f-9219-f605dcb2cd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:31.057822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c072d5-87ac-4a9f-9219-f605dcb2cd19 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.058177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c072d5-87ac-4a9f-9219-f605dcb2cd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.058446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c072d5-87ac-4a9f-9219-f605dcb2cd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.059110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c072d5-87ac-4a9f-9219-f605dcb2cd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:31.061388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c072d5-87ac-4a9f-9219-f605dcb2cd19 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:31.065578 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 997/2034] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:31.075858 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1038/2035] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:31.080197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222959cc-67d0-49c3-947e-6ee3520d850b service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:31.097945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222959cc-67d0-49c3-947e-6ee3520d850b service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:31.098330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c072d5-87ac-4a9f-9219-f605dcb2cd19 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:31.101021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e1c072d5-87ac-4a9f-9219-f605dcb2cd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:31.109419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4c36c-ff08-4ec5-9d37-2e25759143e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:31.110093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4c36c-ff08-4ec5-9d37-2e25759143e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.110371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4c36c-ff08-4ec5-9d37-2e25759143e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.110659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4c36c-ff08-4ec5-9d37-2e25759143e3 admin admin] PATH_INFO: `/v3/projects/dbfd4f76ce4a4536b3ce83255010b060/users/82a177103d144196b94d0012ed589253/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.131608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c072d5-87ac-4a9f-9219-f605dcb2cd19 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:31.141647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4c36c-ff08-4ec5-9d37-2e25759143e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfd4f76ce4a4536b3ce83255010b060, user_id=82a177103d144196b94d0012ed589253, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:31.145438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4c36c-ff08-4ec5-9d37-2e25759143e3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:31.150198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337f838-b09a-4fd9-9948-558531c871ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:31.150821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337f838-b09a-4fd9-9948-558531c871ec service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.151139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337f838-b09a-4fd9-9948-558531c871ec service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.151407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337f838-b09a-4fd9-9948-558531c871ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.154089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8337f838-b09a-4fd9-9948-558531c871ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:31.178843 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 998/2036] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:31 2022] PUT /identity/v3/projects/dbfd4f76ce4a4536b3ce83255010b060/users/82a177103d144196b94d0012ed589253/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:31.180987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4c36c-ff08-4ec5-9d37-2e25759143e3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:31.230254 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:31.272577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337f838-b09a-4fd9-9948-558531c871ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:31.275220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337f838-b09a-4fd9-9948-558531c871ec service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:31.294819 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1039/2037] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:31 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:01:31.329974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4c36c-ff08-4ec5-9d37-2e25759143e3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:31.338397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4273785-39eb-4418-b64a-e6847213348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:31.338397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4273785-39eb-4418-b64a-e6847213348d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.338563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4273785-39eb-4418-b64a-e6847213348d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.339587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4273785-39eb-4418-b64a-e6847213348d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.340329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4273785-39eb-4418-b64a-e6847213348d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:31.342163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4273785-39eb-4418-b64a-e6847213348d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:31.349050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337f838-b09a-4fd9-9948-558531c871ec service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:31.350644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8337f838-b09a-4fd9-9948-558531c871ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:31.361993 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 999/2038] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:31.363304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4273785-39eb-4418-b64a-e6847213348d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:31.374778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4273785-39eb-4418-b64a-e6847213348d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:31.375556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337f838-b09a-4fd9-9948-558531c871ec service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:31.381395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2fa98-697d-47a2-9f02-4217b0160551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:31.381741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2fa98-697d-47a2-9f02-4217b0160551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.382022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2fa98-697d-47a2-9f02-4217b0160551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.382303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2fa98-697d-47a2-9f02-4217b0160551 admin admin] PATH_INFO: `/v3/users/23c825fb97f145bdb04d32e89242edca` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.384174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2fa98-697d-47a2-9f02-4217b0160551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c825fb97f145bdb04d32e89242edca)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:31.385017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9cea2-b40f-4df1-b660-ef5971ff53e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:31.386021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9cea2-b40f-4df1-b660-ef5971ff53e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.386021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9cea2-b40f-4df1-b660-ef5971ff53e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.386224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2fa98-697d-47a2-9f02-4217b0160551 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:31.386377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9cea2-b40f-4df1-b660-ef5971ff53e8 admin admin] PATH_INFO: `/v3/projects/dbfd4f76ce4a4536b3ce83255010b060/users/82a177103d144196b94d0012ed589253/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.391626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9cea2-b40f-4df1-b660-ef5971ff53e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfd4f76ce4a4536b3ce83255010b060, user_id=82a177103d144196b94d0012ed589253, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:31.395812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9cea2-b40f-4df1-b660-ef5971ff53e8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:31.418878 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1000/2039] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:31 2022] PUT /identity/v3/projects/dbfd4f76ce4a4536b3ce83255010b060/users/82a177103d144196b94d0012ed589253/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:31.420818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9cea2-b40f-4df1-b660-ef5971ff53e8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:31.424063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-11d9cea2-b40f-4df1-b660-ef5971ff53e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:31.469390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49b2fa98-697d-47a2-9f02-4217b0160551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c825fb97f145bdb04d32e89242edca'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:31.470136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49b2fa98-697d-47a2-9f02-4217b0160551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c825fb97f145bdb04d32e89242edca'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:31.485807 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:31.489758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49b2fa98-697d-47a2-9f02-4217b0160551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c825fb97f145bdb04d32e89242edca'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:31.505578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49b2fa98-697d-47a2-9f02-4217b0160551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c825fb97f145bdb04d32e89242edca'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:31.506603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49b2fa98-697d-47a2-9f02-4217b0160551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c825fb97f145bdb04d32e89242edca'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:31.543106 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1040/2040] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:31 2022] DELETE /identity/v3/users/23c825fb97f145bdb04d32e89242edca => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:31.543106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659894ee-c49c-4b04-894c-118acbd9fa1d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.543106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659894ee-c49c-4b04-894c-118acbd9fa1d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.543106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659894ee-c49c-4b04-894c-118acbd9fa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.564934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9cea2-b40f-4df1-b660-ef5971ff53e8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:31.595097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-659894ee-c49c-4b04-894c-118acbd9fa1d None None] MFA Rules not processed for user `82a177103d144196b94d0012ed589253`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:31.597495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-659894ee-c49c-4b04-894c-118acbd9fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:31.650825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95663323-aa2d-405e-baf1-4698f4e59cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:31.651497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663323-aa2d-405e-baf1-4698f4e59cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.651891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663323-aa2d-405e-baf1-4698f4e59cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.652169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663323-aa2d-405e-baf1-4698f4e59cbd admin admin] PATH_INFO: `/v3/projects/4160d27bdc5a4fc485ef5565f3ccff83` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.653899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95663323-aa2d-405e-baf1-4698f4e59cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4160d27bdc5a4fc485ef5565f3ccff83)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:31.656457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95663323-aa2d-405e-baf1-4698f4e59cbd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:31.680155 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1041/2041] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:31.684804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4825a-24bf-4410-b19b-d3e704b6b325 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.684804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4825a-24bf-4410-b19b-d3e704b6b325 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.684804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4825a-24bf-4410-b19b-d3e704b6b325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.710115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-72a4825a-24bf-4410-b19b-d3e704b6b325 None None] MFA Rules not processed for user `7cf9dde9e1de4c7c8592ced74f618bed`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:31.711776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-72a4825a-24bf-4410-b19b-d3e704b6b325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:31.727299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-95663323-aa2d-405e-baf1-4698f4e59cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4160d27bdc5a4fc485ef5565f3ccff83', 'request_id': 'req-95663323-aa2d-405e-baf1-4698f4e59cbd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:31.734882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-95663323-aa2d-405e-baf1-4698f4e59cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4160d27bdc5a4fc485ef5565f3ccff83', 'request_id': 'req-95663323-aa2d-405e-baf1-4698f4e59cbd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:31.738070 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:31.743744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-95663323-aa2d-405e-baf1-4698f4e59cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4160d27bdc5a4fc485ef5565f3ccff83', 'request_id': 'req-95663323-aa2d-405e-baf1-4698f4e59cbd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:31.758678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-95663323-aa2d-405e-baf1-4698f4e59cbd admin admin] The token cache is being invalidate because project 4160d27bdc5a4fc485ef5565f3ccff83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:31.759136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-95663323-aa2d-405e-baf1-4698f4e59cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:31.759897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-95663323-aa2d-405e-baf1-4698f4e59cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:31.761963 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1001/2042] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:31 2022] DELETE /identity/v3/projects/4160d27bdc5a4fc485ef5565f3ccff83 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:31.763074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696eade-a26d-45ce-9896-f706692743f2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.763576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696eade-a26d-45ce-9896-f706692743f2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.763946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696eade-a26d-45ce-9896-f706692743f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.776406 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1042/2043] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:31.777274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4825a-24bf-4410-b19b-d3e704b6b325 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:31.778554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-72a4825a-24bf-4410-b19b-d3e704b6b325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:31.791430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3696eade-a26d-45ce-9896-f706692743f2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:31.796322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3696eade-a26d-45ce-9896-f706692743f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:31.895577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4825a-24bf-4410-b19b-d3e704b6b325 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:31.906973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9f6ce-cc38-488b-9c52-810c07ea1093 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:31.908908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9f6ce-cc38-488b-9c52-810c07ea1093 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.909458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9f6ce-cc38-488b-9c52-810c07ea1093 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.909954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9f6ce-cc38-488b-9c52-810c07ea1093 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.913788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-88c9f6ce-cc38-488b-9c52-810c07ea1093 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:31.922784 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:31.942970 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1002/2044] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:31.943992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696eade-a26d-45ce-9896-f706692743f2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:31.945442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3696eade-a26d-45ce-9896-f706692743f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:31.959442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696eade-a26d-45ce-9896-f706692743f2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:31.966735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:31.967558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:31.967989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:31.968367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] PATH_INFO: `/v3/users/1418cbf3e69f4c1cb7646bb2a9216d68` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:31.970229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1418cbf3e69f4c1cb7646bb2a9216d68)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:31.973549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:32.019963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9f6ce-cc38-488b-9c52-810c07ea1093 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:32.021706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9f6ce-cc38-488b-9c52-810c07ea1093 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:32.029892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1418cbf3e69f4c1cb7646bb2a9216d68'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:32.030835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1418cbf3e69f4c1cb7646bb2a9216d68'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:32.033374 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1043/2045] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:31 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:32.035026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9f6ce-cc38-488b-9c52-810c07ea1093 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:32.036330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-88c9f6ce-cc38-488b-9c52-810c07ea1093 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:32.066900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1418cbf3e69f4c1cb7646bb2a9216d68'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:32.092316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1418cbf3e69f4c1cb7646bb2a9216d68'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:32.093814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1418cbf3e69f4c1cb7646bb2a9216d68'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:32.123323 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1003/2046] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:31 2022] DELETE /identity/v3/users/1418cbf3e69f4c1cb7646bb2a9216d68 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:32.144358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9f6ce-cc38-488b-9c52-810c07ea1093 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:32.226565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524452e-9223-4fa8-8bde-46a4bba95064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:32.227320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524452e-9223-4fa8-8bde-46a4bba95064 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:32.227713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524452e-9223-4fa8-8bde-46a4bba95064 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:32.228110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524452e-9223-4fa8-8bde-46a4bba95064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:32.230241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9524452e-9223-4fa8-8bde-46a4bba95064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:32.335654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524452e-9223-4fa8-8bde-46a4bba95064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:32.337231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524452e-9223-4fa8-8bde-46a4bba95064 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:32.355199 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1044/2047] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:32.497674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:32.499337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:32.524100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01a1ad-149f-43a9-b07d-24e3ab738c1b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:32.570371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6409a-3dbc-4a42-8043-2115ead36c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:32.572549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6409a-3dbc-4a42-8043-2115ead36c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:32.573542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6409a-3dbc-4a42-8043-2115ead36c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:32.573828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6409a-3dbc-4a42-8043-2115ead36c90 admin admin] PATH_INFO: `/v3/projects/38d17be0b8d24e79abd0099cd5e5a58b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:32.583348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6409a-3dbc-4a42-8043-2115ead36c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d17be0b8d24e79abd0099cd5e5a58b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:32.585532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6409a-3dbc-4a42-8043-2115ead36c90 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:32.724062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77d6409a-3dbc-4a42-8043-2115ead36c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d17be0b8d24e79abd0099cd5e5a58b', 'request_id': 'req-77d6409a-3dbc-4a42-8043-2115ead36c90'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:32.725445 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=2,keystone:DELETE=17,keystone:SELECT=81 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:32.736456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77d6409a-3dbc-4a42-8043-2115ead36c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d17be0b8d24e79abd0099cd5e5a58b', 'request_id': 'req-77d6409a-3dbc-4a42-8043-2115ead36c90'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:32.750475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77d6409a-3dbc-4a42-8043-2115ead36c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d17be0b8d24e79abd0099cd5e5a58b', 'request_id': 'req-77d6409a-3dbc-4a42-8043-2115ead36c90'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:32.782158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77d6409a-3dbc-4a42-8043-2115ead36c90 admin admin] The token cache is being invalidate because project 38d17be0b8d24e79abd0099cd5e5a58b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:32.782423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524452e-9223-4fa8-8bde-46a4bba95064 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:32.782553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77d6409a-3dbc-4a42-8043-2115ead36c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:32.783500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77d6409a-3dbc-4a42-8043-2115ead36c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:32.785340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9524452e-9223-4fa8-8bde-46a4bba95064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:32.786379 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1004/2048] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:32 2022] DELETE /identity/v3/projects/38d17be0b8d24e79abd0099cd5e5a58b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:32.791810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666cd32-97ea-4607-94dc-86a61d6f9cbd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:32.792802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666cd32-97ea-4607-94dc-86a61d6f9cbd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:32.795651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666cd32-97ea-4607-94dc-86a61d6f9cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:32.801906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524452e-9223-4fa8-8bde-46a4bba95064 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:32.806434 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:32.849162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5666cd32-97ea-4607-94dc-86a61d6f9cbd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:32.850810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5666cd32-97ea-4607-94dc-86a61d6f9cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:32.937575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:32.943636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:32.943917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:32.944200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] PATH_INFO: `/v3/projects/80a75c141a604c8e835745f0452854b6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:32.945523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a75c141a604c8e835745f0452854b6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:32.949986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:32.994960 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1005/2049] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:33.002151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804410-7bfc-43ad-92d1-e112fb0e8cc2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:33.005306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804410-7bfc-43ad-92d1-e112fb0e8cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:33.006257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804410-7bfc-43ad-92d1-e112fb0e8cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:33.045944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a75c141a604c8e835745f0452854b6', 'request_id': 'req-f91f00b2-f69f-46d2-b42e-02ff71538731'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.055561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a75c141a604c8e835745f0452854b6', 'request_id': 'req-f91f00b2-f69f-46d2-b42e-02ff71538731'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.068144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a75c141a604c8e835745f0452854b6', 'request_id': 'req-f91f00b2-f69f-46d2-b42e-02ff71538731'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.072096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-98804410-7bfc-43ad-92d1-e112fb0e8cc2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:33.073994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-98804410-7bfc-43ad-92d1-e112fb0e8cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:33.088236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] The token cache is being invalidate because project 80a75c141a604c8e835745f0452854b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:33.088578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.089388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.092133 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1045/2050] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:32 2022] DELETE /identity/v3/projects/80a75c141a604c8e835745f0452854b6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:33.095646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:33.098376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:33.209992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f00b2-f69f-46d2-b42e-02ff71538731 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:33.211354 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1006/2051] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:33.215784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804410-7bfc-43ad-92d1-e112fb0e8cc2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:33.216536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:33.217122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:33.217469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:33.217809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] PATH_INFO: `/v3/users/399d975fe48049e5b187b69037315629` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:33.219065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] RBAC: Authorizing `identity:delete_user(user_id=399d975fe48049e5b187b69037315629)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:33.221316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:33.243736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804410-7bfc-43ad-92d1-e112fb0e8cc2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:33.257504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b763290-64f1-41a3-965d-7b3f87a45b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:33.258119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b763290-64f1-41a3-965d-7b3f87a45b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:33.258402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b763290-64f1-41a3-965d-7b3f87a45b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:33.258674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b763290-64f1-41a3-965d-7b3f87a45b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:33.259478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b763290-64f1-41a3-965d-7b3f87a45b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:33.259886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b763290-64f1-41a3-965d-7b3f87a45b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:33.261502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b763290-64f1-41a3-965d-7b3f87a45b08 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:33.281678 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1007/2052] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:33.281678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b763290-64f1-41a3-965d-7b3f87a45b08 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:33.285007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b763290-64f1-41a3-965d-7b3f87a45b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:33.310562 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:33.324698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399d975fe48049e5b187b69037315629'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.327332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399d975fe48049e5b187b69037315629'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.347628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399d975fe48049e5b187b69037315629'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.361183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399d975fe48049e5b187b69037315629'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.361183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399d975fe48049e5b187b69037315629'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.384636 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1046/2053] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:33 2022] DELETE /identity/v3/users/399d975fe48049e5b187b69037315629 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:33.385788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:33.398670 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:33.399979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:33.406131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b763290-64f1-41a3-965d-7b3f87a45b08 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:33.538965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bce2f-50f2-4795-adc8-bbdfe68a1cde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:33.539669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bce2f-50f2-4795-adc8-bbdfe68a1cde service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:33.539944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bce2f-50f2-4795-adc8-bbdfe68a1cde service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:33.540387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bce2f-50f2-4795-adc8-bbdfe68a1cde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:33.543168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeb049-de31-4570-be91-38c16814c26d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:33.544514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-539bce2f-50f2-4795-adc8-bbdfe68a1cde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:33.566301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6910322-6c2c-4e76-8c84-d813eed5df4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:33.567298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6910322-6c2c-4e76-8c84-d813eed5df4c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:33.567591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6910322-6c2c-4e76-8c84-d813eed5df4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:33.567862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6910322-6c2c-4e76-8c84-d813eed5df4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:33.568527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6910322-6c2c-4e76-8c84-d813eed5df4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:33.571274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6910322-6c2c-4e76-8c84-d813eed5df4c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:33.651454 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1047/2054] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:33 2022] POST /identity/v3/projects => generated 405 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:33.652643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6910322-6c2c-4e76-8c84-d813eed5df4c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:33.698318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bce2f-50f2-4795-adc8-bbdfe68a1cde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:33.702825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bce2f-50f2-4795-adc8-bbdfe68a1cde service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:33.716331 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1008/2055] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:33 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:33.755071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6910322-6c2c-4e76-8c84-d813eed5df4c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:33.755358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bce2f-50f2-4795-adc8-bbdfe68a1cde service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:33.755762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-539bce2f-50f2-4795-adc8-bbdfe68a1cde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:33.758374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff02c0e-540f-47ed-9dc9-13280d11cee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:33.759032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff02c0e-540f-47ed-9dc9-13280d11cee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:33.759313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff02c0e-540f-47ed-9dc9-13280d11cee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:33.759579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff02c0e-540f-47ed-9dc9-13280d11cee5 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:33.760219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff02c0e-540f-47ed-9dc9-13280d11cee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:33.764947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff02c0e-540f-47ed-9dc9-13280d11cee5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:33.774758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bce2f-50f2-4795-adc8-bbdfe68a1cde service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:33.781621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac39e3-f078-4201-af9d-d3f95a0862ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:33.782311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac39e3-f078-4201-af9d-d3f95a0862ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:33.782572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac39e3-f078-4201-af9d-d3f95a0862ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:33.782847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac39e3-f078-4201-af9d-d3f95a0862ce admin admin] PATH_INFO: `/v3/users/fc40f12d9bee4f26adb09753b5590bf8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:33.785510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac39e3-f078-4201-af9d-d3f95a0862ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc40f12d9bee4f26adb09753b5590bf8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:33.787491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac39e3-f078-4201-af9d-d3f95a0862ce admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:33.796131 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1048/2056] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:33 2022] POST /identity/v3/users => generated 303 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:33.797221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff02c0e-540f-47ed-9dc9-13280d11cee5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:33.810159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff02c0e-540f-47ed-9dc9-13280d11cee5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:33.815255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6193f-536c-48f3-b7b3-539953bf6bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:33.816163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6193f-536c-48f3-b7b3-539953bf6bca admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:33.816724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6193f-536c-48f3-b7b3-539953bf6bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:33.817073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6193f-536c-48f3-b7b3-539953bf6bca admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:33.818570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6193f-536c-48f3-b7b3-539953bf6bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:33.821242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6193f-536c-48f3-b7b3-539953bf6bca admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:33.839986 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1049/2057] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:33.844379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6193f-536c-48f3-b7b3-539953bf6bca admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:33.862013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6193f-536c-48f3-b7b3-539953bf6bca admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:33.869371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3bac39e3-f078-4201-af9d-d3f95a0862ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc40f12d9bee4f26adb09753b5590bf8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.869572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c22f8-fb2d-4869-abf7-b6df14e44e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:33.870192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3bac39e3-f078-4201-af9d-d3f95a0862ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc40f12d9bee4f26adb09753b5590bf8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.870314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c22f8-fb2d-4869-abf7-b6df14e44e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:33.870803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c22f8-fb2d-4869-abf7-b6df14e44e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:33.871374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c22f8-fb2d-4869-abf7-b6df14e44e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:33.872243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c22f8-fb2d-4869-abf7-b6df14e44e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:33.874023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c22f8-fb2d-4869-abf7-b6df14e44e2d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:33.890190 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1050/2058] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:01:33.895188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c22f8-fb2d-4869-abf7-b6df14e44e2d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:33.895669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3bac39e3-f078-4201-af9d-d3f95a0862ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc40f12d9bee4f26adb09753b5590bf8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.897733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9e5c22f8-fb2d-4869-abf7-b6df14e44e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:33.915335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3bac39e3-f078-4201-af9d-d3f95a0862ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc40f12d9bee4f26adb09753b5590bf8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.915335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3bac39e3-f078-4201-af9d-d3f95a0862ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc40f12d9bee4f26adb09753b5590bf8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:33.931386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c22f8-fb2d-4869-abf7-b6df14e44e2d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:33.942216 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1009/2059] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:33 2022] DELETE /identity/v3/users/fc40f12d9bee4f26adb09753b5590bf8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:33.947133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf6189-f126-4c7e-96ec-017f64e34ff6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:33.947450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d7900-b0d0-4cf9-8971-8d273bd3261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:33.947574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf6189-f126-4c7e-96ec-017f64e34ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:33.948150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d7900-b0d0-4cf9-8971-8d273bd3261a admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:33.948470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d7900-b0d0-4cf9-8971-8d273bd3261a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:33.948767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d7900-b0d0-4cf9-8971-8d273bd3261a admin admin] PATH_INFO: `/v3/projects/e3eddc6c9b244816bf13f5cf684892ab/users/324e48a04be4409a9549f8c7ab062dd7/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:33.948870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf6189-f126-4c7e-96ec-017f64e34ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:33.954533 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:33.976640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-91bf6189-f126-4c7e-96ec-017f64e34ff6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:33.978206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-91bf6189-f126-4c7e-96ec-017f64e34ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:33.979092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d7900-b0d0-4cf9-8971-8d273bd3261a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3eddc6c9b244816bf13f5cf684892ab, user_id=324e48a04be4409a9549f8c7ab062dd7, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:33.982347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d7900-b0d0-4cf9-8971-8d273bd3261a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:33.998095 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:34.002269 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1051/2060] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:33 2022] PUT /identity/v3/projects/e3eddc6c9b244816bf13f5cf684892ab/users/324e48a04be4409a9549f8c7ab062dd7/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:01:34.008710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa3fc3-fe05-41a9-8b6c-d6992893f510 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:34.009273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa3fc3-fe05-41a9-8b6c-d6992893f510 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:34.009782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa3fc3-fe05-41a9-8b6c-d6992893f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:34.035579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a6fa3fc3-fe05-41a9-8b6c-d6992893f510 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:34.038546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a6fa3fc3-fe05-41a9-8b6c-d6992893f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:34.075729 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1010/2061] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:34.092807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf6189-f126-4c7e-96ec-017f64e34ff6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:34.094284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-91bf6189-f126-4c7e-96ec-017f64e34ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:34.153417 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1052/2062] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:34.166167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa3fc3-fe05-41a9-8b6c-d6992893f510 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:34.169371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf6189-f126-4c7e-96ec-017f64e34ff6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:34.239592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e11bd-ae36-4396-95fa-957d1f9666d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:34.240194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e11bd-ae36-4396-95fa-957d1f9666d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:34.240490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e11bd-ae36-4396-95fa-957d1f9666d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:34.240744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e11bd-ae36-4396-95fa-957d1f9666d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:34.256486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e11bd-ae36-4396-95fa-957d1f9666d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:34.257802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa3fc3-fe05-41a9-8b6c-d6992893f510 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:34.257925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e11bd-ae36-4396-95fa-957d1f9666d2 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:34.267834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984afdd-db5a-49ba-a144-a8c68b5450c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:34.268517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984afdd-db5a-49ba-a144-a8c68b5450c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:34.269009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984afdd-db5a-49ba-a144-a8c68b5450c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:34.269355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984afdd-db5a-49ba-a144-a8c68b5450c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:34.272369 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1011/2063] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:34.291157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984afdd-db5a-49ba-a144-a8c68b5450c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:34.292858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984afdd-db5a-49ba-a144-a8c68b5450c3 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:34.306001 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1053/2064] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:01:34.615334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e11bd-ae36-4396-95fa-957d1f9666d2 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:34.617833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eb6e11bd-ae36-4396-95fa-957d1f9666d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:34.634629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e11bd-ae36-4396-95fa-957d1f9666d2 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:34.642040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:34.642415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:34.642815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:34.643728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a admin admin] PATH_INFO: `/v3/projects/8e6c7aa43aae479fb846e1639baf2e3f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:34.645233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6c7aa43aae479fb846e1639baf2e3f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:34.647406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:34.731637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6c7aa43aae479fb846e1639baf2e3f', 'request_id': 'req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:34.744478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6c7aa43aae479fb846e1639baf2e3f', 'request_id': 'req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:34.753596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6c7aa43aae479fb846e1639baf2e3f', 'request_id': 'req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:34.759525 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:34.769895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a admin admin] The token cache is being invalidate because project 8e6c7aa43aae479fb846e1639baf2e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:34.770750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:34.772028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71dac5d9-18fe-4dda-a7c3-627ed4fe513a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:34.776964 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1012/2065] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:34 2022] DELETE /identity/v3/projects/8e6c7aa43aae479fb846e1639baf2e3f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:34.781928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2c1a2-513c-4d21-87f0-c328fa1f290a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:34.782377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2c1a2-513c-4d21-87f0-c328fa1f290a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:34.782454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2c1a2-513c-4d21-87f0-c328fa1f290a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:34.805477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b4b2c1a2-513c-4d21-87f0-c328fa1f290a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:34.806706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b4b2c1a2-513c-4d21-87f0-c328fa1f290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:34.929088 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1054/2066] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:34.937581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f93372-6715-407a-b911-6c0ce1ba2315 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:34.938245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f93372-6715-407a-b911-6c0ce1ba2315 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:34.938588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f93372-6715-407a-b911-6c0ce1ba2315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:34.981333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-79f93372-6715-407a-b911-6c0ce1ba2315 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:34.983486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-79f93372-6715-407a-b911-6c0ce1ba2315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:34.995927 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1013/2067] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:35.000007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2c1a2-513c-4d21-87f0-c328fa1f290a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:35.019747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2c1a2-513c-4d21-87f0-c328fa1f290a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:35.027833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa0aa5-c8d7-4510-bb5e-f21edc76e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:35.028638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa0aa5-c8d7-4510-bb5e-f21edc76e664 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:35.029399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa0aa5-c8d7-4510-bb5e-f21edc76e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:35.029942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa0aa5-c8d7-4510-bb5e-f21edc76e664 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:35.030749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa0aa5-c8d7-4510-bb5e-f21edc76e664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:35.031324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa0aa5-c8d7-4510-bb5e-f21edc76e664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:35.033370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa0aa5-c8d7-4510-bb5e-f21edc76e664 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:35.058955 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1055/2068] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:35.061360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f93372-6715-407a-b911-6c0ce1ba2315 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:35.080674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa0aa5-c8d7-4510-bb5e-f21edc76e664 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:35.084008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f93372-6715-407a-b911-6c0ce1ba2315 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:35.084800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9baa0aa5-c8d7-4510-bb5e-f21edc76e664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:35.089575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525880dc-95c2-4124-95bd-eba219b7e369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:35.090468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525880dc-95c2-4124-95bd-eba219b7e369 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:35.090748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525880dc-95c2-4124-95bd-eba219b7e369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:35.092930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525880dc-95c2-4124-95bd-eba219b7e369 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:35.092930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525880dc-95c2-4124-95bd-eba219b7e369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:35.094555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525880dc-95c2-4124-95bd-eba219b7e369 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:35.110373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa0aa5-c8d7-4510-bb5e-f21edc76e664 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:35.117297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:35.118235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:35.118616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:35.119985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] PATH_INFO: `/v3/projects/e48f2ef261914d849e20edb861c30b20` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:35.121912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48f2ef261914d849e20edb861c30b20)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:35.125317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:35.150395 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:35.160008 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1014/2069] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:35 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:35.161539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525880dc-95c2-4124-95bd-eba219b7e369 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:35.227866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48f2ef261914d849e20edb861c30b20', 'request_id': 'req-617decc6-f779-4239-8c5b-8ca9530714d5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:35.241089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48f2ef261914d849e20edb861c30b20', 'request_id': 'req-617decc6-f779-4239-8c5b-8ca9530714d5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:35.257654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48f2ef261914d849e20edb861c30b20', 'request_id': 'req-617decc6-f779-4239-8c5b-8ca9530714d5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:35.279802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] The token cache is being invalidate because project e48f2ef261914d849e20edb861c30b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:35.280248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:35.280983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:35.282107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525880dc-95c2-4124-95bd-eba219b7e369 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:35.282836 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1056/2070] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:35 2022] DELETE /identity/v3/projects/e48f2ef261914d849e20edb861c30b20 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:35.288560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:35.291803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:35.407714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc447f9d-e6f3-46fd-8823-62709d893c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:35.408661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc447f9d-e6f3-46fd-8823-62709d893c6c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:35.409054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc447f9d-e6f3-46fd-8823-62709d893c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:35.409389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc447f9d-e6f3-46fd-8823-62709d893c6c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:35.410253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc447f9d-e6f3-46fd-8823-62709d893c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:35.412650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc447f9d-e6f3-46fd-8823-62709d893c6c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:35.418348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617decc6-f779-4239-8c5b-8ca9530714d5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:35.425465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d24503-065d-4e07-a733-a0a77d0dc686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:35.426597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d24503-065d-4e07-a733-a0a77d0dc686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:35.427010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d24503-065d-4e07-a733-a0a77d0dc686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:35.427951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d24503-065d-4e07-a733-a0a77d0dc686 admin admin] PATH_INFO: `/v3/users/82a177103d144196b94d0012ed589253` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:35.430081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d24503-065d-4e07-a733-a0a77d0dc686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82a177103d144196b94d0012ed589253)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:35.432898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d24503-065d-4e07-a733-a0a77d0dc686 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:35.451695 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1015/2071] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:35 2022] POST /identity/v3/users => generated 288 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:35.452741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc447f9d-e6f3-46fd-8823-62709d893c6c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:35.455004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fc447f9d-e6f3-46fd-8823-62709d893c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:35.482297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc447f9d-e6f3-46fd-8823-62709d893c6c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:35.505192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a29e3b-6d7b-42b5-8bb3-32c6c7e4ab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:35.505824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a29e3b-6d7b-42b5-8bb3-32c6c7e4ab70 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:35.507105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a29e3b-6d7b-42b5-8bb3-32c6c7e4ab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:35.507606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a29e3b-6d7b-42b5-8bb3-32c6c7e4ab70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:35.508485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a29e3b-6d7b-42b5-8bb3-32c6c7e4ab70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:35.512553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a29e3b-6d7b-42b5-8bb3-32c6c7e4ab70 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:35.525412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-52d24503-065d-4e07-a733-a0a77d0dc686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82a177103d144196b94d0012ed589253'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:35.526078 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1016/2072] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:35.526190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-52d24503-065d-4e07-a733-a0a77d0dc686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82a177103d144196b94d0012ed589253'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:35.529965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a29e3b-6d7b-42b5-8bb3-32c6c7e4ab70 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:35.533385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-40a29e3b-6d7b-42b5-8bb3-32c6c7e4ab70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:35.548783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-52d24503-065d-4e07-a733-a0a77d0dc686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82a177103d144196b94d0012ed589253'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:35.564111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-52d24503-065d-4e07-a733-a0a77d0dc686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82a177103d144196b94d0012ed589253'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:35.566337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-52d24503-065d-4e07-a733-a0a77d0dc686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82a177103d144196b94d0012ed589253'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:35.568096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a29e3b-6d7b-42b5-8bb3-32c6c7e4ab70 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:35.576599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab820bf-f7e6-4d44-b78a-86ba0f19beb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:35.578612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab820bf-f7e6-4d44-b78a-86ba0f19beb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:35.579127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab820bf-f7e6-4d44-b78a-86ba0f19beb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:35.579680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab820bf-f7e6-4d44-b78a-86ba0f19beb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:35.585922 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1057/2073] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:35 2022] DELETE /identity/v3/users/82a177103d144196b94d0012ed589253 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:35.586469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab820bf-f7e6-4d44-b78a-86ba0f19beb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:35.589542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab820bf-f7e6-4d44-b78a-86ba0f19beb8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:35.612183 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1017/2074] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:35.616939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d24503-065d-4e07-a733-a0a77d0dc686 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:35.644301 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:35.727447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d24503-065d-4e07-a733-a0a77d0dc686 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:35.733725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab166e98-4c76-4e5b-b75e-f94e6ec50da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:35.735784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab166e98-4c76-4e5b-b75e-f94e6ec50da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:35.736063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab166e98-4c76-4e5b-b75e-f94e6ec50da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:35.736339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab166e98-4c76-4e5b-b75e-f94e6ec50da5 admin admin] PATH_INFO: `/v3/projects/1859d792d8da4c08a3f3b43403c600a5/users/04a64f25f091497ea9f5dec42ad3cecc/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:35.765252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab166e98-4c76-4e5b-b75e-f94e6ec50da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1859d792d8da4c08a3f3b43403c600a5, user_id=04a64f25f091497ea9f5dec42ad3cecc, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:35.769621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab166e98-4c76-4e5b-b75e-f94e6ec50da5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:35.796444 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1058/2075] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:35 2022] PUT /identity/v3/projects/1859d792d8da4c08a3f3b43403c600a5/users/04a64f25f091497ea9f5dec42ad3cecc/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:35.806976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cc6fc-0c53-4c22-8519-01333d995b42 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:35.807816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cc6fc-0c53-4c22-8519-01333d995b42 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:35.809254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cc6fc-0c53-4c22-8519-01333d995b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:35.844834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a66cc6fc-0c53-4c22-8519-01333d995b42 None None] MFA Rules not processed for user `04a64f25f091497ea9f5dec42ad3cecc`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:35.847079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a66cc6fc-0c53-4c22-8519-01333d995b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:35.894813 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:35.958741 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1018/2076] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:35.964047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab166e98-4c76-4e5b-b75e-f94e6ec50da5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:36.054187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab166e98-4c76-4e5b-b75e-f94e6ec50da5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:36.060914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8135f4-5aec-4a16-8c9f-d2eb8d445ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:36.061529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8135f4-5aec-4a16-8c9f-d2eb8d445ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:36.061804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8135f4-5aec-4a16-8c9f-d2eb8d445ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:36.062070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8135f4-5aec-4a16-8c9f-d2eb8d445ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:36.062760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8135f4-5aec-4a16-8c9f-d2eb8d445ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:36.064715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8135f4-5aec-4a16-8c9f-d2eb8d445ee3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:36.106615 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1059/2077] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:35 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:36.111417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cc6fc-0c53-4c22-8519-01333d995b42 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:36.123544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cc6fc-0c53-4c22-8519-01333d995b42 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:36.220665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac965ee0-8e20-4a4d-9ee3-309004eda355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:36.222697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac965ee0-8e20-4a4d-9ee3-309004eda355 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:36.223397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac965ee0-8e20-4a4d-9ee3-309004eda355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:36.224324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac965ee0-8e20-4a4d-9ee3-309004eda355 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:36.225179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac965ee0-8e20-4a4d-9ee3-309004eda355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:36.228416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac965ee0-8e20-4a4d-9ee3-309004eda355 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:36.260921 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1019/2078] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:36 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:36.262661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8135f4-5aec-4a16-8c9f-d2eb8d445ee3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:36.277041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8135f4-5aec-4a16-8c9f-d2eb8d445ee3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:36.284268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236d00b-b167-43df-9bab-0fd0612b8a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:36.285726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236d00b-b167-43df-9bab-0fd0612b8a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:36.285726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236d00b-b167-43df-9bab-0fd0612b8a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:36.285726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236d00b-b167-43df-9bab-0fd0612b8a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:36.286409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236d00b-b167-43df-9bab-0fd0612b8a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:36.288992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236d00b-b167-43df-9bab-0fd0612b8a22 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:36.308825 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1060/2079] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:36.310164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac965ee0-8e20-4a4d-9ee3-309004eda355 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:36.336592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac965ee0-8e20-4a4d-9ee3-309004eda355 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:36.343773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19ad58-91f9-4607-9ff7-b4e686e68902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:36.344879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19ad58-91f9-4607-9ff7-b4e686e68902 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:36.344994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19ad58-91f9-4607-9ff7-b4e686e68902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:36.345346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19ad58-91f9-4607-9ff7-b4e686e68902 admin admin] PATH_INFO: `/v3/projects/a2582367c3a340f8bce00a4517a17c14/users/767deea0bd28443fa71c996a75e7fbc9/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:36.372767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19ad58-91f9-4607-9ff7-b4e686e68902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2582367c3a340f8bce00a4517a17c14, user_id=767deea0bd28443fa71c996a75e7fbc9, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:36.376820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19ad58-91f9-4607-9ff7-b4e686e68902 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:36.406215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236d00b-b167-43df-9bab-0fd0612b8a22 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:36.406660 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1020/2080] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:36 2022] PUT /identity/v3/projects/a2582367c3a340f8bce00a4517a17c14/users/767deea0bd28443fa71c996a75e7fbc9/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:01:36.426300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236d00b-b167-43df-9bab-0fd0612b8a22 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:36.515258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19ad58-91f9-4607-9ff7-b4e686e68902 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:36.517039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ee19ad58-91f9-4607-9ff7-b4e686e68902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:36.606011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae73a1-53b6-4e2a-892e-cc0396aec240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:36.606614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae73a1-53b6-4e2a-892e-cc0396aec240 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:36.606985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae73a1-53b6-4e2a-892e-cc0396aec240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:36.607178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae73a1-53b6-4e2a-892e-cc0396aec240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:36.607826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae73a1-53b6-4e2a-892e-cc0396aec240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:36.614255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae73a1-53b6-4e2a-892e-cc0396aec240 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:36.668833 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1061/2081] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:36.677149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae73a1-53b6-4e2a-892e-cc0396aec240 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:36.695625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae73a1-53b6-4e2a-892e-cc0396aec240 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:36.709987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af66c9f-618c-4f89-a5c4-6001e7ac3b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:36.710664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af66c9f-618c-4f89-a5c4-6001e7ac3b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:36.710845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19ad58-91f9-4607-9ff7-b4e686e68902 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:36.711077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af66c9f-618c-4f89-a5c4-6001e7ac3b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:36.711353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af66c9f-618c-4f89-a5c4-6001e7ac3b49 admin admin] PATH_INFO: `/v3/projects/a2582367c3a340f8bce00a4517a17c14/users/767deea0bd28443fa71c996a75e7fbc9/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:36.719567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af66c9f-618c-4f89-a5c4-6001e7ac3b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2582367c3a340f8bce00a4517a17c14, user_id=767deea0bd28443fa71c996a75e7fbc9, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:36.723009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af66c9f-618c-4f89-a5c4-6001e7ac3b49 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:36.732643 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:36.739718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249f703-d145-4acb-8658-2835a4d0bffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:36.740420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249f703-d145-4acb-8658-2835a4d0bffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:36.740703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249f703-d145-4acb-8658-2835a4d0bffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:36.741137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249f703-d145-4acb-8658-2835a4d0bffb admin admin] PATH_INFO: `/v3/projects/dbfd4f76ce4a4536b3ce83255010b060` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:36.743881 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1062/2082] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:36 2022] PUT /identity/v3/projects/a2582367c3a340f8bce00a4517a17c14/users/767deea0bd28443fa71c996a75e7fbc9/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:01:36.754662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249f703-d145-4acb-8658-2835a4d0bffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfd4f76ce4a4536b3ce83255010b060)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:36.756707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249f703-d145-4acb-8658-2835a4d0bffb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:36.761400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66966f-ac16-49ff-b1d9-d5554564600d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:36.761834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66966f-ac16-49ff-b1d9-d5554564600d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:36.762403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66966f-ac16-49ff-b1d9-d5554564600d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:36.814425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ce66966f-ac16-49ff-b1d9-d5554564600d None None] MFA Rules not processed for user `767deea0bd28443fa71c996a75e7fbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:36.817481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ce66966f-ac16-49ff-b1d9-d5554564600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:36.852873 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:36.870635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b249f703-d145-4acb-8658-2835a4d0bffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfd4f76ce4a4536b3ce83255010b060', 'request_id': 'req-b249f703-d145-4acb-8658-2835a4d0bffb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:36.887934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b249f703-d145-4acb-8658-2835a4d0bffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfd4f76ce4a4536b3ce83255010b060', 'request_id': 'req-b249f703-d145-4acb-8658-2835a4d0bffb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:36.906600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b249f703-d145-4acb-8658-2835a4d0bffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfd4f76ce4a4536b3ce83255010b060', 'request_id': 'req-b249f703-d145-4acb-8658-2835a4d0bffb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:36.929958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b249f703-d145-4acb-8658-2835a4d0bffb admin admin] The token cache is being invalidate because project dbfd4f76ce4a4536b3ce83255010b060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:36.930339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b249f703-d145-4acb-8658-2835a4d0bffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:36.931169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b249f703-d145-4acb-8658-2835a4d0bffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:36.938589 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1021/2083] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:36 2022] DELETE /identity/v3/projects/dbfd4f76ce4a4536b3ce83255010b060 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:36.940952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f41b1-cb2b-419d-9878-dee74ce84bc3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:36.941331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f41b1-cb2b-419d-9878-dee74ce84bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:36.941686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f41b1-cb2b-419d-9878-dee74ce84bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:36.990781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2e1f41b1-cb2b-419d-9878-dee74ce84bc3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:36.994536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2e1f41b1-cb2b-419d-9878-dee74ce84bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:37.025614 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1063/2084] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:37.131556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb11e0-a6b6-4783-bbe2-0dbe0c55cbff None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:37.131987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb11e0-a6b6-4783-bbe2-0dbe0c55cbff None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:37.132344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb11e0-a6b6-4783-bbe2-0dbe0c55cbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:37.141536 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1022/2085] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:37.172141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dbcb11e0-a6b6-4783-bbe2-0dbe0c55cbff None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:37.178052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dbcb11e0-a6b6-4783-bbe2-0dbe0c55cbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:37.208574 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1064/2086] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:37.210125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f41b1-cb2b-419d-9878-dee74ce84bc3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:37.222972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f41b1-cb2b-419d-9878-dee74ce84bc3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:37.236168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69a0ae-3d8c-4891-b027-ee20cad0d1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:37.236850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69a0ae-3d8c-4891-b027-ee20cad0d1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:37.237132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69a0ae-3d8c-4891-b027-ee20cad0d1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:37.237406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69a0ae-3d8c-4891-b027-ee20cad0d1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:37.238066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69a0ae-3d8c-4891-b027-ee20cad0d1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:37.238368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69a0ae-3d8c-4891-b027-ee20cad0d1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:37.240204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69a0ae-3d8c-4891-b027-ee20cad0d1e8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:37.250679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb11e0-a6b6-4783-bbe2-0dbe0c55cbff None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:37.255393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dbcb11e0-a6b6-4783-bbe2-0dbe0c55cbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:37.271317 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1023/2087] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:37.271881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69a0ae-3d8c-4891-b027-ee20cad0d1e8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:37.295383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69a0ae-3d8c-4891-b027-ee20cad0d1e8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:37.309701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd44f2-2dd3-4b37-a479-32a7e3e879dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:37.311063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd44f2-2dd3-4b37-a479-32a7e3e879dc admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:37.311707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd44f2-2dd3-4b37-a479-32a7e3e879dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:37.314187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd44f2-2dd3-4b37-a479-32a7e3e879dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:37.321399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd44f2-2dd3-4b37-a479-32a7e3e879dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:37.325463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd44f2-2dd3-4b37-a479-32a7e3e879dc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:37.392045 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1024/2088] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:37 2022] POST /identity/v3/projects => generated 411 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:37.393894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd44f2-2dd3-4b37-a479-32a7e3e879dc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:37.454513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb11e0-a6b6-4783-bbe2-0dbe0c55cbff None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:37.500794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd44f2-2dd3-4b37-a479-32a7e3e879dc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:37.521065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369b911-2cc1-4c86-a2bf-7c778f7f918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:37.521800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369b911-2cc1-4c86-a2bf-7c778f7f918b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:37.522076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369b911-2cc1-4c86-a2bf-7c778f7f918b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:37.522349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369b911-2cc1-4c86-a2bf-7c778f7f918b admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:37.523118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369b911-2cc1-4c86-a2bf-7c778f7f918b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:37.525046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369b911-2cc1-4c86-a2bf-7c778f7f918b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:37.574056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c8ecd-d1c6-4d0a-8cdd-49c230500873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:37.574682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c8ecd-d1c6-4d0a-8cdd-49c230500873 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:37.574990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c8ecd-d1c6-4d0a-8cdd-49c230500873 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:37.575364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c8ecd-d1c6-4d0a-8cdd-49c230500873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:37.584270 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1025/2089] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:37 2022] POST /identity/v3/users => generated 306 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:37.588360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369b911-2cc1-4c86-a2bf-7c778f7f918b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:37.602738 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:37.612968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369b911-2cc1-4c86-a2bf-7c778f7f918b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:37.625623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f34c1-6fd0-4e92-8792-c2b4321c9a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:37.626394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f34c1-6fd0-4e92-8792-c2b4321c9a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:37.627600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f34c1-6fd0-4e92-8792-c2b4321c9a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:37.629474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f34c1-6fd0-4e92-8792-c2b4321c9a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:37.633010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f34c1-6fd0-4e92-8792-c2b4321c9a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:37.636957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f34c1-6fd0-4e92-8792-c2b4321c9a0c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:37.662983 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1026/2090] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:37.666416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f34c1-6fd0-4e92-8792-c2b4321c9a0c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:37.697264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f34c1-6fd0-4e92-8792-c2b4321c9a0c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:37.716361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e451c-eeda-4056-a9c7-b9ac5cfe802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:37.717986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e451c-eeda-4056-a9c7-b9ac5cfe802a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:37.720490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e451c-eeda-4056-a9c7-b9ac5cfe802a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:37.722854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e451c-eeda-4056-a9c7-b9ac5cfe802a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:37.724227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e451c-eeda-4056-a9c7-b9ac5cfe802a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:37.728951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e451c-eeda-4056-a9c7-b9ac5cfe802a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:37.747076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c8ecd-d1c6-4d0a-8cdd-49c230500873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:37.747324 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:37.751833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c8ecd-d1c6-4d0a-8cdd-49c230500873 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:37.769364 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1027/2091] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:37.770881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e451c-eeda-4056-a9c7-b9ac5cfe802a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:37.788532 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1065/2092] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:37.816309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e451c-eeda-4056-a9c7-b9ac5cfe802a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:37.832272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ffad8-1cff-4c35-ad3a-e7aeea1aced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:37.837402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ffad8-1cff-4c35-ad3a-e7aeea1aced2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:37.838649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ffad8-1cff-4c35-ad3a-e7aeea1aced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:37.838649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ffad8-1cff-4c35-ad3a-e7aeea1aced2 admin admin] PATH_INFO: `/v3/projects/8b4ef535b0684c0180329169a5765107/users/37a61a57ad4448eba9c1bd8762d3a149/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:37.886615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ffad8-1cff-4c35-ad3a-e7aeea1aced2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4ef535b0684c0180329169a5765107, user_id=37a61a57ad4448eba9c1bd8762d3a149, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:37.892481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ffad8-1cff-4c35-ad3a-e7aeea1aced2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:37.933989 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1028/2093] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:37 2022] PUT /identity/v3/projects/8b4ef535b0684c0180329169a5765107/users/37a61a57ad4448eba9c1bd8762d3a149/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:37.941462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47967-ba0a-44bf-bdf5-30d605db3418 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:37.941992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47967-ba0a-44bf-bdf5-30d605db3418 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:37.942447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47967-ba0a-44bf-bdf5-30d605db3418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:37.976400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-11c47967-ba0a-44bf-bdf5-30d605db3418 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:37.978206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-11c47967-ba0a-44bf-bdf5-30d605db3418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:38.162716 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1066/2094] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:38.174904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ffad8-1cff-4c35-ad3a-e7aeea1aced2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:38.177029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-150ffad8-1cff-4c35-ad3a-e7aeea1aced2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:38.273750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ffad8-1cff-4c35-ad3a-e7aeea1aced2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:38.284455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aafb7-b5e9-4bda-946b-e4db0d4fc123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:38.285111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aafb7-b5e9-4bda-946b-e4db0d4fc123 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:38.285390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aafb7-b5e9-4bda-946b-e4db0d4fc123 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:38.285662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aafb7-b5e9-4bda-946b-e4db0d4fc123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:38.312194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6aafb7-b5e9-4bda-946b-e4db0d4fc123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:38.312600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6aafb7-b5e9-4bda-946b-e4db0d4fc123 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:38.332472 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1029/2095] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:38.727894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c47967-ba0a-44bf-bdf5-30d605db3418 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:38.729462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-11c47967-ba0a-44bf-bdf5-30d605db3418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:38.755199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c47967-ba0a-44bf-bdf5-30d605db3418 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:38.759995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:38.760651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:38.760916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:38.761190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] PATH_INFO: `/v3/users/04a64f25f091497ea9f5dec42ad3cecc` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:38.768916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a64f25f091497ea9f5dec42ad3cecc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:38.771306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:38.832848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a64f25f091497ea9f5dec42ad3cecc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:38.833530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a64f25f091497ea9f5dec42ad3cecc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:38.848834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a64f25f091497ea9f5dec42ad3cecc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:38.859281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a64f25f091497ea9f5dec42ad3cecc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:38.859939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a64f25f091497ea9f5dec42ad3cecc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:38.880041 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1067/2096] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:38 2022] DELETE /identity/v3/users/04a64f25f091497ea9f5dec42ad3cecc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:38.884473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84b43f-66f9-4a6a-871c-251663e1d000 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:38.884761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84b43f-66f9-4a6a-871c-251663e1d000 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:38.885204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84b43f-66f9-4a6a-871c-251663e1d000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:38.924156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ce84b43f-66f9-4a6a-871c-251663e1d000 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:38.927936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ce84b43f-66f9-4a6a-871c-251663e1d000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:39.092296 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1030/2097] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:39.136167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:39.137627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:39.185922 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:39.279337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7041f3-0cc7-479e-b3c4-76be99273475 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:39.292109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b7db2-6f91-4289-acf4-5166b94aa08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:39.292996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b7db2-6f91-4289-acf4-5166b94aa08b service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:39.293276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b7db2-6f91-4289-acf4-5166b94aa08b service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:39.294157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b7db2-6f91-4289-acf4-5166b94aa08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:39.314493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b7db2-6f91-4289-acf4-5166b94aa08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:39.316355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b7db2-6f91-4289-acf4-5166b94aa08b service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:39.329073 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1068/2098] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:41.527483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84b43f-66f9-4a6a-871c-251663e1d000 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:41.529009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ce84b43f-66f9-4a6a-871c-251663e1d000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:41.551773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84b43f-66f9-4a6a-871c-251663e1d000 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:41.601846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:41.602505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:41.604677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:41.607286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] PATH_INFO: `/v3/projects/1859d792d8da4c08a3f3b43403c600a5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:41.622273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1859d792d8da4c08a3f3b43403c600a5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:41.625111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:41.699310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1859d792d8da4c08a3f3b43403c600a5', 'request_id': 'req-833dfead-4349-4833-8799-347d92a818ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:41.710037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1859d792d8da4c08a3f3b43403c600a5', 'request_id': 'req-833dfead-4349-4833-8799-347d92a818ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:41.720544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1859d792d8da4c08a3f3b43403c600a5', 'request_id': 'req-833dfead-4349-4833-8799-347d92a818ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:41.741451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] The token cache is being invalidate because project 1859d792d8da4c08a3f3b43403c600a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:41.742143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:41.743046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:41.744714 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1031/2099] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:41 2022] DELETE /identity/v3/projects/1859d792d8da4c08a3f3b43403c600a5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:41.748874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b7db2-6f91-4289-acf4-5166b94aa08b service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:41.766681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b7db2-6f91-4289-acf4-5166b94aa08b service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:41.892260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3d263-eddc-45f2-87ac-8ca2ffda924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:41.893471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3d263-eddc-45f2-87ac-8ca2ffda924a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:41.893820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3d263-eddc-45f2-87ac-8ca2ffda924a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:41.894051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3d263-eddc-45f2-87ac-8ca2ffda924a admin admin] PATH_INFO: `/v3/users/767deea0bd28443fa71c996a75e7fbc9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:41.895208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3d263-eddc-45f2-87ac-8ca2ffda924a admin admin] RBAC: Authorizing `identity:delete_user(user_id=767deea0bd28443fa71c996a75e7fbc9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:41.897154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3d263-eddc-45f2-87ac-8ca2ffda924a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:41.980765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bef3d263-eddc-45f2-87ac-8ca2ffda924a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767deea0bd28443fa71c996a75e7fbc9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:41.981723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bef3d263-eddc-45f2-87ac-8ca2ffda924a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767deea0bd28443fa71c996a75e7fbc9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:42.045095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bef3d263-eddc-45f2-87ac-8ca2ffda924a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767deea0bd28443fa71c996a75e7fbc9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:42.062190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bef3d263-eddc-45f2-87ac-8ca2ffda924a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767deea0bd28443fa71c996a75e7fbc9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:42.062871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bef3d263-eddc-45f2-87ac-8ca2ffda924a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767deea0bd28443fa71c996a75e7fbc9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:42.100030 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1069/2100] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:41 2022] DELETE /identity/v3/users/767deea0bd28443fa71c996a75e7fbc9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:43.004442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:43.006907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:43.019093 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:43.042891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dfead-4349-4833-8799-347d92a818ad admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:43.144934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300947df-f024-455a-8dfe-c97aa062b15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:43.145919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300947df-f024-455a-8dfe-c97aa062b15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:43.146419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300947df-f024-455a-8dfe-c97aa062b15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:43.146876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300947df-f024-455a-8dfe-c97aa062b15e admin admin] PATH_INFO: `/v3/projects/a2582367c3a340f8bce00a4517a17c14` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:43.148428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300947df-f024-455a-8dfe-c97aa062b15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2582367c3a340f8bce00a4517a17c14)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:43.150553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300947df-f024-455a-8dfe-c97aa062b15e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:43.249740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-300947df-f024-455a-8dfe-c97aa062b15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2582367c3a340f8bce00a4517a17c14', 'request_id': 'req-300947df-f024-455a-8dfe-c97aa062b15e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:43.260677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-300947df-f024-455a-8dfe-c97aa062b15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2582367c3a340f8bce00a4517a17c14', 'request_id': 'req-300947df-f024-455a-8dfe-c97aa062b15e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:43.275795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-300947df-f024-455a-8dfe-c97aa062b15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2582367c3a340f8bce00a4517a17c14', 'request_id': 'req-300947df-f024-455a-8dfe-c97aa062b15e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:43.301717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-300947df-f024-455a-8dfe-c97aa062b15e admin admin] The token cache is being invalidate because project a2582367c3a340f8bce00a4517a17c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:43.302304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-300947df-f024-455a-8dfe-c97aa062b15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:43.303461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-300947df-f024-455a-8dfe-c97aa062b15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:43.306318 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1032/2101] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:43 2022] DELETE /identity/v3/projects/a2582367c3a340f8bce00a4517a17c14 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:43.311607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d6416-8574-446a-ad94-c92d7fef0616 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:43.313002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d6416-8574-446a-ad94-c92d7fef0616 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:43.313438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d6416-8574-446a-ad94-c92d7fef0616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:43.358899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-859d6416-8574-446a-ad94-c92d7fef0616 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:43.360458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-859d6416-8574-446a-ad94-c92d7fef0616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:43.444266 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:43.524018 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1070/2102] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:43.527743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69618ecd-3309-4fda-b1b3-9b69225f5772 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:43.528279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69618ecd-3309-4fda-b1b3-9b69225f5772 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:43.528718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69618ecd-3309-4fda-b1b3-9b69225f5772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:43.586044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-69618ecd-3309-4fda-b1b3-9b69225f5772 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:43.587698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-69618ecd-3309-4fda-b1b3-9b69225f5772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:43.609996 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1033/2103] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:43.614092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d6416-8574-446a-ad94-c92d7fef0616 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:43.626260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d6416-8574-446a-ad94-c92d7fef0616 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:43.635025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a739e4-20ba-42ab-9ff8-96fc69861cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:43.635669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a739e4-20ba-42ab-9ff8-96fc69861cbd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:43.636339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a739e4-20ba-42ab-9ff8-96fc69861cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:43.636621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a739e4-20ba-42ab-9ff8-96fc69861cbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:43.637296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a739e4-20ba-42ab-9ff8-96fc69861cbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:43.637606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a739e4-20ba-42ab-9ff8-96fc69861cbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:43.639451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a739e4-20ba-42ab-9ff8-96fc69861cbd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:43.658399 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1071/2104] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:43.663996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69618ecd-3309-4fda-b1b3-9b69225f5772 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:43.679310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69618ecd-3309-4fda-b1b3-9b69225f5772 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:43.694785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ca9a0-b371-4da7-906c-594f1dbbe4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:43.695669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ca9a0-b371-4da7-906c-594f1dbbe4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:43.696100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ca9a0-b371-4da7-906c-594f1dbbe4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:43.696521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ca9a0-b371-4da7-906c-594f1dbbe4d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:43.697560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ca9a0-b371-4da7-906c-594f1dbbe4d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:43.700150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ca9a0-b371-4da7-906c-594f1dbbe4d6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:43.762554 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1034/2105] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:43 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:43.763978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a739e4-20ba-42ab-9ff8-96fc69861cbd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:43.786713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a739e4-20ba-42ab-9ff8-96fc69861cbd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:43.884142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babd34b-ff66-4630-b78b-adc25cfd6ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:43.885772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babd34b-ff66-4630-b78b-adc25cfd6ebc admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:43.886137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babd34b-ff66-4630-b78b-adc25cfd6ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:43.886481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babd34b-ff66-4630-b78b-adc25cfd6ebc admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:43.887803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babd34b-ff66-4630-b78b-adc25cfd6ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:43.891782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babd34b-ff66-4630-b78b-adc25cfd6ebc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:43.931208 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1072/2106] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:43 2022] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:43.932234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ca9a0-b371-4da7-906c-594f1dbbe4d6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:43.962463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ca9a0-b371-4da7-906c-594f1dbbe4d6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:43.995697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4fb7e-f0f0-4c80-81a8-a73318752329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:43.996361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4fb7e-f0f0-4c80-81a8-a73318752329 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:43.997344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4fb7e-f0f0-4c80-81a8-a73318752329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:43.997628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4fb7e-f0f0-4c80-81a8-a73318752329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:44.004030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4fb7e-f0f0-4c80-81a8-a73318752329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:44.008740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4fb7e-f0f0-4c80-81a8-a73318752329 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:44.037857 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1035/2107] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:44.041863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babd34b-ff66-4630-b78b-adc25cfd6ebc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:44.059222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babd34b-ff66-4630-b78b-adc25cfd6ebc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:44.083103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d89dd-6d42-4476-8d66-5317de462bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:44.083827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d89dd-6d42-4476-8d66-5317de462bab admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:44.084205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d89dd-6d42-4476-8d66-5317de462bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:44.084577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d89dd-6d42-4476-8d66-5317de462bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:44.085413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d89dd-6d42-4476-8d66-5317de462bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:44.087373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d89dd-6d42-4476-8d66-5317de462bab admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:44.101783 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1073/2108] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:01:44.105564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4fb7e-f0f0-4c80-81a8-a73318752329 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:44.123502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4fb7e-f0f0-4c80-81a8-a73318752329 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:44.140228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046383-ecbf-41f0-86bc-5f36130aff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:44.142243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046383-ecbf-41f0-86bc-5f36130aff1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:44.142638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046383-ecbf-41f0-86bc-5f36130aff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:44.143650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046383-ecbf-41f0-86bc-5f36130aff1f admin admin] PATH_INFO: `/v3/projects/5715fa91478744bf9563dc2ccf6f29d7/users/3711814aa0e34f5491631828ae21afdc/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:44.186852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c046383-ecbf-41f0-86bc-5f36130aff1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5715fa91478744bf9563dc2ccf6f29d7, user_id=3711814aa0e34f5491631828ae21afdc, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:44.194230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05137a10-77b5-48bb-9634-f5e7ec059bd6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:44.194617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05137a10-77b5-48bb-9634-f5e7ec059bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:44.195085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05137a10-77b5-48bb-9634-f5e7ec059bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:44.208779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c046383-ecbf-41f0-86bc-5f36130aff1f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:44.242115 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1036/2109] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:44 2022] PUT /identity/v3/projects/5715fa91478744bf9563dc2ccf6f29d7/users/3711814aa0e34f5491631828ae21afdc/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:44.253101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe7409-cb1c-45eb-8084-0fb79dce1eca None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:44.253692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe7409-cb1c-45eb-8084-0fb79dce1eca None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:44.254157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe7409-cb1c-45eb-8084-0fb79dce1eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:44.265989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-05137a10-77b5-48bb-9634-f5e7ec059bd6 None None] MFA Rules not processed for user `324e48a04be4409a9549f8c7ab062dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:44.269425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05137a10-77b5-48bb-9634-f5e7ec059bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:44.318550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6dfe7409-cb1c-45eb-8084-0fb79dce1eca None None] MFA Rules not processed for user `3711814aa0e34f5491631828ae21afdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:44.325986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6dfe7409-cb1c-45eb-8084-0fb79dce1eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:44.372884 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:44.427823 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1074/2110] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:44 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:01:44.431956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05137a10-77b5-48bb-9634-f5e7ec059bd6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:44.435418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05137a10-77b5-48bb-9634-f5e7ec059bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:44.488785 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1037/2111] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:44.493742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe7409-cb1c-45eb-8084-0fb79dce1eca None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:44.518297 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:44.576891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05137a10-77b5-48bb-9634-f5e7ec059bd6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:44.598672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2a99b-78d1-4e19-8135-6e9baf120af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:44.599600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2a99b-78d1-4e19-8135-6e9baf120af3 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:44.600006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2a99b-78d1-4e19-8135-6e9baf120af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:44.600787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2a99b-78d1-4e19-8135-6e9baf120af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:44.601533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2a99b-78d1-4e19-8135-6e9baf120af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:44.603828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2a99b-78d1-4e19-8135-6e9baf120af3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:44.695999 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1075/2112] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:44 2022] POST /identity/v3/projects => generated 401 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:44.700430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2a99b-78d1-4e19-8135-6e9baf120af3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:44.710253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe7409-cb1c-45eb-8084-0fb79dce1eca None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:44.844639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2a99b-78d1-4e19-8135-6e9baf120af3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:44.852974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf41c62-87b4-4b3f-bfa4-888598916293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:44.853599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf41c62-87b4-4b3f-bfa4-888598916293 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:44.853875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf41c62-87b4-4b3f-bfa4-888598916293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:44.854146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf41c62-87b4-4b3f-bfa4-888598916293 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:44.855226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf41c62-87b4-4b3f-bfa4-888598916293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:44.858635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf41c62-87b4-4b3f-bfa4-888598916293 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:44.872755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f6ff5-c8d5-4d52-b588-5d7ec1e8d82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:44.873719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f6ff5-c8d5-4d52-b588-5d7ec1e8d82a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:44.874143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f6ff5-c8d5-4d52-b588-5d7ec1e8d82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:44.874774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f6ff5-c8d5-4d52-b588-5d7ec1e8d82a admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:44.875692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f6ff5-c8d5-4d52-b588-5d7ec1e8d82a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:44.879941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f6ff5-c8d5-4d52-b588-5d7ec1e8d82a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:44.902343 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1076/2113] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:44 2022] POST /identity/v3/users => generated 307 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:44.906658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec70d4-867e-4c2d-9f77-7a92c7565940 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:44.907709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec70d4-867e-4c2d-9f77-7a92c7565940 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:44.910502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec70d4-867e-4c2d-9f77-7a92c7565940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:44.924701 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1038/2114] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:44 2022] POST /identity/v3/projects => generated 379 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:01:44.925821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f6ff5-c8d5-4d52-b588-5d7ec1e8d82a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:44.947058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e6ec70d4-867e-4c2d-9f77-7a92c7565940 None None] MFA Rules not processed for user `f3b14e05c41648159d8ed97719c68862`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:44.949010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e6ec70d4-867e-4c2d-9f77-7a92c7565940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:45.000850 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:45.024679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f6ff5-c8d5-4d52-b588-5d7ec1e8d82a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:45.037738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed943d45-c401-44a5-b270-8cd02ea924ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:45.039430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed943d45-c401-44a5-b270-8cd02ea924ad admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:45.039877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed943d45-c401-44a5-b270-8cd02ea924ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:45.040345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed943d45-c401-44a5-b270-8cd02ea924ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:45.041144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed943d45-c401-44a5-b270-8cd02ea924ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:45.043291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed943d45-c401-44a5-b270-8cd02ea924ad admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:45.064081 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1039/2115] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:45.064203 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1077/2116] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:45.069200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed943d45-c401-44a5-b270-8cd02ea924ad admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:45.069846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec70d4-867e-4c2d-9f77-7a92c7565940 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:45.084255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec70d4-867e-4c2d-9f77-7a92c7565940 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:45.089815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089141a-14bf-4342-bf74-32c2ffd424aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:45.090723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089141a-14bf-4342-bf74-32c2ffd424aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:45.091096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089141a-14bf-4342-bf74-32c2ffd424aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:45.091435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089141a-14bf-4342-bf74-32c2ffd424aa admin admin] PATH_INFO: `/v3/projects/f3796bf94a0f4639a5c7da48f22df240/users/d82b62a7b6a44a7d9637493976268a5c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:45.105927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed943d45-c401-44a5-b270-8cd02ea924ad admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:45.121938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc1f81-aa6d-4fdf-8395-bd8fed0627fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:45.123245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc1f81-aa6d-4fdf-8395-bd8fed0627fa admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:45.123695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc1f81-aa6d-4fdf-8395-bd8fed0627fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:45.124123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc1f81-aa6d-4fdf-8395-bd8fed0627fa admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:45.124923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc1f81-aa6d-4fdf-8395-bd8fed0627fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:45.127896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089141a-14bf-4342-bf74-32c2ffd424aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3796bf94a0f4639a5c7da48f22df240, user_id=d82b62a7b6a44a7d9637493976268a5c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:45.130142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc1f81-aa6d-4fdf-8395-bd8fed0627fa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:45.139575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089141a-14bf-4342-bf74-32c2ffd424aa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:45.167053 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1078/2117] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:45 2022] PUT /identity/v3/projects/f3796bf94a0f4639a5c7da48f22df240/users/d82b62a7b6a44a7d9637493976268a5c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:45.170883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089141a-14bf-4342-bf74-32c2ffd424aa admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:45.185911 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1040/2118] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:45 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:45.192468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc1f81-aa6d-4fdf-8395-bd8fed0627fa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:45.219234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc1f81-aa6d-4fdf-8395-bd8fed0627fa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:45.228688 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:45.270801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089141a-14bf-4342-bf74-32c2ffd424aa admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:45.278703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcfb8b-696a-4e9c-adc5-bf844cd9d32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:45.280267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcfb8b-696a-4e9c-adc5-bf844cd9d32e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:45.280731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcfb8b-696a-4e9c-adc5-bf844cd9d32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:45.281097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcfb8b-696a-4e9c-adc5-bf844cd9d32e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:45.282024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcfb8b-696a-4e9c-adc5-bf844cd9d32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:45.285001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcfb8b-696a-4e9c-adc5-bf844cd9d32e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:45.303676 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1079/2119] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:45.304817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcfb8b-696a-4e9c-adc5-bf844cd9d32e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:45.327288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcfb8b-696a-4e9c-adc5-bf844cd9d32e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:45.341579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2a669-f7f0-47e7-9965-f0f4d8a8fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:45.342266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2a669-f7f0-47e7-9965-f0f4d8a8fc99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:45.342546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2a669-f7f0-47e7-9965-f0f4d8a8fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:45.344240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2a669-f7f0-47e7-9965-f0f4d8a8fc99 admin admin] PATH_INFO: `/v3/projects/f3796bf94a0f4639a5c7da48f22df240/users/d82b62a7b6a44a7d9637493976268a5c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:45.352238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2a669-f7f0-47e7-9965-f0f4d8a8fc99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3796bf94a0f4639a5c7da48f22df240, user_id=d82b62a7b6a44a7d9637493976268a5c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:45.359931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2a669-f7f0-47e7-9965-f0f4d8a8fc99 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:45.361391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca011303-cd08-4f86-9ece-dc46a1521818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:45.362275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca011303-cd08-4f86-9ece-dc46a1521818 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:45.362840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca011303-cd08-4f86-9ece-dc46a1521818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:45.363135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca011303-cd08-4f86-9ece-dc46a1521818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:45.363910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca011303-cd08-4f86-9ece-dc46a1521818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:45.365642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca011303-cd08-4f86-9ece-dc46a1521818 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:45.397674 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1041/2121] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:45.397873 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1080/2121] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:45 2022] PUT /identity/v3/projects/f3796bf94a0f4639a5c7da48f22df240/users/d82b62a7b6a44a7d9637493976268a5c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:45.399000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca011303-cd08-4f86-9ece-dc46a1521818 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:45.412724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca011303-cd08-4f86-9ece-dc46a1521818 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:45.507412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f968a-2a0d-4576-9d82-5778b9b11a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:45.508698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f968a-2a0d-4576-9d82-5778b9b11a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:45.509212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f968a-2a0d-4576-9d82-5778b9b11a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:45.509637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f968a-2a0d-4576-9d82-5778b9b11a9e admin admin] PATH_INFO: `/v3/projects/bbb383441ef54487b58fcb51e8140de4/users/979c950aa999436c8e6c3af3090021f0/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:45.536862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f968a-2a0d-4576-9d82-5778b9b11a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb383441ef54487b58fcb51e8140de4, user_id=979c950aa999436c8e6c3af3090021f0, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:45.561771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f968a-2a0d-4576-9d82-5778b9b11a9e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:45.618012 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1042/2122] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:45 2022] PUT /identity/v3/projects/bbb383441ef54487b58fcb51e8140de4/users/979c950aa999436c8e6c3af3090021f0/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:45.622012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2a669-f7f0-47e7-9965-f0f4d8a8fc99 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:45.638770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2a669-f7f0-47e7-9965-f0f4d8a8fc99 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:45.759067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb3dad-f183-466d-8bd4-0d2de9cff597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:45.760320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb3dad-f183-466d-8bd4-0d2de9cff597 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:45.761401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb3dad-f183-466d-8bd4-0d2de9cff597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:45.761844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb3dad-f183-466d-8bd4-0d2de9cff597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:45.762752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb3dad-f183-466d-8bd4-0d2de9cff597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:45.765438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb3dad-f183-466d-8bd4-0d2de9cff597 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:45.779470 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1081/2123] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:45.785372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f968a-2a0d-4576-9d82-5778b9b11a9e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:45.803988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f968a-2a0d-4576-9d82-5778b9b11a9e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:45.810670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fabb69-7f03-468c-8267-2bc8f6ac22c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:45.813711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fabb69-7f03-468c-8267-2bc8f6ac22c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:45.814169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fabb69-7f03-468c-8267-2bc8f6ac22c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:45.814643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fabb69-7f03-468c-8267-2bc8f6ac22c1 admin admin] PATH_INFO: `/v3/projects/bbb383441ef54487b58fcb51e8140de4/users/979c950aa999436c8e6c3af3090021f0/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:45.820091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fabb69-7f03-468c-8267-2bc8f6ac22c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb383441ef54487b58fcb51e8140de4, user_id=979c950aa999436c8e6c3af3090021f0, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:45.822825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fabb69-7f03-468c-8267-2bc8f6ac22c1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:45.879055 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1043/2124] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:45 2022] PUT /identity/v3/projects/bbb383441ef54487b58fcb51e8140de4/users/979c950aa999436c8e6c3af3090021f0/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:45.887208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f331f7-9ad1-471d-9b4e-bfe0abae5d8c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:45.887853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f331f7-9ad1-471d-9b4e-bfe0abae5d8c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:45.888303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f331f7-9ad1-471d-9b4e-bfe0abae5d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:45.953034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-15f331f7-9ad1-471d-9b4e-bfe0abae5d8c None None] MFA Rules not processed for user `979c950aa999436c8e6c3af3090021f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:45.954398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-15f331f7-9ad1-471d-9b4e-bfe0abae5d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:46.155247 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1082/2125] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:46.214698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fabb69-7f03-468c-8267-2bc8f6ac22c1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:46.216640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a2fabb69-7f03-468c-8267-2bc8f6ac22c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:46.349887 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:46.449624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fabb69-7f03-468c-8267-2bc8f6ac22c1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:46.468519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6cc64-9b80-4166-8af1-6edcb1e6dd1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:46.469333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6cc64-9b80-4166-8af1-6edcb1e6dd1f service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:46.469634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6cc64-9b80-4166-8af1-6edcb1e6dd1f service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:46.469904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6cc64-9b80-4166-8af1-6edcb1e6dd1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:46.490423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6cc64-9b80-4166-8af1-6edcb1e6dd1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:46.492162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6cc64-9b80-4166-8af1-6edcb1e6dd1f service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:46.514070 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1044/2126] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:01:46.937133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f331f7-9ad1-471d-9b4e-bfe0abae5d8c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:47.035525 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:47.112416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f331f7-9ad1-471d-9b4e-bfe0abae5d8c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:47.124032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:47.124915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:47.125196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:47.125965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] PATH_INFO: `/v3/users/3711814aa0e34f5491631828ae21afdc` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:47.127287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3711814aa0e34f5491631828ae21afdc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:47.130454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:47.236368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3711814aa0e34f5491631828ae21afdc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:47.238873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3711814aa0e34f5491631828ae21afdc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:47.266364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3711814aa0e34f5491631828ae21afdc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:47.282378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3711814aa0e34f5491631828ae21afdc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:47.283838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3711814aa0e34f5491631828ae21afdc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:47.310186 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1083/2127] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:46 2022] DELETE /identity/v3/users/3711814aa0e34f5491631828ae21afdc => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:47.312383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd7d13-7246-4c25-a118-4edfa23b0650 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:47.313470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd7d13-7246-4c25-a118-4edfa23b0650 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:47.313763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd7d13-7246-4c25-a118-4edfa23b0650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:47.380645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9cbd7d13-7246-4c25-a118-4edfa23b0650 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:47.383009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9cbd7d13-7246-4c25-a118-4edfa23b0650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:47.568954 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1045/2128] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:01:47.612953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:47.615271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:47.763265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59270f22-4234-478b-a950-a6f9bbc0c445 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:47.771329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e2108-247e-4fa1-9ad3-0038e693d2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:47.772126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2108-247e-4fa1-9ad3-0038e693d2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:47.773579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2108-247e-4fa1-9ad3-0038e693d2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:47.773579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2108-247e-4fa1-9ad3-0038e693d2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:47.807303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e2108-247e-4fa1-9ad3-0038e693d2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:47.807303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e2108-247e-4fa1-9ad3-0038e693d2a2 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:47.837713 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1084/2129] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:48.798889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a048aba-68e9-4234-ae26-84cc58efc810 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:48.799390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a048aba-68e9-4234-ae26-84cc58efc810 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:48.799678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a048aba-68e9-4234-ae26-84cc58efc810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:48.845174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6a048aba-68e9-4234-ae26-84cc58efc810 None None] MFA Rules not processed for user `37a61a57ad4448eba9c1bd8762d3a149`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:48.847366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6a048aba-68e9-4234-ae26-84cc58efc810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:48.949413 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1046/2130] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:48 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:48.960899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e3323-4d78-4862-932f-37e396a9a99f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:48.961384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e3323-4d78-4862-932f-37e396a9a99f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:48.961498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e3323-4d78-4862-932f-37e396a9a99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:48.983571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-583e3323-4d78-4862-932f-37e396a9a99f None None] MFA Rules not processed for user `37a61a57ad4448eba9c1bd8762d3a149`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:48.984793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-583e3323-4d78-4862-932f-37e396a9a99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:48.993228 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1085/2131] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:48 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:49.414999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a048aba-68e9-4234-ae26-84cc58efc810 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:49.416944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6a048aba-68e9-4234-ae26-84cc58efc810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:49.516349 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:49.555816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a048aba-68e9-4234-ae26-84cc58efc810 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:49.571677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571b010-4150-44b9-a90a-64a1558bd3ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:49.571677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571b010-4150-44b9-a90a-64a1558bd3ad service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:49.571677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571b010-4150-44b9-a90a-64a1558bd3ad service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:49.571677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571b010-4150-44b9-a90a-64a1558bd3ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:49.577316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571b010-4150-44b9-a90a-64a1558bd3ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:49.579193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571b010-4150-44b9-a90a-64a1558bd3ad service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:49.605520 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1047/2132] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:49 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:50.014250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e3323-4d78-4862-932f-37e396a9a99f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:50.017743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-583e3323-4d78-4862-932f-37e396a9a99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:50.035440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e3323-4d78-4862-932f-37e396a9a99f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:50.041446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:50.042098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:50.043233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:50.043654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] PATH_INFO: `/v3/projects/5715fa91478744bf9563dc2ccf6f29d7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:50.045100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=5715fa91478744bf9563dc2ccf6f29d7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:50.047779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:50.126763 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:50.129143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5715fa91478744bf9563dc2ccf6f29d7', 'request_id': 'req-4eb51372-399d-440e-8273-400c7b0492ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:50.139834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5715fa91478744bf9563dc2ccf6f29d7', 'request_id': 'req-4eb51372-399d-440e-8273-400c7b0492ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:50.150786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5715fa91478744bf9563dc2ccf6f29d7', 'request_id': 'req-4eb51372-399d-440e-8273-400c7b0492ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:50.219534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] The token cache is being invalidate because project 5715fa91478744bf9563dc2ccf6f29d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:50.219836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:50.227970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:50.232313 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1086/2133] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:50 2022] DELETE /identity/v3/projects/5715fa91478744bf9563dc2ccf6f29d7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:50.235656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571b010-4150-44b9-a90a-64a1558bd3ad service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:50.264817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571b010-4150-44b9-a90a-64a1558bd3ad service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:50.400922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c448efd-da9c-4ad1-82a5-34749f155722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:50.401863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c448efd-da9c-4ad1-82a5-34749f155722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:50.402304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c448efd-da9c-4ad1-82a5-34749f155722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:50.402734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c448efd-da9c-4ad1-82a5-34749f155722 admin admin] PATH_INFO: `/v3/users/979c950aa999436c8e6c3af3090021f0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:50.404914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c448efd-da9c-4ad1-82a5-34749f155722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=979c950aa999436c8e6c3af3090021f0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:50.407980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c448efd-da9c-4ad1-82a5-34749f155722 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:50.492453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c448efd-da9c-4ad1-82a5-34749f155722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979c950aa999436c8e6c3af3090021f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:50.493354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c448efd-da9c-4ad1-82a5-34749f155722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979c950aa999436c8e6c3af3090021f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:50.511620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c448efd-da9c-4ad1-82a5-34749f155722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979c950aa999436c8e6c3af3090021f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:50.527779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c448efd-da9c-4ad1-82a5-34749f155722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979c950aa999436c8e6c3af3090021f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:50.528538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c448efd-da9c-4ad1-82a5-34749f155722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979c950aa999436c8e6c3af3090021f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:50.594237 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1048/2134] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:50 2022] DELETE /identity/v3/users/979c950aa999436c8e6c3af3090021f0 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:51.040265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:51.041864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:51.064330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb51372-399d-440e-8273-400c7b0492ae admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:51.151232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:51.152274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:51.152946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:51.153821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6 admin admin] PATH_INFO: `/v3/projects/bbb383441ef54487b58fcb51e8140de4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:51.156450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb383441ef54487b58fcb51e8140de4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:51.158361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:51.271442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb383441ef54487b58fcb51e8140de4', 'request_id': 'req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:51.282348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb383441ef54487b58fcb51e8140de4', 'request_id': 'req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:51.304955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb383441ef54487b58fcb51e8140de4', 'request_id': 'req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:51.323942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6 admin admin] The token cache is being invalidate because project bbb383441ef54487b58fcb51e8140de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:01:51.324243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:51.324915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e7b85bd3-ddc4-477e-8ee9-6bc1405e47b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:01:51.331363 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1087/2135] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:01:51 2022] DELETE /identity/v3/projects/bbb383441ef54487b58fcb51e8140de4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:51.332699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631be950-fcff-4785-823a-e73053268575 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:51.333154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631be950-fcff-4785-823a-e73053268575 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:51.333458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631be950-fcff-4785-823a-e73053268575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:51.358271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-631be950-fcff-4785-823a-e73053268575 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:51.360006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-631be950-fcff-4785-823a-e73053268575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:51.454880 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:51.475640 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1049/2136] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:51.483447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aad2d0-8fd7-4537-aeaa-933f1831c4f1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:51.483726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aad2d0-8fd7-4537-aeaa-933f1831c4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:51.484195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aad2d0-8fd7-4537-aeaa-933f1831c4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:51.552166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-87aad2d0-8fd7-4537-aeaa-933f1831c4f1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:51.554045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-87aad2d0-8fd7-4537-aeaa-933f1831c4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:51.572031 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1088/2137] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:51.576318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631be950-fcff-4785-823a-e73053268575 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:51.590328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631be950-fcff-4785-823a-e73053268575 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:51.595648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4406b-1451-4a6b-bb41-cc1355d2b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:51.597180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4406b-1451-4a6b-bb41-cc1355d2b9ea admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:51.597572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4406b-1451-4a6b-bb41-cc1355d2b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:51.597940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4406b-1451-4a6b-bb41-cc1355d2b9ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:51.599223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4406b-1451-4a6b-bb41-cc1355d2b9ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:01:51.599812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4406b-1451-4a6b-bb41-cc1355d2b9ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:51.601602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4406b-1451-4a6b-bb41-cc1355d2b9ea admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:51.623757 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1050/2138] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:01:51.628134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aad2d0-8fd7-4537-aeaa-933f1831c4f1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:51.641117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aad2d0-8fd7-4537-aeaa-933f1831c4f1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:51.655574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c2736-a59e-426d-b7b8-7055f6bbf594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:51.656513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c2736-a59e-426d-b7b8-7055f6bbf594 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:51.656932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c2736-a59e-426d-b7b8-7055f6bbf594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:51.657416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c2736-a59e-426d-b7b8-7055f6bbf594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:51.658241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c2736-a59e-426d-b7b8-7055f6bbf594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:51.660647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c2736-a59e-426d-b7b8-7055f6bbf594 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:51.732608 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1089/2139] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:01:51 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:51.733723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4406b-1451-4a6b-bb41-cc1355d2b9ea admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:51.747980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4406b-1451-4a6b-bb41-cc1355d2b9ea admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:51.840166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a39d4f-b9ff-4a1b-a04f-7e93570d3586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:51.843324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a39d4f-b9ff-4a1b-a04f-7e93570d3586 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:51.843440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a39d4f-b9ff-4a1b-a04f-7e93570d3586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:51.844426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a39d4f-b9ff-4a1b-a04f-7e93570d3586 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:51.845270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a39d4f-b9ff-4a1b-a04f-7e93570d3586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:51.848293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a39d4f-b9ff-4a1b-a04f-7e93570d3586 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:51.881744 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1051/2140] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:01:51 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:01:51.883165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c2736-a59e-426d-b7b8-7055f6bbf594 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:51.904254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c2736-a59e-426d-b7b8-7055f6bbf594 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:51.914899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06036b1-bf60-487c-a6eb-6eb15be4e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:51.915649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06036b1-bf60-487c-a6eb-6eb15be4e936 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:51.915819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06036b1-bf60-487c-a6eb-6eb15be4e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:51.916085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06036b1-bf60-487c-a6eb-6eb15be4e936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:51.916781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06036b1-bf60-487c-a6eb-6eb15be4e936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:51.918656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06036b1-bf60-487c-a6eb-6eb15be4e936 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:51.933811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a39d4f-b9ff-4a1b-a04f-7e93570d3586 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:51.942282 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1090/2141] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:51.946639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a39d4f-b9ff-4a1b-a04f-7e93570d3586 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:51.952733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ac902-01f7-454f-aac4-1bc201757b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:51.953421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ac902-01f7-454f-aac4-1bc201757b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:51.953768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ac902-01f7-454f-aac4-1bc201757b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:51.954103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ac902-01f7-454f-aac4-1bc201757b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:51.954809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ac902-01f7-454f-aac4-1bc201757b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:51.957062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ac902-01f7-454f-aac4-1bc201757b20 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:51.974318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06036b1-bf60-487c-a6eb-6eb15be4e936 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:51.981510 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1052/2142] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:01:51.988081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06036b1-bf60-487c-a6eb-6eb15be4e936 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:51.994116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae598ee-cafd-4053-9d61-d6b785c98ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:51.994815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae598ee-cafd-4053-9d61-d6b785c98ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:51.995176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae598ee-cafd-4053-9d61-d6b785c98ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:51.995714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae598ee-cafd-4053-9d61-d6b785c98ce5 admin admin] PATH_INFO: `/v3/projects/5eec6e034df149f8863b1b9ebacfaa81/users/aceec71835c14681a2ff7d7285d87776/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:52.033079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae598ee-cafd-4053-9d61-d6b785c98ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eec6e034df149f8863b1b9ebacfaa81, user_id=aceec71835c14681a2ff7d7285d87776, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:52.041113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae598ee-cafd-4053-9d61-d6b785c98ce5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:52.071003 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1091/2143] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:01:51 2022] PUT /identity/v3/projects/5eec6e034df149f8863b1b9ebacfaa81/users/aceec71835c14681a2ff7d7285d87776/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:01:52.072979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad6d42-fe39-49f8-b1c1-44c2fff0beff None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:52.073386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad6d42-fe39-49f8-b1c1-44c2fff0beff None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:52.073822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad6d42-fe39-49f8-b1c1-44c2fff0beff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:52.125444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-33ad6d42-fe39-49f8-b1c1-44c2fff0beff None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:52.127997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-33ad6d42-fe39-49f8-b1c1-44c2fff0beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:52.320571 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1053/2144] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:52.334795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae598ee-cafd-4053-9d61-d6b785c98ce5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:52.340571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cae598ee-cafd-4053-9d61-d6b785c98ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:52.358585 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:52.519742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae598ee-cafd-4053-9d61-d6b785c98ce5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:52.535946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b3762-96c1-41a8-8e02-cf26c1b223d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:52.536288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3762-96c1-41a8-8e02-cf26c1b223d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:52.541264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3762-96c1-41a8-8e02-cf26c1b223d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:52.541607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3762-96c1-41a8-8e02-cf26c1b223d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:52.597544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b3762-96c1-41a8-8e02-cf26c1b223d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:52.608686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b3762-96c1-41a8-8e02-cf26c1b223d3 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:52.652727 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1092/2145] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:56.473365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08982266-fbbe-4dab-8af5-85e52894a6fa None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:56.473907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08982266-fbbe-4dab-8af5-85e52894a6fa None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:56.473907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08982266-fbbe-4dab-8af5-85e52894a6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:56.511133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-08982266-fbbe-4dab-8af5-85e52894a6fa None None] MFA Rules not processed for user `ea698e4b461143cfafb17befe69af2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:56.512431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-08982266-fbbe-4dab-8af5-85e52894a6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:56.670964 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1054/2146] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:59.690162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca3021-5a04-422e-ae37-45a595c525ae None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:59.690750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca3021-5a04-422e-ae37-45a595c525ae None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:59.690851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca3021-5a04-422e-ae37-45a595c525ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:59.735951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-82ca3021-5a04-422e-ae37-45a595c525ae None None] MFA Rules not processed for user `d82b62a7b6a44a7d9637493976268a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:59.737109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-82ca3021-5a04-422e-ae37-45a595c525ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:59.837782 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1093/2147] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:01:59 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:03.775738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08982266-fbbe-4dab-8af5-85e52894a6fa None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:03.778035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-08982266-fbbe-4dab-8af5-85e52894a6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:03.810702 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:04.024285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08982266-fbbe-4dab-8af5-85e52894a6fa None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:04.039585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf53fb-efc4-4e97-9931-e8a798a8314b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:04.044462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf53fb-efc4-4e97-9931-e8a798a8314b service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:04.044842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf53fb-efc4-4e97-9931-e8a798a8314b service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:04.045157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf53fb-efc4-4e97-9931-e8a798a8314b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:04.047137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7fdf53fb-efc4-4e97-9931-e8a798a8314b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:04.223396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf53fb-efc4-4e97-9931-e8a798a8314b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:04.224803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf53fb-efc4-4e97-9931-e8a798a8314b service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:04.253842 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1055/2148] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:06.958901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cd4e8-f36f-4b57-bab4-312f24605974 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:06.960052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cd4e8-f36f-4b57-bab4-312f24605974 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:06.960474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cd4e8-f36f-4b57-bab4-312f24605974 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:06.961978 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1094/2149] 10.222.0.39 () {54 vars in 921 bytes} [Sun Oct 16 01:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:02:06.991248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3ffbc-6f0e-4b9d-b708-8b4c4c8d01df None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:06.992246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3ffbc-6f0e-4b9d-b708-8b4c4c8d01df None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:06.992799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3ffbc-6f0e-4b9d-b708-8b4c4c8d01df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:07.038195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-54f3ffbc-6f0e-4b9d-b708-8b4c4c8d01df None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:07.039966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-54f3ffbc-6f0e-4b9d-b708-8b4c4c8d01df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:07.196787 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1056/2150] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:02:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:07.269766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cd4e8-f36f-4b57-bab4-312f24605974 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:07.271137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dc3cd4e8-f36f-4b57-bab4-312f24605974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:07.329900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cd4e8-f36f-4b57-bab4-312f24605974 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:07.355835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:07.356495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:07.356769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:07.357033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] PATH_INFO: `/v3/users/7cf9dde9e1de4c7c8592ced74f618bed` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:07.363397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf9dde9e1de4c7c8592ced74f618bed)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:07.365368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:07.516280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf9dde9e1de4c7c8592ced74f618bed'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:07.519864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf9dde9e1de4c7c8592ced74f618bed'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:07.556268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf9dde9e1de4c7c8592ced74f618bed'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:07.574190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf9dde9e1de4c7c8592ced74f618bed'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:07.574874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf9dde9e1de4c7c8592ced74f618bed'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:07.605685 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1095/2151] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:07 2022] DELETE /identity/v3/users/7cf9dde9e1de4c7c8592ced74f618bed => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:07.607392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d970a94-21e8-4a0e-8717-7050f0db9980 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:07.607700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d970a94-21e8-4a0e-8717-7050f0db9980 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:07.607968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d970a94-21e8-4a0e-8717-7050f0db9980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:07.672835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6d970a94-21e8-4a0e-8717-7050f0db9980 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:07.673843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6d970a94-21e8-4a0e-8717-7050f0db9980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:07.758472 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:07.833230 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1057/2152] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:07.914976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:07.916529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:07.934672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d970a94-21e8-4a0e-8717-7050f0db9980 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:07.936359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6d970a94-21e8-4a0e-8717-7050f0db9980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:07.947074 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:08.125355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f11ed-009b-4da5-a9e8-5459a2438f0a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:08.136593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad638726-6783-4beb-9498-12b8ece98e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:08.138686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad638726-6783-4beb-9498-12b8ece98e3f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:08.141158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad638726-6783-4beb-9498-12b8ece98e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:08.147362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad638726-6783-4beb-9498-12b8ece98e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:08.169714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad638726-6783-4beb-9498-12b8ece98e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:08.172063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d970a94-21e8-4a0e-8717-7050f0db9980 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:08.175612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad638726-6783-4beb-9498-12b8ece98e3f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:08.189281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef400784-baa0-483c-9150-0040e084dd9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:08.191207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef400784-baa0-483c-9150-0040e084dd9a service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:08.191207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef400784-baa0-483c-9150-0040e084dd9a service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:08.191616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef400784-baa0-483c-9150-0040e084dd9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:08.193817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef400784-baa0-483c-9150-0040e084dd9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:08.208934 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1096/2153] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:08.235964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef400784-baa0-483c-9150-0040e084dd9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:08.239751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef400784-baa0-483c-9150-0040e084dd9a service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:08.262124 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1058/2154] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:09.320040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad638726-6783-4beb-9498-12b8ece98e3f service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:09.322540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ad638726-6783-4beb-9498-12b8ece98e3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:09.340473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad638726-6783-4beb-9498-12b8ece98e3f service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:09.359936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:09.360584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:09.360864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:09.361135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] PATH_INFO: `/v3/projects/61deedbd92ca45e28838b513114952c8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:09.363055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=61deedbd92ca45e28838b513114952c8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:09.364968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:09.475849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61deedbd92ca45e28838b513114952c8', 'request_id': 'req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:09.492231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61deedbd92ca45e28838b513114952c8', 'request_id': 'req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:09.503020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61deedbd92ca45e28838b513114952c8', 'request_id': 'req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:09.520247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] The token cache is being invalidate because project 61deedbd92ca45e28838b513114952c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:09.521152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:09.522440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:09.528335 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1097/2155] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:09 2022] DELETE /identity/v3/projects/61deedbd92ca45e28838b513114952c8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:09.529456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef400784-baa0-483c-9150-0040e084dd9a service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:09.544936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef400784-baa0-483c-9150-0040e084dd9a service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:09.619164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a2dbd-4c54-41c4-8fea-ec4a8620b56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:09.620706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a2dbd-4c54-41c4-8fea-ec4a8620b56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:09.620998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a2dbd-4c54-41c4-8fea-ec4a8620b56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:09.621300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a2dbd-4c54-41c4-8fea-ec4a8620b56a admin admin] PATH_INFO: `/v3/users/56c8dd2fb5e746918010a39000e8dcf8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:09.623122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a2dbd-4c54-41c4-8fea-ec4a8620b56a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c8dd2fb5e746918010a39000e8dcf8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:09.625537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a2dbd-4c54-41c4-8fea-ec4a8620b56a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:09.710042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-527a2dbd-4c54-41c4-8fea-ec4a8620b56a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c8dd2fb5e746918010a39000e8dcf8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:09.712318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-527a2dbd-4c54-41c4-8fea-ec4a8620b56a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c8dd2fb5e746918010a39000e8dcf8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:09.735299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-527a2dbd-4c54-41c4-8fea-ec4a8620b56a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c8dd2fb5e746918010a39000e8dcf8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:09.739239 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:09.753322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-527a2dbd-4c54-41c4-8fea-ec4a8620b56a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c8dd2fb5e746918010a39000e8dcf8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:09.754282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-527a2dbd-4c54-41c4-8fea-ec4a8620b56a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c8dd2fb5e746918010a39000e8dcf8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:09.775204 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1059/2156] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:09 2022] DELETE /identity/v3/users/56c8dd2fb5e746918010a39000e8dcf8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:11.293939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:11.295529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:11.319668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab4b58-f069-4051-aecc-4ee3c01d0b8b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:11.469174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc68d2-0010-4627-9e96-e40621365204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:11.474677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc68d2-0010-4627-9e96-e40621365204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:11.475476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc68d2-0010-4627-9e96-e40621365204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:11.475906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc68d2-0010-4627-9e96-e40621365204 admin admin] PATH_INFO: `/v3/projects/ad22e1e5078f4f9ba7b9dbb0453bc86b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:11.479014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc68d2-0010-4627-9e96-e40621365204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad22e1e5078f4f9ba7b9dbb0453bc86b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:11.483340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc68d2-0010-4627-9e96-e40621365204 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:11.541556 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:11.597791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-27dc68d2-0010-4627-9e96-e40621365204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad22e1e5078f4f9ba7b9dbb0453bc86b', 'request_id': 'req-27dc68d2-0010-4627-9e96-e40621365204'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:11.605505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-27dc68d2-0010-4627-9e96-e40621365204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad22e1e5078f4f9ba7b9dbb0453bc86b', 'request_id': 'req-27dc68d2-0010-4627-9e96-e40621365204'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:11.618595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-27dc68d2-0010-4627-9e96-e40621365204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad22e1e5078f4f9ba7b9dbb0453bc86b', 'request_id': 'req-27dc68d2-0010-4627-9e96-e40621365204'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:11.647859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-27dc68d2-0010-4627-9e96-e40621365204 admin admin] The token cache is being invalidate because project ad22e1e5078f4f9ba7b9dbb0453bc86b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:11.648145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-27dc68d2-0010-4627-9e96-e40621365204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:11.648806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-27dc68d2-0010-4627-9e96-e40621365204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:11.650600 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1098/2157] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:11 2022] DELETE /identity/v3/projects/ad22e1e5078f4f9ba7b9dbb0453bc86b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:11.655603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ef0ed-2bcc-496d-8f5e-7dafd3f9a943 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:11.656665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ef0ed-2bcc-496d-8f5e-7dafd3f9a943 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:11.657156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ef0ed-2bcc-496d-8f5e-7dafd3f9a943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:11.688709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a91ef0ed-2bcc-496d-8f5e-7dafd3f9a943 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:11.691743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a91ef0ed-2bcc-496d-8f5e-7dafd3f9a943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:11.775338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff8d0e-9b6c-4a2b-a913-4e9e4429e8bd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:11.775878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff8d0e-9b6c-4a2b-a913-4e9e4429e8bd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:11.776348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff8d0e-9b6c-4a2b-a913-4e9e4429e8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:11.776988 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1060/2158] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:11.810188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-50ff8d0e-9b6c-4a2b-a913-4e9e4429e8bd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:11.811590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-50ff8d0e-9b6c-4a2b-a913-4e9e4429e8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:11.835876 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1099/2159] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:11.836812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ef0ed-2bcc-496d-8f5e-7dafd3f9a943 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:11.877106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ef0ed-2bcc-496d-8f5e-7dafd3f9a943 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:11.887832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e85c5-d5a0-4bab-922e-fbc2513ca04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:11.889230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e85c5-d5a0-4bab-922e-fbc2513ca04d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:11.889511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e85c5-d5a0-4bab-922e-fbc2513ca04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:11.889785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e85c5-d5a0-4bab-922e-fbc2513ca04d admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:11.895747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e85c5-d5a0-4bab-922e-fbc2513ca04d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:02:11.896084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e85c5-d5a0-4bab-922e-fbc2513ca04d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:11.903920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e85c5-d5a0-4bab-922e-fbc2513ca04d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:11.937076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff8d0e-9b6c-4a2b-a913-4e9e4429e8bd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:11.938013 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1061/2160] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:02:11.961017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff8d0e-9b6c-4a2b-a913-4e9e4429e8bd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:11.977775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b58174-e316-41c5-aef8-823faf71dacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:11.978691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58174-e316-41c5-aef8-823faf71dacb admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:11.979220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58174-e316-41c5-aef8-823faf71dacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:11.979811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58174-e316-41c5-aef8-823faf71dacb admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:11.980752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b58174-e316-41c5-aef8-823faf71dacb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:11.983087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b58174-e316-41c5-aef8-823faf71dacb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:12.027418 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1100/2161] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:11 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:02:12.029634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e85c5-d5a0-4bab-922e-fbc2513ca04d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:12.059306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e85c5-d5a0-4bab-922e-fbc2513ca04d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:12.141113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec5c3d-58ef-42ad-96fe-f775ed3abcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:12.141929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5c3d-58ef-42ad-96fe-f775ed3abcf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:12.142353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5c3d-58ef-42ad-96fe-f775ed3abcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:12.143206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5c3d-58ef-42ad-96fe-f775ed3abcf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:12.144364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec5c3d-58ef-42ad-96fe-f775ed3abcf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:12.146782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec5c3d-58ef-42ad-96fe-f775ed3abcf5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:12.183831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b58174-e316-41c5-aef8-823faf71dacb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:12.184868 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1062/2162] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:12 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:12.195952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b58174-e316-41c5-aef8-823faf71dacb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:12.202164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f62595-d842-4c8a-af60-2699f6da52f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:12.202777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62595-d842-4c8a-af60-2699f6da52f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:12.203274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62595-d842-4c8a-af60-2699f6da52f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:12.203547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62595-d842-4c8a-af60-2699f6da52f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:12.204194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f62595-d842-4c8a-af60-2699f6da52f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:12.206510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f62595-d842-4c8a-af60-2699f6da52f9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:12.245725 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1101/2163] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:12.249726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec5c3d-58ef-42ad-96fe-f775ed3abcf5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:12.266773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec5c3d-58ef-42ad-96fe-f775ed3abcf5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:12.280570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872f0ee-1a0b-4281-878f-877bc4bd0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:12.280786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872f0ee-1a0b-4281-878f-877bc4bd0e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:12.281260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872f0ee-1a0b-4281-878f-877bc4bd0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:12.281768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872f0ee-1a0b-4281-878f-877bc4bd0e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:12.282688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872f0ee-1a0b-4281-878f-877bc4bd0e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:12.285912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872f0ee-1a0b-4281-878f-877bc4bd0e49 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:12.331282 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1063/2164] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:12.333047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f62595-d842-4c8a-af60-2699f6da52f9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:12.353511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f62595-d842-4c8a-af60-2699f6da52f9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:12.361149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9523445-515d-46c9-947c-4d04cd7cec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:12.362812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523445-515d-46c9-947c-4d04cd7cec15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:12.363147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523445-515d-46c9-947c-4d04cd7cec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:12.363426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523445-515d-46c9-947c-4d04cd7cec15 admin admin] PATH_INFO: `/v3/projects/0abbbe62bd7f4ecaaa9c6c9f80da251b/users/4302f49e3704464aa2fd7c66cf6244bc/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:12.386763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9523445-515d-46c9-947c-4d04cd7cec15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abbbe62bd7f4ecaaa9c6c9f80da251b, user_id=4302f49e3704464aa2fd7c66cf6244bc, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:12.390256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9523445-515d-46c9-947c-4d04cd7cec15 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:12.430565 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1102/2165] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:12 2022] PUT /identity/v3/projects/0abbbe62bd7f4ecaaa9c6c9f80da251b/users/4302f49e3704464aa2fd7c66cf6244bc/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:12.434018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefff87f-9bcc-40a8-8923-5c17d6208b6f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:12.434314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefff87f-9bcc-40a8-8923-5c17d6208b6f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:12.435836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefff87f-9bcc-40a8-8923-5c17d6208b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:12.501919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-eefff87f-9bcc-40a8-8923-5c17d6208b6f None None] MFA Rules not processed for user `4302f49e3704464aa2fd7c66cf6244bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:12.504996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eefff87f-9bcc-40a8-8923-5c17d6208b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:12.594601 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:12.677651 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1064/2166] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:12.681329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9523445-515d-46c9-947c-4d04cd7cec15 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:12.775949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9523445-515d-46c9-947c-4d04cd7cec15 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:12.781360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31420464-0819-4fb2-aab2-d4f7f9bb6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:12.782423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31420464-0819-4fb2-aab2-d4f7f9bb6bad admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:12.783960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31420464-0819-4fb2-aab2-d4f7f9bb6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:12.784494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31420464-0819-4fb2-aab2-d4f7f9bb6bad admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:12.785676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31420464-0819-4fb2-aab2-d4f7f9bb6bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:12.788091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31420464-0819-4fb2-aab2-d4f7f9bb6bad admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:12.859957 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1103/2167] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:12 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:02:12.865352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefff87f-9bcc-40a8-8923-5c17d6208b6f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:12.878613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefff87f-9bcc-40a8-8923-5c17d6208b6f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:12.962722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b54f94-ef1c-4aec-86b3-65ec1642bf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:12.963988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b54f94-ef1c-4aec-86b3-65ec1642bf07 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:12.964284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b54f94-ef1c-4aec-86b3-65ec1642bf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:12.964555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b54f94-ef1c-4aec-86b3-65ec1642bf07 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:12.965261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b54f94-ef1c-4aec-86b3-65ec1642bf07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:12.967354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b54f94-ef1c-4aec-86b3-65ec1642bf07 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:13.011542 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1065/2168] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:12 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:02:13.013332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31420464-0819-4fb2-aab2-d4f7f9bb6bad admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:13.033734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31420464-0819-4fb2-aab2-d4f7f9bb6bad admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:13.044441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66938e45-b28f-4db4-8b53-e39c2d70be76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:13.045075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66938e45-b28f-4db4-8b53-e39c2d70be76 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:13.045347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66938e45-b28f-4db4-8b53-e39c2d70be76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:13.045617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66938e45-b28f-4db4-8b53-e39c2d70be76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:13.046488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66938e45-b28f-4db4-8b53-e39c2d70be76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:13.048591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66938e45-b28f-4db4-8b53-e39c2d70be76 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:13.069248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90b048-257c-468b-8268-cdaef0727774 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:13.069620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90b048-257c-468b-8268-cdaef0727774 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:13.069791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90b048-257c-468b-8268-cdaef0727774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:13.098660 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1104/2169] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:13.099935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66938e45-b28f-4db4-8b53-e39c2d70be76 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:13.121410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66938e45-b28f-4db4-8b53-e39c2d70be76 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:13.144822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8e90b048-257c-468b-8268-cdaef0727774 None None] MFA Rules not processed for user `aceec71835c14681a2ff7d7285d87776`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:13.146055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8e90b048-257c-468b-8268-cdaef0727774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:13.155695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d8eb9-ecbc-41f0-bf31-e5e8a7ba552c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:13.169086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d8eb9-ecbc-41f0-bf31-e5e8a7ba552c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:13.169712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d8eb9-ecbc-41f0-bf31-e5e8a7ba552c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:13.169998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d8eb9-ecbc-41f0-bf31-e5e8a7ba552c admin admin] PATH_INFO: `/v3/projects/0c5e6345574949348db5b782b46addf8/users/2fb809dd7c1c4bf4865a0f28610df0a1/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:13.207713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d8eb9-ecbc-41f0-bf31-e5e8a7ba552c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5e6345574949348db5b782b46addf8, user_id=2fb809dd7c1c4bf4865a0f28610df0a1, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:13.210733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d8eb9-ecbc-41f0-bf31-e5e8a7ba552c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:13.242612 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1105/2170] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:13 2022] PUT /identity/v3/projects/0c5e6345574949348db5b782b46addf8/users/2fb809dd7c1c4bf4865a0f28610df0a1/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:13.246390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d8eb9-ecbc-41f0-bf31-e5e8a7ba552c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:13.264090 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:13.351206 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1066/2171] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:13.354400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90b048-257c-468b-8268-cdaef0727774 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:13.360376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8e90b048-257c-468b-8268-cdaef0727774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:13.384818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d8eb9-ecbc-41f0-bf31-e5e8a7ba552c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:13.392438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a2803-f4fd-42bd-a99f-f8fec1a8aa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:13.394087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a2803-f4fd-42bd-a99f-f8fec1a8aa04 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:13.394437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a2803-f4fd-42bd-a99f-f8fec1a8aa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:13.394709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a2803-f4fd-42bd-a99f-f8fec1a8aa04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:13.399706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a2803-f4fd-42bd-a99f-f8fec1a8aa04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:13.402427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a2803-f4fd-42bd-a99f-f8fec1a8aa04 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:13.408176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90b048-257c-468b-8268-cdaef0727774 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:13.422717 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1106/2172] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:02:13.423882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a2803-f4fd-42bd-a99f-f8fec1a8aa04 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:13.431461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4a33f-c6bb-4464-9f8d-3b5d16644c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:13.432729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4a33f-c6bb-4464-9f8d-3b5d16644c25 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:13.433014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4a33f-c6bb-4464-9f8d-3b5d16644c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:13.433289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4a33f-c6bb-4464-9f8d-3b5d16644c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:13.434339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4a33f-c6bb-4464-9f8d-3b5d16644c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:13.436328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4a33f-c6bb-4464-9f8d-3b5d16644c25 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:13.436793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a2803-f4fd-42bd-a99f-f8fec1a8aa04 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:13.443433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8480fc8-8913-49af-9228-4aa2af925203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:13.444855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480fc8-8913-49af-9228-4aa2af925203 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:13.445210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480fc8-8913-49af-9228-4aa2af925203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:13.445691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480fc8-8913-49af-9228-4aa2af925203 admin admin] PATH_INFO: `/v3/projects/0c5e6345574949348db5b782b46addf8/users/2fb809dd7c1c4bf4865a0f28610df0a1/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:13.448568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8480fc8-8913-49af-9228-4aa2af925203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5e6345574949348db5b782b46addf8, user_id=2fb809dd7c1c4bf4865a0f28610df0a1, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:13.453663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8480fc8-8913-49af-9228-4aa2af925203 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:13.498113 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1107/2173] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:13 2022] PUT /identity/v3/projects/0c5e6345574949348db5b782b46addf8/users/2fb809dd7c1c4bf4865a0f28610df0a1/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:13.511985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d35fe1-1c0f-4d6f-b3d6-071189821aa6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:13.512601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d35fe1-1c0f-4d6f-b3d6-071189821aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:13.513211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d35fe1-1c0f-4d6f-b3d6-071189821aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:13.539834 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1067/2174] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:13 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:13.543789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4a33f-c6bb-4464-9f8d-3b5d16644c25 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:13.599773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a1d35fe1-1c0f-4d6f-b3d6-071189821aa6 None None] MFA Rules not processed for user `2fb809dd7c1c4bf4865a0f28610df0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:13.601814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a1d35fe1-1c0f-4d6f-b3d6-071189821aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:13.659339 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:13.712753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4a33f-c6bb-4464-9f8d-3b5d16644c25 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:13.730240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d7350-af27-41ce-bdc2-1a0f0113a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:13.731044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7350-af27-41ce-bdc2-1a0f0113a352 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:13.731324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7350-af27-41ce-bdc2-1a0f0113a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:13.731595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7350-af27-41ce-bdc2-1a0f0113a352 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:13.732239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d7350-af27-41ce-bdc2-1a0f0113a352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:13.734176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d7350-af27-41ce-bdc2-1a0f0113a352 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:13.800435 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1068/2175] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:13 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:02:13.803840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d7350-af27-41ce-bdc2-1a0f0113a352 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:13.808804 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1108/2176] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:13.822067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d7350-af27-41ce-bdc2-1a0f0113a352 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:13.827507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a1a86-0ca7-4d1d-a2a4-f4c4e987bb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:13.828134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a1a86-0ca7-4d1d-a2a4-f4c4e987bb6a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:13.828407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a1a86-0ca7-4d1d-a2a4-f4c4e987bb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:13.828813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a1a86-0ca7-4d1d-a2a4-f4c4e987bb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:13.829475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a1a86-0ca7-4d1d-a2a4-f4c4e987bb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:13.833071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a1a86-0ca7-4d1d-a2a4-f4c4e987bb6a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:13.859900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d35fe1-1c0f-4d6f-b3d6-071189821aa6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:13.863454 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1069/2177] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:13.878964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d35fe1-1c0f-4d6f-b3d6-071189821aa6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:13.888476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c0825-e4fd-43f3-8174-9368c1d6885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:13.890543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c0825-e4fd-43f3-8174-9368c1d6885d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:13.890863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c0825-e4fd-43f3-8174-9368c1d6885d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:13.891187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c0825-e4fd-43f3-8174-9368c1d6885d admin admin] PATH_INFO: `/v3/projects/9a8b7d6b98284f61849a7ef4350a2abe/users/3b1244bc039d4645b2c813b77b1593cd/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:13.937879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c0825-e4fd-43f3-8174-9368c1d6885d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8b7d6b98284f61849a7ef4350a2abe, user_id=3b1244bc039d4645b2c813b77b1593cd, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:13.941023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c0825-e4fd-43f3-8174-9368c1d6885d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:13.974982 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1109/2178] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:13 2022] PUT /identity/v3/projects/9a8b7d6b98284f61849a7ef4350a2abe/users/3b1244bc039d4645b2c813b77b1593cd/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:13.979859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a1a86-0ca7-4d1d-a2a4-f4c4e987bb6a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:14.019122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a1a86-0ca7-4d1d-a2a4-f4c4e987bb6a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:14.249032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019a06d-27ab-465a-a5d8-82cabd3bf03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:14.249664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a06d-27ab-465a-a5d8-82cabd3bf03e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:14.249938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a06d-27ab-465a-a5d8-82cabd3bf03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:14.250206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a06d-27ab-465a-a5d8-82cabd3bf03e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:14.250846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019a06d-27ab-465a-a5d8-82cabd3bf03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:14.252730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019a06d-27ab-465a-a5d8-82cabd3bf03e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:14.281262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c0825-e4fd-43f3-8174-9368c1d6885d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:14.282794 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1070/2179] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:14.305491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c0825-e4fd-43f3-8174-9368c1d6885d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:14.320019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572c41c-0599-4607-9e9c-2380d905dabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:14.320856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572c41c-0599-4607-9e9c-2380d905dabf admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:14.321160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572c41c-0599-4607-9e9c-2380d905dabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:14.321786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572c41c-0599-4607-9e9c-2380d905dabf admin admin] PATH_INFO: `/v3/projects/9a8b7d6b98284f61849a7ef4350a2abe/users/3b1244bc039d4645b2c813b77b1593cd/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:14.324885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572c41c-0599-4607-9e9c-2380d905dabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8b7d6b98284f61849a7ef4350a2abe, user_id=3b1244bc039d4645b2c813b77b1593cd, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:14.327580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572c41c-0599-4607-9e9c-2380d905dabf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:14.373620 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1110/2180] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:14 2022] PUT /identity/v3/projects/9a8b7d6b98284f61849a7ef4350a2abe/users/3b1244bc039d4645b2c813b77b1593cd/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:14.471800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019a06d-27ab-465a-a5d8-82cabd3bf03e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:14.473732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d019a06d-27ab-465a-a5d8-82cabd3bf03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:14.663988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019a06d-27ab-465a-a5d8-82cabd3bf03e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:14.815831 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:14.843639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05948b-b6e8-47c2-9b85-679a139df41f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:14.844586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05948b-b6e8-47c2-9b85-679a139df41f service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:14.844998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05948b-b6e8-47c2-9b85-679a139df41f service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:14.845404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05948b-b6e8-47c2-9b85-679a139df41f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:14.984792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05948b-b6e8-47c2-9b85-679a139df41f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:14.989326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05948b-b6e8-47c2-9b85-679a139df41f service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:15.021286 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1071/2181] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:19.250708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572c41c-0599-4607-9e9c-2380d905dabf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:19.253726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5572c41c-0599-4607-9e9c-2380d905dabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:19.327232 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:19.364828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572c41c-0599-4607-9e9c-2380d905dabf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:19.370953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:19.371875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:19.372545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:19.373024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] PATH_INFO: `/v3/users/324e48a04be4409a9549f8c7ab062dd7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:19.375241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=324e48a04be4409a9549f8c7ab062dd7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:19.379337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:19.479010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '324e48a04be4409a9549f8c7ab062dd7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:19.479902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '324e48a04be4409a9549f8c7ab062dd7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:19.499028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '324e48a04be4409a9549f8c7ab062dd7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:19.517503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '324e48a04be4409a9549f8c7ab062dd7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:19.519144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '324e48a04be4409a9549f8c7ab062dd7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:19.560713 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1111/2182] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:19 2022] DELETE /identity/v3/users/324e48a04be4409a9549f8c7ab062dd7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:20.115472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05948b-b6e8-47c2-9b85-679a139df41f service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:20.130525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05948b-b6e8-47c2-9b85-679a139df41f service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:20.285483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:20.286124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:20.286397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:20.286663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] PATH_INFO: `/v3/projects/e3eddc6c9b244816bf13f5cf684892ab` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:20.287919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3eddc6c9b244816bf13f5cf684892ab)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:20.292817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:20.369503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3eddc6c9b244816bf13f5cf684892ab', 'request_id': 'req-8e96f036-58ab-49d4-97a5-e83b485a843d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:20.381039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3eddc6c9b244816bf13f5cf684892ab', 'request_id': 'req-8e96f036-58ab-49d4-97a5-e83b485a843d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:20.399685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3eddc6c9b244816bf13f5cf684892ab', 'request_id': 'req-8e96f036-58ab-49d4-97a5-e83b485a843d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:20.419515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] The token cache is being invalidate because project e3eddc6c9b244816bf13f5cf684892ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:20.419728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:20.420627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:20.423570 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1072/2183] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:20 2022] DELETE /identity/v3/projects/e3eddc6c9b244816bf13f5cf684892ab => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:20.428033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:20.429611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:20.450978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c09c6-8c87-42d6-81e5-4638948deb91 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:20.594011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f3432-24ac-49b2-8ff6-8d88d5500ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:20.594863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f3432-24ac-49b2-8ff6-8d88d5500ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:20.595355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f3432-24ac-49b2-8ff6-8d88d5500ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:20.596347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f3432-24ac-49b2-8ff6-8d88d5500ce5 admin admin] PATH_INFO: `/v3/users/d82b62a7b6a44a7d9637493976268a5c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:20.598643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f3432-24ac-49b2-8ff6-8d88d5500ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82b62a7b6a44a7d9637493976268a5c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:20.602445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f3432-24ac-49b2-8ff6-8d88d5500ce5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:20.730545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9f1f3432-24ac-49b2-8ff6-8d88d5500ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82b62a7b6a44a7d9637493976268a5c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:20.731311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9f1f3432-24ac-49b2-8ff6-8d88d5500ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82b62a7b6a44a7d9637493976268a5c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:20.741942 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:20.750195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9f1f3432-24ac-49b2-8ff6-8d88d5500ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82b62a7b6a44a7d9637493976268a5c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:20.772727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9f1f3432-24ac-49b2-8ff6-8d88d5500ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82b62a7b6a44a7d9637493976268a5c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:20.773989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9f1f3432-24ac-49b2-8ff6-8d88d5500ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82b62a7b6a44a7d9637493976268a5c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:20.795984 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1112/2184] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:20 2022] DELETE /identity/v3/users/d82b62a7b6a44a7d9637493976268a5c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:21.238408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:21.241248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:21.264859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96f036-58ab-49d4-97a5-e83b485a843d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:21.276951 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:21.356305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f152cc7-9e02-4106-bf86-da749c683cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:21.356979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f152cc7-9e02-4106-bf86-da749c683cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:21.357252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f152cc7-9e02-4106-bf86-da749c683cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:21.357520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f152cc7-9e02-4106-bf86-da749c683cf1 admin admin] PATH_INFO: `/v3/projects/f3796bf94a0f4639a5c7da48f22df240` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:21.358722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f152cc7-9e02-4106-bf86-da749c683cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3796bf94a0f4639a5c7da48f22df240)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:21.361090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f152cc7-9e02-4106-bf86-da749c683cf1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:21.476712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1f152cc7-9e02-4106-bf86-da749c683cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3796bf94a0f4639a5c7da48f22df240', 'request_id': 'req-1f152cc7-9e02-4106-bf86-da749c683cf1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:21.486369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1f152cc7-9e02-4106-bf86-da749c683cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3796bf94a0f4639a5c7da48f22df240', 'request_id': 'req-1f152cc7-9e02-4106-bf86-da749c683cf1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:21.500955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1f152cc7-9e02-4106-bf86-da749c683cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3796bf94a0f4639a5c7da48f22df240', 'request_id': 'req-1f152cc7-9e02-4106-bf86-da749c683cf1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:21.526422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1f152cc7-9e02-4106-bf86-da749c683cf1 admin admin] The token cache is being invalidate because project f3796bf94a0f4639a5c7da48f22df240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:21.526422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1f152cc7-9e02-4106-bf86-da749c683cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:21.527995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1f152cc7-9e02-4106-bf86-da749c683cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:21.537061 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1073/2185] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:21 2022] DELETE /identity/v3/projects/f3796bf94a0f4639a5c7da48f22df240 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:21.539239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf5492-e939-4e37-a4a1-c565ba527fae None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:21.540060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf5492-e939-4e37-a4a1-c565ba527fae None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:21.541104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf5492-e939-4e37-a4a1-c565ba527fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:21.599326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7bcf5492-e939-4e37-a4a1-c565ba527fae None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:21.603040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7bcf5492-e939-4e37-a4a1-c565ba527fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:21.734330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff474b-4337-4530-97d1-df1b9a52dde0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:21.734615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff474b-4337-4530-97d1-df1b9a52dde0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:21.734852 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1113/2186] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:21.734982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff474b-4337-4530-97d1-df1b9a52dde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:21.767130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-31ff474b-4337-4530-97d1-df1b9a52dde0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:21.768646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-31ff474b-4337-4530-97d1-df1b9a52dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:21.795410 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1074/2187] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:21.807658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf5492-e939-4e37-a4a1-c565ba527fae None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:21.824234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf5492-e939-4e37-a4a1-c565ba527fae None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:21.832864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32528c0-8a8d-4074-9d14-e475f0ca8887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:21.833503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32528c0-8a8d-4074-9d14-e475f0ca8887 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:21.833687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32528c0-8a8d-4074-9d14-e475f0ca8887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:21.833967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32528c0-8a8d-4074-9d14-e475f0ca8887 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:21.834630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32528c0-8a8d-4074-9d14-e475f0ca8887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:02:21.834969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32528c0-8a8d-4074-9d14-e475f0ca8887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:21.837399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32528c0-8a8d-4074-9d14-e475f0ca8887 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:21.855376 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1114/2188] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:02:21.859980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff474b-4337-4530-97d1-df1b9a52dde0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:21.874275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff474b-4337-4530-97d1-df1b9a52dde0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:21.881856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8a633-0faf-4725-8e53-3e209ad40408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:21.882694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8a633-0faf-4725-8e53-3e209ad40408 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:21.883018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8a633-0faf-4725-8e53-3e209ad40408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:21.883345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8a633-0faf-4725-8e53-3e209ad40408 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:21.884902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8a633-0faf-4725-8e53-3e209ad40408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:21.886317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8a633-0faf-4725-8e53-3e209ad40408 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:21.919006 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1075/2189] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:21 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:21.922965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32528c0-8a8d-4074-9d14-e475f0ca8887 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:21.937118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32528c0-8a8d-4074-9d14-e475f0ca8887 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:22.006661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb6ed7-125a-4693-b9b8-ac76fc5d8473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:22.007429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb6ed7-125a-4693-b9b8-ac76fc5d8473 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:22.007708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb6ed7-125a-4693-b9b8-ac76fc5d8473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:22.007981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb6ed7-125a-4693-b9b8-ac76fc5d8473 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:22.008700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb6ed7-125a-4693-b9b8-ac76fc5d8473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:22.026863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb6ed7-125a-4693-b9b8-ac76fc5d8473 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:22.072323 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1115/2190] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:21 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:22.074751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8a633-0faf-4725-8e53-3e209ad40408 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:22.092617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8a633-0faf-4725-8e53-3e209ad40408 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:22.102153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12d9f9-e309-447c-8ff1-33bcbd2b8fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:22.103105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12d9f9-e309-447c-8ff1-33bcbd2b8fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:22.103708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12d9f9-e309-447c-8ff1-33bcbd2b8fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:22.104354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12d9f9-e309-447c-8ff1-33bcbd2b8fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:22.106033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12d9f9-e309-447c-8ff1-33bcbd2b8fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:22.107870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12d9f9-e309-447c-8ff1-33bcbd2b8fc5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:22.123314 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1076/2191] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:22.125649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb6ed7-125a-4693-b9b8-ac76fc5d8473 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:22.136165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb6ed7-125a-4693-b9b8-ac76fc5d8473 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:22.141840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce059f5-104d-47b1-b6f4-11805c24cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:22.142452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce059f5-104d-47b1-b6f4-11805c24cf99 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:22.143118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce059f5-104d-47b1-b6f4-11805c24cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:22.143247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce059f5-104d-47b1-b6f4-11805c24cf99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:22.143903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce059f5-104d-47b1-b6f4-11805c24cf99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:22.145758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce059f5-104d-47b1-b6f4-11805c24cf99 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:22.163867 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1116/2192] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:22.169935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12d9f9-e309-447c-8ff1-33bcbd2b8fc5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:22.181489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12d9f9-e309-447c-8ff1-33bcbd2b8fc5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:22.186687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e7f8e-8a9f-4b61-886c-fc9ff83e7f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:22.187450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e7f8e-8a9f-4b61-886c-fc9ff83e7f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:22.187728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e7f8e-8a9f-4b61-886c-fc9ff83e7f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:22.188000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e7f8e-8a9f-4b61-886c-fc9ff83e7f31 admin admin] PATH_INFO: `/v3/projects/65ddfc9041e44055be492260cb2f1ae9/users/4352b314efdf413d940755f4cb0dbbda/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:22.204580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e7f8e-8a9f-4b61-886c-fc9ff83e7f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ddfc9041e44055be492260cb2f1ae9, user_id=4352b314efdf413d940755f4cb0dbbda, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:22.207466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e7f8e-8a9f-4b61-886c-fc9ff83e7f31 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:22.233728 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1077/2193] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:22 2022] PUT /identity/v3/projects/65ddfc9041e44055be492260cb2f1ae9/users/4352b314efdf413d940755f4cb0dbbda/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:22.236960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7473a-9a39-4a9e-b662-96d8fef9b60d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:22.237306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7473a-9a39-4a9e-b662-96d8fef9b60d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:22.237514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7473a-9a39-4a9e-b662-96d8fef9b60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:22.273200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2ef7473a-9a39-4a9e-b662-96d8fef9b60d None None] MFA Rules not processed for user `4352b314efdf413d940755f4cb0dbbda`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:22.274653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2ef7473a-9a39-4a9e-b662-96d8fef9b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:22.312708 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:22.358728 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1117/2194] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:22.364020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e7f8e-8a9f-4b61-886c-fc9ff83e7f31 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:22.413248 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:22.437458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e7f8e-8a9f-4b61-886c-fc9ff83e7f31 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:22.442777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe51ac-4bac-48c8-b544-23c55b6fd61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:22.444734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe51ac-4bac-48c8-b544-23c55b6fd61c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:22.444734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe51ac-4bac-48c8-b544-23c55b6fd61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:22.444734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe51ac-4bac-48c8-b544-23c55b6fd61c admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:22.445018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe51ac-4bac-48c8-b544-23c55b6fd61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:22.447014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe51ac-4bac-48c8-b544-23c55b6fd61c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:22.491080 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1078/2195] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:22 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:22.494886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7473a-9a39-4a9e-b662-96d8fef9b60d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:22.509415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7473a-9a39-4a9e-b662-96d8fef9b60d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:22.665901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51543608-91ee-477f-ae76-4f43f0bfc2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:22.666539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543608-91ee-477f-ae76-4f43f0bfc2df admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:22.666739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543608-91ee-477f-ae76-4f43f0bfc2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:22.666960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543608-91ee-477f-ae76-4f43f0bfc2df admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:22.667694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51543608-91ee-477f-ae76-4f43f0bfc2df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:22.669902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51543608-91ee-477f-ae76-4f43f0bfc2df admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:22.727541 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1118/2196] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:22 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:02:22.731336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe51ac-4bac-48c8-b544-23c55b6fd61c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:22.743176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe51ac-4bac-48c8-b544-23c55b6fd61c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:22.751216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f29c9e-344a-45eb-a979-16b2a7757ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:22.752465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f29c9e-344a-45eb-a979-16b2a7757ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:22.752960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f29c9e-344a-45eb-a979-16b2a7757ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:22.753608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f29c9e-344a-45eb-a979-16b2a7757ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:22.754522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f29c9e-344a-45eb-a979-16b2a7757ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:22.756442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f29c9e-344a-45eb-a979-16b2a7757ac9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:22.770329 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1079/2197] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:22.774337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51543608-91ee-477f-ae76-4f43f0bfc2df admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:22.794824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51543608-91ee-477f-ae76-4f43f0bfc2df admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:22.802668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e2dc2-ea2c-4525-95d4-8f2e1880394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:22.803524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e2dc2-ea2c-4525-95d4-8f2e1880394d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:22.804274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e2dc2-ea2c-4525-95d4-8f2e1880394d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:22.804652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e2dc2-ea2c-4525-95d4-8f2e1880394d admin admin] PATH_INFO: `/v3/projects/ef8095cdcd604edfbdf0222181e7203e/users/87f382afa9194618a94663d350549f76/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:22.827430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e2dc2-ea2c-4525-95d4-8f2e1880394d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8095cdcd604edfbdf0222181e7203e, user_id=87f382afa9194618a94663d350549f76, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:22.831229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e2dc2-ea2c-4525-95d4-8f2e1880394d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:22.851912 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1119/2198] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:22 2022] PUT /identity/v3/projects/ef8095cdcd604edfbdf0222181e7203e/users/87f382afa9194618a94663d350549f76/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:22.855837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f29c9e-344a-45eb-a979-16b2a7757ac9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:22.866752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f29c9e-344a-45eb-a979-16b2a7757ac9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:22.957122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75201e-bf6d-4f71-8f57-fb7b79ade014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:22.957919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75201e-bf6d-4f71-8f57-fb7b79ade014 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:22.958207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75201e-bf6d-4f71-8f57-fb7b79ade014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:22.958484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75201e-bf6d-4f71-8f57-fb7b79ade014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:22.959170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75201e-bf6d-4f71-8f57-fb7b79ade014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:22.960821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75201e-bf6d-4f71-8f57-fb7b79ade014 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:22.972711 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1080/2199] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:22.977190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e2dc2-ea2c-4525-95d4-8f2e1880394d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:22.990007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e2dc2-ea2c-4525-95d4-8f2e1880394d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:22.995098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fadd63-37a0-4a92-a562-0ce3edc8c5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:22.995771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fadd63-37a0-4a92-a562-0ce3edc8c5bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:22.996051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fadd63-37a0-4a92-a562-0ce3edc8c5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:22.996328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fadd63-37a0-4a92-a562-0ce3edc8c5bd admin admin] PATH_INFO: `/v3/projects/ef8095cdcd604edfbdf0222181e7203e/users/87f382afa9194618a94663d350549f76/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:23.001095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fadd63-37a0-4a92-a562-0ce3edc8c5bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8095cdcd604edfbdf0222181e7203e, user_id=87f382afa9194618a94663d350549f76, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:23.004830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fadd63-37a0-4a92-a562-0ce3edc8c5bd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:23.019094 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1120/2200] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:22 2022] PUT /identity/v3/projects/ef8095cdcd604edfbdf0222181e7203e/users/87f382afa9194618a94663d350549f76/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:23.029119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ac10a-efea-428a-a1d4-914435cd3954 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:23.029464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ac10a-efea-428a-a1d4-914435cd3954 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:23.029646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ac10a-efea-428a-a1d4-914435cd3954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:23.084001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ae9ac10a-efea-428a-a1d4-914435cd3954 None None] MFA Rules not processed for user `87f382afa9194618a94663d350549f76`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:23.085306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ae9ac10a-efea-428a-a1d4-914435cd3954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:23.212627 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1081/2201] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:23.222090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6266b-221f-4b93-a7ba-f2c44695cb84 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:23.222432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6266b-221f-4b93-a7ba-f2c44695cb84 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:23.222645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6266b-221f-4b93-a7ba-f2c44695cb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:23.245621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fbc6266b-221f-4b93-a7ba-f2c44695cb84 None None] MFA Rules not processed for user `4352b314efdf413d940755f4cb0dbbda`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:23.246840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fbc6266b-221f-4b93-a7ba-f2c44695cb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:23.312365 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1121/2202] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:24.163139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ac10a-efea-428a-a1d4-914435cd3954 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:24.165225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ae9ac10a-efea-428a-a1d4-914435cd3954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:24.209661 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:24.255018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ac10a-efea-428a-a1d4-914435cd3954 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:24.262496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a2c13-4bc8-4f99-ac17-e697572f1c62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:24.263251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a2c13-4bc8-4f99-ac17-e697572f1c62 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:24.263591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a2c13-4bc8-4f99-ac17-e697572f1c62 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:24.263975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a2c13-4bc8-4f99-ac17-e697572f1c62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:24.275915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a2c13-4bc8-4f99-ac17-e697572f1c62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:24.277642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a2c13-4bc8-4f99-ac17-e697572f1c62 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:24.292217 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1082/2203] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:25.309323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9e558-1db1-4a41-8856-f5e8c16ca3d7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:25.309789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9e558-1db1-4a41-8856-f5e8c16ca3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:25.309915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9e558-1db1-4a41-8856-f5e8c16ca3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:25.361525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b1a9e558-1db1-4a41-8856-f5e8c16ca3d7 None None] MFA Rules not processed for user `5f46ddd0268d44bfacff0400e3f38e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:25.378403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b1a9e558-1db1-4a41-8856-f5e8c16ca3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:25.439956 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:25.535746 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1122/2204] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:26.300689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178d97-3b76-4604-bd66-69d91ac5ff1b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:26.303774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178d97-3b76-4604-bd66-69d91ac5ff1b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:26.304316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178d97-3b76-4604-bd66-69d91ac5ff1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:26.352951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5f178d97-3b76-4604-bd66-69d91ac5ff1b None None] MFA Rules not processed for user `3b1244bc039d4645b2c813b77b1593cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:26.354239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5f178d97-3b76-4604-bd66-69d91ac5ff1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:26.468131 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1083/2205] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:26.975122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9e558-1db1-4a41-8856-f5e8c16ca3d7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:26.977121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b1a9e558-1db1-4a41-8856-f5e8c16ca3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:26.994040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9e558-1db1-4a41-8856-f5e8c16ca3d7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:26.999823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f09a0-7f4e-4691-9f07-a5b4cbb4089e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:27.000700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f09a0-7f4e-4691-9f07-a5b4cbb4089e service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:27.001171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f09a0-7f4e-4691-9f07-a5b4cbb4089e service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:27.001433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f09a0-7f4e-4691-9f07-a5b4cbb4089e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:27.004126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a09f09a0-7f4e-4691-9f07-a5b4cbb4089e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:27.078722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f09a0-7f4e-4691-9f07-a5b4cbb4089e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:27.081094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f09a0-7f4e-4691-9f07-a5b4cbb4089e service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:27.092953 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1123/2206] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:28.505339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178d97-3b76-4604-bd66-69d91ac5ff1b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:28.552344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178d97-3b76-4604-bd66-69d91ac5ff1b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:28.567613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a660238-963d-48fa-99a5-1d80abe78f3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:28.568459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a660238-963d-48fa-99a5-1d80abe78f3d service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:28.568840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a660238-963d-48fa-99a5-1d80abe78f3d service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:28.569215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a660238-963d-48fa-99a5-1d80abe78f3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:28.573419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a660238-963d-48fa-99a5-1d80abe78f3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:28.753590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a660238-963d-48fa-99a5-1d80abe78f3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:28.768829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a660238-963d-48fa-99a5-1d80abe78f3d service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:28.788235 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1084/2207] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:32.564889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330372-37b9-4a9a-91fa-3ea927636a07 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:32.565533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330372-37b9-4a9a-91fa-3ea927636a07 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:32.565533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330372-37b9-4a9a-91fa-3ea927636a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:32.585120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-78330372-37b9-4a9a-91fa-3ea927636a07 None None] MFA Rules not processed for user `aceec71835c14681a2ff7d7285d87776`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:32.586453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-78330372-37b9-4a9a-91fa-3ea927636a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:32.594266 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1124/2208] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:38.782416 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=80 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:40.089401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a660238-963d-48fa-99a5-1d80abe78f3d service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:40.091575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a660238-963d-48fa-99a5-1d80abe78f3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:40.223110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a660238-963d-48fa-99a5-1d80abe78f3d service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:40.229399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:40.230047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:40.230330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:40.230660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] PATH_INFO: `/v3/users/4302f49e3704464aa2fd7c66cf6244bc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:40.231846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4302f49e3704464aa2fd7c66cf6244bc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:40.233903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:40.319774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4302f49e3704464aa2fd7c66cf6244bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:40.320829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4302f49e3704464aa2fd7c66cf6244bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:40.341266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4302f49e3704464aa2fd7c66cf6244bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:40.350600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4302f49e3704464aa2fd7c66cf6244bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:40.351012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4302f49e3704464aa2fd7c66cf6244bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:40.369611 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1085/2209] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:40 2022] DELETE /identity/v3/users/4302f49e3704464aa2fd7c66cf6244bc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:40.371510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d164c6b-ccf5-4527-9fa1-2a6a575b4c9d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:40.372042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d164c6b-ccf5-4527-9fa1-2a6a575b4c9d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:40.372042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d164c6b-ccf5-4527-9fa1-2a6a575b4c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:40.400979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6d164c6b-ccf5-4527-9fa1-2a6a575b4c9d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:40.402409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6d164c6b-ccf5-4527-9fa1-2a6a575b4c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:40.492993 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1125/2210] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:40.504086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:40.505572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:40.589171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2212d-74a6-4dff-85c3-cd3038fb774d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:40.595143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a70bab-ce2e-46ad-a6e7-ee303b0bf568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:40.595872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a70bab-ce2e-46ad-a6e7-ee303b0bf568 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:40.596733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a70bab-ce2e-46ad-a6e7-ee303b0bf568 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:40.597003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a70bab-ce2e-46ad-a6e7-ee303b0bf568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:40.607580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a70bab-ce2e-46ad-a6e7-ee303b0bf568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:40.610013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a70bab-ce2e-46ad-a6e7-ee303b0bf568 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:40.624182 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1086/2211] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:41.201450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d164c6b-ccf5-4527-9fa1-2a6a575b4c9d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:41.202961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6d164c6b-ccf5-4527-9fa1-2a6a575b4c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:41.244704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d164c6b-ccf5-4527-9fa1-2a6a575b4c9d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:41.249842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:41.250477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:41.250755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:41.251084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] PATH_INFO: `/v3/projects/0abbbe62bd7f4ecaaa9c6c9f80da251b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:41.252860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abbbe62bd7f4ecaaa9c6c9f80da251b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:41.254975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:41.276954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a70bab-ce2e-46ad-a6e7-ee303b0bf568 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:41.278473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f3a70bab-ce2e-46ad-a6e7-ee303b0bf568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:41.312804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abbbe62bd7f4ecaaa9c6c9f80da251b', 'request_id': 'req-a8a0eb00-973b-48af-8b45-8e03c1ee498e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.313151 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:41.320540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abbbe62bd7f4ecaaa9c6c9f80da251b', 'request_id': 'req-a8a0eb00-973b-48af-8b45-8e03c1ee498e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.324878 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:41.331269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abbbe62bd7f4ecaaa9c6c9f80da251b', 'request_id': 'req-a8a0eb00-973b-48af-8b45-8e03c1ee498e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.342847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] The token cache is being invalidate because project 0abbbe62bd7f4ecaaa9c6c9f80da251b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:41.343166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.343782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.345441 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1126/2212] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:41 2022] DELETE /identity/v3/projects/0abbbe62bd7f4ecaaa9c6c9f80da251b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:41.346659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:41.348069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:41.364626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a70bab-ce2e-46ad-a6e7-ee303b0bf568 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:41.417735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0eb00-973b-48af-8b45-8e03c1ee498e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:41.423078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:41.424251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:41.425059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:41.425516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] PATH_INFO: `/v3/users/fb4ac632e9e84d6eacd7bb276a93de52` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:41.426848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4ac632e9e84d6eacd7bb276a93de52)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:41.429109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:41.445267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3969938-5b32-4f7d-9f35-5e585d9bad4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:41.446028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3969938-5b32-4f7d-9f35-5e585d9bad4d service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:41.446317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3969938-5b32-4f7d-9f35-5e585d9bad4d service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:41.446589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3969938-5b32-4f7d-9f35-5e585d9bad4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:41.449397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a3969938-5b32-4f7d-9f35-5e585d9bad4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:41.499818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4ac632e9e84d6eacd7bb276a93de52'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.500503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4ac632e9e84d6eacd7bb276a93de52'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.522892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4ac632e9e84d6eacd7bb276a93de52'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.537654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3969938-5b32-4f7d-9f35-5e585d9bad4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:41.538448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4ac632e9e84d6eacd7bb276a93de52'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.539286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4ac632e9e84d6eacd7bb276a93de52'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.539856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3969938-5b32-4f7d-9f35-5e585d9bad4d service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:41.561021 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1127/2213] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:41 2022] DELETE /identity/v3/users/fb4ac632e9e84d6eacd7bb276a93de52 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:41.561970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:41.563907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:41.581186 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1087/2214] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:41.584077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36388cd-2aac-4f62-8f4c-64e4a15a8b47 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:41.584378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36388cd-2aac-4f62-8f4c-64e4a15a8b47 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:41.584648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36388cd-2aac-4f62-8f4c-64e4a15a8b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:41.628680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e36388cd-2aac-4f62-8f4c-64e4a15a8b47 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:41.629910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e36388cd-2aac-4f62-8f4c-64e4a15a8b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:41.673565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1856ab-a8ec-4507-8884-dd93d4d30644 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:41.684312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba21578-b549-4117-978e-c92a7c855701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:41.685045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21578-b549-4117-978e-c92a7c855701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:41.685423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21578-b549-4117-978e-c92a7c855701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:41.685793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21578-b549-4117-978e-c92a7c855701 admin admin] PATH_INFO: `/v3/users/2fb809dd7c1c4bf4865a0f28610df0a1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:41.692275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba21578-b549-4117-978e-c92a7c855701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb809dd7c1c4bf4865a0f28610df0a1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:41.695794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba21578-b549-4117-978e-c92a7c855701 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:41.702222 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:41.753331 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:41.776964 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1088/2215] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:41.784221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36388cd-2aac-4f62-8f4c-64e4a15a8b47 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:41.785655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e36388cd-2aac-4f62-8f4c-64e4a15a8b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:41.791221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2ba21578-b549-4117-978e-c92a7c855701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb809dd7c1c4bf4865a0f28610df0a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.792318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2ba21578-b549-4117-978e-c92a7c855701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb809dd7c1c4bf4865a0f28610df0a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.812573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2ba21578-b549-4117-978e-c92a7c855701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb809dd7c1c4bf4865a0f28610df0a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.826049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2ba21578-b549-4117-978e-c92a7c855701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb809dd7c1c4bf4865a0f28610df0a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.826834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2ba21578-b549-4117-978e-c92a7c855701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb809dd7c1c4bf4865a0f28610df0a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:41.841697 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1128/2216] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:41 2022] DELETE /identity/v3/users/2fb809dd7c1c4bf4865a0f28610df0a1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:41.852011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36388cd-2aac-4f62-8f4c-64e4a15a8b47 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:41.930157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f03b5-878b-4a53-8da5-73f20c9f0ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:41.930852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f03b5-878b-4a53-8da5-73f20c9f0ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:41.931173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f03b5-878b-4a53-8da5-73f20c9f0ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:41.931558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f03b5-878b-4a53-8da5-73f20c9f0ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:41.937371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fa6f03b5-878b-4a53-8da5-73f20c9f0ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:42.018455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c131e9-cafd-4c31-8436-7fb8ee817b1d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:42.018566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c131e9-cafd-4c31-8436-7fb8ee817b1d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:42.018882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c131e9-cafd-4c31-8436-7fb8ee817b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:42.043457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f03b5-878b-4a53-8da5-73f20c9f0ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:42.046957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f03b5-878b-4a53-8da5-73f20c9f0ff0 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:42.058280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-24c131e9-cafd-4c31-8436-7fb8ee817b1d None None] MFA Rules not processed for user `4352b314efdf413d940755f4cb0dbbda`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:42.058481 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1089/2217] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:02:42.059503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-24c131e9-cafd-4c31-8436-7fb8ee817b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:42.174963 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1129/2218] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:42.517058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f03b5-878b-4a53-8da5-73f20c9f0ff0 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:42.518775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fa6f03b5-878b-4a53-8da5-73f20c9f0ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:42.537749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f03b5-878b-4a53-8da5-73f20c9f0ff0 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:42.542759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:42.543430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:42.544127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:42.544408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] PATH_INFO: `/v3/projects/5a5af1e6e5fa46bc9bfa0aa213204ac4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:42.545563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5af1e6e5fa46bc9bfa0aa213204ac4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:42.548195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:42.604131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'request_id': 'req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.610646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'request_id': 'req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.612558 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:42.623179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'request_id': 'req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.636929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] The token cache is being invalidate because project 5a5af1e6e5fa46bc9bfa0aa213204ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:42.637299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.638039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.639638 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1090/2219] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:42 2022] DELETE /identity/v3/projects/5a5af1e6e5fa46bc9bfa0aa213204ac4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:42.644337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c131e9-cafd-4c31-8436-7fb8ee817b1d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:42.656949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c131e9-cafd-4c31-8436-7fb8ee817b1d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:42.706522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:42.708014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:42.723365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf0880-669e-47f3-bf47-363c9abea2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:42.724088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf0880-669e-47f3-bf47-363c9abea2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:42.724474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf0880-669e-47f3-bf47-363c9abea2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:42.724624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf0880-669e-47f3-bf47-363c9abea2f6 admin admin] PATH_INFO: `/v3/users/080ec1cbb5854dc7b3db62197886c3c8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:42.726950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf0880-669e-47f3-bf47-363c9abea2f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=080ec1cbb5854dc7b3db62197886c3c8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:42.728628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf0880-669e-47f3-bf47-363c9abea2f6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:42.774641 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:42.795776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cecf0880-669e-47f3-bf47-363c9abea2f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080ec1cbb5854dc7b3db62197886c3c8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.796949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cecf0880-669e-47f3-bf47-363c9abea2f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080ec1cbb5854dc7b3db62197886c3c8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.815039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cecf0880-669e-47f3-bf47-363c9abea2f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080ec1cbb5854dc7b3db62197886c3c8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.816741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9eaf9-ec70-4e46-ba93-93257b2673c0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:42.822132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255ef3b-b30e-4054-80a1-3ef0386ae40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:42.822891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255ef3b-b30e-4054-80a1-3ef0386ae40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:42.823248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255ef3b-b30e-4054-80a1-3ef0386ae40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:42.823594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255ef3b-b30e-4054-80a1-3ef0386ae40b admin admin] PATH_INFO: `/v3/projects/0c5e6345574949348db5b782b46addf8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:42.824892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255ef3b-b30e-4054-80a1-3ef0386ae40b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5e6345574949348db5b782b46addf8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:42.827103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255ef3b-b30e-4054-80a1-3ef0386ae40b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:42.831974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cecf0880-669e-47f3-bf47-363c9abea2f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080ec1cbb5854dc7b3db62197886c3c8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.832634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cecf0880-669e-47f3-bf47-363c9abea2f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080ec1cbb5854dc7b3db62197886c3c8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.852236 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1130/2220] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:42 2022] DELETE /identity/v3/users/080ec1cbb5854dc7b3db62197886c3c8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:42.880548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c255ef3b-b30e-4054-80a1-3ef0386ae40b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5e6345574949348db5b782b46addf8', 'request_id': 'req-c255ef3b-b30e-4054-80a1-3ef0386ae40b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.887105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c255ef3b-b30e-4054-80a1-3ef0386ae40b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5e6345574949348db5b782b46addf8', 'request_id': 'req-c255ef3b-b30e-4054-80a1-3ef0386ae40b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.896947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c255ef3b-b30e-4054-80a1-3ef0386ae40b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5e6345574949348db5b782b46addf8', 'request_id': 'req-c255ef3b-b30e-4054-80a1-3ef0386ae40b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.909947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c255ef3b-b30e-4054-80a1-3ef0386ae40b admin admin] The token cache is being invalidate because project 0c5e6345574949348db5b782b46addf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:42.910236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c255ef3b-b30e-4054-80a1-3ef0386ae40b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.910909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c255ef3b-b30e-4054-80a1-3ef0386ae40b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:42.916369 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1091/2221] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:42 2022] DELETE /identity/v3/projects/0c5e6345574949348db5b782b46addf8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:42.917589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eac606-c2cc-4056-8657-2bcf6f7ee488 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:42.917874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eac606-c2cc-4056-8657-2bcf6f7ee488 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:42.918142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eac606-c2cc-4056-8657-2bcf6f7ee488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:42.945789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-74eac606-c2cc-4056-8657-2bcf6f7ee488 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:42.946898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-74eac606-c2cc-4056-8657-2bcf6f7ee488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:43.037889 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1131/2222] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:43.046764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a34e9c-1140-4b19-8c54-d7e0b9e645b6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:43.049021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a34e9c-1140-4b19-8c54-d7e0b9e645b6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:43.049632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a34e9c-1140-4b19-8c54-d7e0b9e645b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:43.140119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-30a34e9c-1140-4b19-8c54-d7e0b9e645b6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:43.141352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-30a34e9c-1140-4b19-8c54-d7e0b9e645b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:43.156182 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1092/2223] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:43.156856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eac606-c2cc-4056-8657-2bcf6f7ee488 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:43.169355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eac606-c2cc-4056-8657-2bcf6f7ee488 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:43.174393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8664343-8ec8-4eba-b04d-3009308e3039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:43.175195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8664343-8ec8-4eba-b04d-3009308e3039 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:43.175494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8664343-8ec8-4eba-b04d-3009308e3039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:43.175758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8664343-8ec8-4eba-b04d-3009308e3039 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:43.176413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8664343-8ec8-4eba-b04d-3009308e3039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:02:43.176717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8664343-8ec8-4eba-b04d-3009308e3039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:43.178325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8664343-8ec8-4eba-b04d-3009308e3039 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:43.193051 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1132/2224] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:02:43.198455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a34e9c-1140-4b19-8c54-d7e0b9e645b6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:43.217074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a34e9c-1140-4b19-8c54-d7e0b9e645b6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:43.228296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf57822-c43c-4dad-a21d-f1ae86067127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:43.229109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf57822-c43c-4dad-a21d-f1ae86067127 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:43.229603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf57822-c43c-4dad-a21d-f1ae86067127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:43.229772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf57822-c43c-4dad-a21d-f1ae86067127 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:43.230578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf57822-c43c-4dad-a21d-f1ae86067127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:43.235120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf57822-c43c-4dad-a21d-f1ae86067127 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:43.297381 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1093/2225] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:43 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:43.303027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8664343-8ec8-4eba-b04d-3009308e3039 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:43.331297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8664343-8ec8-4eba-b04d-3009308e3039 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:43.413958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0167cd-9281-4d67-8227-031a4af63acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:43.414895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0167cd-9281-4d67-8227-031a4af63acb admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:43.415311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0167cd-9281-4d67-8227-031a4af63acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:43.415734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0167cd-9281-4d67-8227-031a4af63acb admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:43.416500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0167cd-9281-4d67-8227-031a4af63acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:43.419322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0167cd-9281-4d67-8227-031a4af63acb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:43.448277 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1133/2226] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:43 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:02:43.452494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf57822-c43c-4dad-a21d-f1ae86067127 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:43.483717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf57822-c43c-4dad-a21d-f1ae86067127 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:43.499377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb81b9-8e6e-4724-a419-8ac978682e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:43.500319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb81b9-8e6e-4724-a419-8ac978682e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:43.500719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb81b9-8e6e-4724-a419-8ac978682e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:43.501139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb81b9-8e6e-4724-a419-8ac978682e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:43.505633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb81b9-8e6e-4724-a419-8ac978682e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:43.510412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb81b9-8e6e-4724-a419-8ac978682e4f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:43.536966 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1094/2227] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:43.537750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0167cd-9281-4d67-8227-031a4af63acb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:43.569806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0167cd-9281-4d67-8227-031a4af63acb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:43.578267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf4ab3-45af-40b0-a17a-26d3f0fb2ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:43.581737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf4ab3-45af-40b0-a17a-26d3f0fb2ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:43.582127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf4ab3-45af-40b0-a17a-26d3f0fb2ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:43.582499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf4ab3-45af-40b0-a17a-26d3f0fb2ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:43.583316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf4ab3-45af-40b0-a17a-26d3f0fb2ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:43.585512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf4ab3-45af-40b0-a17a-26d3f0fb2ef8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:43.604828 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1134/2228] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:43.606408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb81b9-8e6e-4724-a419-8ac978682e4f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:43.619234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb81b9-8e6e-4724-a419-8ac978682e4f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:43.632672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dfa44-268a-4120-9e98-27311da9ee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:43.634641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dfa44-268a-4120-9e98-27311da9ee31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:43.636469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dfa44-268a-4120-9e98-27311da9ee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:43.637785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dfa44-268a-4120-9e98-27311da9ee31 admin admin] PATH_INFO: `/v3/projects/8cf85c4b9fb4446bba33d9cf8b366f9e/users/0286dccb8deb401798bd915988e75987/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:43.690459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506dfa44-268a-4120-9e98-27311da9ee31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf85c4b9fb4446bba33d9cf8b366f9e, user_id=0286dccb8deb401798bd915988e75987, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:43.695074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506dfa44-268a-4120-9e98-27311da9ee31 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:43.723985 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1095/2229] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:43 2022] PUT /identity/v3/projects/8cf85c4b9fb4446bba33d9cf8b366f9e/users/0286dccb8deb401798bd915988e75987/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:43.727198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4984ce-5a87-4c42-92cc-f2021b45efca None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:43.727710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4984ce-5a87-4c42-92cc-f2021b45efca None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:43.728257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4984ce-5a87-4c42-92cc-f2021b45efca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:43.770267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cb4984ce-5a87-4c42-92cc-f2021b45efca None None] MFA Rules not processed for user `0286dccb8deb401798bd915988e75987`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:43.771961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cb4984ce-5a87-4c42-92cc-f2021b45efca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:43.777966 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:43.785636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dfa44-268a-4120-9e98-27311da9ee31 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:43.788343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-506dfa44-268a-4120-9e98-27311da9ee31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:43.816607 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:43.885491 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1135/2230] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:43.890242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4984ce-5a87-4c42-92cc-f2021b45efca None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:43.907998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dfa44-268a-4120-9e98-27311da9ee31 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:43.921338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:43.922136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:43.922415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:43.922731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4 admin admin] PATH_INFO: `/v3/projects/b637cd2136a94c98a0e692308b9c4479` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:43.924841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b637cd2136a94c98a0e692308b9c4479)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:43.941919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:44.013820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4984ce-5a87-4c42-92cc-f2021b45efca None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:44.051597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b637cd2136a94c98a0e692308b9c4479', 'request_id': 'req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:44.059420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b637cd2136a94c98a0e692308b9c4479', 'request_id': 'req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:44.068995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b637cd2136a94c98a0e692308b9c4479', 'request_id': 'req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:44.082675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4 admin admin] The token cache is being invalidate because project b637cd2136a94c98a0e692308b9c4479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:44.083017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:44.084459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e69999ad-a1a6-4df0-a398-75e0b4ea22e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:44.086284 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1096/2231] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:43 2022] DELETE /identity/v3/projects/b637cd2136a94c98a0e692308b9c4479 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:44.091025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a6e42-e311-4bea-b633-0b9cc5535a67 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.091375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a6e42-e311-4bea-b633-0b9cc5535a67 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.091729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a6e42-e311-4bea-b633-0b9cc5535a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.103488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5a456-bd67-46a7-b0b9-36a6bd903a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:44.104192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5a456-bd67-46a7-b0b9-36a6bd903a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.104541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5a456-bd67-46a7-b0b9-36a6bd903a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.104906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5a456-bd67-46a7-b0b9-36a6bd903a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.106384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5a456-bd67-46a7-b0b9-36a6bd903a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:44.108422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5a456-bd67-46a7-b0b9-36a6bd903a31 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:44.114762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f77a6e42-e311-4bea-b633-0b9cc5535a67 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:44.116256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f77a6e42-e311-4bea-b633-0b9cc5535a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:44.127251 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1097/2232] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:44.145916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42e56b-c41a-48b6-a4df-384caedfbae9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.147835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42e56b-c41a-48b6-a4df-384caedfbae9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.148189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42e56b-c41a-48b6-a4df-384caedfbae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.159413 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1136/2233] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:43 2022] POST /identity/v3/projects => generated 375 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:02:44.163479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5a456-bd67-46a7-b0b9-36a6bd903a31 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:44.165263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-21c5a456-bd67-46a7-b0b9-36a6bd903a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:44.184493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2f42e56b-c41a-48b6-a4df-384caedfbae9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:44.186104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2f42e56b-c41a-48b6-a4df-384caedfbae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:44.219644 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:44.251017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5a456-bd67-46a7-b0b9-36a6bd903a31 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:44.267038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76296b7-d921-45f1-bf04-181f28af4687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:44.270315 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1098/2234] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:44.271592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76296b7-d921-45f1-bf04-181f28af4687 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.271987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76296b7-d921-45f1-bf04-181f28af4687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.272357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76296b7-d921-45f1-bf04-181f28af4687 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.274308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42e56b-c41a-48b6-a4df-384caedfbae9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:44.275188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76296b7-d921-45f1-bf04-181f28af4687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:44.277552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76296b7-d921-45f1-bf04-181f28af4687 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:44.288273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42e56b-c41a-48b6-a4df-384caedfbae9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:44.295416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee892f0-89dc-4ca4-825d-9f01432bd29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:44.296538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee892f0-89dc-4ca4-825d-9f01432bd29f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.296538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee892f0-89dc-4ca4-825d-9f01432bd29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.296745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee892f0-89dc-4ca4-825d-9f01432bd29f admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.297255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee892f0-89dc-4ca4-825d-9f01432bd29f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:02:44.297565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee892f0-89dc-4ca4-825d-9f01432bd29f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:44.299781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee892f0-89dc-4ca4-825d-9f01432bd29f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:44.318595 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1099/2235] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:02:44.322663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee892f0-89dc-4ca4-825d-9f01432bd29f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:44.335883 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1137/2236] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:44 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:44.336784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76296b7-d921-45f1-bf04-181f28af4687 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:44.348709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76296b7-d921-45f1-bf04-181f28af4687 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:44.348878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee892f0-89dc-4ca4-825d-9f01432bd29f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:44.354975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f8d76-f337-40f2-8dad-45d9ae83f265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:44.355689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f8d76-f337-40f2-8dad-45d9ae83f265 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.355991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be28ee-4850-440b-a917-3343cd0bdba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:44.356120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f8d76-f337-40f2-8dad-45d9ae83f265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.356459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f8d76-f337-40f2-8dad-45d9ae83f265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.356911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be28ee-4850-440b-a917-3343cd0bdba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.357192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be28ee-4850-440b-a917-3343cd0bdba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.357498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f8d76-f337-40f2-8dad-45d9ae83f265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:44.357609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be28ee-4850-440b-a917-3343cd0bdba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.358347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be28ee-4850-440b-a917-3343cd0bdba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:44.363527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be28ee-4850-440b-a917-3343cd0bdba3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:44.370651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f8d76-f337-40f2-8dad-45d9ae83f265 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:44.391134 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1138/2237] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:44.393766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f8d76-f337-40f2-8dad-45d9ae83f265 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:44.405325 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:44.407056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f8d76-f337-40f2-8dad-45d9ae83f265 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:44.416237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6612e3-c33b-410f-83fd-220e5ba6a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:44.417330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6612e3-c33b-410f-83fd-220e5ba6a032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.417643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6612e3-c33b-410f-83fd-220e5ba6a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.417917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6612e3-c33b-410f-83fd-220e5ba6a032 admin admin] PATH_INFO: `/v3/projects/da8cbfb2365e44699e6a9975927f9b78/users/024be1149aa04673ac8d5faa81260244/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.422240 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1100/2238] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:44 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:44.426465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be28ee-4850-440b-a917-3343cd0bdba3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:44.436376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6612e3-c33b-410f-83fd-220e5ba6a032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8cbfb2365e44699e6a9975927f9b78, user_id=024be1149aa04673ac8d5faa81260244, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:44.439085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6612e3-c33b-410f-83fd-220e5ba6a032 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:44.460332 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1139/2239] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:44 2022] PUT /identity/v3/projects/da8cbfb2365e44699e6a9975927f9b78/users/024be1149aa04673ac8d5faa81260244/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:44.464092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6612e3-c33b-410f-83fd-220e5ba6a032 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:44.497624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be28ee-4850-440b-a917-3343cd0bdba3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:44.535884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6612e3-c33b-410f-83fd-220e5ba6a032 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:44.540629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0915c4-5638-4fa6-9e9a-3c202d6b170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:44.541220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0915c4-5638-4fa6-9e9a-3c202d6b170b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.541494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0915c4-5638-4fa6-9e9a-3c202d6b170b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.541759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0915c4-5638-4fa6-9e9a-3c202d6b170b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.542391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0915c4-5638-4fa6-9e9a-3c202d6b170b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:44.544281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0915c4-5638-4fa6-9e9a-3c202d6b170b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:44.557946 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1140/2240] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:02:44.559274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0915c4-5638-4fa6-9e9a-3c202d6b170b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:44.568297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc8eb1-0ede-4c42-a352-89e8db079835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:44.568921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc8eb1-0ede-4c42-a352-89e8db079835 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.569198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc8eb1-0ede-4c42-a352-89e8db079835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.569499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc8eb1-0ede-4c42-a352-89e8db079835 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.570132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc8eb1-0ede-4c42-a352-89e8db079835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:44.572118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc8eb1-0ede-4c42-a352-89e8db079835 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:44.573481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0915c4-5638-4fa6-9e9a-3c202d6b170b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:44.578356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf0b9e-541b-414b-8739-7d1f6d08a5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:44.579133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0b9e-541b-414b-8739-7d1f6d08a5db admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.579404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0b9e-541b-414b-8739-7d1f6d08a5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.579788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0b9e-541b-414b-8739-7d1f6d08a5db admin admin] PATH_INFO: `/v3/projects/da8cbfb2365e44699e6a9975927f9b78/users/024be1149aa04673ac8d5faa81260244/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.581913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf0b9e-541b-414b-8739-7d1f6d08a5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8cbfb2365e44699e6a9975927f9b78, user_id=024be1149aa04673ac8d5faa81260244, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:44.584583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf0b9e-541b-414b-8739-7d1f6d08a5db admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:44.600469 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1101/2241] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:44 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:02:44.600691 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1141/2242] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:44 2022] PUT /identity/v3/projects/da8cbfb2365e44699e6a9975927f9b78/users/024be1149aa04673ac8d5faa81260244/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:44.601498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc8eb1-0ede-4c42-a352-89e8db079835 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:44.609351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebc0f8-f66b-4231-bdb7-3d316172157c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.609632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebc0f8-f66b-4231-bdb7-3d316172157c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.609897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebc0f8-f66b-4231-bdb7-3d316172157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.615870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc8eb1-0ede-4c42-a352-89e8db079835 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:44.640392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4bebc0f8-f66b-4231-bdb7-3d316172157c None None] MFA Rules not processed for user `024be1149aa04673ac8d5faa81260244`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:44.641585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4bebc0f8-f66b-4231-bdb7-3d316172157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:44.691959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ef44e-aa8f-420b-bba2-95b2af9baa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:44.692576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ef44e-aa8f-420b-bba2-95b2af9baa89 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.692853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ef44e-aa8f-420b-bba2-95b2af9baa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.693118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ef44e-aa8f-420b-bba2-95b2af9baa89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.693784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ef44e-aa8f-420b-bba2-95b2af9baa89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:44.695474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ef44e-aa8f-420b-bba2-95b2af9baa89 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:44.718425 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1102/2243] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:44.719747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ef44e-aa8f-420b-bba2-95b2af9baa89 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:44.730857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ef44e-aa8f-420b-bba2-95b2af9baa89 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:44.732760 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:44.738954 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1142/2244] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:44.740522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7184f86-722c-4d02-be04-6fbafdf807cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:44.741145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7184f86-722c-4d02-be04-6fbafdf807cd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.741601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7184f86-722c-4d02-be04-6fbafdf807cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.741878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7184f86-722c-4d02-be04-6fbafdf807cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.742641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7184f86-722c-4d02-be04-6fbafdf807cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:44.744345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7184f86-722c-4d02-be04-6fbafdf807cd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:44.750583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebc0f8-f66b-4231-bdb7-3d316172157c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:44.752866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4bebc0f8-f66b-4231-bdb7-3d316172157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:44.764564 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1103/2245] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:44.765885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7184f86-722c-4d02-be04-6fbafdf807cd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:44.784539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7184f86-722c-4d02-be04-6fbafdf807cd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:44.791342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae73df4-e808-40d1-8571-eac019e6df52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:44.792208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae73df4-e808-40d1-8571-eac019e6df52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.792632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae73df4-e808-40d1-8571-eac019e6df52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.793049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae73df4-e808-40d1-8571-eac019e6df52 admin admin] PATH_INFO: `/v3/projects/9f15cb6a79194375bd48a2af095e9374/users/57612f6a347e49be96d699e76bd9bead/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.818280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae73df4-e808-40d1-8571-eac019e6df52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f15cb6a79194375bd48a2af095e9374, user_id=57612f6a347e49be96d699e76bd9bead, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:44.821602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae73df4-e808-40d1-8571-eac019e6df52 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:44.825529 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:44.843461 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1104/2246] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:44 2022] PUT /identity/v3/projects/9f15cb6a79194375bd48a2af095e9374/users/57612f6a347e49be96d699e76bd9bead/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:44.855435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88512e3-cea4-4ac0-aa52-d37cfc22e604 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:44.855769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88512e3-cea4-4ac0-aa52-d37cfc22e604 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:44.856150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88512e3-cea4-4ac0-aa52-d37cfc22e604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:44.875718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebc0f8-f66b-4231-bdb7-3d316172157c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:44.903110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e88512e3-cea4-4ac0-aa52-d37cfc22e604 None None] MFA Rules not processed for user `57612f6a347e49be96d699e76bd9bead`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:44.907865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e88512e3-cea4-4ac0-aa52-d37cfc22e604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:45.017100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a415912-7cbc-49e9-a70d-e1b5b6cc9025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:45.020328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a415912-7cbc-49e9-a70d-e1b5b6cc9025 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:45.021100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a415912-7cbc-49e9-a70d-e1b5b6cc9025 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:45.021527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a415912-7cbc-49e9-a70d-e1b5b6cc9025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:45.053849 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1105/2247] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:45.057759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88512e3-cea4-4ac0-aa52-d37cfc22e604 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:45.137731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a415912-7cbc-49e9-a70d-e1b5b6cc9025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:45.140574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a415912-7cbc-49e9-a70d-e1b5b6cc9025 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:45.153249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88512e3-cea4-4ac0-aa52-d37cfc22e604 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:45.165042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456a516-4f0e-4395-b543-7d1d69afd945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:45.165277 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1143/2248] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:02:45.165375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456a516-4f0e-4395-b543-7d1d69afd945 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:45.166894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456a516-4f0e-4395-b543-7d1d69afd945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:45.167296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456a516-4f0e-4395-b543-7d1d69afd945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:45.168520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456a516-4f0e-4395-b543-7d1d69afd945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:45.170691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456a516-4f0e-4395-b543-7d1d69afd945 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:45.228806 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1106/2249] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:45 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:02:45.232124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a415912-7cbc-49e9-a70d-e1b5b6cc9025 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:45.244118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456a516-4f0e-4395-b543-7d1d69afd945 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:45.253124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a415912-7cbc-49e9-a70d-e1b5b6cc9025 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:45.349240 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:45.360330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456a516-4f0e-4395-b543-7d1d69afd945 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:45.368116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda0638-0f61-4c88-af40-351760c671b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:45.368753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda0638-0f61-4c88-af40-351760c671b9 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:45.369034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda0638-0f61-4c88-af40-351760c671b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:45.369309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda0638-0f61-4c88-af40-351760c671b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:45.371926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-deda0638-0f61-4c88-af40-351760c671b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:45.384812 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:45.402583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe78fb6-7eca-4455-b34c-431f24ddb5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:45.404183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe78fb6-7eca-4455-b34c-431f24ddb5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:45.404688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe78fb6-7eca-4455-b34c-431f24ddb5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:45.405733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe78fb6-7eca-4455-b34c-431f24ddb5d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:45.422377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe78fb6-7eca-4455-b34c-431f24ddb5d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:45.425977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe78fb6-7eca-4455-b34c-431f24ddb5d9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:45.491362 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1144/2250] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:45 2022] POST /identity/v3/users => generated 295 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:45.495403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda0638-0f61-4c88-af40-351760c671b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:45.496096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe78fb6-7eca-4455-b34c-431f24ddb5d9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:45.497172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda0638-0f61-4c88-af40-351760c671b9 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:45.520744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe78fb6-7eca-4455-b34c-431f24ddb5d9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:45.527333 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1107/2251] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:45.557044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e0c81-0017-4d04-a217-df0128a5ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:45.557680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0c81-0017-4d04-a217-df0128a5ccf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:45.557959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0c81-0017-4d04-a217-df0128a5ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:45.558379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0c81-0017-4d04-a217-df0128a5ccf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:45.559061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e0c81-0017-4d04-a217-df0128a5ccf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:45.560709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e0c81-0017-4d04-a217-df0128a5ccf3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:45.592664 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1145/2252] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:45.597928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda0638-0f61-4c88-af40-351760c671b9 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:45.616171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda0638-0f61-4c88-af40-351760c671b9 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:45.630829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbe8d6-f3c2-4c94-8750-2e30705b8fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:45.631543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbe8d6-f3c2-4c94-8750-2e30705b8fca admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:45.631821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbe8d6-f3c2-4c94-8750-2e30705b8fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:45.632093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbe8d6-f3c2-4c94-8750-2e30705b8fca admin admin] PATH_INFO: `/v3/projects/de18aeb229f843b4ab5928afbdc34afd/users/56a8baf5199545188c7bbbfc2b94060a/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:45.656914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbe8d6-f3c2-4c94-8750-2e30705b8fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=de18aeb229f843b4ab5928afbdc34afd, user_id=56a8baf5199545188c7bbbfc2b94060a, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:45.660451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbe8d6-f3c2-4c94-8750-2e30705b8fca admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:45.681073 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1108/2253] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:45 2022] PUT /identity/v3/projects/de18aeb229f843b4ab5928afbdc34afd/users/56a8baf5199545188c7bbbfc2b94060a/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:45.685134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e0c81-0017-4d04-a217-df0128a5ccf3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:45.702109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e0c81-0017-4d04-a217-df0128a5ccf3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:45.886705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c19f91-f32d-4f85-992a-7f6c61943eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:45.887527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c19f91-f32d-4f85-992a-7f6c61943eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:45.887778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c19f91-f32d-4f85-992a-7f6c61943eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:45.888134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c19f91-f32d-4f85-992a-7f6c61943eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:45.889729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c19f91-f32d-4f85-992a-7f6c61943eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:45.891744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c19f91-f32d-4f85-992a-7f6c61943eb6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:45.910373 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1146/2254] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:45.914084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbe8d6-f3c2-4c94-8750-2e30705b8fca admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:45.928616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbe8d6-f3c2-4c94-8750-2e30705b8fca admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:45.938837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b534098-c8d6-4d9e-bc01-6189a5d910e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:45.940447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b534098-c8d6-4d9e-bc01-6189a5d910e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:45.940873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b534098-c8d6-4d9e-bc01-6189a5d910e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:45.941234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b534098-c8d6-4d9e-bc01-6189a5d910e4 admin admin] PATH_INFO: `/v3/projects/de18aeb229f843b4ab5928afbdc34afd/users/56a8baf5199545188c7bbbfc2b94060a/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:45.943659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b534098-c8d6-4d9e-bc01-6189a5d910e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de18aeb229f843b4ab5928afbdc34afd, user_id=56a8baf5199545188c7bbbfc2b94060a, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:45.946427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b534098-c8d6-4d9e-bc01-6189a5d910e4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:45.971715 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1109/2255] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:45 2022] PUT /identity/v3/projects/de18aeb229f843b4ab5928afbdc34afd/users/56a8baf5199545188c7bbbfc2b94060a/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:45.972604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc139-7488-4da2-aac0-9d4145f0dcb1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:45.972902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc139-7488-4da2-aac0-9d4145f0dcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:45.973178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc139-7488-4da2-aac0-9d4145f0dcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:46.025551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-edfcc139-7488-4da2-aac0-9d4145f0dcb1 None None] MFA Rules not processed for user `56a8baf5199545188c7bbbfc2b94060a`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:46.028553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-edfcc139-7488-4da2-aac0-9d4145f0dcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:46.120482 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1147/2256] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:46.131256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c147da-525c-4db1-afdf-d21719913a3e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:46.131460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c147da-525c-4db1-afdf-d21719913a3e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:46.131728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c147da-525c-4db1-afdf-d21719913a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:46.151337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-25c147da-525c-4db1-afdf-d21719913a3e None None] MFA Rules not processed for user `57612f6a347e49be96d699e76bd9bead`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:46.152536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-25c147da-525c-4db1-afdf-d21719913a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:46.219457 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1110/2257] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:46.314180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcc139-7488-4da2-aac0-9d4145f0dcb1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:46.442797 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:46.512399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcc139-7488-4da2-aac0-9d4145f0dcb1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:46.526498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c0112-c1e0-41dc-92b9-5afe85f0854e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:46.527499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c0112-c1e0-41dc-92b9-5afe85f0854e service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:46.528003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c0112-c1e0-41dc-92b9-5afe85f0854e service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:46.528610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c0112-c1e0-41dc-92b9-5afe85f0854e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:46.548523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c0112-c1e0-41dc-92b9-5afe85f0854e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:46.560495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c0112-c1e0-41dc-92b9-5afe85f0854e service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:46.580599 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1148/2258] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:46.586899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c147da-525c-4db1-afdf-d21719913a3e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:46.723291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c147da-525c-4db1-afdf-d21719913a3e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:46.729842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:46.729842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:46.730143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:46.730288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] PATH_INFO: `/v3/users/0286dccb8deb401798bd915988e75987` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:46.734722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0286dccb8deb401798bd915988e75987)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:46.739606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:46.764503 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:46.840074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0286dccb8deb401798bd915988e75987'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:46.841005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0286dccb8deb401798bd915988e75987'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:46.856032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0286dccb8deb401798bd915988e75987'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:46.866150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0286dccb8deb401798bd915988e75987'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:46.867157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0286dccb8deb401798bd915988e75987'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:46.882365 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1111/2259] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:46 2022] DELETE /identity/v3/users/0286dccb8deb401798bd915988e75987 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:46.887094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a32bc-08e8-49df-ad24-de95a05396f0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:46.887620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a32bc-08e8-49df-ad24-de95a05396f0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:46.887620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a32bc-08e8-49df-ad24-de95a05396f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:46.907830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a44a32bc-08e8-49df-ad24-de95a05396f0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:46.909918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a44a32bc-08e8-49df-ad24-de95a05396f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:47.004518 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1149/2260] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:47.021845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:47.024537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:47.134197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e9d4c-ecad-4db5-a8c6-b19310f6c484 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:47.138281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472d95a-a3c7-4e91-857f-835e1eec69d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:47.138892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472d95a-a3c7-4e91-857f-835e1eec69d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:47.139197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472d95a-a3c7-4e91-857f-835e1eec69d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:47.139465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472d95a-a3c7-4e91-857f-835e1eec69d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:47.150402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472d95a-a3c7-4e91-857f-835e1eec69d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:47.151874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472d95a-a3c7-4e91-857f-835e1eec69d0 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:47.165796 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1112/2261] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:47.659825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a32bc-08e8-49df-ad24-de95a05396f0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:47.661516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a44a32bc-08e8-49df-ad24-de95a05396f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:47.700630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a32bc-08e8-49df-ad24-de95a05396f0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:47.707453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:47.708557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:47.709116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:47.709592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b admin admin] PATH_INFO: `/v3/projects/8cf85c4b9fb4446bba33d9cf8b366f9e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:47.711067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cf85c4b9fb4446bba33d9cf8b366f9e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:47.713482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:47.817433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf85c4b9fb4446bba33d9cf8b366f9e', 'request_id': 'req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:47.826033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf85c4b9fb4446bba33d9cf8b366f9e', 'request_id': 'req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:47.837234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf85c4b9fb4446bba33d9cf8b366f9e', 'request_id': 'req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:47.854910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b admin admin] The token cache is being invalidate because project 8cf85c4b9fb4446bba33d9cf8b366f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:47.855586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:47.856595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dec0a801-ed3f-40a2-9ad2-de99b9f3200b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:47.863915 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1150/2262] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:47 2022] DELETE /identity/v3/projects/8cf85c4b9fb4446bba33d9cf8b366f9e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:47.864099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472d95a-a3c7-4e91-857f-835e1eec69d0 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:47.878404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472d95a-a3c7-4e91-857f-835e1eec69d0 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:47.969438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768462-3c78-455b-b0ba-c631b20d3726 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:47.969898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768462-3c78-455b-b0ba-c631b20d3726 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:47.970143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768462-3c78-455b-b0ba-c631b20d3726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:47.987086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121284e0-617f-4a34-9921-952f53a48e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:47.987772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121284e0-617f-4a34-9921-952f53a48e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:47.988121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121284e0-617f-4a34-9921-952f53a48e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:47.988484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121284e0-617f-4a34-9921-952f53a48e84 admin admin] PATH_INFO: `/v3/users/024be1149aa04673ac8d5faa81260244` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:47.989776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121284e0-617f-4a34-9921-952f53a48e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=024be1149aa04673ac8d5faa81260244)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:47.992226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121284e0-617f-4a34-9921-952f53a48e84 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:48.000769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5d768462-3c78-455b-b0ba-c631b20d3726 None None] MFA Rules not processed for user `57612f6a347e49be96d699e76bd9bead`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:48.002044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5d768462-3c78-455b-b0ba-c631b20d3726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:48.058310 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:48.067143 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:48.087487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-121284e0-617f-4a34-9921-952f53a48e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024be1149aa04673ac8d5faa81260244'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:48.090153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-121284e0-617f-4a34-9921-952f53a48e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024be1149aa04673ac8d5faa81260244'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:48.125211 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1151/2263] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:48.129445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-121284e0-617f-4a34-9921-952f53a48e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024be1149aa04673ac8d5faa81260244'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:48.139773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-121284e0-617f-4a34-9921-952f53a48e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024be1149aa04673ac8d5faa81260244'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:48.140276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-121284e0-617f-4a34-9921-952f53a48e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024be1149aa04673ac8d5faa81260244'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:48.172389 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1113/2264] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:47 2022] DELETE /identity/v3/users/024be1149aa04673ac8d5faa81260244 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:48.534719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d768462-3c78-455b-b0ba-c631b20d3726 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:48.537431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5d768462-3c78-455b-b0ba-c631b20d3726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:48.566269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d768462-3c78-455b-b0ba-c631b20d3726 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:48.723056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:48.725579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:48.725959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:48.726239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e admin admin] PATH_INFO: `/v3/projects/da8cbfb2365e44699e6a9975927f9b78` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:48.727671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=da8cbfb2365e44699e6a9975927f9b78)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:48.729790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:48.840448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8cbfb2365e44699e6a9975927f9b78', 'request_id': 'req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:48.848775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8cbfb2365e44699e6a9975927f9b78', 'request_id': 'req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:48.860484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8cbfb2365e44699e6a9975927f9b78', 'request_id': 'req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:48.878490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e admin admin] The token cache is being invalidate because project da8cbfb2365e44699e6a9975927f9b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:48.878717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:48.879503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aa91fd74-d204-47f2-ac2f-b85dc6b17b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:48.881107 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1152/2265] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:48 2022] DELETE /identity/v3/projects/da8cbfb2365e44699e6a9975927f9b78 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:48.886137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbb29c-6955-4828-848b-c217179c2066 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:48.886669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbb29c-6955-4828-848b-c217179c2066 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:48.886669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbb29c-6955-4828-848b-c217179c2066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:48.909491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a9dbb29c-6955-4828-848b-c217179c2066 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:48.910732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a9dbb29c-6955-4828-848b-c217179c2066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:48.972874 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1114/2266] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:48.980541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da881a5-b3e4-4a1a-b5c4-5e866f6a1c3b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:48.981036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da881a5-b3e4-4a1a-b5c4-5e866f6a1c3b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:48.981247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da881a5-b3e4-4a1a-b5c4-5e866f6a1c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:49.004006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7da881a5-b3e4-4a1a-b5c4-5e866f6a1c3b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:49.005507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7da881a5-b3e4-4a1a-b5c4-5e866f6a1c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:49.013739 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1153/2267] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:49.018757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbb29c-6955-4828-848b-c217179c2066 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:49.028739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbb29c-6955-4828-848b-c217179c2066 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:49.033412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6297d28-baa1-4746-b72f-65f4b43cce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:49.034011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6297d28-baa1-4746-b72f-65f4b43cce9b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:49.034288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6297d28-baa1-4746-b72f-65f4b43cce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:49.034546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6297d28-baa1-4746-b72f-65f4b43cce9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:49.035219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6297d28-baa1-4746-b72f-65f4b43cce9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:02:49.035520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6297d28-baa1-4746-b72f-65f4b43cce9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:49.037108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6297d28-baa1-4746-b72f-65f4b43cce9b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:49.050475 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1115/2268] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:02:49.054819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da881a5-b3e4-4a1a-b5c4-5e866f6a1c3b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:49.063982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da881a5-b3e4-4a1a-b5c4-5e866f6a1c3b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:49.069726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6de00-d048-46a6-91f0-a1c9565d55b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:49.070415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6de00-d048-46a6-91f0-a1c9565d55b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:49.070756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6de00-d048-46a6-91f0-a1c9565d55b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:49.071121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6de00-d048-46a6-91f0-a1c9565d55b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:49.071830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6de00-d048-46a6-91f0-a1c9565d55b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:49.073784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6de00-d048-46a6-91f0-a1c9565d55b5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:49.129746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6297d28-baa1-4746-b72f-65f4b43cce9b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:49.135050 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1154/2269] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:49 2022] POST /identity/v3/projects => generated 393 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:49.165768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6297d28-baa1-4746-b72f-65f4b43cce9b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:49.260118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecfeba-b93e-40f7-8ed2-42783f4ebc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:49.261261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecfeba-b93e-40f7-8ed2-42783f4ebc11 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:49.261741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecfeba-b93e-40f7-8ed2-42783f4ebc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:49.262328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecfeba-b93e-40f7-8ed2-42783f4ebc11 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:49.263189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecfeba-b93e-40f7-8ed2-42783f4ebc11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:49.265461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecfeba-b93e-40f7-8ed2-42783f4ebc11 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:49.310867 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1116/2270] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:49 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:49.312132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6de00-d048-46a6-91f0-a1c9565d55b5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:49.324771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6de00-d048-46a6-91f0-a1c9565d55b5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:49.329611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fcd5a-a809-48e3-8d92-c38d58b3f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:49.330506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fcd5a-a809-48e3-8d92-c38d58b3f338 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:49.330783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fcd5a-a809-48e3-8d92-c38d58b3f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:49.331084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fcd5a-a809-48e3-8d92-c38d58b3f338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:49.332194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fcd5a-a809-48e3-8d92-c38d58b3f338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:49.333322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fcd5a-a809-48e3-8d92-c38d58b3f338 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:49.347084 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1155/2271] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:49.348508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecfeba-b93e-40f7-8ed2-42783f4ebc11 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:49.360305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecfeba-b93e-40f7-8ed2-42783f4ebc11 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:49.366935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff5a7d-041a-406d-88b9-e3e6d7ac93cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:49.367546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff5a7d-041a-406d-88b9-e3e6d7ac93cc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:49.367879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff5a7d-041a-406d-88b9-e3e6d7ac93cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:49.368420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff5a7d-041a-406d-88b9-e3e6d7ac93cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:49.369071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff5a7d-041a-406d-88b9-e3e6d7ac93cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:49.370687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff5a7d-041a-406d-88b9-e3e6d7ac93cc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:49.387567 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1117/2272] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:49.388757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fcd5a-a809-48e3-8d92-c38d58b3f338 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:49.402076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fcd5a-a809-48e3-8d92-c38d58b3f338 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:49.406973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b3643-c953-467d-804f-f0ea542a6a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:49.407523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b3643-c953-467d-804f-f0ea542a6a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:49.407800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b3643-c953-467d-804f-f0ea542a6a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:49.408233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b3643-c953-467d-804f-f0ea542a6a1c admin admin] PATH_INFO: `/v3/projects/8bb8c6c737344e21b5e82ff5acf7e945/users/39ea26fe66864e049c991dc1c4e4010c/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:49.431826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b3643-c953-467d-804f-f0ea542a6a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8c6c737344e21b5e82ff5acf7e945, user_id=39ea26fe66864e049c991dc1c4e4010c, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:49.435703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b3643-c953-467d-804f-f0ea542a6a1c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:49.476218 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1156/2273] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:49 2022] PUT /identity/v3/projects/8bb8c6c737344e21b5e82ff5acf7e945/users/39ea26fe66864e049c991dc1c4e4010c/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:49.476726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31c124-dad3-4697-8720-20781d0d5345 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:49.477016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31c124-dad3-4697-8720-20781d0d5345 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:49.477779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31c124-dad3-4697-8720-20781d0d5345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:49.518354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0b31c124-dad3-4697-8720-20781d0d5345 None None] MFA Rules not processed for user `39ea26fe66864e049c991dc1c4e4010c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:49.519915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0b31c124-dad3-4697-8720-20781d0d5345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:49.535047 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:49.631632 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1118/2274] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:49.635887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b3643-c953-467d-804f-f0ea542a6a1c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:49.651811 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:49.753537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b3643-c953-467d-804f-f0ea542a6a1c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:49.759788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889afd01-61d4-4149-8fb5-3771fc127a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:49.760543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889afd01-61d4-4149-8fb5-3771fc127a7d admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:49.760851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889afd01-61d4-4149-8fb5-3771fc127a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:49.761123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889afd01-61d4-4149-8fb5-3771fc127a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:49.761857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889afd01-61d4-4149-8fb5-3771fc127a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:49.764278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889afd01-61d4-4149-8fb5-3771fc127a7d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:49.811968 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1157/2275] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:49 2022] POST /identity/v3/projects => generated 391 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:49.815572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31c124-dad3-4697-8720-20781d0d5345 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:49.831170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31c124-dad3-4697-8720-20781d0d5345 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:49.906931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87631e1b-d559-4432-a903-1255316c94ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:49.907804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87631e1b-d559-4432-a903-1255316c94ff admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:49.908298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87631e1b-d559-4432-a903-1255316c94ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:49.908769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87631e1b-d559-4432-a903-1255316c94ff admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:49.909708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87631e1b-d559-4432-a903-1255316c94ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:49.913435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87631e1b-d559-4432-a903-1255316c94ff admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:49.945536 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1119/2276] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:49 2022] POST /identity/v3/users => generated 302 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:49.956849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889afd01-61d4-4149-8fb5-3771fc127a7d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:49.969804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889afd01-61d4-4149-8fb5-3771fc127a7d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:49.976844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf8c78-a36e-4bba-9e1b-b7e6ccf5d203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:49.977870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf8c78-a36e-4bba-9e1b-b7e6ccf5d203 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:49.977870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf8c78-a36e-4bba-9e1b-b7e6ccf5d203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:49.978086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf8c78-a36e-4bba-9e1b-b7e6ccf5d203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:49.978735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf8c78-a36e-4bba-9e1b-b7e6ccf5d203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:49.980829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf8c78-a36e-4bba-9e1b-b7e6ccf5d203 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:49.999761 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1158/2277] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:02:50.002389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87631e1b-d559-4432-a903-1255316c94ff admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:50.018517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87631e1b-d559-4432-a903-1255316c94ff admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:50.024426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265ed08-f016-4e57-a055-40964c67d958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:50.025431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265ed08-f016-4e57-a055-40964c67d958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:50.025708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265ed08-f016-4e57-a055-40964c67d958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:50.026579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265ed08-f016-4e57-a055-40964c67d958 admin admin] PATH_INFO: `/v3/projects/da7522a76846491e824f42af58155079/users/c3ce07ff6cf840bb9c33f7d5896f534d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:50.054888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265ed08-f016-4e57-a055-40964c67d958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7522a76846491e824f42af58155079, user_id=c3ce07ff6cf840bb9c33f7d5896f534d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:50.057818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265ed08-f016-4e57-a055-40964c67d958 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:50.084960 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1120/2278] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:49 2022] PUT /identity/v3/projects/da7522a76846491e824f42af58155079/users/c3ce07ff6cf840bb9c33f7d5896f534d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:50.090697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf8c78-a36e-4bba-9e1b-b7e6ccf5d203 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:50.117293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf8c78-a36e-4bba-9e1b-b7e6ccf5d203 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:50.254786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a3c7f-3aa3-471e-bc83-3e73417124b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:50.255428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3c7f-3aa3-471e-bc83-3e73417124b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:50.255708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3c7f-3aa3-471e-bc83-3e73417124b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:50.255958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3c7f-3aa3-471e-bc83-3e73417124b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:50.256592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a3c7f-3aa3-471e-bc83-3e73417124b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:50.261598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a3c7f-3aa3-471e-bc83-3e73417124b0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:50.299156 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1159/2279] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:50.300554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265ed08-f016-4e57-a055-40964c67d958 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:50.317523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265ed08-f016-4e57-a055-40964c67d958 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:50.324699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca54cc7-289b-49d5-a026-f15cbd606f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:50.326070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca54cc7-289b-49d5-a026-f15cbd606f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:50.326400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca54cc7-289b-49d5-a026-f15cbd606f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:50.326745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca54cc7-289b-49d5-a026-f15cbd606f01 admin admin] PATH_INFO: `/v3/projects/da7522a76846491e824f42af58155079/users/c3ce07ff6cf840bb9c33f7d5896f534d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:50.329497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca54cc7-289b-49d5-a026-f15cbd606f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7522a76846491e824f42af58155079, user_id=c3ce07ff6cf840bb9c33f7d5896f534d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:50.333261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca54cc7-289b-49d5-a026-f15cbd606f01 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:50.358947 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1121/2280] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:50 2022] PUT /identity/v3/projects/da7522a76846491e824f42af58155079/users/c3ce07ff6cf840bb9c33f7d5896f534d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:50.363502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c79fb-c578-4106-ae9a-bdce194634da None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:50.364025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c79fb-c578-4106-ae9a-bdce194634da None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:50.364498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c79fb-c578-4106-ae9a-bdce194634da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:50.440704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-119c79fb-c578-4106-ae9a-bdce194634da None None] MFA Rules not processed for user `c3ce07ff6cf840bb9c33f7d5896f534d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:50.443497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-119c79fb-c578-4106-ae9a-bdce194634da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:50.621291 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1160/2281] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:50.973340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca54cc7-289b-49d5-a026-f15cbd606f01 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:51.062762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca54cc7-289b-49d5-a026-f15cbd606f01 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:51.069538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:51.069538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:51.069538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:51.069877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] PATH_INFO: `/v3/users/39ea26fe66864e049c991dc1c4e4010c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:51.071559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ea26fe66864e049c991dc1c4e4010c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:51.074551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:51.082197 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:51.166045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ea26fe66864e049c991dc1c4e4010c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.167468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ea26fe66864e049c991dc1c4e4010c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.184781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ea26fe66864e049c991dc1c4e4010c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.196870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ea26fe66864e049c991dc1c4e4010c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.198107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ea26fe66864e049c991dc1c4e4010c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.246307 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1122/2282] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:50 2022] DELETE /identity/v3/users/39ea26fe66864e049c991dc1c4e4010c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:51.248331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63135538-751d-4d33-923a-26eb4df1e0e1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:51.249182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63135538-751d-4d33-923a-26eb4df1e0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:51.250950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63135538-751d-4d33-923a-26eb4df1e0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:51.271428 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:51.285825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-63135538-751d-4d33-923a-26eb4df1e0e1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:51.289260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-63135538-751d-4d33-923a-26eb4df1e0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:51.446684 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1161/2283] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:51.482775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:51.492191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:51.677064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c2931-2f68-464a-8bc0-c7190dc8275a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:51.681580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25eea2f-1232-41f0-af2c-731f963ef6cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:51.682228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25eea2f-1232-41f0-af2c-731f963ef6cb service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:51.682508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25eea2f-1232-41f0-af2c-731f963ef6cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:51.682801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25eea2f-1232-41f0-af2c-731f963ef6cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:51.693953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25eea2f-1232-41f0-af2c-731f963ef6cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:51.695598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25eea2f-1232-41f0-af2c-731f963ef6cb service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:51.707600 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1123/2284] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:52.756708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63135538-751d-4d33-923a-26eb4df1e0e1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:52.759121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-63135538-751d-4d33-923a-26eb4df1e0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:52.791508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63135538-751d-4d33-923a-26eb4df1e0e1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:52.819002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:52.821344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.823559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.826048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] PATH_INFO: `/v3/projects/8bb8c6c737344e21b5e82ff5acf7e945` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.830396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb8c6c737344e21b5e82ff5acf7e945)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:52.839742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:52.958322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb8c6c737344e21b5e82ff5acf7e945', 'request_id': 'req-435b94c6-7daa-4f30-b6b3-5f53c77593aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:52.967169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb8c6c737344e21b5e82ff5acf7e945', 'request_id': 'req-435b94c6-7daa-4f30-b6b3-5f53c77593aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:52.980934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb8c6c737344e21b5e82ff5acf7e945', 'request_id': 'req-435b94c6-7daa-4f30-b6b3-5f53c77593aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:52.998708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] The token cache is being invalidate because project 8bb8c6c737344e21b5e82ff5acf7e945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:52.999156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:53.000069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:53.008460 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1162/2285] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:52 2022] DELETE /identity/v3/projects/8bb8c6c737344e21b5e82ff5acf7e945 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:53.008762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25eea2f-1232-41f0-af2c-731f963ef6cb service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:53.030520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25eea2f-1232-41f0-af2c-731f963ef6cb service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:53.110899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36385f7e-78f8-439e-b302-48f37d2d6525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:53.112311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36385f7e-78f8-439e-b302-48f37d2d6525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:53.112596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36385f7e-78f8-439e-b302-48f37d2d6525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:53.112870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36385f7e-78f8-439e-b302-48f37d2d6525 admin admin] PATH_INFO: `/v3/users/c3ce07ff6cf840bb9c33f7d5896f534d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:53.114074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36385f7e-78f8-439e-b302-48f37d2d6525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ce07ff6cf840bb9c33f7d5896f534d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:53.116976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36385f7e-78f8-439e-b302-48f37d2d6525 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:53.158535 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:53.196455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-36385f7e-78f8-439e-b302-48f37d2d6525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ce07ff6cf840bb9c33f7d5896f534d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:53.197298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-36385f7e-78f8-439e-b302-48f37d2d6525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ce07ff6cf840bb9c33f7d5896f534d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:53.217653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-36385f7e-78f8-439e-b302-48f37d2d6525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ce07ff6cf840bb9c33f7d5896f534d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:53.238810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-36385f7e-78f8-439e-b302-48f37d2d6525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ce07ff6cf840bb9c33f7d5896f534d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:53.240104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-36385f7e-78f8-439e-b302-48f37d2d6525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ce07ff6cf840bb9c33f7d5896f534d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:53.263905 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1124/2286] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:53 2022] DELETE /identity/v3/users/c3ce07ff6cf840bb9c33f7d5896f534d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:54.748719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:54.750207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:54.766728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b94c6-7daa-4f30-b6b3-5f53c77593aa admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:54.908641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a07b7-8de7-49d2-9f8b-bc56addf0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:54.910414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a07b7-8de7-49d2-9f8b-bc56addf0152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:54.913079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a07b7-8de7-49d2-9f8b-bc56addf0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:54.914006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a07b7-8de7-49d2-9f8b-bc56addf0152 admin admin] PATH_INFO: `/v3/projects/da7522a76846491e824f42af58155079` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:54.921347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a07b7-8de7-49d2-9f8b-bc56addf0152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da7522a76846491e824f42af58155079)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:54.952223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a07b7-8de7-49d2-9f8b-bc56addf0152 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.094015 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:55.137777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b04a07b7-8de7-49d2-9f8b-bc56addf0152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da7522a76846491e824f42af58155079', 'request_id': 'req-b04a07b7-8de7-49d2-9f8b-bc56addf0152'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:55.149896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b04a07b7-8de7-49d2-9f8b-bc56addf0152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da7522a76846491e824f42af58155079', 'request_id': 'req-b04a07b7-8de7-49d2-9f8b-bc56addf0152'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:55.161887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b04a07b7-8de7-49d2-9f8b-bc56addf0152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da7522a76846491e824f42af58155079', 'request_id': 'req-b04a07b7-8de7-49d2-9f8b-bc56addf0152'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:55.183732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b04a07b7-8de7-49d2-9f8b-bc56addf0152 admin admin] The token cache is being invalidate because project da7522a76846491e824f42af58155079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:55.184409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b04a07b7-8de7-49d2-9f8b-bc56addf0152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:55.187038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b04a07b7-8de7-49d2-9f8b-bc56addf0152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:55.190578 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1163/2287] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:54 2022] DELETE /identity/v3/projects/da7522a76846491e824f42af58155079 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:55.195843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e04c1-1980-4f28-8c57-84f9d0b4f362 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.197438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e04c1-1980-4f28-8c57-84f9d0b4f362 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.197951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e04c1-1980-4f28-8c57-84f9d0b4f362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.235607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f92e04c1-1980-4f28-8c57-84f9d0b4f362 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:55.237064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f92e04c1-1980-4f28-8c57-84f9d0b4f362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:55.342078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680f36-be3c-4085-a13f-08657f145af2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.342383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680f36-be3c-4085-a13f-08657f145af2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.343010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680f36-be3c-4085-a13f-08657f145af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.351126 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1125/2288] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:55.366600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fb680f36-be3c-4085-a13f-08657f145af2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:55.368422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fb680f36-be3c-4085-a13f-08657f145af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:55.378601 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1164/2289] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:55.382867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e04c1-1980-4f28-8c57-84f9d0b4f362 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.396457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e04c1-1980-4f28-8c57-84f9d0b4f362 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.402871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d112-6277-42dd-a806-699bb948ad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.403644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d112-6277-42dd-a806-699bb948ad5c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.404192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d112-6277-42dd-a806-699bb948ad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.404558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d112-6277-42dd-a806-699bb948ad5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.405421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118d112-6277-42dd-a806-699bb948ad5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:02:55.405873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118d112-6277-42dd-a806-699bb948ad5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.407685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118d112-6277-42dd-a806-699bb948ad5c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.422691 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1126/2290] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:02:55.428066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb680f36-be3c-4085-a13f-08657f145af2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.438823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb680f36-be3c-4085-a13f-08657f145af2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.444414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd38050-c24a-489e-b675-de45369bea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.445122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd38050-c24a-489e-b675-de45369bea3e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.445508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd38050-c24a-489e-b675-de45369bea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.445953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd38050-c24a-489e-b675-de45369bea3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.447064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd38050-c24a-489e-b675-de45369bea3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.449960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd38050-c24a-489e-b675-de45369bea3e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.490135 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1165/2291] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:55 2022] POST /identity/v3/projects => generated 395 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:55.491165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d112-6277-42dd-a806-699bb948ad5c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.505110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d112-6277-42dd-a806-699bb948ad5c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.584833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e4126-200b-4f78-b906-52f3361bc3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.585491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e4126-200b-4f78-b906-52f3361bc3de admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.586253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e4126-200b-4f78-b906-52f3361bc3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.586253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e4126-200b-4f78-b906-52f3361bc3de admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.586732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e4126-200b-4f78-b906-52f3361bc3de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.589965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e4126-200b-4f78-b906-52f3361bc3de admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.651873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd38050-c24a-489e-b675-de45369bea3e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.663313 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1127/2292] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:55 2022] POST /identity/v3/users => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:02:55.668040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd38050-c24a-489e-b675-de45369bea3e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.676410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadea14-ee28-4aad-9998-3902d5d4b574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.677660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadea14-ee28-4aad-9998-3902d5d4b574 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.678147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadea14-ee28-4aad-9998-3902d5d4b574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.678637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadea14-ee28-4aad-9998-3902d5d4b574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.679557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadea14-ee28-4aad-9998-3902d5d4b574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.681946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadea14-ee28-4aad-9998-3902d5d4b574 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.697305 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1166/2293] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:55.698945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e4126-200b-4f78-b906-52f3361bc3de admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.721036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e4126-200b-4f78-b906-52f3361bc3de admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.731353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4110816-a7db-4ffc-8d29-c1f5aa07ef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.732233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4110816-a7db-4ffc-8d29-c1f5aa07ef14 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.732594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4110816-a7db-4ffc-8d29-c1f5aa07ef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.732933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4110816-a7db-4ffc-8d29-c1f5aa07ef14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.733660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4110816-a7db-4ffc-8d29-c1f5aa07ef14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.735901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4110816-a7db-4ffc-8d29-c1f5aa07ef14 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.769714 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1128/2294] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:55.770251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadea14-ee28-4aad-9998-3902d5d4b574 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.793810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadea14-ee28-4aad-9998-3902d5d4b574 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.806548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72416e46-84d1-4fad-81a6-891fdb50fd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.807532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416e46-84d1-4fad-81a6-891fdb50fd4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.807532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416e46-84d1-4fad-81a6-891fdb50fd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.807787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416e46-84d1-4fad-81a6-891fdb50fd4b admin admin] PATH_INFO: `/v3/projects/e80abb1cee6d40dfb2c3aace3567a6ba/users/7d472e877f0a4cd9bf89589e4006b028/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.840798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72416e46-84d1-4fad-81a6-891fdb50fd4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80abb1cee6d40dfb2c3aace3567a6ba, user_id=7d472e877f0a4cd9bf89589e4006b028, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.844084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72416e46-84d1-4fad-81a6-891fdb50fd4b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.863160 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1167/2295] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:55 2022] PUT /identity/v3/projects/e80abb1cee6d40dfb2c3aace3567a6ba/users/7d472e877f0a4cd9bf89589e4006b028/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:55.878021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127f46-5ee5-45ec-8eb9-2b7a99a7eb86 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.878372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127f46-5ee5-45ec-8eb9-2b7a99a7eb86 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.878570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127f46-5ee5-45ec-8eb9-2b7a99a7eb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.904983 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:55.932314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7d127f46-5ee5-45ec-8eb9-2b7a99a7eb86 None None] MFA Rules not processed for user `7d472e877f0a4cd9bf89589e4006b028`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:55.933232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7d127f46-5ee5-45ec-8eb9-2b7a99a7eb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:56.036505 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1129/2296] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:56.037196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72416e46-84d1-4fad-81a6-891fdb50fd4b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:56.137301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72416e46-84d1-4fad-81a6-891fdb50fd4b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:56.149211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62bcb4-5a3c-4964-8764-9ef08e5b6726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:56.149871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62bcb4-5a3c-4964-8764-9ef08e5b6726 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:56.150334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62bcb4-5a3c-4964-8764-9ef08e5b6726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:56.150611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62bcb4-5a3c-4964-8764-9ef08e5b6726 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:56.153528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62bcb4-5a3c-4964-8764-9ef08e5b6726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:56.155720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62bcb4-5a3c-4964-8764-9ef08e5b6726 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:56.219307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d127f46-5ee5-45ec-8eb9-2b7a99a7eb86 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:56.233400 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1168/2297] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:56 2022] POST /identity/v3/projects => generated 395 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:02:56.238339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d127f46-5ee5-45ec-8eb9-2b7a99a7eb86 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:56.349373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c2524-034d-4768-9d66-32f856338b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:56.350304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c2524-034d-4768-9d66-32f856338b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:56.350792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c2524-034d-4768-9d66-32f856338b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:56.351317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c2524-034d-4768-9d66-32f856338b9e admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:56.352163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c2524-034d-4768-9d66-32f856338b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:56.354484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c2524-034d-4768-9d66-32f856338b9e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:56.387034 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1130/2298] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:56 2022] POST /identity/v3/users => generated 304 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:56.388654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62bcb4-5a3c-4964-8764-9ef08e5b6726 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:56.409482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62bcb4-5a3c-4964-8764-9ef08e5b6726 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:56.416159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72606e42-dfb7-4831-bdf2-4e0e223a4dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:56.417098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72606e42-dfb7-4831-bdf2-4e0e223a4dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:56.417592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72606e42-dfb7-4831-bdf2-4e0e223a4dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:56.417912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72606e42-dfb7-4831-bdf2-4e0e223a4dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:56.418680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72606e42-dfb7-4831-bdf2-4e0e223a4dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:56.420493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72606e42-dfb7-4831-bdf2-4e0e223a4dc0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:56.444964 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1169/2299] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:56.449540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c2524-034d-4768-9d66-32f856338b9e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:56.463600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c2524-034d-4768-9d66-32f856338b9e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:56.469917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddca2a0-f187-4525-8ef2-9d4d289677db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:56.470629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddca2a0-f187-4525-8ef2-9d4d289677db admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:56.471497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddca2a0-f187-4525-8ef2-9d4d289677db admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:56.471497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddca2a0-f187-4525-8ef2-9d4d289677db admin admin] PATH_INFO: `/v3/projects/f9489ece0e6147529712d7533b908134/users/e331f2f4836b40e88cc087c3901509b5/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:56.491762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddca2a0-f187-4525-8ef2-9d4d289677db admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9489ece0e6147529712d7533b908134, user_id=e331f2f4836b40e88cc087c3901509b5, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:56.495584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddca2a0-f187-4525-8ef2-9d4d289677db admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:56.515208 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1131/2300] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:56 2022] PUT /identity/v3/projects/f9489ece0e6147529712d7533b908134/users/e331f2f4836b40e88cc087c3901509b5/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:56.516435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72606e42-dfb7-4831-bdf2-4e0e223a4dc0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:56.528759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72606e42-dfb7-4831-bdf2-4e0e223a4dc0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:56.641521 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:56.703917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d5aa7-b6eb-4290-bf32-369a28021b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:56.704560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d5aa7-b6eb-4290-bf32-369a28021b07 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:56.704899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d5aa7-b6eb-4290-bf32-369a28021b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:56.705174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d5aa7-b6eb-4290-bf32-369a28021b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:56.706540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d5aa7-b6eb-4290-bf32-369a28021b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:56.723779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d5aa7-b6eb-4290-bf32-369a28021b07 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:56.758509 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1170/2301] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:56.763011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddca2a0-f187-4525-8ef2-9d4d289677db admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:56.780306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddca2a0-f187-4525-8ef2-9d4d289677db admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:56.796646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd29fb5-b803-4e44-a4b1-7a8d6321fada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:56.797729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd29fb5-b803-4e44-a4b1-7a8d6321fada admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:56.801186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd29fb5-b803-4e44-a4b1-7a8d6321fada admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:56.801781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd29fb5-b803-4e44-a4b1-7a8d6321fada admin admin] PATH_INFO: `/v3/projects/f9489ece0e6147529712d7533b908134/users/e331f2f4836b40e88cc087c3901509b5/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:56.806940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd29fb5-b803-4e44-a4b1-7a8d6321fada admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9489ece0e6147529712d7533b908134, user_id=e331f2f4836b40e88cc087c3901509b5, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:56.817527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd29fb5-b803-4e44-a4b1-7a8d6321fada admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:56.845398 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1132/2302] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:56 2022] PUT /identity/v3/projects/f9489ece0e6147529712d7533b908134/users/e331f2f4836b40e88cc087c3901509b5/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:56.857904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13622f06-1178-4a2f-b26c-ddab8639081c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:56.858438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13622f06-1178-4a2f-b26c-ddab8639081c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:56.858438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13622f06-1178-4a2f-b26c-ddab8639081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:56.914549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-13622f06-1178-4a2f-b26c-ddab8639081c None None] MFA Rules not processed for user `e331f2f4836b40e88cc087c3901509b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:56.915925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-13622f06-1178-4a2f-b26c-ddab8639081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:57.030180 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1171/2303] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:56 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:57.284633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd29fb5-b803-4e44-a4b1-7a8d6321fada admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:57.289465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cbd29fb5-b803-4e44-a4b1-7a8d6321fada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:57.382959 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:57.415968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd29fb5-b803-4e44-a4b1-7a8d6321fada admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:57.422932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68ce4b-4a31-41f6-aab3-5858e91a5f64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:57.424665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68ce4b-4a31-41f6-aab3-5858e91a5f64 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:57.425043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68ce4b-4a31-41f6-aab3-5858e91a5f64 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:57.425384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68ce4b-4a31-41f6-aab3-5858e91a5f64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:57.446298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68ce4b-4a31-41f6-aab3-5858e91a5f64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:57.448893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68ce4b-4a31-41f6-aab3-5858e91a5f64 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:57.465228 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1133/2304] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:57 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:02:57.549284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13622f06-1178-4a2f-b26c-ddab8639081c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:57.620686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13622f06-1178-4a2f-b26c-ddab8639081c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:57.626154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:57.628346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:57.628346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:57.628346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] PATH_INFO: `/v3/users/7d472e877f0a4cd9bf89589e4006b028` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:57.629522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d472e877f0a4cd9bf89589e4006b028)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:57.631186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:57.710351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d472e877f0a4cd9bf89589e4006b028'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.711092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d472e877f0a4cd9bf89589e4006b028'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.717452 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:57.732059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d472e877f0a4cd9bf89589e4006b028'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.743556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d472e877f0a4cd9bf89589e4006b028'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.744265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d472e877f0a4cd9bf89589e4006b028'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.760173 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1172/2305] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:57 2022] DELETE /identity/v3/users/7d472e877f0a4cd9bf89589e4006b028 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:57.764462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf5d16-ddea-4893-9f3c-eed3577b92e7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:57.764888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf5d16-ddea-4893-9f3c-eed3577b92e7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:57.765156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf5d16-ddea-4893-9f3c-eed3577b92e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:57.786907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cbcf5d16-ddea-4893-9f3c-eed3577b92e7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:57.788311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cbcf5d16-ddea-4893-9f3c-eed3577b92e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:57.860818 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1134/2306] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:57.872613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:57.874774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:57.967665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802a119-b549-4f05-a3ec-a05cfe52c2e0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:57.971908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa213ad6-a07c-4d47-9ab0-3c234d7a9a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:57.972524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa213ad6-a07c-4d47-9ab0-3c234d7a9a86 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:57.972801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa213ad6-a07c-4d47-9ab0-3c234d7a9a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:57.973070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa213ad6-a07c-4d47-9ab0-3c234d7a9a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:57.982778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa213ad6-a07c-4d47-9ab0-3c234d7a9a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:57.984289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa213ad6-a07c-4d47-9ab0-3c234d7a9a86 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:57.996548 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1173/2307] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:58.313332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf5d16-ddea-4893-9f3c-eed3577b92e7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:58.315458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cbcf5d16-ddea-4893-9f3c-eed3577b92e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:58.331388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf5d16-ddea-4893-9f3c-eed3577b92e7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:58.337257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b2465-7084-4e47-8a9f-411410ed0f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:58.338000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b2465-7084-4e47-8a9f-411410ed0f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:58.338344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b2465-7084-4e47-8a9f-411410ed0f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:58.338762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b2465-7084-4e47-8a9f-411410ed0f28 admin admin] PATH_INFO: `/v3/projects/e80abb1cee6d40dfb2c3aace3567a6ba` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:58.340170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b2465-7084-4e47-8a9f-411410ed0f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80abb1cee6d40dfb2c3aace3567a6ba)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:58.344180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b2465-7084-4e47-8a9f-411410ed0f28 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:58.416755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-414b2465-7084-4e47-8a9f-411410ed0f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80abb1cee6d40dfb2c3aace3567a6ba', 'request_id': 'req-414b2465-7084-4e47-8a9f-411410ed0f28'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:58.424273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-414b2465-7084-4e47-8a9f-411410ed0f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80abb1cee6d40dfb2c3aace3567a6ba', 'request_id': 'req-414b2465-7084-4e47-8a9f-411410ed0f28'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:58.434123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-414b2465-7084-4e47-8a9f-411410ed0f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80abb1cee6d40dfb2c3aace3567a6ba', 'request_id': 'req-414b2465-7084-4e47-8a9f-411410ed0f28'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:58.448781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-414b2465-7084-4e47-8a9f-411410ed0f28 admin admin] The token cache is being invalidate because project e80abb1cee6d40dfb2c3aace3567a6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:58.449077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-414b2465-7084-4e47-8a9f-411410ed0f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:58.449739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-414b2465-7084-4e47-8a9f-411410ed0f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:58.451255 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1135/2308] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:58 2022] DELETE /identity/v3/projects/e80abb1cee6d40dfb2c3aace3567a6ba => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:58.455918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa213ad6-a07c-4d47-9ab0-3c234d7a9a86 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:58.465932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa213ad6-a07c-4d47-9ab0-3c234d7a9a86 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:58.529992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d96d13-cc55-4404-bea3-467585b10ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:58.530621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d96d13-cc55-4404-bea3-467585b10ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:58.530903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d96d13-cc55-4404-bea3-467585b10ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:58.531391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d96d13-cc55-4404-bea3-467585b10ff0 admin admin] PATH_INFO: `/v3/users/e331f2f4836b40e88cc087c3901509b5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:58.532519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d96d13-cc55-4404-bea3-467585b10ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e331f2f4836b40e88cc087c3901509b5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:58.534593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d96d13-cc55-4404-bea3-467585b10ff0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:58.609946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-88d96d13-cc55-4404-bea3-467585b10ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e331f2f4836b40e88cc087c3901509b5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:58.610589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-88d96d13-cc55-4404-bea3-467585b10ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e331f2f4836b40e88cc087c3901509b5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:58.630656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-88d96d13-cc55-4404-bea3-467585b10ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e331f2f4836b40e88cc087c3901509b5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:58.656194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-88d96d13-cc55-4404-bea3-467585b10ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e331f2f4836b40e88cc087c3901509b5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:58.657152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-88d96d13-cc55-4404-bea3-467585b10ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e331f2f4836b40e88cc087c3901509b5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:58.672687 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:58.693989 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1174/2309] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:58 2022] DELETE /identity/v3/users/e331f2f4836b40e88cc087c3901509b5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:59.085730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a820402-0573-4895-847c-5a07c9597b27 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:59.086511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a820402-0573-4895-847c-5a07c9597b27 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:59.088874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a820402-0573-4895-847c-5a07c9597b27 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:59.091043 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1136/2310] 10.222.0.39 () {54 vars in 921 bytes} [Sun Oct 16 01:02:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:02:59.108903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1abc5-abe7-4aac-b6cd-a26a9935380d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:59.109934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1abc5-abe7-4aac-b6cd-a26a9935380d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:59.110368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1abc5-abe7-4aac-b6cd-a26a9935380d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:59.138937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-34a1abc5-abe7-4aac-b6cd-a26a9935380d None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:59.140517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-34a1abc5-abe7-4aac-b6cd-a26a9935380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:59.226086 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1175/2311] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:59.263510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a820402-0573-4895-847c-5a07c9597b27 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:59.265429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a820402-0573-4895-847c-5a07c9597b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:59.284015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a820402-0573-4895-847c-5a07c9597b27 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:59.292708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7ea2a-24e1-45a3-8d11-ba64aa57e8ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:59.294286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7ea2a-24e1-45a3-8d11-ba64aa57e8ef service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:59.294680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7ea2a-24e1-45a3-8d11-ba64aa57e8ef service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:59.295118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7ea2a-24e1-45a3-8d11-ba64aa57e8ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:59.304817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1abc5-abe7-4aac-b6cd-a26a9935380d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:59.305446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7ea2a-24e1-45a3-8d11-ba64aa57e8ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:59.306335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-34a1abc5-abe7-4aac-b6cd-a26a9935380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:59.307308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7ea2a-24e1-45a3-8d11-ba64aa57e8ef service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:59.320373 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1137/2312] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:59.390018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1abc5-abe7-4aac-b6cd-a26a9935380d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:59.396430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0745cc-95cc-4fe0-91d9-d97feac7fead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:59.397485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0745cc-95cc-4fe0-91d9-d97feac7fead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:59.397485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0745cc-95cc-4fe0-91d9-d97feac7fead admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:59.397686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0745cc-95cc-4fe0-91d9-d97feac7fead admin admin] PATH_INFO: `/v3/users/37a61a57ad4448eba9c1bd8762d3a149` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:59.398767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0745cc-95cc-4fe0-91d9-d97feac7fead admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a61a57ad4448eba9c1bd8762d3a149)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:59.401039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0745cc-95cc-4fe0-91d9-d97feac7fead admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:59.468413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b0745cc-95cc-4fe0-91d9-d97feac7fead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a61a57ad4448eba9c1bd8762d3a149'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:59.469241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b0745cc-95cc-4fe0-91d9-d97feac7fead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a61a57ad4448eba9c1bd8762d3a149'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:59.494099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b0745cc-95cc-4fe0-91d9-d97feac7fead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a61a57ad4448eba9c1bd8762d3a149'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:59.506113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b0745cc-95cc-4fe0-91d9-d97feac7fead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a61a57ad4448eba9c1bd8762d3a149'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:59.507578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b0745cc-95cc-4fe0-91d9-d97feac7fead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a61a57ad4448eba9c1bd8762d3a149'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:59.526819 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1176/2313] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:59 2022] DELETE /identity/v3/users/37a61a57ad4448eba9c1bd8762d3a149 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:59.736976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7ea2a-24e1-45a3-8d11-ba64aa57e8ef service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:59.738734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-65f7ea2a-24e1-45a3-8d11-ba64aa57e8ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:59.765497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14500a1-8b3e-49d8-b6df-1c348780984c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:59.765782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14500a1-8b3e-49d8-b6df-1c348780984c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:59.766056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14500a1-8b3e-49d8-b6df-1c348780984c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:59.771328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7ea2a-24e1-45a3-8d11-ba64aa57e8ef service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:59.808070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c14500a1-8b3e-49d8-b6df-1c348780984c None None] MFA Rules not processed for user `f3b14e05c41648159d8ed97719c68862`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:59.809736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c14500a1-8b3e-49d8-b6df-1c348780984c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:59.816064 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:59.835431 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:59.851328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a808cc-7ce4-4c81-af2b-5080915bbaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:59.852224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a808cc-7ce4-4c81-af2b-5080915bbaa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:59.852582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a808cc-7ce4-4c81-af2b-5080915bbaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:59.854529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a808cc-7ce4-4c81-af2b-5080915bbaa1 admin admin] PATH_INFO: `/v3/projects/f9489ece0e6147529712d7533b908134` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:59.856939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a808cc-7ce4-4c81-af2b-5080915bbaa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9489ece0e6147529712d7533b908134)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:59.859751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a808cc-7ce4-4c81-af2b-5080915bbaa1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:59.896654 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1177/2314] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:59.897683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14500a1-8b3e-49d8-b6df-1c348780984c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:59.899049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c14500a1-8b3e-49d8-b6df-1c348780984c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:59.931048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14500a1-8b3e-49d8-b6df-1c348780984c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:59.949836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-08a808cc-7ce4-4c81-af2b-5080915bbaa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9489ece0e6147529712d7533b908134', 'request_id': 'req-08a808cc-7ce4-4c81-af2b-5080915bbaa1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:59.961331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-08a808cc-7ce4-4c81-af2b-5080915bbaa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9489ece0e6147529712d7533b908134', 'request_id': 'req-08a808cc-7ce4-4c81-af2b-5080915bbaa1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:59.972848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-08a808cc-7ce4-4c81-af2b-5080915bbaa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9489ece0e6147529712d7533b908134', 'request_id': 'req-08a808cc-7ce4-4c81-af2b-5080915bbaa1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:59.986892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-08a808cc-7ce4-4c81-af2b-5080915bbaa1 admin admin] The token cache is being invalidate because project f9489ece0e6147529712d7533b908134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:59.986892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-08a808cc-7ce4-4c81-af2b-5080915bbaa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:59.987197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-08a808cc-7ce4-4c81-af2b-5080915bbaa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:59.992490 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1138/2315] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:59 2022] DELETE /identity/v3/projects/f9489ece0e6147529712d7533b908134 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:59.994526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d441-295e-4a6d-a28c-5876652415c0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:59.994526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d441-295e-4a6d-a28c-5876652415c0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:59.994837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d441-295e-4a6d-a28c-5876652415c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.017109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168295b-5e4c-49d6-8168-dd1f5242bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.018392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168295b-5e4c-49d6-8168-dd1f5242bdf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.018705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168295b-5e4c-49d6-8168-dd1f5242bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.018950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168295b-5e4c-49d6-8168-dd1f5242bdf8 admin admin] PATH_INFO: `/v3/projects/8b4ef535b0684c0180329169a5765107` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.019789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d237d441-295e-4a6d-a28c-5876652415c0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:00.020237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168295b-5e4c-49d6-8168-dd1f5242bdf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b4ef535b0684c0180329169a5765107)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.021939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d237d441-295e-4a6d-a28c-5876652415c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:00.022302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168295b-5e4c-49d6-8168-dd1f5242bdf8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.037843 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1139/2316] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:00.039352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406b8bb-ed12-4193-8749-92f636b4a45c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.039757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406b8bb-ed12-4193-8749-92f636b4a45c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.040133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406b8bb-ed12-4193-8749-92f636b4a45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.060758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a406b8bb-ed12-4193-8749-92f636b4a45c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:00.062112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a406b8bb-ed12-4193-8749-92f636b4a45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:00.079268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7168295b-5e4c-49d6-8168-dd1f5242bdf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b4ef535b0684c0180329169a5765107', 'request_id': 'req-7168295b-5e4c-49d6-8168-dd1f5242bdf8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:00.086985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7168295b-5e4c-49d6-8168-dd1f5242bdf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b4ef535b0684c0180329169a5765107', 'request_id': 'req-7168295b-5e4c-49d6-8168-dd1f5242bdf8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:00.095891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7168295b-5e4c-49d6-8168-dd1f5242bdf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b4ef535b0684c0180329169a5765107', 'request_id': 'req-7168295b-5e4c-49d6-8168-dd1f5242bdf8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:00.112220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7168295b-5e4c-49d6-8168-dd1f5242bdf8 admin admin] The token cache is being invalidate because project 8b4ef535b0684c0180329169a5765107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:00.112898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7168295b-5e4c-49d6-8168-dd1f5242bdf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:00.113493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7168295b-5e4c-49d6-8168-dd1f5242bdf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:00.115336 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1178/2317] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:59 2022] DELETE /identity/v3/projects/8b4ef535b0684c0180329169a5765107 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:00.120266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e092b-c2f0-4e60-97cd-43584d748804 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.120914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e092b-c2f0-4e60-97cd-43584d748804 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.121299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e092b-c2f0-4e60-97cd-43584d748804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.134756 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1140/2318] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:00.135857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406b8bb-ed12-4193-8749-92f636b4a45c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.145143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3f6e092b-c2f0-4e60-97cd-43584d748804 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:00.145824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406b8bb-ed12-4193-8749-92f636b4a45c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.146544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3f6e092b-c2f0-4e60-97cd-43584d748804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:00.151078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb117fa3-2a5e-4c29-b39e-d0d05a429fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.151926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb117fa3-2a5e-4c29-b39e-d0d05a429fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.152356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb117fa3-2a5e-4c29-b39e-d0d05a429fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.152776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb117fa3-2a5e-4c29-b39e-d0d05a429fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.153676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb117fa3-2a5e-4c29-b39e-d0d05a429fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:03:00.154246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb117fa3-2a5e-4c29-b39e-d0d05a429fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.155081 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1179/2319] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:03:00.156332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb117fa3-2a5e-4c29-b39e-d0d05a429fbd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.162825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776ee45-7db2-4be3-88e6-bb8b285c02b6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.163146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776ee45-7db2-4be3-88e6-bb8b285c02b6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.163421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776ee45-7db2-4be3-88e6-bb8b285c02b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.170178 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1141/2320] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:03:00.175221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb117fa3-2a5e-4c29-b39e-d0d05a429fbd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.185758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb117fa3-2a5e-4c29-b39e-d0d05a429fbd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.188474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e776ee45-7db2-4be3-88e6-bb8b285c02b6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:00.190038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e776ee45-7db2-4be3-88e6-bb8b285c02b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:00.191639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd46755-452f-4141-802b-148eb56c8471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.192291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd46755-452f-4141-802b-148eb56c8471 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.192619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd46755-452f-4141-802b-148eb56c8471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.192835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd46755-452f-4141-802b-148eb56c8471 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.193470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd46755-452f-4141-802b-148eb56c8471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.195590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd46755-452f-4141-802b-148eb56c8471 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.199427 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1180/2321] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:03:00.203259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776ee45-7db2-4be3-88e6-bb8b285c02b6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.213530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776ee45-7db2-4be3-88e6-bb8b285c02b6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.220045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68e339-bb0a-43e0-9620-f30c90cc113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.221543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68e339-bb0a-43e0-9620-f30c90cc113a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.221936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68e339-bb0a-43e0-9620-f30c90cc113a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.222309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68e339-bb0a-43e0-9620-f30c90cc113a admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.223084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68e339-bb0a-43e0-9620-f30c90cc113a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:03:00.223461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68e339-bb0a-43e0-9620-f30c90cc113a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.225188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68e339-bb0a-43e0-9620-f30c90cc113a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.231094 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1142/2322] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:00 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:03:00.235442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd46755-452f-4141-802b-148eb56c8471 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.243610 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1181/2323] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:03:00.244667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68e339-bb0a-43e0-9620-f30c90cc113a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.257149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68e339-bb0a-43e0-9620-f30c90cc113a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.275142 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:00.290880 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:00.320515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd46755-452f-4141-802b-148eb56c8471 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.325378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194358cf-6b81-46eb-a49b-a6796aa0e653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.325966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194358cf-6b81-46eb-a49b-a6796aa0e653 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.326248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194358cf-6b81-46eb-a49b-a6796aa0e653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.326522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194358cf-6b81-46eb-a49b-a6796aa0e653 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.327193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194358cf-6b81-46eb-a49b-a6796aa0e653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.329121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194358cf-6b81-46eb-a49b-a6796aa0e653 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.335656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4daa6-c788-4160-811e-48d19538526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.336568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4daa6-c788-4160-811e-48d19538526d admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.337057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4daa6-c788-4160-811e-48d19538526d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.337537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4daa6-c788-4160-811e-48d19538526d admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.338487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4daa6-c788-4160-811e-48d19538526d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.340692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4daa6-c788-4160-811e-48d19538526d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.360764 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1143/2324] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:00 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:00.362321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194358cf-6b81-46eb-a49b-a6796aa0e653 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.374052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194358cf-6b81-46eb-a49b-a6796aa0e653 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.378418 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1182/2325] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:00 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:03:00.382542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4daa6-c788-4160-811e-48d19538526d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.388208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69696f33-eb0c-43f4-9a62-32c40753df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.388993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69696f33-eb0c-43f4-9a62-32c40753df1d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.389375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69696f33-eb0c-43f4-9a62-32c40753df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.390113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69696f33-eb0c-43f4-9a62-32c40753df1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.391915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69696f33-eb0c-43f4-9a62-32c40753df1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.395899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69696f33-eb0c-43f4-9a62-32c40753df1d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.409818 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1144/2326] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:00.410907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69696f33-eb0c-43f4-9a62-32c40753df1d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.422797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69696f33-eb0c-43f4-9a62-32c40753df1d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.459528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4daa6-c788-4160-811e-48d19538526d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.472034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328ca67-2174-4c4c-a9f5-14015d68c5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.473657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ca67-2174-4c4c-a9f5-14015d68c5df admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.474092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ca67-2174-4c4c-a9f5-14015d68c5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.474549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ca67-2174-4c4c-a9f5-14015d68c5df admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.475524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ca67-2174-4c4c-a9f5-14015d68c5df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.477749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ca67-2174-4c4c-a9f5-14015d68c5df admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.493408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6766-cdec-497d-843b-da54f05c0151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.494085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6766-cdec-497d-843b-da54f05c0151 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.494389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6766-cdec-497d-843b-da54f05c0151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.494972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6766-cdec-497d-843b-da54f05c0151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.495690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e6766-cdec-497d-843b-da54f05c0151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.497365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e6766-cdec-497d-843b-da54f05c0151 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.513460 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1183/2327] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:00 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:03:00.515857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328ca67-2174-4c4c-a9f5-14015d68c5df admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.522081 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1145/2328] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:00.525942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6766-cdec-497d-843b-da54f05c0151 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.534667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328ca67-2174-4c4c-a9f5-14015d68c5df admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.548158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6766-cdec-497d-843b-da54f05c0151 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.548347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8568490-55a8-45b2-8904-da9b927b60d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.552007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8568490-55a8-45b2-8904-da9b927b60d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.552337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8568490-55a8-45b2-8904-da9b927b60d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.553899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8568490-55a8-45b2-8904-da9b927b60d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.554801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8568490-55a8-45b2-8904-da9b927b60d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.557874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8568490-55a8-45b2-8904-da9b927b60d8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.565243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c26946-3721-4ad8-ae8b-599faa3bc9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.566098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c26946-3721-4ad8-ae8b-599faa3bc9da admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.566498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c26946-3721-4ad8-ae8b-599faa3bc9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.567243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c26946-3721-4ad8-ae8b-599faa3bc9da admin admin] PATH_INFO: `/v3/projects/08e90595833b4cc6ad7f572f2cf5ae49/users/b9cd45d8bcda4389876b83b231c021a2/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.575084 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1184/2329] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:00.580526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8568490-55a8-45b2-8904-da9b927b60d8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.590191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c26946-3721-4ad8-ae8b-599faa3bc9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e90595833b4cc6ad7f572f2cf5ae49, user_id=b9cd45d8bcda4389876b83b231c021a2, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.593250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c26946-3721-4ad8-ae8b-599faa3bc9da admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.601487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8568490-55a8-45b2-8904-da9b927b60d8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.614976 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1146/2330] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:00 2022] PUT /identity/v3/projects/08e90595833b4cc6ad7f572f2cf5ae49/users/b9cd45d8bcda4389876b83b231c021a2/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:00.628187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a49e7-b41d-4adb-a226-27c87c33da3f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.628450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a49e7-b41d-4adb-a226-27c87c33da3f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.628731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a49e7-b41d-4adb-a226-27c87c33da3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.682554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d41a49e7-b41d-4adb-a226-27c87c33da3f None None] MFA Rules not processed for user `b9cd45d8bcda4389876b83b231c021a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:00.684465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d41a49e7-b41d-4adb-a226-27c87c33da3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:00.749333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46d6d5-cbd2-40aa-bf9a-3ecd46b411f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.750158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46d6d5-cbd2-40aa-bf9a-3ecd46b411f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.751769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46d6d5-cbd2-40aa-bf9a-3ecd46b411f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.752061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46d6d5-cbd2-40aa-bf9a-3ecd46b411f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.752721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46d6d5-cbd2-40aa-bf9a-3ecd46b411f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.766941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46d6d5-cbd2-40aa-bf9a-3ecd46b411f5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.769179 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1185/2331] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:00.779948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46d6d5-cbd2-40aa-bf9a-3ecd46b411f5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.780056 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1147/2332] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:00.785616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a49e7-b41d-4adb-a226-27c87c33da3f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.800174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a49e7-b41d-4adb-a226-27c87c33da3f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.803263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46d6d5-cbd2-40aa-bf9a-3ecd46b411f5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:00.806233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ca9bf-c158-4cd6-9af0-12a16f1ca229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.806838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ca9bf-c158-4cd6-9af0-12a16f1ca229 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.807160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ca9bf-c158-4cd6-9af0-12a16f1ca229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.821753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ca9bf-c158-4cd6-9af0-12a16f1ca229 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.821753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ca9bf-c158-4cd6-9af0-12a16f1ca229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.821753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ca9bf-c158-4cd6-9af0-12a16f1ca229 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.822111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0bdb0-649a-4b1d-8af5-446dd271e2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:00.822111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0bdb0-649a-4b1d-8af5-446dd271e2de admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.822650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0bdb0-649a-4b1d-8af5-446dd271e2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.823019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0bdb0-649a-4b1d-8af5-446dd271e2de admin admin] PATH_INFO: `/v3/projects/b214da9f32b843de96003cb6169f0a5c/users/283dbcfc68244d4b86de327091147337/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.830772 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:00.845033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0bdb0-649a-4b1d-8af5-446dd271e2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b214da9f32b843de96003cb6169f0a5c, user_id=283dbcfc68244d4b86de327091147337, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:00.846739 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1148/2333] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:00 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:03:00.849467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0bdb0-649a-4b1d-8af5-446dd271e2de admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:00.851057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ca9bf-c158-4cd6-9af0-12a16f1ca229 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:00.852364 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:00.868192 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1186/2334] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:00 2022] PUT /identity/v3/projects/b214da9f32b843de96003cb6169f0a5c/users/283dbcfc68244d4b86de327091147337/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:03:00.879944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93972c-b60c-4b46-bb39-fdf951396f64 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:00.880163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93972c-b60c-4b46-bb39-fdf951396f64 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:00.880704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93972c-b60c-4b46-bb39-fdf951396f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:00.918735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8f93972c-b60c-4b46-bb39-fdf951396f64 None None] MFA Rules not processed for user `283dbcfc68244d4b86de327091147337`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:00.920273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8f93972c-b60c-4b46-bb39-fdf951396f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:00.944452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ca9bf-c158-4cd6-9af0-12a16f1ca229 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:01.016664 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1187/2335] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:03:01.029636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93972c-b60c-4b46-bb39-fdf951396f64 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:01.032997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8f93972c-b60c-4b46-bb39-fdf951396f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:01.042105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e9b11-9dad-4464-ac7e-18c89cc7ca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:01.042718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e9b11-9dad-4464-ac7e-18c89cc7ca7c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:01.043022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e9b11-9dad-4464-ac7e-18c89cc7ca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:01.043293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e9b11-9dad-4464-ac7e-18c89cc7ca7c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:01.043923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e9b11-9dad-4464-ac7e-18c89cc7ca7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:01.046184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e9b11-9dad-4464-ac7e-18c89cc7ca7c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:01.078955 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1149/2336] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:00 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:01.081379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e9b11-9dad-4464-ac7e-18c89cc7ca7c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:01.092912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e9b11-9dad-4464-ac7e-18c89cc7ca7c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:01.098412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5408b5-e354-4c2c-991d-c69ef9cb9df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:01.099128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5408b5-e354-4c2c-991d-c69ef9cb9df7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:01.099405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5408b5-e354-4c2c-991d-c69ef9cb9df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:01.099808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5408b5-e354-4c2c-991d-c69ef9cb9df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:01.100307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5408b5-e354-4c2c-991d-c69ef9cb9df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:01.102060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5408b5-e354-4c2c-991d-c69ef9cb9df7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:01.117422 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1150/2337] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:01.118636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5408b5-e354-4c2c-991d-c69ef9cb9df7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:01.124167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93972c-b60c-4b46-bb39-fdf951396f64 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:01.133346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5408b5-e354-4c2c-991d-c69ef9cb9df7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:01.133591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c7dcc-6ab6-4986-8f73-7e50e08711ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:01.135014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c7dcc-6ab6-4986-8f73-7e50e08711ea service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:01.135430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c7dcc-6ab6-4986-8f73-7e50e08711ea service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:01.135839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c7dcc-6ab6-4986-8f73-7e50e08711ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:01.147693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c7dcc-6ab6-4986-8f73-7e50e08711ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:01.149045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c4c43-e16c-4ec4-8a2f-e9cc1d8dda9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:01.149987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c4c43-e16c-4ec4-8a2f-e9cc1d8dda9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:01.150190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c7dcc-6ab6-4986-8f73-7e50e08711ea service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:01.150568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c4c43-e16c-4ec4-8a2f-e9cc1d8dda9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:01.151025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c4c43-e16c-4ec4-8a2f-e9cc1d8dda9f admin admin] PATH_INFO: `/v3/projects/1f46bef0a9694b169907d15269643c02/users/6d9a86f4719241d3b9e0b8c7d2e27559/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:01.162293 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1188/2338] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:03:01.170467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c4c43-e16c-4ec4-8a2f-e9cc1d8dda9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f46bef0a9694b169907d15269643c02, user_id=6d9a86f4719241d3b9e0b8c7d2e27559, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:01.173167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c4c43-e16c-4ec4-8a2f-e9cc1d8dda9f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:01.188560 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1151/2339] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:01 2022] PUT /identity/v3/projects/1f46bef0a9694b169907d15269643c02/users/6d9a86f4719241d3b9e0b8c7d2e27559/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:01.193623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c7dcc-6ab6-4986-8f73-7e50e08711ea service glance] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:01.209025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c7dcc-6ab6-4986-8f73-7e50e08711ea service glance] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:01.274697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10eddb-c2ba-4d86-983f-f84d0e8f3a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:01.275354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10eddb-c2ba-4d86-983f-f84d0e8f3a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:01.275608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10eddb-c2ba-4d86-983f-f84d0e8f3a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:01.275881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10eddb-c2ba-4d86-983f-f84d0e8f3a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:01.276560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10eddb-c2ba-4d86-983f-f84d0e8f3a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:01.278566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10eddb-c2ba-4d86-983f-f84d0e8f3a8b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:01.290813 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1189/2340] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:01.295062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c4c43-e16c-4ec4-8a2f-e9cc1d8dda9f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:01.305383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c4c43-e16c-4ec4-8a2f-e9cc1d8dda9f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:01.310482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8469d-4249-4b2c-a1ee-d9556dbf17b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:01.311316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8469d-4249-4b2c-a1ee-d9556dbf17b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:01.311697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8469d-4249-4b2c-a1ee-d9556dbf17b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:01.312003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8469d-4249-4b2c-a1ee-d9556dbf17b7 admin admin] PATH_INFO: `/v3/projects/1f46bef0a9694b169907d15269643c02/users/6d9a86f4719241d3b9e0b8c7d2e27559/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:01.314765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8469d-4249-4b2c-a1ee-d9556dbf17b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f46bef0a9694b169907d15269643c02, user_id=6d9a86f4719241d3b9e0b8c7d2e27559, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:01.317461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8469d-4249-4b2c-a1ee-d9556dbf17b7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:01.327960 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1152/2341] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:01 2022] PUT /identity/v3/projects/1f46bef0a9694b169907d15269643c02/users/6d9a86f4719241d3b9e0b8c7d2e27559/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:03:01.339050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3009a5-21c0-4fb6-8fc5-0252ffe289ea None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:01.339335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3009a5-21c0-4fb6-8fc5-0252ffe289ea None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:01.339633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3009a5-21c0-4fb6-8fc5-0252ffe289ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:01.367606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8b3009a5-21c0-4fb6-8fc5-0252ffe289ea None None] MFA Rules not processed for user `6d9a86f4719241d3b9e0b8c7d2e27559`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:01.368844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8b3009a5-21c0-4fb6-8fc5-0252ffe289ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:01.379021 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:01.445278 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1190/2342] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:01.457442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8469d-4249-4b2c-a1ee-d9556dbf17b7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:01.459169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-39d8469d-4249-4b2c-a1ee-d9556dbf17b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:01.510381 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:01.546602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8469d-4249-4b2c-a1ee-d9556dbf17b7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:01.558248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e27bf-5608-4821-9a46-e06efd659b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:01.559134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e27bf-5608-4821-9a46-e06efd659b38 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:01.559417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e27bf-5608-4821-9a46-e06efd659b38 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:01.559742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e27bf-5608-4821-9a46-e06efd659b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:01.571710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e27bf-5608-4821-9a46-e06efd659b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:01.573514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e27bf-5608-4821-9a46-e06efd659b38 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:01.590106 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1153/2343] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:01.991930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3009a5-21c0-4fb6-8fc5-0252ffe289ea None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:02.054890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3009a5-21c0-4fb6-8fc5-0252ffe289ea None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:02.060180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:02.060814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:02.061092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:02.061357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] PATH_INFO: `/v3/users/b9cd45d8bcda4389876b83b231c021a2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:02.062461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9cd45d8bcda4389876b83b231c021a2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:02.065111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:02.115742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9cd45d8bcda4389876b83b231c021a2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:02.116410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9cd45d8bcda4389876b83b231c021a2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:02.129805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9cd45d8bcda4389876b83b231c021a2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:02.138386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9cd45d8bcda4389876b83b231c021a2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:02.139313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9cd45d8bcda4389876b83b231c021a2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:02.155797 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1191/2344] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:01 2022] DELETE /identity/v3/users/b9cd45d8bcda4389876b83b231c021a2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:02.161064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c978b9-a6b4-4ec4-8544-d84fc337fe8f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:02.161309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c978b9-a6b4-4ec4-8544-d84fc337fe8f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:02.161535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c978b9-a6b4-4ec4-8544-d84fc337fe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:02.197178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-05c978b9-a6b4-4ec4-8544-d84fc337fe8f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:02.198646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-05c978b9-a6b4-4ec4-8544-d84fc337fe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:02.329178 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1154/2345] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:02.344997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:02.350441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:02.409192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f246a5-fd53-46fa-bc22-0ff5d02f2f0e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:02.409474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f246a5-fd53-46fa-bc22-0ff5d02f2f0e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:02.409957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f246a5-fd53-46fa-bc22-0ff5d02f2f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:02.419466 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:02.435590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-89f246a5-fd53-46fa-bc22-0ff5d02f2f0e None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:02.437584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-89f246a5-fd53-46fa-bc22-0ff5d02f2f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:02.496956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38333b25-7748-4158-8ab5-5eac34229627 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:02.504834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f977c9-d987-4753-aaa7-3c59f089000b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:02.505568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f977c9-d987-4753-aaa7-3c59f089000b service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:02.505919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f977c9-d987-4753-aaa7-3c59f089000b service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:02.506264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f977c9-d987-4753-aaa7-3c59f089000b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:02.527579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f977c9-d987-4753-aaa7-3c59f089000b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:02.529603 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1155/2346] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:03:02.530153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f977c9-d987-4753-aaa7-3c59f089000b service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:02.566711 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1192/2347] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:02.612450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f246a5-fd53-46fa-bc22-0ff5d02f2f0e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:02.614141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-89f246a5-fd53-46fa-bc22-0ff5d02f2f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:02.729538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f246a5-fd53-46fa-bc22-0ff5d02f2f0e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:02.735054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ae0dc-27e3-47e3-9ee1-ff9893420d44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:02.735734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ae0dc-27e3-47e3-9ee1-ff9893420d44 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:02.736108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ae0dc-27e3-47e3-9ee1-ff9893420d44 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:02.737049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ae0dc-27e3-47e3-9ee1-ff9893420d44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:02.746309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ae0dc-27e3-47e3-9ee1-ff9893420d44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:02.748046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ae0dc-27e3-47e3-9ee1-ff9893420d44 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:02.757578 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1156/2348] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:03:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:03.493192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f977c9-d987-4753-aaa7-3c59f089000b service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:03.494754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-28f977c9-d987-4753-aaa7-3c59f089000b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:03.515117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f977c9-d987-4753-aaa7-3c59f089000b service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:03.523230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517b639-3b4e-414c-861a-db0209d2fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:03.525582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517b639-3b4e-414c-861a-db0209d2fcc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:03.526120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517b639-3b4e-414c-861a-db0209d2fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:03.526887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517b639-3b4e-414c-861a-db0209d2fcc9 admin admin] PATH_INFO: `/v3/projects/08e90595833b4cc6ad7f572f2cf5ae49` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:03.529032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517b639-3b4e-414c-861a-db0209d2fcc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e90595833b4cc6ad7f572f2cf5ae49)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:03.531695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517b639-3b4e-414c-861a-db0209d2fcc9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:03.631709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1517b639-3b4e-414c-861a-db0209d2fcc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e90595833b4cc6ad7f572f2cf5ae49', 'request_id': 'req-1517b639-3b4e-414c-861a-db0209d2fcc9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:03.641700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1517b639-3b4e-414c-861a-db0209d2fcc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e90595833b4cc6ad7f572f2cf5ae49', 'request_id': 'req-1517b639-3b4e-414c-861a-db0209d2fcc9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:03.654312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1517b639-3b4e-414c-861a-db0209d2fcc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e90595833b4cc6ad7f572f2cf5ae49', 'request_id': 'req-1517b639-3b4e-414c-861a-db0209d2fcc9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:03.676874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1517b639-3b4e-414c-861a-db0209d2fcc9 admin admin] The token cache is being invalidate because project 08e90595833b4cc6ad7f572f2cf5ae49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:03.678601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1517b639-3b4e-414c-861a-db0209d2fcc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:03.679991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1517b639-3b4e-414c-861a-db0209d2fcc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:03.682018 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1193/2349] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:03 2022] DELETE /identity/v3/projects/08e90595833b4cc6ad7f572f2cf5ae49 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:03.685901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ae0dc-27e3-47e3-9ee1-ff9893420d44 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:03.695980 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:03.701674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ae0dc-27e3-47e3-9ee1-ff9893420d44 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:03.768227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:03.768925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:03.769203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:03.769474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] PATH_INFO: `/v3/users/6d9a86f4719241d3b9e0b8c7d2e27559` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:03.771259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9a86f4719241d3b9e0b8c7d2e27559)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:03.773835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:03.849793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9a86f4719241d3b9e0b8c7d2e27559'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:03.851347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9a86f4719241d3b9e0b8c7d2e27559'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:03.881348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9a86f4719241d3b9e0b8c7d2e27559'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:03.892730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9a86f4719241d3b9e0b8c7d2e27559'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:03.894632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9a86f4719241d3b9e0b8c7d2e27559'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:03.919769 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1157/2350] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:03 2022] DELETE /identity/v3/users/6d9a86f4719241d3b9e0b8c7d2e27559 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:03:04.441542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fe9bd-793b-4295-aadf-18e51d5b0525 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:04.441832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fe9bd-793b-4295-aadf-18e51d5b0525 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:04.442110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fe9bd-793b-4295-aadf-18e51d5b0525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:04.468460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-905fe9bd-793b-4295-aadf-18e51d5b0525 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:04.469788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-905fe9bd-793b-4295-aadf-18e51d5b0525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:04.566819 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1194/2351] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:04.586207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:04.588848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:04.594442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fe9bd-793b-4295-aadf-18e51d5b0525 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:04.596306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-905fe9bd-793b-4295-aadf-18e51d5b0525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:04.716386 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:04.723330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fe9bd-793b-4295-aadf-18e51d5b0525 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:04.731837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447edd1-c216-462e-8ac8-e4a22869899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:04.733963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447edd1-c216-462e-8ac8-e4a22869899b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:04.734457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447edd1-c216-462e-8ac8-e4a22869899b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:04.735041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447edd1-c216-462e-8ac8-e4a22869899b admin admin] PATH_INFO: `/v3/projects/1f46bef0a9694b169907d15269643c02` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:04.737459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447edd1-c216-462e-8ac8-e4a22869899b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f46bef0a9694b169907d15269643c02)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:04.740261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447edd1-c216-462e-8ac8-e4a22869899b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:04.795428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29b826-458f-42fc-a6c9-680e0ead3f21 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:04.846854 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:04.850780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d447edd1-c216-462e-8ac8-e4a22869899b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f46bef0a9694b169907d15269643c02', 'request_id': 'req-d447edd1-c216-462e-8ac8-e4a22869899b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:04.868998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d447edd1-c216-462e-8ac8-e4a22869899b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f46bef0a9694b169907d15269643c02', 'request_id': 'req-d447edd1-c216-462e-8ac8-e4a22869899b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:04.886284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d447edd1-c216-462e-8ac8-e4a22869899b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f46bef0a9694b169907d15269643c02', 'request_id': 'req-d447edd1-c216-462e-8ac8-e4a22869899b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:04.922286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d447edd1-c216-462e-8ac8-e4a22869899b admin admin] The token cache is being invalidate because project 1f46bef0a9694b169907d15269643c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:04.924876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d447edd1-c216-462e-8ac8-e4a22869899b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:04.929220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d447edd1-c216-462e-8ac8-e4a22869899b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:04.937689 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1195/2352] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:04 2022] DELETE /identity/v3/projects/1f46bef0a9694b169907d15269643c02 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:04.943196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed919f12-a5a2-4c61-a3b5-fad29abf30b8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:04.943716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e44121-1cb5-4f35-995b-a1bd7a6760ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:04.944115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed919f12-a5a2-4c61-a3b5-fad29abf30b8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:04.944479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e44121-1cb5-4f35-995b-a1bd7a6760ea service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:04.944760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e44121-1cb5-4f35-995b-a1bd7a6760ea service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:04.945069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed919f12-a5a2-4c61-a3b5-fad29abf30b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:04.945186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e44121-1cb5-4f35-995b-a1bd7a6760ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:04.948041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b8e44121-1cb5-4f35-995b-a1bd7a6760ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:05.004091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ed919f12-a5a2-4c61-a3b5-fad29abf30b8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:05.005772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ed919f12-a5a2-4c61-a3b5-fad29abf30b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:05.067058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e44121-1cb5-4f35-995b-a1bd7a6760ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:05.068729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e44121-1cb5-4f35-995b-a1bd7a6760ea service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:05.094536 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1158/2353] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:03:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:05.151345 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1196/2354] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:05.160274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cea7b-a5cf-493a-ab28-0f3019f07077 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:05.160816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cea7b-a5cf-493a-ab28-0f3019f07077 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:05.161681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cea7b-a5cf-493a-ab28-0f3019f07077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:05.198351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-434cea7b-a5cf-493a-ab28-0f3019f07077 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:05.201117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-434cea7b-a5cf-493a-ab28-0f3019f07077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:05.218659 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1159/2355] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:05.219474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed919f12-a5a2-4c61-a3b5-fad29abf30b8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:05.235452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed919f12-a5a2-4c61-a3b5-fad29abf30b8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:05.242472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd995d62-cf9f-4cda-9a51-213c411d9b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:05.243038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd995d62-cf9f-4cda-9a51-213c411d9b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:05.243395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd995d62-cf9f-4cda-9a51-213c411d9b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:05.243615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd995d62-cf9f-4cda-9a51-213c411d9b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:05.244509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd995d62-cf9f-4cda-9a51-213c411d9b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:03:05.244783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd995d62-cf9f-4cda-9a51-213c411d9b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:05.246481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd995d62-cf9f-4cda-9a51-213c411d9b4c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:05.267300 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1197/2356] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:03:05.282793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cea7b-a5cf-493a-ab28-0f3019f07077 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:05.302893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cea7b-a5cf-493a-ab28-0f3019f07077 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:05.316264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba519bc-447a-4224-84ae-8ab9eec4f904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:05.317572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba519bc-447a-4224-84ae-8ab9eec4f904 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:05.317793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba519bc-447a-4224-84ae-8ab9eec4f904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:05.318066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba519bc-447a-4224-84ae-8ab9eec4f904 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:05.319248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba519bc-447a-4224-84ae-8ab9eec4f904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:05.322240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba519bc-447a-4224-84ae-8ab9eec4f904 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:05.395787 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1160/2357] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:05 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:05.399313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd995d62-cf9f-4cda-9a51-213c411d9b4c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:05.410011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd995d62-cf9f-4cda-9a51-213c411d9b4c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:05.468461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3dc6b-1716-467e-89fb-cce2fbf58727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:05.469429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3dc6b-1716-467e-89fb-cce2fbf58727 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:05.469898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3dc6b-1716-467e-89fb-cce2fbf58727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:05.470888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3dc6b-1716-467e-89fb-cce2fbf58727 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:05.472023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3dc6b-1716-467e-89fb-cce2fbf58727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:05.474105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3dc6b-1716-467e-89fb-cce2fbf58727 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:05.500478 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1198/2358] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:05 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:05.504737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba519bc-447a-4224-84ae-8ab9eec4f904 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:05.515025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba519bc-447a-4224-84ae-8ab9eec4f904 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:05.519838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b62f90-a9d9-4e48-a3df-13188ac472da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:05.520426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b62f90-a9d9-4e48-a3df-13188ac472da admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:05.520703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b62f90-a9d9-4e48-a3df-13188ac472da admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:05.520974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b62f90-a9d9-4e48-a3df-13188ac472da admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:05.521603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b62f90-a9d9-4e48-a3df-13188ac472da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:05.523216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b62f90-a9d9-4e48-a3df-13188ac472da admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:05.534341 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1161/2359] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:05.538415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3dc6b-1716-467e-89fb-cce2fbf58727 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:05.549599 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:05.551040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3dc6b-1716-467e-89fb-cce2fbf58727 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:05.557271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0bd5d-e47f-4391-9f9c-c0b66dae8992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:05.557881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0bd5d-e47f-4391-9f9c-c0b66dae8992 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:05.558157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0bd5d-e47f-4391-9f9c-c0b66dae8992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:05.558430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0bd5d-e47f-4391-9f9c-c0b66dae8992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:05.559102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0bd5d-e47f-4391-9f9c-c0b66dae8992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:05.560749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0bd5d-e47f-4391-9f9c-c0b66dae8992 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:05.578979 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1199/2360] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:05.580302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b62f90-a9d9-4e48-a3df-13188ac472da admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:05.591199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b62f90-a9d9-4e48-a3df-13188ac472da admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:05.596376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922f052-1e5e-4353-a323-c2d79e715b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:05.597014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f052-1e5e-4353-a323-c2d79e715b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:05.597295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f052-1e5e-4353-a323-c2d79e715b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:05.597664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f052-1e5e-4353-a323-c2d79e715b67 admin admin] PATH_INFO: `/v3/projects/9d880e3b13d14d38bbcec184286d2876/users/a69d5a92a2b1414b859e945011d59a6b/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:05.616090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922f052-1e5e-4353-a323-c2d79e715b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d880e3b13d14d38bbcec184286d2876, user_id=a69d5a92a2b1414b859e945011d59a6b, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:05.622832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922f052-1e5e-4353-a323-c2d79e715b67 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:05.656097 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1162/2361] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:05 2022] PUT /identity/v3/projects/9d880e3b13d14d38bbcec184286d2876/users/a69d5a92a2b1414b859e945011d59a6b/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:03:05.742397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053f8ac-6bfc-428e-8701-19155244693e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:05.742680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053f8ac-6bfc-428e-8701-19155244693e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:05.743044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053f8ac-6bfc-428e-8701-19155244693e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:05.776319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f053f8ac-6bfc-428e-8701-19155244693e None None] MFA Rules not processed for user `a69d5a92a2b1414b859e945011d59a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:05.777644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f053f8ac-6bfc-428e-8701-19155244693e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:05.870854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922f052-1e5e-4353-a323-c2d79e715b67 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:05.872852 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1200/2362] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:05.979324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922f052-1e5e-4353-a323-c2d79e715b67 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:05.985836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd06d73-9022-499d-9726-63a289fd98d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:05.987284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06d73-9022-499d-9726-63a289fd98d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:05.987739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06d73-9022-499d-9726-63a289fd98d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:05.988011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06d73-9022-499d-9726-63a289fd98d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:05.988952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd06d73-9022-499d-9726-63a289fd98d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:05.990533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd06d73-9022-499d-9726-63a289fd98d9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:06.000363 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:06.025960 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1163/2363] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:05 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:06.030076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053f8ac-6bfc-428e-8701-19155244693e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:06.043470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053f8ac-6bfc-428e-8701-19155244693e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:06.107508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fe629-ca1e-48e9-aca4-9d64f1b38999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:06.108116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fe629-ca1e-48e9-aca4-9d64f1b38999 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:06.108392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fe629-ca1e-48e9-aca4-9d64f1b38999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:06.108662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fe629-ca1e-48e9-aca4-9d64f1b38999 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:06.109301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fe629-ca1e-48e9-aca4-9d64f1b38999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:06.111270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fe629-ca1e-48e9-aca4-9d64f1b38999 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:06.133446 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1201/2364] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:06 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:06.137638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd06d73-9022-499d-9726-63a289fd98d9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:06.149041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd06d73-9022-499d-9726-63a289fd98d9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:06.153731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5237c-24ed-4cb7-b740-73bbbd78f933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:06.154343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5237c-24ed-4cb7-b740-73bbbd78f933 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:06.154619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5237c-24ed-4cb7-b740-73bbbd78f933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:06.154887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5237c-24ed-4cb7-b740-73bbbd78f933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:06.155566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5237c-24ed-4cb7-b740-73bbbd78f933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:06.157154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5237c-24ed-4cb7-b740-73bbbd78f933 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:06.168088 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1164/2365] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:03:06.172790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fe629-ca1e-48e9-aca4-9d64f1b38999 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:06.182585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fe629-ca1e-48e9-aca4-9d64f1b38999 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:06.187220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec84304-2aa7-4b11-8f33-6ea1b41ce9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:06.187857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec84304-2aa7-4b11-8f33-6ea1b41ce9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:06.188129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec84304-2aa7-4b11-8f33-6ea1b41ce9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:06.188397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec84304-2aa7-4b11-8f33-6ea1b41ce9c2 admin admin] PATH_INFO: `/v3/projects/6993e79d443b402fb08579ee325b465a/users/f045f6cfe16347bab4e7cad080ae4846/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:06.204540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec84304-2aa7-4b11-8f33-6ea1b41ce9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6993e79d443b402fb08579ee325b465a, user_id=f045f6cfe16347bab4e7cad080ae4846, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:06.207997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec84304-2aa7-4b11-8f33-6ea1b41ce9c2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:06.221528 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1202/2366] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:06 2022] PUT /identity/v3/projects/6993e79d443b402fb08579ee325b465a/users/f045f6cfe16347bab4e7cad080ae4846/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:06.226114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5237c-24ed-4cb7-b740-73bbbd78f933 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:06.236902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5237c-24ed-4cb7-b740-73bbbd78f933 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:06.296125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc55e88-6735-4e48-8213-1e37e060673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:06.296835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc55e88-6735-4e48-8213-1e37e060673c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:06.297252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc55e88-6735-4e48-8213-1e37e060673c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:06.297579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc55e88-6735-4e48-8213-1e37e060673c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:06.298203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc55e88-6735-4e48-8213-1e37e060673c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:06.300456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc55e88-6735-4e48-8213-1e37e060673c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:06.313873 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1165/2367] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:06.315914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec84304-2aa7-4b11-8f33-6ea1b41ce9c2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:06.332262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec84304-2aa7-4b11-8f33-6ea1b41ce9c2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:06.339859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3f628-f4c1-479d-aacc-5b116073d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:06.340622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3f628-f4c1-479d-aacc-5b116073d338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:06.340999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3f628-f4c1-479d-aacc-5b116073d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:06.341355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3f628-f4c1-479d-aacc-5b116073d338 admin admin] PATH_INFO: `/v3/projects/6993e79d443b402fb08579ee325b465a/users/f045f6cfe16347bab4e7cad080ae4846/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:06.343995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3f628-f4c1-479d-aacc-5b116073d338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6993e79d443b402fb08579ee325b465a, user_id=f045f6cfe16347bab4e7cad080ae4846, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:06.347730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3f628-f4c1-479d-aacc-5b116073d338 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:06.361261 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1203/2368] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:06 2022] PUT /identity/v3/projects/6993e79d443b402fb08579ee325b465a/users/f045f6cfe16347bab4e7cad080ae4846/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:06.371400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75f145-58c4-466b-a146-80c7a51080af None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:06.371782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75f145-58c4-466b-a146-80c7a51080af None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:06.372058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75f145-58c4-466b-a146-80c7a51080af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:06.414567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cb75f145-58c4-466b-a146-80c7a51080af None None] MFA Rules not processed for user `f045f6cfe16347bab4e7cad080ae4846`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:06.415812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cb75f145-58c4-466b-a146-80c7a51080af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:06.493771 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1166/2369] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:06.500604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3f628-f4c1-479d-aacc-5b116073d338 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:06.514952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3f628-f4c1-479d-aacc-5b116073d338 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:06.526489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4428df2-262d-450b-9b82-d961b9ce9577 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f045f6cfe16347bab4e7cad080ae4846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6993e79d443b402fb08579ee325b465a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:06.527142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4428df2-262d-450b-9b82-d961b9ce9577 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:06.527424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4428df2-262d-450b-9b82-d961b9ce9577 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:06.527700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4428df2-262d-450b-9b82-d961b9ce9577 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:06.528349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4428df2-262d-450b-9b82-d961b9ce9577 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:03:06.528654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4428df2-262d-450b-9b82-d961b9ce9577 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:06.530234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4428df2-262d-450b-9b82-d961b9ce9577 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:06.556455 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1204/2370] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:03:06.560438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75f145-58c4-466b-a146-80c7a51080af None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:06.579008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75f145-58c4-466b-a146-80c7a51080af None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:06.592100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191545a-1cb5-4fce-ab3c-ebd51d5f51a7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:06.592622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191545a-1cb5-4fce-ab3c-ebd51d5f51a7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:06.593389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130db0f9-9c14-444b-b635-16701971ea2e tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f045f6cfe16347bab4e7cad080ae4846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6993e79d443b402fb08579ee325b465a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:06.594288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130db0f9-9c14-444b-b635-16701971ea2e tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:06.594633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130db0f9-9c14-444b-b635-16701971ea2e tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:06.595002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130db0f9-9c14-444b-b635-16701971ea2e tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:06.596054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130db0f9-9c14-444b-b635-16701971ea2e tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:06.596348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191545a-1cb5-4fce-ab3c-ebd51d5f51a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:06.598363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130db0f9-9c14-444b-b635-16701971ea2e tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:06.632463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8191545a-1cb5-4fce-ab3c-ebd51d5f51a7 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:06.634015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8191545a-1cb5-4fce-ab3c-ebd51d5f51a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:06.667254 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:06.674681 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1167/2371] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:06 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:06.678669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130db0f9-9c14-444b-b635-16701971ea2e tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:06.732059 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1205/2372] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:06.745375 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:06.755530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191545a-1cb5-4fce-ab3c-ebd51d5f51a7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:06.757077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8191545a-1cb5-4fce-ab3c-ebd51d5f51a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:06.772772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130db0f9-9c14-444b-b635-16701971ea2e tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:06.779852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb0d1b-b509-47d3-b2d5-da5f72a4b913 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f045f6cfe16347bab4e7cad080ae4846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6993e79d443b402fb08579ee325b465a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:06.780903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb0d1b-b509-47d3-b2d5-da5f72a4b913 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:06.781424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb0d1b-b509-47d3-b2d5-da5f72a4b913 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:06.781944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb0d1b-b509-47d3-b2d5-da5f72a4b913 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:06.782815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb0d1b-b509-47d3-b2d5-da5f72a4b913 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:03:06.783534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb0d1b-b509-47d3-b2d5-da5f72a4b913 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:06.785663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb0d1b-b509-47d3-b2d5-da5f72a4b913 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:06.838812 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1168/2373] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:03:06.851188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb0d1b-b509-47d3-b2d5-da5f72a4b913 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:06.853202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bddb0d1b-b509-47d3-b2d5-da5f72a4b913 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:06.874528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191545a-1cb5-4fce-ab3c-ebd51d5f51a7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:06.952202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb0d1b-b509-47d3-b2d5-da5f72a4b913 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:06.963382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813e0a8-0aeb-4838-bf48-78b798625cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:06.964358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813e0a8-0aeb-4838-bf48-78b798625cd2 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:06.964845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813e0a8-0aeb-4838-bf48-78b798625cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:06.965188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813e0a8-0aeb-4838-bf48-78b798625cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:06.977735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813e0a8-0aeb-4838-bf48-78b798625cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:06.979590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813e0a8-0aeb-4838-bf48-78b798625cd2 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:06.991036 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1169/2374] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:07.013511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99d392-de39-48d8-97ed-2085b25c3b7b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:07.013854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99d392-de39-48d8-97ed-2085b25c3b7b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:07.014052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99d392-de39-48d8-97ed-2085b25c3b7b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:07.015502 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1170/2375] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 01:03:07.021481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99d392-de39-48d8-97ed-2085b25c3b7b None None] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:03:07.037257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd3fe1-bda8-4aa8-bb7c-3d0976621515 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:07.038056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd3fe1-bda8-4aa8-bb7c-3d0976621515 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:07.038434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd3fe1-bda8-4aa8-bb7c-3d0976621515 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:07.039477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd3fe1-bda8-4aa8-bb7c-3d0976621515 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:07.041904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99d392-de39-48d8-97ed-2085b25c3b7b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:07.064680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99d392-de39-48d8-97ed-2085b25c3b7b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:07.070610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c09f77-9d9d-4e50-bcf2-ff46f15b13d0 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f045f6cfe16347bab4e7cad080ae4846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6993e79d443b402fb08579ee325b465a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:07.071280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c09f77-9d9d-4e50-bcf2-ff46f15b13d0 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:07.071555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c09f77-9d9d-4e50-bcf2-ff46f15b13d0 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:07.071822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c09f77-9d9d-4e50-bcf2-ff46f15b13d0 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] PATH_INFO: `/v3/projects/0a62c676c6d34f9da4a8641118e3f753` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:07.072986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c09f77-9d9d-4e50-bcf2-ff46f15b13d0 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a62c676c6d34f9da4a8641118e3f753)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:07.075233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c09f77-9d9d-4e50-bcf2-ff46f15b13d0 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:07.077423 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1171/2376] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:03:07 2022] GET /identity/v3/projects/0a62c676c6d34f9da4a8641118e3f753 => generated 365 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:03:07.118536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd3fe1-bda8-4aa8-bb7c-3d0976621515 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:07.120340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd3fe1-bda8-4aa8-bb7c-3d0976621515 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:07.143211 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1206/2377] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:03:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:03:07.237428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002d056-ee54-4bae-bb33-e7c2df62596b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:07.237732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002d056-ee54-4bae-bb33-e7c2df62596b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:07.238008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002d056-ee54-4bae-bb33-e7c2df62596b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:07.240132 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1172/2378] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:03:07.255124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd3fe1-bda8-4aa8-bb7c-3d0976621515 service swift] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:03:07.256648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d1bd3fe1-bda8-4aa8-bb7c-3d0976621515 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:07.291835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd3fe1-bda8-4aa8-bb7c-3d0976621515 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:07.310886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd3fe1-bda8-4aa8-bb7c-3d0976621515 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:07.318043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630cce3-3558-4df1-b5ca-4f67e48c1e39 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f045f6cfe16347bab4e7cad080ae4846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6993e79d443b402fb08579ee325b465a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:07.318836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630cce3-3558-4df1-b5ca-4f67e48c1e39 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:07.319252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630cce3-3558-4df1-b5ca-4f67e48c1e39 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:07.319618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630cce3-3558-4df1-b5ca-4f67e48c1e39 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] PATH_INFO: `/v3/projects/0a62c676c6d34f9da4a8641118e3f753` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:07.321491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630cce3-3558-4df1-b5ca-4f67e48c1e39 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a62c676c6d34f9da4a8641118e3f753)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:07.329194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630cce3-3558-4df1-b5ca-4f67e48c1e39 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:07.347792 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1207/2379] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:03:07 2022] GET /identity/v3/projects/0a62c676c6d34f9da4a8641118e3f753 => generated 365 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:03:07.391774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002d056-ee54-4bae-bb33-e7c2df62596b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:07.414187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002d056-ee54-4bae-bb33-e7c2df62596b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:07.430975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee5aa3-267d-4c37-b310-5f86b2a5dc58 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f045f6cfe16347bab4e7cad080ae4846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6993e79d443b402fb08579ee325b465a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:07.431598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee5aa3-267d-4c37-b310-5f86b2a5dc58 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:07.431875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee5aa3-267d-4c37-b310-5f86b2a5dc58 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:07.432142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee5aa3-267d-4c37-b310-5f86b2a5dc58 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:07.436845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee5aa3-267d-4c37-b310-5f86b2a5dc58 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:03:07.440109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee5aa3-267d-4c37-b310-5f86b2a5dc58 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:07.444399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee5aa3-267d-4c37-b310-5f86b2a5dc58 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:07.502373 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1173/2380] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:03:07.503992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630cce3-3558-4df1-b5ca-4f67e48c1e39 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:07.519710 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:07.539970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630cce3-3558-4df1-b5ca-4f67e48c1e39 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:07.565419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ee01d-519f-4150-9d50-75866f960998 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f045f6cfe16347bab4e7cad080ae4846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6993e79d443b402fb08579ee325b465a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:07.567320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ee01d-519f-4150-9d50-75866f960998 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:07.567749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ee01d-519f-4150-9d50-75866f960998 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:07.568122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ee01d-519f-4150-9d50-75866f960998 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:07.569156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ee01d-519f-4150-9d50-75866f960998 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:07.572222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ee01d-519f-4150-9d50-75866f960998 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:07.627789 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1208/2381] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:07 2022] POST /identity/v3/users => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:07.628641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee5aa3-267d-4c37-b310-5f86b2a5dc58 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:07.639228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee5aa3-267d-4c37-b310-5f86b2a5dc58 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:07.644960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c3481-7e76-436d-9baa-a19927a65bd2 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f045f6cfe16347bab4e7cad080ae4846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6993e79d443b402fb08579ee325b465a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:07.645565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c3481-7e76-436d-9baa-a19927a65bd2 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:07.645841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c3481-7e76-436d-9baa-a19927a65bd2 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:07.646119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c3481-7e76-436d-9baa-a19927a65bd2 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:07.646843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c3481-7e76-436d-9baa-a19927a65bd2 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:03:07.647199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c3481-7e76-436d-9baa-a19927a65bd2 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:07.648880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c3481-7e76-436d-9baa-a19927a65bd2 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:07.694220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0c2b-3e0c-491c-a5be-439088c1228e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:07.697705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0c2b-3e0c-491c-a5be-439088c1228e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:07.697705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0c2b-3e0c-491c-a5be-439088c1228e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:07.698047 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1174/2382] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:03:07.715615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb2496-9a95-4058-bbd3-aef1a63b6f26 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:07.715915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb2496-9a95-4058-bbd3-aef1a63b6f26 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:07.716327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb2496-9a95-4058-bbd3-aef1a63b6f26 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:07.717839 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1175/2383] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:03:07.726116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb2496-9a95-4058-bbd3-aef1a63b6f26 None None] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:03:07.740334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0c0d0c2b-3e0c-491c-a5be-439088c1228e None None] MFA Rules not processed for user `283dbcfc68244d4b86de327091147337`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:07.741812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0c0d0c2b-3e0c-491c-a5be-439088c1228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:07.745240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb2496-9a95-4058-bbd3-aef1a63b6f26 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:07.758436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb2496-9a95-4058-bbd3-aef1a63b6f26 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:07.765818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17aebb-5774-4039-a5d1-f654838cddec tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f045f6cfe16347bab4e7cad080ae4846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6993e79d443b402fb08579ee325b465a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:07.766547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17aebb-5774-4039-a5d1-f654838cddec tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:07.766897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17aebb-5774-4039-a5d1-f654838cddec tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:07.767234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17aebb-5774-4039-a5d1-f654838cddec tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] PATH_INFO: `/v3/projects/0a62c676c6d34f9da4a8641118e3f753` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:07.769013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17aebb-5774-4039-a5d1-f654838cddec tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a62c676c6d34f9da4a8641118e3f753)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:07.771086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17aebb-5774-4039-a5d1-f654838cddec tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:07.772878 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1176/2384] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:03:07 2022] GET /identity/v3/projects/0a62c676c6d34f9da4a8641118e3f753 => generated 365 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:03:07.857117 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1209/2385] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:08.069785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17aebb-5774-4039-a5d1-f654838cddec tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:08.071752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cc17aebb-5774-4039-a5d1-f654838cddec tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:08.079072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d30052-5d68-4aa9-9202-e3b2a7e71987 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:08.079364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d30052-5d68-4aa9-9202-e3b2a7e71987 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:08.079634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d30052-5d68-4aa9-9202-e3b2a7e71987 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:08.082818 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1210/2386] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:03:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:03:08.088427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d30052-5d68-4aa9-9202-e3b2a7e71987 None None] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:03:08.103675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d30052-5d68-4aa9-9202-e3b2a7e71987 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:08.115342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d30052-5d68-4aa9-9202-e3b2a7e71987 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:08.123615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed4f12-b0b5-4233-981e-f3be549759c5 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f045f6cfe16347bab4e7cad080ae4846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6993e79d443b402fb08579ee325b465a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:08.124542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed4f12-b0b5-4233-981e-f3be549759c5 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:08.124542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed4f12-b0b5-4233-981e-f3be549759c5 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:08.124846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed4f12-b0b5-4233-981e-f3be549759c5 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] PATH_INFO: `/v3/projects/0a62c676c6d34f9da4a8641118e3f753` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:08.125919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed4f12-b0b5-4233-981e-f3be549759c5 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a62c676c6d34f9da4a8641118e3f753)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:08.128890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed4f12-b0b5-4233-981e-f3be549759c5 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:08.131118 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1211/2387] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:03:08 2022] GET /identity/v3/projects/0a62c676c6d34f9da4a8641118e3f753 => generated 365 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:03:08.175378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed4f12-b0b5-4233-981e-f3be549759c5 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:08.186151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17aebb-5774-4039-a5d1-f654838cddec tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:08.188596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed4f12-b0b5-4233-981e-f3be549759c5 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:08.195273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fab17d-45f2-410b-91fd-f4bdf979218e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:08.196272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37679985-0758-4f1c-97cc-8715744a9f7d tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f045f6cfe16347bab4e7cad080ae4846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6993e79d443b402fb08579ee325b465a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:08.196917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fab17d-45f2-410b-91fd-f4bdf979218e service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:08.197419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37679985-0758-4f1c-97cc-8715744a9f7d tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:08.197747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37679985-0758-4f1c-97cc-8715744a9f7d tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:08.198096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fab17d-45f2-410b-91fd-f4bdf979218e service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:08.198226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37679985-0758-4f1c-97cc-8715744a9f7d tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] PATH_INFO: `/v3/users/7902fd7520e144b4afa475433173058d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:08.201017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fab17d-45f2-410b-91fd-f4bdf979218e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:08.205114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-40fab17d-45f2-410b-91fd-f4bdf979218e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:08.224093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fab17d-45f2-410b-91fd-f4bdf979218e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:08.226644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fab17d-45f2-410b-91fd-f4bdf979218e service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:08.229795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37679985-0758-4f1c-97cc-8715744a9f7d tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7902fd7520e144b4afa475433173058d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:08.237736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37679985-0758-4f1c-97cc-8715744a9f7d tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:08.244128 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1177/2388] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:08.312147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37679985-0758-4f1c-97cc-8715744a9f7d tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7902fd7520e144b4afa475433173058d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:08.312827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37679985-0758-4f1c-97cc-8715744a9f7d tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7902fd7520e144b4afa475433173058d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:08.351137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37679985-0758-4f1c-97cc-8715744a9f7d tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7902fd7520e144b4afa475433173058d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:08.383074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37679985-0758-4f1c-97cc-8715744a9f7d tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7902fd7520e144b4afa475433173058d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:08.385761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37679985-0758-4f1c-97cc-8715744a9f7d tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7902fd7520e144b4afa475433173058d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:08.407306 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1212/2389] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:08 2022] DELETE /identity/v3/users/7902fd7520e144b4afa475433173058d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:08.409674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fab17d-45f2-410b-91fd-f4bdf979218e service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:08.416025 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:08.424015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fab17d-45f2-410b-91fd-f4bdf979218e service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:08.483688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e37e9-857a-41ae-b2cf-fa07c2609803 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:08.483688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e37e9-857a-41ae-b2cf-fa07c2609803 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:08.484102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e37e9-857a-41ae-b2cf-fa07c2609803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:08.519685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12673941-6ea5-4540-b7d2-a19da1b54f29 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f045f6cfe16347bab4e7cad080ae4846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6993e79d443b402fb08579ee325b465a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:08.520854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12673941-6ea5-4540-b7d2-a19da1b54f29 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:08.521474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12673941-6ea5-4540-b7d2-a19da1b54f29 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:08.521890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12673941-6ea5-4540-b7d2-a19da1b54f29 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] PATH_INFO: `/v3/projects/0a62c676c6d34f9da4a8641118e3f753` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:08.524045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8d9e37e9-857a-41ae-b2cf-fa07c2609803 None None] MFA Rules not processed for user `283dbcfc68244d4b86de327091147337`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:08.524807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12673941-6ea5-4540-b7d2-a19da1b54f29 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a62c676c6d34f9da4a8641118e3f753)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:08.527029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8d9e37e9-857a-41ae-b2cf-fa07c2609803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:08.527521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12673941-6ea5-4540-b7d2-a19da1b54f29 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:08.607859 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:08.656029 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1213/2390] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:08.657723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12673941-6ea5-4540-b7d2-a19da1b54f29 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a62c676c6d34f9da4a8641118e3f753', 'request_id': 'req-12673941-6ea5-4540-b7d2-a19da1b54f29'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:08.666957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12673941-6ea5-4540-b7d2-a19da1b54f29 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a62c676c6d34f9da4a8641118e3f753', 'request_id': 'req-12673941-6ea5-4540-b7d2-a19da1b54f29'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:08.683406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12673941-6ea5-4540-b7d2-a19da1b54f29 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a62c676c6d34f9da4a8641118e3f753', 'request_id': 'req-12673941-6ea5-4540-b7d2-a19da1b54f29'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:08.704917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12673941-6ea5-4540-b7d2-a19da1b54f29 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] The token cache is being invalidate because project 0a62c676c6d34f9da4a8641118e3f753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:08.706123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12673941-6ea5-4540-b7d2-a19da1b54f29 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:08.706787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12673941-6ea5-4540-b7d2-a19da1b54f29 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:08.708403 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1178/2391] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:08 2022] DELETE /identity/v3/projects/0a62c676c6d34f9da4a8641118e3f753 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:08.714050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e37e9-857a-41ae-b2cf-fa07c2609803 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:08.715626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8d9e37e9-857a-41ae-b2cf-fa07c2609803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:08.867767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e37e9-857a-41ae-b2cf-fa07c2609803 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:08.942567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c2c8-92c1-4702-b19c-5beaf2def231 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:08.943048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c2c8-92c1-4702-b19c-5beaf2def231 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:08.943432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c2c8-92c1-4702-b19c-5beaf2def231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:09.040606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3a45c2c8-92c1-4702-b19c-5beaf2def231 None None] MFA Rules not processed for user `57612f6a347e49be96d699e76bd9bead`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:09.043685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a45c2c8-92c1-4702-b19c-5beaf2def231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:09.126537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:09.127691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:09.127811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:09.128035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] PATH_INFO: `/v3/users/a69d5a92a2b1414b859e945011d59a6b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:09.138063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a69d5a92a2b1414b859e945011d59a6b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:09.146864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:09.197551 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1179/2392] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:09.279315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a69d5a92a2b1414b859e945011d59a6b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:09.291034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a69d5a92a2b1414b859e945011d59a6b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:09.312347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a69d5a92a2b1414b859e945011d59a6b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:09.326551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a69d5a92a2b1414b859e945011d59a6b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:09.327196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a69d5a92a2b1414b859e945011d59a6b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:09.358109 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1214/2393] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:08 2022] DELETE /identity/v3/users/a69d5a92a2b1414b859e945011d59a6b => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:09.363180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b5149-3a20-46e9-ac26-5626f005c3c8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:09.363471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b5149-3a20-46e9-ac26-5626f005c3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:09.363779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b5149-3a20-46e9-ac26-5626f005c3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:09.395078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cd3b5149-3a20-46e9-ac26-5626f005c3c8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:09.396597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cd3b5149-3a20-46e9-ac26-5626f005c3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:09.483074 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:09.529247 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1180/2394] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:09.543279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:09.545932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:09.573140 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:09.690650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899688b5-092a-4b5b-b18b-f6fbcd06528e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:09.694538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e43a48-a554-4b67-8675-b6159d13eddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:09.695211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e43a48-a554-4b67-8675-b6159d13eddf service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:09.695513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e43a48-a554-4b67-8675-b6159d13eddf service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:09.695807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e43a48-a554-4b67-8675-b6159d13eddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:09.706476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e43a48-a554-4b67-8675-b6159d13eddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:09.708054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e43a48-a554-4b67-8675-b6159d13eddf service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:09.725207 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1215/2395] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:10.644543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b5149-3a20-46e9-ac26-5626f005c3c8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:10.646535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cd3b5149-3a20-46e9-ac26-5626f005c3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:10.667446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b5149-3a20-46e9-ac26-5626f005c3c8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:10.682397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:10.682997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:10.683460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:10.683886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] PATH_INFO: `/v3/projects/9d880e3b13d14d38bbcec184286d2876` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:10.686380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d880e3b13d14d38bbcec184286d2876)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:10.688675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:10.883265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d880e3b13d14d38bbcec184286d2876', 'request_id': 'req-6f749bfd-d275-4710-8e95-d84177942d72'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:10.903641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d880e3b13d14d38bbcec184286d2876', 'request_id': 'req-6f749bfd-d275-4710-8e95-d84177942d72'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:10.932106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d880e3b13d14d38bbcec184286d2876', 'request_id': 'req-6f749bfd-d275-4710-8e95-d84177942d72'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:10.959083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] The token cache is being invalidate because project 9d880e3b13d14d38bbcec184286d2876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:10.959616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:10.960622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:10.968700 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1181/2396] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:10 2022] DELETE /identity/v3/projects/9d880e3b13d14d38bbcec184286d2876 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:10.969284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e43a48-a554-4b67-8675-b6159d13eddf service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:10.989267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e43a48-a554-4b67-8675-b6159d13eddf service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:11.131285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4807450-f202-413d-84d8-bf2e215cded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:11.132740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4807450-f202-413d-84d8-bf2e215cded6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:11.133221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4807450-f202-413d-84d8-bf2e215cded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:11.133740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4807450-f202-413d-84d8-bf2e215cded6 admin admin] PATH_INFO: `/v3/users/f045f6cfe16347bab4e7cad080ae4846` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:11.136049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4807450-f202-413d-84d8-bf2e215cded6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f045f6cfe16347bab4e7cad080ae4846)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:11.140350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4807450-f202-413d-84d8-bf2e215cded6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:11.303503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4807450-f202-413d-84d8-bf2e215cded6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f045f6cfe16347bab4e7cad080ae4846'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:11.304684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4807450-f202-413d-84d8-bf2e215cded6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f045f6cfe16347bab4e7cad080ae4846'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:11.325704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4807450-f202-413d-84d8-bf2e215cded6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f045f6cfe16347bab4e7cad080ae4846'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:11.344562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4807450-f202-413d-84d8-bf2e215cded6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f045f6cfe16347bab4e7cad080ae4846'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:11.346172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4807450-f202-413d-84d8-bf2e215cded6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f045f6cfe16347bab4e7cad080ae4846'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:11.365647 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1216/2397] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:10 2022] DELETE /identity/v3/users/f045f6cfe16347bab4e7cad080ae4846 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:12.183462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:12.185300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:12.217353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749bfd-d275-4710-8e95-d84177942d72 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:12.318702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:12.319688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:12.320118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:12.320562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c admin admin] PATH_INFO: `/v3/projects/6993e79d443b402fb08579ee325b465a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:12.322313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6993e79d443b402fb08579ee325b465a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:12.325418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:12.402238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6993e79d443b402fb08579ee325b465a', 'request_id': 'req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:12.410107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6993e79d443b402fb08579ee325b465a', 'request_id': 'req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:12.420720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6993e79d443b402fb08579ee325b465a', 'request_id': 'req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:12.423085 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:12.436151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c admin admin] The token cache is being invalidate because project 6993e79d443b402fb08579ee325b465a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:12.436460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:12.437721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77cbf2f3-0bf7-4263-a46b-1d23b6db3c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:12.439502 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1182/2398] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:12 2022] DELETE /identity/v3/projects/6993e79d443b402fb08579ee325b465a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:12.445575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac70824-af92-4e44-9b67-49b715026a57 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:12.446094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac70824-af92-4e44-9b67-49b715026a57 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:12.446211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac70824-af92-4e44-9b67-49b715026a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:12.488825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4ac70824-af92-4e44-9b67-49b715026a57 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:12.490553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4ac70824-af92-4e44-9b67-49b715026a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:12.535036 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:12.597841 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1217/2399] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:12.607730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec67ad-b36b-4db8-b69b-9382e1e8cb34 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:12.608146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec67ad-b36b-4db8-b69b-9382e1e8cb34 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:12.608449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec67ad-b36b-4db8-b69b-9382e1e8cb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:12.632547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b2ec67ad-b36b-4db8-b69b-9382e1e8cb34 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:12.635258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b2ec67ad-b36b-4db8-b69b-9382e1e8cb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:12.651475 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1183/2400] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:12.652809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac70824-af92-4e44-9b67-49b715026a57 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:12.667853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac70824-af92-4e44-9b67-49b715026a57 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:12.674100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07d42b-0103-491d-a09a-2d879cc126b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:12.674698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07d42b-0103-491d-a09a-2d879cc126b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:12.675221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07d42b-0103-491d-a09a-2d879cc126b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:12.675511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07d42b-0103-491d-a09a-2d879cc126b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:12.677785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07d42b-0103-491d-a09a-2d879cc126b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:03:12.677785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07d42b-0103-491d-a09a-2d879cc126b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:12.680252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07d42b-0103-491d-a09a-2d879cc126b7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:12.698091 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1218/2401] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:03:12.703300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec67ad-b36b-4db8-b69b-9382e1e8cb34 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:12.725051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec67ad-b36b-4db8-b69b-9382e1e8cb34 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:12.732180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba39e3-e0d5-4bd6-bb60-5945baa2ae85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:12.733439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba39e3-e0d5-4bd6-bb60-5945baa2ae85 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:12.733991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba39e3-e0d5-4bd6-bb60-5945baa2ae85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:12.734604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba39e3-e0d5-4bd6-bb60-5945baa2ae85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:12.736822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba39e3-e0d5-4bd6-bb60-5945baa2ae85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:12.740174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba39e3-e0d5-4bd6-bb60-5945baa2ae85 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:12.777273 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1184/2402] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:12 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:12.781652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07d42b-0103-491d-a09a-2d879cc126b7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:12.797760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07d42b-0103-491d-a09a-2d879cc126b7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:12.885409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925b36e-5613-4610-ba30-8f84721c2894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:12.885409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925b36e-5613-4610-ba30-8f84721c2894 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:12.885409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925b36e-5613-4610-ba30-8f84721c2894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:12.885409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925b36e-5613-4610-ba30-8f84721c2894 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:12.885874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925b36e-5613-4610-ba30-8f84721c2894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:12.887997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925b36e-5613-4610-ba30-8f84721c2894 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:12.925384 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1219/2403] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:12 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:03:12.932490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba39e3-e0d5-4bd6-bb60-5945baa2ae85 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:12.945615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba39e3-e0d5-4bd6-bb60-5945baa2ae85 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:12.957111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf03d5-baf4-4330-a409-c389ebcd7914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:12.957824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf03d5-baf4-4330-a409-c389ebcd7914 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:12.958103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf03d5-baf4-4330-a409-c389ebcd7914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:12.958390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf03d5-baf4-4330-a409-c389ebcd7914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:12.959072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf03d5-baf4-4330-a409-c389ebcd7914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:12.960684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf03d5-baf4-4330-a409-c389ebcd7914 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:12.972553 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1185/2404] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:12.977256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925b36e-5613-4610-ba30-8f84721c2894 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:12.991706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925b36e-5613-4610-ba30-8f84721c2894 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:13.023561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64855e-c595-4b37-ac5d-6431dea4a482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:13.024352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64855e-c595-4b37-ac5d-6431dea4a482 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:13.024647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64855e-c595-4b37-ac5d-6431dea4a482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:13.024925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64855e-c595-4b37-ac5d-6431dea4a482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:13.025582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64855e-c595-4b37-ac5d-6431dea4a482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:13.027227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64855e-c595-4b37-ac5d-6431dea4a482 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:13.050438 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1220/2405] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:13.052435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf03d5-baf4-4330-a409-c389ebcd7914 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:13.065021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf03d5-baf4-4330-a409-c389ebcd7914 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:13.070443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20145040-6a9d-44e8-85e6-a2a080a046f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:13.071262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20145040-6a9d-44e8-85e6-a2a080a046f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:13.071549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20145040-6a9d-44e8-85e6-a2a080a046f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:13.071823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20145040-6a9d-44e8-85e6-a2a080a046f5 admin admin] PATH_INFO: `/v3/projects/be4026a24ff44aeab4eb6147a1747870/users/2a1a6b79c3d34188927004454082ef7e/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:13.103979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20145040-6a9d-44e8-85e6-a2a080a046f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4026a24ff44aeab4eb6147a1747870, user_id=2a1a6b79c3d34188927004454082ef7e, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:13.118968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20145040-6a9d-44e8-85e6-a2a080a046f5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:13.151804 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1186/2406] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:13 2022] PUT /identity/v3/projects/be4026a24ff44aeab4eb6147a1747870/users/2a1a6b79c3d34188927004454082ef7e/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:13.164136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3cb5b-1b6f-4c37-9628-b75f445dd6ac None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:13.164412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3cb5b-1b6f-4c37-9628-b75f445dd6ac None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:13.164681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3cb5b-1b6f-4c37-9628-b75f445dd6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:13.223379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dca3cb5b-1b6f-4c37-9628-b75f445dd6ac None None] MFA Rules not processed for user `2a1a6b79c3d34188927004454082ef7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:13.224620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dca3cb5b-1b6f-4c37-9628-b75f445dd6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:13.327110 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1221/2407] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:13.340510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20145040-6a9d-44e8-85e6-a2a080a046f5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:13.342355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-20145040-6a9d-44e8-85e6-a2a080a046f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:13.432116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20145040-6a9d-44e8-85e6-a2a080a046f5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:13.437836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31b852-d64b-41b7-88bd-357cd43db7f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:13.438529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31b852-d64b-41b7-88bd-357cd43db7f9 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:13.438882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31b852-d64b-41b7-88bd-357cd43db7f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:13.439934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31b852-d64b-41b7-88bd-357cd43db7f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:13.450165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31b852-d64b-41b7-88bd-357cd43db7f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:13.451832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31b852-d64b-41b7-88bd-357cd43db7f9 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:13.462411 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1187/2408] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:14.485200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3cb5b-1b6f-4c37-9628-b75f445dd6ac None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:14.530936 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:14.590167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3cb5b-1b6f-4c37-9628-b75f445dd6ac None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:14.597646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:14.598297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:14.598577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:14.598848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] PATH_INFO: `/v3/users/2a1a6b79c3d34188927004454082ef7e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:14.600047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1a6b79c3d34188927004454082ef7e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:14.602493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:14.667075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1a6b79c3d34188927004454082ef7e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:14.668033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1a6b79c3d34188927004454082ef7e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:14.686283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1a6b79c3d34188927004454082ef7e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:14.698527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1a6b79c3d34188927004454082ef7e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:14.699192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1a6b79c3d34188927004454082ef7e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:14.722160 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1222/2409] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:14 2022] DELETE /identity/v3/users/2a1a6b79c3d34188927004454082ef7e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:14.726708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a65b-b1df-447f-be1a-838467c29a53 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:14.727261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a65b-b1df-447f-be1a-838467c29a53 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:14.727361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a65b-b1df-447f-be1a-838467c29a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:14.784209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7c19a65b-b1df-447f-be1a-838467c29a53 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:14.786032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7c19a65b-b1df-447f-be1a-838467c29a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:14.892568 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1188/2410] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:14.915083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:14.920373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:15.122578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04952-a3a1-4249-8610-b575cdb82a43 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:15.135403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaec54-f2d6-4f9b-87c2-47e5fdfb4668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:15.136036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaec54-f2d6-4f9b-87c2-47e5fdfb4668 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:15.138564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaec54-f2d6-4f9b-87c2-47e5fdfb4668 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:15.138849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaec54-f2d6-4f9b-87c2-47e5fdfb4668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:15.163793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eaec54-f2d6-4f9b-87c2-47e5fdfb4668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:15.166048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eaec54-f2d6-4f9b-87c2-47e5fdfb4668 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:15.192334 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1223/2411] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:16.816667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19a65b-b1df-447f-be1a-838467c29a53 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:16.819360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7c19a65b-b1df-447f-be1a-838467c29a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:16.847016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19a65b-b1df-447f-be1a-838467c29a53 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:16.868571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:16.869350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:16.869757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:16.870060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] PATH_INFO: `/v3/users/4352b314efdf413d940755f4cb0dbbda` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:16.876361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4352b314efdf413d940755f4cb0dbbda)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:16.880076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:16.897888 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:16.974181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4352b314efdf413d940755f4cb0dbbda'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:16.975353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4352b314efdf413d940755f4cb0dbbda'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:16.997533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4352b314efdf413d940755f4cb0dbbda'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:17.010009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4352b314efdf413d940755f4cb0dbbda'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:17.012091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4352b314efdf413d940755f4cb0dbbda'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:17.047457 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1189/2412] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:16 2022] DELETE /identity/v3/users/4352b314efdf413d940755f4cb0dbbda => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:17.054433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8945b-7c06-4bc6-86ea-536e24c1830b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:17.055478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8945b-7c06-4bc6-86ea-536e24c1830b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:17.055971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8945b-7c06-4bc6-86ea-536e24c1830b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:17.094131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-88f8945b-7c06-4bc6-86ea-536e24c1830b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:17.095532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-88f8945b-7c06-4bc6-86ea-536e24c1830b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:17.196171 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:17.214911 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1224/2413] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:17.226589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:17.228706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:17.339026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5c960-6557-4f5a-89b2-6c71e4c551c5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:17.343558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad9f26-294f-471d-a8f6-943f2a5b3eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:17.344423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad9f26-294f-471d-a8f6-943f2a5b3eee service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:17.344847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad9f26-294f-471d-a8f6-943f2a5b3eee service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:17.345330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad9f26-294f-471d-a8f6-943f2a5b3eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:17.358397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad9f26-294f-471d-a8f6-943f2a5b3eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:17.360378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad9f26-294f-471d-a8f6-943f2a5b3eee service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:17.394625 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1190/2414] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:17.530061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e61c8-cf08-4f29-8c7e-b4f508107b09 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:17.530353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e61c8-cf08-4f29-8c7e-b4f508107b09 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:17.530694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e61c8-cf08-4f29-8c7e-b4f508107b09 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:17.533529 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1225/2415] 10.222.0.39 () {54 vars in 921 bytes} [Sun Oct 16 01:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:03:17.541583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acb36-162a-42ae-8bae-dbe886c02496 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:17.542225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acb36-162a-42ae-8bae-dbe886c02496 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:17.543225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acb36-162a-42ae-8bae-dbe886c02496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:17.588095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f50acb36-162a-42ae-8bae-dbe886c02496 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:17.590441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f50acb36-162a-42ae-8bae-dbe886c02496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:17.707896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e61c8-cf08-4f29-8c7e-b4f508107b09 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:17.709775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5d1e61c8-cf08-4f29-8c7e-b4f508107b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:17.743861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e61c8-cf08-4f29-8c7e-b4f508107b09 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:17.746566 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1191/2416] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:17.754089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:17.755053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:17.755507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:17.756920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] PATH_INFO: `/v3/projects/be4026a24ff44aeab4eb6147a1747870` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:17.757655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4026a24ff44aeab4eb6147a1747870)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:17.760297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:17.803195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50acb36-162a-42ae-8bae-dbe886c02496 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:17.876305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50acb36-162a-42ae-8bae-dbe886c02496 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:17.882494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4026a24ff44aeab4eb6147a1747870', 'request_id': 'req-0be59170-a27b-4979-bd95-a8af85b52b6b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:17.901908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4026a24ff44aeab4eb6147a1747870', 'request_id': 'req-0be59170-a27b-4979-bd95-a8af85b52b6b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:17.916957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4026a24ff44aeab4eb6147a1747870', 'request_id': 'req-0be59170-a27b-4979-bd95-a8af85b52b6b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:17.924139 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:17.930856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] The token cache is being invalidate because project be4026a24ff44aeab4eb6147a1747870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:17.931270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:17.931943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:17.933717 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1226/2417] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:17 2022] DELETE /identity/v3/projects/be4026a24ff44aeab4eb6147a1747870 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:17.934553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:17.936072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:17.971567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7d3fa-e1db-47b8-8aaa-71e2404ad19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:17.972861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7d3fa-e1db-47b8-8aaa-71e2404ad19f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:17.973212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7d3fa-e1db-47b8-8aaa-71e2404ad19f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:17.973558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7d3fa-e1db-47b8-8aaa-71e2404ad19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:17.975528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3cf7d3fa-e1db-47b8-8aaa-71e2404ad19f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:18.013304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59170-a27b-4979-bd95-a8af85b52b6b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:18.018860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:18.019520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:18.019796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:18.020065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] PATH_INFO: `/v3/projects/65ddfc9041e44055be492260cb2f1ae9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:18.021197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ddfc9041e44055be492260cb2f1ae9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:18.023171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:18.061244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7d3fa-e1db-47b8-8aaa-71e2404ad19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:18.063018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7d3fa-e1db-47b8-8aaa-71e2404ad19f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:18.076394 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1192/2418] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:18.086609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca252-679f-48aa-9a36-7bd38550750e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:18.086902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca252-679f-48aa-9a36-7bd38550750e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:18.087506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ddfc9041e44055be492260cb2f1ae9', 'request_id': 'req-ee213014-43a0-4fec-8527-9735c50da4ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.091019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca252-679f-48aa-9a36-7bd38550750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:18.095837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ddfc9041e44055be492260cb2f1ae9', 'request_id': 'req-ee213014-43a0-4fec-8527-9735c50da4ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.106955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ddfc9041e44055be492260cb2f1ae9', 'request_id': 'req-ee213014-43a0-4fec-8527-9735c50da4ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.123133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] The token cache is being invalidate because project 65ddfc9041e44055be492260cb2f1ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:18.123523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.124104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.126522 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1227/2419] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:17 2022] DELETE /identity/v3/projects/65ddfc9041e44055be492260cb2f1ae9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:18.131137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:18.132372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-71aca252-679f-48aa-9a36-7bd38550750e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:18.132800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:18.133801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-71aca252-679f-48aa-9a36-7bd38550750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:18.146865 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:18.211522 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1193/2420] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:18.221122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d536fe-42a4-40e1-b3c6-347073700f3f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:18.221579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d536fe-42a4-40e1-b3c6-347073700f3f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:18.221952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d536fe-42a4-40e1-b3c6-347073700f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:18.243721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d4d536fe-42a4-40e1-b3c6-347073700f3f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:18.245386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d4d536fe-42a4-40e1-b3c6-347073700f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:18.252487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee213014-43a0-4fec-8527-9735c50da4ea admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:18.255416 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1194/2421] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:18.259627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d536fe-42a4-40e1-b3c6-347073700f3f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:18.262421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e9633-c8cb-44ea-8ff3-e6cae95fe962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:18.263112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e9633-c8cb-44ea-8ff3-e6cae95fe962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:18.263388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e9633-c8cb-44ea-8ff3-e6cae95fe962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:18.263655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e9633-c8cb-44ea-8ff3-e6cae95fe962 admin admin] PATH_INFO: `/v3/users/87f382afa9194618a94663d350549f76` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:18.264914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e9633-c8cb-44ea-8ff3-e6cae95fe962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f382afa9194618a94663d350549f76)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:18.268320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e9633-c8cb-44ea-8ff3-e6cae95fe962 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:18.272028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d536fe-42a4-40e1-b3c6-347073700f3f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:18.279162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebb073-4a79-4c9c-8bcd-b2871b22c929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:18.279915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebb073-4a79-4c9c-8bcd-b2871b22c929 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:18.280242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebb073-4a79-4c9c-8bcd-b2871b22c929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:18.280614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebb073-4a79-4c9c-8bcd-b2871b22c929 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:18.281407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebb073-4a79-4c9c-8bcd-b2871b22c929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:03:18.281778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebb073-4a79-4c9c-8bcd-b2871b22c929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:18.283732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebb073-4a79-4c9c-8bcd-b2871b22c929 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:18.299030 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1195/2422] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:03:18.303327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebb073-4a79-4c9c-8bcd-b2871b22c929 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:18.319021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebb073-4a79-4c9c-8bcd-b2871b22c929 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:18.341487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5ea54-068d-4e61-be08-8170cb9bc0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:18.342448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5ea54-068d-4e61-be08-8170cb9bc0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:18.343003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5ea54-068d-4e61-be08-8170cb9bc0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:18.343510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5ea54-068d-4e61-be08-8170cb9bc0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:18.344513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5ea54-068d-4e61-be08-8170cb9bc0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:18.347203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5ea54-068d-4e61-be08-8170cb9bc0a4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:18.378096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4a7e9633-c8cb-44ea-8ff3-e6cae95fe962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f382afa9194618a94663d350549f76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.379096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4a7e9633-c8cb-44ea-8ff3-e6cae95fe962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f382afa9194618a94663d350549f76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.397970 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1196/2423] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:18 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:03:18.399252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5ea54-068d-4e61-be08-8170cb9bc0a4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:18.407392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-66d5ea54-068d-4e61-be08-8170cb9bc0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:18.411513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4a7e9633-c8cb-44ea-8ff3-e6cae95fe962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f382afa9194618a94663d350549f76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.422839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4a7e9633-c8cb-44ea-8ff3-e6cae95fe962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f382afa9194618a94663d350549f76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.425507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4a7e9633-c8cb-44ea-8ff3-e6cae95fe962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f382afa9194618a94663d350549f76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.444241 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:18.451053 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1228/2424] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:18 2022] DELETE /identity/v3/users/87f382afa9194618a94663d350549f76 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:03:18.513138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5ea54-068d-4e61-be08-8170cb9bc0a4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:18.586567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e314b-72e4-450f-8477-246739b55374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:18.587282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e314b-72e4-450f-8477-246739b55374 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:18.587652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e314b-72e4-450f-8477-246739b55374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:18.588016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e314b-72e4-450f-8477-246739b55374 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:18.588743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e314b-72e4-450f-8477-246739b55374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:18.591413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e314b-72e4-450f-8477-246739b55374 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:18.630089 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1197/2425] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:18 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:18.634291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e9633-c8cb-44ea-8ff3-e6cae95fe962 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:18.652826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e9633-c8cb-44ea-8ff3-e6cae95fe962 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:18.664955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407149e-9d72-458f-a7ed-99bb3ce36815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:18.665539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407149e-9d72-458f-a7ed-99bb3ce36815 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:18.665870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407149e-9d72-458f-a7ed-99bb3ce36815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:18.666771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407149e-9d72-458f-a7ed-99bb3ce36815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:18.667475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407149e-9d72-458f-a7ed-99bb3ce36815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:18.671412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407149e-9d72-458f-a7ed-99bb3ce36815 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:18.705930 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1229/2426] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:18.706786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e314b-72e4-450f-8477-246739b55374 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:18.717816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407149e-9d72-458f-a7ed-99bb3ce36815 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:18.721479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d407149e-9d72-458f-a7ed-99bb3ce36815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:18.732629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e314b-72e4-450f-8477-246739b55374 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:18.743353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407149e-9d72-458f-a7ed-99bb3ce36815 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:18.752805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c036c-b657-433f-980a-44017c91f8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:18.753437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c036c-b657-433f-980a-44017c91f8cc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:18.753716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c036c-b657-433f-980a-44017c91f8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:18.754137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c036c-b657-433f-980a-44017c91f8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:18.754807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c036c-b657-433f-980a-44017c91f8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:18.756596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c036c-b657-433f-980a-44017c91f8cc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:18.760796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:18.762028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:18.762541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:18.763125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] PATH_INFO: `/v3/projects/ef8095cdcd604edfbdf0222181e7203e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:18.765866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef8095cdcd604edfbdf0222181e7203e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:18.771389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:18.786859 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1198/2427] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:18.788214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c036c-b657-433f-980a-44017c91f8cc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:18.808085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c036c-b657-433f-980a-44017c91f8cc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:18.813920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db25d03-1f7a-48b2-a6c0-1c5d395a9d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:18.814999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db25d03-1f7a-48b2-a6c0-1c5d395a9d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:18.815379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db25d03-1f7a-48b2-a6c0-1c5d395a9d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:18.816242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db25d03-1f7a-48b2-a6c0-1c5d395a9d8d admin admin] PATH_INFO: `/v3/projects/880e05820ad14f60888593d56af81f70/users/875dca9ed4914e379601ddbdba035cb2/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:18.842346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db25d03-1f7a-48b2-a6c0-1c5d395a9d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=880e05820ad14f60888593d56af81f70, user_id=875dca9ed4914e379601ddbdba035cb2, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:18.848604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db25d03-1f7a-48b2-a6c0-1c5d395a9d8d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:18.876965 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1199/2428] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:18 2022] PUT /identity/v3/projects/880e05820ad14f60888593d56af81f70/users/875dca9ed4914e379601ddbdba035cb2/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:18.885222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5082ed5-f1bb-4bd2-a3be-ed0f81b84404 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:18.886846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5082ed5-f1bb-4bd2-a3be-ed0f81b84404 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:18.886846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5082ed5-f1bb-4bd2-a3be-ed0f81b84404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:18.907697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef8095cdcd604edfbdf0222181e7203e', 'request_id': 'req-a1259aed-f784-4a28-a022-5c9df26b5584'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.921321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef8095cdcd604edfbdf0222181e7203e', 'request_id': 'req-a1259aed-f784-4a28-a022-5c9df26b5584'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.931849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b5082ed5-f1bb-4bd2-a3be-ed0f81b84404 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:18.933096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b5082ed5-f1bb-4bd2-a3be-ed0f81b84404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:18.940287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef8095cdcd604edfbdf0222181e7203e', 'request_id': 'req-a1259aed-f784-4a28-a022-5c9df26b5584'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.948884 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:18.960332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] The token cache is being invalidate because project ef8095cdcd604edfbdf0222181e7203e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:18.960907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.962875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:18.965271 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1230/2429] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:18 2022] DELETE /identity/v3/projects/ef8095cdcd604edfbdf0222181e7203e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:03:18.971914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:18.973587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:19.037839 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1200/2430] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:19.037839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46c074-2cb3-4769-9960-1459e7dc1a4b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:19.037839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46c074-2cb3-4769-9960-1459e7dc1a4b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:19.037839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46c074-2cb3-4769-9960-1459e7dc1a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:19.077788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-eb46c074-2cb3-4769-9960-1459e7dc1a4b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:19.079026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eb46c074-2cb3-4769-9960-1459e7dc1a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:19.083052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1259aed-f784-4a28-a022-5c9df26b5584 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:19.091354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830d705-7a94-4392-a788-f3e2350e2c5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:19.092129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830d705-7a94-4392-a788-f3e2350e2c5b service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:19.092552 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1201/2431] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:19.092717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830d705-7a94-4392-a788-f3e2350e2c5b service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:19.092979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830d705-7a94-4392-a788-f3e2350e2c5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:19.093690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46c074-2cb3-4769-9960-1459e7dc1a4b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:19.095119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c830d705-7a94-4392-a788-f3e2350e2c5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:19.095446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eb46c074-2cb3-4769-9960-1459e7dc1a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:19.108490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830d705-7a94-4392-a788-f3e2350e2c5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:19.110000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830d705-7a94-4392-a788-f3e2350e2c5b service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:19.118902 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:19.121897 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1231/2432] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:19.123391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365f303-3a03-426d-ae5a-2822559fdd48 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:19.123796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365f303-3a03-426d-ae5a-2822559fdd48 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:19.124175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365f303-3a03-426d-ae5a-2822559fdd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:19.153274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c365f303-3a03-426d-ae5a-2822559fdd48 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:19.154770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c365f303-3a03-426d-ae5a-2822559fdd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:19.189529 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1232/2433] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:19.194790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365f303-3a03-426d-ae5a-2822559fdd48 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:19.207419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365f303-3a03-426d-ae5a-2822559fdd48 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:19.213026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78192001-2b22-48c1-8a48-30f75b57a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:19.213769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78192001-2b22-48c1-8a48-30f75b57a578 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:19.214180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78192001-2b22-48c1-8a48-30f75b57a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:19.214549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78192001-2b22-48c1-8a48-30f75b57a578 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:19.215506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78192001-2b22-48c1-8a48-30f75b57a578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:03:19.215976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78192001-2b22-48c1-8a48-30f75b57a578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:19.218544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78192001-2b22-48c1-8a48-30f75b57a578 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:19.223156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46c074-2cb3-4769-9960-1459e7dc1a4b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:19.227622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a87a29-9b05-4373-8a73-33cac2afdfb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:19.228288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a87a29-9b05-4373-8a73-33cac2afdfb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:19.228573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a87a29-9b05-4373-8a73-33cac2afdfb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:19.229276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a87a29-9b05-4373-8a73-33cac2afdfb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:19.232671 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1233/2434] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:03:19.240075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78192001-2b22-48c1-8a48-30f75b57a578 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:19.240377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a87a29-9b05-4373-8a73-33cac2afdfb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:19.245122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a87a29-9b05-4373-8a73-33cac2afdfb5 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:19.250776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78192001-2b22-48c1-8a48-30f75b57a578 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:19.258037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975bb8-341b-415a-b522-0bf2eb62ac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:19.258705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975bb8-341b-415a-b522-0bf2eb62ac6d admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:19.258941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975bb8-341b-415a-b522-0bf2eb62ac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:19.259235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975bb8-341b-415a-b522-0bf2eb62ac6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:19.259859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a975bb8-341b-415a-b522-0bf2eb62ac6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:19.261816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a975bb8-341b-415a-b522-0bf2eb62ac6d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:19.275233 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1202/2435] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:19.310976 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1234/2436] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:19 2022] POST /identity/v3/projects => generated 397 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:19.311262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a87a29-9b05-4373-8a73-33cac2afdfb5 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:19.326387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a87a29-9b05-4373-8a73-33cac2afdfb5 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:19.440942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30921c26-3286-407d-95a2-360ce58e8834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:19.441977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921c26-3286-407d-95a2-360ce58e8834 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:19.442447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921c26-3286-407d-95a2-360ce58e8834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:19.442942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921c26-3286-407d-95a2-360ce58e8834 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:19.443590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30921c26-3286-407d-95a2-360ce58e8834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:19.445534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30921c26-3286-407d-95a2-360ce58e8834 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:19.472806 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1203/2437] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:19 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:19.474833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975bb8-341b-415a-b522-0bf2eb62ac6d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:19.489395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975bb8-341b-415a-b522-0bf2eb62ac6d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:19.496570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735abad0-395a-4af7-bba2-2f1033779104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:19.497308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735abad0-395a-4af7-bba2-2f1033779104 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:19.497647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735abad0-395a-4af7-bba2-2f1033779104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:19.497983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735abad0-395a-4af7-bba2-2f1033779104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:19.499082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735abad0-395a-4af7-bba2-2f1033779104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:19.500734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735abad0-395a-4af7-bba2-2f1033779104 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:19.516582 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1235/2438] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:19.518045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30921c26-3286-407d-95a2-360ce58e8834 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:19.529789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30921c26-3286-407d-95a2-360ce58e8834 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:19.538012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc7c32-c2d1-4448-b9d6-f9f91662c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:19.538538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc7c32-c2d1-4448-b9d6-f9f91662c00d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:19.538869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc7c32-c2d1-4448-b9d6-f9f91662c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:19.539204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc7c32-c2d1-4448-b9d6-f9f91662c00d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:19.542285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc7c32-c2d1-4448-b9d6-f9f91662c00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:19.543766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc7c32-c2d1-4448-b9d6-f9f91662c00d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:19.571680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735abad0-395a-4af7-bba2-2f1033779104 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:19.579801 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1204/2439] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:19.586550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735abad0-395a-4af7-bba2-2f1033779104 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:19.592107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd829d0f-1e41-485f-a1c7-d78b9ea387ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:19.592825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd829d0f-1e41-485f-a1c7-d78b9ea387ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:19.593198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd829d0f-1e41-485f-a1c7-d78b9ea387ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:19.593580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd829d0f-1e41-485f-a1c7-d78b9ea387ce admin admin] PATH_INFO: `/v3/projects/7776307d685b47fe8beca919b5f90966/users/8cd01d53807440fd827b41778a54627a/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:19.627934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd829d0f-1e41-485f-a1c7-d78b9ea387ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7776307d685b47fe8beca919b5f90966, user_id=8cd01d53807440fd827b41778a54627a, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:19.632572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd829d0f-1e41-485f-a1c7-d78b9ea387ce admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:19.660158 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1236/2440] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:19 2022] PUT /identity/v3/projects/7776307d685b47fe8beca919b5f90966/users/8cd01d53807440fd827b41778a54627a/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:19.665976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26026a1-269b-40c5-8393-28841b94c87a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:19.666271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26026a1-269b-40c5-8393-28841b94c87a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:19.666623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26026a1-269b-40c5-8393-28841b94c87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:19.700782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b26026a1-269b-40c5-8393-28841b94c87a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:19.702160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b26026a1-269b-40c5-8393-28841b94c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:19.878874 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1205/2441] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:20.135707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd829d0f-1e41-485f-a1c7-d78b9ea387ce admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:20.138603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fd829d0f-1e41-485f-a1c7-d78b9ea387ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:20.243387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd829d0f-1e41-485f-a1c7-d78b9ea387ce admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:20.247699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15027c91-db58-44af-a7fa-6db650102c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:20.248291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15027c91-db58-44af-a7fa-6db650102c86 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:20.248997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15027c91-db58-44af-a7fa-6db650102c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:20.248997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15027c91-db58-44af-a7fa-6db650102c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:20.263728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15027c91-db58-44af-a7fa-6db650102c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:20.265255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15027c91-db58-44af-a7fa-6db650102c86 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:20.284872 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1237/2442] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:29.828491 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:30.278270 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:30.593914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8fde8-3ee7-44d3-974a-3498fb9e0270 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:30.594098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8fde8-3ee7-44d3-974a-3498fb9e0270 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:30.594394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8fde8-3ee7-44d3-974a-3498fb9e0270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:30.689343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5da8fde8-3ee7-44d3-974a-3498fb9e0270 None None] MFA Rules not processed for user `875dca9ed4914e379601ddbdba035cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:30.690757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5da8fde8-3ee7-44d3-974a-3498fb9e0270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:30.854488 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1206/2443] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:30.866283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d8031-1991-4c4e-b5c0-c2d742d4055e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:30.867186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d8031-1991-4c4e-b5c0-c2d742d4055e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:30.867682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d8031-1991-4c4e-b5c0-c2d742d4055e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:30.905471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8e8d8031-1991-4c4e-b5c0-c2d742d4055e None None] MFA Rules not processed for user `875dca9ed4914e379601ddbdba035cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:30.907323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8e8d8031-1991-4c4e-b5c0-c2d742d4055e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:30.917264 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1238/2444] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:31.248258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8fde8-3ee7-44d3-974a-3498fb9e0270 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:31.249768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5da8fde8-3ee7-44d3-974a-3498fb9e0270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:31.277295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8fde8-3ee7-44d3-974a-3498fb9e0270 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:31.292178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:31.292990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.293270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.293543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] PATH_INFO: `/v3/users/ea698e4b461143cfafb17befe69af2a5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.295329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea698e4b461143cfafb17befe69af2a5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:31.297632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:31.383343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea698e4b461143cfafb17befe69af2a5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:31.384965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea698e4b461143cfafb17befe69af2a5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:31.412090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea698e4b461143cfafb17befe69af2a5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:31.422415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea698e4b461143cfafb17befe69af2a5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:31.423635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea698e4b461143cfafb17befe69af2a5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:31.439043 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1207/2445] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:31 2022] DELETE /identity/v3/users/ea698e4b461143cfafb17befe69af2a5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:31.750249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d8031-1991-4c4e-b5c0-c2d742d4055e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:31.753745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:31.755631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:31.765353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d8031-1991-4c4e-b5c0-c2d742d4055e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:31.857724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:31.858544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.858911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.859321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] PATH_INFO: `/v3/projects/bdbebb3c197640f8b915a091c4277bc8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.863619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdbebb3c197640f8b915a091c4277bc8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:31.866573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:31.880734 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:31.900741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45915c7f-3b25-4d80-b16c-091d1c3df189 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:31.912574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617d72b-6b48-46e9-a325-2d6a30af5022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:31.913838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617d72b-6b48-46e9-a325-2d6a30af5022 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.914444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617d72b-6b48-46e9-a325-2d6a30af5022 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.915396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617d72b-6b48-46e9-a325-2d6a30af5022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.918424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8617d72b-6b48-46e9-a325-2d6a30af5022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:31.960140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdbebb3c197640f8b915a091c4277bc8', 'request_id': 'req-18063966-f8a2-4631-ac6b-139e20ff26ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:31.995814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdbebb3c197640f8b915a091c4277bc8', 'request_id': 'req-18063966-f8a2-4631-ac6b-139e20ff26ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.018563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdbebb3c197640f8b915a091c4277bc8', 'request_id': 'req-18063966-f8a2-4631-ac6b-139e20ff26ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.051106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617d72b-6b48-46e9-a325-2d6a30af5022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:32.052789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617d72b-6b48-46e9-a325-2d6a30af5022 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:32.053263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] The token cache is being invalidate because project bdbebb3c197640f8b915a091c4277bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:32.053815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.055167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.057527 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1239/2446] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:31 2022] DELETE /identity/v3/projects/bdbebb3c197640f8b915a091c4277bc8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:32.061128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:32.062802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:32.066410 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1208/2447] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:03:32.157531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18063966-f8a2-4631-ac6b-139e20ff26ae admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:32.175996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362bf78-29d2-4e92-b62c-470d62523732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:32.176805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362bf78-29d2-4e92-b62c-470d62523732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:32.177181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362bf78-29d2-4e92-b62c-470d62523732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:32.177577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362bf78-29d2-4e92-b62c-470d62523732 admin admin] PATH_INFO: `/v3/users/d0a0b0460f2f412eb3c47e66515bcfc3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:32.181407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362bf78-29d2-4e92-b62c-470d62523732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a0b0460f2f412eb3c47e66515bcfc3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:32.183720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362bf78-29d2-4e92-b62c-470d62523732 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:32.245397 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:32.276973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c362bf78-29d2-4e92-b62c-470d62523732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a0b0460f2f412eb3c47e66515bcfc3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.277425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c362bf78-29d2-4e92-b62c-470d62523732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a0b0460f2f412eb3c47e66515bcfc3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.303937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c362bf78-29d2-4e92-b62c-470d62523732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a0b0460f2f412eb3c47e66515bcfc3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.321229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c362bf78-29d2-4e92-b62c-470d62523732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a0b0460f2f412eb3c47e66515bcfc3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.321929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c362bf78-29d2-4e92-b62c-470d62523732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a0b0460f2f412eb3c47e66515bcfc3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.341502 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1240/2448] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:32 2022] DELETE /identity/v3/users/d0a0b0460f2f412eb3c47e66515bcfc3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:03:32.663238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617d72b-6b48-46e9-a325-2d6a30af5022 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:32.666028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8617d72b-6b48-46e9-a325-2d6a30af5022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:32.689924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617d72b-6b48-46e9-a325-2d6a30af5022 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:32.778768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50be2f-e449-475e-861d-5870bb6c5640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:32.781577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50be2f-e449-475e-861d-5870bb6c5640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:32.782092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50be2f-e449-475e-861d-5870bb6c5640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:32.782536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50be2f-e449-475e-861d-5870bb6c5640 admin admin] PATH_INFO: `/v3/projects/9981cabbcf534912ae56b4319a05a44a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:32.786080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50be2f-e449-475e-861d-5870bb6c5640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9981cabbcf534912ae56b4319a05a44a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:32.788503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50be2f-e449-475e-861d-5870bb6c5640 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:32.849599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac50be2f-e449-475e-861d-5870bb6c5640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9981cabbcf534912ae56b4319a05a44a', 'request_id': 'req-ac50be2f-e449-475e-861d-5870bb6c5640'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.858753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac50be2f-e449-475e-861d-5870bb6c5640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9981cabbcf534912ae56b4319a05a44a', 'request_id': 'req-ac50be2f-e449-475e-861d-5870bb6c5640'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.872955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac50be2f-e449-475e-861d-5870bb6c5640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9981cabbcf534912ae56b4319a05a44a', 'request_id': 'req-ac50be2f-e449-475e-861d-5870bb6c5640'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.887020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac50be2f-e449-475e-861d-5870bb6c5640 admin admin] The token cache is being invalidate because project 9981cabbcf534912ae56b4319a05a44a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:32.887539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac50be2f-e449-475e-861d-5870bb6c5640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.888147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac50be2f-e449-475e-861d-5870bb6c5640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:32.890119 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1209/2449] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:32 2022] DELETE /identity/v3/projects/9981cabbcf534912ae56b4319a05a44a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:32.895631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcd2b3-b0b0-47a5-964b-b83adf58d757 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:32.896074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcd2b3-b0b0-47a5-964b-b83adf58d757 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:32.896345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcd2b3-b0b0-47a5-964b-b83adf58d757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:32.921699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2bfcd2b3-b0b0-47a5-964b-b83adf58d757 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:32.922831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2bfcd2b3-b0b0-47a5-964b-b83adf58d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:32.997404 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1241/2450] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:33.005592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a6eeb-52e2-49b0-a25b-2a56777e8a2b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:33.006142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a6eeb-52e2-49b0-a25b-2a56777e8a2b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:33.006618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a6eeb-52e2-49b0-a25b-2a56777e8a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:33.045667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b53a6eeb-52e2-49b0-a25b-2a56777e8a2b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:33.046906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b53a6eeb-52e2-49b0-a25b-2a56777e8a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:33.068697 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1210/2451] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:33.070003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcd2b3-b0b0-47a5-964b-b83adf58d757 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:33.087379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcd2b3-b0b0-47a5-964b-b83adf58d757 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:33.098641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df78be-45ff-4621-81cd-d152ed74ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:33.100002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df78be-45ff-4621-81cd-d152ed74ebb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:33.100871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df78be-45ff-4621-81cd-d152ed74ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:33.101608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df78be-45ff-4621-81cd-d152ed74ebb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:33.102444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df78be-45ff-4621-81cd-d152ed74ebb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:03:33.103004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df78be-45ff-4621-81cd-d152ed74ebb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:33.105041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df78be-45ff-4621-81cd-d152ed74ebb8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:33.132523 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1242/2452] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:03:33.136747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a6eeb-52e2-49b0-a25b-2a56777e8a2b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:33.152118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a6eeb-52e2-49b0-a25b-2a56777e8a2b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:33.161852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d436d1-e8b4-4b16-a9d8-a870a3e3bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:33.163509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d436d1-e8b4-4b16-a9d8-a870a3e3bcfc admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:33.165949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d436d1-e8b4-4b16-a9d8-a870a3e3bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:33.166999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d436d1-e8b4-4b16-a9d8-a870a3e3bcfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:33.169902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d436d1-e8b4-4b16-a9d8-a870a3e3bcfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:33.178172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d436d1-e8b4-4b16-a9d8-a870a3e3bcfc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:33.243663 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:33.270565 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1211/2453] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:33 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:03:33.274542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df78be-45ff-4621-81cd-d152ed74ebb8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:33.285959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df78be-45ff-4621-81cd-d152ed74ebb8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:33.376833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b02fb-8cb3-4e3d-afa8-1200cae37972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:33.377768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b02fb-8cb3-4e3d-afa8-1200cae37972 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:33.378465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b02fb-8cb3-4e3d-afa8-1200cae37972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:33.379132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b02fb-8cb3-4e3d-afa8-1200cae37972 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:33.380178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b02fb-8cb3-4e3d-afa8-1200cae37972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:33.382649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b02fb-8cb3-4e3d-afa8-1200cae37972 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:33.413732 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1243/2454] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:33 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:33.417962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d436d1-e8b4-4b16-a9d8-a870a3e3bcfc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:33.465528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d436d1-e8b4-4b16-a9d8-a870a3e3bcfc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:33.482402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f7e69-e132-4d34-aedc-8afeb79c498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:33.482959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f7e69-e132-4d34-aedc-8afeb79c498b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:33.483242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f7e69-e132-4d34-aedc-8afeb79c498b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:33.483511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f7e69-e132-4d34-aedc-8afeb79c498b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:33.484155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f7e69-e132-4d34-aedc-8afeb79c498b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:33.496346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f7e69-e132-4d34-aedc-8afeb79c498b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:33.518018 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1212/2455] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:33.519299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b02fb-8cb3-4e3d-afa8-1200cae37972 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:33.541661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b02fb-8cb3-4e3d-afa8-1200cae37972 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:33.564845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f658-f077-4279-b8f2-6263615708a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:33.566984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f658-f077-4279-b8f2-6263615708a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:33.566984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f658-f077-4279-b8f2-6263615708a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:33.566984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f658-f077-4279-b8f2-6263615708a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:33.566984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1f658-f077-4279-b8f2-6263615708a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:33.569023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1f658-f077-4279-b8f2-6263615708a6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:33.601176 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1244/2456] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:33.605029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f7e69-e132-4d34-aedc-8afeb79c498b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:33.625055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f7e69-e132-4d34-aedc-8afeb79c498b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:33.636427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398e508-f999-4a1a-ad3a-9d90a3a313fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:33.637389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398e508-f999-4a1a-ad3a-9d90a3a313fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:33.637690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398e508-f999-4a1a-ad3a-9d90a3a313fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:33.637932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398e508-f999-4a1a-ad3a-9d90a3a313fa admin admin] PATH_INFO: `/v3/projects/be9356f95149425bad7161e9c5a98779/users/86507518b8004deb9671f526d213a37f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:33.665353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398e508-f999-4a1a-ad3a-9d90a3a313fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9356f95149425bad7161e9c5a98779, user_id=86507518b8004deb9671f526d213a37f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:33.668377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398e508-f999-4a1a-ad3a-9d90a3a313fa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:33.697895 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1213/2457] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:33 2022] PUT /identity/v3/projects/be9356f95149425bad7161e9c5a98779/users/86507518b8004deb9671f526d213a37f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:33.698475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fd9eb-3185-4145-a975-4a45470b214d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:33.698765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fd9eb-3185-4145-a975-4a45470b214d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:33.700141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fd9eb-3185-4145-a975-4a45470b214d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:33.772085 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:33.793951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c28fd9eb-3185-4145-a975-4a45470b214d None None] MFA Rules not processed for user `86507518b8004deb9671f526d213a37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:33.795148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c28fd9eb-3185-4145-a975-4a45470b214d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:33.911749 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1245/2458] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:03:33.915331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398e508-f999-4a1a-ad3a-9d90a3a313fa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:34.035168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398e508-f999-4a1a-ad3a-9d90a3a313fa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:34.046204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5a3b5-0f0f-48be-b4f9-4c6ce134f81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:34.047765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5a3b5-0f0f-48be-b4f9-4c6ce134f81b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:34.048242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5a3b5-0f0f-48be-b4f9-4c6ce134f81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:34.049957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5a3b5-0f0f-48be-b4f9-4c6ce134f81b admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:34.051371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5a3b5-0f0f-48be-b4f9-4c6ce134f81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:34.054026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5a3b5-0f0f-48be-b4f9-4c6ce134f81b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:34.090395 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1214/2459] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:33 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:34.096309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fd9eb-3185-4145-a975-4a45470b214d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:34.114901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fd9eb-3185-4145-a975-4a45470b214d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:34.122539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df89e1a-4aa4-4e36-8688-9e70afff9066 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:34.122993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df89e1a-4aa4-4e36-8688-9e70afff9066 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:34.123298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df89e1a-4aa4-4e36-8688-9e70afff9066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:34.168499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2df89e1a-4aa4-4e36-8688-9e70afff9066 None None] MFA Rules not processed for user `8cd01d53807440fd827b41778a54627a`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:34.169983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2df89e1a-4aa4-4e36-8688-9e70afff9066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:34.258650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da569731-19b2-4c79-9491-85a3853d674f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:34.259293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569731-19b2-4c79-9491-85a3853d674f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:34.259686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569731-19b2-4c79-9491-85a3853d674f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:34.259874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569731-19b2-4c79-9491-85a3853d674f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:34.260517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da569731-19b2-4c79-9491-85a3853d674f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:34.262779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da569731-19b2-4c79-9491-85a3853d674f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:34.280530 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1215/2460] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:03:34.290740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023505db-54af-477f-8a13-0bab802449b2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:34.291351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023505db-54af-477f-8a13-0bab802449b2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:34.291729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023505db-54af-477f-8a13-0bab802449b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:34.308320 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1246/2461] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:34 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:34.313355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da569731-19b2-4c79-9491-85a3853d674f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:34.323745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-023505db-54af-477f-8a13-0bab802449b2 None None] MFA Rules not processed for user `8cd01d53807440fd827b41778a54627a`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:34.325865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-023505db-54af-477f-8a13-0bab802449b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:34.334998 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1216/2462] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:34.342556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da569731-19b2-4c79-9491-85a3853d674f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:34.346636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023505db-54af-477f-8a13-0bab802449b2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:34.349590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-023505db-54af-477f-8a13-0bab802449b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:34.350446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd7896-446d-4869-b286-607f9c8849f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:34.351068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd7896-446d-4869-b286-607f9c8849f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:34.351347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd7896-446d-4869-b286-607f9c8849f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:34.351622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd7896-446d-4869-b286-607f9c8849f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:34.352269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd7896-446d-4869-b286-607f9c8849f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:34.355092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd7896-446d-4869-b286-607f9c8849f5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:34.371333 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1247/2463] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:34.372578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd7896-446d-4869-b286-607f9c8849f5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:34.397455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd7896-446d-4869-b286-607f9c8849f5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:34.411145 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:34.413546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac1a3c-386f-4d6d-84c7-2eac0d07d894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:34.414443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac1a3c-386f-4d6d-84c7-2eac0d07d894 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:34.414875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac1a3c-386f-4d6d-84c7-2eac0d07d894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:34.415242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac1a3c-386f-4d6d-84c7-2eac0d07d894 admin admin] PATH_INFO: `/v3/projects/93365404dd2b40d3aefa4f1fbd5417aa/users/487be91079b94d7998af67b0f4d4608b/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:34.461572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac1a3c-386f-4d6d-84c7-2eac0d07d894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93365404dd2b40d3aefa4f1fbd5417aa, user_id=487be91079b94d7998af67b0f4d4608b, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:34.464774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac1a3c-386f-4d6d-84c7-2eac0d07d894 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:34.499897 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1248/2464] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:34 2022] PUT /identity/v3/projects/93365404dd2b40d3aefa4f1fbd5417aa/users/487be91079b94d7998af67b0f4d4608b/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:34.505037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac1a3c-386f-4d6d-84c7-2eac0d07d894 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:34.507631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023505db-54af-477f-8a13-0bab802449b2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:34.640262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d001f40-db59-478a-a339-4dea86d2b8a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:34.640896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d001f40-db59-478a-a339-4dea86d2b8a6 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:34.641196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d001f40-db59-478a-a339-4dea86d2b8a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:34.641732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d001f40-db59-478a-a339-4dea86d2b8a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:34.655958 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:34.677807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac1a3c-386f-4d6d-84c7-2eac0d07d894 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:34.691553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5f3ac-2f49-455c-9f7f-c0b887eeeb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:34.692174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5f3ac-2f49-455c-9f7f-c0b887eeeb2f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:34.692448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5f3ac-2f49-455c-9f7f-c0b887eeeb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:34.699433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5f3ac-2f49-455c-9f7f-c0b887eeeb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:34.700161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5f3ac-2f49-455c-9f7f-c0b887eeeb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:34.701786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5f3ac-2f49-455c-9f7f-c0b887eeeb2f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:34.767877 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1249/2465] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:34.771699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5f3ac-2f49-455c-9f7f-c0b887eeeb2f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:34.804079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5f3ac-2f49-455c-9f7f-c0b887eeeb2f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:34.817562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5ab1-5846-4514-aacf-5cd2bbe81bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:34.818230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5ab1-5846-4514-aacf-5cd2bbe81bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:34.818510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5ab1-5846-4514-aacf-5cd2bbe81bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:34.818785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5ab1-5846-4514-aacf-5cd2bbe81bf6 admin admin] PATH_INFO: `/v3/projects/93365404dd2b40d3aefa4f1fbd5417aa/users/487be91079b94d7998af67b0f4d4608b/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:34.823647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5ab1-5846-4514-aacf-5cd2bbe81bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93365404dd2b40d3aefa4f1fbd5417aa, user_id=487be91079b94d7998af67b0f4d4608b, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:34.833108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5ab1-5846-4514-aacf-5cd2bbe81bf6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:34.843061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d001f40-db59-478a-a339-4dea86d2b8a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:34.849548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d001f40-db59-478a-a339-4dea86d2b8a6 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:34.860746 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1250/2466] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:34 2022] PUT /identity/v3/projects/93365404dd2b40d3aefa4f1fbd5417aa/users/487be91079b94d7998af67b0f4d4608b/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:34.872248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b57a3-e5d8-4feb-aadd-f206c599ef94 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:34.872626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b57a3-e5d8-4feb-aadd-f206c599ef94 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:34.872827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b57a3-e5d8-4feb-aadd-f206c599ef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:34.881938 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1217/2467] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:34.906594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d07b57a3-e5d8-4feb-aadd-f206c599ef94 None None] MFA Rules not processed for user `487be91079b94d7998af67b0f4d4608b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:34.908740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d07b57a3-e5d8-4feb-aadd-f206c599ef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:35.072091 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1251/2468] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:03:36.066357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d001f40-db59-478a-a339-4dea86d2b8a6 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:36.086950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d001f40-db59-478a-a339-4dea86d2b8a6 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:36.216580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f14bf-8b0a-47cd-889d-8896bef8153b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:36.217959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f14bf-8b0a-47cd-889d-8896bef8153b service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:36.218240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f14bf-8b0a-47cd-889d-8896bef8153b service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:36.218509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f14bf-8b0a-47cd-889d-8896bef8153b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:36.229802 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:36.234130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f14bf-8b0a-47cd-889d-8896bef8153b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:36.237120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f14bf-8b0a-47cd-889d-8896bef8153b service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:36.249605 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1218/2469] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:37.403444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b57a3-e5d8-4feb-aadd-f206c599ef94 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:37.571833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b57a3-e5d8-4feb-aadd-f206c599ef94 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:37.583952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:37.584867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:37.588023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:37.588555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] PATH_INFO: `/v3/users/86507518b8004deb9671f526d213a37f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:37.592036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=86507518b8004deb9671f526d213a37f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:37.601874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:37.722309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86507518b8004deb9671f526d213a37f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:37.724623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86507518b8004deb9671f526d213a37f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:37.741809 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:37.743782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86507518b8004deb9671f526d213a37f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:37.754518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86507518b8004deb9671f526d213a37f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:37.756011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86507518b8004deb9671f526d213a37f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:37.803688 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1252/2470] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:37 2022] DELETE /identity/v3/users/86507518b8004deb9671f526d213a37f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:37.808324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edce2b4-53d7-4f3c-817e-c4ff53c06a2a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:37.808850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edce2b4-53d7-4f3c-817e-c4ff53c06a2a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:37.808850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edce2b4-53d7-4f3c-817e-c4ff53c06a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:37.837316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0edce2b4-53d7-4f3c-817e-c4ff53c06a2a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:37.838486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0edce2b4-53d7-4f3c-817e-c4ff53c06a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:38.010571 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1219/2471] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:38.024546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:38.026099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:38.170150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edce2b4-53d7-4f3c-817e-c4ff53c06a2a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:38.171827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0edce2b4-53d7-4f3c-817e-c4ff53c06a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:38.205834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0092b60-2ded-4c23-842a-02c8d83b41dc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:38.219883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2660a55-78ea-4bad-8bd8-7d19af4673cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:38.222080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2660a55-78ea-4bad-8bd8-7d19af4673cf service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:38.224293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2660a55-78ea-4bad-8bd8-7d19af4673cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:38.225598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2660a55-78ea-4bad-8bd8-7d19af4673cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:38.244791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2660a55-78ea-4bad-8bd8-7d19af4673cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:38.246512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2660a55-78ea-4bad-8bd8-7d19af4673cf service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:38.260714 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1253/2472] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:38.375302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edce2b4-53d7-4f3c-817e-c4ff53c06a2a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:38.384827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1c73a-9527-4ed9-bf9d-8a492b4f5bd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:38.385641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1c73a-9527-4ed9-bf9d-8a492b4f5bd9 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:38.386034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1c73a-9527-4ed9-bf9d-8a492b4f5bd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:38.386410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1c73a-9527-4ed9-bf9d-8a492b4f5bd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:38.392661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7fa1c73a-9527-4ed9-bf9d-8a492b4f5bd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:38.575667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1c73a-9527-4ed9-bf9d-8a492b4f5bd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:38.577684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1c73a-9527-4ed9-bf9d-8a492b4f5bd9 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:38.598294 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1220/2473] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:03:39.183324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2660a55-78ea-4bad-8bd8-7d19af4673cf service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:39.184935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c2660a55-78ea-4bad-8bd8-7d19af4673cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:39.212991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2660a55-78ea-4bad-8bd8-7d19af4673cf service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:39.230569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:39.231248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:39.231531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:39.231805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6 admin admin] PATH_INFO: `/v3/projects/be9356f95149425bad7161e9c5a98779` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:39.233352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9356f95149425bad7161e9c5a98779)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:39.235630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:39.353712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9356f95149425bad7161e9c5a98779', 'request_id': 'req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:39.362611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9356f95149425bad7161e9c5a98779', 'request_id': 'req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:39.374139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9356f95149425bad7161e9c5a98779', 'request_id': 'req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:39.391311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6 admin admin] The token cache is being invalidate because project be9356f95149425bad7161e9c5a98779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:39.391625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:39.392333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-de9576f0-a19f-4bd6-8f89-e02df8fe38b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:39.394775 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1254/2474] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:39 2022] DELETE /identity/v3/projects/be9356f95149425bad7161e9c5a98779 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:39.399175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1c73a-9527-4ed9-bf9d-8a492b4f5bd9 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:39.418580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1c73a-9527-4ed9-bf9d-8a492b4f5bd9 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:39.471635 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:39.524310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:39.525212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:39.525587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:39.527357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] PATH_INFO: `/v3/users/487be91079b94d7998af67b0f4d4608b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:39.528714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=487be91079b94d7998af67b0f4d4608b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:39.531677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:39.638284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '487be91079b94d7998af67b0f4d4608b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:39.639255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '487be91079b94d7998af67b0f4d4608b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:39.658225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '487be91079b94d7998af67b0f4d4608b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:39.670851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '487be91079b94d7998af67b0f4d4608b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:39.671851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '487be91079b94d7998af67b0f4d4608b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:39.690433 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1221/2475] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:39 2022] DELETE /identity/v3/users/487be91079b94d7998af67b0f4d4608b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:03:40.198252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1069455-7990-481a-b06d-26f6c7e685df None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:40.198905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1069455-7990-481a-b06d-26f6c7e685df None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:40.199289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1069455-7990-481a-b06d-26f6c7e685df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:40.264159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e1069455-7990-481a-b06d-26f6c7e685df None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:40.272535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e1069455-7990-481a-b06d-26f6c7e685df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:40.414382 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1255/2476] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:03:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:40.468503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:40.470698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:40.708267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1706db-fe65-4214-86c1-4f194c4cec1b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:40.715961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd034174-941e-41b9-9726-98fe702ee091 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:40.716815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd034174-941e-41b9-9726-98fe702ee091 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:40.718240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd034174-941e-41b9-9726-98fe702ee091 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:40.718240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd034174-941e-41b9-9726-98fe702ee091 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:40.746857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd034174-941e-41b9-9726-98fe702ee091 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:40.750793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd034174-941e-41b9-9726-98fe702ee091 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:40.783182 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1222/2477] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:03:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:41.404715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1069455-7990-481a-b06d-26f6c7e685df None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:41.407424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e1069455-7990-481a-b06d-26f6c7e685df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:41.455132 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:41.668702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1069455-7990-481a-b06d-26f6c7e685df None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:41.681533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac352c4-6864-436f-8d2c-7fd7585263ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:41.683699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac352c4-6864-436f-8d2c-7fd7585263ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:41.685467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac352c4-6864-436f-8d2c-7fd7585263ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:41.685943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac352c4-6864-436f-8d2c-7fd7585263ee admin admin] PATH_INFO: `/v3/projects/93365404dd2b40d3aefa4f1fbd5417aa` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:41.690562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac352c4-6864-436f-8d2c-7fd7585263ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=93365404dd2b40d3aefa4f1fbd5417aa)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:41.694790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac352c4-6864-436f-8d2c-7fd7585263ee admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:41.842537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eac352c4-6864-436f-8d2c-7fd7585263ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93365404dd2b40d3aefa4f1fbd5417aa', 'request_id': 'req-eac352c4-6864-436f-8d2c-7fd7585263ee'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:41.861478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eac352c4-6864-436f-8d2c-7fd7585263ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93365404dd2b40d3aefa4f1fbd5417aa', 'request_id': 'req-eac352c4-6864-436f-8d2c-7fd7585263ee'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:41.882102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eac352c4-6864-436f-8d2c-7fd7585263ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93365404dd2b40d3aefa4f1fbd5417aa', 'request_id': 'req-eac352c4-6864-436f-8d2c-7fd7585263ee'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:41.913630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eac352c4-6864-436f-8d2c-7fd7585263ee admin admin] The token cache is being invalidate because project 93365404dd2b40d3aefa4f1fbd5417aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:41.917573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eac352c4-6864-436f-8d2c-7fd7585263ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:41.921959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eac352c4-6864-436f-8d2c-7fd7585263ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:41.943963 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1256/2478] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:41 2022] DELETE /identity/v3/projects/93365404dd2b40d3aefa4f1fbd5417aa => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:41.944082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a9fee-6606-441e-a679-4caf96afa206 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:41.944082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a9fee-6606-441e-a679-4caf96afa206 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:41.944082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a9fee-6606-441e-a679-4caf96afa206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:41.997669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ac0a9fee-6606-441e-a679-4caf96afa206 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:41.998898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ac0a9fee-6606-441e-a679-4caf96afa206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:42.088570 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:42.165056 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1223/2479] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:42.174321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fee45-bc2f-4ea6-8eb6-91825f31d498 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:42.174885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fee45-bc2f-4ea6-8eb6-91825f31d498 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:42.175196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fee45-bc2f-4ea6-8eb6-91825f31d498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:42.210346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d82fee45-bc2f-4ea6-8eb6-91825f31d498 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:42.211669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d82fee45-bc2f-4ea6-8eb6-91825f31d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:42.228625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a9fee-6606-441e-a679-4caf96afa206 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:42.235385 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1257/2480] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:03:42.256227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a9fee-6606-441e-a679-4caf96afa206 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:42.268860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f56b2e-fe8e-4317-8067-6bbcf91128bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:42.269788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56b2e-fe8e-4317-8067-6bbcf91128bd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:42.270846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56b2e-fe8e-4317-8067-6bbcf91128bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:42.271139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56b2e-fe8e-4317-8067-6bbcf91128bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:42.272940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f56b2e-fe8e-4317-8067-6bbcf91128bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:03:42.273260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f56b2e-fe8e-4317-8067-6bbcf91128bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:42.277195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f56b2e-fe8e-4317-8067-6bbcf91128bd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:42.312790 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1224/2481] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:03:42.313997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fee45-bc2f-4ea6-8eb6-91825f31d498 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:42.325371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fee45-bc2f-4ea6-8eb6-91825f31d498 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:42.338674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717438e2-64cd-4e48-896a-97593e98730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:42.339743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717438e2-64cd-4e48-896a-97593e98730e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:42.340194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717438e2-64cd-4e48-896a-97593e98730e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:42.340662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717438e2-64cd-4e48-896a-97593e98730e admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:42.341458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717438e2-64cd-4e48-896a-97593e98730e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:42.346522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717438e2-64cd-4e48-896a-97593e98730e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:42.410139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f56b2e-fe8e-4317-8067-6bbcf91128bd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:42.411025 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1258/2482] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:42 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:42.425099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f56b2e-fe8e-4317-8067-6bbcf91128bd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:42.578539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c954d-c8e6-4e4f-b28c-09ae2da61b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:42.579216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c954d-c8e6-4e4f-b28c-09ae2da61b42 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:42.579513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c954d-c8e6-4e4f-b28c-09ae2da61b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:42.579790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c954d-c8e6-4e4f-b28c-09ae2da61b42 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:42.580423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c954d-c8e6-4e4f-b28c-09ae2da61b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:42.582574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c954d-c8e6-4e4f-b28c-09ae2da61b42 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:42.633030 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1225/2483] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:42 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:42.637367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717438e2-64cd-4e48-896a-97593e98730e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:42.662659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717438e2-64cd-4e48-896a-97593e98730e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:42.693144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31620ed-84ca-4ac4-9a8e-dbbec1190f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:42.694659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31620ed-84ca-4ac4-9a8e-dbbec1190f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:42.700915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31620ed-84ca-4ac4-9a8e-dbbec1190f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:42.700915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31620ed-84ca-4ac4-9a8e-dbbec1190f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:42.700915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31620ed-84ca-4ac4-9a8e-dbbec1190f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:42.706164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31620ed-84ca-4ac4-9a8e-dbbec1190f11 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:42.735726 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1259/2484] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:42.740145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c954d-c8e6-4e4f-b28c-09ae2da61b42 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:42.751124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c954d-c8e6-4e4f-b28c-09ae2da61b42 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:42.776607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0936970-de45-4975-906e-e98f0e505146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:42.776823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0936970-de45-4975-906e-e98f0e505146 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:42.777104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0936970-de45-4975-906e-e98f0e505146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:42.777370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0936970-de45-4975-906e-e98f0e505146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:42.778015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0936970-de45-4975-906e-e98f0e505146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:42.784099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0936970-de45-4975-906e-e98f0e505146 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:42.809323 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1226/2485] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:42.814249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31620ed-84ca-4ac4-9a8e-dbbec1190f11 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:42.836006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31620ed-84ca-4ac4-9a8e-dbbec1190f11 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:42.853015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc095a16-c6e2-4896-94c7-7a806af3e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:42.853911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc095a16-c6e2-4896-94c7-7a806af3e92e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:42.854553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc095a16-c6e2-4896-94c7-7a806af3e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:42.855106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc095a16-c6e2-4896-94c7-7a806af3e92e admin admin] PATH_INFO: `/v3/projects/05a68224ef104af2963c881faa8383de/users/3c33afd9ae144eb185203c30baa70351/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:42.895708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc095a16-c6e2-4896-94c7-7a806af3e92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a68224ef104af2963c881faa8383de, user_id=3c33afd9ae144eb185203c30baa70351, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:42.898540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc095a16-c6e2-4896-94c7-7a806af3e92e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:42.965730 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1260/2486] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:42 2022] PUT /identity/v3/projects/05a68224ef104af2963c881faa8383de/users/3c33afd9ae144eb185203c30baa70351/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:42.971469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3788f-ce10-4060-82c8-09ef37707cd7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:42.971998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3788f-ce10-4060-82c8-09ef37707cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:42.972246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3788f-ce10-4060-82c8-09ef37707cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:43.007213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d9c3788f-ce10-4060-82c8-09ef37707cd7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:43.009327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d9c3788f-ce10-4060-82c8-09ef37707cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:43.136779 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1227/2487] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:43.147918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc095a16-c6e2-4896-94c7-7a806af3e92e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:43.150252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dc095a16-c6e2-4896-94c7-7a806af3e92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:43.338286 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:43.390393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc095a16-c6e2-4896-94c7-7a806af3e92e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:43.402956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c78e2-836e-48d1-9293-8f7845429a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:43.404229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c78e2-836e-48d1-9293-8f7845429a19 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:43.404229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c78e2-836e-48d1-9293-8f7845429a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:43.404229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c78e2-836e-48d1-9293-8f7845429a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:43.430867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c78e2-836e-48d1-9293-8f7845429a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:43.433042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c78e2-836e-48d1-9293-8f7845429a19 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:43.471615 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1261/2488] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:03:53.126778 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:53.447170 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=9 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:54.088923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7c42c-c9da-4a85-b9aa-dc1282ab582a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:54.089209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7c42c-c9da-4a85-b9aa-dc1282ab582a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:54.089492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7c42c-c9da-4a85-b9aa-dc1282ab582a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:54.214848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-80b7c42c-c9da-4a85-b9aa-dc1282ab582a None None] MFA Rules not processed for user `3c33afd9ae144eb185203c30baa70351`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:54.217085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-80b7c42c-c9da-4a85-b9aa-dc1282ab582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:54.383512 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1228/2489] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:03:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:54.388267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c78e2-836e-48d1-9293-8f7845429a19 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:54.400651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c78e2-836e-48d1-9293-8f7845429a19 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:54.421768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aeebcb-03db-49a5-95d5-1dd20b9c007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:54.425041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeebcb-03db-49a5-95d5-1dd20b9c007b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:54.425342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeebcb-03db-49a5-95d5-1dd20b9c007b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:54.425597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeebcb-03db-49a5-95d5-1dd20b9c007b admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:54.426276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aeebcb-03db-49a5-95d5-1dd20b9c007b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:54.437299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aeebcb-03db-49a5-95d5-1dd20b9c007b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:54.560125 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1262/2490] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:54 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:54.561898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7c42c-c9da-4a85-b9aa-dc1282ab582a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:54.584461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7c42c-c9da-4a85-b9aa-dc1282ab582a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:54.731964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f7ae6-c5f2-48e8-9044-3756e21f15ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:54.732894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f7ae6-c5f2-48e8-9044-3756e21f15ba admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:54.733180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f7ae6-c5f2-48e8-9044-3756e21f15ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:54.733453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f7ae6-c5f2-48e8-9044-3756e21f15ba admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:54.734166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f7ae6-c5f2-48e8-9044-3756e21f15ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:54.736702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f7ae6-c5f2-48e8-9044-3756e21f15ba admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:54.796448 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1229/2491] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:54 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:54.796920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aeebcb-03db-49a5-95d5-1dd20b9c007b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:54.821488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aeebcb-03db-49a5-95d5-1dd20b9c007b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:54.835825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd10e01-9943-47b1-bfb7-3de01d43993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:54.837891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd10e01-9943-47b1-bfb7-3de01d43993b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:54.838628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd10e01-9943-47b1-bfb7-3de01d43993b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:54.840768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd10e01-9943-47b1-bfb7-3de01d43993b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:54.858564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd10e01-9943-47b1-bfb7-3de01d43993b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:54.862032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd10e01-9943-47b1-bfb7-3de01d43993b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:54.889128 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1263/2492] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:54.893809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f7ae6-c5f2-48e8-9044-3756e21f15ba admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:54.934314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f7ae6-c5f2-48e8-9044-3756e21f15ba admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:54.968580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa262ca-5ec5-4e05-89b1-f098cedc94bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:54.975921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa262ca-5ec5-4e05-89b1-f098cedc94bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:54.976944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa262ca-5ec5-4e05-89b1-f098cedc94bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:54.978116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa262ca-5ec5-4e05-89b1-f098cedc94bd admin admin] PATH_INFO: `/v3/projects/d52b6331f10047d893139c0cbfbc8b97/users/f763fa3c3d314867b792913013b65505/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:55.031825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa262ca-5ec5-4e05-89b1-f098cedc94bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52b6331f10047d893139c0cbfbc8b97, user_id=f763fa3c3d314867b792913013b65505, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:55.047420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa262ca-5ec5-4e05-89b1-f098cedc94bd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:55.079229 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1230/2493] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:54 2022] PUT /identity/v3/projects/d52b6331f10047d893139c0cbfbc8b97/users/f763fa3c3d314867b792913013b65505/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:55.083796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd10e01-9943-47b1-bfb7-3de01d43993b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:55.099921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd10e01-9943-47b1-bfb7-3de01d43993b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:55.258709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166e0f8-8a55-47d2-806d-96b3dfac7b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:55.259622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166e0f8-8a55-47d2-806d-96b3dfac7b81 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:55.259820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166e0f8-8a55-47d2-806d-96b3dfac7b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:55.260098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166e0f8-8a55-47d2-806d-96b3dfac7b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:55.260746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166e0f8-8a55-47d2-806d-96b3dfac7b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:55.264227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166e0f8-8a55-47d2-806d-96b3dfac7b81 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:55.298032 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1264/2494] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:55.302316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa262ca-5ec5-4e05-89b1-f098cedc94bd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:55.317711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa262ca-5ec5-4e05-89b1-f098cedc94bd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:55.346267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a67d0-bca3-488f-a2c1-a6ad28306c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:55.347006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a67d0-bca3-488f-a2c1-a6ad28306c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:55.347267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a67d0-bca3-488f-a2c1-a6ad28306c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:55.347538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a67d0-bca3-488f-a2c1-a6ad28306c90 admin admin] PATH_INFO: `/v3/projects/d52b6331f10047d893139c0cbfbc8b97/users/f763fa3c3d314867b792913013b65505/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:55.354607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a67d0-bca3-488f-a2c1-a6ad28306c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52b6331f10047d893139c0cbfbc8b97, user_id=f763fa3c3d314867b792913013b65505, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:55.357791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a67d0-bca3-488f-a2c1-a6ad28306c90 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:55.412437 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1231/2495] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:55 2022] PUT /identity/v3/projects/d52b6331f10047d893139c0cbfbc8b97/users/f763fa3c3d314867b792913013b65505/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:01.566744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d586-9527-4a11-a3a8-52baa97145de None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:01.567283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d586-9527-4a11-a3a8-52baa97145de None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:01.567403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d586-9527-4a11-a3a8-52baa97145de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:01.639748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-79e6d586-9527-4a11-a3a8-52baa97145de None None] MFA Rules not processed for user `8cd01d53807440fd827b41778a54627a`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:01.645230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79e6d586-9527-4a11-a3a8-52baa97145de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:02.001120 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1265/2496] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:04:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:05.377837 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:06.780100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b8858-9d87-42db-9e5b-e1038b35b624 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:06.783680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b8858-9d87-42db-9e5b-e1038b35b624 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:06.784402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b8858-9d87-42db-9e5b-e1038b35b624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:06.870540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7b6b8858-9d87-42db-9e5b-e1038b35b624 None None] MFA Rules not processed for user `f763fa3c3d314867b792913013b65505`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:06.871848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b6b8858-9d87-42db-9e5b-e1038b35b624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:07.072819 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1232/2497] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:04:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:07.081028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5382793-cd3a-4a40-9177-ed8d273f5256 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:07.082012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5382793-cd3a-4a40-9177-ed8d273f5256 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:07.082421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5382793-cd3a-4a40-9177-ed8d273f5256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:07.120224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b5382793-cd3a-4a40-9177-ed8d273f5256 None None] MFA Rules not processed for user `3c33afd9ae144eb185203c30baa70351`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:07.121915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b5382793-cd3a-4a40-9177-ed8d273f5256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:07.239396 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1266/2498] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:04:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:07.248126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b8858-9d87-42db-9e5b-e1038b35b624 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:07.249571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b6b8858-9d87-42db-9e5b-e1038b35b624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:07.383846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b8858-9d87-42db-9e5b-e1038b35b624 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:07.412117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d915-ac86-46c3-9b33-b09fd0a3c6b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:07.413750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d915-ac86-46c3-9b33-b09fd0a3c6b2 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:07.415245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d915-ac86-46c3-9b33-b09fd0a3c6b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:07.415640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d915-ac86-46c3-9b33-b09fd0a3c6b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:07.440096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d915-ac86-46c3-9b33-b09fd0a3c6b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:07.441998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d915-ac86-46c3-9b33-b09fd0a3c6b2 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:07.469817 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1233/2499] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:09.030281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5382793-cd3a-4a40-9177-ed8d273f5256 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:09.072915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5382793-cd3a-4a40-9177-ed8d273f5256 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:09.081376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d7d4f-3456-4f25-ab04-ce236ffd67e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:09.083169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d7d4f-3456-4f25-ab04-ce236ffd67e2 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:09.083611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d7d4f-3456-4f25-ab04-ce236ffd67e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:09.084031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d7d4f-3456-4f25-ab04-ce236ffd67e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:09.087511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-287d7d4f-3456-4f25-ab04-ce236ffd67e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:09.123511 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:09.226893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d7d4f-3456-4f25-ab04-ce236ffd67e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:09.232559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d7d4f-3456-4f25-ab04-ce236ffd67e2 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:09.257187 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1267/2500] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:10.781657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89519e-b580-40a8-a89e-291159a03cb2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:10.782132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89519e-b580-40a8-a89e-291159a03cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:10.782356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89519e-b580-40a8-a89e-291159a03cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:10.835401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1b89519e-b580-40a8-a89e-291159a03cb2 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:10.837369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1b89519e-b580-40a8-a89e-291159a03cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:10.919702 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1234/2501] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:04:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:10.939805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d7d4f-3456-4f25-ab04-ce236ffd67e2 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:10.942113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-287d7d4f-3456-4f25-ab04-ce236ffd67e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:11.150630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d7d4f-3456-4f25-ab04-ce236ffd67e2 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:11.164394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d134d5f-1a98-4a56-b5d4-19966428a990 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:11.165309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d134d5f-1a98-4a56-b5d4-19966428a990 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:11.165771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d134d5f-1a98-4a56-b5d4-19966428a990 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:11.166532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d134d5f-1a98-4a56-b5d4-19966428a990 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:11.193621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d134d5f-1a98-4a56-b5d4-19966428a990 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:11.195510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d134d5f-1a98-4a56-b5d4-19966428a990 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:11.228961 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1268/2502] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:04:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:17.003581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beabfa-cded-489e-877e-7b78640c8d06 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:17.004108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beabfa-cded-489e-877e-7b78640c8d06 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:17.004369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beabfa-cded-489e-877e-7b78640c8d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:17.044059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c6beabfa-cded-489e-877e-7b78640c8d06 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:17.045944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c6beabfa-cded-489e-877e-7b78640c8d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:17.065270 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1235/2503] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:04:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:17.077378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d134d5f-1a98-4a56-b5d4-19966428a990 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:17.097828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d134d5f-1a98-4a56-b5d4-19966428a990 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:17.115329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42dcd0-42fd-449a-9d69-d1a19b9900a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:17.116275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42dcd0-42fd-449a-9d69-d1a19b9900a1 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:17.116768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42dcd0-42fd-449a-9d69-d1a19b9900a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:17.117411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42dcd0-42fd-449a-9d69-d1a19b9900a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:17.139613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42dcd0-42fd-449a-9d69-d1a19b9900a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:17.145569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42dcd0-42fd-449a-9d69-d1a19b9900a1 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:17.168291 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1269/2504] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:04:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:27.037624 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:27.163618 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=62 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:29.275622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91edf1-413f-4c84-bb95-01aa5e1b4231 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:29.276567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91edf1-413f-4c84-bb95-01aa5e1b4231 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:29.276991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91edf1-413f-4c84-bb95-01aa5e1b4231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:29.301770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-aa91edf1-413f-4c84-bb95-01aa5e1b4231 None None] MFA Rules not processed for user `aceec71835c14681a2ff7d7285d87776`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:29.303288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aa91edf1-413f-4c84-bb95-01aa5e1b4231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:29.391288 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1236/2505] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:04:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:30.080434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc73baf-3dc6-4bf8-9df5-bf315614e588 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:30.081009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc73baf-3dc6-4bf8-9df5-bf315614e588 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:30.081009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc73baf-3dc6-4bf8-9df5-bf315614e588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:30.101661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1fc73baf-3dc6-4bf8-9df5-bf315614e588 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:30.102877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1fc73baf-3dc6-4bf8-9df5-bf315614e588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:30.121114 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1270/2506] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:04:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:30.140079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91edf1-413f-4c84-bb95-01aa5e1b4231 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:30.153537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91edf1-413f-4c84-bb95-01aa5e1b4231 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:30.159103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c7c31-54aa-4e2d-b7b1-98925e946de7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:30.159733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c7c31-54aa-4e2d-b7b1-98925e946de7 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:30.159997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c7c31-54aa-4e2d-b7b1-98925e946de7 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:30.160334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c7c31-54aa-4e2d-b7b1-98925e946de7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:30.170152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c7c31-54aa-4e2d-b7b1-98925e946de7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:30.172096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c7c31-54aa-4e2d-b7b1-98925e946de7 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:30.184992 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1237/2507] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:04:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:32.046497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe395-860f-4f22-adb7-cd80480fb47e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:32.048868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe395-860f-4f22-adb7-cd80480fb47e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:32.049245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe395-860f-4f22-adb7-cd80480fb47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:32.092027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0b9fe395-860f-4f22-adb7-cd80480fb47e None None] MFA Rules not processed for user `f3b14e05c41648159d8ed97719c68862`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:32.095644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0b9fe395-860f-4f22-adb7-cd80480fb47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:32.230337 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1271/2508] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:04:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:32.255784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876be856-d931-4d7e-aee3-717f2a94a58a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:32.256298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876be856-d931-4d7e-aee3-717f2a94a58a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:32.256383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876be856-d931-4d7e-aee3-717f2a94a58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:32.279661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-876be856-d931-4d7e-aee3-717f2a94a58a None None] MFA Rules not processed for user `875dca9ed4914e379601ddbdba035cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:32.281071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-876be856-d931-4d7e-aee3-717f2a94a58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:32.381754 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1238/2509] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:04:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:39.236369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fe395-860f-4f22-adb7-cd80480fb47e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:39.256098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fe395-860f-4f22-adb7-cd80480fb47e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:39.271835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be7885-29f5-4184-9031-2d8de4bf6165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:39.274752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be7885-29f5-4184-9031-2d8de4bf6165 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:39.278236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be7885-29f5-4184-9031-2d8de4bf6165 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:39.279326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be7885-29f5-4184-9031-2d8de4bf6165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:39.289207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be7885-29f5-4184-9031-2d8de4bf6165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:39.291078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be7885-29f5-4184-9031-2d8de4bf6165 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:39.304126 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1272/2510] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:42.374583 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=56 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:42.600812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473d154-c6b0-46d9-84c9-6cb6fd134911 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:42.601352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473d154-c6b0-46d9-84c9-6cb6fd134911 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:42.601776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473d154-c6b0-46d9-84c9-6cb6fd134911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:42.635887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a473d154-c6b0-46d9-84c9-6cb6fd134911 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:42.637379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a473d154-c6b0-46d9-84c9-6cb6fd134911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:42.660294 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1239/2511] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:42.724041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be7885-29f5-4184-9031-2d8de4bf6165 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:42.732027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f5be7885-29f5-4184-9031-2d8de4bf6165 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:42.833875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be7885-29f5-4184-9031-2d8de4bf6165 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:42.838765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf2e5b-17f8-4fdd-a6b4-3531e3e3d29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:42.839801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf2e5b-17f8-4fdd-a6b4-3531e3e3d29f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:42.840287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf2e5b-17f8-4fdd-a6b4-3531e3e3d29f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:42.840792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf2e5b-17f8-4fdd-a6b4-3531e3e3d29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:42.870186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf2e5b-17f8-4fdd-a6b4-3531e3e3d29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:42.873268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf2e5b-17f8-4fdd-a6b4-3531e3e3d29f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:42.889580 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1273/2512] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:44.349709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13604b3d-bda4-444b-861a-d629ee672d89 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:44.350186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13604b3d-bda4-444b-861a-d629ee672d89 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:44.351022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13604b3d-bda4-444b-861a-d629ee672d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:44.387960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-13604b3d-bda4-444b-861a-d629ee672d89 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:44.389072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-13604b3d-bda4-444b-861a-d629ee672d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:44.398879 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1240/2513] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:04:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:44.411394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf2e5b-17f8-4fdd-a6b4-3531e3e3d29f service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:44.426306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf2e5b-17f8-4fdd-a6b4-3531e3e3d29f service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:44.432613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e0a72-9710-4a11-a914-5d79efbf608e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:44.433243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e0a72-9710-4a11-a914-5d79efbf608e service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:44.433918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e0a72-9710-4a11-a914-5d79efbf608e service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:44.434447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e0a72-9710-4a11-a914-5d79efbf608e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:44.461875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e0a72-9710-4a11-a914-5d79efbf608e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:44.470434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e0a72-9710-4a11-a914-5d79efbf608e service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:44.492069 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1274/2514] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:04:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:54.383115 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:54.481671 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=66 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:05.053646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dff67-c813-4660-9121-8af1b2537bff None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:05.054293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dff67-c813-4660-9121-8af1b2537bff None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:05.054293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dff67-c813-4660-9121-8af1b2537bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:05.087791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a65dff67-c813-4660-9121-8af1b2537bff None None] MFA Rules not processed for user `3c33afd9ae144eb185203c30baa70351`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:05.090625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a65dff67-c813-4660-9121-8af1b2537bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:05.111389 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1241/2515] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:07.166334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e466caa-daf2-4dda-84c4-1af5f757af4c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:07.166832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e466caa-daf2-4dda-84c4-1af5f757af4c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:07.166952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e466caa-daf2-4dda-84c4-1af5f757af4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:07.194390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9e466caa-daf2-4dda-84c4-1af5f757af4c None None] MFA Rules not processed for user `5f46ddd0268d44bfacff0400e3f38e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:07.196186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9e466caa-daf2-4dda-84c4-1af5f757af4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:07.314401 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1275/2516] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:10.136966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d19a2f-7a03-44f5-9cff-140080694a8f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:10.137474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d19a2f-7a03-44f5-9cff-140080694a8f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:10.137715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d19a2f-7a03-44f5-9cff-140080694a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:10.170079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d5d19a2f-7a03-44f5-9cff-140080694a8f None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:10.173860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d5d19a2f-7a03-44f5-9cff-140080694a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:10.198484 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1242/2517] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:05:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:10.247536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e466caa-daf2-4dda-84c4-1af5f757af4c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:10.273991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e466caa-daf2-4dda-84c4-1af5f757af4c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:10.282136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fa6c2-3e3b-4d93-8b07-9e0be05b6dcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:10.283486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fa6c2-3e3b-4d93-8b07-9e0be05b6dcd service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:10.284019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fa6c2-3e3b-4d93-8b07-9e0be05b6dcd service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:10.284517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fa6c2-3e3b-4d93-8b07-9e0be05b6dcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:10.315226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fa6c2-3e3b-4d93-8b07-9e0be05b6dcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:10.318233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fa6c2-3e3b-4d93-8b07-9e0be05b6dcd service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:10.335199 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1276/2518] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:05:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:11.542442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d19a2f-7a03-44f5-9cff-140080694a8f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:11.566884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d19a2f-7a03-44f5-9cff-140080694a8f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:11.571252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0e207-2964-4232-9899-a8e291170863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:11.571868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0e207-2964-4232-9899-a8e291170863 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:11.572362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0e207-2964-4232-9899-a8e291170863 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:11.572849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0e207-2964-4232-9899-a8e291170863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:11.574123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea44e3e-bebb-40c6-a1d1-5ca50ab5e5a6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:11.574598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea44e3e-bebb-40c6-a1d1-5ca50ab5e5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:11.574683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea44e3e-bebb-40c6-a1d1-5ca50ab5e5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:11.576408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f2e0e207-2964-4232-9899-a8e291170863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:11.599304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0e207-2964-4232-9899-a8e291170863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:11.600952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0e207-2964-4232-9899-a8e291170863 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:11.618650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9ea44e3e-bebb-40c6-a1d1-5ca50ab5e5a6 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:11.620322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9ea44e3e-bebb-40c6-a1d1-5ca50ab5e5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:11.629892 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1277/2519] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:05:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:11.643532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea44e3e-bebb-40c6-a1d1-5ca50ab5e5a6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:11.645226 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1243/2520] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:11.673972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea44e3e-bebb-40c6-a1d1-5ca50ab5e5a6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:11.693674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd57a9-ed5a-4b68-a8c6-4b937f2f7993 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:11.695551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd57a9-ed5a-4b68-a8c6-4b937f2f7993 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:11.696301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd57a9-ed5a-4b68-a8c6-4b937f2f7993 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:11.697301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd57a9-ed5a-4b68-a8c6-4b937f2f7993 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:11.719440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd57a9-ed5a-4b68-a8c6-4b937f2f7993 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:11.727892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd57a9-ed5a-4b68-a8c6-4b937f2f7993 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:11.756933 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1278/2521] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:05:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:13.229555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dced2-44e4-4a51-9dc3-eea6d7b7914d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:13.230063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dced2-44e4-4a51-9dc3-eea6d7b7914d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:13.230063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dced2-44e4-4a51-9dc3-eea6d7b7914d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:13.270044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dc8dced2-44e4-4a51-9dc3-eea6d7b7914d None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:13.271645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dc8dced2-44e4-4a51-9dc3-eea6d7b7914d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:13.288389 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1244/2522] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:05:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:13.303191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd57a9-ed5a-4b68-a8c6-4b937f2f7993 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:13.329110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd57a9-ed5a-4b68-a8c6-4b937f2f7993 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:13.358096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411847e6-fe02-4167-a545-1e12e7ba82e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:13.358722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411847e6-fe02-4167-a545-1e12e7ba82e7 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:13.359064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411847e6-fe02-4167-a545-1e12e7ba82e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:13.359348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411847e6-fe02-4167-a545-1e12e7ba82e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:13.381675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411847e6-fe02-4167-a545-1e12e7ba82e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:13.385138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411847e6-fe02-4167-a545-1e12e7ba82e7 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:13.405864 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1279/2523] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:05:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:15.995867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dced2-44e4-4a51-9dc3-eea6d7b7914d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:15.998623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dc8dced2-44e4-4a51-9dc3-eea6d7b7914d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:16.075599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dced2-44e4-4a51-9dc3-eea6d7b7914d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:16.080485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef33221-063c-4c79-8423-6e8d315ab137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:16.081132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef33221-063c-4c79-8423-6e8d315ab137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:16.081415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef33221-063c-4c79-8423-6e8d315ab137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:16.081736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef33221-063c-4c79-8423-6e8d315ab137 admin admin] PATH_INFO: `/v3/users/8cd01d53807440fd827b41778a54627a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.082902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef33221-063c-4c79-8423-6e8d315ab137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd01d53807440fd827b41778a54627a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:16.085080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef33221-063c-4c79-8423-6e8d315ab137 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:16.147397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ef33221-063c-4c79-8423-6e8d315ab137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd01d53807440fd827b41778a54627a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:16.148290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ef33221-063c-4c79-8423-6e8d315ab137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd01d53807440fd827b41778a54627a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:16.190486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ef33221-063c-4c79-8423-6e8d315ab137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd01d53807440fd827b41778a54627a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:16.207627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ef33221-063c-4c79-8423-6e8d315ab137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd01d53807440fd827b41778a54627a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:16.209020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ef33221-063c-4c79-8423-6e8d315ab137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd01d53807440fd827b41778a54627a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:16.226113 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1245/2524] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:15 2022] DELETE /identity/v3/users/8cd01d53807440fd827b41778a54627a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:16.432266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411847e6-fe02-4167-a545-1e12e7ba82e7 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:16.444868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411847e6-fe02-4167-a545-1e12e7ba82e7 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:16.595186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a408d61-850d-4b64-921f-cb148acc8ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:16.598386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a408d61-850d-4b64-921f-cb148acc8ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:16.599162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a408d61-850d-4b64-921f-cb148acc8ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:16.601889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a408d61-850d-4b64-921f-cb148acc8ec4 admin admin] PATH_INFO: `/v3/projects/7776307d685b47fe8beca919b5f90966` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.603691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a408d61-850d-4b64-921f-cb148acc8ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7776307d685b47fe8beca919b5f90966)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:16.611614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a408d61-850d-4b64-921f-cb148acc8ec4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:16.701859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a408d61-850d-4b64-921f-cb148acc8ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7776307d685b47fe8beca919b5f90966', 'request_id': 'req-8a408d61-850d-4b64-921f-cb148acc8ec4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:16.711809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a408d61-850d-4b64-921f-cb148acc8ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7776307d685b47fe8beca919b5f90966', 'request_id': 'req-8a408d61-850d-4b64-921f-cb148acc8ec4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:16.723439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a408d61-850d-4b64-921f-cb148acc8ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7776307d685b47fe8beca919b5f90966', 'request_id': 'req-8a408d61-850d-4b64-921f-cb148acc8ec4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:16.725666 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:16.749905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a408d61-850d-4b64-921f-cb148acc8ec4 admin admin] The token cache is being invalidate because project 7776307d685b47fe8beca919b5f90966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:16.750200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a408d61-850d-4b64-921f-cb148acc8ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:16.751471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a408d61-850d-4b64-921f-cb148acc8ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:16.753871 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1280/2525] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:16 2022] DELETE /identity/v3/projects/7776307d685b47fe8beca919b5f90966 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:16.758473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3664b-b3f8-4015-b8ff-a366b06507e7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:16.758843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3664b-b3f8-4015-b8ff-a366b06507e7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:16.759234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3664b-b3f8-4015-b8ff-a366b06507e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.792918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e8b3664b-b3f8-4015-b8ff-a366b06507e7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:16.794244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e8b3664b-b3f8-4015-b8ff-a366b06507e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:16.904036 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:16.935751 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1246/2526] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:05:16.943669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80579490-6199-437a-8326-2e3ce1735849 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:16.943969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80579490-6199-437a-8326-2e3ce1735849 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:16.944236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80579490-6199-437a-8326-2e3ce1735849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.974199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-80579490-6199-437a-8326-2e3ce1735849 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:16.976238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-80579490-6199-437a-8326-2e3ce1735849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:16.991499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3664b-b3f8-4015-b8ff-a366b06507e7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:16.996751 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1281/2527] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:17.011431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3664b-b3f8-4015-b8ff-a366b06507e7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:17.025467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024b46-95c8-498c-9dbc-a536febd335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:17.027246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024b46-95c8-498c-9dbc-a536febd335d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:17.027758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024b46-95c8-498c-9dbc-a536febd335d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:17.028244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024b46-95c8-498c-9dbc-a536febd335d admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:17.029108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c024b46-95c8-498c-9dbc-a536febd335d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:17.029902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c024b46-95c8-498c-9dbc-a536febd335d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:17.031913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c024b46-95c8-498c-9dbc-a536febd335d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:17.048483 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1247/2528] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:05:17.055205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80579490-6199-437a-8326-2e3ce1735849 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:17.077771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80579490-6199-437a-8326-2e3ce1735849 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:17.091203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2e214-2675-4583-97bb-b0513f0c13d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:17.091927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2e214-2675-4583-97bb-b0513f0c13d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:17.092279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2e214-2675-4583-97bb-b0513f0c13d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:17.092628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2e214-2675-4583-97bb-b0513f0c13d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:17.093339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2e214-2675-4583-97bb-b0513f0c13d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:17.096582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2e214-2675-4583-97bb-b0513f0c13d4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:17.138086 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1282/2529] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:17 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:17.145092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024b46-95c8-498c-9dbc-a536febd335d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:17.162812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024b46-95c8-498c-9dbc-a536febd335d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:17.348203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584be5ea-2d99-43ac-a576-e8540de2f501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:17.349345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584be5ea-2d99-43ac-a576-e8540de2f501 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:17.349773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584be5ea-2d99-43ac-a576-e8540de2f501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:17.350202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584be5ea-2d99-43ac-a576-e8540de2f501 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:17.351282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584be5ea-2d99-43ac-a576-e8540de2f501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:17.353751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584be5ea-2d99-43ac-a576-e8540de2f501 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:17.389898 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1248/2530] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:17 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:17.394330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2e214-2675-4583-97bb-b0513f0c13d4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:17.409985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2e214-2675-4583-97bb-b0513f0c13d4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:17.420539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddc14b-4daf-465e-9bf3-be7f9d0e5cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:17.423025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddc14b-4daf-465e-9bf3-be7f9d0e5cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:17.424006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddc14b-4daf-465e-9bf3-be7f9d0e5cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:17.424006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddc14b-4daf-465e-9bf3-be7f9d0e5cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:17.424798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddc14b-4daf-465e-9bf3-be7f9d0e5cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:17.430101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddc14b-4daf-465e-9bf3-be7f9d0e5cb9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:17.463978 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1283/2531] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:17.469115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584be5ea-2d99-43ac-a576-e8540de2f501 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:17.482253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584be5ea-2d99-43ac-a576-e8540de2f501 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:17.488488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26409b37-af6d-4a57-b36a-36de36a18264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:17.489361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26409b37-af6d-4a57-b36a-36de36a18264 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:17.489808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26409b37-af6d-4a57-b36a-36de36a18264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:17.490083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26409b37-af6d-4a57-b36a-36de36a18264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:17.490725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26409b37-af6d-4a57-b36a-36de36a18264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:17.492374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26409b37-af6d-4a57-b36a-36de36a18264 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:17.505335 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1249/2532] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:17.509985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddc14b-4daf-465e-9bf3-be7f9d0e5cb9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:17.524439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddc14b-4daf-465e-9bf3-be7f9d0e5cb9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:17.537052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7aabe-f85a-4485-845a-77e9eea34873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:17.538379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7aabe-f85a-4485-845a-77e9eea34873 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:17.538668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7aabe-f85a-4485-845a-77e9eea34873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:17.539199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7aabe-f85a-4485-845a-77e9eea34873 admin admin] PATH_INFO: `/v3/projects/8a91e848d7ef4946ad7499af40ad187e/users/075812ec2ad746dcbb55fceead90d0eb/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:17.573610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7aabe-f85a-4485-845a-77e9eea34873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a91e848d7ef4946ad7499af40ad187e, user_id=075812ec2ad746dcbb55fceead90d0eb, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:17.578289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7aabe-f85a-4485-845a-77e9eea34873 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:17.616434 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1284/2533] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:17 2022] PUT /identity/v3/projects/8a91e848d7ef4946ad7499af40ad187e/users/075812ec2ad746dcbb55fceead90d0eb/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:17.622888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6508cb8-afe1-4c03-a06b-59e699966f41 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:17.623203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6508cb8-afe1-4c03-a06b-59e699966f41 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:17.623481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6508cb8-afe1-4c03-a06b-59e699966f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:17.648881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d6508cb8-afe1-4c03-a06b-59e699966f41 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:17.650511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d6508cb8-afe1-4c03-a06b-59e699966f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:17.733621 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1250/2534] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:17.757089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7aabe-f85a-4485-845a-77e9eea34873 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:17.759222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47a7aabe-f85a-4485-845a-77e9eea34873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:17.860917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7aabe-f85a-4485-845a-77e9eea34873 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:17.868680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d2d00-f4bc-469d-aae5-bc86748e78fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:17.869954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d2d00-f4bc-469d-aae5-bc86748e78fb service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:17.870373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d2d00-f4bc-469d-aae5-bc86748e78fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:17.870717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d2d00-f4bc-469d-aae5-bc86748e78fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:17.884784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d2d00-f4bc-469d-aae5-bc86748e78fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:17.886497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d2d00-f4bc-469d-aae5-bc86748e78fb service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:17.901564 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1285/2535] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:18.504817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6508cb8-afe1-4c03-a06b-59e699966f41 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:18.521530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6508cb8-afe1-4c03-a06b-59e699966f41 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:18.534585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b31f17-491c-4b3f-9801-8a422a6c0187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:18.535285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31f17-491c-4b3f-9801-8a422a6c0187 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:18.535574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31f17-491c-4b3f-9801-8a422a6c0187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:18.535839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31f17-491c-4b3f-9801-8a422a6c0187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:18.538562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b5b31f17-491c-4b3f-9801-8a422a6c0187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:18.555267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b31f17-491c-4b3f-9801-8a422a6c0187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:18.557978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b31f17-491c-4b3f-9801-8a422a6c0187 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:18.571020 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1251/2536] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:19.966050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d2d00-f4bc-469d-aae5-bc86748e78fb service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:19.968082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-405d2d00-f4bc-469d-aae5-bc86748e78fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:19.992518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d2d00-f4bc-469d-aae5-bc86748e78fb service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:20.000200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4936-eff1-4aa3-b346-cbe34b14c5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:20.001499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4936-eff1-4aa3-b346-cbe34b14c5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:20.002015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4936-eff1-4aa3-b346-cbe34b14c5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:20.026113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4936-eff1-4aa3-b346-cbe34b14c5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:20.033453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-98fd4936-eff1-4aa3-b346-cbe34b14c5b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:20.193422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd4936-eff1-4aa3-b346-cbe34b14c5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:20.196605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd4936-eff1-4aa3-b346-cbe34b14c5b5 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:20.225775 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1286/2537] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:24.786975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b31f17-491c-4b3f-9801-8a422a6c0187 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:24.789540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b5b31f17-491c-4b3f-9801-8a422a6c0187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:24.823560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b31f17-491c-4b3f-9801-8a422a6c0187 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:24.831776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a919f0-9665-4ebf-8aae-32ebcd3d5aca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:24.832741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a919f0-9665-4ebf-8aae-32ebcd3d5aca service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:24.833216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a919f0-9665-4ebf-8aae-32ebcd3d5aca service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:24.833702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a919f0-9665-4ebf-8aae-32ebcd3d5aca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:24.836145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c1a919f0-9665-4ebf-8aae-32ebcd3d5aca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:24.855599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a919f0-9665-4ebf-8aae-32ebcd3d5aca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:24.857787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a919f0-9665-4ebf-8aae-32ebcd3d5aca service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:24.883732 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1252/2538] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:30.217329 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=2,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:31.654037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a279d6-12ac-4da6-a0b9-1ffe36305815 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:31.655374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a279d6-12ac-4da6-a0b9-1ffe36305815 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:31.655908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a279d6-12ac-4da6-a0b9-1ffe36305815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:31.703219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d0a279d6-12ac-4da6-a0b9-1ffe36305815 None None] MFA Rules not processed for user `075812ec2ad746dcbb55fceead90d0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:31.705133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d0a279d6-12ac-4da6-a0b9-1ffe36305815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:31.955906 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1287/2539] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:32.772235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a919f0-9665-4ebf-8aae-32ebcd3d5aca service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:32.777503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c1a919f0-9665-4ebf-8aae-32ebcd3d5aca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:32.793403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a919f0-9665-4ebf-8aae-32ebcd3d5aca service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:32.800301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ea4b-8e58-438b-a86d-f649ddce0607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:32.801122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ea4b-8e58-438b-a86d-f649ddce0607 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:32.801687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ea4b-8e58-438b-a86d-f649ddce0607 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:32.802134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ea4b-8e58-438b-a86d-f649ddce0607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:32.804097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-68e9ea4b-8e58-438b-a86d-f649ddce0607 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:32.834961 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:32.892154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9ea4b-8e58-438b-a86d-f649ddce0607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:32.894555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9ea4b-8e58-438b-a86d-f649ddce0607 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:32.918902 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1253/2540] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:32.920380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a279d6-12ac-4da6-a0b9-1ffe36305815 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:32.939704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a279d6-12ac-4da6-a0b9-1ffe36305815 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:32.947957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2e113-ade5-492d-9ccd-db04799fe527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:32.949015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2e113-ade5-492d-9ccd-db04799fe527 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:32.949530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2e113-ade5-492d-9ccd-db04799fe527 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:32.950039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2e113-ade5-492d-9ccd-db04799fe527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:32.963191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2e113-ade5-492d-9ccd-db04799fe527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:32.966669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2e113-ade5-492d-9ccd-db04799fe527 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:32.982472 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1288/2541] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:35.211589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ea4b-8e58-438b-a86d-f649ddce0607 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:35.213092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-68e9ea4b-8e58-438b-a86d-f649ddce0607 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:35.239690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ea4b-8e58-438b-a86d-f649ddce0607 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:35.252073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ce040-2983-498d-8e43-f648905407ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:35.253173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ce040-2983-498d-8e43-f648905407ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:35.253607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ce040-2983-498d-8e43-f648905407ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:35.254037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ce040-2983-498d-8e43-f648905407ed admin admin] PATH_INFO: `/v3/users/57612f6a347e49be96d699e76bd9bead` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:35.255404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ce040-2983-498d-8e43-f648905407ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=57612f6a347e49be96d699e76bd9bead)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:35.257674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ce040-2983-498d-8e43-f648905407ed admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:35.360914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c4ce040-2983-498d-8e43-f648905407ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57612f6a347e49be96d699e76bd9bead'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:35.371397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c4ce040-2983-498d-8e43-f648905407ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57612f6a347e49be96d699e76bd9bead'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:35.390650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c4ce040-2983-498d-8e43-f648905407ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57612f6a347e49be96d699e76bd9bead'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:35.413815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c4ce040-2983-498d-8e43-f648905407ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57612f6a347e49be96d699e76bd9bead'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:35.415689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c4ce040-2983-498d-8e43-f648905407ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57612f6a347e49be96d699e76bd9bead'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:35.466117 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1254/2542] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:35 2022] DELETE /identity/v3/users/57612f6a347e49be96d699e76bd9bead => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:35.467449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fabb8d-1330-48d6-9ca6-b858f600de5f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:35.467938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fabb8d-1330-48d6-9ca6-b858f600de5f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:35.468027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fabb8d-1330-48d6-9ca6-b858f600de5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:35.495284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-80fabb8d-1330-48d6-9ca6-b858f600de5f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:35.497833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-80fabb8d-1330-48d6-9ca6-b858f600de5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:35.598040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff03503-80ab-499d-99ba-23c5a83db13d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:35.598319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff03503-80ab-499d-99ba-23c5a83db13d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:35.598587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff03503-80ab-499d-99ba-23c5a83db13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:35.603216 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1289/2543] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:35.614162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fabb8d-1330-48d6-9ca6-b858f600de5f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:35.616091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-80fabb8d-1330-48d6-9ca6-b858f600de5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:35.644507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dff03503-80ab-499d-99ba-23c5a83db13d None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:35.645802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dff03503-80ab-499d-99ba-23c5a83db13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:35.777063 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1255/2544] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:05:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:35.793919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff03503-80ab-499d-99ba-23c5a83db13d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:35.799639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dff03503-80ab-499d-99ba-23c5a83db13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:35.805722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fabb8d-1330-48d6-9ca6-b858f600de5f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:35.837858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a7ddb-044d-4e41-99d7-51fba425e40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:35.838781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a7ddb-044d-4e41-99d7-51fba425e40f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:35.838901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a7ddb-044d-4e41-99d7-51fba425e40f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:35.839210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a7ddb-044d-4e41-99d7-51fba425e40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:35.864054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a7ddb-044d-4e41-99d7-51fba425e40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:35.866381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a7ddb-044d-4e41-99d7-51fba425e40f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:35.909627 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1290/2545] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:05:35.930300 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:36.015731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff03503-80ab-499d-99ba-23c5a83db13d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:36.036355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd63a3-71e2-468b-88fe-ba8ea8489750 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:36.038624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd63a3-71e2-468b-88fe-ba8ea8489750 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:36.038624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd63a3-71e2-468b-88fe-ba8ea8489750 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:36.038883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd63a3-71e2-468b-88fe-ba8ea8489750 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:36.075540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd63a3-71e2-468b-88fe-ba8ea8489750 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:36.084477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd63a3-71e2-468b-88fe-ba8ea8489750 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:36.129537 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1256/2546] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:05:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:36.420501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a7ddb-044d-4e41-99d7-51fba425e40f service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:36.423626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d11a7ddb-044d-4e41-99d7-51fba425e40f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:36.459993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a7ddb-044d-4e41-99d7-51fba425e40f service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:36.533245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:36.534012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:36.534192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:36.538876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a admin admin] PATH_INFO: `/v3/projects/9f15cb6a79194375bd48a2af095e9374` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:36.540533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f15cb6a79194375bd48a2af095e9374)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:36.543327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:36.649420 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:36.786252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f15cb6a79194375bd48a2af095e9374', 'request_id': 'req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:36.805425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f15cb6a79194375bd48a2af095e9374', 'request_id': 'req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:36.830999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f15cb6a79194375bd48a2af095e9374', 'request_id': 'req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:36.861994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a admin admin] The token cache is being invalidate because project 9f15cb6a79194375bd48a2af095e9374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:36.862300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:36.863192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e5ea730-4c94-49c3-996e-dbf9b9d1d42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:36.867828 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1291/2547] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:36 2022] DELETE /identity/v3/projects/9f15cb6a79194375bd48a2af095e9374 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:36.868701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd63a3-71e2-468b-88fe-ba8ea8489750 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:36.886021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd63a3-71e2-468b-88fe-ba8ea8489750 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:37.043300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:37.043953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:37.044225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:37.044496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] PATH_INFO: `/v3/users/56a8baf5199545188c7bbbfc2b94060a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:37.050678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a8baf5199545188c7bbbfc2b94060a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:37.057716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:37.142415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a8baf5199545188c7bbbfc2b94060a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:37.143627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a8baf5199545188c7bbbfc2b94060a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:37.160388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a8baf5199545188c7bbbfc2b94060a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:37.186951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a8baf5199545188c7bbbfc2b94060a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:37.193049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a8baf5199545188c7bbbfc2b94060a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:37.241019 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1257/2548] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:36 2022] DELETE /identity/v3/users/56a8baf5199545188c7bbbfc2b94060a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:37.487459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac764b-45af-433d-983b-f90e3a2bf24e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:37.487744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac764b-45af-433d-983b-f90e3a2bf24e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:37.488206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac764b-45af-433d-983b-f90e3a2bf24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:37.542638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e5ac764b-45af-433d-983b-f90e3a2bf24e None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:37.545094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e5ac764b-45af-433d-983b-f90e3a2bf24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:37.724268 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1292/2549] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:05:37.739801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:37.741696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:37.863588 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:37.911326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37218982-8aff-43cc-8e62-17e2badd826b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:37.920105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e72d4-b16c-423d-91db-e8c9996f9dcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:37.921216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e72d4-b16c-423d-91db-e8c9996f9dcf service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:37.921679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e72d4-b16c-423d-91db-e8c9996f9dcf service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:37.922111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e72d4-b16c-423d-91db-e8c9996f9dcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:37.935317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e72d4-b16c-423d-91db-e8c9996f9dcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:37.937972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e72d4-b16c-423d-91db-e8c9996f9dcf service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:37.960498 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1258/2550] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:05:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:38.838974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a0f8-69bb-4881-99c6-a0aebdf866bb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:38.840210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a0f8-69bb-4881-99c6-a0aebdf866bb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:38.840665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a0f8-69bb-4881-99c6-a0aebdf866bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:38.866706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-47e2a0f8-69bb-4881-99c6-a0aebdf866bb None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:38.869021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47e2a0f8-69bb-4881-99c6-a0aebdf866bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:38.879369 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1293/2551] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:05:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:38.906138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e72d4-b16c-423d-91db-e8c9996f9dcf service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:38.920154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e72d4-b16c-423d-91db-e8c9996f9dcf service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:38.927750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf522b8-9b79-43b9-8136-064095cbaf75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:38.928422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf522b8-9b79-43b9-8136-064095cbaf75 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:38.928865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf522b8-9b79-43b9-8136-064095cbaf75 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:38.929384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf522b8-9b79-43b9-8136-064095cbaf75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:38.940044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf522b8-9b79-43b9-8136-064095cbaf75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:38.941711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf522b8-9b79-43b9-8136-064095cbaf75 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:38.951764 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1259/2552] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:05:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:38.987016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2a0f8-69bb-4881-99c6-a0aebdf866bb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:38.990685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47e2a0f8-69bb-4881-99c6-a0aebdf866bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:39.177564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf522b8-9b79-43b9-8136-064095cbaf75 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:39.180678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8cf522b8-9b79-43b9-8136-064095cbaf75 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:39.191229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2a0f8-69bb-4881-99c6-a0aebdf866bb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:39.198396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cd688-f0e9-44ef-b770-5e1923be74ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:39.199085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cd688-f0e9-44ef-b770-5e1923be74ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:39.199574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cd688-f0e9-44ef-b770-5e1923be74ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:39.200007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cd688-f0e9-44ef-b770-5e1923be74ef admin admin] PATH_INFO: `/v3/projects/de18aeb229f843b4ab5928afbdc34afd` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:39.201334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cd688-f0e9-44ef-b770-5e1923be74ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=de18aeb229f843b4ab5928afbdc34afd)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:39.203295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cd688-f0e9-44ef-b770-5e1923be74ef admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:39.204417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf522b8-9b79-43b9-8136-064095cbaf75 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:39.221239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894666c-f44a-41d3-bd63-56cec5641c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:39.223129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894666c-f44a-41d3-bd63-56cec5641c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:39.224577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894666c-f44a-41d3-bd63-56cec5641c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:39.224872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894666c-f44a-41d3-bd63-56cec5641c03 admin admin] PATH_INFO: `/v3/users/283dbcfc68244d4b86de327091147337` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:39.227280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894666c-f44a-41d3-bd63-56cec5641c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=283dbcfc68244d4b86de327091147337)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:39.233568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894666c-f44a-41d3-bd63-56cec5641c03 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:39.300521 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:39.306467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-338cd688-f0e9-44ef-b770-5e1923be74ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de18aeb229f843b4ab5928afbdc34afd', 'request_id': 'req-338cd688-f0e9-44ef-b770-5e1923be74ef'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:39.318905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-338cd688-f0e9-44ef-b770-5e1923be74ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de18aeb229f843b4ab5928afbdc34afd', 'request_id': 'req-338cd688-f0e9-44ef-b770-5e1923be74ef'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:39.332871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-338cd688-f0e9-44ef-b770-5e1923be74ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de18aeb229f843b4ab5928afbdc34afd', 'request_id': 'req-338cd688-f0e9-44ef-b770-5e1923be74ef'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:39.353397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-338cd688-f0e9-44ef-b770-5e1923be74ef admin admin] The token cache is being invalidate because project de18aeb229f843b4ab5928afbdc34afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:39.354106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-338cd688-f0e9-44ef-b770-5e1923be74ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:39.355107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-338cd688-f0e9-44ef-b770-5e1923be74ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:39.356835 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1294/2553] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:38 2022] DELETE /identity/v3/projects/de18aeb229f843b4ab5928afbdc34afd => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:39.361359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0894666c-f44a-41d3-bd63-56cec5641c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283dbcfc68244d4b86de327091147337'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:39.362345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0894666c-f44a-41d3-bd63-56cec5641c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283dbcfc68244d4b86de327091147337'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:39.364545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f810f-2583-4241-836c-9f16e0282794 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:39.364889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f810f-2583-4241-836c-9f16e0282794 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:39.365230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f810f-2583-4241-836c-9f16e0282794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:39.380194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0894666c-f44a-41d3-bd63-56cec5641c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283dbcfc68244d4b86de327091147337'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:39.392689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0894666c-f44a-41d3-bd63-56cec5641c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283dbcfc68244d4b86de327091147337'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:39.393740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0894666c-f44a-41d3-bd63-56cec5641c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283dbcfc68244d4b86de327091147337'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:39.397921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-578f810f-2583-4241-836c-9f16e0282794 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:39.399456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-578f810f-2583-4241-836c-9f16e0282794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:39.415410 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1260/2554] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:39 2022] DELETE /identity/v3/users/283dbcfc68244d4b86de327091147337 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:39.416975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fea491-ff38-4653-857c-89d42f43f6aa None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:39.417331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fea491-ff38-4653-857c-89d42f43f6aa None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:39.417825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fea491-ff38-4653-857c-89d42f43f6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:39.475110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-39fea491-ff38-4653-857c-89d42f43f6aa None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:39.476366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-39fea491-ff38-4653-857c-89d42f43f6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:39.519286 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1295/2555] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:39.534098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb92b58-9b7b-4db6-bbd7-5000dbf1f2fa None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:39.534581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb92b58-9b7b-4db6-bbd7-5000dbf1f2fa None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:39.535134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb92b58-9b7b-4db6-bbd7-5000dbf1f2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:39.616150 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1261/2556] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:39.624143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5cb92b58-9b7b-4db6-bbd7-5000dbf1f2fa None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:39.625593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5cb92b58-9b7b-4db6-bbd7-5000dbf1f2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:39.651488 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1296/2557] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:39.656453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fea491-ff38-4653-857c-89d42f43f6aa None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:39.674440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fea491-ff38-4653-857c-89d42f43f6aa None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:39.679272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb92b58-9b7b-4db6-bbd7-5000dbf1f2fa None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:39.682170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5cb92b58-9b7b-4db6-bbd7-5000dbf1f2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:39.686305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b741fbd-d97f-4a3c-8a4c-621a782fbf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:39.687462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b741fbd-d97f-4a3c-8a4c-621a782fbf9f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:39.688258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b741fbd-d97f-4a3c-8a4c-621a782fbf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:39.688373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b741fbd-d97f-4a3c-8a4c-621a782fbf9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:39.689264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b741fbd-d97f-4a3c-8a4c-621a782fbf9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:39.689611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b741fbd-d97f-4a3c-8a4c-621a782fbf9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:39.692286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b741fbd-d97f-4a3c-8a4c-621a782fbf9f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:39.717470 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1262/2558] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:05:39.720212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b741fbd-d97f-4a3c-8a4c-621a782fbf9f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:39.740147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b741fbd-d97f-4a3c-8a4c-621a782fbf9f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:39.748664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e4394-bc30-4c60-90af-bc305e00fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:39.749417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e4394-bc30-4c60-90af-bc305e00fe5f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:39.749700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e4394-bc30-4c60-90af-bc305e00fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:39.749971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e4394-bc30-4c60-90af-bc305e00fe5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:39.750648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e4394-bc30-4c60-90af-bc305e00fe5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:39.754091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e4394-bc30-4c60-90af-bc305e00fe5f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:39.764849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb92b58-9b7b-4db6-bbd7-5000dbf1f2fa None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:39.770023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60753600-2ed7-4375-9630-6357c0d01c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:39.770785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60753600-2ed7-4375-9630-6357c0d01c6e service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:39.771201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60753600-2ed7-4375-9630-6357c0d01c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:39.771577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60753600-2ed7-4375-9630-6357c0d01c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:39.786803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60753600-2ed7-4375-9630-6357c0d01c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:39.788738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60753600-2ed7-4375-9630-6357c0d01c6e service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:39.800939 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1297/2559] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:39.804526 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1263/2560] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:39 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:39.804987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60753600-2ed7-4375-9630-6357c0d01c6e service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:39.815647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60753600-2ed7-4375-9630-6357c0d01c6e service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:39.883195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d041c9f-c21b-4a67-a1e3-0c9bbe3c7ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:39.883904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041c9f-c21b-4a67-a1e3-0c9bbe3c7ede admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:39.884094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041c9f-c21b-4a67-a1e3-0c9bbe3c7ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:39.884511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041c9f-c21b-4a67-a1e3-0c9bbe3c7ede admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:39.885229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d041c9f-c21b-4a67-a1e3-0c9bbe3c7ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:39.887292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d041c9f-c21b-4a67-a1e3-0c9bbe3c7ede admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:39.907528 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:39.920384 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1298/2561] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:39 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:05:39.923177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e4394-bc30-4c60-90af-bc305e00fe5f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:39.941587 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:39.947771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e4394-bc30-4c60-90af-bc305e00fe5f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:39.956466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c3428-977f-4d65-a6f9-37ed210eaa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:39.957115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c3428-977f-4d65-a6f9-37ed210eaa93 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:39.957410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c3428-977f-4d65-a6f9-37ed210eaa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:39.957906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c3428-977f-4d65-a6f9-37ed210eaa93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:39.959039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c3428-977f-4d65-a6f9-37ed210eaa93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:39.961997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c3428-977f-4d65-a6f9-37ed210eaa93 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:39.974288 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1264/2562] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:39.978370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d041c9f-c21b-4a67-a1e3-0c9bbe3c7ede admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:39.990485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d041c9f-c21b-4a67-a1e3-0c9bbe3c7ede admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:39.995370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982e838-530c-4656-aa1b-c978beed5941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:39.995997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982e838-530c-4656-aa1b-c978beed5941 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:39.996278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982e838-530c-4656-aa1b-c978beed5941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:39.996555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982e838-530c-4656-aa1b-c978beed5941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:39.997375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982e838-530c-4656-aa1b-c978beed5941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:39.999022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982e838-530c-4656-aa1b-c978beed5941 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:40.011616 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1299/2563] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:40.015831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c3428-977f-4d65-a6f9-37ed210eaa93 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:40.029075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c3428-977f-4d65-a6f9-37ed210eaa93 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:40.036193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95983c-f9ab-47b0-a4ce-dc852886f5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:40.037112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95983c-f9ab-47b0-a4ce-dc852886f5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:40.037263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95983c-f9ab-47b0-a4ce-dc852886f5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:40.037444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95983c-f9ab-47b0-a4ce-dc852886f5a4 admin admin] PATH_INFO: `/v3/projects/c4d93522c54c4449926b8ddfeda3d96e/users/5c224f40dc3447d2b3bec25f1ca968fa/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:40.059063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95983c-f9ab-47b0-a4ce-dc852886f5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d93522c54c4449926b8ddfeda3d96e, user_id=5c224f40dc3447d2b3bec25f1ca968fa, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:40.062109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95983c-f9ab-47b0-a4ce-dc852886f5a4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:40.083870 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1265/2564] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:40 2022] PUT /identity/v3/projects/c4d93522c54c4449926b8ddfeda3d96e/users/5c224f40dc3447d2b3bec25f1ca968fa/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:40.091770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcaecc-e385-4f7f-8e7e-95e3d16b3543 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:40.092192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcaecc-e385-4f7f-8e7e-95e3d16b3543 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:40.093528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcaecc-e385-4f7f-8e7e-95e3d16b3543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:40.136409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-93bcaecc-e385-4f7f-8e7e-95e3d16b3543 None None] MFA Rules not processed for user `5c224f40dc3447d2b3bec25f1ca968fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:40.147379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-93bcaecc-e385-4f7f-8e7e-95e3d16b3543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:40.279761 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1300/2565] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:40.284760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95983c-f9ab-47b0-a4ce-dc852886f5a4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:40.366305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95983c-f9ab-47b0-a4ce-dc852886f5a4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:40.371089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcaecc-e385-4f7f-8e7e-95e3d16b3543 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:40.371560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923614f-afa3-48af-ad6d-f7166e06d39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:40.372188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923614f-afa3-48af-ad6d-f7166e06d39e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:40.372457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923614f-afa3-48af-ad6d-f7166e06d39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:40.372727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923614f-afa3-48af-ad6d-f7166e06d39e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:40.372945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-93bcaecc-e385-4f7f-8e7e-95e3d16b3543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:40.373425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923614f-afa3-48af-ad6d-f7166e06d39e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:40.375418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923614f-afa3-48af-ad6d-f7166e06d39e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:40.389414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcaecc-e385-4f7f-8e7e-95e3d16b3543 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:40.396552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:40.397652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:40.397652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:40.397889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5 admin admin] PATH_INFO: `/v3/projects/b214da9f32b843de96003cb6169f0a5c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:40.398945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b214da9f32b843de96003cb6169f0a5c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:40.401046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:40.448670 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1266/2566] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:40 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:40.452003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923614f-afa3-48af-ad6d-f7166e06d39e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:40.497308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b214da9f32b843de96003cb6169f0a5c', 'request_id': 'req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:40.508155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b214da9f32b843de96003cb6169f0a5c', 'request_id': 'req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:40.522255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b214da9f32b843de96003cb6169f0a5c', 'request_id': 'req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:40.541546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5 admin admin] The token cache is being invalidate because project b214da9f32b843de96003cb6169f0a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:40.541935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:40.544222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c96f58ed-7cb3-4229-80f9-6c6261aa92d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:40.551639 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1301/2567] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:40 2022] DELETE /identity/v3/projects/b214da9f32b843de96003cb6169f0a5c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:40.554133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651ab27-6eb2-4939-9f37-33e0640d9342 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:40.554689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651ab27-6eb2-4939-9f37-33e0640d9342 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:40.555098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651ab27-6eb2-4939-9f37-33e0640d9342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:40.587249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3651ab27-6eb2-4939-9f37-33e0640d9342 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:40.588577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3651ab27-6eb2-4939-9f37-33e0640d9342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:40.616844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923614f-afa3-48af-ad6d-f7166e06d39e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:40.675719 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:40.698276 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1302/2568] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:40.699834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54fd48-ebb1-4ee3-8c6b-829c69b92b6e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:40.700489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54fd48-ebb1-4ee3-8c6b-829c69b92b6e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:40.702344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54fd48-ebb1-4ee3-8c6b-829c69b92b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:40.730054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ad54fd48-ebb1-4ee3-8c6b-829c69b92b6e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:40.731801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ad54fd48-ebb1-4ee3-8c6b-829c69b92b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:40.738677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a5608-8f99-45a1-9ac6-fb81415181d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:40.739451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a5608-8f99-45a1-9ac6-fb81415181d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:40.739733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a5608-8f99-45a1-9ac6-fb81415181d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:40.740001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a5608-8f99-45a1-9ac6-fb81415181d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:40.740891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a5608-8f99-45a1-9ac6-fb81415181d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:40.746386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a5608-8f99-45a1-9ac6-fb81415181d1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:40.748164 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1303/2569] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:40.749279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54fd48-ebb1-4ee3-8c6b-829c69b92b6e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:40.758990 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:40.762178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54fd48-ebb1-4ee3-8c6b-829c69b92b6e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:40.772670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00218648-e7fa-464c-9929-2fcc50296526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:40.773600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00218648-e7fa-464c-9929-2fcc50296526 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:40.773600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00218648-e7fa-464c-9929-2fcc50296526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:40.774594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00218648-e7fa-464c-9929-2fcc50296526 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:40.776124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00218648-e7fa-464c-9929-2fcc50296526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:40.776510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00218648-e7fa-464c-9929-2fcc50296526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:40.778204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00218648-e7fa-464c-9929-2fcc50296526 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:40.786118 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1267/2570] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:40 2022] POST /identity/v3/users => generated 295 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:40.790061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a5608-8f99-45a1-9ac6-fb81415181d1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:40.792285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d00a5608-8f99-45a1-9ac6-fb81415181d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:40.802161 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1304/2571] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:05:40.803196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00218648-e7fa-464c-9929-2fcc50296526 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:40.819445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a5608-8f99-45a1-9ac6-fb81415181d1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:40.831144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab0b2e-c41e-42ee-ae94-cd5316d19b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:40.832308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab0b2e-c41e-42ee-ae94-cd5316d19b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:40.832437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab0b2e-c41e-42ee-ae94-cd5316d19b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:40.833376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab0b2e-c41e-42ee-ae94-cd5316d19b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:40.834030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab0b2e-c41e-42ee-ae94-cd5316d19b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:40.836301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab0b2e-c41e-42ee-ae94-cd5316d19b06 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:40.844167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00218648-e7fa-464c-9929-2fcc50296526 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:40.855865 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1268/2572] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:05:40.859568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab0b2e-c41e-42ee-ae94-cd5316d19b06 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:40.861889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b9ea0-bfaa-4dcf-a9f6-ca7181b6a587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:40.862509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b9ea0-bfaa-4dcf-a9f6-ca7181b6a587 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:40.862788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b9ea0-bfaa-4dcf-a9f6-ca7181b6a587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:40.863086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b9ea0-bfaa-4dcf-a9f6-ca7181b6a587 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:40.863734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b9ea0-bfaa-4dcf-a9f6-ca7181b6a587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:40.865655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b9ea0-bfaa-4dcf-a9f6-ca7181b6a587 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:40.876396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab0b2e-c41e-42ee-ae94-cd5316d19b06 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:40.885531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ff244-b095-46d8-9c45-2d33e0d310b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:40.886414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ff244-b095-46d8-9c45-2d33e0d310b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:40.886764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ff244-b095-46d8-9c45-2d33e0d310b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:40.887213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ff244-b095-46d8-9c45-2d33e0d310b9 admin admin] PATH_INFO: `/v3/projects/8c8d4ba17275414498d270c16b5d42c3/users/06312e3c1bc94c77ac6d840e5f325588/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:40.918077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ff244-b095-46d8-9c45-2d33e0d310b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8d4ba17275414498d270c16b5d42c3, user_id=06312e3c1bc94c77ac6d840e5f325588, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:40.921290 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1305/2573] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:40 2022] POST /identity/v3/projects => generated 361 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:40.928293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b9ea0-bfaa-4dcf-a9f6-ca7181b6a587 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:40.929432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ff244-b095-46d8-9c45-2d33e0d310b9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:40.961926 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1269/2574] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:40 2022] PUT /identity/v3/projects/8c8d4ba17275414498d270c16b5d42c3/users/06312e3c1bc94c77ac6d840e5f325588/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:40.962848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ff244-b095-46d8-9c45-2d33e0d310b9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:41.049766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b9ea0-bfaa-4dcf-a9f6-ca7181b6a587 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:41.096369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ff244-b095-46d8-9c45-2d33e0d310b9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:41.104352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad6dc5-4ef8-453b-ba5d-b61ceb89fef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:41.105228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad6dc5-4ef8-453b-ba5d-b61ceb89fef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:41.105692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad6dc5-4ef8-453b-ba5d-b61ceb89fef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:41.106139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad6dc5-4ef8-453b-ba5d-b61ceb89fef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:41.106976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad6dc5-4ef8-453b-ba5d-b61ceb89fef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:41.108738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad6dc5-4ef8-453b-ba5d-b61ceb89fef9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:41.136233 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1270/2575] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:41.137322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad6dc5-4ef8-453b-ba5d-b61ceb89fef9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:41.157321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad6dc5-4ef8-453b-ba5d-b61ceb89fef9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:41.176488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319a903-0de7-43e3-9125-102cfd620a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:41.178646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319a903-0de7-43e3-9125-102cfd620a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:41.180963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319a903-0de7-43e3-9125-102cfd620a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:41.181841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319a903-0de7-43e3-9125-102cfd620a49 admin admin] PATH_INFO: `/v3/projects/8c8d4ba17275414498d270c16b5d42c3/users/06312e3c1bc94c77ac6d840e5f325588/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:41.190539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319a903-0de7-43e3-9125-102cfd620a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8d4ba17275414498d270c16b5d42c3, user_id=06312e3c1bc94c77ac6d840e5f325588, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:41.199342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319a903-0de7-43e3-9125-102cfd620a49 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:41.220342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d477fd-37c9-4a27-adf4-b5405a25c327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:41.222363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d477fd-37c9-4a27-adf4-b5405a25c327 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:41.223691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d477fd-37c9-4a27-adf4-b5405a25c327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:41.224935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d477fd-37c9-4a27-adf4-b5405a25c327 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:41.226077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d477fd-37c9-4a27-adf4-b5405a25c327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:41.232560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d477fd-37c9-4a27-adf4-b5405a25c327 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:41.244880 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1271/2576] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:41 2022] PUT /identity/v3/projects/8c8d4ba17275414498d270c16b5d42c3/users/06312e3c1bc94c77ac6d840e5f325588/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:41.248648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cab6ae-61d8-42df-b139-df22ee349999 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:41.248937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cab6ae-61d8-42df-b139-df22ee349999 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:41.249208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cab6ae-61d8-42df-b139-df22ee349999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:41.292950 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1306/2577] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:40 2022] POST /identity/v3/users => generated 281 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:41.294139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d477fd-37c9-4a27-adf4-b5405a25c327 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:41.301017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e7cab6ae-61d8-42df-b139-df22ee349999 None None] MFA Rules not processed for user `06312e3c1bc94c77ac6d840e5f325588`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:41.302852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e7cab6ae-61d8-42df-b139-df22ee349999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:41.316553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d477fd-37c9-4a27-adf4-b5405a25c327 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:41.425460 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1272/2578] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:05:41.437403 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:41.440921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd56ad-c351-4f97-ad67-277b6cf17877 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:41.441326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd56ad-c351-4f97-ad67-277b6cf17877 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:41.441624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd56ad-c351-4f97-ad67-277b6cf17877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:41.446203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89849357-4497-46e5-9857-ffd18c6b683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:41.447614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849357-4497-46e5-9857-ffd18c6b683d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:41.447912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849357-4497-46e5-9857-ffd18c6b683d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:41.448222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849357-4497-46e5-9857-ffd18c6b683d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:41.448874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89849357-4497-46e5-9857-ffd18c6b683d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:41.450706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89849357-4497-46e5-9857-ffd18c6b683d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:41.467034 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1307/2579] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:05:41.470335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89849357-4497-46e5-9857-ffd18c6b683d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:41.483197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e8bd56ad-c351-4f97-ad67-277b6cf17877 None None] MFA Rules not processed for user `5c224f40dc3447d2b3bec25f1ca968fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:41.485127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e8bd56ad-c351-4f97-ad67-277b6cf17877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:41.492376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89849357-4497-46e5-9857-ffd18c6b683d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:41.497489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511eae1d-daad-49b6-850c-4cb6f6718fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:41.498481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eae1d-daad-49b6-850c-4cb6f6718fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:41.499031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eae1d-daad-49b6-850c-4cb6f6718fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:41.499538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eae1d-daad-49b6-850c-4cb6f6718fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:41.500401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511eae1d-daad-49b6-850c-4cb6f6718fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:41.503786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511eae1d-daad-49b6-850c-4cb6f6718fe7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:41.522835 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:41.535099 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1308/2580] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:05:41.536418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511eae1d-daad-49b6-850c-4cb6f6718fe7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:41.556521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511eae1d-daad-49b6-850c-4cb6f6718fe7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:41.569888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78705783-84fe-4b94-bb54-2d4683e45f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:41.570592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78705783-84fe-4b94-bb54-2d4683e45f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:41.572403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78705783-84fe-4b94-bb54-2d4683e45f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:41.572687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78705783-84fe-4b94-bb54-2d4683e45f54 admin admin] PATH_INFO: `/v3/projects/2321b6dab1724b8f8924031dedfaad4b/users/12b8cec3ac0e4fb9888ea0e53c46701f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:41.586612 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1273/2581] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:41.599142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78705783-84fe-4b94-bb54-2d4683e45f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2321b6dab1724b8f8924031dedfaad4b, user_id=12b8cec3ac0e4fb9888ea0e53c46701f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:41.603423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78705783-84fe-4b94-bb54-2d4683e45f54 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:41.623758 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1309/2582] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:41 2022] PUT /identity/v3/projects/2321b6dab1724b8f8924031dedfaad4b/users/12b8cec3ac0e4fb9888ea0e53c46701f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:41.636207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4de024-4610-40b1-9d87-7b1cfa3f8110 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:41.637145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4de024-4610-40b1-9d87-7b1cfa3f8110 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:41.637316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4de024-4610-40b1-9d87-7b1cfa3f8110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:41.715577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5d4de024-4610-40b1-9d87-7b1cfa3f8110 None None] MFA Rules not processed for user `12b8cec3ac0e4fb9888ea0e53c46701f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:41.717405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5d4de024-4610-40b1-9d87-7b1cfa3f8110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:41.819014 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1274/2583] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:42.089401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78705783-84fe-4b94-bb54-2d4683e45f54 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:42.091412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-78705783-84fe-4b94-bb54-2d4683e45f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:42.115312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4de024-4610-40b1-9d87-7b1cfa3f8110 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:42.117385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5d4de024-4610-40b1-9d87-7b1cfa3f8110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:42.203194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78705783-84fe-4b94-bb54-2d4683e45f54 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:42.208590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61dbca-b1a8-4c73-8ff4-bda382700386 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:42.209198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61dbca-b1a8-4c73-8ff4-bda382700386 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:42.209477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61dbca-b1a8-4c73-8ff4-bda382700386 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:42.209779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61dbca-b1a8-4c73-8ff4-bda382700386 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:42.211596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9c61dbca-b1a8-4c73-8ff4-bda382700386 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:42.216724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4de024-4610-40b1-9d87-7b1cfa3f8110 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:42.222433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:42.223190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:42.223479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:42.223738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] PATH_INFO: `/v3/users/aceec71835c14681a2ff7d7285d87776` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:42.224510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61dbca-b1a8-4c73-8ff4-bda382700386 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:42.226093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61dbca-b1a8-4c73-8ff4-bda382700386 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:42.229170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aceec71835c14681a2ff7d7285d87776)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:42.231973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:42.237688 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1310/2584] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:42.238696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61dbca-b1a8-4c73-8ff4-bda382700386 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:42.240255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9c61dbca-b1a8-4c73-8ff4-bda382700386 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:42.317964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aceec71835c14681a2ff7d7285d87776'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.318764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aceec71835c14681a2ff7d7285d87776'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.341920 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:42.346440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aceec71835c14681a2ff7d7285d87776'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.355949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61dbca-b1a8-4c73-8ff4-bda382700386 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:42.358930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aceec71835c14681a2ff7d7285d87776'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.359936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aceec71835c14681a2ff7d7285d87776'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.364138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837e01-90b4-4ba4-a078-a769f2f26697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:42.364860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837e01-90b4-4ba4-a078-a769f2f26697 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:42.365253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837e01-90b4-4ba4-a078-a769f2f26697 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:42.365618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837e01-90b4-4ba4-a078-a769f2f26697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:42.367837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5a837e01-90b4-4ba4-a078-a769f2f26697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:42.377986 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1275/2585] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:42 2022] DELETE /identity/v3/users/aceec71835c14681a2ff7d7285d87776 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:42.420876 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:42.451831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a837e01-90b4-4ba4-a078-a769f2f26697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:42.453822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a837e01-90b4-4ba4-a078-a769f2f26697 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:42.465304 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1311/2586] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:42.629127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:42.630656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:42.721137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bf5b3-4749-4e74-8eaf-27d2d74afb70 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:42.727285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:42.728047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:42.728425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:42.728877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] PATH_INFO: `/v3/projects/5eec6e034df149f8863b1b9ebacfaa81` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:42.730697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eec6e034df149f8863b1b9ebacfaa81)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:42.732212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:42.788279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eec6e034df149f8863b1b9ebacfaa81', 'request_id': 'req-b476c5d5-7ae6-4247-be93-393470e18c73'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.794656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eec6e034df149f8863b1b9ebacfaa81', 'request_id': 'req-b476c5d5-7ae6-4247-be93-393470e18c73'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.803714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eec6e034df149f8863b1b9ebacfaa81', 'request_id': 'req-b476c5d5-7ae6-4247-be93-393470e18c73'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.815336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] The token cache is being invalidate because project 5eec6e034df149f8863b1b9ebacfaa81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:42.815682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.816345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.817823 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1276/2587] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:42 2022] DELETE /identity/v3/projects/5eec6e034df149f8863b1b9ebacfaa81 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:42.822201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837e01-90b4-4ba4-a078-a769f2f26697 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:42.834573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837e01-90b4-4ba4-a078-a769f2f26697 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:42.897768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:42.898551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:42.898834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:42.899152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] PATH_INFO: `/v3/users/3b1244bc039d4645b2c813b77b1593cd` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:42.900262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1244bc039d4645b2c813b77b1593cd)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:42.902233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:42.960659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1244bc039d4645b2c813b77b1593cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.961511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1244bc039d4645b2c813b77b1593cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.975402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1244bc039d4645b2c813b77b1593cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.983769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1244bc039d4645b2c813b77b1593cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:42.984418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1244bc039d4645b2c813b77b1593cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:43.001838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:43.007983 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1312/2588] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:42 2022] DELETE /identity/v3/users/3b1244bc039d4645b2c813b77b1593cd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:43.011121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:43.119109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476c5d5-7ae6-4247-be93-393470e18c73 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:43.132117 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:43.220524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc0785-a701-4e62-a7fe-6affef35d8ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:43.221193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc0785-a701-4e62-a7fe-6affef35d8ab service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:43.221515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc0785-a701-4e62-a7fe-6affef35d8ab service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:43.221789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc0785-a701-4e62-a7fe-6affef35d8ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:43.223837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9fdc0785-a701-4e62-a7fe-6affef35d8ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:43.321818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:43.326303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:43.352810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc0785-a701-4e62-a7fe-6affef35d8ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:43.354482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc0785-a701-4e62-a7fe-6affef35d8ab service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:43.366240 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1277/2589] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:43.430116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc0785-a701-4e62-a7fe-6affef35d8ab service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:43.435986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9fdc0785-a701-4e62-a7fe-6affef35d8ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:43.440405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e8eb4-6b71-49b3-8d61-5e783195f691 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:43.446861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647501a-2873-446e-abcf-9863fa54a085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:43.447934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647501a-2873-446e-abcf-9863fa54a085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:43.448333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647501a-2873-446e-abcf-9863fa54a085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:43.448677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647501a-2873-446e-abcf-9863fa54a085 admin admin] PATH_INFO: `/v3/projects/9a8b7d6b98284f61849a7ef4350a2abe` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:43.450777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647501a-2873-446e-abcf-9863fa54a085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8b7d6b98284f61849a7ef4350a2abe)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:43.453341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647501a-2873-446e-abcf-9863fa54a085 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:43.456346 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:43.472285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc0785-a701-4e62-a7fe-6affef35d8ab service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:43.481276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e927e-fd99-40fc-b151-23bb2d2ebcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:43.489183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e927e-fd99-40fc-b151-23bb2d2ebcec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:43.491130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e927e-fd99-40fc-b151-23bb2d2ebcec admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:43.493717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e927e-fd99-40fc-b151-23bb2d2ebcec admin admin] PATH_INFO: `/v3/users/12b8cec3ac0e4fb9888ea0e53c46701f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:43.497482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e927e-fd99-40fc-b151-23bb2d2ebcec admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b8cec3ac0e4fb9888ea0e53c46701f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:43.502699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e927e-fd99-40fc-b151-23bb2d2ebcec admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:43.539994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1647501a-2873-446e-abcf-9863fa54a085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8b7d6b98284f61849a7ef4350a2abe', 'request_id': 'req-1647501a-2873-446e-abcf-9863fa54a085'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:43.564529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1647501a-2873-446e-abcf-9863fa54a085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8b7d6b98284f61849a7ef4350a2abe', 'request_id': 'req-1647501a-2873-446e-abcf-9863fa54a085'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:43.576678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1647501a-2873-446e-abcf-9863fa54a085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8b7d6b98284f61849a7ef4350a2abe', 'request_id': 'req-1647501a-2873-446e-abcf-9863fa54a085'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:43.607769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1647501a-2873-446e-abcf-9863fa54a085 admin admin] The token cache is being invalidate because project 9a8b7d6b98284f61849a7ef4350a2abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:43.607769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1647501a-2873-446e-abcf-9863fa54a085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:43.608501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ed9e927e-fd99-40fc-b151-23bb2d2ebcec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b8cec3ac0e4fb9888ea0e53c46701f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:43.612386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ed9e927e-fd99-40fc-b151-23bb2d2ebcec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b8cec3ac0e4fb9888ea0e53c46701f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:43.615212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1647501a-2873-446e-abcf-9863fa54a085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:43.625117 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1313/2590] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:43 2022] DELETE /identity/v3/projects/9a8b7d6b98284f61849a7ef4350a2abe => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:43.630216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5e16b-731d-47c0-813b-e43a09f20b27 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:43.630897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5e16b-731d-47c0-813b-e43a09f20b27 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:43.630897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5e16b-731d-47c0-813b-e43a09f20b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:43.650133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ed9e927e-fd99-40fc-b151-23bb2d2ebcec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b8cec3ac0e4fb9888ea0e53c46701f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:43.668066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ed9e927e-fd99-40fc-b151-23bb2d2ebcec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b8cec3ac0e4fb9888ea0e53c46701f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:43.669019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ed9e927e-fd99-40fc-b151-23bb2d2ebcec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b8cec3ac0e4fb9888ea0e53c46701f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:43.698679 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1278/2591] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:43 2022] DELETE /identity/v3/users/12b8cec3ac0e4fb9888ea0e53c46701f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:43.702826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4de5e16b-731d-47c0-813b-e43a09f20b27 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:43.703369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d0bc3-0df2-4db3-857b-d1f26c0862fd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:43.704238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d0bc3-0df2-4db3-857b-d1f26c0862fd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:43.704698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d0bc3-0df2-4db3-857b-d1f26c0862fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:43.706069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4de5e16b-731d-47c0-813b-e43a09f20b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:43.752517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4f2d0bc3-0df2-4db3-857b-d1f26c0862fd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:43.754885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4f2d0bc3-0df2-4db3-857b-d1f26c0862fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:43.809714 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:43.915781 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1314/2592] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:43.921090 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1279/2593] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:43.924404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386e77b-2e4b-431e-9444-32568b09497f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:43.924690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386e77b-2e4b-431e-9444-32568b09497f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:43.924968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386e77b-2e4b-431e-9444-32568b09497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:43.955679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2386e77b-2e4b-431e-9444-32568b09497f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:43.956952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2386e77b-2e4b-431e-9444-32568b09497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:43.958004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d0bc3-0df2-4db3-857b-d1f26c0862fd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:43.962599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4f2d0bc3-0df2-4db3-857b-d1f26c0862fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:43.966661 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1315/2594] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:43.971239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386e77b-2e4b-431e-9444-32568b09497f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:43.982123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386e77b-2e4b-431e-9444-32568b09497f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:43.988610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1c7e4-7037-4619-9300-0f1226e87c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:43.989318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1c7e4-7037-4619-9300-0f1226e87c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:43.989670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1c7e4-7037-4619-9300-0f1226e87c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:43.990017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1c7e4-7037-4619-9300-0f1226e87c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:43.990883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1c7e4-7037-4619-9300-0f1226e87c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:43.991452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1c7e4-7037-4619-9300-0f1226e87c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:43.994029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1c7e4-7037-4619-9300-0f1226e87c18 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:44.012096 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1316/2595] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:05:44.016073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1c7e4-7037-4619-9300-0f1226e87c18 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:44.043210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1c7e4-7037-4619-9300-0f1226e87c18 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:44.048989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aada7f8-d65d-4049-aed9-bbe47c7442da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:44.049596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aada7f8-d65d-4049-aed9-bbe47c7442da admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:44.049869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aada7f8-d65d-4049-aed9-bbe47c7442da admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:44.050317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aada7f8-d65d-4049-aed9-bbe47c7442da admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:44.050824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aada7f8-d65d-4049-aed9-bbe47c7442da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:44.052930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aada7f8-d65d-4049-aed9-bbe47c7442da admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:44.086291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d0bc3-0df2-4db3-857b-d1f26c0862fd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:44.088142 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1317/2596] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:44 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:05:44.094110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aada7f8-d65d-4049-aed9-bbe47c7442da admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:44.182416 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:44.212207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aada7f8-d65d-4049-aed9-bbe47c7442da admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:44.226882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984bdfb-9b89-443c-86ab-1f560c9f1071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:44.232640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac5076-1040-47ae-a710-801852721467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:44.233275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac5076-1040-47ae-a710-801852721467 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:44.233554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac5076-1040-47ae-a710-801852721467 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:44.233822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac5076-1040-47ae-a710-801852721467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:44.239375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984bdfb-9b89-443c-86ab-1f560c9f1071 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:44.240847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984bdfb-9b89-443c-86ab-1f560c9f1071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:44.241670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984bdfb-9b89-443c-86ab-1f560c9f1071 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:44.243493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984bdfb-9b89-443c-86ab-1f560c9f1071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:44.261886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac5076-1040-47ae-a710-801852721467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:44.265139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984bdfb-9b89-443c-86ab-1f560c9f1071 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:44.266868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac5076-1040-47ae-a710-801852721467 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:44.305930 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1280/2597] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:44.308284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac5076-1040-47ae-a710-801852721467 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:44.312905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c0ac5076-1040-47ae-a710-801852721467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:44.318373 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1318/2598] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:44 2022] POST /identity/v3/users => generated 295 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:44.319293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984bdfb-9b89-443c-86ab-1f560c9f1071 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:44.338147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac5076-1040-47ae-a710-801852721467 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:44.349635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464640f7-5593-4727-a37f-6b299ef3298b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:44.350671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464640f7-5593-4727-a37f-6b299ef3298b service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:44.351243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464640f7-5593-4727-a37f-6b299ef3298b service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:44.352643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464640f7-5593-4727-a37f-6b299ef3298b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:44.353207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984bdfb-9b89-443c-86ab-1f560c9f1071 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:44.357007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-464640f7-5593-4727-a37f-6b299ef3298b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:44.364261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95addbb5-20f4-421c-a968-c80138773306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:44.366140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95addbb5-20f4-421c-a968-c80138773306 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:44.366420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95addbb5-20f4-421c-a968-c80138773306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:44.366689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95addbb5-20f4-421c-a968-c80138773306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:44.367385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95addbb5-20f4-421c-a968-c80138773306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:44.381626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464640f7-5593-4727-a37f-6b299ef3298b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:44.383282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464640f7-5593-4727-a37f-6b299ef3298b service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:44.391005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95addbb5-20f4-421c-a968-c80138773306 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:44.407821 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1281/2599] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:44.419023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464640f7-5593-4727-a37f-6b299ef3298b service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:44.419475 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1319/2600] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:44.442346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464640f7-5593-4727-a37f-6b299ef3298b service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:44.456110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbb5e3-bb66-4938-ba7a-2cb878909874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:44.456886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb5e3-bb66-4938-ba7a-2cb878909874 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:44.457041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb5e3-bb66-4938-ba7a-2cb878909874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:44.457243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb5e3-bb66-4938-ba7a-2cb878909874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:44.457888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbb5e3-bb66-4938-ba7a-2cb878909874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:44.459711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbb5e3-bb66-4938-ba7a-2cb878909874 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:44.480592 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1282/2601] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:05:44.484804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95addbb5-20f4-421c-a968-c80138773306 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:44.499748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95addbb5-20f4-421c-a968-c80138773306 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:44.512199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c91bf4-ad2d-4468-985e-1eb85bf4d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:44.512875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c91bf4-ad2d-4468-985e-1eb85bf4d8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:44.513160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c91bf4-ad2d-4468-985e-1eb85bf4d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:44.513432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c91bf4-ad2d-4468-985e-1eb85bf4d8bc admin admin] PATH_INFO: `/v3/projects/6134cfbb8dc9412886f06387d75ccf6f/users/c44d7f87c3564cb681b680f389265c74/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:44.563742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c91bf4-ad2d-4468-985e-1eb85bf4d8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6134cfbb8dc9412886f06387d75ccf6f, user_id=c44d7f87c3564cb681b680f389265c74, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:44.583571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c91bf4-ad2d-4468-985e-1eb85bf4d8bc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:44.624906 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1320/2602] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:44 2022] PUT /identity/v3/projects/6134cfbb8dc9412886f06387d75ccf6f/users/c44d7f87c3564cb681b680f389265c74/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:44.631730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445caa68-3912-4462-8dbd-49f8a9e0b454 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:44.632093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445caa68-3912-4462-8dbd-49f8a9e0b454 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:44.632483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445caa68-3912-4462-8dbd-49f8a9e0b454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:44.665278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-445caa68-3912-4462-8dbd-49f8a9e0b454 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:44.668521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-445caa68-3912-4462-8dbd-49f8a9e0b454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:44.843713 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:44.845808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05440c52-99c6-4f9e-8e61-b1e443bd5486 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:44.845808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05440c52-99c6-4f9e-8e61-b1e443bd5486 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:44.845808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05440c52-99c6-4f9e-8e61-b1e443bd5486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:44.872897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-05440c52-99c6-4f9e-8e61-b1e443bd5486 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:44.874096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05440c52-99c6-4f9e-8e61-b1e443bd5486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:44.879085 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1283/2603] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:44.916410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445caa68-3912-4462-8dbd-49f8a9e0b454 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:44.997063 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1321/2604] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:05:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:44.997597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445caa68-3912-4462-8dbd-49f8a9e0b454 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:44.997918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05440c52-99c6-4f9e-8e61-b1e443bd5486 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:44.999383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05440c52-99c6-4f9e-8e61-b1e443bd5486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:45.002738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25459e1e-69d2-4cf2-8c32-ab1a15558261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:45.003657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459e1e-69d2-4cf2-8c32-ab1a15558261 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:45.004170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459e1e-69d2-4cf2-8c32-ab1a15558261 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:45.004673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459e1e-69d2-4cf2-8c32-ab1a15558261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:45.016741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25459e1e-69d2-4cf2-8c32-ab1a15558261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:45.018541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25459e1e-69d2-4cf2-8c32-ab1a15558261 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:45.033935 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1284/2605] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:45.034984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25459e1e-69d2-4cf2-8c32-ab1a15558261 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:45.036562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-25459e1e-69d2-4cf2-8c32-ab1a15558261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:45.172135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25459e1e-69d2-4cf2-8c32-ab1a15558261 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:45.188370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e35c54-199b-41f9-85fb-d4ef934c814a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:45.189783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05440c52-99c6-4f9e-8e61-b1e443bd5486 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:45.191889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e35c54-199b-41f9-85fb-d4ef934c814a service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:45.193141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e35c54-199b-41f9-85fb-d4ef934c814a service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:45.194989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e35c54-199b-41f9-85fb-d4ef934c814a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:45.208562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e00fe6-8935-42a8-852e-4404864aa99e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:45.209198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e00fe6-8935-42a8-852e-4404864aa99e service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:45.209480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e00fe6-8935-42a8-852e-4404864aa99e service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:45.209772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e00fe6-8935-42a8-852e-4404864aa99e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:45.217257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a1e00fe6-8935-42a8-852e-4404864aa99e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:45.228267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e35c54-199b-41f9-85fb-d4ef934c814a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:45.234577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e35c54-199b-41f9-85fb-d4ef934c814a service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:45.268145 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1285/2606] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:05:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:45.269416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e35c54-199b-41f9-85fb-d4ef934c814a service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:45.275930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f4e35c54-199b-41f9-85fb-d4ef934c814a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:45.381262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e35c54-199b-41f9-85fb-d4ef934c814a service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:45.403669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:45.404639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:45.404924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:45.405194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] PATH_INFO: `/v3/projects/2321b6dab1724b8f8924031dedfaad4b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:45.410933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2321b6dab1724b8f8924031dedfaad4b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:45.413133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:45.532784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2321b6dab1724b8f8924031dedfaad4b', 'request_id': 'req-829a6f07-4004-4193-8598-edefe3518c5b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:45.534008 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:45.552216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2321b6dab1724b8f8924031dedfaad4b', 'request_id': 'req-829a6f07-4004-4193-8598-edefe3518c5b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:45.580625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e00fe6-8935-42a8-852e-4404864aa99e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:45.581789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2321b6dab1724b8f8924031dedfaad4b', 'request_id': 'req-829a6f07-4004-4193-8598-edefe3518c5b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:45.582358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e00fe6-8935-42a8-852e-4404864aa99e service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:45.626793 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1322/2607] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:44 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:45.631232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e00fe6-8935-42a8-852e-4404864aa99e service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:45.634356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] The token cache is being invalidate because project 2321b6dab1724b8f8924031dedfaad4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:45.636059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:45.638564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:45.645752 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1286/2608] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:45 2022] DELETE /identity/v3/projects/2321b6dab1724b8f8924031dedfaad4b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:45.646765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:45.653170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:45.670494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e00fe6-8935-42a8-852e-4404864aa99e service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:45.695303 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:45.887391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e547d48-3972-4441-8220-6d2de45ba615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:45.888715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e547d48-3972-4441-8220-6d2de45ba615 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:45.888992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e547d48-3972-4441-8220-6d2de45ba615 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:45.889262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e547d48-3972-4441-8220-6d2de45ba615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:45.895789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7e547d48-3972-4441-8220-6d2de45ba615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:45.935071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a6f07-4004-4193-8598-edefe3518c5b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:45.943137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62107a7b-3572-455f-8221-16f5cb3a313f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:45.945424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62107a7b-3572-455f-8221-16f5cb3a313f service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:45.945766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62107a7b-3572-455f-8221-16f5cb3a313f service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:45.946037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62107a7b-3572-455f-8221-16f5cb3a313f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:45.948204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-62107a7b-3572-455f-8221-16f5cb3a313f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:46.035263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e547d48-3972-4441-8220-6d2de45ba615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:46.037315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e547d48-3972-4441-8220-6d2de45ba615 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:46.062732 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1323/2609] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:46.063965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca299d81-48e0-4dd8-920e-1087e4de70fd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:46.068281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca299d81-48e0-4dd8-920e-1087e4de70fd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:46.068584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca299d81-48e0-4dd8-920e-1087e4de70fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:46.090720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62107a7b-3572-455f-8221-16f5cb3a313f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:46.092587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62107a7b-3572-455f-8221-16f5cb3a313f service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:46.119766 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1287/2610] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:46.121924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ca299d81-48e0-4dd8-920e-1087e4de70fd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:46.126965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ca299d81-48e0-4dd8-920e-1087e4de70fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:46.303138 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1324/2611] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:46.303945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0416c-3449-4abb-8f47-a6df06a9ac39 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:46.304409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0416c-3449-4abb-8f47-a6df06a9ac39 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:46.304559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0416c-3449-4abb-8f47-a6df06a9ac39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:46.343217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-35b0416c-3449-4abb-8f47-a6df06a9ac39 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:46.344967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-35b0416c-3449-4abb-8f47-a6df06a9ac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:46.366839 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1288/2612] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:46.370727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca299d81-48e0-4dd8-920e-1087e4de70fd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:46.395930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca299d81-48e0-4dd8-920e-1087e4de70fd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:46.404823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4b194-c61b-4e36-a48b-30709f178cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:46.405441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4b194-c61b-4e36-a48b-30709f178cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:46.405722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4b194-c61b-4e36-a48b-30709f178cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:46.406002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4b194-c61b-4e36-a48b-30709f178cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:46.406710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4b194-c61b-4e36-a48b-30709f178cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:46.407217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4b194-c61b-4e36-a48b-30709f178cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:46.408901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4b194-c61b-4e36-a48b-30709f178cd8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:46.430339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0416c-3449-4abb-8f47-a6df06a9ac39 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:46.435578 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1325/2613] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:05:46.465940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0416c-3449-4abb-8f47-a6df06a9ac39 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:46.482200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b6d46-4a71-46ba-bb9f-7ea4a4a406da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:46.483577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6d46-4a71-46ba-bb9f-7ea4a4a406da admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:46.483577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6d46-4a71-46ba-bb9f-7ea4a4a406da admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:46.483577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6d46-4a71-46ba-bb9f-7ea4a4a406da admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:46.484050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b6d46-4a71-46ba-bb9f-7ea4a4a406da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:46.487092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b6d46-4a71-46ba-bb9f-7ea4a4a406da admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:46.566793 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1289/2614] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:46 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:46.570954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4b194-c61b-4e36-a48b-30709f178cd8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:46.585475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4b194-c61b-4e36-a48b-30709f178cd8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:46.673772 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:46.748960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978cb12-da2f-414f-84d0-fd26a15a6870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:46.751002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978cb12-da2f-414f-84d0-fd26a15a6870 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:46.751403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978cb12-da2f-414f-84d0-fd26a15a6870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:46.751782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978cb12-da2f-414f-84d0-fd26a15a6870 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:46.752554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978cb12-da2f-414f-84d0-fd26a15a6870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:46.754776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978cb12-da2f-414f-84d0-fd26a15a6870 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:46.792536 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1326/2615] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:46 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:46.796986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b6d46-4a71-46ba-bb9f-7ea4a4a406da admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:46.813526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b6d46-4a71-46ba-bb9f-7ea4a4a406da admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:46.841502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f355a-0373-4964-a834-fdfc359994e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:46.845601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f355a-0373-4964-a834-fdfc359994e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:46.845897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f355a-0373-4964-a834-fdfc359994e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:46.846236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f355a-0373-4964-a834-fdfc359994e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:46.846961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f355a-0373-4964-a834-fdfc359994e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:46.854539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f355a-0373-4964-a834-fdfc359994e9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:46.891583 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1290/2616] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:46.896198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978cb12-da2f-414f-84d0-fd26a15a6870 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:46.914744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978cb12-da2f-414f-84d0-fd26a15a6870 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:46.921688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d380e8-9ef0-4f95-8551-b6d334def2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:46.922542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d380e8-9ef0-4f95-8551-b6d334def2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:46.923616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d380e8-9ef0-4f95-8551-b6d334def2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:46.924124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d380e8-9ef0-4f95-8551-b6d334def2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:46.924996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d380e8-9ef0-4f95-8551-b6d334def2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:46.926751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d380e8-9ef0-4f95-8551-b6d334def2e0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:46.942522 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1327/2617] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:46.946662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f355a-0373-4964-a834-fdfc359994e9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:46.962154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f355a-0373-4964-a834-fdfc359994e9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:46.979814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c14c2-798a-4796-8cf9-93be1f3a94a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:46.980975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c14c2-798a-4796-8cf9-93be1f3a94a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:46.987551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c14c2-798a-4796-8cf9-93be1f3a94a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:46.988003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c14c2-798a-4796-8cf9-93be1f3a94a5 admin admin] PATH_INFO: `/v3/projects/ba43dd17d7974221a59efaa1452b3b2f/users/5d9ecc8887874f989006a848b818ac84/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:47.024231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c14c2-798a-4796-8cf9-93be1f3a94a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba43dd17d7974221a59efaa1452b3b2f, user_id=5d9ecc8887874f989006a848b818ac84, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:47.027709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c14c2-798a-4796-8cf9-93be1f3a94a5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:47.057978 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1291/2618] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:46 2022] PUT /identity/v3/projects/ba43dd17d7974221a59efaa1452b3b2f/users/5d9ecc8887874f989006a848b818ac84/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:47.062956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0e62-0c62-4f8c-85a0-1762425fdd15 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:47.063978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0e62-0c62-4f8c-85a0-1762425fdd15 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:47.064307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0e62-0c62-4f8c-85a0-1762425fdd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:47.110759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c31c0e62-0c62-4f8c-85a0-1762425fdd15 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:47.112089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c31c0e62-0c62-4f8c-85a0-1762425fdd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:47.302741 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1328/2619] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:47.350256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c14c2-798a-4796-8cf9-93be1f3a94a5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:47.352489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-920c14c2-798a-4796-8cf9-93be1f3a94a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:47.506943 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:47.568302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c14c2-798a-4796-8cf9-93be1f3a94a5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:47.585330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73ab8e-8aa3-4c7a-b0f1-4f796c7b5716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:47.585979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73ab8e-8aa3-4c7a-b0f1-4f796c7b5716 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:47.586257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73ab8e-8aa3-4c7a-b0f1-4f796c7b5716 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:47.586533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73ab8e-8aa3-4c7a-b0f1-4f796c7b5716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:47.631763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73ab8e-8aa3-4c7a-b0f1-4f796c7b5716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:47.633654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73ab8e-8aa3-4c7a-b0f1-4f796c7b5716 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:47.671451 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1292/2620] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:48.521454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c0e62-0c62-4f8c-85a0-1762425fdd15 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:48.523578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c31c0e62-0c62-4f8c-85a0-1762425fdd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:48.733667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c0e62-0c62-4f8c-85a0-1762425fdd15 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:48.743907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d00165-4cd4-4d53-9e26-f0a9fad04f96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:48.744822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d00165-4cd4-4d53-9e26-f0a9fad04f96 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:48.745318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d00165-4cd4-4d53-9e26-f0a9fad04f96 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:48.745759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d00165-4cd4-4d53-9e26-f0a9fad04f96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:48.748472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-07d00165-4cd4-4d53-9e26-f0a9fad04f96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:48.768612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d00165-4cd4-4d53-9e26-f0a9fad04f96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:48.771271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d00165-4cd4-4d53-9e26-f0a9fad04f96 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:48.789248 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1329/2621] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:56.866539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73ab8e-8aa3-4c7a-b0f1-4f796c7b5716 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:56.894212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73ab8e-8aa3-4c7a-b0f1-4f796c7b5716 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:56.917425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6eaf2-2cd7-4579-9341-80fca3912efb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:56.918583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6eaf2-2cd7-4579-9341-80fca3912efb service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:56.919840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6eaf2-2cd7-4579-9341-80fca3912efb service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:56.921494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6eaf2-2cd7-4579-9341-80fca3912efb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:56.930220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4ca6eaf2-2cd7-4579-9341-80fca3912efb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:56.973771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6eaf2-2cd7-4579-9341-80fca3912efb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:56.975754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6eaf2-2cd7-4579-9341-80fca3912efb service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:57.007391 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1293/2622] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:58.779006 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:02.434965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef441e-4d48-47cd-b8b3-402b6b3a5be3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:02.435601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef441e-4d48-47cd-b8b3-402b6b3a5be3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:02.435601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef441e-4d48-47cd-b8b3-402b6b3a5be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:02.570662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a8ef441e-4d48-47cd-b8b3-402b6b3a5be3 None None] MFA Rules not processed for user `5d9ecc8887874f989006a848b818ac84`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:02.582507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a8ef441e-4d48-47cd-b8b3-402b6b3a5be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:02.760655 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1330/2623] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:02.772733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e8df7-14d6-4c7d-94fa-bccff5f9bf8e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:02.773729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e8df7-14d6-4c7d-94fa-bccff5f9bf8e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:02.774342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e8df7-14d6-4c7d-94fa-bccff5f9bf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:02.831766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c94e8df7-14d6-4c7d-94fa-bccff5f9bf8e None None] MFA Rules not processed for user `5d9ecc8887874f989006a848b818ac84`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:02.835939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c94e8df7-14d6-4c7d-94fa-bccff5f9bf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:02.878273 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1294/2624] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:02.890443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef441e-4d48-47cd-b8b3-402b6b3a5be3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:02.924702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef441e-4d48-47cd-b8b3-402b6b3a5be3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:02.942998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814544b-5cf2-4ba7-b8b0-30ee2a710e73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:02.946600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814544b-5cf2-4ba7-b8b0-30ee2a710e73 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:02.947137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814544b-5cf2-4ba7-b8b0-30ee2a710e73 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:02.948358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814544b-5cf2-4ba7-b8b0-30ee2a710e73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:02.978097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814544b-5cf2-4ba7-b8b0-30ee2a710e73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:02.986779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814544b-5cf2-4ba7-b8b0-30ee2a710e73 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:03.005466 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1331/2625] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:05.306038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb793b-6b3d-4d15-aaf0-c3181091740e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:05.306867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb793b-6b3d-4d15-aaf0-c3181091740e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:05.307360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb793b-6b3d-4d15-aaf0-c3181091740e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:05.360373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-40bb793b-6b3d-4d15-aaf0-c3181091740e None None] MFA Rules not processed for user `3c33afd9ae144eb185203c30baa70351`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:05.379876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-40bb793b-6b3d-4d15-aaf0-c3181091740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:05.569312 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1295/2626] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:05.729775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814544b-5cf2-4ba7-b8b0-30ee2a710e73 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:05.731820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e814544b-5cf2-4ba7-b8b0-30ee2a710e73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:05.756712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814544b-5cf2-4ba7-b8b0-30ee2a710e73 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:05.765739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5c4d4-8fc6-45b8-8620-ff3793224054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:05.769066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c4d4-8fc6-45b8-8620-ff3793224054 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:05.769353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c4d4-8fc6-45b8-8620-ff3793224054 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:05.769631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c4d4-8fc6-45b8-8620-ff3793224054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:05.774940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-86f5c4d4-8fc6-45b8-8620-ff3793224054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:05.807224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5c4d4-8fc6-45b8-8620-ff3793224054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:05.810577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5c4d4-8fc6-45b8-8620-ff3793224054 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:05.836179 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1332/2627] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:06:07.465685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75f070-5b5a-495e-9c78-aa054f1ef6c8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:07.466216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75f070-5b5a-495e-9c78-aa054f1ef6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:07.466216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75f070-5b5a-495e-9c78-aa054f1ef6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:07.511227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4f75f070-5b5a-495e-9c78-aa054f1ef6c8 None None] MFA Rules not processed for user `c44d7f87c3564cb681b680f389265c74`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:07.513097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4f75f070-5b5a-495e-9c78-aa054f1ef6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:07.785649 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1296/2628] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:10.063551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5c4d4-8fc6-45b8-8620-ff3793224054 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:10.065084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-86f5c4d4-8fc6-45b8-8620-ff3793224054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:10.110862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5c4d4-8fc6-45b8-8620-ff3793224054 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:10.120189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:10.120974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:10.121254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:10.121525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] PATH_INFO: `/v3/users/075812ec2ad746dcbb55fceead90d0eb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:10.126834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=075812ec2ad746dcbb55fceead90d0eb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:10.129124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:10.218197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075812ec2ad746dcbb55fceead90d0eb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:10.220201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075812ec2ad746dcbb55fceead90d0eb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:10.246495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075812ec2ad746dcbb55fceead90d0eb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:10.295953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075812ec2ad746dcbb55fceead90d0eb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:10.304906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075812ec2ad746dcbb55fceead90d0eb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:10.331548 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1333/2629] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:10 2022] DELETE /identity/v3/users/075812ec2ad746dcbb55fceead90d0eb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:10.525324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75f070-5b5a-495e-9c78-aa054f1ef6c8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:10.554027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75f070-5b5a-495e-9c78-aa054f1ef6c8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:10.712960 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:10.780666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ec66c-17ec-46cc-9779-1b221f97f5b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:10.781298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ec66c-17ec-46cc-9779-1b221f97f5b7 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:10.781576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ec66c-17ec-46cc-9779-1b221f97f5b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:10.781927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ec66c-17ec-46cc-9779-1b221f97f5b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:10.819873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-817ec66c-17ec-46cc-9779-1b221f97f5b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:10.976988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ec66c-17ec-46cc-9779-1b221f97f5b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:10.978870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ec66c-17ec-46cc-9779-1b221f97f5b7 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:11.011654 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1297/2630] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:11.643759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:11.650708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:11.746078 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:11.841832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af0101-9ae9-4e74-9521-b562b01c5061 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:11.861692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0d05e-410c-400d-a028-81bed9289fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:11.862560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0d05e-410c-400d-a028-81bed9289fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:11.863917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0d05e-410c-400d-a028-81bed9289fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:11.866656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0d05e-410c-400d-a028-81bed9289fc7 admin admin] PATH_INFO: `/v3/projects/8a91e848d7ef4946ad7499af40ad187e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:11.877059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0d05e-410c-400d-a028-81bed9289fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a91e848d7ef4946ad7499af40ad187e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:11.881007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0d05e-410c-400d-a028-81bed9289fc7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:12.021142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5b0d05e-410c-400d-a028-81bed9289fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a91e848d7ef4946ad7499af40ad187e', 'request_id': 'req-c5b0d05e-410c-400d-a028-81bed9289fc7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:12.035093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5b0d05e-410c-400d-a028-81bed9289fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a91e848d7ef4946ad7499af40ad187e', 'request_id': 'req-c5b0d05e-410c-400d-a028-81bed9289fc7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:12.050331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5b0d05e-410c-400d-a028-81bed9289fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a91e848d7ef4946ad7499af40ad187e', 'request_id': 'req-c5b0d05e-410c-400d-a028-81bed9289fc7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:12.076568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5b0d05e-410c-400d-a028-81bed9289fc7 admin admin] The token cache is being invalidate because project 8a91e848d7ef4946ad7499af40ad187e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:12.077265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5b0d05e-410c-400d-a028-81bed9289fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:12.078610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5b0d05e-410c-400d-a028-81bed9289fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:12.082015 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1334/2631] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:11 2022] DELETE /identity/v3/projects/8a91e848d7ef4946ad7499af40ad187e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:12.086762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6811c5-bb11-4608-9bf2-a4e4588d694a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.087282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6811c5-bb11-4608-9bf2-a4e4588d694a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.087368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6811c5-bb11-4608-9bf2-a4e4588d694a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.124979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cb6811c5-bb11-4608-9bf2-a4e4588d694a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:12.127283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cb6811c5-bb11-4608-9bf2-a4e4588d694a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:12.302777 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1298/2632] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:06:12.312077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15015c-d8c7-443c-a7d1-27cee8c719c2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.312657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15015c-d8c7-443c-a7d1-27cee8c719c2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.313745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15015c-d8c7-443c-a7d1-27cee8c719c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.369567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7e15015c-d8c7-443c-a7d1-27cee8c719c2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:12.377114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7e15015c-d8c7-443c-a7d1-27cee8c719c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:12.405289 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1335/2633] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:06:12.410322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6811c5-bb11-4608-9bf2-a4e4588d694a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:12.437673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6811c5-bb11-4608-9bf2-a4e4588d694a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:12.450794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe14668-23fa-47cc-90d6-4ec2d80663b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:12.453108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe14668-23fa-47cc-90d6-4ec2d80663b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.454508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe14668-23fa-47cc-90d6-4ec2d80663b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.454943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe14668-23fa-47cc-90d6-4ec2d80663b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.456245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe14668-23fa-47cc-90d6-4ec2d80663b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:06:12.457827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe14668-23fa-47cc-90d6-4ec2d80663b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:12.461400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe14668-23fa-47cc-90d6-4ec2d80663b4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:12.513418 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1299/2634] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:06:12.516756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15015c-d8c7-443c-a7d1-27cee8c719c2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:12.532254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15015c-d8c7-443c-a7d1-27cee8c719c2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:12.542665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ade256-c865-4e7c-b54d-d1ca0ad418bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:12.543888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ade256-c865-4e7c-b54d-d1ca0ad418bc admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.544283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ade256-c865-4e7c-b54d-d1ca0ad418bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.545122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ade256-c865-4e7c-b54d-d1ca0ad418bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.545896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ade256-c865-4e7c-b54d-d1ca0ad418bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:12.549499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ade256-c865-4e7c-b54d-d1ca0ad418bc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:12.635404 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1336/2635] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:12 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:12.636684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe14668-23fa-47cc-90d6-4ec2d80663b4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:12.665678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe14668-23fa-47cc-90d6-4ec2d80663b4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:12.914195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b8839-c249-4be4-81f6-dbeb31e49261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:12.924082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b8839-c249-4be4-81f6-dbeb31e49261 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.924605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b8839-c249-4be4-81f6-dbeb31e49261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.925128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b8839-c249-4be4-81f6-dbeb31e49261 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.926012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b8839-c249-4be4-81f6-dbeb31e49261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:12.933271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b8839-c249-4be4-81f6-dbeb31e49261 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:13.012235 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1300/2636] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:12 2022] POST /identity/v3/users => generated 293 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:13.015928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ade256-c865-4e7c-b54d-d1ca0ad418bc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:13.035794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ade256-c865-4e7c-b54d-d1ca0ad418bc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:13.049747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc5c39-6af0-4327-a5bc-fab74e1dfa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:13.050571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc5c39-6af0-4327-a5bc-fab74e1dfa2d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:13.051165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc5c39-6af0-4327-a5bc-fab74e1dfa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:13.051733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc5c39-6af0-4327-a5bc-fab74e1dfa2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:13.052607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc5c39-6af0-4327-a5bc-fab74e1dfa2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:13.055556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc5c39-6af0-4327-a5bc-fab74e1dfa2d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:13.076953 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1337/2637] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:13.081099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b8839-c249-4be4-81f6-dbeb31e49261 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:13.097345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b8839-c249-4be4-81f6-dbeb31e49261 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:13.106070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a8f41-3c2f-4eee-836e-97108c56abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:13.106975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a8f41-3c2f-4eee-836e-97108c56abb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:13.107492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a8f41-3c2f-4eee-836e-97108c56abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:13.108046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a8f41-3c2f-4eee-836e-97108c56abb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:13.109154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a8f41-3c2f-4eee-836e-97108c56abb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:13.111510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a8f41-3c2f-4eee-836e-97108c56abb9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:13.130657 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:13.171719 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1301/2638] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:13.176547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc5c39-6af0-4327-a5bc-fab74e1dfa2d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:13.205733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc5c39-6af0-4327-a5bc-fab74e1dfa2d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:13.237164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d17e9-6b2d-4476-aef0-2dcfe7efa334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:13.238012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d17e9-6b2d-4476-aef0-2dcfe7efa334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:13.240400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d17e9-6b2d-4476-aef0-2dcfe7efa334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:13.240693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d17e9-6b2d-4476-aef0-2dcfe7efa334 admin admin] PATH_INFO: `/v3/projects/fef9d51a911c47919ee3589efc80b986/users/9bdd2d0be04c469083df1dd7a0ddf986/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:13.266750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d17e9-6b2d-4476-aef0-2dcfe7efa334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef9d51a911c47919ee3589efc80b986, user_id=9bdd2d0be04c469083df1dd7a0ddf986, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:13.286505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d17e9-6b2d-4476-aef0-2dcfe7efa334 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:13.359413 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1338/2639] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:13 2022] PUT /identity/v3/projects/fef9d51a911c47919ee3589efc80b986/users/9bdd2d0be04c469083df1dd7a0ddf986/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:13.423609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41f40-532c-4a8a-b6da-7c317dc2dc30 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:13.423757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41f40-532c-4a8a-b6da-7c317dc2dc30 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:13.424309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41f40-532c-4a8a-b6da-7c317dc2dc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:13.515628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6da41f40-532c-4a8a-b6da-7c317dc2dc30 None None] MFA Rules not processed for user `9bdd2d0be04c469083df1dd7a0ddf986`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:13.521602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6da41f40-532c-4a8a-b6da-7c317dc2dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:13.699481 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1302/2640] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:14.255197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d17e9-6b2d-4476-aef0-2dcfe7efa334 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:14.259757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-755d17e9-6b2d-4476-aef0-2dcfe7efa334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:14.525136 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:14.583536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d17e9-6b2d-4476-aef0-2dcfe7efa334 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:14.612140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57ea54-dfde-4e6d-9eef-0b2d2a489514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:14.613161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ea54-dfde-4e6d-9eef-0b2d2a489514 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:14.613870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ea54-dfde-4e6d-9eef-0b2d2a489514 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:14.614136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ea54-dfde-4e6d-9eef-0b2d2a489514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:14.631142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57ea54-dfde-4e6d-9eef-0b2d2a489514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:14.635419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57ea54-dfde-4e6d-9eef-0b2d2a489514 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:14.654265 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1339/2641] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:15.256997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41f40-532c-4a8a-b6da-7c317dc2dc30 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:15.290360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41f40-532c-4a8a-b6da-7c317dc2dc30 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:15.305690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2936f12-bea5-49bb-9601-4e7892e5a5ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:15.306470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2936f12-bea5-49bb-9601-4e7892e5a5ef service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:15.306747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2936f12-bea5-49bb-9601-4e7892e5a5ef service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:15.307220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2936f12-bea5-49bb-9601-4e7892e5a5ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:15.316014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e2936f12-bea5-49bb-9601-4e7892e5a5ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:15.473735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2936f12-bea5-49bb-9601-4e7892e5a5ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:15.476978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2936f12-bea5-49bb-9601-4e7892e5a5ef service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:15.497259 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1303/2642] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:16.080888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041fd4a-242e-4c1d-86df-564cf3264eb2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:16.081452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041fd4a-242e-4c1d-86df-564cf3264eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:16.081452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041fd4a-242e-4c1d-86df-564cf3264eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:16.120742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5041fd4a-242e-4c1d-86df-564cf3264eb2 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:16.122385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5041fd4a-242e-4c1d-86df-564cf3264eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:16.306272 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1340/2643] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:06:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:16.324280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2936f12-bea5-49bb-9601-4e7892e5a5ef service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:16.326292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e2936f12-bea5-49bb-9601-4e7892e5a5ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:16.512688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2936f12-bea5-49bb-9601-4e7892e5a5ef service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:16.528284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a25bb7-ae9f-4eb1-bb23-423cd67e1059 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:16.529375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a25bb7-ae9f-4eb1-bb23-423cd67e1059 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:16.529815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a25bb7-ae9f-4eb1-bb23-423cd67e1059 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:16.530247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a25bb7-ae9f-4eb1-bb23-423cd67e1059 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:16.546416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a25bb7-ae9f-4eb1-bb23-423cd67e1059 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:16.548819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a25bb7-ae9f-4eb1-bb23-423cd67e1059 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:16.580384 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1304/2644] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:06:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:06:17.840145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d060a-5454-454c-95ea-3d2349aa68a0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:17.841037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d060a-5454-454c-95ea-3d2349aa68a0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:17.841465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d060a-5454-454c-95ea-3d2349aa68a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:17.880723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-371d060a-5454-454c-95ea-3d2349aa68a0 None None] MFA Rules not processed for user `875dca9ed4914e379601ddbdba035cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:17.883173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-371d060a-5454-454c-95ea-3d2349aa68a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:17.972285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a25bb7-ae9f-4eb1-bb23-423cd67e1059 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:17.989568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a25bb7-ae9f-4eb1-bb23-423cd67e1059 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:17.999602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a00b93-d495-4ac4-90b3-57b3782ea1ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:18.001652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a00b93-d495-4ac4-90b3-57b3782ea1ee service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:18.002089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a00b93-d495-4ac4-90b3-57b3782ea1ee service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:18.003134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a00b93-d495-4ac4-90b3-57b3782ea1ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:18.006139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-35a00b93-d495-4ac4-90b3-57b3782ea1ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:18.023641 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:18.080392 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1341/2645] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:06:18.150700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a00b93-d495-4ac4-90b3-57b3782ea1ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:18.165780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a00b93-d495-4ac4-90b3-57b3782ea1ee service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:18.191096 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1305/2646] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:17 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:06:20.387033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d060a-5454-454c-95ea-3d2349aa68a0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:20.512465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d060a-5454-454c-95ea-3d2349aa68a0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:20.517898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:20.519198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:20.521012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:20.521863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] PATH_INFO: `/v3/users/9bdd2d0be04c469083df1dd7a0ddf986` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:20.524805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bdd2d0be04c469083df1dd7a0ddf986)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:20.528245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:20.618743 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:20.627776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bdd2d0be04c469083df1dd7a0ddf986'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:20.628758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bdd2d0be04c469083df1dd7a0ddf986'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:20.647749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bdd2d0be04c469083df1dd7a0ddf986'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:20.661016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bdd2d0be04c469083df1dd7a0ddf986'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:20.661632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bdd2d0be04c469083df1dd7a0ddf986'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:20.686261 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1342/2647] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:20 2022] DELETE /identity/v3/users/9bdd2d0be04c469083df1dd7a0ddf986 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:20.690603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c318e-48f3-4893-ac0a-ca00a18cb886 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:20.691644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c318e-48f3-4893-ac0a-ca00a18cb886 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:20.691922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c318e-48f3-4893-ac0a-ca00a18cb886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:20.734149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-894c318e-48f3-4893-ac0a-ca00a18cb886 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:20.736600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-894c318e-48f3-4893-ac0a-ca00a18cb886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:20.840356 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1306/2648] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:20.867177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:20.870205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:20.988650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b46c4f-84f4-4fd5-ba35-3add408fb6ff admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:20.998459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a674d6-0a0d-41ea-8d46-75ef25979115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:20.999779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a674d6-0a0d-41ea-8d46-75ef25979115 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:21.000206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a674d6-0a0d-41ea-8d46-75ef25979115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:21.000676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a674d6-0a0d-41ea-8d46-75ef25979115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:21.013512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a674d6-0a0d-41ea-8d46-75ef25979115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:21.014512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a674d6-0a0d-41ea-8d46-75ef25979115 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:21.028187 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1343/2649] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:21.831246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c318e-48f3-4893-ac0a-ca00a18cb886 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:21.833882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-894c318e-48f3-4893-ac0a-ca00a18cb886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:21.952350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c318e-48f3-4893-ac0a-ca00a18cb886 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:21.958848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6bca-89b2-47df-81a8-c1a556077100 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:21.960274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6bca-89b2-47df-81a8-c1a556077100 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:21.960657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6bca-89b2-47df-81a8-c1a556077100 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:21.961206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6bca-89b2-47df-81a8-c1a556077100 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:21.963151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c13b6bca-89b2-47df-81a8-c1a556077100 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:21.979109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b6bca-89b2-47df-81a8-c1a556077100 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:21.981409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b6bca-89b2-47df-81a8-c1a556077100 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:22.014147 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1307/2650] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:22.729348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a674d6-0a0d-41ea-8d46-75ef25979115 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:22.731358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d8a674d6-0a0d-41ea-8d46-75ef25979115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:22.758726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a674d6-0a0d-41ea-8d46-75ef25979115 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:22.782465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453703cc-821e-475a-aa19-aca37b084527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:22.783168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453703cc-821e-475a-aa19-aca37b084527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:22.783722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453703cc-821e-475a-aa19-aca37b084527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:22.784339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453703cc-821e-475a-aa19-aca37b084527 admin admin] PATH_INFO: `/v3/projects/fef9d51a911c47919ee3589efc80b986` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:22.785949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453703cc-821e-475a-aa19-aca37b084527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef9d51a911c47919ee3589efc80b986)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:22.788559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6bca-89b2-47df-81a8-c1a556077100 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:22.790225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c13b6bca-89b2-47df-81a8-c1a556077100 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:22.796445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453703cc-821e-475a-aa19-aca37b084527 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:22.823951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6bca-89b2-47df-81a8-c1a556077100 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:22.838491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bb12e-2ab2-4925-bf02-2ec3ead5aa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:22.839972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bb12e-2ab2-4925-bf02-2ec3ead5aa69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:22.841581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bb12e-2ab2-4925-bf02-2ec3ead5aa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:22.845812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bb12e-2ab2-4925-bf02-2ec3ead5aa69 admin admin] PATH_INFO: `/v3/users/c44d7f87c3564cb681b680f389265c74` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:22.847482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8bb12e-2ab2-4925-bf02-2ec3ead5aa69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44d7f87c3564cb681b680f389265c74)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:22.851153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8bb12e-2ab2-4925-bf02-2ec3ead5aa69 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:22.953641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-453703cc-821e-475a-aa19-aca37b084527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef9d51a911c47919ee3589efc80b986', 'request_id': 'req-453703cc-821e-475a-aa19-aca37b084527'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:22.978964 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:22.987992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-453703cc-821e-475a-aa19-aca37b084527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef9d51a911c47919ee3589efc80b986', 'request_id': 'req-453703cc-821e-475a-aa19-aca37b084527'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.010254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-453703cc-821e-475a-aa19-aca37b084527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef9d51a911c47919ee3589efc80b986', 'request_id': 'req-453703cc-821e-475a-aa19-aca37b084527'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.028222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da8bb12e-2ab2-4925-bf02-2ec3ead5aa69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44d7f87c3564cb681b680f389265c74'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.035083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da8bb12e-2ab2-4925-bf02-2ec3ead5aa69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44d7f87c3564cb681b680f389265c74'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.065490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-453703cc-821e-475a-aa19-aca37b084527 admin admin] The token cache is being invalidate because project fef9d51a911c47919ee3589efc80b986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:23.065789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-453703cc-821e-475a-aa19-aca37b084527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.066495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-453703cc-821e-475a-aa19-aca37b084527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.071048 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1344/2651] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:22 2022] DELETE /identity/v3/projects/fef9d51a911c47919ee3589efc80b986 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:23.087306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dfd0e-94b7-4cdf-b858-4c5bba61e07a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.087306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dfd0e-94b7-4cdf-b858-4c5bba61e07a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.087306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dfd0e-94b7-4cdf-b858-4c5bba61e07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.108228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da8bb12e-2ab2-4925-bf02-2ec3ead5aa69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44d7f87c3564cb681b680f389265c74'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.137788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da8bb12e-2ab2-4925-bf02-2ec3ead5aa69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44d7f87c3564cb681b680f389265c74'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.139027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da8bb12e-2ab2-4925-bf02-2ec3ead5aa69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44d7f87c3564cb681b680f389265c74'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.159860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-166dfd0e-94b7-4cdf-b858-4c5bba61e07a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:23.172976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-166dfd0e-94b7-4cdf-b858-4c5bba61e07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:23.193273 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1308/2652] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:22 2022] DELETE /identity/v3/users/c44d7f87c3564cb681b680f389265c74 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:06:23.364215 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:23.467093 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1345/2653] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:23.476050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab8f90-b9f2-47ab-b945-94577be63b1a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.476391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab8f90-b9f2-47ab-b945-94577be63b1a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.477556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab8f90-b9f2-47ab-b945-94577be63b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.478123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dfd0e-94b7-4cdf-b858-4c5bba61e07a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:23.479815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-166dfd0e-94b7-4cdf-b858-4c5bba61e07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:23.526250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-45ab8f90-b9f2-47ab-b945-94577be63b1a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:23.528165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-45ab8f90-b9f2-47ab-b945-94577be63b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:23.554026 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1309/2654] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:23.564862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab8f90-b9f2-47ab-b945-94577be63b1a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:23.588219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab8f90-b9f2-47ab-b945-94577be63b1a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:23.593110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dfd0e-94b7-4cdf-b858-4c5bba61e07a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:23.599529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7da170-b9fa-4b5f-9050-450f3679bfbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:23.600167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7da170-b9fa-4b5f-9050-450f3679bfbd service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.600442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7da170-b9fa-4b5f-9050-450f3679bfbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.600710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7da170-b9fa-4b5f-9050-450f3679bfbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.602573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2b7da170-b9fa-4b5f-9050-450f3679bfbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:23.617362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dd938-e553-41a5-877e-c0341b2ed047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:23.618057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dd938-e553-41a5-877e-c0341b2ed047 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.618443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dd938-e553-41a5-877e-c0341b2ed047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.618649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dd938-e553-41a5-877e-c0341b2ed047 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.619398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dd938-e553-41a5-877e-c0341b2ed047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:06:23.619724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dd938-e553-41a5-877e-c0341b2ed047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:23.621527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dd938-e553-41a5-877e-c0341b2ed047 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:23.653204 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1310/2655] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:06:23.654783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dd938-e553-41a5-877e-c0341b2ed047 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:23.687137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dd938-e553-41a5-877e-c0341b2ed047 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:23.698178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d65528-8e6c-408d-bb19-f424ae97f081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:23.700024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d65528-8e6c-408d-bb19-f424ae97f081 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.700526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d65528-8e6c-408d-bb19-f424ae97f081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.700674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d65528-8e6c-408d-bb19-f424ae97f081 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.704200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d65528-8e6c-408d-bb19-f424ae97f081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:23.718727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d65528-8e6c-408d-bb19-f424ae97f081 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:23.776733 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1311/2656] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:23 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:23.778013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d65528-8e6c-408d-bb19-f424ae97f081 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:23.783672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7da170-b9fa-4b5f-9050-450f3679bfbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:23.784660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-07d65528-8e6c-408d-bb19-f424ae97f081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:23.786959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7da170-b9fa-4b5f-9050-450f3679bfbd service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:23.811333 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1346/2657] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:23.811493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7da170-b9fa-4b5f-9050-450f3679bfbd service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:23.828139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7da170-b9fa-4b5f-9050-450f3679bfbd service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:23.975576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494caef-1195-4735-a5a3-1b2eeb0f6edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:23.977772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494caef-1195-4735-a5a3-1b2eeb0f6edd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.978269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494caef-1195-4735-a5a3-1b2eeb0f6edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.979660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494caef-1195-4735-a5a3-1b2eeb0f6edd admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.983948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494caef-1195-4735-a5a3-1b2eeb0f6edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:23.987381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d65528-8e6c-408d-bb19-f424ae97f081 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:23.987893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494caef-1195-4735-a5a3-1b2eeb0f6edd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:24.005362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:24.006016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:24.006608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:24.006608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] PATH_INFO: `/v3/projects/6134cfbb8dc9412886f06387d75ccf6f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:24.008123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6134cfbb8dc9412886f06387d75ccf6f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:24.010658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:24.049780 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1347/2658] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:23 2022] POST /identity/v3/users => generated 302 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:24.052604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494caef-1195-4735-a5a3-1b2eeb0f6edd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:24.095871 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:24.150801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6134cfbb8dc9412886f06387d75ccf6f', 'request_id': 'req-b4546f1c-98fe-4fdc-be29-0b56423e590e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:24.176233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6134cfbb8dc9412886f06387d75ccf6f', 'request_id': 'req-b4546f1c-98fe-4fdc-be29-0b56423e590e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:24.194342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6134cfbb8dc9412886f06387d75ccf6f', 'request_id': 'req-b4546f1c-98fe-4fdc-be29-0b56423e590e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:24.206535 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:24.218743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] The token cache is being invalidate because project 6134cfbb8dc9412886f06387d75ccf6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:24.220115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:24.222170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:24.225559 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1312/2659] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:23 2022] DELETE /identity/v3/projects/6134cfbb8dc9412886f06387d75ccf6f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:24.227185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:24.231355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:24.238878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494caef-1195-4735-a5a3-1b2eeb0f6edd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:24.414840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4546f1c-98fe-4fdc-be29-0b56423e590e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:24.439743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ff26b-64a8-4da4-a590-df393d5ae7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:24.440387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ff26b-64a8-4da4-a590-df393d5ae7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:24.440667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ff26b-64a8-4da4-a590-df393d5ae7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:24.440997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ff26b-64a8-4da4-a590-df393d5ae7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:24.441659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ff26b-64a8-4da4-a590-df393d5ae7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:24.443437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ff26b-64a8-4da4-a590-df393d5ae7b1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:24.459089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea3ee5-7436-4891-ae0a-e500f4bcc8c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:24.459722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea3ee5-7436-4891-ae0a-e500f4bcc8c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:24.459999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea3ee5-7436-4891-ae0a-e500f4bcc8c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:24.460272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea3ee5-7436-4891-ae0a-e500f4bcc8c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:24.463909 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1313/2660] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:24.465695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9639b-e24e-4435-afa7-fc5c5b9f7917 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:24.465982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9639b-e24e-4435-afa7-fc5c5b9f7917 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:24.466255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9639b-e24e-4435-afa7-fc5c5b9f7917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:24.468023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-31ea3ee5-7436-4891-ae0a-e500f4bcc8c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:24.490124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea3ee5-7436-4891-ae0a-e500f4bcc8c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:24.491530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea3ee5-7436-4891-ae0a-e500f4bcc8c0 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:24.514577 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1348/2661] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:24.515493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea3ee5-7436-4891-ae0a-e500f4bcc8c0 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:24.516581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-96d9639b-e24e-4435-afa7-fc5c5b9f7917 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:24.518371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-96d9639b-e24e-4435-afa7-fc5c5b9f7917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:24.536426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea3ee5-7436-4891-ae0a-e500f4bcc8c0 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:24.539109 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1314/2662] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:24.546673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da59b1-0b55-4035-9c9d-32e492de83c0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:24.547057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da59b1-0b55-4035-9c9d-32e492de83c0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:24.547057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da59b1-0b55-4035-9c9d-32e492de83c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:24.560714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1742-8d60-4e7e-8baa-42d990ae6042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:24.560714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1742-8d60-4e7e-8baa-42d990ae6042 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:24.560714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1742-8d60-4e7e-8baa-42d990ae6042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:24.560714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1742-8d60-4e7e-8baa-42d990ae6042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:24.562010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef1742-8d60-4e7e-8baa-42d990ae6042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:24.562010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef1742-8d60-4e7e-8baa-42d990ae6042 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:24.590404 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1349/2663] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:24.595100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1742-8d60-4e7e-8baa-42d990ae6042 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:24.596727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e9da59b1-0b55-4035-9c9d-32e492de83c0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:24.598036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e9da59b1-0b55-4035-9c9d-32e492de83c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:24.620419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1742-8d60-4e7e-8baa-42d990ae6042 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:24.626886 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1315/2664] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:06:24.631364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da59b1-0b55-4035-9c9d-32e492de83c0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:24.638329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8965724-07b2-4b52-9609-c8c3e5cc1e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:24.639162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8965724-07b2-4b52-9609-c8c3e5cc1e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:24.639876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8965724-07b2-4b52-9609-c8c3e5cc1e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:24.640395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8965724-07b2-4b52-9609-c8c3e5cc1e49 admin admin] PATH_INFO: `/v3/projects/06ffa5dcbbb745ba8b09806f2202e95d/users/e6f9ebc41aaf4f2895c5f2fb02e28166/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:24.652694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da59b1-0b55-4035-9c9d-32e492de83c0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:24.666814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51755919-d33f-4336-9601-9eeace41e908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:24.667594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755919-d33f-4336-9601-9eeace41e908 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:24.667969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755919-d33f-4336-9601-9eeace41e908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:24.668474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755919-d33f-4336-9601-9eeace41e908 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:24.669243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51755919-d33f-4336-9601-9eeace41e908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:06:24.670546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51755919-d33f-4336-9601-9eeace41e908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:24.674115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51755919-d33f-4336-9601-9eeace41e908 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:24.677771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8965724-07b2-4b52-9609-c8c3e5cc1e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ffa5dcbbb745ba8b09806f2202e95d, user_id=e6f9ebc41aaf4f2895c5f2fb02e28166, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:24.682587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8965724-07b2-4b52-9609-c8c3e5cc1e49 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:24.701746 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1316/2665] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:06:24.704427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51755919-d33f-4336-9601-9eeace41e908 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:24.718633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51755919-d33f-4336-9601-9eeace41e908 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:24.724186 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1350/2666] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:24 2022] PUT /identity/v3/projects/06ffa5dcbbb745ba8b09806f2202e95d/users/e6f9ebc41aaf4f2895c5f2fb02e28166/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:24.727089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44076ef6-62c2-49f0-9e94-fa231362c510 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:24.727839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44076ef6-62c2-49f0-9e94-fa231362c510 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:24.728391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44076ef6-62c2-49f0-9e94-fa231362c510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:24.780995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-44076ef6-62c2-49f0-9e94-fa231362c510 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:24.785007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-44076ef6-62c2-49f0-9e94-fa231362c510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:24.865131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afa193-9010-4f23-975b-9843455428ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:24.865818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afa193-9010-4f23-975b-9843455428ee admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:24.866252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afa193-9010-4f23-975b-9843455428ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:24.866530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afa193-9010-4f23-975b-9843455428ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:24.867238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afa193-9010-4f23-975b-9843455428ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:24.869232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afa193-9010-4f23-975b-9843455428ee admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:24.945278 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1317/2667] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:24 2022] POST /identity/v3/projects => generated 403 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:24.946243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afa193-9010-4f23-975b-9843455428ee admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:24.989232 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1351/2668] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:25.058263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44076ef6-62c2-49f0-9e94-fa231362c510 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:25.060344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-44076ef6-62c2-49f0-9e94-fa231362c510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:25.120029 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:25.140470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afa193-9010-4f23-975b-9843455428ee admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:25.171651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf564f54-f752-407f-b8c3-344a235f9eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:25.173157 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:25.177214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf564f54-f752-407f-b8c3-344a235f9eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:25.177634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf564f54-f752-407f-b8c3-344a235f9eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:25.178561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf564f54-f752-407f-b8c3-344a235f9eaa admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:25.179380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf564f54-f752-407f-b8c3-344a235f9eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:25.186806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf564f54-f752-407f-b8c3-344a235f9eaa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:25.223790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44076ef6-62c2-49f0-9e94-fa231362c510 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:25.270463 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1318/2669] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:24 2022] POST /identity/v3/users => generated 302 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:25.273759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf564f54-f752-407f-b8c3-344a235f9eaa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:25.312671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf564f54-f752-407f-b8c3-344a235f9eaa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:25.324530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe0f86-2642-4a19-9cf0-c0ccef69cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:25.326470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe0f86-2642-4a19-9cf0-c0ccef69cef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:25.327903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe0f86-2642-4a19-9cf0-c0ccef69cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:25.328661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe0f86-2642-4a19-9cf0-c0ccef69cef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:25.330998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe0f86-2642-4a19-9cf0-c0ccef69cef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:25.333951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe0f86-2642-4a19-9cf0-c0ccef69cef3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:25.379568 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1319/2670] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:25.379568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe0f86-2642-4a19-9cf0-c0ccef69cef3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:25.379733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35e76e-5fc0-4710-afcd-4db8a783b08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:25.379733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35e76e-5fc0-4710-afcd-4db8a783b08f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:25.379915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35e76e-5fc0-4710-afcd-4db8a783b08f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:25.380871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35e76e-5fc0-4710-afcd-4db8a783b08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:25.395955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35e76e-5fc0-4710-afcd-4db8a783b08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:25.398108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35e76e-5fc0-4710-afcd-4db8a783b08f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:25.422008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe0f86-2642-4a19-9cf0-c0ccef69cef3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:25.434712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5628d64-165f-4718-a6ef-c380027dbb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:25.435381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5628d64-165f-4718-a6ef-c380027dbb6a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:25.435664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5628d64-165f-4718-a6ef-c380027dbb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:25.435964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5628d64-165f-4718-a6ef-c380027dbb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:25.436649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5628d64-165f-4718-a6ef-c380027dbb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:25.438377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5628d64-165f-4718-a6ef-c380027dbb6a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:25.443864 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1352/2671] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:06:25.454626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35e76e-5fc0-4710-afcd-4db8a783b08f service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:25.458875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5f35e76e-5fc0-4710-afcd-4db8a783b08f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:25.462432 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1320/2672] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:25.466687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5628d64-165f-4718-a6ef-c380027dbb6a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:25.501406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35e76e-5fc0-4710-afcd-4db8a783b08f service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:25.504213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5628d64-165f-4718-a6ef-c380027dbb6a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:25.515781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1e005-4ddc-48aa-82b1-054c5aad8ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:25.518943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1e005-4ddc-48aa-82b1-054c5aad8ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:25.519255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1e005-4ddc-48aa-82b1-054c5aad8ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:25.522510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1e005-4ddc-48aa-82b1-054c5aad8ab6 admin admin] PATH_INFO: `/v3/users/5c224f40dc3447d2b3bec25f1ca968fa` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:25.523625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde7f95-7e56-4d41-a3ac-030faf6c303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:25.524380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde7f95-7e56-4d41-a3ac-030faf6c303d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:25.524694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde7f95-7e56-4d41-a3ac-030faf6c303d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:25.525523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde7f95-7e56-4d41-a3ac-030faf6c303d admin admin] PATH_INFO: `/v3/projects/7d149768b97a4e3985a0be62510997f3/users/d739d3fe2e744013b322ecb3b887be07/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:25.525663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1e005-4ddc-48aa-82b1-054c5aad8ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c224f40dc3447d2b3bec25f1ca968fa)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:25.529060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1e005-4ddc-48aa-82b1-054c5aad8ab6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:25.571687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde7f95-7e56-4d41-a3ac-030faf6c303d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d149768b97a4e3985a0be62510997f3, user_id=d739d3fe2e744013b322ecb3b887be07, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:25.589267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde7f95-7e56-4d41-a3ac-030faf6c303d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:25.633306 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1321/2673] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:25 2022] PUT /identity/v3/projects/7d149768b97a4e3985a0be62510997f3/users/d739d3fe2e744013b322ecb3b887be07/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:25.647736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504cde3-f1e6-42f8-889f-b15541ddd14d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:25.647736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504cde3-f1e6-42f8-889f-b15541ddd14d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:25.648577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504cde3-f1e6-42f8-889f-b15541ddd14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:25.668922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abc1e005-4ddc-48aa-82b1-054c5aad8ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c224f40dc3447d2b3bec25f1ca968fa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:25.669707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abc1e005-4ddc-48aa-82b1-054c5aad8ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c224f40dc3447d2b3bec25f1ca968fa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:25.684532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abc1e005-4ddc-48aa-82b1-054c5aad8ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c224f40dc3447d2b3bec25f1ca968fa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:25.684987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a504cde3-f1e6-42f8-889f-b15541ddd14d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:25.686773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a504cde3-f1e6-42f8-889f-b15541ddd14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:25.696090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abc1e005-4ddc-48aa-82b1-054c5aad8ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c224f40dc3447d2b3bec25f1ca968fa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:25.697189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abc1e005-4ddc-48aa-82b1-054c5aad8ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c224f40dc3447d2b3bec25f1ca968fa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:25.714234 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1353/2674] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:25 2022] DELETE /identity/v3/users/5c224f40dc3447d2b3bec25f1ca968fa => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:25.720097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd462986-c696-41fa-95ad-b981aab3cc88 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:25.720614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd462986-c696-41fa-95ad-b981aab3cc88 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:25.722283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd462986-c696-41fa-95ad-b981aab3cc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:25.755604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fd462986-c696-41fa-95ad-b981aab3cc88 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:25.757321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fd462986-c696-41fa-95ad-b981aab3cc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:25.831492 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1322/2675] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:25.877610 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1354/2676] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:06:25.889577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504cde3-f1e6-42f8-889f-b15541ddd14d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:25.891969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a504cde3-f1e6-42f8-889f-b15541ddd14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:25.900192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd462986-c696-41fa-95ad-b981aab3cc88 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:25.901676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fd462986-c696-41fa-95ad-b981aab3cc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:25.930488 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:26.036953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504cde3-f1e6-42f8-889f-b15541ddd14d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:26.042849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d921f9-8ab5-4cd4-bdd9-1a6ec0129400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:26.043338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d921f9-8ab5-4cd4-bdd9-1a6ec0129400 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:26.043688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d921f9-8ab5-4cd4-bdd9-1a6ec0129400 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:26.044164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d921f9-8ab5-4cd4-bdd9-1a6ec0129400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:26.051472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd462986-c696-41fa-95ad-b981aab3cc88 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:26.061064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1bcab-bc84-4a82-9a7f-dcd1b80be8a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:26.063733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1bcab-bc84-4a82-9a7f-dcd1b80be8a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:26.064911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1bcab-bc84-4a82-9a7f-dcd1b80be8a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:26.065263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1bcab-bc84-4a82-9a7f-dcd1b80be8a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:26.068077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d921f9-8ab5-4cd4-bdd9-1a6ec0129400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:26.070576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d921f9-8ab5-4cd4-bdd9-1a6ec0129400 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:26.083536 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1323/2677] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:26.088161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1bcab-bc84-4a82-9a7f-dcd1b80be8a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:26.090137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1bcab-bc84-4a82-9a7f-dcd1b80be8a2 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:26.112212 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1355/2678] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:26.914625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d921f9-8ab5-4cd4-bdd9-1a6ec0129400 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:26.916268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-30d921f9-8ab5-4cd4-bdd9-1a6ec0129400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:26.921523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1bcab-bc84-4a82-9a7f-dcd1b80be8a2 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:26.923527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-02d1bcab-bc84-4a82-9a7f-dcd1b80be8a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:26.940767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d921f9-8ab5-4cd4-bdd9-1a6ec0129400 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:26.945042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1bcab-bc84-4a82-9a7f-dcd1b80be8a2 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:26.950713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b260bbc-7043-4e0d-8a9e-096e5240f797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:26.951765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b260bbc-7043-4e0d-8a9e-096e5240f797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:26.952229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b260bbc-7043-4e0d-8a9e-096e5240f797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:26.952463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:26.952810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b260bbc-7043-4e0d-8a9e-096e5240f797 admin admin] PATH_INFO: `/v3/users/f3b14e05c41648159d8ed97719c68862` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:26.953312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:26.954624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b260bbc-7043-4e0d-8a9e-096e5240f797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b14e05c41648159d8ed97719c68862)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:26.954772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:26.955204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] PATH_INFO: `/v3/projects/c4d93522c54c4449926b8ddfeda3d96e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:26.956499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d93522c54c4449926b8ddfeda3d96e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:26.957051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b260bbc-7043-4e0d-8a9e-096e5240f797 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:26.958725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:27.011032 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:27.052183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6b260bbc-7043-4e0d-8a9e-096e5240f797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b14e05c41648159d8ed97719c68862'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.052922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6b260bbc-7043-4e0d-8a9e-096e5240f797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b14e05c41648159d8ed97719c68862'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.059890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d93522c54c4449926b8ddfeda3d96e', 'request_id': 'req-818a0c1b-d40f-4434-936c-5b67249d99d6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.070989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6b260bbc-7043-4e0d-8a9e-096e5240f797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b14e05c41648159d8ed97719c68862'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.080270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d93522c54c4449926b8ddfeda3d96e', 'request_id': 'req-818a0c1b-d40f-4434-936c-5b67249d99d6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.083215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6b260bbc-7043-4e0d-8a9e-096e5240f797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b14e05c41648159d8ed97719c68862'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.085415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6b260bbc-7043-4e0d-8a9e-096e5240f797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b14e05c41648159d8ed97719c68862'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.098241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d93522c54c4449926b8ddfeda3d96e', 'request_id': 'req-818a0c1b-d40f-4434-936c-5b67249d99d6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.107139 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1356/2679] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:26 2022] DELETE /identity/v3/users/f3b14e05c41648159d8ed97719c68862 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:06:27.112263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4de57-f149-40aa-90dc-ca54be9ee5f5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.112984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4de57-f149-40aa-90dc-ca54be9ee5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.113513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4de57-f149-40aa-90dc-ca54be9ee5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:27.129255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] The token cache is being invalidate because project c4d93522c54c4449926b8ddfeda3d96e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:27.131136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.132627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.140076 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1324/2680] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:26 2022] DELETE /identity/v3/projects/c4d93522c54c4449926b8ddfeda3d96e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:27.141810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:27.143618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:27.146329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-75e4de57-f149-40aa-90dc-ca54be9ee5f5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:27.148214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-75e4de57-f149-40aa-90dc-ca54be9ee5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:27.261250 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1357/2681] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:06:27.282220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a0c1b-d40f-4434-936c-5b67249d99d6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:27.295260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:27.296694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.296970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.297308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] PATH_INFO: `/v3/users/06312e3c1bc94c77ac6d840e5f325588` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:27.299876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=06312e3c1bc94c77ac6d840e5f325588)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:27.304551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:27.312143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4de57-f149-40aa-90dc-ca54be9ee5f5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:27.314160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-75e4de57-f149-40aa-90dc-ca54be9ee5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:27.436057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06312e3c1bc94c77ac6d840e5f325588'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.439564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06312e3c1bc94c77ac6d840e5f325588'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.446408 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:27.474151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06312e3c1bc94c77ac6d840e5f325588'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.491050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06312e3c1bc94c77ac6d840e5f325588'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.491720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06312e3c1bc94c77ac6d840e5f325588'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.518827 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1325/2682] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:27 2022] DELETE /identity/v3/users/06312e3c1bc94c77ac6d840e5f325588 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:27.540874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4de57-f149-40aa-90dc-ca54be9ee5f5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:27.613657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc79dba-aba9-4a20-a350-167faaceff27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:27.614279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc79dba-aba9-4a20-a350-167faaceff27 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.614555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc79dba-aba9-4a20-a350-167faaceff27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.614929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc79dba-aba9-4a20-a350-167faaceff27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:27.617437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1dc79dba-aba9-4a20-a350-167faaceff27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:27.702099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc79dba-aba9-4a20-a350-167faaceff27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:27.704733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc79dba-aba9-4a20-a350-167faaceff27 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:27.721307 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1358/2683] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:06:29.067202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:29.068718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:29.094844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a957f-eba3-421d-8225-1c5327e0a65d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:29.112088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:29.114277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:29.114570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:29.114845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] PATH_INFO: `/v3/projects/f6556287cca54d74b4971ef3e666cc1e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:29.117554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6556287cca54d74b4971ef3e666cc1e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:29.121895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:29.123542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc79dba-aba9-4a20-a350-167faaceff27 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:29.126218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1dc79dba-aba9-4a20-a350-167faaceff27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:29.149977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc79dba-aba9-4a20-a350-167faaceff27 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:29.168519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7770ab-5e1d-409a-8868-06de96c46621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:29.169329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7770ab-5e1d-409a-8868-06de96c46621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:29.169616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7770ab-5e1d-409a-8868-06de96c46621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:29.169908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7770ab-5e1d-409a-8868-06de96c46621 admin admin] PATH_INFO: `/v3/projects/8c8d4ba17275414498d270c16b5d42c3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:29.175963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7770ab-5e1d-409a-8868-06de96c46621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8d4ba17275414498d270c16b5d42c3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:29.181749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7770ab-5e1d-409a-8868-06de96c46621 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:29.229429 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:29.259505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6556287cca54d74b4971ef3e666cc1e', 'request_id': 'req-00175bbb-7e1a-4289-b383-479466579922'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:29.276241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6556287cca54d74b4971ef3e666cc1e', 'request_id': 'req-00175bbb-7e1a-4289-b383-479466579922'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:29.290948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d7770ab-5e1d-409a-8868-06de96c46621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8d4ba17275414498d270c16b5d42c3', 'request_id': 'req-4d7770ab-5e1d-409a-8868-06de96c46621'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:29.299951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d7770ab-5e1d-409a-8868-06de96c46621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8d4ba17275414498d270c16b5d42c3', 'request_id': 'req-4d7770ab-5e1d-409a-8868-06de96c46621'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:29.304306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6556287cca54d74b4971ef3e666cc1e', 'request_id': 'req-00175bbb-7e1a-4289-b383-479466579922'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:29.312658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d7770ab-5e1d-409a-8868-06de96c46621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8d4ba17275414498d270c16b5d42c3', 'request_id': 'req-4d7770ab-5e1d-409a-8868-06de96c46621'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:29.331929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] The token cache is being invalidate because project f6556287cca54d74b4971ef3e666cc1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:29.332427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:29.335073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:29.341681 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1326/2684] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:29 2022] DELETE /identity/v3/projects/f6556287cca54d74b4971ef3e666cc1e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:29.346583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:29.351023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:29.351815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d7770ab-5e1d-409a-8868-06de96c46621 admin admin] The token cache is being invalidate because project 8c8d4ba17275414498d270c16b5d42c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:29.352481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d7770ab-5e1d-409a-8868-06de96c46621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:29.353624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d7770ab-5e1d-409a-8868-06de96c46621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:29.357126 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1359/2685] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:29 2022] DELETE /identity/v3/projects/8c8d4ba17275414498d270c16b5d42c3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:06:29.372496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4047fc-df60-483b-812c-9c416b9bbc62 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:29.373171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4047fc-df60-483b-812c-9c416b9bbc62 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:29.373557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4047fc-df60-483b-812c-9c416b9bbc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:29.456641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0b4047fc-df60-483b-812c-9c416b9bbc62 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:29.465879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0b4047fc-df60-483b-812c-9c416b9bbc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:29.507569 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:29.545371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00175bbb-7e1a-4289-b383-479466579922 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:29.757506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2aab6-0e1b-4e8f-b153-d0c0f70db2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:29.758192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2aab6-0e1b-4e8f-b153-d0c0f70db2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:29.760258 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1360/2686] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:29.761214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2aab6-0e1b-4e8f-b153-d0c0f70db2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:29.761582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2aab6-0e1b-4e8f-b153-d0c0f70db2d4 admin admin] PATH_INFO: `/v3/users/6f6ea3b7518449b89a369107e12ee9cf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:29.767012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2aab6-0e1b-4e8f-b153-d0c0f70db2d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6ea3b7518449b89a369107e12ee9cf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:29.769599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2aab6-0e1b-4e8f-b153-d0c0f70db2d4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:29.770180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ed4f3-8af8-4b48-992a-f2ded277b0e9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:29.770833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ed4f3-8af8-4b48-992a-f2ded277b0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:29.772187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ed4f3-8af8-4b48-992a-f2ded277b0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:29.825802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c79ed4f3-8af8-4b48-992a-f2ded277b0e9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:29.827328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c79ed4f3-8af8-4b48-992a-f2ded277b0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:29.839579 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1361/2687] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:06:29.845246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ed4f3-8af8-4b48-992a-f2ded277b0e9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:29.858536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ed4f3-8af8-4b48-992a-f2ded277b0e9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:29.872066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d913fd-b5d3-490c-afd0-957875068e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:29.873766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d913fd-b5d3-490c-afd0-957875068e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:29.874048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d913fd-b5d3-490c-afd0-957875068e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:29.876259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d913fd-b5d3-490c-afd0-957875068e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:29.877124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d913fd-b5d3-490c-afd0-957875068e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:06:29.878315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d913fd-b5d3-490c-afd0-957875068e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:29.882244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d913fd-b5d3-490c-afd0-957875068e46 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:29.907139 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1362/2688] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:06:29.911014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d913fd-b5d3-490c-afd0-957875068e46 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:29.933261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06d2aab6-0e1b-4e8f-b153-d0c0f70db2d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6ea3b7518449b89a369107e12ee9cf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:29.934441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06d2aab6-0e1b-4e8f-b153-d0c0f70db2d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6ea3b7518449b89a369107e12ee9cf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:29.939874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d913fd-b5d3-490c-afd0-957875068e46 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:29.998282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06d2aab6-0e1b-4e8f-b153-d0c0f70db2d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6ea3b7518449b89a369107e12ee9cf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:30.013835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41425973-0323-49ec-b0ef-5e1ffc539a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:30.014785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41425973-0323-49ec-b0ef-5e1ffc539a04 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:30.015284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41425973-0323-49ec-b0ef-5e1ffc539a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:30.015555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41425973-0323-49ec-b0ef-5e1ffc539a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:30.016934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41425973-0323-49ec-b0ef-5e1ffc539a04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:30.019752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41425973-0323-49ec-b0ef-5e1ffc539a04 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:30.022965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06d2aab6-0e1b-4e8f-b153-d0c0f70db2d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6ea3b7518449b89a369107e12ee9cf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:30.023988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06d2aab6-0e1b-4e8f-b153-d0c0f70db2d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6ea3b7518449b89a369107e12ee9cf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:30.026681 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:30.087709 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1363/2689] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:29 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:30.093790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41425973-0323-49ec-b0ef-5e1ffc539a04 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:30.097540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-41425973-0323-49ec-b0ef-5e1ffc539a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:30.103774 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1327/2690] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:29 2022] DELETE /identity/v3/users/6f6ea3b7518449b89a369107e12ee9cf => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:06:30.238725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41425973-0323-49ec-b0ef-5e1ffc539a04 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:30.407250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508d2bb-1945-440f-95c5-c6dd9439ebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:30.408284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508d2bb-1945-440f-95c5-c6dd9439ebc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:30.408792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508d2bb-1945-440f-95c5-c6dd9439ebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:30.409293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508d2bb-1945-440f-95c5-c6dd9439ebc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:30.410160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508d2bb-1945-440f-95c5-c6dd9439ebc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:30.416903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508d2bb-1945-440f-95c5-c6dd9439ebc9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:30.467839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2aab6-0e1b-4e8f-b153-d0c0f70db2d4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:30.468068 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1364/2691] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:30 2022] POST /identity/v3/users => generated 293 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:30.491459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2aab6-0e1b-4e8f-b153-d0c0f70db2d4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:30.502163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af576a3-2b54-4d9d-9a21-9895fdfcdbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:30.502883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af576a3-2b54-4d9d-9a21-9895fdfcdbfe admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:30.506552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af576a3-2b54-4d9d-9a21-9895fdfcdbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:30.506944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af576a3-2b54-4d9d-9a21-9895fdfcdbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:30.507716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af576a3-2b54-4d9d-9a21-9895fdfcdbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:30.511112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af576a3-2b54-4d9d-9a21-9895fdfcdbfe admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:30.536538 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1328/2692] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:30.543416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508d2bb-1945-440f-95c5-c6dd9439ebc9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:30.586876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508d2bb-1945-440f-95c5-c6dd9439ebc9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:30.609618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7de5df-809d-4dcf-b4d1-af8f0a8a6bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:30.613172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7de5df-809d-4dcf-b4d1-af8f0a8a6bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:30.613663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7de5df-809d-4dcf-b4d1-af8f0a8a6bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:30.614403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7de5df-809d-4dcf-b4d1-af8f0a8a6bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:30.615339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7de5df-809d-4dcf-b4d1-af8f0a8a6bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:30.626760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7de5df-809d-4dcf-b4d1-af8f0a8a6bf6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:30.638065 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:30.682443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af576a3-2b54-4d9d-9a21-9895fdfcdbfe admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:30.682720 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1365/2693] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:30.700251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af576a3-2b54-4d9d-9a21-9895fdfcdbfe admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:30.712488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758b651-6053-4336-8415-aeb971d4fcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:30.713624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758b651-6053-4336-8415-aeb971d4fcd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:30.714115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758b651-6053-4336-8415-aeb971d4fcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:30.714618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758b651-6053-4336-8415-aeb971d4fcd5 admin admin] PATH_INFO: `/v3/projects/622fb0e0967148838b71b51b4d572d38/users/a745e8bb56574606b709907e661b9cd8/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:30.750724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758b651-6053-4336-8415-aeb971d4fcd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622fb0e0967148838b71b51b4d572d38, user_id=a745e8bb56574606b709907e661b9cd8, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:30.762899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758b651-6053-4336-8415-aeb971d4fcd5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:30.793173 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1329/2694] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:30 2022] PUT /identity/v3/projects/622fb0e0967148838b71b51b4d572d38/users/a745e8bb56574606b709907e661b9cd8/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:06:30.801822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17267dc0-3ca2-4638-963d-2e16d9e55cf6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:30.802327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17267dc0-3ca2-4638-963d-2e16d9e55cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:30.802815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17267dc0-3ca2-4638-963d-2e16d9e55cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:30.864921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-17267dc0-3ca2-4638-963d-2e16d9e55cf6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:30.871394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-17267dc0-3ca2-4638-963d-2e16d9e55cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:31.099409 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1366/2695] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:31.112226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758b651-6053-4336-8415-aeb971d4fcd5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:31.115687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3758b651-6053-4336-8415-aeb971d4fcd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:31.494948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758b651-6053-4336-8415-aeb971d4fcd5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:31.501366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5829027-de35-4adb-819f-c6a5df16f5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:31.502140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5829027-de35-4adb-819f-c6a5df16f5ba service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:31.503480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5829027-de35-4adb-819f-c6a5df16f5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:31.503480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5829027-de35-4adb-819f-c6a5df16f5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:31.515780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5829027-de35-4adb-819f-c6a5df16f5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:31.518046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5829027-de35-4adb-819f-c6a5df16f5ba service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:31.561892 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1330/2696] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:31.949000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17267dc0-3ca2-4638-963d-2e16d9e55cf6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:31.952080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-17267dc0-3ca2-4638-963d-2e16d9e55cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:31.975390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17267dc0-3ca2-4638-963d-2e16d9e55cf6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:31.990702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24408db2-68bb-42d7-8038-316f45afb4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:31.991386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24408db2-68bb-42d7-8038-316f45afb4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:31.991661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24408db2-68bb-42d7-8038-316f45afb4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:31.991929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24408db2-68bb-42d7-8038-316f45afb4b7 admin admin] PATH_INFO: `/v3/projects/f1dc88035f18493d8c713b47a35517ea` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:31.993076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24408db2-68bb-42d7-8038-316f45afb4b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1dc88035f18493d8c713b47a35517ea)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:31.995070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24408db2-68bb-42d7-8038-316f45afb4b7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:32.137776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24408db2-68bb-42d7-8038-316f45afb4b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1dc88035f18493d8c713b47a35517ea', 'request_id': 'req-24408db2-68bb-42d7-8038-316f45afb4b7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:32.154190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24408db2-68bb-42d7-8038-316f45afb4b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1dc88035f18493d8c713b47a35517ea', 'request_id': 'req-24408db2-68bb-42d7-8038-316f45afb4b7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:32.208684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24408db2-68bb-42d7-8038-316f45afb4b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1dc88035f18493d8c713b47a35517ea', 'request_id': 'req-24408db2-68bb-42d7-8038-316f45afb4b7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:32.258870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24408db2-68bb-42d7-8038-316f45afb4b7 admin admin] The token cache is being invalidate because project f1dc88035f18493d8c713b47a35517ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:32.259191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24408db2-68bb-42d7-8038-316f45afb4b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:32.269692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24408db2-68bb-42d7-8038-316f45afb4b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:32.274418 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1367/2697] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:31 2022] DELETE /identity/v3/projects/f1dc88035f18493d8c713b47a35517ea => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:32.282714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c398b2-371c-4aaf-984e-64fa9d71b555 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:32.283446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c398b2-371c-4aaf-984e-64fa9d71b555 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:32.283908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c398b2-371c-4aaf-984e-64fa9d71b555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:32.320468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b3c398b2-371c-4aaf-984e-64fa9d71b555 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:32.321982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b3c398b2-371c-4aaf-984e-64fa9d71b555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:32.513374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb35f25-9f5d-4c08-b3a4-1ef051c6b0c1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:32.513723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb35f25-9f5d-4c08-b3a4-1ef051c6b0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:32.513908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb35f25-9f5d-4c08-b3a4-1ef051c6b0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:32.514936 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1331/2698] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:32.567017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-edb35f25-9f5d-4c08-b3a4-1ef051c6b0c1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:32.568922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-edb35f25-9f5d-4c08-b3a4-1ef051c6b0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:32.593225 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1368/2699] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:32.598506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c398b2-371c-4aaf-984e-64fa9d71b555 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:32.614008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c398b2-371c-4aaf-984e-64fa9d71b555 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:32.621994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa690e-68db-44f0-b46c-dffc60f612b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:32.622879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa690e-68db-44f0-b46c-dffc60f612b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:32.623364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa690e-68db-44f0-b46c-dffc60f612b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:32.623993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa690e-68db-44f0-b46c-dffc60f612b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:32.625059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa690e-68db-44f0-b46c-dffc60f612b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:06:32.627363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa690e-68db-44f0-b46c-dffc60f612b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:32.630542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa690e-68db-44f0-b46c-dffc60f612b8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:32.676827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb35f25-9f5d-4c08-b3a4-1ef051c6b0c1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:32.687043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb35f25-9f5d-4c08-b3a4-1ef051c6b0c1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:32.689787 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1332/2700] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:06:32.708322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfafdb4-904d-41f7-b3e6-7509969efcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:32.708946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfafdb4-904d-41f7-b3e6-7509969efcbf admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:32.709221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfafdb4-904d-41f7-b3e6-7509969efcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:32.709489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfafdb4-904d-41f7-b3e6-7509969efcbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:32.710120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfafdb4-904d-41f7-b3e6-7509969efcbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:32.712244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfafdb4-904d-41f7-b3e6-7509969efcbf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:32.765164 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1369/2701] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:32 2022] POST /identity/v3/projects => generated 361 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:06:32.771141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa690e-68db-44f0-b46c-dffc60f612b8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:32.787510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa690e-68db-44f0-b46c-dffc60f612b8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:32.873166 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:32.918567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631f5d1-6788-4c04-9c6a-e9c45e068ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:32.919230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631f5d1-6788-4c04-9c6a-e9c45e068ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:32.919513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631f5d1-6788-4c04-9c6a-e9c45e068ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:32.919788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631f5d1-6788-4c04-9c6a-e9c45e068ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:32.920423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631f5d1-6788-4c04-9c6a-e9c45e068ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:32.928934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631f5d1-6788-4c04-9c6a-e9c45e068ac6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:32.987783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfafdb4-904d-41f7-b3e6-7509969efcbf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:32.988898 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1333/2702] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:32 2022] POST /identity/v3/users => generated 281 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:33.007519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfafdb4-904d-41f7-b3e6-7509969efcbf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:33.020281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f45af-c14f-4ad9-b122-ac9fe37134d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:33.021173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f45af-c14f-4ad9-b122-ac9fe37134d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:33.023944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f45af-c14f-4ad9-b122-ac9fe37134d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:33.025498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f45af-c14f-4ad9-b122-ac9fe37134d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:33.026560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f45af-c14f-4ad9-b122-ac9fe37134d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:33.032889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f45af-c14f-4ad9-b122-ac9fe37134d7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:33.066667 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1370/2703] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:33.067547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631f5d1-6788-4c04-9c6a-e9c45e068ac6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:33.078939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631f5d1-6788-4c04-9c6a-e9c45e068ac6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:33.095144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695f8aa-60fc-4584-aa6b-b9c5c340b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:33.096014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695f8aa-60fc-4584-aa6b-b9c5c340b7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:33.096813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695f8aa-60fc-4584-aa6b-b9c5c340b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:33.096813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695f8aa-60fc-4584-aa6b-b9c5c340b7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:33.097505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695f8aa-60fc-4584-aa6b-b9c5c340b7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:33.099278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695f8aa-60fc-4584-aa6b-b9c5c340b7e0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:33.131616 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1334/2704] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:33.133015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f45af-c14f-4ad9-b122-ac9fe37134d7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:33.150326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f45af-c14f-4ad9-b122-ac9fe37134d7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:33.155411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52472-b0b0-4af8-a380-fa9143399105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:33.156289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52472-b0b0-4af8-a380-fa9143399105 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:33.156807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52472-b0b0-4af8-a380-fa9143399105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:33.157894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52472-b0b0-4af8-a380-fa9143399105 admin admin] PATH_INFO: `/v3/projects/f1d2a6df99954f1aa85ebc9e028dfdb9/users/47e1b5a7ae4143bcaeef0f07f01aa0de/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:33.183231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52472-b0b0-4af8-a380-fa9143399105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d2a6df99954f1aa85ebc9e028dfdb9, user_id=47e1b5a7ae4143bcaeef0f07f01aa0de, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:33.186266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52472-b0b0-4af8-a380-fa9143399105 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:33.220965 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1371/2705] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:33 2022] PUT /identity/v3/projects/f1d2a6df99954f1aa85ebc9e028dfdb9/users/47e1b5a7ae4143bcaeef0f07f01aa0de/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:33.231612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ff4cb-1098-4e85-887e-4752f9a34a4f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:33.232251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ff4cb-1098-4e85-887e-4752f9a34a4f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:33.232733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ff4cb-1098-4e85-887e-4752f9a34a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:33.272475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-378ff4cb-1098-4e85-887e-4752f9a34a4f None None] MFA Rules not processed for user `47e1b5a7ae4143bcaeef0f07f01aa0de`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:33.274311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-378ff4cb-1098-4e85-887e-4752f9a34a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:33.388488 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1335/2706] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:33.390568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52472-b0b0-4af8-a380-fa9143399105 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:33.432386 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:33.557492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52472-b0b0-4af8-a380-fa9143399105 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:33.564498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebc50d-3abd-4339-9bba-e6ef4df6c83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:33.565123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebc50d-3abd-4339-9bba-e6ef4df6c83c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:33.565401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebc50d-3abd-4339-9bba-e6ef4df6c83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:33.565674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebc50d-3abd-4339-9bba-e6ef4df6c83c admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:33.566326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebc50d-3abd-4339-9bba-e6ef4df6c83c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:33.569682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebc50d-3abd-4339-9bba-e6ef4df6c83c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:33.621443 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1372/2707] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:33 2022] POST /identity/v3/projects => generated 359 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:33.625150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ff4cb-1098-4e85-887e-4752f9a34a4f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:33.644682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ff4cb-1098-4e85-887e-4752f9a34a4f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:33.723031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49266f5-cadf-418a-b825-b53fb1952b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:33.723838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49266f5-cadf-418a-b825-b53fb1952b82 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:33.724120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49266f5-cadf-418a-b825-b53fb1952b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:33.724397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49266f5-cadf-418a-b825-b53fb1952b82 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:33.725487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49266f5-cadf-418a-b825-b53fb1952b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:33.727611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49266f5-cadf-418a-b825-b53fb1952b82 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:33.768612 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1336/2708] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:33 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:33.771687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebc50d-3abd-4339-9bba-e6ef4df6c83c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:33.789492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebc50d-3abd-4339-9bba-e6ef4df6c83c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:33.803766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec079-2870-4aa9-9655-22e3f624719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:33.804409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec079-2870-4aa9-9655-22e3f624719b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:33.806528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec079-2870-4aa9-9655-22e3f624719b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:33.806873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec079-2870-4aa9-9655-22e3f624719b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:33.807568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ec079-2870-4aa9-9655-22e3f624719b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:33.817756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ec079-2870-4aa9-9655-22e3f624719b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:33.839358 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1373/2709] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:33.843597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49266f5-cadf-418a-b825-b53fb1952b82 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:33.859423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49266f5-cadf-418a-b825-b53fb1952b82 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:33.871601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7814166-6dfa-4d42-8d0f-f941dc9f8703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:33.872458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7814166-6dfa-4d42-8d0f-f941dc9f8703 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:33.872898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7814166-6dfa-4d42-8d0f-f941dc9f8703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:33.873281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7814166-6dfa-4d42-8d0f-f941dc9f8703 admin admin] PATH_INFO: `/v3/projects/85d5065042e54fd2b1471cc3ab14cc31/users/235a301575374d899d3a8ca8eea031a1/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:33.903956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7814166-6dfa-4d42-8d0f-f941dc9f8703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d5065042e54fd2b1471cc3ab14cc31, user_id=235a301575374d899d3a8ca8eea031a1, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:33.912393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7814166-6dfa-4d42-8d0f-f941dc9f8703 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:33.935651 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1337/2710] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:33 2022] PUT /identity/v3/projects/85d5065042e54fd2b1471cc3ab14cc31/users/235a301575374d899d3a8ca8eea031a1/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:33.941817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec079-2870-4aa9-9655-22e3f624719b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:33.955973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec079-2870-4aa9-9655-22e3f624719b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:34.109428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56da8ec-570f-49f4-b1b8-75ecb7cf1412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:34.110764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56da8ec-570f-49f4-b1b8-75ecb7cf1412 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:34.111071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56da8ec-570f-49f4-b1b8-75ecb7cf1412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:34.111344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56da8ec-570f-49f4-b1b8-75ecb7cf1412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:34.117127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56da8ec-570f-49f4-b1b8-75ecb7cf1412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:34.118980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56da8ec-570f-49f4-b1b8-75ecb7cf1412 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:34.151584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7814166-6dfa-4d42-8d0f-f941dc9f8703 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:34.160507 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1374/2711] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:34.170619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7814166-6dfa-4d42-8d0f-f941dc9f8703 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:34.185217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773326f-55f3-43c2-bdee-714b0c9a8343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:34.186016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773326f-55f3-43c2-bdee-714b0c9a8343 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:34.186732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773326f-55f3-43c2-bdee-714b0c9a8343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:34.187215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773326f-55f3-43c2-bdee-714b0c9a8343 admin admin] PATH_INFO: `/v3/projects/85d5065042e54fd2b1471cc3ab14cc31/users/235a301575374d899d3a8ca8eea031a1/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:34.193358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773326f-55f3-43c2-bdee-714b0c9a8343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d5065042e54fd2b1471cc3ab14cc31, user_id=235a301575374d899d3a8ca8eea031a1, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:34.200449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773326f-55f3-43c2-bdee-714b0c9a8343 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:34.227588 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1338/2712] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:34 2022] PUT /identity/v3/projects/85d5065042e54fd2b1471cc3ab14cc31/users/235a301575374d899d3a8ca8eea031a1/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:34.239458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dbc7a-d074-4c2e-8023-b1ffc91e6a4f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:34.239740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dbc7a-d074-4c2e-8023-b1ffc91e6a4f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:34.240018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dbc7a-d074-4c2e-8023-b1ffc91e6a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:34.311127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-349dbc7a-d074-4c2e-8023-b1ffc91e6a4f None None] MFA Rules not processed for user `235a301575374d899d3a8ca8eea031a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:34.312175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-349dbc7a-d074-4c2e-8023-b1ffc91e6a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:34.466121 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1375/2713] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:34 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:34.592228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773326f-55f3-43c2-bdee-714b0c9a8343 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:34.595768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b773326f-55f3-43c2-bdee-714b0c9a8343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:34.612339 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:34.783326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773326f-55f3-43c2-bdee-714b0c9a8343 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:34.798146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc18581-e383-450a-a588-97cf1310b9db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:34.798728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc18581-e383-450a-a588-97cf1310b9db service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:34.800042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc18581-e383-450a-a588-97cf1310b9db service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:34.800261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc18581-e383-450a-a588-97cf1310b9db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:34.824901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc18581-e383-450a-a588-97cf1310b9db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:34.828028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc18581-e383-450a-a588-97cf1310b9db service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:34.865191 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1339/2714] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:34 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:38.596571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d96c-f63a-4f8c-a3c9-a7bf8a4f78bd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:38.597530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d96c-f63a-4f8c-a3c9-a7bf8a4f78bd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:38.598085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d96c-f63a-4f8c-a3c9-a7bf8a4f78bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:38.676308 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:38.691423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3d22d96c-f63a-4f8c-a3c9-a7bf8a4f78bd None None] MFA Rules not processed for user `e6f9ebc41aaf4f2895c5f2fb02e28166`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:38.702374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3d22d96c-f63a-4f8c-a3c9-a7bf8a4f78bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:38.866555 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1376/2715] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:39.200946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc18581-e383-450a-a588-97cf1310b9db service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:39.322541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22d96c-f63a-4f8c-a3c9-a7bf8a4f78bd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:39.324136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3d22d96c-f63a-4f8c-a3c9-a7bf8a4f78bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:39.357658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22d96c-f63a-4f8c-a3c9-a7bf8a4f78bd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:39.372329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c014955-321d-47f8-a5fc-e5c4dddf43fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:39.373129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c014955-321d-47f8-a5fc-e5c4dddf43fb service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:39.373512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c014955-321d-47f8-a5fc-e5c4dddf43fb service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:39.374750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c014955-321d-47f8-a5fc-e5c4dddf43fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:39.383236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc18581-e383-450a-a588-97cf1310b9db service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:39.386848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c014955-321d-47f8-a5fc-e5c4dddf43fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:39.388565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c014955-321d-47f8-a5fc-e5c4dddf43fb service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:39.390127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:39.391723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:39.393084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:39.393542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] PATH_INFO: `/v3/users/47e1b5a7ae4143bcaeef0f07f01aa0de` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:39.396215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e1b5a7ae4143bcaeef0f07f01aa0de)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:39.399714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:39.417540 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1377/2716] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:39 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:39.473471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e1b5a7ae4143bcaeef0f07f01aa0de'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:39.475123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e1b5a7ae4143bcaeef0f07f01aa0de'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:39.501030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e1b5a7ae4143bcaeef0f07f01aa0de'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:39.515168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e1b5a7ae4143bcaeef0f07f01aa0de'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:39.516512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e1b5a7ae4143bcaeef0f07f01aa0de'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:39.539120 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1340/2717] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:39 2022] DELETE /identity/v3/users/47e1b5a7ae4143bcaeef0f07f01aa0de => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:39.546333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb58a8c-d85c-479f-9bee-b027d9c82c53 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:39.548847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb58a8c-d85c-479f-9bee-b027d9c82c53 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:39.549562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb58a8c-d85c-479f-9bee-b027d9c82c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:39.581792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6bb58a8c-d85c-479f-9bee-b027d9c82c53 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:39.583339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6bb58a8c-d85c-479f-9bee-b027d9c82c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:39.666909 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1378/2718] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:06:39.677839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:39.680100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:39.695360 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:39.785645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436fd50-1835-4b18-b230-f5961e9c130e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:39.790947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304427d-9c07-4142-8fa4-c78b4796720e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:39.792374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304427d-9c07-4142-8fa4-c78b4796720e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:39.792991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304427d-9c07-4142-8fa4-c78b4796720e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:39.793784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304427d-9c07-4142-8fa4-c78b4796720e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:39.812672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304427d-9c07-4142-8fa4-c78b4796720e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:39.815284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304427d-9c07-4142-8fa4-c78b4796720e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:39.841923 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1341/2719] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:40.365553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb58a8c-d85c-479f-9bee-b027d9c82c53 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:40.367758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6bb58a8c-d85c-479f-9bee-b027d9c82c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:40.381289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb58a8c-d85c-479f-9bee-b027d9c82c53 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:40.387113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:40.387964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:40.388246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:40.388518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] PATH_INFO: `/v3/projects/f1d2a6df99954f1aa85ebc9e028dfdb9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:40.389655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d2a6df99954f1aa85ebc9e028dfdb9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:40.393653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:40.472604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d2a6df99954f1aa85ebc9e028dfdb9', 'request_id': 'req-b059d7f5-a0c3-4b01-bcca-bb67d567307b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:40.482954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d2a6df99954f1aa85ebc9e028dfdb9', 'request_id': 'req-b059d7f5-a0c3-4b01-bcca-bb67d567307b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:40.498687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d2a6df99954f1aa85ebc9e028dfdb9', 'request_id': 'req-b059d7f5-a0c3-4b01-bcca-bb67d567307b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:40.511599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] The token cache is being invalidate because project f1d2a6df99954f1aa85ebc9e028dfdb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:40.512126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:40.512908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:40.515357 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1379/2720] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:40 2022] DELETE /identity/v3/projects/f1d2a6df99954f1aa85ebc9e028dfdb9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:40.520211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304427d-9c07-4142-8fa4-c78b4796720e service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:40.531011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304427d-9c07-4142-8fa4-c78b4796720e service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:40.669773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5e7e6-7c91-4754-b90d-6729b864e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:40.670078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5e7e6-7c91-4754-b90d-6729b864e902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:40.670463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5e7e6-7c91-4754-b90d-6729b864e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:40.670956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5e7e6-7c91-4754-b90d-6729b864e902 admin admin] PATH_INFO: `/v3/users/235a301575374d899d3a8ca8eea031a1` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:40.672310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5e7e6-7c91-4754-b90d-6729b864e902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=235a301575374d899d3a8ca8eea031a1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:40.674660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5e7e6-7c91-4754-b90d-6729b864e902 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:41.043312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f0f5e7e6-7c91-4754-b90d-6729b864e902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235a301575374d899d3a8ca8eea031a1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:41.044339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f0f5e7e6-7c91-4754-b90d-6729b864e902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235a301575374d899d3a8ca8eea031a1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:41.083394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f0f5e7e6-7c91-4754-b90d-6729b864e902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235a301575374d899d3a8ca8eea031a1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:41.107353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f0f5e7e6-7c91-4754-b90d-6729b864e902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235a301575374d899d3a8ca8eea031a1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:41.108744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f0f5e7e6-7c91-4754-b90d-6729b864e902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235a301575374d899d3a8ca8eea031a1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:41.138260 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1342/2721] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:40 2022] DELETE /identity/v3/users/235a301575374d899d3a8ca8eea031a1 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:41.570683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:41.572260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:41.589853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059d7f5-a0c3-4b01-bcca-bb67d567307b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:41.601253 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:41.665495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0b3a-268b-416c-8602-139bed83792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:41.667270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0b3a-268b-416c-8602-139bed83792d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:41.667782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0b3a-268b-416c-8602-139bed83792d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:41.668338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0b3a-268b-416c-8602-139bed83792d admin admin] PATH_INFO: `/v3/projects/85d5065042e54fd2b1471cc3ab14cc31` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:41.670852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a0b3a-268b-416c-8602-139bed83792d admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d5065042e54fd2b1471cc3ab14cc31)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:41.674352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a0b3a-268b-416c-8602-139bed83792d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:41.790820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4b3a0b3a-268b-416c-8602-139bed83792d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d5065042e54fd2b1471cc3ab14cc31', 'request_id': 'req-4b3a0b3a-268b-416c-8602-139bed83792d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:41.801708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4b3a0b3a-268b-416c-8602-139bed83792d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d5065042e54fd2b1471cc3ab14cc31', 'request_id': 'req-4b3a0b3a-268b-416c-8602-139bed83792d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:41.813753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4b3a0b3a-268b-416c-8602-139bed83792d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d5065042e54fd2b1471cc3ab14cc31', 'request_id': 'req-4b3a0b3a-268b-416c-8602-139bed83792d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:41.833428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4b3a0b3a-268b-416c-8602-139bed83792d admin admin] The token cache is being invalidate because project 85d5065042e54fd2b1471cc3ab14cc31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:41.833756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4b3a0b3a-268b-416c-8602-139bed83792d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:41.834615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4b3a0b3a-268b-416c-8602-139bed83792d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:41.836742 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1380/2722] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:41 2022] DELETE /identity/v3/projects/85d5065042e54fd2b1471cc3ab14cc31 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:41.841443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34253454-8dd7-4a0d-8f20-63bdcbf3f881 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:41.841969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34253454-8dd7-4a0d-8f20-63bdcbf3f881 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:41.841969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34253454-8dd7-4a0d-8f20-63bdcbf3f881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:41.866881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-34253454-8dd7-4a0d-8f20-63bdcbf3f881 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:41.868796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-34253454-8dd7-4a0d-8f20-63bdcbf3f881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:41.915885 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:41.981630 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1343/2723] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:41.989417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe226b2-b36f-463a-95a9-c3187bad359f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:41.989739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe226b2-b36f-463a-95a9-c3187bad359f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:41.990082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe226b2-b36f-463a-95a9-c3187bad359f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:42.032983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ffe226b2-b36f-463a-95a9-c3187bad359f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:42.037739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ffe226b2-b36f-463a-95a9-c3187bad359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:42.059238 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1381/2724] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:42.065249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34253454-8dd7-4a0d-8f20-63bdcbf3f881 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:42.084150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34253454-8dd7-4a0d-8f20-63bdcbf3f881 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:42.091560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b3b92-3a8c-49db-8f0e-afdb2de5df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:42.092191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b3b92-3a8c-49db-8f0e-afdb2de5df17 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:42.092471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b3b92-3a8c-49db-8f0e-afdb2de5df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:42.092739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b3b92-3a8c-49db-8f0e-afdb2de5df17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:42.093422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b3b92-3a8c-49db-8f0e-afdb2de5df17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:06:42.093688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b3b92-3a8c-49db-8f0e-afdb2de5df17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:42.096630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b3b92-3a8c-49db-8f0e-afdb2de5df17 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:42.126035 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1344/2725] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:06:42.131301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe226b2-b36f-463a-95a9-c3187bad359f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:42.162406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe226b2-b36f-463a-95a9-c3187bad359f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:42.197392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d64a7-c41b-405a-8354-39e860e11bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:42.203110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d64a7-c41b-405a-8354-39e860e11bcb admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:42.203990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d64a7-c41b-405a-8354-39e860e11bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:42.204458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d64a7-c41b-405a-8354-39e860e11bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:42.212183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d64a7-c41b-405a-8354-39e860e11bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:42.214197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d64a7-c41b-405a-8354-39e860e11bcb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:42.280167 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1382/2726] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:42 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:42.286693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b3b92-3a8c-49db-8f0e-afdb2de5df17 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:42.301906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b3b92-3a8c-49db-8f0e-afdb2de5df17 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:42.431613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f80bc-dd9d-4924-8b7f-6c1ea6f86976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:42.432457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f80bc-dd9d-4924-8b7f-6c1ea6f86976 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:42.432895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f80bc-dd9d-4924-8b7f-6c1ea6f86976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:42.435672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f80bc-dd9d-4924-8b7f-6c1ea6f86976 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:42.436947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f80bc-dd9d-4924-8b7f-6c1ea6f86976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:42.440711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f80bc-dd9d-4924-8b7f-6c1ea6f86976 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:42.514085 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1345/2727] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:42 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:42.514993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d64a7-c41b-405a-8354-39e860e11bcb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:42.530502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d64a7-c41b-405a-8354-39e860e11bcb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:42.535924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439a71f-5cd0-44db-868b-e57165878545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:42.536528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a71f-5cd0-44db-868b-e57165878545 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:42.536804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a71f-5cd0-44db-868b-e57165878545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:42.537074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a71f-5cd0-44db-868b-e57165878545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:42.537712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439a71f-5cd0-44db-868b-e57165878545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:42.539863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439a71f-5cd0-44db-868b-e57165878545 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:42.555336 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1383/2728] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:06:42.556809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f80bc-dd9d-4924-8b7f-6c1ea6f86976 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:42.575137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f80bc-dd9d-4924-8b7f-6c1ea6f86976 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:42.587274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b11b0-8644-4178-9a7f-27b229157dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:42.589725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b11b0-8644-4178-9a7f-27b229157dfc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:42.591091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b11b0-8644-4178-9a7f-27b229157dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:42.591618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b11b0-8644-4178-9a7f-27b229157dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:42.592659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b11b0-8644-4178-9a7f-27b229157dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:42.595459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b11b0-8644-4178-9a7f-27b229157dfc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:42.620671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439a71f-5cd0-44db-868b-e57165878545 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:42.621167 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1346/2729] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:42.637337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439a71f-5cd0-44db-868b-e57165878545 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:42.651875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25721609-7ead-4dd8-b3ae-85e69deaadbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:42.652610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25721609-7ead-4dd8-b3ae-85e69deaadbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:42.652891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25721609-7ead-4dd8-b3ae-85e69deaadbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:42.653167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25721609-7ead-4dd8-b3ae-85e69deaadbb admin admin] PATH_INFO: `/v3/projects/4b9c3aba240f4a509f642e257ea05d88/users/7b858e11563d4c9596744cb59e3fb0eb/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:42.684564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25721609-7ead-4dd8-b3ae-85e69deaadbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9c3aba240f4a509f642e257ea05d88, user_id=7b858e11563d4c9596744cb59e3fb0eb, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:42.698072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25721609-7ead-4dd8-b3ae-85e69deaadbb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:42.723179 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1384/2730] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:42 2022] PUT /identity/v3/projects/4b9c3aba240f4a509f642e257ea05d88/users/7b858e11563d4c9596744cb59e3fb0eb/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:42.733822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a1d83-fcbb-4060-b446-ee94d03a7db9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:42.735643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a1d83-fcbb-4060-b446-ee94d03a7db9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:42.736240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a1d83-fcbb-4060-b446-ee94d03a7db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:42.776496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-560a1d83-fcbb-4060-b446-ee94d03a7db9 None None] MFA Rules not processed for user `7b858e11563d4c9596744cb59e3fb0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:42.778052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-560a1d83-fcbb-4060-b446-ee94d03a7db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:42.908426 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1347/2731] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:42.912934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25721609-7ead-4dd8-b3ae-85e69deaadbb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:42.977620 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:43.019724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25721609-7ead-4dd8-b3ae-85e69deaadbb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:43.028047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0bd67-265f-4c97-ba08-4b9462b4c761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:43.028909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0bd67-265f-4c97-ba08-4b9462b4c761 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:43.030131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0bd67-265f-4c97-ba08-4b9462b4c761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:43.030474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0bd67-265f-4c97-ba08-4b9462b4c761 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:43.032093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0bd67-265f-4c97-ba08-4b9462b4c761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:43.034236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0bd67-265f-4c97-ba08-4b9462b4c761 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:43.063307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ce261-c552-44ee-b80a-0d9037b0666e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:43.063530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ce261-c552-44ee-b80a-0d9037b0666e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:43.063780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ce261-c552-44ee-b80a-0d9037b0666e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:43.092198 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1385/2732] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:42 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:43.098806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0bd67-265f-4c97-ba08-4b9462b4c761 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:43.128416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f32ce261-c552-44ee-b80a-0d9037b0666e None None] MFA Rules not processed for user `d739d3fe2e744013b322ecb3b887be07`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:43.133892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f32ce261-c552-44ee-b80a-0d9037b0666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:43.167913 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:43.259990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0bd67-265f-4c97-ba08-4b9462b4c761 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:43.272203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3c3a-ed2c-4f4e-aff0-ff2ef94bcbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:43.272828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3c3a-ed2c-4f4e-aff0-ff2ef94bcbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:43.273105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3c3a-ed2c-4f4e-aff0-ff2ef94bcbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:43.275559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3c3a-ed2c-4f4e-aff0-ff2ef94bcbb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:43.277873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe3c3a-ed2c-4f4e-aff0-ff2ef94bcbb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:43.280938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe3c3a-ed2c-4f4e-aff0-ff2ef94bcbb7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:43.324177 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1348/2733] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:43 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:43.336430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ce261-c552-44ee-b80a-0d9037b0666e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:43.337985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f32ce261-c552-44ee-b80a-0d9037b0666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:43.346484 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1386/2734] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:43 2022] POST /identity/v3/users => generated 300 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:43.350049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3c3a-ed2c-4f4e-aff0-ff2ef94bcbb7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:43.384453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3c3a-ed2c-4f4e-aff0-ff2ef94bcbb7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:43.399860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185282e1-5152-47ee-88a2-2c3e627cb845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:43.401310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185282e1-5152-47ee-88a2-2c3e627cb845 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:43.403386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185282e1-5152-47ee-88a2-2c3e627cb845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:43.405387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185282e1-5152-47ee-88a2-2c3e627cb845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:43.408737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185282e1-5152-47ee-88a2-2c3e627cb845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:43.413129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185282e1-5152-47ee-88a2-2c3e627cb845 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:43.446534 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1387/2735] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:43.453145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185282e1-5152-47ee-88a2-2c3e627cb845 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:43.487271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185282e1-5152-47ee-88a2-2c3e627cb845 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:43.502860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e189d3a-5fcd-45c1-99ba-9a9c1ae998d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:43.505822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e189d3a-5fcd-45c1-99ba-9a9c1ae998d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:43.507087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e189d3a-5fcd-45c1-99ba-9a9c1ae998d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:43.508125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e189d3a-5fcd-45c1-99ba-9a9c1ae998d9 admin admin] PATH_INFO: `/v3/projects/92bc63e1133341848385a97c0ded5a43/users/2167308b7e16435e8665c15b37f239e6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:43.520609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ce261-c552-44ee-b80a-0d9037b0666e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:43.551576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7bc07-e1ff-4dfe-8dee-06f1dc61319d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:43.552582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7bc07-e1ff-4dfe-8dee-06f1dc61319d service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:43.553069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7bc07-e1ff-4dfe-8dee-06f1dc61319d service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:43.553567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7bc07-e1ff-4dfe-8dee-06f1dc61319d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:43.576249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7bc07-e1ff-4dfe-8dee-06f1dc61319d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:43.578888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7bc07-e1ff-4dfe-8dee-06f1dc61319d service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:43.582663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e189d3a-5fcd-45c1-99ba-9a9c1ae998d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92bc63e1133341848385a97c0ded5a43, user_id=2167308b7e16435e8665c15b37f239e6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:43.593664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e189d3a-5fcd-45c1-99ba-9a9c1ae998d9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:43.598618 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1349/2736] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:43 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:43.624205 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1388/2737] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:43 2022] PUT /identity/v3/projects/92bc63e1133341848385a97c0ded5a43/users/2167308b7e16435e8665c15b37f239e6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:43.628035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7bc07-e1ff-4dfe-8dee-06f1dc61319d service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:43.646429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7bc07-e1ff-4dfe-8dee-06f1dc61319d service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:43.793262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a94208-fd4f-4dea-84c6-345cd0983355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:43.794346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a94208-fd4f-4dea-84c6-345cd0983355 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:43.795174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a94208-fd4f-4dea-84c6-345cd0983355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:43.795851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a94208-fd4f-4dea-84c6-345cd0983355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:43.796775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a94208-fd4f-4dea-84c6-345cd0983355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:43.799369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a94208-fd4f-4dea-84c6-345cd0983355 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:43.846307 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1350/2738] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:43.851042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e189d3a-5fcd-45c1-99ba-9a9c1ae998d9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:43.865420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e189d3a-5fcd-45c1-99ba-9a9c1ae998d9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:43.881092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb71e8a-499f-4e90-a20d-105ae2d804eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:43.882545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb71e8a-499f-4e90-a20d-105ae2d804eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:43.882890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb71e8a-499f-4e90-a20d-105ae2d804eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:43.883440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb71e8a-499f-4e90-a20d-105ae2d804eb admin admin] PATH_INFO: `/v3/projects/92bc63e1133341848385a97c0ded5a43/users/2167308b7e16435e8665c15b37f239e6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:43.887845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb71e8a-499f-4e90-a20d-105ae2d804eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=92bc63e1133341848385a97c0ded5a43, user_id=2167308b7e16435e8665c15b37f239e6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:43.890965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb71e8a-499f-4e90-a20d-105ae2d804eb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:43.930802 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1389/2739] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:43 2022] PUT /identity/v3/projects/92bc63e1133341848385a97c0ded5a43/users/2167308b7e16435e8665c15b37f239e6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:43.932075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c945b8-1993-4ccc-9ee2-dbc6a90b8468 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:43.932883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c945b8-1993-4ccc-9ee2-dbc6a90b8468 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:43.933594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c945b8-1993-4ccc-9ee2-dbc6a90b8468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:44.004385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-46c945b8-1993-4ccc-9ee2-dbc6a90b8468 None None] MFA Rules not processed for user `2167308b7e16435e8665c15b37f239e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:44.007886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-46c945b8-1993-4ccc-9ee2-dbc6a90b8468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:44.082588 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:44.181431 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1351/2740] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:44.364707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb71e8a-499f-4e90-a20d-105ae2d804eb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:44.366614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7fb71e8a-499f-4e90-a20d-105ae2d804eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:44.536527 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:44.554624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb71e8a-499f-4e90-a20d-105ae2d804eb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:44.577660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71ee05-122d-4a61-b8ea-e4ab2e12048e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:44.579262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71ee05-122d-4a61-b8ea-e4ab2e12048e service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:44.579684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71ee05-122d-4a61-b8ea-e4ab2e12048e service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:44.579963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71ee05-122d-4a61-b8ea-e4ab2e12048e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:44.591931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71ee05-122d-4a61-b8ea-e4ab2e12048e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:44.593696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71ee05-122d-4a61-b8ea-e4ab2e12048e service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:44.606870 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1390/2741] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:46.817482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c945b8-1993-4ccc-9ee2-dbc6a90b8468 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:47.041930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c945b8-1993-4ccc-9ee2-dbc6a90b8468 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:47.048056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:47.048924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:47.049066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:47.050137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] PATH_INFO: `/v3/users/7b858e11563d4c9596744cb59e3fb0eb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:47.051689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b858e11563d4c9596744cb59e3fb0eb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:47.053631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:47.195666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b858e11563d4c9596744cb59e3fb0eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:47.199087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b858e11563d4c9596744cb59e3fb0eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:47.248632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b858e11563d4c9596744cb59e3fb0eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:47.275010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b858e11563d4c9596744cb59e3fb0eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:47.275010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b858e11563d4c9596744cb59e3fb0eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:47.326569 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1352/2742] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:46 2022] DELETE /identity/v3/users/7b858e11563d4c9596744cb59e3fb0eb => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:47.332548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5248f-0e7e-4912-9159-6af49f2770b8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:47.333070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5248f-0e7e-4912-9159-6af49f2770b8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:47.333909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5248f-0e7e-4912-9159-6af49f2770b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:47.413562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cff5248f-0e7e-4912-9159-6af49f2770b8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:47.416532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cff5248f-0e7e-4912-9159-6af49f2770b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:47.600718 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1391/2743] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:47.634330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:47.635965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:47.754122 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:47.786789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d446a6-3df7-4296-8d6e-ceb49f8ac495 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:47.793243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d544306-74df-4149-b56a-09d16d9d79c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:47.794425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d544306-74df-4149-b56a-09d16d9d79c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:47.794949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d544306-74df-4149-b56a-09d16d9d79c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:47.795734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d544306-74df-4149-b56a-09d16d9d79c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:47.814179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d544306-74df-4149-b56a-09d16d9d79c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:47.817877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d544306-74df-4149-b56a-09d16d9d79c7 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:47.841594 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1353/2744] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:49.445313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5248f-0e7e-4912-9159-6af49f2770b8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:49.448069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cff5248f-0e7e-4912-9159-6af49f2770b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:49.477342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5248f-0e7e-4912-9159-6af49f2770b8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:49.492298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:49.495041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:49.495600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:49.496070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] PATH_INFO: `/v3/projects/4b9c3aba240f4a509f642e257ea05d88` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:49.499519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9c3aba240f4a509f642e257ea05d88)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:49.508815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:49.627514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9c3aba240f4a509f642e257ea05d88', 'request_id': 'req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:49.638802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9c3aba240f4a509f642e257ea05d88', 'request_id': 'req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:49.653604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9c3aba240f4a509f642e257ea05d88', 'request_id': 'req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:49.673470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] The token cache is being invalidate because project 4b9c3aba240f4a509f642e257ea05d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:49.674111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:49.676299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:49.679471 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1392/2745] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:49 2022] DELETE /identity/v3/projects/4b9c3aba240f4a509f642e257ea05d88 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:49.683593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d544306-74df-4149-b56a-09d16d9d79c7 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:49.699129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d544306-74df-4149-b56a-09d16d9d79c7 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:49.792883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5c9cd-66df-4407-bdc6-7ece49548115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:49.794027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c9cd-66df-4407-bdc6-7ece49548115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:49.794659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c9cd-66df-4407-bdc6-7ece49548115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:49.795136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c9cd-66df-4407-bdc6-7ece49548115 admin admin] PATH_INFO: `/v3/users/2167308b7e16435e8665c15b37f239e6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:49.796685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c9cd-66df-4407-bdc6-7ece49548115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2167308b7e16435e8665c15b37f239e6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:49.800627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c9cd-66df-4407-bdc6-7ece49548115 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:49.911023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-19e5c9cd-66df-4407-bdc6-7ece49548115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2167308b7e16435e8665c15b37f239e6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:49.911756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-19e5c9cd-66df-4407-bdc6-7ece49548115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2167308b7e16435e8665c15b37f239e6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:49.928503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-19e5c9cd-66df-4407-bdc6-7ece49548115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2167308b7e16435e8665c15b37f239e6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:49.950744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-19e5c9cd-66df-4407-bdc6-7ece49548115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2167308b7e16435e8665c15b37f239e6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:49.954239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-19e5c9cd-66df-4407-bdc6-7ece49548115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2167308b7e16435e8665c15b37f239e6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:50.004498 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1354/2746] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:49 2022] DELETE /identity/v3/users/2167308b7e16435e8665c15b37f239e6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:50.256962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:50.258726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:50.285214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dd986-a71d-40f9-a27f-4d7ceea1fbf4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:50.429795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:50.430623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:50.430850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:50.431139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] PATH_INFO: `/v3/users/5d9ecc8887874f989006a848b818ac84` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:50.435412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d9ecc8887874f989006a848b818ac84)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:50.437693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:50.464013 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:50.551651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d9ecc8887874f989006a848b818ac84'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:50.554779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d9ecc8887874f989006a848b818ac84'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:50.577156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d9ecc8887874f989006a848b818ac84'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:50.609573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d9ecc8887874f989006a848b818ac84'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:50.610387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d9ecc8887874f989006a848b818ac84'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:50.645591 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1393/2747] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:50 2022] DELETE /identity/v3/users/5d9ecc8887874f989006a848b818ac84 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:51.165865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545901fd-a40b-4f9a-a76d-60bb187ab9ce None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:51.166332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545901fd-a40b-4f9a-a76d-60bb187ab9ce None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:51.166656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545901fd-a40b-4f9a-a76d-60bb187ab9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:51.240633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-545901fd-a40b-4f9a-a76d-60bb187ab9ce None None] MFA Rules not processed for user `a745e8bb56574606b709907e661b9cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:51.242435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-545901fd-a40b-4f9a-a76d-60bb187ab9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:51.368572 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:51.394638 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1355/2748] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:51.399731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:51.401714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:51.613912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76a1b1-5b39-45ee-a50d-c71ba443a99b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:51.625644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086899b-5edd-4efa-98db-c5cb5484c7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:51.626425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086899b-5edd-4efa-98db-c5cb5484c7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:51.626578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086899b-5edd-4efa-98db-c5cb5484c7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:51.626987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086899b-5edd-4efa-98db-c5cb5484c7a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:51.627739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086899b-5edd-4efa-98db-c5cb5484c7a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:51.630020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086899b-5edd-4efa-98db-c5cb5484c7a8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:51.677999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545901fd-a40b-4f9a-a76d-60bb187ab9ce None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:51.680619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-545901fd-a40b-4f9a-a76d-60bb187ab9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:51.706825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545901fd-a40b-4f9a-a76d-60bb187ab9ce None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:51.722739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:51.723707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:51.724062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:51.724459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] PATH_INFO: `/v3/projects/ba43dd17d7974221a59efaa1452b3b2f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:51.725747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba43dd17d7974221a59efaa1452b3b2f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:51.728078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:51.759071 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1394/2749] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:51 2022] POST /identity/v3/projects => generated 383 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:51.761254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086899b-5edd-4efa-98db-c5cb5484c7a8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:51.769985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f086899b-5edd-4efa-98db-c5cb5484c7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:51.837539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba43dd17d7974221a59efaa1452b3b2f', 'request_id': 'req-65bcb311-fbdf-4048-84ec-4b59600a3868'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:51.847552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba43dd17d7974221a59efaa1452b3b2f', 'request_id': 'req-65bcb311-fbdf-4048-84ec-4b59600a3868'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:51.864212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba43dd17d7974221a59efaa1452b3b2f', 'request_id': 'req-65bcb311-fbdf-4048-84ec-4b59600a3868'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:51.881899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] The token cache is being invalidate because project ba43dd17d7974221a59efaa1452b3b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:51.882476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:51.884066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:51.889584 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1356/2750] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:51 2022] DELETE /identity/v3/projects/ba43dd17d7974221a59efaa1452b3b2f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:06:51.890689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:51.895660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:52.027372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcb311-fbdf-4048-84ec-4b59600a3868 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:52.040128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086899b-5edd-4efa-98db-c5cb5484c7a8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:52.043248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1f2de-e25d-4cdf-9107-3291b82cd749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:52.043911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1f2de-e25d-4cdf-9107-3291b82cd749 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:52.044246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1f2de-e25d-4cdf-9107-3291b82cd749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:52.044565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1f2de-e25d-4cdf-9107-3291b82cd749 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:52.045337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1f2de-e25d-4cdf-9107-3291b82cd749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:52.049122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1f2de-e25d-4cdf-9107-3291b82cd749 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:52.054348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253dfd-98b3-404c-bd00-d86037dbe1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:52.056191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253dfd-98b3-404c-bd00-d86037dbe1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:52.056555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253dfd-98b3-404c-bd00-d86037dbe1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:52.058799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253dfd-98b3-404c-bd00-d86037dbe1f5 admin admin] PATH_INFO: `/v3/projects/92bc63e1133341848385a97c0ded5a43` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:52.061432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6253dfd-98b3-404c-bd00-d86037dbe1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92bc63e1133341848385a97c0ded5a43)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:52.069256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6253dfd-98b3-404c-bd00-d86037dbe1f5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:52.096473 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1357/2751] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:51 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:52.098863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a34b5c-72c9-4186-9f13-a91657121735 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:52.100151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a34b5c-72c9-4186-9f13-a91657121735 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:52.100446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a34b5c-72c9-4186-9f13-a91657121735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:52.141892 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:52.144599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-78a34b5c-72c9-4186-9f13-a91657121735 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:52.148663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-78a34b5c-72c9-4186-9f13-a91657121735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:52.174561 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1358/2752] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:52.178219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a34b5c-72c9-4186-9f13-a91657121735 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:52.200373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a34b5c-72c9-4186-9f13-a91657121735 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:52.227393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6253dfd-98b3-404c-bd00-d86037dbe1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92bc63e1133341848385a97c0ded5a43', 'request_id': 'req-b6253dfd-98b3-404c-bd00-d86037dbe1f5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:52.245255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6253dfd-98b3-404c-bd00-d86037dbe1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92bc63e1133341848385a97c0ded5a43', 'request_id': 'req-b6253dfd-98b3-404c-bd00-d86037dbe1f5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:52.257505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6253dfd-98b3-404c-bd00-d86037dbe1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92bc63e1133341848385a97c0ded5a43', 'request_id': 'req-b6253dfd-98b3-404c-bd00-d86037dbe1f5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:52.272521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6253dfd-98b3-404c-bd00-d86037dbe1f5 admin admin] The token cache is being invalidate because project 92bc63e1133341848385a97c0ded5a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:52.273233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6253dfd-98b3-404c-bd00-d86037dbe1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:52.274552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6253dfd-98b3-404c-bd00-d86037dbe1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:52.280715 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1395/2753] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:51 2022] DELETE /identity/v3/projects/92bc63e1133341848385a97c0ded5a43 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:52.283552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903978-1558-4069-af74-be7e8aaa2ad2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:52.283837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903978-1558-4069-af74-be7e8aaa2ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:52.284300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903978-1558-4069-af74-be7e8aaa2ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:52.334802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e6903978-1558-4069-af74-be7e8aaa2ad2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:52.339868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e6903978-1558-4069-af74-be7e8aaa2ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:52.346795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6b0cf-c929-46ac-96d1-0b9ffd9bd040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:52.348174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6b0cf-c929-46ac-96d1-0b9ffd9bd040 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:52.349425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6b0cf-c929-46ac-96d1-0b9ffd9bd040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:52.349704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6b0cf-c929-46ac-96d1-0b9ffd9bd040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:52.351101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6b0cf-c929-46ac-96d1-0b9ffd9bd040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:52.354596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6b0cf-c929-46ac-96d1-0b9ffd9bd040 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:52.364877 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1396/2754] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:52.366568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902235-c58d-4d46-968f-c05f548a19f2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:52.367123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902235-c58d-4d46-968f-c05f548a19f2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:52.367409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902235-c58d-4d46-968f-c05f548a19f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:52.367831 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:52.394197 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1359/2755] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:52.396580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6b0cf-c929-46ac-96d1-0b9ffd9bd040 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:52.424603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6b0cf-c929-46ac-96d1-0b9ffd9bd040 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:52.426692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-50902235-c58d-4d46-968f-c05f548a19f2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:52.428467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-50902235-c58d-4d46-968f-c05f548a19f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:52.444670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9267ae1-d9cf-4b14-9387-d74fbdea333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:52.445419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9267ae1-d9cf-4b14-9387-d74fbdea333d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:52.445704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9267ae1-d9cf-4b14-9387-d74fbdea333d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:52.446799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9267ae1-d9cf-4b14-9387-d74fbdea333d admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:52.448029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9267ae1-d9cf-4b14-9387-d74fbdea333d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:06:52.449023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9267ae1-d9cf-4b14-9387-d74fbdea333d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:52.455498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9267ae1-d9cf-4b14-9387-d74fbdea333d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:52.467335 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1397/2756] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:52.468330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902235-c58d-4d46-968f-c05f548a19f2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:52.473722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-50902235-c58d-4d46-968f-c05f548a19f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:52.508054 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1360/2757] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:06:52.515207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e4a05-5377-4588-9f19-c0865bc0d641 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:52.515474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e4a05-5377-4588-9f19-c0865bc0d641 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:52.515748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e4a05-5377-4588-9f19-c0865bc0d641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:52.519202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902235-c58d-4d46-968f-c05f548a19f2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:52.533088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b37b16-a74f-42c9-be50-2adcd6faa34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:52.534653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b37b16-a74f-42c9-be50-2adcd6faa34d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:52.537418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b37b16-a74f-42c9-be50-2adcd6faa34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:52.538290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b37b16-a74f-42c9-be50-2adcd6faa34d admin admin] PATH_INFO: `/v3/projects/236b760a7a88423cb3f03f28b7712461/users/59f3db3aa571450c903a9733155561a8/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:52.574018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ba2e4a05-5377-4588-9f19-c0865bc0d641 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:52.577004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba2e4a05-5377-4588-9f19-c0865bc0d641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:52.580723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b37b16-a74f-42c9-be50-2adcd6faa34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=236b760a7a88423cb3f03f28b7712461, user_id=59f3db3aa571450c903a9733155561a8, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:52.586386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b37b16-a74f-42c9-be50-2adcd6faa34d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:52.605911 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1361/2758] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:52.607569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e4a05-5377-4588-9f19-c0865bc0d641 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:52.623958 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1398/2759] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:52 2022] PUT /identity/v3/projects/236b760a7a88423cb3f03f28b7712461/users/59f3db3aa571450c903a9733155561a8/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:52.626750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b37b16-a74f-42c9-be50-2adcd6faa34d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:52.643568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e4a05-5377-4588-9f19-c0865bc0d641 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:52.811662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b37b16-a74f-42c9-be50-2adcd6faa34d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:52.821615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e109e-3db1-46ac-9f03-b35295ac9421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:52.825293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf011f9c-1b2f-4892-a65a-5c0b5a32a7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:52.826072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf011f9c-1b2f-4892-a65a-5c0b5a32a7cc admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:52.826355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf011f9c-1b2f-4892-a65a-5c0b5a32a7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:52.827231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf011f9c-1b2f-4892-a65a-5c0b5a32a7cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:52.829732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf011f9c-1b2f-4892-a65a-5c0b5a32a7cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:06:52.831095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e109e-3db1-46ac-9f03-b35295ac9421 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:52.831361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e109e-3db1-46ac-9f03-b35295ac9421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:52.831479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf011f9c-1b2f-4892-a65a-5c0b5a32a7cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:52.831636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e109e-3db1-46ac-9f03-b35295ac9421 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:52.834451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e109e-3db1-46ac-9f03-b35295ac9421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:52.836310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf011f9c-1b2f-4892-a65a-5c0b5a32a7cc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:52.841656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e109e-3db1-46ac-9f03-b35295ac9421 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:52.874210 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1399/2760] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:06:52.876663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf011f9c-1b2f-4892-a65a-5c0b5a32a7cc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:52.905703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf011f9c-1b2f-4892-a65a-5c0b5a32a7cc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:52.921928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ab026-124d-4d76-8e5b-ac4c5677f9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:52.922638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ab026-124d-4d76-8e5b-ac4c5677f9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:52.922937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ab026-124d-4d76-8e5b-ac4c5677f9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:52.923309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ab026-124d-4d76-8e5b-ac4c5677f9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:52.925163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ab026-124d-4d76-8e5b-ac4c5677f9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:52.928818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ab026-124d-4d76-8e5b-ac4c5677f9fc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:52.968723 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1400/2761] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:52.969449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ab026-124d-4d76-8e5b-ac4c5677f9fc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:52.989939 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1362/2762] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:52 2022] POST /identity/v3/projects => generated 377 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:52.991244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e109e-3db1-46ac-9f03-b35295ac9421 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:53.001812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ab026-124d-4d76-8e5b-ac4c5677f9fc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:53.131112 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:53.151303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e109e-3db1-46ac-9f03-b35295ac9421 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:53.152346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec568a-0be1-492c-89f9-bc2cf66f8f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:53.154680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec568a-0be1-492c-89f9-bc2cf66f8f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:53.155082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec568a-0be1-492c-89f9-bc2cf66f8f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:53.155469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec568a-0be1-492c-89f9-bc2cf66f8f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:53.160072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec568a-0be1-492c-89f9-bc2cf66f8f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:53.163264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec568a-0be1-492c-89f9-bc2cf66f8f09 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:53.179348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8a235-8e29-4d6f-a846-4035ff7cd2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:53.180367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8a235-8e29-4d6f-a846-4035ff7cd2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:53.180367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8a235-8e29-4d6f-a846-4035ff7cd2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:53.180678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8a235-8e29-4d6f-a846-4035ff7cd2b2 admin admin] PATH_INFO: `/v3/projects/236b760a7a88423cb3f03f28b7712461/users/59f3db3aa571450c903a9733155561a8/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:53.198241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8a235-8e29-4d6f-a846-4035ff7cd2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236b760a7a88423cb3f03f28b7712461, user_id=59f3db3aa571450c903a9733155561a8, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:53.207055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8a235-8e29-4d6f-a846-4035ff7cd2b2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:53.231842 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1401/2763] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:52 2022] POST /identity/v3/projects => generated 389 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:53.232967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec568a-0be1-492c-89f9-bc2cf66f8f09 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:53.279180 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1363/2764] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:52 2022] PUT /identity/v3/projects/236b760a7a88423cb3f03f28b7712461/users/59f3db3aa571450c903a9733155561a8/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:53.284227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8a235-8e29-4d6f-a846-4035ff7cd2b2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:53.404723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec568a-0be1-492c-89f9-bc2cf66f8f09 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:53.557905 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:53.567144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8a235-8e29-4d6f-a846-4035ff7cd2b2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:53.577222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c9137-8438-4a23-ad88-5d8d4fb5751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:53.579299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c9137-8438-4a23-ad88-5d8d4fb5751b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:53.579742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c9137-8438-4a23-ad88-5d8d4fb5751b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:53.580257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c9137-8438-4a23-ad88-5d8d4fb5751b admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:53.581073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c9137-8438-4a23-ad88-5d8d4fb5751b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:53.584736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf69b13-de36-4c64-97b0-b9f03777f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:53.586311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf69b13-de36-4c64-97b0-b9f03777f6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:53.586465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf69b13-de36-4c64-97b0-b9f03777f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:53.586691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf69b13-de36-4c64-97b0-b9f03777f6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:53.587084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c9137-8438-4a23-ad88-5d8d4fb5751b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:53.588542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf69b13-de36-4c64-97b0-b9f03777f6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:53.592939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf69b13-de36-4c64-97b0-b9f03777f6f0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:53.657278 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1402/2765] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:53 2022] POST /identity/v3/users => generated 289 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:53.662910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf69b13-de36-4c64-97b0-b9f03777f6f0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:53.674799 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1364/2766] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:53 2022] POST /identity/v3/users => generated 295 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:53.682796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c9137-8438-4a23-ad88-5d8d4fb5751b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:53.696035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf69b13-de36-4c64-97b0-b9f03777f6f0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:53.710818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8a524-e8f1-4482-be07-3c6c8a456fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:53.713612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8a524-e8f1-4482-be07-3c6c8a456fac admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:53.713921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8a524-e8f1-4482-be07-3c6c8a456fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:53.714205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8a524-e8f1-4482-be07-3c6c8a456fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:53.718017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8a524-e8f1-4482-be07-3c6c8a456fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:53.721952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c9137-8438-4a23-ad88-5d8d4fb5751b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:53.722403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8a524-e8f1-4482-be07-3c6c8a456fac admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:53.738786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cd89f-3f27-4f2a-8b28-d8c92bab30b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:53.739459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cd89f-3f27-4f2a-8b28-d8c92bab30b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:53.740164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cd89f-3f27-4f2a-8b28-d8c92bab30b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:53.740164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cd89f-3f27-4f2a-8b28-d8c92bab30b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:53.740634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249cd89f-3f27-4f2a-8b28-d8c92bab30b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:53.742244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249cd89f-3f27-4f2a-8b28-d8c92bab30b6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:53.751212 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1403/2767] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:53.756864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f85b4c-d846-4541-bffa-551acc438da9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:53.757164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f85b4c-d846-4541-bffa-551acc438da9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:53.757538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f85b4c-d846-4541-bffa-551acc438da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:53.789409 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1365/2768] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:53.791984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cd89f-3f27-4f2a-8b28-d8c92bab30b6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:53.815397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-93f85b4c-d846-4541-bffa-551acc438da9 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:53.819079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-93f85b4c-d846-4541-bffa-551acc438da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:53.829587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cd89f-3f27-4f2a-8b28-d8c92bab30b6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:53.853533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c4590-b0de-4e76-b35f-c3773d4e0fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:53.854219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c4590-b0de-4e76-b35f-c3773d4e0fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:53.854861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c4590-b0de-4e76-b35f-c3773d4e0fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:53.856221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c4590-b0de-4e76-b35f-c3773d4e0fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:53.857437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c4590-b0de-4e76-b35f-c3773d4e0fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:53.868165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c4590-b0de-4e76-b35f-c3773d4e0fc4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:53.899081 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1366/2769] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:53.900089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c4590-b0de-4e76-b35f-c3773d4e0fc4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:53.915846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c4590-b0de-4e76-b35f-c3773d4e0fc4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:53.932978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f56991-3700-4121-b739-0fd42efc76ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:53.933698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f56991-3700-4121-b739-0fd42efc76ab admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:53.934001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f56991-3700-4121-b739-0fd42efc76ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:53.934271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f56991-3700-4121-b739-0fd42efc76ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:53.935001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f56991-3700-4121-b739-0fd42efc76ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:53.939548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f56991-3700-4121-b739-0fd42efc76ab admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:53.962518 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1367/2770] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:53.963506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f56991-3700-4121-b739-0fd42efc76ab admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:53.976910 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1404/2771] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:06:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:53.977896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f85b4c-d846-4541-bffa-551acc438da9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:54.010015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f85b4c-d846-4541-bffa-551acc438da9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:54.014773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f56991-3700-4121-b739-0fd42efc76ab admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:54.016480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7d787-bcf0-4845-b90b-35b826f09e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:54.017359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7d787-bcf0-4845-b90b-35b826f09e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:54.017806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7d787-bcf0-4845-b90b-35b826f09e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:54.018239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7d787-bcf0-4845-b90b-35b826f09e40 admin admin] PATH_INFO: `/v3/projects/9d4c6dec778e43aa9d9169344e11a3ca/users/d443cc1d790444b3a78c8038c0e1fa92/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:54.045568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b14ab-1de1-48ef-be54-d235a81971ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:54.050439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b14ab-1de1-48ef-be54-d235a81971ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:54.050881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b14ab-1de1-48ef-be54-d235a81971ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:54.052337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b14ab-1de1-48ef-be54-d235a81971ff admin admin] PATH_INFO: `/v3/projects/cb799a0263a14d1a93ba6e3fd37c260a/users/0c8da9a32cb54d0a87d914234b1e9f40/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:54.055427 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:54.081570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7d787-bcf0-4845-b90b-35b826f09e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4c6dec778e43aa9d9169344e11a3ca, user_id=d443cc1d790444b3a78c8038c0e1fa92, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:54.100965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7d787-bcf0-4845-b90b-35b826f09e40 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:54.135496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b14ab-1de1-48ef-be54-d235a81971ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb799a0263a14d1a93ba6e3fd37c260a, user_id=0c8da9a32cb54d0a87d914234b1e9f40, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:54.143145 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1405/2772] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:53 2022] PUT /identity/v3/projects/9d4c6dec778e43aa9d9169344e11a3ca/users/d443cc1d790444b3a78c8038c0e1fa92/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:54.144281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7d787-bcf0-4845-b90b-35b826f09e40 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:54.144873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b14ab-1de1-48ef-be54-d235a81971ff admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:54.153055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d1f7d787-bcf0-4845-b90b-35b826f09e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:54.186737 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1368/2773] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:53 2022] PUT /identity/v3/projects/cb799a0263a14d1a93ba6e3fd37c260a/users/0c8da9a32cb54d0a87d914234b1e9f40/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:54.193922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d7047-54c6-48b1-ba98-1d0b408062c8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:54.195286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d7047-54c6-48b1-ba98-1d0b408062c8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:54.195961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d7047-54c6-48b1-ba98-1d0b408062c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:54.275828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e63d7047-54c6-48b1-ba98-1d0b408062c8 None None] MFA Rules not processed for user `d443cc1d790444b3a78c8038c0e1fa92`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:54.277174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e63d7047-54c6-48b1-ba98-1d0b408062c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:54.323669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7d787-bcf0-4845-b90b-35b826f09e40 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:54.431419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134257-5f62-41a8-85d8-d5a46e649dea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:54.432419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134257-5f62-41a8-85d8-d5a46e649dea service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:54.432977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134257-5f62-41a8-85d8-d5a46e649dea service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:54.433420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134257-5f62-41a8-85d8-d5a46e649dea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:54.457410 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1369/2774] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:54.458904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83991d-a444-42ac-a4ac-88b28d88185b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:54.459229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83991d-a444-42ac-a4ac-88b28d88185b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:54.459497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83991d-a444-42ac-a4ac-88b28d88185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:54.490470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3e83991d-a444-42ac-a4ac-88b28d88185b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:54.492599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3e83991d-a444-42ac-a4ac-88b28d88185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:54.597206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72134257-5f62-41a8-85d8-d5a46e649dea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:54.601103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72134257-5f62-41a8-85d8-d5a46e649dea service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:54.617418 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1370/2775] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:54.618292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83991d-a444-42ac-a4ac-88b28d88185b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:54.636490 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1406/2776] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:06:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:06:54.638172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134257-5f62-41a8-85d8-d5a46e649dea service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:54.642311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-72134257-5f62-41a8-85d8-d5a46e649dea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:54.652967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83991d-a444-42ac-a4ac-88b28d88185b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:54.669933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01d0db-e537-4391-99d3-fa78899e1b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:54.670781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01d0db-e537-4391-99d3-fa78899e1b56 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:54.671217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01d0db-e537-4391-99d3-fa78899e1b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:54.671587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01d0db-e537-4391-99d3-fa78899e1b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:54.672863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01d0db-e537-4391-99d3-fa78899e1b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:54.698368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01d0db-e537-4391-99d3-fa78899e1b56 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:54.738199 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:54.767608 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1371/2777] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:54 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:54.773037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01d0db-e537-4391-99d3-fa78899e1b56 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:54.790417 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:54.934874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134257-5f62-41a8-85d8-d5a46e649dea service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:54.947150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01d0db-e537-4391-99d3-fa78899e1b56 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:54.954651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7009fb0-3b73-4117-8a42-96adf7f12fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:54.955409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7009fb0-3b73-4117-8a42-96adf7f12fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:54.955736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7009fb0-3b73-4117-8a42-96adf7f12fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:54.956015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7009fb0-3b73-4117-8a42-96adf7f12fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:54.958027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7009fb0-3b73-4117-8a42-96adf7f12fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:54.962184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7009fb0-3b73-4117-8a42-96adf7f12fe2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:55.017380 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1372/2778] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:54 2022] POST /identity/v3/users => generated 302 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:55.039530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7009fb0-3b73-4117-8a42-96adf7f12fe2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:55.057459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7009fb0-3b73-4117-8a42-96adf7f12fe2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:55.083425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcde300-305a-46f4-87d6-b989e334bf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:55.085090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcde300-305a-46f4-87d6-b989e334bf8a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:55.085729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcde300-305a-46f4-87d6-b989e334bf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:55.086240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcde300-305a-46f4-87d6-b989e334bf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:55.087297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcde300-305a-46f4-87d6-b989e334bf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:55.089423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcde300-305a-46f4-87d6-b989e334bf8a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:55.093124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac2570-7e23-4f0a-ad75-b67785b1170d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:55.093629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2570-7e23-4f0a-ad75-b67785b1170d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:55.094432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2570-7e23-4f0a-ad75-b67785b1170d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:55.094717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2570-7e23-4f0a-ad75-b67785b1170d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:55.114218 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1373/2779] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:55.118579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcde300-305a-46f4-87d6-b989e334bf8a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:55.127466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac2570-7e23-4f0a-ad75-b67785b1170d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:55.128922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac2570-7e23-4f0a-ad75-b67785b1170d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:55.153894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcde300-305a-46f4-87d6-b989e334bf8a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:55.165463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37091aa1-0670-4e97-b357-3f14740c9cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:55.168872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37091aa1-0670-4e97-b357-3f14740c9cad admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:55.169974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37091aa1-0670-4e97-b357-3f14740c9cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:55.170499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37091aa1-0670-4e97-b357-3f14740c9cad admin admin] PATH_INFO: `/v3/projects/39e912c48da34bac9ba0117b68dd4861/users/e16a8c8afa3642738fd3de616619a626/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:55.183850 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1407/2780] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:55.221824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37091aa1-0670-4e97-b357-3f14740c9cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e912c48da34bac9ba0117b68dd4861, user_id=e16a8c8afa3642738fd3de616619a626, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:55.228586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37091aa1-0670-4e97-b357-3f14740c9cad admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:55.253553 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1374/2781] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:55 2022] PUT /identity/v3/projects/39e912c48da34bac9ba0117b68dd4861/users/e16a8c8afa3642738fd3de616619a626/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:55.257514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac2570-7e23-4f0a-ad75-b67785b1170d service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:55.272930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac2570-7e23-4f0a-ad75-b67785b1170d service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:55.417114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd488d-af54-4202-9c9a-ea1025fbabab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:55.417713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd488d-af54-4202-9c9a-ea1025fbabab admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:55.417995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd488d-af54-4202-9c9a-ea1025fbabab admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:55.418262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd488d-af54-4202-9c9a-ea1025fbabab admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:55.418909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd488d-af54-4202-9c9a-ea1025fbabab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:55.420559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd488d-af54-4202-9c9a-ea1025fbabab admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:55.441394 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1408/2782] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:55.443877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37091aa1-0670-4e97-b357-3f14740c9cad admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:55.459965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37091aa1-0670-4e97-b357-3f14740c9cad admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:55.476786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a5363-46d6-4dbe-9a20-ab12c3ad46c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:55.478003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a5363-46d6-4dbe-9a20-ab12c3ad46c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:55.479551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a5363-46d6-4dbe-9a20-ab12c3ad46c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:55.480302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a5363-46d6-4dbe-9a20-ab12c3ad46c1 admin admin] PATH_INFO: `/v3/projects/39e912c48da34bac9ba0117b68dd4861/users/e16a8c8afa3642738fd3de616619a626/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:55.486572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a5363-46d6-4dbe-9a20-ab12c3ad46c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e912c48da34bac9ba0117b68dd4861, user_id=e16a8c8afa3642738fd3de616619a626, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:55.496017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a5363-46d6-4dbe-9a20-ab12c3ad46c1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:55.529960 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1375/2783] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:55 2022] PUT /identity/v3/projects/39e912c48da34bac9ba0117b68dd4861/users/e16a8c8afa3642738fd3de616619a626/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:55.609379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e7b84-ff33-4a4d-97d2-77cb35051dc0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:55.609972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e7b84-ff33-4a4d-97d2-77cb35051dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:55.610406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e7b84-ff33-4a4d-97d2-77cb35051dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:55.664200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-713e7b84-ff33-4a4d-97d2-77cb35051dc0 None None] MFA Rules not processed for user `e16a8c8afa3642738fd3de616619a626`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:55.666800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-713e7b84-ff33-4a4d-97d2-77cb35051dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:55.813959 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1409/2784] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:56.477852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a5363-46d6-4dbe-9a20-ab12c3ad46c1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:56.479642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0e8a5363-46d6-4dbe-9a20-ab12c3ad46c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:56.669669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a5363-46d6-4dbe-9a20-ab12c3ad46c1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:56.686438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25411b3-94d7-4974-9168-38f2749d681f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:56.687401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25411b3-94d7-4974-9168-38f2749d681f service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:56.688509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25411b3-94d7-4974-9168-38f2749d681f service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:56.689604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25411b3-94d7-4974-9168-38f2749d681f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:56.838188 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:56.928214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25411b3-94d7-4974-9168-38f2749d681f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:56.929842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25411b3-94d7-4974-9168-38f2749d681f service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:56.951565 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1376/2785] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:57.098899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e7b84-ff33-4a4d-97d2-77cb35051dc0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:57.100426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-713e7b84-ff33-4a4d-97d2-77cb35051dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:57.124875 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:57.274562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e7b84-ff33-4a4d-97d2-77cb35051dc0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:57.290540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac57833-cc6b-43ab-8973-9a57dcb97082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:57.291288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac57833-cc6b-43ab-8973-9a57dcb97082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:57.291684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac57833-cc6b-43ab-8973-9a57dcb97082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:57.292006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac57833-cc6b-43ab-8973-9a57dcb97082 admin admin] PATH_INFO: `/v3/users/d739d3fe2e744013b322ecb3b887be07` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:57.293284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac57833-cc6b-43ab-8973-9a57dcb97082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d739d3fe2e744013b322ecb3b887be07)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:57.295282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac57833-cc6b-43ab-8973-9a57dcb97082 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:57.410285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bac57833-cc6b-43ab-8973-9a57dcb97082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd739d3fe2e744013b322ecb3b887be07'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:57.411180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bac57833-cc6b-43ab-8973-9a57dcb97082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd739d3fe2e744013b322ecb3b887be07'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:57.438685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bac57833-cc6b-43ab-8973-9a57dcb97082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd739d3fe2e744013b322ecb3b887be07'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:57.460881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bac57833-cc6b-43ab-8973-9a57dcb97082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd739d3fe2e744013b322ecb3b887be07'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:57.462419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bac57833-cc6b-43ab-8973-9a57dcb97082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd739d3fe2e744013b322ecb3b887be07'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:57.501978 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1410/2786] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:57 2022] DELETE /identity/v3/users/d739d3fe2e744013b322ecb3b887be07 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:59.027487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25411b3-94d7-4974-9168-38f2749d681f service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:59.055272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25411b3-94d7-4974-9168-38f2749d681f service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:59.232925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:59.233681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:59.234077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:59.234425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f admin admin] PATH_INFO: `/v3/projects/7d149768b97a4e3985a0be62510997f3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:59.238209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d149768b97a4e3985a0be62510997f3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:59.241539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:59.494658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d149768b97a4e3985a0be62510997f3', 'request_id': 'req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:59.527178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d149768b97a4e3985a0be62510997f3', 'request_id': 'req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:59.572560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d149768b97a4e3985a0be62510997f3', 'request_id': 'req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:59.616788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f admin admin] The token cache is being invalidate because project 7d149768b97a4e3985a0be62510997f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:59.617954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:59.621702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b9db4c13-2d7f-4caa-924e-9b93e9bd273f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:59.627921 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1377/2787] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:59 2022] DELETE /identity/v3/projects/7d149768b97a4e3985a0be62510997f3 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:59.630195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3300-df8f-4f1b-91a9-8cf020a719ff None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:59.630685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3300-df8f-4f1b-91a9-8cf020a719ff None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:59.630779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3300-df8f-4f1b-91a9-8cf020a719ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:59.712014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3bdf3300-df8f-4f1b-91a9-8cf020a719ff None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:59.713565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3bdf3300-df8f-4f1b-91a9-8cf020a719ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:59.890937 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1411/2788] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:59.905096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cd91f-468b-4b4b-9785-c9dc5655d718 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:59.907530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cd91f-468b-4b4b-9785-c9dc5655d718 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:59.907893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cd91f-468b-4b4b-9785-c9dc5655d718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:00.009503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cf5cd91f-468b-4b4b-9785-c9dc5655d718 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:00.014275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cf5cd91f-468b-4b4b-9785-c9dc5655d718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:00.042434 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1378/2789] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:00.045933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf3300-df8f-4f1b-91a9-8cf020a719ff None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:00.071975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf3300-df8f-4f1b-91a9-8cf020a719ff None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:00.110176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7a1c3-9dce-4f9c-bcf6-ca0a7cd57839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:00.110820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a1c3-9dce-4f9c-bcf6-ca0a7cd57839 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:00.113426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a1c3-9dce-4f9c-bcf6-ca0a7cd57839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:00.113728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a1c3-9dce-4f9c-bcf6-ca0a7cd57839 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:00.114707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7a1c3-9dce-4f9c-bcf6-ca0a7cd57839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:07:00.115103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7a1c3-9dce-4f9c-bcf6-ca0a7cd57839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:00.116801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7a1c3-9dce-4f9c-bcf6-ca0a7cd57839 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:00.163843 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1412/2790] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:07:00.168100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cd91f-468b-4b4b-9785-c9dc5655d718 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:00.190172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cd91f-468b-4b4b-9785-c9dc5655d718 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:00.213906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa5fc2-8700-470b-b19c-2e8cf8109963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:00.230252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa5fc2-8700-470b-b19c-2e8cf8109963 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:00.230538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa5fc2-8700-470b-b19c-2e8cf8109963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:00.230893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa5fc2-8700-470b-b19c-2e8cf8109963 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:00.231622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa5fc2-8700-470b-b19c-2e8cf8109963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:00.255751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa5fc2-8700-470b-b19c-2e8cf8109963 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:00.427933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7a1c3-9dce-4f9c-bcf6-ca0a7cd57839 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:00.431216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d4c7a1c3-9dce-4f9c-bcf6-ca0a7cd57839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:00.446601 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1379/2791] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:07:00 2022] POST /identity/v3/projects => generated 379 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:07:00.451172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa5fc2-8700-470b-b19c-2e8cf8109963 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:00.512693 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:00.689791 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:00.695277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7a1c3-9dce-4f9c-bcf6-ca0a7cd57839 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:00.816742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa5fc2-8700-470b-b19c-2e8cf8109963 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:00.830352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe85c0-7649-4858-ab1a-89fa3bbd3fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:00.832121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe85c0-7649-4858-ab1a-89fa3bbd3fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:00.832474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe85c0-7649-4858-ab1a-89fa3bbd3fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:00.832756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe85c0-7649-4858-ab1a-89fa3bbd3fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:00.833558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe85c0-7649-4858-ab1a-89fa3bbd3fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:00.836824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe85c0-7649-4858-ab1a-89fa3bbd3fc2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:00.854563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf1305-1763-4b50-8eff-3177b439c3da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:00.855467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf1305-1763-4b50-8eff-3177b439c3da service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:00.856127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf1305-1763-4b50-8eff-3177b439c3da service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:00.856561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf1305-1763-4b50-8eff-3177b439c3da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:00.873271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79cf1305-1763-4b50-8eff-3177b439c3da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:00.901139 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1380/2792] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:07:00 2022] POST /identity/v3/users => generated 290 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:07:00.905386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe85c0-7649-4858-ab1a-89fa3bbd3fc2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:00.933664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe85c0-7649-4858-ab1a-89fa3bbd3fc2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:00.945281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070c541-7f9d-46d5-9b36-0f26263fdef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:00.946216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070c541-7f9d-46d5-9b36-0f26263fdef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:00.947600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070c541-7f9d-46d5-9b36-0f26263fdef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:00.948362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070c541-7f9d-46d5-9b36-0f26263fdef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:00.949192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070c541-7f9d-46d5-9b36-0f26263fdef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:00.951089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070c541-7f9d-46d5-9b36-0f26263fdef3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:00.982072 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1381/2793] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:07:00.986394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070c541-7f9d-46d5-9b36-0f26263fdef3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:01.006296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070c541-7f9d-46d5-9b36-0f26263fdef3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:01.021899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d07f1-7a82-40b6-89af-4ba79e22ff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:01.022812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d07f1-7a82-40b6-89af-4ba79e22ff1e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:01.023335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d07f1-7a82-40b6-89af-4ba79e22ff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:01.023807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d07f1-7a82-40b6-89af-4ba79e22ff1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:01.024611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d07f1-7a82-40b6-89af-4ba79e22ff1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:01.026409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d07f1-7a82-40b6-89af-4ba79e22ff1e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:01.030209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf1305-1763-4b50-8eff-3177b439c3da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:01.034026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf1305-1763-4b50-8eff-3177b439c3da service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:01.083945 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1382/2794] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:07:01.084563 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1413/2795] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:01.087455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d07f1-7a82-40b6-89af-4ba79e22ff1e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:01.101414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d07f1-7a82-40b6-89af-4ba79e22ff1e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:01.118951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca698802-23a3-49e9-8229-0ad2dfd1de0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:01.119757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca698802-23a3-49e9-8229-0ad2dfd1de0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:01.120070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca698802-23a3-49e9-8229-0ad2dfd1de0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:01.120392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca698802-23a3-49e9-8229-0ad2dfd1de0e admin admin] PATH_INFO: `/v3/projects/5eae09e917ca43229255dc36feb372b1/users/f9006b4b81c74fedb161ef214bd39158/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:01.170532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca698802-23a3-49e9-8229-0ad2dfd1de0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eae09e917ca43229255dc36feb372b1, user_id=f9006b4b81c74fedb161ef214bd39158, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:01.173400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca698802-23a3-49e9-8229-0ad2dfd1de0e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:01.211804 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1383/2796] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:07:01 2022] PUT /identity/v3/projects/5eae09e917ca43229255dc36feb372b1/users/f9006b4b81c74fedb161ef214bd39158/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:01.225515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f640d-b9b5-41d5-abfa-2122a8c56a74 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:01.226062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f640d-b9b5-41d5-abfa-2122a8c56a74 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:01.226536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f640d-b9b5-41d5-abfa-2122a8c56a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:01.279192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a94f640d-b9b5-41d5-abfa-2122a8c56a74 None None] MFA Rules not processed for user `f9006b4b81c74fedb161ef214bd39158`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:01.280941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a94f640d-b9b5-41d5-abfa-2122a8c56a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:01.372985 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:01.445629 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1414/2797] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:01.530809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca698802-23a3-49e9-8229-0ad2dfd1de0e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:01.536266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ca698802-23a3-49e9-8229-0ad2dfd1de0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:01.747802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca698802-23a3-49e9-8229-0ad2dfd1de0e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:01.761617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca6cb6-0f08-416f-92c2-c83b0038a576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:01.762291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca6cb6-0f08-416f-92c2-c83b0038a576 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:01.762559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca6cb6-0f08-416f-92c2-c83b0038a576 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:01.762829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca6cb6-0f08-416f-92c2-c83b0038a576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:01.781830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca6cb6-0f08-416f-92c2-c83b0038a576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:01.788641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca6cb6-0f08-416f-92c2-c83b0038a576 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:01.813637 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1384/2798] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:01.921764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f640d-b9b5-41d5-abfa-2122a8c56a74 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:02.183613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f640d-b9b5-41d5-abfa-2122a8c56a74 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:02.201542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:02.206485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:02.207082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:02.208390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] PATH_INFO: `/v3/users/f9006b4b81c74fedb161ef214bd39158` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:02.212012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9006b4b81c74fedb161ef214bd39158)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:02.216855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:02.387969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9006b4b81c74fedb161ef214bd39158'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:02.389288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9006b4b81c74fedb161ef214bd39158'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:02.423244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9006b4b81c74fedb161ef214bd39158'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:02.440385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9006b4b81c74fedb161ef214bd39158'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:02.441781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9006b4b81c74fedb161ef214bd39158'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:02.467429 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1415/2799] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:07:01 2022] DELETE /identity/v3/users/f9006b4b81c74fedb161ef214bd39158 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:02.472436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0f449-4e24-4630-8305-f7b5ba4ca8dd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:02.473409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0f449-4e24-4630-8305-f7b5ba4ca8dd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:02.473939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0f449-4e24-4630-8305-f7b5ba4ca8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:02.513634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-95b0f449-4e24-4630-8305-f7b5ba4ca8dd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:02.515486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-95b0f449-4e24-4630-8305-f7b5ba4ca8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:02.680104 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1385/2800] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:02.957583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:02.959567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:03.164877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e0335-4d75-456e-84e3-d0f63b633b30 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:03.173309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844936f-0955-424a-b468-443d5a5853a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:03.180033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844936f-0955-424a-b468-443d5a5853a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:03.180345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844936f-0955-424a-b468-443d5a5853a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:03.180636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844936f-0955-424a-b468-443d5a5853a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:03.217429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844936f-0955-424a-b468-443d5a5853a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:03.226244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844936f-0955-424a-b468-443d5a5853a5 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:03.241903 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:03.252024 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1416/2801] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:05.268225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0f449-4e24-4630-8305-f7b5ba4ca8dd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:05.269902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-95b0f449-4e24-4630-8305-f7b5ba4ca8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:05.279824 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:05.300717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0f449-4e24-4630-8305-f7b5ba4ca8dd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:05.315729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a55209-3967-4d94-b391-7eb0406c53cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:05.320452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a55209-3967-4d94-b391-7eb0406c53cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:05.321960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a55209-3967-4d94-b391-7eb0406c53cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:05.322362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a55209-3967-4d94-b391-7eb0406c53cc admin admin] PATH_INFO: `/v3/projects/5eae09e917ca43229255dc36feb372b1` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:05.326867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a55209-3967-4d94-b391-7eb0406c53cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eae09e917ca43229255dc36feb372b1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:05.335956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a55209-3967-4d94-b391-7eb0406c53cc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:05.516538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a9a55209-3967-4d94-b391-7eb0406c53cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eae09e917ca43229255dc36feb372b1', 'request_id': 'req-a9a55209-3967-4d94-b391-7eb0406c53cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:05.532492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a9a55209-3967-4d94-b391-7eb0406c53cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eae09e917ca43229255dc36feb372b1', 'request_id': 'req-a9a55209-3967-4d94-b391-7eb0406c53cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:05.564923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a9a55209-3967-4d94-b391-7eb0406c53cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eae09e917ca43229255dc36feb372b1', 'request_id': 'req-a9a55209-3967-4d94-b391-7eb0406c53cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:05.616265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a9a55209-3967-4d94-b391-7eb0406c53cc admin admin] The token cache is being invalidate because project 5eae09e917ca43229255dc36feb372b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:07:05.619727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a9a55209-3967-4d94-b391-7eb0406c53cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:05.623343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a9a55209-3967-4d94-b391-7eb0406c53cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:05.632672 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1386/2802] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:05 2022] DELETE /identity/v3/projects/5eae09e917ca43229255dc36feb372b1 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:05.634482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565cfe8-6f13-4096-a7c6-bbaa13c9d056 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:05.635024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565cfe8-6f13-4096-a7c6-bbaa13c9d056 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:05.635300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565cfe8-6f13-4096-a7c6-bbaa13c9d056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:05.703702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2565cfe8-6f13-4096-a7c6-bbaa13c9d056 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:05.709361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2565cfe8-6f13-4096-a7c6-bbaa13c9d056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:05.928860 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1417/2803] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:05.946635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7d506-df5a-4c73-947b-6415a1ef0ec2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:05.946888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7d506-df5a-4c73-947b-6415a1ef0ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:05.947442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7d506-df5a-4c73-947b-6415a1ef0ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:06.022843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d2f7d506-df5a-4c73-947b-6415a1ef0ec2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:06.029847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d2f7d506-df5a-4c73-947b-6415a1ef0ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:06.087709 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1387/2804] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:06.094856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565cfe8-6f13-4096-a7c6-bbaa13c9d056 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:06.112834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565cfe8-6f13-4096-a7c6-bbaa13c9d056 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:06.136730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa818b1-5532-4c50-9293-cd4846eaea1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:06.137374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa818b1-5532-4c50-9293-cd4846eaea1e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:06.137659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa818b1-5532-4c50-9293-cd4846eaea1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:06.137938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa818b1-5532-4c50-9293-cd4846eaea1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:06.148192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa818b1-5532-4c50-9293-cd4846eaea1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:07:06.153798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa818b1-5532-4c50-9293-cd4846eaea1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:06.155152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa818b1-5532-4c50-9293-cd4846eaea1e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:06.227715 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1418/2805] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:07:06.232413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7d506-df5a-4c73-947b-6415a1ef0ec2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:06.246276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7d506-df5a-4c73-947b-6415a1ef0ec2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:06.283857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908e1a7-e9bd-4148-949d-a7c97acebe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:06.284777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908e1a7-e9bd-4148-949d-a7c97acebe8e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:06.285554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908e1a7-e9bd-4148-949d-a7c97acebe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:06.285554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908e1a7-e9bd-4148-949d-a7c97acebe8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:06.286017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908e1a7-e9bd-4148-949d-a7c97acebe8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:06.293468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908e1a7-e9bd-4148-949d-a7c97acebe8e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:06.348102 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1388/2806] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:07:06 2022] POST /identity/v3/projects => generated 397 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:07:06.352195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa818b1-5532-4c50-9293-cd4846eaea1e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:06.372030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa818b1-5532-4c50-9293-cd4846eaea1e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:06.475079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3a416-0074-4b48-8bcf-68431b9ae915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:06.476084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3a416-0074-4b48-8bcf-68431b9ae915 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:06.476552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3a416-0074-4b48-8bcf-68431b9ae915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:06.477008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3a416-0074-4b48-8bcf-68431b9ae915 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:06.478084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3a416-0074-4b48-8bcf-68431b9ae915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:06.480563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3a416-0074-4b48-8bcf-68431b9ae915 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:06.541207 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1419/2807] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:07:06 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:07:06.543386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908e1a7-e9bd-4148-949d-a7c97acebe8e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:06.585145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908e1a7-e9bd-4148-949d-a7c97acebe8e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:06.614994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2162767-f26d-42be-9bf2-820e877aa5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:06.615589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2162767-f26d-42be-9bf2-820e877aa5ac admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:06.615867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2162767-f26d-42be-9bf2-820e877aa5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:06.622433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2162767-f26d-42be-9bf2-820e877aa5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:06.623162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2162767-f26d-42be-9bf2-820e877aa5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:06.633249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2162767-f26d-42be-9bf2-820e877aa5ac admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:06.687500 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1389/2808] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:07:06.689946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3a416-0074-4b48-8bcf-68431b9ae915 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:06.704915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3a416-0074-4b48-8bcf-68431b9ae915 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:06.720021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4038b88-d653-4a55-8adb-44ade0938790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:06.721090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4038b88-d653-4a55-8adb-44ade0938790 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:06.721592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4038b88-d653-4a55-8adb-44ade0938790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:06.722085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4038b88-d653-4a55-8adb-44ade0938790 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:06.723112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4038b88-d653-4a55-8adb-44ade0938790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:06.725005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4038b88-d653-4a55-8adb-44ade0938790 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:06.756350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2162767-f26d-42be-9bf2-820e877aa5ac admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:06.786212 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1420/2809] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:07:06.791328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2162767-f26d-42be-9bf2-820e877aa5ac admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:06.799324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8911e2d-7233-4a1f-9e17-6be19be1d87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:06.800614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8911e2d-7233-4a1f-9e17-6be19be1d87f admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:06.801152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8911e2d-7233-4a1f-9e17-6be19be1d87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:06.801647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8911e2d-7233-4a1f-9e17-6be19be1d87f admin admin] PATH_INFO: `/v3/projects/181b321b1e104ee29512c219f7db1e90/users/cc9d35bb66124eea8cf5870ab7524a10/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:06.874443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8911e2d-7233-4a1f-9e17-6be19be1d87f admin admin] RBAC: Authorizing `identity:create_grant(project_id=181b321b1e104ee29512c219f7db1e90, user_id=cc9d35bb66124eea8cf5870ab7524a10, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:06.885882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8911e2d-7233-4a1f-9e17-6be19be1d87f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:06.952152 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1390/2810] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:07:06 2022] PUT /identity/v3/projects/181b321b1e104ee29512c219f7db1e90/users/cc9d35bb66124eea8cf5870ab7524a10/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:06.962007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727720eb-8ba6-4880-956b-a8e8b020b05f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:06.962646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727720eb-8ba6-4880-956b-a8e8b020b05f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:06.963465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727720eb-8ba6-4880-956b-a8e8b020b05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:07.024711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-727720eb-8ba6-4880-956b-a8e8b020b05f None None] MFA Rules not processed for user `cc9d35bb66124eea8cf5870ab7524a10`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:07.029132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-727720eb-8ba6-4880-956b-a8e8b020b05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:07.173350 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:07.211039 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1421/2811] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:07.491350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8911e2d-7233-4a1f-9e17-6be19be1d87f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:07.499004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f8911e2d-7233-4a1f-9e17-6be19be1d87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:07.712256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8911e2d-7233-4a1f-9e17-6be19be1d87f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:07.736714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e93b9-26d1-4bed-a81a-6054ff104609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:07.737366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e93b9-26d1-4bed-a81a-6054ff104609 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:07.737644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e93b9-26d1-4bed-a81a-6054ff104609 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:07.737919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e93b9-26d1-4bed-a81a-6054ff104609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:07.753651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e93b9-26d1-4bed-a81a-6054ff104609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:07.755350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e93b9-26d1-4bed-a81a-6054ff104609 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:07.780270 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1391/2812] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:07 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:07.911286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02909a0d-52d6-4428-9c80-2975e44e1a3d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:07.911834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02909a0d-52d6-4428-9c80-2975e44e1a3d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:07.911834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02909a0d-52d6-4428-9c80-2975e44e1a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:07.979591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-02909a0d-52d6-4428-9c80-2975e44e1a3d None None] MFA Rules not processed for user `cc9d35bb66124eea8cf5870ab7524a10`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:07.979803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-02909a0d-52d6-4428-9c80-2975e44e1a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:08.023291 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1422/2813] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:10.176106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e93b9-26d1-4bed-a81a-6054ff104609 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:10.199384 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:10.387471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e93b9-26d1-4bed-a81a-6054ff104609 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:10.405752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e24d55-8ecd-4775-bea5-c873b5343b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:10.406864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e24d55-8ecd-4775-bea5-c873b5343b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:10.407255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e24d55-8ecd-4775-bea5-c873b5343b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:10.407639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e24d55-8ecd-4775-bea5-c873b5343b91 admin admin] PATH_INFO: `/v3/users/cc9d35bb66124eea8cf5870ab7524a10` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:10.413272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e24d55-8ecd-4775-bea5-c873b5343b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9d35bb66124eea8cf5870ab7524a10)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:10.415252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e24d55-8ecd-4775-bea5-c873b5343b91 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:10.541125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d9e24d55-8ecd-4775-bea5-c873b5343b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9d35bb66124eea8cf5870ab7524a10'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:10.542610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d9e24d55-8ecd-4775-bea5-c873b5343b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9d35bb66124eea8cf5870ab7524a10'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:10.587789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d9e24d55-8ecd-4775-bea5-c873b5343b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9d35bb66124eea8cf5870ab7524a10'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:10.605400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d9e24d55-8ecd-4775-bea5-c873b5343b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9d35bb66124eea8cf5870ab7524a10'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:10.606079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d9e24d55-8ecd-4775-bea5-c873b5343b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9d35bb66124eea8cf5870ab7524a10'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:10.634971 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1392/2814] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:07:10 2022] DELETE /identity/v3/users/cc9d35bb66124eea8cf5870ab7524a10 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:10.639959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0df26-dcc0-4609-8643-cc6cc89e782d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:10.641508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0df26-dcc0-4609-8643-cc6cc89e782d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:10.642666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0df26-dcc0-4609-8643-cc6cc89e782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:10.722778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fcd0df26-dcc0-4609-8643-cc6cc89e782d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:10.724165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fcd0df26-dcc0-4609-8643-cc6cc89e782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:10.907283 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1423/2815] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:10.923866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6752e60-ed1f-4600-81cd-f98ce958bb38 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:10.924238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6752e60-ed1f-4600-81cd-f98ce958bb38 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:10.924440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6752e60-ed1f-4600-81cd-f98ce958bb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:10.929398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0df26-dcc0-4609-8643-cc6cc89e782d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:10.932144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fcd0df26-dcc0-4609-8643-cc6cc89e782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:11.023401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e6752e60-ed1f-4600-81cd-f98ce958bb38 None None] MFA Rules not processed for user `59f3db3aa571450c903a9733155561a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:11.025063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e6752e60-ed1f-4600-81cd-f98ce958bb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:11.146218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0df26-dcc0-4609-8643-cc6cc89e782d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:11.162220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46ccc-a172-41f1-a162-98450e76a95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:11.166762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46ccc-a172-41f1-a162-98450e76a95d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:11.170869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46ccc-a172-41f1-a162-98450e76a95d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:11.171373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46ccc-a172-41f1-a162-98450e76a95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:11.205952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e46ccc-a172-41f1-a162-98450e76a95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:11.210395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e46ccc-a172-41f1-a162-98450e76a95d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:11.241353 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1393/2816] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:11.253624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6752e60-ed1f-4600-81cd-f98ce958bb38 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:11.254045 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1424/2817] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:07:11.255115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e6752e60-ed1f-4600-81cd-f98ce958bb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:11.292137 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:11.512913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6752e60-ed1f-4600-81cd-f98ce958bb38 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:11.529477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fe50d-5683-4cda-a8e7-95713ddd34ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:11.530783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fe50d-5683-4cda-a8e7-95713ddd34ca service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:11.531103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fe50d-5683-4cda-a8e7-95713ddd34ca service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:11.531924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fe50d-5683-4cda-a8e7-95713ddd34ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:11.563422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fe50d-5683-4cda-a8e7-95713ddd34ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:11.564905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fe50d-5683-4cda-a8e7-95713ddd34ca service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:11.618677 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1394/2818] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:07:12.319003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46ccc-a172-41f1-a162-98450e76a95d service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:12.321953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-99e46ccc-a172-41f1-a162-98450e76a95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:12.359804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46ccc-a172-41f1-a162-98450e76a95d service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:12.376128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e6370-46b4-480c-9b55-a970d24b3113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:12.379670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e6370-46b4-480c-9b55-a970d24b3113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:12.380334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e6370-46b4-480c-9b55-a970d24b3113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:12.383965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e6370-46b4-480c-9b55-a970d24b3113 admin admin] PATH_INFO: `/v3/projects/181b321b1e104ee29512c219f7db1e90` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:12.392226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e6370-46b4-480c-9b55-a970d24b3113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=181b321b1e104ee29512c219f7db1e90)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:12.394946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e6370-46b4-480c-9b55-a970d24b3113 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:12.538436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-969e6370-46b4-480c-9b55-a970d24b3113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181b321b1e104ee29512c219f7db1e90', 'request_id': 'req-969e6370-46b4-480c-9b55-a970d24b3113'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:12.564744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-969e6370-46b4-480c-9b55-a970d24b3113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181b321b1e104ee29512c219f7db1e90', 'request_id': 'req-969e6370-46b4-480c-9b55-a970d24b3113'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:12.594411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-969e6370-46b4-480c-9b55-a970d24b3113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181b321b1e104ee29512c219f7db1e90', 'request_id': 'req-969e6370-46b4-480c-9b55-a970d24b3113'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:12.646870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-969e6370-46b4-480c-9b55-a970d24b3113 admin admin] The token cache is being invalidate because project 181b321b1e104ee29512c219f7db1e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:07:12.649288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-969e6370-46b4-480c-9b55-a970d24b3113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:12.651156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-969e6370-46b4-480c-9b55-a970d24b3113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:12.661149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbbad2-89d3-4eff-828d-bef1df589975 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:12.662301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbbad2-89d3-4eff-828d-bef1df589975 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:12.662435 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1425/2819] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:12 2022] DELETE /identity/v3/projects/181b321b1e104ee29512c219f7db1e90 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:12.662877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbbad2-89d3-4eff-828d-bef1df589975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:12.732055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9bcbbad2-89d3-4eff-828d-bef1df589975 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:12.747773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9bcbbad2-89d3-4eff-828d-bef1df589975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:13.036089 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1395/2820] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:13.036620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51353604-3fa1-4595-a5df-13534393259a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:13.037308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51353604-3fa1-4595-a5df-13534393259a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:13.037594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51353604-3fa1-4595-a5df-13534393259a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:13.090796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-51353604-3fa1-4595-a5df-13534393259a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:13.092086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-51353604-3fa1-4595-a5df-13534393259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:13.143658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbbad2-89d3-4eff-828d-bef1df589975 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:13.144348 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1426/2821] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:13.158582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbbad2-89d3-4eff-828d-bef1df589975 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:13.176852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d48fe-fc73-4b7c-bb61-75c95e66c90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:13.179500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d48fe-fc73-4b7c-bb61-75c95e66c90c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:13.181214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d48fe-fc73-4b7c-bb61-75c95e66c90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:13.181782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d48fe-fc73-4b7c-bb61-75c95e66c90c admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:13.184905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d48fe-fc73-4b7c-bb61-75c95e66c90c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:07:13.186933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d48fe-fc73-4b7c-bb61-75c95e66c90c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:13.193318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d48fe-fc73-4b7c-bb61-75c95e66c90c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:13.237266 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1396/2822] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:07:13.238647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51353604-3fa1-4595-a5df-13534393259a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:13.252083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51353604-3fa1-4595-a5df-13534393259a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:13.275093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14136678-746e-477c-b60c-8204935cc6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:13.276233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14136678-746e-477c-b60c-8204935cc6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:13.276522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14136678-746e-477c-b60c-8204935cc6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:13.276804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14136678-746e-477c-b60c-8204935cc6d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:13.277465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14136678-746e-477c-b60c-8204935cc6d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:13.284850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14136678-746e-477c-b60c-8204935cc6d0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:13.309514 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:13.395258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d48fe-fc73-4b7c-bb61-75c95e66c90c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:13.397188 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1427/2823] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:07:13 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:07:13.409889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d48fe-fc73-4b7c-bb61-75c95e66c90c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:13.903798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcab9e-3b46-4fbb-ba48-6c60a19159d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:13.913299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcab9e-3b46-4fbb-ba48-6c60a19159d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:13.913859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcab9e-3b46-4fbb-ba48-6c60a19159d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:13.914250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcab9e-3b46-4fbb-ba48-6c60a19159d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:13.915095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcab9e-3b46-4fbb-ba48-6c60a19159d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:13.917465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcab9e-3b46-4fbb-ba48-6c60a19159d3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:13.989383 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1397/2824] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:07:13 2022] POST /identity/v3/users => generated 291 bytes in 592 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:07:13.990983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14136678-746e-477c-b60c-8204935cc6d0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:14.012916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14136678-746e-477c-b60c-8204935cc6d0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:14.042737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2da77-e4d3-41a8-83af-261ff468ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:14.046005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2da77-e4d3-41a8-83af-261ff468ae5c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:14.046293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2da77-e4d3-41a8-83af-261ff468ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:14.046575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2da77-e4d3-41a8-83af-261ff468ae5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:14.053903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2da77-e4d3-41a8-83af-261ff468ae5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:14.074031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2da77-e4d3-41a8-83af-261ff468ae5c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:14.138452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcab9e-3b46-4fbb-ba48-6c60a19159d3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:14.146899 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1428/2825] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:07:14.161895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcab9e-3b46-4fbb-ba48-6c60a19159d3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:14.178883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b973fd-57c7-4ff5-9878-910624a8abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:14.180859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b973fd-57c7-4ff5-9878-910624a8abc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:14.183142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b973fd-57c7-4ff5-9878-910624a8abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:14.184344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b973fd-57c7-4ff5-9878-910624a8abc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:14.195209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b973fd-57c7-4ff5-9878-910624a8abc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:14.201751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b973fd-57c7-4ff5-9878-910624a8abc1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:14.220675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff691-364e-4555-8a48-16cd00c49349 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:14.221294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff691-364e-4555-8a48-16cd00c49349 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:14.221941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff691-364e-4555-8a48-16cd00c49349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:14.295400 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1398/2826] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:07:14.301646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b973fd-57c7-4ff5-9878-910624a8abc1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:14.344592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b973fd-57c7-4ff5-9878-910624a8abc1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:14.360154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cacacd-0d2c-4902-ba6e-143c2bc846b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:14.360742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cacacd-0d2c-4902-ba6e-143c2bc846b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:14.361056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cacacd-0d2c-4902-ba6e-143c2bc846b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:14.361278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cacacd-0d2c-4902-ba6e-143c2bc846b1 admin admin] PATH_INFO: `/v3/projects/7777fe2afdda4571bf43cee54828d89a/users/0fcaf607c2ef4e64bb227622907dbfc5/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:14.413397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c7aff691-364e-4555-8a48-16cd00c49349 None None] MFA Rules not processed for user `0c8da9a32cb54d0a87d914234b1e9f40`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:14.414693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c7aff691-364e-4555-8a48-16cd00c49349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:14.469533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cacacd-0d2c-4902-ba6e-143c2bc846b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7777fe2afdda4571bf43cee54828d89a, user_id=0fcaf607c2ef4e64bb227622907dbfc5, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:14.478679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cacacd-0d2c-4902-ba6e-143c2bc846b1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:14.527852 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:14.562986 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1399/2827] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:07:14 2022] PUT /identity/v3/projects/7777fe2afdda4571bf43cee54828d89a/users/0fcaf607c2ef4e64bb227622907dbfc5/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:14.565324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339de6e-ee6e-4cba-86f2-51d1d11a748b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:14.565324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339de6e-ee6e-4cba-86f2-51d1d11a748b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:14.565324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339de6e-ee6e-4cba-86f2-51d1d11a748b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:14.650484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7339de6e-ee6e-4cba-86f2-51d1d11a748b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:14.659157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7339de6e-ee6e-4cba-86f2-51d1d11a748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:14.788850 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1429/2828] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 569 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:14.963792 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1400/2829] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:15.004960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aff691-364e-4555-8a48-16cd00c49349 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:15.006462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c7aff691-364e-4555-8a48-16cd00c49349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:15.182938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aff691-364e-4555-8a48-16cd00c49349 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:15.357807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769481a0-eec3-4002-85cb-bedff79034b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:15.359185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769481a0-eec3-4002-85cb-bedff79034b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:15.359185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769481a0-eec3-4002-85cb-bedff79034b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:15.363154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769481a0-eec3-4002-85cb-bedff79034b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:15.404059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769481a0-eec3-4002-85cb-bedff79034b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:15.412172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769481a0-eec3-4002-85cb-bedff79034b8 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:15.447047 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1430/2830] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:17.190295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339de6e-ee6e-4cba-86f2-51d1d11a748b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:17.192357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7339de6e-ee6e-4cba-86f2-51d1d11a748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:17.439139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769481a0-eec3-4002-85cb-bedff79034b8 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:17.440636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-769481a0-eec3-4002-85cb-bedff79034b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:17.477941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769481a0-eec3-4002-85cb-bedff79034b8 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:17.492031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339de6e-ee6e-4cba-86f2-51d1d11a748b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:17.507641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6f4da-c192-4087-bd22-0e4140660f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:17.511528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6f4da-c192-4087-bd22-0e4140660f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:17.517577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993f0b8-30fa-48e8-8798-ed5c848189c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:17.518537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993f0b8-30fa-48e8-8798-ed5c848189c9 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:17.521980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6f4da-c192-4087-bd22-0e4140660f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:17.522408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6f4da-c192-4087-bd22-0e4140660f92 admin admin] PATH_INFO: `/v3/users/e6f9ebc41aaf4f2895c5f2fb02e28166` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:17.527218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993f0b8-30fa-48e8-8798-ed5c848189c9 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:17.528370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993f0b8-30fa-48e8-8798-ed5c848189c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:17.529540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6f4da-c192-4087-bd22-0e4140660f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f9ebc41aaf4f2895c5f2fb02e28166)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:17.533742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6f4da-c192-4087-bd22-0e4140660f92 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:17.536811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9993f0b8-30fa-48e8-8798-ed5c848189c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:17.572035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993f0b8-30fa-48e8-8798-ed5c848189c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:17.573929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993f0b8-30fa-48e8-8798-ed5c848189c9 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:17.606356 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1401/2831] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:17.611255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993f0b8-30fa-48e8-8798-ed5c848189c9 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:17.618796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9993f0b8-30fa-48e8-8798-ed5c848189c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:17.740457 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:17.833067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993f0b8-30fa-48e8-8798-ed5c848189c9 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:17.853148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e440849-7b93-43a4-ab2c-c83e1d3fc4d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:17.853793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e440849-7b93-43a4-ab2c-c83e1d3fc4d7 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:17.854470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e440849-7b93-43a4-ab2c-c83e1d3fc4d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:17.855156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e440849-7b93-43a4-ab2c-c83e1d3fc4d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:17.860003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20a6f4da-c192-4087-bd22-0e4140660f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f9ebc41aaf4f2895c5f2fb02e28166'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:17.868858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20a6f4da-c192-4087-bd22-0e4140660f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f9ebc41aaf4f2895c5f2fb02e28166'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:17.924820 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:18.022992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20a6f4da-c192-4087-bd22-0e4140660f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f9ebc41aaf4f2895c5f2fb02e28166'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:18.071289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20a6f4da-c192-4087-bd22-0e4140660f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f9ebc41aaf4f2895c5f2fb02e28166'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:18.073609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20a6f4da-c192-4087-bd22-0e4140660f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f9ebc41aaf4f2895c5f2fb02e28166'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:18.103729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e440849-7b93-43a4-ab2c-c83e1d3fc4d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:18.115993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e440849-7b93-43a4-ab2c-c83e1d3fc4d7 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:18.147183 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1402/2832] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:18.197626 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1431/2833] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:07:17 2022] DELETE /identity/v3/users/e6f9ebc41aaf4f2895c5f2fb02e28166 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:07:19.143028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e440849-7b93-43a4-ab2c-c83e1d3fc4d7 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:19.158238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e440849-7b93-43a4-ab2c-c83e1d3fc4d7 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:19.494794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda45c2-145b-48df-aa77-33743b8c44b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:19.499069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda45c2-145b-48df-aa77-33743b8c44b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:19.499356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda45c2-145b-48df-aa77-33743b8c44b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:19.499633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda45c2-145b-48df-aa77-33743b8c44b2 admin admin] PATH_INFO: `/v3/projects/06ffa5dcbbb745ba8b09806f2202e95d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:19.511878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda45c2-145b-48df-aa77-33743b8c44b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ffa5dcbbb745ba8b09806f2202e95d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:19.513838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda45c2-145b-48df-aa77-33743b8c44b2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:19.793844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-efda45c2-145b-48df-aa77-33743b8c44b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ffa5dcbbb745ba8b09806f2202e95d', 'request_id': 'req-efda45c2-145b-48df-aa77-33743b8c44b2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:19.830845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-efda45c2-145b-48df-aa77-33743b8c44b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ffa5dcbbb745ba8b09806f2202e95d', 'request_id': 'req-efda45c2-145b-48df-aa77-33743b8c44b2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:19.887428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-efda45c2-145b-48df-aa77-33743b8c44b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ffa5dcbbb745ba8b09806f2202e95d', 'request_id': 'req-efda45c2-145b-48df-aa77-33743b8c44b2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:19.946801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-efda45c2-145b-48df-aa77-33743b8c44b2 admin admin] The token cache is being invalidate because project 06ffa5dcbbb745ba8b09806f2202e95d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:07:19.949411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-efda45c2-145b-48df-aa77-33743b8c44b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:19.953302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-efda45c2-145b-48df-aa77-33743b8c44b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:19.969984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06350c4-4184-463a-9613-228947813d72 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:19.970561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06350c4-4184-463a-9613-228947813d72 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:19.970736 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1403/2834] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:19 2022] DELETE /identity/v3/projects/06ffa5dcbbb745ba8b09806f2202e95d => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:19.970936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06350c4-4184-463a-9613-228947813d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:20.058711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d06350c4-4184-463a-9613-228947813d72 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:20.073510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d06350c4-4184-463a-9613-228947813d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:20.392147 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1432/2835] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:07:20.395455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a12ba1-1f3f-4f0c-b60d-ddbdb503624b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:20.396280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a12ba1-1f3f-4f0c-b60d-ddbdb503624b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:20.396720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a12ba1-1f3f-4f0c-b60d-ddbdb503624b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:20.477456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-29a12ba1-1f3f-4f0c-b60d-ddbdb503624b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:20.486471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-29a12ba1-1f3f-4f0c-b60d-ddbdb503624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:20.536061 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1404/2836] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:20.540688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06350c4-4184-463a-9613-228947813d72 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:20.571047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06350c4-4184-463a-9613-228947813d72 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:20.612513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ce9b2-e14c-432a-825a-12c9f1994b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:20.614142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ce9b2-e14c-432a-825a-12c9f1994b1c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:20.620819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ce9b2-e14c-432a-825a-12c9f1994b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:20.621205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ce9b2-e14c-432a-825a-12c9f1994b1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:20.621922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ce9b2-e14c-432a-825a-12c9f1994b1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:07:20.622234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ce9b2-e14c-432a-825a-12c9f1994b1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:20.623909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ce9b2-e14c-432a-825a-12c9f1994b1c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:20.710350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a12ba1-1f3f-4f0c-b60d-ddbdb503624b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:20.723098 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1433/2837] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:07:20.726385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a12ba1-1f3f-4f0c-b60d-ddbdb503624b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:20.755085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f574ba-6722-476f-81bf-1b049b7fa2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:20.755645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f574ba-6722-476f-81bf-1b049b7fa2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:20.757954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f574ba-6722-476f-81bf-1b049b7fa2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:20.758232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f574ba-6722-476f-81bf-1b049b7fa2f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:20.758887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f574ba-6722-476f-81bf-1b049b7fa2f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:20.781542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f574ba-6722-476f-81bf-1b049b7fa2f7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:20.885479 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1405/2838] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:07:20 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:07:20.889558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ce9b2-e14c-432a-825a-12c9f1994b1c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:20.908384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ce9b2-e14c-432a-825a-12c9f1994b1c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:21.319759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04249-eb82-492d-afcc-d9582c713559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:21.320559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04249-eb82-492d-afcc-d9582c713559 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:21.320862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04249-eb82-492d-afcc-d9582c713559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:21.321138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04249-eb82-492d-afcc-d9582c713559 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:21.333172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c04249-eb82-492d-afcc-d9582c713559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:21.333172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c04249-eb82-492d-afcc-d9582c713559 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:21.401494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f574ba-6722-476f-81bf-1b049b7fa2f7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:21.412116 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1434/2839] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:07:20 2022] POST /identity/v3/users => generated 292 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:07:21.421517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f574ba-6722-476f-81bf-1b049b7fa2f7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:21.447152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e914e-617e-41d0-a1c6-25197c790335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:21.447784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e914e-617e-41d0-a1c6-25197c790335 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:21.448062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e914e-617e-41d0-a1c6-25197c790335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:21.448333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e914e-617e-41d0-a1c6-25197c790335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:21.449538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e914e-617e-41d0-a1c6-25197c790335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:21.461044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e914e-617e-41d0-a1c6-25197c790335 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:21.485449 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1406/2840] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:07:21.490448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04249-eb82-492d-afcc-d9582c713559 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:21.506590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04249-eb82-492d-afcc-d9582c713559 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:21.527389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213a407-8375-46c8-909c-fa2304a513fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:21.530280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a407-8375-46c8-909c-fa2304a513fa admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:21.540781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a407-8375-46c8-909c-fa2304a513fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:21.540781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a407-8375-46c8-909c-fa2304a513fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:21.540781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213a407-8375-46c8-909c-fa2304a513fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:21.564764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213a407-8375-46c8-909c-fa2304a513fa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:21.609148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e914e-617e-41d0-a1c6-25197c790335 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:21.618218 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1435/2841] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:07:21.628541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e914e-617e-41d0-a1c6-25197c790335 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:21.643614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb688b1-dbbe-458a-9a3d-9cd3fa58984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:21.647707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb688b1-dbbe-458a-9a3d-9cd3fa58984e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:21.648172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb688b1-dbbe-458a-9a3d-9cd3fa58984e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:21.648639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb688b1-dbbe-458a-9a3d-9cd3fa58984e admin admin] PATH_INFO: `/v3/projects/e26830af72bd451a97abc960c77b2e84/users/4659517918be43da927a7f465efe0143/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:21.688008 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:21.698115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb688b1-dbbe-458a-9a3d-9cd3fa58984e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26830af72bd451a97abc960c77b2e84, user_id=4659517918be43da927a7f465efe0143, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:21.701639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb688b1-dbbe-458a-9a3d-9cd3fa58984e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:21.736369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74804179-2f91-46ba-b4d8-fb5b74da7157 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:21.736945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74804179-2f91-46ba-b4d8-fb5b74da7157 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:21.737385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74804179-2f91-46ba-b4d8-fb5b74da7157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:21.740823 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1407/2842] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:07:21 2022] PUT /identity/v3/projects/e26830af72bd451a97abc960c77b2e84/users/4659517918be43da927a7f465efe0143/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:21.747757 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:21.781144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-74804179-2f91-46ba-b4d8-fb5b74da7157 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:21.785323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-74804179-2f91-46ba-b4d8-fb5b74da7157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:22.112637 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1436/2843] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:22.177812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb688b1-dbbe-458a-9a3d-9cd3fa58984e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:22.179748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-abb688b1-dbbe-458a-9a3d-9cd3fa58984e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:22.519759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb688b1-dbbe-458a-9a3d-9cd3fa58984e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:22.538954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f3e90-480f-417c-ac0d-9059785f3e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:22.538954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f3e90-480f-417c-ac0d-9059785f3e5e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:22.538954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f3e90-480f-417c-ac0d-9059785f3e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:22.538954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f3e90-480f-417c-ac0d-9059785f3e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:22.607284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f3e90-480f-417c-ac0d-9059785f3e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:22.608740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f3e90-480f-417c-ac0d-9059785f3e5e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:22.679230 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1408/2844] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:07:24.591859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638541b-81c3-42d8-86bb-972be53e418e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:24.593389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638541b-81c3-42d8-86bb-972be53e418e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:24.594360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638541b-81c3-42d8-86bb-972be53e418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:24.643618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4638541b-81c3-42d8-86bb-972be53e418e None None] MFA Rules not processed for user `0c8da9a32cb54d0a87d914234b1e9f40`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:24.645146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4638541b-81c3-42d8-86bb-972be53e418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:24.979424 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1437/2845] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:27.026804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b9f2-358c-4dc0-9b0d-ff20fd9c1b70 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:27.027446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b9f2-358c-4dc0-9b0d-ff20fd9c1b70 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:27.027446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b9f2-358c-4dc0-9b0d-ff20fd9c1b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:27.108636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f638b9f2-358c-4dc0-9b0d-ff20fd9c1b70 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:27.109945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f638b9f2-358c-4dc0-9b0d-ff20fd9c1b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:27.401834 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1409/2846] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:27.409902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638541b-81c3-42d8-86bb-972be53e418e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:27.411615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4638541b-81c3-42d8-86bb-972be53e418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:27.765225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638541b-81c3-42d8-86bb-972be53e418e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:27.806363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902edf0-a524-4ebc-90cd-6bb61ebab427 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:27.807347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902edf0-a524-4ebc-90cd-6bb61ebab427 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:27.809664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902edf0-a524-4ebc-90cd-6bb61ebab427 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:27.810393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902edf0-a524-4ebc-90cd-6bb61ebab427 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:27.840825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902edf0-a524-4ebc-90cd-6bb61ebab427 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:27.843435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902edf0-a524-4ebc-90cd-6bb61ebab427 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:27.882255 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1438/2847] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:07:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:07:34.661500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638b9f2-358c-4dc0-9b0d-ff20fd9c1b70 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:34.677236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638b9f2-358c-4dc0-9b0d-ff20fd9c1b70 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:34.699847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9341829-6424-4b8d-8723-844ee1cb448f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:34.701377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341829-6424-4b8d-8723-844ee1cb448f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:34.702040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341829-6424-4b8d-8723-844ee1cb448f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:34.705357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341829-6424-4b8d-8723-844ee1cb448f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:34.713838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d9341829-6424-4b8d-8723-844ee1cb448f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:34.758260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9341829-6424-4b8d-8723-844ee1cb448f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:34.764270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9341829-6424-4b8d-8723-844ee1cb448f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:34.821241 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1410/2848] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:37.067643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db158148-e445-4a4b-8203-d5b09d8c91f8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:37.069359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db158148-e445-4a4b-8203-d5b09d8c91f8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:37.069638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db158148-e445-4a4b-8203-d5b09d8c91f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:37.130152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-db158148-e445-4a4b-8203-d5b09d8c91f8 None None] MFA Rules not processed for user `0fcaf607c2ef4e64bb227622907dbfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:37.132148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-db158148-e445-4a4b-8203-d5b09d8c91f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:37.201370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9341829-6424-4b8d-8723-844ee1cb448f service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:37.202971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d9341829-6424-4b8d-8723-844ee1cb448f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:37.256353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9341829-6424-4b8d-8723-844ee1cb448f service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:37.262452 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:37.278363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72bcda-2c12-4f89-9d19-41b03d20e244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:37.279049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72bcda-2c12-4f89-9d19-41b03d20e244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:37.279327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72bcda-2c12-4f89-9d19-41b03d20e244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:37.279598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72bcda-2c12-4f89-9d19-41b03d20e244 admin admin] PATH_INFO: `/v3/users/d443cc1d790444b3a78c8038c0e1fa92` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:37.293935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72bcda-2c12-4f89-9d19-41b03d20e244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d443cc1d790444b3a78c8038c0e1fa92)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:37.303103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72bcda-2c12-4f89-9d19-41b03d20e244 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:37.427647 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1439/2849] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:37.553305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db158148-e445-4a4b-8203-d5b09d8c91f8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:37.563803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-db158148-e445-4a4b-8203-d5b09d8c91f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:37.583473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b72bcda-2c12-4f89-9d19-41b03d20e244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd443cc1d790444b3a78c8038c0e1fa92'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:37.586407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b72bcda-2c12-4f89-9d19-41b03d20e244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd443cc1d790444b3a78c8038c0e1fa92'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:37.663199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b72bcda-2c12-4f89-9d19-41b03d20e244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd443cc1d790444b3a78c8038c0e1fa92'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:37.686843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b72bcda-2c12-4f89-9d19-41b03d20e244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd443cc1d790444b3a78c8038c0e1fa92'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:37.687583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b72bcda-2c12-4f89-9d19-41b03d20e244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd443cc1d790444b3a78c8038c0e1fa92'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:37.716864 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:37.777686 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1411/2850] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:07:37 2022] DELETE /identity/v3/users/d443cc1d790444b3a78c8038c0e1fa92 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:37.778876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659f7c4-048b-4c1f-8f68-28aa07f05c1b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:37.815239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659f7c4-048b-4c1f-8f68-28aa07f05c1b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:37.815520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659f7c4-048b-4c1f-8f68-28aa07f05c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:38.002402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4659f7c4-048b-4c1f-8f68-28aa07f05c1b None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:38.003862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4659f7c4-048b-4c1f-8f68-28aa07f05c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:38.090099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db158148-e445-4a4b-8203-d5b09d8c91f8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:38.326330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ff6ba-3bd8-4cd9-87ba-4cde5c4fdb1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:38.329796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ff6ba-3bd8-4cd9-87ba-4cde5c4fdb1e service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:38.331028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ff6ba-3bd8-4cd9-87ba-4cde5c4fdb1e service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:38.331308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ff6ba-3bd8-4cd9-87ba-4cde5c4fdb1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:38.339418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-526ff6ba-3bd8-4cd9-87ba-4cde5c4fdb1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:38.473871 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1412/2851] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:07:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 696 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:38.495678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606fdb5-29f0-424f-adcc-336c84a44d1f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:38.495969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606fdb5-29f0-424f-adcc-336c84a44d1f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:38.496250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606fdb5-29f0-424f-adcc-336c84a44d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:38.576664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9606fdb5-29f0-424f-adcc-336c84a44d1f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:38.582306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ff6ba-3bd8-4cd9-87ba-4cde5c4fdb1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:38.587004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9606fdb5-29f0-424f-adcc-336c84a44d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:38.588668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ff6ba-3bd8-4cd9-87ba-4cde5c4fdb1e service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:38.623368 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1440/2852] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 1073 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:38.624305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ff6ba-3bd8-4cd9-87ba-4cde5c4fdb1e service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:38.627506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-526ff6ba-3bd8-4cd9-87ba-4cde5c4fdb1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:38.640163 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:38.895416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ff6ba-3bd8-4cd9-87ba-4cde5c4fdb1e service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:38.904920 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1413/2853] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:38.915986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606fdb5-29f0-424f-adcc-336c84a44d1f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:38.918439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9606fdb5-29f0-424f-adcc-336c84a44d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:38.927090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee04ab3-b2cc-4611-95a5-24aa463385e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:38.928177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee04ab3-b2cc-4611-95a5-24aa463385e5 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:38.929952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee04ab3-b2cc-4611-95a5-24aa463385e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:38.932479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee04ab3-b2cc-4611-95a5-24aa463385e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:38.959744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee04ab3-b2cc-4611-95a5-24aa463385e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:38.964746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee04ab3-b2cc-4611-95a5-24aa463385e5 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:39.029829 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1441/2854] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:07:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:07:39.142082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e05621-40f6-46e2-b3df-9af76969afa8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:39.143778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e05621-40f6-46e2-b3df-9af76969afa8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:39.143778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e05621-40f6-46e2-b3df-9af76969afa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:39.265701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a2e05621-40f6-46e2-b3df-9af76969afa8 None None] MFA Rules not processed for user `4659517918be43da927a7f465efe0143`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:39.277950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a2e05621-40f6-46e2-b3df-9af76969afa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:39.355244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606fdb5-29f0-424f-adcc-336c84a44d1f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:39.378690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea8adc-3208-4a7c-9d9f-734b149270c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:39.382475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea8adc-3208-4a7c-9d9f-734b149270c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:39.387933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea8adc-3208-4a7c-9d9f-734b149270c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:39.388413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea8adc-3208-4a7c-9d9f-734b149270c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:39.448344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea8adc-3208-4a7c-9d9f-734b149270c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:39.456149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea8adc-3208-4a7c-9d9f-734b149270c5 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:39.519604 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1414/2855] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:07:39.525340 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1442/2856] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:39.539988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bb62b-714a-4c0c-9832-5d4ce03a29d9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:39.540500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bb62b-714a-4c0c-9832-5d4ce03a29d9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:39.540815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bb62b-714a-4c0c-9832-5d4ce03a29d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:39.620541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f26bb62b-714a-4c0c-9832-5d4ce03a29d9 None None] MFA Rules not processed for user `4659517918be43da927a7f465efe0143`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:39.621857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f26bb62b-714a-4c0c-9832-5d4ce03a29d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:39.664659 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1415/2857] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:40.150017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e05621-40f6-46e2-b3df-9af76969afa8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:40.151702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a2e05621-40f6-46e2-b3df-9af76969afa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:40.210564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e05621-40f6-46e2-b3df-9af76969afa8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:40.243539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604acac-1c23-48fe-a717-c2e765211167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:40.244171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604acac-1c23-48fe-a717-c2e765211167 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:40.244455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604acac-1c23-48fe-a717-c2e765211167 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:40.244731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604acac-1c23-48fe-a717-c2e765211167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:40.247783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bb62b-714a-4c0c-9832-5d4ce03a29d9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:40.249488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f26bb62b-714a-4c0c-9832-5d4ce03a29d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:40.286271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bb62b-714a-4c0c-9832-5d4ce03a29d9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:40.298935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604acac-1c23-48fe-a717-c2e765211167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:40.301255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604acac-1c23-48fe-a717-c2e765211167 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:40.301495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041f554-2bde-4bec-b5c2-4896e22120ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:40.302264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041f554-2bde-4bec-b5c2-4896e22120ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:40.302635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041f554-2bde-4bec-b5c2-4896e22120ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:40.303032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041f554-2bde-4bec-b5c2-4896e22120ec admin admin] PATH_INFO: `/v3/projects/9d4c6dec778e43aa9d9169344e11a3ca` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:40.305847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041f554-2bde-4bec-b5c2-4896e22120ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4c6dec778e43aa9d9169344e11a3ca)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:40.308157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041f554-2bde-4bec-b5c2-4896e22120ec admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:40.355658 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1443/2858] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:40.430011 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:40.471386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9041f554-2bde-4bec-b5c2-4896e22120ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4c6dec778e43aa9d9169344e11a3ca', 'request_id': 'req-9041f554-2bde-4bec-b5c2-4896e22120ec'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:40.484514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9041f554-2bde-4bec-b5c2-4896e22120ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4c6dec778e43aa9d9169344e11a3ca', 'request_id': 'req-9041f554-2bde-4bec-b5c2-4896e22120ec'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:40.504914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9041f554-2bde-4bec-b5c2-4896e22120ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4c6dec778e43aa9d9169344e11a3ca', 'request_id': 'req-9041f554-2bde-4bec-b5c2-4896e22120ec'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:40.530394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9041f554-2bde-4bec-b5c2-4896e22120ec admin admin] The token cache is being invalidate because project 9d4c6dec778e43aa9d9169344e11a3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:07:40.532054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9041f554-2bde-4bec-b5c2-4896e22120ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:40.532918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9041f554-2bde-4bec-b5c2-4896e22120ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:40.537503 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1416/2859] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:40 2022] DELETE /identity/v3/projects/9d4c6dec778e43aa9d9169344e11a3ca => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:40.538584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604acac-1c23-48fe-a717-c2e765211167 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:40.570183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604acac-1c23-48fe-a717-c2e765211167 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:40.818269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:40.819252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:40.819723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:40.821107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] PATH_INFO: `/v3/users/e16a8c8afa3642738fd3de616619a626` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:40.823223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16a8c8afa3642738fd3de616619a626)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:40.830214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:40.890754 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:41.056856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16a8c8afa3642738fd3de616619a626'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:41.059958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16a8c8afa3642738fd3de616619a626'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:41.123003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d93aa7-6a20-492b-9a9a-d0f334d45cb3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:41.123653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d93aa7-6a20-492b-9a9a-d0f334d45cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:41.124098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d93aa7-6a20-492b-9a9a-d0f334d45cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:41.127780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16a8c8afa3642738fd3de616619a626'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:41.146696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16a8c8afa3642738fd3de616619a626'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:41.147460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16a8c8afa3642738fd3de616619a626'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:41.173692 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1444/2860] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:07:40 2022] DELETE /identity/v3/users/e16a8c8afa3642738fd3de616619a626 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:41.220094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-44d93aa7-6a20-492b-9a9a-d0f334d45cb3 None None] MFA Rules not processed for user `875dca9ed4914e379601ddbdba035cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:41.221352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-44d93aa7-6a20-492b-9a9a-d0f334d45cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:41.415979 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1417/2861] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:43.011931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:43.020826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:43.297650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64515c5-2b10-40fb-af69-164e6f642982 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:43.310566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f6d1d-c121-4fa7-813f-18519c5a61cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:43.323302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f6d1d-c121-4fa7-813f-18519c5a61cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:43.324044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f6d1d-c121-4fa7-813f-18519c5a61cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:43.324488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f6d1d-c121-4fa7-813f-18519c5a61cf admin admin] PATH_INFO: `/v3/projects/39e912c48da34bac9ba0117b68dd4861` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:43.326005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f6d1d-c121-4fa7-813f-18519c5a61cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e912c48da34bac9ba0117b68dd4861)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:43.330374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f6d1d-c121-4fa7-813f-18519c5a61cf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:43.452490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-125f6d1d-c121-4fa7-813f-18519c5a61cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e912c48da34bac9ba0117b68dd4861', 'request_id': 'req-125f6d1d-c121-4fa7-813f-18519c5a61cf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:43.490787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-125f6d1d-c121-4fa7-813f-18519c5a61cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e912c48da34bac9ba0117b68dd4861', 'request_id': 'req-125f6d1d-c121-4fa7-813f-18519c5a61cf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:43.507985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-125f6d1d-c121-4fa7-813f-18519c5a61cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e912c48da34bac9ba0117b68dd4861', 'request_id': 'req-125f6d1d-c121-4fa7-813f-18519c5a61cf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:43.525470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-125f6d1d-c121-4fa7-813f-18519c5a61cf admin admin] The token cache is being invalidate because project 39e912c48da34bac9ba0117b68dd4861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:07:43.526005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-125f6d1d-c121-4fa7-813f-18519c5a61cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:43.527374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-125f6d1d-c121-4fa7-813f-18519c5a61cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:43.534071 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1445/2862] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:43 2022] DELETE /identity/v3/projects/39e912c48da34bac9ba0117b68dd4861 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:43.535623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e9ea9-4413-4d0d-b0e7-3afe62158ccb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:43.536105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e9ea9-4413-4d0d-b0e7-3afe62158ccb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:43.536210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e9ea9-4413-4d0d-b0e7-3afe62158ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:43.598083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0a2e9ea9-4413-4d0d-b0e7-3afe62158ccb None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:43.603550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0a2e9ea9-4413-4d0d-b0e7-3afe62158ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:43.919319 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1418/2863] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:43.923784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f81c5-4d9b-4544-ab74-57e3d8ad120e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:43.924171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f81c5-4d9b-4544-ab74-57e3d8ad120e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:43.924543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f81c5-4d9b-4544-ab74-57e3d8ad120e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:43.986240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-603f81c5-4d9b-4544-ab74-57e3d8ad120e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:43.987572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-603f81c5-4d9b-4544-ab74-57e3d8ad120e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:44.012469 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1446/2864] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:44.013131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e9ea9-4413-4d0d-b0e7-3afe62158ccb None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:44.041258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e9ea9-4413-4d0d-b0e7-3afe62158ccb None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:44.073488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5591f0-eb3d-48d1-b40b-6db0d8daebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:44.074900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5591f0-eb3d-48d1-b40b-6db0d8daebca admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:44.079750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5591f0-eb3d-48d1-b40b-6db0d8daebca admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:44.080037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5591f0-eb3d-48d1-b40b-6db0d8daebca admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:44.080743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5591f0-eb3d-48d1-b40b-6db0d8daebca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:07:44.081055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5591f0-eb3d-48d1-b40b-6db0d8daebca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:44.082694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5591f0-eb3d-48d1-b40b-6db0d8daebca admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:44.175340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f81c5-4d9b-4544-ab74-57e3d8ad120e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:44.193671 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1419/2865] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:07:44.198542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f81c5-4d9b-4544-ab74-57e3d8ad120e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:44.222411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6710a2-48dd-4940-832d-27a6e06d3ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:44.224254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6710a2-48dd-4940-832d-27a6e06d3ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:44.224550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6710a2-48dd-4940-832d-27a6e06d3ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:44.226114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6710a2-48dd-4940-832d-27a6e06d3ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:44.229067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6710a2-48dd-4940-832d-27a6e06d3ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:44.236293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6710a2-48dd-4940-832d-27a6e06d3ee5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:44.277340 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:44.340328 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1447/2866] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:07:44 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:07:44.345463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5591f0-eb3d-48d1-b40b-6db0d8daebca admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:44.372453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5591f0-eb3d-48d1-b40b-6db0d8daebca admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:44.561656 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:44.607753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd033c-878f-4a59-b9c5-a25c3129e236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:44.608384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd033c-878f-4a59-b9c5-a25c3129e236 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:44.608663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd033c-878f-4a59-b9c5-a25c3129e236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:44.608936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd033c-878f-4a59-b9c5-a25c3129e236 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:44.609669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd033c-878f-4a59-b9c5-a25c3129e236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:44.611722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd033c-878f-4a59-b9c5-a25c3129e236 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:44.681304 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1420/2867] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:07:44 2022] POST /identity/v3/users => generated 291 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:07:44.682226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6710a2-48dd-4940-832d-27a6e06d3ee5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:44.708744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6710a2-48dd-4940-832d-27a6e06d3ee5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:44.730825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b54fc-db2a-49b3-ae4f-2c8b2fb2e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:44.731543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b54fc-db2a-49b3-ae4f-2c8b2fb2e7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:44.731820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b54fc-db2a-49b3-ae4f-2c8b2fb2e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:44.732091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b54fc-db2a-49b3-ae4f-2c8b2fb2e7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:44.737930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b54fc-db2a-49b3-ae4f-2c8b2fb2e7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:44.739710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b54fc-db2a-49b3-ae4f-2c8b2fb2e7cd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:44.789527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd033c-878f-4a59-b9c5-a25c3129e236 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:44.803361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd033c-878f-4a59-b9c5-a25c3129e236 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:44.815578 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1448/2868] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:07:44.833756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68163d-3d3b-4d41-ba4b-8943966dc6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:44.834662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68163d-3d3b-4d41-ba4b-8943966dc6de admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:44.835173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68163d-3d3b-4d41-ba4b-8943966dc6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:44.835737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68163d-3d3b-4d41-ba4b-8943966dc6de admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:44.836736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68163d-3d3b-4d41-ba4b-8943966dc6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:44.840533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68163d-3d3b-4d41-ba4b-8943966dc6de admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:44.881036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b54fc-db2a-49b3-ae4f-2c8b2fb2e7cd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:44.896309 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1421/2869] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:07:44.899035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b54fc-db2a-49b3-ae4f-2c8b2fb2e7cd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:44.933637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8b04e-fefd-45e9-8075-3b2c174d2158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:44.934663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b04e-fefd-45e9-8075-3b2c174d2158 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:44.935204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b04e-fefd-45e9-8075-3b2c174d2158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:44.935712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b04e-fefd-45e9-8075-3b2c174d2158 admin admin] PATH_INFO: `/v3/projects/abaf72f7fc7248a388dbfbd2b646dc56/users/2d7df9a6845440bbad5bd7c0a192171b/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:44.987159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8b04e-fefd-45e9-8075-3b2c174d2158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abaf72f7fc7248a388dbfbd2b646dc56, user_id=2d7df9a6845440bbad5bd7c0a192171b, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:44.992788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8b04e-fefd-45e9-8075-3b2c174d2158 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:45.052890 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1449/2870] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:07:44 2022] PUT /identity/v3/projects/abaf72f7fc7248a388dbfbd2b646dc56/users/2d7df9a6845440bbad5bd7c0a192171b/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:07:45.063373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b42c0-6199-419e-8504-ea547d9429a6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:45.063886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b42c0-6199-419e-8504-ea547d9429a6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:45.064267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b42c0-6199-419e-8504-ea547d9429a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:45.149078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-399b42c0-6199-419e-8504-ea547d9429a6 None None] MFA Rules not processed for user `2d7df9a6845440bbad5bd7c0a192171b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:45.150297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-399b42c0-6199-419e-8504-ea547d9429a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:45.360818 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1422/2871] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:45.365465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8b04e-fefd-45e9-8075-3b2c174d2158 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:45.581743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8b04e-fefd-45e9-8075-3b2c174d2158 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:45.598516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e317a-097c-434b-9a14-bf23ef266f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:45.599712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e317a-097c-434b-9a14-bf23ef266f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:45.600283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e317a-097c-434b-9a14-bf23ef266f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:45.600796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e317a-097c-434b-9a14-bf23ef266f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:45.601774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e317a-097c-434b-9a14-bf23ef266f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:45.605105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e317a-097c-434b-9a14-bf23ef266f59 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:45.685129 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1450/2872] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:07:45 2022] POST /identity/v3/projects => generated 381 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:07:45.686823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b42c0-6199-419e-8504-ea547d9429a6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:45.712835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b42c0-6199-419e-8504-ea547d9429a6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:45.816080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec346d48-3d8d-4414-b36e-1b889eec7233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:45.816769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec346d48-3d8d-4414-b36e-1b889eec7233 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:45.817047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec346d48-3d8d-4414-b36e-1b889eec7233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:45.817319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec346d48-3d8d-4414-b36e-1b889eec7233 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:45.818007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec346d48-3d8d-4414-b36e-1b889eec7233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:45.820390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec346d48-3d8d-4414-b36e-1b889eec7233 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:45.881228 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1423/2873] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:07:45 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:07:45.887010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e317a-097c-434b-9a14-bf23ef266f59 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:45.964657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e317a-097c-434b-9a14-bf23ef266f59 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:45.992951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a1ff5-db8f-4398-9366-e7a3ea4bfbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:45.993965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a1ff5-db8f-4398-9366-e7a3ea4bfbab admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:45.995789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a1ff5-db8f-4398-9366-e7a3ea4bfbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:45.996594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a1ff5-db8f-4398-9366-e7a3ea4bfbab admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:45.998748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a1ff5-db8f-4398-9366-e7a3ea4bfbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:46.001181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a1ff5-db8f-4398-9366-e7a3ea4bfbab admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:46.017497 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1451/2874] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:07:46.021404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec346d48-3d8d-4414-b36e-1b889eec7233 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:46.034495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec346d48-3d8d-4414-b36e-1b889eec7233 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:46.075085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123da88-db93-497b-b9eb-efc9f94c8ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:46.084020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123da88-db93-497b-b9eb-efc9f94c8ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:46.086015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123da88-db93-497b-b9eb-efc9f94c8ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:46.087607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123da88-db93-497b-b9eb-efc9f94c8ec0 admin admin] PATH_INFO: `/v3/projects/24362bc2011d4ef09104a7375df177e7/users/3daa6ccee90c41b9993e90458cecf35d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:46.200644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123da88-db93-497b-b9eb-efc9f94c8ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24362bc2011d4ef09104a7375df177e7, user_id=3daa6ccee90c41b9993e90458cecf35d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:46.209402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123da88-db93-497b-b9eb-efc9f94c8ec0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:46.240040 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1424/2875] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:07:46 2022] PUT /identity/v3/projects/24362bc2011d4ef09104a7375df177e7/users/3daa6ccee90c41b9993e90458cecf35d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:46.245805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a1ff5-db8f-4398-9366-e7a3ea4bfbab admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:46.261651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a1ff5-db8f-4398-9366-e7a3ea4bfbab admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:46.514303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa81b28-4cdd-494b-865a-614caa0b8c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:46.519164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa81b28-4cdd-494b-865a-614caa0b8c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:46.523149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa81b28-4cdd-494b-865a-614caa0b8c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:46.523744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa81b28-4cdd-494b-865a-614caa0b8c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:46.525981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa81b28-4cdd-494b-865a-614caa0b8c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:46.527973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa81b28-4cdd-494b-865a-614caa0b8c30 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:46.561879 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1452/2876] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:07:46.563844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123da88-db93-497b-b9eb-efc9f94c8ec0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:46.583837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123da88-db93-497b-b9eb-efc9f94c8ec0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:46.610658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520938a-31d2-48e7-aa47-cc17181afc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:46.612700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520938a-31d2-48e7-aa47-cc17181afc72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:46.613550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520938a-31d2-48e7-aa47-cc17181afc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:46.614238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520938a-31d2-48e7-aa47-cc17181afc72 admin admin] PATH_INFO: `/v3/projects/24362bc2011d4ef09104a7375df177e7/users/3daa6ccee90c41b9993e90458cecf35d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:46.619990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520938a-31d2-48e7-aa47-cc17181afc72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24362bc2011d4ef09104a7375df177e7, user_id=3daa6ccee90c41b9993e90458cecf35d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:46.627396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520938a-31d2-48e7-aa47-cc17181afc72 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:46.703393 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1425/2877] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:07:46 2022] PUT /identity/v3/projects/24362bc2011d4ef09104a7375df177e7/users/3daa6ccee90c41b9993e90458cecf35d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:07:46.720927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beab3f-2cec-4099-af59-808ebbe0350f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:46.721783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beab3f-2cec-4099-af59-808ebbe0350f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:46.722350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beab3f-2cec-4099-af59-808ebbe0350f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:46.806646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-59beab3f-2cec-4099-af59-808ebbe0350f None None] MFA Rules not processed for user `3daa6ccee90c41b9993e90458cecf35d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:46.808106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-59beab3f-2cec-4099-af59-808ebbe0350f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:46.851426 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:47.047543 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1453/2878] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:47.047798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9cb33-1eb6-4023-bde6-525e9f76b412 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:47.047938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9cb33-1eb6-4023-bde6-525e9f76b412 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:47.048397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9cb33-1eb6-4023-bde6-525e9f76b412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:47.147144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-84f9cb33-1eb6-4023-bde6-525e9f76b412 None None] MFA Rules not processed for user `2d7df9a6845440bbad5bd7c0a192171b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:47.148597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-84f9cb33-1eb6-4023-bde6-525e9f76b412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:47.172816 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:47.335028 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1426/2879] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:07:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:47.753971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beab3f-2cec-4099-af59-808ebbe0350f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:47.755539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-59beab3f-2cec-4099-af59-808ebbe0350f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:48.037473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beab3f-2cec-4099-af59-808ebbe0350f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:48.067761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d0be1-cb93-4ab1-91ee-c8152da64012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:48.068443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d0be1-cb93-4ab1-91ee-c8152da64012 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:48.068673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d0be1-cb93-4ab1-91ee-c8152da64012 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:48.068945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d0be1-cb93-4ab1-91ee-c8152da64012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:48.097022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d0be1-cb93-4ab1-91ee-c8152da64012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:48.098544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d0be1-cb93-4ab1-91ee-c8152da64012 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:48.123621 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1454/2880] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:54.818894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9cb33-1eb6-4023-bde6-525e9f76b412 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:54.823292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-84f9cb33-1eb6-4023-bde6-525e9f76b412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:54.971881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9cb33-1eb6-4023-bde6-525e9f76b412 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:54.976444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a70e0-fb7a-4c7d-8c62-7c1b985b33fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:54.977338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a70e0-fb7a-4c7d-8c62-7c1b985b33fe service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:54.977863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a70e0-fb7a-4c7d-8c62-7c1b985b33fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:54.978387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a70e0-fb7a-4c7d-8c62-7c1b985b33fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:54.980534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-743a70e0-fb7a-4c7d-8c62-7c1b985b33fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:55.001028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a70e0-fb7a-4c7d-8c62-7c1b985b33fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:55.002830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a70e0-fb7a-4c7d-8c62-7c1b985b33fe service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:55.014134 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1427/2881] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:58.118067 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=57 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:58.617834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d0be1-cb93-4ab1-91ee-c8152da64012 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:58.619184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f20d0be1-cb93-4ab1-91ee-c8152da64012 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:59.049108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d0be1-cb93-4ab1-91ee-c8152da64012 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:59.066813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:59.067494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:59.067773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:59.068042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] PATH_INFO: `/v3/users/0fcaf607c2ef4e64bb227622907dbfc5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:59.080274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fcaf607c2ef4e64bb227622907dbfc5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:59.082239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:59.226469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fcaf607c2ef4e64bb227622907dbfc5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.227943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fcaf607c2ef4e64bb227622907dbfc5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.261272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fcaf607c2ef4e64bb227622907dbfc5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.277990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fcaf607c2ef4e64bb227622907dbfc5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.279412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fcaf607c2ef4e64bb227622907dbfc5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:07:59.318292 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1455/2882] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:07:58 2022] DELETE /identity/v3/users/0fcaf607c2ef4e64bb227622907dbfc5 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:00.659661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a70e0-fb7a-4c7d-8c62-7c1b985b33fe service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:00.695310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a70e0-fb7a-4c7d-8c62-7c1b985b33fe service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:00.799742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8118fc-89c3-4889-96d2-df8b00c92922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:00.800751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8118fc-89c3-4889-96d2-df8b00c92922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:00.802511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8118fc-89c3-4889-96d2-df8b00c92922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:00.802847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8118fc-89c3-4889-96d2-df8b00c92922 admin admin] PATH_INFO: `/v3/projects/7777fe2afdda4571bf43cee54828d89a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:00.809591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8118fc-89c3-4889-96d2-df8b00c92922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7777fe2afdda4571bf43cee54828d89a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:00.812606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8118fc-89c3-4889-96d2-df8b00c92922 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:00.901864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c8118fc-89c3-4889-96d2-df8b00c92922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7777fe2afdda4571bf43cee54828d89a', 'request_id': 'req-1c8118fc-89c3-4889-96d2-df8b00c92922'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:00.912400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c8118fc-89c3-4889-96d2-df8b00c92922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7777fe2afdda4571bf43cee54828d89a', 'request_id': 'req-1c8118fc-89c3-4889-96d2-df8b00c92922'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:00.942179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c8118fc-89c3-4889-96d2-df8b00c92922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7777fe2afdda4571bf43cee54828d89a', 'request_id': 'req-1c8118fc-89c3-4889-96d2-df8b00c92922'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:00.944386 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:00.971896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:00.973355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:00.996371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c8118fc-89c3-4889-96d2-df8b00c92922 admin admin] The token cache is being invalidate because project 7777fe2afdda4571bf43cee54828d89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:08:00.997591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c8118fc-89c3-4889-96d2-df8b00c92922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:01.000423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c8118fc-89c3-4889-96d2-df8b00c92922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:01.004264 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1428/2883] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:08:00 2022] DELETE /identity/v3/projects/7777fe2afdda4571bf43cee54828d89a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:01.012401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab52b-9bb3-4f4a-9de3-7339269790c2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:01.012688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab52b-9bb3-4f4a-9de3-7339269790c2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:01.012965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab52b-9bb3-4f4a-9de3-7339269790c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:01.094318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-927ab52b-9bb3-4f4a-9de3-7339269790c2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:01.095613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-927ab52b-9bb3-4f4a-9de3-7339269790c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:01.124239 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:01.206117 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1429/2884] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:08:01.214381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554fcf7-440a-471c-ad46-8d7172e12ce1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:01.215870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554fcf7-440a-471c-ad46-8d7172e12ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:01.216297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554fcf7-440a-471c-ad46-8d7172e12ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:01.243568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d744e-fcfa-4cba-9561-d6c8f7929ade admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:01.263637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9554fcf7-440a-471c-ad46-8d7172e12ce1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:01.265012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9554fcf7-440a-471c-ad46-8d7172e12ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:01.283381 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1430/2885] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:01.287393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554fcf7-440a-471c-ad46-8d7172e12ce1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:01.315069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554fcf7-440a-471c-ad46-8d7172e12ce1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:01.336901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5681a-8bde-46ba-9591-68df1cefc597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:01.337951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5681a-8bde-46ba-9591-68df1cefc597 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:01.340076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5681a-8bde-46ba-9591-68df1cefc597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:01.341545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5681a-8bde-46ba-9591-68df1cefc597 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:01.343432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5681a-8bde-46ba-9591-68df1cefc597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:08:01.345115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5681a-8bde-46ba-9591-68df1cefc597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:01.347120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5681a-8bde-46ba-9591-68df1cefc597 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:01.378212 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1431/2886] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:08:01.382803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5681a-8bde-46ba-9591-68df1cefc597 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:01.394535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7caf4-09f1-46cd-bea3-a8cc6b642035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:01.395201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7caf4-09f1-46cd-bea3-a8cc6b642035 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:01.395486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7caf4-09f1-46cd-bea3-a8cc6b642035 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:01.395912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7caf4-09f1-46cd-bea3-a8cc6b642035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:01.397732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ead7caf4-09f1-46cd-bea3-a8cc6b642035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:01.402804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5681a-8bde-46ba-9591-68df1cefc597 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:01.418330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1f910-86e1-44ee-8cc3-f281124e36ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:01.419146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1f910-86e1-44ee-8cc3-f281124e36ff admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:01.419529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1f910-86e1-44ee-8cc3-f281124e36ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:01.419902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1f910-86e1-44ee-8cc3-f281124e36ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:01.420700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1f910-86e1-44ee-8cc3-f281124e36ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:01.422773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1f910-86e1-44ee-8cc3-f281124e36ff admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:01.479977 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1432/2887] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:08:01 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:08:01.483871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1f910-86e1-44ee-8cc3-f281124e36ff admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:01.553936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7caf4-09f1-46cd-bea3-a8cc6b642035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:01.555752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7caf4-09f1-46cd-bea3-a8cc6b642035 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:01.570067 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1456/2888] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:08:01.628224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1f910-86e1-44ee-8cc3-f281124e36ff admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:01.644103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf54e3b-96aa-458b-b051-0cf27aa954be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:01.644893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf54e3b-96aa-458b-b051-0cf27aa954be admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:01.645358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf54e3b-96aa-458b-b051-0cf27aa954be admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:01.645735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf54e3b-96aa-458b-b051-0cf27aa954be admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:01.646484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf54e3b-96aa-458b-b051-0cf27aa954be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:01.648632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf54e3b-96aa-458b-b051-0cf27aa954be admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:01.691290 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1433/2889] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:08:01 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:08:01.695373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7caf4-09f1-46cd-bea3-a8cc6b642035 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:01.712375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7caf4-09f1-46cd-bea3-a8cc6b642035 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:01.725650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76698aaf-0e28-4723-a994-1e5d72179489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:01.727676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76698aaf-0e28-4723-a994-1e5d72179489 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:01.728862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76698aaf-0e28-4723-a994-1e5d72179489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:01.729338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76698aaf-0e28-4723-a994-1e5d72179489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:01.730942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76698aaf-0e28-4723-a994-1e5d72179489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:01.737416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76698aaf-0e28-4723-a994-1e5d72179489 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:01.789331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf54e3b-96aa-458b-b051-0cf27aa954be admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:01.789806 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1457/2890] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:08:01.806969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf54e3b-96aa-458b-b051-0cf27aa954be admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:01.824704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb18cc1-7939-4634-aedc-a17930b92aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:01.825843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb18cc1-7939-4634-aedc-a17930b92aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:01.826011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb18cc1-7939-4634-aedc-a17930b92aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:01.826286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb18cc1-7939-4634-aedc-a17930b92aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:01.826953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb18cc1-7939-4634-aedc-a17930b92aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:01.828607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb18cc1-7939-4634-aedc-a17930b92aa7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:01.866750 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1434/2891] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:08:01.870746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76698aaf-0e28-4723-a994-1e5d72179489 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:01.897415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76698aaf-0e28-4723-a994-1e5d72179489 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:01.909691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786f426-aec1-41f7-a4e3-aa8e03f17dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:01.910372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f426-aec1-41f7-a4e3-aa8e03f17dff admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:01.910650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f426-aec1-41f7-a4e3-aa8e03f17dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:01.910940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f426-aec1-41f7-a4e3-aa8e03f17dff admin admin] PATH_INFO: `/v3/projects/011a6b8a86274f2db2cf1c66338790b2/users/040056f7aa7e4630813628aa516e3842/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:01.953429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786f426-aec1-41f7-a4e3-aa8e03f17dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=011a6b8a86274f2db2cf1c66338790b2, user_id=040056f7aa7e4630813628aa516e3842, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:01.956349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786f426-aec1-41f7-a4e3-aa8e03f17dff admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:01.995787 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1458/2892] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:08:01 2022] PUT /identity/v3/projects/011a6b8a86274f2db2cf1c66338790b2/users/040056f7aa7e4630813628aa516e3842/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:02.006972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdd33d-cb64-44af-8474-da8e14d8ef98 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:02.007812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdd33d-cb64-44af-8474-da8e14d8ef98 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:02.008098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdd33d-cb64-44af-8474-da8e14d8ef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:02.051449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-36fdd33d-cb64-44af-8474-da8e14d8ef98 None None] MFA Rules not processed for user `040056f7aa7e4630813628aa516e3842`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:02.053060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-36fdd33d-cb64-44af-8474-da8e14d8ef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:02.059538 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:02.198346 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1435/2893] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:02.209597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47f1b4-eef3-4b14-8168-56d302a8a485 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:02.210055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47f1b4-eef3-4b14-8168-56d302a8a485 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:02.210436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47f1b4-eef3-4b14-8168-56d302a8a485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:02.235786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7e47f1b4-eef3-4b14-8168-56d302a8a485 None None] MFA Rules not processed for user `040056f7aa7e4630813628aa516e3842`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:02.237104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7e47f1b4-eef3-4b14-8168-56d302a8a485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:02.246962 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1459/2894] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:02.319373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdd33d-cb64-44af-8474-da8e14d8ef98 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:02.321406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-36fdd33d-cb64-44af-8474-da8e14d8ef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:02.478305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdd33d-cb64-44af-8474-da8e14d8ef98 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:02.491140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a34ee-c910-4ced-8d25-b78c748c36bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:02.491837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a34ee-c910-4ced-8d25-b78c748c36bd service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:02.492516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a34ee-c910-4ced-8d25-b78c748c36bd service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:02.493182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a34ee-c910-4ced-8d25-b78c748c36bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:02.507719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a34ee-c910-4ced-8d25-b78c748c36bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:02.510452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a34ee-c910-4ced-8d25-b78c748c36bd service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:02.528811 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1436/2895] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:03.125625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b1873-112c-45dc-8146-7f9b5eb062dd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:03.126748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b1873-112c-45dc-8146-7f9b5eb062dd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:03.127266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b1873-112c-45dc-8146-7f9b5eb062dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:03.180417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-db0b1873-112c-45dc-8146-7f9b5eb062dd None None] MFA Rules not processed for user `040056f7aa7e4630813628aa516e3842`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:03.184605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-db0b1873-112c-45dc-8146-7f9b5eb062dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:03.215051 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1460/2896] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:05.046226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b62fbb-d256-4fd1-80c6-e8d44ef9233b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:05.046959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b62fbb-d256-4fd1-80c6-e8d44ef9233b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:05.046959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b62fbb-d256-4fd1-80c6-e8d44ef9233b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:05.089963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-54b62fbb-d256-4fd1-80c6-e8d44ef9233b None None] MFA Rules not processed for user `a745e8bb56574606b709907e661b9cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:05.091480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-54b62fbb-d256-4fd1-80c6-e8d44ef9233b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:05.245966 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1437/2897] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:09.191459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b1873-112c-45dc-8146-7f9b5eb062dd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:09.194745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-db0b1873-112c-45dc-8146-7f9b5eb062dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:09.220978 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:09.319782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b1873-112c-45dc-8146-7f9b5eb062dd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:09.325100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a16fe-9a41-4607-afe8-0662ec7f96a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:09.325885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a16fe-9a41-4607-afe8-0662ec7f96a0 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:09.326166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a16fe-9a41-4607-afe8-0662ec7f96a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:09.326436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a16fe-9a41-4607-afe8-0662ec7f96a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:09.328368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e41a16fe-9a41-4607-afe8-0662ec7f96a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:09.341881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a16fe-9a41-4607-afe8-0662ec7f96a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:09.344937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a16fe-9a41-4607-afe8-0662ec7f96a0 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:09.359897 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1461/2898] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:09.535639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b62fbb-d256-4fd1-80c6-e8d44ef9233b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:09.537063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-54b62fbb-d256-4fd1-80c6-e8d44ef9233b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:09.584923 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:09.606975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b62fbb-d256-4fd1-80c6-e8d44ef9233b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:09.611398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003c413-9300-48b3-87d8-88b295ac573a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:09.612005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c413-9300-48b3-87d8-88b295ac573a service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:09.612282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c413-9300-48b3-87d8-88b295ac573a service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:09.612579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c413-9300-48b3-87d8-88b295ac573a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:09.614289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f003c413-9300-48b3-87d8-88b295ac573a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:09.678806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003c413-9300-48b3-87d8-88b295ac573a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:09.681132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003c413-9300-48b3-87d8-88b295ac573a service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:09.695162 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1438/2899] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:09.948095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a16fe-9a41-4607-afe8-0662ec7f96a0 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:09.950187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e41a16fe-9a41-4607-afe8-0662ec7f96a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:10.000687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a16fe-9a41-4607-afe8-0662ec7f96a0 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:10.013380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e88246-89d6-49cb-aa23-d0bb572795e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:10.013998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e88246-89d6-49cb-aa23-d0bb572795e6 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:10.014281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e88246-89d6-49cb-aa23-d0bb572795e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:10.014552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e88246-89d6-49cb-aa23-d0bb572795e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:10.017079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f4e88246-89d6-49cb-aa23-d0bb572795e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:10.096234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e88246-89d6-49cb-aa23-d0bb572795e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:10.098316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e88246-89d6-49cb-aa23-d0bb572795e6 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:10.116660 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1462/2900] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:10.853066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221d30d-ccfa-42ad-ba66-d860a756c785 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:10.853609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221d30d-ccfa-42ad-ba66-d860a756c785 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:10.853733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221d30d-ccfa-42ad-ba66-d860a756c785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:10.873429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1221d30d-ccfa-42ad-ba66-d860a756c785 None None] MFA Rules not processed for user `2d7df9a6845440bbad5bd7c0a192171b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:10.874655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1221d30d-ccfa-42ad-ba66-d860a756c785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:10.956877 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1439/2901] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:11.846845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5943eb5-81ee-4ed0-8ca2-e1a67fc5c7f0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:11.847868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5943eb5-81ee-4ed0-8ca2-e1a67fc5c7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:11.848358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5943eb5-81ee-4ed0-8ca2-e1a67fc5c7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:11.929103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f5943eb5-81ee-4ed0-8ca2-e1a67fc5c7f0 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:11.934005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f5943eb5-81ee-4ed0-8ca2-e1a67fc5c7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:12.080900 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1463/2902] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:08:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:12.095939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221d30d-ccfa-42ad-ba66-d860a756c785 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:12.097512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1221d30d-ccfa-42ad-ba66-d860a756c785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:12.268727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221d30d-ccfa-42ad-ba66-d860a756c785 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:12.276248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893130f-373d-439e-8171-9e80838b1218 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:12.277705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893130f-373d-439e-8171-9e80838b1218 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:12.292446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893130f-373d-439e-8171-9e80838b1218 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:12.293067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893130f-373d-439e-8171-9e80838b1218 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:12.313460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893130f-373d-439e-8171-9e80838b1218 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:12.315797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893130f-373d-439e-8171-9e80838b1218 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:12.353845 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1440/2903] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:08:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:08:13.569390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa027f-9621-4ee2-8fc4-861372269daa None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:13.570300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa027f-9621-4ee2-8fc4-861372269daa None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:13.570927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa027f-9621-4ee2-8fc4-861372269daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:13.643644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-adfa027f-9621-4ee2-8fc4-861372269daa None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:13.647725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-adfa027f-9621-4ee2-8fc4-861372269daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:13.678078 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1464/2904] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:08:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:13.714308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893130f-373d-439e-8171-9e80838b1218 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:13.732335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893130f-373d-439e-8171-9e80838b1218 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:13.745458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fea5d-0ebf-4850-9549-735db08d5384 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:13.746560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fea5d-0ebf-4850-9549-735db08d5384 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:13.747203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fea5d-0ebf-4850-9549-735db08d5384 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:13.747775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fea5d-0ebf-4850-9549-735db08d5384 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:13.774113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fea5d-0ebf-4850-9549-735db08d5384 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:13.780600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fea5d-0ebf-4850-9549-735db08d5384 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:13.795468 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1441/2905] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:08:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:08:23.604589 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:23.792159 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:31.973201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c92f2-89b5-41ba-8ff7-7a0828a23985 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:31.973201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c92f2-89b5-41ba-8ff7-7a0828a23985 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:31.973201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c92f2-89b5-41ba-8ff7-7a0828a23985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:32.043569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-703c92f2-89b5-41ba-8ff7-7a0828a23985 None None] MFA Rules not processed for user `875dca9ed4914e379601ddbdba035cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:32.045015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-703c92f2-89b5-41ba-8ff7-7a0828a23985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:32.176260 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1465/2906] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:32.282489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fea5d-0ebf-4850-9549-735db08d5384 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:32.283950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-897fea5d-0ebf-4850-9549-735db08d5384 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:32.444166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fea5d-0ebf-4850-9549-735db08d5384 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:32.457843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bb51c-5145-4b63-af89-8e658b71c9fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:32.459196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bb51c-5145-4b63-af89-8e658b71c9fa service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:32.459479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bb51c-5145-4b63-af89-8e658b71c9fa service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:32.459752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bb51c-5145-4b63-af89-8e658b71c9fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:32.470467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4f8bb51c-5145-4b63-af89-8e658b71c9fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:32.482480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c92f2-89b5-41ba-8ff7-7a0828a23985 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:32.496144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8bb51c-5145-4b63-af89-8e658b71c9fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:32.497602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8bb51c-5145-4b63-af89-8e658b71c9fa service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:32.508191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c92f2-89b5-41ba-8ff7-7a0828a23985 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:32.521973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a94b7-a7c7-4bfc-8e48-550d7519f275 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:32.522899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a94b7-a7c7-4bfc-8e48-550d7519f275 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:32.523316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a94b7-a7c7-4bfc-8e48-550d7519f275 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:32.525599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a94b7-a7c7-4bfc-8e48-550d7519f275 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:32.527910 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1442/2907] 10.222.0.39 () {60 vars in 1396 bytes} [Sun Oct 16 01:08:32 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:32.536525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e39a94b7-a7c7-4bfc-8e48-550d7519f275 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:32.565994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a94b7-a7c7-4bfc-8e48-550d7519f275 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:32.567951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a94b7-a7c7-4bfc-8e48-550d7519f275 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:32.594137 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1466/2908] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:08:32.733332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bb51c-5145-4b63-af89-8e658b71c9fa service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:32.735435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4f8bb51c-5145-4b63-af89-8e658b71c9fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:32.880660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bb51c-5145-4b63-af89-8e658b71c9fa service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:32.907533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:32.908010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:32.908290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:32.908564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] PATH_INFO: `/v3/users/5f46ddd0268d44bfacff0400e3f38e7e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:32.925706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f46ddd0268d44bfacff0400e3f38e7e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:32.932773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:33.112046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f46ddd0268d44bfacff0400e3f38e7e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:33.112899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f46ddd0268d44bfacff0400e3f38e7e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:33.139749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f46ddd0268d44bfacff0400e3f38e7e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:33.170087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f46ddd0268d44bfacff0400e3f38e7e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:33.171021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f46ddd0268d44bfacff0400e3f38e7e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:33.206967 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1443/2909] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:08:32 2022] DELETE /identity/v3/users/5f46ddd0268d44bfacff0400e3f38e7e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:35.065041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a94b7-a7c7-4bfc-8e48-550d7519f275 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:35.085203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a94b7-a7c7-4bfc-8e48-550d7519f275 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:35.327148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:35.329786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:35.330399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:35.331461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] PATH_INFO: `/v3/projects/e9173928e9c94d31b8d2eca240e28d50` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:35.334183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9173928e9c94d31b8d2eca240e28d50)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:35.337535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:35.494181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9173928e9c94d31b8d2eca240e28d50', 'request_id': 'req-b6aeb679-2232-4344-97e2-062e284851d2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:35.514614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9173928e9c94d31b8d2eca240e28d50', 'request_id': 'req-b6aeb679-2232-4344-97e2-062e284851d2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:35.532302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9173928e9c94d31b8d2eca240e28d50', 'request_id': 'req-b6aeb679-2232-4344-97e2-062e284851d2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:35.548882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] The token cache is being invalidate because project e9173928e9c94d31b8d2eca240e28d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:08:35.549257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:35.549875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:35.552043 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1467/2910] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:08:35 2022] DELETE /identity/v3/projects/e9173928e9c94d31b8d2eca240e28d50 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:35.557571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:35.566292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:35.583976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff7852-e2dd-4a74-aa2a-6cd8cec2f518 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:35.652367 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:35.683324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:35.684135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:35.684640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:35.685042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] PATH_INFO: `/v3/users/ea5df25b228648a0aa6c10519e921d40` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:35.686387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5df25b228648a0aa6c10519e921d40)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:35.690509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:35.731384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:35.733232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:35.775041 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:35.777307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5df25b228648a0aa6c10519e921d40'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:35.778259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5df25b228648a0aa6c10519e921d40'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:35.794382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5df25b228648a0aa6c10519e921d40'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:35.805756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5df25b228648a0aa6c10519e921d40'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:35.807224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5df25b228648a0aa6c10519e921d40'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:35.825867 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1444/2911] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:08:35 2022] DELETE /identity/v3/users/ea5df25b228648a0aa6c10519e921d40 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:35.852337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aeb679-2232-4344-97e2-062e284851d2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:35.952025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:35.956673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:35.982143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a9ba0-058a-4b35-9a26-a3f11ea0e7c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:35.982866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9ba0-058a-4b35-9a26-a3f11ea0e7c5 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:35.983239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9ba0-058a-4b35-9a26-a3f11ea0e7c5 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:35.983584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9ba0-058a-4b35-9a26-a3f11ea0e7c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:35.985764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-222a9ba0-058a-4b35-9a26-a3f11ea0e7c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:35.999228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a9ba0-058a-4b35-9a26-a3f11ea0e7c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:36.001029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a9ba0-058a-4b35-9a26-a3f11ea0e7c5 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:36.012818 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1468/2912] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:36.041373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136cb6c-8d4a-4119-9883-563ec87ff592 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:36.047542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcf908-643f-4980-acef-87d7fa8c4b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:36.048431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcf908-643f-4980-acef-87d7fa8c4b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:36.048576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcf908-643f-4980-acef-87d7fa8c4b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:36.049362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcf908-643f-4980-acef-87d7fa8c4b01 admin admin] PATH_INFO: `/v3/users/4659517918be43da927a7f465efe0143` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:36.051380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcf908-643f-4980-acef-87d7fa8c4b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4659517918be43da927a7f465efe0143)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:36.063527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcf908-643f-4980-acef-87d7fa8c4b01 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:36.148091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86fcf908-643f-4980-acef-87d7fa8c4b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4659517918be43da927a7f465efe0143'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.148838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86fcf908-643f-4980-acef-87d7fa8c4b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4659517918be43da927a7f465efe0143'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.191242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86fcf908-643f-4980-acef-87d7fa8c4b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4659517918be43da927a7f465efe0143'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.195480 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:36.204191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86fcf908-643f-4980-acef-87d7fa8c4b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4659517918be43da927a7f465efe0143'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.206416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86fcf908-643f-4980-acef-87d7fa8c4b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4659517918be43da927a7f465efe0143'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.211646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a9ba0-058a-4b35-9a26-a3f11ea0e7c5 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:36.213696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-222a9ba0-058a-4b35-9a26-a3f11ea0e7c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:36.235193 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1445/2913] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:08:35 2022] DELETE /identity/v3/users/4659517918be43da927a7f465efe0143 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:08:36.238229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a9ba0-058a-4b35-9a26-a3f11ea0e7c5 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:36.321717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:36.322433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:36.322780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:36.324175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] PATH_INFO: `/v3/projects/68df95d36de0437291c869f75979ec31` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:36.325416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68df95d36de0437291c869f75979ec31)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:36.327403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:36.405319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68df95d36de0437291c869f75979ec31', 'request_id': 'req-eec4a25b-3f47-4899-805f-e88e2d766d25'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.412552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68df95d36de0437291c869f75979ec31', 'request_id': 'req-eec4a25b-3f47-4899-805f-e88e2d766d25'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.415459 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:36.423895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68df95d36de0437291c869f75979ec31', 'request_id': 'req-eec4a25b-3f47-4899-805f-e88e2d766d25'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.438581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] The token cache is being invalidate because project 68df95d36de0437291c869f75979ec31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:08:36.439420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.439730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.441392 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1469/2914] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:08:36 2022] DELETE /identity/v3/projects/68df95d36de0437291c869f75979ec31 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:36.446156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0dc21-4ea6-41ae-8cc8-ec53701e6ff3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:36.446593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0dc21-4ea6-41ae-8cc8-ec53701e6ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:36.446962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0dc21-4ea6-41ae-8cc8-ec53701e6ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:36.508668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-adf0dc21-4ea6-41ae-8cc8-ec53701e6ff3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:36.510128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-adf0dc21-4ea6-41ae-8cc8-ec53701e6ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:36.584026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:36.586202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:36.586908 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1446/2915] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:36.594512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ebc6c-8970-44aa-ad08-6d30fd7d7df5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:36.594875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ebc6c-8970-44aa-ad08-6d30fd7d7df5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:36.596439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ebc6c-8970-44aa-ad08-6d30fd7d7df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:36.601025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4a25b-3f47-4899-805f-e88e2d766d25 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:36.606344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9160e56-8e12-4e50-b252-f0ee52c35ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:36.607562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9160e56-8e12-4e50-b252-f0ee52c35ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:36.607562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9160e56-8e12-4e50-b252-f0ee52c35ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:36.607811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9160e56-8e12-4e50-b252-f0ee52c35ce9 admin admin] PATH_INFO: `/v3/projects/e26830af72bd451a97abc960c77b2e84` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:36.609090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9160e56-8e12-4e50-b252-f0ee52c35ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26830af72bd451a97abc960c77b2e84)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:36.612887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9160e56-8e12-4e50-b252-f0ee52c35ce9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:36.622313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-061ebc6c-8970-44aa-ad08-6d30fd7d7df5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:36.624134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-061ebc6c-8970-44aa-ad08-6d30fd7d7df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:36.634432 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1447/2916] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:08:36.638432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ebc6c-8970-44aa-ad08-6d30fd7d7df5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:36.650435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ebc6c-8970-44aa-ad08-6d30fd7d7df5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:36.655114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b87de6-374d-4caa-bd84-2d3fc0b6756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:36.655713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b87de6-374d-4caa-bd84-2d3fc0b6756d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:36.656650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b87de6-374d-4caa-bd84-2d3fc0b6756d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:36.657677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b87de6-374d-4caa-bd84-2d3fc0b6756d admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:36.658322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b87de6-374d-4caa-bd84-2d3fc0b6756d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:08:36.658626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b87de6-374d-4caa-bd84-2d3fc0b6756d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:36.660237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b87de6-374d-4caa-bd84-2d3fc0b6756d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:36.673828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9160e56-8e12-4e50-b252-f0ee52c35ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26830af72bd451a97abc960c77b2e84', 'request_id': 'req-e9160e56-8e12-4e50-b252-f0ee52c35ce9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.678758 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1448/2917] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:08:36.680893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9160e56-8e12-4e50-b252-f0ee52c35ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26830af72bd451a97abc960c77b2e84', 'request_id': 'req-e9160e56-8e12-4e50-b252-f0ee52c35ce9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.683459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b87de6-374d-4caa-bd84-2d3fc0b6756d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:36.688744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9160e56-8e12-4e50-b252-f0ee52c35ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26830af72bd451a97abc960c77b2e84', 'request_id': 'req-e9160e56-8e12-4e50-b252-f0ee52c35ce9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.694852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b87de6-374d-4caa-bd84-2d3fc0b6756d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:36.700391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9160e56-8e12-4e50-b252-f0ee52c35ce9 admin admin] The token cache is being invalidate because project e26830af72bd451a97abc960c77b2e84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:08:36.700677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9160e56-8e12-4e50-b252-f0ee52c35ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.701311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9160e56-8e12-4e50-b252-f0ee52c35ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:36.707244 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1470/2918] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:08:36 2022] DELETE /identity/v3/projects/e26830af72bd451a97abc960c77b2e84 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:08:36.709182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b657-5052-42cf-8df0-207094a1a978 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:36.709564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b657-5052-42cf-8df0-207094a1a978 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:36.709939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b657-5052-42cf-8df0-207094a1a978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:36.730908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-47f6b657-5052-42cf-8df0-207094a1a978 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:36.732070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47f6b657-5052-42cf-8df0-207094a1a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:36.761385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e84e8c-a81c-4893-a2f4-e1c15c3b80ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:36.761994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e84e8c-a81c-4893-a2f4-e1c15c3b80ed admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:36.762271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e84e8c-a81c-4893-a2f4-e1c15c3b80ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:36.762541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e84e8c-a81c-4893-a2f4-e1c15c3b80ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:36.763207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e84e8c-a81c-4893-a2f4-e1c15c3b80ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:36.765099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e84e8c-a81c-4893-a2f4-e1c15c3b80ed admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:36.793284 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1449/2919] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:08:36 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:08:36.794454 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1471/2920] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:36.800749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e84e8c-a81c-4893-a2f4-e1c15c3b80ed admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:36.802581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-63e84e8c-a81c-4893-a2f4-e1c15c3b80ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:36.804516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d11535-eb19-4cb9-bf2b-90ef3361e3d4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:36.804802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d11535-eb19-4cb9-bf2b-90ef3361e3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:36.805072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d11535-eb19-4cb9-bf2b-90ef3361e3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:36.826017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e0d11535-eb19-4cb9-bf2b-90ef3361e3d4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:36.827323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e0d11535-eb19-4cb9-bf2b-90ef3361e3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:36.837289 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:36.918728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e84e8c-a81c-4893-a2f4-e1c15c3b80ed admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:36.928089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e73cb-fcdd-4c89-9307-e80f6f2e0821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:36.929106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e73cb-fcdd-4c89-9307-e80f6f2e0821 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:36.929702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e73cb-fcdd-4c89-9307-e80f6f2e0821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:36.930122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e73cb-fcdd-4c89-9307-e80f6f2e0821 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:36.930949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e73cb-fcdd-4c89-9307-e80f6f2e0821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:36.933149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e73cb-fcdd-4c89-9307-e80f6f2e0821 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:36.957354 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1472/2921] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:36.959801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d11535-eb19-4cb9-bf2b-90ef3361e3d4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:36.976610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d11535-eb19-4cb9-bf2b-90ef3361e3d4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:36.977266 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1450/2922] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:08:36 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:08:36.981408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e73cb-fcdd-4c89-9307-e80f6f2e0821 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:36.997435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69344b-6713-4a28-952b-cfc7177fcf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:36.998081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69344b-6713-4a28-952b-cfc7177fcf68 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:36.998371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69344b-6713-4a28-952b-cfc7177fcf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:36.998906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69344b-6713-4a28-952b-cfc7177fcf68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:36.999321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69344b-6713-4a28-952b-cfc7177fcf68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:08:37.000142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69344b-6713-4a28-952b-cfc7177fcf68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:37.001811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69344b-6713-4a28-952b-cfc7177fcf68 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:37.004561 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:37.013144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e73cb-fcdd-4c89-9307-e80f6f2e0821 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:37.023021 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1473/2923] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:08:37.023301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4bc45-996d-47e6-9544-92dc504d2dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:37.023301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4bc45-996d-47e6-9544-92dc504d2dce admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:37.023301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4bc45-996d-47e6-9544-92dc504d2dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:37.023301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4bc45-996d-47e6-9544-92dc504d2dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:37.023753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4bc45-996d-47e6-9544-92dc504d2dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:37.025151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4bc45-996d-47e6-9544-92dc504d2dce admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:37.026146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69344b-6713-4a28-952b-cfc7177fcf68 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:37.038181 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1451/2924] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:08:37.040214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69344b-6713-4a28-952b-cfc7177fcf68 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:37.042082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4bc45-996d-47e6-9544-92dc504d2dce admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:37.045139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9b432-0703-4e54-91a9-b32558dbd64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:37.045858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9b432-0703-4e54-91a9-b32558dbd64c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:37.046233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9b432-0703-4e54-91a9-b32558dbd64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:37.046968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9b432-0703-4e54-91a9-b32558dbd64c admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:37.047956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9b432-0703-4e54-91a9-b32558dbd64c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:37.049975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9b432-0703-4e54-91a9-b32558dbd64c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:37.087525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4bc45-996d-47e6-9544-92dc504d2dce admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:37.089822 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1474/2925] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:08:37 2022] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:08:37.094773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9b432-0703-4e54-91a9-b32558dbd64c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:37.225032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727d168-3194-4e29-9627-33366398bad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:37.225650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d168-3194-4e29-9627-33366398bad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:37.226046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d168-3194-4e29-9627-33366398bad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:37.226331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d168-3194-4e29-9627-33366398bad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:37.227364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727d168-3194-4e29-9627-33366398bad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:37.228982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727d168-3194-4e29-9627-33366398bad1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:37.245478 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1452/2926] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:08:37.251755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727d168-3194-4e29-9627-33366398bad1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:37.261413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9b432-0703-4e54-91a9-b32558dbd64c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:37.268222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd1312-ba44-46d7-a383-7ecaa7975d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:37.268839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd1312-ba44-46d7-a383-7ecaa7975d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:37.269278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd1312-ba44-46d7-a383-7ecaa7975d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:37.269555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd1312-ba44-46d7-a383-7ecaa7975d36 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:37.270190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd1312-ba44-46d7-a383-7ecaa7975d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:37.272472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd1312-ba44-46d7-a383-7ecaa7975d36 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:37.278739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727d168-3194-4e29-9627-33366398bad1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:37.290227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e05f02-c040-4b1f-8aac-64b8398c47a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:37.291148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e05f02-c040-4b1f-8aac-64b8398c47a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:37.291531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e05f02-c040-4b1f-8aac-64b8398c47a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:37.292575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e05f02-c040-4b1f-8aac-64b8398c47a6 admin admin] PATH_INFO: `/v3/projects/9b63ec6e0e3c4f268e63ae8da2ffe884/users/d0caedd0bc41435c9426ee622b9d2113/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:37.304784 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1475/2927] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:08:37 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:08:37.309424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd1312-ba44-46d7-a383-7ecaa7975d36 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:37.334101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e05f02-c040-4b1f-8aac-64b8398c47a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b63ec6e0e3c4f268e63ae8da2ffe884, user_id=d0caedd0bc41435c9426ee622b9d2113, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:37.338568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd1312-ba44-46d7-a383-7ecaa7975d36 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:37.340577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e05f02-c040-4b1f-8aac-64b8398c47a6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:37.350216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd770195-3d6f-44c8-acc4-2140a11bc27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:37.351018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd770195-3d6f-44c8-acc4-2140a11bc27d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:37.351418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd770195-3d6f-44c8-acc4-2140a11bc27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:37.351849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd770195-3d6f-44c8-acc4-2140a11bc27d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:37.352599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd770195-3d6f-44c8-acc4-2140a11bc27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:37.354950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd770195-3d6f-44c8-acc4-2140a11bc27d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:37.369051 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1453/2928] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:08:37 2022] PUT /identity/v3/projects/9b63ec6e0e3c4f268e63ae8da2ffe884/users/d0caedd0bc41435c9426ee622b9d2113/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:37.381552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963c65-1560-4c99-973f-4b260c74633f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:37.382164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963c65-1560-4c99-973f-4b260c74633f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:37.382666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963c65-1560-4c99-973f-4b260c74633f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:37.382963 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1476/2929] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:08:37.387232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd770195-3d6f-44c8-acc4-2140a11bc27d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:37.403628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd770195-3d6f-44c8-acc4-2140a11bc27d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:37.465143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0d963c65-1560-4c99-973f-4b260c74633f None None] MFA Rules not processed for user `d0caedd0bc41435c9426ee622b9d2113`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:37.467102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0d963c65-1560-4c99-973f-4b260c74633f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:37.560399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b484fe5-c59b-4ab9-a32d-5ce6e9fd64ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:37.560399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b484fe5-c59b-4ab9-a32d-5ce6e9fd64ec admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:37.560399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b484fe5-c59b-4ab9-a32d-5ce6e9fd64ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:37.560399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b484fe5-c59b-4ab9-a32d-5ce6e9fd64ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:37.561040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b484fe5-c59b-4ab9-a32d-5ce6e9fd64ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:37.564342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b484fe5-c59b-4ab9-a32d-5ce6e9fd64ec admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:37.592355 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1477/2930] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:08:37.600236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b484fe5-c59b-4ab9-a32d-5ce6e9fd64ec admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:37.628272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b484fe5-c59b-4ab9-a32d-5ce6e9fd64ec admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:37.643707 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1454/2931] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:08:37.650365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed3c3d-c219-4a67-b193-3d2dc84a2917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:37.652029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed3c3d-c219-4a67-b193-3d2dc84a2917 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:37.652411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed3c3d-c219-4a67-b193-3d2dc84a2917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:37.652785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed3c3d-c219-4a67-b193-3d2dc84a2917 admin admin] PATH_INFO: `/v3/projects/b6131663e36b42a4927bc315de1b839b/users/ddb8afba545d46278cf751e2087801a1/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:37.653028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963c65-1560-4c99-973f-4b260c74633f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:37.677589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963c65-1560-4c99-973f-4b260c74633f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:37.680451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed3c3d-c219-4a67-b193-3d2dc84a2917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6131663e36b42a4927bc315de1b839b, user_id=ddb8afba545d46278cf751e2087801a1, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:37.685316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522946e-4a2d-42ea-bbd0-7a710d1ea5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:37.686460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522946e-4a2d-42ea-bbd0-7a710d1ea5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:37.686745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522946e-4a2d-42ea-bbd0-7a710d1ea5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:37.687327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522946e-4a2d-42ea-bbd0-7a710d1ea5b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:37.688279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522946e-4a2d-42ea-bbd0-7a710d1ea5b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:37.689890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522946e-4a2d-42ea-bbd0-7a710d1ea5b5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:37.696231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed3c3d-c219-4a67-b193-3d2dc84a2917 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:37.707459 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:37.726097 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1478/2932] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:08:37 2022] PUT /identity/v3/projects/b6131663e36b42a4927bc315de1b839b/users/ddb8afba545d46278cf751e2087801a1/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:37.729838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd5db-31b5-4e06-90a2-3b66383dbad8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:37.730406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd5db-31b5-4e06-90a2-3b66383dbad8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:37.731370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd5db-31b5-4e06-90a2-3b66383dbad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:37.757855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7e1bd5db-31b5-4e06-90a2-3b66383dbad8 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:37.759104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7e1bd5db-31b5-4e06-90a2-3b66383dbad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:37.762733 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1455/2933] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:08:37 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:08:37.768731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24516654-4d2a-4306-8c9f-b7b27246c747 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:37.768972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24516654-4d2a-4306-8c9f-b7b27246c747 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:37.769231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24516654-4d2a-4306-8c9f-b7b27246c747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:37.788723 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:37.835114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-24516654-4d2a-4306-8c9f-b7b27246c747 None None] MFA Rules not processed for user `ddb8afba545d46278cf751e2087801a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:37.836256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-24516654-4d2a-4306-8c9f-b7b27246c747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:37.902822 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1479/2934] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:08:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:37.903816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bd5db-31b5-4e06-90a2-3b66383dbad8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:37.970151 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1456/2935] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:37.980554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24516654-4d2a-4306-8c9f-b7b27246c747 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:37.980554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-24516654-4d2a-4306-8c9f-b7b27246c747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:38.036937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bd5db-31b5-4e06-90a2-3b66383dbad8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:38.046686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d60c69-2ea4-4dec-9c40-40087957b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:38.047600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60c69-2ea4-4dec-9c40-40087957b684 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:38.047880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60c69-2ea4-4dec-9c40-40087957b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:38.048151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60c69-2ea4-4dec-9c40-40087957b684 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:38.050980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d60c69-2ea4-4dec-9c40-40087957b684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:38.057649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d60c69-2ea4-4dec-9c40-40087957b684 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:38.105795 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1480/2936] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:08:37 2022] POST /identity/v3/users => generated 303 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:08:38.112564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684fd0d-c726-4f88-8dba-8b29a7e090bd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:38.114101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684fd0d-c726-4f88-8dba-8b29a7e090bd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:38.115883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684fd0d-c726-4f88-8dba-8b29a7e090bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:38.160097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b684fd0d-c726-4f88-8dba-8b29a7e090bd None None] MFA Rules not processed for user `ddb8afba545d46278cf751e2087801a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:38.161337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b684fd0d-c726-4f88-8dba-8b29a7e090bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:38.166112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24516654-4d2a-4306-8c9f-b7b27246c747 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:38.174811 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1481/2937] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:38.177846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684fd0d-c726-4f88-8dba-8b29a7e090bd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:38.181021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1262b07-77a5-442b-b925-834ab9d0e150 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:38.181647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1262b07-77a5-442b-b925-834ab9d0e150 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:38.183261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1262b07-77a5-442b-b925-834ab9d0e150 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:38.183557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1262b07-77a5-442b-b925-834ab9d0e150 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:38.203718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1262b07-77a5-442b-b925-834ab9d0e150 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:38.206296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1262b07-77a5-442b-b925-834ab9d0e150 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:38.209948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684fd0d-c726-4f88-8dba-8b29a7e090bd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:38.222007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158275c9-a65f-4664-bd95-c91b1a714f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:38.223492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158275c9-a65f-4664-bd95-c91b1a714f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:38.223778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158275c9-a65f-4664-bd95-c91b1a714f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:38.224048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158275c9-a65f-4664-bd95-c91b1a714f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:38.224708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158275c9-a65f-4664-bd95-c91b1a714f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:38.229076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158275c9-a65f-4664-bd95-c91b1a714f3a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:38.230748 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1457/2938] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:08:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:08:38.252427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1262b07-77a5-442b-b925-834ab9d0e150 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:38.260689 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1482/2939] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:08:38.261682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158275c9-a65f-4664-bd95-c91b1a714f3a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:38.266131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-158275c9-a65f-4664-bd95-c91b1a714f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:38.277224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1262b07-77a5-442b-b925-834ab9d0e150 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:38.286538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c37e6c-ba0e-437d-9b17-afd19aad6c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:38.287212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c37e6c-ba0e-437d-9b17-afd19aad6c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:38.287498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c37e6c-ba0e-437d-9b17-afd19aad6c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:38.287771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c37e6c-ba0e-437d-9b17-afd19aad6c70 admin admin] PATH_INFO: `/v3/projects/2d294ef805184d7ca640b17b0d696056/users/9eec60746b3b409e91a3e8942fe1c73c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:38.309503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c37e6c-ba0e-437d-9b17-afd19aad6c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d294ef805184d7ca640b17b0d696056, user_id=9eec60746b3b409e91a3e8942fe1c73c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:38.313799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c37e6c-ba0e-437d-9b17-afd19aad6c70 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:38.354357 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1458/2940] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:08:38 2022] PUT /identity/v3/projects/2d294ef805184d7ca640b17b0d696056/users/9eec60746b3b409e91a3e8942fe1c73c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:38.361172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c37e6c-ba0e-437d-9b17-afd19aad6c70 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:38.423980 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:38.450800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c37e6c-ba0e-437d-9b17-afd19aad6c70 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:38.460172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8abff1-c11f-43b8-990a-f91ad90b2213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:38.461152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8abff1-c11f-43b8-990a-f91ad90b2213 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:38.461566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8abff1-c11f-43b8-990a-f91ad90b2213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:38.462080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8abff1-c11f-43b8-990a-f91ad90b2213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:38.463054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8abff1-c11f-43b8-990a-f91ad90b2213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:38.464750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8abff1-c11f-43b8-990a-f91ad90b2213 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:38.480725 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1459/2941] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:08:38.487174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8abff1-c11f-43b8-990a-f91ad90b2213 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:38.507261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8abff1-c11f-43b8-990a-f91ad90b2213 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:38.517063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59fb14-7d71-4048-9cea-1b50c5e16fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:38.517963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59fb14-7d71-4048-9cea-1b50c5e16fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:38.518357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59fb14-7d71-4048-9cea-1b50c5e16fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:38.518818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59fb14-7d71-4048-9cea-1b50c5e16fc2 admin admin] PATH_INFO: `/v3/projects/2d294ef805184d7ca640b17b0d696056/users/9eec60746b3b409e91a3e8942fe1c73c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:38.522255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59fb14-7d71-4048-9cea-1b50c5e16fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d294ef805184d7ca640b17b0d696056, user_id=9eec60746b3b409e91a3e8942fe1c73c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:38.527007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59fb14-7d71-4048-9cea-1b50c5e16fc2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:38.541768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158275c9-a65f-4664-bd95-c91b1a714f3a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:38.545661 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1460/2942] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:08:38 2022] PUT /identity/v3/projects/2d294ef805184d7ca640b17b0d696056/users/9eec60746b3b409e91a3e8942fe1c73c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:38.563933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6ba9b-258f-46be-9b70-699c08a1c677 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:38.564247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6ba9b-258f-46be-9b70-699c08a1c677 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:38.564495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6ba9b-258f-46be-9b70-699c08a1c677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:38.581535 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:38.638592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-13c6ba9b-258f-46be-9b70-699c08a1c677 None None] MFA Rules not processed for user `9eec60746b3b409e91a3e8942fe1c73c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:38.640192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-13c6ba9b-258f-46be-9b70-699c08a1c677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:38.689865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9face5f-7708-4f02-aa22-f3799a098fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:38.689865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9face5f-7708-4f02-aa22-f3799a098fa5 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:38.690409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9face5f-7708-4f02-aa22-f3799a098fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:38.690698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9face5f-7708-4f02-aa22-f3799a098fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:38.782567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9face5f-7708-4f02-aa22-f3799a098fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:38.784492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9face5f-7708-4f02-aa22-f3799a098fa5 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:38.785283 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1461/2943] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:08:38.797832 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1483/2944] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:38.803101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b493d-c992-48da-ab08-42e93c554793 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:38.803692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b493d-c992-48da-ab08-42e93c554793 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:38.804155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b493d-c992-48da-ab08-42e93c554793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:38.846849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f07b493d-c992-48da-ab08-42e93c554793 None None] MFA Rules not processed for user `d0caedd0bc41435c9426ee622b9d2113`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:38.848177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f07b493d-c992-48da-ab08-42e93c554793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:38.855469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d24b2-10ff-4138-9702-a8a9503fb1e7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:38.855953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d24b2-10ff-4138-9702-a8a9503fb1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:38.856434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d24b2-10ff-4138-9702-a8a9503fb1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:38.912459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7a2d24b2-10ff-4138-9702-a8a9503fb1e7 None None] MFA Rules not processed for user `ddb8afba545d46278cf751e2087801a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:38.916241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7a2d24b2-10ff-4138-9702-a8a9503fb1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:38.946099 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1484/2945] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:08:39.010593 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1462/2946] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:39.449468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d24b2-10ff-4138-9702-a8a9503fb1e7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:39.475614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d24b2-10ff-4138-9702-a8a9503fb1e7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:39.489051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92394c4e-bcb7-49bc-beca-512fb0baeae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:39.489671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92394c4e-bcb7-49bc-beca-512fb0baeae4 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:39.489945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92394c4e-bcb7-49bc-beca-512fb0baeae4 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:39.490213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92394c4e-bcb7-49bc-beca-512fb0baeae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:39.493786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc64f6-e350-4198-a7d0-570af622ae02 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:39.494075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc64f6-e350-4198-a7d0-570af622ae02 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:39.494354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc64f6-e350-4198-a7d0-570af622ae02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:39.517866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92394c4e-bcb7-49bc-beca-512fb0baeae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:39.518795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92394c4e-bcb7-49bc-beca-512fb0baeae4 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:39.537605 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1485/2947] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:39.548790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dabc64f6-e350-4198-a7d0-570af622ae02 None None] MFA Rules not processed for user `ddb8afba545d46278cf751e2087801a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:39.551042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dabc64f6-e350-4198-a7d0-570af622ae02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:39.592846 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1463/2948] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:40.445719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10186fa-8d7c-43bd-937c-e2107b3d0d61 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:40.445991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10186fa-8d7c-43bd-937c-e2107b3d0d61 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:40.446294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10186fa-8d7c-43bd-937c-e2107b3d0d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:40.497426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f10186fa-8d7c-43bd-937c-e2107b3d0d61 None None] MFA Rules not processed for user `ddb8afba545d46278cf751e2087801a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:40.516078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f10186fa-8d7c-43bd-937c-e2107b3d0d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:40.535011 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1486/2949] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:40.992888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00745e41-e63e-48be-9fe7-d3babe069bcd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:40.993452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00745e41-e63e-48be-9fe7-d3babe069bcd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:40.993896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00745e41-e63e-48be-9fe7-d3babe069bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:41.060342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-00745e41-e63e-48be-9fe7-d3babe069bcd None None] MFA Rules not processed for user `ddb8afba545d46278cf751e2087801a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:41.065419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-00745e41-e63e-48be-9fe7-d3babe069bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:41.103359 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1464/2950] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:41.144112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10186fa-8d7c-43bd-937c-e2107b3d0d61 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:41.254447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10186fa-8d7c-43bd-937c-e2107b3d0d61 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:41.264109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:41.265821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:41.266126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:41.267350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] PATH_INFO: `/v3/users/ddb8afba545d46278cf751e2087801a1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:41.270507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb8afba545d46278cf751e2087801a1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:41.272644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:41.305401 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:41.336211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb8afba545d46278cf751e2087801a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:41.337259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb8afba545d46278cf751e2087801a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:41.357054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb8afba545d46278cf751e2087801a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:41.380354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb8afba545d46278cf751e2087801a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:41.381465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb8afba545d46278cf751e2087801a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:41.397790 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1487/2951] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:08:41 2022] DELETE /identity/v3/users/ddb8afba545d46278cf751e2087801a1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:41.402292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29510a-4457-40a4-a756-f5dfbbe5c145 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:41.402811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29510a-4457-40a4-a756-f5dfbbe5c145 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:41.403316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29510a-4457-40a4-a756-f5dfbbe5c145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:41.436181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5f29510a-4457-40a4-a756-f5dfbbe5c145 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:41.437776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5f29510a-4457-40a4-a756-f5dfbbe5c145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:41.524201 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:41.569299 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1465/2952] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:41.580274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:41.581810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:41.706020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a813e9-da0f-4e21-84aa-8ffc1ae1a776 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:41.713150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c1d11-dbdf-4821-b521-bc48f9ecc2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:41.713975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c1d11-dbdf-4821-b521-bc48f9ecc2fa service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:41.723354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c1d11-dbdf-4821-b521-bc48f9ecc2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:41.723709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c1d11-dbdf-4821-b521-bc48f9ecc2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:41.739091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c1d11-dbdf-4821-b521-bc48f9ecc2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:41.740548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c1d11-dbdf-4821-b521-bc48f9ecc2fa service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:41.751798 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1488/2953] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:42.102564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29510a-4457-40a4-a756-f5dfbbe5c145 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:42.104301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5f29510a-4457-40a4-a756-f5dfbbe5c145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:42.123989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29510a-4457-40a4-a756-f5dfbbe5c145 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:42.131103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1260f75-8220-493f-a2ad-d90e18aaa1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:42.132198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1260f75-8220-493f-a2ad-d90e18aaa1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:42.132672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1260f75-8220-493f-a2ad-d90e18aaa1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:42.133104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1260f75-8220-493f-a2ad-d90e18aaa1d2 admin admin] PATH_INFO: `/v3/projects/b6131663e36b42a4927bc315de1b839b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:42.134465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1260f75-8220-493f-a2ad-d90e18aaa1d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6131663e36b42a4927bc315de1b839b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:42.137385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1260f75-8220-493f-a2ad-d90e18aaa1d2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:42.216795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c1260f75-8220-493f-a2ad-d90e18aaa1d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6131663e36b42a4927bc315de1b839b', 'request_id': 'req-c1260f75-8220-493f-a2ad-d90e18aaa1d2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:42.226417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c1260f75-8220-493f-a2ad-d90e18aaa1d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6131663e36b42a4927bc315de1b839b', 'request_id': 'req-c1260f75-8220-493f-a2ad-d90e18aaa1d2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:42.243016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c1260f75-8220-493f-a2ad-d90e18aaa1d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6131663e36b42a4927bc315de1b839b', 'request_id': 'req-c1260f75-8220-493f-a2ad-d90e18aaa1d2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:42.258225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c1260f75-8220-493f-a2ad-d90e18aaa1d2 admin admin] The token cache is being invalidate because project b6131663e36b42a4927bc315de1b839b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:08:42.258669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c1260f75-8220-493f-a2ad-d90e18aaa1d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:42.259474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c1260f75-8220-493f-a2ad-d90e18aaa1d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:42.261380 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1466/2954] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:08:42 2022] DELETE /identity/v3/projects/b6131663e36b42a4927bc315de1b839b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:42.267615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d4eeb-44af-445f-9642-116bd69855f2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:42.268290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d4eeb-44af-445f-9642-116bd69855f2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:42.268655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d4eeb-44af-445f-9642-116bd69855f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:42.329120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-385d4eeb-44af-445f-9642-116bd69855f2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:42.331633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-385d4eeb-44af-445f-9642-116bd69855f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:42.442730 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1489/2955] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:08:42.450767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0e42-0774-4469-9482-c2b013742105 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:42.451108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0e42-0774-4469-9482-c2b013742105 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:42.451353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0e42-0774-4469-9482-c2b013742105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:42.473102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-822a0e42-0774-4469-9482-c2b013742105 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:42.474320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-822a0e42-0774-4469-9482-c2b013742105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:42.482552 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1467/2956] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:42.487060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d4eeb-44af-445f-9642-116bd69855f2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:42.498684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d4eeb-44af-445f-9642-116bd69855f2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:42.504159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2c0a6-b953-4e34-85b1-7af9f800b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:42.504857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2c0a6-b953-4e34-85b1-7af9f800b052 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:42.505194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2c0a6-b953-4e34-85b1-7af9f800b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:42.505843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2c0a6-b953-4e34-85b1-7af9f800b052 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:42.506253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2c0a6-b953-4e34-85b1-7af9f800b052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:08:42.506562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2c0a6-b953-4e34-85b1-7af9f800b052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:42.508284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2c0a6-b953-4e34-85b1-7af9f800b052 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:42.532681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a0e42-0774-4469-9482-c2b013742105 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:42.535128 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1490/2957] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:08:42.551560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a0e42-0774-4469-9482-c2b013742105 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:42.574522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4b175-5fe5-4872-9a9e-6e6a3da157a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:42.575176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4b175-5fe5-4872-9a9e-6e6a3da157a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:42.575453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4b175-5fe5-4872-9a9e-6e6a3da157a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:42.575720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4b175-5fe5-4872-9a9e-6e6a3da157a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:42.576383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4b175-5fe5-4872-9a9e-6e6a3da157a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:42.578967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4b175-5fe5-4872-9a9e-6e6a3da157a4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:42.618311 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1468/2958] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:08:42 2022] POST /identity/v3/projects => generated 399 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:08:42.622659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2c0a6-b953-4e34-85b1-7af9f800b052 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:42.634170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2c0a6-b953-4e34-85b1-7af9f800b052 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:42.645510 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:42.729806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322129c5-e95d-47e2-a3d4-b1259c81e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:42.730559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322129c5-e95d-47e2-a3d4-b1259c81e36f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:42.730985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322129c5-e95d-47e2-a3d4-b1259c81e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:42.731832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322129c5-e95d-47e2-a3d4-b1259c81e36f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:42.732104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322129c5-e95d-47e2-a3d4-b1259c81e36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:42.735116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322129c5-e95d-47e2-a3d4-b1259c81e36f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:42.778146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4b175-5fe5-4872-9a9e-6e6a3da157a4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:42.788925 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1491/2959] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:08:42 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:08:42.793774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4b175-5fe5-4872-9a9e-6e6a3da157a4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:42.813439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a2983-8869-44d1-9f13-a402d56121b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:42.814565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a2983-8869-44d1-9f13-a402d56121b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:42.815107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a2983-8869-44d1-9f13-a402d56121b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:42.815577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a2983-8869-44d1-9f13-a402d56121b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:42.816414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a2983-8869-44d1-9f13-a402d56121b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:42.818425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a2983-8869-44d1-9f13-a402d56121b3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:42.845105 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1469/2960] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:08:42.846808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322129c5-e95d-47e2-a3d4-b1259c81e36f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:42.864608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322129c5-e95d-47e2-a3d4-b1259c81e36f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:42.869733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f1b02-9179-4f78-97ee-bc71620409b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:42.870492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f1b02-9179-4f78-97ee-bc71620409b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:42.870773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f1b02-9179-4f78-97ee-bc71620409b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:42.871083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f1b02-9179-4f78-97ee-bc71620409b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:42.872089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f1b02-9179-4f78-97ee-bc71620409b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:42.882525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f1b02-9179-4f78-97ee-bc71620409b1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:42.898702 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1492/2961] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:08:42.902743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a2983-8869-44d1-9f13-a402d56121b3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:42.916722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a2983-8869-44d1-9f13-a402d56121b3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:42.922441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3130b-67c8-40d4-8a67-adc66c410847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:42.923226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3130b-67c8-40d4-8a67-adc66c410847 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:42.923763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3130b-67c8-40d4-8a67-adc66c410847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:42.924109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3130b-67c8-40d4-8a67-adc66c410847 admin admin] PATH_INFO: `/v3/projects/3073f1ee5beb4ec2924fd3b3297a00d5/users/3f51c8481e854aa98f0b2601260efe5d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:42.964495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3130b-67c8-40d4-8a67-adc66c410847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3073f1ee5beb4ec2924fd3b3297a00d5, user_id=3f51c8481e854aa98f0b2601260efe5d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:42.967441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3130b-67c8-40d4-8a67-adc66c410847 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:42.988857 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1470/2962] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:08:42 2022] PUT /identity/v3/projects/3073f1ee5beb4ec2924fd3b3297a00d5/users/3f51c8481e854aa98f0b2601260efe5d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:08:42.996678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2797a2b-3ba0-4dd8-a376-5a12730a36c6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:42.996991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2797a2b-3ba0-4dd8-a376-5a12730a36c6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:42.997265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2797a2b-3ba0-4dd8-a376-5a12730a36c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:43.016548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f2797a2b-3ba0-4dd8-a376-5a12730a36c6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:43.017776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f2797a2b-3ba0-4dd8-a376-5a12730a36c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:43.087181 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1493/2963] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:43.097519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3130b-67c8-40d4-8a67-adc66c410847 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:43.099352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2af3130b-67c8-40d4-8a67-adc66c410847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:43.163522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3130b-67c8-40d4-8a67-adc66c410847 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:43.167286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d89ee-4221-4440-9e97-f92bbd997dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:43.167963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d89ee-4221-4440-9e97-f92bbd997dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:43.168312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d89ee-4221-4440-9e97-f92bbd997dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:43.168673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d89ee-4221-4440-9e97-f92bbd997dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:43.178908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d89ee-4221-4440-9e97-f92bbd997dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:43.180351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d89ee-4221-4440-9e97-f92bbd997dc4 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:43.189793 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1471/2964] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:48.039291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa01d0-d550-4360-952d-cbe0d0a4ff6e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:48.039877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa01d0-d550-4360-952d-cbe0d0a4ff6e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:48.039877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa01d0-d550-4360-952d-cbe0d0a4ff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:48.076740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ebaa01d0-d550-4360-952d-cbe0d0a4ff6e None None] MFA Rules not processed for user `2d7df9a6845440bbad5bd7c0a192171b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:48.078771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ebaa01d0-d550-4360-952d-cbe0d0a4ff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:48.241091 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1494/2965] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:51.492605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a56d0-bb03-4784-b66d-e62817a0741d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:51.493008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a56d0-bb03-4784-b66d-e62817a0741d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:51.493253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a56d0-bb03-4784-b66d-e62817a0741d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:51.504913 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:51.554586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3b2a56d0-bb03-4784-b66d-e62817a0741d None None] MFA Rules not processed for user `3f51c8481e854aa98f0b2601260efe5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:51.556711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b2a56d0-bb03-4784-b66d-e62817a0741d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:51.714700 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1472/2966] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:51.726731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32052ac5-bb75-452c-8bd4-b27f729bbaa4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:51.728361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32052ac5-bb75-452c-8bd4-b27f729bbaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:51.729028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32052ac5-bb75-452c-8bd4-b27f729bbaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:51.757409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-32052ac5-bb75-452c-8bd4-b27f729bbaa4 None None] MFA Rules not processed for user `3f51c8481e854aa98f0b2601260efe5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:51.758899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-32052ac5-bb75-452c-8bd4-b27f729bbaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:51.771505 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1495/2967] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:08:52.086696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a56d0-bb03-4784-b66d-e62817a0741d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:52.088776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b2a56d0-bb03-4784-b66d-e62817a0741d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:52.210492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a56d0-bb03-4784-b66d-e62817a0741d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:52.221715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b3495-a14c-4ebb-afc7-8bcab46ae160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:52.223703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b3495-a14c-4ebb-afc7-8bcab46ae160 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:52.224254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b3495-a14c-4ebb-afc7-8bcab46ae160 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:52.224888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b3495-a14c-4ebb-afc7-8bcab46ae160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:52.244601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b3495-a14c-4ebb-afc7-8bcab46ae160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:52.247265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b3495-a14c-4ebb-afc7-8bcab46ae160 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:52.259309 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1473/2968] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:52 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:56.092864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9e3ac-61ec-4e36-b259-40b2e18d7e8a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:56.093402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9e3ac-61ec-4e36-b259-40b2e18d7e8a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:56.093793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9e3ac-61ec-4e36-b259-40b2e18d7e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:56.126764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-86f9e3ac-61ec-4e36-b259-40b2e18d7e8a None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:56.128309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-86f9e3ac-61ec-4e36-b259-40b2e18d7e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:56.176346 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:56.242619 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1496/2969] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:08:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:56.257798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b3495-a14c-4ebb-afc7-8bcab46ae160 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:56.259374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e53b3495-a14c-4ebb-afc7-8bcab46ae160 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:56.467669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b3495-a14c-4ebb-afc7-8bcab46ae160 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:56.478895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820043ba-fe36-4967-9c9f-d4be8840c304 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:56.479726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820043ba-fe36-4967-9c9f-d4be8840c304 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:56.481661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820043ba-fe36-4967-9c9f-d4be8840c304 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:56.482168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820043ba-fe36-4967-9c9f-d4be8840c304 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:56.507254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820043ba-fe36-4967-9c9f-d4be8840c304 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:56.509314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820043ba-fe36-4967-9c9f-d4be8840c304 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:56.534274 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1474/2970] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:08:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:04.153065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9e3ac-61ec-4e36-b259-40b2e18d7e8a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:04.155295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-86f9e3ac-61ec-4e36-b259-40b2e18d7e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:04.178005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9e3ac-61ec-4e36-b259-40b2e18d7e8a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:04.185403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:04.186270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:04.187676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:04.188558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] PATH_INFO: `/v3/users/040056f7aa7e4630813628aa516e3842` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:04.190259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=040056f7aa7e4630813628aa516e3842)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:04.192245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:04.298950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040056f7aa7e4630813628aa516e3842'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:04.299997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040056f7aa7e4630813628aa516e3842'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:04.321721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040056f7aa7e4630813628aa516e3842'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:04.338459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040056f7aa7e4630813628aa516e3842'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:04.339628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040056f7aa7e4630813628aa516e3842'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:04.362989 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1497/2971] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:09:04 2022] DELETE /identity/v3/users/040056f7aa7e4630813628aa516e3842 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:09:04.367866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74898-ca6a-447f-a5fb-2abeaa510d1d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:04.368764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74898-ca6a-447f-a5fb-2abeaa510d1d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:04.375565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74898-ca6a-447f-a5fb-2abeaa510d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:04.405406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4bc74898-ca6a-447f-a5fb-2abeaa510d1d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:04.407116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4bc74898-ca6a-447f-a5fb-2abeaa510d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:04.414005 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:04.584568 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1475/2972] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:04.608150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:04.610407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:04.728067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7b167-0e56-416c-8dda-bac64b956e6f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:04.735280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967fa9f-407d-4d22-acd1-3a53ba8f6260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:04.735730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967fa9f-407d-4d22-acd1-3a53ba8f6260 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:04.736006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967fa9f-407d-4d22-acd1-3a53ba8f6260 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:04.736275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967fa9f-407d-4d22-acd1-3a53ba8f6260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:04.749292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967fa9f-407d-4d22-acd1-3a53ba8f6260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:04.751044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967fa9f-407d-4d22-acd1-3a53ba8f6260 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:04.762294 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1498/2973] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:09:05.145513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf4098-f807-4322-93e4-6fa4048f5c9f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:05.145825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf4098-f807-4322-93e4-6fa4048f5c9f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:05.146099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf4098-f807-4322-93e4-6fa4048f5c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:05.183548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6abf4098-f807-4322-93e4-6fa4048f5c9f None None] MFA Rules not processed for user `3c33afd9ae144eb185203c30baa70351`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:05.186491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6abf4098-f807-4322-93e4-6fa4048f5c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:05.432613 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1476/2974] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:05.759948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967fa9f-407d-4d22-acd1-3a53ba8f6260 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:05.763511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7967fa9f-407d-4d22-acd1-3a53ba8f6260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:05.809674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967fa9f-407d-4d22-acd1-3a53ba8f6260 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:05.827842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:05.834255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:05.834829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:05.835340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1 admin admin] PATH_INFO: `/v3/projects/011a6b8a86274f2db2cf1c66338790b2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:05.847399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011a6b8a86274f2db2cf1c66338790b2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:05.854745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:05.963922 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:05.973383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011a6b8a86274f2db2cf1c66338790b2', 'request_id': 'req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:05.988016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011a6b8a86274f2db2cf1c66338790b2', 'request_id': 'req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:06.003715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011a6b8a86274f2db2cf1c66338790b2', 'request_id': 'req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:06.059257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1 admin admin] The token cache is being invalidate because project 011a6b8a86274f2db2cf1c66338790b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:09:06.059257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:06.059257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-713853fb-6e20-4193-a21f-c3e8d0c3ebd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:06.059257 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1499/2975] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:09:05 2022] DELETE /identity/v3/projects/011a6b8a86274f2db2cf1c66338790b2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:09:06.060926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb25a2-37eb-44cf-b567-218796b08005 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:06.060926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb25a2-37eb-44cf-b567-218796b08005 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:06.060926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb25a2-37eb-44cf-b567-218796b08005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:06.146541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e5fb25a2-37eb-44cf-b567-218796b08005 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:06.160295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e5fb25a2-37eb-44cf-b567-218796b08005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:06.413759 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1477/2976] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:09:06.415362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1f940-7a98-4a5a-840f-76b38963f820 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:06.416004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1f940-7a98-4a5a-840f-76b38963f820 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:06.416756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1f940-7a98-4a5a-840f-76b38963f820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:06.472973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c0a1f940-7a98-4a5a-840f-76b38963f820 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:06.479921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c0a1f940-7a98-4a5a-840f-76b38963f820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:06.514565 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1500/2977] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:09:06.516677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb25a2-37eb-44cf-b567-218796b08005 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:06.529998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb25a2-37eb-44cf-b567-218796b08005 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:06.553563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b746cf-adf2-48d6-8997-9eb84f450720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:06.554209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b746cf-adf2-48d6-8997-9eb84f450720 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:06.554489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b746cf-adf2-48d6-8997-9eb84f450720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:06.554758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b746cf-adf2-48d6-8997-9eb84f450720 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:06.559060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b746cf-adf2-48d6-8997-9eb84f450720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:09:06.559500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b746cf-adf2-48d6-8997-9eb84f450720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:06.579833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b746cf-adf2-48d6-8997-9eb84f450720 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:06.617254 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1478/2978] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:09:06.621755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1f940-7a98-4a5a-840f-76b38963f820 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:06.632959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1f940-7a98-4a5a-840f-76b38963f820 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:06.653950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99554a29-86df-4268-b00a-de9228ee1409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:06.654593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554a29-86df-4268-b00a-de9228ee1409 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:06.654884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554a29-86df-4268-b00a-de9228ee1409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:06.655161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554a29-86df-4268-b00a-de9228ee1409 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:06.655917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99554a29-86df-4268-b00a-de9228ee1409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:06.657907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99554a29-86df-4268-b00a-de9228ee1409 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:06.741984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b746cf-adf2-48d6-8997-9eb84f450720 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:06.752666 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1501/2979] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:09:06 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:09:06.755182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b746cf-adf2-48d6-8997-9eb84f450720 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:06.815703 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:06.892619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a924ac-10e0-4646-afbc-a05b4c48dbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:06.893709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a924ac-10e0-4646-afbc-a05b4c48dbbf admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:06.894206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a924ac-10e0-4646-afbc-a05b4c48dbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:06.894665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a924ac-10e0-4646-afbc-a05b4c48dbbf admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:06.895555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a924ac-10e0-4646-afbc-a05b4c48dbbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:06.897685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a924ac-10e0-4646-afbc-a05b4c48dbbf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:06.943909 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1479/2980] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:09:06 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:09:06.945743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99554a29-86df-4268-b00a-de9228ee1409 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:06.972360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99554a29-86df-4268-b00a-de9228ee1409 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:06.989464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2c397-08cc-4728-8eeb-6210a1c99ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:06.994208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2c397-08cc-4728-8eeb-6210a1c99ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:06.994508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2c397-08cc-4728-8eeb-6210a1c99ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:06.994855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2c397-08cc-4728-8eeb-6210a1c99ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:06.997929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2c397-08cc-4728-8eeb-6210a1c99ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:07.002697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2c397-08cc-4728-8eeb-6210a1c99ce2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:07.021798 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1502/2981] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:09:07.024410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a924ac-10e0-4646-afbc-a05b4c48dbbf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:07.046042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a924ac-10e0-4646-afbc-a05b4c48dbbf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:07.060704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b9ee2-bac0-42cc-bcc3-6d043a3123a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:07.063616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b9ee2-bac0-42cc-bcc3-6d043a3123a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:07.063920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b9ee2-bac0-42cc-bcc3-6d043a3123a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:07.064197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b9ee2-bac0-42cc-bcc3-6d043a3123a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:07.064855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b9ee2-bac0-42cc-bcc3-6d043a3123a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:07.070411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b9ee2-bac0-42cc-bcc3-6d043a3123a6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:07.098412 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1480/2982] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:09:07.110951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2c397-08cc-4728-8eeb-6210a1c99ce2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:07.122076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2c397-08cc-4728-8eeb-6210a1c99ce2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:07.143819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4cb84-7a66-409a-94df-6a1042bcfd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:07.145563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4cb84-7a66-409a-94df-6a1042bcfd82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:07.145563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4cb84-7a66-409a-94df-6a1042bcfd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:07.145563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4cb84-7a66-409a-94df-6a1042bcfd82 admin admin] PATH_INFO: `/v3/projects/021b1335de664adea720f7b92f00cff5/users/bc122b9d7abf459fa506adcdbc0e4c50/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:07.211883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4cb84-7a66-409a-94df-6a1042bcfd82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021b1335de664adea720f7b92f00cff5, user_id=bc122b9d7abf459fa506adcdbc0e4c50, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:07.219811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4cb84-7a66-409a-94df-6a1042bcfd82 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:07.284127 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1503/2983] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:09:07 2022] PUT /identity/v3/projects/021b1335de664adea720f7b92f00cff5/users/bc122b9d7abf459fa506adcdbc0e4c50/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:09:07.293926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4fce-c2ba-4681-9fb9-2ebe6fac6f3e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:07.294300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4fce-c2ba-4681-9fb9-2ebe6fac6f3e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:07.294650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4fce-c2ba-4681-9fb9-2ebe6fac6f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:07.402580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e80a4fce-c2ba-4681-9fb9-2ebe6fac6f3e None None] MFA Rules not processed for user `bc122b9d7abf459fa506adcdbc0e4c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:07.404198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e80a4fce-c2ba-4681-9fb9-2ebe6fac6f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:07.650144 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1481/2984] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:07.662472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd52f3-f670-4ef2-aa00-64e4d61011b5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:07.662979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd52f3-f670-4ef2-aa00-64e4d61011b5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:07.663520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd52f3-f670-4ef2-aa00-64e4d61011b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:07.692681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-73fd52f3-f670-4ef2-aa00-64e4d61011b5 None None] MFA Rules not processed for user `bc122b9d7abf459fa506adcdbc0e4c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:07.693915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-73fd52f3-f670-4ef2-aa00-64e4d61011b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:07.709565 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1504/2985] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:08.093540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a4fce-c2ba-4681-9fb9-2ebe6fac6f3e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:08.095222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e80a4fce-c2ba-4681-9fb9-2ebe6fac6f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:08.284411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a4fce-c2ba-4681-9fb9-2ebe6fac6f3e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:08.314032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b369727-6961-4512-8c20-5bc357b9b9f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:08.316860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b369727-6961-4512-8c20-5bc357b9b9f9 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:08.317350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b369727-6961-4512-8c20-5bc357b9b9f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:08.318306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b369727-6961-4512-8c20-5bc357b9b9f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:08.339368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b369727-6961-4512-8c20-5bc357b9b9f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:08.345132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b369727-6961-4512-8c20-5bc357b9b9f9 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:08.367924 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1482/2986] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:09:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:09:08.448985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd52f3-f670-4ef2-aa00-64e4d61011b5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:08.450528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-73fd52f3-f670-4ef2-aa00-64e4d61011b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:08.576551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd52f3-f670-4ef2-aa00-64e4d61011b5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:08.583042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b915bd-1246-476c-9e31-c72fc21f8e80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:08.583807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b915bd-1246-476c-9e31-c72fc21f8e80 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:08.584232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b915bd-1246-476c-9e31-c72fc21f8e80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:08.584607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b915bd-1246-476c-9e31-c72fc21f8e80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:08.587024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22b915bd-1246-476c-9e31-c72fc21f8e80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:08.738628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b915bd-1246-476c-9e31-c72fc21f8e80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:08.740361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b915bd-1246-476c-9e31-c72fc21f8e80 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:08.766498 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1505/2987] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:09:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:09:10.487893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b369727-6961-4512-8c20-5bc357b9b9f9 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:10.487893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1b369727-6961-4512-8c20-5bc357b9b9f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:10.517763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b369727-6961-4512-8c20-5bc357b9b9f9 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:10.525152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767182af-f363-4ba6-84c5-d82b812061b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:10.525767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767182af-f363-4ba6-84c5-d82b812061b7 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:10.526044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767182af-f363-4ba6-84c5-d82b812061b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:10.526342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767182af-f363-4ba6-84c5-d82b812061b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:10.533608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-767182af-f363-4ba6-84c5-d82b812061b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:10.633186 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:10.711420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767182af-f363-4ba6-84c5-d82b812061b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:10.715942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767182af-f363-4ba6-84c5-d82b812061b7 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:10.748654 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1483/2988] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:09:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:09:10.790135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995aaf2-c2d1-44bd-b301-19c1c154c6c9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:10.790674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995aaf2-c2d1-44bd-b301-19c1c154c6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:10.790674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995aaf2-c2d1-44bd-b301-19c1c154c6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:10.852666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1995aaf2-c2d1-44bd-b301-19c1c154c6c9 None None] MFA Rules not processed for user `d0caedd0bc41435c9426ee622b9d2113`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:10.873361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1995aaf2-c2d1-44bd-b301-19c1c154c6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:10.920908 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:11.052028 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1506/2989] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:16.317697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cb9cb-faa5-48fd-bbe0-f724d48b482b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:16.318280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cb9cb-faa5-48fd-bbe0-f724d48b482b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:16.318280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cb9cb-faa5-48fd-bbe0-f724d48b482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:16.356691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9f7cb9cb-faa5-48fd-bbe0-f724d48b482b None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:16.359428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9f7cb9cb-faa5-48fd-bbe0-f724d48b482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:16.437431 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1484/2990] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:16.456267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995aaf2-c2d1-44bd-b301-19c1c154c6c9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:16.471204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1995aaf2-c2d1-44bd-b301-19c1c154c6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:16.568012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995aaf2-c2d1-44bd-b301-19c1c154c6c9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:16.573200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af742305-5955-4a02-975f-dae6afdac81a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:16.573842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af742305-5955-4a02-975f-dae6afdac81a service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:16.574120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af742305-5955-4a02-975f-dae6afdac81a service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:16.574389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af742305-5955-4a02-975f-dae6afdac81a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:16.585332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af742305-5955-4a02-975f-dae6afdac81a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:16.587590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af742305-5955-4a02-975f-dae6afdac81a service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:16.599868 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1507/2991] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:09:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:17.783670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb86c-6346-4cc7-8fc1-0137cb6f75c7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:17.784729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb86c-6346-4cc7-8fc1-0137cb6f75c7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:17.785144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb86c-6346-4cc7-8fc1-0137cb6f75c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:17.824113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b11eb86c-6346-4cc7-8fc1-0137cb6f75c7 None None] MFA Rules not processed for user `875dca9ed4914e379601ddbdba035cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:17.825394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b11eb86c-6346-4cc7-8fc1-0137cb6f75c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:18.004213 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1485/2992] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:09:18.345303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d54c2-4f42-4a19-b846-a12d794996e7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:18.345825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d54c2-4f42-4a19-b846-a12d794996e7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:18.345825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d54c2-4f42-4a19-b846-a12d794996e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:18.370434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-650d54c2-4f42-4a19-b846-a12d794996e7 None None] MFA Rules not processed for user `2d7df9a6845440bbad5bd7c0a192171b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:18.371979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-650d54c2-4f42-4a19-b846-a12d794996e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:18.440531 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1508/2993] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:23.947168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e638eb-cf19-4c30-9920-1f6f57e587dc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:23.947963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e638eb-cf19-4c30-9920-1f6f57e587dc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:23.947963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e638eb-cf19-4c30-9920-1f6f57e587dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:23.982219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-64e638eb-cf19-4c30-9920-1f6f57e587dc None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:23.991212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-64e638eb-cf19-4c30-9920-1f6f57e587dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:24.006533 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1486/2994] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:09:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:09:24.065408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d54c2-4f42-4a19-b846-a12d794996e7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:24.114167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d54c2-4f42-4a19-b846-a12d794996e7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:24.141190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaa4a7-6bd2-49db-b4c4-98da75531cea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:24.142224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaa4a7-6bd2-49db-b4c4-98da75531cea service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:24.144956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaa4a7-6bd2-49db-b4c4-98da75531cea service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:24.145458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaa4a7-6bd2-49db-b4c4-98da75531cea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:24.159382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaa4a7-6bd2-49db-b4c4-98da75531cea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:24.161236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaa4a7-6bd2-49db-b4c4-98da75531cea service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:24.180379 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1509/2995] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:09:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:33.971018 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=67 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:34.173646 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=80 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:37.268746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e638eb-cf19-4c30-9920-1f6f57e587dc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:37.270663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-64e638eb-cf19-4c30-9920-1f6f57e587dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:37.479298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e638eb-cf19-4c30-9920-1f6f57e587dc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:37.486760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6e24c-17d7-49db-b3f6-1005c7bbff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:37.487465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6e24c-17d7-49db-b3f6-1005c7bbff61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:37.487748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6e24c-17d7-49db-b3f6-1005c7bbff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:37.488386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6e24c-17d7-49db-b3f6-1005c7bbff61 admin admin] PATH_INFO: `/v3/users/3f51c8481e854aa98f0b2601260efe5d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:37.489545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6e24c-17d7-49db-b3f6-1005c7bbff61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f51c8481e854aa98f0b2601260efe5d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:37.503639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6e24c-17d7-49db-b3f6-1005c7bbff61 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:37.607043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-59f6e24c-17d7-49db-b3f6-1005c7bbff61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f51c8481e854aa98f0b2601260efe5d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:37.608596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-59f6e24c-17d7-49db-b3f6-1005c7bbff61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f51c8481e854aa98f0b2601260efe5d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:37.644690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-59f6e24c-17d7-49db-b3f6-1005c7bbff61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f51c8481e854aa98f0b2601260efe5d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:37.663010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-59f6e24c-17d7-49db-b3f6-1005c7bbff61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f51c8481e854aa98f0b2601260efe5d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:37.663821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-59f6e24c-17d7-49db-b3f6-1005c7bbff61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f51c8481e854aa98f0b2601260efe5d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:37.689529 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1487/2996] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:09:37 2022] DELETE /identity/v3/users/3f51c8481e854aa98f0b2601260efe5d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:09:38.060746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaa4a7-6bd2-49db-b4c4-98da75531cea service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:38.076836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaa4a7-6bd2-49db-b4c4-98da75531cea service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:38.228024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:38.228735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:38.229020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:38.229295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d admin admin] PATH_INFO: `/v3/projects/3073f1ee5beb4ec2924fd3b3297a00d5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:38.231059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3073f1ee5beb4ec2924fd3b3297a00d5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:38.233004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:38.298202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3073f1ee5beb4ec2924fd3b3297a00d5', 'request_id': 'req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:38.306730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3073f1ee5beb4ec2924fd3b3297a00d5', 'request_id': 'req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:38.346652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3073f1ee5beb4ec2924fd3b3297a00d5', 'request_id': 'req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:38.377121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d admin admin] The token cache is being invalidate because project 3073f1ee5beb4ec2924fd3b3297a00d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:09:38.377698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:38.378607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5bb49cdc-1dce-48c5-b37d-a50c8bb7806d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:38.383933 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1510/2997] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:09:38 2022] DELETE /identity/v3/projects/3073f1ee5beb4ec2924fd3b3297a00d5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:09:38.390378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323137f-f477-4a79-9ca2-70956cdab5f3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:38.390879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323137f-f477-4a79-9ca2-70956cdab5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:38.390985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323137f-f477-4a79-9ca2-70956cdab5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:38.431077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d323137f-f477-4a79-9ca2-70956cdab5f3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:38.433403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d323137f-f477-4a79-9ca2-70956cdab5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:38.595775 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1488/2998] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:38.602766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217dcbd-7169-42ea-8cc4-59c49c90d8c0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:38.603271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217dcbd-7169-42ea-8cc4-59c49c90d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:38.603853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217dcbd-7169-42ea-8cc4-59c49c90d8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:38.648428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1217dcbd-7169-42ea-8cc4-59c49c90d8c0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:38.650093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1217dcbd-7169-42ea-8cc4-59c49c90d8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:38.671621 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1511/2999] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:38.675662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323137f-f477-4a79-9ca2-70956cdab5f3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:38.693115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323137f-f477-4a79-9ca2-70956cdab5f3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:38.705374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df150-982b-477a-be2b-f38282169d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:38.706149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df150-982b-477a-be2b-f38282169d13 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:38.706526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df150-982b-477a-be2b-f38282169d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:38.706863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df150-982b-477a-be2b-f38282169d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:38.707602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20df150-982b-477a-be2b-f38282169d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:09:38.707995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20df150-982b-477a-be2b-f38282169d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:38.712958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20df150-982b-477a-be2b-f38282169d13 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:38.736328 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1489/3000] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:09:38.741909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217dcbd-7169-42ea-8cc4-59c49c90d8c0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:38.760122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217dcbd-7169-42ea-8cc4-59c49c90d8c0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:38.768868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0edf5-5888-45fa-bcc4-ded9c0fb566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:38.771981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0edf5-5888-45fa-bcc4-ded9c0fb566d admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:38.773140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0edf5-5888-45fa-bcc4-ded9c0fb566d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:38.773602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0edf5-5888-45fa-bcc4-ded9c0fb566d admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:38.775302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0edf5-5888-45fa-bcc4-ded9c0fb566d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:38.778719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0edf5-5888-45fa-bcc4-ded9c0fb566d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:38.844448 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1512/3001] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:09:38 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:09:38.848259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df150-982b-477a-be2b-f38282169d13 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:38.870619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df150-982b-477a-be2b-f38282169d13 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:38.878463 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:38.990612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c878d21-eeed-44e9-bfce-3ac9938a422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:38.991470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c878d21-eeed-44e9-bfce-3ac9938a422c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:38.991914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c878d21-eeed-44e9-bfce-3ac9938a422c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:38.992337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c878d21-eeed-44e9-bfce-3ac9938a422c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:38.993530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c878d21-eeed-44e9-bfce-3ac9938a422c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:38.999928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c878d21-eeed-44e9-bfce-3ac9938a422c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:39.081096 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1490/3002] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:09:38 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:09:39.085186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0edf5-5888-45fa-bcc4-ded9c0fb566d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:39.118022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0edf5-5888-45fa-bcc4-ded9c0fb566d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:39.128554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3e439-c75b-489e-b278-e3bba49d5e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:39.130079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3e439-c75b-489e-b278-e3bba49d5e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:39.130079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3e439-c75b-489e-b278-e3bba49d5e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:39.130079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3e439-c75b-489e-b278-e3bba49d5e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:39.130391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3e439-c75b-489e-b278-e3bba49d5e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:39.132269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3e439-c75b-489e-b278-e3bba49d5e15 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:39.154672 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1513/3003] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:09:39.167186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c878d21-eeed-44e9-bfce-3ac9938a422c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:39.207058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c878d21-eeed-44e9-bfce-3ac9938a422c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:39.213741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b210f-5e16-4dbb-a399-6e56efe418b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:39.214480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b210f-5e16-4dbb-a399-6e56efe418b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:39.214822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b210f-5e16-4dbb-a399-6e56efe418b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:39.215190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b210f-5e16-4dbb-a399-6e56efe418b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:39.215902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b210f-5e16-4dbb-a399-6e56efe418b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:39.234419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b210f-5e16-4dbb-a399-6e56efe418b0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:39.234419 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1491/3004] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:09:39.246436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3e439-c75b-489e-b278-e3bba49d5e15 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:39.268210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3e439-c75b-489e-b278-e3bba49d5e15 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:39.272938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b472a5-d50a-47a3-9ac0-cc85ae8a130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:39.273614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b472a5-d50a-47a3-9ac0-cc85ae8a130f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:39.273890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b472a5-d50a-47a3-9ac0-cc85ae8a130f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:39.274160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b472a5-d50a-47a3-9ac0-cc85ae8a130f admin admin] PATH_INFO: `/v3/projects/12f75cea27f642c18d60645158425380/users/df9979f0dcd74d60a55d02d432de6a51/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:39.292225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b472a5-d50a-47a3-9ac0-cc85ae8a130f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f75cea27f642c18d60645158425380, user_id=df9979f0dcd74d60a55d02d432de6a51, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:39.294803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b472a5-d50a-47a3-9ac0-cc85ae8a130f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:39.318242 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1514/3005] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:09:39 2022] PUT /identity/v3/projects/12f75cea27f642c18d60645158425380/users/df9979f0dcd74d60a55d02d432de6a51/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:09:39.328799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbe181-fbc0-444d-ac07-e13d70a0c7f7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:39.329161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbe181-fbc0-444d-ac07-e13d70a0c7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:39.329344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbe181-fbc0-444d-ac07-e13d70a0c7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:39.362966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2dcbe181-fbc0-444d-ac07-e13d70a0c7f7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:39.362966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2dcbe181-fbc0-444d-ac07-e13d70a0c7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:39.481990 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1492/3006] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:39.492533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b472a5-d50a-47a3-9ac0-cc85ae8a130f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:39.499148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-97b472a5-d50a-47a3-9ac0-cc85ae8a130f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:39.581090 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:39.641081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b472a5-d50a-47a3-9ac0-cc85ae8a130f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:39.645673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7e78c-8947-4682-8e8e-0c285958c331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:39.647026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7e78c-8947-4682-8e8e-0c285958c331 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:39.647455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7e78c-8947-4682-8e8e-0c285958c331 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:39.650806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7e78c-8947-4682-8e8e-0c285958c331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:39.666892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7e78c-8947-4682-8e8e-0c285958c331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:39.669059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7e78c-8947-4682-8e8e-0c285958c331 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:39.683916 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1515/3007] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:09:40.251135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630be8b-f96e-48e7-87de-fc55ed5b265f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:40.251425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630be8b-f96e-48e7-87de-fc55ed5b265f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:40.251703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630be8b-f96e-48e7-87de-fc55ed5b265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:40.323857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2630be8b-f96e-48e7-87de-fc55ed5b265f None None] MFA Rules not processed for user `2d7df9a6845440bbad5bd7c0a192171b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:40.330861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2630be8b-f96e-48e7-87de-fc55ed5b265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:40.489309 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1493/3008] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:49.683546 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=14 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:50.467760 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:52.143508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414b3f0-f802-4a24-b523-93c61a3c0ffd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:52.144860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414b3f0-f802-4a24-b523-93c61a3c0ffd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:52.145285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414b3f0-f802-4a24-b523-93c61a3c0ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:52.206939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5414b3f0-f802-4a24-b523-93c61a3c0ffd None None] MFA Rules not processed for user `df9979f0dcd74d60a55d02d432de6a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:52.208510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5414b3f0-f802-4a24-b523-93c61a3c0ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:52.386725 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1516/3009] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:52.398578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49335389-8de2-4551-bab0-cdbf6bb7b6f3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:52.399278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49335389-8de2-4551-bab0-cdbf6bb7b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:52.399278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49335389-8de2-4551-bab0-cdbf6bb7b6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:52.437693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-49335389-8de2-4551-bab0-cdbf6bb7b6f3 None None] MFA Rules not processed for user `df9979f0dcd74d60a55d02d432de6a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:52.442115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-49335389-8de2-4551-bab0-cdbf6bb7b6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:52.479612 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1494/3010] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:52.636241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414b3f0-f802-4a24-b523-93c61a3c0ffd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:52.638757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5414b3f0-f802-4a24-b523-93c61a3c0ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:52.732252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414b3f0-f802-4a24-b523-93c61a3c0ffd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:52.739079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef36313-7028-4d3e-9cfd-4f6be2ce7b15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:52.739962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef36313-7028-4d3e-9cfd-4f6be2ce7b15 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:52.740467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef36313-7028-4d3e-9cfd-4f6be2ce7b15 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:52.741056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef36313-7028-4d3e-9cfd-4f6be2ce7b15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:52.752192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef36313-7028-4d3e-9cfd-4f6be2ce7b15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:52.755192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef36313-7028-4d3e-9cfd-4f6be2ce7b15 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:52.766777 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1517/3011] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:09:56.662626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49335389-8de2-4551-bab0-cdbf6bb7b6f3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:56.697458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49335389-8de2-4551-bab0-cdbf6bb7b6f3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:56.709997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6e436-b8de-4f94-bebe-96e8ee5b7f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:56.711007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e436-b8de-4f94-bebe-96e8ee5b7f14 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:56.711488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e436-b8de-4f94-bebe-96e8ee5b7f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:56.711987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e436-b8de-4f94-bebe-96e8ee5b7f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:56.714151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-20f6e436-b8de-4f94-bebe-96e8ee5b7f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:56.739820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6e436-b8de-4f94-bebe-96e8ee5b7f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:56.742088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6e436-b8de-4f94-bebe-96e8ee5b7f14 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:56.757957 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1495/3012] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:00.792909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef36313-7028-4d3e-9cfd-4f6be2ce7b15 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:00.797099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cef36313-7028-4d3e-9cfd-4f6be2ce7b15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:00.823822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef36313-7028-4d3e-9cfd-4f6be2ce7b15 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:00.832313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:00.833519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:00.833861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:00.834144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] PATH_INFO: `/v3/users/d0caedd0bc41435c9426ee622b9d2113` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:00.848097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0caedd0bc41435c9426ee622b9d2113)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:00.850458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:00.945836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0caedd0bc41435c9426ee622b9d2113'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:00.946605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0caedd0bc41435c9426ee622b9d2113'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:00.961553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0caedd0bc41435c9426ee622b9d2113'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:00.967357 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:00.977282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0caedd0bc41435c9426ee622b9d2113'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:00.980928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0caedd0bc41435c9426ee622b9d2113'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:01.003972 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1518/3013] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:10:00 2022] DELETE /identity/v3/users/d0caedd0bc41435c9426ee622b9d2113 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:01.008369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4852ef-b5e9-40e5-a4d7-996aec1e2593 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:01.008830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4852ef-b5e9-40e5-a4d7-996aec1e2593 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:01.009026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4852ef-b5e9-40e5-a4d7-996aec1e2593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:01.069161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7f4852ef-b5e9-40e5-a4d7-996aec1e2593 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:01.071043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7f4852ef-b5e9-40e5-a4d7-996aec1e2593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:01.178458 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1496/3014] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:01.201744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:01.207284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:01.322470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80453c3-e933-4b4a-9aad-38b2e3c554fd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:01.326779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672581e-71d4-4c67-8dc8-6ed2466ac249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:01.327598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672581e-71d4-4c67-8dc8-6ed2466ac249 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:01.327877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672581e-71d4-4c67-8dc8-6ed2466ac249 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:01.328740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672581e-71d4-4c67-8dc8-6ed2466ac249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:01.341644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672581e-71d4-4c67-8dc8-6ed2466ac249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:01.344511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672581e-71d4-4c67-8dc8-6ed2466ac249 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:01.357103 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1519/3015] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:01.624660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4852ef-b5e9-40e5-a4d7-996aec1e2593 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:01.627125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7f4852ef-b5e9-40e5-a4d7-996aec1e2593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:01.647537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4852ef-b5e9-40e5-a4d7-996aec1e2593 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:01.666374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:01.667276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:01.667702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:01.668308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] PATH_INFO: `/v3/projects/9b63ec6e0e3c4f268e63ae8da2ffe884` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:01.672021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b63ec6e0e3c4f268e63ae8da2ffe884)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:01.676150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:01.772598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'request_id': 'req-9869bc6b-067e-4474-83a5-fd2a41aa2996'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:01.781086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'request_id': 'req-9869bc6b-067e-4474-83a5-fd2a41aa2996'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:01.793115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'request_id': 'req-9869bc6b-067e-4474-83a5-fd2a41aa2996'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:01.810002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] The token cache is being invalidate because project 9b63ec6e0e3c4f268e63ae8da2ffe884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:01.811217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:01.812204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:01.814364 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1497/3016] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:01 2022] DELETE /identity/v3/projects/9b63ec6e0e3c4f268e63ae8da2ffe884 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:01.820745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672581e-71d4-4c67-8dc8-6ed2466ac249 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:01.851284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672581e-71d4-4c67-8dc8-6ed2466ac249 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:02.000906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d35b2-b244-46ba-b80e-961f0639089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:02.002259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d35b2-b244-46ba-b80e-961f0639089f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:02.002716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d35b2-b244-46ba-b80e-961f0639089f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:02.005491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d35b2-b244-46ba-b80e-961f0639089f admin admin] PATH_INFO: `/v3/users/9eec60746b3b409e91a3e8942fe1c73c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:02.008437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d35b2-b244-46ba-b80e-961f0639089f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eec60746b3b409e91a3e8942fe1c73c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:02.015228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d35b2-b244-46ba-b80e-961f0639089f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:02.179382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-254d35b2-b244-46ba-b80e-961f0639089f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eec60746b3b409e91a3e8942fe1c73c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:02.180607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-254d35b2-b244-46ba-b80e-961f0639089f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eec60746b3b409e91a3e8942fe1c73c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:02.260254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-254d35b2-b244-46ba-b80e-961f0639089f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eec60746b3b409e91a3e8942fe1c73c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:02.309875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-254d35b2-b244-46ba-b80e-961f0639089f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eec60746b3b409e91a3e8942fe1c73c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:02.311153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-254d35b2-b244-46ba-b80e-961f0639089f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eec60746b3b409e91a3e8942fe1c73c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:02.353824 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1520/3017] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:10:01 2022] DELETE /identity/v3/users/9eec60746b3b409e91a3e8942fe1c73c => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:02.390549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:02.392915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:02.421970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869bc6b-067e-4474-83a5-fd2a41aa2996 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:02.565271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:02.566014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:02.566293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:02.566565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] PATH_INFO: `/v3/users/875dca9ed4914e379601ddbdba035cb2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:02.567918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=875dca9ed4914e379601ddbdba035cb2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:02.570109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:02.577362 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:02.667348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '875dca9ed4914e379601ddbdba035cb2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:02.678418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '875dca9ed4914e379601ddbdba035cb2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:02.708306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '875dca9ed4914e379601ddbdba035cb2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:02.719520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '875dca9ed4914e379601ddbdba035cb2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:02.720195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '875dca9ed4914e379601ddbdba035cb2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:02.749713 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1498/3018] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:10:02 2022] DELETE /identity/v3/users/875dca9ed4914e379601ddbdba035cb2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:02.865149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14f955-8fa3-4165-bd68-eac26c3d3d06 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:02.865639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14f955-8fa3-4165-bd68-eac26c3d3d06 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:02.865715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14f955-8fa3-4165-bd68-eac26c3d3d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:02.913406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ad14f955-8fa3-4165-bd68-eac26c3d3d06 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:02.914623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ad14f955-8fa3-4165-bd68-eac26c3d3d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:02.927369 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:03.089051 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1521/3019] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:03.093245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:03.095640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:03.110358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37c6f3-2d7c-4466-a0d2-ae6b918f5ff8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:03.110646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37c6f3-2d7c-4466-a0d2-ae6b918f5ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:03.110978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37c6f3-2d7c-4466-a0d2-ae6b918f5ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:03.155761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4f37c6f3-2d7c-4466-a0d2-ae6b918f5ff8 None None] MFA Rules not processed for user `2d7df9a6845440bbad5bd7c0a192171b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:03.163717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4f37c6f3-2d7c-4466-a0d2-ae6b918f5ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:03.263048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee7bc-8796-469d-ab31-4979952c5901 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:03.293905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2e86c-781c-4604-af25-8d905ff63445 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:03.294547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2e86c-781c-4604-af25-8d905ff63445 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:03.294942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2e86c-781c-4604-af25-8d905ff63445 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:03.295394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2e86c-781c-4604-af25-8d905ff63445 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:03.334326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2e86c-781c-4604-af25-8d905ff63445 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:03.360958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2e86c-781c-4604-af25-8d905ff63445 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:03.387649 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1522/3020] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:10:03.388566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37c6f3-2d7c-4466-a0d2-ae6b918f5ff8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:03.389949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4f37c6f3-2d7c-4466-a0d2-ae6b918f5ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:03.395611 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1499/3021] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:03.610798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2e86c-781c-4604-af25-8d905ff63445 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:03.612290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aea2e86c-781c-4604-af25-8d905ff63445 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:03.614230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37c6f3-2d7c-4466-a0d2-ae6b918f5ff8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:03.624759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b554b48-a278-48ef-acb2-d1b541ed76c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:03.625416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b554b48-a278-48ef-acb2-d1b541ed76c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:03.625696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b554b48-a278-48ef-acb2-d1b541ed76c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:03.625970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b554b48-a278-48ef-acb2-d1b541ed76c4 admin admin] PATH_INFO: `/v3/projects/2d294ef805184d7ca640b17b0d696056` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:03.627850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b554b48-a278-48ef-acb2-d1b541ed76c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d294ef805184d7ca640b17b0d696056)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:03.629945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b554b48-a278-48ef-acb2-d1b541ed76c4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:03.637504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2e86c-781c-4604-af25-8d905ff63445 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:03.653124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:03.653984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:03.655023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:03.655772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b admin admin] PATH_INFO: `/v3/projects/880e05820ad14f60888593d56af81f70` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:03.656941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b admin admin] RBAC: Authorizing `identity:delete_project(project_id=880e05820ad14f60888593d56af81f70)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:03.659199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:03.732120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9b554b48-a278-48ef-acb2-d1b541ed76c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d294ef805184d7ca640b17b0d696056', 'request_id': 'req-9b554b48-a278-48ef-acb2-d1b541ed76c4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:03.739937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9b554b48-a278-48ef-acb2-d1b541ed76c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d294ef805184d7ca640b17b0d696056', 'request_id': 'req-9b554b48-a278-48ef-acb2-d1b541ed76c4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:03.751940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9b554b48-a278-48ef-acb2-d1b541ed76c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d294ef805184d7ca640b17b0d696056', 'request_id': 'req-9b554b48-a278-48ef-acb2-d1b541ed76c4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:03.753835 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:03.777296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9b554b48-a278-48ef-acb2-d1b541ed76c4 admin admin] The token cache is being invalidate because project 2d294ef805184d7ca640b17b0d696056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:03.777597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9b554b48-a278-48ef-acb2-d1b541ed76c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:03.780565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9b554b48-a278-48ef-acb2-d1b541ed76c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:03.790951 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1523/3022] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:03 2022] DELETE /identity/v3/projects/2d294ef805184d7ca640b17b0d696056 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:03.793306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc696f8-0d4b-4ee3-bc77-ccce5933c3c4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:03.793747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc696f8-0d4b-4ee3-bc77-ccce5933c3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:03.794074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc696f8-0d4b-4ee3-bc77-ccce5933c3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:03.848358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5dc696f8-0d4b-4ee3-bc77-ccce5933c3c4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:03.852283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5dc696f8-0d4b-4ee3-bc77-ccce5933c3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:03.864960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880e05820ad14f60888593d56af81f70', 'request_id': 'req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:03.875895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880e05820ad14f60888593d56af81f70', 'request_id': 'req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:03.913862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880e05820ad14f60888593d56af81f70', 'request_id': 'req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:03.930951 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:03.945101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b admin admin] The token cache is being invalidate because project 880e05820ad14f60888593d56af81f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:03.946897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:03.948268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ed8c6cd3-3c58-4df6-b538-91bcb6b5221b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:03.960570 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1500/3023] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:03 2022] DELETE /identity/v3/projects/880e05820ad14f60888593d56af81f70 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:10:03.971466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224c7f-aa70-4d45-aab4-a32c3a93ee42 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:03.971979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224c7f-aa70-4d45-aab4-a32c3a93ee42 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:03.973659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224c7f-aa70-4d45-aab4-a32c3a93ee42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:03.989368 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1524/3024] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:03.991047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3ebfa-b4ae-4c41-9ab3-a187896388fb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:03.992809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3ebfa-b4ae-4c41-9ab3-a187896388fb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:03.993094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3ebfa-b4ae-4c41-9ab3-a187896388fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:04.024878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-92d3ebfa-b4ae-4c41-9ab3-a187896388fb None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:04.026339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-92d3ebfa-b4ae-4c41-9ab3-a187896388fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:04.039417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b7224c7f-aa70-4d45-aab4-a32c3a93ee42 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:04.039417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b7224c7f-aa70-4d45-aab4-a32c3a93ee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:04.040100 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1525/3025] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:04.041460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3ebfa-b4ae-4c41-9ab3-a187896388fb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:04.054874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3ebfa-b4ae-4c41-9ab3-a187896388fb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:04.064384 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1501/3026] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:04.065999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dd250-21b0-4b91-92f3-1701c1d4be36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:04.072195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dd250-21b0-4b91-92f3-1701c1d4be36 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:04.072699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dd250-21b0-4b91-92f3-1701c1d4be36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:04.073127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dd250-21b0-4b91-92f3-1701c1d4be36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:04.074003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dd250-21b0-4b91-92f3-1701c1d4be36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:10:04.074460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dd250-21b0-4b91-92f3-1701c1d4be36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:04.078708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dd250-21b0-4b91-92f3-1701c1d4be36 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:04.090547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20284f4e-a7ca-420f-b717-3f70c431cf63 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:04.091103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20284f4e-a7ca-420f-b717-3f70c431cf63 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:04.091556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20284f4e-a7ca-420f-b717-3f70c431cf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:04.114565 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1526/3027] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:10:04.116112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dd250-21b0-4b91-92f3-1701c1d4be36 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:04.151542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-20284f4e-a7ca-420f-b717-3f70c431cf63 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:04.151742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dd250-21b0-4b91-92f3-1701c1d4be36 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:04.154453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-20284f4e-a7ca-420f-b717-3f70c431cf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:04.165141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343dab3-2508-4e6d-ab8e-bc307ffb0e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:04.165859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343dab3-2508-4e6d-ab8e-bc307ffb0e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:04.166399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343dab3-2508-4e6d-ab8e-bc307ffb0e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:04.166682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343dab3-2508-4e6d-ab8e-bc307ffb0e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:04.168431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343dab3-2508-4e6d-ab8e-bc307ffb0e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:04.179805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343dab3-2508-4e6d-ab8e-bc307ffb0e52 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:04.188378 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1502/3028] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:04.191303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20284f4e-a7ca-420f-b717-3f70c431cf63 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:04.219253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20284f4e-a7ca-420f-b717-3f70c431cf63 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:04.234951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f809e5d-7967-456e-a3cd-da2db0f6fea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:04.235366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f809e5d-7967-456e-a3cd-da2db0f6fea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:04.236388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f809e5d-7967-456e-a3cd-da2db0f6fea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:04.236671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f809e5d-7967-456e-a3cd-da2db0f6fea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:04.237323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f809e5d-7967-456e-a3cd-da2db0f6fea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:10:04.237623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f809e5d-7967-456e-a3cd-da2db0f6fea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:04.243682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f809e5d-7967-456e-a3cd-da2db0f6fea6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:04.278905 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1503/3029] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:10:04.284736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f809e5d-7967-456e-a3cd-da2db0f6fea6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:04.298948 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1527/3030] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:04 2022] POST /identity/v3/projects => generated 393 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:04.300262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f809e5d-7967-456e-a3cd-da2db0f6fea6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:04.303853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343dab3-2508-4e6d-ab8e-bc307ffb0e52 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:04.421250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbcde9-6f8f-41e2-9b8e-137ae5cafc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:04.422070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbcde9-6f8f-41e2-9b8e-137ae5cafc9e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:04.423193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbcde9-6f8f-41e2-9b8e-137ae5cafc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:04.423536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbcde9-6f8f-41e2-9b8e-137ae5cafc9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:04.424587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbcde9-6f8f-41e2-9b8e-137ae5cafc9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:04.426798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbcde9-6f8f-41e2-9b8e-137ae5cafc9e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:04.465523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343dab3-2508-4e6d-ab8e-bc307ffb0e52 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:04.488608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dbe3f-bf79-4ba5-b4d1-e408bd089e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:04.489679 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1504/3031] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:04 2022] POST /identity/v3/projects => generated 393 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:10:04.489994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dbe3f-bf79-4ba5-b4d1-e408bd089e0c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:04.490376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dbe3f-bf79-4ba5-b4d1-e408bd089e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:04.490645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dbe3f-bf79-4ba5-b4d1-e408bd089e0c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:04.491847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42dbe3f-bf79-4ba5-b4d1-e408bd089e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:04.493926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42dbe3f-bf79-4ba5-b4d1-e408bd089e0c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:04.497511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbcde9-6f8f-41e2-9b8e-137ae5cafc9e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:04.577602 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1528/3032] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:04 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:04.587823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dbe3f-bf79-4ba5-b4d1-e408bd089e0c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:04.606164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dbe3f-bf79-4ba5-b4d1-e408bd089e0c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:04.706246 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:04.714198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbcde9-6f8f-41e2-9b8e-137ae5cafc9e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:04.735278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42d012-de4a-4c07-8af8-c66efe018d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:04.736211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42d012-de4a-4c07-8af8-c66efe018d21 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:04.736670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42d012-de4a-4c07-8af8-c66efe018d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:04.737095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42d012-de4a-4c07-8af8-c66efe018d21 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:04.738656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42d012-de4a-4c07-8af8-c66efe018d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:04.742616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42d012-de4a-4c07-8af8-c66efe018d21 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:04.795850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489df52-bbea-4948-b30d-6cdfba2b4921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:04.797141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489df52-bbea-4948-b30d-6cdfba2b4921 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:04.797571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489df52-bbea-4948-b30d-6cdfba2b4921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:04.797848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489df52-bbea-4948-b30d-6cdfba2b4921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:04.798374 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1505/3033] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:04 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:04.798744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489df52-bbea-4948-b30d-6cdfba2b4921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:04.800562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489df52-bbea-4948-b30d-6cdfba2b4921 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:04.804102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42d012-de4a-4c07-8af8-c66efe018d21 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:04.813848 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1529/3034] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:04.814742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489df52-bbea-4948-b30d-6cdfba2b4921 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:04.815116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8c42d012-de4a-4c07-8af8-c66efe018d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:04.826462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489df52-bbea-4948-b30d-6cdfba2b4921 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:04.831924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e304a-8688-4bc1-ae3c-774d1e629199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:04.832541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e304a-8688-4bc1-ae3c-774d1e629199 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:04.832819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e304a-8688-4bc1-ae3c-774d1e629199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:04.833089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e304a-8688-4bc1-ae3c-774d1e629199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:04.834445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e304a-8688-4bc1-ae3c-774d1e629199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:04.835809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e304a-8688-4bc1-ae3c-774d1e629199 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:04.854254 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1530/3035] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:04.855349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e304a-8688-4bc1-ae3c-774d1e629199 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:04.868407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42d012-de4a-4c07-8af8-c66efe018d21 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:04.884386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323d8ec-4af8-4868-8125-d21aba19ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:04.885034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323d8ec-4af8-4868-8125-d21aba19ca0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:04.885309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323d8ec-4af8-4868-8125-d21aba19ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:04.889178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323d8ec-4af8-4868-8125-d21aba19ca0d admin admin] PATH_INFO: `/v3/users/bc122b9d7abf459fa506adcdbc0e4c50` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:04.889479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e304a-8688-4bc1-ae3c-774d1e629199 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:04.891342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323d8ec-4af8-4868-8125-d21aba19ca0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc122b9d7abf459fa506adcdbc0e4c50)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:04.897240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323d8ec-4af8-4868-8125-d21aba19ca0d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:04.901400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e18441-f3e5-4323-a6a5-076c6def3494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:04.902016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e18441-f3e5-4323-a6a5-076c6def3494 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:04.902299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e18441-f3e5-4323-a6a5-076c6def3494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:04.903215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e18441-f3e5-4323-a6a5-076c6def3494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:04.903877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e18441-f3e5-4323-a6a5-076c6def3494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:04.906114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e18441-f3e5-4323-a6a5-076c6def3494 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:04.936496 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1531/3036] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:04.936496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e18441-f3e5-4323-a6a5-076c6def3494 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:04.946616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e18441-f3e5-4323-a6a5-076c6def3494 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:04.952586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769c44-fc8b-4f95-a2a1-662814b47069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:04.953278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769c44-fc8b-4f95-a2a1-662814b47069 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:04.953557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769c44-fc8b-4f95-a2a1-662814b47069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:04.953832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769c44-fc8b-4f95-a2a1-662814b47069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:04.954484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef769c44-fc8b-4f95-a2a1-662814b47069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:04.956374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef769c44-fc8b-4f95-a2a1-662814b47069 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:04.970937 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1532/3037] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:04.972158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769c44-fc8b-4f95-a2a1-662814b47069 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:05.001905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769c44-fc8b-4f95-a2a1-662814b47069 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:05.016892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2139ca6-a3b6-41a7-8d0e-1cb2db215b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:05.019829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2139ca6-a3b6-41a7-8d0e-1cb2db215b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:05.020338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2139ca6-a3b6-41a7-8d0e-1cb2db215b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:05.020689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2139ca6-a3b6-41a7-8d0e-1cb2db215b94 admin admin] PATH_INFO: `/v3/projects/8dfcf1d8ad1d4fa9bfc92b9112306793/users/e0650f2323bb460494dcab303fffc62d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:05.030454 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:05.070145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b323d8ec-4af8-4868-8125-d21aba19ca0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc122b9d7abf459fa506adcdbc0e4c50'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:05.072252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b323d8ec-4af8-4868-8125-d21aba19ca0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc122b9d7abf459fa506adcdbc0e4c50'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:05.088924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2139ca6-a3b6-41a7-8d0e-1cb2db215b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dfcf1d8ad1d4fa9bfc92b9112306793, user_id=e0650f2323bb460494dcab303fffc62d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:05.092272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2139ca6-a3b6-41a7-8d0e-1cb2db215b94 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:05.107389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b323d8ec-4af8-4868-8125-d21aba19ca0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc122b9d7abf459fa506adcdbc0e4c50'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:05.124549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b323d8ec-4af8-4868-8125-d21aba19ca0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc122b9d7abf459fa506adcdbc0e4c50'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:05.125655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b323d8ec-4af8-4868-8125-d21aba19ca0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc122b9d7abf459fa506adcdbc0e4c50'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:05.145976 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1533/3038] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:04 2022] PUT /identity/v3/projects/8dfcf1d8ad1d4fa9bfc92b9112306793/users/e0650f2323bb460494dcab303fffc62d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:05.147296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2139ca6-a3b6-41a7-8d0e-1cb2db215b94 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:05.162950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b2139ca6-a3b6-41a7-8d0e-1cb2db215b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:05.208498 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1506/3039] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:10:04 2022] DELETE /identity/v3/users/bc122b9d7abf459fa506adcdbc0e4c50 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:05.218639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244a269-dc4e-4e73-8845-ef0f7db918b2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:05.218639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244a269-dc4e-4e73-8845-ef0f7db918b2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:05.219319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244a269-dc4e-4e73-8845-ef0f7db918b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:05.314628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7244a269-dc4e-4e73-8845-ef0f7db918b2 None None] MFA Rules not processed for user `e0650f2323bb460494dcab303fffc62d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:05.317608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7244a269-dc4e-4e73-8845-ef0f7db918b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:05.429815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2139ca6-a3b6-41a7-8d0e-1cb2db215b94 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:05.478122 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1507/3040] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:05.480012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d22a1-9238-4989-b640-2a66a98c638a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:05.480332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d22a1-9238-4989-b640-2a66a98c638a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:05.480607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d22a1-9238-4989-b640-2a66a98c638a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:05.509793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e51d22a1-9238-4989-b640-2a66a98c638a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:05.511345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e51d22a1-9238-4989-b640-2a66a98c638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:05.660507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7e244-4177-48bc-90bd-22428d0241e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:05.661192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7e244-4177-48bc-90bd-22428d0241e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:05.661474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7e244-4177-48bc-90bd-22428d0241e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:05.661751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7e244-4177-48bc-90bd-22428d0241e0 admin admin] PATH_INFO: `/v3/projects/380d48805a1544d19327c51762bb4ac9/users/b81ffd4e8de04c69a577e41d685d04e3/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:05.724479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7e244-4177-48bc-90bd-22428d0241e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380d48805a1544d19327c51762bb4ac9, user_id=b81ffd4e8de04c69a577e41d685d04e3, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:05.727237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7e244-4177-48bc-90bd-22428d0241e0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:05.743672 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:05.750360 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1534/3041] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:05 2022] PUT /identity/v3/projects/380d48805a1544d19327c51762bb4ac9/users/b81ffd4e8de04c69a577e41d685d04e3/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:05.762824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7e244-4177-48bc-90bd-22428d0241e0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:05.768810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b9d7e244-4177-48bc-90bd-22428d0241e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:05.770945 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1508/3042] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:05.781471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328887a9-db98-416d-81bf-b98089fef7eb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:05.781758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328887a9-db98-416d-81bf-b98089fef7eb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:05.782040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328887a9-db98-416d-81bf-b98089fef7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:05.921819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-328887a9-db98-416d-81bf-b98089fef7eb None None] MFA Rules not processed for user `b81ffd4e8de04c69a577e41d685d04e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:05.923095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-328887a9-db98-416d-81bf-b98089fef7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:05.980624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7e244-4177-48bc-90bd-22428d0241e0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:05.987271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a103625-4f30-475a-adb7-53e62a00e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:05.988060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a103625-4f30-475a-adb7-53e62a00e178 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:05.988673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a103625-4f30-475a-adb7-53e62a00e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:05.989085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a103625-4f30-475a-adb7-53e62a00e178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:05.990014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a103625-4f30-475a-adb7-53e62a00e178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:05.992558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a103625-4f30-475a-adb7-53e62a00e178 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:06.050644 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1535/3043] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:05 2022] POST /identity/v3/projects => generated 391 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:06.052516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a103625-4f30-475a-adb7-53e62a00e178 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:06.053202 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:06.060225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4a103625-4f30-475a-adb7-53e62a00e178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:06.185108 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1509/3044] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:06.189348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328887a9-db98-416d-81bf-b98089fef7eb None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:06.228699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328887a9-db98-416d-81bf-b98089fef7eb None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:06.236185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a103625-4f30-475a-adb7-53e62a00e178 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:06.255110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d517e1-d47e-46ac-a3c0-d765cce707ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:06.255743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d517e1-d47e-46ac-a3c0-d765cce707ea service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:06.256016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d517e1-d47e-46ac-a3c0-d765cce707ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:06.256286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d517e1-d47e-46ac-a3c0-d765cce707ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:06.457866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d517e1-d47e-46ac-a3c0-d765cce707ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:06.459354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d517e1-d47e-46ac-a3c0-d765cce707ea service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:06.491773 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1536/3045] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:06.494113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ef445-10f7-4e8d-aa17-fd282d1b73dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:06.494741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef445-10f7-4e8d-aa17-fd282d1b73dc admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:06.495058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef445-10f7-4e8d-aa17-fd282d1b73dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:06.495318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef445-10f7-4e8d-aa17-fd282d1b73dc admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:06.495805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d517e1-d47e-46ac-a3c0-d765cce707ea service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:06.495934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ef445-10f7-4e8d-aa17-fd282d1b73dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:06.499482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-48d517e1-d47e-46ac-a3c0-d765cce707ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:06.509250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ef445-10f7-4e8d-aa17-fd282d1b73dc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:06.586817 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1510/3046] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:06 2022] POST /identity/v3/users => generated 302 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:06.597971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ef445-10f7-4e8d-aa17-fd282d1b73dc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:06.614821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ef445-10f7-4e8d-aa17-fd282d1b73dc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:06.621685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43b1a5-01ee-4759-a8c9-650b87dd9eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:06.622374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43b1a5-01ee-4759-a8c9-650b87dd9eef admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:06.622714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43b1a5-01ee-4759-a8c9-650b87dd9eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:06.623720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43b1a5-01ee-4759-a8c9-650b87dd9eef admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:06.624573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43b1a5-01ee-4759-a8c9-650b87dd9eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:06.626382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43b1a5-01ee-4759-a8c9-650b87dd9eef admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:06.637783 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:06.646501 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1511/3047] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:06.650492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43b1a5-01ee-4759-a8c9-650b87dd9eef admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:06.676747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43b1a5-01ee-4759-a8c9-650b87dd9eef admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:06.691449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94c0c-9ce9-45cf-80cd-2489df6fa850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:06.692211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94c0c-9ce9-45cf-80cd-2489df6fa850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:06.692559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94c0c-9ce9-45cf-80cd-2489df6fa850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:06.694384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94c0c-9ce9-45cf-80cd-2489df6fa850 admin admin] PATH_INFO: `/v3/projects/94d80ca9deb240349103dee5843ff740/users/98711c7997fd47beb19f8357d6dd1e76/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:06.740595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d94c0c-9ce9-45cf-80cd-2489df6fa850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d80ca9deb240349103dee5843ff740, user_id=98711c7997fd47beb19f8357d6dd1e76, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:06.749483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d94c0c-9ce9-45cf-80cd-2489df6fa850 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:06.778417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d517e1-d47e-46ac-a3c0-d765cce707ea service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:06.787545 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1512/3048] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:06 2022] PUT /identity/v3/projects/94d80ca9deb240349103dee5843ff740/users/98711c7997fd47beb19f8357d6dd1e76/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:06.788875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94c0c-9ce9-45cf-80cd-2489df6fa850 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:06.905749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94c0c-9ce9-45cf-80cd-2489df6fa850 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:06.914679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e803ed-c421-4fb7-b414-e5bb74ccda96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:06.915387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e803ed-c421-4fb7-b414-e5bb74ccda96 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:06.915665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e803ed-c421-4fb7-b414-e5bb74ccda96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:06.915998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e803ed-c421-4fb7-b414-e5bb74ccda96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:06.917495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e803ed-c421-4fb7-b414-e5bb74ccda96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:06.919127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e803ed-c421-4fb7-b414-e5bb74ccda96 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:06.932911 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1513/3049] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:10:06.942344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e803ed-c421-4fb7-b414-e5bb74ccda96 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:06.969684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e803ed-c421-4fb7-b414-e5bb74ccda96 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:06.980695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51a4b0-ad44-4c49-b79a-f1b85658a30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:06.981732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51a4b0-ad44-4c49-b79a-f1b85658a30f admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:06.981993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51a4b0-ad44-4c49-b79a-f1b85658a30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:06.982886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51a4b0-ad44-4c49-b79a-f1b85658a30f admin admin] PATH_INFO: `/v3/projects/94d80ca9deb240349103dee5843ff740/users/98711c7997fd47beb19f8357d6dd1e76/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:06.988177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51a4b0-ad44-4c49-b79a-f1b85658a30f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d80ca9deb240349103dee5843ff740, user_id=98711c7997fd47beb19f8357d6dd1e76, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:06.990945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51a4b0-ad44-4c49-b79a-f1b85658a30f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:07.028549 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1514/3050] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:06 2022] PUT /identity/v3/projects/94d80ca9deb240349103dee5843ff740/users/98711c7997fd47beb19f8357d6dd1e76/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:07.031016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20f48c-0447-4225-a8e4-117c254ef8b5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:07.032419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20f48c-0447-4225-a8e4-117c254ef8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:07.033532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20f48c-0447-4225-a8e4-117c254ef8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:07.055111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2464154-117b-45b2-b15d-c4f88aac36a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:07.056618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2464154-117b-45b2-b15d-c4f88aac36a1 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:07.060549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2464154-117b-45b2-b15d-c4f88aac36a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:07.061022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2464154-117b-45b2-b15d-c4f88aac36a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:07.087355 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:07.096560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3c20f48c-0447-4225-a8e4-117c254ef8b5 None None] MFA Rules not processed for user `98711c7997fd47beb19f8357d6dd1e76`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:07.100653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3c20f48c-0447-4225-a8e4-117c254ef8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:07.285513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2464154-117b-45b2-b15d-c4f88aac36a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:07.305969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2464154-117b-45b2-b15d-c4f88aac36a1 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:07.348001 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1515/3051] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:07.360456 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1537/3052] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 868 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:07.441812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20f48c-0447-4225-a8e4-117c254ef8b5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:07.443363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3c20f48c-0447-4225-a8e4-117c254ef8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:07.748966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20f48c-0447-4225-a8e4-117c254ef8b5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:07.760709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ddfd1-b5f3-480e-be0b-261ee20de0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:07.770768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ddfd1-b5f3-480e-be0b-261ee20de0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:07.771159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ddfd1-b5f3-480e-be0b-261ee20de0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:07.771487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ddfd1-b5f3-480e-be0b-261ee20de0e9 admin admin] PATH_INFO: `/v3/projects/021b1335de664adea720f7b92f00cff5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:07.773269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ddfd1-b5f3-480e-be0b-261ee20de0e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=021b1335de664adea720f7b92f00cff5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:07.787719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ddfd1-b5f3-480e-be0b-261ee20de0e9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:07.792862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2464154-117b-45b2-b15d-c4f88aac36a1 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:07.799003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c2464154-117b-45b2-b15d-c4f88aac36a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:07.843242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2464154-117b-45b2-b15d-c4f88aac36a1 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:07.930566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-071ddfd1-b5f3-480e-be0b-261ee20de0e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021b1335de664adea720f7b92f00cff5', 'request_id': 'req-071ddfd1-b5f3-480e-be0b-261ee20de0e9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:07.955309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-071ddfd1-b5f3-480e-be0b-261ee20de0e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021b1335de664adea720f7b92f00cff5', 'request_id': 'req-071ddfd1-b5f3-480e-be0b-261ee20de0e9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:07.969249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-071ddfd1-b5f3-480e-be0b-261ee20de0e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021b1335de664adea720f7b92f00cff5', 'request_id': 'req-071ddfd1-b5f3-480e-be0b-261ee20de0e9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:07.984094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-071ddfd1-b5f3-480e-be0b-261ee20de0e9 admin admin] The token cache is being invalidate because project 021b1335de664adea720f7b92f00cff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:07.984792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-071ddfd1-b5f3-480e-be0b-261ee20de0e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:07.985201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-071ddfd1-b5f3-480e-be0b-261ee20de0e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:07.996553 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1516/3053] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:07 2022] DELETE /identity/v3/projects/021b1335de664adea720f7b92f00cff5 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:07.999080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3945572-e1e7-4e31-9d58-97a112821d75 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:07.999372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3945572-e1e7-4e31-9d58-97a112821d75 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:07.999648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3945572-e1e7-4e31-9d58-97a112821d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:08.041310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f2b4d-7adf-4bc3-acfd-448bd05b5563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:08.041938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f2b4d-7adf-4bc3-acfd-448bd05b5563 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:08.046715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f2b4d-7adf-4bc3-acfd-448bd05b5563 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:08.047053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f2b4d-7adf-4bc3-acfd-448bd05b5563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:08.048955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-195f2b4d-7adf-4bc3-acfd-448bd05b5563 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:08.051389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c3945572-e1e7-4e31-9d58-97a112821d75 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:08.054332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c3945572-e1e7-4e31-9d58-97a112821d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:08.058432 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:08.064828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f2b4d-7adf-4bc3-acfd-448bd05b5563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:08.068320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f2b4d-7adf-4bc3-acfd-448bd05b5563 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:08.084692 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1538/3054] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:10:08.117755 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:08.212503 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1517/3055] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:08.213362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f340639-1760-45b3-a417-13f0cad1783e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:08.213725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f340639-1760-45b3-a417-13f0cad1783e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:08.214065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f340639-1760-45b3-a417-13f0cad1783e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:08.253034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4f340639-1760-45b3-a417-13f0cad1783e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:08.254255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4f340639-1760-45b3-a417-13f0cad1783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:08.287815 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1539/3056] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:10:08.291635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3945572-e1e7-4e31-9d58-97a112821d75 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:08.291837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f340639-1760-45b3-a417-13f0cad1783e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:08.293172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c3945572-e1e7-4e31-9d58-97a112821d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:08.308879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f340639-1760-45b3-a417-13f0cad1783e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:08.322900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a668d2e-3fd3-4dbc-8c61-f1d299f85007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:08.323642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a668d2e-3fd3-4dbc-8c61-f1d299f85007 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:08.324178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a668d2e-3fd3-4dbc-8c61-f1d299f85007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:08.324508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a668d2e-3fd3-4dbc-8c61-f1d299f85007 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:08.325213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a668d2e-3fd3-4dbc-8c61-f1d299f85007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:10:08.325567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a668d2e-3fd3-4dbc-8c61-f1d299f85007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:08.332780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a668d2e-3fd3-4dbc-8c61-f1d299f85007 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:08.362787 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1540/3057] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:10:08.367165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a668d2e-3fd3-4dbc-8c61-f1d299f85007 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:08.398398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a668d2e-3fd3-4dbc-8c61-f1d299f85007 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:08.428776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b401-0e7d-4966-bc0c-fa2fb55c28bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:08.431171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b401-0e7d-4966-bc0c-fa2fb55c28bf admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:08.432219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b401-0e7d-4966-bc0c-fa2fb55c28bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:08.433383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b401-0e7d-4966-bc0c-fa2fb55c28bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:08.435576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069b401-0e7d-4966-bc0c-fa2fb55c28bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:08.443420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069b401-0e7d-4966-bc0c-fa2fb55c28bf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:08.485899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3945572-e1e7-4e31-9d58-97a112821d75 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:08.504560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe1c3c-15ff-46f8-99bb-6dd39d71dad0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:08.505203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe1c3c-15ff-46f8-99bb-6dd39d71dad0 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:08.505485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe1c3c-15ff-46f8-99bb-6dd39d71dad0 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:08.505902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe1c3c-15ff-46f8-99bb-6dd39d71dad0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:08.508764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6ebe1c3c-15ff-46f8-99bb-6dd39d71dad0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:08.525720 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1541/3058] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:08 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:08.529827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b401-0e7d-4966-bc0c-fa2fb55c28bf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:08.668443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe1c3c-15ff-46f8-99bb-6dd39d71dad0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:08.670595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe1c3c-15ff-46f8-99bb-6dd39d71dad0 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:08.709484 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1518/3059] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:08 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:08.733395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe1c3c-15ff-46f8-99bb-6dd39d71dad0 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:08.736037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6ebe1c3c-15ff-46f8-99bb-6dd39d71dad0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:08.783907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe1c3c-15ff-46f8-99bb-6dd39d71dad0 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:08.814472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:08.816333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:08.818060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:08.818506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] PATH_INFO: `/v3/users/e0650f2323bb460494dcab303fffc62d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:08.823182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0650f2323bb460494dcab303fffc62d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:08.828559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:08.835822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b401-0e7d-4966-bc0c-fa2fb55c28bf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:08.855503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513c6b2-7935-4801-9055-20d79c1c888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:08.856279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513c6b2-7935-4801-9055-20d79c1c888f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:08.857017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513c6b2-7935-4801-9055-20d79c1c888f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:08.859335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513c6b2-7935-4801-9055-20d79c1c888f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:08.860103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513c6b2-7935-4801-9055-20d79c1c888f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:08.863019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513c6b2-7935-4801-9055-20d79c1c888f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:08.941845 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1542/3060] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:08 2022] POST /identity/v3/users => generated 287 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:10:08.943043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513c6b2-7935-4801-9055-20d79c1c888f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:08.946807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6513c6b2-7935-4801-9055-20d79c1c888f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:08.992527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0650f2323bb460494dcab303fffc62d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:08.994161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0650f2323bb460494dcab303fffc62d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:09.009782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513c6b2-7935-4801-9055-20d79c1c888f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:09.030621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319df7f-4fa5-4cb4-985e-dca5090be7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:09.031300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319df7f-4fa5-4cb4-985e-dca5090be7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:09.031576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319df7f-4fa5-4cb4-985e-dca5090be7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:09.031848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319df7f-4fa5-4cb4-985e-dca5090be7ac admin admin] PATH_INFO: `/v3/users/b81ffd4e8de04c69a577e41d685d04e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:09.038661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319df7f-4fa5-4cb4-985e-dca5090be7ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b81ffd4e8de04c69a577e41d685d04e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:09.040549 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:09.040721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319df7f-4fa5-4cb4-985e-dca5090be7ac admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:09.051215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0650f2323bb460494dcab303fffc62d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:09.083474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0650f2323bb460494dcab303fffc62d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:09.087239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0650f2323bb460494dcab303fffc62d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:09.141205 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1519/3061] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:10:08 2022] DELETE /identity/v3/users/e0650f2323bb460494dcab303fffc62d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:10:09.141205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:09.143775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:09.255566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6319df7f-4fa5-4cb4-985e-dca5090be7ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b81ffd4e8de04c69a577e41d685d04e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:09.257112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6319df7f-4fa5-4cb4-985e-dca5090be7ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b81ffd4e8de04c69a577e41d685d04e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:09.285120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6319df7f-4fa5-4cb4-985e-dca5090be7ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b81ffd4e8de04c69a577e41d685d04e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:09.305980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6319df7f-4fa5-4cb4-985e-dca5090be7ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b81ffd4e8de04c69a577e41d685d04e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:09.306700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6319df7f-4fa5-4cb4-985e-dca5090be7ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b81ffd4e8de04c69a577e41d685d04e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:09.355283 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1543/3062] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:10:08 2022] DELETE /identity/v3/users/b81ffd4e8de04c69a577e41d685d04e3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:09.356318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a6b80-da5d-417a-b294-9168222c946c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:09.356604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a6b80-da5d-417a-b294-9168222c946c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:09.356877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a6b80-da5d-417a-b294-9168222c946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:09.408318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eeab6-aa0c-4df4-9c80-93933ebf53c7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:09.433199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cb9a6b80-da5d-417a-b294-9168222c946c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:09.442623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cb9a6b80-da5d-417a-b294-9168222c946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:09.473924 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:09.626412 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1544/3063] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:09.627983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068e5c9-f7b5-4731-bc0c-08094b9ef58a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:09.629227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068e5c9-f7b5-4731-bc0c-08094b9ef58a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:09.629650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068e5c9-f7b5-4731-bc0c-08094b9ef58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:09.635102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e668211-b870-45e2-9caf-05bb0a50f7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:09.635873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e668211-b870-45e2-9caf-05bb0a50f7da admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:09.636308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e668211-b870-45e2-9caf-05bb0a50f7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:09.636689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e668211-b870-45e2-9caf-05bb0a50f7da admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:09.637445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e668211-b870-45e2-9caf-05bb0a50f7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:09.644246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e668211-b870-45e2-9caf-05bb0a50f7da admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:09.677469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0068e5c9-f7b5-4731-bc0c-08094b9ef58a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:09.680155 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1520/3064] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:09.682316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0068e5c9-f7b5-4731-bc0c-08094b9ef58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:09.683827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e668211-b870-45e2-9caf-05bb0a50f7da admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:09.692415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5e668211-b870-45e2-9caf-05bb0a50f7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:09.698794 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1545/3065] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:09.699853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068e5c9-f7b5-4731-bc0c-08094b9ef58a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:09.704478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0068e5c9-f7b5-4731-bc0c-08094b9ef58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:09.724614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e668211-b870-45e2-9caf-05bb0a50f7da admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:09.757107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2e0c9-8aac-4269-a844-83317f63a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:09.757910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2e0c9-8aac-4269-a844-83317f63a50c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:09.758339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2e0c9-8aac-4269-a844-83317f63a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:09.758752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2e0c9-8aac-4269-a844-83317f63a50c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:09.759605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2e0c9-8aac-4269-a844-83317f63a50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:09.763569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2e0c9-8aac-4269-a844-83317f63a50c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:09.792384 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1521/3066] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:09.794185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2e0c9-8aac-4269-a844-83317f63a50c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:09.800188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2de2e0c9-8aac-4269-a844-83317f63a50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:09.859825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068e5c9-f7b5-4731-bc0c-08094b9ef58a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:09.866228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a615e66-a8cb-4665-921d-be2af7d5f7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:09.867127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a615e66-a8cb-4665-921d-be2af7d5f7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:09.867408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a615e66-a8cb-4665-921d-be2af7d5f7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:09.871379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a615e66-a8cb-4665-921d-be2af7d5f7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:09.908662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a615e66-a8cb-4665-921d-be2af7d5f7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:09.910137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a615e66-a8cb-4665-921d-be2af7d5f7e0 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:09.932716 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1546/3067] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:09.933591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a615e66-a8cb-4665-921d-be2af7d5f7e0 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:09.958863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2e0c9-8aac-4269-a844-83317f63a50c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:09.971784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a615e66-a8cb-4665-921d-be2af7d5f7e0 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:09.972315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef761fa-a4de-4160-8a62-54f32682af22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:09.972952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef761fa-a4de-4160-8a62-54f32682af22 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:09.973231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef761fa-a4de-4160-8a62-54f32682af22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:09.973506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef761fa-a4de-4160-8a62-54f32682af22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:10.013531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42058dfd-73fe-4f13-a90c-f3101d74d192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:10.014556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058dfd-73fe-4f13-a90c-f3101d74d192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:10.019911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef761fa-a4de-4160-8a62-54f32682af22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:10.020044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058dfd-73fe-4f13-a90c-f3101d74d192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:10.020458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058dfd-73fe-4f13-a90c-f3101d74d192 admin admin] PATH_INFO: `/v3/projects/6c515ba81d4541abaf3b88e3786e6f61/users/35b70431e8c442b29659394bed48ec71/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:10.021286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef761fa-a4de-4160-8a62-54f32682af22 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:10.060489 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1522/3068] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:10.076683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42058dfd-73fe-4f13-a90c-f3101d74d192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c515ba81d4541abaf3b88e3786e6f61, user_id=35b70431e8c442b29659394bed48ec71, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:10.082899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42058dfd-73fe-4f13-a90c-f3101d74d192 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:10.123874 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1547/3069] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:09 2022] PUT /identity/v3/projects/6c515ba81d4541abaf3b88e3786e6f61/users/35b70431e8c442b29659394bed48ec71/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:10.136274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d545f3-bf44-444c-aa67-396be47bc88b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:10.136274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d545f3-bf44-444c-aa67-396be47bc88b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:10.137091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d545f3-bf44-444c-aa67-396be47bc88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:10.210303 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:10.216181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c3d545f3-bf44-444c-aa67-396be47bc88b None None] MFA Rules not processed for user `35b70431e8c442b29659394bed48ec71`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:10.220320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c3d545f3-bf44-444c-aa67-396be47bc88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:10.343985 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1523/3070] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:10.352370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42058dfd-73fe-4f13-a90c-f3101d74d192 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:10.354266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-42058dfd-73fe-4f13-a90c-f3101d74d192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:10.551545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42058dfd-73fe-4f13-a90c-f3101d74d192 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:10.569586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2052627-07cc-4c89-bca5-f2805c3f3664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:10.583549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2052627-07cc-4c89-bca5-f2805c3f3664 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:10.585912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2052627-07cc-4c89-bca5-f2805c3f3664 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:10.587259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2052627-07cc-4c89-bca5-f2805c3f3664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:10.643836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2052627-07cc-4c89-bca5-f2805c3f3664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:10.653169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2052627-07cc-4c89-bca5-f2805c3f3664 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:10.680923 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1548/3071] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:11.973833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d545f3-bf44-444c-aa67-396be47bc88b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:12.142089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d545f3-bf44-444c-aa67-396be47bc88b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:12.147083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c1942-3208-437a-b4ab-798fce741116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:12.147883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c1942-3208-437a-b4ab-798fce741116 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:12.148163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c1942-3208-437a-b4ab-798fce741116 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:12.148496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c1942-3208-437a-b4ab-798fce741116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:12.150564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c31c1942-3208-437a-b4ab-798fce741116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:12.183104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c1942-3208-437a-b4ab-798fce741116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:12.186137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c1942-3208-437a-b4ab-798fce741116 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:12.206684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2052627-07cc-4c89-bca5-f2805c3f3664 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:12.209321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a2052627-07cc-4c89-bca5-f2805c3f3664 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:12.236916 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1524/3072] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:12.239240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c1942-3208-437a-b4ab-798fce741116 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:12.241007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c31c1942-3208-437a-b4ab-798fce741116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:12.309933 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:12.417958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c1942-3208-437a-b4ab-798fce741116 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:12.434606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958260b5-245d-43b0-99e0-ce2ec0de50fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:12.436557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958260b5-245d-43b0-99e0-ce2ec0de50fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:12.436835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958260b5-245d-43b0-99e0-ce2ec0de50fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:12.437108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958260b5-245d-43b0-99e0-ce2ec0de50fb admin admin] PATH_INFO: `/v3/projects/380d48805a1544d19327c51762bb4ac9` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:12.439465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958260b5-245d-43b0-99e0-ce2ec0de50fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=380d48805a1544d19327c51762bb4ac9)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:12.441378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958260b5-245d-43b0-99e0-ce2ec0de50fb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:12.478636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2052627-07cc-4c89-bca5-f2805c3f3664 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:12.485446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:12.486620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:12.487221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:12.487988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] PATH_INFO: `/v3/projects/8dfcf1d8ad1d4fa9bfc92b9112306793` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:12.489570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dfcf1d8ad1d4fa9bfc92b9112306793)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:12.491980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:12.601723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dfcf1d8ad1d4fa9bfc92b9112306793', 'request_id': 'req-598e290b-ab03-41b2-8054-95c1dfac5dc7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:12.607451 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:12.610279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-958260b5-245d-43b0-99e0-ce2ec0de50fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380d48805a1544d19327c51762bb4ac9', 'request_id': 'req-958260b5-245d-43b0-99e0-ce2ec0de50fb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:12.624659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dfcf1d8ad1d4fa9bfc92b9112306793', 'request_id': 'req-598e290b-ab03-41b2-8054-95c1dfac5dc7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:12.639433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-958260b5-245d-43b0-99e0-ce2ec0de50fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380d48805a1544d19327c51762bb4ac9', 'request_id': 'req-958260b5-245d-43b0-99e0-ce2ec0de50fb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:12.646762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dfcf1d8ad1d4fa9bfc92b9112306793', 'request_id': 'req-598e290b-ab03-41b2-8054-95c1dfac5dc7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:12.654125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-958260b5-245d-43b0-99e0-ce2ec0de50fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380d48805a1544d19327c51762bb4ac9', 'request_id': 'req-958260b5-245d-43b0-99e0-ce2ec0de50fb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:12.682881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] The token cache is being invalidate because project 8dfcf1d8ad1d4fa9bfc92b9112306793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:12.683260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-958260b5-245d-43b0-99e0-ce2ec0de50fb admin admin] The token cache is being invalidate because project 380d48805a1544d19327c51762bb4ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:12.683558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-958260b5-245d-43b0-99e0-ce2ec0de50fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:12.683673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:12.684342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-958260b5-245d-43b0-99e0-ce2ec0de50fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:12.686666 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1525/3073] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:12 2022] DELETE /identity/v3/projects/380d48805a1544d19327c51762bb4ac9 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:12.687078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:12.695002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466476e-acab-4ac6-bbf9-7c90218b81a2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:12.695002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466476e-acab-4ac6-bbf9-7c90218b81a2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:12.695002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466476e-acab-4ac6-bbf9-7c90218b81a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:12.695651 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1549/3074] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:12 2022] DELETE /identity/v3/projects/8dfcf1d8ad1d4fa9bfc92b9112306793 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:10:12.696908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:12.699115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:12.733984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3466476e-acab-4ac6-bbf9-7c90218b81a2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:12.733984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3466476e-acab-4ac6-bbf9-7c90218b81a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:12.838803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e290b-ab03-41b2-8054-95c1dfac5dc7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:12.846681 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1526/3075] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:12.848220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34d56a-9b32-4507-9c7e-67b4feadd361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:12.849022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34d56a-9b32-4507-9c7e-67b4feadd361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:12.849297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34d56a-9b32-4507-9c7e-67b4feadd361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:12.849560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34d56a-9b32-4507-9c7e-67b4feadd361 admin admin] PATH_INFO: `/v3/users/98711c7997fd47beb19f8357d6dd1e76` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:12.850700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34d56a-9b32-4507-9c7e-67b4feadd361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98711c7997fd47beb19f8357d6dd1e76)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:12.853173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34d56a-9b32-4507-9c7e-67b4feadd361 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:12.854357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813250-32b3-4edb-b117-ea79b5852086 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:12.854960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813250-32b3-4edb-b117-ea79b5852086 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:12.855397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813250-32b3-4edb-b117-ea79b5852086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:12.883483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6a813250-32b3-4edb-b117-ea79b5852086 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:12.885397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6a813250-32b3-4edb-b117-ea79b5852086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:12.898294 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1527/3076] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:12.902674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813250-32b3-4edb-b117-ea79b5852086 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:12.922107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813250-32b3-4edb-b117-ea79b5852086 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:12.931755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be34d56a-9b32-4507-9c7e-67b4feadd361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98711c7997fd47beb19f8357d6dd1e76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:12.932493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be34d56a-9b32-4507-9c7e-67b4feadd361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98711c7997fd47beb19f8357d6dd1e76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:12.933659 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:12.956251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbcb46-9c4f-46ef-aa45-fec1cccc4d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:12.957908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbcb46-9c4f-46ef-aa45-fec1cccc4d38 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:12.958188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbcb46-9c4f-46ef-aa45-fec1cccc4d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:12.961009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbcb46-9c4f-46ef-aa45-fec1cccc4d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:12.962470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbcb46-9c4f-46ef-aa45-fec1cccc4d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:10:12.964770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbcb46-9c4f-46ef-aa45-fec1cccc4d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:12.968586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbcb46-9c4f-46ef-aa45-fec1cccc4d38 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:12.996903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be34d56a-9b32-4507-9c7e-67b4feadd361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98711c7997fd47beb19f8357d6dd1e76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:13.014831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be34d56a-9b32-4507-9c7e-67b4feadd361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98711c7997fd47beb19f8357d6dd1e76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:13.015556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be34d56a-9b32-4507-9c7e-67b4feadd361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98711c7997fd47beb19f8357d6dd1e76'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:13.034555 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1528/3077] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:10:13.036500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbcb46-9c4f-46ef-aa45-fec1cccc4d38 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:13.039490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-61dbcb46-9c4f-46ef-aa45-fec1cccc4d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:13.058805 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1550/3078] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:10:12 2022] DELETE /identity/v3/users/98711c7997fd47beb19f8357d6dd1e76 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:13.059026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbcb46-9c4f-46ef-aa45-fec1cccc4d38 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:13.214316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7ff0b-9f18-4ded-8dc4-bdad3f663de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:13.215475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7ff0b-9f18-4ded-8dc4-bdad3f663de5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:13.215751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7ff0b-9f18-4ded-8dc4-bdad3f663de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:13.216071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7ff0b-9f18-4ded-8dc4-bdad3f663de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:13.217329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7ff0b-9f18-4ded-8dc4-bdad3f663de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:13.224753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7ff0b-9f18-4ded-8dc4-bdad3f663de5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:13.291059 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1529/3079] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:13 2022] POST /identity/v3/projects => generated 381 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:13.292158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34d56a-9b32-4507-9c7e-67b4feadd361 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:13.309803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34d56a-9b32-4507-9c7e-67b4feadd361 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:13.361340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7ff0b-9f18-4ded-8dc4-bdad3f663de5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:13.363123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-63d7ff0b-9f18-4ded-8dc4-bdad3f663de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:13.452283 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:13.469163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8fecf-d4c1-47f0-af4e-5d09ffb8f1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:13.479850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8fecf-d4c1-47f0-af4e-5d09ffb8f1db admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:13.484667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8fecf-d4c1-47f0-af4e-5d09ffb8f1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:13.485389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8fecf-d4c1-47f0-af4e-5d09ffb8f1db admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:13.486432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8fecf-d4c1-47f0-af4e-5d09ffb8f1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:13.492019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8fecf-d4c1-47f0-af4e-5d09ffb8f1db admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:13.511714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7ff0b-9f18-4ded-8dc4-bdad3f663de5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:13.522183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedea1f-e877-46fd-816e-d775bc2ecfa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:13.523352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedea1f-e877-46fd-816e-d775bc2ecfa8 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:13.523639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedea1f-e877-46fd-816e-d775bc2ecfa8 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:13.523905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedea1f-e877-46fd-816e-d775bc2ecfa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:13.528047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ffedea1f-e877-46fd-816e-d775bc2ecfa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:13.542119 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1551/3080] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:13 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:10:13.545904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8fecf-d4c1-47f0-af4e-5d09ffb8f1db admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:13.568205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8fecf-d4c1-47f0-af4e-5d09ffb8f1db admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:13.575503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ee6d8-ed29-429c-8d34-56ac14df2a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:13.576709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ee6d8-ed29-429c-8d34-56ac14df2a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:13.577141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ee6d8-ed29-429c-8d34-56ac14df2a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:13.577415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ee6d8-ed29-429c-8d34-56ac14df2a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:13.578063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ee6d8-ed29-429c-8d34-56ac14df2a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:13.579754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ee6d8-ed29-429c-8d34-56ac14df2a71 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:13.595715 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1552/3081] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:10:13.596718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ee6d8-ed29-429c-8d34-56ac14df2a71 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:13.625077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ee6d8-ed29-429c-8d34-56ac14df2a71 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:13.654567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034514eb-a270-41c5-a90a-b15b2fbcb274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:13.655612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034514eb-a270-41c5-a90a-b15b2fbcb274 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:13.658586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034514eb-a270-41c5-a90a-b15b2fbcb274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:13.660086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034514eb-a270-41c5-a90a-b15b2fbcb274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:13.662630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034514eb-a270-41c5-a90a-b15b2fbcb274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:13.673459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034514eb-a270-41c5-a90a-b15b2fbcb274 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:13.684048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedea1f-e877-46fd-816e-d775bc2ecfa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:13.686698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedea1f-e877-46fd-816e-d775bc2ecfa8 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:13.718062 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1530/3082] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:10:13.718785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedea1f-e877-46fd-816e-d775bc2ecfa8 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:13.724561 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1553/3083] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:13.726867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034514eb-a270-41c5-a90a-b15b2fbcb274 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:13.730680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ffedea1f-e877-46fd-816e-d775bc2ecfa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:13.754479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034514eb-a270-41c5-a90a-b15b2fbcb274 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:13.766276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211deb9-1191-4cda-9154-76335c32a374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:13.767160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211deb9-1191-4cda-9154-76335c32a374 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:13.767439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211deb9-1191-4cda-9154-76335c32a374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:13.767710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211deb9-1191-4cda-9154-76335c32a374 admin admin] PATH_INFO: `/v3/projects/f9416837a51e484094dba1a296c4d096/users/0a7ca896a35447f8a828817a8620d308/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:13.779717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedea1f-e877-46fd-816e-d775bc2ecfa8 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:13.789336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211deb9-1191-4cda-9154-76335c32a374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9416837a51e484094dba1a296c4d096, user_id=0a7ca896a35447f8a828817a8620d308, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:13.792178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211deb9-1191-4cda-9154-76335c32a374 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:13.798888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfe87b-23ac-44de-907d-6d2804c49a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:13.799627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfe87b-23ac-44de-907d-6d2804c49a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:13.799978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfe87b-23ac-44de-907d-6d2804c49a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:13.800175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfe87b-23ac-44de-907d-6d2804c49a6e admin admin] PATH_INFO: `/v3/projects/94d80ca9deb240349103dee5843ff740` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:13.802343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfe87b-23ac-44de-907d-6d2804c49a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d80ca9deb240349103dee5843ff740)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:13.808760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfe87b-23ac-44de-907d-6d2804c49a6e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:13.818146 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1554/3084] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:13 2022] PUT /identity/v3/projects/f9416837a51e484094dba1a296c4d096/users/0a7ca896a35447f8a828817a8620d308/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:13.821860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4220b8f-e260-4f3a-af33-87de86aa7d7b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:13.822150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4220b8f-e260-4f3a-af33-87de86aa7d7b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:13.835381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4220b8f-e260-4f3a-af33-87de86aa7d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:13.870961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c4220b8f-e260-4f3a-af33-87de86aa7d7b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:13.877734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c4220b8f-e260-4f3a-af33-87de86aa7d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:13.905235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-94dfe87b-23ac-44de-907d-6d2804c49a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d80ca9deb240349103dee5843ff740', 'request_id': 'req-94dfe87b-23ac-44de-907d-6d2804c49a6e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:13.922328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-94dfe87b-23ac-44de-907d-6d2804c49a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d80ca9deb240349103dee5843ff740', 'request_id': 'req-94dfe87b-23ac-44de-907d-6d2804c49a6e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:13.940414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-94dfe87b-23ac-44de-907d-6d2804c49a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d80ca9deb240349103dee5843ff740', 'request_id': 'req-94dfe87b-23ac-44de-907d-6d2804c49a6e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:13.959228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-94dfe87b-23ac-44de-907d-6d2804c49a6e admin admin] The token cache is being invalidate because project 94d80ca9deb240349103dee5843ff740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:13.961258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-94dfe87b-23ac-44de-907d-6d2804c49a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:13.962782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-94dfe87b-23ac-44de-907d-6d2804c49a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:13.967555 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1531/3085] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:13 2022] DELETE /identity/v3/projects/94d80ca9deb240349103dee5843ff740 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:13.978219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91d2a6-7800-4945-8644-17e077a3397e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:13.978659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91d2a6-7800-4945-8644-17e077a3397e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:13.979067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91d2a6-7800-4945-8644-17e077a3397e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:14.009115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7b91d2a6-7800-4945-8644-17e077a3397e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:14.014100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b91d2a6-7800-4945-8644-17e077a3397e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:14.024385 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1532/3086] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:14.032722 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1555/3087] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:14.071336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91d2a6-7800-4945-8644-17e077a3397e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:14.078615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b91d2a6-7800-4945-8644-17e077a3397e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:14.103610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ed149-5e01-4cdf-8ea7-cb40737d4a9b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:14.103955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ed149-5e01-4cdf-8ea7-cb40737d4a9b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:14.104234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ed149-5e01-4cdf-8ea7-cb40737d4a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:14.114642 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:14.130412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e44ed149-5e01-4cdf-8ea7-cb40737d4a9b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:14.132146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e44ed149-5e01-4cdf-8ea7-cb40737d4a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:14.147223 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1556/3088] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:10:14.150562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ed149-5e01-4cdf-8ea7-cb40737d4a9b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:14.165545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ed149-5e01-4cdf-8ea7-cb40737d4a9b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:14.171638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd66f3b-05da-445e-9e11-b5dfa7a4f1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:14.172252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd66f3b-05da-445e-9e11-b5dfa7a4f1af admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:14.172531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd66f3b-05da-445e-9e11-b5dfa7a4f1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:14.172801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd66f3b-05da-445e-9e11-b5dfa7a4f1af admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:14.173591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd66f3b-05da-445e-9e11-b5dfa7a4f1af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:10:14.173896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd66f3b-05da-445e-9e11-b5dfa7a4f1af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:14.175767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd66f3b-05da-445e-9e11-b5dfa7a4f1af admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:14.193730 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1557/3089] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:10:14.194769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd66f3b-05da-445e-9e11-b5dfa7a4f1af admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:14.221141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd66f3b-05da-445e-9e11-b5dfa7a4f1af admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:14.224133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91d2a6-7800-4945-8644-17e077a3397e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:14.232508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42f41f-b21b-405d-bfc9-017117c9c157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:14.233132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42f41f-b21b-405d-bfc9-017117c9c157 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:14.233842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6009a-8e36-4fb3-b96e-d8e39e9f19b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:14.234455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6009a-8e36-4fb3-b96e-d8e39e9f19b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:14.234972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6009a-8e36-4fb3-b96e-d8e39e9f19b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:14.235260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6009a-8e36-4fb3-b96e-d8e39e9f19b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:14.235937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6009a-8e36-4fb3-b96e-d8e39e9f19b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:14.236691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42f41f-b21b-405d-bfc9-017117c9c157 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:14.237125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42f41f-b21b-405d-bfc9-017117c9c157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:14.239306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6009a-8e36-4fb3-b96e-d8e39e9f19b2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:14.251323 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:14.260765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42f41f-b21b-405d-bfc9-017117c9c157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:14.262373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42f41f-b21b-405d-bfc9-017117c9c157 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:14.308979 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1533/3090] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:14.330745 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1558/3091] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:14 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:14.335149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42f41f-b21b-405d-bfc9-017117c9c157 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:14.353171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42f41f-b21b-405d-bfc9-017117c9c157 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:14.495458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636e2e6-f9a9-4340-a6a6-6270ebbea5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:14.496071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636e2e6-f9a9-4340-a6a6-6270ebbea5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:14.496487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636e2e6-f9a9-4340-a6a6-6270ebbea5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:14.496661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636e2e6-f9a9-4340-a6a6-6270ebbea5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:14.497244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636e2e6-f9a9-4340-a6a6-6270ebbea5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:14.499879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636e2e6-f9a9-4340-a6a6-6270ebbea5b7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:14.577821 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1534/3092] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:14 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:14.579780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6009a-8e36-4fb3-b96e-d8e39e9f19b2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:14.606743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6009a-8e36-4fb3-b96e-d8e39e9f19b2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:14.619154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94734e-eb5c-40f1-9683-5f4e5b0b63ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:14.621657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94734e-eb5c-40f1-9683-5f4e5b0b63ca admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:14.624894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94734e-eb5c-40f1-9683-5f4e5b0b63ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:14.625537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94734e-eb5c-40f1-9683-5f4e5b0b63ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:14.627406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94734e-eb5c-40f1-9683-5f4e5b0b63ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:14.633031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94734e-eb5c-40f1-9683-5f4e5b0b63ca admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:14.682177 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1559/3093] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:14.682634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636e2e6-f9a9-4340-a6a6-6270ebbea5b7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:14.699806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636e2e6-f9a9-4340-a6a6-6270ebbea5b7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:14.709295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1f56b-6abf-4bae-9b22-20d0f3856403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:14.709919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1f56b-6abf-4bae-9b22-20d0f3856403 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:14.710196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1f56b-6abf-4bae-9b22-20d0f3856403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:14.710469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1f56b-6abf-4bae-9b22-20d0f3856403 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:14.711328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1f56b-6abf-4bae-9b22-20d0f3856403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:14.715303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1f56b-6abf-4bae-9b22-20d0f3856403 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:14.740557 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1535/3094] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:14.745041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94734e-eb5c-40f1-9683-5f4e5b0b63ca admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:14.764729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8717980-57bc-43e3-ae6f-479624c55bf3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:14.765018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8717980-57bc-43e3-ae6f-479624c55bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:14.765288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8717980-57bc-43e3-ae6f-479624c55bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:14.768237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94734e-eb5c-40f1-9683-5f4e5b0b63ca admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:14.784894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208e8b3-7d45-451a-a922-e847f0cb7765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:14.785570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e8b3-7d45-451a-a922-e847f0cb7765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:14.785799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e8b3-7d45-451a-a922-e847f0cb7765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:14.786076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e8b3-7d45-451a-a922-e847f0cb7765 admin admin] PATH_INFO: `/v3/projects/d1b47b2269ae43d58842e61b7b0de759/users/02ad8a9597ab413dad2f7babb1ffbc69/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:14.808925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c8717980-57bc-43e3-ae6f-479624c55bf3 None None] MFA Rules not processed for user `df9979f0dcd74d60a55d02d432de6a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:14.810475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c8717980-57bc-43e3-ae6f-479624c55bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:14.837076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208e8b3-7d45-451a-a922-e847f0cb7765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b47b2269ae43d58842e61b7b0de759, user_id=02ad8a9597ab413dad2f7babb1ffbc69, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:14.844686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208e8b3-7d45-451a-a922-e847f0cb7765 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:14.880762 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1560/3095] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:14 2022] PUT /identity/v3/projects/d1b47b2269ae43d58842e61b7b0de759/users/02ad8a9597ab413dad2f7babb1ffbc69/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:14.898075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8cf8e-6f2c-436d-bb71-46023c346958 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:14.898431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8cf8e-6f2c-436d-bb71-46023c346958 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:14.898707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8cf8e-6f2c-436d-bb71-46023c346958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:14.960911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ecf8cf8e-6f2c-436d-bb71-46023c346958 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:14.962163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ecf8cf8e-6f2c-436d-bb71-46023c346958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:14.970687 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1536/3096] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:10:15.091263 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1561/3097] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:15.093055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8717980-57bc-43e3-ae6f-479624c55bf3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:15.213229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8717980-57bc-43e3-ae6f-479624c55bf3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:15.275859 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:15.327211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbd625-91a1-4d92-ba82-4853b1015e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:15.327839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd625-91a1-4d92-ba82-4853b1015e74 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:15.328118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd625-91a1-4d92-ba82-4853b1015e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:15.328390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd625-91a1-4d92-ba82-4853b1015e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:15.346820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbd625-91a1-4d92-ba82-4853b1015e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:15.349769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbd625-91a1-4d92-ba82-4853b1015e74 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:15.371661 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1537/3098] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:10:18.848174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8cf8e-6f2c-436d-bb71-46023c346958 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:18.873423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8cf8e-6f2c-436d-bb71-46023c346958 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:18.892664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0ea2d-8214-4a89-8584-596c86bf2ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:18.893800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0ea2d-8214-4a89-8584-596c86bf2ace service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:18.894373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0ea2d-8214-4a89-8584-596c86bf2ace service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:18.895365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0ea2d-8214-4a89-8584-596c86bf2ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:18.906815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e2b0ea2d-8214-4a89-8584-596c86bf2ace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:19.131398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbd625-91a1-4d92-ba82-4853b1015e74 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:19.133283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0adbd625-91a1-4d92-ba82-4853b1015e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:19.168219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbd625-91a1-4d92-ba82-4853b1015e74 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:19.198269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:19.202652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:19.203606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:19.205418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] PATH_INFO: `/v3/users/35b70431e8c442b29659394bed48ec71` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:19.209491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b70431e8c442b29659394bed48ec71)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:19.217346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:19.355615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0ea2d-8214-4a89-8584-596c86bf2ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:19.378733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0ea2d-8214-4a89-8584-596c86bf2ace service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:19.444761 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1562/3099] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:19.466393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b70431e8c442b29659394bed48ec71'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:19.467308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b70431e8c442b29659394bed48ec71'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:19.519328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b70431e8c442b29659394bed48ec71'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:19.539489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b70431e8c442b29659394bed48ec71'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:19.540369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b70431e8c442b29659394bed48ec71'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:19.586658 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1538/3100] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:10:19 2022] DELETE /identity/v3/users/35b70431e8c442b29659394bed48ec71 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:19.587421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac60cb8-b2d2-44e1-b57f-37206d20f46d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:19.588331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac60cb8-b2d2-44e1-b57f-37206d20f46d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:19.588639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac60cb8-b2d2-44e1-b57f-37206d20f46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:19.633736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cac60cb8-b2d2-44e1-b57f-37206d20f46d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:19.635999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cac60cb8-b2d2-44e1-b57f-37206d20f46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:19.665663 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:19.854766 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1563/3101] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:10:19.886088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:19.887870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:20.063390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a77ca-19c1-4fbf-a14a-06a4d384f064 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:20.074731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7921d-e647-490c-b035-b3a71a2420b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:20.075030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7921d-e647-490c-b035-b3a71a2420b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:20.075388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7921d-e647-490c-b035-b3a71a2420b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:20.075774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7921d-e647-490c-b035-b3a71a2420b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:20.080423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac60cb8-b2d2-44e1-b57f-37206d20f46d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:20.082045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cac60cb8-b2d2-44e1-b57f-37206d20f46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:20.095453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dfa7921d-e647-490c-b035-b3a71a2420b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:20.112154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac60cb8-b2d2-44e1-b57f-37206d20f46d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:20.128531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3076cf-af05-4fee-bfaa-375114b992fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:20.131012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3076cf-af05-4fee-bfaa-375114b992fd service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:20.131261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3076cf-af05-4fee-bfaa-375114b992fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:20.131539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3076cf-af05-4fee-bfaa-375114b992fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:20.202290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3076cf-af05-4fee-bfaa-375114b992fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:20.204964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3076cf-af05-4fee-bfaa-375114b992fd service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:20.233215 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1564/3102] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:20.335796 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:20.393127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7921d-e647-490c-b035-b3a71a2420b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:20.398688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7921d-e647-490c-b035-b3a71a2420b9 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:20.432425 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1539/3103] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:21.110159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3076cf-af05-4fee-bfaa-375114b992fd service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:21.124433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3076cf-af05-4fee-bfaa-375114b992fd service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:21.145428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa7c22-f4dd-43ee-9a39-f48d5eb25349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:21.146212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa7c22-f4dd-43ee-9a39-f48d5eb25349 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:21.146616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa7c22-f4dd-43ee-9a39-f48d5eb25349 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:21.147022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa7c22-f4dd-43ee-9a39-f48d5eb25349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:21.152828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-96fa7c22-f4dd-43ee-9a39-f48d5eb25349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:21.192459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa7c22-f4dd-43ee-9a39-f48d5eb25349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:21.194949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa7c22-f4dd-43ee-9a39-f48d5eb25349 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:21.243800 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1565/3104] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:22.606018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7921d-e647-490c-b035-b3a71a2420b9 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:22.630095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dfa7921d-e647-490c-b035-b3a71a2420b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:22.711669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7921d-e647-490c-b035-b3a71a2420b9 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:22.764127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10738f1a-6fc1-4525-891e-8b49b3c26927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:22.764851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738f1a-6fc1-4525-891e-8b49b3c26927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:22.765132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738f1a-6fc1-4525-891e-8b49b3c26927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:22.765404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738f1a-6fc1-4525-891e-8b49b3c26927 admin admin] PATH_INFO: `/v3/projects/6c515ba81d4541abaf3b88e3786e6f61` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:22.766604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10738f1a-6fc1-4525-891e-8b49b3c26927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c515ba81d4541abaf3b88e3786e6f61)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:22.768954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10738f1a-6fc1-4525-891e-8b49b3c26927 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:22.954785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-10738f1a-6fc1-4525-891e-8b49b3c26927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c515ba81d4541abaf3b88e3786e6f61', 'request_id': 'req-10738f1a-6fc1-4525-891e-8b49b3c26927'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:22.965282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-10738f1a-6fc1-4525-891e-8b49b3c26927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c515ba81d4541abaf3b88e3786e6f61', 'request_id': 'req-10738f1a-6fc1-4525-891e-8b49b3c26927'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:22.981362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-10738f1a-6fc1-4525-891e-8b49b3c26927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c515ba81d4541abaf3b88e3786e6f61', 'request_id': 'req-10738f1a-6fc1-4525-891e-8b49b3c26927'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:23.011051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-10738f1a-6fc1-4525-891e-8b49b3c26927 admin admin] The token cache is being invalidate because project 6c515ba81d4541abaf3b88e3786e6f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:23.013273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-10738f1a-6fc1-4525-891e-8b49b3c26927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:23.014119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-10738f1a-6fc1-4525-891e-8b49b3c26927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:23.024132 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1540/3105] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:22 2022] DELETE /identity/v3/projects/6c515ba81d4541abaf3b88e3786e6f61 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:23.025893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133aebc-a168-415b-a016-45ac742d5b49 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:23.026363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133aebc-a168-415b-a016-45ac742d5b49 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:23.026363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133aebc-a168-415b-a016-45ac742d5b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:23.066498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8133aebc-a168-415b-a016-45ac742d5b49 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:23.070183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8133aebc-a168-415b-a016-45ac742d5b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:23.168336 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1566/3106] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:23.176081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9891f0-b0a3-459a-a1ec-8f2aed86b319 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:23.176432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9891f0-b0a3-459a-a1ec-8f2aed86b319 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:23.179013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9891f0-b0a3-459a-a1ec-8f2aed86b319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:23.244813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3c9891f0-b0a3-459a-a1ec-8f2aed86b319 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:23.246249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3c9891f0-b0a3-459a-a1ec-8f2aed86b319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:23.265885 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1541/3107] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:10:23.269960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133aebc-a168-415b-a016-45ac742d5b49 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:23.287202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133aebc-a168-415b-a016-45ac742d5b49 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:23.301284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7585bb7-3c4a-4ea7-b8ab-e66c6a062a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:23.312063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585bb7-3c4a-4ea7-b8ab-e66c6a062a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:23.312676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585bb7-3c4a-4ea7-b8ab-e66c6a062a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:23.314447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585bb7-3c4a-4ea7-b8ab-e66c6a062a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:23.315403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7585bb7-3c4a-4ea7-b8ab-e66c6a062a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:10:23.315946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7585bb7-3c4a-4ea7-b8ab-e66c6a062a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:23.317990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7585bb7-3c4a-4ea7-b8ab-e66c6a062a51 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:23.345275 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1567/3108] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:10:23.349517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9891f0-b0a3-459a-a1ec-8f2aed86b319 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:23.360781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9891f0-b0a3-459a-a1ec-8f2aed86b319 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:23.365955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c3a84-a2b8-40aa-be11-841754f84279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:23.366644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c3a84-a2b8-40aa-be11-841754f84279 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:23.367038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c3a84-a2b8-40aa-be11-841754f84279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:23.367956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c3a84-a2b8-40aa-be11-841754f84279 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:23.368640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c3a84-a2b8-40aa-be11-841754f84279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:23.370627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c3a84-a2b8-40aa-be11-841754f84279 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:23.427751 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1542/3109] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:23 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:10:23.428884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7585bb7-3c4a-4ea7-b8ab-e66c6a062a51 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:23.473855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7585bb7-3c4a-4ea7-b8ab-e66c6a062a51 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:23.592664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ec8f-41f7-485c-9ae1-34610e14beab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:23.593403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ec8f-41f7-485c-9ae1-34610e14beab admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:23.593785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ec8f-41f7-485c-9ae1-34610e14beab admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:23.594160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ec8f-41f7-485c-9ae1-34610e14beab admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:23.595079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ec8f-41f7-485c-9ae1-34610e14beab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:23.597237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ec8f-41f7-485c-9ae1-34610e14beab admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:23.647721 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1568/3110] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:23 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:23.652165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c3a84-a2b8-40aa-be11-841754f84279 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:23.665266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c3a84-a2b8-40aa-be11-841754f84279 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:23.672578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207f6fa-149b-462e-9c16-1df596252105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:23.673673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207f6fa-149b-462e-9c16-1df596252105 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:23.674160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207f6fa-149b-462e-9c16-1df596252105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:23.674758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207f6fa-149b-462e-9c16-1df596252105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:23.677240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207f6fa-149b-462e-9c16-1df596252105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:23.679373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207f6fa-149b-462e-9c16-1df596252105 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:23.702815 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1543/3111] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:23.706593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ec8f-41f7-485c-9ae1-34610e14beab admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:23.717818 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:23.724174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ec8f-41f7-485c-9ae1-34610e14beab admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:23.732685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e257c97-da20-449f-bb71-f1202534f75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:23.733651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e257c97-da20-449f-bb71-f1202534f75b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:23.734217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e257c97-da20-449f-bb71-f1202534f75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:23.736248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e257c97-da20-449f-bb71-f1202534f75b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:23.737707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e257c97-da20-449f-bb71-f1202534f75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:23.740984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e257c97-da20-449f-bb71-f1202534f75b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:23.766822 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1569/3112] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:10:23.770781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207f6fa-149b-462e-9c16-1df596252105 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:23.784140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207f6fa-149b-462e-9c16-1df596252105 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:23.798097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb418d-7100-423a-9fc7-361df63e8c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:23.798989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb418d-7100-423a-9fc7-361df63e8c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:23.799383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb418d-7100-423a-9fc7-361df63e8c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:23.799943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb418d-7100-423a-9fc7-361df63e8c80 admin admin] PATH_INFO: `/v3/projects/1fe07ab5afac468d9a55448f2ac3584a/users/45963b0b51474cae80b9efadf734cfdf/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:23.847069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb418d-7100-423a-9fc7-361df63e8c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe07ab5afac468d9a55448f2ac3584a, user_id=45963b0b51474cae80b9efadf734cfdf, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:23.851054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb418d-7100-423a-9fc7-361df63e8c80 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:23.893322 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1544/3113] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:23 2022] PUT /identity/v3/projects/1fe07ab5afac468d9a55448f2ac3584a/users/45963b0b51474cae80b9efadf734cfdf/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:23.904505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1606a-cf98-4397-9374-fe02b86dcdf3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:23.905022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1606a-cf98-4397-9374-fe02b86dcdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:23.905405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1606a-cf98-4397-9374-fe02b86dcdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:23.985020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4fe1606a-cf98-4397-9374-fe02b86dcdf3 None None] MFA Rules not processed for user `45963b0b51474cae80b9efadf734cfdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:23.995674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4fe1606a-cf98-4397-9374-fe02b86dcdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:24.348961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb418d-7100-423a-9fc7-361df63e8c80 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:24.349967 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1570/3114] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:24.589487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb418d-7100-423a-9fc7-361df63e8c80 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:24.611926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb3132-3e4a-4635-96e0-3d164d016340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:24.612629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb3132-3e4a-4635-96e0-3d164d016340 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:24.612912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb3132-3e4a-4635-96e0-3d164d016340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:24.616908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb3132-3e4a-4635-96e0-3d164d016340 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:24.620141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb3132-3e4a-4635-96e0-3d164d016340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:24.623937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb3132-3e4a-4635-96e0-3d164d016340 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:24.705838 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:24.741984 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1545/3115] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:24 2022] POST /identity/v3/projects => generated 371 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:24.746309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1606a-cf98-4397-9374-fe02b86dcdf3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:24.766283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1606a-cf98-4397-9374-fe02b86dcdf3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:24.967383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d353547-7e7f-4b4e-a6f0-ae2a62fd55c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:24.968021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d353547-7e7f-4b4e-a6f0-ae2a62fd55c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:24.968297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d353547-7e7f-4b4e-a6f0-ae2a62fd55c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:24.968568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d353547-7e7f-4b4e-a6f0-ae2a62fd55c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:24.969222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d353547-7e7f-4b4e-a6f0-ae2a62fd55c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:24.971312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d353547-7e7f-4b4e-a6f0-ae2a62fd55c1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:25.030995 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1571/3116] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:24 2022] POST /identity/v3/users => generated 292 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:25.035030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb3132-3e4a-4635-96e0-3d164d016340 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:25.057331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb3132-3e4a-4635-96e0-3d164d016340 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:25.070882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d513b-ed33-4865-9406-77afad1885fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:25.071806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d513b-ed33-4865-9406-77afad1885fd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:25.072364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d513b-ed33-4865-9406-77afad1885fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:25.073150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d513b-ed33-4865-9406-77afad1885fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:25.073949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d513b-ed33-4865-9406-77afad1885fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:25.076564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d513b-ed33-4865-9406-77afad1885fd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:25.108462 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1546/3117] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:25.112538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d353547-7e7f-4b4e-a6f0-ae2a62fd55c1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:25.125606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d353547-7e7f-4b4e-a6f0-ae2a62fd55c1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:25.138856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25611325-e25d-40d5-a919-623cb89add94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:25.139898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25611325-e25d-40d5-a919-623cb89add94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:25.140336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25611325-e25d-40d5-a919-623cb89add94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:25.140749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25611325-e25d-40d5-a919-623cb89add94 admin admin] PATH_INFO: `/v3/projects/f58ba50466d24cb29fff768be831edd4/users/32d69db511744d28b91e76ec69e61337/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:25.179398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25611325-e25d-40d5-a919-623cb89add94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58ba50466d24cb29fff768be831edd4, user_id=32d69db511744d28b91e76ec69e61337, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:25.182293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25611325-e25d-40d5-a919-623cb89add94 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:25.207315 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1572/3118] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:25 2022] PUT /identity/v3/projects/f58ba50466d24cb29fff768be831edd4/users/32d69db511744d28b91e76ec69e61337/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:25.211407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d513b-ed33-4865-9406-77afad1885fd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:25.227338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d513b-ed33-4865-9406-77afad1885fd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:25.434676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a3b7b-d141-43dc-8caf-c02d2d7cace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:25.435418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a3b7b-d141-43dc-8caf-c02d2d7cace7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:25.435698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a3b7b-d141-43dc-8caf-c02d2d7cace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:25.436037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a3b7b-d141-43dc-8caf-c02d2d7cace7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:25.436765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a3b7b-d141-43dc-8caf-c02d2d7cace7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:25.438359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a3b7b-d141-43dc-8caf-c02d2d7cace7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:25.476373 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1547/3119] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:25.480399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25611325-e25d-40d5-a919-623cb89add94 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:25.496716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cbbe2-462c-4bd8-a8ae-bcb782e4c63c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:25.496925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cbbe2-462c-4bd8-a8ae-bcb782e4c63c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:25.497229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cbbe2-462c-4bd8-a8ae-bcb782e4c63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:25.504406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25611325-e25d-40d5-a919-623cb89add94 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:25.525515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30b472-9876-419d-a2ab-11cba0eeadfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:25.526217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30b472-9876-419d-a2ab-11cba0eeadfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:25.526534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30b472-9876-419d-a2ab-11cba0eeadfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:25.526807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30b472-9876-419d-a2ab-11cba0eeadfc admin admin] PATH_INFO: `/v3/projects/f58ba50466d24cb29fff768be831edd4/users/32d69db511744d28b91e76ec69e61337/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:25.541771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30b472-9876-419d-a2ab-11cba0eeadfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58ba50466d24cb29fff768be831edd4, user_id=32d69db511744d28b91e76ec69e61337, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:25.552942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30b472-9876-419d-a2ab-11cba0eeadfc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:25.573437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-983cbbe2-462c-4bd8-a8ae-bcb782e4c63c None None] MFA Rules not processed for user `df9979f0dcd74d60a55d02d432de6a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:25.585722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-983cbbe2-462c-4bd8-a8ae-bcb782e4c63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:25.622955 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1573/3120] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:25 2022] PUT /identity/v3/projects/f58ba50466d24cb29fff768be831edd4/users/32d69db511744d28b91e76ec69e61337/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:25.631792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a2426-9101-4463-8375-cce2693fd742 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:25.632077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a2426-9101-4463-8375-cce2693fd742 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:25.632350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a2426-9101-4463-8375-cce2693fd742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:25.734466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6c7a2426-9101-4463-8375-cce2693fd742 None None] MFA Rules not processed for user `32d69db511744d28b91e76ec69e61337`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:25.735850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c7a2426-9101-4463-8375-cce2693fd742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:25.822167 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:25.838625 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1548/3121] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:25.959190 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1574/3122] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:25.964267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cbbe2-462c-4bd8-a8ae-bcb782e4c63c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:25.984427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cbbe2-462c-4bd8-a8ae-bcb782e4c63c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:26.004411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cd1df-38f4-45c6-9640-9c8abb0265ce tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:26.005313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd1df-38f4-45c6-9640-9c8abb0265ce tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:26.005659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd1df-38f4-45c6-9640-9c8abb0265ce tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:26.022949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd1df-38f4-45c6-9640-9c8abb0265ce tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:26.023781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cd1df-38f4-45c6-9640-9c8abb0265ce tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:26.025243 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-328cd1df-38f4-45c6-9640-9c8abb0265ce tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:10:26.025243 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:10:26.025243 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:10:26.025938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cd1df-38f4-45c6-9640-9c8abb0265ce tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:26.108939 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1549/3123] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:25 2022] POST /identity/v3/services => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:26.110738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a2426-9101-4463-8375-cce2693fd742 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:26.125205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a2426-9101-4463-8375-cce2693fd742 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:26.197409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27818b50-d761-4e81-9f26-9a619b2e0e5b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:26.198028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818b50-d761-4e81-9f26-9a619b2e0e5b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:26.198306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818b50-d761-4e81-9f26-9a619b2e0e5b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:26.198708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818b50-d761-4e81-9f26-9a619b2e0e5b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:26.202882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27818b50-d761-4e81-9f26-9a619b2e0e5b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:26.204196 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-27818b50-d761-4e81-9f26-9a619b2e0e5b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:10:26.204196 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:10:26.204196 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:10:26.205137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27818b50-d761-4e81-9f26-9a619b2e0e5b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:26.297396 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-27818b50-d761-4e81-9f26-9a619b2e0e5b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1773748008. To ensure interoperability, identifiers should be a valid uuid. Oct 16 01:10:26.297396 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 16 01:10:26.297396 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:10:26.367792 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1575/3124] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Oct 16 01:10:26 2022] POST /identity/v3/endpoints => generated 360 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:26.374540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cd1df-38f4-45c6-9640-9c8abb0265ce tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:26.403210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cd1df-38f4-45c6-9640-9c8abb0265ce tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:26.456367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6661ddc-5791-4bc3-9a02-84599cc4ce2a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:26.457008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6661ddc-5791-4bc3-9a02-84599cc4ce2a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:26.457286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6661ddc-5791-4bc3-9a02-84599cc4ce2a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:26.457554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6661ddc-5791-4bc3-9a02-84599cc4ce2a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/regions/tempest-region-1773748008` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:26.459375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6661ddc-5791-4bc3-9a02-84599cc4ce2a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1773748008)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:26.459375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6661ddc-5791-4bc3-9a02-84599cc4ce2a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:26.462876 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1550/3125] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Oct 16 01:10:26 2022] GET /identity/v3/regions/tempest-region-1773748008 => generated 180 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:10:26.467636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27818b50-d761-4e81-9f26-9a619b2e0e5b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:26.485049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27818b50-d761-4e81-9f26-9a619b2e0e5b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:26.494792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75619d8d-b063-452f-a63e-4d0e424ba015 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:26.495728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75619d8d-b063-452f-a63e-4d0e424ba015 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:26.496068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75619d8d-b063-452f-a63e-4d0e424ba015 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:26.496396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75619d8d-b063-452f-a63e-4d0e424ba015 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:26.497511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75619d8d-b063-452f-a63e-4d0e424ba015 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:26.498950 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-75619d8d-b063-452f-a63e-4d0e424ba015 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:10:26.498950 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:10:26.498950 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:10:26.499973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75619d8d-b063-452f-a63e-4d0e424ba015 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:26.536862 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1576/3126] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:26 2022] POST /identity/v3/services => generated 289 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:26.540760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6661ddc-5791-4bc3-9a02-84599cc4ce2a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:26.555326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6661ddc-5791-4bc3-9a02-84599cc4ce2a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:26.603974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526f81-d86a-4404-96df-c7093d23f891 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:26.605003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526f81-d86a-4404-96df-c7093d23f891 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:26.605476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526f81-d86a-4404-96df-c7093d23f891 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:26.605971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526f81-d86a-4404-96df-c7093d23f891 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:26.607313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526f81-d86a-4404-96df-c7093d23f891 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:26.608481 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-49526f81-d86a-4404-96df-c7093d23f891 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:10:26.608481 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:10:26.608481 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:10:26.621535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526f81-d86a-4404-96df-c7093d23f891 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:26.688083 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-49526f81-d86a-4404-96df-c7093d23f891 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1035041725. To ensure interoperability, identifiers should be a valid uuid. Oct 16 01:10:26.688083 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 16 01:10:26.688083 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:10:26.773859 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1551/3127] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Oct 16 01:10:26 2022] POST /identity/v3/endpoints => generated 362 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:26.777769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75619d8d-b063-452f-a63e-4d0e424ba015 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:26.810766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75619d8d-b063-452f-a63e-4d0e424ba015 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:26.863382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024472ce-e8d1-484b-9708-347b74319f9c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:26.864037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024472ce-e8d1-484b-9708-347b74319f9c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:26.864307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024472ce-e8d1-484b-9708-347b74319f9c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:26.864581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024472ce-e8d1-484b-9708-347b74319f9c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/regions/tempest-region-1035041725` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:26.872611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024472ce-e8d1-484b-9708-347b74319f9c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1035041725)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:26.879313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024472ce-e8d1-484b-9708-347b74319f9c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:26.889642 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1577/3128] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Oct 16 01:10:26 2022] GET /identity/v3/regions/tempest-region-1035041725 => generated 180 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:10:26.894486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526f81-d86a-4404-96df-c7093d23f891 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:26.928585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526f81-d86a-4404-96df-c7093d23f891 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:26.945800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137e323-41ba-4bcf-a1a3-a6b0b1ae491e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:26.949966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137e323-41ba-4bcf-a1a3-a6b0b1ae491e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:26.953558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137e323-41ba-4bcf-a1a3-a6b0b1ae491e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:26.953852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137e323-41ba-4bcf-a1a3-a6b0b1ae491e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:26.954569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137e323-41ba-4bcf-a1a3-a6b0b1ae491e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:26.961295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137e323-41ba-4bcf-a1a3-a6b0b1ae491e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:26.983263 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:27.026196 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-0137e323-41ba-4bcf-a1a3-a6b0b1ae491e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1261776126. To ensure interoperability, identifiers should be a valid uuid. Oct 16 01:10:27.026196 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 16 01:10:27.026196 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:10:27.109569 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1552/3129] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Oct 16 01:10:26 2022] POST /identity/v3/endpoints => generated 360 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:27.110001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024472ce-e8d1-484b-9708-347b74319f9c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:27.123567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024472ce-e8d1-484b-9708-347b74319f9c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:27.180842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99001fe6-1a5f-4d50-8244-ee3ec58407f9 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:27.181477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99001fe6-1a5f-4d50-8244-ee3ec58407f9 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:27.181753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99001fe6-1a5f-4d50-8244-ee3ec58407f9 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:27.182031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99001fe6-1a5f-4d50-8244-ee3ec58407f9 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/regions/tempest-region-1261776126` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:27.182615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99001fe6-1a5f-4d50-8244-ee3ec58407f9 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1261776126)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:27.183702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99001fe6-1a5f-4d50-8244-ee3ec58407f9 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:27.207452 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1578/3130] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Oct 16 01:10:27 2022] GET /identity/v3/regions/tempest-region-1261776126 => generated 180 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:10:27.212452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137e323-41ba-4bcf-a1a3-a6b0b1ae491e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:27.228971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137e323-41ba-4bcf-a1a3-a6b0b1ae491e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:27.241685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa302b8-12cf-417f-a793-bccf4639fada tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:27.243620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa302b8-12cf-417f-a793-bccf4639fada tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:27.245090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa302b8-12cf-417f-a793-bccf4639fada tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:27.245495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa302b8-12cf-417f-a793-bccf4639fada tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:27.259459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa302b8-12cf-417f-a793-bccf4639fada tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:27.265644 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-1fa302b8-12cf-417f-a793-bccf4639fada tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:10:27.265644 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:10:27.265644 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:10:27.268138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa302b8-12cf-417f-a793-bccf4639fada tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:27.314054 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1553/3131] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Oct 16 01:10:27 2022] GET /identity/v3/endpoints => generated 4396 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:27.315922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99001fe6-1a5f-4d50-8244-ee3ec58407f9 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:27.339392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99001fe6-1a5f-4d50-8244-ee3ec58407f9 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:27.351692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd04236-04e6-413e-a2e6-04d0362c4f1e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:27.352262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd04236-04e6-413e-a2e6-04d0362c4f1e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:27.352542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd04236-04e6-413e-a2e6-04d0362c4f1e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:27.352814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd04236-04e6-413e-a2e6-04d0362c4f1e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints/ddff2ed24c6d478faabb04300aab6f4f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:27.393600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd04236-04e6-413e-a2e6-04d0362c4f1e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=ddff2ed24c6d478faabb04300aab6f4f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:27.399404 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-2fd04236-04e6-413e-a2e6-04d0362c4f1e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:10:27.399404 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:10:27.399404 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:10:27.400526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd04236-04e6-413e-a2e6-04d0362c4f1e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:27.411413 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1579/3132] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:27 2022] GET /identity/v3/endpoints/ddff2ed24c6d478faabb04300aab6f4f => generated 360 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:10:27.415710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa302b8-12cf-417f-a793-bccf4639fada tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:27.432324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa302b8-12cf-417f-a793-bccf4639fada tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:27.452802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e015a34-3bdd-465c-a09b-353d0518a933 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:27.453453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e015a34-3bdd-465c-a09b-353d0518a933 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:27.453733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e015a34-3bdd-465c-a09b-353d0518a933 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:27.454004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e015a34-3bdd-465c-a09b-353d0518a933 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints/ddff2ed24c6d478faabb04300aab6f4f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:27.461331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e015a34-3bdd-465c-a09b-353d0518a933 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ddff2ed24c6d478faabb04300aab6f4f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:27.462369 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-8e015a34-3bdd-465c-a09b-353d0518a933 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:10:27.462369 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:10:27.462369 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:10:27.463299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e015a34-3bdd-465c-a09b-353d0518a933 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:27.502583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8e015a34-3bdd-465c-a09b-353d0518a933 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ddff2ed24c6d478faabb04300aab6f4f', 'request_id': 'req-8e015a34-3bdd-465c-a09b-353d0518a933'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:27.554522 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1554/3133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:27 2022] DELETE /identity/v3/endpoints/ddff2ed24c6d478faabb04300aab6f4f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:27.555764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd04236-04e6-413e-a2e6-04d0362c4f1e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:27.566366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd04236-04e6-413e-a2e6-04d0362c4f1e tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:27.630416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29c2c4-065a-4675-b086-b4521e1c4b64 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:27.633269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29c2c4-065a-4675-b086-b4521e1c4b64 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:27.633555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29c2c4-065a-4675-b086-b4521e1c4b64 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:27.633833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29c2c4-065a-4675-b086-b4521e1c4b64 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:27.634470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29c2c4-065a-4675-b086-b4521e1c4b64 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:27.635512 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-2f29c2c4-065a-4675-b086-b4521e1c4b64 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:10:27.635512 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:10:27.635512 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:10:27.645451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29c2c4-065a-4675-b086-b4521e1c4b64 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:27.685084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e015a34-3bdd-465c-a09b-353d0518a933 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:27.697958 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1580/3134] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Oct 16 01:10:27 2022] GET /identity/v3/endpoints => generated 4049 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:27.703087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e015a34-3bdd-465c-a09b-353d0518a933 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:27.722903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7865c-858b-40e7-a434-a0f61e4c0de5 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:27.723587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7865c-858b-40e7-a434-a0f61e4c0de5 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:27.723869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7865c-858b-40e7-a434-a0f61e4c0de5 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:27.724143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7865c-858b-40e7-a434-a0f61e4c0de5 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints/ddff2ed24c6d478faabb04300aab6f4f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:27.748915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7865c-858b-40e7-a434-a0f61e4c0de5 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-98d7865c-858b-40e7-a434-a0f61e4c0de5 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Could not find endpoint: ddff2ed24c6d478faabb04300aab6f4f.: keystone.exception.EndpointNotFound: Could not find endpoint: ddff2ed24c6d478faabb04300aab6f4f. Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._iter().one() Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._only_one_row( Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:10:27.789226 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: ddff2ed24c6d478faabb04300aab6f4f. Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:10:27.793589 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:10:27.794639 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: ddff2ed24c6d478faabb04300aab6f4f. Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:10:27.795889 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1555/3135] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:27 2022] DELETE /identity/v3/endpoints/ddff2ed24c6d478faabb04300aab6f4f => generated 114 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:10:27.796672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29c2c4-065a-4675-b086-b4521e1c4b64 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:27.808077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29c2c4-065a-4675-b086-b4521e1c4b64 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:27.826505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e780b25-9627-43f1-a3b3-51f457d416de tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:27.827236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e780b25-9627-43f1-a3b3-51f457d416de tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:27.827512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e780b25-9627-43f1-a3b3-51f457d416de tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:27.827790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e780b25-9627-43f1-a3b3-51f457d416de tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/regions/tempest-region-1261776126` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:27.828380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e780b25-9627-43f1-a3b3-51f457d416de tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1261776126)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:27.829385 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-1e780b25-9627-43f1-a3b3-51f457d416de tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:10:27.829385 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:10:27.829385 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:10:27.830274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e780b25-9627-43f1-a3b3-51f457d416de tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:27.889189 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-1e780b25-9627-43f1-a3b3-51f457d416de tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1261776126. To ensure interoperability, identifiers should be a valid uuid. Oct 16 01:10:27.889189 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 16 01:10:27.889189 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:10:27.923078 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1581/3136] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Oct 16 01:10:27 2022] DELETE /identity/v3/regions/tempest-region-1261776126 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:10:27.924845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7865c-858b-40e7-a434-a0f61e4c0de5 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:27.935869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7865c-858b-40e7-a434-a0f61e4c0de5 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:27.976677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988ceb1-5ae7-4568-9df7-09c1e3647ac0 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:27.977310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988ceb1-5ae7-4568-9df7-09c1e3647ac0 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:27.977575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988ceb1-5ae7-4568-9df7-09c1e3647ac0 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:27.977845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988ceb1-5ae7-4568-9df7-09c1e3647ac0 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:27.978607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988ceb1-5ae7-4568-9df7-09c1e3647ac0 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:27.980252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988ceb1-5ae7-4568-9df7-09c1e3647ac0 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:28.004690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e780b25-9627-43f1-a3b3-51f457d416de tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:28.005779 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1556/3137] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Oct 16 01:10:27 2022] GET /identity/v3/endpoints => generated 4049 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:28.022083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e780b25-9627-43f1-a3b3-51f457d416de tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:28.033401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d8cdf-bb93-4234-a45a-115efdb6b7b3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:28.034026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d8cdf-bb93-4234-a45a-115efdb6b7b3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:28.034302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d8cdf-bb93-4234-a45a-115efdb6b7b3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:28.034573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d8cdf-bb93-4234-a45a-115efdb6b7b3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:28.035344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d8cdf-bb93-4234-a45a-115efdb6b7b3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Adding query filter params (service_id=3727e766c64f4abcab4e1e1c6f4edce0) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:10:28.035648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d8cdf-bb93-4234-a45a-115efdb6b7b3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:28.037265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d8cdf-bb93-4234-a45a-115efdb6b7b3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:28.053878 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1582/3138] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:10:28 2022] GET /identity/v3/endpoints?service_id=3727e766c64f4abcab4e1e1c6f4edce0 => generated 502 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:10:28.057690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988ceb1-5ae7-4568-9df7-09c1e3647ac0 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:28.077488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988ceb1-5ae7-4568-9df7-09c1e3647ac0 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:28.092717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d2068-eb52-40c4-b96f-a9fec503770d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:28.093676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d2068-eb52-40c4-b96f-a9fec503770d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:28.094106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d2068-eb52-40c4-b96f-a9fec503770d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:28.094571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d2068-eb52-40c4-b96f-a9fec503770d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:28.095434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d2068-eb52-40c4-b96f-a9fec503770d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Adding query filter params (service_id=b1bfb3080f554c09aa964eedd5a4c5aa) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:10:28.095991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d2068-eb52-40c4-b96f-a9fec503770d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:28.097855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d2068-eb52-40c4-b96f-a9fec503770d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:28.113468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d8cdf-bb93-4234-a45a-115efdb6b7b3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:28.114029 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1557/3139] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:10:28 2022] GET /identity/v3/endpoints?service_id=b1bfb3080f554c09aa964eedd5a4c5aa => generated 504 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:10:28.125339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d8cdf-bb93-4234-a45a-115efdb6b7b3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:28.136939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba415a9-b5e1-4096-8a4d-905c5540c435 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:28.138298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba415a9-b5e1-4096-8a4d-905c5540c435 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:28.138676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba415a9-b5e1-4096-8a4d-905c5540c435 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:28.139262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba415a9-b5e1-4096-8a4d-905c5540c435 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:28.140147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba415a9-b5e1-4096-8a4d-905c5540c435 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:10:28.146943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba415a9-b5e1-4096-8a4d-905c5540c435 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:28.148988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba415a9-b5e1-4096-8a4d-905c5540c435 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:28.169140 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1583/3140] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Oct 16 01:10:28 2022] GET /identity/v3/endpoints?interface=public => generated 3405 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:28.173432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d2068-eb52-40c4-b96f-a9fec503770d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:28.205985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d2068-eb52-40c4-b96f-a9fec503770d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:28.223388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d369f48-ebb3-4e2e-a28d-1ffd69259852 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:28.224013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d369f48-ebb3-4e2e-a28d-1ffd69259852 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:28.224290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d369f48-ebb3-4e2e-a28d-1ffd69259852 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:28.224567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d369f48-ebb3-4e2e-a28d-1ffd69259852 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:28.225220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d369f48-ebb3-4e2e-a28d-1ffd69259852 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:10:28.225525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d369f48-ebb3-4e2e-a28d-1ffd69259852 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:28.227392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d369f48-ebb3-4e2e-a28d-1ffd69259852 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:28.248446 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1558/3141] 10.222.0.39 () {58 vars in 1171 bytes} [Sun Oct 16 01:10:28 2022] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:10:28.249775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba415a9-b5e1-4096-8a4d-905c5540c435 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:28.266295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba415a9-b5e1-4096-8a4d-905c5540c435 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:28.283968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef6857-663a-4c0e-a05e-f95983988d3b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:28.284588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef6857-663a-4c0e-a05e-f95983988d3b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:28.284878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef6857-663a-4c0e-a05e-f95983988d3b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:28.285140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef6857-663a-4c0e-a05e-f95983988d3b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:28.285794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef6857-663a-4c0e-a05e-f95983988d3b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:28.287605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef6857-663a-4c0e-a05e-f95983988d3b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:28.324272 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1584/3142] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:28 2022] POST /identity/v3/services => generated 288 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:28.328902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d369f48-ebb3-4e2e-a28d-1ffd69259852 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:28.346625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d369f48-ebb3-4e2e-a28d-1ffd69259852 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:28.383813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917822b-3d01-4691-9d4d-e5110b0f5fb4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:28.384569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917822b-3d01-4691-9d4d-e5110b0f5fb4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:28.384946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917822b-3d01-4691-9d4d-e5110b0f5fb4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:28.385399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917822b-3d01-4691-9d4d-e5110b0f5fb4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:28.386308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917822b-3d01-4691-9d4d-e5110b0f5fb4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:28.388567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917822b-3d01-4691-9d4d-e5110b0f5fb4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:28.437049 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-d917822b-3d01-4691-9d4d-e5110b0f5fb4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-595027192. To ensure interoperability, identifiers should be a valid uuid. Oct 16 01:10:28.437049 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 16 01:10:28.437049 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:10:28.500514 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1559/3143] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Oct 16 01:10:28 2022] POST /identity/v3/endpoints => generated 358 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:10:28.504641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef6857-663a-4c0e-a05e-f95983988d3b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:28.525438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef6857-663a-4c0e-a05e-f95983988d3b tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:28.569098 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:28.577725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39738807-b552-4b7f-9b8a-4e6e6c6cca9d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:28.582884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39738807-b552-4b7f-9b8a-4e6e6c6cca9d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:28.582884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39738807-b552-4b7f-9b8a-4e6e6c6cca9d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:28.583128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39738807-b552-4b7f-9b8a-4e6e6c6cca9d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/regions/tempest-region-595027192` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:28.586321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39738807-b552-4b7f-9b8a-4e6e6c6cca9d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-595027192)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:28.586321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39738807-b552-4b7f-9b8a-4e6e6c6cca9d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:28.593668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917822b-3d01-4691-9d4d-e5110b0f5fb4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:28.598625 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1585/3144] 10.222.0.39 () {58 vars in 1203 bytes} [Sun Oct 16 01:10:28 2022] GET /identity/v3/regions/tempest-region-595027192 => generated 178 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:10:28.614415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917822b-3d01-4691-9d4d-e5110b0f5fb4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:28.634238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee2e63-3805-4df3-b3df-7d972bd75f11 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:28.634903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee2e63-3805-4df3-b3df-7d972bd75f11 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:28.635307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee2e63-3805-4df3-b3df-7d972bd75f11 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:28.635562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee2e63-3805-4df3-b3df-7d972bd75f11 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints/23fddfa1cdf44bd4bf33d85b703fece5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:28.656487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee2e63-3805-4df3-b3df-7d972bd75f11 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=23fddfa1cdf44bd4bf33d85b703fece5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:28.657572 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-a6ee2e63-3805-4df3-b3df-7d972bd75f11 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:10:28.657572 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:10:28.657572 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:10:28.658566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee2e63-3805-4df3-b3df-7d972bd75f11 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:28.710805 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-a6ee2e63-3805-4df3-b3df-7d972bd75f11 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-551074209. To ensure interoperability, identifiers should be a valid uuid. Oct 16 01:10:28.710805 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 16 01:10:28.710805 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:10:28.775652 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1560/3145] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Oct 16 01:10:28 2022] PATCH /identity/v3/endpoints/23fddfa1cdf44bd4bf33d85b703fece5 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:10:28.779652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39738807-b552-4b7f-9b8a-4e6e6c6cca9d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:28.794518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39738807-b552-4b7f-9b8a-4e6e6c6cca9d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:28.835798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c779c3-7513-4372-ab33-f78f59990ed4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:28.836559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c779c3-7513-4372-ab33-f78f59990ed4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:28.836811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c779c3-7513-4372-ab33-f78f59990ed4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:28.837086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c779c3-7513-4372-ab33-f78f59990ed4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/regions/tempest-region-551074209` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:28.837881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c779c3-7513-4372-ab33-f78f59990ed4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-551074209)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:28.841504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c779c3-7513-4372-ab33-f78f59990ed4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:28.846609 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1586/3146] 10.222.0.39 () {58 vars in 1203 bytes} [Sun Oct 16 01:10:28 2022] GET /identity/v3/regions/tempest-region-551074209 => generated 178 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:10:28.850085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee2e63-3805-4df3-b3df-7d972bd75f11 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:28.866951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee2e63-3805-4df3-b3df-7d972bd75f11 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:28.877917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2265e8-eacc-4e75-826b-1aa742a2b744 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:28.878571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2265e8-eacc-4e75-826b-1aa742a2b744 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:28.878846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2265e8-eacc-4e75-826b-1aa742a2b744 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:28.879142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2265e8-eacc-4e75-826b-1aa742a2b744 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints/23fddfa1cdf44bd4bf33d85b703fece5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:28.894128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2265e8-eacc-4e75-826b-1aa742a2b744 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=23fddfa1cdf44bd4bf33d85b703fece5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:28.896057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2265e8-eacc-4e75-826b-1aa742a2b744 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:28.916660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3d2265e8-eacc-4e75-826b-1aa742a2b744 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '23fddfa1cdf44bd4bf33d85b703fece5', 'request_id': 'req-3d2265e8-eacc-4e75-826b-1aa742a2b744'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:28.936017 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1561/3147] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:28 2022] DELETE /identity/v3/endpoints/23fddfa1cdf44bd4bf33d85b703fece5 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:28.940272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c779c3-7513-4372-ab33-f78f59990ed4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:28.953521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c779c3-7513-4372-ab33-f78f59990ed4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:28.990797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab021571-5cbc-4855-af02-e6cfdf6c9d9a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:28.993304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab021571-5cbc-4855-af02-e6cfdf6c9d9a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:28.993587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab021571-5cbc-4855-af02-e6cfdf6c9d9a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:28.994072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab021571-5cbc-4855-af02-e6cfdf6c9d9a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/regions/tempest-region-551074209` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:28.995205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab021571-5cbc-4855-af02-e6cfdf6c9d9a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-551074209)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:28.998649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab021571-5cbc-4855-af02-e6cfdf6c9d9a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:29.032779 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-ab021571-5cbc-4855-af02-e6cfdf6c9d9a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-551074209. To ensure interoperability, identifiers should be a valid uuid. Oct 16 01:10:29.032779 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 16 01:10:29.032779 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:10:29.045003 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1587/3148] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Oct 16 01:10:28 2022] DELETE /identity/v3/regions/tempest-region-551074209 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:29.048771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2265e8-eacc-4e75-826b-1aa742a2b744 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:29.064615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2265e8-eacc-4e75-826b-1aa742a2b744 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:29.084643 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:29.116499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218139aa-c4e2-45f3-8b6c-77e3e0475228 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:29.117685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218139aa-c4e2-45f3-8b6c-77e3e0475228 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:29.118237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218139aa-c4e2-45f3-8b6c-77e3e0475228 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:29.118516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218139aa-c4e2-45f3-8b6c-77e3e0475228 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/regions/tempest-region-595027192` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:29.119315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218139aa-c4e2-45f3-8b6c-77e3e0475228 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-595027192)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:29.120444 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-218139aa-c4e2-45f3-8b6c-77e3e0475228 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:10:29.120444 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:10:29.120444 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:10:29.121469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218139aa-c4e2-45f3-8b6c-77e3e0475228 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:29.158161 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1562/3149] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Oct 16 01:10:29 2022] DELETE /identity/v3/regions/tempest-region-595027192 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:29.162113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab021571-5cbc-4855-af02-e6cfdf6c9d9a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:29.186806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab021571-5cbc-4855-af02-e6cfdf6c9d9a tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:29.236821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776b7ab-c021-4c9e-b82b-340b6ac8a35d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:29.239480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776b7ab-c021-4c9e-b82b-340b6ac8a35d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:29.240161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776b7ab-c021-4c9e-b82b-340b6ac8a35d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:29.241162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776b7ab-c021-4c9e-b82b-340b6ac8a35d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/services/367b8ff3501d4d37ab9ea3d99ed5fd7a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:29.242911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776b7ab-c021-4c9e-b82b-340b6ac8a35d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:delete_service(service_id=367b8ff3501d4d37ab9ea3d99ed5fd7a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:29.244306 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-9776b7ab-c021-4c9e-b82b-340b6ac8a35d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:10:29.244306 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:10:29.244306 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:10:29.245591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776b7ab-c021-4c9e-b82b-340b6ac8a35d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:29.290003 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1588/3150] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:29 2022] DELETE /identity/v3/services/367b8ff3501d4d37ab9ea3d99ed5fd7a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:29.294600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218139aa-c4e2-45f3-8b6c-77e3e0475228 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:29.308528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218139aa-c4e2-45f3-8b6c-77e3e0475228 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:29.346654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5391d-8b33-4700-bf5d-06c7eb6cbebf tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:29.347342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5391d-8b33-4700-bf5d-06c7eb6cbebf tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:29.347622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5391d-8b33-4700-bf5d-06c7eb6cbebf tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:29.349141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5391d-8b33-4700-bf5d-06c7eb6cbebf tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints/8ed1d061670944e39600317c740d3c39` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:29.357429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5391d-8b33-4700-bf5d-06c7eb6cbebf tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8ed1d061670944e39600317c740d3c39)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:29.359894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5391d-8b33-4700-bf5d-06c7eb6cbebf tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:29.375554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6df5391d-8b33-4700-bf5d-06c7eb6cbebf tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8ed1d061670944e39600317c740d3c39', 'request_id': 'req-6df5391d-8b33-4700-bf5d-06c7eb6cbebf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:29.402990 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1563/3151] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:29 2022] DELETE /identity/v3/endpoints/8ed1d061670944e39600317c740d3c39 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:29.407892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776b7ab-c021-4c9e-b82b-340b6ac8a35d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:29.422502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776b7ab-c021-4c9e-b82b-340b6ac8a35d tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:29.453136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efacdef-e2a6-453e-9ef6-1400568a2950 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:29.453854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efacdef-e2a6-453e-9ef6-1400568a2950 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:29.454190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efacdef-e2a6-453e-9ef6-1400568a2950 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:29.454586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efacdef-e2a6-453e-9ef6-1400568a2950 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/regions/tempest-region-1035041725` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:29.455382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efacdef-e2a6-453e-9ef6-1400568a2950 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1035041725)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:29.458582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efacdef-e2a6-453e-9ef6-1400568a2950 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:29.476562 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-1efacdef-e2a6-453e-9ef6-1400568a2950 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1035041725. To ensure interoperability, identifiers should be a valid uuid. Oct 16 01:10:29.476562 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 16 01:10:29.476562 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:10:29.493793 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1589/3152] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Oct 16 01:10:29 2022] DELETE /identity/v3/regions/tempest-region-1035041725 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:29.502984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5391d-8b33-4700-bf5d-06c7eb6cbebf tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:29.559845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5391d-8b33-4700-bf5d-06c7eb6cbebf tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:29.639633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dc878-4762-4f02-800b-02894da1fcf3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:29.640290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dc878-4762-4f02-800b-02894da1fcf3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:29.640629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dc878-4762-4f02-800b-02894da1fcf3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:29.640908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dc878-4762-4f02-800b-02894da1fcf3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/services/b1bfb3080f554c09aa964eedd5a4c5aa` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:29.641492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dc878-4762-4f02-800b-02894da1fcf3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b1bfb3080f554c09aa964eedd5a4c5aa)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:29.642502 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-c94dc878-4762-4f02-800b-02894da1fcf3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:10:29.642502 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:10:29.642502 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:10:29.644396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dc878-4762-4f02-800b-02894da1fcf3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:29.667776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dbb8a-b823-453e-be6f-7b0bd41c1ecc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:29.668246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dbb8a-b823-453e-be6f-7b0bd41c1ecc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:29.668339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dbb8a-b823-453e-be6f-7b0bd41c1ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:29.777382 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1564/3153] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:29 2022] DELETE /identity/v3/services/b1bfb3080f554c09aa964eedd5a4c5aa => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:29.780159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dc878-4762-4f02-800b-02894da1fcf3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:29.870825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dc878-4762-4f02-800b-02894da1fcf3 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:29.884828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee20b-6b08-4239-9a94-bbf17d39382c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:29.885797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee20b-6b08-4239-9a94-bbf17d39382c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:29.889077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee20b-6b08-4239-9a94-bbf17d39382c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:29.890660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee20b-6b08-4239-9a94-bbf17d39382c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/endpoints/8e435bd150f3490c832e82db95cfa7db` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:29.903807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aee20b-6b08-4239-9a94-bbf17d39382c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8e435bd150f3490c832e82db95cfa7db)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:29.910352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aee20b-6b08-4239-9a94-bbf17d39382c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:29.920260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e63dbb8a-b823-453e-be6f-7b0bd41c1ecc None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:29.921591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e63dbb8a-b823-453e-be6f-7b0bd41c1ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:29.930561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f0aee20b-6b08-4239-9a94-bbf17d39382c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8e435bd150f3490c832e82db95cfa7db', 'request_id': 'req-f0aee20b-6b08-4239-9a94-bbf17d39382c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:29.968400 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1565/3154] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:29 2022] DELETE /identity/v3/endpoints/8e435bd150f3490c832e82db95cfa7db => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:29.969320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee20b-6b08-4239-9a94-bbf17d39382c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:30.025570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee20b-6b08-4239-9a94-bbf17d39382c tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:30.038334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1273a50-1272-4c20-bcf5-f10fcf8ef4d4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:30.040439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1273a50-1272-4c20-bcf5-f10fcf8ef4d4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:30.040730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1273a50-1272-4c20-bcf5-f10fcf8ef4d4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:30.043312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1273a50-1272-4c20-bcf5-f10fcf8ef4d4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/regions/tempest-region-1773748008` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:30.044043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1273a50-1272-4c20-bcf5-f10fcf8ef4d4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1773748008)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:30.048853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1273a50-1272-4c20-bcf5-f10fcf8ef4d4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:30.080490 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-f1273a50-1272-4c20-bcf5-f10fcf8ef4d4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1773748008. To ensure interoperability, identifiers should be a valid uuid. Oct 16 01:10:30.080490 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 16 01:10:30.080490 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:10:30.091556 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1566/3155] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Oct 16 01:10:29 2022] DELETE /identity/v3/regions/tempest-region-1773748008 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:30.096035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1273a50-1272-4c20-bcf5-f10fcf8ef4d4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:30.208991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1273a50-1272-4c20-bcf5-f10fcf8ef4d4 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:30.223663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92761c0a-73b9-441f-87b3-3cf0feca7828 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d69db511744d28b91e76ec69e61337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f58ba50466d24cb29fff768be831edd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:30.223976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761c0a-73b9-441f-87b3-3cf0feca7828 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:30.224415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761c0a-73b9-441f-87b3-3cf0feca7828 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:30.225459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761c0a-73b9-441f-87b3-3cf0feca7828 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] PATH_INFO: `/v3/services/3727e766c64f4abcab4e1e1c6f4edce0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:30.227177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92761c0a-73b9-441f-87b3-3cf0feca7828 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3727e766c64f4abcab4e1e1c6f4edce0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:30.234561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92761c0a-73b9-441f-87b3-3cf0feca7828 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:30.241182 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1590/3156] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:10:29 2022] POST /identity/v3/auth/tokens => generated 3328 bytes in 574 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:10:30.324428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dbb8a-b823-453e-be6f-7b0bd41c1ecc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:30.326184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e63dbb8a-b823-453e-be6f-7b0bd41c1ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:30.337819 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1567/3157] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:30 2022] DELETE /identity/v3/services/3727e766c64f4abcab4e1e1c6f4edce0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:30.341876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92761c0a-73b9-441f-87b3-3cf0feca7828 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:30.400456 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:30.421301 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:30.528554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92761c0a-73b9-441f-87b3-3cf0feca7828 tempest-EndPointsTestJSON-1034341535 tempest-EndPointsTestJSON-1034341535-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:30.538299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a71105-a9bf-4251-a0a5-4a1993bc5ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:30.539139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71105-a9bf-4251-a0a5-4a1993bc5ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:30.539513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71105-a9bf-4251-a0a5-4a1993bc5ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:30.539878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71105-a9bf-4251-a0a5-4a1993bc5ecc admin admin] PATH_INFO: `/v3/users/45963b0b51474cae80b9efadf734cfdf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:30.542514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a71105-a9bf-4251-a0a5-4a1993bc5ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=45963b0b51474cae80b9efadf734cfdf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:30.546601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a71105-a9bf-4251-a0a5-4a1993bc5ecc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:30.702119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30a71105-a9bf-4251-a0a5-4a1993bc5ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45963b0b51474cae80b9efadf734cfdf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:30.705358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30a71105-a9bf-4251-a0a5-4a1993bc5ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45963b0b51474cae80b9efadf734cfdf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:30.747825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30a71105-a9bf-4251-a0a5-4a1993bc5ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45963b0b51474cae80b9efadf734cfdf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:30.770112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30a71105-a9bf-4251-a0a5-4a1993bc5ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45963b0b51474cae80b9efadf734cfdf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:30.771251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30a71105-a9bf-4251-a0a5-4a1993bc5ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45963b0b51474cae80b9efadf734cfdf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:30.808095 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1568/3158] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:10:30 2022] DELETE /identity/v3/users/45963b0b51474cae80b9efadf734cfdf => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:30.816387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9208f-5c4b-4038-a29d-3fbca50f530b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:30.821239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9208f-5c4b-4038-a29d-3fbca50f530b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:30.827596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9208f-5c4b-4038-a29d-3fbca50f530b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:30.937879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f3f9208f-5c4b-4038-a29d-3fbca50f530b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:30.945478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f3f9208f-5c4b-4038-a29d-3fbca50f530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:31.056946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dbb8a-b823-453e-be6f-7b0bd41c1ecc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:31.280190 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1569/3159] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:31.283239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c329049-56b2-4522-a7e5-ecae555e4d70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:31.284033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c329049-56b2-4522-a7e5-ecae555e4d70 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:31.284473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c329049-56b2-4522-a7e5-ecae555e4d70 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:31.284886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c329049-56b2-4522-a7e5-ecae555e4d70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:31.286877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2c329049-56b2-4522-a7e5-ecae555e4d70 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:31.305426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9208f-5c4b-4038-a29d-3fbca50f530b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:31.307458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f3f9208f-5c4b-4038-a29d-3fbca50f530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:31.431698 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:31.478831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9208f-5c4b-4038-a29d-3fbca50f530b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:31.479066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c329049-56b2-4522-a7e5-ecae555e4d70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:31.480481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c329049-56b2-4522-a7e5-ecae555e4d70 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:31.490875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8041d-50c0-4fe4-9eb7-7aa02270b7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:31.491559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8041d-50c0-4fe4-9eb7-7aa02270b7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:31.491842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8041d-50c0-4fe4-9eb7-7aa02270b7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:31.492114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8041d-50c0-4fe4-9eb7-7aa02270b7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:31.511112 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1591/3160] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:10:31.515851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8041d-50c0-4fe4-9eb7-7aa02270b7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:31.517315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8041d-50c0-4fe4-9eb7-7aa02270b7b0 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:31.546573 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1570/3161] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:10:32.828235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c329049-56b2-4522-a7e5-ecae555e4d70 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:32.831817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2c329049-56b2-4522-a7e5-ecae555e4d70 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:32.888751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c329049-56b2-4522-a7e5-ecae555e4d70 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:32.911210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:32.929167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:32.935331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:32.935331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] PATH_INFO: `/v3/projects/1fe07ab5afac468d9a55448f2ac3584a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:32.943079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe07ab5afac468d9a55448f2ac3584a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:32.958484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:33.182730 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:33.230751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe07ab5afac468d9a55448f2ac3584a', 'request_id': 'req-d0f0101b-f54e-47c2-8d0b-608e679fc90b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:33.267374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe07ab5afac468d9a55448f2ac3584a', 'request_id': 'req-d0f0101b-f54e-47c2-8d0b-608e679fc90b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:33.296651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe07ab5afac468d9a55448f2ac3584a', 'request_id': 'req-d0f0101b-f54e-47c2-8d0b-608e679fc90b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:33.327689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] The token cache is being invalidate because project 1fe07ab5afac468d9a55448f2ac3584a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:33.329842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:33.331272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:33.344452 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1592/3162] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:32 2022] DELETE /identity/v3/projects/1fe07ab5afac468d9a55448f2ac3584a => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:33.350740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8041d-50c0-4fe4-9eb7-7aa02270b7b0 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:33.385147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8041d-50c0-4fe4-9eb7-7aa02270b7b0 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:33.571031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea6fe4-efab-4602-8b6a-9b468739f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:33.572449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea6fe4-efab-4602-8b6a-9b468739f8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:33.574405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea6fe4-efab-4602-8b6a-9b468739f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:33.576703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea6fe4-efab-4602-8b6a-9b468739f8dc admin admin] PATH_INFO: `/v3/users/32d69db511744d28b91e76ec69e61337` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:33.580553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea6fe4-efab-4602-8b6a-9b468739f8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d69db511744d28b91e76ec69e61337)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:33.585817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea6fe4-efab-4602-8b6a-9b468739f8dc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:33.694637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3dea6fe4-efab-4602-8b6a-9b468739f8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d69db511744d28b91e76ec69e61337'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:33.696508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3dea6fe4-efab-4602-8b6a-9b468739f8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d69db511744d28b91e76ec69e61337'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:33.725149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3dea6fe4-efab-4602-8b6a-9b468739f8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d69db511744d28b91e76ec69e61337'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:33.741071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3dea6fe4-efab-4602-8b6a-9b468739f8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d69db511744d28b91e76ec69e61337'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:33.741664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3dea6fe4-efab-4602-8b6a-9b468739f8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d69db511744d28b91e76ec69e61337'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:33.768499 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1571/3163] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:10:33 2022] DELETE /identity/v3/users/32d69db511744d28b91e76ec69e61337 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:35.350346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:35.352764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:35.384591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0101b-f54e-47c2-8d0b-608e679fc90b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:35.587702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7c7fc-f2a4-4039-aa71-a06d023ca087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:35.588507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7c7fc-f2a4-4039-aa71-a06d023ca087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:35.589208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7c7fc-f2a4-4039-aa71-a06d023ca087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:35.589885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7c7fc-f2a4-4039-aa71-a06d023ca087 admin admin] PATH_INFO: `/v3/projects/f58ba50466d24cb29fff768be831edd4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:35.592592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7c7fc-f2a4-4039-aa71-a06d023ca087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58ba50466d24cb29fff768be831edd4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:35.595403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7c7fc-f2a4-4039-aa71-a06d023ca087 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:35.672116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c38ddc-6a11-4d22-b322-6ff499d6d876 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:35.672623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c38ddc-6a11-4d22-b322-6ff499d6d876 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:35.672894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c38ddc-6a11-4d22-b322-6ff499d6d876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:35.760381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f7c38ddc-6a11-4d22-b322-6ff499d6d876 None None] MFA Rules not processed for user `0a7ca896a35447f8a828817a8620d308`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:35.764773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f7c38ddc-6a11-4d22-b322-6ff499d6d876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:35.769963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-73c7c7fc-f2a4-4039-aa71-a06d023ca087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58ba50466d24cb29fff768be831edd4', 'request_id': 'req-73c7c7fc-f2a4-4039-aa71-a06d023ca087'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:35.797668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-73c7c7fc-f2a4-4039-aa71-a06d023ca087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58ba50466d24cb29fff768be831edd4', 'request_id': 'req-73c7c7fc-f2a4-4039-aa71-a06d023ca087'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:35.822115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-73c7c7fc-f2a4-4039-aa71-a06d023ca087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58ba50466d24cb29fff768be831edd4', 'request_id': 'req-73c7c7fc-f2a4-4039-aa71-a06d023ca087'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:35.868958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-73c7c7fc-f2a4-4039-aa71-a06d023ca087 admin admin] The token cache is being invalidate because project f58ba50466d24cb29fff768be831edd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:35.868958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-73c7c7fc-f2a4-4039-aa71-a06d023ca087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:35.869546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-73c7c7fc-f2a4-4039-aa71-a06d023ca087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:35.872389 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1593/3164] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:35 2022] DELETE /identity/v3/projects/f58ba50466d24cb29fff768be831edd4 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:35.876465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7856bc-3a7f-4f5e-8065-757749d0baca None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:35.876959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7856bc-3a7f-4f5e-8065-757749d0baca None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:35.877625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7856bc-3a7f-4f5e-8065-757749d0baca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:35.935078 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:36.002318 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1572/3165] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:36.013171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b350f16-b769-4d2d-82e9-20ca37eea899 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:36.017913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b350f16-b769-4d2d-82e9-20ca37eea899 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:36.018298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b350f16-b769-4d2d-82e9-20ca37eea899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:36.026669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0a7856bc-3a7f-4f5e-8065-757749d0baca None None] MFA Rules not processed for user `02ad8a9597ab413dad2f7babb1ffbc69`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:36.028642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0a7856bc-3a7f-4f5e-8065-757749d0baca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:36.094727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6b350f16-b769-4d2d-82e9-20ca37eea899 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:36.099763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6b350f16-b769-4d2d-82e9-20ca37eea899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:36.178116 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:36.244192 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1594/3166] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:36.248576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e89bd-0b95-47b0-b690-90791a709a7a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:36.248874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e89bd-0b95-47b0-b690-90791a709a7a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:36.249166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e89bd-0b95-47b0-b690-90791a709a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:36.308995 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1573/3167] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:36.314271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81562566-ae85-4b92-b4c0-063669b732e3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:36.316641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-036e89bd-0b95-47b0-b690-90791a709a7a None None] MFA Rules not processed for user `0a7ca896a35447f8a828817a8620d308`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:36.317865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81562566-ae85-4b92-b4c0-063669b732e3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:36.317865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81562566-ae85-4b92-b4c0-063669b732e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:36.321719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-036e89bd-0b95-47b0-b690-90791a709a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:36.350946 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1595/3168] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:36.383274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-81562566-ae85-4b92-b4c0-063669b732e3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:36.390791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-81562566-ae85-4b92-b4c0-063669b732e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:36.416820 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1574/3169] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:36.418537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e89bd-0b95-47b0-b690-90791a709a7a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:36.457612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e89bd-0b95-47b0-b690-90791a709a7a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:36.509868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5ae90-fde1-4154-a6a6-8208e35acc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:36.511225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5ae90-fde1-4154-a6a6-8208e35acc19 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:36.513396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5ae90-fde1-4154-a6a6-8208e35acc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:36.515157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5ae90-fde1-4154-a6a6-8208e35acc19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:36.523987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81562566-ae85-4b92-b4c0-063669b732e3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:36.525619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-81562566-ae85-4b92-b4c0-063669b732e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:36.527263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5ae90-fde1-4154-a6a6-8208e35acc19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:10:36.531686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5ae90-fde1-4154-a6a6-8208e35acc19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:36.533767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5ae90-fde1-4154-a6a6-8208e35acc19 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:36.593327 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1596/3170] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:10:36.594772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5ae90-fde1-4154-a6a6-8208e35acc19 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:36.680322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5ae90-fde1-4154-a6a6-8208e35acc19 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:36.701087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912c107-7e19-46b2-a86a-f8f53948be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:36.701927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912c107-7e19-46b2-a86a-f8f53948be8b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:36.702316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912c107-7e19-46b2-a86a-f8f53948be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:36.702705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912c107-7e19-46b2-a86a-f8f53948be8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:36.703474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912c107-7e19-46b2-a86a-f8f53948be8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:36.705575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912c107-7e19-46b2-a86a-f8f53948be8b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:36.787088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81562566-ae85-4b92-b4c0-063669b732e3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:36.799811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2de034-069f-4bed-9a8b-7de790e7cd57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:36.800453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2de034-069f-4bed-9a8b-7de790e7cd57 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:36.800733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2de034-069f-4bed-9a8b-7de790e7cd57 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:36.801004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2de034-069f-4bed-9a8b-7de790e7cd57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:36.807626 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1597/3171] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:36 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:36.809455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94850e-1b8d-477e-9c2a-a1b5e1ed0e00 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:36.810294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94850e-1b8d-477e-9c2a-a1b5e1ed0e00 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:36.810826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94850e-1b8d-477e-9c2a-a1b5e1ed0e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:36.822538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2de034-069f-4bed-9a8b-7de790e7cd57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:36.826202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2de034-069f-4bed-9a8b-7de790e7cd57 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:36.859441 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1575/3172] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:10:36.860539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2de034-069f-4bed-9a8b-7de790e7cd57 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:36.876800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bf94850e-1b8d-477e-9c2a-a1b5e1ed0e00 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:36.878282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bf94850e-1b8d-477e-9c2a-a1b5e1ed0e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:36.889071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2de034-069f-4bed-9a8b-7de790e7cd57 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:37.022219 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:37.030007 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1598/3173] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:10:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:37.039515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1b03-5a9f-40eb-ba94-ecf035e23966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:37.040185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1b03-5a9f-40eb-ba94-ecf035e23966 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:37.040410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1b03-5a9f-40eb-ba94-ecf035e23966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:37.040677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1b03-5a9f-40eb-ba94-ecf035e23966 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:37.041315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c1b03-5a9f-40eb-ba94-ecf035e23966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:37.043463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c1b03-5a9f-40eb-ba94-ecf035e23966 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:37.044862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94850e-1b8d-477e-9c2a-a1b5e1ed0e00 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:37.047179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bf94850e-1b8d-477e-9c2a-a1b5e1ed0e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:37.107935 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1576/3174] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:36 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:37.112193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1b03-5a9f-40eb-ba94-ecf035e23966 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:37.125225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1b03-5a9f-40eb-ba94-ecf035e23966 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:37.139361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49123b3a-8395-4f50-bf4a-cf7c09b5557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:37.141343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49123b3a-8395-4f50-bf4a-cf7c09b5557d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:37.142561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49123b3a-8395-4f50-bf4a-cf7c09b5557d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:37.143474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49123b3a-8395-4f50-bf4a-cf7c09b5557d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:37.145397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49123b3a-8395-4f50-bf4a-cf7c09b5557d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:37.149943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49123b3a-8395-4f50-bf4a-cf7c09b5557d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:37.185547 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1577/3175] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:37.187095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49123b3a-8395-4f50-bf4a-cf7c09b5557d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:37.216122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49123b3a-8395-4f50-bf4a-cf7c09b5557d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:37.222330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99988599-0e13-4f92-b5a1-2a1c366c4d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:37.223096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99988599-0e13-4f92-b5a1-2a1c366c4d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:37.223379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99988599-0e13-4f92-b5a1-2a1c366c4d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:37.223644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99988599-0e13-4f92-b5a1-2a1c366c4d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:37.224317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94850e-1b8d-477e-9c2a-a1b5e1ed0e00 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:37.224429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99988599-0e13-4f92-b5a1-2a1c366c4d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:37.227593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99988599-0e13-4f92-b5a1-2a1c366c4d9c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:37.233670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e767a-4fe8-4f40-b4d6-f6da67fc7e8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:37.234599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e767a-4fe8-4f40-b4d6-f6da67fc7e8d service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:37.236176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e767a-4fe8-4f40-b4d6-f6da67fc7e8d service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:37.236683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e767a-4fe8-4f40-b4d6-f6da67fc7e8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:37.248534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e767a-4fe8-4f40-b4d6-f6da67fc7e8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:37.250508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e767a-4fe8-4f40-b4d6-f6da67fc7e8d service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:37.272156 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1578/3176] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:37.276694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99988599-0e13-4f92-b5a1-2a1c366c4d9c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:37.295973 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1599/3177] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:37.314118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99988599-0e13-4f92-b5a1-2a1c366c4d9c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:37.326753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64895973-4c54-44c8-84df-3f1771071eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:37.330447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64895973-4c54-44c8-84df-3f1771071eea admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:37.330873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64895973-4c54-44c8-84df-3f1771071eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:37.331237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64895973-4c54-44c8-84df-3f1771071eea admin admin] PATH_INFO: `/v3/projects/b999ba20713e414d8f685a6caca2f9c1/users/0906ad89e192444fa41bedc1e815ee97/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:37.387858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64895973-4c54-44c8-84df-3f1771071eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b999ba20713e414d8f685a6caca2f9c1, user_id=0906ad89e192444fa41bedc1e815ee97, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:37.396582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64895973-4c54-44c8-84df-3f1771071eea admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:37.443052 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1579/3178] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:37 2022] PUT /identity/v3/projects/b999ba20713e414d8f685a6caca2f9c1/users/0906ad89e192444fa41bedc1e815ee97/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:37.448887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998f8e-2049-4aad-9f4f-2b85a60fdf7e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:37.449781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998f8e-2049-4aad-9f4f-2b85a60fdf7e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:37.450247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998f8e-2049-4aad-9f4f-2b85a60fdf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:37.592837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c0998f8e-2049-4aad-9f4f-2b85a60fdf7e None None] MFA Rules not processed for user `0906ad89e192444fa41bedc1e815ee97`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:37.599556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c0998f8e-2049-4aad-9f4f-2b85a60fdf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:37.658856 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:37.815855 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1600/3179] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:37.819517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64895973-4c54-44c8-84df-3f1771071eea admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:38.008066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64895973-4c54-44c8-84df-3f1771071eea admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:38.013376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe8798-84fd-48e6-8d5b-c1f509e31e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:38.014169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe8798-84fd-48e6-8d5b-c1f509e31e99 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:38.014450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe8798-84fd-48e6-8d5b-c1f509e31e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:38.014718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe8798-84fd-48e6-8d5b-c1f509e31e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:38.015587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe8798-84fd-48e6-8d5b-c1f509e31e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:38.017453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe8798-84fd-48e6-8d5b-c1f509e31e99 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:38.054883 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1580/3180] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:37 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:38.059515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0998f8e-2049-4aad-9f4f-2b85a60fdf7e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:38.082015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0998f8e-2049-4aad-9f4f-2b85a60fdf7e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:38.226691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fdbd-c683-49c2-a0c6-44becba00180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:38.227293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fdbd-c683-49c2-a0c6-44becba00180 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:38.227569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fdbd-c683-49c2-a0c6-44becba00180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:38.227841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fdbd-c683-49c2-a0c6-44becba00180 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:38.228473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29fdbd-c683-49c2-a0c6-44becba00180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:38.230396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29fdbd-c683-49c2-a0c6-44becba00180 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:38.275615 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1601/3181] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:38 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:38.276615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe8798-84fd-48e6-8d5b-c1f509e31e99 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:38.310646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe8798-84fd-48e6-8d5b-c1f509e31e99 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:38.327791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b17e2-5e30-45dc-a211-c71f157a38fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:38.330099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b17e2-5e30-45dc-a211-c71f157a38fa admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:38.330785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b17e2-5e30-45dc-a211-c71f157a38fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:38.331114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b17e2-5e30-45dc-a211-c71f157a38fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:38.331828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b17e2-5e30-45dc-a211-c71f157a38fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:38.346824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b17e2-5e30-45dc-a211-c71f157a38fa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:38.378549 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1581/3182] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:38.385094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fdbd-c683-49c2-a0c6-44becba00180 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:38.404620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b17e2-5e30-45dc-a211-c71f157a38fa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:38.408105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-123b17e2-5e30-45dc-a211-c71f157a38fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:38.416939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fdbd-c683-49c2-a0c6-44becba00180 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:38.431022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffc71e-ebdd-40c9-a62e-94429854b4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:38.431985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffc71e-ebdd-40c9-a62e-94429854b4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:38.432328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffc71e-ebdd-40c9-a62e-94429854b4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:38.434871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffc71e-ebdd-40c9-a62e-94429854b4e8 admin admin] PATH_INFO: `/v3/projects/948e095f530b4f0aa841002ff723b304/users/705275aabc55446f9329f2cbfd2085d8/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:38.479106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffc71e-ebdd-40c9-a62e-94429854b4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948e095f530b4f0aa841002ff723b304, user_id=705275aabc55446f9329f2cbfd2085d8, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:38.483713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffc71e-ebdd-40c9-a62e-94429854b4e8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:38.526481 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1602/3183] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:38 2022] PUT /identity/v3/projects/948e095f530b4f0aa841002ff723b304/users/705275aabc55446f9329f2cbfd2085d8/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:38.530378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffc71e-ebdd-40c9-a62e-94429854b4e8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:38.604340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b17e2-5e30-45dc-a211-c71f157a38fa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:38.629560 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:38.720089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffc71e-ebdd-40c9-a62e-94429854b4e8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:38.730209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20df2a4-ca5f-41f1-93cf-ec35be323c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:38.731786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20df2a4-ca5f-41f1-93cf-ec35be323c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:38.732215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20df2a4-ca5f-41f1-93cf-ec35be323c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:38.732495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20df2a4-ca5f-41f1-93cf-ec35be323c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:38.734016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20df2a4-ca5f-41f1-93cf-ec35be323c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:38.736476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20df2a4-ca5f-41f1-93cf-ec35be323c18 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:38.756724 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1603/3184] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:10:38.760821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20df2a4-ca5f-41f1-93cf-ec35be323c18 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:38.772879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbd20e-a5c6-497e-a8a6-87853b67b9ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:38.773706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbd20e-a5c6-497e-a8a6-87853b67b9ef service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:38.774170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbd20e-a5c6-497e-a8a6-87853b67b9ef service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:38.774589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbd20e-a5c6-497e-a8a6-87853b67b9ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:38.781498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20df2a4-ca5f-41f1-93cf-ec35be323c18 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:38.791912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71270ed-5880-4c05-80b1-28b01ce7879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:38.793432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71270ed-5880-4c05-80b1-28b01ce7879f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:38.793722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71270ed-5880-4c05-80b1-28b01ce7879f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:38.794002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71270ed-5880-4c05-80b1-28b01ce7879f admin admin] PATH_INFO: `/v3/projects/948e095f530b4f0aa841002ff723b304/users/705275aabc55446f9329f2cbfd2085d8/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:38.797337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71270ed-5880-4c05-80b1-28b01ce7879f admin admin] RBAC: Authorizing `identity:create_grant(project_id=948e095f530b4f0aa841002ff723b304, user_id=705275aabc55446f9329f2cbfd2085d8, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:38.801439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71270ed-5880-4c05-80b1-28b01ce7879f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:38.823718 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1604/3185] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:38 2022] PUT /identity/v3/projects/948e095f530b4f0aa841002ff723b304/users/705275aabc55446f9329f2cbfd2085d8/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:10:38.836216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a035818-9d2f-4d45-9211-50ba03e6e2ec None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:38.836504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a035818-9d2f-4d45-9211-50ba03e6e2ec None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:38.836778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a035818-9d2f-4d45-9211-50ba03e6e2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:38.855165 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:38.863054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbd20e-a5c6-497e-a8a6-87853b67b9ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:38.865113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbd20e-a5c6-497e-a8a6-87853b67b9ef service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:38.886873 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1582/3186] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:38.891051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8a035818-9d2f-4d45-9211-50ba03e6e2ec None None] MFA Rules not processed for user `705275aabc55446f9329f2cbfd2085d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:38.892398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8a035818-9d2f-4d45-9211-50ba03e6e2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:39.092842 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1605/3187] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:10:39.099569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbd20e-a5c6-497e-a8a6-87853b67b9ef service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:39.226270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbd20e-a5c6-497e-a8a6-87853b67b9ef service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:39.242801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c6006-59f9-41c8-9065-30eb25e4b844 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705275aabc55446f9329f2cbfd2085d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948e095f530b4f0aa841002ff723b304', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:39.243701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c6006-59f9-41c8-9065-30eb25e4b844 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:39.244168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c6006-59f9-41c8-9065-30eb25e4b844 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:39.244537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c6006-59f9-41c8-9065-30eb25e4b844 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:39.245308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c6006-59f9-41c8-9065-30eb25e4b844 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:39.261094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c6006-59f9-41c8-9065-30eb25e4b844 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:39.341583 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1583/3188] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:39 2022] POST /identity/v3/projects => generated 357 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:39.346451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a035818-9d2f-4d45-9211-50ba03e6e2ec None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:39.363184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a035818-9d2f-4d45-9211-50ba03e6e2ec None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:39.458525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85a44-4de3-4eb4-889c-97404271558c tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705275aabc55446f9329f2cbfd2085d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948e095f530b4f0aa841002ff723b304', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:39.459676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85a44-4de3-4eb4-889c-97404271558c tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:39.460409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85a44-4de3-4eb4-889c-97404271558c tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:39.460868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85a44-4de3-4eb4-889c-97404271558c tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] PATH_INFO: `/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags/tempest-tag-1181543873` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:39.462451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e85a44-4de3-4eb4-889c-97404271558c tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=76db3f15db9749d6a3c5baaaeb18a297, value=tempest-tag-1181543873)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:39.465685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e85a44-4de3-4eb4-889c-97404271558c tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:39.571958 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-62e85a44-4de3-4eb4-889c-97404271558c tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1181543873. To ensure interoperability, identifiers should be a valid uuid. Oct 16 01:10:39.571958 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 16 01:10:39.571958 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:10:39.587662 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1606/3189] 10.222.0.39 () {60 vars in 1333 bytes} [Sun Oct 16 01:10:39 2022] PUT /identity/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags/tempest-tag-1181543873 => generated 0 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Oct 16 01:10:39.589362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c6006-59f9-41c8-9065-30eb25e4b844 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:39.605219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c6006-59f9-41c8-9065-30eb25e4b844 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:39.622052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23747ec9-817b-4a9f-b78c-d68ae1dce9e0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705275aabc55446f9329f2cbfd2085d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948e095f530b4f0aa841002ff723b304', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:39.622871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23747ec9-817b-4a9f-b78c-d68ae1dce9e0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:39.623238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23747ec9-817b-4a9f-b78c-d68ae1dce9e0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:39.623653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23747ec9-817b-4a9f-b78c-d68ae1dce9e0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] PATH_INFO: `/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags/tempest-tag-1181543873` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:39.651751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23747ec9-817b-4a9f-b78c-d68ae1dce9e0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=76db3f15db9749d6a3c5baaaeb18a297, value=tempest-tag-1181543873)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:39.656128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23747ec9-817b-4a9f-b78c-d68ae1dce9e0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:39.709097 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1584/3190] 10.222.0.39 () {58 vars in 1314 bytes} [Sun Oct 16 01:10:39 2022] GET /identity/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags/tempest-tag-1181543873 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:10:39.713268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85a44-4de3-4eb4-889c-97404271558c tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:39.751066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85a44-4de3-4eb4-889c-97404271558c tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:39.767378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365593c-f9b5-43ab-90fe-ea047affdea3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705275aabc55446f9329f2cbfd2085d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948e095f530b4f0aa841002ff723b304', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:39.768251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365593c-f9b5-43ab-90fe-ea047affdea3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:39.768776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365593c-f9b5-43ab-90fe-ea047affdea3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:39.769150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365593c-f9b5-43ab-90fe-ea047affdea3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] PATH_INFO: `/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:39.772502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365593c-f9b5-43ab-90fe-ea047affdea3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=76db3f15db9749d6a3c5baaaeb18a297)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:39.774947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365593c-f9b5-43ab-90fe-ea047affdea3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:39.876896 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1607/3191] 10.222.0.39 () {60 vars in 1265 bytes} [Sun Oct 16 01:10:39 2022] PUT /identity/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags => generated 140 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:10:39.877680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23747ec9-817b-4a9f-b78c-d68ae1dce9e0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:39.889821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23747ec9-817b-4a9f-b78c-d68ae1dce9e0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:39.907718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82718003-d76b-4624-8630-0d0457ebf03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705275aabc55446f9329f2cbfd2085d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948e095f530b4f0aa841002ff723b304', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:39.908408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82718003-d76b-4624-8630-0d0457ebf03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:39.908760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82718003-d76b-4624-8630-0d0457ebf03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:39.908957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82718003-d76b-4624-8630-0d0457ebf03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] PATH_INFO: `/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:39.931264 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:39.943364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82718003-d76b-4624-8630-0d0457ebf03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=76db3f15db9749d6a3c5baaaeb18a297)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:39.947128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82718003-d76b-4624-8630-0d0457ebf03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:39.988544 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1585/3192] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:10:39 2022] GET /identity/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags => generated 140 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:10:39.991155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365593c-f9b5-43ab-90fe-ea047affdea3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:40.007299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365593c-f9b5-43ab-90fe-ea047affdea3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:40.018370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4ba84-13ee-4505-b2b9-c4174c451cf3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705275aabc55446f9329f2cbfd2085d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948e095f530b4f0aa841002ff723b304', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:40.019188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4ba84-13ee-4505-b2b9-c4174c451cf3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:40.019570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4ba84-13ee-4505-b2b9-c4174c451cf3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:40.020102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4ba84-13ee-4505-b2b9-c4174c451cf3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] PATH_INFO: `/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags/tempest-tag-336930446` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:40.025208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4ba84-13ee-4505-b2b9-c4174c451cf3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=76db3f15db9749d6a3c5baaaeb18a297, value=tempest-tag-336930446)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:40.029210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4ba84-13ee-4505-b2b9-c4174c451cf3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:40.034151 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:40.132022 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-ccd4ba84-13ee-4505-b2b9-c4174c451cf3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-336930446. To ensure interoperability, identifiers should be a valid uuid. Oct 16 01:10:40.132022 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 16 01:10:40.132022 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:10:40.149888 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1608/3193] 10.222.0.39 () {58 vars in 1314 bytes} [Sun Oct 16 01:10:39 2022] DELETE /identity/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags/tempest-tag-336930446 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:40.150769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82718003-d76b-4624-8630-0d0457ebf03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:40.164189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82718003-d76b-4624-8630-0d0457ebf03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:40.183399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af8fec-1dce-4cfd-8b1a-ce3e278cd61f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705275aabc55446f9329f2cbfd2085d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948e095f530b4f0aa841002ff723b304', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:40.184255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af8fec-1dce-4cfd-8b1a-ce3e278cd61f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:40.184572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af8fec-1dce-4cfd-8b1a-ce3e278cd61f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:40.184845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af8fec-1dce-4cfd-8b1a-ce3e278cd61f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] PATH_INFO: `/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags/tempest-tag-336930446` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:40.245230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af8fec-1dce-4cfd-8b1a-ce3e278cd61f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=76db3f15db9749d6a3c5baaaeb18a297, value=tempest-tag-336930446)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:40.252725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af8fec-1dce-4cfd-8b1a-ce3e278cd61f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-29af8fec-1dce-4cfd-8b1a-ce3e278cd61f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Could not find project tag: tempest-tag-336930446.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-336930446. Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 16 01:10:40.308755 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 16 01:10:40.309895 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:10:40.309895 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:10:40.309895 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 16 01:10:40.309895 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 16 01:10:40.309895 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-336930446. Oct 16 01:10:40.309895 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:10:40.316131 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1586/3194] 10.222.0.39 () {58 vars in 1311 bytes} [Sun Oct 16 01:10:40 2022] GET /identity/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags/tempest-tag-336930446 => generated 106 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:10:40.319392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4ba84-13ee-4505-b2b9-c4174c451cf3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:40.333385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4ba84-13ee-4505-b2b9-c4174c451cf3 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:40.351912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62f325-0c12-4757-babe-8d610ceaa03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705275aabc55446f9329f2cbfd2085d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948e095f530b4f0aa841002ff723b304', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:40.352368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62f325-0c12-4757-babe-8d610ceaa03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:40.352791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62f325-0c12-4757-babe-8d610ceaa03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:40.353178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62f325-0c12-4757-babe-8d610ceaa03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] PATH_INFO: `/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:40.357044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62f325-0c12-4757-babe-8d610ceaa03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=76db3f15db9749d6a3c5baaaeb18a297)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:40.362357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62f325-0c12-4757-babe-8d610ceaa03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:40.486776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af8fec-1dce-4cfd-8b1a-ce3e278cd61f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:40.499717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af8fec-1dce-4cfd-8b1a-ce3e278cd61f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:40.503107 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1609/3195] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:10:40 2022] DELETE /identity/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:40.519167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c05c19-145a-4f71-b1fa-994c317eecf8 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705275aabc55446f9329f2cbfd2085d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948e095f530b4f0aa841002ff723b304', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:40.519869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c05c19-145a-4f71-b1fa-994c317eecf8 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:40.520173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c05c19-145a-4f71-b1fa-994c317eecf8 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:40.520451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c05c19-145a-4f71-b1fa-994c317eecf8 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] PATH_INFO: `/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:40.549373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c05c19-145a-4f71-b1fa-994c317eecf8 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=76db3f15db9749d6a3c5baaaeb18a297)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:40.553410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c05c19-145a-4f71-b1fa-994c317eecf8 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:40.617840 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1587/3196] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:10:40 2022] GET /identity/v3/projects/76db3f15db9749d6a3c5baaaeb18a297/tags => generated 66 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:10:40.620159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62f325-0c12-4757-babe-8d610ceaa03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:40.641656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62f325-0c12-4757-babe-8d610ceaa03f tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:40.663580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6d6b8-d862-4107-8d61-3132e3939db0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705275aabc55446f9329f2cbfd2085d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948e095f530b4f0aa841002ff723b304', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:40.664673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6d6b8-d862-4107-8d61-3132e3939db0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:40.667697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6d6b8-d862-4107-8d61-3132e3939db0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:40.669421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6d6b8-d862-4107-8d61-3132e3939db0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] PATH_INFO: `/v3/projects/76db3f15db9749d6a3c5baaaeb18a297` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:40.673459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6d6b8-d862-4107-8d61-3132e3939db0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorizing `identity:delete_project(project_id=76db3f15db9749d6a3c5baaaeb18a297)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:40.678221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6d6b8-d862-4107-8d61-3132e3939db0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:40.811638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-99c6d6b8-d862-4107-8d61-3132e3939db0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76db3f15db9749d6a3c5baaaeb18a297', 'request_id': 'req-99c6d6b8-d862-4107-8d61-3132e3939db0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:40.820710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-99c6d6b8-d862-4107-8d61-3132e3939db0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76db3f15db9749d6a3c5baaaeb18a297', 'request_id': 'req-99c6d6b8-d862-4107-8d61-3132e3939db0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:40.834150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-99c6d6b8-d862-4107-8d61-3132e3939db0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76db3f15db9749d6a3c5baaaeb18a297', 'request_id': 'req-99c6d6b8-d862-4107-8d61-3132e3939db0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:40.859453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-99c6d6b8-d862-4107-8d61-3132e3939db0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] The token cache is being invalidate because project 76db3f15db9749d6a3c5baaaeb18a297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:40.859767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-99c6d6b8-d862-4107-8d61-3132e3939db0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:40.861824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-99c6d6b8-d862-4107-8d61-3132e3939db0 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:40.870888 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1610/3197] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:40 2022] DELETE /identity/v3/projects/76db3f15db9749d6a3c5baaaeb18a297 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:40.872316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c05c19-145a-4f71-b1fa-994c317eecf8 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:40.878235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c9c05c19-145a-4f71-b1fa-994c317eecf8 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:41.022773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c05c19-145a-4f71-b1fa-994c317eecf8 tempest-IdentityV3ProjectTagsTest-442913275 tempest-IdentityV3ProjectTagsTest-442913275-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:41.140430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:41.144781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:41.145400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:41.145656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] PATH_INFO: `/v3/users/0906ad89e192444fa41bedc1e815ee97` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:41.147427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0906ad89e192444fa41bedc1e815ee97)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:41.149843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:41.278289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0906ad89e192444fa41bedc1e815ee97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:41.282657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0906ad89e192444fa41bedc1e815ee97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:41.304092 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:41.327633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0906ad89e192444fa41bedc1e815ee97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:41.351797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0906ad89e192444fa41bedc1e815ee97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:41.352773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0906ad89e192444fa41bedc1e815ee97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:41.374156 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1588/3198] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:10:40 2022] DELETE /identity/v3/users/0906ad89e192444fa41bedc1e815ee97 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:10:41.379401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d47d7-2d37-4d71-9dff-2d247b25d635 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:41.379756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d47d7-2d37-4d71-9dff-2d247b25d635 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:41.380041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d47d7-2d37-4d71-9dff-2d247b25d635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:41.421689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-177d47d7-2d37-4d71-9dff-2d247b25d635 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:41.425088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-177d47d7-2d37-4d71-9dff-2d247b25d635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:41.636082 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1611/3199] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:41.646025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:41.647532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:41.796754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4f493-b44b-4b06-a2f3-dd2a6184592c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:41.825098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85133e-3543-4aad-b5ca-a37cf134a18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:41.825687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85133e-3543-4aad-b5ca-a37cf134a18c service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:41.825975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85133e-3543-4aad-b5ca-a37cf134a18c service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:41.826304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85133e-3543-4aad-b5ca-a37cf134a18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:41.861206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85133e-3543-4aad-b5ca-a37cf134a18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:41.862134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85133e-3543-4aad-b5ca-a37cf134a18c service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:41.903852 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1589/3200] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:42.517615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d47d7-2d37-4d71-9dff-2d247b25d635 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:42.521043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-177d47d7-2d37-4d71-9dff-2d247b25d635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:42.576154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d47d7-2d37-4d71-9dff-2d247b25d635 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:42.601427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:42.602151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:42.602433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:42.602671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] PATH_INFO: `/v3/projects/b999ba20713e414d8f685a6caca2f9c1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:42.611869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b999ba20713e414d8f685a6caca2f9c1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:42.613854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:42.621066 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:42.717299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b999ba20713e414d8f685a6caca2f9c1', 'request_id': 'req-aebe924a-c421-4a87-a939-d3eaf24401d6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:42.726666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b999ba20713e414d8f685a6caca2f9c1', 'request_id': 'req-aebe924a-c421-4a87-a939-d3eaf24401d6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:42.742993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b999ba20713e414d8f685a6caca2f9c1', 'request_id': 'req-aebe924a-c421-4a87-a939-d3eaf24401d6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:42.760747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] The token cache is being invalidate because project b999ba20713e414d8f685a6caca2f9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:42.761475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:42.763191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:42.765553 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1612/3201] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:42 2022] DELETE /identity/v3/projects/b999ba20713e414d8f685a6caca2f9c1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:42.769377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85133e-3543-4aad-b5ca-a37cf134a18c service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:42.780415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85133e-3543-4aad-b5ca-a37cf134a18c service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:42.936308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4d252-2209-41e6-bca0-040794237929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:42.937643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d252-2209-41e6-bca0-040794237929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:42.938092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d252-2209-41e6-bca0-040794237929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:42.938515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d252-2209-41e6-bca0-040794237929 admin admin] PATH_INFO: `/v3/users/705275aabc55446f9329f2cbfd2085d8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:42.949241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4d252-2209-41e6-bca0-040794237929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=705275aabc55446f9329f2cbfd2085d8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:42.952287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4d252-2209-41e6-bca0-040794237929 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:43.051853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bdc4d252-2209-41e6-bca0-040794237929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705275aabc55446f9329f2cbfd2085d8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:43.052983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bdc4d252-2209-41e6-bca0-040794237929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705275aabc55446f9329f2cbfd2085d8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:43.087639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bdc4d252-2209-41e6-bca0-040794237929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705275aabc55446f9329f2cbfd2085d8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:43.100968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bdc4d252-2209-41e6-bca0-040794237929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705275aabc55446f9329f2cbfd2085d8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:43.101675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bdc4d252-2209-41e6-bca0-040794237929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705275aabc55446f9329f2cbfd2085d8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:43.109025 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:43.124306 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1590/3202] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:10:42 2022] DELETE /identity/v3/users/705275aabc55446f9329f2cbfd2085d8 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:43.148329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:43.151021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:43.341722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe924a-c421-4a87-a939-d3eaf24401d6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:43.531577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98e158-a32d-452b-b06e-8f0ec869c87d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:43.533533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98e158-a32d-452b-b06e-8f0ec869c87d service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:43.535931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98e158-a32d-452b-b06e-8f0ec869c87d service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:43.536951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98e158-a32d-452b-b06e-8f0ec869c87d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:43.541856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0e98e158-a32d-452b-b06e-8f0ec869c87d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:43.595318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98e158-a32d-452b-b06e-8f0ec869c87d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:43.597490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98e158-a32d-452b-b06e-8f0ec869c87d service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:43.617020 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1613/3203] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:44.128421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe1951-1e94-49df-b406-871e02d56a0f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:44.129294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe1951-1e94-49df-b406-871e02d56a0f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:44.129821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe1951-1e94-49df-b406-871e02d56a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:44.200248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fbbe1951-1e94-49df-b406-871e02d56a0f None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:44.205499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fbbe1951-1e94-49df-b406-871e02d56a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:44.229382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98e158-a32d-452b-b06e-8f0ec869c87d service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:44.234126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0e98e158-a32d-452b-b06e-8f0ec869c87d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:44.308105 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:44.402541 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1591/3204] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:44.421082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe1951-1e94-49df-b406-871e02d56a0f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:44.423556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fbbe1951-1e94-49df-b406-871e02d56a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:44.435445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98e158-a32d-452b-b06e-8f0ec869c87d service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:44.447437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a0da1-2630-4373-9e74-e67ceca8f89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:44.448090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a0da1-2630-4373-9e74-e67ceca8f89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:44.448439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a0da1-2630-4373-9e74-e67ceca8f89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:44.448634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a0da1-2630-4373-9e74-e67ceca8f89b admin admin] PATH_INFO: `/v3/projects/948e095f530b4f0aa841002ff723b304` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:44.451867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a0da1-2630-4373-9e74-e67ceca8f89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=948e095f530b4f0aa841002ff723b304)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:44.453835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a0da1-2630-4373-9e74-e67ceca8f89b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:44.581827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a18a0da1-2630-4373-9e74-e67ceca8f89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948e095f530b4f0aa841002ff723b304', 'request_id': 'req-a18a0da1-2630-4373-9e74-e67ceca8f89b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:44.594625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a18a0da1-2630-4373-9e74-e67ceca8f89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948e095f530b4f0aa841002ff723b304', 'request_id': 'req-a18a0da1-2630-4373-9e74-e67ceca8f89b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:44.620778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a18a0da1-2630-4373-9e74-e67ceca8f89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948e095f530b4f0aa841002ff723b304', 'request_id': 'req-a18a0da1-2630-4373-9e74-e67ceca8f89b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:44.641170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a18a0da1-2630-4373-9e74-e67ceca8f89b admin admin] The token cache is being invalidate because project 948e095f530b4f0aa841002ff723b304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:44.641474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a18a0da1-2630-4373-9e74-e67ceca8f89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:44.651786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a18a0da1-2630-4373-9e74-e67ceca8f89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:44.672283 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1614/3205] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:44 2022] DELETE /identity/v3/projects/948e095f530b4f0aa841002ff723b304 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:44.673751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639e333-368e-462f-883b-8cf5546faf45 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:44.674035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639e333-368e-462f-883b-8cf5546faf45 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:44.674304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639e333-368e-462f-883b-8cf5546faf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:44.679487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe1951-1e94-49df-b406-871e02d56a0f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:44.716926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0639e333-368e-462f-883b-8cf5546faf45 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:44.725356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0639e333-368e-462f-883b-8cf5546faf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:44.851473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed06f97-9994-48d0-a0d0-daee901a9aa5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:44.853295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed06f97-9994-48d0-a0d0-daee901a9aa5 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:44.853782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed06f97-9994-48d0-a0d0-daee901a9aa5 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:44.859034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed06f97-9994-48d0-a0d0-daee901a9aa5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:44.861293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8ed06f97-9994-48d0-a0d0-daee901a9aa5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:44.867053 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1615/3206] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:44.874723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639e333-368e-462f-883b-8cf5546faf45 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:44.876167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0639e333-368e-462f-883b-8cf5546faf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:44.956818 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:44.972200 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:44.978705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639e333-368e-462f-883b-8cf5546faf45 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:44.986089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed06f97-9994-48d0-a0d0-daee901a9aa5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:44.988862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed06f97-9994-48d0-a0d0-daee901a9aa5 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:44.993842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba41b82-2f3f-4ee3-8925-c986252de288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:44.995639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba41b82-2f3f-4ee3-8925-c986252de288 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:44.997063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba41b82-2f3f-4ee3-8925-c986252de288 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:44.997339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba41b82-2f3f-4ee3-8925-c986252de288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:45.003326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dba41b82-2f3f-4ee3-8925-c986252de288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:45.004456 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1592/3207] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:45.008710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165905e5-0c63-4917-99de-85ae48cfec57 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:45.008997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165905e5-0c63-4917-99de-85ae48cfec57 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:45.009271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165905e5-0c63-4917-99de-85ae48cfec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:45.030545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba41b82-2f3f-4ee3-8925-c986252de288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:45.032946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba41b82-2f3f-4ee3-8925-c986252de288 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:45.050138 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1616/3208] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:45.054691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-165905e5-0c63-4917-99de-85ae48cfec57 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:45.055940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-165905e5-0c63-4917-99de-85ae48cfec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:45.071208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba41b82-2f3f-4ee3-8925-c986252de288 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:45.071735 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1593/3209] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:45.096486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba41b82-2f3f-4ee3-8925-c986252de288 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:45.101426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f643e9d-59fc-4fcb-8335-99ed974aa8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:45.102265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f643e9d-59fc-4fcb-8335-99ed974aa8db admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:45.102607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f643e9d-59fc-4fcb-8335-99ed974aa8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:45.102891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f643e9d-59fc-4fcb-8335-99ed974aa8db admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:45.103646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f643e9d-59fc-4fcb-8335-99ed974aa8db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:10:45.103975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f643e9d-59fc-4fcb-8335-99ed974aa8db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:45.106447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f643e9d-59fc-4fcb-8335-99ed974aa8db admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:45.127019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165905e5-0c63-4917-99de-85ae48cfec57 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:45.131477 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1617/3210] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:10:45.140291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165905e5-0c63-4917-99de-85ae48cfec57 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:45.145922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bf3c7-6a6e-4fdc-9237-9738130123b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:45.147078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf3c7-6a6e-4fdc-9237-9738130123b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:45.147620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf3c7-6a6e-4fdc-9237-9738130123b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:45.147964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf3c7-6a6e-4fdc-9237-9738130123b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:45.148946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bf3c7-6a6e-4fdc-9237-9738130123b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:45.151682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bf3c7-6a6e-4fdc-9237-9738130123b7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:45.220004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f643e9d-59fc-4fcb-8335-99ed974aa8db admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:45.227144 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1594/3211] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:45 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:45.232908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f643e9d-59fc-4fcb-8335-99ed974aa8db admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:45.390697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597856-015a-473c-a048-b0b9500ad3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:45.391560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597856-015a-473c-a048-b0b9500ad3ff admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:45.391981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597856-015a-473c-a048-b0b9500ad3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:45.392361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597856-015a-473c-a048-b0b9500ad3ff admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:45.393947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a597856-015a-473c-a048-b0b9500ad3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:45.396236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a597856-015a-473c-a048-b0b9500ad3ff admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:45.440999 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1618/3212] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:45 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:45.445303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bf3c7-6a6e-4fdc-9237-9738130123b7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:45.467349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bf3c7-6a6e-4fdc-9237-9738130123b7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:45.491407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c2444-c8fa-4a54-b8a5-933d2fae9750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:45.492827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2444-c8fa-4a54-b8a5-933d2fae9750 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:45.495212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2444-c8fa-4a54-b8a5-933d2fae9750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:45.496268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2444-c8fa-4a54-b8a5-933d2fae9750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:45.503102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c2444-c8fa-4a54-b8a5-933d2fae9750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:45.508563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c2444-c8fa-4a54-b8a5-933d2fae9750 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:45.546618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597856-015a-473c-a048-b0b9500ad3ff admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:45.565046 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1595/3213] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:45.569395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597856-015a-473c-a048-b0b9500ad3ff admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:45.579765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddf1f7-cfe1-4e53-8926-d591102db93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:45.580453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddf1f7-cfe1-4e53-8926-d591102db93d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:45.580729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddf1f7-cfe1-4e53-8926-d591102db93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:45.582760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddf1f7-cfe1-4e53-8926-d591102db93d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:45.586899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddf1f7-cfe1-4e53-8926-d591102db93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:45.593206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddf1f7-cfe1-4e53-8926-d591102db93d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:45.622136 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1619/3214] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:10:45.623725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c2444-c8fa-4a54-b8a5-933d2fae9750 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:45.650737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c2444-c8fa-4a54-b8a5-933d2fae9750 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:45.669230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf84699-daa4-48df-ad0c-6c8578b3eae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:45.670590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf84699-daa4-48df-ad0c-6c8578b3eae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:45.670590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf84699-daa4-48df-ad0c-6c8578b3eae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:45.670590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf84699-daa4-48df-ad0c-6c8578b3eae8 admin admin] PATH_INFO: `/v3/projects/59fd658f59ff4a5cbc1c9585b95a24a3/users/3f6077c51a224ecd91ab3cc728794050/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:45.691565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1676-9406-42c0-88d8-a04646036306 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:45.692786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1676-9406-42c0-88d8-a04646036306 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:45.693271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1676-9406-42c0-88d8-a04646036306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:45.720998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c91f1676-9406-42c0-88d8-a04646036306 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:45.722338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c91f1676-9406-42c0-88d8-a04646036306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:45.723729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf84699-daa4-48df-ad0c-6c8578b3eae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59fd658f59ff4a5cbc1c9585b95a24a3, user_id=3f6077c51a224ecd91ab3cc728794050, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:45.727319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf84699-daa4-48df-ad0c-6c8578b3eae8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:45.771644 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1596/3215] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:45 2022] PUT /identity/v3/projects/59fd658f59ff4a5cbc1c9585b95a24a3/users/3f6077c51a224ecd91ab3cc728794050/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:10:45.773525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f0651-3a4e-4c1d-8def-f08a5657fc7f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:45.774063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f0651-3a4e-4c1d-8def-f08a5657fc7f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:45.774435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f0651-3a4e-4c1d-8def-f08a5657fc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:45.855417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f42f0651-3a4e-4c1d-8def-f08a5657fc7f None None] MFA Rules not processed for user `3f6077c51a224ecd91ab3cc728794050`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:45.857890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f42f0651-3a4e-4c1d-8def-f08a5657fc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:45.898427 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1620/3216] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:10:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:45.900309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1676-9406-42c0-88d8-a04646036306 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:45.911950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c91f1676-9406-42c0-88d8-a04646036306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:45.958734 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1597/3217] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:45.978626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f0651-3a4e-4c1d-8def-f08a5657fc7f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:45.980352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f42f0651-3a4e-4c1d-8def-f08a5657fc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:46.068279 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:46.080839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1676-9406-42c0-88d8-a04646036306 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:46.094203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f0651-3a4e-4c1d-8def-f08a5657fc7f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:46.103512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46eeec-bdea-4fd1-a051-865b5ce9fceb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:46.104492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46eeec-bdea-4fd1-a051-865b5ce9fceb service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:46.106242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46eeec-bdea-4fd1-a051-865b5ce9fceb service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:46.106947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46eeec-bdea-4fd1-a051-865b5ce9fceb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:46.125629 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:46.135308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46eeec-bdea-4fd1-a051-865b5ce9fceb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:46.137385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46eeec-bdea-4fd1-a051-865b5ce9fceb service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:46.165501 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1598/3218] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:10:46.173217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9938f-51d5-42cc-bfd8-09cdb21e2238 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:46.174056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9938f-51d5-42cc-bfd8-09cdb21e2238 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:46.174636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9938f-51d5-42cc-bfd8-09cdb21e2238 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:46.175109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9938f-51d5-42cc-bfd8-09cdb21e2238 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:46.308389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9938f-51d5-42cc-bfd8-09cdb21e2238 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:46.312944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9938f-51d5-42cc-bfd8-09cdb21e2238 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:46.329282 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1621/3219] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:46.527528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cae11-cc42-456e-abbf-0be7cb8c6e7b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:46.528951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cae11-cc42-456e-abbf-0be7cb8c6e7b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:46.529406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cae11-cc42-456e-abbf-0be7cb8c6e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:46.597498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a89cae11-cc42-456e-abbf-0be7cb8c6e7b None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:46.600618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a89cae11-cc42-456e-abbf-0be7cb8c6e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:46.641630 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1599/3220] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:10:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:46.676341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9938f-51d5-42cc-bfd8-09cdb21e2238 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:46.710135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9938f-51d5-42cc-bfd8-09cdb21e2238 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:46.756426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d2f2b-69bc-47fc-ba54-cf315802da88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:46.758372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d2f2b-69bc-47fc-ba54-cf315802da88 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:46.759049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d2f2b-69bc-47fc-ba54-cf315802da88 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:46.759748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d2f2b-69bc-47fc-ba54-cf315802da88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:46.773979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d2f2b-69bc-47fc-ba54-cf315802da88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:46.777295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d2f2b-69bc-47fc-ba54-cf315802da88 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:46.825029 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1622/3221] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:47.257375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb0095-0645-41e8-98e4-6771fb2c1dbc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:47.258396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb0095-0645-41e8-98e4-6771fb2c1dbc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:47.260775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb0095-0645-41e8-98e4-6771fb2c1dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:47.298981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-07eb0095-0645-41e8-98e4-6771fb2c1dbc None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:47.300765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-07eb0095-0645-41e8-98e4-6771fb2c1dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:47.333678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d2f2b-69bc-47fc-ba54-cf315802da88 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:47.334430 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1600/3222] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:10:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:47.359850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d2f2b-69bc-47fc-ba54-cf315802da88 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:47.385451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33240ab7-8a49-4800-b295-92045b866257 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:47.386424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33240ab7-8a49-4800-b295-92045b866257 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:47.389219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33240ab7-8a49-4800-b295-92045b866257 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:47.389691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33240ab7-8a49-4800-b295-92045b866257 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:47.417940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33240ab7-8a49-4800-b295-92045b866257 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:47.420937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33240ab7-8a49-4800-b295-92045b866257 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:47.446626 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1623/3223] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:47.983354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb3960-db89-49f6-aa9d-f4a581f1b7c7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:47.985027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb3960-db89-49f6-aa9d-f4a581f1b7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:47.985777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb3960-db89-49f6-aa9d-f4a581f1b7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:48.013761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c4bb3960-db89-49f6-aa9d-f4a581f1b7c7 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:48.015578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c4bb3960-db89-49f6-aa9d-f4a581f1b7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:48.055431 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1601/3224] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:10:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:48.056255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33240ab7-8a49-4800-b295-92045b866257 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:48.071576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33240ab7-8a49-4800-b295-92045b866257 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:48.082644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd77fdd-b602-49cd-8f67-e6138af7ee3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:48.083544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd77fdd-b602-49cd-8f67-e6138af7ee3f service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:48.084132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd77fdd-b602-49cd-8f67-e6138af7ee3f service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:48.084421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd77fdd-b602-49cd-8f67-e6138af7ee3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:48.098372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd77fdd-b602-49cd-8f67-e6138af7ee3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:48.100487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd77fdd-b602-49cd-8f67-e6138af7ee3f service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:48.128558 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1624/3225] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:48.564089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3032a1-f1f0-446d-9872-c492906b38e0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:48.565147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3032a1-f1f0-446d-9872-c492906b38e0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:48.565535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3032a1-f1f0-446d-9872-c492906b38e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:48.590675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6d3032a1-f1f0-446d-9872-c492906b38e0 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:48.594778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6d3032a1-f1f0-446d-9872-c492906b38e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:48.603544 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1602/3226] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:10:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:48.623118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd77fdd-b602-49cd-8f67-e6138af7ee3f service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:48.642373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd77fdd-b602-49cd-8f67-e6138af7ee3f service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:48.649813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274bde6-c186-42c8-8573-d9485ecf5ac4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:48.650457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274bde6-c186-42c8-8573-d9485ecf5ac4 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:48.650771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274bde6-c186-42c8-8573-d9485ecf5ac4 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:48.651080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274bde6-c186-42c8-8573-d9485ecf5ac4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:48.663445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274bde6-c186-42c8-8573-d9485ecf5ac4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:48.665037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274bde6-c186-42c8-8573-d9485ecf5ac4 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:48.676113 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1625/3227] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:49.026704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeae85-b391-4ffc-a77a-b095a8233323 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:49.027032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeae85-b391-4ffc-a77a-b095a8233323 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:49.027353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeae85-b391-4ffc-a77a-b095a8233323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:49.049066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4adeae85-b391-4ffc-a77a-b095a8233323 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:49.050645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4adeae85-b391-4ffc-a77a-b095a8233323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:49.061121 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1603/3228] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:49.077159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274bde6-c186-42c8-8573-d9485ecf5ac4 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:49.089856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274bde6-c186-42c8-8573-d9485ecf5ac4 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:49.095711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db711018-06f2-4679-ac9a-506eb49a05ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:49.096439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711018-06f2-4679-ac9a-506eb49a05ee service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:49.096818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711018-06f2-4679-ac9a-506eb49a05ee service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:49.097212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711018-06f2-4679-ac9a-506eb49a05ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:49.106593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db711018-06f2-4679-ac9a-506eb49a05ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:49.108297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db711018-06f2-4679-ac9a-506eb49a05ee service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:49.116917 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1626/3229] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:49.427544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dd45c-19b9-49cc-ae36-c6a807978065 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:49.427913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dd45c-19b9-49cc-ae36-c6a807978065 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:49.428252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dd45c-19b9-49cc-ae36-c6a807978065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:49.447720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d93dd45c-19b9-49cc-ae36-c6a807978065 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:49.449039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d93dd45c-19b9-49cc-ae36-c6a807978065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:49.457260 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1604/3230] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:49.470629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db711018-06f2-4679-ac9a-506eb49a05ee service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:49.481864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db711018-06f2-4679-ac9a-506eb49a05ee service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:49.487442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98662688-2217-44ec-a842-fddd89942bd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:49.488180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662688-2217-44ec-a842-fddd89942bd5 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:49.488500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662688-2217-44ec-a842-fddd89942bd5 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:49.488937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662688-2217-44ec-a842-fddd89942bd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:49.497831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98662688-2217-44ec-a842-fddd89942bd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:49.499668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98662688-2217-44ec-a842-fddd89942bd5 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:49.508284 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1627/3231] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:50.521533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9ff5b-aabe-41fc-9960-99e403e6525b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:50.522113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9ff5b-aabe-41fc-9960-99e403e6525b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:50.522206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9ff5b-aabe-41fc-9960-99e403e6525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:50.550967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1cd9ff5b-aabe-41fc-9960-99e403e6525b None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:50.553698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1cd9ff5b-aabe-41fc-9960-99e403e6525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:50.571687 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1605/3232] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:50.603486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98662688-2217-44ec-a842-fddd89942bd5 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:50.612911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98662688-2217-44ec-a842-fddd89942bd5 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:50.628115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1819f6a-774d-4aa0-bc0a-09c8e7511aaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:50.628906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819f6a-774d-4aa0-bc0a-09c8e7511aaf service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:50.629295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819f6a-774d-4aa0-bc0a-09c8e7511aaf service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:50.629678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819f6a-774d-4aa0-bc0a-09c8e7511aaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:50.641771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1819f6a-774d-4aa0-bc0a-09c8e7511aaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:50.643983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1819f6a-774d-4aa0-bc0a-09c8e7511aaf service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:50.652927 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1628/3233] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:50.854777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad204d-7ed1-4638-8018-88bac57bef68 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:50.855947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad204d-7ed1-4638-8018-88bac57bef68 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:50.856629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad204d-7ed1-4638-8018-88bac57bef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:50.879669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-54ad204d-7ed1-4638-8018-88bac57bef68 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:50.881254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-54ad204d-7ed1-4638-8018-88bac57bef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:50.899259 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1606/3234] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:50.907405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1819f6a-774d-4aa0-bc0a-09c8e7511aaf service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:50.923170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1819f6a-774d-4aa0-bc0a-09c8e7511aaf service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:50.935174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4172a21-eb59-4b96-9e40-dca8d1d91843 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:50.935939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172a21-eb59-4b96-9e40-dca8d1d91843 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:50.936503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172a21-eb59-4b96-9e40-dca8d1d91843 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:50.937257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172a21-eb59-4b96-9e40-dca8d1d91843 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:50.953161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4172a21-eb59-4b96-9e40-dca8d1d91843 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:50.954774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4172a21-eb59-4b96-9e40-dca8d1d91843 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:50.959985 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:50.965193 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1629/3235] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:10:51.257300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699db175-adbc-46db-ab52-ba51786be391 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:51.258227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699db175-adbc-46db-ab52-ba51786be391 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:51.258734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699db175-adbc-46db-ab52-ba51786be391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:51.290702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-699db175-adbc-46db-ab52-ba51786be391 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:51.295306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-699db175-adbc-46db-ab52-ba51786be391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:51.320590 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1607/3236] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:10:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:51.328413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4172a21-eb59-4b96-9e40-dca8d1d91843 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:51.346993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4172a21-eb59-4b96-9e40-dca8d1d91843 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:51.354380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a99a6-4da1-4022-9017-971c6663f351 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:51.355202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a99a6-4da1-4022-9017-971c6663f351 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:51.356309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a99a6-4da1-4022-9017-971c6663f351 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:51.356605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a99a6-4da1-4022-9017-971c6663f351 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:51.367809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a99a6-4da1-4022-9017-971c6663f351 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:51.369400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a99a6-4da1-4022-9017-971c6663f351 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:51.387090 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1630/3237] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:10:51.616021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90477c67-2c49-4306-83c1-ba1a7f10ec2f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:51.616511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90477c67-2c49-4306-83c1-ba1a7f10ec2f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:51.616808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90477c67-2c49-4306-83c1-ba1a7f10ec2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:51.647318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-90477c67-2c49-4306-83c1-ba1a7f10ec2f None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:51.648765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-90477c67-2c49-4306-83c1-ba1a7f10ec2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:51.672544 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1608/3238] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:10:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:51.681275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a99a6-4da1-4022-9017-971c6663f351 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:51.706716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a99a6-4da1-4022-9017-971c6663f351 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:51.712859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ca6e8-94d3-410f-894f-4431933b7ac0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:51.713790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ca6e8-94d3-410f-894f-4431933b7ac0 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:51.714470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ca6e8-94d3-410f-894f-4431933b7ac0 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:51.715874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ca6e8-94d3-410f-894f-4431933b7ac0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:51.728600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ca6e8-94d3-410f-894f-4431933b7ac0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:51.730654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ca6e8-94d3-410f-894f-4431933b7ac0 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:51.751625 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1631/3239] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:10:52.055329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c6e48-d5b3-485c-ae1c-a584bb6f0d9b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:52.055623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c6e48-d5b3-485c-ae1c-a584bb6f0d9b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:52.055896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c6e48-d5b3-485c-ae1c-a584bb6f0d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:52.093092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8c4c6e48-d5b3-485c-ae1c-a584bb6f0d9b None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:52.095526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8c4c6e48-d5b3-485c-ae1c-a584bb6f0d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:52.140207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ca6e8-94d3-410f-894f-4431933b7ac0 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:52.165037 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1609/3240] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:10:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:52.174885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ca6e8-94d3-410f-894f-4431933b7ac0 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:52.194092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749f508-ef50-4e7f-b97b-3adc486de052 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:52.194893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f508-ef50-4e7f-b97b-3adc486de052 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:52.195206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f508-ef50-4e7f-b97b-3adc486de052 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:52.195770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f508-ef50-4e7f-b97b-3adc486de052 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:52.223924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749f508-ef50-4e7f-b97b-3adc486de052 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:52.232954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749f508-ef50-4e7f-b97b-3adc486de052 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:52.253736 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1632/3241] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:10:52.532124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c6e48-d5b3-485c-ae1c-a584bb6f0d9b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:52.534006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8c4c6e48-d5b3-485c-ae1c-a584bb6f0d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:52.741208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266f56c-b520-43df-aa18-7a9b324587e3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:52.741772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266f56c-b520-43df-aa18-7a9b324587e3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:52.741772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266f56c-b520-43df-aa18-7a9b324587e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:52.765964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1266f56c-b520-43df-aa18-7a9b324587e3 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:52.767419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1266f56c-b520-43df-aa18-7a9b324587e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:52.782271 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1633/3242] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:10:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:10:52.790678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266f56c-b520-43df-aa18-7a9b324587e3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:52.825918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266f56c-b520-43df-aa18-7a9b324587e3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:52.833315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c6e48-d5b3-485c-ae1c-a584bb6f0d9b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:52.841266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f679b-2aee-4d70-b833-c1299236a8d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:52.842177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f679b-2aee-4d70-b833-c1299236a8d8 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:52.842460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f679b-2aee-4d70-b833-c1299236a8d8 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:52.842731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f679b-2aee-4d70-b833-c1299236a8d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:52.851301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87253c-96fe-45c3-bcfe-205abd2e60e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:52.852181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87253c-96fe-45c3-bcfe-205abd2e60e8 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:52.852719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87253c-96fe-45c3-bcfe-205abd2e60e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:52.853135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87253c-96fe-45c3-bcfe-205abd2e60e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:52.861712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fc87253c-96fe-45c3-bcfe-205abd2e60e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:52.866374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f679b-2aee-4d70-b833-c1299236a8d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:52.872951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f679b-2aee-4d70-b833-c1299236a8d8 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:52.892174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87253c-96fe-45c3-bcfe-205abd2e60e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:52.894179 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1634/3243] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:10:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:52.894712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87253c-96fe-45c3-bcfe-205abd2e60e8 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:52.930076 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1610/3244] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:53.125586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f679b-2aee-4d70-b833-c1299236a8d8 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:53.299203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f679b-2aee-4d70-b833-c1299236a8d8 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:53.337770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:53.340224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:53.343990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:53.344329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] PATH_INFO: `/v3/users/3f6077c51a224ecd91ab3cc728794050` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:53.350150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f6077c51a224ecd91ab3cc728794050)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:53.356352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:53.529143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f6077c51a224ecd91ab3cc728794050'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:53.531847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f6077c51a224ecd91ab3cc728794050'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:53.579303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f6077c51a224ecd91ab3cc728794050'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:53.599733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f6077c51a224ecd91ab3cc728794050'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:53.600286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f6077c51a224ecd91ab3cc728794050'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:53.620782 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1635/3245] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:10:53 2022] DELETE /identity/v3/users/3f6077c51a224ecd91ab3cc728794050 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:53.626025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd48fe-ec6d-4079-a530-63b5edadbad6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:53.626540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd48fe-ec6d-4079-a530-63b5edadbad6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:53.629482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd48fe-ec6d-4079-a530-63b5edadbad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:53.665145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-74dd48fe-ec6d-4079-a530-63b5edadbad6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:53.671602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-74dd48fe-ec6d-4079-a530-63b5edadbad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:53.792119 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1611/3246] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:10:53.837436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:53.839198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:53.889756 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:53.952616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895db6b-1a9e-4972-a4b9-30357f643230 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:53.957145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1378b-0953-4905-8eda-7442ff16f845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:53.958074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1378b-0953-4905-8eda-7442ff16f845 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:53.958581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1378b-0953-4905-8eda-7442ff16f845 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:53.959100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1378b-0953-4905-8eda-7442ff16f845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:53.974659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1378b-0953-4905-8eda-7442ff16f845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:53.977382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1378b-0953-4905-8eda-7442ff16f845 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:53.992086 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1636/3247] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:10:54.859401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd48fe-ec6d-4079-a530-63b5edadbad6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:54.861402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-74dd48fe-ec6d-4079-a530-63b5edadbad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:54.876359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd48fe-ec6d-4079-a530-63b5edadbad6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:54.885066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f766e-cc6f-4a02-a7e6-de040062158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:54.885730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f766e-cc6f-4a02-a7e6-de040062158d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:54.886168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f766e-cc6f-4a02-a7e6-de040062158d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:54.886622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f766e-cc6f-4a02-a7e6-de040062158d admin admin] PATH_INFO: `/v3/projects/59fd658f59ff4a5cbc1c9585b95a24a3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:54.888352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f766e-cc6f-4a02-a7e6-de040062158d admin admin] RBAC: Authorizing `identity:delete_project(project_id=59fd658f59ff4a5cbc1c9585b95a24a3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:54.891139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f766e-cc6f-4a02-a7e6-de040062158d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:54.894111 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:54.979726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b77f766e-cc6f-4a02-a7e6-de040062158d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59fd658f59ff4a5cbc1c9585b95a24a3', 'request_id': 'req-b77f766e-cc6f-4a02-a7e6-de040062158d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:54.987239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b77f766e-cc6f-4a02-a7e6-de040062158d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59fd658f59ff4a5cbc1c9585b95a24a3', 'request_id': 'req-b77f766e-cc6f-4a02-a7e6-de040062158d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:55.003373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b77f766e-cc6f-4a02-a7e6-de040062158d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59fd658f59ff4a5cbc1c9585b95a24a3', 'request_id': 'req-b77f766e-cc6f-4a02-a7e6-de040062158d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:55.018580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b77f766e-cc6f-4a02-a7e6-de040062158d admin admin] The token cache is being invalidate because project 59fd658f59ff4a5cbc1c9585b95a24a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:10:55.018872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b77f766e-cc6f-4a02-a7e6-de040062158d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:55.019887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b77f766e-cc6f-4a02-a7e6-de040062158d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:10:55.021443 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1612/3248] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:10:54 2022] DELETE /identity/v3/projects/59fd658f59ff4a5cbc1c9585b95a24a3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:55.026601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651176a2-90eb-47c3-aa80-327e75be3189 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:55.027603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651176a2-90eb-47c3-aa80-327e75be3189 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:55.028209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651176a2-90eb-47c3-aa80-327e75be3189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:55.083703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-651176a2-90eb-47c3-aa80-327e75be3189 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:55.087574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-651176a2-90eb-47c3-aa80-327e75be3189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:55.284654 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1637/3249] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:10:55.383489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfd320-0af7-44e1-8680-8af49fc0d0d6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:55.383833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfd320-0af7-44e1-8680-8af49fc0d0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:55.383960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfd320-0af7-44e1-8680-8af49fc0d0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:55.431004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cacfd320-0af7-44e1-8680-8af49fc0d0d6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:55.432681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cacfd320-0af7-44e1-8680-8af49fc0d0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:55.470173 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1613/3250] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:10:55.474209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651176a2-90eb-47c3-aa80-327e75be3189 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:55.485363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651176a2-90eb-47c3-aa80-327e75be3189 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:55.490182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abecc30-bbb0-42bf-84ad-00dd92898063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:55.491101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abecc30-bbb0-42bf-84ad-00dd92898063 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:55.491545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abecc30-bbb0-42bf-84ad-00dd92898063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:55.491952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abecc30-bbb0-42bf-84ad-00dd92898063 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:55.492763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abecc30-bbb0-42bf-84ad-00dd92898063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:10:55.493229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abecc30-bbb0-42bf-84ad-00dd92898063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:55.494871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abecc30-bbb0-42bf-84ad-00dd92898063 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:55.512994 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1638/3251] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:10:55.517538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfd320-0af7-44e1-8680-8af49fc0d0d6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:55.528990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfd320-0af7-44e1-8680-8af49fc0d0d6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:55.534994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e438e8-9fca-4483-a7af-18b35f23915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:55.535864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e438e8-9fca-4483-a7af-18b35f23915b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:55.536150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e438e8-9fca-4483-a7af-18b35f23915b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:55.536417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e438e8-9fca-4483-a7af-18b35f23915b admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:55.537211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e438e8-9fca-4483-a7af-18b35f23915b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:55.539370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e438e8-9fca-4483-a7af-18b35f23915b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:55.587534 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1614/3252] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:55 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:55.592034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abecc30-bbb0-42bf-84ad-00dd92898063 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:55.603592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abecc30-bbb0-42bf-84ad-00dd92898063 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:55.691940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b494c-47cf-451d-b210-3b43f911b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:55.692459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b494c-47cf-451d-b210-3b43f911b23e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:55.692742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b494c-47cf-451d-b210-3b43f911b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:55.693015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b494c-47cf-451d-b210-3b43f911b23e admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:55.693649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b494c-47cf-451d-b210-3b43f911b23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:55.695769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b494c-47cf-451d-b210-3b43f911b23e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:55.730959 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1639/3253] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:55 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:55.735232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e438e8-9fca-4483-a7af-18b35f23915b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:55.752774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e438e8-9fca-4483-a7af-18b35f23915b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:55.761035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576bd98-e109-459d-ba18-8bfbcdfbd6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:55.762682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576bd98-e109-459d-ba18-8bfbcdfbd6eb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:55.763232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576bd98-e109-459d-ba18-8bfbcdfbd6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:55.763719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576bd98-e109-459d-ba18-8bfbcdfbd6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:55.764553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576bd98-e109-459d-ba18-8bfbcdfbd6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:55.766285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576bd98-e109-459d-ba18-8bfbcdfbd6eb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:55.778948 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1615/3254] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:55.782604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b494c-47cf-451d-b210-3b43f911b23e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:55.793327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b494c-47cf-451d-b210-3b43f911b23e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:55.798286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b081f6-48ed-491c-b12b-d646fe685a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:55.798904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b081f6-48ed-491c-b12b-d646fe685a8a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:55.799216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b081f6-48ed-491c-b12b-d646fe685a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:55.799493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b081f6-48ed-491c-b12b-d646fe685a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:55.800210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b081f6-48ed-491c-b12b-d646fe685a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:55.802278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b081f6-48ed-491c-b12b-d646fe685a8a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:55.814852 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1640/3255] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:55.818694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576bd98-e109-459d-ba18-8bfbcdfbd6eb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:55.832151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576bd98-e109-459d-ba18-8bfbcdfbd6eb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:55.837241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2d76-8163-4d0e-a773-db563f9e682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:55.838036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2d76-8163-4d0e-a773-db563f9e682c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:55.838418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2d76-8163-4d0e-a773-db563f9e682c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:55.838796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2d76-8163-4d0e-a773-db563f9e682c admin admin] PATH_INFO: `/v3/projects/f6eaf1f531a34918b667dd13ee546c3c/users/cb8b0f8bc10744a48ba642a19d131473/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:55.860532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc2d76-8163-4d0e-a773-db563f9e682c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6eaf1f531a34918b667dd13ee546c3c, user_id=cb8b0f8bc10744a48ba642a19d131473, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:55.863693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc2d76-8163-4d0e-a773-db563f9e682c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:55.913373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123f2bf-bd69-4edc-b531-f01dedb8dfe5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:55.913663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123f2bf-bd69-4edc-b531-f01dedb8dfe5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:55.914041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123f2bf-bd69-4edc-b531-f01dedb8dfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:55.916818 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1616/3256] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:55 2022] PUT /identity/v3/projects/f6eaf1f531a34918b667dd13ee546c3c/users/cb8b0f8bc10744a48ba642a19d131473/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:55.948059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0123f2bf-bd69-4edc-b531-f01dedb8dfe5 None None] MFA Rules not processed for user `cb8b0f8bc10744a48ba642a19d131473`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:55.950254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0123f2bf-bd69-4edc-b531-f01dedb8dfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:55.971735 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:56.054759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2d76-8163-4d0e-a773-db563f9e682c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:56.057950 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1641/3257] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:56.196906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2d76-8163-4d0e-a773-db563f9e682c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:56.209473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a3dbb-f271-457a-b447-677fee2bffae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:56.210108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a3dbb-f271-457a-b447-677fee2bffae admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:56.210387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a3dbb-f271-457a-b447-677fee2bffae admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:56.210660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a3dbb-f271-457a-b447-677fee2bffae admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:56.211358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a3dbb-f271-457a-b447-677fee2bffae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:56.221019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a3dbb-f271-457a-b447-677fee2bffae admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:56.304387 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1617/3258] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:56 2022] POST /identity/v3/projects => generated 381 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:56.305889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123f2bf-bd69-4edc-b531-f01dedb8dfe5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:56.328280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123f2bf-bd69-4edc-b531-f01dedb8dfe5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:56.449945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb00178-d96f-469e-aa38-c90dabf20d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:56.451816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb00178-d96f-469e-aa38-c90dabf20d3f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:56.452238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb00178-d96f-469e-aa38-c90dabf20d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:56.452700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb00178-d96f-469e-aa38-c90dabf20d3f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:56.453645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb00178-d96f-469e-aa38-c90dabf20d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:56.455849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb00178-d96f-469e-aa38-c90dabf20d3f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:56.500165 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1642/3259] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:56 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:56.503840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a3dbb-f271-457a-b447-677fee2bffae admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:56.517890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a3dbb-f271-457a-b447-677fee2bffae admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:56.523774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b2e83-f3af-40d4-ab6b-21ad45443fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:56.524955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2e83-f3af-40d4-ab6b-21ad45443fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:56.525579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2e83-f3af-40d4-ab6b-21ad45443fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:56.526029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2e83-f3af-40d4-ab6b-21ad45443fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:56.526964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b2e83-f3af-40d4-ab6b-21ad45443fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:56.529781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b2e83-f3af-40d4-ab6b-21ad45443fcf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:56.536626 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:56.576663 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1618/3260] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:56.580636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb00178-d96f-469e-aa38-c90dabf20d3f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:56.595534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb00178-d96f-469e-aa38-c90dabf20d3f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:56.608496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e672a2-3f91-4b89-97ad-241ab39d2f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:56.609122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e672a2-3f91-4b89-97ad-241ab39d2f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:56.610556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e672a2-3f91-4b89-97ad-241ab39d2f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:56.611064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e672a2-3f91-4b89-97ad-241ab39d2f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:56.612469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e672a2-3f91-4b89-97ad-241ab39d2f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:56.617185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e672a2-3f91-4b89-97ad-241ab39d2f4e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:56.667176 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1643/3261] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:56.669599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b2e83-f3af-40d4-ab6b-21ad45443fcf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:56.688887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b2e83-f3af-40d4-ab6b-21ad45443fcf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:56.702581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78733a-df83-4692-8189-23185fc07aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:56.705000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78733a-df83-4692-8189-23185fc07aec admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:56.705294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78733a-df83-4692-8189-23185fc07aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:56.705573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78733a-df83-4692-8189-23185fc07aec admin admin] PATH_INFO: `/v3/projects/84be84455fa74c24ad8304157689a6e8/users/23d6dd2f36be41388c2227c785b0753c/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:56.759735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78733a-df83-4692-8189-23185fc07aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=84be84455fa74c24ad8304157689a6e8, user_id=23d6dd2f36be41388c2227c785b0753c, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:56.763893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78733a-df83-4692-8189-23185fc07aec admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:56.801008 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1619/3262] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:56 2022] PUT /identity/v3/projects/84be84455fa74c24ad8304157689a6e8/users/23d6dd2f36be41388c2227c785b0753c/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:10:56.813519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef98d5a-1e3f-47d5-bfb2-568723412fd6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:56.814259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef98d5a-1e3f-47d5-bfb2-568723412fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:56.815586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef98d5a-1e3f-47d5-bfb2-568723412fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:56.865288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fef98d5a-1e3f-47d5-bfb2-568723412fd6 None None] MFA Rules not processed for user `23d6dd2f36be41388c2227c785b0753c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:56.866885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fef98d5a-1e3f-47d5-bfb2-568723412fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:56.970820 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1644/3263] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:10:56.974931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78733a-df83-4692-8189-23185fc07aec admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:57.133667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78733a-df83-4692-8189-23185fc07aec admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:57.145791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba84b3-950b-4364-82db-eb30bf55ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:57.146418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba84b3-950b-4364-82db-eb30bf55ff65 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:57.146699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba84b3-950b-4364-82db-eb30bf55ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:57.147005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba84b3-950b-4364-82db-eb30bf55ff65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:57.147651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba84b3-950b-4364-82db-eb30bf55ff65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:57.150168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba84b3-950b-4364-82db-eb30bf55ff65 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:57.228175 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1620/3264] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:10:56 2022] POST /identity/v3/projects => generated 383 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:57.229471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef98d5a-1e3f-47d5-bfb2-568723412fd6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:57.249202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef98d5a-1e3f-47d5-bfb2-568723412fd6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:57.319214 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:57.387194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af216287-20de-4b52-93b2-a33beabc7fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:57.387829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af216287-20de-4b52-93b2-a33beabc7fcb admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:57.388228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af216287-20de-4b52-93b2-a33beabc7fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:57.391861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af216287-20de-4b52-93b2-a33beabc7fcb admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:57.394185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af216287-20de-4b52-93b2-a33beabc7fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:57.396546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af216287-20de-4b52-93b2-a33beabc7fcb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:57.428105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba84b3-950b-4364-82db-eb30bf55ff65 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:57.435852 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1645/3265] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:10:57 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:10:57.441795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba84b3-950b-4364-82db-eb30bf55ff65 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:57.448116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e5cc1-6f68-401a-8d63-36a6d7a9d82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:57.449822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e5cc1-6f68-401a-8d63-36a6d7a9d82d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:57.450287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e5cc1-6f68-401a-8d63-36a6d7a9d82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:57.450973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e5cc1-6f68-401a-8d63-36a6d7a9d82d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:57.454613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e5cc1-6f68-401a-8d63-36a6d7a9d82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:57.456613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e5cc1-6f68-401a-8d63-36a6d7a9d82d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:57.477124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af216287-20de-4b52-93b2-a33beabc7fcb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:57.477373 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1621/3266] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:10:57.491975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af216287-20de-4b52-93b2-a33beabc7fcb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:57.499394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1f9cb-c6a7-485e-bc7c-ff6648e2a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:57.500197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1f9cb-c6a7-485e-bc7c-ff6648e2a433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:57.500344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1f9cb-c6a7-485e-bc7c-ff6648e2a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:57.500620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1f9cb-c6a7-485e-bc7c-ff6648e2a433 admin admin] PATH_INFO: `/v3/projects/92049268d16940af898e86019eb6966b/users/c211efdd2a2745f3a302c243f4ce1964/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:57.521817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1f9cb-c6a7-485e-bc7c-ff6648e2a433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92049268d16940af898e86019eb6966b, user_id=c211efdd2a2745f3a302c243f4ce1964, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:57.525259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1f9cb-c6a7-485e-bc7c-ff6648e2a433 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:57.544514 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1646/3267] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:57 2022] PUT /identity/v3/projects/92049268d16940af898e86019eb6966b/users/c211efdd2a2745f3a302c243f4ce1964/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:10:57.548333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e5cc1-6f68-401a-8d63-36a6d7a9d82d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:57.565382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e5cc1-6f68-401a-8d63-36a6d7a9d82d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:57.648092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f215f-840d-4fe1-928a-f4296feb0ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:57.649018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f215f-840d-4fe1-928a-f4296feb0ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:57.650129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f215f-840d-4fe1-928a-f4296feb0ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:57.650682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f215f-840d-4fe1-928a-f4296feb0ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:57.651537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f215f-840d-4fe1-928a-f4296feb0ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:57.653883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f215f-840d-4fe1-928a-f4296feb0ae3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:57.668337 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1622/3268] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:10:57.672414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1f9cb-c6a7-485e-bc7c-ff6648e2a433 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:57.694252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1f9cb-c6a7-485e-bc7c-ff6648e2a433 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:57.707714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2870b9-7531-43d5-aa67-f6c298abad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:57.708391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2870b9-7531-43d5-aa67-f6c298abad75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:57.710152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2870b9-7531-43d5-aa67-f6c298abad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:57.710434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2870b9-7531-43d5-aa67-f6c298abad75 admin admin] PATH_INFO: `/v3/projects/92049268d16940af898e86019eb6966b/users/c211efdd2a2745f3a302c243f4ce1964/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:57.718937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2870b9-7531-43d5-aa67-f6c298abad75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92049268d16940af898e86019eb6966b, user_id=c211efdd2a2745f3a302c243f4ce1964, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:57.724488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2870b9-7531-43d5-aa67-f6c298abad75 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:57.761549 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1647/3269] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:10:57 2022] PUT /identity/v3/projects/92049268d16940af898e86019eb6966b/users/c211efdd2a2745f3a302c243f4ce1964/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:10:57.773374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9400ed-0129-4c7f-812d-5f3c4ad0946d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:57.776280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9400ed-0129-4c7f-812d-5f3c4ad0946d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:57.776647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9400ed-0129-4c7f-812d-5f3c4ad0946d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:57.810381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ed9400ed-0129-4c7f-812d-5f3c4ad0946d None None] MFA Rules not processed for user `c211efdd2a2745f3a302c243f4ce1964`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:10:57.812614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ed9400ed-0129-4c7f-812d-5f3c4ad0946d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:57.854609 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:57.916149 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1623/3270] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:10:57.950856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2870b9-7531-43d5-aa67-f6c298abad75 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:10:57.952804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dd2870b9-7531-43d5-aa67-f6c298abad75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:10:58.051459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2870b9-7531-43d5-aa67-f6c298abad75 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:10:58.059599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2b775-f482-41be-833f-3dd191332cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:10:58.060710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2b775-f482-41be-833f-3dd191332cda service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:10:58.061062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2b775-f482-41be-833f-3dd191332cda service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:10:58.061403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2b775-f482-41be-833f-3dd191332cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:10:58.251059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2b775-f482-41be-833f-3dd191332cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:10:58.253393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2b775-f482-41be-833f-3dd191332cda service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:10:58.276870 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1648/3271] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:10:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:00.741496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16de66-69f0-4b0b-988d-8891006d2f0e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:00.742027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16de66-69f0-4b0b-988d-8891006d2f0e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:00.742027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16de66-69f0-4b0b-988d-8891006d2f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:00.773822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fd16de66-69f0-4b0b-988d-8891006d2f0e None None] MFA Rules not processed for user `0c8da9a32cb54d0a87d914234b1e9f40`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:00.777518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fd16de66-69f0-4b0b-988d-8891006d2f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:00.915459 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1624/3272] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:03.341224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2b775-f482-41be-833f-3dd191332cda service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:03.342692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22f2b775-f482-41be-833f-3dd191332cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:03.422104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16de66-69f0-4b0b-988d-8891006d2f0e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:03.424371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fd16de66-69f0-4b0b-988d-8891006d2f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:03.476483 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:03.573200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16de66-69f0-4b0b-988d-8891006d2f0e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:03.582368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acd4ef-cb35-4da5-ae97-fe42ba8e6ccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:03.583581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acd4ef-cb35-4da5-ae97-fe42ba8e6ccd service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:03.584928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acd4ef-cb35-4da5-ae97-fe42ba8e6ccd service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:03.584928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acd4ef-cb35-4da5-ae97-fe42ba8e6ccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:03.588450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-98acd4ef-cb35-4da5-ae97-fe42ba8e6ccd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:03.596751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2b775-f482-41be-833f-3dd191332cda service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:03.610344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c784f5-7a62-4407-b6b6-45977a626b48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:03.611283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c784f5-7a62-4407-b6b6-45977a626b48 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:03.611703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c784f5-7a62-4407-b6b6-45977a626b48 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:03.612115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c784f5-7a62-4407-b6b6-45977a626b48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:03.615571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-14c784f5-7a62-4407-b6b6-45977a626b48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:03.620287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acd4ef-cb35-4da5-ae97-fe42ba8e6ccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:03.623606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acd4ef-cb35-4da5-ae97-fe42ba8e6ccd service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:03.642985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c784f5-7a62-4407-b6b6-45977a626b48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:03.644870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c784f5-7a62-4407-b6b6-45977a626b48 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:03.655410 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1625/3273] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:03.675582 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1649/3274] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:05.282559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d2a96-1ee7-48f9-b52e-b59f13a635ee None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:05.283708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d2a96-1ee7-48f9-b52e-b59f13a635ee None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:05.284425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d2a96-1ee7-48f9-b52e-b59f13a635ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:05.320058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-096d2a96-1ee7-48f9-b52e-b59f13a635ee None None] MFA Rules not processed for user `df9979f0dcd74d60a55d02d432de6a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:05.321200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-096d2a96-1ee7-48f9-b52e-b59f13a635ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:05.452791 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:05.543752 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1626/3275] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:06.301317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c784f5-7a62-4407-b6b6-45977a626b48 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:06.304187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-14c784f5-7a62-4407-b6b6-45977a626b48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:06.462754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c784f5-7a62-4407-b6b6-45977a626b48 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:06.473433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:06.474085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:06.474360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:06.474626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] PATH_INFO: `/v3/users/a745e8bb56574606b709907e661b9cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:06.475938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a745e8bb56574606b709907e661b9cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:06.477878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:06.611002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a745e8bb56574606b709907e661b9cd8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:06.611871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a745e8bb56574606b709907e661b9cd8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:06.646352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a745e8bb56574606b709907e661b9cd8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:06.667158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a745e8bb56574606b709907e661b9cd8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:06.673173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a745e8bb56574606b709907e661b9cd8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:06.711813 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1650/3276] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:06 2022] DELETE /identity/v3/users/a745e8bb56574606b709907e661b9cd8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:07.711417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d2a96-1ee7-48f9-b52e-b59f13a635ee None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:07.730765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d2a96-1ee7-48f9-b52e-b59f13a635ee None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:07.854265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:07.855000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:07.855706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:07.855984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] PATH_INFO: `/v3/projects/622fb0e0967148838b71b51b4d572d38` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:07.857335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=622fb0e0967148838b71b51b4d572d38)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:07.860287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:07.935990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622fb0e0967148838b71b51b4d572d38', 'request_id': 'req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:07.954872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622fb0e0967148838b71b51b4d572d38', 'request_id': 'req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:07.968924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622fb0e0967148838b71b51b4d572d38', 'request_id': 'req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:07.996212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] The token cache is being invalidate because project 622fb0e0967148838b71b51b4d572d38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:07.996555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:07.997563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:08.001096 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1627/3277] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:07 2022] DELETE /identity/v3/projects/622fb0e0967148838b71b51b4d572d38 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:08.005243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:08.007886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:08.040794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c2c6-bbea-4402-8a83-2e778b3ec4fb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:08.125764 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:08.210613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49972c14-8352-46ca-b75c-fd5cfecdf66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:08.211437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49972c14-8352-46ca-b75c-fd5cfecdf66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:08.211722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49972c14-8352-46ca-b75c-fd5cfecdf66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:08.211998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49972c14-8352-46ca-b75c-fd5cfecdf66b admin admin] PATH_INFO: `/v3/users/59f3db3aa571450c903a9733155561a8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:08.216149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49972c14-8352-46ca-b75c-fd5cfecdf66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f3db3aa571450c903a9733155561a8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:08.220344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49972c14-8352-46ca-b75c-fd5cfecdf66b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:08.329720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49972c14-8352-46ca-b75c-fd5cfecdf66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f3db3aa571450c903a9733155561a8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:08.330437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49972c14-8352-46ca-b75c-fd5cfecdf66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f3db3aa571450c903a9733155561a8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:08.365987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49972c14-8352-46ca-b75c-fd5cfecdf66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f3db3aa571450c903a9733155561a8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:08.379843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49972c14-8352-46ca-b75c-fd5cfecdf66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f3db3aa571450c903a9733155561a8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:08.380548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49972c14-8352-46ca-b75c-fd5cfecdf66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f3db3aa571450c903a9733155561a8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:08.414795 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1651/3278] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:08 2022] DELETE /identity/v3/users/59f3db3aa571450c903a9733155561a8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:08.967873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:08.969372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:08.983675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0e2bd-f67e-4d84-b0a5-bcbc675fac38 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:09.112365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:09.113414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:09.114301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:09.115267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef admin admin] PATH_INFO: `/v3/projects/236b760a7a88423cb3f03f28b7712461` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:09.121205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=236b760a7a88423cb3f03f28b7712461)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:09.127637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:09.177894 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:09.241209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236b760a7a88423cb3f03f28b7712461', 'request_id': 'req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:09.250302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236b760a7a88423cb3f03f28b7712461', 'request_id': 'req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:09.264417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236b760a7a88423cb3f03f28b7712461', 'request_id': 'req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:09.288490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef admin admin] The token cache is being invalidate because project 236b760a7a88423cb3f03f28b7712461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:09.291626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:09.295094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33bdfb8a-4c26-4e7b-94f0-bb9da99a70ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:09.300752 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1628/3279] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:08 2022] DELETE /identity/v3/projects/236b760a7a88423cb3f03f28b7712461 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:11:09.302773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800406e-2fd9-4326-b484-6130d984e7fe None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:09.303393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800406e-2fd9-4326-b484-6130d984e7fe None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:09.303658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800406e-2fd9-4326-b484-6130d984e7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:09.346216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1800406e-2fd9-4326-b484-6130d984e7fe None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:09.350001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1800406e-2fd9-4326-b484-6130d984e7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:09.513497 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1652/3280] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:09.521877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922ba78-5601-4e80-9027-02bbab7f162b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:09.522167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922ba78-5601-4e80-9027-02bbab7f162b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:09.522439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922ba78-5601-4e80-9027-02bbab7f162b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:09.570368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e922ba78-5601-4e80-9027-02bbab7f162b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:09.572445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e922ba78-5601-4e80-9027-02bbab7f162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:09.586857 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1629/3281] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:09.591285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800406e-2fd9-4326-b484-6130d984e7fe None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:09.603896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800406e-2fd9-4326-b484-6130d984e7fe None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:09.610704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb31d87-3514-4be7-abdc-c16e9a9a9740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:09.611588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb31d87-3514-4be7-abdc-c16e9a9a9740 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:09.612035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb31d87-3514-4be7-abdc-c16e9a9a9740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:09.612327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb31d87-3514-4be7-abdc-c16e9a9a9740 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:09.612990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb31d87-3514-4be7-abdc-c16e9a9a9740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:11:09.613691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb31d87-3514-4be7-abdc-c16e9a9a9740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:09.616346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb31d87-3514-4be7-abdc-c16e9a9a9740 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:09.641937 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1653/3282] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:11:09.646978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922ba78-5601-4e80-9027-02bbab7f162b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:09.659704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922ba78-5601-4e80-9027-02bbab7f162b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:09.665187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d15de7-ffe6-43ac-85a7-4606d23a1250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:09.665802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d15de7-ffe6-43ac-85a7-4606d23a1250 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:09.666107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d15de7-ffe6-43ac-85a7-4606d23a1250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:09.666373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d15de7-ffe6-43ac-85a7-4606d23a1250 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:09.667034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d15de7-ffe6-43ac-85a7-4606d23a1250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:09.669663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d15de7-ffe6-43ac-85a7-4606d23a1250 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:09.702955 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1630/3283] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:11:09 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:09.706172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb31d87-3514-4be7-abdc-c16e9a9a9740 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:09.720287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb31d87-3514-4be7-abdc-c16e9a9a9740 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:09.764542 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:09.785997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe611e-dbbf-44e3-93fe-265b863113df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:09.786613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe611e-dbbf-44e3-93fe-265b863113df admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:09.786891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe611e-dbbf-44e3-93fe-265b863113df admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:09.787195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe611e-dbbf-44e3-93fe-265b863113df admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:09.787818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe611e-dbbf-44e3-93fe-265b863113df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:09.789720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe611e-dbbf-44e3-93fe-265b863113df admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:09.814199 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1654/3284] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:11:09 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:09.818719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d15de7-ffe6-43ac-85a7-4606d23a1250 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:09.829746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d15de7-ffe6-43ac-85a7-4606d23a1250 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:09.834395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568538cb-1c25-45b5-a8f9-ea38d46069a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:09.835014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568538cb-1c25-45b5-a8f9-ea38d46069a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:09.835298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568538cb-1c25-45b5-a8f9-ea38d46069a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:09.835569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568538cb-1c25-45b5-a8f9-ea38d46069a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:09.836200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568538cb-1c25-45b5-a8f9-ea38d46069a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:09.837807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568538cb-1c25-45b5-a8f9-ea38d46069a4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:09.849240 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1631/3285] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:09.853389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe611e-dbbf-44e3-93fe-265b863113df admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:09.864171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe611e-dbbf-44e3-93fe-265b863113df admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:09.869145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d94053-9d33-4e17-956a-2699c8953f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:09.869811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d94053-9d33-4e17-956a-2699c8953f8c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:09.870112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d94053-9d33-4e17-956a-2699c8953f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:09.870581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d94053-9d33-4e17-956a-2699c8953f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:09.871404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d94053-9d33-4e17-956a-2699c8953f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:09.873151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d94053-9d33-4e17-956a-2699c8953f8c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:09.884801 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1655/3286] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:09.890098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568538cb-1c25-45b5-a8f9-ea38d46069a4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:09.900784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568538cb-1c25-45b5-a8f9-ea38d46069a4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:09.907213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ccec-3863-44f2-8249-f7df0042bf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:09.907910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ccec-3863-44f2-8249-f7df0042bf8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:09.908192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ccec-3863-44f2-8249-f7df0042bf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:09.908468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ccec-3863-44f2-8249-f7df0042bf8c admin admin] PATH_INFO: `/v3/projects/5fa23478036a4bcdafbac2b61d7b970b/users/dcddb65efbf14eee9f1af5839919c12c/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:09.925130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3ccec-3863-44f2-8249-f7df0042bf8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa23478036a4bcdafbac2b61d7b970b, user_id=dcddb65efbf14eee9f1af5839919c12c, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:09.927988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3ccec-3863-44f2-8249-f7df0042bf8c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:09.941938 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1632/3287] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:11:09 2022] PUT /identity/v3/projects/5fa23478036a4bcdafbac2b61d7b970b/users/dcddb65efbf14eee9f1af5839919c12c/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:09.953840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f78995-ab14-48cd-a3f4-308b090efd89 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:09.954391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f78995-ab14-48cd-a3f4-308b090efd89 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:09.954774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f78995-ab14-48cd-a3f4-308b090efd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:09.983704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b4f78995-ab14-48cd-a3f4-308b090efd89 None None] MFA Rules not processed for user `dcddb65efbf14eee9f1af5839919c12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:09.984939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b4f78995-ab14-48cd-a3f4-308b090efd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:10.056154 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1656/3288] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:11:10.528361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ccec-3863-44f2-8249-f7df0042bf8c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:10.530277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bad3ccec-3863-44f2-8249-f7df0042bf8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:10.691754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ccec-3863-44f2-8249-f7df0042bf8c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:10.707625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a469ff-a9d7-40f3-99a5-67b175be4d09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:10.708616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a469ff-a9d7-40f3-99a5-67b175be4d09 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:10.709196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a469ff-a9d7-40f3-99a5-67b175be4d09 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:10.709869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a469ff-a9d7-40f3-99a5-67b175be4d09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:10.722449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a469ff-a9d7-40f3-99a5-67b175be4d09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:10.724429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a469ff-a9d7-40f3-99a5-67b175be4d09 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:10.748821 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1633/3289] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:13.241164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f78995-ab14-48cd-a3f4-308b090efd89 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:13.328092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f78995-ab14-48cd-a3f4-308b090efd89 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:13.336041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:13.337113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:13.337541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:13.337951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] PATH_INFO: `/v3/users/dcddb65efbf14eee9f1af5839919c12c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:13.340994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcddb65efbf14eee9f1af5839919c12c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:13.343142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:13.468790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcddb65efbf14eee9f1af5839919c12c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:13.469745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcddb65efbf14eee9f1af5839919c12c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:13.474274 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:13.496587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcddb65efbf14eee9f1af5839919c12c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:13.507529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcddb65efbf14eee9f1af5839919c12c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:13.510650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcddb65efbf14eee9f1af5839919c12c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:13.528891 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1657/3290] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:13 2022] DELETE /identity/v3/users/dcddb65efbf14eee9f1af5839919c12c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:13.535379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dff07-336f-4832-86b1-4e8ab07aebee None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:13.536704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dff07-336f-4832-86b1-4e8ab07aebee None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:13.537149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dff07-336f-4832-86b1-4e8ab07aebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:13.607255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-625dff07-336f-4832-86b1-4e8ab07aebee None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:13.608518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-625dff07-336f-4832-86b1-4e8ab07aebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:13.669513 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:13.729294 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1634/3291] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:13.768614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:13.776183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:13.874790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5192340-41b3-4e0f-9536-385aa39b9f22 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:13.879691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed1457-2554-47dd-a8d6-a8d213ba50cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:13.881099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed1457-2554-47dd-a8d6-a8d213ba50cf service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:13.881522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed1457-2554-47dd-a8d6-a8d213ba50cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:13.883045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed1457-2554-47dd-a8d6-a8d213ba50cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:13.898797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed1457-2554-47dd-a8d6-a8d213ba50cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:13.900816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed1457-2554-47dd-a8d6-a8d213ba50cf service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:13.913243 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1658/3292] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:16.619808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dff07-336f-4832-86b1-4e8ab07aebee None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:16.623412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-625dff07-336f-4832-86b1-4e8ab07aebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:16.652691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dff07-336f-4832-86b1-4e8ab07aebee None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:16.664426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b995129-ee30-4303-88e1-6c8de728b0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:16.665402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b995129-ee30-4303-88e1-6c8de728b0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:16.665796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b995129-ee30-4303-88e1-6c8de728b0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:16.666178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b995129-ee30-4303-88e1-6c8de728b0fe admin admin] PATH_INFO: `/v3/projects/5fa23478036a4bcdafbac2b61d7b970b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:16.668045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b995129-ee30-4303-88e1-6c8de728b0fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa23478036a4bcdafbac2b61d7b970b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:16.670267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b995129-ee30-4303-88e1-6c8de728b0fe admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:16.786217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1b995129-ee30-4303-88e1-6c8de728b0fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa23478036a4bcdafbac2b61d7b970b', 'request_id': 'req-1b995129-ee30-4303-88e1-6c8de728b0fe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:16.795854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1b995129-ee30-4303-88e1-6c8de728b0fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa23478036a4bcdafbac2b61d7b970b', 'request_id': 'req-1b995129-ee30-4303-88e1-6c8de728b0fe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:16.819318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1b995129-ee30-4303-88e1-6c8de728b0fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa23478036a4bcdafbac2b61d7b970b', 'request_id': 'req-1b995129-ee30-4303-88e1-6c8de728b0fe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:16.842471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1b995129-ee30-4303-88e1-6c8de728b0fe admin admin] The token cache is being invalidate because project 5fa23478036a4bcdafbac2b61d7b970b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:16.842880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1b995129-ee30-4303-88e1-6c8de728b0fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:16.844182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1b995129-ee30-4303-88e1-6c8de728b0fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:16.846147 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1635/3293] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:16 2022] DELETE /identity/v3/projects/5fa23478036a4bcdafbac2b61d7b970b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:16.851071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c7a35-8346-49b2-a733-b5ff5defba96 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:16.851587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c7a35-8346-49b2-a733-b5ff5defba96 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:16.851703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c7a35-8346-49b2-a733-b5ff5defba96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:16.882038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e86c7a35-8346-49b2-a733-b5ff5defba96 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:16.883292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e86c7a35-8346-49b2-a733-b5ff5defba96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:17.117073 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1659/3294] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:17.125743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044299-2f66-4a5a-bf0f-f7cd6d139921 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:17.125743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044299-2f66-4a5a-bf0f-f7cd6d139921 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:17.125743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044299-2f66-4a5a-bf0f-f7cd6d139921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:17.176421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c9044299-2f66-4a5a-bf0f-f7cd6d139921 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:17.181779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c9044299-2f66-4a5a-bf0f-f7cd6d139921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:17.208554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c7a35-8346-49b2-a733-b5ff5defba96 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:17.209071 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1636/3295] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:17.225045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c7a35-8346-49b2-a733-b5ff5defba96 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:17.238635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe18e2-936e-4656-b1e0-fdaaa5bf79d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:17.239965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe18e2-936e-4656-b1e0-fdaaa5bf79d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:17.240682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe18e2-936e-4656-b1e0-fdaaa5bf79d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:17.241183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe18e2-936e-4656-b1e0-fdaaa5bf79d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:17.242368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe18e2-936e-4656-b1e0-fdaaa5bf79d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:11:17.243128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe18e2-936e-4656-b1e0-fdaaa5bf79d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:17.262317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe18e2-936e-4656-b1e0-fdaaa5bf79d5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:17.305359 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1660/3296] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:11:17.309994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9044299-2f66-4a5a-bf0f-f7cd6d139921 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:17.322614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9044299-2f66-4a5a-bf0f-f7cd6d139921 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:17.336274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dce1e-4ef6-4c0c-b71e-553d6f3d7f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:17.336915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dce1e-4ef6-4c0c-b71e-553d6f3d7f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:17.337191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dce1e-4ef6-4c0c-b71e-553d6f3d7f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:17.337460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dce1e-4ef6-4c0c-b71e-553d6f3d7f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:17.338106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dce1e-4ef6-4c0c-b71e-553d6f3d7f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:17.343301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dce1e-4ef6-4c0c-b71e-553d6f3d7f2e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:17.422575 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1637/3297] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:11:17 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:17.426694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe18e2-936e-4656-b1e0-fdaaa5bf79d5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:17.445454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe18e2-936e-4656-b1e0-fdaaa5bf79d5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:17.636042 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:17.654621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608765bb-b5eb-4496-8d3e-32e25a6c7c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:17.655843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608765bb-b5eb-4496-8d3e-32e25a6c7c83 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:17.656637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608765bb-b5eb-4496-8d3e-32e25a6c7c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:17.657128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608765bb-b5eb-4496-8d3e-32e25a6c7c83 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:17.657796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608765bb-b5eb-4496-8d3e-32e25a6c7c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:17.660113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608765bb-b5eb-4496-8d3e-32e25a6c7c83 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:17.706306 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1661/3298] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:11:17 2022] POST /identity/v3/users => generated 291 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:17.710064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dce1e-4ef6-4c0c-b71e-553d6f3d7f2e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:17.725683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dce1e-4ef6-4c0c-b71e-553d6f3d7f2e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:17.737382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99aedc-a470-4692-9178-fd50c39a3c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:17.738790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99aedc-a470-4692-9178-fd50c39a3c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:17.739318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99aedc-a470-4692-9178-fd50c39a3c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:17.739731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99aedc-a470-4692-9178-fd50c39a3c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:17.740549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99aedc-a470-4692-9178-fd50c39a3c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:17.743263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99aedc-a470-4692-9178-fd50c39a3c88 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:17.756494 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1638/3299] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:11:17.762324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608765bb-b5eb-4496-8d3e-32e25a6c7c83 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:17.780184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608765bb-b5eb-4496-8d3e-32e25a6c7c83 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:17.785651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2597eb-3a84-4ea6-b392-a03e50ef680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:17.786491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2597eb-3a84-4ea6-b392-a03e50ef680a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:17.786993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2597eb-3a84-4ea6-b392-a03e50ef680a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:17.790360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2597eb-3a84-4ea6-b392-a03e50ef680a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:17.791295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2597eb-3a84-4ea6-b392-a03e50ef680a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:17.794318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2597eb-3a84-4ea6-b392-a03e50ef680a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:17.813967 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1662/3300] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:17.817895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99aedc-a470-4692-9178-fd50c39a3c88 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:17.831097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99aedc-a470-4692-9178-fd50c39a3c88 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:17.840309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a43193-7b7e-4d76-b42d-5eea6a20f3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:17.841433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a43193-7b7e-4d76-b42d-5eea6a20f3a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:17.842185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a43193-7b7e-4d76-b42d-5eea6a20f3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:17.842676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a43193-7b7e-4d76-b42d-5eea6a20f3a9 admin admin] PATH_INFO: `/v3/projects/3986cde5f07a4eeead588c344187a0b8/users/17f95d77e66946ce9ac525cc34c61d7c/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:17.882612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a43193-7b7e-4d76-b42d-5eea6a20f3a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3986cde5f07a4eeead588c344187a0b8, user_id=17f95d77e66946ce9ac525cc34c61d7c, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:17.886425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a43193-7b7e-4d76-b42d-5eea6a20f3a9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:17.925530 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1639/3301] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:11:17 2022] PUT /identity/v3/projects/3986cde5f07a4eeead588c344187a0b8/users/17f95d77e66946ce9ac525cc34c61d7c/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:17.927567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121047e-7b12-40c0-a929-1544f26c675d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:17.928051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121047e-7b12-40c0-a929-1544f26c675d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:17.928165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121047e-7b12-40c0-a929-1544f26c675d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:17.966728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6121047e-7b12-40c0-a929-1544f26c675d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:17.970183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6121047e-7b12-40c0-a929-1544f26c675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:18.140368 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1663/3302] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:18.151820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a43193-7b7e-4d76-b42d-5eea6a20f3a9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:18.153608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-15a43193-7b7e-4d76-b42d-5eea6a20f3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:18.281291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a43193-7b7e-4d76-b42d-5eea6a20f3a9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:18.306223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b18180-d381-4b5d-a96e-65fa51548d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:18.306866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b18180-d381-4b5d-a96e-65fa51548d06 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:18.307180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b18180-d381-4b5d-a96e-65fa51548d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:18.308015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b18180-d381-4b5d-a96e-65fa51548d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:18.316328 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:18.325788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b18180-d381-4b5d-a96e-65fa51548d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:18.328810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b18180-d381-4b5d-a96e-65fa51548d06 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:18.356069 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1640/3303] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:21.513289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121047e-7b12-40c0-a929-1544f26c675d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:21.516650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6121047e-7b12-40c0-a929-1544f26c675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:21.537640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121047e-7b12-40c0-a929-1544f26c675d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:21.549983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f606c49-4a7e-4b3d-a911-0160a578f8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:21.550746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f606c49-4a7e-4b3d-a911-0160a578f8df service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:21.551155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f606c49-4a7e-4b3d-a911-0160a578f8df service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:21.551675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f606c49-4a7e-4b3d-a911-0160a578f8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:21.554850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4f606c49-4a7e-4b3d-a911-0160a578f8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:21.730805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f606c49-4a7e-4b3d-a911-0160a578f8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:21.733576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f606c49-4a7e-4b3d-a911-0160a578f8df service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:21.755876 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1664/3304] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:24.190497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b18180-d381-4b5d-a96e-65fa51548d06 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:24.192454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-08b18180-d381-4b5d-a96e-65fa51548d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:24.237940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b18180-d381-4b5d-a96e-65fa51548d06 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:24.252320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41794d2e-ff17-41ef-89ca-45019963cd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:24.253113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41794d2e-ff17-41ef-89ca-45019963cd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:24.253458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41794d2e-ff17-41ef-89ca-45019963cd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:24.253803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41794d2e-ff17-41ef-89ca-45019963cd05 admin admin] PATH_INFO: `/v3/users/02ad8a9597ab413dad2f7babb1ffbc69` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:24.255264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41794d2e-ff17-41ef-89ca-45019963cd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ad8a9597ab413dad2f7babb1ffbc69)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:24.257426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41794d2e-ff17-41ef-89ca-45019963cd05 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:24.387454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-41794d2e-ff17-41ef-89ca-45019963cd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ad8a9597ab413dad2f7babb1ffbc69'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:24.392224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-41794d2e-ff17-41ef-89ca-45019963cd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ad8a9597ab413dad2f7babb1ffbc69'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:24.405317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f606c49-4a7e-4b3d-a911-0160a578f8df service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:24.408354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4f606c49-4a7e-4b3d-a911-0160a578f8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:24.449485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-41794d2e-ff17-41ef-89ca-45019963cd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ad8a9597ab413dad2f7babb1ffbc69'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:24.460049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f606c49-4a7e-4b3d-a911-0160a578f8df service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:24.466493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-41794d2e-ff17-41ef-89ca-45019963cd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ad8a9597ab413dad2f7babb1ffbc69'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:24.469992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:24.470882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:24.471351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:24.471768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] PATH_INFO: `/v3/users/2d7df9a6845440bbad5bd7c0a192171b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:24.473243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-41794d2e-ff17-41ef-89ca-45019963cd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ad8a9597ab413dad2f7babb1ffbc69'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:24.474020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7df9a6845440bbad5bd7c0a192171b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:24.476140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:24.517269 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1641/3305] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:24 2022] DELETE /identity/v3/users/02ad8a9597ab413dad2f7babb1ffbc69 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:24.582445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7df9a6845440bbad5bd7c0a192171b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:24.583353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7df9a6845440bbad5bd7c0a192171b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:24.607777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7df9a6845440bbad5bd7c0a192171b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:24.610307 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:24.628015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7df9a6845440bbad5bd7c0a192171b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:24.628843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7df9a6845440bbad5bd7c0a192171b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:24.676248 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1665/3306] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:24 2022] DELETE /identity/v3/users/2d7df9a6845440bbad5bd7c0a192171b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:11:24.677460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af283-ce8e-4c15-ba48-610796f6baa9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:24.677460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af283-ce8e-4c15-ba48-610796f6baa9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:24.677460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af283-ce8e-4c15-ba48-610796f6baa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:24.713191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a49af283-ce8e-4c15-ba48-610796f6baa9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:24.714830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a49af283-ce8e-4c15-ba48-610796f6baa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:24.856895 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1642/3307] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:24.878415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:24.879889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:25.017968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d87ae6-f442-42e0-ae4a-bc6b9ea2e45e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:25.026779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c311f42-e9be-4dc2-8622-1e25ce2d0e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:25.027521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311f42-e9be-4dc2-8622-1e25ce2d0e67 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:25.027805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311f42-e9be-4dc2-8622-1e25ce2d0e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:25.028068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311f42-e9be-4dc2-8622-1e25ce2d0e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:25.055255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c311f42-e9be-4dc2-8622-1e25ce2d0e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:25.056775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c311f42-e9be-4dc2-8622-1e25ce2d0e67 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:25.081155 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1666/3308] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:25.993738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49af283-ce8e-4c15-ba48-610796f6baa9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:25.997023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a49af283-ce8e-4c15-ba48-610796f6baa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:26.013230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49af283-ce8e-4c15-ba48-610796f6baa9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:26.021805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:26.022812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:26.023322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:26.023769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] PATH_INFO: `/v3/projects/abaf72f7fc7248a388dbfbd2b646dc56` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:26.027820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abaf72f7fc7248a388dbfbd2b646dc56)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:26.030134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:26.145846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abaf72f7fc7248a388dbfbd2b646dc56', 'request_id': 'req-4fa38c77-7462-43d8-b710-9bc5d1cf5056'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.162761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abaf72f7fc7248a388dbfbd2b646dc56', 'request_id': 'req-4fa38c77-7462-43d8-b710-9bc5d1cf5056'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.173022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abaf72f7fc7248a388dbfbd2b646dc56', 'request_id': 'req-4fa38c77-7462-43d8-b710-9bc5d1cf5056'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.175617 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:26.197262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] The token cache is being invalidate because project abaf72f7fc7248a388dbfbd2b646dc56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:26.197628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.199322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.203856 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1643/3309] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:25 2022] DELETE /identity/v3/projects/abaf72f7fc7248a388dbfbd2b646dc56 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:26.208308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:26.208558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c311f42-e9be-4dc2-8622-1e25ce2d0e67 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:26.210009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c311f42-e9be-4dc2-8622-1e25ce2d0e67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:26.210855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:26.252386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c311f42-e9be-4dc2-8622-1e25ce2d0e67 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:26.393525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa38c77-7462-43d8-b710-9bc5d1cf5056 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:26.412373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544f5bb-661e-42f5-9bce-047ff214872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:26.413228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544f5bb-661e-42f5-9bce-047ff214872a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:26.417923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544f5bb-661e-42f5-9bce-047ff214872a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:26.418839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544f5bb-661e-42f5-9bce-047ff214872a admin admin] PATH_INFO: `/v3/users/3daa6ccee90c41b9993e90458cecf35d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:26.423576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544f5bb-661e-42f5-9bce-047ff214872a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3daa6ccee90c41b9993e90458cecf35d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:26.423576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544f5bb-661e-42f5-9bce-047ff214872a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:26.430411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2264060-f179-4310-ac78-82ec6e02bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:26.439154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2264060-f179-4310-ac78-82ec6e02bc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:26.439962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2264060-f179-4310-ac78-82ec6e02bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:26.441287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2264060-f179-4310-ac78-82ec6e02bc57 admin admin] PATH_INFO: `/v3/projects/d1b47b2269ae43d58842e61b7b0de759` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:26.444563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2264060-f179-4310-ac78-82ec6e02bc57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b47b2269ae43d58842e61b7b0de759)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:26.449393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2264060-f179-4310-ac78-82ec6e02bc57 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:26.601991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2544f5bb-661e-42f5-9bce-047ff214872a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3daa6ccee90c41b9993e90458cecf35d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.602831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2544f5bb-661e-42f5-9bce-047ff214872a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3daa6ccee90c41b9993e90458cecf35d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.663752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b2264060-f179-4310-ac78-82ec6e02bc57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b47b2269ae43d58842e61b7b0de759', 'request_id': 'req-b2264060-f179-4310-ac78-82ec6e02bc57'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.673445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2544f5bb-661e-42f5-9bce-047ff214872a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3daa6ccee90c41b9993e90458cecf35d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.689260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b2264060-f179-4310-ac78-82ec6e02bc57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b47b2269ae43d58842e61b7b0de759', 'request_id': 'req-b2264060-f179-4310-ac78-82ec6e02bc57'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.703623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2544f5bb-661e-42f5-9bce-047ff214872a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3daa6ccee90c41b9993e90458cecf35d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.707415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2544f5bb-661e-42f5-9bce-047ff214872a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3daa6ccee90c41b9993e90458cecf35d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.726798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b2264060-f179-4310-ac78-82ec6e02bc57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b47b2269ae43d58842e61b7b0de759', 'request_id': 'req-b2264060-f179-4310-ac78-82ec6e02bc57'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.749279 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1644/3310] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:26 2022] DELETE /identity/v3/users/3daa6ccee90c41b9993e90458cecf35d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:26.773174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b2264060-f179-4310-ac78-82ec6e02bc57 admin admin] The token cache is being invalidate because project d1b47b2269ae43d58842e61b7b0de759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:26.773755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b2264060-f179-4310-ac78-82ec6e02bc57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.774588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b2264060-f179-4310-ac78-82ec6e02bc57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:26.776452 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1667/3311] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:26 2022] DELETE /identity/v3/projects/d1b47b2269ae43d58842e61b7b0de759 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:26.781430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54038b2-a266-4689-a25b-29c047532eea None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:26.781924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54038b2-a266-4689-a25b-29c047532eea None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:26.782370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54038b2-a266-4689-a25b-29c047532eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:26.835541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d54038b2-a266-4689-a25b-29c047532eea None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:26.836785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d54038b2-a266-4689-a25b-29c047532eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:27.023812 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1645/3312] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:11:27.025424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845c052-2fc6-4aab-8729-8440b3c3f331 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:27.025714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845c052-2fc6-4aab-8729-8440b3c3f331 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:27.026033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845c052-2fc6-4aab-8729-8440b3c3f331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:27.063327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2845c052-2fc6-4aab-8729-8440b3c3f331 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:27.064554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2845c052-2fc6-4aab-8729-8440b3c3f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:27.103146 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1668/3313] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:27.105220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54038b2-a266-4689-a25b-29c047532eea None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:27.114172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845c052-2fc6-4aab-8729-8440b3c3f331 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:27.117380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54038b2-a266-4689-a25b-29c047532eea None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:27.118772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2845c052-2fc6-4aab-8729-8440b3c3f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:27.138932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543a71b-ca74-4f13-ac53-b60836f1228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:27.139766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543a71b-ca74-4f13-ac53-b60836f1228a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:27.143995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543a71b-ca74-4f13-ac53-b60836f1228a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:27.144396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543a71b-ca74-4f13-ac53-b60836f1228a admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:27.144544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845c052-2fc6-4aab-8729-8440b3c3f331 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:27.146886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543a71b-ca74-4f13-ac53-b60836f1228a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:11:27.147338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543a71b-ca74-4f13-ac53-b60836f1228a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:27.152052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543a71b-ca74-4f13-ac53-b60836f1228a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:27.158794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d02c-b638-4494-b9eb-a86efc178069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:27.159400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d02c-b638-4494-b9eb-a86efc178069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:27.159679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d02c-b638-4494-b9eb-a86efc178069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:27.160142 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:27.160546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d02c-b638-4494-b9eb-a86efc178069 admin admin] PATH_INFO: `/v3/projects/24362bc2011d4ef09104a7375df177e7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:27.161770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44d02c-b638-4494-b9eb-a86efc178069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24362bc2011d4ef09104a7375df177e7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:27.163868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44d02c-b638-4494-b9eb-a86efc178069 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:27.171527 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:27.188768 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1646/3314] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:11:27.189890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543a71b-ca74-4f13-ac53-b60836f1228a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:27.230984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543a71b-ca74-4f13-ac53-b60836f1228a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:27.259436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc44d02c-b638-4494-b9eb-a86efc178069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24362bc2011d4ef09104a7375df177e7', 'request_id': 'req-cc44d02c-b638-4494-b9eb-a86efc178069'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:27.272874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc44d02c-b638-4494-b9eb-a86efc178069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24362bc2011d4ef09104a7375df177e7', 'request_id': 'req-cc44d02c-b638-4494-b9eb-a86efc178069'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:27.286347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc44d02c-b638-4494-b9eb-a86efc178069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24362bc2011d4ef09104a7375df177e7', 'request_id': 'req-cc44d02c-b638-4494-b9eb-a86efc178069'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:27.309701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc44d02c-b638-4494-b9eb-a86efc178069 admin admin] The token cache is being invalidate because project 24362bc2011d4ef09104a7375df177e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:27.310239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc44d02c-b638-4494-b9eb-a86efc178069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:27.315276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc44d02c-b638-4494-b9eb-a86efc178069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:27.317376 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1669/3315] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:27 2022] DELETE /identity/v3/projects/24362bc2011d4ef09104a7375df177e7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:27.322551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e00b99-f316-4b6b-b1c4-b4e98715fbf5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:27.323199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e00b99-f316-4b6b-b1c4-b4e98715fbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:27.323719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e00b99-f316-4b6b-b1c4-b4e98715fbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:27.364019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-99e00b99-f316-4b6b-b1c4-b4e98715fbf5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:27.369484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-99e00b99-f316-4b6b-b1c4-b4e98715fbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:27.433826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f77b6-e78f-4e7a-b217-a888fcd6e960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:27.434607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f77b6-e78f-4e7a-b217-a888fcd6e960 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:27.435600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f77b6-e78f-4e7a-b217-a888fcd6e960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:27.437268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f77b6-e78f-4e7a-b217-a888fcd6e960 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:27.439016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f77b6-e78f-4e7a-b217-a888fcd6e960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:27.443920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f77b6-e78f-4e7a-b217-a888fcd6e960 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:27.506190 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1670/3316] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:27.507903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893445c9-cc02-4679-97f7-842b04658b4c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:27.508240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893445c9-cc02-4679-97f7-842b04658b4c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:27.508516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893445c9-cc02-4679-97f7-842b04658b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:27.518032 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1647/3317] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:11:27 2022] POST /identity/v3/projects => generated 377 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:27.519458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f77b6-e78f-4e7a-b217-a888fcd6e960 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:27.521844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fc9f77b6-e78f-4e7a-b217-a888fcd6e960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:27.531706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-893445c9-cc02-4679-97f7-842b04658b4c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:27.533112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-893445c9-cc02-4679-97f7-842b04658b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:27.706380 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1671/3318] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:27.711225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893445c9-cc02-4679-97f7-842b04658b4c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:27.739218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893445c9-cc02-4679-97f7-842b04658b4c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:27.745102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988aea8e-ae49-4805-a6a8-eccec56a2037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:27.746074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aea8e-ae49-4805-a6a8-eccec56a2037 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:27.746501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aea8e-ae49-4805-a6a8-eccec56a2037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:27.747040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aea8e-ae49-4805-a6a8-eccec56a2037 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:27.747850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aea8e-ae49-4805-a6a8-eccec56a2037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:11:27.748453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aea8e-ae49-4805-a6a8-eccec56a2037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:27.750271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aea8e-ae49-4805-a6a8-eccec56a2037 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:27.754088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f77b6-e78f-4e7a-b217-a888fcd6e960 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:27.771490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164fb8f-a4d2-4bfa-9e39-5ad0f2205386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:27.772129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164fb8f-a4d2-4bfa-9e39-5ad0f2205386 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:27.772410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164fb8f-a4d2-4bfa-9e39-5ad0f2205386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:27.772684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164fb8f-a4d2-4bfa-9e39-5ad0f2205386 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:27.773325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164fb8f-a4d2-4bfa-9e39-5ad0f2205386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:27.775327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164fb8f-a4d2-4bfa-9e39-5ad0f2205386 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:27.803199 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1672/3319] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:11:27.807948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988aea8e-ae49-4805-a6a8-eccec56a2037 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:27.816337 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1648/3320] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:11:27 2022] POST /identity/v3/users => generated 289 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:27.817824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164fb8f-a4d2-4bfa-9e39-5ad0f2205386 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:27.836365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164fb8f-a4d2-4bfa-9e39-5ad0f2205386 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:27.839419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988aea8e-ae49-4805-a6a8-eccec56a2037 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:27.842428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ef75c-f181-4169-8e21-4f91c673bfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:27.843021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ef75c-f181-4169-8e21-4f91c673bfec admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:27.843021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ef75c-f181-4169-8e21-4f91c673bfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:27.843349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ef75c-f181-4169-8e21-4f91c673bfec admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:27.844049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ef75c-f181-4169-8e21-4f91c673bfec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:27.846056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ef75c-f181-4169-8e21-4f91c673bfec admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:27.854793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f48817-f82f-4e91-a168-90a647788d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:27.856061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f48817-f82f-4e91-a168-90a647788d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:27.856483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f48817-f82f-4e91-a168-90a647788d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:27.857099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f48817-f82f-4e91-a168-90a647788d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:27.861995 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1649/3321] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:11:27.863060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f48817-f82f-4e91-a168-90a647788d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:27.865611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f48817-f82f-4e91-a168-90a647788d27 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:27.868115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ef75c-f181-4169-8e21-4f91c673bfec admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:27.893150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ef75c-f181-4169-8e21-4f91c673bfec admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:27.914288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a75495-f056-4f46-8c8f-afc24f063a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:27.915478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a75495-f056-4f46-8c8f-afc24f063a5f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:27.915778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a75495-f056-4f46-8c8f-afc24f063a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:27.919918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a75495-f056-4f46-8c8f-afc24f063a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:27.920736 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:27.922904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a75495-f056-4f46-8c8f-afc24f063a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:27.928958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a75495-f056-4f46-8c8f-afc24f063a5f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:27.945748 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1673/3322] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:11:27 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:27.951996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f48817-f82f-4e91-a168-90a647788d27 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:27.958853 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1650/3323] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:27.959232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a75495-f056-4f46-8c8f-afc24f063a5f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:27.959472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-55f48817-f82f-4e91-a168-90a647788d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:27.985347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a75495-f056-4f46-8c8f-afc24f063a5f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:28.135959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f48817-f82f-4e91-a168-90a647788d27 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:28.146990 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:28.149275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173fa44-7bbd-488f-84fd-71e8a715008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:28.150359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173fa44-7bbd-488f-84fd-71e8a715008b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:28.150359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173fa44-7bbd-488f-84fd-71e8a715008b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:28.150563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173fa44-7bbd-488f-84fd-71e8a715008b admin admin] PATH_INFO: `/v3/users/0a7ca896a35447f8a828817a8620d308` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:28.154792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173fa44-7bbd-488f-84fd-71e8a715008b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7ca896a35447f8a828817a8620d308)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:28.157062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173fa44-7bbd-488f-84fd-71e8a715008b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:28.183671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee9bf5-6108-475d-bbd5-c4eaa0ebd7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:28.184213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee9bf5-6108-475d-bbd5-c4eaa0ebd7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:28.185116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee9bf5-6108-475d-bbd5-c4eaa0ebd7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:28.185397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee9bf5-6108-475d-bbd5-c4eaa0ebd7e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:28.186046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee9bf5-6108-475d-bbd5-c4eaa0ebd7e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:28.188223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee9bf5-6108-475d-bbd5-c4eaa0ebd7e8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:28.247517 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1651/3324] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:11:27 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:28.248566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee9bf5-6108-475d-bbd5-c4eaa0ebd7e8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:28.271967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee9bf5-6108-475d-bbd5-c4eaa0ebd7e8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:28.283507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45dfae-aadb-4520-ac8f-2a51e65a9fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:28.286267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45dfae-aadb-4520-ac8f-2a51e65a9fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:28.286267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45dfae-aadb-4520-ac8f-2a51e65a9fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:28.286267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45dfae-aadb-4520-ac8f-2a51e65a9fe6 admin admin] PATH_INFO: `/v3/projects/61f3c40ffaff4643896b3dfbedada1a7/users/ac5b287a0e084b4d8e0480cd177e1eaa/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:28.318482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a173fa44-7bbd-488f-84fd-71e8a715008b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7ca896a35447f8a828817a8620d308'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:28.319124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45dfae-aadb-4520-ac8f-2a51e65a9fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f3c40ffaff4643896b3dfbedada1a7, user_id=ac5b287a0e084b4d8e0480cd177e1eaa, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:28.320607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a173fa44-7bbd-488f-84fd-71e8a715008b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7ca896a35447f8a828817a8620d308'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:28.351959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45dfae-aadb-4520-ac8f-2a51e65a9fe6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:28.379552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a173fa44-7bbd-488f-84fd-71e8a715008b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7ca896a35447f8a828817a8620d308'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:28.382347 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1652/3325] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:11:28 2022] PUT /identity/v3/projects/61f3c40ffaff4643896b3dfbedada1a7/users/ac5b287a0e084b4d8e0480cd177e1eaa/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:28.383412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45dfae-aadb-4520-ac8f-2a51e65a9fe6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:28.394845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ad45dfae-aadb-4520-ac8f-2a51e65a9fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:28.412360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a173fa44-7bbd-488f-84fd-71e8a715008b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7ca896a35447f8a828817a8620d308'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:28.413747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a173fa44-7bbd-488f-84fd-71e8a715008b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7ca896a35447f8a828817a8620d308'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:28.473742 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1674/3326] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:27 2022] DELETE /identity/v3/users/0a7ca896a35447f8a828817a8620d308 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:28.477508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47108-f7c3-41f9-8a8a-1882a7f23a72 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:28.480706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47108-f7c3-41f9-8a8a-1882a7f23a72 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:28.481253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47108-f7c3-41f9-8a8a-1882a7f23a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:28.539056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-87d47108-f7c3-41f9-8a8a-1882a7f23a72 None None] MFA Rules not processed for user `ac5b287a0e084b4d8e0480cd177e1eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:28.545061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-87d47108-f7c3-41f9-8a8a-1882a7f23a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:28.555702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45dfae-aadb-4520-ac8f-2a51e65a9fe6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:28.702113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46b8cf-8d1e-4ef6-8a37-73128df8bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:28.702803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46b8cf-8d1e-4ef6-8a37-73128df8bfb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:28.703211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46b8cf-8d1e-4ef6-8a37-73128df8bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:28.703571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46b8cf-8d1e-4ef6-8a37-73128df8bfb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:28.704294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46b8cf-8d1e-4ef6-8a37-73128df8bfb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:28.706733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46b8cf-8d1e-4ef6-8a37-73128df8bfb4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:28.720704 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1653/3327] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:28.726271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46b8cf-8d1e-4ef6-8a37-73128df8bfb4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:28.728387 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1675/3328] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:28.744011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47108-f7c3-41f9-8a8a-1882a7f23a72 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:28.747917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-87d47108-f7c3-41f9-8a8a-1882a7f23a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:28.758467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46b8cf-8d1e-4ef6-8a37-73128df8bfb4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:28.787702 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:28.795545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851416f0-c682-4d06-ae05-3e65f5b4fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:28.796169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851416f0-c682-4d06-ae05-3e65f5b4fcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:28.796447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851416f0-c682-4d06-ae05-3e65f5b4fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:28.796719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851416f0-c682-4d06-ae05-3e65f5b4fcc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:28.797370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851416f0-c682-4d06-ae05-3e65f5b4fcc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:28.799026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851416f0-c682-4d06-ae05-3e65f5b4fcc9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:28.822363 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1654/3329] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:28.826632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851416f0-c682-4d06-ae05-3e65f5b4fcc9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:28.855818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851416f0-c682-4d06-ae05-3e65f5b4fcc9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:28.872751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe8c9f-def7-40bd-82d6-71d52756aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:28.873438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe8c9f-def7-40bd-82d6-71d52756aff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:28.873720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe8c9f-def7-40bd-82d6-71d52756aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:28.873996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe8c9f-def7-40bd-82d6-71d52756aff6 admin admin] PATH_INFO: `/v3/projects/b8fc396554c84269805db99beff5e471/users/cdbd559440454d2f82801ee6bbe280c0/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:28.908396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe8c9f-def7-40bd-82d6-71d52756aff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8fc396554c84269805db99beff5e471, user_id=cdbd559440454d2f82801ee6bbe280c0, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:28.910772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe8c9f-def7-40bd-82d6-71d52756aff6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:28.914398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47108-f7c3-41f9-8a8a-1882a7f23a72 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:28.919865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe3761-fe38-4919-9b17-5657b1cad413 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:28.920493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3761-fe38-4919-9b17-5657b1cad413 service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:28.920967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3761-fe38-4919-9b17-5657b1cad413 service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:28.922059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3761-fe38-4919-9b17-5657b1cad413 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:28.939249 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1655/3330] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:11:28 2022] PUT /identity/v3/projects/b8fc396554c84269805db99beff5e471/users/cdbd559440454d2f82801ee6bbe280c0/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:11:28.948254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe3761-fe38-4919-9b17-5657b1cad413 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:28.950335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0fd19-b65e-4614-867a-c9070c4c7692 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:28.950829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0fd19-b65e-4614-867a-c9070c4c7692 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:28.951474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0fd19-b65e-4614-867a-c9070c4c7692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:28.957393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe3761-fe38-4919-9b17-5657b1cad413 service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:29.002712 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1676/3331] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:29.005412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe3761-fe38-4919-9b17-5657b1cad413 service glance] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:29.006909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-48fe3761-fe38-4919-9b17-5657b1cad413 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:29.039833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-22e0fd19-b65e-4614-867a-c9070c4c7692 None None] MFA Rules not processed for user `cdbd559440454d2f82801ee6bbe280c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:29.041468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-22e0fd19-b65e-4614-867a-c9070c4c7692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:29.047350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe3761-fe38-4919-9b17-5657b1cad413 service glance] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:29.065822 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:29.170926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:29.189530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:29.189815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:29.191450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] PATH_INFO: `/v3/projects/f9416837a51e484094dba1a296c4d096` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:29.191708 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1656/3332] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:29.194035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9416837a51e484094dba1a296c4d096)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:29.196816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0fd19-b65e-4614-867a-c9070c4c7692 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:29.202564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:29.228670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0fd19-b65e-4614-867a-c9070c4c7692 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:29.240791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ff816-c805-4c05-b7a9-82718b314301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:29.243199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ff816-c805-4c05-b7a9-82718b314301 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:29.244779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ff816-c805-4c05-b7a9-82718b314301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:29.245629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ff816-c805-4c05-b7a9-82718b314301 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:29.247159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ff816-c805-4c05-b7a9-82718b314301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:29.252037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ff816-c805-4c05-b7a9-82718b314301 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:29.306053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9416837a51e484094dba1a296c4d096', 'request_id': 'req-4c9e35e2-36b0-4275-8b81-2220315e736d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:29.312838 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1657/3333] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:11:29 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:29.315980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9416837a51e484094dba1a296c4d096', 'request_id': 'req-4c9e35e2-36b0-4275-8b81-2220315e736d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:29.318705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c4d26-7cda-40c2-9193-39334f45da99 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:29.319273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c4d26-7cda-40c2-9193-39334f45da99 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:29.321661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c4d26-7cda-40c2-9193-39334f45da99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:29.329185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9416837a51e484094dba1a296c4d096', 'request_id': 'req-4c9e35e2-36b0-4275-8b81-2220315e736d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:29.348608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] The token cache is being invalidate because project f9416837a51e484094dba1a296c4d096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:29.349047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:29.349939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:29.352150 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1677/3334] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:29 2022] DELETE /identity/v3/projects/f9416837a51e484094dba1a296c4d096 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:29.352984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:29.354506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:29.371440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e65c4d26-7cda-40c2-9193-39334f45da99 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:29.374820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e65c4d26-7cda-40c2-9193-39334f45da99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:29.429004 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:29.467125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e35e2-36b0-4275-8b81-2220315e736d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:29.480509 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1658/3335] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:11:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:29.481889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a68f2-9082-48ce-8740-71fbd9885197 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:29.482281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a68f2-9082-48ce-8740-71fbd9885197 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:29.482683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a68f2-9082-48ce-8740-71fbd9885197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:29.516567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a71a68f2-9082-48ce-8740-71fbd9885197 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:29.518038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a71a68f2-9082-48ce-8740-71fbd9885197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:29.560314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0277b5-03fe-41b4-a4cb-2866d53bc030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:29.560949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0277b5-03fe-41b4-a4cb-2866d53bc030 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:29.561223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0277b5-03fe-41b4-a4cb-2866d53bc030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:29.561489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0277b5-03fe-41b4-a4cb-2866d53bc030 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:29.562252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0277b5-03fe-41b4-a4cb-2866d53bc030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:29.567739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0277b5-03fe-41b4-a4cb-2866d53bc030 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:29.618299 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1678/3336] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:11:29 2022] POST /identity/v3/users => generated 303 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:29.620254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0277b5-03fe-41b4-a4cb-2866d53bc030 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:29.627168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1c0277b5-03fe-41b4-a4cb-2866d53bc030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:29.640115 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1659/3337] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:29.641104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a68f2-9082-48ce-8740-71fbd9885197 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:29.651786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a68f2-9082-48ce-8740-71fbd9885197 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:29.658370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f36f4e-ada9-461f-a7db-94b3b102b22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:29.659180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f36f4e-ada9-461f-a7db-94b3b102b22d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:29.659570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f36f4e-ada9-461f-a7db-94b3b102b22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:29.659951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f36f4e-ada9-461f-a7db-94b3b102b22d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:29.660709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f36f4e-ada9-461f-a7db-94b3b102b22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:29.662427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f36f4e-ada9-461f-a7db-94b3b102b22d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:29.675458 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1660/3338] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:29.680458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f96540-d3a7-49e3-a768-463afc2f0765 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:29.683201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f96540-d3a7-49e3-a768-463afc2f0765 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:29.683201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f96540-d3a7-49e3-a768-463afc2f0765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:29.712929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-65f96540-d3a7-49e3-a768-463afc2f0765 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:29.715455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-65f96540-d3a7-49e3-a768-463afc2f0765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:29.737895 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1661/3339] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:29.740182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f96540-d3a7-49e3-a768-463afc2f0765 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:29.755774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f96540-d3a7-49e3-a768-463afc2f0765 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:29.776335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddfa2a-91b3-4367-9522-b3ea926888ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:29.777025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddfa2a-91b3-4367-9522-b3ea926888ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:29.777307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddfa2a-91b3-4367-9522-b3ea926888ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:29.777585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddfa2a-91b3-4367-9522-b3ea926888ee admin admin] PATH_INFO: `/v3/projects/3ea7b21e3f594fdf938b3e1a1edcd835/users/a916d3edd02444c3ba0ac1905f1bc6bf/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:29.792251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0277b5-03fe-41b4-a4cb-2866d53bc030 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:29.798527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408820ba-160b-4fa9-adc9-f110063ca182 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:29.799205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408820ba-160b-4fa9-adc9-f110063ca182 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:29.799483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408820ba-160b-4fa9-adc9-f110063ca182 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:29.799754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408820ba-160b-4fa9-adc9-f110063ca182 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:29.812312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddfa2a-91b3-4367-9522-b3ea926888ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea7b21e3f594fdf938b3e1a1edcd835, user_id=a916d3edd02444c3ba0ac1905f1bc6bf, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:29.815106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408820ba-160b-4fa9-adc9-f110063ca182 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:29.815523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddfa2a-91b3-4367-9522-b3ea926888ee admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:29.816840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408820ba-160b-4fa9-adc9-f110063ca182 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:29.818263 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:29.830293 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1679/3340] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:11:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:29.831310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408820ba-160b-4fa9-adc9-f110063ca182 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:29.846589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408820ba-160b-4fa9-adc9-f110063ca182 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:29.849491 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1662/3341] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:11:29 2022] PUT /identity/v3/projects/3ea7b21e3f594fdf938b3e1a1edcd835/users/a916d3edd02444c3ba0ac1905f1bc6bf/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:29.855502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddfa2a-91b3-4367-9522-b3ea926888ee admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:29.974530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c71507-07eb-4152-a6b8-8af88cbcbf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:29.980275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c71507-07eb-4152-a6b8-8af88cbcbf23 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:29.980691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c71507-07eb-4152-a6b8-8af88cbcbf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:29.983237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c71507-07eb-4152-a6b8-8af88cbcbf23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:29.984742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c71507-07eb-4152-a6b8-8af88cbcbf23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:11:29.985803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c71507-07eb-4152-a6b8-8af88cbcbf23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:29.990475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c71507-07eb-4152-a6b8-8af88cbcbf23 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:30.021267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddfa2a-91b3-4367-9522-b3ea926888ee admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:30.035380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985e636-0e62-4851-ab16-587e79d8496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:30.037174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985e636-0e62-4851-ab16-587e79d8496f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:30.038521 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:30.039275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985e636-0e62-4851-ab16-587e79d8496f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:30.039565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985e636-0e62-4851-ab16-587e79d8496f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:30.043552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985e636-0e62-4851-ab16-587e79d8496f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:30.048821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985e636-0e62-4851-ab16-587e79d8496f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:30.053260 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1680/3342] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:11:30.054028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c71507-07eb-4152-a6b8-8af88cbcbf23 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:30.073280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c71507-07eb-4152-a6b8-8af88cbcbf23 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:30.079481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99f473-1fd0-43ae-a625-9390ac072934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:30.080434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99f473-1fd0-43ae-a625-9390ac072934 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:30.080719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99f473-1fd0-43ae-a625-9390ac072934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:30.080998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99f473-1fd0-43ae-a625-9390ac072934 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:30.081636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99f473-1fd0-43ae-a625-9390ac072934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:30.083716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99f473-1fd0-43ae-a625-9390ac072934 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:30.083897 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1663/3343] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:11:30.087378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985e636-0e62-4851-ab16-587e79d8496f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:30.108800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985e636-0e62-4851-ab16-587e79d8496f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:30.131092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d4d1b-1e26-457c-86c6-86b9326f3270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:30.132478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d4d1b-1e26-457c-86c6-86b9326f3270 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:30.132478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d4d1b-1e26-457c-86c6-86b9326f3270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:30.132478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d4d1b-1e26-457c-86c6-86b9326f3270 admin admin] PATH_INFO: `/v3/projects/3ea7b21e3f594fdf938b3e1a1edcd835/users/a916d3edd02444c3ba0ac1905f1bc6bf/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:30.134230 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1681/3344] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:11:30 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:30.138734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99f473-1fd0-43ae-a625-9390ac072934 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:30.146707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d4d1b-1e26-457c-86c6-86b9326f3270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea7b21e3f594fdf938b3e1a1edcd835, user_id=a916d3edd02444c3ba0ac1905f1bc6bf, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:30.149878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d4d1b-1e26-457c-86c6-86b9326f3270 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:30.186636 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1664/3345] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:11:30 2022] PUT /identity/v3/projects/3ea7b21e3f594fdf938b3e1a1edcd835/users/a916d3edd02444c3ba0ac1905f1bc6bf/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:30.199091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed72a75-9be2-4354-adf5-07eee2337a66 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:30.199766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed72a75-9be2-4354-adf5-07eee2337a66 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:30.199766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed72a75-9be2-4354-adf5-07eee2337a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:30.268690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bed72a75-9be2-4354-adf5-07eee2337a66 None None] MFA Rules not processed for user `a916d3edd02444c3ba0ac1905f1bc6bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:30.270031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bed72a75-9be2-4354-adf5-07eee2337a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:30.342430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99f473-1fd0-43ae-a625-9390ac072934 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:30.419529 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1665/3346] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:30.429979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cea9c1-8ad9-4979-9bc2-3d268d5bf932 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:30.430312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cea9c1-8ad9-4979-9bc2-3d268d5bf932 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:30.430656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cea9c1-8ad9-4979-9bc2-3d268d5bf932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:30.458592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-66cea9c1-8ad9-4979-9bc2-3d268d5bf932 None None] MFA Rules not processed for user `cdbd559440454d2f82801ee6bbe280c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:30.460181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-66cea9c1-8ad9-4979-9bc2-3d268d5bf932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:30.461530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e292a6-cb72-49d8-befe-56b2158f58d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:30.462615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e292a6-cb72-49d8-befe-56b2158f58d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:30.463996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e292a6-cb72-49d8-befe-56b2158f58d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:30.464520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e292a6-cb72-49d8-befe-56b2158f58d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:30.465883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e292a6-cb72-49d8-befe-56b2158f58d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:30.468139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e292a6-cb72-49d8-befe-56b2158f58d0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:30.498371 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1682/3347] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:11:30 2022] POST /identity/v3/users => generated 287 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:30.503597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e292a6-cb72-49d8-befe-56b2158f58d0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:30.542611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e292a6-cb72-49d8-befe-56b2158f58d0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:30.563769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b253ee-f591-4b24-b724-4a69e5ac243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:30.566499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b253ee-f591-4b24-b724-4a69e5ac243a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:30.568426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b253ee-f591-4b24-b724-4a69e5ac243a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:30.568953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b253ee-f591-4b24-b724-4a69e5ac243a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:30.570135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b253ee-f591-4b24-b724-4a69e5ac243a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:30.582811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b253ee-f591-4b24-b724-4a69e5ac243a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:30.607991 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1683/3348] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:11:30.608851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b253ee-f591-4b24-b724-4a69e5ac243a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:30.619524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b253ee-f591-4b24-b724-4a69e5ac243a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:30.625003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfa782-24cd-44ac-95ef-60914d8cf660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:30.625615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfa782-24cd-44ac-95ef-60914d8cf660 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:30.625894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfa782-24cd-44ac-95ef-60914d8cf660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:30.626170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfa782-24cd-44ac-95ef-60914d8cf660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:30.626813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfa782-24cd-44ac-95ef-60914d8cf660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:30.628459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfa782-24cd-44ac-95ef-60914d8cf660 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:30.644744 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1684/3349] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:30.648807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfa782-24cd-44ac-95ef-60914d8cf660 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:30.656046 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1666/3350] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:30.664005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfa782-24cd-44ac-95ef-60914d8cf660 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:30.668783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cea9c1-8ad9-4979-9bc2-3d268d5bf932 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:30.669937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad205b9-83f4-4cdc-a8d1-4f107b38d035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:30.670153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-66cea9c1-8ad9-4979-9bc2-3d268d5bf932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:30.670643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad205b9-83f4-4cdc-a8d1-4f107b38d035 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:30.670874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad205b9-83f4-4cdc-a8d1-4f107b38d035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:30.671192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad205b9-83f4-4cdc-a8d1-4f107b38d035 admin admin] PATH_INFO: `/v3/projects/54913c9d843e43c4b0d5b1c4a78a0e70/users/e9f13f7cba4342aba47cd3e5f4b19e2a/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:30.685381 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:30.691753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad205b9-83f4-4cdc-a8d1-4f107b38d035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54913c9d843e43c4b0d5b1c4a78a0e70, user_id=e9f13f7cba4342aba47cd3e5f4b19e2a, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:30.701833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad205b9-83f4-4cdc-a8d1-4f107b38d035 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:30.737442 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1685/3351] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:11:30 2022] PUT /identity/v3/projects/54913c9d843e43c4b0d5b1c4a78a0e70/users/e9f13f7cba4342aba47cd3e5f4b19e2a/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:11:30.750786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62003ac-e3db-4f1f-b225-dacc47b95a6a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:30.751235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62003ac-e3db-4f1f-b225-dacc47b95a6a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:30.751606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62003ac-e3db-4f1f-b225-dacc47b95a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:30.807057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b62003ac-e3db-4f1f-b225-dacc47b95a6a None None] MFA Rules not processed for user `e9f13f7cba4342aba47cd3e5f4b19e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:30.812772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b62003ac-e3db-4f1f-b225-dacc47b95a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:30.830051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cea9c1-8ad9-4979-9bc2-3d268d5bf932 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:30.851047 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:30.968036 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1686/3352] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:30.990880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8107c-ab7d-4299-abd2-b0ce08dc4622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:30.991538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8107c-ab7d-4299-abd2-b0ce08dc4622 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:30.991817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8107c-ab7d-4299-abd2-b0ce08dc4622 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:30.992293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8107c-ab7d-4299-abd2-b0ce08dc4622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:30.997212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a5e8107c-ab7d-4299-abd2-b0ce08dc4622 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:31.107021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8107c-ab7d-4299-abd2-b0ce08dc4622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:31.108978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8107c-ab7d-4299-abd2-b0ce08dc4622 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:31.123696 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1667/3353] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:31.425358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62003ac-e3db-4f1f-b225-dacc47b95a6a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:31.443371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62003ac-e3db-4f1f-b225-dacc47b95a6a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:31.460985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ec435-130c-4cbf-a0c3-6b5993f32a2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:31.461766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ec435-130c-4cbf-a0c3-6b5993f32a2c service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:31.462150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ec435-130c-4cbf-a0c3-6b5993f32a2c service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:31.462565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ec435-130c-4cbf-a0c3-6b5993f32a2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:31.508952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ec435-130c-4cbf-a0c3-6b5993f32a2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:31.512229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ec435-130c-4cbf-a0c3-6b5993f32a2c service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:31.563135 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1687/3354] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:34.497141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8babc-4102-4219-bb6b-e0b4b5d48dcd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:34.498038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8babc-4102-4219-bb6b-e0b4b5d48dcd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:34.498324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8babc-4102-4219-bb6b-e0b4b5d48dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:34.555529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bff8babc-4102-4219-bb6b-e0b4b5d48dcd None None] MFA Rules not processed for user `17f95d77e66946ce9ac525cc34c61d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:34.557532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bff8babc-4102-4219-bb6b-e0b4b5d48dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:34.563690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ec435-130c-4cbf-a0c3-6b5993f32a2c service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:34.567659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d13ec435-130c-4cbf-a0c3-6b5993f32a2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:34.653655 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:34.690522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ec435-130c-4cbf-a0c3-6b5993f32a2c service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:34.695984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490d020-8b58-4336-ae47-38298328090a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:34.696505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490d020-8b58-4336-ae47-38298328090a service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:34.696781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490d020-8b58-4336-ae47-38298328090a service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:34.697055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490d020-8b58-4336-ae47-38298328090a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:34.707752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8490d020-8b58-4336-ae47-38298328090a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:34.739258 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1668/3355] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:34.839097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490d020-8b58-4336-ae47-38298328090a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:34.840940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490d020-8b58-4336-ae47-38298328090a service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:34.858550 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1688/3356] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:34.871186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8babc-4102-4219-bb6b-e0b4b5d48dcd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:34.873469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bff8babc-4102-4219-bb6b-e0b4b5d48dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:34.907548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8babc-4102-4219-bb6b-e0b4b5d48dcd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:34.929780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef26c1d-e2a3-4e0b-8b71-7da3a8238e37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:34.930602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef26c1d-e2a3-4e0b-8b71-7da3a8238e37 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:34.931187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef26c1d-e2a3-4e0b-8b71-7da3a8238e37 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:34.931674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef26c1d-e2a3-4e0b-8b71-7da3a8238e37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:34.947113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef26c1d-e2a3-4e0b-8b71-7da3a8238e37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:34.949667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef26c1d-e2a3-4e0b-8b71-7da3a8238e37 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:34.978764 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1669/3357] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:35.860047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec7f3-154d-4bce-a370-200728f1ff55 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:35.860555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec7f3-154d-4bce-a370-200728f1ff55 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:35.860998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec7f3-154d-4bce-a370-200728f1ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:35.979102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a14ec7f3-154d-4bce-a370-200728f1ff55 None None] MFA Rules not processed for user `17f95d77e66946ce9ac525cc34c61d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:35.985385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a14ec7f3-154d-4bce-a370-200728f1ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:36.018364 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1689/3358] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:36.549531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef26c1d-e2a3-4e0b-8b71-7da3a8238e37 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:36.565143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef26c1d-e2a3-4e0b-8b71-7da3a8238e37 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:36.575222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c20eef-f20a-4412-8e8b-6e34b94979b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:36.576414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c20eef-f20a-4412-8e8b-6e34b94979b1 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:36.576907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c20eef-f20a-4412-8e8b-6e34b94979b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:36.577397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c20eef-f20a-4412-8e8b-6e34b94979b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:36.796057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c20eef-f20a-4412-8e8b-6e34b94979b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:36.814508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c20eef-f20a-4412-8e8b-6e34b94979b1 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:36.848706 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1670/3359] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:36 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:36.951875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ec7f3-154d-4bce-a370-200728f1ff55 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:36.955148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a14ec7f3-154d-4bce-a370-200728f1ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:37.006010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ec7f3-154d-4bce-a370-200728f1ff55 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:37.025230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb9ae8-7fe7-41be-bd99-65c324cc30ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:37.030215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb9ae8-7fe7-41be-bd99-65c324cc30ff service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:37.031584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb9ae8-7fe7-41be-bd99-65c324cc30ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:37.032203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb9ae8-7fe7-41be-bd99-65c324cc30ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:37.039610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6ddb9ae8-7fe7-41be-bd99-65c324cc30ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:37.063560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb9ae8-7fe7-41be-bd99-65c324cc30ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:37.065365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb9ae8-7fe7-41be-bd99-65c324cc30ff service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:37.082411 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1690/3360] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:37.722739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c20eef-f20a-4412-8e8b-6e34b94979b1 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:37.903424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c20eef-f20a-4412-8e8b-6e34b94979b1 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:37.910266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:37.911184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:37.911760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:37.912324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] PATH_INFO: `/v3/users/e9f13f7cba4342aba47cd3e5f4b19e2a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:37.913721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f13f7cba4342aba47cd3e5f4b19e2a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:37.926555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:38.021745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f13f7cba4342aba47cd3e5f4b19e2a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:38.022643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f13f7cba4342aba47cd3e5f4b19e2a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:38.029272 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:38.039753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f13f7cba4342aba47cd3e5f4b19e2a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:38.049740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f13f7cba4342aba47cd3e5f4b19e2a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:38.050367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f13f7cba4342aba47cd3e5f4b19e2a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:38.075374 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1671/3361] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:37 2022] DELETE /identity/v3/users/e9f13f7cba4342aba47cd3e5f4b19e2a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:38.079968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc58fe3-6293-41be-80c9-3ecd0d0dbf13 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:38.080390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc58fe3-6293-41be-80c9-3ecd0d0dbf13 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:38.080544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc58fe3-6293-41be-80c9-3ecd0d0dbf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:38.101650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bbc58fe3-6293-41be-80c9-3ecd0d0dbf13 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:38.104971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bbc58fe3-6293-41be-80c9-3ecd0d0dbf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:38.196661 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:38.277308 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1691/3362] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:11:38.285396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:38.286457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:38.468111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1a421-29e5-49b9-bc68-b3724e958d43 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:38.477903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d87d5-26dc-4602-8673-cabeb8180f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:38.480384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d87d5-26dc-4602-8673-cabeb8180f46 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:38.480711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d87d5-26dc-4602-8673-cabeb8180f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:38.480985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d87d5-26dc-4602-8673-cabeb8180f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:38.518216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d87d5-26dc-4602-8673-cabeb8180f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:38.519845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d87d5-26dc-4602-8673-cabeb8180f46 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:38.569229 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1672/3363] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:38.592925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e2877-3ada-43dc-8eb5-f8789145dc94 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:38.593225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e2877-3ada-43dc-8eb5-f8789145dc94 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:38.593641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e2877-3ada-43dc-8eb5-f8789145dc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:38.637798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-529e2877-3ada-43dc-8eb5-f8789145dc94 None None] MFA Rules not processed for user `df9979f0dcd74d60a55d02d432de6a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:38.639244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-529e2877-3ada-43dc-8eb5-f8789145dc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:38.776765 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1692/3364] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:11:40.425981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d87d5-26dc-4602-8673-cabeb8180f46 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:40.428689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-353d87d5-26dc-4602-8673-cabeb8180f46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:40.472085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d87d5-26dc-4602-8673-cabeb8180f46 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:40.490456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6d7f2-a34c-4d69-9d64-66baece083c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:40.491212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6d7f2-a34c-4d69-9d64-66baece083c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:40.491491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6d7f2-a34c-4d69-9d64-66baece083c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:40.492204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6d7f2-a34c-4d69-9d64-66baece083c9 admin admin] PATH_INFO: `/v3/projects/54913c9d843e43c4b0d5b1c4a78a0e70` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:40.493641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6d7f2-a34c-4d69-9d64-66baece083c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54913c9d843e43c4b0d5b1c4a78a0e70)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:40.496310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6d7f2-a34c-4d69-9d64-66baece083c9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:40.638374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09a6d7f2-a34c-4d69-9d64-66baece083c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54913c9d843e43c4b0d5b1c4a78a0e70', 'request_id': 'req-09a6d7f2-a34c-4d69-9d64-66baece083c9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:40.660560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09a6d7f2-a34c-4d69-9d64-66baece083c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54913c9d843e43c4b0d5b1c4a78a0e70', 'request_id': 'req-09a6d7f2-a34c-4d69-9d64-66baece083c9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:40.696744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09a6d7f2-a34c-4d69-9d64-66baece083c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54913c9d843e43c4b0d5b1c4a78a0e70', 'request_id': 'req-09a6d7f2-a34c-4d69-9d64-66baece083c9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:40.733259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09a6d7f2-a34c-4d69-9d64-66baece083c9 admin admin] The token cache is being invalidate because project 54913c9d843e43c4b0d5b1c4a78a0e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:40.734101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09a6d7f2-a34c-4d69-9d64-66baece083c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:40.735988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09a6d7f2-a34c-4d69-9d64-66baece083c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:40.738868 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1673/3365] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:40 2022] DELETE /identity/v3/projects/54913c9d843e43c4b0d5b1c4a78a0e70 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:40.744897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307e068-a7c2-4660-bce1-460ec5b58447 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:40.745944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307e068-a7c2-4660-bce1-460ec5b58447 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:40.746370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307e068-a7c2-4660-bce1-460ec5b58447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:40.794366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9307e068-a7c2-4660-bce1-460ec5b58447 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:40.799405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9307e068-a7c2-4660-bce1-460ec5b58447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:40.911548 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1693/3366] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:40.920927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685659f-2345-4665-b060-9b8f32a14196 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:40.921279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685659f-2345-4665-b060-9b8f32a14196 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:40.921658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685659f-2345-4665-b060-9b8f32a14196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:40.970844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b685659f-2345-4665-b060-9b8f32a14196 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:40.987859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b685659f-2345-4665-b060-9b8f32a14196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:41.017265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307e068-a7c2-4660-bce1-460ec5b58447 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:41.024291 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1674/3367] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:41.030858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307e068-a7c2-4660-bce1-460ec5b58447 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:41.048311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14159a3-b301-4738-9bec-fd55feda4112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:41.049149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14159a3-b301-4738-9bec-fd55feda4112 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:41.049430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14159a3-b301-4738-9bec-fd55feda4112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:41.049702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14159a3-b301-4738-9bec-fd55feda4112 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:41.050373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14159a3-b301-4738-9bec-fd55feda4112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:11:41.051006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14159a3-b301-4738-9bec-fd55feda4112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:41.054074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14159a3-b301-4738-9bec-fd55feda4112 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:41.106574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685659f-2345-4665-b060-9b8f32a14196 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:41.117298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685659f-2345-4665-b060-9b8f32a14196 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:41.119201 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1694/3368] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:11:41.133019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14a696-97dd-40d5-a844-bd94466325d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:41.137087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14a696-97dd-40d5-a844-bd94466325d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:41.137579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14a696-97dd-40d5-a844-bd94466325d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:41.138037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14a696-97dd-40d5-a844-bd94466325d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:41.138868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14a696-97dd-40d5-a844-bd94466325d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:41.146068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14a696-97dd-40d5-a844-bd94466325d5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:41.229890 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1675/3369] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:11:41 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:41.234460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14159a3-b301-4738-9bec-fd55feda4112 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:41.253424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14159a3-b301-4738-9bec-fd55feda4112 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:41.423631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12ec3c-331b-4816-991e-172acdbee297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:41.424292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12ec3c-331b-4816-991e-172acdbee297 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:41.424648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12ec3c-331b-4816-991e-172acdbee297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:41.425071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12ec3c-331b-4816-991e-172acdbee297 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:41.426126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12ec3c-331b-4816-991e-172acdbee297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:41.428192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12ec3c-331b-4816-991e-172acdbee297 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:41.489464 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1695/3370] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:11:41 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:41.493572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14a696-97dd-40d5-a844-bd94466325d5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:41.507312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14a696-97dd-40d5-a844-bd94466325d5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:41.513988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cad800-9de5-4634-9943-55efe739eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:41.514970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cad800-9de5-4634-9943-55efe739eb72 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:41.515470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cad800-9de5-4634-9943-55efe739eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:41.516305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cad800-9de5-4634-9943-55efe739eb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:41.518624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cad800-9de5-4634-9943-55efe739eb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:41.520802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cad800-9de5-4634-9943-55efe739eb72 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:41.543394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12ec3c-331b-4816-991e-172acdbee297 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:41.568803 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1676/3371] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:41.568959 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:41.577593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12ec3c-331b-4816-991e-172acdbee297 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:41.610268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda4355-df64-4850-a3e9-6d58de639ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:41.611005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda4355-df64-4850-a3e9-6d58de639ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:41.611548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda4355-df64-4850-a3e9-6d58de639ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:41.611548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda4355-df64-4850-a3e9-6d58de639ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:41.613556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda4355-df64-4850-a3e9-6d58de639ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:41.621830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda4355-df64-4850-a3e9-6d58de639ac7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:41.653775 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1696/3372] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:41.655161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cad800-9de5-4634-9943-55efe739eb72 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:41.671810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cad800-9de5-4634-9943-55efe739eb72 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:41.687203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549e7c1-7127-4539-860e-2f9d196a1de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:41.688174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549e7c1-7127-4539-860e-2f9d196a1de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:41.689870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549e7c1-7127-4539-860e-2f9d196a1de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:41.690409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549e7c1-7127-4539-860e-2f9d196a1de5 admin admin] PATH_INFO: `/v3/projects/d688e31f04ce4d14bbc9c4d2635d3e2a/users/befcf8a010bb48d3a174a52ea94d012e/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:41.729592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549e7c1-7127-4539-860e-2f9d196a1de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d688e31f04ce4d14bbc9c4d2635d3e2a, user_id=befcf8a010bb48d3a174a52ea94d012e, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:41.746351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549e7c1-7127-4539-860e-2f9d196a1de5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:41.749178 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:41.778530 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1677/3373] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:11:41 2022] PUT /identity/v3/projects/d688e31f04ce4d14bbc9c4d2635d3e2a/users/befcf8a010bb48d3a174a52ea94d012e/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:41.784781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a289c-3064-4422-a103-5c33514a7e1c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:41.785255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a289c-3064-4422-a103-5c33514a7e1c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:41.785337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a289c-3064-4422-a103-5c33514a7e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:41.834273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9f3a289c-3064-4422-a103-5c33514a7e1c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:41.836791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9f3a289c-3064-4422-a103-5c33514a7e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:41.967555 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1697/3374] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:11:42.002181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549e7c1-7127-4539-860e-2f9d196a1de5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:42.006569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7549e7c1-7127-4539-860e-2f9d196a1de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:42.139996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549e7c1-7127-4539-860e-2f9d196a1de5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:42.145156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d465e-d09d-4bde-9ba7-8388693c4b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:42.146270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d465e-d09d-4bde-9ba7-8388693c4b27 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:42.146474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d465e-d09d-4bde-9ba7-8388693c4b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:42.146695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d465e-d09d-4bde-9ba7-8388693c4b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:42.164643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d465e-d09d-4bde-9ba7-8388693c4b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:42.166682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d465e-d09d-4bde-9ba7-8388693c4b27 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:42.203564 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1678/3375] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:42.332117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99adc-93a0-463f-9315-5defd6e5fea2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:42.332435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99adc-93a0-463f-9315-5defd6e5fea2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:42.332710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99adc-93a0-463f-9315-5defd6e5fea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:42.374149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-48a99adc-93a0-463f-9315-5defd6e5fea2 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:42.375430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-48a99adc-93a0-463f-9315-5defd6e5fea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:42.478835 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1698/3376] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:11:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:42.501998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d465e-d09d-4bde-9ba7-8388693c4b27 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:42.504955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-658d465e-d09d-4bde-9ba7-8388693c4b27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:42.591609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d465e-d09d-4bde-9ba7-8388693c4b27 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:42.597194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72447d8-f0f1-46e7-8c1c-7418fa46464b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:42.597799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72447d8-f0f1-46e7-8c1c-7418fa46464b service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:42.598074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72447d8-f0f1-46e7-8c1c-7418fa46464b service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:42.598342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72447d8-f0f1-46e7-8c1c-7418fa46464b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:42.607960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72447d8-f0f1-46e7-8c1c-7418fa46464b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:42.609591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72447d8-f0f1-46e7-8c1c-7418fa46464b service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:42.617905 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1679/3377] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:11:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:42.738771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99adc-93a0-463f-9315-5defd6e5fea2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:42.740755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-48a99adc-93a0-463f-9315-5defd6e5fea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:42.759021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99adc-93a0-463f-9315-5defd6e5fea2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:42.764960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:42.765859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:42.766321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:42.766813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] PATH_INFO: `/v3/users/ac5b287a0e084b4d8e0480cd177e1eaa` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:42.768184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5b287a0e084b4d8e0480cd177e1eaa)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:42.770336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:42.837450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5b287a0e084b4d8e0480cd177e1eaa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:42.841835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5b287a0e084b4d8e0480cd177e1eaa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:42.868460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5b287a0e084b4d8e0480cd177e1eaa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:42.881443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5b287a0e084b4d8e0480cd177e1eaa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:42.882745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5b287a0e084b4d8e0480cd177e1eaa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:42.908988 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1699/3378] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:42 2022] DELETE /identity/v3/users/ac5b287a0e084b4d8e0480cd177e1eaa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:42.915170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a7d6f-44a5-43a9-9333-23ca87c0eb0c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:42.915832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a7d6f-44a5-43a9-9333-23ca87c0eb0c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:42.916150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a7d6f-44a5-43a9-9333-23ca87c0eb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:42.952554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d01a7d6f-44a5-43a9-9333-23ca87c0eb0c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:42.953933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d01a7d6f-44a5-43a9-9333-23ca87c0eb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:43.076918 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1680/3379] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:11:43.114503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:43.116231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:43.139057 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:43.263507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c2390-5bbd-4b34-8aef-370f7bb17c13 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:43.267997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430539b0-63aa-43d0-a0a1-69888350e199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:43.268924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430539b0-63aa-43d0-a0a1-69888350e199 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:43.269321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430539b0-63aa-43d0-a0a1-69888350e199 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:43.269654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430539b0-63aa-43d0-a0a1-69888350e199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:43.288068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430539b0-63aa-43d0-a0a1-69888350e199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:43.289969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430539b0-63aa-43d0-a0a1-69888350e199 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:43.302682 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1700/3380] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:43.765701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a7d6f-44a5-43a9-9333-23ca87c0eb0c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:43.767412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d01a7d6f-44a5-43a9-9333-23ca87c0eb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:43.779846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a7d6f-44a5-43a9-9333-23ca87c0eb0c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:43.784879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb7f10-21ac-4409-be97-41076fd06dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:43.785624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7f10-21ac-4409-be97-41076fd06dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:43.785900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7f10-21ac-4409-be97-41076fd06dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:43.786178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7f10-21ac-4409-be97-41076fd06dcd admin admin] PATH_INFO: `/v3/projects/61f3c40ffaff4643896b3dfbedada1a7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:43.787418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb7f10-21ac-4409-be97-41076fd06dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f3c40ffaff4643896b3dfbedada1a7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:43.789504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb7f10-21ac-4409-be97-41076fd06dcd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:43.829296 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:43.859273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b7eb7f10-21ac-4409-be97-41076fd06dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f3c40ffaff4643896b3dfbedada1a7', 'request_id': 'req-b7eb7f10-21ac-4409-be97-41076fd06dcd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:43.866573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b7eb7f10-21ac-4409-be97-41076fd06dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f3c40ffaff4643896b3dfbedada1a7', 'request_id': 'req-b7eb7f10-21ac-4409-be97-41076fd06dcd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:43.897720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b7eb7f10-21ac-4409-be97-41076fd06dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f3c40ffaff4643896b3dfbedada1a7', 'request_id': 'req-b7eb7f10-21ac-4409-be97-41076fd06dcd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:43.915496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b7eb7f10-21ac-4409-be97-41076fd06dcd admin admin] The token cache is being invalidate because project 61f3c40ffaff4643896b3dfbedada1a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:43.915968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b7eb7f10-21ac-4409-be97-41076fd06dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:43.916895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b7eb7f10-21ac-4409-be97-41076fd06dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:43.919924 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1681/3381] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:43 2022] DELETE /identity/v3/projects/61f3c40ffaff4643896b3dfbedada1a7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:43.925056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4398a43-b02e-4b51-bbab-d12292743f74 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:43.925564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4398a43-b02e-4b51-bbab-d12292743f74 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:43.925693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4398a43-b02e-4b51-bbab-d12292743f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:43.954508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a4398a43-b02e-4b51-bbab-d12292743f74 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:43.956116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a4398a43-b02e-4b51-bbab-d12292743f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:44.114890 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1701/3382] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:44.124805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecefb0-e591-4016-9ee2-0e38e9b0931c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:44.125096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecefb0-e591-4016-9ee2-0e38e9b0931c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:44.125376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecefb0-e591-4016-9ee2-0e38e9b0931c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:44.167480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0eecefb0-e591-4016-9ee2-0e38e9b0931c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:44.170433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0eecefb0-e591-4016-9ee2-0e38e9b0931c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:44.180951 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1682/3383] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:44.200090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4398a43-b02e-4b51-bbab-d12292743f74 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:44.224995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4398a43-b02e-4b51-bbab-d12292743f74 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:44.233704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b278-3c05-43be-bebe-c1a22549ee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:44.234751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b278-3c05-43be-bebe-c1a22549ee21 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:44.243321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b278-3c05-43be-bebe-c1a22549ee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:44.243703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b278-3c05-43be-bebe-c1a22549ee21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:44.245079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b278-3c05-43be-bebe-c1a22549ee21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:11:44.245451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b278-3c05-43be-bebe-c1a22549ee21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:44.247268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b278-3c05-43be-bebe-c1a22549ee21 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:44.262318 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1702/3384] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:11:44.266526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecefb0-e591-4016-9ee2-0e38e9b0931c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:44.281522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecefb0-e591-4016-9ee2-0e38e9b0931c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:44.291437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e422ae-5d16-4bd8-9e41-8bbe8d75b0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:44.293155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e422ae-5d16-4bd8-9e41-8bbe8d75b0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:44.293694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e422ae-5d16-4bd8-9e41-8bbe8d75b0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:44.295447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e422ae-5d16-4bd8-9e41-8bbe8d75b0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:44.296191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e422ae-5d16-4bd8-9e41-8bbe8d75b0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:44.298576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e422ae-5d16-4bd8-9e41-8bbe8d75b0e0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:44.370056 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1683/3385] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:11:44 2022] POST /identity/v3/projects => generated 397 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:44.374601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b278-3c05-43be-bebe-c1a22549ee21 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:44.399132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b278-3c05-43be-bebe-c1a22549ee21 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:44.524023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcb9c4-7a70-47f0-8827-4adae94595ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:44.525092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcb9c4-7a70-47f0-8827-4adae94595ad admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:44.526333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcb9c4-7a70-47f0-8827-4adae94595ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:44.527025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcb9c4-7a70-47f0-8827-4adae94595ad admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:44.527860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fcb9c4-7a70-47f0-8827-4adae94595ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:44.530232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fcb9c4-7a70-47f0-8827-4adae94595ad admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:44.597892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e422ae-5d16-4bd8-9e41-8bbe8d75b0e0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:44.598535 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1703/3386] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:11:44 2022] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:44.613149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e422ae-5d16-4bd8-9e41-8bbe8d75b0e0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:44.619109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e45c4-419c-40ed-93e0-d38a03cb4474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:44.619699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e45c4-419c-40ed-93e0-d38a03cb4474 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:44.619976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e45c4-419c-40ed-93e0-d38a03cb4474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:44.620245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e45c4-419c-40ed-93e0-d38a03cb4474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:44.621123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e45c4-419c-40ed-93e0-d38a03cb4474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:44.623143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e45c4-419c-40ed-93e0-d38a03cb4474 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:44.636654 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1684/3387] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:44.640636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcb9c4-7a70-47f0-8827-4adae94595ad admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:44.654444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcb9c4-7a70-47f0-8827-4adae94595ad admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:44.665861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11756-db16-4d7a-ad97-5f4f97ec2dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:44.668911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11756-db16-4d7a-ad97-5f4f97ec2dde admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:44.670444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11756-db16-4d7a-ad97-5f4f97ec2dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:44.670762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11756-db16-4d7a-ad97-5f4f97ec2dde admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:44.672949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b11756-db16-4d7a-ad97-5f4f97ec2dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:44.677706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b11756-db16-4d7a-ad97-5f4f97ec2dde admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:44.714901 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1704/3388] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:44.718980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e45c4-419c-40ed-93e0-d38a03cb4474 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:44.739882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e45c4-419c-40ed-93e0-d38a03cb4474 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:44.746141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6015d1-dae9-4b60-afbc-bcb1526c1f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:44.747226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6015d1-dae9-4b60-afbc-bcb1526c1f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:44.747774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6015d1-dae9-4b60-afbc-bcb1526c1f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:44.748248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6015d1-dae9-4b60-afbc-bcb1526c1f79 admin admin] PATH_INFO: `/v3/projects/02b9058861b64d68b7c87ed1b1516a25/users/a112d6d4601d4bd4a3ffe3a65cd59fe9/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:44.788441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6015d1-dae9-4b60-afbc-bcb1526c1f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b9058861b64d68b7c87ed1b1516a25, user_id=a112d6d4601d4bd4a3ffe3a65cd59fe9, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:44.793440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6015d1-dae9-4b60-afbc-bcb1526c1f79 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:44.819273 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1685/3389] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:11:44 2022] PUT /identity/v3/projects/02b9058861b64d68b7c87ed1b1516a25/users/a112d6d4601d4bd4a3ffe3a65cd59fe9/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:44.833232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086997-86bd-4696-8e3d-a40ad3fc639e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:44.833525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086997-86bd-4696-8e3d-a40ad3fc639e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:44.834081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086997-86bd-4696-8e3d-a40ad3fc639e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:44.912207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5e086997-86bd-4696-8e3d-a40ad3fc639e None None] MFA Rules not processed for user `a112d6d4601d4bd4a3ffe3a65cd59fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:44.914855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5e086997-86bd-4696-8e3d-a40ad3fc639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:44.940768 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:45.063754 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1705/3390] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:45.080672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6015d1-dae9-4b60-afbc-bcb1526c1f79 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:45.083307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ed6015d1-dae9-4b60-afbc-bcb1526c1f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:45.192087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6015d1-dae9-4b60-afbc-bcb1526c1f79 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:45.198663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e50204-9f92-479e-bc13-fbf03cbd1262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:45.199414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e50204-9f92-479e-bc13-fbf03cbd1262 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:45.199735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e50204-9f92-479e-bc13-fbf03cbd1262 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:45.199964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e50204-9f92-479e-bc13-fbf03cbd1262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:45.209455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e50204-9f92-479e-bc13-fbf03cbd1262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:45.211082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e50204-9f92-479e-bc13-fbf03cbd1262 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:45.223182 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1686/3391] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:45.638435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e086997-86bd-4696-8e3d-a40ad3fc639e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:45.751609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e086997-86bd-4696-8e3d-a40ad3fc639e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:45.787584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:45.788433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:45.788715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:45.789029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] PATH_INFO: `/v3/users/a112d6d4601d4bd4a3ffe3a65cd59fe9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:45.793419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a112d6d4601d4bd4a3ffe3a65cd59fe9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:45.797125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:45.914680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a112d6d4601d4bd4a3ffe3a65cd59fe9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:45.919472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a112d6d4601d4bd4a3ffe3a65cd59fe9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:45.956277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a112d6d4601d4bd4a3ffe3a65cd59fe9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:45.969260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a112d6d4601d4bd4a3ffe3a65cd59fe9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:45.970337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a112d6d4601d4bd4a3ffe3a65cd59fe9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:46.003551 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1706/3392] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:45 2022] DELETE /identity/v3/users/a112d6d4601d4bd4a3ffe3a65cd59fe9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:46.005324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5af074-e8f0-46be-ab6d-35efdd43dc26 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:46.005797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5af074-e8f0-46be-ab6d-35efdd43dc26 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:46.005889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5af074-e8f0-46be-ab6d-35efdd43dc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:46.069449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bc5af074-e8f0-46be-ab6d-35efdd43dc26 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:46.070985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bc5af074-e8f0-46be-ab6d-35efdd43dc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:46.121533 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:46.174868 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1687/3393] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:46.200077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:46.201834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:46.248804 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:46.282889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c2cce-3584-4cea-9199-a765ed6f8eef admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:46.286977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982ab44-3630-479b-8778-45fe94725164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:46.287615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982ab44-3630-479b-8778-45fe94725164 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:46.287888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982ab44-3630-479b-8778-45fe94725164 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:46.288154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982ab44-3630-479b-8778-45fe94725164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:46.300400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982ab44-3630-479b-8778-45fe94725164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:46.302265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982ab44-3630-479b-8778-45fe94725164 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:46.326721 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1707/3394] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:11:47.274601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5af074-e8f0-46be-ab6d-35efdd43dc26 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:47.278178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bc5af074-e8f0-46be-ab6d-35efdd43dc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:47.304471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5af074-e8f0-46be-ab6d-35efdd43dc26 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:47.338901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3728289-766a-47b2-9421-a7c77a312ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:47.340048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3728289-766a-47b2-9421-a7c77a312ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:47.340330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3728289-766a-47b2-9421-a7c77a312ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:47.340606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3728289-766a-47b2-9421-a7c77a312ca7 admin admin] PATH_INFO: `/v3/projects/02b9058861b64d68b7c87ed1b1516a25` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:47.343292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3728289-766a-47b2-9421-a7c77a312ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b9058861b64d68b7c87ed1b1516a25)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:47.345213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3728289-766a-47b2-9421-a7c77a312ca7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:47.470601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a3728289-766a-47b2-9421-a7c77a312ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b9058861b64d68b7c87ed1b1516a25', 'request_id': 'req-a3728289-766a-47b2-9421-a7c77a312ca7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:47.481180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a3728289-766a-47b2-9421-a7c77a312ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b9058861b64d68b7c87ed1b1516a25', 'request_id': 'req-a3728289-766a-47b2-9421-a7c77a312ca7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:47.496137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a3728289-766a-47b2-9421-a7c77a312ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b9058861b64d68b7c87ed1b1516a25', 'request_id': 'req-a3728289-766a-47b2-9421-a7c77a312ca7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:47.512939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a3728289-766a-47b2-9421-a7c77a312ca7 admin admin] The token cache is being invalidate because project 02b9058861b64d68b7c87ed1b1516a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:47.513444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a3728289-766a-47b2-9421-a7c77a312ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:47.514303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a3728289-766a-47b2-9421-a7c77a312ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:47.517123 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1688/3395] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:47 2022] DELETE /identity/v3/projects/02b9058861b64d68b7c87ed1b1516a25 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:47.521849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b675-c256-4959-957b-1321b87ef916 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:47.522370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b675-c256-4959-957b-1321b87ef916 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:47.522466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b675-c256-4959-957b-1321b87ef916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:47.570902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5006b675-c256-4959-957b-1321b87ef916 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:47.573191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5006b675-c256-4959-957b-1321b87ef916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:47.681067 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1708/3396] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:47.694839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0af6f-28a8-47e6-abb0-d5cbf2dce0ea None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:47.695929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0af6f-28a8-47e6-abb0-d5cbf2dce0ea None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:47.697218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0af6f-28a8-47e6-abb0-d5cbf2dce0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:47.731264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-17e0af6f-28a8-47e6-abb0-d5cbf2dce0ea None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:47.733578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-17e0af6f-28a8-47e6-abb0-d5cbf2dce0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:47.747718 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1689/3397] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:47.752397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b675-c256-4959-957b-1321b87ef916 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:47.767063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b675-c256-4959-957b-1321b87ef916 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:47.772296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6d0d-0152-470f-a0f0-66dec64bbdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:47.773116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6d0d-0152-470f-a0f0-66dec64bbdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:47.773563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6d0d-0152-470f-a0f0-66dec64bbdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:47.774010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6d0d-0152-470f-a0f0-66dec64bbdc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:47.775776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a6d0d-0152-470f-a0f0-66dec64bbdc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:11:47.776254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a6d0d-0152-470f-a0f0-66dec64bbdc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:47.778238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a6d0d-0152-470f-a0f0-66dec64bbdc7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:47.793616 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1709/3398] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:11:47.797826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0af6f-28a8-47e6-abb0-d5cbf2dce0ea None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:47.809250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0af6f-28a8-47e6-abb0-d5cbf2dce0ea None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:47.817146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380d5da-88aa-4342-8cae-f44bc5912e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:47.818035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d5da-88aa-4342-8cae-f44bc5912e91 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:47.818820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d5da-88aa-4342-8cae-f44bc5912e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:47.819419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d5da-88aa-4342-8cae-f44bc5912e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:47.820264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380d5da-88aa-4342-8cae-f44bc5912e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:47.823239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380d5da-88aa-4342-8cae-f44bc5912e91 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:47.862381 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1690/3399] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:11:47 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:47.867287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6d0d-0152-470f-a0f0-66dec64bbdc7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:47.887596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6d0d-0152-470f-a0f0-66dec64bbdc7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:48.017212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987ba43-d41d-42a8-b4cf-b7b280c3c50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:48.018519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987ba43-d41d-42a8-b4cf-b7b280c3c50a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:48.018893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987ba43-d41d-42a8-b4cf-b7b280c3c50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:48.019291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987ba43-d41d-42a8-b4cf-b7b280c3c50a admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:48.024047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987ba43-d41d-42a8-b4cf-b7b280c3c50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:48.026523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987ba43-d41d-42a8-b4cf-b7b280c3c50a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:48.076503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380d5da-88aa-4342-8cae-f44bc5912e91 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:48.077978 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1710/3400] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:11:47 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:48.093023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380d5da-88aa-4342-8cae-f44bc5912e91 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:48.099507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3fd45-c995-4f16-b0f8-166dc14d80d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:48.100308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3fd45-c995-4f16-b0f8-166dc14d80d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:48.100751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3fd45-c995-4f16-b0f8-166dc14d80d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:48.101186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3fd45-c995-4f16-b0f8-166dc14d80d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:48.102157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3fd45-c995-4f16-b0f8-166dc14d80d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:48.104523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3fd45-c995-4f16-b0f8-166dc14d80d9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:48.126756 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1691/3401] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:11:48.127215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987ba43-d41d-42a8-b4cf-b7b280c3c50a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:48.143958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987ba43-d41d-42a8-b4cf-b7b280c3c50a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:48.168042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9264bf3-5095-44ec-8e87-1e3e4e9f83f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:48.174445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9264bf3-5095-44ec-8e87-1e3e4e9f83f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:48.174445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9264bf3-5095-44ec-8e87-1e3e4e9f83f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:48.174445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9264bf3-5095-44ec-8e87-1e3e4e9f83f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:48.174445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9264bf3-5095-44ec-8e87-1e3e4e9f83f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:48.174445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9264bf3-5095-44ec-8e87-1e3e4e9f83f9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:48.190959 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1711/3402] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:48.194350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3fd45-c995-4f16-b0f8-166dc14d80d9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:48.208722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3fd45-c995-4f16-b0f8-166dc14d80d9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:48.218003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76927cfd-cb07-451b-8ebc-652ffddc9311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:48.218717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76927cfd-cb07-451b-8ebc-652ffddc9311 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:48.219032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76927cfd-cb07-451b-8ebc-652ffddc9311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:48.221429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76927cfd-cb07-451b-8ebc-652ffddc9311 admin admin] PATH_INFO: `/v3/projects/78f1b685cc2c47ec8a02cc1e12a53792/users/c77ddc8451b149128f5420c0fd665a59/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:48.250186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76927cfd-cb07-451b-8ebc-652ffddc9311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f1b685cc2c47ec8a02cc1e12a53792, user_id=c77ddc8451b149128f5420c0fd665a59, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:48.253235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76927cfd-cb07-451b-8ebc-652ffddc9311 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:48.290018 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1692/3403] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:11:48 2022] PUT /identity/v3/projects/78f1b685cc2c47ec8a02cc1e12a53792/users/c77ddc8451b149128f5420c0fd665a59/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:48.292580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f36af-acbe-4bd8-8bb0-b76d36a7252f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:48.292999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f36af-acbe-4bd8-8bb0-b76d36a7252f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:48.293386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f36af-acbe-4bd8-8bb0-b76d36a7252f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:48.325946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2d6f36af-acbe-4bd8-8bb0-b76d36a7252f None None] MFA Rules not processed for user `c77ddc8451b149128f5420c0fd665a59`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:48.327357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2d6f36af-acbe-4bd8-8bb0-b76d36a7252f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:48.364261 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:48.435290 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1712/3404] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:11:48.810403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76927cfd-cb07-451b-8ebc-652ffddc9311 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:48.812770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-76927cfd-cb07-451b-8ebc-652ffddc9311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:48.933920 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:48.982492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76927cfd-cb07-451b-8ebc-652ffddc9311 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:48.989804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f6ec7-2385-49a7-be0f-24ef4f5a4221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:48.990548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6ec7-2385-49a7-be0f-24ef4f5a4221 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:48.990829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6ec7-2385-49a7-be0f-24ef4f5a4221 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:48.991131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6ec7-2385-49a7-be0f-24ef4f5a4221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:49.003430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f6ec7-2385-49a7-be0f-24ef4f5a4221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:49.005693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f6ec7-2385-49a7-be0f-24ef4f5a4221 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:49.023161 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1693/3405] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:49.855562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f36af-acbe-4bd8-8bb0-b76d36a7252f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:49.943909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f36af-acbe-4bd8-8bb0-b76d36a7252f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:49.950108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:49.950768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:49.951232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:49.951868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] PATH_INFO: `/v3/users/c77ddc8451b149128f5420c0fd665a59` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:49.953063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c77ddc8451b149128f5420c0fd665a59)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:49.955182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:50.027409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c77ddc8451b149128f5420c0fd665a59'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:50.028674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c77ddc8451b149128f5420c0fd665a59'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:50.048712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c77ddc8451b149128f5420c0fd665a59'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:50.062619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c77ddc8451b149128f5420c0fd665a59'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:50.064375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c77ddc8451b149128f5420c0fd665a59'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:50.088052 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1713/3406] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:49 2022] DELETE /identity/v3/users/c77ddc8451b149128f5420c0fd665a59 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:11:50.092893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462030ad-4b32-4e58-bb3c-56a2aa4452b8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:50.093789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462030ad-4b32-4e58-bb3c-56a2aa4452b8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:50.094364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462030ad-4b32-4e58-bb3c-56a2aa4452b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:50.131826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-462030ad-4b32-4e58-bb3c-56a2aa4452b8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:50.134150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-462030ad-4b32-4e58-bb3c-56a2aa4452b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:50.262260 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1694/3407] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:50.296613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:50.298237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:50.374652 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:50.396650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c9de8-c077-40bc-b27b-c1b2eb970ca6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:50.402796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71155e8-3ac7-463c-8e30-15518cd6222e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:50.403476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71155e8-3ac7-463c-8e30-15518cd6222e service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:50.403913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71155e8-3ac7-463c-8e30-15518cd6222e service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:50.404195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71155e8-3ac7-463c-8e30-15518cd6222e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:50.416196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71155e8-3ac7-463c-8e30-15518cd6222e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:50.417777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71155e8-3ac7-463c-8e30-15518cd6222e service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:50.429644 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1714/3408] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:51.222173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a884eab-69cd-40c6-92e1-8965dc108e55 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:51.222706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a884eab-69cd-40c6-92e1-8965dc108e55 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:51.222706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a884eab-69cd-40c6-92e1-8965dc108e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:51.276559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3a884eab-69cd-40c6-92e1-8965dc108e55 None None] MFA Rules not processed for user `0c8da9a32cb54d0a87d914234b1e9f40`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:51.279216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a884eab-69cd-40c6-92e1-8965dc108e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:51.459038 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1695/3409] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:51.585661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71155e8-3ac7-463c-8e30-15518cd6222e service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:51.600967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71155e8-3ac7-463c-8e30-15518cd6222e service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:51.606213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2442210-170e-45fa-89d2-767f13db0cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:51.607433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2442210-170e-45fa-89d2-767f13db0cec service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:51.608061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2442210-170e-45fa-89d2-767f13db0cec service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:51.608493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2442210-170e-45fa-89d2-767f13db0cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:51.610479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e2442210-170e-45fa-89d2-767f13db0cec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:51.634123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2442210-170e-45fa-89d2-767f13db0cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:51.636749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2442210-170e-45fa-89d2-767f13db0cec service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:51.653717 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1715/3410] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:51.909130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a884eab-69cd-40c6-92e1-8965dc108e55 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:51.911125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a884eab-69cd-40c6-92e1-8965dc108e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:51.926128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a884eab-69cd-40c6-92e1-8965dc108e55 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:51.932118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666f884-5227-4d1b-9690-d23e00791f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:51.933035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666f884-5227-4d1b-9690-d23e00791f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:51.942727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666f884-5227-4d1b-9690-d23e00791f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:51.946598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666f884-5227-4d1b-9690-d23e00791f14 admin admin] PATH_INFO: `/v3/projects/78f1b685cc2c47ec8a02cc1e12a53792` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:51.948907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666f884-5227-4d1b-9690-d23e00791f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f1b685cc2c47ec8a02cc1e12a53792)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:51.951259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666f884-5227-4d1b-9690-d23e00791f14 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:52.058967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e666f884-5227-4d1b-9690-d23e00791f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f1b685cc2c47ec8a02cc1e12a53792', 'request_id': 'req-e666f884-5227-4d1b-9690-d23e00791f14'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:52.066100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e666f884-5227-4d1b-9690-d23e00791f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f1b685cc2c47ec8a02cc1e12a53792', 'request_id': 'req-e666f884-5227-4d1b-9690-d23e00791f14'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:52.076653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e666f884-5227-4d1b-9690-d23e00791f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f1b685cc2c47ec8a02cc1e12a53792', 'request_id': 'req-e666f884-5227-4d1b-9690-d23e00791f14'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:52.090739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e666f884-5227-4d1b-9690-d23e00791f14 admin admin] The token cache is being invalidate because project 78f1b685cc2c47ec8a02cc1e12a53792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:52.091183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e666f884-5227-4d1b-9690-d23e00791f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:52.091903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e666f884-5227-4d1b-9690-d23e00791f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:52.093863 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1696/3411] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:51 2022] DELETE /identity/v3/projects/78f1b685cc2c47ec8a02cc1e12a53792 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:52.100349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5e7b-4c16-413f-b99b-3fe4935ab137 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:52.107997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5e7b-4c16-413f-b99b-3fe4935ab137 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:52.109046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5e7b-4c16-413f-b99b-3fe4935ab137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:52.161877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-05fb5e7b-4c16-413f-b99b-3fe4935ab137 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:52.163806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05fb5e7b-4c16-413f-b99b-3fe4935ab137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:52.282124 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1716/3412] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:52.282343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689274d3-0cdc-40e9-9648-7f2a075570e0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:52.282805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689274d3-0cdc-40e9-9648-7f2a075570e0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:52.282805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689274d3-0cdc-40e9-9648-7f2a075570e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:52.304095 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:52.326619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-689274d3-0cdc-40e9-9648-7f2a075570e0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:52.328241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-689274d3-0cdc-40e9-9648-7f2a075570e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:52.340855 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1697/3413] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:52.346164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb5e7b-4c16-413f-b99b-3fe4935ab137 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:52.347222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689274d3-0cdc-40e9-9648-7f2a075570e0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:52.347863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05fb5e7b-4c16-413f-b99b-3fe4935ab137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:52.362887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689274d3-0cdc-40e9-9648-7f2a075570e0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:52.369870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb5e7b-4c16-413f-b99b-3fe4935ab137 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:52.370986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dbdbf-fd25-4635-9e60-608c5a2a1bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:52.372171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dbdbf-fd25-4635-9e60-608c5a2a1bed admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:52.372653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dbdbf-fd25-4635-9e60-608c5a2a1bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:52.373140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dbdbf-fd25-4635-9e60-608c5a2a1bed admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:52.374002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dbdbf-fd25-4635-9e60-608c5a2a1bed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:11:52.374790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dbdbf-fd25-4635-9e60-608c5a2a1bed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:52.378578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dbdbf-fd25-4635-9e60-608c5a2a1bed admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:52.387547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f56c9-607f-416d-83a6-e512497e5557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:52.388280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f56c9-607f-416d-83a6-e512497e5557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:52.388603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f56c9-607f-416d-83a6-e512497e5557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:52.388909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f56c9-607f-416d-83a6-e512497e5557 admin admin] PATH_INFO: `/v3/users/cb8b0f8bc10744a48ba642a19d131473` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:52.392182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f56c9-607f-416d-83a6-e512497e5557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8b0f8bc10744a48ba642a19d131473)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:52.396823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f56c9-607f-416d-83a6-e512497e5557 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:52.398110 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1698/3414] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:11:52.403456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dbdbf-fd25-4635-9e60-608c5a2a1bed admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:52.428107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dbdbf-fd25-4635-9e60-608c5a2a1bed admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:52.442036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4018d-35a6-4fc5-a47c-e2277c0fa516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:52.443440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4018d-35a6-4fc5-a47c-e2277c0fa516 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:52.443941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4018d-35a6-4fc5-a47c-e2277c0fa516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:52.444830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4018d-35a6-4fc5-a47c-e2277c0fa516 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:52.445679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4018d-35a6-4fc5-a47c-e2277c0fa516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:52.449643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4018d-35a6-4fc5-a47c-e2277c0fa516 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:52.501594 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1699/3415] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:11:52 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:52.505347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4018d-35a6-4fc5-a47c-e2277c0fa516 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:52.512286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-384f56c9-607f-416d-83a6-e512497e5557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8b0f8bc10744a48ba642a19d131473'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:52.513083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-384f56c9-607f-416d-83a6-e512497e5557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8b0f8bc10744a48ba642a19d131473'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:52.572257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-384f56c9-607f-416d-83a6-e512497e5557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8b0f8bc10744a48ba642a19d131473'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:52.583179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-384f56c9-607f-416d-83a6-e512497e5557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8b0f8bc10744a48ba642a19d131473'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:52.584263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-384f56c9-607f-416d-83a6-e512497e5557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8b0f8bc10744a48ba642a19d131473'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:52.615270 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1717/3416] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:52 2022] DELETE /identity/v3/users/cb8b0f8bc10744a48ba642a19d131473 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:52.617872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b139-0cd1-40af-ab45-3303ffa02cd5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:52.617872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b139-0cd1-40af-ab45-3303ffa02cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:52.617872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b139-0cd1-40af-ab45-3303ffa02cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:52.619185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4018d-35a6-4fc5-a47c-e2277c0fa516 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:52.679283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-48f6b139-0cd1-40af-ab45-3303ffa02cd5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:52.679283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-48f6b139-0cd1-40af-ab45-3303ffa02cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:52.767375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b3032-b93f-4d4b-a3e7-6ef181f33317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:52.768143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3032-b93f-4d4b-a3e7-6ef181f33317 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:52.768519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3032-b93f-4d4b-a3e7-6ef181f33317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:52.768883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3032-b93f-4d4b-a3e7-6ef181f33317 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:52.769611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b3032-b93f-4d4b-a3e7-6ef181f33317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:52.772279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b3032-b93f-4d4b-a3e7-6ef181f33317 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:52.780569 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:52.818562 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1700/3417] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:11:52 2022] POST /identity/v3/users => generated 294 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:11:52.820260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b3032-b93f-4d4b-a3e7-6ef181f33317 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:52.824801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8b0b3032-b93f-4d4b-a3e7-6ef181f33317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:52.832848 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1718/3418] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:52.848713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b3032-b93f-4d4b-a3e7-6ef181f33317 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:52.854222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff2f0-69ae-4582-9e13-e2b625b267aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:52.854902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff2f0-69ae-4582-9e13-e2b625b267aa admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:52.855228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff2f0-69ae-4582-9e13-e2b625b267aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:52.855495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff2f0-69ae-4582-9e13-e2b625b267aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:52.856628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeff2f0-69ae-4582-9e13-e2b625b267aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:52.858582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeff2f0-69ae-4582-9e13-e2b625b267aa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:52.875101 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1701/3419] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:52.881118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b139-0cd1-40af-ab45-3303ffa02cd5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:52.898605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b139-0cd1-40af-ab45-3303ffa02cd5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:52.899260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff2f0-69ae-4582-9e13-e2b625b267aa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:52.903268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bbeff2f0-69ae-4582-9e13-e2b625b267aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:52.914445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b969f7-7cac-48e4-8b72-b4fb3d492845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:52.916284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b969f7-7cac-48e4-8b72-b4fb3d492845 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:52.917602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b969f7-7cac-48e4-8b72-b4fb3d492845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:52.917931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b969f7-7cac-48e4-8b72-b4fb3d492845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:52.920834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b969f7-7cac-48e4-8b72-b4fb3d492845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:52.923636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b969f7-7cac-48e4-8b72-b4fb3d492845 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:52.956792 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1719/3420] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:11:52.958648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b969f7-7cac-48e4-8b72-b4fb3d492845 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:52.991558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b969f7-7cac-48e4-8b72-b4fb3d492845 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:53.005046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e31095-e5a7-4b9d-8402-614c54b417f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:53.005729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e31095-e5a7-4b9d-8402-614c54b417f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:53.008680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e31095-e5a7-4b9d-8402-614c54b417f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:53.017677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e31095-e5a7-4b9d-8402-614c54b417f5 admin admin] PATH_INFO: `/v3/projects/8747e7b25c434abfbdb3e7f981ef8fc8/users/ebca99f6818548b982e94948327522b5/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:53.088198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e31095-e5a7-4b9d-8402-614c54b417f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8747e7b25c434abfbdb3e7f981ef8fc8, user_id=ebca99f6818548b982e94948327522b5, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:53.091468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e31095-e5a7-4b9d-8402-614c54b417f5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:53.130565 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1720/3421] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:11:52 2022] PUT /identity/v3/projects/8747e7b25c434abfbdb3e7f981ef8fc8/users/ebca99f6818548b982e94948327522b5/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:53.132160 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:53.137910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbbb15-76e9-442c-909a-f347eb0051f8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:53.138040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbbb15-76e9-442c-909a-f347eb0051f8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:53.138220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbbb15-76e9-442c-909a-f347eb0051f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:53.151447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff2f0-69ae-4582-9e13-e2b625b267aa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:53.207765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9bfbbb15-76e9-442c-909a-f347eb0051f8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:53.209086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9bfbbb15-76e9-442c-909a-f347eb0051f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:53.273803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe12679-5933-4f83-aa98-6a4d14d0f671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:53.274345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe12679-5933-4f83-aa98-6a4d14d0f671 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:53.274605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe12679-5933-4f83-aa98-6a4d14d0f671 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:53.275015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe12679-5933-4f83-aa98-6a4d14d0f671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:53.363501 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1721/3422] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:53.412115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbbb15-76e9-442c-909a-f347eb0051f8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:53.463736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbbb15-76e9-442c-909a-f347eb0051f8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:53.470502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af193d-a45d-43f6-8537-63a7125f083a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:53.471461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af193d-a45d-43f6-8537-63a7125f083a service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:53.471923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af193d-a45d-43f6-8537-63a7125f083a service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:53.472411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af193d-a45d-43f6-8537-63a7125f083a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:53.476380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe12679-5933-4f83-aa98-6a4d14d0f671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:53.477838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe12679-5933-4f83-aa98-6a4d14d0f671 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:53.488046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af193d-a45d-43f6-8537-63a7125f083a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:53.490642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af193d-a45d-43f6-8537-63a7125f083a service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:53.507836 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1722/3424] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:11:53.508007 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1702/3424] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:54.600341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af193d-a45d-43f6-8537-63a7125f083a service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:54.601754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-14af193d-a45d-43f6-8537-63a7125f083a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:54.623796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af193d-a45d-43f6-8537-63a7125f083a service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:54.629720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a5f16-e97c-44af-8083-c52aeed21973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:54.630409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a5f16-e97c-44af-8083-c52aeed21973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:54.630693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a5f16-e97c-44af-8083-c52aeed21973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:54.631143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a5f16-e97c-44af-8083-c52aeed21973 admin admin] PATH_INFO: `/v3/projects/f6eaf1f531a34918b667dd13ee546c3c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:54.633838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a5f16-e97c-44af-8083-c52aeed21973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6eaf1f531a34918b667dd13ee546c3c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:54.636645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a5f16-e97c-44af-8083-c52aeed21973 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:54.797441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-de8a5f16-e97c-44af-8083-c52aeed21973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6eaf1f531a34918b667dd13ee546c3c', 'request_id': 'req-de8a5f16-e97c-44af-8083-c52aeed21973'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:54.807132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-de8a5f16-e97c-44af-8083-c52aeed21973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6eaf1f531a34918b667dd13ee546c3c', 'request_id': 'req-de8a5f16-e97c-44af-8083-c52aeed21973'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:54.818849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-de8a5f16-e97c-44af-8083-c52aeed21973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6eaf1f531a34918b667dd13ee546c3c', 'request_id': 'req-de8a5f16-e97c-44af-8083-c52aeed21973'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:54.836602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-de8a5f16-e97c-44af-8083-c52aeed21973 admin admin] The token cache is being invalidate because project f6eaf1f531a34918b667dd13ee546c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:54.836894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-de8a5f16-e97c-44af-8083-c52aeed21973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:54.838742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-de8a5f16-e97c-44af-8083-c52aeed21973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:54.840848 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1723/3425] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:54 2022] DELETE /identity/v3/projects/f6eaf1f531a34918b667dd13ee546c3c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:54.845029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe12679-5933-4f83-aa98-6a4d14d0f671 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:54.864752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe12679-5933-4f83-aa98-6a4d14d0f671 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:55.019913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:55.020684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:55.020974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:55.021253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] PATH_INFO: `/v3/users/23d6dd2f36be41388c2227c785b0753c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:55.028041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d6dd2f36be41388c2227c785b0753c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:55.030078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:55.168520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d6dd2f36be41388c2227c785b0753c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:55.170515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d6dd2f36be41388c2227c785b0753c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:55.193397 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:55.207761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d6dd2f36be41388c2227c785b0753c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:55.227136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d6dd2f36be41388c2227c785b0753c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:55.228809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d6dd2f36be41388c2227c785b0753c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:55.288991 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1703/3426] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:54 2022] DELETE /identity/v3/users/23d6dd2f36be41388c2227c785b0753c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:56.197445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe223196-5a5f-4b85-b363-ba1df3ee4273 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:56.197973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe223196-5a5f-4b85-b363-ba1df3ee4273 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:56.197973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe223196-5a5f-4b85-b363-ba1df3ee4273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:56.260791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fe223196-5a5f-4b85-b363-ba1df3ee4273 None None] MFA Rules not processed for user `befcf8a010bb48d3a174a52ea94d012e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:56.262426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fe223196-5a5f-4b85-b363-ba1df3ee4273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:56.282380 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:56.493143 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1724/3427] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:56.507201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:56.509312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:56.672428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf7e84-1dc8-433f-a69b-0941f6c1ebb7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:56.678568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d03d34-56c7-4071-99fa-15582726e069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:56.679380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d03d34-56c7-4071-99fa-15582726e069 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:56.679666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d03d34-56c7-4071-99fa-15582726e069 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:56.679941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d03d34-56c7-4071-99fa-15582726e069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:56.696269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d03d34-56c7-4071-99fa-15582726e069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:56.697947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d03d34-56c7-4071-99fa-15582726e069 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:56.730458 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1704/3428] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:56.943077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe223196-5a5f-4b85-b363-ba1df3ee4273 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:56.945745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fe223196-5a5f-4b85-b363-ba1df3ee4273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:57.064015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe223196-5a5f-4b85-b363-ba1df3ee4273 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:57.077905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:57.078903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:57.080222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:57.080599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] PATH_INFO: `/v3/projects/84be84455fa74c24ad8304157689a6e8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:57.082010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84be84455fa74c24ad8304157689a6e8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:57.084513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:57.211536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84be84455fa74c24ad8304157689a6e8', 'request_id': 'req-a8fdba5e-868c-4d3d-8fba-64cc07285831'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:57.242292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84be84455fa74c24ad8304157689a6e8', 'request_id': 'req-a8fdba5e-868c-4d3d-8fba-64cc07285831'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:57.257282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84be84455fa74c24ad8304157689a6e8', 'request_id': 'req-a8fdba5e-868c-4d3d-8fba-64cc07285831'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:57.271960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] The token cache is being invalidate because project 84be84455fa74c24ad8304157689a6e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:57.272556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:57.273395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:57.278848 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1725/3429] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:56 2022] DELETE /identity/v3/projects/84be84455fa74c24ad8304157689a6e8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:57.279925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d03d34-56c7-4071-99fa-15582726e069 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:57.302198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d03d34-56c7-4071-99fa-15582726e069 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:57.442050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae4aba-7787-4069-a080-1841ba6794cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:57.444543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4aba-7787-4069-a080-1841ba6794cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:57.449815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4aba-7787-4069-a080-1841ba6794cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:57.451415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4aba-7787-4069-a080-1841ba6794cc admin admin] PATH_INFO: `/v3/users/c211efdd2a2745f3a302c243f4ce1964` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:57.453067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae4aba-7787-4069-a080-1841ba6794cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c211efdd2a2745f3a302c243f4ce1964)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:57.461360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae4aba-7787-4069-a080-1841ba6794cc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:57.580956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2fae4aba-7787-4069-a080-1841ba6794cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c211efdd2a2745f3a302c243f4ce1964'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:57.581987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2fae4aba-7787-4069-a080-1841ba6794cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c211efdd2a2745f3a302c243f4ce1964'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:57.616379 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:57.629178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2fae4aba-7787-4069-a080-1841ba6794cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c211efdd2a2745f3a302c243f4ce1964'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:57.647486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2fae4aba-7787-4069-a080-1841ba6794cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c211efdd2a2745f3a302c243f4ce1964'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:57.649201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2fae4aba-7787-4069-a080-1841ba6794cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c211efdd2a2745f3a302c243f4ce1964'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:57.680698 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1705/3430] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:11:57 2022] DELETE /identity/v3/users/c211efdd2a2745f3a302c243f4ce1964 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:11:59.278250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:59.283108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:59.307246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdba5e-868c-4d3d-8fba-64cc07285831 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:59.448793 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:59.487883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91c4a5-4350-4f5d-915e-da04e4629909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:59.488904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91c4a5-4350-4f5d-915e-da04e4629909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:59.489400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91c4a5-4350-4f5d-915e-da04e4629909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:59.489820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91c4a5-4350-4f5d-915e-da04e4629909 admin admin] PATH_INFO: `/v3/projects/92049268d16940af898e86019eb6966b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:59.491206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91c4a5-4350-4f5d-915e-da04e4629909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92049268d16940af898e86019eb6966b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:59.494011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91c4a5-4350-4f5d-915e-da04e4629909 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:59.681032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b91c4a5-4350-4f5d-915e-da04e4629909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92049268d16940af898e86019eb6966b', 'request_id': 'req-2b91c4a5-4350-4f5d-915e-da04e4629909'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:59.701847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b91c4a5-4350-4f5d-915e-da04e4629909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92049268d16940af898e86019eb6966b', 'request_id': 'req-2b91c4a5-4350-4f5d-915e-da04e4629909'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:59.720534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b91c4a5-4350-4f5d-915e-da04e4629909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92049268d16940af898e86019eb6966b', 'request_id': 'req-2b91c4a5-4350-4f5d-915e-da04e4629909'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:59.748266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b91c4a5-4350-4f5d-915e-da04e4629909 admin admin] The token cache is being invalidate because project 92049268d16940af898e86019eb6966b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:11:59.748580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b91c4a5-4350-4f5d-915e-da04e4629909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:59.749855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b91c4a5-4350-4f5d-915e-da04e4629909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:11:59.756275 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1726/3431] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:59 2022] DELETE /identity/v3/projects/92049268d16940af898e86019eb6966b => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:11:59.758269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e4927-3b1f-40cc-9cd6-eb7d240c69d4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:59.758714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e4927-3b1f-40cc-9cd6-eb7d240c69d4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:59.758845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e4927-3b1f-40cc-9cd6-eb7d240c69d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:59.817727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-413e4927-3b1f-40cc-9cd6-eb7d240c69d4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:11:59.819188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-413e4927-3b1f-40cc-9cd6-eb7d240c69d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:59.961780 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1706/3432] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:11:59.969864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f4b1f-a44c-4fcd-918b-b2b123edd99d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:59.970142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f4b1f-a44c-4fcd-918b-b2b123edd99d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:59.970593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f4b1f-a44c-4fcd-918b-b2b123edd99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:00.002164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8d5f4b1f-a44c-4fcd-918b-b2b123edd99d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:00.003501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8d5f4b1f-a44c-4fcd-918b-b2b123edd99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:00.017717 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1727/3433] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:00.021844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e4927-3b1f-40cc-9cd6-eb7d240c69d4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:00.040066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e4927-3b1f-40cc-9cd6-eb7d240c69d4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:00.048750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bbca6-f7fc-4b99-af68-b43c3c383fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:00.049973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bbca6-f7fc-4b99-af68-b43c3c383fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:00.050474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bbca6-f7fc-4b99-af68-b43c3c383fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:00.051123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bbca6-f7fc-4b99-af68-b43c3c383fe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:00.052234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bbca6-f7fc-4b99-af68-b43c3c383fe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:12:00.052954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bbca6-f7fc-4b99-af68-b43c3c383fe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:00.055677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bbca6-f7fc-4b99-af68-b43c3c383fe6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:00.084460 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1707/3434] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:12:00.090435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f4b1f-a44c-4fcd-918b-b2b123edd99d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:00.101878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f4b1f-a44c-4fcd-918b-b2b123edd99d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:00.115599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca253fc-42b3-4ca5-91f3-4d32c0660913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:00.117113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca253fc-42b3-4ca5-91f3-4d32c0660913 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:00.119120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca253fc-42b3-4ca5-91f3-4d32c0660913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:00.119323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca253fc-42b3-4ca5-91f3-4d32c0660913 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:00.122046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca253fc-42b3-4ca5-91f3-4d32c0660913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:00.124250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca253fc-42b3-4ca5-91f3-4d32c0660913 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:00.184202 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1728/3435] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:12:00 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:12:00.188179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bbca6-f7fc-4b99-af68-b43c3c383fe6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:00.205512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bbca6-f7fc-4b99-af68-b43c3c383fe6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:00.303559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ef8de-4f59-4609-b4c6-418a8694b81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:00.304342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ef8de-4f59-4609-b4c6-418a8694b81e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:00.305104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ef8de-4f59-4609-b4c6-418a8694b81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:00.305530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ef8de-4f59-4609-b4c6-418a8694b81e admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:00.307817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ef8de-4f59-4609-b4c6-418a8694b81e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:00.318404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ef8de-4f59-4609-b4c6-418a8694b81e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:00.370847 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1708/3436] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:12:00 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:12:00.375961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca253fc-42b3-4ca5-91f3-4d32c0660913 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:00.401285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca253fc-42b3-4ca5-91f3-4d32c0660913 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:00.415631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49ed1-ea52-43fb-9a2f-4f33cae9a8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:00.416262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49ed1-ea52-43fb-9a2f-4f33cae9a8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:00.416542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49ed1-ea52-43fb-9a2f-4f33cae9a8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:00.416815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49ed1-ea52-43fb-9a2f-4f33cae9a8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:00.417521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb49ed1-ea52-43fb-9a2f-4f33cae9a8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:00.419771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb49ed1-ea52-43fb-9a2f-4f33cae9a8e4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:00.449048 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1729/3437] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:12:00.453558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ef8de-4f59-4609-b4c6-418a8694b81e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:00.470172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ef8de-4f59-4609-b4c6-418a8694b81e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:00.482218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b5ff1-24d6-4286-aad8-c0c779327476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:00.484089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b5ff1-24d6-4286-aad8-c0c779327476 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:00.484511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b5ff1-24d6-4286-aad8-c0c779327476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:00.484913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b5ff1-24d6-4286-aad8-c0c779327476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:00.486557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b5ff1-24d6-4286-aad8-c0c779327476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:00.490481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b5ff1-24d6-4286-aad8-c0c779327476 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:00.520390 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1709/3438] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:12:00.525985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49ed1-ea52-43fb-9a2f-4f33cae9a8e4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:00.541512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49ed1-ea52-43fb-9a2f-4f33cae9a8e4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:00.554476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6811e87-e338-4961-ba0e-f2d5e0cdcac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:00.555396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6811e87-e338-4961-ba0e-f2d5e0cdcac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:00.555684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6811e87-e338-4961-ba0e-f2d5e0cdcac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:00.556555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6811e87-e338-4961-ba0e-f2d5e0cdcac7 admin admin] PATH_INFO: `/v3/projects/9ac16855ff374f4ca671f66bc1213542/users/e054787c98ac46d7ad0323e4c29bd241/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:00.594472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6811e87-e338-4961-ba0e-f2d5e0cdcac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac16855ff374f4ca671f66bc1213542, user_id=e054787c98ac46d7ad0323e4c29bd241, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:00.598640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6811e87-e338-4961-ba0e-f2d5e0cdcac7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:00.660996 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1730/3439] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:12:00 2022] PUT /identity/v3/projects/9ac16855ff374f4ca671f66bc1213542/users/e054787c98ac46d7ad0323e4c29bd241/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:00.664403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cccd6-b97f-4906-9e4d-3f614827176d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:00.664765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cccd6-b97f-4906-9e4d-3f614827176d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:00.665039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cccd6-b97f-4906-9e4d-3f614827176d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:00.732308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-166cccd6-b97f-4906-9e4d-3f614827176d None None] MFA Rules not processed for user `e054787c98ac46d7ad0323e4c29bd241`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:00.734018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-166cccd6-b97f-4906-9e4d-3f614827176d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:00.814251 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:00.873475 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1710/3440] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:00.877701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6811e87-e338-4961-ba0e-f2d5e0cdcac7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:01.027880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6811e87-e338-4961-ba0e-f2d5e0cdcac7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:01.038161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70050e84-d2a0-4635-999f-8ec480cef800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:01.039192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050e84-d2a0-4635-999f-8ec480cef800 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:01.039901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050e84-d2a0-4635-999f-8ec480cef800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:01.041206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050e84-d2a0-4635-999f-8ec480cef800 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:01.052289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70050e84-d2a0-4635-999f-8ec480cef800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:01.055348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70050e84-d2a0-4635-999f-8ec480cef800 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:01.081420 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:01.111049 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1731/3441] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:12:00 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:12:01.114956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cccd6-b97f-4906-9e4d-3f614827176d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:01.138789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cccd6-b97f-4906-9e4d-3f614827176d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:01.300734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a51f63-0000-4f20-ab7f-ddf9ab83889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:01.301893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a51f63-0000-4f20-ab7f-ddf9ab83889b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:01.308960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a51f63-0000-4f20-ab7f-ddf9ab83889b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:01.309430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a51f63-0000-4f20-ab7f-ddf9ab83889b admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:01.310278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a51f63-0000-4f20-ab7f-ddf9ab83889b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:01.313417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a51f63-0000-4f20-ab7f-ddf9ab83889b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:01.350280 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1711/3442] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:12:01 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:12:01.352111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70050e84-d2a0-4635-999f-8ec480cef800 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:01.372952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70050e84-d2a0-4635-999f-8ec480cef800 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:01.393291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fede92-f902-4b32-9587-8dc40dc68927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:01.393949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fede92-f902-4b32-9587-8dc40dc68927 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:01.394344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fede92-f902-4b32-9587-8dc40dc68927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:01.394702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fede92-f902-4b32-9587-8dc40dc68927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:01.396894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fede92-f902-4b32-9587-8dc40dc68927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:01.402327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fede92-f902-4b32-9587-8dc40dc68927 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:01.435274 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1732/3443] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:12:01.439208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a51f63-0000-4f20-ab7f-ddf9ab83889b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:01.450865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a51f63-0000-4f20-ab7f-ddf9ab83889b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:01.458359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1630c60-eca8-4643-a04f-e5fbdc674dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:01.459118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1630c60-eca8-4643-a04f-e5fbdc674dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:01.459399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1630c60-eca8-4643-a04f-e5fbdc674dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:01.459674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1630c60-eca8-4643-a04f-e5fbdc674dcb admin admin] PATH_INFO: `/v3/projects/c77eb4be189747e2828a98f817c7d0ae/users/a25c0a7113cf42018616ded36dbfd985/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:01.499309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1630c60-eca8-4643-a04f-e5fbdc674dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77eb4be189747e2828a98f817c7d0ae, user_id=a25c0a7113cf42018616ded36dbfd985, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:01.503082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1630c60-eca8-4643-a04f-e5fbdc674dcb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:01.557051 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1712/3444] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:12:01 2022] PUT /identity/v3/projects/c77eb4be189747e2828a98f817c7d0ae/users/a25c0a7113cf42018616ded36dbfd985/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:01.561007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fede92-f902-4b32-9587-8dc40dc68927 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:01.603839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fede92-f902-4b32-9587-8dc40dc68927 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:01.762726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dfd0a-8a85-42c0-911d-8994909356ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:01.763388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dfd0a-8a85-42c0-911d-8994909356ad admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:01.763671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dfd0a-8a85-42c0-911d-8994909356ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:01.763946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dfd0a-8a85-42c0-911d-8994909356ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:01.768538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599dfd0a-8a85-42c0-911d-8994909356ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:01.773882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599dfd0a-8a85-42c0-911d-8994909356ad admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:01.803676 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1733/3445] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:12:01.807955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1630c60-eca8-4643-a04f-e5fbdc674dcb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:01.824169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1630c60-eca8-4643-a04f-e5fbdc674dcb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:01.830418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18d1c6-bc1b-44db-902d-3f8d0c511ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:01.831410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18d1c6-bc1b-44db-902d-3f8d0c511ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:01.831903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18d1c6-bc1b-44db-902d-3f8d0c511ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:01.832410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18d1c6-bc1b-44db-902d-3f8d0c511ae5 admin admin] PATH_INFO: `/v3/projects/c77eb4be189747e2828a98f817c7d0ae/users/a25c0a7113cf42018616ded36dbfd985/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:01.835577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18d1c6-bc1b-44db-902d-3f8d0c511ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77eb4be189747e2828a98f817c7d0ae, user_id=a25c0a7113cf42018616ded36dbfd985, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:01.840229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18d1c6-bc1b-44db-902d-3f8d0c511ae5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:01.867347 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1713/3446] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:12:01 2022] PUT /identity/v3/projects/c77eb4be189747e2828a98f817c7d0ae/users/a25c0a7113cf42018616ded36dbfd985/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:01.870987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee12ce1-e4f3-44e0-8ee4-93370653be60 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:01.871284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee12ce1-e4f3-44e0-8ee4-93370653be60 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:01.871561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee12ce1-e4f3-44e0-8ee4-93370653be60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:01.908171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8ee12ce1-e4f3-44e0-8ee4-93370653be60 None None] MFA Rules not processed for user `a25c0a7113cf42018616ded36dbfd985`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:01.909674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8ee12ce1-e4f3-44e0-8ee4-93370653be60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:02.016913 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1734/3447] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:02.051877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18d1c6-bc1b-44db-902d-3f8d0c511ae5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:02.053633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0f18d1c6-bc1b-44db-902d-3f8d0c511ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:02.162359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18d1c6-bc1b-44db-902d-3f8d0c511ae5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:02.166653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338f905-fce4-4c73-9624-717e002cb53f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:02.167486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338f905-fce4-4c73-9624-717e002cb53f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:02.167910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338f905-fce4-4c73-9624-717e002cb53f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:02.168356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338f905-fce4-4c73-9624-717e002cb53f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:02.183870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338f905-fce4-4c73-9624-717e002cb53f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:02.185325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338f905-fce4-4c73-9624-717e002cb53f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:02.199529 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1714/3448] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:12:03.216497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217a53-8730-47c1-8a26-e3f4ea3b58f3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:03.217356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217a53-8730-47c1-8a26-e3f4ea3b58f3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:03.217781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217a53-8730-47c1-8a26-e3f4ea3b58f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:03.243886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b1217a53-8730-47c1-8a26-e3f4ea3b58f3 None None] MFA Rules not processed for user `befcf8a010bb48d3a174a52ea94d012e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:03.245695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b1217a53-8730-47c1-8a26-e3f4ea3b58f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:03.382537 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1735/3449] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:06.441700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1d67-a1df-45e5-8d90-3c26817a9f13 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:06.442285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1d67-a1df-45e5-8d90-3c26817a9f13 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:06.442399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1d67-a1df-45e5-8d90-3c26817a9f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:06.505451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-75ab1d67-a1df-45e5-8d90-3c26817a9f13 None None] MFA Rules not processed for user `df9979f0dcd74d60a55d02d432de6a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:06.506749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-75ab1d67-a1df-45e5-8d90-3c26817a9f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:06.598247 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:06.711577 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1715/3450] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:07.924647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0fce2-5fb3-4009-800b-cddf3338616c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:07.925191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0fce2-5fb3-4009-800b-cddf3338616c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:07.925191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0fce2-5fb3-4009-800b-cddf3338616c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:07.968713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c3e0fce2-5fb3-4009-800b-cddf3338616c None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:07.974054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c3e0fce2-5fb3-4009-800b-cddf3338616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:07.984501 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:08.131025 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1736/3451] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:12:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:08.139281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1d67-a1df-45e5-8d90-3c26817a9f13 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:08.140769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-75ab1d67-a1df-45e5-8d90-3c26817a9f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:08.309380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1d67-a1df-45e5-8d90-3c26817a9f13 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:08.319155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a7b7b-5352-4408-895c-ab553e4f4c7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:08.320954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a7b7b-5352-4408-895c-ab553e4f4c7f service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:08.322287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a7b7b-5352-4408-895c-ab553e4f4c7f service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:08.323276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a7b7b-5352-4408-895c-ab553e4f4c7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:08.339529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a7b7b-5352-4408-895c-ab553e4f4c7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:08.341726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a7b7b-5352-4408-895c-ab553e4f4c7f service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:08.362267 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1716/3452] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:12:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:09.061003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0fce2-5fb3-4009-800b-cddf3338616c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:09.078165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0fce2-5fb3-4009-800b-cddf3338616c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:09.084980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4acc3-214e-4465-801a-bb3ea05a52d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:09.085597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4acc3-214e-4465-801a-bb3ea05a52d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:09.085869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4acc3-214e-4465-801a-bb3ea05a52d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:09.086294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4acc3-214e-4465-801a-bb3ea05a52d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:09.255395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4acc3-214e-4465-801a-bb3ea05a52d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:09.257100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4acc3-214e-4465-801a-bb3ea05a52d2 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:09.280212 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1737/3453] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:12:11.422882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e82d80-8bbb-4748-ba32-77e0c891e84a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:11.423423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e82d80-8bbb-4748-ba32-77e0c891e84a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:11.423526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e82d80-8bbb-4748-ba32-77e0c891e84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:11.528456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a7e82d80-8bbb-4748-ba32-77e0c891e84a None None] MFA Rules not processed for user `ebca99f6818548b982e94948327522b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:11.531867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a7e82d80-8bbb-4748-ba32-77e0c891e84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:11.732018 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1717/3454] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:12.785867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4acc3-214e-4465-801a-bb3ea05a52d2 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:12.787578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7ed4acc3-214e-4465-801a-bb3ea05a52d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:12.973265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4acc3-214e-4465-801a-bb3ea05a52d2 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:12.985673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1b2b1-4b36-4de8-a0a5-c38ea547e790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:12.987486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1b2b1-4b36-4de8-a0a5-c38ea547e790 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:12.987835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1b2b1-4b36-4de8-a0a5-c38ea547e790 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:12.988089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1b2b1-4b36-4de8-a0a5-c38ea547e790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:13.010429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1b2b1-4b36-4de8-a0a5-c38ea547e790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:13.015407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1b2b1-4b36-4de8-a0a5-c38ea547e790 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:13.032865 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1738/3455] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:12:13.052972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e82d80-8bbb-4748-ba32-77e0c891e84a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:13.195852 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:13.242133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e82d80-8bbb-4748-ba32-77e0c891e84a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:13.298384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:13.301667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:13.301953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:13.302227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] PATH_INFO: `/v3/users/e054787c98ac46d7ad0323e4c29bd241` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:13.304486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e054787c98ac46d7ad0323e4c29bd241)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:13.307467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:13.431668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e054787c98ac46d7ad0323e4c29bd241'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:13.432359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e054787c98ac46d7ad0323e4c29bd241'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:13.448475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e054787c98ac46d7ad0323e4c29bd241'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:13.462592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e054787c98ac46d7ad0323e4c29bd241'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:13.463775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e054787c98ac46d7ad0323e4c29bd241'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:13.498028 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1718/3456] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:12:13 2022] DELETE /identity/v3/users/e054787c98ac46d7ad0323e4c29bd241 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:13.502943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fb7a-4b9d-4510-aa45-56074559a6ff None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:13.503225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fb7a-4b9d-4510-aa45-56074559a6ff None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:13.503834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fb7a-4b9d-4510-aa45-56074559a6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:13.542850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ba67fb7a-4b9d-4510-aa45-56074559a6ff None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:13.550440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ba67fb7a-4b9d-4510-aa45-56074559a6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:13.654104 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:13.718486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:13.720240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:13.728120 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1739/3457] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:13.754278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10c92e-38f3-43d6-ab6c-df6c8a015684 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:13.763710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:13.764589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:13.764873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:13.765659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] PATH_INFO: `/v3/users/3c33afd9ae144eb185203c30baa70351` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:13.768910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c33afd9ae144eb185203c30baa70351)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:13.774756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:13.833265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67fb7a-4b9d-4510-aa45-56074559a6ff None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:13.835733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ba67fb7a-4b9d-4510-aa45-56074559a6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:13.880650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c33afd9ae144eb185203c30baa70351'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:13.884436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c33afd9ae144eb185203c30baa70351'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:13.935905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c33afd9ae144eb185203c30baa70351'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:13.953484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c33afd9ae144eb185203c30baa70351'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:13.954209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c33afd9ae144eb185203c30baa70351'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:13.982881 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1719/3458] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:12:13 2022] DELETE /identity/v3/users/3c33afd9ae144eb185203c30baa70351 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:14.000946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67fb7a-4b9d-4510-aa45-56074559a6ff None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:14.121429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884865c-5064-464b-a922-fcc50c5bde4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:14.123533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884865c-5064-464b-a922-fcc50c5bde4d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:14.123734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884865c-5064-464b-a922-fcc50c5bde4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:14.124276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884865c-5064-464b-a922-fcc50c5bde4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:14.126664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4884865c-5064-464b-a922-fcc50c5bde4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:14.373206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884865c-5064-464b-a922-fcc50c5bde4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:14.380057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884865c-5064-464b-a922-fcc50c5bde4d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:14.417670 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1740/3459] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:12:14.995246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:14.997424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:15.029697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9b752-dd37-446f-942d-511028426d2c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:15.050404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:15.051265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:15.051795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:15.052064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] PATH_INFO: `/v3/projects/05a68224ef104af2963c881faa8383de` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:15.053847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a68224ef104af2963c881faa8383de)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:15.064279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:15.167356 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=75,keystone:DELETE=23,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:15.188420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a68224ef104af2963c881faa8383de', 'request_id': 'req-aeb7f074-404c-4f30-a29f-1d8d752b5252'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:15.255444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a68224ef104af2963c881faa8383de', 'request_id': 'req-aeb7f074-404c-4f30-a29f-1d8d752b5252'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:15.279943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a68224ef104af2963c881faa8383de', 'request_id': 'req-aeb7f074-404c-4f30-a29f-1d8d752b5252'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:15.332058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] The token cache is being invalidate because project 05a68224ef104af2963c881faa8383de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:12:15.332365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:15.334243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:15.342985 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1720/3460] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:12:14 2022] DELETE /identity/v3/projects/05a68224ef104af2963c881faa8383de => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:15.343229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884865c-5064-464b-a922-fcc50c5bde4d service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:15.356834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884865c-5064-464b-a922-fcc50c5bde4d service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:15.480699 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:15.542182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:15.543040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:15.543432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:15.543808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] PATH_INFO: `/v3/users/f763fa3c3d314867b792913013b65505` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:15.552700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f763fa3c3d314867b792913013b65505)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:15.564241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:15.719031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:15.720806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:15.740920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f763fa3c3d314867b792913013b65505'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:15.742527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f763fa3c3d314867b792913013b65505'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:15.748809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7f074-404c-4f30-a29f-1d8d752b5252 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:15.789248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:15.791121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:15.795028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:15.795592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] PATH_INFO: `/v3/projects/9ac16855ff374f4ca671f66bc1213542` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:15.795723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f763fa3c3d314867b792913013b65505'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:15.801142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac16855ff374f4ca671f66bc1213542)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:15.809679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:15.812966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f763fa3c3d314867b792913013b65505'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:15.813712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f763fa3c3d314867b792913013b65505'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:15.861845 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1741/3461] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:12:15 2022] DELETE /identity/v3/users/f763fa3c3d314867b792913013b65505 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:12:16.010400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac16855ff374f4ca671f66bc1213542', 'request_id': 'req-fa4db293-bd4b-4842-9c68-683e00e087e7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:16.031648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac16855ff374f4ca671f66bc1213542', 'request_id': 'req-fa4db293-bd4b-4842-9c68-683e00e087e7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:16.090654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac16855ff374f4ca671f66bc1213542', 'request_id': 'req-fa4db293-bd4b-4842-9c68-683e00e087e7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:16.127628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] The token cache is being invalidate because project 9ac16855ff374f4ca671f66bc1213542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:12:16.127856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:16.130367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:16.135365 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1721/3462] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:12:15 2022] DELETE /identity/v3/projects/9ac16855ff374f4ca671f66bc1213542 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:16.139198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:16.140870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:16.347500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2bfef-b342-479c-bbc0-a18e392869f7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:16.525879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fc357-576c-46e7-a0b6-1034d221e570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:16.528867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fc357-576c-46e7-a0b6-1034d221e570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:16.531983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fc357-576c-46e7-a0b6-1034d221e570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:16.534329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fc357-576c-46e7-a0b6-1034d221e570 admin admin] PATH_INFO: `/v3/users/a25c0a7113cf42018616ded36dbfd985` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:16.536421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fc357-576c-46e7-a0b6-1034d221e570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25c0a7113cf42018616ded36dbfd985)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:16.546971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fc357-576c-46e7-a0b6-1034d221e570 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:16.612199 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:16.709406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cb2fc357-576c-46e7-a0b6-1034d221e570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25c0a7113cf42018616ded36dbfd985'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:16.715094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cb2fc357-576c-46e7-a0b6-1034d221e570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25c0a7113cf42018616ded36dbfd985'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:16.780093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cb2fc357-576c-46e7-a0b6-1034d221e570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25c0a7113cf42018616ded36dbfd985'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:16.796960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cb2fc357-576c-46e7-a0b6-1034d221e570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25c0a7113cf42018616ded36dbfd985'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:16.797996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cb2fc357-576c-46e7-a0b6-1034d221e570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25c0a7113cf42018616ded36dbfd985'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:16.831567 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1742/3463] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:12:16 2022] DELETE /identity/v3/users/a25c0a7113cf42018616ded36dbfd985 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:17.030075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:17.032342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:17.054588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4db293-bd4b-4842-9c68-683e00e087e7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:17.252286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:17.253057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:17.253839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:17.254126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] PATH_INFO: `/v3/projects/d52b6331f10047d893139c0cbfbc8b97` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:17.255344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52b6331f10047d893139c0cbfbc8b97)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:17.257348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:17.382005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52b6331f10047d893139c0cbfbc8b97', 'request_id': 'req-adcd187d-d9f8-413f-9e31-a4ed7905a99d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:17.388584 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:17.397554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52b6331f10047d893139c0cbfbc8b97', 'request_id': 'req-adcd187d-d9f8-413f-9e31-a4ed7905a99d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:17.419244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52b6331f10047d893139c0cbfbc8b97', 'request_id': 'req-adcd187d-d9f8-413f-9e31-a4ed7905a99d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:17.437566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] The token cache is being invalidate because project d52b6331f10047d893139c0cbfbc8b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:12:17.437971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:17.439672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:17.444825 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1722/3464] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:12:17 2022] DELETE /identity/v3/projects/d52b6331f10047d893139c0cbfbc8b97 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:17.446420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b1701-ac13-4ac2-a2d0-780dc5aaeeab None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:17.446910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b1701-ac13-4ac2-a2d0-780dc5aaeeab None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:17.447085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b1701-ac13-4ac2-a2d0-780dc5aaeeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:17.504572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a74b1701-ac13-4ac2-a2d0-780dc5aaeeab None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:17.509733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a74b1701-ac13-4ac2-a2d0-780dc5aaeeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:17.591317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:17.593114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:17.673587 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1743/3465] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:17.676997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110556-8d5b-4111-a89f-3159893f836d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:17.677288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110556-8d5b-4111-a89f-3159893f836d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:17.677563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110556-8d5b-4111-a89f-3159893f836d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:17.719899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b9110556-8d5b-4111-a89f-3159893f836d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:17.721247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b9110556-8d5b-4111-a89f-3159893f836d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:17.740259 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1744/3466] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:12:17.745157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9110556-8d5b-4111-a89f-3159893f836d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:17.763668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9110556-8d5b-4111-a89f-3159893f836d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:17.775111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686457de-709b-4a4a-914d-bfdfe9f86df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:17.775827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686457de-709b-4a4a-914d-bfdfe9f86df7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:17.776105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686457de-709b-4a4a-914d-bfdfe9f86df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:17.776376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686457de-709b-4a4a-914d-bfdfe9f86df7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:17.777020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686457de-709b-4a4a-914d-bfdfe9f86df7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:12:17.777318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686457de-709b-4a4a-914d-bfdfe9f86df7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:17.777437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd187d-d9f8-413f-9e31-a4ed7905a99d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:17.778952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686457de-709b-4a4a-914d-bfdfe9f86df7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:17.785738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e4b96-773e-456d-bd19-cfdf5253133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:17.788334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e4b96-773e-456d-bd19-cfdf5253133b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:17.788334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e4b96-773e-456d-bd19-cfdf5253133b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:17.788334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e4b96-773e-456d-bd19-cfdf5253133b admin admin] PATH_INFO: `/v3/projects/c77eb4be189747e2828a98f817c7d0ae` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:17.789540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e4b96-773e-456d-bd19-cfdf5253133b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77eb4be189747e2828a98f817c7d0ae)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:17.795698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e4b96-773e-456d-bd19-cfdf5253133b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:17.815198 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1745/3467] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:12:17.819162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686457de-709b-4a4a-914d-bfdfe9f86df7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:17.836984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686457de-709b-4a4a-914d-bfdfe9f86df7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:17.843648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403df45e-96d8-4470-ac7b-702104bb28e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:17.844275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403df45e-96d8-4470-ac7b-702104bb28e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:17.844568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403df45e-96d8-4470-ac7b-702104bb28e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:17.844945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403df45e-96d8-4470-ac7b-702104bb28e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:17.845584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403df45e-96d8-4470-ac7b-702104bb28e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:17.848372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403df45e-96d8-4470-ac7b-702104bb28e0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:17.909367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-795e4b96-773e-456d-bd19-cfdf5253133b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77eb4be189747e2828a98f817c7d0ae', 'request_id': 'req-795e4b96-773e-456d-bd19-cfdf5253133b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:17.910059 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1746/3468] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:12:17 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:12:17.914242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403df45e-96d8-4470-ac7b-702104bb28e0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:17.917425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-795e4b96-773e-456d-bd19-cfdf5253133b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77eb4be189747e2828a98f817c7d0ae', 'request_id': 'req-795e4b96-773e-456d-bd19-cfdf5253133b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:17.938327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-795e4b96-773e-456d-bd19-cfdf5253133b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77eb4be189747e2828a98f817c7d0ae', 'request_id': 'req-795e4b96-773e-456d-bd19-cfdf5253133b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:17.972677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-795e4b96-773e-456d-bd19-cfdf5253133b admin admin] The token cache is being invalidate because project c77eb4be189747e2828a98f817c7d0ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:12:17.973472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-795e4b96-773e-456d-bd19-cfdf5253133b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:17.974133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-795e4b96-773e-456d-bd19-cfdf5253133b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:17.975931 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1723/3469] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:12:17 2022] DELETE /identity/v3/projects/c77eb4be189747e2828a98f817c7d0ae => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:17.982471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c661f8-e9a7-4435-becb-09a0f5485958 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:17.983933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c661f8-e9a7-4435-becb-09a0f5485958 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:17.984229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c661f8-e9a7-4435-becb-09a0f5485958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:18.011803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-61c661f8-e9a7-4435-becb-09a0f5485958 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:18.013175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-61c661f8-e9a7-4435-becb-09a0f5485958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:18.049682 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:18.082168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403df45e-96d8-4470-ac7b-702104bb28e0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:18.093295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c796e-1329-4af8-8b75-f59b0a5fbe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:18.093295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c796e-1329-4af8-8b75-f59b0a5fbe38 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:18.093295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c796e-1329-4af8-8b75-f59b0a5fbe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:18.093560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c796e-1329-4af8-8b75-f59b0a5fbe38 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:18.094185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c796e-1329-4af8-8b75-f59b0a5fbe38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:18.096125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c796e-1329-4af8-8b75-f59b0a5fbe38 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:18.130574 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1724/3470] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:18.139549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293449-b51c-44f9-b92a-00c14f1bbb9d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:18.140211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293449-b51c-44f9-b92a-00c14f1bbb9d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:18.140716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293449-b51c-44f9-b92a-00c14f1bbb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:18.153377 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1747/3471] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:12:17 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:12:18.154321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c796e-1329-4af8-8b75-f59b0a5fbe38 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:18.156565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-679c796e-1329-4af8-8b75-f59b0a5fbe38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:18.172389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c796e-1329-4af8-8b75-f59b0a5fbe38 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:18.175101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f7293449-b51c-44f9-b92a-00c14f1bbb9d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:18.177276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f7293449-b51c-44f9-b92a-00c14f1bbb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:18.177429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb5473-9a4f-4a3b-9185-b2876945b4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:18.178317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb5473-9a4f-4a3b-9185-b2876945b4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:18.178688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb5473-9a4f-4a3b-9185-b2876945b4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:18.179134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb5473-9a4f-4a3b-9185-b2876945b4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:18.179858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb5473-9a4f-4a3b-9185-b2876945b4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:18.182404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb5473-9a4f-4a3b-9185-b2876945b4c8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:18.189691 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1725/3472] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:18.193603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7293449-b51c-44f9-b92a-00c14f1bbb9d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:18.201149 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:18.206997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7293449-b51c-44f9-b92a-00c14f1bbb9d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:18.208152 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1748/3473] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:12:18.210242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb5473-9a4f-4a3b-9185-b2876945b4c8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:18.216795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61ac9b-e8c5-46e1-a549-0156f5e6af08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:18.221636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61ac9b-e8c5-46e1-a549-0156f5e6af08 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:18.222385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61ac9b-e8c5-46e1-a549-0156f5e6af08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:18.223024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61ac9b-e8c5-46e1-a549-0156f5e6af08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:18.224745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61ac9b-e8c5-46e1-a549-0156f5e6af08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:12:18.224745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61ac9b-e8c5-46e1-a549-0156f5e6af08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:18.227925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61ac9b-e8c5-46e1-a549-0156f5e6af08 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:18.235243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb5473-9a4f-4a3b-9185-b2876945b4c8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:18.248707 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1726/3474] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:12:18.252947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61ac9b-e8c5-46e1-a549-0156f5e6af08 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:18.253962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e1dd6-5a69-4159-b181-8c421d783713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:18.254584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e1dd6-5a69-4159-b181-8c421d783713 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:18.254859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e1dd6-5a69-4159-b181-8c421d783713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:18.255173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e1dd6-5a69-4159-b181-8c421d783713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:18.255806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e1dd6-5a69-4159-b181-8c421d783713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:18.257906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e1dd6-5a69-4159-b181-8c421d783713 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:18.274106 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1749/3475] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:12:18.275809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e1dd6-5a69-4159-b181-8c421d783713 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:18.277797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61ac9b-e8c5-46e1-a549-0156f5e6af08 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:18.286851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e1dd6-5a69-4159-b181-8c421d783713 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:18.288263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edab8b1-a7cd-40d7-abab-61d82336835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:18.289886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edab8b1-a7cd-40d7-abab-61d82336835e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:18.290171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edab8b1-a7cd-40d7-abab-61d82336835e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:18.290447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edab8b1-a7cd-40d7-abab-61d82336835e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:18.291951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edab8b1-a7cd-40d7-abab-61d82336835e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:18.294753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c7490-1f79-40e9-967f-cf222c41bdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:18.295466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c7490-1f79-40e9-967f-cf222c41bdf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:18.295744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c7490-1f79-40e9-967f-cf222c41bdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:18.296018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c7490-1f79-40e9-967f-cf222c41bdf9 admin admin] PATH_INFO: `/v3/projects/5c325a1382a84822b02f62d51b8cd163/users/7cbe5edbc4a040758d293b6932f52328/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:18.306834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edab8b1-a7cd-40d7-abab-61d82336835e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:18.329359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c7490-1f79-40e9-967f-cf222c41bdf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c325a1382a84822b02f62d51b8cd163, user_id=7cbe5edbc4a040758d293b6932f52328, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:18.339326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c7490-1f79-40e9-967f-cf222c41bdf9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:18.352191 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1727/3476] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:12:18 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:12:18.357960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edab8b1-a7cd-40d7-abab-61d82336835e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:18.393709 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1750/3477] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:12:18 2022] PUT /identity/v3/projects/5c325a1382a84822b02f62d51b8cd163/users/7cbe5edbc4a040758d293b6932f52328/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:18.396621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e2e46-6979-447d-83dd-166541838b8f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:18.397039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e2e46-6979-447d-83dd-166541838b8f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:18.397389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e2e46-6979-447d-83dd-166541838b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:18.450723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-777e2e46-6979-447d-83dd-166541838b8f None None] MFA Rules not processed for user `7cbe5edbc4a040758d293b6932f52328`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:18.452593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-777e2e46-6979-447d-83dd-166541838b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:18.577060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edab8b1-a7cd-40d7-abab-61d82336835e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:18.650440 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1751/3478] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:18.699240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be43bd-0836-46a2-9480-e5ccf9e92017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:18.700008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be43bd-0836-46a2-9480-e5ccf9e92017 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:18.700351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be43bd-0836-46a2-9480-e5ccf9e92017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:18.700682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be43bd-0836-46a2-9480-e5ccf9e92017 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:18.701378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be43bd-0836-46a2-9480-e5ccf9e92017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:18.703468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be43bd-0836-46a2-9480-e5ccf9e92017 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:18.735334 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1728/3479] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:12:18 2022] POST /identity/v3/users => generated 294 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:12:18.737839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e2e46-6979-447d-83dd-166541838b8f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:18.756370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e2e46-6979-447d-83dd-166541838b8f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:18.765187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ac4c1-40f2-4671-886f-0b54f1cabbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:18.766342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ac4c1-40f2-4671-886f-0b54f1cabbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:18.766902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ac4c1-40f2-4671-886f-0b54f1cabbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:18.767451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ac4c1-40f2-4671-886f-0b54f1cabbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:18.769246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ac4c1-40f2-4671-886f-0b54f1cabbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:18.772199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ac4c1-40f2-4671-886f-0b54f1cabbb3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:18.786998 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1752/3480] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:12:18.791662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be43bd-0836-46a2-9480-e5ccf9e92017 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:18.808132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be43bd-0836-46a2-9480-e5ccf9e92017 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:18.815948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8522b-7992-4be1-bebf-b16ea48c1540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:18.816923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8522b-7992-4be1-bebf-b16ea48c1540 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:18.817421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8522b-7992-4be1-bebf-b16ea48c1540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:18.817909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8522b-7992-4be1-bebf-b16ea48c1540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:18.819071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8522b-7992-4be1-bebf-b16ea48c1540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:18.821174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8522b-7992-4be1-bebf-b16ea48c1540 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:18.834438 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1729/3481] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:12:18.839501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ac4c1-40f2-4671-886f-0b54f1cabbb3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:18.857071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ac4c1-40f2-4671-886f-0b54f1cabbb3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:18.862633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c527f-ca9d-4285-a3f3-d0891ea74cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:18.863603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c527f-ca9d-4285-a3f3-d0891ea74cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:18.864144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c527f-ca9d-4285-a3f3-d0891ea74cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:18.864521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c527f-ca9d-4285-a3f3-d0891ea74cdf admin admin] PATH_INFO: `/v3/projects/1dd361816e7248d5aa0510a6290cac0e/users/7000f8a941224f25a7f76528eb80e798/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:18.889776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c527f-ca9d-4285-a3f3-d0891ea74cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dd361816e7248d5aa0510a6290cac0e, user_id=7000f8a941224f25a7f76528eb80e798, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:18.900612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c527f-ca9d-4285-a3f3-d0891ea74cdf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:18.914127 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1753/3482] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:12:18 2022] PUT /identity/v3/projects/1dd361816e7248d5aa0510a6290cac0e/users/7000f8a941224f25a7f76528eb80e798/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:18.922607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8522b-7992-4be1-bebf-b16ea48c1540 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:18.925647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-90a8522b-7992-4be1-bebf-b16ea48c1540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:18.936940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748ca19-78cf-48c9-ba0f-42f76cfeb14d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:18.937349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748ca19-78cf-48c9-ba0f-42f76cfeb14d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:18.938343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748ca19-78cf-48c9-ba0f-42f76cfeb14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:19.019492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f748ca19-78cf-48c9-ba0f-42f76cfeb14d None None] MFA Rules not processed for user `7000f8a941224f25a7f76528eb80e798`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:19.022040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f748ca19-78cf-48c9-ba0f-42f76cfeb14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:19.062964 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:19.099034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8522b-7992-4be1-bebf-b16ea48c1540 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:19.156456 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:19.233323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80279f-a048-4ae5-8a38-9d54693ba9a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:19.234479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80279f-a048-4ae5-8a38-9d54693ba9a4 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:19.234479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80279f-a048-4ae5-8a38-9d54693ba9a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:19.234832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80279f-a048-4ae5-8a38-9d54693ba9a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:19.263270 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1754/3483] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:19.273835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748ca19-78cf-48c9-ba0f-42f76cfeb14d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:19.275816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f748ca19-78cf-48c9-ba0f-42f76cfeb14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:19.324436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80279f-a048-4ae5-8a38-9d54693ba9a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:19.326326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80279f-a048-4ae5-8a38-9d54693ba9a4 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:19.350745 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1730/3484] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:12:19.408331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748ca19-78cf-48c9-ba0f-42f76cfeb14d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:19.427214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb45b48-910e-4660-987c-09aa0631827f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:19.427942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb45b48-910e-4660-987c-09aa0631827f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:19.428227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb45b48-910e-4660-987c-09aa0631827f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:19.428500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb45b48-910e-4660-987c-09aa0631827f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:19.452044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb45b48-910e-4660-987c-09aa0631827f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:19.454830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb45b48-910e-4660-987c-09aa0631827f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:19.482106 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1755/3485] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:12:19.614669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f417f23-b2b8-4ee4-9dda-5dfd99be6bf0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:19.614669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f417f23-b2b8-4ee4-9dda-5dfd99be6bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:19.615050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f417f23-b2b8-4ee4-9dda-5dfd99be6bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:19.649224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8f417f23-b2b8-4ee4-9dda-5dfd99be6bf0 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:19.651185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8f417f23-b2b8-4ee4-9dda-5dfd99be6bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:19.776057 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1731/3486] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:19.807301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb45b48-910e-4660-987c-09aa0631827f service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:19.808738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f417f23-b2b8-4ee4-9dda-5dfd99be6bf0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:19.808897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9fb45b48-910e-4660-987c-09aa0631827f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:19.811320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8f417f23-b2b8-4ee4-9dda-5dfd99be6bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:19.840455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb45b48-910e-4660-987c-09aa0631827f service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:19.857279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9a706-c00f-4dd9-a28a-fa59cee357e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:19.858796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9a706-c00f-4dd9-a28a-fa59cee357e7 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:19.859707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9a706-c00f-4dd9-a28a-fa59cee357e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:19.860920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9a706-c00f-4dd9-a28a-fa59cee357e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:19.865038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5ac9a706-c00f-4dd9-a28a-fa59cee357e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:19.902304 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:19.977694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f417f23-b2b8-4ee4-9dda-5dfd99be6bf0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:19.992098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2e87a-e847-4b1f-8ed0-929f177812a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:19.992990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2e87a-e847-4b1f-8ed0-929f177812a9 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:19.993371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2e87a-e847-4b1f-8ed0-929f177812a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:19.993649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2e87a-e847-4b1f-8ed0-929f177812a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:20.001523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9a706-c00f-4dd9-a28a-fa59cee357e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:20.003432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9a706-c00f-4dd9-a28a-fa59cee357e7 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:20.012185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2e87a-e847-4b1f-8ed0-929f177812a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:20.014297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2e87a-e847-4b1f-8ed0-929f177812a9 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:20.027893 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1756/3487] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:12:20.036583 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1732/3488] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:12:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:20.300464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e14bb-f697-470a-aad2-973a9f703f16 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:20.300749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e14bb-f697-470a-aad2-973a9f703f16 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:20.301023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e14bb-f697-470a-aad2-973a9f703f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:20.335475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-852e14bb-f697-470a-aad2-973a9f703f16 None None] MFA Rules not processed for user `7cbe5edbc4a040758d293b6932f52328`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:20.336812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-852e14bb-f697-470a-aad2-973a9f703f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:20.359268 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1757/3489] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:21.433053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899902d-789d-4a8e-b9e3-95a2c35293e1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:21.433545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899902d-789d-4a8e-b9e3-95a2c35293e1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:21.433651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899902d-789d-4a8e-b9e3-95a2c35293e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:21.487114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e899902d-789d-4a8e-b9e3-95a2c35293e1 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:21.488656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e899902d-789d-4a8e-b9e3-95a2c35293e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:21.509416 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1733/3490] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:12:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:12:21.528216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e14bb-f697-470a-aad2-973a9f703f16 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:21.547904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e14bb-f697-470a-aad2-973a9f703f16 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:21.587273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21677e52-1988-4aee-9867-c66a174fb5ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:21.588117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21677e52-1988-4aee-9867-c66a174fb5ad service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:21.588566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21677e52-1988-4aee-9867-c66a174fb5ad service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:21.589619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21677e52-1988-4aee-9867-c66a174fb5ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:21.609500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21677e52-1988-4aee-9867-c66a174fb5ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:21.611224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21677e52-1988-4aee-9867-c66a174fb5ad service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:21.635865 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1758/3491] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:12:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:21.895309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899902d-789d-4a8e-b9e3-95a2c35293e1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:22.042780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899902d-789d-4a8e-b9e3-95a2c35293e1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:22.060595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:22.061238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:22.061519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:22.062392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] PATH_INFO: `/v3/users/7cbe5edbc4a040758d293b6932f52328` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:22.063040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cbe5edbc4a040758d293b6932f52328)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:22.065079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:22.203503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cbe5edbc4a040758d293b6932f52328'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:22.204328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cbe5edbc4a040758d293b6932f52328'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:22.223103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cbe5edbc4a040758d293b6932f52328'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:22.236014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cbe5edbc4a040758d293b6932f52328'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:22.237827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cbe5edbc4a040758d293b6932f52328'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:22.261730 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1734/3492] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:12:21 2022] DELETE /identity/v3/users/7cbe5edbc4a040758d293b6932f52328 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:22.262947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ec2b3-1ff5-41b4-a176-6692d0482437 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:22.263244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ec2b3-1ff5-41b4-a176-6692d0482437 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:22.263524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ec2b3-1ff5-41b4-a176-6692d0482437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:22.292032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-984ec2b3-1ff5-41b4-a176-6692d0482437 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:22.294056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-984ec2b3-1ff5-41b4-a176-6692d0482437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:22.453663 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:22.513049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:22.514122 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1759/3493] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:22.515869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:22.624923 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:22.670267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddb081-64d7-4f51-be44-cbafb805927f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:22.689281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6d4fe-7b4a-495e-9e74-fde30a9a7805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:22.689916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6d4fe-7b4a-495e-9e74-fde30a9a7805 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:22.690338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6d4fe-7b4a-495e-9e74-fde30a9a7805 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:22.690619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6d4fe-7b4a-495e-9e74-fde30a9a7805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:22.704807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6d4fe-7b4a-495e-9e74-fde30a9a7805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:22.706397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6d4fe-7b4a-495e-9e74-fde30a9a7805 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:22.732524 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1735/3494] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:12:23.622965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ec2b3-1ff5-41b4-a176-6692d0482437 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:23.625621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-984ec2b3-1ff5-41b4-a176-6692d0482437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:23.646830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ec2b3-1ff5-41b4-a176-6692d0482437 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:23.659036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a97ecb-478c-4d68-af8d-9a975124fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:23.660252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97ecb-478c-4d68-af8d-9a975124fe49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:23.660702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97ecb-478c-4d68-af8d-9a975124fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:23.661130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97ecb-478c-4d68-af8d-9a975124fe49 admin admin] PATH_INFO: `/v3/projects/5c325a1382a84822b02f62d51b8cd163` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:23.662623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a97ecb-478c-4d68-af8d-9a975124fe49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c325a1382a84822b02f62d51b8cd163)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:23.668311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a97ecb-478c-4d68-af8d-9a975124fe49 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:23.898975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c3a97ecb-478c-4d68-af8d-9a975124fe49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c325a1382a84822b02f62d51b8cd163', 'request_id': 'req-c3a97ecb-478c-4d68-af8d-9a975124fe49'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:23.921391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c3a97ecb-478c-4d68-af8d-9a975124fe49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c325a1382a84822b02f62d51b8cd163', 'request_id': 'req-c3a97ecb-478c-4d68-af8d-9a975124fe49'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:23.952307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c3a97ecb-478c-4d68-af8d-9a975124fe49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c325a1382a84822b02f62d51b8cd163', 'request_id': 'req-c3a97ecb-478c-4d68-af8d-9a975124fe49'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:23.995402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c3a97ecb-478c-4d68-af8d-9a975124fe49 admin admin] The token cache is being invalidate because project 5c325a1382a84822b02f62d51b8cd163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:12:23.995702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c3a97ecb-478c-4d68-af8d-9a975124fe49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:24.002346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c3a97ecb-478c-4d68-af8d-9a975124fe49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:24.007746 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1760/3495] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:12:23 2022] DELETE /identity/v3/projects/5c325a1382a84822b02f62d51b8cd163 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:24.012871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceb3f6-ed72-40af-a778-6b54d5b68827 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:24.013809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceb3f6-ed72-40af-a778-6b54d5b68827 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:24.014412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceb3f6-ed72-40af-a778-6b54d5b68827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:24.056629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-deceb3f6-ed72-40af-a778-6b54d5b68827 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:24.058161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-deceb3f6-ed72-40af-a778-6b54d5b68827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:24.225017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328cd8-b7b8-4c53-b1ff-c081c48d190c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:24.225390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328cd8-b7b8-4c53-b1ff-c081c48d190c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:24.225740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328cd8-b7b8-4c53-b1ff-c081c48d190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:24.240388 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1736/3496] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:24.293141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-26328cd8-b7b8-4c53-b1ff-c081c48d190c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:24.295504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-26328cd8-b7b8-4c53-b1ff-c081c48d190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:24.324411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceb3f6-ed72-40af-a778-6b54d5b68827 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:24.324626 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1761/3497] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:24.337160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceb3f6-ed72-40af-a778-6b54d5b68827 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:24.380776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46062-b00b-4fbd-bab9-d7afb8d7f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:24.381546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46062-b00b-4fbd-bab9-d7afb8d7f5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:24.382088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46062-b00b-4fbd-bab9-d7afb8d7f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:24.382580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46062-b00b-4fbd-bab9-d7afb8d7f5c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:24.383826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf46062-b00b-4fbd-bab9-d7afb8d7f5c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:12:24.384380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf46062-b00b-4fbd-bab9-d7afb8d7f5c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:24.386277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf46062-b00b-4fbd-bab9-d7afb8d7f5c3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:24.433170 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1737/3498] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:12:24.439955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26328cd8-b7b8-4c53-b1ff-c081c48d190c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:24.455713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26328cd8-b7b8-4c53-b1ff-c081c48d190c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:24.462089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78680-fc6e-4e48-b9e3-6a5cf7417bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:24.462861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78680-fc6e-4e48-b9e3-6a5cf7417bbc admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:24.463902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78680-fc6e-4e48-b9e3-6a5cf7417bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:24.464689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78680-fc6e-4e48-b9e3-6a5cf7417bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:24.465884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78680-fc6e-4e48-b9e3-6a5cf7417bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:24.468337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78680-fc6e-4e48-b9e3-6a5cf7417bbc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:24.518202 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1762/3499] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:12:24 2022] POST /identity/v3/projects => generated 395 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:12:24.528680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46062-b00b-4fbd-bab9-d7afb8d7f5c3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:24.585724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46062-b00b-4fbd-bab9-d7afb8d7f5c3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:24.699191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a119b-47c8-438c-9311-458f4a867e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:24.699781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a119b-47c8-438c-9311-458f4a867e04 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:24.700061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a119b-47c8-438c-9311-458f4a867e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:24.700380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a119b-47c8-438c-9311-458f4a867e04 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:24.701909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a119b-47c8-438c-9311-458f4a867e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:24.705603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a119b-47c8-438c-9311-458f4a867e04 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:24.742606 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1738/3500] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:12:24 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:12:24.746778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78680-fc6e-4e48-b9e3-6a5cf7417bbc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:24.763264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78680-fc6e-4e48-b9e3-6a5cf7417bbc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:24.778406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558827a-3159-45c8-98a1-0ad8dffe0a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:24.779095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558827a-3159-45c8-98a1-0ad8dffe0a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:24.779378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558827a-3159-45c8-98a1-0ad8dffe0a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:24.779707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558827a-3159-45c8-98a1-0ad8dffe0a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:24.781147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558827a-3159-45c8-98a1-0ad8dffe0a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:24.782965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558827a-3159-45c8-98a1-0ad8dffe0a07 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:24.801113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a119b-47c8-438c-9311-458f4a867e04 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:24.809117 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1763/3501] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:12:24.815258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a119b-47c8-438c-9311-458f4a867e04 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:24.828060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a80a2-6310-4794-9309-05dec31c488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:24.828695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a80a2-6310-4794-9309-05dec31c488c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:24.828978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a80a2-6310-4794-9309-05dec31c488c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:24.829253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a80a2-6310-4794-9309-05dec31c488c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:24.830008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a80a2-6310-4794-9309-05dec31c488c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:24.832264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a80a2-6310-4794-9309-05dec31c488c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:24.856242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558827a-3159-45c8-98a1-0ad8dffe0a07 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:24.857612 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1739/3502] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:12:24.876989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558827a-3159-45c8-98a1-0ad8dffe0a07 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:24.888574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737b8c5-9939-4055-a705-c7e69dc73858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:24.889668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737b8c5-9939-4055-a705-c7e69dc73858 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:24.889953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737b8c5-9939-4055-a705-c7e69dc73858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:24.890228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737b8c5-9939-4055-a705-c7e69dc73858 admin admin] PATH_INFO: `/v3/projects/325693aecd4344b9a9ee136574fea515/users/61dc016688674a9991b1d89c17e37fbc/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:24.928583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737b8c5-9939-4055-a705-c7e69dc73858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=325693aecd4344b9a9ee136574fea515, user_id=61dc016688674a9991b1d89c17e37fbc, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:24.932154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737b8c5-9939-4055-a705-c7e69dc73858 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:24.962670 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1764/3503] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:12:24 2022] PUT /identity/v3/projects/325693aecd4344b9a9ee136574fea515/users/61dc016688674a9991b1d89c17e37fbc/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:24.968842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307b696-a0b6-4981-904b-850b13a1f310 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:24.969161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307b696-a0b6-4981-904b-850b13a1f310 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:24.969403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307b696-a0b6-4981-904b-850b13a1f310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:25.020597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2307b696-a0b6-4981-904b-850b13a1f310 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:25.026783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2307b696-a0b6-4981-904b-850b13a1f310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:25.152820 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:25.204762 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1740/3504] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:25.219629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737b8c5-9939-4055-a705-c7e69dc73858 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:25.223215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2737b8c5-9939-4055-a705-c7e69dc73858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:25.260130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b1524-042c-41a5-942b-c9df47cd7e7b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:25.260476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b1524-042c-41a5-942b-c9df47cd7e7b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:25.260757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b1524-042c-41a5-942b-c9df47cd7e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:25.307494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c45b1524-042c-41a5-942b-c9df47cd7e7b None None] MFA Rules not processed for user `17f95d77e66946ce9ac525cc34c61d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:25.309470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c45b1524-042c-41a5-942b-c9df47cd7e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:25.439970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737b8c5-9939-4055-a705-c7e69dc73858 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:25.460681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9b05-46c6-40df-a067-c58d8428b882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:25.462270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9b05-46c6-40df-a067-c58d8428b882 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:25.462677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9b05-46c6-40df-a067-c58d8428b882 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:25.463295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9b05-46c6-40df-a067-c58d8428b882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:25.487494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba9b05-46c6-40df-a067-c58d8428b882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:25.488806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba9b05-46c6-40df-a067-c58d8428b882 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:25.520763 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1765/3505] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:12:25.656033 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1741/3506] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:35.506392 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:35.625550 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=31 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:37.734215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9b05-46c6-40df-a067-c58d8428b882 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:37.746243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9b05-46c6-40df-a067-c58d8428b882 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:37.761243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c8da6-3a66-4643-ab50-d1ef29064144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:37.761889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c8da6-3a66-4643-ab50-d1ef29064144 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:37.762194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c8da6-3a66-4643-ab50-d1ef29064144 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:37.762471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c8da6-3a66-4643-ab50-d1ef29064144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:37.765335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ec3c8da6-3a66-4643-ab50-d1ef29064144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:37.782276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c8da6-3a66-4643-ab50-d1ef29064144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:37.783987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c8da6-3a66-4643-ab50-d1ef29064144 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:37.807355 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1766/3507] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:12:40.643360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821b92-878f-4865-a668-d24faa928348 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:40.644609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821b92-878f-4865-a668-d24faa928348 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:40.645123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821b92-878f-4865-a668-d24faa928348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:40.672000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7b821b92-878f-4865-a668-d24faa928348 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:40.673451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b821b92-878f-4865-a668-d24faa928348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:40.754706 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1742/3508] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:12:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:40.768467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c8da6-3a66-4643-ab50-d1ef29064144 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:40.770438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ec3c8da6-3a66-4643-ab50-d1ef29064144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:40.832195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee01c1c-45f7-4d57-be26-e7d85dbfdd36 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:40.832485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee01c1c-45f7-4d57-be26-e7d85dbfdd36 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:40.832764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee01c1c-45f7-4d57-be26-e7d85dbfdd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:40.873972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c8da6-3a66-4643-ab50-d1ef29064144 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:40.884547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b800e-9a9d-4840-bf92-dae1251b29e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:40.885171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b800e-9a9d-4840-bf92-dae1251b29e7 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:40.887714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b800e-9a9d-4840-bf92-dae1251b29e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:40.887883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b800e-9a9d-4840-bf92-dae1251b29e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:40.898678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b800e-9a9d-4840-bf92-dae1251b29e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:40.903519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b800e-9a9d-4840-bf92-dae1251b29e7 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:40.909833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4ee01c1c-45f7-4d57-be26-e7d85dbfdd36 None None] MFA Rules not processed for user `61dc016688674a9991b1d89c17e37fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:40.911105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4ee01c1c-45f7-4d57-be26-e7d85dbfdd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:40.918790 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1767/3509] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:12:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:41.105767 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1743/3510] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:41.115161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b800e-9a9d-4840-bf92-dae1251b29e7 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:41.116518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-876b800e-9a9d-4840-bf92-dae1251b29e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:41.365731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b800e-9a9d-4840-bf92-dae1251b29e7 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:41.380671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d7c6f-4507-49c3-8ffa-7703ea595b83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:41.381124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d7c6f-4507-49c3-8ffa-7703ea595b83 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:41.381396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d7c6f-4507-49c3-8ffa-7703ea595b83 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:41.381704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d7c6f-4507-49c3-8ffa-7703ea595b83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:41.424192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d7c6f-4507-49c3-8ffa-7703ea595b83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:41.425853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d7c6f-4507-49c3-8ffa-7703ea595b83 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:41.478107 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1768/3511] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:41 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:12:42.805906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac9d99-ee32-4df7-939c-051ce1cbc276 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:42.806453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac9d99-ee32-4df7-939c-051ce1cbc276 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:42.806562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac9d99-ee32-4df7-939c-051ce1cbc276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:42.849586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-52ac9d99-ee32-4df7-939c-051ce1cbc276 None None] MFA Rules not processed for user `df9979f0dcd74d60a55d02d432de6a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:42.851976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-52ac9d99-ee32-4df7-939c-051ce1cbc276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:42.971448 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1744/3512] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:50.825825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d7c6f-4507-49c3-8ffa-7703ea595b83 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:50.827430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-519d7c6f-4507-49c3-8ffa-7703ea595b83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:50.985550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac9d99-ee32-4df7-939c-051ce1cbc276 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:50.991124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-52ac9d99-ee32-4df7-939c-051ce1cbc276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:51.017309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac9d99-ee32-4df7-939c-051ce1cbc276 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:51.027757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decceaa-35a7-48f4-8a05-08b04048d8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:51.028308 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:51.028755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decceaa-35a7-48f4-8a05-08b04048d8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:51.032713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decceaa-35a7-48f4-8a05-08b04048d8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:51.033461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decceaa-35a7-48f4-8a05-08b04048d8eb admin admin] PATH_INFO: `/v3/users/ebca99f6818548b982e94948327522b5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:51.039383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decceaa-35a7-48f4-8a05-08b04048d8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebca99f6818548b982e94948327522b5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:51.041358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decceaa-35a7-48f4-8a05-08b04048d8eb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:51.042016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d7c6f-4507-49c3-8ffa-7703ea595b83 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:51.057080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bf344-3533-48e8-a9b8-831449134723 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:51.058021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bf344-3533-48e8-a9b8-831449134723 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:51.058407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bf344-3533-48e8-a9b8-831449134723 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:51.058788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bf344-3533-48e8-a9b8-831449134723 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:51.062955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1d8bf344-3533-48e8-a9b8-831449134723 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:51.088965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bf344-3533-48e8-a9b8-831449134723 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:51.090637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bf344-3533-48e8-a9b8-831449134723 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:51.123841 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1769/3513] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:12:51.174882 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:51.199441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8decceaa-35a7-48f4-8a05-08b04048d8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebca99f6818548b982e94948327522b5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:51.200245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8decceaa-35a7-48f4-8a05-08b04048d8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebca99f6818548b982e94948327522b5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:51.239985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8decceaa-35a7-48f4-8a05-08b04048d8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebca99f6818548b982e94948327522b5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:51.254037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8decceaa-35a7-48f4-8a05-08b04048d8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebca99f6818548b982e94948327522b5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:51.254795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8decceaa-35a7-48f4-8a05-08b04048d8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebca99f6818548b982e94948327522b5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:51.285503 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1745/3514] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:12:50 2022] DELETE /identity/v3/users/ebca99f6818548b982e94948327522b5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:12:51.613636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bf344-3533-48e8-a9b8-831449134723 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:51.638970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bf344-3533-48e8-a9b8-831449134723 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:51.817875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b31d4-d397-41b5-8e7c-db66d6338ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:51.818576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b31d4-d397-41b5-8e7c-db66d6338ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:51.818857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b31d4-d397-41b5-8e7c-db66d6338ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:51.823425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b31d4-d397-41b5-8e7c-db66d6338ff2 admin admin] PATH_INFO: `/v3/projects/8747e7b25c434abfbdb3e7f981ef8fc8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:51.828870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b31d4-d397-41b5-8e7c-db66d6338ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8747e7b25c434abfbdb3e7f981ef8fc8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:51.839299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b31d4-d397-41b5-8e7c-db66d6338ff2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:51.966772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b78b31d4-d397-41b5-8e7c-db66d6338ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8747e7b25c434abfbdb3e7f981ef8fc8', 'request_id': 'req-b78b31d4-d397-41b5-8e7c-db66d6338ff2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:51.995277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b78b31d4-d397-41b5-8e7c-db66d6338ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8747e7b25c434abfbdb3e7f981ef8fc8', 'request_id': 'req-b78b31d4-d397-41b5-8e7c-db66d6338ff2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:52.011701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b78b31d4-d397-41b5-8e7c-db66d6338ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8747e7b25c434abfbdb3e7f981ef8fc8', 'request_id': 'req-b78b31d4-d397-41b5-8e7c-db66d6338ff2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:52.039881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b78b31d4-d397-41b5-8e7c-db66d6338ff2 admin admin] The token cache is being invalidate because project 8747e7b25c434abfbdb3e7f981ef8fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:12:52.040689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b78b31d4-d397-41b5-8e7c-db66d6338ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:52.043419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b78b31d4-d397-41b5-8e7c-db66d6338ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:52.047378 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1770/3515] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:12:51 2022] DELETE /identity/v3/projects/8747e7b25c434abfbdb3e7f981ef8fc8 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:12:52.055182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637554b-0f9d-4626-bff2-96faddc729e5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:52.055789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637554b-0f9d-4626-bff2-96faddc729e5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:52.055911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637554b-0f9d-4626-bff2-96faddc729e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:52.082400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c637554b-0f9d-4626-bff2-96faddc729e5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:52.084194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c637554b-0f9d-4626-bff2-96faddc729e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:52.197491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4760201-5c7b-411d-aa4d-5d5e2bc9f171 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:52.197961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4760201-5c7b-411d-aa4d-5d5e2bc9f171 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:52.198500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4760201-5c7b-411d-aa4d-5d5e2bc9f171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:52.203018 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1746/3516] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:52.235458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b4760201-5c7b-411d-aa4d-5d5e2bc9f171 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:52.238108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b4760201-5c7b-411d-aa4d-5d5e2bc9f171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:52.253030 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1771/3517] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:52.258122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637554b-0f9d-4626-bff2-96faddc729e5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:52.276413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637554b-0f9d-4626-bff2-96faddc729e5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:52.297118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df766d-688d-47e5-a4a5-e4b3f4c035b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:52.297758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df766d-688d-47e5-a4a5-e4b3f4c035b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:52.298160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df766d-688d-47e5-a4a5-e4b3f4c035b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:52.299174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df766d-688d-47e5-a4a5-e4b3f4c035b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:52.302090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df766d-688d-47e5-a4a5-e4b3f4c035b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:12:52.302395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df766d-688d-47e5-a4a5-e4b3f4c035b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:52.306171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df766d-688d-47e5-a4a5-e4b3f4c035b5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:52.324240 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1747/3518] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:12:52.328349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4760201-5c7b-411d-aa4d-5d5e2bc9f171 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:52.338554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4760201-5c7b-411d-aa4d-5d5e2bc9f171 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:52.344654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88cc77-6334-4ff3-89a6-55fa4e0defb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:52.345614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88cc77-6334-4ff3-89a6-55fa4e0defb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:52.346185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88cc77-6334-4ff3-89a6-55fa4e0defb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:52.346682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88cc77-6334-4ff3-89a6-55fa4e0defb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:52.347601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88cc77-6334-4ff3-89a6-55fa4e0defb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:52.349745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88cc77-6334-4ff3-89a6-55fa4e0defb7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:52.389368 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1772/3519] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:12:52 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:12:52.391315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df766d-688d-47e5-a4a5-e4b3f4c035b5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:52.403431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df766d-688d-47e5-a4a5-e4b3f4c035b5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:52.477430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba63c81-12bb-4ad5-803b-01d69d007faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:52.477964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba63c81-12bb-4ad5-803b-01d69d007faf admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:52.478245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba63c81-12bb-4ad5-803b-01d69d007faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:52.478518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba63c81-12bb-4ad5-803b-01d69d007faf admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:52.479197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba63c81-12bb-4ad5-803b-01d69d007faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:52.481954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba63c81-12bb-4ad5-803b-01d69d007faf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:52.514985 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1748/3520] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:12:52 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:12:52.518767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88cc77-6334-4ff3-89a6-55fa4e0defb7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:52.534809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88cc77-6334-4ff3-89a6-55fa4e0defb7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:52.541099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0bcd5-a6d8-40d2-9791-1b6e00375141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:52.541710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0bcd5-a6d8-40d2-9791-1b6e00375141 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:52.542253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0bcd5-a6d8-40d2-9791-1b6e00375141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:52.543069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0bcd5-a6d8-40d2-9791-1b6e00375141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:52.552606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0bcd5-a6d8-40d2-9791-1b6e00375141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:52.554657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0bcd5-a6d8-40d2-9791-1b6e00375141 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:52.597869 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1773/3521] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:12:52.602511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba63c81-12bb-4ad5-803b-01d69d007faf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:52.617555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba63c81-12bb-4ad5-803b-01d69d007faf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:52.635621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0efd1d-7b58-46e3-a071-7a9f84185b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:52.636254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0efd1d-7b58-46e3-a071-7a9f84185b01 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:52.636541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0efd1d-7b58-46e3-a071-7a9f84185b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:52.636797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0efd1d-7b58-46e3-a071-7a9f84185b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:52.642415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0efd1d-7b58-46e3-a071-7a9f84185b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:52.648705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0efd1d-7b58-46e3-a071-7a9f84185b01 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:52.694601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0bcd5-a6d8-40d2-9791-1b6e00375141 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:52.696294 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1749/3522] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:12:52.733624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0bcd5-a6d8-40d2-9791-1b6e00375141 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:52.750096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45d6ea-8c4b-469b-9045-dcb679f5278f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:52.751063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45d6ea-8c4b-469b-9045-dcb679f5278f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:52.751828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45d6ea-8c4b-469b-9045-dcb679f5278f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:52.752350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45d6ea-8c4b-469b-9045-dcb679f5278f admin admin] PATH_INFO: `/v3/projects/cfee6c66b8f5495a8eb29e4136ec3ed7/users/3714a80dffe147b5b683e6a3419d0df3/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:52.786793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45d6ea-8c4b-469b-9045-dcb679f5278f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfee6c66b8f5495a8eb29e4136ec3ed7, user_id=3714a80dffe147b5b683e6a3419d0df3, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:52.790000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45d6ea-8c4b-469b-9045-dcb679f5278f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:52.815085 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1774/3523] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:12:52 2022] PUT /identity/v3/projects/cfee6c66b8f5495a8eb29e4136ec3ed7/users/3714a80dffe147b5b683e6a3419d0df3/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:12:52.820242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03512fa-ec72-40fb-9cdc-d5633960e5f1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:52.820951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03512fa-ec72-40fb-9cdc-d5633960e5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:52.821243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03512fa-ec72-40fb-9cdc-d5633960e5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:52.873950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a03512fa-ec72-40fb-9cdc-d5633960e5f1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:52.878644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a03512fa-ec72-40fb-9cdc-d5633960e5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:52.909996 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:53.025086 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1750/3524] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:53.048423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45d6ea-8c4b-469b-9045-dcb679f5278f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:53.053625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ee45d6ea-8c4b-469b-9045-dcb679f5278f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:53.083899 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:53.148956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45d6ea-8c4b-469b-9045-dcb679f5278f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:53.166211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c46ca-7748-42b3-9106-0c8796678c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:53.167237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c46ca-7748-42b3-9106-0c8796678c18 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:53.168156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c46ca-7748-42b3-9106-0c8796678c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:53.169223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c46ca-7748-42b3-9106-0c8796678c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:53.188293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c46ca-7748-42b3-9106-0c8796678c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:53.198897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c46ca-7748-42b3-9106-0c8796678c18 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:53.224470 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1775/3525] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:12:54.685360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03512fa-ec72-40fb-9cdc-d5633960e5f1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:54.687682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a03512fa-ec72-40fb-9cdc-d5633960e5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:54.702491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03512fa-ec72-40fb-9cdc-d5633960e5f1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:54.712271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef937148-6177-4dab-8472-9aff52777f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:54.713389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef937148-6177-4dab-8472-9aff52777f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:54.713854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef937148-6177-4dab-8472-9aff52777f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:54.714557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef937148-6177-4dab-8472-9aff52777f9f admin admin] PATH_INFO: `/v3/users/7000f8a941224f25a7f76528eb80e798` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:54.716201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef937148-6177-4dab-8472-9aff52777f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7000f8a941224f25a7f76528eb80e798)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:54.718836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef937148-6177-4dab-8472-9aff52777f9f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:54.789944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef937148-6177-4dab-8472-9aff52777f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7000f8a941224f25a7f76528eb80e798'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:54.790709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef937148-6177-4dab-8472-9aff52777f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7000f8a941224f25a7f76528eb80e798'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:54.813713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef937148-6177-4dab-8472-9aff52777f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7000f8a941224f25a7f76528eb80e798'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:54.826494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef937148-6177-4dab-8472-9aff52777f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7000f8a941224f25a7f76528eb80e798'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:54.827441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef937148-6177-4dab-8472-9aff52777f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7000f8a941224f25a7f76528eb80e798'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:54.831754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658d10a-adfb-4a03-8390-dccb93932d06 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:54.832316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658d10a-adfb-4a03-8390-dccb93932d06 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:54.832316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658d10a-adfb-4a03-8390-dccb93932d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:54.851431 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1751/3526] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:12:54 2022] DELETE /identity/v3/users/7000f8a941224f25a7f76528eb80e798 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:54.853623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247b2b-b627-47cd-9229-90830d8c8abb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:54.854231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247b2b-b627-47cd-9229-90830d8c8abb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:54.854461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247b2b-b627-47cd-9229-90830d8c8abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:54.855590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4658d10a-adfb-4a03-8390-dccb93932d06 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:54.856863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4658d10a-adfb-4a03-8390-dccb93932d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:54.880825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-80247b2b-b627-47cd-9229-90830d8c8abb None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:54.883658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-80247b2b-b627-47cd-9229-90830d8c8abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:54.934478 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1776/3527] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:12:54.973252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658d10a-adfb-4a03-8390-dccb93932d06 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:54.974810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4658d10a-adfb-4a03-8390-dccb93932d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:54.998867 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1752/3528] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:55.010322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80247b2b-b627-47cd-9229-90830d8c8abb None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:55.012525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-80247b2b-b627-47cd-9229-90830d8c8abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:55.052633 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:55.085589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658d10a-adfb-4a03-8390-dccb93932d06 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:55.090946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80247b2b-b627-47cd-9229-90830d8c8abb None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:55.091391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf15e3-fe09-45ca-96d7-1ad5977fb21a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:55.092235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf15e3-fe09-45ca-96d7-1ad5977fb21a service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:55.092597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf15e3-fe09-45ca-96d7-1ad5977fb21a service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:55.092944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf15e3-fe09-45ca-96d7-1ad5977fb21a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:55.094971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c8a52-7fe8-4b23-b3cf-9019e6a65d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:55.095905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c8a52-7fe8-4b23-b3cf-9019e6a65d22 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:55.096249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c8a52-7fe8-4b23-b3cf-9019e6a65d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:55.096589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c8a52-7fe8-4b23-b3cf-9019e6a65d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:55.102127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf15e3-fe09-45ca-96d7-1ad5977fb21a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:55.103956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf15e3-fe09-45ca-96d7-1ad5977fb21a service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:55.106854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c8a52-7fe8-4b23-b3cf-9019e6a65d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:55.109599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c8a52-7fe8-4b23-b3cf-9019e6a65d22 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:55.115161 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1777/3529] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:12:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:12:55.124104 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1753/3530] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:12:55.370396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf15e3-fe09-45ca-96d7-1ad5977fb21a service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:55.372174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bedf15e3-fe09-45ca-96d7-1ad5977fb21a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:55.415012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf15e3-fe09-45ca-96d7-1ad5977fb21a service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:55.427541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c0007-e5a1-463d-86bb-837749455b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:55.428172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c0007-e5a1-463d-86bb-837749455b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:55.428448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c0007-e5a1-463d-86bb-837749455b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:55.428716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c0007-e5a1-463d-86bb-837749455b1e admin admin] PATH_INFO: `/v3/projects/1dd361816e7248d5aa0510a6290cac0e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:55.431743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c0007-e5a1-463d-86bb-837749455b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dd361816e7248d5aa0510a6290cac0e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:55.435196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c0007-e5a1-463d-86bb-837749455b1e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:55.502405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f7c0007-e5a1-463d-86bb-837749455b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dd361816e7248d5aa0510a6290cac0e', 'request_id': 'req-8f7c0007-e5a1-463d-86bb-837749455b1e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:55.503692 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:55.511782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f7c0007-e5a1-463d-86bb-837749455b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dd361816e7248d5aa0510a6290cac0e', 'request_id': 'req-8f7c0007-e5a1-463d-86bb-837749455b1e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:55.526740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f7c0007-e5a1-463d-86bb-837749455b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dd361816e7248d5aa0510a6290cac0e', 'request_id': 'req-8f7c0007-e5a1-463d-86bb-837749455b1e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:55.566656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f7c0007-e5a1-463d-86bb-837749455b1e admin admin] The token cache is being invalidate because project 1dd361816e7248d5aa0510a6290cac0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:12:55.567214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f7c0007-e5a1-463d-86bb-837749455b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:55.567944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f7c0007-e5a1-463d-86bb-837749455b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:12:55.569494 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1778/3531] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:12:55 2022] DELETE /identity/v3/projects/1dd361816e7248d5aa0510a6290cac0e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:12:55.575121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbcb21-8b85-4440-9b79-2ba6cf222265 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:55.575408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbcb21-8b85-4440-9b79-2ba6cf222265 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:55.575669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbcb21-8b85-4440-9b79-2ba6cf222265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:55.616155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f7fbcb21-8b85-4440-9b79-2ba6cf222265 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:55.618557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f7fbcb21-8b85-4440-9b79-2ba6cf222265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:55.766535 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1754/3532] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:55.774625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3d988-92cb-4921-8f23-7dacb97ed550 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:55.775125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3d988-92cb-4921-8f23-7dacb97ed550 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:55.775400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3d988-92cb-4921-8f23-7dacb97ed550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:55.803444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b7e3d988-92cb-4921-8f23-7dacb97ed550 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:55.805049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b7e3d988-92cb-4921-8f23-7dacb97ed550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:55.854134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbcb21-8b85-4440-9b79-2ba6cf222265 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:55.855104 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1779/3533] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:55.875153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbcb21-8b85-4440-9b79-2ba6cf222265 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:55.892121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5dbdc-a4fb-4577-b321-501970f730a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:55.893345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5dbdc-a4fb-4577-b321-501970f730a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:55.893618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5dbdc-a4fb-4577-b321-501970f730a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:55.894179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5dbdc-a4fb-4577-b321-501970f730a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:55.894834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5dbdc-a4fb-4577-b321-501970f730a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:12:55.895357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5dbdc-a4fb-4577-b321-501970f730a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:55.897169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5dbdc-a4fb-4577-b321-501970f730a0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:55.937106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3d988-92cb-4921-8f23-7dacb97ed550 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:55.939392 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1755/3534] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:12:55.948732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3d988-92cb-4921-8f23-7dacb97ed550 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:55.955130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2dfa5-d41d-400f-93fe-71a6370efe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:55.955870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2dfa5-d41d-400f-93fe-71a6370efe73 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:55.956208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2dfa5-d41d-400f-93fe-71a6370efe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:55.956544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2dfa5-d41d-400f-93fe-71a6370efe73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:55.957287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2dfa5-d41d-400f-93fe-71a6370efe73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:55.959308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2dfa5-d41d-400f-93fe-71a6370efe73 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:55.991406 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1780/3535] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:12:55 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:12:55.995382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5dbdc-a4fb-4577-b321-501970f730a0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:56.006321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5dbdc-a4fb-4577-b321-501970f730a0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:56.114132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e7feb-00f4-496f-b940-81674e3d134d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:56.115368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7feb-00f4-496f-b940-81674e3d134d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:56.115660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7feb-00f4-496f-b940-81674e3d134d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:56.115933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7feb-00f4-496f-b940-81674e3d134d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:56.116996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e7feb-00f4-496f-b940-81674e3d134d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:56.119264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e7feb-00f4-496f-b940-81674e3d134d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:56.152177 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1756/3536] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:12:55 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:12:56.156175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2dfa5-d41d-400f-93fe-71a6370efe73 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:56.171815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2dfa5-d41d-400f-93fe-71a6370efe73 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:56.183933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130356c-0cf3-4e8a-a525-c854ff2cc0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:56.184712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130356c-0cf3-4e8a-a525-c854ff2cc0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:56.185028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130356c-0cf3-4e8a-a525-c854ff2cc0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:56.185391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130356c-0cf3-4e8a-a525-c854ff2cc0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:56.186123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130356c-0cf3-4e8a-a525-c854ff2cc0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:56.188509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130356c-0cf3-4e8a-a525-c854ff2cc0d5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:56.212217 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1781/3537] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:12:56.215990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e7feb-00f4-496f-b940-81674e3d134d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:56.235597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e7feb-00f4-496f-b940-81674e3d134d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:56.241287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6614d-8855-401c-9ff8-d8fed03f4ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:56.242001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6614d-8855-401c-9ff8-d8fed03f4ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:56.242361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6614d-8855-401c-9ff8-d8fed03f4ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:56.242633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6614d-8855-401c-9ff8-d8fed03f4ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:56.243417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6614d-8855-401c-9ff8-d8fed03f4ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:56.246004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6614d-8855-401c-9ff8-d8fed03f4ec0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:56.266029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130356c-0cf3-4e8a-a525-c854ff2cc0d5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:56.269226 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1757/3538] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:12:56.278637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130356c-0cf3-4e8a-a525-c854ff2cc0d5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:56.290522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ed52-edd4-4a84-b92d-071d16c2a9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:56.291370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ed52-edd4-4a84-b92d-071d16c2a9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:56.291677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ed52-edd4-4a84-b92d-071d16c2a9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:56.291956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ed52-edd4-4a84-b92d-071d16c2a9bf admin admin] PATH_INFO: `/v3/projects/949699648c5f47f2b0dce63a3bf4a665/users/98757311ce154e76ab6e4da5730031d0/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:56.326855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832ed52-edd4-4a84-b92d-071d16c2a9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=949699648c5f47f2b0dce63a3bf4a665, user_id=98757311ce154e76ab6e4da5730031d0, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:56.336538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832ed52-edd4-4a84-b92d-071d16c2a9bf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:56.396359 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1782/3539] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:12:56 2022] PUT /identity/v3/projects/949699648c5f47f2b0dce63a3bf4a665/users/98757311ce154e76ab6e4da5730031d0/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:12:56.397820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1408-48ae-4bd2-8040-1958c282fec5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:56.397820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1408-48ae-4bd2-8040-1958c282fec5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:56.397820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1408-48ae-4bd2-8040-1958c282fec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:56.450453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b04f1408-48ae-4bd2-8040-1958c282fec5 None None] MFA Rules not processed for user `98757311ce154e76ab6e4da5730031d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:12:56.457732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b04f1408-48ae-4bd2-8040-1958c282fec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:56.495283 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:56.589318 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1758/3540] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:12:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:12:56.639005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ed52-edd4-4a84-b92d-071d16c2a9bf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:56.646759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b832ed52-edd4-4a84-b92d-071d16c2a9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:56.759478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ed52-edd4-4a84-b92d-071d16c2a9bf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:56.763431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad21c9-f819-49c6-8867-d72cd514ee5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:56.764177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad21c9-f819-49c6-8867-d72cd514ee5e service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:56.764888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad21c9-f819-49c6-8867-d72cd514ee5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:56.765764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad21c9-f819-49c6-8867-d72cd514ee5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:56.778305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad21c9-f819-49c6-8867-d72cd514ee5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:56.780212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad21c9-f819-49c6-8867-d72cd514ee5e service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:56.797214 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1783/3541] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:13:00.430333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1408-48ae-4bd2-8040-1958c282fec5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:00.434517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b04f1408-48ae-4bd2-8040-1958c282fec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:00.597181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1408-48ae-4bd2-8040-1958c282fec5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:00.602982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d09ae5-c04c-4db1-91ed-32d0f8c6b806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:00.603600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09ae5-c04c-4db1-91ed-32d0f8c6b806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:00.603873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09ae5-c04c-4db1-91ed-32d0f8c6b806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:00.604141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09ae5-c04c-4db1-91ed-32d0f8c6b806 admin admin] PATH_INFO: `/v3/users/61dc016688674a9991b1d89c17e37fbc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:00.605258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d09ae5-c04c-4db1-91ed-32d0f8c6b806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61dc016688674a9991b1d89c17e37fbc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:00.607242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d09ae5-c04c-4db1-91ed-32d0f8c6b806 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:00.700334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7d09ae5-c04c-4db1-91ed-32d0f8c6b806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61dc016688674a9991b1d89c17e37fbc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:00.702439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7d09ae5-c04c-4db1-91ed-32d0f8c6b806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61dc016688674a9991b1d89c17e37fbc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:00.729317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7d09ae5-c04c-4db1-91ed-32d0f8c6b806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61dc016688674a9991b1d89c17e37fbc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:00.740020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7d09ae5-c04c-4db1-91ed-32d0f8c6b806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61dc016688674a9991b1d89c17e37fbc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:00.740746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7d09ae5-c04c-4db1-91ed-32d0f8c6b806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61dc016688674a9991b1d89c17e37fbc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:00.762992 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1759/3542] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:13:00 2022] DELETE /identity/v3/users/61dc016688674a9991b1d89c17e37fbc => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:01.162672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad21c9-f819-49c6-8867-d72cd514ee5e service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:01.180597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad21c9-f819-49c6-8867-d72cd514ee5e service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:01.411848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76030b9a-5cc4-45ff-aa7a-1e954563d73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:01.412501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76030b9a-5cc4-45ff-aa7a-1e954563d73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:01.412777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76030b9a-5cc4-45ff-aa7a-1e954563d73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:01.413967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76030b9a-5cc4-45ff-aa7a-1e954563d73b admin admin] PATH_INFO: `/v3/projects/325693aecd4344b9a9ee136574fea515` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:01.415626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76030b9a-5cc4-45ff-aa7a-1e954563d73b admin admin] RBAC: Authorizing `identity:delete_project(project_id=325693aecd4344b9a9ee136574fea515)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:01.417365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76030b9a-5cc4-45ff-aa7a-1e954563d73b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:01.496100 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:01.584366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76030b9a-5cc4-45ff-aa7a-1e954563d73b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325693aecd4344b9a9ee136574fea515', 'request_id': 'req-76030b9a-5cc4-45ff-aa7a-1e954563d73b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:01.617942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76030b9a-5cc4-45ff-aa7a-1e954563d73b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325693aecd4344b9a9ee136574fea515', 'request_id': 'req-76030b9a-5cc4-45ff-aa7a-1e954563d73b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:01.637975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76030b9a-5cc4-45ff-aa7a-1e954563d73b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325693aecd4344b9a9ee136574fea515', 'request_id': 'req-76030b9a-5cc4-45ff-aa7a-1e954563d73b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:01.672276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76030b9a-5cc4-45ff-aa7a-1e954563d73b admin admin] The token cache is being invalidate because project 325693aecd4344b9a9ee136574fea515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:13:01.672569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76030b9a-5cc4-45ff-aa7a-1e954563d73b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:01.673218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76030b9a-5cc4-45ff-aa7a-1e954563d73b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:01.681446 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1784/3543] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:13:01 2022] DELETE /identity/v3/projects/325693aecd4344b9a9ee136574fea515 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:01.683574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eed7df-f0fe-4758-b650-6e65e6c02c89 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:01.684061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eed7df-f0fe-4758-b650-6e65e6c02c89 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:01.684239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eed7df-f0fe-4758-b650-6e65e6c02c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:01.747139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-52eed7df-f0fe-4758-b650-6e65e6c02c89 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:01.750242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-52eed7df-f0fe-4758-b650-6e65e6c02c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:01.824248 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:01.850991 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1760/3544] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:01.861483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be912259-9e9d-47f1-bed9-c6360eed4b0d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:01.864586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be912259-9e9d-47f1-bed9-c6360eed4b0d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:01.865422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be912259-9e9d-47f1-bed9-c6360eed4b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:01.912628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-be912259-9e9d-47f1-bed9-c6360eed4b0d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:01.915752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-be912259-9e9d-47f1-bed9-c6360eed4b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:01.940997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eed7df-f0fe-4758-b650-6e65e6c02c89 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:01.941195 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1785/3545] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:01.952328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eed7df-f0fe-4758-b650-6e65e6c02c89 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:01.958813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625eee91-fd8d-44a9-aa24-2d26df55718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:01.960636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625eee91-fd8d-44a9-aa24-2d26df55718c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:01.961416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625eee91-fd8d-44a9-aa24-2d26df55718c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:01.961416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625eee91-fd8d-44a9-aa24-2d26df55718c admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:01.962257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625eee91-fd8d-44a9-aa24-2d26df55718c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:13:01.962655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625eee91-fd8d-44a9-aa24-2d26df55718c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:01.964388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625eee91-fd8d-44a9-aa24-2d26df55718c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:01.982460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be912259-9e9d-47f1-bed9-c6360eed4b0d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:01.987895 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1761/3546] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:13:01.996147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be912259-9e9d-47f1-bed9-c6360eed4b0d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:02.002527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f31bf4-e5fc-4f70-b1ac-e9a238cef7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:02.003556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f31bf4-e5fc-4f70-b1ac-e9a238cef7dc admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:02.004545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f31bf4-e5fc-4f70-b1ac-e9a238cef7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:02.004946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f31bf4-e5fc-4f70-b1ac-e9a238cef7dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:02.006217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f31bf4-e5fc-4f70-b1ac-e9a238cef7dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:02.011000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f31bf4-e5fc-4f70-b1ac-e9a238cef7dc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:02.061824 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1786/3547] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:13:01 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:13:02.066845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625eee91-fd8d-44a9-aa24-2d26df55718c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:02.113644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625eee91-fd8d-44a9-aa24-2d26df55718c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:02.240219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d8bba-4221-4be0-a311-e22ac1b75bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:02.240863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d8bba-4221-4be0-a311-e22ac1b75bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:02.241235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d8bba-4221-4be0-a311-e22ac1b75bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:02.242722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d8bba-4221-4be0-a311-e22ac1b75bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:02.243544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d8bba-4221-4be0-a311-e22ac1b75bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:02.245463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d8bba-4221-4be0-a311-e22ac1b75bc1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:02.274702 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1762/3548] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:13:02 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:13:02.283447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f31bf4-e5fc-4f70-b1ac-e9a238cef7dc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:02.294040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f31bf4-e5fc-4f70-b1ac-e9a238cef7dc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:02.299150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb3b88-69b3-462a-a3b4-a8d14a7c639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:02.299774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb3b88-69b3-462a-a3b4-a8d14a7c639a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:02.300051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb3b88-69b3-462a-a3b4-a8d14a7c639a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:02.300326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb3b88-69b3-462a-a3b4-a8d14a7c639a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:02.300969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb3b88-69b3-462a-a3b4-a8d14a7c639a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:02.303154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb3b88-69b3-462a-a3b4-a8d14a7c639a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:02.323147 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1787/3549] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:13:02.326904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d8bba-4221-4be0-a311-e22ac1b75bc1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:02.338955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d8bba-4221-4be0-a311-e22ac1b75bc1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:02.345300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06bbb0-8c84-4b7b-8863-122018433270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:02.346159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06bbb0-8c84-4b7b-8863-122018433270 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:02.346709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06bbb0-8c84-4b7b-8863-122018433270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:02.347971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06bbb0-8c84-4b7b-8863-122018433270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:02.348984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06bbb0-8c84-4b7b-8863-122018433270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:02.352586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06bbb0-8c84-4b7b-8863-122018433270 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:02.368736 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1763/3550] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:13:02.370445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb3b88-69b3-462a-a3b4-a8d14a7c639a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:02.381981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb3b88-69b3-462a-a3b4-a8d14a7c639a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:02.388970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131ec35-a98b-4931-a841-a52bc90b009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:02.390402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ec35-a98b-4931-a841-a52bc90b009f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:02.390687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ec35-a98b-4931-a841-a52bc90b009f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:02.391083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ec35-a98b-4931-a841-a52bc90b009f admin admin] PATH_INFO: `/v3/projects/3078012968784295bc15ee359b50fd67/users/49b3edfc62e747a8a21e76bfde79f40e/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:02.410777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131ec35-a98b-4931-a841-a52bc90b009f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3078012968784295bc15ee359b50fd67, user_id=49b3edfc62e747a8a21e76bfde79f40e, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:02.415890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131ec35-a98b-4931-a841-a52bc90b009f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:02.437699 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1788/3551] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:13:02 2022] PUT /identity/v3/projects/3078012968784295bc15ee359b50fd67/users/49b3edfc62e747a8a21e76bfde79f40e/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:02.442508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e221a58-518c-4927-8a1b-630159e9ce8e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:02.443027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e221a58-518c-4927-8a1b-630159e9ce8e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:02.443490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e221a58-518c-4927-8a1b-630159e9ce8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:02.467744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4e221a58-518c-4927-8a1b-630159e9ce8e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:02.469079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4e221a58-518c-4927-8a1b-630159e9ce8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:02.611117 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1764/3552] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:13:02.673823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131ec35-a98b-4931-a841-a52bc90b009f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:02.675896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8131ec35-a98b-4931-a841-a52bc90b009f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:02.790248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131ec35-a98b-4931-a841-a52bc90b009f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:02.796779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a0018-f58c-498b-bd08-2aed331dee80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:02.797403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0018-f58c-498b-bd08-2aed331dee80 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:02.797678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0018-f58c-498b-bd08-2aed331dee80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:02.798131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0018-f58c-498b-bd08-2aed331dee80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:02.818708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a0018-f58c-498b-bd08-2aed331dee80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:02.821333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a0018-f58c-498b-bd08-2aed331dee80 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:02.842779 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1789/3553] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:13:03.389192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee50a9-e080-44f6-89ad-14fb70c8db81 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:03.389703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee50a9-e080-44f6-89ad-14fb70c8db81 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:03.389920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee50a9-e080-44f6-89ad-14fb70c8db81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:03.465329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3aee50a9-e080-44f6-89ad-14fb70c8db81 None None] MFA Rules not processed for user `3714a80dffe147b5b683e6a3419d0df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:03.466420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3aee50a9-e080-44f6-89ad-14fb70c8db81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:03.617471 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:03.670630 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1765/3554] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:03.844183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a0018-f58c-498b-bd08-2aed331dee80 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:03.845818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6e7a0018-f58c-498b-bd08-2aed331dee80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:03.941323 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:03.990981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a0018-f58c-498b-bd08-2aed331dee80 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:04.000090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eaadb-b443-4757-9dd3-9c284c92ae0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:04.001237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eaadb-b443-4757-9dd3-9c284c92ae0c service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:04.001624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eaadb-b443-4757-9dd3-9c284c92ae0c service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:04.002310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eaadb-b443-4757-9dd3-9c284c92ae0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:04.014054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561eaadb-b443-4757-9dd3-9c284c92ae0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:04.016164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561eaadb-b443-4757-9dd3-9c284c92ae0c service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:04.040573 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1790/3555] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:13:08.921716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4c8f8-1a45-47a0-8c49-a1b7a54f6ecb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:08.922168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4c8f8-1a45-47a0-8c49-a1b7a54f6ecb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:08.922532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4c8f8-1a45-47a0-8c49-a1b7a54f6ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:08.964120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3ec4c8f8-1a45-47a0-8c49-a1b7a54f6ecb None None] MFA Rules not processed for user `3714a80dffe147b5b683e6a3419d0df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:08.967481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3ec4c8f8-1a45-47a0-8c49-a1b7a54f6ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:08.984068 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1766/3556] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:09.377784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eaadb-b443-4757-9dd3-9c284c92ae0c service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:09.379439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-561eaadb-b443-4757-9dd3-9c284c92ae0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:09.549746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eaadb-b443-4757-9dd3-9c284c92ae0c service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:09.571369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e48b5-b65b-4e29-81dd-0c867395eaef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:09.572482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e48b5-b65b-4e29-81dd-0c867395eaef service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:09.573139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e48b5-b65b-4e29-81dd-0c867395eaef service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:09.573652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e48b5-b65b-4e29-81dd-0c867395eaef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:09.580389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-819e48b5-b65b-4e29-81dd-0c867395eaef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:09.615109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e48b5-b65b-4e29-81dd-0c867395eaef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:09.617470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e48b5-b65b-4e29-81dd-0c867395eaef service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:09.662238 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1791/3557] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:13:18.639305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4ea0b-918e-43c2-b018-98c85a6a5aae None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:18.640962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4ea0b-918e-43c2-b018-98c85a6a5aae None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:18.642047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4ea0b-918e-43c2-b018-98c85a6a5aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:18.751926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3fc4ea0b-918e-43c2-b018-98c85a6a5aae None None] MFA Rules not processed for user `49b3edfc62e747a8a21e76bfde79f40e`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:18.760180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3fc4ea0b-918e-43c2-b018-98c85a6a5aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:18.992247 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1767/3558] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:18.996786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e48b5-b65b-4e29-81dd-0c867395eaef service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:19.017473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e48b5-b65b-4e29-81dd-0c867395eaef service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:19.054828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cbbca-e986-421b-ada1-5f37636b9c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:19.055404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cbbca-e986-421b-ada1-5f37636b9c04 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:19.055690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cbbca-e986-421b-ada1-5f37636b9c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:19.056138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cbbca-e986-421b-ada1-5f37636b9c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:19.056812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56cbbca-e986-421b-ada1-5f37636b9c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:19.058732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56cbbca-e986-421b-ada1-5f37636b9c04 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:19.161140 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1792/3559] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:13:18 2022] POST /identity/v3/projects => generated 389 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:13:19.165445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4ea0b-918e-43c2-b018-98c85a6a5aae None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:19.182374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4ea0b-918e-43c2-b018-98c85a6a5aae None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:19.339829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183f588-9412-49bd-bbeb-f3bd426eea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:19.351167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183f588-9412-49bd-bbeb-f3bd426eea6e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:19.351579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183f588-9412-49bd-bbeb-f3bd426eea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:19.351866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183f588-9412-49bd-bbeb-f3bd426eea6e admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:19.352570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183f588-9412-49bd-bbeb-f3bd426eea6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:19.354529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183f588-9412-49bd-bbeb-f3bd426eea6e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:19.395177 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1768/3560] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:13:19 2022] POST /identity/v3/users => generated 301 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:13:19.396252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cbbca-e986-421b-ada1-5f37636b9c04 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:19.414400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cbbca-e986-421b-ada1-5f37636b9c04 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:19.426606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66497b96-1ea2-44b5-89ab-20ba393d8912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:19.428273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497b96-1ea2-44b5-89ab-20ba393d8912 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:19.429298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497b96-1ea2-44b5-89ab-20ba393d8912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:19.429780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497b96-1ea2-44b5-89ab-20ba393d8912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:19.432541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66497b96-1ea2-44b5-89ab-20ba393d8912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:19.452044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66497b96-1ea2-44b5-89ab-20ba393d8912 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:19.530692 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1793/3561] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:13:19.533707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183f588-9412-49bd-bbeb-f3bd426eea6e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:19.546012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183f588-9412-49bd-bbeb-f3bd426eea6e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:19.564581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ae8f9-04e3-4540-a379-12df84537005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:19.564696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ae8f9-04e3-4540-a379-12df84537005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:19.564977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ae8f9-04e3-4540-a379-12df84537005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:19.565160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ae8f9-04e3-4540-a379-12df84537005 admin admin] PATH_INFO: `/v3/projects/7cb95dba529544919ecc28e834172965/users/a5a864e596cb43b89de3638aa25e0555/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:19.604485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ae8f9-04e3-4540-a379-12df84537005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb95dba529544919ecc28e834172965, user_id=a5a864e596cb43b89de3638aa25e0555, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:19.607711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ae8f9-04e3-4540-a379-12df84537005 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:19.629972 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1769/3562] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:13:19 2022] PUT /identity/v3/projects/7cb95dba529544919ecc28e834172965/users/a5a864e596cb43b89de3638aa25e0555/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:19.631783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66497b96-1ea2-44b5-89ab-20ba393d8912 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:19.651203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66497b96-1ea2-44b5-89ab-20ba393d8912 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:19.897976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44beb10e-b091-4c04-8cbc-ceafbfe365a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:19.914794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb10e-b091-4c04-8cbc-ceafbfe365a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:19.927074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb10e-b091-4c04-8cbc-ceafbfe365a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:19.931138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb10e-b091-4c04-8cbc-ceafbfe365a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:19.935251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44beb10e-b091-4c04-8cbc-ceafbfe365a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:19.945061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44beb10e-b091-4c04-8cbc-ceafbfe365a9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:19.959200 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1794/3563] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:13:19.963843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ae8f9-04e3-4540-a379-12df84537005 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:19.981290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ae8f9-04e3-4540-a379-12df84537005 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:19.994677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c0946-3008-41f3-87cc-8c582c563227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:19.995455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c0946-3008-41f3-87cc-8c582c563227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:19.995734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c0946-3008-41f3-87cc-8c582c563227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:19.996008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c0946-3008-41f3-87cc-8c582c563227 admin admin] PATH_INFO: `/v3/projects/7cb95dba529544919ecc28e834172965/users/a5a864e596cb43b89de3638aa25e0555/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:19.998637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c0946-3008-41f3-87cc-8c582c563227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb95dba529544919ecc28e834172965, user_id=a5a864e596cb43b89de3638aa25e0555, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:20.001389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c0946-3008-41f3-87cc-8c582c563227 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:20.044053 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1770/3564] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:13:19 2022] PUT /identity/v3/projects/7cb95dba529544919ecc28e834172965/users/a5a864e596cb43b89de3638aa25e0555/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:22.061992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb9b49-abcd-4ef4-a770-77949ec558e7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:22.062545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb9b49-abcd-4ef4-a770-77949ec558e7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:22.062678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb9b49-abcd-4ef4-a770-77949ec558e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:22.124093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d0cb9b49-abcd-4ef4-a770-77949ec558e7 None None] MFA Rules not processed for user `df9979f0dcd74d60a55d02d432de6a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:22.125707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d0cb9b49-abcd-4ef4-a770-77949ec558e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:22.175749 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:22.289014 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1795/3565] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:22.972450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c0946-3008-41f3-87cc-8c582c563227 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:22.974323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e92c0946-3008-41f3-87cc-8c582c563227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:23.044279 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:23.179063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c0946-3008-41f3-87cc-8c582c563227 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:23.200342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9ae85-f75c-4cf1-9e85-638d476c123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:23.201586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ae85-f75c-4cf1-9e85-638d476c123a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:23.202046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ae85-f75c-4cf1-9e85-638d476c123a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:23.202482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ae85-f75c-4cf1-9e85-638d476c123a admin admin] PATH_INFO: `/v3/users/befcf8a010bb48d3a174a52ea94d012e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:23.204062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9ae85-f75c-4cf1-9e85-638d476c123a admin admin] RBAC: Authorizing `identity:delete_user(user_id=befcf8a010bb48d3a174a52ea94d012e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:23.206524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9ae85-f75c-4cf1-9e85-638d476c123a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:23.381321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-44f9ae85-f75c-4cf1-9e85-638d476c123a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'befcf8a010bb48d3a174a52ea94d012e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:23.382283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-44f9ae85-f75c-4cf1-9e85-638d476c123a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'befcf8a010bb48d3a174a52ea94d012e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:23.405416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-44f9ae85-f75c-4cf1-9e85-638d476c123a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'befcf8a010bb48d3a174a52ea94d012e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:23.433784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-44f9ae85-f75c-4cf1-9e85-638d476c123a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'befcf8a010bb48d3a174a52ea94d012e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:23.435750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-44f9ae85-f75c-4cf1-9e85-638d476c123a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'befcf8a010bb48d3a174a52ea94d012e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:23.485244 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1771/3566] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:13:22 2022] DELETE /identity/v3/users/befcf8a010bb48d3a174a52ea94d012e => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:23.806884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb9b49-abcd-4ef4-a770-77949ec558e7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:23.826155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb9b49-abcd-4ef4-a770-77949ec558e7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:23.921653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a62a93-092f-45af-b3a7-13812576ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:23.922603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a62a93-092f-45af-b3a7-13812576ec39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:23.922896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a62a93-092f-45af-b3a7-13812576ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:23.923189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a62a93-092f-45af-b3a7-13812576ec39 admin admin] PATH_INFO: `/v3/projects/d688e31f04ce4d14bbc9c4d2635d3e2a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:23.925395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a62a93-092f-45af-b3a7-13812576ec39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d688e31f04ce4d14bbc9c4d2635d3e2a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:23.930968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a62a93-092f-45af-b3a7-13812576ec39 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:24.011939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-50a62a93-092f-45af-b3a7-13812576ec39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'request_id': 'req-50a62a93-092f-45af-b3a7-13812576ec39'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:24.024134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-50a62a93-092f-45af-b3a7-13812576ec39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'request_id': 'req-50a62a93-092f-45af-b3a7-13812576ec39'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:24.038050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-50a62a93-092f-45af-b3a7-13812576ec39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'request_id': 'req-50a62a93-092f-45af-b3a7-13812576ec39'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:24.057604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-50a62a93-092f-45af-b3a7-13812576ec39 admin admin] The token cache is being invalidate because project d688e31f04ce4d14bbc9c4d2635d3e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:13:24.058739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-50a62a93-092f-45af-b3a7-13812576ec39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:24.059477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-50a62a93-092f-45af-b3a7-13812576ec39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:24.064701 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1796/3567] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:13:23 2022] DELETE /identity/v3/projects/d688e31f04ce4d14bbc9c4d2635d3e2a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:24.066474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2d388-5363-4463-842b-0c231de02bf6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:24.066951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2d388-5363-4463-842b-0c231de02bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:24.067063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2d388-5363-4463-842b-0c231de02bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:24.094334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-62f2d388-5363-4463-842b-0c231de02bf6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:24.095898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-62f2d388-5363-4463-842b-0c231de02bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:24.202193 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1772/3568] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:24.209846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc5382-ff95-4729-ae09-e5197646d11a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:24.210376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc5382-ff95-4729-ae09-e5197646d11a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:24.210674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc5382-ff95-4729-ae09-e5197646d11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:24.239030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4ffc5382-ff95-4729-ae09-e5197646d11a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:24.240597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4ffc5382-ff95-4729-ae09-e5197646d11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:24.254285 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1797/3569] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:13:24.258633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2d388-5363-4463-842b-0c231de02bf6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:24.273402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2d388-5363-4463-842b-0c231de02bf6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:24.284631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65c931-2b60-4a06-8fed-b39695339465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:24.286021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65c931-2b60-4a06-8fed-b39695339465 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:24.286614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65c931-2b60-4a06-8fed-b39695339465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:24.287235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65c931-2b60-4a06-8fed-b39695339465 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:24.289203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65c931-2b60-4a06-8fed-b39695339465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:13:24.289804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65c931-2b60-4a06-8fed-b39695339465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:24.292286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65c931-2b60-4a06-8fed-b39695339465 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:24.312944 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1773/3570] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:13:24.317300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc5382-ff95-4729-ae09-e5197646d11a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:24.327997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc5382-ff95-4729-ae09-e5197646d11a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:24.338649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ce56b-3873-46fd-b478-5602eadb0a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:24.339339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ce56b-3873-46fd-b478-5602eadb0a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:24.339589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ce56b-3873-46fd-b478-5602eadb0a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:24.339859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ce56b-3873-46fd-b478-5602eadb0a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:24.340516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ce56b-3873-46fd-b478-5602eadb0a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:24.342432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ce56b-3873-46fd-b478-5602eadb0a67 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:24.432666 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1798/3571] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:13:24 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:13:24.437348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65c931-2b60-4a06-8fed-b39695339465 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:24.450233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65c931-2b60-4a06-8fed-b39695339465 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:24.531266 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:24.618291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ab624-66b9-412e-86f8-5ac7a067b87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:24.619627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab624-66b9-412e-86f8-5ac7a067b87d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:24.620087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab624-66b9-412e-86f8-5ac7a067b87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:24.621949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab624-66b9-412e-86f8-5ac7a067b87d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:24.623504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ab624-66b9-412e-86f8-5ac7a067b87d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:24.629113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ab624-66b9-412e-86f8-5ac7a067b87d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:24.719878 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1774/3572] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:13:24 2022] POST /identity/v3/users => generated 283 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:13:24.720086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ce56b-3873-46fd-b478-5602eadb0a67 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:24.736931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ce56b-3873-46fd-b478-5602eadb0a67 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:24.743048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b1e45-4b1e-4e25-b2d2-6ac5b9c8c808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:24.745266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b1e45-4b1e-4e25-b2d2-6ac5b9c8c808 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:24.746101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b1e45-4b1e-4e25-b2d2-6ac5b9c8c808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:24.746650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b1e45-4b1e-4e25-b2d2-6ac5b9c8c808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:24.749741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b1e45-4b1e-4e25-b2d2-6ac5b9c8c808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:24.753361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b1e45-4b1e-4e25-b2d2-6ac5b9c8c808 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:24.799516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ab624-66b9-412e-86f8-5ac7a067b87d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:24.809889 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1799/3573] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:13:24.821218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ab624-66b9-412e-86f8-5ac7a067b87d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:24.838420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5abb5b-67a5-4597-8905-96faeac5b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:24.841423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5abb5b-67a5-4597-8905-96faeac5b9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:24.841719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5abb5b-67a5-4597-8905-96faeac5b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:24.841997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5abb5b-67a5-4597-8905-96faeac5b9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:24.845891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5abb5b-67a5-4597-8905-96faeac5b9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:24.849290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5abb5b-67a5-4597-8905-96faeac5b9a1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:24.886754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b1e45-4b1e-4e25-b2d2-6ac5b9c8c808 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:24.894936 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1775/3574] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:13:24.901951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b1e45-4b1e-4e25-b2d2-6ac5b9c8c808 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:24.914353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22b218-7123-4bfc-914b-da179225d8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:24.916367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b218-7123-4bfc-914b-da179225d8b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:24.916678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b218-7123-4bfc-914b-da179225d8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:24.917832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b218-7123-4bfc-914b-da179225d8b7 admin admin] PATH_INFO: `/v3/projects/82d1c738ddf642ed8febdb236f5bf8f3/users/1cb1f704f82b46bd85d0f117f1686b5d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:24.962193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22b218-7123-4bfc-914b-da179225d8b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d1c738ddf642ed8febdb236f5bf8f3, user_id=1cb1f704f82b46bd85d0f117f1686b5d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:24.966365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22b218-7123-4bfc-914b-da179225d8b7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:24.975419 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:25.013817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345970e-99fc-44cf-8441-c6a45116f75f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:25.014482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345970e-99fc-44cf-8441-c6a45116f75f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:25.014887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345970e-99fc-44cf-8441-c6a45116f75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:25.017912 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1800/3575] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:13:24 2022] PUT /identity/v3/projects/82d1c738ddf642ed8febdb236f5bf8f3/users/1cb1f704f82b46bd85d0f117f1686b5d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:25.056847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6345970e-99fc-44cf-8441-c6a45116f75f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:25.058908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6345970e-99fc-44cf-8441-c6a45116f75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:25.148315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5571b-769e-40fe-9c88-168f1bbeba9a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:25.148764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5571b-769e-40fe-9c88-168f1bbeba9a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:25.149308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5571b-769e-40fe-9c88-168f1bbeba9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:25.189136 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1776/3576] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:25.200956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345970e-99fc-44cf-8441-c6a45116f75f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:25.203969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6345970e-99fc-44cf-8441-c6a45116f75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:25.211320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-22f5571b-769e-40fe-9c88-168f1bbeba9a None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:25.214162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22f5571b-769e-40fe-9c88-168f1bbeba9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:25.345988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345970e-99fc-44cf-8441-c6a45116f75f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:25.351554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd5446-4b77-4e96-9b17-ed4389177009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:25.356299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd5446-4b77-4e96-9b17-ed4389177009 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:25.356627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd5446-4b77-4e96-9b17-ed4389177009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:25.356911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd5446-4b77-4e96-9b17-ed4389177009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:25.406050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd5446-4b77-4e96-9b17-ed4389177009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:25.407577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd5446-4b77-4e96-9b17-ed4389177009 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:25.437740 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1777/3577] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:13:25.442403 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1801/3578] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:25.468209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd5446-4b77-4e96-9b17-ed4389177009 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:25.474269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b0cd5446-4b77-4e96-9b17-ed4389177009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:25.586862 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:25.640192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd5446-4b77-4e96-9b17-ed4389177009 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:25.654002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4147d-f2d3-4716-8f9d-f282b33dce9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:25.654947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4147d-f2d3-4716-8f9d-f282b33dce9c service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:25.655160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4147d-f2d3-4716-8f9d-f282b33dce9c service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:25.655400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4147d-f2d3-4716-8f9d-f282b33dce9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:25.682446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4147d-f2d3-4716-8f9d-f282b33dce9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:25.686439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4147d-f2d3-4716-8f9d-f282b33dce9c service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:25.708663 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1778/3579] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:13:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:13:35.423237 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=27 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:35.696833 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:41.023701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae30359-fdca-4790-be4d-96ca59e5b5a4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:41.024169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae30359-fdca-4790-be4d-96ca59e5b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:41.024438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae30359-fdca-4790-be4d-96ca59e5b5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:41.132699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1ae30359-fdca-4790-be4d-96ca59e5b5a4 None None] MFA Rules not processed for user `a5a864e596cb43b89de3638aa25e0555`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:41.133933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1ae30359-fdca-4790-be4d-96ca59e5b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:41.403966 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1802/3580] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:41.414999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4147d-f2d3-4716-8f9d-f282b33dce9c service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:41.416528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-55c4147d-f2d3-4716-8f9d-f282b33dce9c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:41.584415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4147d-f2d3-4716-8f9d-f282b33dce9c service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:41.598146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff7ee4-9698-4a7d-8bc7-32af4f68c2e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:41.598887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff7ee4-9698-4a7d-8bc7-32af4f68c2e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:41.599360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff7ee4-9698-4a7d-8bc7-32af4f68c2e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:41.600281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff7ee4-9698-4a7d-8bc7-32af4f68c2e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:41.602217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c4ff7ee4-9698-4a7d-8bc7-32af4f68c2e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:41.757138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff7ee4-9698-4a7d-8bc7-32af4f68c2e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:41.759130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff7ee4-9698-4a7d-8bc7-32af4f68c2e4 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:41.785082 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1779/3581] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:13:47.392109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae30359-fdca-4790-be4d-96ca59e5b5a4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:47.395004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1ae30359-fdca-4790-be4d-96ca59e5b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:47.442783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae30359-fdca-4790-be4d-96ca59e5b5a4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:47.484411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4782f5-2e0c-4dfc-b0af-fc3b75d9fd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:47.485059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4782f5-2e0c-4dfc-b0af-fc3b75d9fd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:47.485337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4782f5-2e0c-4dfc-b0af-fc3b75d9fd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:47.485610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4782f5-2e0c-4dfc-b0af-fc3b75d9fd5e admin admin] PATH_INFO: `/v3/users/17f95d77e66946ce9ac525cc34c61d7c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:47.497209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4782f5-2e0c-4dfc-b0af-fc3b75d9fd5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f95d77e66946ce9ac525cc34c61d7c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:47.504176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4782f5-2e0c-4dfc-b0af-fc3b75d9fd5e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:47.678431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fa4782f5-2e0c-4dfc-b0af-fc3b75d9fd5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f95d77e66946ce9ac525cc34c61d7c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:47.683767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fa4782f5-2e0c-4dfc-b0af-fc3b75d9fd5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f95d77e66946ce9ac525cc34c61d7c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:47.714544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fa4782f5-2e0c-4dfc-b0af-fc3b75d9fd5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f95d77e66946ce9ac525cc34c61d7c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:47.740673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fa4782f5-2e0c-4dfc-b0af-fc3b75d9fd5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f95d77e66946ce9ac525cc34c61d7c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:47.741444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fa4782f5-2e0c-4dfc-b0af-fc3b75d9fd5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f95d77e66946ce9ac525cc34c61d7c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:47.767362 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1803/3582] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:13:47 2022] DELETE /identity/v3/users/17f95d77e66946ce9ac525cc34c61d7c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:48.179315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff7ee4-9698-4a7d-8bc7-32af4f68c2e4 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:48.192062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff7ee4-9698-4a7d-8bc7-32af4f68c2e4 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:48.383205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3f795-8bb1-4b62-a492-0b3096805bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:48.384602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f795-8bb1-4b62-a492-0b3096805bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:48.387094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f795-8bb1-4b62-a492-0b3096805bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:48.388196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f795-8bb1-4b62-a492-0b3096805bbe admin admin] PATH_INFO: `/v3/projects/3986cde5f07a4eeead588c344187a0b8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:48.391060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3f795-8bb1-4b62-a492-0b3096805bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3986cde5f07a4eeead588c344187a0b8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:48.397434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3f795-8bb1-4b62-a492-0b3096805bbe admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:48.529487 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:48.533798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-73c3f795-8bb1-4b62-a492-0b3096805bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3986cde5f07a4eeead588c344187a0b8', 'request_id': 'req-73c3f795-8bb1-4b62-a492-0b3096805bbe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:48.544969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-73c3f795-8bb1-4b62-a492-0b3096805bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3986cde5f07a4eeead588c344187a0b8', 'request_id': 'req-73c3f795-8bb1-4b62-a492-0b3096805bbe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:48.584859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-73c3f795-8bb1-4b62-a492-0b3096805bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3986cde5f07a4eeead588c344187a0b8', 'request_id': 'req-73c3f795-8bb1-4b62-a492-0b3096805bbe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:48.603919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-73c3f795-8bb1-4b62-a492-0b3096805bbe admin admin] The token cache is being invalidate because project 3986cde5f07a4eeead588c344187a0b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:13:48.604297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-73c3f795-8bb1-4b62-a492-0b3096805bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:48.604878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-73c3f795-8bb1-4b62-a492-0b3096805bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:48.606717 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1780/3583] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:13:48 2022] DELETE /identity/v3/projects/3986cde5f07a4eeead588c344187a0b8 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:48.612676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa55baa-8bb7-46d1-9bff-8cf98a0d2f98 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:48.614271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa55baa-8bb7-46d1-9bff-8cf98a0d2f98 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:48.614892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa55baa-8bb7-46d1-9bff-8cf98a0d2f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:48.664800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-caa55baa-8bb7-46d1-9bff-8cf98a0d2f98 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:48.673305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-caa55baa-8bb7-46d1-9bff-8cf98a0d2f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:48.826315 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:48.847692 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1804/3584] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:48.856197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb627ce6-ab70-4a2b-bd9f-f81150685882 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:48.856431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb627ce6-ab70-4a2b-bd9f-f81150685882 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:48.856716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb627ce6-ab70-4a2b-bd9f-f81150685882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:48.908036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cb627ce6-ab70-4a2b-bd9f-f81150685882 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:48.909284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cb627ce6-ab70-4a2b-bd9f-f81150685882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:48.934940 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1781/3585] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:48.945220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa55baa-8bb7-46d1-9bff-8cf98a0d2f98 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:48.957317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa55baa-8bb7-46d1-9bff-8cf98a0d2f98 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:48.967791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e09108-809b-49aa-854d-654b19dfe767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:48.968658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e09108-809b-49aa-854d-654b19dfe767 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:48.969116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e09108-809b-49aa-854d-654b19dfe767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:48.969550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e09108-809b-49aa-854d-654b19dfe767 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:48.970373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e09108-809b-49aa-854d-654b19dfe767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:13:48.971335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e09108-809b-49aa-854d-654b19dfe767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:48.973419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e09108-809b-49aa-854d-654b19dfe767 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:48.999534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb627ce6-ab70-4a2b-bd9f-f81150685882 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:49.000521 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1805/3586] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:13:49.016177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb627ce6-ab70-4a2b-bd9f-f81150685882 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:49.024828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e210b64-f928-4940-9861-182dd2dece31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:49.025456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e210b64-f928-4940-9861-182dd2dece31 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:49.025737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e210b64-f928-4940-9861-182dd2dece31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:49.026023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e210b64-f928-4940-9861-182dd2dece31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:49.026676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e210b64-f928-4940-9861-182dd2dece31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:49.028644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e210b64-f928-4940-9861-182dd2dece31 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:49.091985 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1782/3587] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:13:48 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:13:49.096409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e09108-809b-49aa-854d-654b19dfe767 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:49.114550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e09108-809b-49aa-854d-654b19dfe767 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:49.235651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884c60a-323d-4055-a499-0f4a535dbaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:49.236312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c60a-323d-4055-a499-0f4a535dbaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:49.236723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c60a-323d-4055-a499-0f4a535dbaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:49.236997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c60a-323d-4055-a499-0f4a535dbaf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:49.237952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884c60a-323d-4055-a499-0f4a535dbaf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:49.240443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884c60a-323d-4055-a499-0f4a535dbaf9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:49.289714 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1806/3588] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:13:49 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:13:49.290943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e210b64-f928-4940-9861-182dd2dece31 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:49.308531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e210b64-f928-4940-9861-182dd2dece31 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:49.323773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b9997-4db9-4968-b815-3d010cb03c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:49.324751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b9997-4db9-4968-b815-3d010cb03c4d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:49.324751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b9997-4db9-4968-b815-3d010cb03c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:49.324948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b9997-4db9-4968-b815-3d010cb03c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:49.325525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b9997-4db9-4968-b815-3d010cb03c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:49.327176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b9997-4db9-4968-b815-3d010cb03c4d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:49.345821 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1783/3589] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:13:49.347193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884c60a-323d-4055-a499-0f4a535dbaf9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:49.363033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884c60a-323d-4055-a499-0f4a535dbaf9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:49.376045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097a9a3-94e5-4564-aaea-94db22c69dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:49.376045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097a9a3-94e5-4564-aaea-94db22c69dbc admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:49.376045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097a9a3-94e5-4564-aaea-94db22c69dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:49.376045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097a9a3-94e5-4564-aaea-94db22c69dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:49.376937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097a9a3-94e5-4564-aaea-94db22c69dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:49.378204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097a9a3-94e5-4564-aaea-94db22c69dbc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:49.406570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b9997-4db9-4968-b815-3d010cb03c4d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:49.411955 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1807/3590] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:13:49.420286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b9997-4db9-4968-b815-3d010cb03c4d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:49.436584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97aebc-e913-4ed1-99a3-bc641b794f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:49.437368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97aebc-e913-4ed1-99a3-bc641b794f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:49.437662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97aebc-e913-4ed1-99a3-bc641b794f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:49.437959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97aebc-e913-4ed1-99a3-bc641b794f48 admin admin] PATH_INFO: `/v3/projects/50faaea815f44af798f20a9977157801/users/d0213371a83f4a85bacc0ecdec5b2535/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:49.472603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97aebc-e913-4ed1-99a3-bc641b794f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50faaea815f44af798f20a9977157801, user_id=d0213371a83f4a85bacc0ecdec5b2535, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:49.475386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97aebc-e913-4ed1-99a3-bc641b794f48 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:49.496929 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1784/3591] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:13:49 2022] PUT /identity/v3/projects/50faaea815f44af798f20a9977157801/users/d0213371a83f4a85bacc0ecdec5b2535/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:49.501626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e391fed-5ca1-493e-a3f3-d1ec6c2c4254 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:49.501913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e391fed-5ca1-493e-a3f3-d1ec6c2c4254 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:49.502184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e391fed-5ca1-493e-a3f3-d1ec6c2c4254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:49.537503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4e391fed-5ca1-493e-a3f3-d1ec6c2c4254 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:49.538783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4e391fed-5ca1-493e-a3f3-d1ec6c2c4254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:49.696118 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1808/3592] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:49.698218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97aebc-e913-4ed1-99a3-bc641b794f48 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:49.700003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fb97aebc-e913-4ed1-99a3-bc641b794f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:49.711404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e391fed-5ca1-493e-a3f3-d1ec6c2c4254 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:49.712821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4e391fed-5ca1-493e-a3f3-d1ec6c2c4254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:49.881125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97aebc-e913-4ed1-99a3-bc641b794f48 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:49.897733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e391fed-5ca1-493e-a3f3-d1ec6c2c4254 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:49.904234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c0f63-7f30-4e0b-b3f7-89a23ba32e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:49.904882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c0f63-7f30-4e0b-b3f7-89a23ba32e18 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:49.905160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c0f63-7f30-4e0b-b3f7-89a23ba32e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:49.906531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c0f63-7f30-4e0b-b3f7-89a23ba32e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:49.923771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8869830-99a2-444b-a25b-39172db3bb49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:49.924414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8869830-99a2-444b-a25b-39172db3bb49 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:49.924668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8869830-99a2-444b-a25b-39172db3bb49 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:49.924938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8869830-99a2-444b-a25b-39172db3bb49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:49.928406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f8869830-99a2-444b-a25b-39172db3bb49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:49.938979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c0f63-7f30-4e0b-b3f7-89a23ba32e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:49.940456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c0f63-7f30-4e0b-b3f7-89a23ba32e18 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:49.954427 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:49.963775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8869830-99a2-444b-a25b-39172db3bb49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:49.965076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8869830-99a2-444b-a25b-39172db3bb49 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:49.976935 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1785/3593] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:13:50.009728 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1809/3594] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:13:53.126215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716cd90-b004-4089-9014-7b1a91cfeebf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:53.126694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716cd90-b004-4089-9014-7b1a91cfeebf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:53.126799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716cd90-b004-4089-9014-7b1a91cfeebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:53.226614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b716cd90-b004-4089-9014-7b1a91cfeebf None None] MFA Rules not processed for user `1cb1f704f82b46bd85d0f117f1686b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:53.231428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b716cd90-b004-4089-9014-7b1a91cfeebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:53.422355 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1786/3595] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:53.437218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8869830-99a2-444b-a25b-39172db3bb49 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:53.439421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f8869830-99a2-444b-a25b-39172db3bb49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:53.751983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8869830-99a2-444b-a25b-39172db3bb49 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:53.780779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e3ca5-0628-40ea-b809-db6b3c0514a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:53.781405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e3ca5-0628-40ea-b809-db6b3c0514a4 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:53.790438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e3ca5-0628-40ea-b809-db6b3c0514a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:53.790752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e3ca5-0628-40ea-b809-db6b3c0514a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:53.818332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e3ca5-0628-40ea-b809-db6b3c0514a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:53.821944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e3ca5-0628-40ea-b809-db6b3c0514a4 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:53.848103 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1810/3596] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:13:54.749372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716cd90-b004-4089-9014-7b1a91cfeebf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:54.751042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b716cd90-b004-4089-9014-7b1a91cfeebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:54.779470 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:54.822719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716cd90-b004-4089-9014-7b1a91cfeebf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:54.843766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:54.845786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:54.847178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:54.848509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] PATH_INFO: `/v3/users/98757311ce154e76ab6e4da5730031d0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:54.856903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98757311ce154e76ab6e4da5730031d0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:54.863917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:55.035332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98757311ce154e76ab6e4da5730031d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:55.037596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98757311ce154e76ab6e4da5730031d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:55.072004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98757311ce154e76ab6e4da5730031d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:55.085983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98757311ce154e76ab6e4da5730031d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:55.086625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98757311ce154e76ab6e4da5730031d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:55.112657 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1787/3597] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:13:54 2022] DELETE /identity/v3/users/98757311ce154e76ab6e4da5730031d0 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:55.118035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa766-613d-4ce6-87f2-40146629d2b5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:55.118600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa766-613d-4ce6-87f2-40146629d2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:55.118600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa766-613d-4ce6-87f2-40146629d2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:55.156729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-891aa766-613d-4ce6-87f2-40146629d2b5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:55.158800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-891aa766-613d-4ce6-87f2-40146629d2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:55.263320 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1811/3598] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:55.285284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:55.287984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:55.451123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c648ae8-a7ad-43e2-9e83-6efba0be2f35 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:55.473265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62713292-0f71-48df-a272-ea159014cbb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:55.474800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62713292-0f71-48df-a272-ea159014cbb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:55.475210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62713292-0f71-48df-a272-ea159014cbb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:55.477514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62713292-0f71-48df-a272-ea159014cbb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:55.520401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62713292-0f71-48df-a272-ea159014cbb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:55.524968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62713292-0f71-48df-a272-ea159014cbb8 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:55.576679 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1788/3599] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:13:57.500609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aa766-613d-4ce6-87f2-40146629d2b5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:57.502967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-891aa766-613d-4ce6-87f2-40146629d2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:57.545889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aa766-613d-4ce6-87f2-40146629d2b5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:57.566122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6e6a6-e484-4f4e-be38-152a672267fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:57.568392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6e6a6-e484-4f4e-be38-152a672267fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:57.570150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6e6a6-e484-4f4e-be38-152a672267fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:57.573363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6e6a6-e484-4f4e-be38-152a672267fe admin admin] PATH_INFO: `/v3/projects/949699648c5f47f2b0dce63a3bf4a665` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:57.575553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6e6a6-e484-4f4e-be38-152a672267fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=949699648c5f47f2b0dce63a3bf4a665)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:57.580886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6e6a6-e484-4f4e-be38-152a672267fe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:57.794153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06d6e6a6-e484-4f4e-be38-152a672267fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949699648c5f47f2b0dce63a3bf4a665', 'request_id': 'req-06d6e6a6-e484-4f4e-be38-152a672267fe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:57.807463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06d6e6a6-e484-4f4e-be38-152a672267fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949699648c5f47f2b0dce63a3bf4a665', 'request_id': 'req-06d6e6a6-e484-4f4e-be38-152a672267fe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:57.823096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06d6e6a6-e484-4f4e-be38-152a672267fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949699648c5f47f2b0dce63a3bf4a665', 'request_id': 'req-06d6e6a6-e484-4f4e-be38-152a672267fe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:57.855004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06d6e6a6-e484-4f4e-be38-152a672267fe admin admin] The token cache is being invalidate because project 949699648c5f47f2b0dce63a3bf4a665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:13:57.855339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06d6e6a6-e484-4f4e-be38-152a672267fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:57.857293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06d6e6a6-e484-4f4e-be38-152a672267fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:57.859377 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1812/3600] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:13:57 2022] DELETE /identity/v3/projects/949699648c5f47f2b0dce63a3bf4a665 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:57.864037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0b34d-00e1-4a9b-8179-638ddb5c05bf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:57.865861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0b34d-00e1-4a9b-8179-638ddb5c05bf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:57.865861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0b34d-00e1-4a9b-8179-638ddb5c05bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:57.948103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7bb0b34d-00e1-4a9b-8179-638ddb5c05bf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:57.949501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7bb0b34d-00e1-4a9b-8179-638ddb5c05bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:58.142788 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1789/3601] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:58.151001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85568206-174e-45f2-a2d7-a6623c722919 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:58.151427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85568206-174e-45f2-a2d7-a6623c722919 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:58.151811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85568206-174e-45f2-a2d7-a6623c722919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:58.172820 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:58.219193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-85568206-174e-45f2-a2d7-a6623c722919 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:58.228844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-85568206-174e-45f2-a2d7-a6623c722919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:58.253196 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1813/3602] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:58.256347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0b34d-00e1-4a9b-8179-638ddb5c05bf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:58.272356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0b34d-00e1-4a9b-8179-638ddb5c05bf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:58.287268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8572d-9136-4c77-a62f-40520d9cabf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:58.288113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8572d-9136-4c77-a62f-40520d9cabf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:58.288640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8572d-9136-4c77-a62f-40520d9cabf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:58.289016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8572d-9136-4c77-a62f-40520d9cabf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:58.290355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8572d-9136-4c77-a62f-40520d9cabf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:13:58.290897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8572d-9136-4c77-a62f-40520d9cabf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:58.296487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8572d-9136-4c77-a62f-40520d9cabf3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:58.366494 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1790/3603] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:13:58.368016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85568206-174e-45f2-a2d7-a6623c722919 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:58.385063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85568206-174e-45f2-a2d7-a6623c722919 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:58.405150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7bc33-7866-4381-873a-4731f2fe3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:58.415455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7bc33-7866-4381-873a-4731f2fe3cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:58.416945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7bc33-7866-4381-873a-4731f2fe3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:58.418093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7bc33-7866-4381-873a-4731f2fe3cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:58.424089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7bc33-7866-4381-873a-4731f2fe3cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:58.429605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7bc33-7866-4381-873a-4731f2fe3cd8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:58.530226 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1814/3604] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:13:58 2022] POST /identity/v3/projects => generated 359 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:13:58.547563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8572d-9136-4c77-a62f-40520d9cabf3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:58.579695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8572d-9136-4c77-a62f-40520d9cabf3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:58.587492 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:58.797969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47637c-b16d-4fac-a860-910cc947339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:58.798603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47637c-b16d-4fac-a860-910cc947339b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:58.798882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47637c-b16d-4fac-a860-910cc947339b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:58.799185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47637c-b16d-4fac-a860-910cc947339b admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:58.800400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47637c-b16d-4fac-a860-910cc947339b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:58.802657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47637c-b16d-4fac-a860-910cc947339b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:58.884399 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1791/3605] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:13:58 2022] POST /identity/v3/users => generated 280 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:13:58.885280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7bc33-7866-4381-873a-4731f2fe3cd8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:58.904731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7bc33-7866-4381-873a-4731f2fe3cd8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:58.929433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e474c0-964b-45ae-98a4-98ce84751035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:58.934375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e474c0-964b-45ae-98a4-98ce84751035 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:58.936015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e474c0-964b-45ae-98a4-98ce84751035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:58.938355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e474c0-964b-45ae-98a4-98ce84751035 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:58.941200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e474c0-964b-45ae-98a4-98ce84751035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:58.951105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e474c0-964b-45ae-98a4-98ce84751035 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:59.001353 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1815/3606] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:13:59.005592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47637c-b16d-4fac-a860-910cc947339b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:59.029742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47637c-b16d-4fac-a860-910cc947339b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:59.047574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4537a6a-fdde-40b8-94ea-2e69c6c60a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:59.048199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4537a6a-fdde-40b8-94ea-2e69c6c60a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:59.048477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4537a6a-fdde-40b8-94ea-2e69c6c60a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:59.048754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4537a6a-fdde-40b8-94ea-2e69c6c60a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:59.049393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4537a6a-fdde-40b8-94ea-2e69c6c60a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:59.051274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4537a6a-fdde-40b8-94ea-2e69c6c60a79 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:59.091372 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1792/3607] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:13:59.095742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e474c0-964b-45ae-98a4-98ce84751035 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:59.120732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e474c0-964b-45ae-98a4-98ce84751035 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:59.143199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3323f-265b-42d3-ad02-e18b790c7faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:59.143968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3323f-265b-42d3-ad02-e18b790c7faf admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:59.144193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3323f-265b-42d3-ad02-e18b790c7faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:59.144407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3323f-265b-42d3-ad02-e18b790c7faf admin admin] PATH_INFO: `/v3/projects/0d1d988e038040d1bd7d090ff7844380/users/dbae84ec01b641ebb5d51f996d1d7c07/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:59.213292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3323f-265b-42d3-ad02-e18b790c7faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1d988e038040d1bd7d090ff7844380, user_id=dbae84ec01b641ebb5d51f996d1d7c07, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:59.226399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3323f-265b-42d3-ad02-e18b790c7faf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:59.275797 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1816/3608] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:13:59 2022] PUT /identity/v3/projects/0d1d988e038040d1bd7d090ff7844380/users/dbae84ec01b641ebb5d51f996d1d7c07/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:59.281325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3568da-aaa5-429a-8353-cc9751b819d6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:59.281616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3568da-aaa5-429a-8353-cc9751b819d6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:59.282023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3568da-aaa5-429a-8353-cc9751b819d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:59.345275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ba81-ca57-4227-ad6f-1aeb32a42314 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:59.345568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ba81-ca57-4227-ad6f-1aeb32a42314 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:59.345891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ba81-ca57-4227-ad6f-1aeb32a42314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:59.389298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ef57ba81-ca57-4227-ad6f-1aeb32a42314 None None] MFA Rules not processed for user `1cb1f704f82b46bd85d0f117f1686b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:59.390528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ef57ba81-ca57-4227-ad6f-1aeb32a42314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:59.391596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ec3568da-aaa5-429a-8353-cc9751b819d6 None None] MFA Rules not processed for user `dbae84ec01b641ebb5d51f996d1d7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:13:59.392902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ec3568da-aaa5-429a-8353-cc9751b819d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:59.620449 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1817/3609] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:59.640020 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1793/3610] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:13:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:13:59.646876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57ba81-ca57-4227-ad6f-1aeb32a42314 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:59.648457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ef57ba81-ca57-4227-ad6f-1aeb32a42314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:59.770531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57ba81-ca57-4227-ad6f-1aeb32a42314 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:59.775794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed5a31-3b5e-4c87-bf24-cc165d4a46da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:59.777304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed5a31-3b5e-4c87-bf24-cc165d4a46da service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:59.778135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed5a31-3b5e-4c87-bf24-cc165d4a46da service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:59.778657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed5a31-3b5e-4c87-bf24-cc165d4a46da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:59.810875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed5a31-3b5e-4c87-bf24-cc165d4a46da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:59.813488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed5a31-3b5e-4c87-bf24-cc165d4a46da service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:59.829308 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1818/3611] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:14:03.586973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3568da-aaa5-429a-8353-cc9751b819d6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:03.589027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ec3568da-aaa5-429a-8353-cc9751b819d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:03.775498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3568da-aaa5-429a-8353-cc9751b819d6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:03.791734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c416f-e829-4f47-b765-87cfd0da5ea8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:03.795171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c416f-e829-4f47-b765-87cfd0da5ea8 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:03.795571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c416f-e829-4f47-b765-87cfd0da5ea8 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:03.795945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c416f-e829-4f47-b765-87cfd0da5ea8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:03.799390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-315c416f-e829-4f47-b765-87cfd0da5ea8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:03.839984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c416f-e829-4f47-b765-87cfd0da5ea8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:03.841961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c416f-e829-4f47-b765-87cfd0da5ea8 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:03.862151 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1794/3612] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:14:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:14:04.488041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed5a31-3b5e-4c87-bf24-cc165d4a46da service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:04.490373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e8ed5a31-3b5e-4c87-bf24-cc165d4a46da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:04.727725 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:04.741619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed5a31-3b5e-4c87-bf24-cc165d4a46da service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:04.760953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae94624-0fcd-41bd-9c50-0d6f9077cec2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:04.763382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae94624-0fcd-41bd-9c50-0d6f9077cec2 service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:04.763860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae94624-0fcd-41bd-9c50-0d6f9077cec2 service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:04.769895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae94624-0fcd-41bd-9c50-0d6f9077cec2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:04.775141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7ae94624-0fcd-41bd-9c50-0d6f9077cec2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:05.057767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae94624-0fcd-41bd-9c50-0d6f9077cec2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:05.066494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae94624-0fcd-41bd-9c50-0d6f9077cec2 service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:05.116244 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1819/3613] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:14:05.760999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c416f-e829-4f47-b765-87cfd0da5ea8 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:05.768771 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:05.774042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c416f-e829-4f47-b765-87cfd0da5ea8 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:05.785729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e686b4-df5e-443d-be29-c67c61df875d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:05.787136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e686b4-df5e-443d-be29-c67c61df875d service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:05.787594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e686b4-df5e-443d-be29-c67c61df875d service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:05.788347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e686b4-df5e-443d-be29-c67c61df875d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:05.793108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-40e686b4-df5e-443d-be29-c67c61df875d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:05.815763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e686b4-df5e-443d-be29-c67c61df875d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:05.818062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e686b4-df5e-443d-be29-c67c61df875d service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:05.836670 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1795/3614] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:14:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:14:08.271840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65506b-ce66-415a-93b0-d5a154971586 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:08.272927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65506b-ce66-415a-93b0-d5a154971586 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:08.273357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65506b-ce66-415a-93b0-d5a154971586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:08.363531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fd65506b-ce66-415a-93b0-d5a154971586 None None] MFA Rules not processed for user `d0213371a83f4a85bacc0ecdec5b2535`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:08.365789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fd65506b-ce66-415a-93b0-d5a154971586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:08.569973 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1820/3615] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:08.574448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e686b4-df5e-443d-be29-c67c61df875d service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:08.577043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-40e686b4-df5e-443d-be29-c67c61df875d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:08.753075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae4dc6-b102-4e52-b9a2-22a6282819d8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:08.753364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae4dc6-b102-4e52-b9a2-22a6282819d8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:08.753634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae4dc6-b102-4e52-b9a2-22a6282819d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:08.806521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-78ae4dc6-b102-4e52-b9a2-22a6282819d8 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:08.808212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-78ae4dc6-b102-4e52-b9a2-22a6282819d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:08.870076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e686b4-df5e-443d-be29-c67c61df875d service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:08.876711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d15104-025c-458f-a360-3c8fd584e332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:08.877443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d15104-025c-458f-a360-3c8fd584e332 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:08.877807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d15104-025c-458f-a360-3c8fd584e332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:08.878253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d15104-025c-458f-a360-3c8fd584e332 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:08.880999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d15104-025c-458f-a360-3c8fd584e332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:08.884485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d15104-025c-458f-a360-3c8fd584e332 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:08.939961 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1821/3616] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:08.955286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae4dc6-b102-4e52-b9a2-22a6282819d8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:08.957658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-78ae4dc6-b102-4e52-b9a2-22a6282819d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:08.976848 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1796/3617] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:14:08 2022] POST /identity/v3/projects => generated 379 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:14:08.977897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d15104-025c-458f-a360-3c8fd584e332 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:09.055679 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:09.170356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d15104-025c-458f-a360-3c8fd584e332 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:09.175637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cbd2c-6db1-4106-b00c-f60b09bc5a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:09.176891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cbd2c-6db1-4106-b00c-f60b09bc5a2c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:09.178447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cbd2c-6db1-4106-b00c-f60b09bc5a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:09.178881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cbd2c-6db1-4106-b00c-f60b09bc5a2c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:09.179746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cbd2c-6db1-4106-b00c-f60b09bc5a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:09.186858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cbd2c-6db1-4106-b00c-f60b09bc5a2c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:09.188170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae4dc6-b102-4e52-b9a2-22a6282819d8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:09.237241 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1797/3618] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:14:08 2022] POST /identity/v3/users => generated 296 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:14:09.244408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cbd2c-6db1-4106-b00c-f60b09bc5a2c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:09.264471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cbd2c-6db1-4106-b00c-f60b09bc5a2c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:09.275479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df35056-e19a-4ce6-97c8-937fdb82bc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:09.276089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df35056-e19a-4ce6-97c8-937fdb82bc4b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:09.276358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df35056-e19a-4ce6-97c8-937fdb82bc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:09.276635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df35056-e19a-4ce6-97c8-937fdb82bc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:09.277829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df35056-e19a-4ce6-97c8-937fdb82bc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:09.279479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df35056-e19a-4ce6-97c8-937fdb82bc4b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:09.306791 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1798/3619] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:14:09.311051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df35056-e19a-4ce6-97c8-937fdb82bc4b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:09.339469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1284e-e0a6-4af7-b82a-4f58f1b0b183 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:09.341228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1284e-e0a6-4af7-b82a-4f58f1b0b183 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:09.341749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1284e-e0a6-4af7-b82a-4f58f1b0b183 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:09.342234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1284e-e0a6-4af7-b82a-4f58f1b0b183 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:09.347557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df35056-e19a-4ce6-97c8-937fdb82bc4b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:09.357170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff7ec9-caff-43c8-9933-13a07b27198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:09.357853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff7ec9-caff-43c8-9933-13a07b27198b admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:09.358130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff7ec9-caff-43c8-9933-13a07b27198b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:09.358404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff7ec9-caff-43c8-9933-13a07b27198b admin admin] PATH_INFO: `/v3/projects/211fbadd72b0429fadc3de0e7dcabef3/users/e57fa00acff741b59c2abb7be4e7c6d8/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:09.435998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff7ec9-caff-43c8-9933-13a07b27198b admin admin] RBAC: Authorizing `identity:create_grant(project_id=211fbadd72b0429fadc3de0e7dcabef3, user_id=e57fa00acff741b59c2abb7be4e7c6d8, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:09.461172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff7ec9-caff-43c8-9933-13a07b27198b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:09.527338 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1799/3620] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:14:09 2022] PUT /identity/v3/projects/211fbadd72b0429fadc3de0e7dcabef3/users/e57fa00acff741b59c2abb7be4e7c6d8/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:14:09.531204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff7ec9-caff-43c8-9933-13a07b27198b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:09.640635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1284e-e0a6-4af7-b82a-4f58f1b0b183 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:09.642391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1284e-e0a6-4af7-b82a-4f58f1b0b183 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:09.662475 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:09.673684 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1822/3621] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:14:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:09.752791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff7ec9-caff-43c8-9933-13a07b27198b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:09.767634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6265e1f-ce95-446f-a89c-5e881c4ac57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:09.768269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6265e1f-ce95-446f-a89c-5e881c4ac57f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:09.768543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6265e1f-ce95-446f-a89c-5e881c4ac57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:09.769463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6265e1f-ce95-446f-a89c-5e881c4ac57f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:09.770152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6265e1f-ce95-446f-a89c-5e881c4ac57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:09.780349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6265e1f-ce95-446f-a89c-5e881c4ac57f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:09.810122 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1800/3622] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:14:09.816240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1284e-e0a6-4af7-b82a-4f58f1b0b183 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:09.839734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1284e-e0a6-4af7-b82a-4f58f1b0b183 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:09.869139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f6bee-604f-4ae0-82fc-2e75878ddff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:09.870765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f6bee-604f-4ae0-82fc-2e75878ddff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:09.871081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f6bee-604f-4ae0-82fc-2e75878ddff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:09.874829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f6bee-604f-4ae0-82fc-2e75878ddff7 admin admin] PATH_INFO: `/v3/projects/211fbadd72b0429fadc3de0e7dcabef3/users/e57fa00acff741b59c2abb7be4e7c6d8/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:09.888254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f6bee-604f-4ae0-82fc-2e75878ddff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=211fbadd72b0429fadc3de0e7dcabef3, user_id=e57fa00acff741b59c2abb7be4e7c6d8, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:09.895967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f6bee-604f-4ae0-82fc-2e75878ddff7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:09.937839 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1823/3623] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:14:09 2022] PUT /identity/v3/projects/211fbadd72b0429fadc3de0e7dcabef3/users/e57fa00acff741b59c2abb7be4e7c6d8/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:14:15.564245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d01090-f1a9-42a1-b64a-8a883a36d2e8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:15.564805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d01090-f1a9-42a1-b64a-8a883a36d2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:15.564917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d01090-f1a9-42a1-b64a-8a883a36d2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:15.624261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c6d01090-f1a9-42a1-b64a-8a883a36d2e8 None None] MFA Rules not processed for user `0c8da9a32cb54d0a87d914234b1e9f40`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:15.625504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c6d01090-f1a9-42a1-b64a-8a883a36d2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:15.880876 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1801/3624] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:19.929829 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:24.364900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d636d8e-6a8b-49a6-8265-d1b6a3143696 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:24.365534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d636d8e-6a8b-49a6-8265-d1b6a3143696 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:24.365534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d636d8e-6a8b-49a6-8265-d1b6a3143696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:24.445143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1d636d8e-6a8b-49a6-8265-d1b6a3143696 None None] MFA Rules not processed for user `e57fa00acff741b59c2abb7be4e7c6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:24.453546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1d636d8e-6a8b-49a6-8265-d1b6a3143696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:24.643305 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1824/3625] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:24.657311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d01090-f1a9-42a1-b64a-8a883a36d2e8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:24.658727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c6d01090-f1a9-42a1-b64a-8a883a36d2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:24.803916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d01090-f1a9-42a1-b64a-8a883a36d2e8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:24.813531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3204cb-2b6e-4752-a896-83eb724116c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:24.816489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3204cb-2b6e-4752-a896-83eb724116c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:24.816820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3204cb-2b6e-4752-a896-83eb724116c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:24.817382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3204cb-2b6e-4752-a896-83eb724116c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:25.002108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3204cb-2b6e-4752-a896-83eb724116c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:25.007454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3204cb-2b6e-4752-a896-83eb724116c3 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:25.040110 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1802/3626] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:14:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:14:29.096733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e79bb-9013-458f-90e0-126d5a6ec14d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:29.097631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e79bb-9013-458f-90e0-126d5a6ec14d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:29.098663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e79bb-9013-458f-90e0-126d5a6ec14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:29.163613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-107e79bb-9013-458f-90e0-126d5a6ec14d None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:29.168512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-107e79bb-9013-458f-90e0-126d5a6ec14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:29.432788 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1825/3627] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:14:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:29.440823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3204cb-2b6e-4752-a896-83eb724116c3 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:29.512281 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:29.565953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3204cb-2b6e-4752-a896-83eb724116c3 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:29.584187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094a933-d52a-4078-b532-85171a9dfe37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:29.584836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094a933-d52a-4078-b532-85171a9dfe37 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:29.585112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094a933-d52a-4078-b532-85171a9dfe37 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:29.586279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094a933-d52a-4078-b532-85171a9dfe37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:29.610652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094a933-d52a-4078-b532-85171a9dfe37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:29.619851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094a933-d52a-4078-b532-85171a9dfe37 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:29.639433 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1803/3628] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:14:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:36.931623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e79bb-9013-458f-90e0-126d5a6ec14d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:36.934732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-107e79bb-9013-458f-90e0-126d5a6ec14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:37.162624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e79bb-9013-458f-90e0-126d5a6ec14d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:37.168727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:37.169633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:37.170083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:37.170510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] PATH_INFO: `/v3/users/cdbd559440454d2f82801ee6bbe280c0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:37.172693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdbd559440454d2f82801ee6bbe280c0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:37.175514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:37.241035 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:37.290864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdbd559440454d2f82801ee6bbe280c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:37.292224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdbd559440454d2f82801ee6bbe280c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:37.343060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdbd559440454d2f82801ee6bbe280c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:37.362757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdbd559440454d2f82801ee6bbe280c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:37.363488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdbd559440454d2f82801ee6bbe280c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:37.389439 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1826/3629] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:14:36 2022] DELETE /identity/v3/users/cdbd559440454d2f82801ee6bbe280c0 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:14:37.393772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d9a12-065e-46de-88c0-15a4c4bce6d0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:37.395349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d9a12-065e-46de-88c0-15a4c4bce6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:37.395817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d9a12-065e-46de-88c0-15a4c4bce6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:37.439343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e42d9a12-065e-46de-88c0-15a4c4bce6d0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:37.444007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e42d9a12-065e-46de-88c0-15a4c4bce6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:37.674651 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1804/3630] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:37.824285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:37.826115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:37.949736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2740-d831-42fa-913c-9d152b06e74f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:37.955989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d65b56-5ee6-47e0-b868-b24a2a52b830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:37.959111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d65b56-5ee6-47e0-b868-b24a2a52b830 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:37.959495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d65b56-5ee6-47e0-b868-b24a2a52b830 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:37.959883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d65b56-5ee6-47e0-b868-b24a2a52b830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:37.982394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d65b56-5ee6-47e0-b868-b24a2a52b830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:37.984411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d65b56-5ee6-47e0-b868-b24a2a52b830 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:38.002399 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1827/3631] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:14:41.539319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d9a12-065e-46de-88c0-15a4c4bce6d0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:41.541013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e42d9a12-065e-46de-88c0-15a4c4bce6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:41.565455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d9a12-065e-46de-88c0-15a4c4bce6d0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:41.573229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:41.574184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:41.574704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:41.575163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] PATH_INFO: `/v3/projects/b8fc396554c84269805db99beff5e471` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:41.576782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8fc396554c84269805db99beff5e471)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:41.578893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:41.667103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8fc396554c84269805db99beff5e471', 'request_id': 'req-024482fb-398f-4df7-933a-8dc2060fcbd6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:41.680287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8fc396554c84269805db99beff5e471', 'request_id': 'req-024482fb-398f-4df7-933a-8dc2060fcbd6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:41.720484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8fc396554c84269805db99beff5e471', 'request_id': 'req-024482fb-398f-4df7-933a-8dc2060fcbd6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:41.752038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] The token cache is being invalidate because project b8fc396554c84269805db99beff5e471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:14:41.752630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:41.754298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:41.759600 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1805/3632] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:14:41 2022] DELETE /identity/v3/projects/b8fc396554c84269805db99beff5e471 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:14:41.763814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d65b56-5ee6-47e0-b868-b24a2a52b830 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:41.782612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d65b56-5ee6-47e0-b868-b24a2a52b830 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:41.910400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5432234-b84a-4c46-bfa4-bdeb478f7b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:41.912165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5432234-b84a-4c46-bfa4-bdeb478f7b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:41.912654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5432234-b84a-4c46-bfa4-bdeb478f7b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:41.913088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5432234-b84a-4c46-bfa4-bdeb478f7b2e admin admin] PATH_INFO: `/v3/users/a916d3edd02444c3ba0ac1905f1bc6bf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:41.914611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5432234-b84a-4c46-bfa4-bdeb478f7b2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a916d3edd02444c3ba0ac1905f1bc6bf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:41.916858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5432234-b84a-4c46-bfa4-bdeb478f7b2e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:42.046554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5432234-b84a-4c46-bfa4-bdeb478f7b2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a916d3edd02444c3ba0ac1905f1bc6bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:42.049774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5432234-b84a-4c46-bfa4-bdeb478f7b2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a916d3edd02444c3ba0ac1905f1bc6bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:42.063380 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:42.084773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5432234-b84a-4c46-bfa4-bdeb478f7b2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a916d3edd02444c3ba0ac1905f1bc6bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:42.096555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5432234-b84a-4c46-bfa4-bdeb478f7b2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a916d3edd02444c3ba0ac1905f1bc6bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:42.097438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5432234-b84a-4c46-bfa4-bdeb478f7b2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a916d3edd02444c3ba0ac1905f1bc6bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:42.123024 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1828/3633] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:14:41 2022] DELETE /identity/v3/users/a916d3edd02444c3ba0ac1905f1bc6bf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:14:43.742564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:43.745059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:43.774203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024482fb-398f-4df7-933a-8dc2060fcbd6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:43.859804 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:43.903194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2078183-665c-49df-88d5-767ebd0730e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:43.909499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2078183-665c-49df-88d5-767ebd0730e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:43.909499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2078183-665c-49df-88d5-767ebd0730e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:43.909499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2078183-665c-49df-88d5-767ebd0730e0 admin admin] PATH_INFO: `/v3/projects/3ea7b21e3f594fdf938b3e1a1edcd835` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:43.910168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2078183-665c-49df-88d5-767ebd0730e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea7b21e3f594fdf938b3e1a1edcd835)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:43.915814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2078183-665c-49df-88d5-767ebd0730e0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:44.030714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2078183-665c-49df-88d5-767ebd0730e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea7b21e3f594fdf938b3e1a1edcd835', 'request_id': 'req-e2078183-665c-49df-88d5-767ebd0730e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:44.045651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2078183-665c-49df-88d5-767ebd0730e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea7b21e3f594fdf938b3e1a1edcd835', 'request_id': 'req-e2078183-665c-49df-88d5-767ebd0730e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:44.066061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2078183-665c-49df-88d5-767ebd0730e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea7b21e3f594fdf938b3e1a1edcd835', 'request_id': 'req-e2078183-665c-49df-88d5-767ebd0730e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:44.085178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2078183-665c-49df-88d5-767ebd0730e0 admin admin] The token cache is being invalidate because project 3ea7b21e3f594fdf938b3e1a1edcd835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:14:44.085478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2078183-665c-49df-88d5-767ebd0730e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:44.087050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2078183-665c-49df-88d5-767ebd0730e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:44.090441 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1806/3634] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:14:43 2022] DELETE /identity/v3/projects/3ea7b21e3f594fdf938b3e1a1edcd835 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:14:44.096952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29058ad8-98fd-4faf-9d67-837af6473ae1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:44.098344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29058ad8-98fd-4faf-9d67-837af6473ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:44.099286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29058ad8-98fd-4faf-9d67-837af6473ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:44.216624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-29058ad8-98fd-4faf-9d67-837af6473ae1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:44.221665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-29058ad8-98fd-4faf-9d67-837af6473ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:44.361672 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1829/3635] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:44.370075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5acf0-c44b-4b47-84a2-df182a5e11cc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:44.370771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5acf0-c44b-4b47-84a2-df182a5e11cc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:44.371359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5acf0-c44b-4b47-84a2-df182a5e11cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:44.415866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7ae5acf0-c44b-4b47-84a2-df182a5e11cc None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:44.417424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7ae5acf0-c44b-4b47-84a2-df182a5e11cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:44.443538 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1807/3636] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:44.452075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29058ad8-98fd-4faf-9d67-837af6473ae1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:44.507379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29058ad8-98fd-4faf-9d67-837af6473ae1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:44.524789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc9298-f464-47ad-8c1a-4dc5957c5937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:44.525419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9298-f464-47ad-8c1a-4dc5957c5937 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:44.525695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9298-f464-47ad-8c1a-4dc5957c5937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:44.526379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9298-f464-47ad-8c1a-4dc5957c5937 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:44.549072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc9298-f464-47ad-8c1a-4dc5957c5937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:14:44.549465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc9298-f464-47ad-8c1a-4dc5957c5937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:44.553289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc9298-f464-47ad-8c1a-4dc5957c5937 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:44.571110 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1830/3637] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:14:44.575203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5acf0-c44b-4b47-84a2-df182a5e11cc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:44.591459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5acf0-c44b-4b47-84a2-df182a5e11cc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:44.600571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a796df-0a8a-4705-9a14-484941acc573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:44.601426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a796df-0a8a-4705-9a14-484941acc573 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:44.601426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a796df-0a8a-4705-9a14-484941acc573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:44.601851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a796df-0a8a-4705-9a14-484941acc573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:44.602574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a796df-0a8a-4705-9a14-484941acc573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:44.604524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a796df-0a8a-4705-9a14-484941acc573 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:44.677138 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1808/3638] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:14:44 2022] POST /identity/v3/projects => generated 401 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:14:44.680997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc9298-f464-47ad-8c1a-4dc5957c5937 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:44.694720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc9298-f464-47ad-8c1a-4dc5957c5937 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:44.888109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08e6b-b7e1-4533-abde-830c8209cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:44.888610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08e6b-b7e1-4533-abde-830c8209cefe admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:44.888886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08e6b-b7e1-4533-abde-830c8209cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:44.889156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08e6b-b7e1-4533-abde-830c8209cefe admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:44.889810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f08e6b-b7e1-4533-abde-830c8209cefe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:44.891889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f08e6b-b7e1-4533-abde-830c8209cefe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:44.955009 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1831/3639] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:14:44 2022] POST /identity/v3/users => generated 301 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:14:44.957326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a796df-0a8a-4705-9a14-484941acc573 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:44.978378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a796df-0a8a-4705-9a14-484941acc573 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:44.995528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fe79c-9746-4a93-a72f-dfa37ecc94c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:44.997861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fe79c-9746-4a93-a72f-dfa37ecc94c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:44.998145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fe79c-9746-4a93-a72f-dfa37ecc94c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:44.998415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fe79c-9746-4a93-a72f-dfa37ecc94c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:45.003353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fe79c-9746-4a93-a72f-dfa37ecc94c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:45.011035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fe79c-9746-4a93-a72f-dfa37ecc94c0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:45.062803 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1809/3640] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:14:45.067227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08e6b-b7e1-4533-abde-830c8209cefe admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:45.090619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08e6b-b7e1-4533-abde-830c8209cefe admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:45.111488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed20d4-3ff5-4d0b-8e71-fcda0dd1564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:45.113976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed20d4-3ff5-4d0b-8e71-fcda0dd1564a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:45.118068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed20d4-3ff5-4d0b-8e71-fcda0dd1564a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:45.120081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed20d4-3ff5-4d0b-8e71-fcda0dd1564a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:45.126483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed20d4-3ff5-4d0b-8e71-fcda0dd1564a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:45.138205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed20d4-3ff5-4d0b-8e71-fcda0dd1564a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:45.180501 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1832/3641] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:14:45.184475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fe79c-9746-4a93-a72f-dfa37ecc94c0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:45.209423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fe79c-9746-4a93-a72f-dfa37ecc94c0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:45.224202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7a9e4-f3a1-488c-8a32-d3dc65ad2fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:45.229158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7a9e4-f3a1-488c-8a32-d3dc65ad2fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:45.229479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7a9e4-f3a1-488c-8a32-d3dc65ad2fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:45.229765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7a9e4-f3a1-488c-8a32-d3dc65ad2fc1 admin admin] PATH_INFO: `/v3/projects/2dd11774ad374cff9a6825b5eebcc70d/users/15efdbb672a24b37a7b483f40eca67f9/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:45.266948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7a9e4-f3a1-488c-8a32-d3dc65ad2fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd11774ad374cff9a6825b5eebcc70d, user_id=15efdbb672a24b37a7b483f40eca67f9, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:45.274094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7a9e4-f3a1-488c-8a32-d3dc65ad2fc1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:45.330327 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1810/3642] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:14:45 2022] PUT /identity/v3/projects/2dd11774ad374cff9a6825b5eebcc70d/users/15efdbb672a24b37a7b483f40eca67f9/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:14:45.342250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87c23b-a9f5-4523-98fb-ede133891839 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:45.342828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87c23b-a9f5-4523-98fb-ede133891839 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:45.344646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87c23b-a9f5-4523-98fb-ede133891839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:45.427039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6f87c23b-a9f5-4523-98fb-ede133891839 None None] MFA Rules not processed for user `15efdbb672a24b37a7b483f40eca67f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:45.428370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6f87c23b-a9f5-4523-98fb-ede133891839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:45.484220 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:45.624833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7a9e4-f3a1-488c-8a32-d3dc65ad2fc1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:45.639126 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1833/3643] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:14:45.725485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7a9e4-f3a1-488c-8a32-d3dc65ad2fc1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:45.730853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e629b5-1c13-4506-9932-c32ac7ef2744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:45.731890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e629b5-1c13-4506-9932-c32ac7ef2744 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:45.732321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e629b5-1c13-4506-9932-c32ac7ef2744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:45.732733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e629b5-1c13-4506-9932-c32ac7ef2744 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:45.733797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e629b5-1c13-4506-9932-c32ac7ef2744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:45.736501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e629b5-1c13-4506-9932-c32ac7ef2744 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:45.750652 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:45.782789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87c23b-a9f5-4523-98fb-ede133891839 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:45.782895 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1811/3644] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:14:45 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:14:45.861406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87c23b-a9f5-4523-98fb-ede133891839 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:46.006182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0a69e-5cdc-443e-bf1b-c52f343ddb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:46.007816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0a69e-5cdc-443e-bf1b-c52f343ddb42 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:46.008389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0a69e-5cdc-443e-bf1b-c52f343ddb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:46.009172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0a69e-5cdc-443e-bf1b-c52f343ddb42 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:46.010246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0a69e-5cdc-443e-bf1b-c52f343ddb42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:46.012503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0a69e-5cdc-443e-bf1b-c52f343ddb42 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:46.046278 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1834/3645] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:14:45 2022] POST /identity/v3/users => generated 308 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:14:46.049822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e629b5-1c13-4506-9932-c32ac7ef2744 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:46.070264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e629b5-1c13-4506-9932-c32ac7ef2744 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:46.094195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f811dbf-8e7c-41d9-a1e6-8e0c3c5593ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:46.094949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f811dbf-8e7c-41d9-a1e6-8e0c3c5593ba admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:46.095389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f811dbf-8e7c-41d9-a1e6-8e0c3c5593ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:46.095855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f811dbf-8e7c-41d9-a1e6-8e0c3c5593ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:46.096690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f811dbf-8e7c-41d9-a1e6-8e0c3c5593ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:46.114512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f811dbf-8e7c-41d9-a1e6-8e0c3c5593ba admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:46.135706 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1812/3646] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:14:46.140235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0a69e-5cdc-443e-bf1b-c52f343ddb42 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:46.154027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0a69e-5cdc-443e-bf1b-c52f343ddb42 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:46.159390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd85d3-6750-4e8f-8968-54848acf127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:46.160388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd85d3-6750-4e8f-8968-54848acf127f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:46.160727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd85d3-6750-4e8f-8968-54848acf127f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:46.161453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd85d3-6750-4e8f-8968-54848acf127f admin admin] PATH_INFO: `/v3/projects/b36dcf096eea494aa835aecd4fc9965f/users/7687b91fc67f43a9a6880d9f29ef3d73/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:46.192476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd85d3-6750-4e8f-8968-54848acf127f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36dcf096eea494aa835aecd4fc9965f, user_id=7687b91fc67f43a9a6880d9f29ef3d73, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:46.195417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd85d3-6750-4e8f-8968-54848acf127f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:46.253488 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1835/3647] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:14:46 2022] PUT /identity/v3/projects/b36dcf096eea494aa835aecd4fc9965f/users/7687b91fc67f43a9a6880d9f29ef3d73/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:14:46.267852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f811dbf-8e7c-41d9-a1e6-8e0c3c5593ba admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:46.295078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f811dbf-8e7c-41d9-a1e6-8e0c3c5593ba admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:46.466938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877f12e-4fde-43d4-a970-37f227cef578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:46.466938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877f12e-4fde-43d4-a970-37f227cef578 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:46.466938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877f12e-4fde-43d4-a970-37f227cef578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:46.466938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877f12e-4fde-43d4-a970-37f227cef578 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:46.467510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877f12e-4fde-43d4-a970-37f227cef578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:46.467510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877f12e-4fde-43d4-a970-37f227cef578 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:46.500508 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1813/3648] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:14:46.504668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd85d3-6750-4e8f-8968-54848acf127f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:46.520554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd85d3-6750-4e8f-8968-54848acf127f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:46.533113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ec736-ea48-40c4-b5da-d59855210877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:46.533799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ec736-ea48-40c4-b5da-d59855210877 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:46.534073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ec736-ea48-40c4-b5da-d59855210877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:46.534529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ec736-ea48-40c4-b5da-d59855210877 admin admin] PATH_INFO: `/v3/projects/b36dcf096eea494aa835aecd4fc9965f/users/7687b91fc67f43a9a6880d9f29ef3d73/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:46.541937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ec736-ea48-40c4-b5da-d59855210877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36dcf096eea494aa835aecd4fc9965f, user_id=7687b91fc67f43a9a6880d9f29ef3d73, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:46.554564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ec736-ea48-40c4-b5da-d59855210877 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:46.587149 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1836/3649] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:14:46 2022] PUT /identity/v3/projects/b36dcf096eea494aa835aecd4fc9965f/users/7687b91fc67f43a9a6880d9f29ef3d73/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:14:46.599085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7347b-6ffd-4c2d-9a6b-3b4464d52824 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:46.599432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7347b-6ffd-4c2d-9a6b-3b4464d52824 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:46.599712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7347b-6ffd-4c2d-9a6b-3b4464d52824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:46.637498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7ee7347b-6ffd-4c2d-9a6b-3b4464d52824 None None] MFA Rules not processed for user `7687b91fc67f43a9a6880d9f29ef3d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:46.640244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7ee7347b-6ffd-4c2d-9a6b-3b4464d52824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:46.776791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ec736-ea48-40c4-b5da-d59855210877 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:46.779048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-615ec736-ea48-40c4-b5da-d59855210877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:46.795547 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1814/3650] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:46 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:46.826697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7347b-6ffd-4c2d-9a6b-3b4464d52824 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:46.828209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7ee7347b-6ffd-4c2d-9a6b-3b4464d52824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:46.875617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ec736-ea48-40c4-b5da-d59855210877 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:46.880511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659deb8-68ff-4328-a39f-dea2d051bb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:46.881140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659deb8-68ff-4328-a39f-dea2d051bb10 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:46.881416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659deb8-68ff-4328-a39f-dea2d051bb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:46.881688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659deb8-68ff-4328-a39f-dea2d051bb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:46.883576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c659deb8-68ff-4328-a39f-dea2d051bb10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:46.945540 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:46.955201 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:46.995131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7347b-6ffd-4c2d-9a6b-3b4464d52824 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:47.002658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cdd27-04e7-4e9e-a55f-b4bd0e2b6692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:47.003387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cdd27-04e7-4e9e-a55f-b4bd0e2b6692 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:47.003700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cdd27-04e7-4e9e-a55f-b4bd0e2b6692 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:47.004003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cdd27-04e7-4e9e-a55f-b4bd0e2b6692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:47.016430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cdd27-04e7-4e9e-a55f-b4bd0e2b6692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:47.018649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cdd27-04e7-4e9e-a55f-b4bd0e2b6692 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:47.020137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659deb8-68ff-4328-a39f-dea2d051bb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:47.022021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659deb8-68ff-4328-a39f-dea2d051bb10 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:47.033086 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1815/3651] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:14:46 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:14:47.048153 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1837/3652] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:14:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:14:47.641128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cdd27-04e7-4e9e-a55f-b4bd0e2b6692 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:47.671965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cdd27-04e7-4e9e-a55f-b4bd0e2b6692 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:47.692140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5980ce-45b5-4af1-ae0c-b1108d6ff624 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:47.693211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5980ce-45b5-4af1-ae0c-b1108d6ff624 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:47.693698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5980ce-45b5-4af1-ae0c-b1108d6ff624 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:47.694103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5980ce-45b5-4af1-ae0c-b1108d6ff624 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:47.818850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0ad2-25b0-4aaa-83b9-e9a4c39b9760 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:47.818850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0ad2-25b0-4aaa-83b9-e9a4c39b9760 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:47.818850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0ad2-25b0-4aaa-83b9-e9a4c39b9760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:47.832733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5980ce-45b5-4af1-ae0c-b1108d6ff624 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:47.835529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5980ce-45b5-4af1-ae0c-b1108d6ff624 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:47.849285 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1816/3653] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:14:47 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:14:47.856554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d17d0ad2-25b0-4aaa-83b9-e9a4c39b9760 None None] MFA Rules not processed for user `0c8da9a32cb54d0a87d914234b1e9f40`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:47.858230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d17d0ad2-25b0-4aaa-83b9-e9a4c39b9760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:47.871788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5980ce-45b5-4af1-ae0c-b1108d6ff624 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:47.895777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5980ce-45b5-4af1-ae0c-b1108d6ff624 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:47.902096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:47.902805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:47.903191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:47.903468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] PATH_INFO: `/v3/users/15efdbb672a24b37a7b483f40eca67f9` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:47.904864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15efdbb672a24b37a7b483f40eca67f9)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:47.907972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:48.010643 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1838/3654] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:48.053536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15efdbb672a24b37a7b483f40eca67f9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:48.057261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15efdbb672a24b37a7b483f40eca67f9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:48.086616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15efdbb672a24b37a7b483f40eca67f9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:48.137017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15efdbb672a24b37a7b483f40eca67f9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:48.142147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15efdbb672a24b37a7b483f40eca67f9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:48.171379 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1817/3655] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:14:47 2022] DELETE /identity/v3/users/15efdbb672a24b37a7b483f40eca67f9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:14:48.177383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f9408-98e6-4262-a342-587c8503c80c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:48.177959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f9408-98e6-4262-a342-587c8503c80c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:48.178586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f9408-98e6-4262-a342-587c8503c80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:48.204463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-572f9408-98e6-4262-a342-587c8503c80c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:48.206010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-572f9408-98e6-4262-a342-587c8503c80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:48.316129 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1839/3656] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:14:48.337134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:48.338947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:48.438449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae1b8c-ffce-4f98-bee7-9ff8ba8b4486 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:48.447014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677870a-e812-42ed-be7c-e8e68881f1c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:48.448281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677870a-e812-42ed-be7c-e8e68881f1c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:48.448641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677870a-e812-42ed-be7c-e8e68881f1c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:48.449164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677870a-e812-42ed-be7c-e8e68881f1c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:48.472448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677870a-e812-42ed-be7c-e8e68881f1c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:48.472448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677870a-e812-42ed-be7c-e8e68881f1c6 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:48.478516 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:48.490370 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1818/3657] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:14:48.562389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b736a1-7824-492d-a88c-b8880a10fa13 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:48.562847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b736a1-7824-492d-a88c-b8880a10fa13 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:48.563211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b736a1-7824-492d-a88c-b8880a10fa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:48.592502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-19b736a1-7824-492d-a88c-b8880a10fa13 None None] MFA Rules not processed for user `49b3edfc62e747a8a21e76bfde79f40e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:48.592502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-19b736a1-7824-492d-a88c-b8880a10fa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:48.706500 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1840/3658] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:48.709425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97090-a300-4fc4-8ad5-3af08568123a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:48.709915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97090-a300-4fc4-8ad5-3af08568123a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:48.710003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97090-a300-4fc4-8ad5-3af08568123a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:48.754657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8ca97090-a300-4fc4-8ad5-3af08568123a None None] MFA Rules not processed for user `49b3edfc62e747a8a21e76bfde79f40e`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:48.756316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8ca97090-a300-4fc4-8ad5-3af08568123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:48.766549 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1819/3659] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:48.953235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b736a1-7824-492d-a88c-b8880a10fa13 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:48.954759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-19b736a1-7824-492d-a88c-b8880a10fa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:48.976696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b736a1-7824-492d-a88c-b8880a10fa13 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:48.984585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:48.986205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:48.986205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:48.986205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] PATH_INFO: `/v3/projects/2dd11774ad374cff9a6825b5eebcc70d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:48.987907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd11774ad374cff9a6825b5eebcc70d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:49.001033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:49.030563 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:49.078127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd11774ad374cff9a6825b5eebcc70d', 'request_id': 'req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:49.086672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd11774ad374cff9a6825b5eebcc70d', 'request_id': 'req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:49.099167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd11774ad374cff9a6825b5eebcc70d', 'request_id': 'req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:49.140283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] The token cache is being invalidate because project 2dd11774ad374cff9a6825b5eebcc70d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:14:49.141670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:49.142561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:49.147851 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1841/3660] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:14:48 2022] DELETE /identity/v3/projects/2dd11774ad374cff9a6825b5eebcc70d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:14:49.151769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca97090-a300-4fc4-8ad5-3af08568123a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:49.170038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca97090-a300-4fc4-8ad5-3af08568123a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:49.280410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c513718-12d6-492d-9f38-1d76a108cf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:49.281131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c513718-12d6-492d-9f38-1d76a108cf48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:49.281352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c513718-12d6-492d-9f38-1d76a108cf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:49.281623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c513718-12d6-492d-9f38-1d76a108cf48 admin admin] PATH_INFO: `/v3/users/7687b91fc67f43a9a6880d9f29ef3d73` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:49.286694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c513718-12d6-492d-9f38-1d76a108cf48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7687b91fc67f43a9a6880d9f29ef3d73)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:49.290033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c513718-12d6-492d-9f38-1d76a108cf48 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:49.385750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c513718-12d6-492d-9f38-1d76a108cf48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7687b91fc67f43a9a6880d9f29ef3d73'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:49.386446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c513718-12d6-492d-9f38-1d76a108cf48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7687b91fc67f43a9a6880d9f29ef3d73'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:49.405095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c513718-12d6-492d-9f38-1d76a108cf48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7687b91fc67f43a9a6880d9f29ef3d73'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:49.415066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c513718-12d6-492d-9f38-1d76a108cf48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7687b91fc67f43a9a6880d9f29ef3d73'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:49.416136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c513718-12d6-492d-9f38-1d76a108cf48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7687b91fc67f43a9a6880d9f29ef3d73'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:49.438063 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1820/3661] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:14:49 2022] DELETE /identity/v3/users/7687b91fc67f43a9a6880d9f29ef3d73 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:14:49.959746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:49.961956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:49.988041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5848c-4bd2-43ab-9e5d-7ebc7f7a9a54 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:50.099318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f32792-e85c-4efd-adb2-814f5e9cae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:50.100127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f32792-e85c-4efd-adb2-814f5e9cae4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:50.100415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f32792-e85c-4efd-adb2-814f5e9cae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:50.100694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f32792-e85c-4efd-adb2-814f5e9cae4a admin admin] PATH_INFO: `/v3/projects/b36dcf096eea494aa835aecd4fc9965f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:50.102108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f32792-e85c-4efd-adb2-814f5e9cae4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36dcf096eea494aa835aecd4fc9965f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:50.104317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f32792-e85c-4efd-adb2-814f5e9cae4a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:50.174692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24f32792-e85c-4efd-adb2-814f5e9cae4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36dcf096eea494aa835aecd4fc9965f', 'request_id': 'req-24f32792-e85c-4efd-adb2-814f5e9cae4a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:50.185957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24f32792-e85c-4efd-adb2-814f5e9cae4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36dcf096eea494aa835aecd4fc9965f', 'request_id': 'req-24f32792-e85c-4efd-adb2-814f5e9cae4a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:50.199187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24f32792-e85c-4efd-adb2-814f5e9cae4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36dcf096eea494aa835aecd4fc9965f', 'request_id': 'req-24f32792-e85c-4efd-adb2-814f5e9cae4a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:50.225604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24f32792-e85c-4efd-adb2-814f5e9cae4a admin admin] The token cache is being invalidate because project b36dcf096eea494aa835aecd4fc9965f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:14:50.226197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24f32792-e85c-4efd-adb2-814f5e9cae4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:50.227750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24f32792-e85c-4efd-adb2-814f5e9cae4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:50.230338 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1842/3662] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:14:49 2022] DELETE /identity/v3/projects/b36dcf096eea494aa835aecd4fc9965f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:14:50.235796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77d1d8-0097-4b59-8322-e6cad52af24f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:50.236431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77d1d8-0097-4b59-8322-e6cad52af24f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:50.236852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77d1d8-0097-4b59-8322-e6cad52af24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:50.273995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ae77d1d8-0097-4b59-8322-e6cad52af24f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:50.277688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ae77d1d8-0097-4b59-8322-e6cad52af24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:50.381622 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1821/3663] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:50.392226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69c2a0-2c85-40d6-8dee-8820dd955bb0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:50.392598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69c2a0-2c85-40d6-8dee-8820dd955bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:50.392783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69c2a0-2c85-40d6-8dee-8820dd955bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:50.429425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3c69c2a0-2c85-40d6-8dee-8820dd955bb0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:50.433172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3c69c2a0-2c85-40d6-8dee-8820dd955bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:50.460244 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1843/3664] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:50.461645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77d1d8-0097-4b59-8322-e6cad52af24f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:50.473209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77d1d8-0097-4b59-8322-e6cad52af24f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:50.478427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc668c87-b3d1-4861-a7fe-96b6c9a8d904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:50.479392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc668c87-b3d1-4861-a7fe-96b6c9a8d904 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:50.479674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc668c87-b3d1-4861-a7fe-96b6c9a8d904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:50.480004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc668c87-b3d1-4861-a7fe-96b6c9a8d904 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:50.480906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc668c87-b3d1-4861-a7fe-96b6c9a8d904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:14:50.481095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc668c87-b3d1-4861-a7fe-96b6c9a8d904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:50.482762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc668c87-b3d1-4861-a7fe-96b6c9a8d904 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:50.494130 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:50.501664 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1822/3665] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:14:50.502972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69c2a0-2c85-40d6-8dee-8820dd955bb0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:50.516908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69c2a0-2c85-40d6-8dee-8820dd955bb0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:50.534612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ebf59-c384-4ec0-9513-198a9cd7d526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:50.535768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ebf59-c384-4ec0-9513-198a9cd7d526 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:50.536248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ebf59-c384-4ec0-9513-198a9cd7d526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:50.536528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ebf59-c384-4ec0-9513-198a9cd7d526 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:50.537278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ebf59-c384-4ec0-9513-198a9cd7d526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:50.539359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ebf59-c384-4ec0-9513-198a9cd7d526 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:50.627166 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1844/3666] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:14:50 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:14:50.631801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc668c87-b3d1-4861-a7fe-96b6c9a8d904 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:50.650548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc668c87-b3d1-4861-a7fe-96b6c9a8d904 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:50.870179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe493b55-4e3a-402a-a4d1-249192ce7788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:50.872453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe493b55-4e3a-402a-a4d1-249192ce7788 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:50.872739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe493b55-4e3a-402a-a4d1-249192ce7788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:50.873019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe493b55-4e3a-402a-a4d1-249192ce7788 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:50.873676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe493b55-4e3a-402a-a4d1-249192ce7788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:50.879741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe493b55-4e3a-402a-a4d1-249192ce7788 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:50.915101 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1823/3667] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:14:50 2022] POST /identity/v3/users => generated 291 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:14:50.920472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ebf59-c384-4ec0-9513-198a9cd7d526 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:50.940417 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:50.952222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ebf59-c384-4ec0-9513-198a9cd7d526 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:50.968879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4636-70fd-465d-b239-d849f80493cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:50.972643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4636-70fd-465d-b239-d849f80493cd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:50.973593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4636-70fd-465d-b239-d849f80493cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:50.974257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4636-70fd-465d-b239-d849f80493cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:50.975710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc4636-70fd-465d-b239-d849f80493cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:50.978377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc4636-70fd-465d-b239-d849f80493cd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:50.994790 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1845/3668] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:14:51.000854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe493b55-4e3a-402a-a4d1-249192ce7788 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:51.026436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe493b55-4e3a-402a-a4d1-249192ce7788 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:51.036233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a8a4a-e9b4-46e6-ad80-53fe4149a998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:51.037250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8a4a-e9b4-46e6-ad80-53fe4149a998 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:51.037780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8a4a-e9b4-46e6-ad80-53fe4149a998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:51.038559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8a4a-e9b4-46e6-ad80-53fe4149a998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:51.040148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a8a4a-e9b4-46e6-ad80-53fe4149a998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:51.042384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a8a4a-e9b4-46e6-ad80-53fe4149a998 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:51.072426 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1824/3669] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:14:51.073882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4636-70fd-465d-b239-d849f80493cd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:51.098672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4636-70fd-465d-b239-d849f80493cd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:51.105226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3fbc9-c82e-489a-97d7-81b1ab84744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:51.106054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3fbc9-c82e-489a-97d7-81b1ab84744f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:51.106591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3fbc9-c82e-489a-97d7-81b1ab84744f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:51.106819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3fbc9-c82e-489a-97d7-81b1ab84744f admin admin] PATH_INFO: `/v3/projects/ec64ba1a19d54d38aecbabcd25b075da/users/7c1e0fc9ff7e4c0da77439e27166264f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:51.127231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3fbc9-c82e-489a-97d7-81b1ab84744f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec64ba1a19d54d38aecbabcd25b075da, user_id=7c1e0fc9ff7e4c0da77439e27166264f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:51.133938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3fbc9-c82e-489a-97d7-81b1ab84744f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:51.165103 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1846/3670] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:14:51 2022] PUT /identity/v3/projects/ec64ba1a19d54d38aecbabcd25b075da/users/7c1e0fc9ff7e4c0da77439e27166264f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:14:51.169909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61e898-06e4-464d-b321-be2a4459dfcc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:51.170440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61e898-06e4-464d-b321-be2a4459dfcc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:51.170873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61e898-06e4-464d-b321-be2a4459dfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:51.241961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ab61e898-06e4-464d-b321-be2a4459dfcc None None] MFA Rules not processed for user `7c1e0fc9ff7e4c0da77439e27166264f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:51.244141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ab61e898-06e4-464d-b321-be2a4459dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:51.483706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412782f7-f286-4af6-894c-3aa36e7f8287 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:51.484499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412782f7-f286-4af6-894c-3aa36e7f8287 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:51.485233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412782f7-f286-4af6-894c-3aa36e7f8287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:51.489579 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1825/3671] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:51.555527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-412782f7-f286-4af6-894c-3aa36e7f8287 None None] MFA Rules not processed for user `7c1e0fc9ff7e4c0da77439e27166264f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:14:51.557175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-412782f7-f286-4af6-894c-3aa36e7f8287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:51.568573 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1847/3672] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:14:51.588351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61e898-06e4-464d-b321-be2a4459dfcc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:51.590947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ab61e898-06e4-464d-b321-be2a4459dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:51.865677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61e898-06e4-464d-b321-be2a4459dfcc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:51.882596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5bbb0-7ee8-4fb8-bf98-2b9bb11e9bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:51.883276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5bbb0-7ee8-4fb8-bf98-2b9bb11e9bde service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:51.883627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5bbb0-7ee8-4fb8-bf98-2b9bb11e9bde service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:51.883935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5bbb0-7ee8-4fb8-bf98-2b9bb11e9bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:51.891556 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:51.904628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5bbb0-7ee8-4fb8-bf98-2b9bb11e9bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:51.907091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5bbb0-7ee8-4fb8-bf98-2b9bb11e9bde service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:51.935346 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1826/3673] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:14:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:14:58.549980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412782f7-f286-4af6-894c-3aa36e7f8287 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:58.551813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-412782f7-f286-4af6-894c-3aa36e7f8287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:58.655214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412782f7-f286-4af6-894c-3aa36e7f8287 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:58.663560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a869529-4cf2-42c2-b934-df053717616e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:58.664540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a869529-4cf2-42c2-b934-df053717616e service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:58.664900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a869529-4cf2-42c2-b934-df053717616e service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:58.665608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a869529-4cf2-42c2-b934-df053717616e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:58.678472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6a869529-4cf2-42c2-b934-df053717616e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:58.717430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a869529-4cf2-42c2-b934-df053717616e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:58.719443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a869529-4cf2-42c2-b934-df053717616e service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:58.734832 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1848/3674] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:14:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:14:59.145609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5bbb0-7ee8-4fb8-bf98-2b9bb11e9bde service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:14:59.147107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-51c5bbb0-7ee8-4fb8-bf98-2b9bb11e9bde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:14:59.297446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5bbb0-7ee8-4fb8-bf98-2b9bb11e9bde service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:14:59.312132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b64c4d-37ce-45bd-bfbe-63d08dd3d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:14:59.312132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b64c4d-37ce-45bd-bfbe-63d08dd3d89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:14:59.315132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b64c4d-37ce-45bd-bfbe-63d08dd3d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:14:59.315417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b64c4d-37ce-45bd-bfbe-63d08dd3d89a admin admin] PATH_INFO: `/v3/users/df9979f0dcd74d60a55d02d432de6a51` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:14:59.321971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b64c4d-37ce-45bd-bfbe-63d08dd3d89a admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9979f0dcd74d60a55d02d432de6a51)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:14:59.326183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b64c4d-37ce-45bd-bfbe-63d08dd3d89a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:14:59.429069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2b64c4d-37ce-45bd-bfbe-63d08dd3d89a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9979f0dcd74d60a55d02d432de6a51'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:59.432942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2b64c4d-37ce-45bd-bfbe-63d08dd3d89a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9979f0dcd74d60a55d02d432de6a51'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:59.453232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2b64c4d-37ce-45bd-bfbe-63d08dd3d89a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9979f0dcd74d60a55d02d432de6a51'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:59.465127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2b64c4d-37ce-45bd-bfbe-63d08dd3d89a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9979f0dcd74d60a55d02d432de6a51'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:59.466622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2b64c4d-37ce-45bd-bfbe-63d08dd3d89a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9979f0dcd74d60a55d02d432de6a51'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:14:59.486689 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1827/3675] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:14:59 2022] DELETE /identity/v3/users/df9979f0dcd74d60a55d02d432de6a51 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:15:00.869365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a869529-4cf2-42c2-b934-df053717616e service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:00.885160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a869529-4cf2-42c2-b934-df053717616e service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:01.001168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d327e-6f86-4533-a418-ed98ed6aee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:01.002214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d327e-6f86-4533-a418-ed98ed6aee67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:01.002711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d327e-6f86-4533-a418-ed98ed6aee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:01.003336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d327e-6f86-4533-a418-ed98ed6aee67 admin admin] PATH_INFO: `/v3/projects/12f75cea27f642c18d60645158425380` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:01.005767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d327e-6f86-4533-a418-ed98ed6aee67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f75cea27f642c18d60645158425380)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:01.008571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d327e-6f86-4533-a418-ed98ed6aee67 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:01.149161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-496d327e-6f86-4533-a418-ed98ed6aee67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f75cea27f642c18d60645158425380', 'request_id': 'req-496d327e-6f86-4533-a418-ed98ed6aee67'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:01.170232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-496d327e-6f86-4533-a418-ed98ed6aee67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f75cea27f642c18d60645158425380', 'request_id': 'req-496d327e-6f86-4533-a418-ed98ed6aee67'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:01.211256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-496d327e-6f86-4533-a418-ed98ed6aee67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f75cea27f642c18d60645158425380', 'request_id': 'req-496d327e-6f86-4533-a418-ed98ed6aee67'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:01.222683 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:01.238419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-496d327e-6f86-4533-a418-ed98ed6aee67 admin admin] The token cache is being invalidate because project 12f75cea27f642c18d60645158425380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:01.238848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-496d327e-6f86-4533-a418-ed98ed6aee67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:01.239671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-496d327e-6f86-4533-a418-ed98ed6aee67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:01.241653 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1849/3676] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:00 2022] DELETE /identity/v3/projects/12f75cea27f642c18d60645158425380 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:01.250384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad07a52-7c10-4956-969a-d6136e99334c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:01.250384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad07a52-7c10-4956-969a-d6136e99334c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:01.250384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad07a52-7c10-4956-969a-d6136e99334c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:01.281967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3ad07a52-7c10-4956-969a-d6136e99334c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:01.283408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3ad07a52-7c10-4956-969a-d6136e99334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:01.406835 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1828/3677] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:01.408748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc12e0e-8d71-41b0-9b72-5a89a0b4988b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:01.409080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc12e0e-8d71-41b0-9b72-5a89a0b4988b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:01.409364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc12e0e-8d71-41b0-9b72-5a89a0b4988b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:01.440039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8cc12e0e-8d71-41b0-9b72-5a89a0b4988b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:01.442315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8cc12e0e-8d71-41b0-9b72-5a89a0b4988b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:01.458678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad07a52-7c10-4956-969a-d6136e99334c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:01.459329 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1850/3678] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:01.470890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad07a52-7c10-4956-969a-d6136e99334c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:01.496929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a211f24-a89d-4e22-bbec-b8a610cd4551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:01.497655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a211f24-a89d-4e22-bbec-b8a610cd4551 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:01.497969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a211f24-a89d-4e22-bbec-b8a610cd4551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:01.498688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a211f24-a89d-4e22-bbec-b8a610cd4551 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:01.498885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a211f24-a89d-4e22-bbec-b8a610cd4551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:01.499216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a211f24-a89d-4e22-bbec-b8a610cd4551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:01.505726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a211f24-a89d-4e22-bbec-b8a610cd4551 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:01.523991 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:01.538417 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1829/3679] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:01.541768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc12e0e-8d71-41b0-9b72-5a89a0b4988b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:01.555977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc12e0e-8d71-41b0-9b72-5a89a0b4988b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:01.583926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952efb3-bede-4387-8e2b-6a1ea581b955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:01.584561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952efb3-bede-4387-8e2b-6a1ea581b955 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:01.584843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952efb3-bede-4387-8e2b-6a1ea581b955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:01.585115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952efb3-bede-4387-8e2b-6a1ea581b955 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:01.585764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952efb3-bede-4387-8e2b-6a1ea581b955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:01.589417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952efb3-bede-4387-8e2b-6a1ea581b955 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:01.647091 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1851/3680] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:01 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:01.651424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a211f24-a89d-4e22-bbec-b8a610cd4551 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:01.673748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a211f24-a89d-4e22-bbec-b8a610cd4551 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:01.797387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf86c42-8b6b-4054-84a5-e29aea2f42b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:01.798475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf86c42-8b6b-4054-84a5-e29aea2f42b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:01.798994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf86c42-8b6b-4054-84a5-e29aea2f42b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:01.799593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf86c42-8b6b-4054-84a5-e29aea2f42b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:01.800541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf86c42-8b6b-4054-84a5-e29aea2f42b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:01.803261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf86c42-8b6b-4054-84a5-e29aea2f42b5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:01.850691 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1830/3681] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:15:01 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:01.852063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952efb3-bede-4387-8e2b-6a1ea581b955 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:01.868291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952efb3-bede-4387-8e2b-6a1ea581b955 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:01.880962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fe82b-8a5b-4954-9d6b-f63cafb205a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:01.881748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fe82b-8a5b-4954-9d6b-f63cafb205a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:01.882323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fe82b-8a5b-4954-9d6b-f63cafb205a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:01.882665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fe82b-8a5b-4954-9d6b-f63cafb205a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:01.883413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fe82b-8a5b-4954-9d6b-f63cafb205a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:01.885113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fe82b-8a5b-4954-9d6b-f63cafb205a9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:01.911731 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1852/3682] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:01.915942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf86c42-8b6b-4054-84a5-e29aea2f42b5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:01.929682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf86c42-8b6b-4054-84a5-e29aea2f42b5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:01.941013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c629cc-bca9-4f73-8721-19261e98bd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:01.942120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c629cc-bca9-4f73-8721-19261e98bd35 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:01.942561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c629cc-bca9-4f73-8721-19261e98bd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:01.943200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c629cc-bca9-4f73-8721-19261e98bd35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:01.943995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c629cc-bca9-4f73-8721-19261e98bd35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:01.947787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c629cc-bca9-4f73-8721-19261e98bd35 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:01.986231 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1831/3683] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:01.991348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fe82b-8a5b-4954-9d6b-f63cafb205a9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:02.003315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fe82b-8a5b-4954-9d6b-f63cafb205a9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:02.023619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7b4d0-3545-4a80-a49b-583eb2650c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:02.031257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7b4d0-3545-4a80-a49b-583eb2650c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:02.031715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7b4d0-3545-4a80-a49b-583eb2650c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:02.031996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7b4d0-3545-4a80-a49b-583eb2650c8a admin admin] PATH_INFO: `/v3/projects/3b9dc39908a3467eb268f6ca12ff2bec/users/40bfc4c6de0b40069fb5f395cccc8424/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:02.065345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7b4d0-3545-4a80-a49b-583eb2650c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9dc39908a3467eb268f6ca12ff2bec, user_id=40bfc4c6de0b40069fb5f395cccc8424, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:02.073503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7b4d0-3545-4a80-a49b-583eb2650c8a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:02.104002 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1853/3684] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:01 2022] PUT /identity/v3/projects/3b9dc39908a3467eb268f6ca12ff2bec/users/40bfc4c6de0b40069fb5f395cccc8424/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:02.121758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eaa99-88fe-42b1-9d05-3cfc846803ca None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:02.122050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eaa99-88fe-42b1-9d05-3cfc846803ca None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:02.122324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eaa99-88fe-42b1-9d05-3cfc846803ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:02.172303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c22eaa99-88fe-42b1-9d05-3cfc846803ca None None] MFA Rules not processed for user `40bfc4c6de0b40069fb5f395cccc8424`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:02.173544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c22eaa99-88fe-42b1-9d05-3cfc846803ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:02.315660 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1832/3685] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:02.324047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7b4d0-3545-4a80-a49b-583eb2650c8a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:02.497477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7b4d0-3545-4a80-a49b-583eb2650c8a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:02.522427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66777e3-c0fc-4a04-96c3-ab0d624889fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:02.523420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66777e3-c0fc-4a04-96c3-ab0d624889fa admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:02.524525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66777e3-c0fc-4a04-96c3-ab0d624889fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:02.524844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66777e3-c0fc-4a04-96c3-ab0d624889fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:02.525492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66777e3-c0fc-4a04-96c3-ab0d624889fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:02.531365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66777e3-c0fc-4a04-96c3-ab0d624889fa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:02.614948 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1854/3686] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:02 2022] POST /identity/v3/projects => generated 381 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:02.619070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eaa99-88fe-42b1-9d05-3cfc846803ca None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:02.653162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eaa99-88fe-42b1-9d05-3cfc846803ca None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:02.822873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f4560-31ac-4910-80bf-0955623f4310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:02.823920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f4560-31ac-4910-80bf-0955623f4310 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:02.824490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f4560-31ac-4910-80bf-0955623f4310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:02.825078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f4560-31ac-4910-80bf-0955623f4310 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:02.825924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f4560-31ac-4910-80bf-0955623f4310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:02.829552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f4560-31ac-4910-80bf-0955623f4310 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:02.868977 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:02.882351 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1833/3687] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:15:02 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:02.884244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66777e3-c0fc-4a04-96c3-ab0d624889fa admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:02.895507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66777e3-c0fc-4a04-96c3-ab0d624889fa admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:02.923705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023f8a1-4589-425a-800f-07365f05e46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:02.924344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023f8a1-4589-425a-800f-07365f05e46b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:02.924620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023f8a1-4589-425a-800f-07365f05e46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:02.925163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023f8a1-4589-425a-800f-07365f05e46b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:02.926764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023f8a1-4589-425a-800f-07365f05e46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:02.928630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023f8a1-4589-425a-800f-07365f05e46b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:02.964042 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1855/3688] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:02.968430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f4560-31ac-4910-80bf-0955623f4310 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:02.986416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f4560-31ac-4910-80bf-0955623f4310 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:02.999665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef330c8d-4656-457b-9e6f-ad9b4035596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:03.000352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef330c8d-4656-457b-9e6f-ad9b4035596c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:03.000637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef330c8d-4656-457b-9e6f-ad9b4035596c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:03.000913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef330c8d-4656-457b-9e6f-ad9b4035596c admin admin] PATH_INFO: `/v3/projects/92d88399e8da4cb7af87c4302078a0ba/users/0fd4e5fe2e9f497e9384e58081b7c335/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:03.040381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef330c8d-4656-457b-9e6f-ad9b4035596c admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d88399e8da4cb7af87c4302078a0ba, user_id=0fd4e5fe2e9f497e9384e58081b7c335, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:03.043169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef330c8d-4656-457b-9e6f-ad9b4035596c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:03.080255 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1834/3689] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:02 2022] PUT /identity/v3/projects/92d88399e8da4cb7af87c4302078a0ba/users/0fd4e5fe2e9f497e9384e58081b7c335/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:15:03.081911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023f8a1-4589-425a-800f-07365f05e46b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:03.093054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023f8a1-4589-425a-800f-07365f05e46b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:03.242314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52378b9-42d9-45a6-b43e-38bcddd75add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:03.243132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52378b9-42d9-45a6-b43e-38bcddd75add admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:03.243419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52378b9-42d9-45a6-b43e-38bcddd75add admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:03.243692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52378b9-42d9-45a6-b43e-38bcddd75add admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:03.244395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52378b9-42d9-45a6-b43e-38bcddd75add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:03.246117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52378b9-42d9-45a6-b43e-38bcddd75add admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:03.272580 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1856/3690] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:03.277719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef330c8d-4656-457b-9e6f-ad9b4035596c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:03.294300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef330c8d-4656-457b-9e6f-ad9b4035596c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:03.309009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94d2a1-6eba-45fd-b4d2-272c27729f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:03.309456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94d2a1-6eba-45fd-b4d2-272c27729f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:03.310119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94d2a1-6eba-45fd-b4d2-272c27729f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:03.310880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94d2a1-6eba-45fd-b4d2-272c27729f97 admin admin] PATH_INFO: `/v3/projects/92d88399e8da4cb7af87c4302078a0ba/users/0fd4e5fe2e9f497e9384e58081b7c335/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:03.322744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94d2a1-6eba-45fd-b4d2-272c27729f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d88399e8da4cb7af87c4302078a0ba, user_id=0fd4e5fe2e9f497e9384e58081b7c335, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:03.326308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94d2a1-6eba-45fd-b4d2-272c27729f97 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:03.357550 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1835/3691] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:03 2022] PUT /identity/v3/projects/92d88399e8da4cb7af87c4302078a0ba/users/0fd4e5fe2e9f497e9384e58081b7c335/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:03.382616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811963-dd33-4766-8f93-58462de25ac7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:03.382908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811963-dd33-4766-8f93-58462de25ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:03.383213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811963-dd33-4766-8f93-58462de25ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:03.400753 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:03.442316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6d811963-dd33-4766-8f93-58462de25ac7 None None] MFA Rules not processed for user `0fd4e5fe2e9f497e9384e58081b7c335`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:03.444804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6d811963-dd33-4766-8f93-58462de25ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:03.682135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94d2a1-6eba-45fd-b4d2-272c27729f97 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:03.693053 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1857/3692] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:03.697789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94d2a1-6eba-45fd-b4d2-272c27729f97 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:03.710547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a3010-f2c2-4d90-94bd-7e55701d893d tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd4e5fe2e9f497e9384e58081b7c335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92d88399e8da4cb7af87c4302078a0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:03.711531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a3010-f2c2-4d90-94bd-7e55701d893d tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:03.711972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a3010-f2c2-4d90-94bd-7e55701d893d tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:03.712388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a3010-f2c2-4d90-94bd-7e55701d893d tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:03.713588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a3010-f2c2-4d90-94bd-7e55701d893d tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:03.716883 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-564a3010-f2c2-4d90-94bd-7e55701d893d tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:03.716883 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:15:03.716883 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:15:03.718502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a3010-f2c2-4d90-94bd-7e55701d893d tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-564a3010-f2c2-4d90-94bd-7e55701d893d tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invalid input for field 'name': '' is too short Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: Failed validating 'minLength' in schema['properties']['name']: Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: On instance['name']: Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: Failed validating 'minLength' in schema['properties']['name']: Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: On instance['name']: Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: '' Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise error Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application On instance['name']: Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application '' Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:03.755593 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 16 01:15:03.757388 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 16 01:15:03.758500 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 16 01:15:03.758500 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 16 01:15:03.758500 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:03.758500 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 16 01:15:03.758500 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:15:03.758500 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:03.758500 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application On instance['name']: Oct 16 01:15:03.758500 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application '' Oct 16 01:15:03.758500 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:03.767908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d811963-dd33-4766-8f93-58462de25ac7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:03.777339 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1836/3693] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:15:03 2022] POST /identity/v3/domains => generated 283 bytes in 94 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 16 01:15:03.793292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d811963-dd33-4766-8f93-58462de25ac7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:03.806755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58394ea-b705-47e3-8e5a-e83d77bbcded tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd4e5fe2e9f497e9384e58081b7c335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92d88399e8da4cb7af87c4302078a0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:03.807686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58394ea-b705-47e3-8e5a-e83d77bbcded tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:03.808194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58394ea-b705-47e3-8e5a-e83d77bbcded tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:03.808679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58394ea-b705-47e3-8e5a-e83d77bbcded tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:03.809726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58394ea-b705-47e3-8e5a-e83d77bbcded tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:03.811038 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-a58394ea-b705-47e3-8e5a-e83d77bbcded tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:03.811038 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:15:03.811038 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:15:03.812335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58394ea-b705-47e3-8e5a-e83d77bbcded tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-a58394ea-b705-47e3-8e5a-e83d77bbcded tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: Failed validating 'maxLength' in schema['properties']['name']: Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: On instance['name']: Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: Failed validating 'maxLength' in schema['properties']['name']: Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: On instance['name']: Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise error Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:15:03.824485 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application On instance['name']: Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 16 01:15:03.825829 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 16 01:15:03.826964 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 16 01:15:03.826964 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 16 01:15:03.826964 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 16 01:15:03.826964 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 16 01:15:03.826964 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:15:03.826964 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:03.826964 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 16 01:15:03.826964 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:15:03.826964 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:03.826964 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application On instance['name']: Oct 16 01:15:03.826964 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 16 01:15:03.826964 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:03.831417 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1858/3694] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:15:03 2022] POST /identity/v3/domains => generated 412 bytes in 64 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 16 01:15:03.837765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a3010-f2c2-4d90-94bd-7e55701d893d tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:03.849155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a3010-f2c2-4d90-94bd-7e55701d893d tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:03.861553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08e2e5-1552-4fd6-935a-42e410fb2cba tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd4e5fe2e9f497e9384e58081b7c335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92d88399e8da4cb7af87c4302078a0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:03.862438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08e2e5-1552-4fd6-935a-42e410fb2cba tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:03.863121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08e2e5-1552-4fd6-935a-42e410fb2cba tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:03.863944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08e2e5-1552-4fd6-935a-42e410fb2cba tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:03.865820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08e2e5-1552-4fd6-935a-42e410fb2cba tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:03.868822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08e2e5-1552-4fd6-935a-42e410fb2cba tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:03.913510 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1837/3695] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:15:03 2022] POST /identity/v3/domains => generated 276 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:03.914668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58394ea-b705-47e3-8e5a-e83d77bbcded tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:03.931943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58394ea-b705-47e3-8e5a-e83d77bbcded tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:04.125204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bdf3a-c148-4bdf-a01a-17ef41c9d488 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd4e5fe2e9f497e9384e58081b7c335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92d88399e8da4cb7af87c4302078a0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:04.125846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bdf3a-c148-4bdf-a01a-17ef41c9d488 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:04.126146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bdf3a-c148-4bdf-a01a-17ef41c9d488 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:04.126439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bdf3a-c148-4bdf-a01a-17ef41c9d488 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] PATH_INFO: `/v3/domains/8667096afcf34aea92ccf5d8d79d2883` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:04.141783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bdf3a-c148-4bdf-a01a-17ef41c9d488 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8667096afcf34aea92ccf5d8d79d2883)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:04.142524 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-d79bdf3a-c148-4bdf-a01a-17ef41c9d488 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:04.142524 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:15:04.142524 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:15:04.143654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bdf3a-c148-4bdf-a01a-17ef41c9d488 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-d79bdf3a-c148-4bdf-a01a-17ef41c9d488 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 16 01:15:04.163705 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 16 01:15:04.164774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:15:04.164774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:15:04.164774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 16 01:15:04.164774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 16 01:15:04.164774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 16 01:15:04.164774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 16 01:15:04.164774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 16 01:15:04.164774 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:04.165398 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1859/3696] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:15:03 2022] DELETE /identity/v3/domains/8667096afcf34aea92ccf5d8d79d2883 => generated 120 bytes in 251 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 16 01:15:04.169344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08e2e5-1552-4fd6-935a-42e410fb2cba tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:04.182413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08e2e5-1552-4fd6-935a-42e410fb2cba tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:04.198252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31316030-b912-43f4-9c8c-51f89f933c5f tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd4e5fe2e9f497e9384e58081b7c335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92d88399e8da4cb7af87c4302078a0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:04.198931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31316030-b912-43f4-9c8c-51f89f933c5f tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:04.199223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31316030-b912-43f4-9c8c-51f89f933c5f tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:04.199526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31316030-b912-43f4-9c8c-51f89f933c5f tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] PATH_INFO: `/v3/domains/8667096afcf34aea92ccf5d8d79d2883` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:04.204203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31316030-b912-43f4-9c8c-51f89f933c5f tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8667096afcf34aea92ccf5d8d79d2883)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:04.207700 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-31316030-b912-43f4-9c8c-51f89f933c5f tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:04.207700 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:15:04.207700 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:15:04.208655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31316030-b912-43f4-9c8c-51f89f933c5f tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:04.250681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-31316030-b912-43f4-9c8c-51f89f933c5f tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8667096afcf34aea92ccf5d8d79d2883'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.251518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-31316030-b912-43f4-9c8c-51f89f933c5f tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8667096afcf34aea92ccf5d8d79d2883'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.298886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-31316030-b912-43f4-9c8c-51f89f933c5f tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8667096afcf34aea92ccf5d8d79d2883'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.301986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-31316030-b912-43f4-9c8c-51f89f933c5f tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8667096afcf34aea92ccf5d8d79d2883'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.307135 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1838/3697] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:15:04 2022] PATCH /identity/v3/domains/8667096afcf34aea92ccf5d8d79d2883 => generated 277 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:04.311161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bdf3a-c148-4bdf-a01a-17ef41c9d488 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:04.313321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d79bdf3a-c148-4bdf-a01a-17ef41c9d488 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:04.328152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bdf3a-c148-4bdf-a01a-17ef41c9d488 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:04.435896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd4e5fe2e9f497e9384e58081b7c335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92d88399e8da4cb7af87c4302078a0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:04.436574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:04.437328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:04.437747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] PATH_INFO: `/v3/domains/8667096afcf34aea92ccf5d8d79d2883` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:04.461330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8667096afcf34aea92ccf5d8d79d2883)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:04.463246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:04.464880 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:04.503798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8667096afcf34aea92ccf5d8d79d2883'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.526962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8667096afcf34aea92ccf5d8d79d2883'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.593268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8667096afcf34aea92ccf5d8d79d2883', 'request_id': 'req-26572eaf-1610-4135-8365-5fcefe0b4fc3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.605783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8667096afcf34aea92ccf5d8d79d2883', 'request_id': 'req-26572eaf-1610-4135-8365-5fcefe0b4fc3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.618666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8667096afcf34aea92ccf5d8d79d2883', 'request_id': 'req-26572eaf-1610-4135-8365-5fcefe0b4fc3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.636403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] The token cache is being invalidate because project 8667096afcf34aea92ccf5d8d79d2883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:04.637324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.638472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.654493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8667096afcf34aea92ccf5d8d79d2883', 'request_id': 'req-26572eaf-1610-4135-8365-5fcefe0b4fc3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.655533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8667096afcf34aea92ccf5d8d79d2883', 'request_id': 'req-26572eaf-1610-4135-8365-5fcefe0b4fc3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.656183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8667096afcf34aea92ccf5d8d79d2883', 'request_id': 'req-26572eaf-1610-4135-8365-5fcefe0b4fc3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:04.670700 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1860/3698] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:15:04 2022] DELETE /identity/v3/domains/8667096afcf34aea92ccf5d8d79d2883 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:04.677134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31316030-b912-43f4-9c8c-51f89f933c5f tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:04.690565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31316030-b912-43f4-9c8c-51f89f933c5f tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:04.898165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7fe83-027c-4fe5-957d-213be2feb260 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd4e5fe2e9f497e9384e58081b7c335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92d88399e8da4cb7af87c4302078a0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:04.899114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7fe83-027c-4fe5-957d-213be2feb260 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:04.899581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7fe83-027c-4fe5-957d-213be2feb260 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:04.899918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7fe83-027c-4fe5-957d-213be2feb260 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] PATH_INFO: `/v3/domains/67dcc8109d624bb0b4a4e208dde8144b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:04.920328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7fe83-027c-4fe5-957d-213be2feb260 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-d2b7fe83-027c-4fe5-957d-213be2feb260 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Could not find domain: 67dcc8109d624bb0b4a4e208dde8144b.: keystone.exception.DomainNotFound: Could not find domain: 67dcc8109d624bb0b4a4e208dde8144b. Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 67dcc8109d624bb0b4a4e208dde8144b. Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:15:04.930880 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:15:04.932132 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:15:04.933308 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 67dcc8109d624bb0b4a4e208dde8144b. Oct 16 01:15:04.934533 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:04.939976 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1839/3699] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:15:04 2022] DELETE /identity/v3/domains/67dcc8109d624bb0b4a4e208dde8144b => generated 112 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:15:04.940202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:04.942808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:04.969833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26572eaf-1610-4135-8365-5fcefe0b4fc3 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:04.983159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09292ba6-bd5c-49a0-8930-8e15ac76fe45 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd4e5fe2e9f497e9384e58081b7c335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92d88399e8da4cb7af87c4302078a0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:04.983923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292ba6-bd5c-49a0-8930-8e15ac76fe45 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:04.984779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292ba6-bd5c-49a0-8930-8e15ac76fe45 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:04.986670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292ba6-bd5c-49a0-8930-8e15ac76fe45 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:04.987543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09292ba6-bd5c-49a0-8930-8e15ac76fe45 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:04.991864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09292ba6-bd5c-49a0-8930-8e15ac76fe45 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:05.032658 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1861/3700] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:15:04 2022] POST /identity/v3/domains => generated 252 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:05.033981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7fe83-027c-4fe5-957d-213be2feb260 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:05.057050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7fe83-027c-4fe5-957d-213be2feb260 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:05.249963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98351e5-a7b1-499b-b6ef-0a5c13342175 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd4e5fe2e9f497e9384e58081b7c335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92d88399e8da4cb7af87c4302078a0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:05.250869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98351e5-a7b1-499b-b6ef-0a5c13342175 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:05.251178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98351e5-a7b1-499b-b6ef-0a5c13342175 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:05.251507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98351e5-a7b1-499b-b6ef-0a5c13342175 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:05.252412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98351e5-a7b1-499b-b6ef-0a5c13342175 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:05.276188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98351e5-a7b1-499b-b6ef-0a5c13342175 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:05.287600 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:05.297210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.sql.core [None req-c98351e5-a7b1-499b-b6ef-0a5c13342175 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-401634925' for key 'project.ixu_project_name_domain_id'") Oct 16 01:15:05.297210 n-d-master-1 devstack@keystone.service[81805]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 01:15:05.297210 n-d-master-1 devstack@keystone.service[81805]: [parameters: {'id': '077d441b774c4bf3a58c86235d1bf940', 'name': 'tempest-domain-dup-401634925', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 01:15:05.297210 n-d-master-1 devstack@keystone.service[81805]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81805) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 01:15:05.321516 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c98351e5-a7b1-499b-b6ef-0a5c13342175 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-401634925.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-401634925. Oct 16 01:15:05.321516 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:05.321516 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 01:15:05.321516 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 01:15:05.321516 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 01:15:05.321516 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 01:15:05.321516 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 01:15:05.321516 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 01:15:05.321516 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 01:15:05.321516 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application conn.query(q) Oct 16 01:15:05.321516 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 01:15:05.321516 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 01:15:05.321516 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result.read() Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-401634925' for key 'project.ixu_project_name_domain_id'") Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 16 01:15:05.322636 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application next(self.gen) Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application yield resource Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application next(self.gen) Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise self.value Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application session.commit() Oct 16 01:15:05.324262 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.session.flush() Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application compat.raise_( Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 01:15:05.325629 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 01:15:05.327139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application conn.query(q) Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result.read() Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 01:15:05.328429 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-401634925' for key 'project.ixu_project_name_domain_id'") Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [parameters: {'id': '077d441b774c4bf3a58c86235d1bf940', 'name': 'tempest-domain-dup-401634925', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:05.329792 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-401634925. Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:15:05.331001 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-401634925. Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:15:05.334006 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1840/3701] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:15:05 2022] POST /identity/v3/domains => generated 211 bytes in 290 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 16 01:15:05.336417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09292ba6-bd5c-49a0-8930-8e15ac76fe45 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:05.348557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09292ba6-bd5c-49a0-8930-8e15ac76fe45 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:05.353887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bcfb7-55b9-4d07-97fb-e9925cb8565c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd4e5fe2e9f497e9384e58081b7c335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92d88399e8da4cb7af87c4302078a0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:05.366656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bcfb7-55b9-4d07-97fb-e9925cb8565c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:05.368296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bcfb7-55b9-4d07-97fb-e9925cb8565c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:05.369538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bcfb7-55b9-4d07-97fb-e9925cb8565c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] PATH_INFO: `/v3/domains/6eb447bd1cf54dff8fa81c836146433b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:05.406808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bcfb7-55b9-4d07-97fb-e9925cb8565c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6eb447bd1cf54dff8fa81c836146433b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:05.411970 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-5b2bcfb7-55b9-4d07-97fb-e9925cb8565c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:05.411970 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:15:05.411970 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:15:05.413297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bcfb7-55b9-4d07-97fb-e9925cb8565c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:05.448718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5b2bcfb7-55b9-4d07-97fb-e9925cb8565c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6eb447bd1cf54dff8fa81c836146433b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.449675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5b2bcfb7-55b9-4d07-97fb-e9925cb8565c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6eb447bd1cf54dff8fa81c836146433b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.511149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5b2bcfb7-55b9-4d07-97fb-e9925cb8565c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6eb447bd1cf54dff8fa81c836146433b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.512226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5b2bcfb7-55b9-4d07-97fb-e9925cb8565c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6eb447bd1cf54dff8fa81c836146433b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.520965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98351e5-a7b1-499b-b6ef-0a5c13342175 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:05.522144 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1862/3702] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:15:05 2022] PATCH /identity/v3/domains/6eb447bd1cf54dff8fa81c836146433b => generated 253 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:15:05.522744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c98351e5-a7b1-499b-b6ef-0a5c13342175 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:05.542822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98351e5-a7b1-499b-b6ef-0a5c13342175 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:05.629990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd4e5fe2e9f497e9384e58081b7c335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92d88399e8da4cb7af87c4302078a0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:05.631654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:05.632161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:05.633244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] PATH_INFO: `/v3/domains/6eb447bd1cf54dff8fa81c836146433b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:05.650600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6eb447bd1cf54dff8fa81c836146433b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:05.652006 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:05.652006 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:15:05.652006 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:15:05.653375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:05.685462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6eb447bd1cf54dff8fa81c836146433b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.710678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6eb447bd1cf54dff8fa81c836146433b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.815342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb447bd1cf54dff8fa81c836146433b', 'request_id': 'req-bb37b76f-c240-4e70-a8ee-f68f7071190c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.826274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb447bd1cf54dff8fa81c836146433b', 'request_id': 'req-bb37b76f-c240-4e70-a8ee-f68f7071190c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.846682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb447bd1cf54dff8fa81c836146433b', 'request_id': 'req-bb37b76f-c240-4e70-a8ee-f68f7071190c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.864873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] The token cache is being invalidate because project 6eb447bd1cf54dff8fa81c836146433b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:05.865172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.867345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.891961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6eb447bd1cf54dff8fa81c836146433b', 'request_id': 'req-bb37b76f-c240-4e70-a8ee-f68f7071190c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.895682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6eb447bd1cf54dff8fa81c836146433b', 'request_id': 'req-bb37b76f-c240-4e70-a8ee-f68f7071190c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.896374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6eb447bd1cf54dff8fa81c836146433b', 'request_id': 'req-bb37b76f-c240-4e70-a8ee-f68f7071190c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:05.916098 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1841/3703] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:15:05 2022] DELETE /identity/v3/domains/6eb447bd1cf54dff8fa81c836146433b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:05.921290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bcfb7-55b9-4d07-97fb-e9925cb8565c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:05.942536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bcfb7-55b9-4d07-97fb-e9925cb8565c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:06.045259 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:06.073259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fe814-dbf9-4824-9dc7-b4629c4281d7 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd4e5fe2e9f497e9384e58081b7c335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92d88399e8da4cb7af87c4302078a0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:06.074969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fe814-dbf9-4824-9dc7-b4629c4281d7 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:06.074969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fe814-dbf9-4824-9dc7-b4629c4281d7 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:06.075291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fe814-dbf9-4824-9dc7-b4629c4281d7 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] PATH_INFO: `/v3/domains/8667096afcf34aea92ccf5d8d79d2883` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:06.086736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fe814-dbf9-4824-9dc7-b4629c4281d7 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-116fe814-dbf9-4824-9dc7-b4629c4281d7 tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Could not find domain: 8667096afcf34aea92ccf5d8d79d2883.: keystone.exception.DomainNotFound: Could not find domain: 8667096afcf34aea92ccf5d8d79d2883. Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8667096afcf34aea92ccf5d8d79d2883. Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:15:06.093681 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:15:06.094828 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:15:06.095861 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8667096afcf34aea92ccf5d8d79d2883. Oct 16 01:15:06.097106 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:06.099524 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1863/3704] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:15:05 2022] PATCH /identity/v3/domains/8667096afcf34aea92ccf5d8d79d2883 => generated 112 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:15:06.100199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:06.101646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:06.154702 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:06.193276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37b76f-c240-4e70-a8ee-f68f7071190c tempest-DomainsNegativeTestJSON-361908510 tempest-DomainsNegativeTestJSON-361908510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:06.199276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:06.200323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:06.200975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:06.201525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] PATH_INFO: `/v3/users/40bfc4c6de0b40069fb5f395cccc8424` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:06.203106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40bfc4c6de0b40069fb5f395cccc8424)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:06.205569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:06.279094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40bfc4c6de0b40069fb5f395cccc8424'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:06.280807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40bfc4c6de0b40069fb5f395cccc8424'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:06.303599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40bfc4c6de0b40069fb5f395cccc8424'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:06.317667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40bfc4c6de0b40069fb5f395cccc8424'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:06.319533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40bfc4c6de0b40069fb5f395cccc8424'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:06.344831 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1842/3705] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:06 2022] DELETE /identity/v3/users/40bfc4c6de0b40069fb5f395cccc8424 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:15:06.349993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d096aa-d588-476b-98e8-f6bcd1a1ad95 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:06.350278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d096aa-d588-476b-98e8-f6bcd1a1ad95 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:06.350554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d096aa-d588-476b-98e8-f6bcd1a1ad95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:06.397012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d1d096aa-d588-476b-98e8-f6bcd1a1ad95 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:06.398701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d1d096aa-d588-476b-98e8-f6bcd1a1ad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:06.626363 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1864/3706] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:06.802314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:06.803921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:06.936428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd988d-bcc7-4cf7-8e4a-4e2242e0e223 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:06.942414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e09d9f-bfab-497d-b6ec-0a8986f43c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:06.943445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e09d9f-bfab-497d-b6ec-0a8986f43c56 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:06.943942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e09d9f-bfab-497d-b6ec-0a8986f43c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:06.944547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e09d9f-bfab-497d-b6ec-0a8986f43c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:06.970164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e09d9f-bfab-497d-b6ec-0a8986f43c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:06.977337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e09d9f-bfab-497d-b6ec-0a8986f43c56 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:07.006812 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1843/3707] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:15:08.713826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d096aa-d588-476b-98e8-f6bcd1a1ad95 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:08.717890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d1d096aa-d588-476b-98e8-f6bcd1a1ad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:08.738763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d096aa-d588-476b-98e8-f6bcd1a1ad95 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:08.752046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:08.752758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:08.753077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:08.753658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] PATH_INFO: `/v3/projects/3b9dc39908a3467eb268f6ca12ff2bec` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:08.755135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9dc39908a3467eb268f6ca12ff2bec)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:08.758329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:08.881300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9dc39908a3467eb268f6ca12ff2bec', 'request_id': 'req-1debf6de-17cf-4925-aa80-e592cd6dacd6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:08.902580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9dc39908a3467eb268f6ca12ff2bec', 'request_id': 'req-1debf6de-17cf-4925-aa80-e592cd6dacd6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:08.939039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9dc39908a3467eb268f6ca12ff2bec', 'request_id': 'req-1debf6de-17cf-4925-aa80-e592cd6dacd6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:09.005210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] The token cache is being invalidate because project 3b9dc39908a3467eb268f6ca12ff2bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:09.009005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:09.013557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:09.016297 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1865/3708] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:08 2022] DELETE /identity/v3/projects/3b9dc39908a3467eb268f6ca12ff2bec => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:09.021798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e09d9f-bfab-497d-b6ec-0a8986f43c56 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:09.034610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e09d9f-bfab-497d-b6ec-0a8986f43c56 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:09.151384 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:09.172817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503fba4-d0be-4ccd-aacb-17e140c4fbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:09.175741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503fba4-d0be-4ccd-aacb-17e140c4fbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:09.178161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503fba4-d0be-4ccd-aacb-17e140c4fbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:09.178503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503fba4-d0be-4ccd-aacb-17e140c4fbee admin admin] PATH_INFO: `/v3/users/0fd4e5fe2e9f497e9384e58081b7c335` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:09.183298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503fba4-d0be-4ccd-aacb-17e140c4fbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd4e5fe2e9f497e9384e58081b7c335)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:09.189604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503fba4-d0be-4ccd-aacb-17e140c4fbee admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:09.330964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1503fba4-d0be-4ccd-aacb-17e140c4fbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd4e5fe2e9f497e9384e58081b7c335'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:09.333973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1503fba4-d0be-4ccd-aacb-17e140c4fbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd4e5fe2e9f497e9384e58081b7c335'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:09.378629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1503fba4-d0be-4ccd-aacb-17e140c4fbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd4e5fe2e9f497e9384e58081b7c335'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:09.400134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1503fba4-d0be-4ccd-aacb-17e140c4fbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd4e5fe2e9f497e9384e58081b7c335'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:09.400772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1503fba4-d0be-4ccd-aacb-17e140c4fbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd4e5fe2e9f497e9384e58081b7c335'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:09.436907 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1844/3709] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:09 2022] DELETE /identity/v3/users/0fd4e5fe2e9f497e9384e58081b7c335 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:11.457580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:11.459317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:11.490745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debf6de-17cf-4925-aa80-e592cd6dacd6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:11.627216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:11.627871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:11.628348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:11.628795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03 admin admin] PATH_INFO: `/v3/projects/92d88399e8da4cb7af87c4302078a0ba` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:11.630277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d88399e8da4cb7af87c4302078a0ba)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:11.638444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:11.669150 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:11.772125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d88399e8da4cb7af87c4302078a0ba', 'request_id': 'req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:11.786439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d88399e8da4cb7af87c4302078a0ba', 'request_id': 'req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:11.805780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d88399e8da4cb7af87c4302078a0ba', 'request_id': 'req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:11.825118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03 admin admin] The token cache is being invalidate because project 92d88399e8da4cb7af87c4302078a0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:11.825695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:11.826551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9cdafb0-fe2b-40ca-937f-6e7807f13a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:11.849712 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1866/3710] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:11 2022] DELETE /identity/v3/projects/92d88399e8da4cb7af87c4302078a0ba => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:11.850690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b408-9363-4773-b21c-1faf3d2b548d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:11.851280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b408-9363-4773-b21c-1faf3d2b548d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:11.851533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b408-9363-4773-b21c-1faf3d2b548d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:11.908165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5269b408-9363-4773-b21c-1faf3d2b548d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:11.920868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5269b408-9363-4773-b21c-1faf3d2b548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:12.112644 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1845/3711] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:12.117444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb13a1e-4ddb-4ab1-8086-76440d9b9174 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:12.119316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb13a1e-4ddb-4ab1-8086-76440d9b9174 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:12.119829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb13a1e-4ddb-4ab1-8086-76440d9b9174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:12.171866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ddb13a1e-4ddb-4ab1-8086-76440d9b9174 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:12.173637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ddb13a1e-4ddb-4ab1-8086-76440d9b9174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:12.198706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269b408-9363-4773-b21c-1faf3d2b548d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:12.199894 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1867/3712] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:12.209889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269b408-9363-4773-b21c-1faf3d2b548d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:12.222736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2312555-1db4-4e8e-8e13-208d52b5df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:12.223222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2312555-1db4-4e8e-8e13-208d52b5df9e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:12.223566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2312555-1db4-4e8e-8e13-208d52b5df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:12.223906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2312555-1db4-4e8e-8e13-208d52b5df9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:12.224623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2312555-1db4-4e8e-8e13-208d52b5df9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:12.224991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2312555-1db4-4e8e-8e13-208d52b5df9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:12.236974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2312555-1db4-4e8e-8e13-208d52b5df9e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:12.263026 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1846/3713] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:15:12.263742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb13a1e-4ddb-4ab1-8086-76440d9b9174 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:12.282711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb13a1e-4ddb-4ab1-8086-76440d9b9174 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:12.290724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6866b-956f-4328-b907-91ee5b0cafb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:12.291381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6866b-956f-4328-b907-91ee5b0cafb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:12.291732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6866b-956f-4328-b907-91ee5b0cafb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:12.292065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6866b-956f-4328-b907-91ee5b0cafb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:12.292854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6866b-956f-4328-b907-91ee5b0cafb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:12.294850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6866b-956f-4328-b907-91ee5b0cafb6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:12.379404 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1868/3714] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:12 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:12.468949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2312555-1db4-4e8e-8e13-208d52b5df9e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:12.481905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2312555-1db4-4e8e-8e13-208d52b5df9e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:12.630123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67992d60-e8b9-4e22-9343-5316d2fdcebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:12.631147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67992d60-e8b9-4e22-9343-5316d2fdcebb admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:12.631147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67992d60-e8b9-4e22-9343-5316d2fdcebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:12.631408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67992d60-e8b9-4e22-9343-5316d2fdcebb admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:12.632069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67992d60-e8b9-4e22-9343-5316d2fdcebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:12.633997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67992d60-e8b9-4e22-9343-5316d2fdcebb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:12.663026 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:12.671100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6866b-956f-4328-b907-91ee5b0cafb6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:12.672983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8fd6866b-956f-4328-b907-91ee5b0cafb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:12.684772 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1847/3715] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:15:12 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:12.689316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67992d60-e8b9-4e22-9343-5316d2fdcebb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:12.717018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67992d60-e8b9-4e22-9343-5316d2fdcebb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:12.724941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379fee9-498f-43d5-a5b6-83be85b8aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:12.725565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379fee9-498f-43d5-a5b6-83be85b8aad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:12.725846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379fee9-498f-43d5-a5b6-83be85b8aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:12.726119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379fee9-498f-43d5-a5b6-83be85b8aad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:12.726765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379fee9-498f-43d5-a5b6-83be85b8aad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:12.728414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379fee9-498f-43d5-a5b6-83be85b8aad8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:12.755628 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1848/3716] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:12.759922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379fee9-498f-43d5-a5b6-83be85b8aad8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:12.780203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6866b-956f-4328-b907-91ee5b0cafb6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:12.783348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379fee9-498f-43d5-a5b6-83be85b8aad8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:12.788973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316e8ee-5250-4fd3-b98c-6b94db12dc59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:12.790046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316e8ee-5250-4fd3-b98c-6b94db12dc59 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:12.790477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316e8ee-5250-4fd3-b98c-6b94db12dc59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:12.791008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316e8ee-5250-4fd3-b98c-6b94db12dc59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:12.793076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8316e8ee-5250-4fd3-b98c-6b94db12dc59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:12.799951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121f73a-ced4-4979-8fbd-5d5c5f61cc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:12.800861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121f73a-ced4-4979-8fbd-5d5c5f61cc0b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:12.801408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121f73a-ced4-4979-8fbd-5d5c5f61cc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:12.801682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121f73a-ced4-4979-8fbd-5d5c5f61cc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:12.802322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121f73a-ced4-4979-8fbd-5d5c5f61cc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:12.810307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121f73a-ced4-4979-8fbd-5d5c5f61cc0b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:12.830393 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1849/3717] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:15:12.835374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121f73a-ced4-4979-8fbd-5d5c5f61cc0b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:12.846773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121f73a-ced4-4979-8fbd-5d5c5f61cc0b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:12.853300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356162-1b27-4341-8173-e0bf8f31e077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:12.854742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356162-1b27-4341-8173-e0bf8f31e077 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:12.855226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356162-1b27-4341-8173-e0bf8f31e077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:12.855885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356162-1b27-4341-8173-e0bf8f31e077 admin admin] PATH_INFO: `/v3/projects/2f18c57c283b4136b3e16e0c4d1fbd33/users/cee824de5f004a729325a2f6c6fc2eaa/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:12.915163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46356162-1b27-4341-8173-e0bf8f31e077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f18c57c283b4136b3e16e0c4d1fbd33, user_id=cee824de5f004a729325a2f6c6fc2eaa, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:12.918173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46356162-1b27-4341-8173-e0bf8f31e077 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:12.933708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316e8ee-5250-4fd3-b98c-6b94db12dc59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:12.937336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316e8ee-5250-4fd3-b98c-6b94db12dc59 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:12.951643 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1850/3718] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:12 2022] PUT /identity/v3/projects/2f18c57c283b4136b3e16e0c4d1fbd33/users/cee824de5f004a729325a2f6c6fc2eaa/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:15:12.962174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1366380-7069-4847-b16a-2c74818d89f7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:12.962492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1366380-7069-4847-b16a-2c74818d89f7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:12.962788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1366380-7069-4847-b16a-2c74818d89f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:12.965978 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1869/3719] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:15:13.029475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f1366380-7069-4847-b16a-2c74818d89f7 None None] MFA Rules not processed for user `cee824de5f004a729325a2f6c6fc2eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:13.030903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f1366380-7069-4847-b16a-2c74818d89f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:13.236936 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1851/3720] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:15:13.242339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316e8ee-5250-4fd3-b98c-6b94db12dc59 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:13.261021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316e8ee-5250-4fd3-b98c-6b94db12dc59 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:13.266867 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:13.389881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65554a-44f1-46e4-a58b-b4506f46bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:13.390228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65554a-44f1-46e4-a58b-b4506f46bf7b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:13.390508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65554a-44f1-46e4-a58b-b4506f46bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:13.390774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65554a-44f1-46e4-a58b-b4506f46bf7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:13.391465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65554a-44f1-46e4-a58b-b4506f46bf7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:13.393363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65554a-44f1-46e4-a58b-b4506f46bf7b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:13.458768 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1870/3721] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:13 2022] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:13.462906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1366380-7069-4847-b16a-2c74818d89f7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:13.476687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1366380-7069-4847-b16a-2c74818d89f7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:13.606544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c80c6-4930-4234-9b8a-a0d09d6dd3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:13.607365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c80c6-4930-4234-9b8a-a0d09d6dd3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:13.607644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c80c6-4930-4234-9b8a-a0d09d6dd3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:13.609264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c80c6-4930-4234-9b8a-a0d09d6dd3a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:13.611278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c80c6-4930-4234-9b8a-a0d09d6dd3a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:13.620011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c80c6-4930-4234-9b8a-a0d09d6dd3a3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:13.669196 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1852/3722] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:15:13 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:13.672185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65554a-44f1-46e4-a58b-b4506f46bf7b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:13.688519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65554a-44f1-46e4-a58b-b4506f46bf7b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:13.704167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15cd7e-910d-4504-b090-26126cdfe9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:13.704951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15cd7e-910d-4504-b090-26126cdfe9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:13.708159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15cd7e-910d-4504-b090-26126cdfe9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:13.708535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15cd7e-910d-4504-b090-26126cdfe9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:13.709287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15cd7e-910d-4504-b090-26126cdfe9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:13.713786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15cd7e-910d-4504-b090-26126cdfe9c8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:13.742834 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1871/3723] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:13.745778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c80c6-4930-4234-9b8a-a0d09d6dd3a3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:13.765786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c80c6-4930-4234-9b8a-a0d09d6dd3a3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:13.778672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fe193-4714-49f8-bc8d-1657633cf142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:13.780157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fe193-4714-49f8-bc8d-1657633cf142 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:13.780157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fe193-4714-49f8-bc8d-1657633cf142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:13.780999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fe193-4714-49f8-bc8d-1657633cf142 admin admin] PATH_INFO: `/v3/projects/fbcf0862b80744ad9e105a19f21f6623/users/6fee2dab736648a28cf44adf9ffbdbb0/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:13.823970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fe193-4714-49f8-bc8d-1657633cf142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbcf0862b80744ad9e105a19f21f6623, user_id=6fee2dab736648a28cf44adf9ffbdbb0, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:13.826047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ea30b-085d-43a6-a091-69fe4316ec59 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:13.826336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ea30b-085d-43a6-a091-69fe4316ec59 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:13.826606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ea30b-085d-43a6-a091-69fe4316ec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:13.829861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fe193-4714-49f8-bc8d-1657633cf142 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:13.863173 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1853/3724] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:13 2022] PUT /identity/v3/projects/fbcf0862b80744ad9e105a19f21f6623/users/6fee2dab736648a28cf44adf9ffbdbb0/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:13.871183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fe193-4714-49f8-bc8d-1657633cf142 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:13.872771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ca0ea30b-085d-43a6-a091-69fe4316ec59 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:13.876473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ca0ea30b-085d-43a6-a091-69fe4316ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:13.882356 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:13.983184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fe193-4714-49f8-bc8d-1657633cf142 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:13.999677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a308d-cf7c-47a8-b4d9-4873cd75c5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:14.000752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a308d-cf7c-47a8-b4d9-4873cd75c5be admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:14.001559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a308d-cf7c-47a8-b4d9-4873cd75c5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:14.002627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a308d-cf7c-47a8-b4d9-4873cd75c5be admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:14.005597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a308d-cf7c-47a8-b4d9-4873cd75c5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:14.008738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a308d-cf7c-47a8-b4d9-4873cd75c5be admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:14.041169 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1854/3725] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:14.045764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a308d-cf7c-47a8-b4d9-4873cd75c5be admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:14.055244 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1872/3726] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:15:14.091521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ea30b-085d-43a6-a091-69fe4316ec59 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:14.093700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ca0ea30b-085d-43a6-a091-69fe4316ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:14.104687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a308d-cf7c-47a8-b4d9-4873cd75c5be admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:14.114603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7103f57-ef25-4426-82b1-c4a7932f1451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:14.115331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103f57-ef25-4426-82b1-c4a7932f1451 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:14.115610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103f57-ef25-4426-82b1-c4a7932f1451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:14.115928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103f57-ef25-4426-82b1-c4a7932f1451 admin admin] PATH_INFO: `/v3/projects/fbcf0862b80744ad9e105a19f21f6623/users/6fee2dab736648a28cf44adf9ffbdbb0/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:14.125128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7103f57-ef25-4426-82b1-c4a7932f1451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbcf0862b80744ad9e105a19f21f6623, user_id=6fee2dab736648a28cf44adf9ffbdbb0, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:14.132231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7103f57-ef25-4426-82b1-c4a7932f1451 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:14.170375 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1855/3727] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:14 2022] PUT /identity/v3/projects/fbcf0862b80744ad9e105a19f21f6623/users/6fee2dab736648a28cf44adf9ffbdbb0/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:14.171931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5b042-ce15-41e6-861f-f0fc62f113bd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:14.172216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5b042-ce15-41e6-861f-f0fc62f113bd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:14.172489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5b042-ce15-41e6-861f-f0fc62f113bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:14.257452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6ae5b042-ce15-41e6-861f-f0fc62f113bd None None] MFA Rules not processed for user `6fee2dab736648a28cf44adf9ffbdbb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:14.261364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6ae5b042-ce15-41e6-861f-f0fc62f113bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:14.342608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ea30b-085d-43a6-a091-69fe4316ec59 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:14.424242 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:14.533908 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1856/3728] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:14.542808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5b042-ce15-41e6-861f-f0fc62f113bd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:14.599785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ed5ad-fbaa-4749-ad55-3c3b966189b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:14.600420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ed5ad-fbaa-4749-ad55-3c3b966189b8 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:14.600702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ed5ad-fbaa-4749-ad55-3c3b966189b8 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:14.600978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ed5ad-fbaa-4749-ad55-3c3b966189b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:14.607710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5b042-ce15-41e6-861f-f0fc62f113bd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:14.634609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab52924-b7b0-40be-a75a-b9a22ca5dfc1 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:14.637384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab52924-b7b0-40be-a75a-b9a22ca5dfc1 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:14.637863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab52924-b7b0-40be-a75a-b9a22ca5dfc1 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:14.640026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab52924-b7b0-40be-a75a-b9a22ca5dfc1 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:14.641112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab52924-b7b0-40be-a75a-b9a22ca5dfc1 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:14.645085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab52924-b7b0-40be-a75a-b9a22ca5dfc1 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:14.689706 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1857/3729] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:15:14 2022] POST /identity/v3/domains => generated 276 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:14.689706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da297ba-3a0d-46aa-be5a-9d7852b21090 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:14.689706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da297ba-3a0d-46aa-be5a-9d7852b21090 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:14.689706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da297ba-3a0d-46aa-be5a-9d7852b21090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:14.774749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0da297ba-3a0d-46aa-be5a-9d7852b21090 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:14.776135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0da297ba-3a0d-46aa-be5a-9d7852b21090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:14.791904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ed5ad-fbaa-4749-ad55-3c3b966189b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:14.793968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ed5ad-fbaa-4749-ad55-3c3b966189b8 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:14.820310 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1873/3730] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:15:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:15:14.821164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ed5ad-fbaa-4749-ad55-3c3b966189b8 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:14.846419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ed5ad-fbaa-4749-ad55-3c3b966189b8 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:14.994609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa47dd-6264-4655-ac73-951ecefd2721 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:14.995276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa47dd-6264-4655-ac73-951ecefd2721 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:14.995561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa47dd-6264-4655-ac73-951ecefd2721 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:14.995833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa47dd-6264-4655-ac73-951ecefd2721 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:14.996682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa47dd-6264-4655-ac73-951ecefd2721 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:14.998414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa47dd-6264-4655-ac73-951ecefd2721 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:15.033229 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1858/3731] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:15:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:15.053150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da297ba-3a0d-46aa-be5a-9d7852b21090 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:15.057084 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:15.096033 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1874/3732] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:14 2022] POST /identity/v3/projects => generated 403 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:15.101542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa47dd-6264-4655-ac73-951ecefd2721 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:15.211798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da297ba-3a0d-46aa-be5a-9d7852b21090 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:15.217379 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:15.241019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa47dd-6264-4655-ac73-951ecefd2721 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:15.254446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30adfd-8afa-4ade-a73e-5683827e457f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:15.255108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30adfd-8afa-4ade-a73e-5683827e457f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:15.255421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30adfd-8afa-4ade-a73e-5683827e457f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:15.255665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30adfd-8afa-4ade-a73e-5683827e457f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:15.256307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30adfd-8afa-4ade-a73e-5683827e457f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:15.257402 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-3f30adfd-8afa-4ade-a73e-5683827e457f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:15.257402 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:15:15.257402 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:15:15.262841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30adfd-8afa-4ade-a73e-5683827e457f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:15.296610 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1875/3733] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:15:15 2022] POST /identity/v3/groups => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:15:15.305741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30adfd-8afa-4ade-a73e-5683827e457f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:15.325596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30adfd-8afa-4ade-a73e-5683827e457f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:15.337994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456d631-dcbe-4055-abda-c0a325da9fb7 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:15.338665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456d631-dcbe-4055-abda-c0a325da9fb7 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:15.338980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456d631-dcbe-4055-abda-c0a325da9fb7 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:15.339276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456d631-dcbe-4055-abda-c0a325da9fb7 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:15.339922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456d631-dcbe-4055-abda-c0a325da9fb7 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:15.341836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456d631-dcbe-4055-abda-c0a325da9fb7 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:15.374382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7173f-9969-41ab-b1f0-3c7512e0428a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:15.375086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7173f-9969-41ab-b1f0-3c7512e0428a service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:15.375367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7173f-9969-41ab-b1f0-3c7512e0428a service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:15.375642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7173f-9969-41ab-b1f0-3c7512e0428a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:15.391317 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1876/3734] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:15:15 2022] POST /identity/v3/users => generated 445 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:15.396579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456d631-dcbe-4055-abda-c0a325da9fb7 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:15.412803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456d631-dcbe-4055-abda-c0a325da9fb7 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:15.427732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19263047-3d5b-4bbf-afcf-0c1b9d27a2f3 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:15.428808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19263047-3d5b-4bbf-afcf-0c1b9d27a2f3 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:15.429086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19263047-3d5b-4bbf-afcf-0c1b9d27a2f3 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:15.430099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19263047-3d5b-4bbf-afcf-0c1b9d27a2f3 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:15.433000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19263047-3d5b-4bbf-afcf-0c1b9d27a2f3 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:15.434141 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-19263047-3d5b-4bbf-afcf-0c1b9d27a2f3 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:15.434141 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:15:15.434141 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:15:15.439111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19263047-3d5b-4bbf-afcf-0c1b9d27a2f3 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:15.474455 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1877/3735] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:15:15 2022] POST /identity/v3/roles => generated 240 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:15:15.479206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19263047-3d5b-4bbf-afcf-0c1b9d27a2f3 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:15.505052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19263047-3d5b-4bbf-afcf-0c1b9d27a2f3 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:15.519539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae87d-8ead-42ca-abe6-a090f21a298b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:15.520239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae87d-8ead-42ca-abe6-a090f21a298b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:15.520573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae87d-8ead-42ca-abe6-a090f21a298b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:15.520849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae87d-8ead-42ca-abe6-a090f21a298b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/84eb99afe9504dd7b8b54e01eca1ea41/inherited_to_projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:15.521804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7173f-9969-41ab-b1f0-3c7512e0428a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:15.523473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7173f-9969-41ab-b1f0-3c7512e0428a service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:15.534249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ae87d-8ead-42ca-abe6-a090f21a298b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b1a06e70b2f843c4befc2f6d0e692389, group_id=c996d958dfc2425e8977aafd5cd1eebd, role_id=84eb99afe9504dd7b8b54e01eca1ea41)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:15.539494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ae87d-8ead-42ca-abe6-a090f21a298b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:15.543264 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1859/3736] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:15:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:15:15.569959 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1878/3737] 10.222.0.39 () {60 vars in 1585 bytes} [Sun Oct 16 01:15:15 2022] PUT /identity/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/84eb99afe9504dd7b8b54e01eca1ea41/inherited_to_projects => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:15.573900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7173f-9969-41ab-b1f0-3c7512e0428a service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:15.590699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7173f-9969-41ab-b1f0-3c7512e0428a service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:15.675516 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:15.747767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73102d-f235-41fc-a899-089afc288abe tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:15.748486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73102d-f235-41fc-a899-089afc288abe tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:15.748781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73102d-f235-41fc-a899-089afc288abe tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:15.749046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73102d-f235-41fc-a899-089afc288abe tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/84eb99afe9504dd7b8b54e01eca1ea41/inherited_to_projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:15.758357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73102d-f235-41fc-a899-089afc288abe tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b1a06e70b2f843c4befc2f6d0e692389, group_id=c996d958dfc2425e8977aafd5cd1eebd, role_id=84eb99afe9504dd7b8b54e01eca1ea41)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:15.760225 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-cf73102d-f235-41fc-a899-089afc288abe tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:15.760225 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:15:15.760225 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:15:15.774455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73102d-f235-41fc-a899-089afc288abe tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:15.800658 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1860/3738] 10.222.0.39 () {58 vars in 1567 bytes} [Sun Oct 16 01:15:15 2022] HEAD /identity/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/84eb99afe9504dd7b8b54e01eca1ea41/inherited_to_projects => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:15.801736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae87d-8ead-42ca-abe6-a090f21a298b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:15.821102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae87d-8ead-42ca-abe6-a090f21a298b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:15.857784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8df22-44bd-4db0-9f29-3731c8a78036 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:15.858623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8df22-44bd-4db0-9f29-3731c8a78036 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:15.858927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8df22-44bd-4db0-9f29-3731c8a78036 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:15.859237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8df22-44bd-4db0-9f29-3731c8a78036 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/84eb99afe9504dd7b8b54e01eca1ea41/inherited_to_projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:15.865568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8df22-44bd-4db0-9f29-3731c8a78036 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b1a06e70b2f843c4befc2f6d0e692389, group_id=c996d958dfc2425e8977aafd5cd1eebd, role_id=84eb99afe9504dd7b8b54e01eca1ea41)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:15.870967 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-72d8df22-44bd-4db0-9f29-3731c8a78036 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:15.870967 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:15:15.870967 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:15:15.896169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8df22-44bd-4db0-9f29-3731c8a78036 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:15.910254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72d8df22-44bd-4db0-9f29-3731c8a78036 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invalidating the token cache because role 84eb99afe9504dd7b8b54e01eca1ea41 was removed from group c996d958dfc2425e8977aafd5cd1eebd on project b1a06e70b2f843c4befc2f6d0e692389. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:15.910556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72d8df22-44bd-4db0-9f29-3731c8a78036 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:15.915393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72d8df22-44bd-4db0-9f29-3731c8a78036 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:15.963360 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1879/3739] 10.222.0.39 () {58 vars in 1569 bytes} [Sun Oct 16 01:15:15 2022] DELETE /identity/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/84eb99afe9504dd7b8b54e01eca1ea41/inherited_to_projects => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:15.971098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73102d-f235-41fc-a899-089afc288abe tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:15.971098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cf73102d-f235-41fc-a899-089afc288abe tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:16.009984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73102d-f235-41fc-a899-089afc288abe tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:16.240819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfa927-2065-489d-8866-9a302d623081 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:16.250199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfa927-2065-489d-8866-9a302d623081 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:16.251464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfa927-2065-489d-8866-9a302d623081 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:16.251910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfa927-2065-489d-8866-9a302d623081 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/roles/84eb99afe9504dd7b8b54e01eca1ea41` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:16.254761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfa927-2065-489d-8866-9a302d623081 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:delete_role(role_id=84eb99afe9504dd7b8b54e01eca1ea41)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:16.263266 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-c3dfa927-2065-489d-8866-9a302d623081 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:16.263266 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:15:16.263266 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:15:16.277091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfa927-2065-489d-8866-9a302d623081 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:16.388984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c3dfa927-2065-489d-8866-9a302d623081 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invalidating the token cache because role 84eb99afe9504dd7b8b54e01eca1ea41 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:16.389281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c3dfa927-2065-489d-8866-9a302d623081 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:16.390692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c3dfa927-2065-489d-8866-9a302d623081 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:16.396672 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1861/3740] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:15 2022] DELETE /identity/v3/roles/84eb99afe9504dd7b8b54e01eca1ea41 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:16.401572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8df22-44bd-4db0-9f29-3731c8a78036 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:16.422148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8df22-44bd-4db0-9f29-3731c8a78036 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:16.656224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be489a-0ae5-41d5-946c-7d9d8d58ff00 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:16.657167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be489a-0ae5-41d5-946c-7d9d8d58ff00 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:16.657715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be489a-0ae5-41d5-946c-7d9d8d58ff00 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:16.658214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be489a-0ae5-41d5-946c-7d9d8d58ff00 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:16.659272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be489a-0ae5-41d5-946c-7d9d8d58ff00 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:16.661405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be489a-0ae5-41d5-946c-7d9d8d58ff00 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:16.696856 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1880/3741] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:15:16 2022] POST /identity/v3/roles => generated 239 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:16.697597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfa927-2065-489d-8866-9a302d623081 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:16.699215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c3dfa927-2065-489d-8866-9a302d623081 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:16.729278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfa927-2065-489d-8866-9a302d623081 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:16.748567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b023a6-af04-46b1-9d7e-4fa0b433c4bc tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:16.756850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b023a6-af04-46b1-9d7e-4fa0b433c4bc tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:16.757227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b023a6-af04-46b1-9d7e-4fa0b433c4bc tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:16.758658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b023a6-af04-46b1-9d7e-4fa0b433c4bc tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/users/aac4d8327d7849ffbe28402bf33a26cc/roles/d0561a51235b4ead8652520c55b211f6/inherited_to_projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:16.814537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b023a6-af04-46b1-9d7e-4fa0b433c4bc tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b1a06e70b2f843c4befc2f6d0e692389, user_id=aac4d8327d7849ffbe28402bf33a26cc, role_id=d0561a51235b4ead8652520c55b211f6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:16.824121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b023a6-af04-46b1-9d7e-4fa0b433c4bc tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:16.869644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be489a-0ae5-41d5-946c-7d9d8d58ff00 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:16.870697 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1862/3742] 10.222.0.39 () {60 vars in 1582 bytes} [Sun Oct 16 01:15:16 2022] PUT /identity/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/users/aac4d8327d7849ffbe28402bf33a26cc/roles/d0561a51235b4ead8652520c55b211f6/inherited_to_projects => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:16.883545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be489a-0ae5-41d5-946c-7d9d8d58ff00 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:17.175813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685cd97-b98f-41a0-b5f5-a7a59017a869 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:17.177935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685cd97-b98f-41a0-b5f5-a7a59017a869 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:17.180407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685cd97-b98f-41a0-b5f5-a7a59017a869 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:17.180873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685cd97-b98f-41a0-b5f5-a7a59017a869 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/users/aac4d8327d7849ffbe28402bf33a26cc/roles/d0561a51235b4ead8652520c55b211f6/inherited_to_projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:17.195895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685cd97-b98f-41a0-b5f5-a7a59017a869 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b1a06e70b2f843c4befc2f6d0e692389, user_id=aac4d8327d7849ffbe28402bf33a26cc, role_id=d0561a51235b4ead8652520c55b211f6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:17.197270 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-7685cd97-b98f-41a0-b5f5-a7a59017a869 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:17.197270 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:15:17.197270 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:15:17.209647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685cd97-b98f-41a0-b5f5-a7a59017a869 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:17.246686 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1881/3743] 10.222.0.39 () {58 vars in 1564 bytes} [Sun Oct 16 01:15:16 2022] HEAD /identity/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/users/aac4d8327d7849ffbe28402bf33a26cc/roles/d0561a51235b4ead8652520c55b211f6/inherited_to_projects => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:17.251278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b023a6-af04-46b1-9d7e-4fa0b433c4bc tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:17.266116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b023a6-af04-46b1-9d7e-4fa0b433c4bc tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:17.280873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd9dea-c8c8-4e1d-a77f-41929148751c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:17.281707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd9dea-c8c8-4e1d-a77f-41929148751c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:17.281999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd9dea-c8c8-4e1d-a77f-41929148751c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:17.282394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd9dea-c8c8-4e1d-a77f-41929148751c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/users/aac4d8327d7849ffbe28402bf33a26cc/roles/d0561a51235b4ead8652520c55b211f6/inherited_to_projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:17.289419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd9dea-c8c8-4e1d-a77f-41929148751c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b1a06e70b2f843c4befc2f6d0e692389, user_id=aac4d8327d7849ffbe28402bf33a26cc, role_id=d0561a51235b4ead8652520c55b211f6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:17.292348 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-b0fd9dea-c8c8-4e1d-a77f-41929148751c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:17.292348 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:15:17.292348 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:15:17.296869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd9dea-c8c8-4e1d-a77f-41929148751c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:17.306034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b0fd9dea-c8c8-4e1d-a77f-41929148751c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invalidating the token cache because role d0561a51235b4ead8652520c55b211f6 was removed from user aac4d8327d7849ffbe28402bf33a26cc on project b1a06e70b2f843c4befc2f6d0e692389. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:17.306484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b0fd9dea-c8c8-4e1d-a77f-41929148751c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:17.307426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b0fd9dea-c8c8-4e1d-a77f-41929148751c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:17.354857 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1863/3744] 10.222.0.39 () {58 vars in 1566 bytes} [Sun Oct 16 01:15:17 2022] DELETE /identity/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/users/aac4d8327d7849ffbe28402bf33a26cc/roles/d0561a51235b4ead8652520c55b211f6/inherited_to_projects => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:17.359703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685cd97-b98f-41a0-b5f5-a7a59017a869 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:17.361664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7685cd97-b98f-41a0-b5f5-a7a59017a869 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:17.389607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685cd97-b98f-41a0-b5f5-a7a59017a869 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:17.402679 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:17.572031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aa46d-e2d5-4ef3-b860-340c5b946933 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:17.572693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa46d-e2d5-4ef3-b860-340c5b946933 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:17.572973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa46d-e2d5-4ef3-b860-340c5b946933 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:17.573244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa46d-e2d5-4ef3-b860-340c5b946933 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/roles/d0561a51235b4ead8652520c55b211f6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:17.575715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199aa46d-e2d5-4ef3-b860-340c5b946933 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d0561a51235b4ead8652520c55b211f6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:17.576740 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-199aa46d-e2d5-4ef3-b860-340c5b946933 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:17.576740 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:15:17.576740 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:15:17.587687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199aa46d-e2d5-4ef3-b860-340c5b946933 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:17.727673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-199aa46d-e2d5-4ef3-b860-340c5b946933 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invalidating the token cache because role d0561a51235b4ead8652520c55b211f6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:17.727983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-199aa46d-e2d5-4ef3-b860-340c5b946933 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:17.731540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-199aa46d-e2d5-4ef3-b860-340c5b946933 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:17.740554 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1882/3745] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:17 2022] DELETE /identity/v3/roles/d0561a51235b4ead8652520c55b211f6 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:17.745324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd9dea-c8c8-4e1d-a77f-41929148751c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:17.764612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd9dea-c8c8-4e1d-a77f-41929148751c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:17.996767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9a550-da78-4e38-86c6-2e44e4dc9750 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:17.996767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9a550-da78-4e38-86c6-2e44e4dc9750 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:17.997095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9a550-da78-4e38-86c6-2e44e4dc9750 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:17.997310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9a550-da78-4e38-86c6-2e44e4dc9750 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:17.999769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9a550-da78-4e38-86c6-2e44e4dc9750 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:18.001595 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-f8a9a550-da78-4e38-86c6-2e44e4dc9750 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:18.001595 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:15:18.001595 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:15:18.007015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9a550-da78-4e38-86c6-2e44e4dc9750 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:18.050716 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1864/3746] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:15:17 2022] POST /identity/v3/roles => generated 239 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:18.055340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aa46d-e2d5-4ef3-b860-340c5b946933 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:18.057709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-199aa46d-e2d5-4ef3-b860-340c5b946933 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:18.086165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aa46d-e2d5-4ef3-b860-340c5b946933 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:18.100142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ffc8e-a87c-4b09-bc73-df4ac984c8b8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:18.100835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ffc8e-a87c-4b09-bc73-df4ac984c8b8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:18.101116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ffc8e-a87c-4b09-bc73-df4ac984c8b8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:18.101394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ffc8e-a87c-4b09-bc73-df4ac984c8b8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/0b5a2d1419ea4a2dab31f5a0bd25067d/inherited_to_projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:18.105638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ffc8e-a87c-4b09-bc73-df4ac984c8b8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=03f032541da14a2091bedaca940d6100, group_id=c996d958dfc2425e8977aafd5cd1eebd, role_id=0b5a2d1419ea4a2dab31f5a0bd25067d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:18.117077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ffc8e-a87c-4b09-bc73-df4ac984c8b8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:18.168449 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1883/3747] 10.222.0.39 () {60 vars in 1582 bytes} [Sun Oct 16 01:15:18 2022] PUT /identity/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/0b5a2d1419ea4a2dab31f5a0bd25067d/inherited_to_projects => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:18.172617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9a550-da78-4e38-86c6-2e44e4dc9750 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:18.178746 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:18.188012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9a550-da78-4e38-86c6-2e44e4dc9750 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:18.326029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e100996-f9c8-4aea-a9ca-cc985284b828 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:18.326865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e100996-f9c8-4aea-a9ca-cc985284b828 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:18.327297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e100996-f9c8-4aea-a9ca-cc985284b828 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:18.327707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e100996-f9c8-4aea-a9ca-cc985284b828 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/inherited_to_projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:18.329721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e100996-f9c8-4aea-a9ca-cc985284b828 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=03f032541da14a2091bedaca940d6100, group_id=c996d958dfc2425e8977aafd5cd1eebd)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:18.331045 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-5e100996-f9c8-4aea-a9ca-cc985284b828 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:18.331045 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:15:18.331045 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:15:18.334079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e100996-f9c8-4aea-a9ca-cc985284b828 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:18.352879 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1865/3748] 10.222.0.39 () {58 vars in 1464 bytes} [Sun Oct 16 01:15:18 2022] GET /identity/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/inherited_to_projects => generated 447 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:18.353989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ffc8e-a87c-4b09-bc73-df4ac984c8b8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:18.374685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ffc8e-a87c-4b09-bc73-df4ac984c8b8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:18.403532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd47892-0747-4d3b-8a56-eeebde2f2ac8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:18.404586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47892-0747-4d3b-8a56-eeebde2f2ac8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:18.405109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47892-0747-4d3b-8a56-eeebde2f2ac8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:18.405623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47892-0747-4d3b-8a56-eeebde2f2ac8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/0b5a2d1419ea4a2dab31f5a0bd25067d/inherited_to_projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:18.425335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd47892-0747-4d3b-8a56-eeebde2f2ac8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=03f032541da14a2091bedaca940d6100, group_id=c996d958dfc2425e8977aafd5cd1eebd, role_id=0b5a2d1419ea4a2dab31f5a0bd25067d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:18.435461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd47892-0747-4d3b-8a56-eeebde2f2ac8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:18.447564 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1884/3749] 10.222.0.39 () {58 vars in 1564 bytes} [Sun Oct 16 01:15:18 2022] HEAD /identity/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/0b5a2d1419ea4a2dab31f5a0bd25067d/inherited_to_projects => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:18.451581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e100996-f9c8-4aea-a9ca-cc985284b828 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:18.468874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e100996-f9c8-4aea-a9ca-cc985284b828 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:18.482541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20383319-84fc-4963-8408-fe2d0e57b25d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:18.484668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20383319-84fc-4963-8408-fe2d0e57b25d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:18.484961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20383319-84fc-4963-8408-fe2d0e57b25d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:18.486326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20383319-84fc-4963-8408-fe2d0e57b25d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/0b5a2d1419ea4a2dab31f5a0bd25067d/inherited_to_projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:18.494278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20383319-84fc-4963-8408-fe2d0e57b25d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=03f032541da14a2091bedaca940d6100, group_id=c996d958dfc2425e8977aafd5cd1eebd, role_id=0b5a2d1419ea4a2dab31f5a0bd25067d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:18.505195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20383319-84fc-4963-8408-fe2d0e57b25d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:18.524798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-20383319-84fc-4963-8408-fe2d0e57b25d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invalidating the token cache because role 0b5a2d1419ea4a2dab31f5a0bd25067d was removed from group c996d958dfc2425e8977aafd5cd1eebd on domain 03f032541da14a2091bedaca940d6100. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:18.526505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-20383319-84fc-4963-8408-fe2d0e57b25d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:18.528854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-20383319-84fc-4963-8408-fe2d0e57b25d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:18.569778 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1866/3750] 10.222.0.39 () {58 vars in 1566 bytes} [Sun Oct 16 01:15:18 2022] DELETE /identity/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/groups/c996d958dfc2425e8977aafd5cd1eebd/roles/0b5a2d1419ea4a2dab31f5a0bd25067d/inherited_to_projects => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:18.574209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd47892-0747-4d3b-8a56-eeebde2f2ac8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:18.576345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ddd47892-0747-4d3b-8a56-eeebde2f2ac8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:18.640001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd47892-0747-4d3b-8a56-eeebde2f2ac8 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:18.835073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561ba2b-0a59-41d9-923b-d1e51029f6a6 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:18.835966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561ba2b-0a59-41d9-923b-d1e51029f6a6 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:18.836131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561ba2b-0a59-41d9-923b-d1e51029f6a6 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:18.836414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561ba2b-0a59-41d9-923b-d1e51029f6a6 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/roles/0b5a2d1419ea4a2dab31f5a0bd25067d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:18.839338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561ba2b-0a59-41d9-923b-d1e51029f6a6 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0b5a2d1419ea4a2dab31f5a0bd25067d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:18.847335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561ba2b-0a59-41d9-923b-d1e51029f6a6 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:18.986078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9561ba2b-0a59-41d9-923b-d1e51029f6a6 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invalidating the token cache because role 0b5a2d1419ea4a2dab31f5a0bd25067d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:18.986078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9561ba2b-0a59-41d9-923b-d1e51029f6a6 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:18.992649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9561ba2b-0a59-41d9-923b-d1e51029f6a6 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:19.002988 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1885/3751] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:18 2022] DELETE /identity/v3/roles/0b5a2d1419ea4a2dab31f5a0bd25067d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:19.004246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20383319-84fc-4963-8408-fe2d0e57b25d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:19.025988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20383319-84fc-4963-8408-fe2d0e57b25d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:19.289959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8006694-1feb-4ede-94f4-94b473b9b029 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:19.290151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006694-1feb-4ede-94f4-94b473b9b029 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:19.290692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006694-1feb-4ede-94f4-94b473b9b029 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:19.291232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006694-1feb-4ede-94f4-94b473b9b029 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:19.292362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8006694-1feb-4ede-94f4-94b473b9b029 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:19.294191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8006694-1feb-4ede-94f4-94b473b9b029 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:19.329321 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1867/3752] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:15:19 2022] POST /identity/v3/roles => generated 239 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:19.333778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561ba2b-0a59-41d9-923b-d1e51029f6a6 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:19.335389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9561ba2b-0a59-41d9-923b-d1e51029f6a6 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:19.365057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561ba2b-0a59-41d9-923b-d1e51029f6a6 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:19.373462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97fedb-e54f-4028-aef1-b19efdb03484 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:19.375227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97fedb-e54f-4028-aef1-b19efdb03484 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:19.375839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97fedb-e54f-4028-aef1-b19efdb03484 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:19.376274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97fedb-e54f-4028-aef1-b19efdb03484 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/users/aac4d8327d7849ffbe28402bf33a26cc/roles/c49b9c8f94ec45849968e9587eb12996/inherited_to_projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:19.380353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97fedb-e54f-4028-aef1-b19efdb03484 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=03f032541da14a2091bedaca940d6100, user_id=aac4d8327d7849ffbe28402bf33a26cc, role_id=c49b9c8f94ec45849968e9587eb12996)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:19.388000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97fedb-e54f-4028-aef1-b19efdb03484 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:19.474598 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1886/3753] 10.222.0.39 () {60 vars in 1579 bytes} [Sun Oct 16 01:15:19 2022] PUT /identity/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/users/aac4d8327d7849ffbe28402bf33a26cc/roles/c49b9c8f94ec45849968e9587eb12996/inherited_to_projects => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:19.478806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8006694-1feb-4ede-94f4-94b473b9b029 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:19.496568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8006694-1feb-4ede-94f4-94b473b9b029 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:19.695213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233182ff-44f7-4f53-a765-667a479d26cf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:19.696138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233182ff-44f7-4f53-a765-667a479d26cf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:19.696429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233182ff-44f7-4f53-a765-667a479d26cf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:19.696709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233182ff-44f7-4f53-a765-667a479d26cf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/users/aac4d8327d7849ffbe28402bf33a26cc/roles/inherited_to_projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:19.699370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233182ff-44f7-4f53-a765-667a479d26cf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=03f032541da14a2091bedaca940d6100, user_id=aac4d8327d7849ffbe28402bf33a26cc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:19.705671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233182ff-44f7-4f53-a765-667a479d26cf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:19.748220 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1868/3754] 10.222.0.39 () {58 vars in 1461 bytes} [Sun Oct 16 01:15:19 2022] GET /identity/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/users/aac4d8327d7849ffbe28402bf33a26cc/roles/inherited_to_projects => generated 446 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:15:19.750288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97fedb-e54f-4028-aef1-b19efdb03484 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:19.763322 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:19.787700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97fedb-e54f-4028-aef1-b19efdb03484 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:19.813578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8185f8-8843-42d3-b431-7d600f31c892 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:19.818203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8185f8-8843-42d3-b431-7d600f31c892 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:19.818735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8185f8-8843-42d3-b431-7d600f31c892 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:19.819211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8185f8-8843-42d3-b431-7d600f31c892 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/users/aac4d8327d7849ffbe28402bf33a26cc/roles/c49b9c8f94ec45849968e9587eb12996/inherited_to_projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:19.827486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8185f8-8843-42d3-b431-7d600f31c892 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=03f032541da14a2091bedaca940d6100, user_id=aac4d8327d7849ffbe28402bf33a26cc, role_id=c49b9c8f94ec45849968e9587eb12996)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:19.837549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8185f8-8843-42d3-b431-7d600f31c892 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:19.855573 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1887/3755] 10.222.0.39 () {58 vars in 1561 bytes} [Sun Oct 16 01:15:19 2022] HEAD /identity/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/users/aac4d8327d7849ffbe28402bf33a26cc/roles/c49b9c8f94ec45849968e9587eb12996/inherited_to_projects => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:19.859602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233182ff-44f7-4f53-a765-667a479d26cf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:19.865905 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:19.879196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233182ff-44f7-4f53-a765-667a479d26cf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:19.899147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811e98d-98f3-4d1e-a4e0-f09dab73007d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:19.900650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811e98d-98f3-4d1e-a4e0-f09dab73007d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:19.901121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811e98d-98f3-4d1e-a4e0-f09dab73007d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:19.901560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811e98d-98f3-4d1e-a4e0-f09dab73007d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/users/aac4d8327d7849ffbe28402bf33a26cc/roles/c49b9c8f94ec45849968e9587eb12996/inherited_to_projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:19.910576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811e98d-98f3-4d1e-a4e0-f09dab73007d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=03f032541da14a2091bedaca940d6100, user_id=aac4d8327d7849ffbe28402bf33a26cc, role_id=c49b9c8f94ec45849968e9587eb12996)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:19.914710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811e98d-98f3-4d1e-a4e0-f09dab73007d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:19.934202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9811e98d-98f3-4d1e-a4e0-f09dab73007d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invalidating the token cache because role c49b9c8f94ec45849968e9587eb12996 was removed from user aac4d8327d7849ffbe28402bf33a26cc on domain 03f032541da14a2091bedaca940d6100. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:19.936453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9811e98d-98f3-4d1e-a4e0-f09dab73007d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:19.938574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9811e98d-98f3-4d1e-a4e0-f09dab73007d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:19.969957 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1869/3756] 10.222.0.39 () {58 vars in 1563 bytes} [Sun Oct 16 01:15:19 2022] DELETE /identity/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/users/aac4d8327d7849ffbe28402bf33a26cc/roles/c49b9c8f94ec45849968e9587eb12996/inherited_to_projects => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:19.974859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8185f8-8843-42d3-b431-7d600f31c892 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:19.977212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-db8185f8-8843-42d3-b431-7d600f31c892 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:20.003167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8185f8-8843-42d3-b431-7d600f31c892 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:20.161237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac98062-7c36-4085-a2cb-7a18d9ff0569 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:20.162316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac98062-7c36-4085-a2cb-7a18d9ff0569 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:20.167172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac98062-7c36-4085-a2cb-7a18d9ff0569 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:20.167620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac98062-7c36-4085-a2cb-7a18d9ff0569 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/roles/c49b9c8f94ec45849968e9587eb12996` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:20.169300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac98062-7c36-4085-a2cb-7a18d9ff0569 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c49b9c8f94ec45849968e9587eb12996)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:20.171215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac98062-7c36-4085-a2cb-7a18d9ff0569 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:20.273697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ac98062-7c36-4085-a2cb-7a18d9ff0569 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invalidating the token cache because role c49b9c8f94ec45849968e9587eb12996 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:20.274431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ac98062-7c36-4085-a2cb-7a18d9ff0569 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:20.278410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ac98062-7c36-4085-a2cb-7a18d9ff0569 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:20.282447 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1888/3757] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:19 2022] DELETE /identity/v3/roles/c49b9c8f94ec45849968e9587eb12996 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:20.288604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811e98d-98f3-4d1e-a4e0-f09dab73007d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:20.319459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811e98d-98f3-4d1e-a4e0-f09dab73007d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:20.609333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3c34-b65c-4d31-bb9d-b239d734d09d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:20.610759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3c34-b65c-4d31-bb9d-b239d734d09d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:20.611245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3c34-b65c-4d31-bb9d-b239d734d09d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:20.611861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3c34-b65c-4d31-bb9d-b239d734d09d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:20.612810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b3c34-b65c-4d31-bb9d-b239d734d09d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:20.616163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b3c34-b65c-4d31-bb9d-b239d734d09d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:20.670040 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1870/3758] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:15:20 2022] POST /identity/v3/roles => generated 240 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:20.673944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac98062-7c36-4085-a2cb-7a18d9ff0569 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:20.676042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3ac98062-7c36-4085-a2cb-7a18d9ff0569 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:20.707418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac98062-7c36-4085-a2cb-7a18d9ff0569 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:20.721155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670bb14-a887-433d-8964-7ec0929bd93b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:20.722478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670bb14-a887-433d-8964-7ec0929bd93b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:20.722899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670bb14-a887-433d-8964-7ec0929bd93b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:20.723627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670bb14-a887-433d-8964-7ec0929bd93b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:20.725501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670bb14-a887-433d-8964-7ec0929bd93b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:20.741856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670bb14-a887-433d-8964-7ec0929bd93b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:20.823020 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1889/3759] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:20 2022] POST /identity/v3/projects => generated 409 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:20.826898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3c34-b65c-4d31-bb9d-b239d734d09d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:20.843237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3c34-b65c-4d31-bb9d-b239d734d09d tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:21.005069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0147c-041a-44ec-8639-92654ef4e064 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:21.005822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0147c-041a-44ec-8639-92654ef4e064 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:21.006223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0147c-041a-44ec-8639-92654ef4e064 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:21.006608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0147c-041a-44ec-8639-92654ef4e064 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/users/aac4d8327d7849ffbe28402bf33a26cc/roles/8c4916256b9443188462bcdf13a10b5b/inherited_to_projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:21.028953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0147c-041a-44ec-8639-92654ef4e064 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=03f032541da14a2091bedaca940d6100, user_id=aac4d8327d7849ffbe28402bf33a26cc, role_id=8c4916256b9443188462bcdf13a10b5b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:21.032843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0147c-041a-44ec-8639-92654ef4e064 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:21.074693 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1871/3760] 10.222.0.39 () {60 vars in 1579 bytes} [Sun Oct 16 01:15:20 2022] PUT /identity/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/users/aac4d8327d7849ffbe28402bf33a26cc/roles/8c4916256b9443188462bcdf13a10b5b/inherited_to_projects => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:21.076065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670bb14-a887-433d-8964-7ec0929bd93b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:21.094101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670bb14-a887-433d-8964-7ec0929bd93b tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:21.239734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5a0a5-8995-4804-8944-8e637f86ef62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:21.240457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5a0a5-8995-4804-8944-8e637f86ef62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:21.240838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5a0a5-8995-4804-8944-8e637f86ef62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:21.241234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5a0a5-8995-4804-8944-8e637f86ef62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:21.242059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5a0a5-8995-4804-8944-8e637f86ef62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Adding query filter params (scope.project.id=b1a06e70b2f843c4befc2f6d0e692389, user.id=aac4d8327d7849ffbe28402bf33a26cc) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:21.242491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5a0a5-8995-4804-8944-8e637f86ef62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:21.243646 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-b4e5a0a5-8995-4804-8944-8e637f86ef62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:21.243646 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:15:21.243646 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:15:21.245182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5a0a5-8995-4804-8944-8e637f86ef62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:21.368868 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:21.424076 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1890/3761] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Oct 16 01:15:21 2022] GET /identity/v3/role_assignments?scope.project.id=b1a06e70b2f843c4befc2f6d0e692389&user.id=aac4d8327d7849ffbe28402bf33a26cc&effective => generated 648 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:21.428601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0147c-041a-44ec-8639-92654ef4e064 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:21.449261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0147c-041a-44ec-8639-92654ef4e064 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:21.464139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a423ee9-5a6c-44ba-9247-091298ba1d04 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:21.467465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a423ee9-5a6c-44ba-9247-091298ba1d04 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:21.470506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a423ee9-5a6c-44ba-9247-091298ba1d04 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:21.470910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a423ee9-5a6c-44ba-9247-091298ba1d04 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:21.473232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a423ee9-5a6c-44ba-9247-091298ba1d04 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Adding query filter params (scope.project.id=c72573bc49f54403853f847b9d9fbbc3, user.id=aac4d8327d7849ffbe28402bf33a26cc) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:21.474318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a423ee9-5a6c-44ba-9247-091298ba1d04 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:21.480686 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-4a423ee9-5a6c-44ba-9247-091298ba1d04 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:21.480686 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:15:21.480686 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:15:21.485240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a423ee9-5a6c-44ba-9247-091298ba1d04 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:21.759384 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1872/3762] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Oct 16 01:15:21 2022] GET /identity/v3/role_assignments?scope.project.id=c72573bc49f54403853f847b9d9fbbc3&user.id=aac4d8327d7849ffbe28402bf33a26cc&effective => generated 648 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:21.763536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5a0a5-8995-4804-8944-8e637f86ef62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:21.782904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5a0a5-8995-4804-8944-8e637f86ef62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:21.801820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3003e47-9478-46e2-baa7-37697ea9ea62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:21.807488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3003e47-9478-46e2-baa7-37697ea9ea62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:21.813936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3003e47-9478-46e2-baa7-37697ea9ea62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:21.816534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3003e47-9478-46e2-baa7-37697ea9ea62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/users/aac4d8327d7849ffbe28402bf33a26cc/roles/8c4916256b9443188462bcdf13a10b5b/inherited_to_projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:21.830586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3003e47-9478-46e2-baa7-37697ea9ea62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=03f032541da14a2091bedaca940d6100, user_id=aac4d8327d7849ffbe28402bf33a26cc, role_id=8c4916256b9443188462bcdf13a10b5b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:21.854356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3003e47-9478-46e2-baa7-37697ea9ea62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:21.886993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3003e47-9478-46e2-baa7-37697ea9ea62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invalidating the token cache because role 8c4916256b9443188462bcdf13a10b5b was removed from user aac4d8327d7849ffbe28402bf33a26cc on domain 03f032541da14a2091bedaca940d6100. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:21.888606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3003e47-9478-46e2-baa7-37697ea9ea62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:21.891595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3003e47-9478-46e2-baa7-37697ea9ea62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:21.938332 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1891/3763] 10.222.0.39 () {58 vars in 1563 bytes} [Sun Oct 16 01:15:21 2022] DELETE /identity/v3/OS-INHERIT/domains/03f032541da14a2091bedaca940d6100/users/aac4d8327d7849ffbe28402bf33a26cc/roles/8c4916256b9443188462bcdf13a10b5b/inherited_to_projects => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:21.943310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a423ee9-5a6c-44ba-9247-091298ba1d04 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:21.945422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4a423ee9-5a6c-44ba-9247-091298ba1d04 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:21.982969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a423ee9-5a6c-44ba-9247-091298ba1d04 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:22.046324 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:22.270281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922cc9c-d4f8-426d-a957-977077d7497e tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:22.271247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922cc9c-d4f8-426d-a957-977077d7497e tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:22.271641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922cc9c-d4f8-426d-a957-977077d7497e tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:22.272018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922cc9c-d4f8-426d-a957-977077d7497e tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:22.272935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922cc9c-d4f8-426d-a957-977077d7497e tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Adding query filter params (scope.project.id=b1a06e70b2f843c4befc2f6d0e692389, user.id=aac4d8327d7849ffbe28402bf33a26cc) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:22.274867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922cc9c-d4f8-426d-a957-977077d7497e tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:22.283131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922cc9c-d4f8-426d-a957-977077d7497e tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:22.473848 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1873/3764] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Oct 16 01:15:21 2022] GET /identity/v3/role_assignments?scope.project.id=b1a06e70b2f843c4befc2f6d0e692389&user.id=aac4d8327d7849ffbe28402bf33a26cc&effective => generated 228 bytes in 531 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:22.478267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3003e47-9478-46e2-baa7-37697ea9ea62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:22.503213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3003e47-9478-46e2-baa7-37697ea9ea62 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:22.532640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe8ca2-c570-49b5-8f5c-c689ecce3be0 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:22.534513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe8ca2-c570-49b5-8f5c-c689ecce3be0 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:22.535081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe8ca2-c570-49b5-8f5c-c689ecce3be0 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:22.535423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe8ca2-c570-49b5-8f5c-c689ecce3be0 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:22.536160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe8ca2-c570-49b5-8f5c-c689ecce3be0 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Adding query filter params (scope.project.id=c72573bc49f54403853f847b9d9fbbc3, user.id=aac4d8327d7849ffbe28402bf33a26cc) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:22.536471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe8ca2-c570-49b5-8f5c-c689ecce3be0 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:22.570380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe8ca2-c570-49b5-8f5c-c689ecce3be0 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:22.757519 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1892/3765] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Oct 16 01:15:22 2022] GET /identity/v3/role_assignments?scope.project.id=c72573bc49f54403853f847b9d9fbbc3&user.id=aac4d8327d7849ffbe28402bf33a26cc&effective => generated 228 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:22.761359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922cc9c-d4f8-426d-a957-977077d7497e tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:22.786151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922cc9c-d4f8-426d-a957-977077d7497e tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:22.808568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:22.817449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:22.819904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:22.820299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/projects/c72573bc49f54403853f847b9d9fbbc3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:22.822277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c72573bc49f54403853f847b9d9fbbc3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:22.829821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:23.001349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72573bc49f54403853f847b9d9fbbc3', 'request_id': 'req-ea2b79be-b03a-4069-b413-02e5f2f28525'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:23.017711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72573bc49f54403853f847b9d9fbbc3', 'request_id': 'req-ea2b79be-b03a-4069-b413-02e5f2f28525'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:23.035864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72573bc49f54403853f847b9d9fbbc3', 'request_id': 'req-ea2b79be-b03a-4069-b413-02e5f2f28525'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:23.056920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] The token cache is being invalidate because project c72573bc49f54403853f847b9d9fbbc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:23.057372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:23.058844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:23.064547 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1874/3766] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:22 2022] DELETE /identity/v3/projects/c72573bc49f54403853f847b9d9fbbc3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:23.066678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe8ca2-c570-49b5-8f5c-c689ecce3be0 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:23.071081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-84fe8ca2-c570-49b5-8f5c-c689ecce3be0 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:23.121098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe8ca2-c570-49b5-8f5c-c689ecce3be0 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:23.415394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a7a5e-d3e1-4d59-aae8-e689d55d42fb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:23.416070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7a5e-d3e1-4d59-aae8-e689d55d42fb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:23.416343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7a5e-d3e1-4d59-aae8-e689d55d42fb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:23.416622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7a5e-d3e1-4d59-aae8-e689d55d42fb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/roles/8c4916256b9443188462bcdf13a10b5b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:23.422260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a7a5e-d3e1-4d59-aae8-e689d55d42fb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8c4916256b9443188462bcdf13a10b5b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:23.446439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a7a5e-d3e1-4d59-aae8-e689d55d42fb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:23.539046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:23.578442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:23.714104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-479a7a5e-d3e1-4d59-aae8-e689d55d42fb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invalidating the token cache because role 8c4916256b9443188462bcdf13a10b5b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:23.714461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-479a7a5e-d3e1-4d59-aae8-e689d55d42fb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:23.719463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-479a7a5e-d3e1-4d59-aae8-e689d55d42fb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:23.723350 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1893/3767] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:23 2022] DELETE /identity/v3/roles/8c4916256b9443188462bcdf13a10b5b => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:23.728947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a7a5e-d3e1-4d59-aae8-e689d55d42fb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:23.736472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-479a7a5e-d3e1-4d59-aae8-e689d55d42fb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:23.874611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b79be-b03a-4069-b413-02e5f2f28525 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:23.904786 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:23.907874 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:23.954539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a7a5e-d3e1-4d59-aae8-e689d55d42fb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:23.972746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c61a29-d8db-4aa6-97bb-3a05bf7eb277 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:23.973509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c61a29-d8db-4aa6-97bb-3a05bf7eb277 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:23.973850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c61a29-d8db-4aa6-97bb-3a05bf7eb277 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:23.975127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c61a29-d8db-4aa6-97bb-3a05bf7eb277 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:23.977468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c61a29-d8db-4aa6-97bb-3a05bf7eb277 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:23.978831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108565c-7fb0-47f3-9ce3-6747f9a71b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:23.979777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108565c-7fb0-47f3-9ce3-6747f9a71b87 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:23.980308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108565c-7fb0-47f3-9ce3-6747f9a71b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:23.980720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108565c-7fb0-47f3-9ce3-6747f9a71b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:23.983100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c61a29-d8db-4aa6-97bb-3a05bf7eb277 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:23.986333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a108565c-7fb0-47f3-9ce3-6747f9a71b87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:24.017307 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1894/3768] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:15:23 2022] POST /identity/v3/roles => generated 240 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:24.022046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c61a29-d8db-4aa6-97bb-3a05bf7eb277 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:24.026979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108565c-7fb0-47f3-9ce3-6747f9a71b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:24.032128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108565c-7fb0-47f3-9ce3-6747f9a71b87 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:24.045036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c61a29-d8db-4aa6-97bb-3a05bf7eb277 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:24.057270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60aa22-5991-4268-bdaf-ec4c5a88c61a tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:24.057889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60aa22-5991-4268-bdaf-ec4c5a88c61a tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:24.058165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60aa22-5991-4268-bdaf-ec4c5a88c61a tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:24.058438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60aa22-5991-4268-bdaf-ec4c5a88c61a tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:24.059106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60aa22-5991-4268-bdaf-ec4c5a88c61a tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:24.065526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60aa22-5991-4268-bdaf-ec4c5a88c61a tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:24.081999 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1875/3769] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:15:24.166474 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1895/3770] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:24 2022] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:24.172404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108565c-7fb0-47f3-9ce3-6747f9a71b87 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:24.204428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108565c-7fb0-47f3-9ce3-6747f9a71b87 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:24.474817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00576737-b30e-47de-8744-3caa8ba0b2f4 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:24.475563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00576737-b30e-47de-8744-3caa8ba0b2f4 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:24.475843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00576737-b30e-47de-8744-3caa8ba0b2f4 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:24.476135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00576737-b30e-47de-8744-3caa8ba0b2f4 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/users/aac4d8327d7849ffbe28402bf33a26cc/roles/4dc44275348c4ab6a902425d499505b1/inherited_to_projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:24.479692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00576737-b30e-47de-8744-3caa8ba0b2f4 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b1a06e70b2f843c4befc2f6d0e692389, user_id=aac4d8327d7849ffbe28402bf33a26cc, role_id=4dc44275348c4ab6a902425d499505b1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:24.488481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00576737-b30e-47de-8744-3caa8ba0b2f4 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:24.516474 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1876/3771] 10.222.0.39 () {60 vars in 1582 bytes} [Sun Oct 16 01:15:24 2022] PUT /identity/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/users/aac4d8327d7849ffbe28402bf33a26cc/roles/4dc44275348c4ab6a902425d499505b1/inherited_to_projects => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:24.521598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60aa22-5991-4268-bdaf-ec4c5a88c61a tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:24.542608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60aa22-5991-4268-bdaf-ec4c5a88c61a tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:24.772901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fcf42-fb6d-4522-bd88-1931bf4f7e32 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:24.774448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fcf42-fb6d-4522-bd88-1931bf4f7e32 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:24.774806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fcf42-fb6d-4522-bd88-1931bf4f7e32 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:24.775171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fcf42-fb6d-4522-bd88-1931bf4f7e32 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:24.776639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fcf42-fb6d-4522-bd88-1931bf4f7e32 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Adding query filter params (scope.project.id=dd9409756d3349dbb3a4e5c6524fa8c7, user.id=aac4d8327d7849ffbe28402bf33a26cc) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:24.777024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fcf42-fb6d-4522-bd88-1931bf4f7e32 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:24.781214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fcf42-fb6d-4522-bd88-1931bf4f7e32 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:24.945420 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1896/3772] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Oct 16 01:15:24 2022] GET /identity/v3/role_assignments?scope.project.id=dd9409756d3349dbb3a4e5c6524fa8c7&user.id=aac4d8327d7849ffbe28402bf33a26cc&effective => generated 649 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:24.949144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00576737-b30e-47de-8744-3caa8ba0b2f4 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:24.972547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00576737-b30e-47de-8744-3caa8ba0b2f4 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:24.982044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53c908-3601-4c8a-9089-902d69a2f551 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:24.983193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53c908-3601-4c8a-9089-902d69a2f551 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:24.983907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53c908-3601-4c8a-9089-902d69a2f551 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:24.993182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53c908-3601-4c8a-9089-902d69a2f551 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/users/aac4d8327d7849ffbe28402bf33a26cc/roles/4dc44275348c4ab6a902425d499505b1/inherited_to_projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:24.998610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53c908-3601-4c8a-9089-902d69a2f551 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b1a06e70b2f843c4befc2f6d0e692389, user_id=aac4d8327d7849ffbe28402bf33a26cc, role_id=4dc44275348c4ab6a902425d499505b1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:25.001905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53c908-3601-4c8a-9089-902d69a2f551 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:25.022691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2e53c908-3601-4c8a-9089-902d69a2f551 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invalidating the token cache because role 4dc44275348c4ab6a902425d499505b1 was removed from user aac4d8327d7849ffbe28402bf33a26cc on project b1a06e70b2f843c4befc2f6d0e692389. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:25.023453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2e53c908-3601-4c8a-9089-902d69a2f551 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:25.026968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2e53c908-3601-4c8a-9089-902d69a2f551 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:25.092963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fcf42-fb6d-4522-bd88-1931bf4f7e32 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:25.094355 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1877/3773] 10.222.0.39 () {58 vars in 1566 bytes} [Sun Oct 16 01:15:24 2022] DELETE /identity/v3/OS-INHERIT/projects/b1a06e70b2f843c4befc2f6d0e692389/users/aac4d8327d7849ffbe28402bf33a26cc/roles/4dc44275348c4ab6a902425d499505b1/inherited_to_projects => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:25.095543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-036fcf42-fb6d-4522-bd88-1931bf4f7e32 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:25.124965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fcf42-fb6d-4522-bd88-1931bf4f7e32 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:25.283049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4817a9c-4f8c-4b07-bf94-4c6193025065 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:25.285501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4817a9c-4f8c-4b07-bf94-4c6193025065 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:25.285861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4817a9c-4f8c-4b07-bf94-4c6193025065 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:25.286137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4817a9c-4f8c-4b07-bf94-4c6193025065 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:25.286877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4817a9c-4f8c-4b07-bf94-4c6193025065 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Adding query filter params (scope.project.id=dd9409756d3349dbb3a4e5c6524fa8c7, user.id=aac4d8327d7849ffbe28402bf33a26cc) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:25.291374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4817a9c-4f8c-4b07-bf94-4c6193025065 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:25.293281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4817a9c-4f8c-4b07-bf94-4c6193025065 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:25.308848 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:25.422789 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1897/3774] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Oct 16 01:15:25 2022] GET /identity/v3/role_assignments?scope.project.id=dd9409756d3349dbb3a4e5c6524fa8c7&user.id=aac4d8327d7849ffbe28402bf33a26cc&effective => generated 228 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:15:25.424373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53c908-3601-4c8a-9089-902d69a2f551 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:25.442795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53c908-3601-4c8a-9089-902d69a2f551 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:25.470769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:25.471736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:25.472066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:25.472523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/projects/dd9409756d3349dbb3a4e5c6524fa8c7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:25.477417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd9409756d3349dbb3a4e5c6524fa8c7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:25.489800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:25.683367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9409756d3349dbb3a4e5c6524fa8c7', 'request_id': 'req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:25.708967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9409756d3349dbb3a4e5c6524fa8c7', 'request_id': 'req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:25.733656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9409756d3349dbb3a4e5c6524fa8c7', 'request_id': 'req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:25.761603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] The token cache is being invalidate because project dd9409756d3349dbb3a4e5c6524fa8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:25.761948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:25.764629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:25.766637 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1878/3775] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:25 2022] DELETE /identity/v3/projects/dd9409756d3349dbb3a4e5c6524fa8c7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:25.770900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4817a9c-4f8c-4b07-bf94-4c6193025065 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:25.772774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b4817a9c-4f8c-4b07-bf94-4c6193025065 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:25.824671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4817a9c-4f8c-4b07-bf94-4c6193025065 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:26.099894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a918831-07e8-4b31-9311-64c58ca7dd8f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:26.104087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a918831-07e8-4b31-9311-64c58ca7dd8f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:26.104621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a918831-07e8-4b31-9311-64c58ca7dd8f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:26.104742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a918831-07e8-4b31-9311-64c58ca7dd8f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/roles/4dc44275348c4ab6a902425d499505b1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:26.117069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a918831-07e8-4b31-9311-64c58ca7dd8f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4dc44275348c4ab6a902425d499505b1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:26.131264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a918831-07e8-4b31-9311-64c58ca7dd8f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:26.264853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a918831-07e8-4b31-9311-64c58ca7dd8f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invalidating the token cache because role 4dc44275348c4ab6a902425d499505b1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:26.267526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a918831-07e8-4b31-9311-64c58ca7dd8f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:26.272903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a918831-07e8-4b31-9311-64c58ca7dd8f tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:26.289747 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1898/3776] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:25 2022] DELETE /identity/v3/roles/4dc44275348c4ab6a902425d499505b1 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:26.294618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:26.312832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ac0df-ece7-4589-8c8b-9ae69e8bf8dd tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:26.387336 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:26.710533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057c96d-b6a7-4cbe-abde-b40ed66dc995 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:26.710944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057c96d-b6a7-4cbe-abde-b40ed66dc995 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:26.711338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057c96d-b6a7-4cbe-abde-b40ed66dc995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:26.740615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:26.745278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:26.745278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:26.745488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/users/aac4d8327d7849ffbe28402bf33a26cc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:26.755883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:delete_user(user_id=aac4d8327d7849ffbe28402bf33a26cc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:26.757884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:26.798387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e057c96d-b6a7-4cbe-abde-b40ed66dc995 None None] MFA Rules not processed for user `d0213371a83f4a85bacc0ecdec5b2535`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:26.811465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e057c96d-b6a7-4cbe-abde-b40ed66dc995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:27.016753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac4d8327d7849ffbe28402bf33a26cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:27.021839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac4d8327d7849ffbe28402bf33a26cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:27.085794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac4d8327d7849ffbe28402bf33a26cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:27.113998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac4d8327d7849ffbe28402bf33a26cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:27.115521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac4d8327d7849ffbe28402bf33a26cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:27.160157 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1899/3777] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:15:27.161627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c3d0-4d27-4810-8f95-b76494584c12 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:27.161912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c3d0-4d27-4810-8f95-b76494584c12 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:27.162184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c3d0-4d27-4810-8f95-b76494584c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:27.200066 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1879/3778] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:26 2022] DELETE /identity/v3/users/aac4d8327d7849ffbe28402bf33a26cc => generated 0 bytes in 903 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:27.202898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:27.218047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:27.295171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a889c3d0-4d27-4810-8f95-b76494584c12 None None] MFA Rules not processed for user `d0213371a83f4a85bacc0ecdec5b2535`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:27.296407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a889c3d0-4d27-4810-8f95-b76494584c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:27.419766 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:27.561837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011710c-c3a2-4345-8820-f0bd8f4b8adb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:27.598971 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1900/3779] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:27.611535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73466910-16f6-4f29-bf4c-786595736222 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:27.613021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73466910-16f6-4f29-bf4c-786595736222 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:27.613482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73466910-16f6-4f29-bf4c-786595736222 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:27.613931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73466910-16f6-4f29-bf4c-786595736222 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/groups/c996d958dfc2425e8977aafd5cd1eebd` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:27.633894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73466910-16f6-4f29-bf4c-786595736222 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c996d958dfc2425e8977aafd5cd1eebd)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:27.635278 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-73466910-16f6-4f29-bf4c-786595736222 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:27.635278 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:15:27.635278 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:15:27.636866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73466910-16f6-4f29-bf4c-786595736222 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:27.773483 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:27.795942 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1880/3780] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:15:27 2022] DELETE /identity/v3/groups/c996d958dfc2425e8977aafd5cd1eebd => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:27.799912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c3d0-4d27-4810-8f95-b76494584c12 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:27.820671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c3d0-4d27-4810-8f95-b76494584c12 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:28.120764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:28.132536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:28.135792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:28.136007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/projects/b1a06e70b2f843c4befc2f6d0e692389` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:28.145760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b1a06e70b2f843c4befc2f6d0e692389)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:28.157561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:28.400704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a06e70b2f843c4befc2f6d0e692389', 'request_id': 'req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:28.418260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a06e70b2f843c4befc2f6d0e692389', 'request_id': 'req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:28.442739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a06e70b2f843c4befc2f6d0e692389', 'request_id': 'req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:28.478509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] The token cache is being invalidate because project b1a06e70b2f843c4befc2f6d0e692389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:28.479180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:28.480153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:28.487639 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1901/3781] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:27 2022] DELETE /identity/v3/projects/b1a06e70b2f843c4befc2f6d0e692389 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:28.491702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73466910-16f6-4f29-bf4c-786595736222 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:28.494041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-73466910-16f6-4f29-bf4c-786595736222 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:28.563679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73466910-16f6-4f29-bf4c-786595736222 tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:28.887904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e85df9-e07a-43ac-9ded-f2621084d5bb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:28.889543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e85df9-e07a-43ac-9ded-f2621084d5bb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:28.892259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e85df9-e07a-43ac-9ded-f2621084d5bb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:28.892954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e85df9-e07a-43ac-9ded-f2621084d5bb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/domains/03f032541da14a2091bedaca940d6100` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:28.900341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e85df9-e07a-43ac-9ded-f2621084d5bb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=03f032541da14a2091bedaca940d6100)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:28.904780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e85df9-e07a-43ac-9ded-f2621084d5bb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:28.992360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b0e85df9-e07a-43ac-9ded-f2621084d5bb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '03f032541da14a2091bedaca940d6100'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:28.995509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b0e85df9-e07a-43ac-9ded-f2621084d5bb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '03f032541da14a2091bedaca940d6100'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.051751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b0e85df9-e07a-43ac-9ded-f2621084d5bb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '03f032541da14a2091bedaca940d6100'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.053403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b0e85df9-e07a-43ac-9ded-f2621084d5bb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '03f032541da14a2091bedaca940d6100'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.063121 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1881/3782] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:15:28 2022] PATCH /identity/v3/domains/03f032541da14a2091bedaca940d6100 => generated 277 bytes in 572 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:29.067554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:29.081480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b0ba4-e644-4ecf-92ab-ec56a3e6adcf tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:29.164340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e85df9-e07a-43ac-9ded-f2621084d5bb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:29.165872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b0e85df9-e07a-43ac-9ded-f2621084d5bb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:29.359306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fee2dab736648a28cf44adf9ffbdbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbcf0862b80744ad9e105a19f21f6623', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:29.360324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:29.360824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:29.361274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] PATH_INFO: `/v3/domains/03f032541da14a2091bedaca940d6100` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:29.386733 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:29.394811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=03f032541da14a2091bedaca940d6100)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:29.399818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:29.473657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '03f032541da14a2091bedaca940d6100'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.524160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '03f032541da14a2091bedaca940d6100'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.547382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e85df9-e07a-43ac-9ded-f2621084d5bb tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:29.582843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30da0e9-4919-4905-8085-0213175d1a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:29.584520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30da0e9-4919-4905-8085-0213175d1a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:29.587172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30da0e9-4919-4905-8085-0213175d1a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:29.587761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30da0e9-4919-4905-8085-0213175d1a2d admin admin] PATH_INFO: `/v3/users/dbae84ec01b641ebb5d51f996d1d7c07` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:29.592925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30da0e9-4919-4905-8085-0213175d1a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbae84ec01b641ebb5d51f996d1d7c07)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:29.598055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30da0e9-4919-4905-8085-0213175d1a2d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:29.641943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f032541da14a2091bedaca940d6100', 'request_id': 'req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.656037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f032541da14a2091bedaca940d6100', 'request_id': 'req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.673973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f032541da14a2091bedaca940d6100', 'request_id': 'req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.702772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] The token cache is being invalidate because project 03f032541da14a2091bedaca940d6100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:29.703103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.703817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.722442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '03f032541da14a2091bedaca940d6100', 'request_id': 'req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.723330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '03f032541da14a2091bedaca940d6100', 'request_id': 'req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.724053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '03f032541da14a2091bedaca940d6100', 'request_id': 'req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.739403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f30da0e9-4919-4905-8085-0213175d1a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbae84ec01b641ebb5d51f996d1d7c07'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.740555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f30da0e9-4919-4905-8085-0213175d1a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbae84ec01b641ebb5d51f996d1d7c07'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.753807 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1902/3783] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:15:29 2022] DELETE /identity/v3/domains/03f032541da14a2091bedaca940d6100 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:29.757687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:29.760959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:29.775817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f30da0e9-4919-4905-8085-0213175d1a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbae84ec01b641ebb5d51f996d1d7c07'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.785584 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:29.796215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f30da0e9-4919-4905-8085-0213175d1a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbae84ec01b641ebb5d51f996d1d7c07'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.797347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f30da0e9-4919-4905-8085-0213175d1a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbae84ec01b641ebb5d51f996d1d7c07'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:29.856684 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1882/3784] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:29 2022] DELETE /identity/v3/users/dbae84ec01b641ebb5d51f996d1d7c07 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:29.861673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f53ef-395c-40df-99aa-aba82cadaf99 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:29.861673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f53ef-395c-40df-99aa-aba82cadaf99 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:29.861673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f53ef-395c-40df-99aa-aba82cadaf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:29.914505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7b4f53ef-395c-40df-99aa-aba82cadaf99 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:29.919250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b4f53ef-395c-40df-99aa-aba82cadaf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:29.964384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd7756-fc0e-4a91-b9aa-cd0111d0a11c tempest-InheritsV3TestJSON-1877788881 tempest-InheritsV3TestJSON-1877788881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:30.107031 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1883/3785] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:30.118823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f53ef-395c-40df-99aa-aba82cadaf99 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:30.121633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b4f53ef-395c-40df-99aa-aba82cadaf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:30.137088 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:30.169957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acf7f5-335e-4917-a590-37b10b919a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:30.170643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acf7f5-335e-4917-a590-37b10b919a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:30.170947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acf7f5-335e-4917-a590-37b10b919a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:30.171225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acf7f5-335e-4917-a590-37b10b919a97 admin admin] PATH_INFO: `/v3/users/cee824de5f004a729325a2f6c6fc2eaa` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:30.172389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acf7f5-335e-4917-a590-37b10b919a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee824de5f004a729325a2f6c6fc2eaa)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:30.174399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acf7f5-335e-4917-a590-37b10b919a97 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:30.271714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d2acf7f5-335e-4917-a590-37b10b919a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee824de5f004a729325a2f6c6fc2eaa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:30.274047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d2acf7f5-335e-4917-a590-37b10b919a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee824de5f004a729325a2f6c6fc2eaa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:30.302501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d2acf7f5-335e-4917-a590-37b10b919a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee824de5f004a729325a2f6c6fc2eaa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:30.321658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d2acf7f5-335e-4917-a590-37b10b919a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee824de5f004a729325a2f6c6fc2eaa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:30.327502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d2acf7f5-335e-4917-a590-37b10b919a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee824de5f004a729325a2f6c6fc2eaa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:30.346862 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1903/3786] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:29 2022] DELETE /identity/v3/users/cee824de5f004a729325a2f6c6fc2eaa => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:15:30.351546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44574-0157-44be-b949-14de15404fe5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:30.351808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44574-0157-44be-b949-14de15404fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:30.352910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44574-0157-44be-b949-14de15404fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:30.463368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f53ef-395c-40df-99aa-aba82cadaf99 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:30.467437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-61d44574-0157-44be-b949-14de15404fe5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:30.469045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-61d44574-0157-44be-b949-14de15404fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:30.654246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba40fa-00f7-46ae-a486-89e806a7c683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:30.654884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba40fa-00f7-46ae-a486-89e806a7c683 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:30.655168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba40fa-00f7-46ae-a486-89e806a7c683 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:30.655442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba40fa-00f7-46ae-a486-89e806a7c683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:30.664610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3cba40fa-00f7-46ae-a486-89e806a7c683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:30.686983 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1904/3787] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:30.688112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d44574-0157-44be-b949-14de15404fe5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:30.689743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-61d44574-0157-44be-b949-14de15404fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:30.705882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba40fa-00f7-46ae-a486-89e806a7c683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:30.707400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba40fa-00f7-46ae-a486-89e806a7c683 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:30.720267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d44574-0157-44be-b949-14de15404fe5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:30.730355 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1884/3788] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:15:30.731198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958bc88-da9f-411f-aca9-161bf1d270b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:30.732241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958bc88-da9f-411f-aca9-161bf1d270b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:30.732383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958bc88-da9f-411f-aca9-161bf1d270b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:30.732588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958bc88-da9f-411f-aca9-161bf1d270b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:30.774301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958bc88-da9f-411f-aca9-161bf1d270b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:30.775784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958bc88-da9f-411f-aca9-161bf1d270b6 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:30.795526 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1905/3789] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:15:31.157431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba40fa-00f7-46ae-a486-89e806a7c683 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:31.159067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3cba40fa-00f7-46ae-a486-89e806a7c683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:31.192230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba40fa-00f7-46ae-a486-89e806a7c683 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:31.219788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:31.220441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:31.220722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:31.221070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] PATH_INFO: `/v3/projects/0d1d988e038040d1bd7d090ff7844380` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:31.227765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1d988e038040d1bd7d090ff7844380)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:31.231920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:31.343738 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:31.395510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1d988e038040d1bd7d090ff7844380', 'request_id': 'req-9363c933-6ed0-4eda-954f-82513926666a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:31.421226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1d988e038040d1bd7d090ff7844380', 'request_id': 'req-9363c933-6ed0-4eda-954f-82513926666a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:31.473991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1d988e038040d1bd7d090ff7844380', 'request_id': 'req-9363c933-6ed0-4eda-954f-82513926666a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:31.519689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] The token cache is being invalidate because project 0d1d988e038040d1bd7d090ff7844380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:31.522811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:31.525980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:31.548431 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1885/3790] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:31 2022] DELETE /identity/v3/projects/0d1d988e038040d1bd7d090ff7844380 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:15:31.550328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2563c-f298-4b6f-a448-e5b456c4855c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:31.550525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2563c-f298-4b6f-a448-e5b456c4855c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:31.551035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2563c-f298-4b6f-a448-e5b456c4855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:31.608122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6ac2563c-f298-4b6f-a448-e5b456c4855c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:31.609629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6ac2563c-f298-4b6f-a448-e5b456c4855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:31.708454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:31.710624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:31.874547 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:31.926697 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1906/3791] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:31.935787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29724-5008-4233-a810-ed0e9fb22762 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:31.936450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29724-5008-4233-a810-ed0e9fb22762 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:31.937192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29724-5008-4233-a810-ed0e9fb22762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:31.941781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363c933-6ed0-4eda-954f-82513926666a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:31.949635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:31.950294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:31.950571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:31.950845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] PATH_INFO: `/v3/projects/2f18c57c283b4136b3e16e0c4d1fbd33` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:31.952554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f18c57c283b4136b3e16e0c4d1fbd33)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:31.961370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:31.982838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-41f29724-5008-4233-a810-ed0e9fb22762 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:31.984352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-41f29724-5008-4233-a810-ed0e9fb22762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:32.009585 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1907/3792] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:32.013778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29724-5008-4233-a810-ed0e9fb22762 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:32.029736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29724-5008-4233-a810-ed0e9fb22762 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:32.043803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22115465-7a0c-408c-8287-64ebc7c56091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:32.044727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22115465-7a0c-408c-8287-64ebc7c56091 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:32.045147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22115465-7a0c-408c-8287-64ebc7c56091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:32.045749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22115465-7a0c-408c-8287-64ebc7c56091 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:32.046720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22115465-7a0c-408c-8287-64ebc7c56091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:32.047214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22115465-7a0c-408c-8287-64ebc7c56091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:32.048994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22115465-7a0c-408c-8287-64ebc7c56091 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:32.077226 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1908/3793] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:15:32.082353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22115465-7a0c-408c-8287-64ebc7c56091 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:32.112792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22115465-7a0c-408c-8287-64ebc7c56091 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:32.124031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219439a-2616-4d9d-a350-a84bd986d374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:32.125078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219439a-2616-4d9d-a350-a84bd986d374 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:32.125632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219439a-2616-4d9d-a350-a84bd986d374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:32.126199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219439a-2616-4d9d-a350-a84bd986d374 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:32.127585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219439a-2616-4d9d-a350-a84bd986d374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:32.130580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219439a-2616-4d9d-a350-a84bd986d374 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:32.199737 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1909/3794] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:32 2022] POST /identity/v3/projects => generated 359 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:15:32.203136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219439a-2616-4d9d-a350-a84bd986d374 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:32.207248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f18c57c283b4136b3e16e0c4d1fbd33', 'request_id': 'req-9ec4ee1f-2a52-4c69-990f-e626a697a488'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:32.222435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f18c57c283b4136b3e16e0c4d1fbd33', 'request_id': 'req-9ec4ee1f-2a52-4c69-990f-e626a697a488'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:32.240000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f18c57c283b4136b3e16e0c4d1fbd33', 'request_id': 'req-9ec4ee1f-2a52-4c69-990f-e626a697a488'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:32.256582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] The token cache is being invalidate because project 2f18c57c283b4136b3e16e0c4d1fbd33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:32.256887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:32.260870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:32.268634 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1886/3795] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:31 2022] DELETE /identity/v3/projects/2f18c57c283b4136b3e16e0c4d1fbd33 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:32.269608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:32.279826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:32.408597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219439a-2616-4d9d-a350-a84bd986d374 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:32.429205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ee1f-2a52-4c69-990f-e626a697a488 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:32.437574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0449beb-8a98-40dd-88f5-35517d8ef2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:32.438227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0449beb-8a98-40dd-88f5-35517d8ef2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:32.438514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0449beb-8a98-40dd-88f5-35517d8ef2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:32.440349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0449beb-8a98-40dd-88f5-35517d8ef2f9 admin admin] PATH_INFO: `/v3/users/6fee2dab736648a28cf44adf9ffbdbb0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:32.443535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0449beb-8a98-40dd-88f5-35517d8ef2f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fee2dab736648a28cf44adf9ffbdbb0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:32.448856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0449beb-8a98-40dd-88f5-35517d8ef2f9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:32.463179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfac87-d799-4bec-8b6b-e4b9feff7102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:32.477761 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:32.480441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfac87-d799-4bec-8b6b-e4b9feff7102 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:32.487484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfac87-d799-4bec-8b6b-e4b9feff7102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:32.488013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfac87-d799-4bec-8b6b-e4b9feff7102 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:32.488802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfac87-d799-4bec-8b6b-e4b9feff7102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:32.523024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfac87-d799-4bec-8b6b-e4b9feff7102 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:32.603459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c0449beb-8a98-40dd-88f5-35517d8ef2f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fee2dab736648a28cf44adf9ffbdbb0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:32.604501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c0449beb-8a98-40dd-88f5-35517d8ef2f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fee2dab736648a28cf44adf9ffbdbb0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:32.632684 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1910/3796] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:15:32 2022] POST /identity/v3/users => generated 280 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:32.639071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfac87-d799-4bec-8b6b-e4b9feff7102 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:32.647604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c0449beb-8a98-40dd-88f5-35517d8ef2f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fee2dab736648a28cf44adf9ffbdbb0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:32.650265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aecfac87-d799-4bec-8b6b-e4b9feff7102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:32.662993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c0449beb-8a98-40dd-88f5-35517d8ef2f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fee2dab736648a28cf44adf9ffbdbb0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:32.667633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c0449beb-8a98-40dd-88f5-35517d8ef2f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fee2dab736648a28cf44adf9ffbdbb0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:32.682552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfac87-d799-4bec-8b6b-e4b9feff7102 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:32.695852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e345d-ba14-4fe8-8b9b-03f425fc51a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:32.696488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e345d-ba14-4fe8-8b9b-03f425fc51a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:32.696836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e345d-ba14-4fe8-8b9b-03f425fc51a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:32.697112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e345d-ba14-4fe8-8b9b-03f425fc51a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:32.699709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e345d-ba14-4fe8-8b9b-03f425fc51a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:32.704486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e345d-ba14-4fe8-8b9b-03f425fc51a1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:32.707092 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1887/3797] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:32 2022] DELETE /identity/v3/users/6fee2dab736648a28cf44adf9ffbdbb0 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:32.737883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0449beb-8a98-40dd-88f5-35517d8ef2f9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:32.738723 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1911/3798] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:32.910743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0449beb-8a98-40dd-88f5-35517d8ef2f9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:32.926654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df753c1-577a-460e-933b-26ec70f0768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:32.927738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df753c1-577a-460e-933b-26ec70f0768e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:32.928230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df753c1-577a-460e-933b-26ec70f0768e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:32.928709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df753c1-577a-460e-933b-26ec70f0768e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:32.929609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df753c1-577a-460e-933b-26ec70f0768e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:32.934809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df753c1-577a-460e-933b-26ec70f0768e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:32.965701 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1888/3799] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:15:32.965871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e345d-ba14-4fe8-8b9b-03f425fc51a1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:33.010793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e345d-ba14-4fe8-8b9b-03f425fc51a1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:33.027909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead2977-fe3c-4ea4-99c7-d0af105fd83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:33.028600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead2977-fe3c-4ea4-99c7-d0af105fd83f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:33.032046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead2977-fe3c-4ea4-99c7-d0af105fd83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:33.036004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead2977-fe3c-4ea4-99c7-d0af105fd83f admin admin] PATH_INFO: `/v3/projects/b273f53385bf4ef5832d45d755e749c0/users/513ff7ce16284c9c8b90c4b3f19c595d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:33.110079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead2977-fe3c-4ea4-99c7-d0af105fd83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b273f53385bf4ef5832d45d755e749c0, user_id=513ff7ce16284c9c8b90c4b3f19c595d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:33.115465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead2977-fe3c-4ea4-99c7-d0af105fd83f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:33.155677 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1912/3800] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:32 2022] PUT /identity/v3/projects/b273f53385bf4ef5832d45d755e749c0/users/513ff7ce16284c9c8b90c4b3f19c595d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:33.166986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a9311-793c-4347-9111-3b8ca10d57ad None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:33.167255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a9311-793c-4347-9111-3b8ca10d57ad None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:33.167636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a9311-793c-4347-9111-3b8ca10d57ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:33.254186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ac7a9311-793c-4347-9111-3b8ca10d57ad None None] MFA Rules not processed for user `513ff7ce16284c9c8b90c4b3f19c595d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:33.255655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ac7a9311-793c-4347-9111-3b8ca10d57ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:33.370775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead2977-fe3c-4ea4-99c7-d0af105fd83f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:33.372638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8ead2977-fe3c-4ea4-99c7-d0af105fd83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:33.460097 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1889/3801] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:33.474731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a9311-793c-4347-9111-3b8ca10d57ad None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:33.476985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ac7a9311-793c-4347-9111-3b8ca10d57ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:33.486397 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:33.514564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead2977-fe3c-4ea4-99c7-d0af105fd83f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:33.529304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a4326-3508-48ff-b067-ff9e0f67aba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:33.530121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a4326-3508-48ff-b067-ff9e0f67aba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:33.530495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a4326-3508-48ff-b067-ff9e0f67aba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:33.530864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a4326-3508-48ff-b067-ff9e0f67aba3 admin admin] PATH_INFO: `/v3/projects/fbcf0862b80744ad9e105a19f21f6623` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:33.536721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a4326-3508-48ff-b067-ff9e0f67aba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbcf0862b80744ad9e105a19f21f6623)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:33.538861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a4326-3508-48ff-b067-ff9e0f67aba3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:33.555760 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:33.615896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a9311-793c-4347-9111-3b8ca10d57ad None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:33.640032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0b4a4326-3508-48ff-b067-ff9e0f67aba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbcf0862b80744ad9e105a19f21f6623', 'request_id': 'req-0b4a4326-3508-48ff-b067-ff9e0f67aba3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:33.657751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0b4a4326-3508-48ff-b067-ff9e0f67aba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbcf0862b80744ad9e105a19f21f6623', 'request_id': 'req-0b4a4326-3508-48ff-b067-ff9e0f67aba3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:33.679619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0b4a4326-3508-48ff-b067-ff9e0f67aba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbcf0862b80744ad9e105a19f21f6623', 'request_id': 'req-0b4a4326-3508-48ff-b067-ff9e0f67aba3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:33.711219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0b4a4326-3508-48ff-b067-ff9e0f67aba3 admin admin] The token cache is being invalidate because project fbcf0862b80744ad9e105a19f21f6623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:33.713450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0b4a4326-3508-48ff-b067-ff9e0f67aba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:33.716884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0b4a4326-3508-48ff-b067-ff9e0f67aba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:33.718980 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1913/3802] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:33 2022] DELETE /identity/v3/projects/fbcf0862b80744ad9e105a19f21f6623 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:15:33.725506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d07f81-91ff-4737-9406-48669f79b957 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:33.725918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d07f81-91ff-4737-9406-48669f79b957 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:33.728318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d07f81-91ff-4737-9406-48669f79b957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:33.762402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b72e8-17a3-4b07-925e-0d0e169d62ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:33.763117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b72e8-17a3-4b07-925e-0d0e169d62ce service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:33.763117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b72e8-17a3-4b07-925e-0d0e169d62ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:33.763638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b72e8-17a3-4b07-925e-0d0e169d62ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:33.766894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4d4b72e8-17a3-4b07-925e-0d0e169d62ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:33.777561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-53d07f81-91ff-4737-9406-48669f79b957 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:33.778948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-53d07f81-91ff-4737-9406-48669f79b957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:33.935717 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1914/3803] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:33.937351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede7737-bf3d-4269-8f88-48555e9707b4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:33.937711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede7737-bf3d-4269-8f88-48555e9707b4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:33.938365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede7737-bf3d-4269-8f88-48555e9707b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:33.947633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b72e8-17a3-4b07-925e-0d0e169d62ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:33.949375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b72e8-17a3-4b07-925e-0d0e169d62ce service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:33.974823 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1890/3804] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:15:33.999658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fede7737-bf3d-4269-8f88-48555e9707b4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:34.001166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fede7737-bf3d-4269-8f88-48555e9707b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:34.029288 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1915/3805] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:34.032229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b72e8-17a3-4b07-925e-0d0e169d62ce service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:34.051558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b72e8-17a3-4b07-925e-0d0e169d62ce service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:34.073772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861cfbe-b633-499b-bf28-3fb57c31bb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:34.074380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861cfbe-b633-499b-bf28-3fb57c31bb9a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:34.074660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861cfbe-b633-499b-bf28-3fb57c31bb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:34.074959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861cfbe-b633-499b-bf28-3fb57c31bb9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:34.075741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861cfbe-b633-499b-bf28-3fb57c31bb9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:34.076053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861cfbe-b633-499b-bf28-3fb57c31bb9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:34.078043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861cfbe-b633-499b-bf28-3fb57c31bb9a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:34.121987 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1891/3806] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:34.122996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede7737-bf3d-4269-8f88-48555e9707b4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:34.134594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede7737-bf3d-4269-8f88-48555e9707b4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:34.149712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bad23-c716-4475-8bb0-1dcb4857865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:34.150340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bad23-c716-4475-8bb0-1dcb4857865c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:34.150619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bad23-c716-4475-8bb0-1dcb4857865c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:34.151428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bad23-c716-4475-8bb0-1dcb4857865c admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:34.152138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bad23-c716-4475-8bb0-1dcb4857865c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:34.154023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bad23-c716-4475-8bb0-1dcb4857865c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:34.251388 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1916/3807] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:34 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:15:34.252757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861cfbe-b633-499b-bf28-3fb57c31bb9a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:34.273923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861cfbe-b633-499b-bf28-3fb57c31bb9a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:34.522373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22ea33-71d0-4cd4-9887-4cd1c826ef5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:34.523025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22ea33-71d0-4cd4-9887-4cd1c826ef5c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:34.523295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22ea33-71d0-4cd4-9887-4cd1c826ef5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:34.523566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22ea33-71d0-4cd4-9887-4cd1c826ef5c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:34.524214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22ea33-71d0-4cd4-9887-4cd1c826ef5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:34.526364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22ea33-71d0-4cd4-9887-4cd1c826ef5c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:34.553416 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:34.590025 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1892/3808] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:15:34 2022] POST /identity/v3/users => generated 284 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:34.596253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bad23-c716-4475-8bb0-1dcb4857865c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:34.622118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bad23-c716-4475-8bb0-1dcb4857865c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:34.645360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad994e-4695-4de7-81a3-673ae36cbf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:34.646972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad994e-4695-4de7-81a3-673ae36cbf1a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:34.649236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad994e-4695-4de7-81a3-673ae36cbf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:34.649582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad994e-4695-4de7-81a3-673ae36cbf1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:34.650275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad994e-4695-4de7-81a3-673ae36cbf1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:34.655279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad994e-4695-4de7-81a3-673ae36cbf1a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:34.702144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22ea33-71d0-4cd4-9887-4cd1c826ef5c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:34.704411 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1917/3809] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:34.721581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22ea33-71d0-4cd4-9887-4cd1c826ef5c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:34.741365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3db62b-27b8-42dd-b624-da3b81bc42a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:34.742181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3db62b-27b8-42dd-b624-da3b81bc42a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:34.744048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3db62b-27b8-42dd-b624-da3b81bc42a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:34.747046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3db62b-27b8-42dd-b624-da3b81bc42a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:34.749444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3db62b-27b8-42dd-b624-da3b81bc42a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:34.755957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3db62b-27b8-42dd-b624-da3b81bc42a8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:34.809722 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1893/3810] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:34.811885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad994e-4695-4de7-81a3-673ae36cbf1a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:34.829205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad994e-4695-4de7-81a3-673ae36cbf1a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:34.842688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5257f5-6c68-4699-b4ec-b1451a3c744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:34.843400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5257f5-6c68-4699-b4ec-b1451a3c744e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:34.843682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5257f5-6c68-4699-b4ec-b1451a3c744e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:34.843958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5257f5-6c68-4699-b4ec-b1451a3c744e admin admin] PATH_INFO: `/v3/projects/2114775f454342118879d7346b33f624/users/c26c84d4c82546498290c2a7ae18f725/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:34.897773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5257f5-6c68-4699-b4ec-b1451a3c744e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2114775f454342118879d7346b33f624, user_id=c26c84d4c82546498290c2a7ae18f725, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:34.900499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5257f5-6c68-4699-b4ec-b1451a3c744e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:34.932278 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1918/3811] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:34 2022] PUT /identity/v3/projects/2114775f454342118879d7346b33f624/users/c26c84d4c82546498290c2a7ae18f725/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:34.943467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1a0e6-ab1f-4980-bf14-866a31ae8470 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:34.943756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1a0e6-ab1f-4980-bf14-866a31ae8470 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:34.944015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1a0e6-ab1f-4980-bf14-866a31ae8470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:35.047883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ffa1a0e6-ab1f-4980-bf14-866a31ae8470 None None] MFA Rules not processed for user `c26c84d4c82546498290c2a7ae18f725`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:35.049197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ffa1a0e6-ab1f-4980-bf14-866a31ae8470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:35.229460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5257f5-6c68-4699-b4ec-b1451a3c744e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:35.230182 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1894/3812] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:35.338976 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:35.385656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5257f5-6c68-4699-b4ec-b1451a3c744e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:35.391521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea4bfd-ef65-4695-91ad-b329f3bb4d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:35.392156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea4bfd-ef65-4695-91ad-b329f3bb4d7e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:35.392423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea4bfd-ef65-4695-91ad-b329f3bb4d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:35.392692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea4bfd-ef65-4695-91ad-b329f3bb4d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:35.393368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea4bfd-ef65-4695-91ad-b329f3bb4d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:35.395373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea4bfd-ef65-4695-91ad-b329f3bb4d7e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:35.458201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1a0e6-ab1f-4980-bf14-866a31ae8470 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:35.470153 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1919/3813] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:35 2022] POST /identity/v3/projects => generated 365 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:35.488381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1a0e6-ab1f-4980-bf14-866a31ae8470 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:35.634810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35338e9e-58d2-421b-a087-0f5f9133f65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:35.635499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35338e9e-58d2-421b-a087-0f5f9133f65b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:35.635771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35338e9e-58d2-421b-a087-0f5f9133f65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:35.636040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35338e9e-58d2-421b-a087-0f5f9133f65b admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:35.636745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35338e9e-58d2-421b-a087-0f5f9133f65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:35.638718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35338e9e-58d2-421b-a087-0f5f9133f65b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:35.688265 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1895/3814] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:15:35 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:35.692277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea4bfd-ef65-4695-91ad-b329f3bb4d7e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:35.708006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea4bfd-ef65-4695-91ad-b329f3bb4d7e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:35.790626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec496a-df2f-4eed-afb6-1b891ef307e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:35.791307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec496a-df2f-4eed-afb6-1b891ef307e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:35.791587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec496a-df2f-4eed-afb6-1b891ef307e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:35.791872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec496a-df2f-4eed-afb6-1b891ef307e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:35.792517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec496a-df2f-4eed-afb6-1b891ef307e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:35.812169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec496a-df2f-4eed-afb6-1b891ef307e0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:35.865802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35338e9e-58d2-421b-a087-0f5f9133f65b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:35.876854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35338e9e-58d2-421b-a087-0f5f9133f65b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:35.878327 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1920/3815] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:35.902480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafbd2d-4122-41bb-8ab8-c8b8f5aa5f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:35.903207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafbd2d-4122-41bb-8ab8-c8b8f5aa5f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:35.903487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafbd2d-4122-41bb-8ab8-c8b8f5aa5f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:35.903758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafbd2d-4122-41bb-8ab8-c8b8f5aa5f83 admin admin] PATH_INFO: `/v3/projects/c5d101362b384b31b918c791ac3dd759/users/bd786e9230bc4296a593ad7909401dba/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:35.957201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafbd2d-4122-41bb-8ab8-c8b8f5aa5f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d101362b384b31b918c791ac3dd759, user_id=bd786e9230bc4296a593ad7909401dba, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:35.964736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafbd2d-4122-41bb-8ab8-c8b8f5aa5f83 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:36.001622 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1896/3816] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:35 2022] PUT /identity/v3/projects/c5d101362b384b31b918c791ac3dd759/users/bd786e9230bc4296a593ad7909401dba/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:36.007517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec496a-df2f-4eed-afb6-1b891ef307e0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:36.021278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec496a-df2f-4eed-afb6-1b891ef307e0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:36.174113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae3b7f-9f07-4b41-9afb-70b92b7f7055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:36.175078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae3b7f-9f07-4b41-9afb-70b92b7f7055 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:36.175361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae3b7f-9f07-4b41-9afb-70b92b7f7055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:36.175630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae3b7f-9f07-4b41-9afb-70b92b7f7055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:36.178524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae3b7f-9f07-4b41-9afb-70b92b7f7055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:36.181534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae3b7f-9f07-4b41-9afb-70b92b7f7055 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:36.207522 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1921/3817] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:36.209084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafbd2d-4122-41bb-8ab8-c8b8f5aa5f83 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:36.222599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafbd2d-4122-41bb-8ab8-c8b8f5aa5f83 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:36.236429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae4541-1825-474a-8f25-3900055f4402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:36.237970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4541-1825-474a-8f25-3900055f4402 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:36.238251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4541-1825-474a-8f25-3900055f4402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:36.238944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4541-1825-474a-8f25-3900055f4402 admin admin] PATH_INFO: `/v3/projects/c5d101362b384b31b918c791ac3dd759/users/bd786e9230bc4296a593ad7909401dba/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:36.242580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae4541-1825-474a-8f25-3900055f4402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d101362b384b31b918c791ac3dd759, user_id=bd786e9230bc4296a593ad7909401dba, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:36.245284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae4541-1825-474a-8f25-3900055f4402 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:36.281902 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1897/3818] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:36 2022] PUT /identity/v3/projects/c5d101362b384b31b918c791ac3dd759/users/bd786e9230bc4296a593ad7909401dba/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:36.283652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bf370-b6a4-4cbe-8fbe-ae89596b55a4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:36.284137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bf370-b6a4-4cbe-8fbe-ae89596b55a4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:36.284478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bf370-b6a4-4cbe-8fbe-ae89596b55a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:36.400262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c16bf370-b6a4-4cbe-8fbe-ae89596b55a4 None None] MFA Rules not processed for user `bd786e9230bc4296a593ad7909401dba`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:36.402203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c16bf370-b6a4-4cbe-8fbe-ae89596b55a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:36.650280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae4541-1825-474a-8f25-3900055f4402 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:36.668870 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1922/3819] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:36.674168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae4541-1825-474a-8f25-3900055f4402 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:36.685501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2400a-d07c-4d41-9a54-8a94e49fcbca tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd786e9230bc4296a593ad7909401dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d101362b384b31b918c791ac3dd759', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:36.686665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2400a-d07c-4d41-9a54-8a94e49fcbca tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:36.691538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2400a-d07c-4d41-9a54-8a94e49fcbca tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:36.692172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2400a-d07c-4d41-9a54-8a94e49fcbca tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:36.693340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2400a-d07c-4d41-9a54-8a94e49fcbca tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:36.695421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2400a-d07c-4d41-9a54-8a94e49fcbca tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:36.733222 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1898/3820] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:15:36 2022] POST /identity/v3/domains => generated 277 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:15:36.737317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bf370-b6a4-4cbe-8fbe-ae89596b55a4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:36.753870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bf370-b6a4-4cbe-8fbe-ae89596b55a4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:36.855545 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:36.926971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852b98b-2de6-4936-bbbb-ba8353da63d5 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd786e9230bc4296a593ad7909401dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d101362b384b31b918c791ac3dd759', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:36.930458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852b98b-2de6-4936-bbbb-ba8353da63d5 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:36.930889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852b98b-2de6-4936-bbbb-ba8353da63d5 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:36.931427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852b98b-2de6-4936-bbbb-ba8353da63d5 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:36.932209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852b98b-2de6-4936-bbbb-ba8353da63d5 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:36.934272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852b98b-2de6-4936-bbbb-ba8353da63d5 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:37.025007 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1923/3821] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:15:36 2022] POST /identity/v3/users => generated 346 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:37.027684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2400a-d07c-4d41-9a54-8a94e49fcbca tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:37.047769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2400a-d07c-4d41-9a54-8a94e49fcbca tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:37.062712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f4f76-8f0a-4b7b-b5e7-a710e081aa98 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd786e9230bc4296a593ad7909401dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d101362b384b31b918c791ac3dd759', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:37.063400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f4f76-8f0a-4b7b-b5e7-a710e081aa98 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:37.063662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f4f76-8f0a-4b7b-b5e7-a710e081aa98 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:37.063923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f4f76-8f0a-4b7b-b5e7-a710e081aa98 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:37.064582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f4f76-8f0a-4b7b-b5e7-a710e081aa98 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:37.071950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f4f76-8f0a-4b7b-b5e7-a710e081aa98 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:37.100184 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:37.150018 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1899/3822] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:15:37 2022] POST /identity/v3/users => generated 323 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:37.155145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852b98b-2de6-4936-bbbb-ba8353da63d5 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:37.170161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852b98b-2de6-4936-bbbb-ba8353da63d5 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:37.193455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ab1a8-d97b-475d-b25d-cac5bfbe62bc tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd786e9230bc4296a593ad7909401dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d101362b384b31b918c791ac3dd759', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:37.200783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ab1a8-d97b-475d-b25d-cac5bfbe62bc tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:37.202315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ab1a8-d97b-475d-b25d-cac5bfbe62bc tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:37.202799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ab1a8-d97b-475d-b25d-cac5bfbe62bc tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] PATH_INFO: `/v3/users/f39631272235470a8309d6f80cde7d22` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:37.276735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ab1a8-d97b-475d-b25d-cac5bfbe62bc tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorizing `identity:get_user(user_id=f39631272235470a8309d6f80cde7d22)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:37.283284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ab1a8-d97b-475d-b25d-cac5bfbe62bc tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:37.297677 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1924/3823] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:15:37 2022] GET /identity/v3/users/f39631272235470a8309d6f80cde7d22 => generated 346 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:37.298955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f4f76-8f0a-4b7b-b5e7-a710e081aa98 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:37.337646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f4f76-8f0a-4b7b-b5e7-a710e081aa98 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:37.398451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c3eec-db74-4578-ab0b-43e5231a0493 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd786e9230bc4296a593ad7909401dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d101362b384b31b918c791ac3dd759', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:37.400307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c3eec-db74-4578-ab0b-43e5231a0493 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:37.400307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c3eec-db74-4578-ab0b-43e5231a0493 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:37.402080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c3eec-db74-4578-ab0b-43e5231a0493 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:37.402892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c3eec-db74-4578-ab0b-43e5231a0493 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Adding query filter params (domain_id=2cd9bdeb24dc40b987143c9b03356b50) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:37.406956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c3eec-db74-4578-ab0b-43e5231a0493 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:37.409361 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-3e8c3eec-db74-4578-ab0b-43e5231a0493 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:37.409361 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:15:37.409361 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:15:37.419928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c3eec-db74-4578-ab0b-43e5231a0493 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:37.492453 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1900/3824] 10.222.0.39 () {58 vars in 1207 bytes} [Sun Oct 16 01:15:37 2022] GET /identity/v3/users?domain_id=2cd9bdeb24dc40b987143c9b03356b50 => generated 483 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:37.493623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ab1a8-d97b-475d-b25d-cac5bfbe62bc tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:37.508886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ab1a8-d97b-475d-b25d-cac5bfbe62bc tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:37.533391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb8af5-3d0a-421d-9b5a-955b1cea4ae3 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd786e9230bc4296a593ad7909401dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d101362b384b31b918c791ac3dd759', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:37.534431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb8af5-3d0a-421d-9b5a-955b1cea4ae3 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:37.534828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb8af5-3d0a-421d-9b5a-955b1cea4ae3 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:37.535209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb8af5-3d0a-421d-9b5a-955b1cea4ae3 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:37.537667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb8af5-3d0a-421d-9b5a-955b1cea4ae3 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:37.538812 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-bedb8af5-3d0a-421d-9b5a-955b1cea4ae3 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:37.538812 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:15:37.538812 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:15:37.544693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb8af5-3d0a-421d-9b5a-955b1cea4ae3 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:37.664211 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1925/3825] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:37 2022] GET /identity/v3/users => generated 8860 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:37.665469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c3eec-db74-4578-ab0b-43e5231a0493 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:37.682703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c3eec-db74-4578-ab0b-43e5231a0493 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:37.697798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622b0d-3c32-4b24-b878-0a55a15078dd tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd786e9230bc4296a593ad7909401dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d101362b384b31b918c791ac3dd759', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:37.698620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622b0d-3c32-4b24-b878-0a55a15078dd tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:37.699150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622b0d-3c32-4b24-b878-0a55a15078dd tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:37.699530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622b0d-3c32-4b24-b878-0a55a15078dd tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:37.701365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39622b0d-3c32-4b24-b878-0a55a15078dd tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Adding query filter params (name=tempest-test_user-597913717) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:37.701775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39622b0d-3c32-4b24-b878-0a55a15078dd tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:37.703931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39622b0d-3c32-4b24-b878-0a55a15078dd tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:37.850890 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1901/3826] 10.222.0.39 () {58 vars in 1187 bytes} [Sun Oct 16 01:15:37 2022] GET /identity/v3/users?name=tempest-test_user-597913717 => generated 473 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:37.852351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb8af5-3d0a-421d-9b5a-955b1cea4ae3 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:37.870122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb8af5-3d0a-421d-9b5a-955b1cea4ae3 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:37.897815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0022ad-7d79-49a7-be20-95546685e14d tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd786e9230bc4296a593ad7909401dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d101362b384b31b918c791ac3dd759', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:37.899457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0022ad-7d79-49a7-be20-95546685e14d tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:37.901418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0022ad-7d79-49a7-be20-95546685e14d tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:37.904756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0022ad-7d79-49a7-be20-95546685e14d tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:37.911851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0022ad-7d79-49a7-be20-95546685e14d tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:37.912819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0022ad-7d79-49a7-be20-95546685e14d tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:37.926483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0022ad-7d79-49a7-be20-95546685e14d tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:38.043222 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1926/3827] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Oct 16 01:15:37 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:38.044488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622b0d-3c32-4b24-b878-0a55a15078dd tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:38.059078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622b0d-3c32-4b24-b878-0a55a15078dd tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:38.083976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6469f8-10ba-4d24-914e-3cff1221e72f tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd786e9230bc4296a593ad7909401dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d101362b384b31b918c791ac3dd759', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:38.084652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6469f8-10ba-4d24-914e-3cff1221e72f tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:38.084932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6469f8-10ba-4d24-914e-3cff1221e72f tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:38.085203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6469f8-10ba-4d24-914e-3cff1221e72f tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] PATH_INFO: `/v3/users/efae909259324495b82c8a77bf6e55eb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:38.140076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6469f8-10ba-4d24-914e-3cff1221e72f tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorizing `identity:delete_user(user_id=efae909259324495b82c8a77bf6e55eb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:38.142255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6469f8-10ba-4d24-914e-3cff1221e72f tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:38.245246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8c6469f8-10ba-4d24-914e-3cff1221e72f tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efae909259324495b82c8a77bf6e55eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:38.249208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8c6469f8-10ba-4d24-914e-3cff1221e72f tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efae909259324495b82c8a77bf6e55eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:38.294149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8c6469f8-10ba-4d24-914e-3cff1221e72f tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efae909259324495b82c8a77bf6e55eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:38.312758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8c6469f8-10ba-4d24-914e-3cff1221e72f tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efae909259324495b82c8a77bf6e55eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:38.313509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8c6469f8-10ba-4d24-914e-3cff1221e72f tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efae909259324495b82c8a77bf6e55eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:38.367855 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1902/3828] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:38 2022] DELETE /identity/v3/users/efae909259324495b82c8a77bf6e55eb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:38.371856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0022ad-7d79-49a7-be20-95546685e14d tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:38.374203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bd0022ad-7d79-49a7-be20-95546685e14d tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:38.410031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0022ad-7d79-49a7-be20-95546685e14d tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:38.566770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd786e9230bc4296a593ad7909401dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d101362b384b31b918c791ac3dd759', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:38.567749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:38.568222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:38.568700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] PATH_INFO: `/v3/users/f39631272235470a8309d6f80cde7d22` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:38.571680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f39631272235470a8309d6f80cde7d22)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:38.573859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:38.679697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39631272235470a8309d6f80cde7d22'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:38.680388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39631272235470a8309d6f80cde7d22'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:38.730128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39631272235470a8309d6f80cde7d22'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:38.745826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39631272235470a8309d6f80cde7d22'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:38.746504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39631272235470a8309d6f80cde7d22'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:38.765044 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:38.788931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6469f8-10ba-4d24-914e-3cff1221e72f tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:38.804599 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1927/3829] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:38 2022] DELETE /identity/v3/users/f39631272235470a8309d6f80cde7d22 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:38.819419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6469f8-10ba-4d24-914e-3cff1221e72f tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:38.967593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afd21c-b15e-4d9b-8027-46b1f04aac91 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd786e9230bc4296a593ad7909401dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d101362b384b31b918c791ac3dd759', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:38.968386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afd21c-b15e-4d9b-8027-46b1f04aac91 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:38.968682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afd21c-b15e-4d9b-8027-46b1f04aac91 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:38.969113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afd21c-b15e-4d9b-8027-46b1f04aac91 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] PATH_INFO: `/v3/domains/2cd9bdeb24dc40b987143c9b03356b50` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:38.975294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afd21c-b15e-4d9b-8027-46b1f04aac91 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2cd9bdeb24dc40b987143c9b03356b50)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:38.976932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afd21c-b15e-4d9b-8027-46b1f04aac91 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:39.022882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-26afd21c-b15e-4d9b-8027-46b1f04aac91 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2cd9bdeb24dc40b987143c9b03356b50'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.026098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-26afd21c-b15e-4d9b-8027-46b1f04aac91 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2cd9bdeb24dc40b987143c9b03356b50'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.047515 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:39.088947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-26afd21c-b15e-4d9b-8027-46b1f04aac91 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2cd9bdeb24dc40b987143c9b03356b50'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.090102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-26afd21c-b15e-4d9b-8027-46b1f04aac91 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2cd9bdeb24dc40b987143c9b03356b50'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.096880 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1903/3830] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:15:38 2022] PATCH /identity/v3/domains/2cd9bdeb24dc40b987143c9b03356b50 => generated 278 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:39.102752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:39.109677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:39.155880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a3b9f-4037-4b42-aa38-2e3d2e53bf84 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:39.302433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd786e9230bc4296a593ad7909401dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d101362b384b31b918c791ac3dd759', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:39.303024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:39.305519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:39.305838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] PATH_INFO: `/v3/domains/2cd9bdeb24dc40b987143c9b03356b50` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:39.314409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afd21c-b15e-4d9b-8027-46b1f04aac91 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:39.316311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-26afd21c-b15e-4d9b-8027-46b1f04aac91 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:39.331273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2cd9bdeb24dc40b987143c9b03356b50)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:39.333004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:39.385151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2cd9bdeb24dc40b987143c9b03356b50'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.407420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2cd9bdeb24dc40b987143c9b03356b50'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.527270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd9bdeb24dc40b987143c9b03356b50', 'request_id': 'req-30ef7f41-35be-4362-8b45-ec60b178e2ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.554146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afd21c-b15e-4d9b-8027-46b1f04aac91 tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:39.561410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd9bdeb24dc40b987143c9b03356b50', 'request_id': 'req-30ef7f41-35be-4362-8b45-ec60b178e2ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.587435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd9bdeb24dc40b987143c9b03356b50', 'request_id': 'req-30ef7f41-35be-4362-8b45-ec60b178e2ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.615066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] The token cache is being invalidate because project 2cd9bdeb24dc40b987143c9b03356b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:39.615717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.618863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.635475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2cd9bdeb24dc40b987143c9b03356b50', 'request_id': 'req-30ef7f41-35be-4362-8b45-ec60b178e2ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.639568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2cd9bdeb24dc40b987143c9b03356b50', 'request_id': 'req-30ef7f41-35be-4362-8b45-ec60b178e2ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.640865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2cd9bdeb24dc40b987143c9b03356b50', 'request_id': 'req-30ef7f41-35be-4362-8b45-ec60b178e2ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:39.665796 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1928/3831] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:15:39 2022] DELETE /identity/v3/domains/2cd9bdeb24dc40b987143c9b03356b50 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:39.670255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:39.678445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:39.775633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3f9ba-2748-4d46-8e43-34d1fd874884 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:39.779470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3f9ba-2748-4d46-8e43-34d1fd874884 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:39.797107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3f9ba-2748-4d46-8e43-34d1fd874884 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:39.807223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3f9ba-2748-4d46-8e43-34d1fd874884 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:39.809357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-faa3f9ba-2748-4d46-8e43-34d1fd874884 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:39.840383 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:39.889802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3f9ba-2748-4d46-8e43-34d1fd874884 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:39.891270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3f9ba-2748-4d46-8e43-34d1fd874884 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:39.933071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef7f41-35be-4362-8b45-ec60b178e2ae tempest-UsersV3TestJSON-931758010 tempest-UsersV3TestJSON-931758010-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:39.944263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:39.945048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:39.945431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:39.945803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] PATH_INFO: `/v3/users/c26c84d4c82546498290c2a7ae18f725` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:39.947105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26c84d4c82546498290c2a7ae18f725)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:39.949392 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1904/3832] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:15:39.951564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:40.068937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26c84d4c82546498290c2a7ae18f725'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:40.070458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26c84d4c82546498290c2a7ae18f725'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:40.107575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26c84d4c82546498290c2a7ae18f725'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:40.125920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26c84d4c82546498290c2a7ae18f725'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:40.126721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26c84d4c82546498290c2a7ae18f725'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:40.154322 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1929/3833] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:39 2022] DELETE /identity/v3/users/c26c84d4c82546498290c2a7ae18f725 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:40.159313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89269116-d7ed-4fae-9758-95ad357a904b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:40.159768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89269116-d7ed-4fae-9758-95ad357a904b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:40.159866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89269116-d7ed-4fae-9758-95ad357a904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:40.218548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-89269116-d7ed-4fae-9758-95ad357a904b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:40.219854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-89269116-d7ed-4fae-9758-95ad357a904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:40.386825 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:UPDATE=1,keystone:SELECT=99 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:40.451585 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1905/3834] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:40.616386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:40.618316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:40.791956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d944a8e-f4dd-4bf3-95c7-28a40e18922b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:40.802547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97ec2-9d3a-412c-9fb8-6dd16de270fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:40.803207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97ec2-9d3a-412c-9fb8-6dd16de270fe service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:40.803487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97ec2-9d3a-412c-9fb8-6dd16de270fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:40.803758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97ec2-9d3a-412c-9fb8-6dd16de270fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:40.834812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f97ec2-9d3a-412c-9fb8-6dd16de270fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:40.836306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f97ec2-9d3a-412c-9fb8-6dd16de270fe service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:40.859490 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1930/3835] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:15:44.263462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89269116-d7ed-4fae-9758-95ad357a904b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:44.265882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-89269116-d7ed-4fae-9758-95ad357a904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:44.285840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89269116-d7ed-4fae-9758-95ad357a904b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:44.292017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:44.293488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:44.294580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:44.295063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] PATH_INFO: `/v3/projects/2114775f454342118879d7346b33f624` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:44.297056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2114775f454342118879d7346b33f624)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:44.301577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:44.369307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2114775f454342118879d7346b33f624', 'request_id': 'req-a57b3353-dc11-4083-af8f-83bc3985dd1d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:44.381878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2114775f454342118879d7346b33f624', 'request_id': 'req-a57b3353-dc11-4083-af8f-83bc3985dd1d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:44.392268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2114775f454342118879d7346b33f624', 'request_id': 'req-a57b3353-dc11-4083-af8f-83bc3985dd1d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:44.412723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] The token cache is being invalidate because project 2114775f454342118879d7346b33f624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:44.414991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:44.414991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:44.415792 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1906/3836] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:44 2022] DELETE /identity/v3/projects/2114775f454342118879d7346b33f624 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:44.419468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97ec2-9d3a-412c-9fb8-6dd16de270fe service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:44.433179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97ec2-9d3a-412c-9fb8-6dd16de270fe service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:44.510813 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:44.520793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df477ac-1cbc-49b9-a52b-a8c91d7f4dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:44.521766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df477ac-1cbc-49b9-a52b-a8c91d7f4dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:44.522558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df477ac-1cbc-49b9-a52b-a8c91d7f4dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:44.525266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df477ac-1cbc-49b9-a52b-a8c91d7f4dbf admin admin] PATH_INFO: `/v3/users/bd786e9230bc4296a593ad7909401dba` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:44.527674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df477ac-1cbc-49b9-a52b-a8c91d7f4dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd786e9230bc4296a593ad7909401dba)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:44.530013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df477ac-1cbc-49b9-a52b-a8c91d7f4dbf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:44.624006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7df477ac-1cbc-49b9-a52b-a8c91d7f4dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd786e9230bc4296a593ad7909401dba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:44.627091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7df477ac-1cbc-49b9-a52b-a8c91d7f4dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd786e9230bc4296a593ad7909401dba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:44.645790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7df477ac-1cbc-49b9-a52b-a8c91d7f4dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd786e9230bc4296a593ad7909401dba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:44.656674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7df477ac-1cbc-49b9-a52b-a8c91d7f4dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd786e9230bc4296a593ad7909401dba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:44.659032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7df477ac-1cbc-49b9-a52b-a8c91d7f4dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd786e9230bc4296a593ad7909401dba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:44.678546 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1931/3837] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:44 2022] DELETE /identity/v3/users/bd786e9230bc4296a593ad7909401dba => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:15:45.941620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:45.943736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:45.994706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b3353-dc11-4083-af8f-83bc3985dd1d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:46.086930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:46.087599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:46.087876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:46.088205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f admin admin] PATH_INFO: `/v3/projects/c5d101362b384b31b918c791ac3dd759` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:46.089443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d101362b384b31b918c791ac3dd759)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:46.091418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:46.197285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d101362b384b31b918c791ac3dd759', 'request_id': 'req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:46.204927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d101362b384b31b918c791ac3dd759', 'request_id': 'req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:46.220792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d101362b384b31b918c791ac3dd759', 'request_id': 'req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:46.238870 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:46.259353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f admin admin] The token cache is being invalidate because project c5d101362b384b31b918c791ac3dd759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:46.261609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:46.263266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9fe2eb18-a34a-4b12-97fc-aa499a166f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:46.265715 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1907/3838] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:45 2022] DELETE /identity/v3/projects/c5d101362b384b31b918c791ac3dd759 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:46.271410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9e7bf-3d99-496a-addc-6dcce26d228c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:46.271986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9e7bf-3d99-496a-addc-6dcce26d228c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:46.271986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9e7bf-3d99-496a-addc-6dcce26d228c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:46.301544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cee9e7bf-3d99-496a-addc-6dcce26d228c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:46.303286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cee9e7bf-3d99-496a-addc-6dcce26d228c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:46.394026 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1932/3839] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:46.401613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc671849-34e5-4e3e-97f8-f93474afa62d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:46.402127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc671849-34e5-4e3e-97f8-f93474afa62d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:46.402591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc671849-34e5-4e3e-97f8-f93474afa62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:46.431846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cc671849-34e5-4e3e-97f8-f93474afa62d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:46.433708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cc671849-34e5-4e3e-97f8-f93474afa62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:46.446849 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1908/3840] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:15:46.451124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9e7bf-3d99-496a-addc-6dcce26d228c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:46.468394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9e7bf-3d99-496a-addc-6dcce26d228c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:46.477402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2c239-8667-4c4e-934b-a786b268f63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:46.478313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2c239-8667-4c4e-934b-a786b268f63b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:46.478812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2c239-8667-4c4e-934b-a786b268f63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:46.479332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2c239-8667-4c4e-934b-a786b268f63b admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:46.480327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2c239-8667-4c4e-934b-a786b268f63b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:46.480823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2c239-8667-4c4e-934b-a786b268f63b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:46.483469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2c239-8667-4c4e-934b-a786b268f63b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:46.500935 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1933/3841] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:46.505870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc671849-34e5-4e3e-97f8-f93474afa62d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:46.521750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc671849-34e5-4e3e-97f8-f93474afa62d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:46.532915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc87a2d-988e-4e8b-93f0-ef1e4a2638bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:46.538106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc87a2d-988e-4e8b-93f0-ef1e4a2638bf admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:46.538404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc87a2d-988e-4e8b-93f0-ef1e4a2638bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:46.538697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc87a2d-988e-4e8b-93f0-ef1e4a2638bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:46.539548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc87a2d-988e-4e8b-93f0-ef1e4a2638bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:46.541716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc87a2d-988e-4e8b-93f0-ef1e4a2638bf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:46.597824 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1909/3842] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:46 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:46.602829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2c239-8667-4c4e-934b-a786b268f63b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:46.617978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2c239-8667-4c4e-934b-a786b268f63b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:46.722231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cd3ce-eb35-4b6e-8d51-957ce7d51003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:46.723701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cd3ce-eb35-4b6e-8d51-957ce7d51003 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:46.726682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cd3ce-eb35-4b6e-8d51-957ce7d51003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:46.727835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cd3ce-eb35-4b6e-8d51-957ce7d51003 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:46.729309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cd3ce-eb35-4b6e-8d51-957ce7d51003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:46.733070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cd3ce-eb35-4b6e-8d51-957ce7d51003 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:46.758212 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:46.802176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc87a2d-988e-4e8b-93f0-ef1e4a2638bf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:46.807691 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1934/3843] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:15:46 2022] POST /identity/v3/users => generated 285 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:46.819802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc87a2d-988e-4e8b-93f0-ef1e4a2638bf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:46.828957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c51e7-9e00-467b-9ce7-d142d852d986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:46.829673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c51e7-9e00-467b-9ce7-d142d852d986 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:46.830014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c51e7-9e00-467b-9ce7-d142d852d986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:46.832699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c51e7-9e00-467b-9ce7-d142d852d986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:46.836344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c51e7-9e00-467b-9ce7-d142d852d986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:46.838092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c51e7-9e00-467b-9ce7-d142d852d986 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:46.859487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355dc6e-8567-465b-b9bc-65f87589e04b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:46.859953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355dc6e-8567-465b-b9bc-65f87589e04b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:46.860295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355dc6e-8567-465b-b9bc-65f87589e04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:46.861090 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1910/3844] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:15:46.867106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c51e7-9e00-467b-9ce7-d142d852d986 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:46.882163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c51e7-9e00-467b-9ce7-d142d852d986 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:46.899732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dba821-295f-463a-a747-76758cb88599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:46.901122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dba821-295f-463a-a747-76758cb88599 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:46.901271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e355dc6e-8567-465b-b9bc-65f87589e04b None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:46.902088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dba821-295f-463a-a747-76758cb88599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:46.902741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dba821-295f-463a-a747-76758cb88599 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:46.903711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dba821-295f-463a-a747-76758cb88599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:46.903833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e355dc6e-8567-465b-b9bc-65f87589e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:46.905938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dba821-295f-463a-a747-76758cb88599 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:46.927041 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1911/3845] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:15:46.934507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dba821-295f-463a-a747-76758cb88599 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:46.965536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dba821-295f-463a-a747-76758cb88599 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:46.987299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cd193-257c-4530-922c-6e323bc467cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:46.988489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cd193-257c-4530-922c-6e323bc467cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:46.989010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cd193-257c-4530-922c-6e323bc467cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:46.990055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cd193-257c-4530-922c-6e323bc467cf admin admin] PATH_INFO: `/v3/projects/d7278e39974c4170a445cad87f2e0cde/users/186da211df2a4e3f9e0ea8c0b3db54bd/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:47.004401 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1935/3846] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:15:47.005587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355dc6e-8567-465b-b9bc-65f87589e04b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:47.007232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e355dc6e-8567-465b-b9bc-65f87589e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:47.069374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cd193-257c-4530-922c-6e323bc467cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7278e39974c4170a445cad87f2e0cde, user_id=186da211df2a4e3f9e0ea8c0b3db54bd, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:47.073849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cd193-257c-4530-922c-6e323bc467cf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:47.109414 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1912/3847] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:46 2022] PUT /identity/v3/projects/d7278e39974c4170a445cad87f2e0cde/users/186da211df2a4e3f9e0ea8c0b3db54bd/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:47.120321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6c343-43f9-42f1-95bb-5fef5c01b520 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:47.120510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6c343-43f9-42f1-95bb-5fef5c01b520 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:47.121118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6c343-43f9-42f1-95bb-5fef5c01b520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:47.165354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355dc6e-8567-465b-b9bc-65f87589e04b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:47.184893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f0e6c343-43f9-42f1-95bb-5fef5c01b520 None None] MFA Rules not processed for user `186da211df2a4e3f9e0ea8c0b3db54bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:47.186126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f0e6c343-43f9-42f1-95bb-5fef5c01b520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:47.310240 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1913/3848] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:47.315104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6c343-43f9-42f1-95bb-5fef5c01b520 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:47.326838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20857898-81bc-4118-9eb6-c760fb1d6fcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:47.327499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20857898-81bc-4118-9eb6-c760fb1d6fcc service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:47.327780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20857898-81bc-4118-9eb6-c760fb1d6fcc service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:47.328055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20857898-81bc-4118-9eb6-c760fb1d6fcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:47.441395 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:47.452241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6c343-43f9-42f1-95bb-5fef5c01b520 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:47.469611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cee7d-9ed3-46dd-b3eb-c37758f276ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:47.470543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cee7d-9ed3-46dd-b3eb-c37758f276ea admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:47.471038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cee7d-9ed3-46dd-b3eb-c37758f276ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:47.471487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cee7d-9ed3-46dd-b3eb-c37758f276ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:47.472305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632cee7d-9ed3-46dd-b3eb-c37758f276ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:47.474407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632cee7d-9ed3-46dd-b3eb-c37758f276ea admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:47.496439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20857898-81bc-4118-9eb6-c760fb1d6fcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:47.498156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20857898-81bc-4118-9eb6-c760fb1d6fcc service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:47.517592 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1936/3849] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:15:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:15:47.538722 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:47.565572 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1914/3850] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:47 2022] POST /identity/v3/projects => generated 369 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:47.568208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20857898-81bc-4118-9eb6-c760fb1d6fcc service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:47.590497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20857898-81bc-4118-9eb6-c760fb1d6fcc service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:47.750198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e6c67-146e-44aa-9f15-aa051d46356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:47.751263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e6c67-146e-44aa-9f15-aa051d46356b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:47.751546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e6c67-146e-44aa-9f15-aa051d46356b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:47.751816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e6c67-146e-44aa-9f15-aa051d46356b admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:47.754377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e6c67-146e-44aa-9f15-aa051d46356b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:47.758039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e6c67-146e-44aa-9f15-aa051d46356b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:47.807929 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1937/3851] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:15:47 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:47.812631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cee7d-9ed3-46dd-b3eb-c37758f276ea admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:47.851568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cee7d-9ed3-46dd-b3eb-c37758f276ea admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:47.864161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef47ef7-57bf-4334-b94b-f63e1e1293cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:47.864404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef47ef7-57bf-4334-b94b-f63e1e1293cb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:47.864544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef47ef7-57bf-4334-b94b-f63e1e1293cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:47.864789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef47ef7-57bf-4334-b94b-f63e1e1293cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:47.865442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef47ef7-57bf-4334-b94b-f63e1e1293cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:47.867138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef47ef7-57bf-4334-b94b-f63e1e1293cb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:47.914609 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1915/3852] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:47.919238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e6c67-146e-44aa-9f15-aa051d46356b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:47.955766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e6c67-146e-44aa-9f15-aa051d46356b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:47.976061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b7722-e468-49d8-9533-651528a8bffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:47.979164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b7722-e468-49d8-9533-651528a8bffa admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:47.982315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b7722-e468-49d8-9533-651528a8bffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:47.982836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b7722-e468-49d8-9533-651528a8bffa admin admin] PATH_INFO: `/v3/projects/cacacce70eb6439085474194becb2b90/users/aedb9562634946eeabfe62d8af756b99/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:48.030415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b7722-e468-49d8-9533-651528a8bffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cacacce70eb6439085474194becb2b90, user_id=aedb9562634946eeabfe62d8af756b99, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:48.035047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b7722-e468-49d8-9533-651528a8bffa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:48.093673 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1938/3853] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:47 2022] PUT /identity/v3/projects/cacacce70eb6439085474194becb2b90/users/aedb9562634946eeabfe62d8af756b99/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:48.094235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef47ef7-57bf-4334-b94b-f63e1e1293cb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:48.133172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef47ef7-57bf-4334-b94b-f63e1e1293cb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:48.231640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81ede7-5186-4c75-843e-f74c2f852146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:48.232280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ede7-5186-4c75-843e-f74c2f852146 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:48.232621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ede7-5186-4c75-843e-f74c2f852146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:48.232825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ede7-5186-4c75-843e-f74c2f852146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:48.233769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81ede7-5186-4c75-843e-f74c2f852146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:48.235447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81ede7-5186-4c75-843e-f74c2f852146 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:48.249064 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1916/3854] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:48.253208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b7722-e468-49d8-9533-651528a8bffa admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:48.266628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b7722-e468-49d8-9533-651528a8bffa admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:48.274122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b1d65-d7b4-42ee-bae0-82cd0b3ab56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:48.275301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b1d65-d7b4-42ee-bae0-82cd0b3ab56a admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:48.275686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b1d65-d7b4-42ee-bae0-82cd0b3ab56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:48.276209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b1d65-d7b4-42ee-bae0-82cd0b3ab56a admin admin] PATH_INFO: `/v3/projects/cacacce70eb6439085474194becb2b90/users/aedb9562634946eeabfe62d8af756b99/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:48.278665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b1d65-d7b4-42ee-bae0-82cd0b3ab56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cacacce70eb6439085474194becb2b90, user_id=aedb9562634946eeabfe62d8af756b99, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:48.281868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b1d65-d7b4-42ee-bae0-82cd0b3ab56a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:48.299790 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1939/3855] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:48 2022] PUT /identity/v3/projects/cacacce70eb6439085474194becb2b90/users/aedb9562634946eeabfe62d8af756b99/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:48.311812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b827e7-9f83-407c-9fdb-2edfa1c515c8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:48.312443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b827e7-9f83-407c-9fdb-2edfa1c515c8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:48.313071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b827e7-9f83-407c-9fdb-2edfa1c515c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:48.366564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-58b827e7-9f83-407c-9fdb-2edfa1c515c8 None None] MFA Rules not processed for user `aedb9562634946eeabfe62d8af756b99`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:48.372338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-58b827e7-9f83-407c-9fdb-2edfa1c515c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:48.502515 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1917/3856] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:48.507421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b1d65-d7b4-42ee-bae0-82cd0b3ab56a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:48.521641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b1d65-d7b4-42ee-bae0-82cd0b3ab56a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:48.527868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bffa8-97c3-4267-9124-f84ffe16cfa2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:48.528491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bffa8-97c3-4267-9124-f84ffe16cfa2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:48.528769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bffa8-97c3-4267-9124-f84ffe16cfa2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:48.529040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bffa8-97c3-4267-9124-f84ffe16cfa2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:48.529813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bffa8-97c3-4267-9124-f84ffe16cfa2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:48.531451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bffa8-97c3-4267-9124-f84ffe16cfa2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:48.594396 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1940/3857] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:15:48 2022] POST /identity/v3/services => generated 240 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:48.595737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b827e7-9f83-407c-9fdb-2edfa1c515c8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:48.611273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b827e7-9f83-407c-9fdb-2edfa1c515c8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:48.641309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e9cb3-09da-49d7-b950-cd50d418c633 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:48.642241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e9cb3-09da-49d7-b950-cd50d418c633 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:48.642726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e9cb3-09da-49d7-b950-cd50d418c633 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:48.643240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e9cb3-09da-49d7-b950-cd50d418c633 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services/1a97580eb0624afc84146cdb3c600929` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:48.644040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e9cb3-09da-49d7-b950-cd50d418c633 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1a97580eb0624afc84146cdb3c600929)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:48.646364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e9cb3-09da-49d7-b950-cd50d418c633 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:48.681570 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1918/3858] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:48 2022] DELETE /identity/v3/services/1a97580eb0624afc84146cdb3c600929 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:15:48.686490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bffa8-97c3-4267-9124-f84ffe16cfa2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:48.704301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bffa8-97c3-4267-9124-f84ffe16cfa2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:48.759138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2bbb8-07d8-4760-9a57-9cab4e2223e7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:48.759817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2bbb8-07d8-4760-9a57-9cab4e2223e7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:48.760115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2bbb8-07d8-4760-9a57-9cab4e2223e7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:48.760392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2bbb8-07d8-4760-9a57-9cab4e2223e7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:48.761049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2bbb8-07d8-4760-9a57-9cab4e2223e7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:48.762683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2bbb8-07d8-4760-9a57-9cab4e2223e7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:48.792186 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1941/3859] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:48 2022] POST /identity/v3/services => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:48.796563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e9cb3-09da-49d7-b950-cd50d418c633 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:48.812842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e9cb3-09da-49d7-b950-cd50d418c633 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:48.845489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcc1b6-c411-405c-9406-f99474f98bfa tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:48.846269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcc1b6-c411-405c-9406-f99474f98bfa tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:48.846589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcc1b6-c411-405c-9406-f99474f98bfa tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:48.846895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcc1b6-c411-405c-9406-f99474f98bfa tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services/aae71742a1f64987a0e25d5f2a2d6610` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:48.847569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcc1b6-c411-405c-9406-f99474f98bfa tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:update_service(service_id=aae71742a1f64987a0e25d5f2a2d6610)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:48.848785 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-56dcc1b6-c411-405c-9406-f99474f98bfa tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:48.848785 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:15:48.848785 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:15:48.849667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcc1b6-c411-405c-9406-f99474f98bfa tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:48.882952 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1919/3860] 10.222.0.39 () {60 vars in 1252 bytes} [Sun Oct 16 01:15:48 2022] PATCH /identity/v3/services/aae71742a1f64987a0e25d5f2a2d6610 => generated 282 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:48.886986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2bbb8-07d8-4760-9a57-9cab4e2223e7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:48.899935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2bbb8-07d8-4760-9a57-9cab4e2223e7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:48.920475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4ba13-15e6-446b-aa0a-b6800225ddc3 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:48.921757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4ba13-15e6-446b-aa0a-b6800225ddc3 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:48.922420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4ba13-15e6-446b-aa0a-b6800225ddc3 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:48.922976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4ba13-15e6-446b-aa0a-b6800225ddc3 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services/aae71742a1f64987a0e25d5f2a2d6610` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:48.923789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4ba13-15e6-446b-aa0a-b6800225ddc3 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:get_service(service_id=aae71742a1f64987a0e25d5f2a2d6610)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:48.926828 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-d2d4ba13-15e6-446b-aa0a-b6800225ddc3 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:48.926828 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:15:48.926828 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:15:48.928304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4ba13-15e6-446b-aa0a-b6800225ddc3 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:48.937553 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1942/3861] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:15:48 2022] GET /identity/v3/services/aae71742a1f64987a0e25d5f2a2d6610 => generated 282 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:48.942640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcc1b6-c411-405c-9406-f99474f98bfa tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:48.964668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcc1b6-c411-405c-9406-f99474f98bfa tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:48.978400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3c12e-6731-4621-b264-2edc17e90e05 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:48.979596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3c12e-6731-4621-b264-2edc17e90e05 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:48.980042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3c12e-6731-4621-b264-2edc17e90e05 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:48.980481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3c12e-6731-4621-b264-2edc17e90e05 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services/aae71742a1f64987a0e25d5f2a2d6610` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:48.982007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3c12e-6731-4621-b264-2edc17e90e05 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:delete_service(service_id=aae71742a1f64987a0e25d5f2a2d6610)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:48.983997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3c12e-6731-4621-b264-2edc17e90e05 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:48.992206 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:49.025275 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1920/3862] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:48 2022] DELETE /identity/v3/services/aae71742a1f64987a0e25d5f2a2d6610 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:49.027245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4ba13-15e6-446b-aa0a-b6800225ddc3 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:49.060581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4ba13-15e6-446b-aa0a-b6800225ddc3 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:49.088024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc0d41-fc53-405a-a055-7c4f7245d0bd tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:49.089142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc0d41-fc53-405a-a055-7c4f7245d0bd tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:49.089546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc0d41-fc53-405a-a055-7c4f7245d0bd tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:49.089923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc0d41-fc53-405a-a055-7c4f7245d0bd tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services/aae71742a1f64987a0e25d5f2a2d6610` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:49.090776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc0d41-fc53-405a-a055-7c4f7245d0bd tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:get_service(service_id=aae71742a1f64987a0e25d5f2a2d6610)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:49.092608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc0d41-fc53-405a-a055-7c4f7245d0bd tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b2fc0d41-fc53-405a-a055-7c4f7245d0bd tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Could not find service: aae71742a1f64987a0e25d5f2a2d6610.: keystone.exception.ServiceNotFound: Could not find service: aae71742a1f64987a0e25d5f2a2d6610. Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: aae71742a1f64987a0e25d5f2a2d6610. Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:15:49.105935 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:15:49.107278 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: aae71742a1f64987a0e25d5f2a2d6610. Oct 16 01:15:49.108537 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:15:49.111168 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1943/3863] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:15:49 2022] GET /identity/v3/services/aae71742a1f64987a0e25d5f2a2d6610 => generated 113 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 16 01:15:49.117073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3c12e-6731-4621-b264-2edc17e90e05 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:49.129460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3c12e-6731-4621-b264-2edc17e90e05 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:49.134823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca0368-eaf1-4201-98ac-38e29869d708 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:49.135627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca0368-eaf1-4201-98ac-38e29869d708 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:49.136021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca0368-eaf1-4201-98ac-38e29869d708 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:49.136404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca0368-eaf1-4201-98ac-38e29869d708 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:49.137193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca0368-eaf1-4201-98ac-38e29869d708 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:49.139118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca0368-eaf1-4201-98ac-38e29869d708 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:49.179045 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1921/3864] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:49 2022] POST /identity/v3/services => generated 275 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:49.183613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc0d41-fc53-405a-a055-7c4f7245d0bd tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:49.198998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc0d41-fc53-405a-a055-7c4f7245d0bd tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:49.218762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286d33e-c39d-4316-8689-e13c5aa3f616 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:49.219602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286d33e-c39d-4316-8689-e13c5aa3f616 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:49.219992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286d33e-c39d-4316-8689-e13c5aa3f616 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:49.220376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286d33e-c39d-4316-8689-e13c5aa3f616 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:49.221198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286d33e-c39d-4316-8689-e13c5aa3f616 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:49.223576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286d33e-c39d-4316-8689-e13c5aa3f616 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:49.246607 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:49.260105 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1944/3865] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:49 2022] POST /identity/v3/services => generated 275 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:49.265018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca0368-eaf1-4201-98ac-38e29869d708 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:49.279706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca0368-eaf1-4201-98ac-38e29869d708 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:49.329923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc001e-7e15-4b69-8bdc-f1864ea916b5 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:49.330904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc001e-7e15-4b69-8bdc-f1864ea916b5 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:49.331502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc001e-7e15-4b69-8bdc-f1864ea916b5 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:49.331875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc001e-7e15-4b69-8bdc-f1864ea916b5 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:49.332638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc001e-7e15-4b69-8bdc-f1864ea916b5 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:49.334721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc001e-7e15-4b69-8bdc-f1864ea916b5 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:49.360297 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1922/3866] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:49 2022] POST /identity/v3/services => generated 274 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:49.362240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286d33e-c39d-4316-8689-e13c5aa3f616 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:49.374305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286d33e-c39d-4316-8689-e13c5aa3f616 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:49.396024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703ce02-ee7c-4e9c-b02a-be2491b9a747 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:49.397544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703ce02-ee7c-4e9c-b02a-be2491b9a747 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:49.398061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703ce02-ee7c-4e9c-b02a-be2491b9a747 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:49.398582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703ce02-ee7c-4e9c-b02a-be2491b9a747 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:49.399472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703ce02-ee7c-4e9c-b02a-be2491b9a747 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:49.400964 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-a703ce02-ee7c-4e9c-b02a-be2491b9a747 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:49.400964 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:15:49.400964 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:15:49.402623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703ce02-ee7c-4e9c-b02a-be2491b9a747 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:49.415758 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1945/3867] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Oct 16 01:15:49 2022] GET /identity/v3/services => generated 2979 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:49.416455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc001e-7e15-4b69-8bdc-f1864ea916b5 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:49.430640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc001e-7e15-4b69-8bdc-f1864ea916b5 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:49.436839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b532f8-a00a-4fad-8be1-d28ab49eab3f tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:49.437858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b532f8-a00a-4fad-8be1-d28ab49eab3f tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:49.438301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b532f8-a00a-4fad-8be1-d28ab49eab3f tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:49.438734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b532f8-a00a-4fad-8be1-d28ab49eab3f tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:49.441170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b532f8-a00a-4fad-8be1-d28ab49eab3f tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1924918351) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:49.442261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b532f8-a00a-4fad-8be1-d28ab49eab3f tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:49.443711 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-20b532f8-a00a-4fad-8be1-d28ab49eab3f tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:15:49.443711 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:15:49.443711 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:15:49.445576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b532f8-a00a-4fad-8be1-d28ab49eab3f tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:49.454953 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1923/3868] 10.222.0.39 () {58 vars in 1222 bytes} [Sun Oct 16 01:15:49 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1924918351 => generated 418 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:15:49.458722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703ce02-ee7c-4e9c-b02a-be2491b9a747 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:49.476892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703ce02-ee7c-4e9c-b02a-be2491b9a747 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:49.490448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87a7d4-5d57-41ec-8164-1c71808bdfa1 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:49.495135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87a7d4-5d57-41ec-8164-1c71808bdfa1 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:49.495437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87a7d4-5d57-41ec-8164-1c71808bdfa1 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:49.495798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87a7d4-5d57-41ec-8164-1c71808bdfa1 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:49.496337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87a7d4-5d57-41ec-8164-1c71808bdfa1 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2129059306) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:49.496652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87a7d4-5d57-41ec-8164-1c71808bdfa1 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:49.498288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87a7d4-5d57-41ec-8164-1c71808bdfa1 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:49.514775 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1946/3869] 10.222.0.39 () {58 vars in 1222 bytes} [Sun Oct 16 01:15:49 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2129059306 => generated 418 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:49.519586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b532f8-a00a-4fad-8be1-d28ab49eab3f tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:49.538035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b532f8-a00a-4fad-8be1-d28ab49eab3f tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:49.554458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f7a62-453e-40b9-855e-4fcd3ef8395b tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:49.556215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f7a62-453e-40b9-855e-4fcd3ef8395b tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:49.558671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f7a62-453e-40b9-855e-4fcd3ef8395b tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:49.559985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f7a62-453e-40b9-855e-4fcd3ef8395b tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:49.562646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f7a62-453e-40b9-855e-4fcd3ef8395b tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1545441725) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:49.565491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f7a62-453e-40b9-855e-4fcd3ef8395b tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:49.573931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f7a62-453e-40b9-855e-4fcd3ef8395b tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:49.605943 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1924/3870] 10.222.0.39 () {58 vars in 1222 bytes} [Sun Oct 16 01:15:49 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1545441725 => generated 417 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:49.610443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87a7d4-5d57-41ec-8164-1c71808bdfa1 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:49.621064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87a7d4-5d57-41ec-8164-1c71808bdfa1 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:49.638485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b6c85-5758-48c6-9c8e-8eab92b7b6f2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:49.638485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b6c85-5758-48c6-9c8e-8eab92b7b6f2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:49.638485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b6c85-5758-48c6-9c8e-8eab92b7b6f2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:49.639155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b6c85-5758-48c6-9c8e-8eab92b7b6f2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services/7e0dee0f05504c688835516bdb86542b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:49.639155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b6c85-5758-48c6-9c8e-8eab92b7b6f2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7e0dee0f05504c688835516bdb86542b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:49.650664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b6c85-5758-48c6-9c8e-8eab92b7b6f2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:49.686162 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1947/3871] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:49 2022] DELETE /identity/v3/services/7e0dee0f05504c688835516bdb86542b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:49.691880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f7a62-453e-40b9-855e-4fcd3ef8395b tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:49.746668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f7a62-453e-40b9-855e-4fcd3ef8395b tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:49.824607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bf8ee-7a11-45c5-bc27-ebadf930893d tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:49.825592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bf8ee-7a11-45c5-bc27-ebadf930893d tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:49.826545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bf8ee-7a11-45c5-bc27-ebadf930893d tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:49.827108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bf8ee-7a11-45c5-bc27-ebadf930893d tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services/9ea0dbb7280e415fa0f45851c10bfdfa` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:49.827826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bf8ee-7a11-45c5-bc27-ebadf930893d tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9ea0dbb7280e415fa0f45851c10bfdfa)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:49.829946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bf8ee-7a11-45c5-bc27-ebadf930893d tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:49.883694 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1925/3872] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:49 2022] DELETE /identity/v3/services/9ea0dbb7280e415fa0f45851c10bfdfa => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:49.887771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b6c85-5758-48c6-9c8e-8eab92b7b6f2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:49.906324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b6c85-5758-48c6-9c8e-8eab92b7b6f2 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:49.957902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825248c-f92f-4943-ae11-0fca46e360c7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aedb9562634946eeabfe62d8af756b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacacce70eb6439085474194becb2b90', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:49.959302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825248c-f92f-4943-ae11-0fca46e360c7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:49.959302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825248c-f92f-4943-ae11-0fca46e360c7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:49.959302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825248c-f92f-4943-ae11-0fca46e360c7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] PATH_INFO: `/v3/services/80af560050dd4ae983d340552808138f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:49.960257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825248c-f92f-4943-ae11-0fca46e360c7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorizing `identity:delete_service(service_id=80af560050dd4ae983d340552808138f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:49.961326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825248c-f92f-4943-ae11-0fca46e360c7 tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:50.014693 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1948/3873] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:49 2022] DELETE /identity/v3/services/80af560050dd4ae983d340552808138f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:50.019962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bf8ee-7a11-45c5-bc27-ebadf930893d tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:50.351923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bf8ee-7a11-45c5-bc27-ebadf930893d tempest-ServicesTestJSON-1328599993 tempest-ServicesTestJSON-1328599993-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:50.406743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:50.409062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:50.409541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:50.410183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] PATH_INFO: `/v3/users/186da211df2a4e3f9e0ea8c0b3db54bd` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:50.412013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=186da211df2a4e3f9e0ea8c0b3db54bd)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:50.423733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:50.594452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '186da211df2a4e3f9e0ea8c0b3db54bd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:50.598102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '186da211df2a4e3f9e0ea8c0b3db54bd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:50.602200 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:50.654948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '186da211df2a4e3f9e0ea8c0b3db54bd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:50.696235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '186da211df2a4e3f9e0ea8c0b3db54bd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:50.696891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '186da211df2a4e3f9e0ea8c0b3db54bd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:50.722220 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1926/3874] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:50 2022] DELETE /identity/v3/users/186da211df2a4e3f9e0ea8c0b3db54bd => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:50.726427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490d8e0-2a63-4bbc-9c56-dc095ebf3620 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:50.726966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490d8e0-2a63-4bbc-9c56-dc095ebf3620 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:50.727063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490d8e0-2a63-4bbc-9c56-dc095ebf3620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:50.761061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e490d8e0-2a63-4bbc-9c56-dc095ebf3620 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:50.765035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e490d8e0-2a63-4bbc-9c56-dc095ebf3620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:50.947639 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1949/3875] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:51.019551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:51.021073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:51.093662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490d8e0-2a63-4bbc-9c56-dc095ebf3620 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:51.095445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e490d8e0-2a63-4bbc-9c56-dc095ebf3620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:51.216132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87862b76-cabf-47da-ac16-4a711b732b65 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:51.225526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbfe98-c36a-4775-9c5a-d1c093b3b51d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:51.226160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbfe98-c36a-4775-9c5a-d1c093b3b51d service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:51.226436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbfe98-c36a-4775-9c5a-d1c093b3b51d service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:51.226701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbfe98-c36a-4775-9c5a-d1c093b3b51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:51.243072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbfe98-c36a-4775-9c5a-d1c093b3b51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:51.248359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbfe98-c36a-4775-9c5a-d1c093b3b51d service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:51.255122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490d8e0-2a63-4bbc-9c56-dc095ebf3620 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:51.261509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508b41b-5b66-4f1d-8402-2ac172f68d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:51.262486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508b41b-5b66-4f1d-8402-2ac172f68d32 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:51.263685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508b41b-5b66-4f1d-8402-2ac172f68d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:51.264398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508b41b-5b66-4f1d-8402-2ac172f68d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:51.266512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0508b41b-5b66-4f1d-8402-2ac172f68d32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:51.277346 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1927/3876] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:15:51.345506 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:51.426448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508b41b-5b66-4f1d-8402-2ac172f68d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:51.429016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508b41b-5b66-4f1d-8402-2ac172f68d32 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:51.475456 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1950/3877] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:15:52.665501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbfe98-c36a-4775-9c5a-d1c093b3b51d service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:52.666970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-02dbfe98-c36a-4775-9c5a-d1c093b3b51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:52.701497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbfe98-c36a-4775-9c5a-d1c093b3b51d service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:52.722478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:52.723169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:52.723550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:52.723713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] PATH_INFO: `/v3/projects/d7278e39974c4170a445cad87f2e0cde` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:52.726427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7278e39974c4170a445cad87f2e0cde)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:52.728400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:52.847060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7278e39974c4170a445cad87f2e0cde', 'request_id': 'req-ca2a11e1-8e5b-4984-accf-05e66ab1755d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:52.874241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7278e39974c4170a445cad87f2e0cde', 'request_id': 'req-ca2a11e1-8e5b-4984-accf-05e66ab1755d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:52.916364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7278e39974c4170a445cad87f2e0cde', 'request_id': 'req-ca2a11e1-8e5b-4984-accf-05e66ab1755d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:52.946775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] The token cache is being invalidate because project d7278e39974c4170a445cad87f2e0cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:52.947450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:52.948502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:52.950473 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1928/3878] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:52 2022] DELETE /identity/v3/projects/d7278e39974c4170a445cad87f2e0cde => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:52.954393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508b41b-5b66-4f1d-8402-2ac172f68d32 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:52.968434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508b41b-5b66-4f1d-8402-2ac172f68d32 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:53.055518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:53.056233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:53.056514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:53.056784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] PATH_INFO: `/v3/users/aedb9562634946eeabfe62d8af756b99` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:53.057966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aedb9562634946eeabfe62d8af756b99)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:53.059948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:53.168652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aedb9562634946eeabfe62d8af756b99'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:53.169575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aedb9562634946eeabfe62d8af756b99'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:53.186832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aedb9562634946eeabfe62d8af756b99'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:53.200233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aedb9562634946eeabfe62d8af756b99'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:53.201969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aedb9562634946eeabfe62d8af756b99'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:53.235263 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1951/3879] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:52 2022] DELETE /identity/v3/users/aedb9562634946eeabfe62d8af756b99 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:54.163941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:54.166308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:54.288975 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:54.308789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a11e1-8e5b-4984-accf-05e66ab1755d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:54.401851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3396b2-2511-4161-8759-89173dd9b881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:54.403140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3396b2-2511-4161-8759-89173dd9b881 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:54.403592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3396b2-2511-4161-8759-89173dd9b881 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:54.404125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3396b2-2511-4161-8759-89173dd9b881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:54.415954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ff3396b2-2511-4161-8759-89173dd9b881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:54.443159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3396b2-2511-4161-8759-89173dd9b881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:54.444635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3396b2-2511-4161-8759-89173dd9b881 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:54.464494 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1929/3880] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:15:55.562784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:55.564867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:55.585208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f180b6-bc62-475d-82bd-f87104279207 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:55.586262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f180b6-bc62-475d-82bd-f87104279207 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:55.586700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f180b6-bc62-475d-82bd-f87104279207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:55.610460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c9f180b6-bc62-475d-82bd-f87104279207 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:55.613206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c9f180b6-bc62-475d-82bd-f87104279207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:55.649564 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:55.738103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eb64e-a648-46b8-baa5-57c1d5663a24 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:55.753567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:55.754224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:55.754499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:55.754767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c admin admin] PATH_INFO: `/v3/projects/cacacce70eb6439085474194becb2b90` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:55.759355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cacacce70eb6439085474194becb2b90)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:55.761296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:55.799051 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1930/3881] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:15:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:55.814164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f180b6-bc62-475d-82bd-f87104279207 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:55.818559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c9f180b6-bc62-475d-82bd-f87104279207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:55.886513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cacacce70eb6439085474194becb2b90', 'request_id': 'req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:55.910570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cacacce70eb6439085474194becb2b90', 'request_id': 'req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:55.930411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cacacce70eb6439085474194becb2b90', 'request_id': 'req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:55.954412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c admin admin] The token cache is being invalidate because project cacacce70eb6439085474194becb2b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:55.954713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:55.961703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-04d682cf-0a19-4fa0-8c2f-e1dea891cf1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:55.965847 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1952/3882] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:55 2022] DELETE /identity/v3/projects/cacacce70eb6439085474194becb2b90 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:55.972454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae5976-6332-493e-81a4-d2ade0b1d65f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:55.975153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae5976-6332-493e-81a4-d2ade0b1d65f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:55.975312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f180b6-bc62-475d-82bd-f87104279207 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:55.975763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae5976-6332-493e-81a4-d2ade0b1d65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:56.028413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-00ae5976-6332-493e-81a4-d2ade0b1d65f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:56.030029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-00ae5976-6332-493e-81a4-d2ade0b1d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:56.041801 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:56.120443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8346fd2-fe39-4ac3-b99b-c4a9949e7098 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:56.120443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8346fd2-fe39-4ac3-b99b-c4a9949e7098 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:56.120706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8346fd2-fe39-4ac3-b99b-c4a9949e7098 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:56.121058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8346fd2-fe39-4ac3-b99b-c4a9949e7098 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:56.127463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f8346fd2-fe39-4ac3-b99b-c4a9949e7098 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:56.210570 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1953/3883] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:56.218901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c2327-472f-49a4-9545-fa382959ed70 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:56.219412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c2327-472f-49a4-9545-fa382959ed70 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:56.219871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c2327-472f-49a4-9545-fa382959ed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:56.280926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8346fd2-fe39-4ac3-b99b-c4a9949e7098 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:56.288237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8346fd2-fe39-4ac3-b99b-c4a9949e7098 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:56.288796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-be9c2327-472f-49a4-9545-fa382959ed70 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:56.295225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-be9c2327-472f-49a4-9545-fa382959ed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:56.322816 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1931/3884] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:15:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:15:56.337574 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1954/3885] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:56.341511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8346fd2-fe39-4ac3-b99b-c4a9949e7098 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:56.405356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8346fd2-fe39-4ac3-b99b-c4a9949e7098 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:56.431671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49975a-c571-4f7c-8745-71842c4b7a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:56.432299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49975a-c571-4f7c-8745-71842c4b7a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:56.432580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49975a-c571-4f7c-8745-71842c4b7a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:56.432841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49975a-c571-4f7c-8745-71842c4b7a30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:56.433491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49975a-c571-4f7c-8745-71842c4b7a30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:15:56.433793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49975a-c571-4f7c-8745-71842c4b7a30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:56.435434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49975a-c571-4f7c-8745-71842c4b7a30 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:56.490103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c2327-472f-49a4-9545-fa382959ed70 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:56.491465 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1932/3886] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:15:56.505943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c2327-472f-49a4-9545-fa382959ed70 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:56.521797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e7ed1-01aa-4044-a421-e25126c03cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:56.522427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e7ed1-01aa-4044-a421-e25126c03cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:56.522706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e7ed1-01aa-4044-a421-e25126c03cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:56.523011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e7ed1-01aa-4044-a421-e25126c03cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:56.523698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e7ed1-01aa-4044-a421-e25126c03cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:56.529126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e7ed1-01aa-4044-a421-e25126c03cf0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:56.633757 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1955/3887] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:15:56 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:15:56.644295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49975a-c571-4f7c-8745-71842c4b7a30 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:56.661481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49975a-c571-4f7c-8745-71842c4b7a30 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:56.763949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e7ed1-01aa-4044-a421-e25126c03cf0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:56.768962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-053e7ed1-01aa-4044-a421-e25126c03cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:56.842121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45475c72-740f-4eb2-9799-f655cacefeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:56.843581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45475c72-740f-4eb2-9799-f655cacefeb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:56.843983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45475c72-740f-4eb2-9799-f655cacefeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:56.844496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45475c72-740f-4eb2-9799-f655cacefeb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:56.845275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45475c72-740f-4eb2-9799-f655cacefeb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:56.849708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45475c72-740f-4eb2-9799-f655cacefeb0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:56.904918 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1933/3888] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:15:56 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:15:56.906003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45475c72-740f-4eb2-9799-f655cacefeb0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:56.933278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45475c72-740f-4eb2-9799-f655cacefeb0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:56.935224 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:56.960152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8ff45-fec2-4824-acaa-0c52d9d88a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:56.960898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8ff45-fec2-4824-acaa-0c52d9d88a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:56.964413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8ff45-fec2-4824-acaa-0c52d9d88a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:56.965926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8ff45-fec2-4824-acaa-0c52d9d88a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:56.968216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8ff45-fec2-4824-acaa-0c52d9d88a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:56.980918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8ff45-fec2-4824-acaa-0c52d9d88a20 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:57.036455 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1934/3889] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:57.043663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8ff45-fec2-4824-acaa-0c52d9d88a20 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:57.089981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8ff45-fec2-4824-acaa-0c52d9d88a20 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:57.114261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd25f03-b773-4ecd-831a-1149497cd1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:57.122341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd25f03-b773-4ecd-831a-1149497cd1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:57.124744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd25f03-b773-4ecd-831a-1149497cd1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:57.132731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd25f03-b773-4ecd-831a-1149497cd1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:57.134103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd25f03-b773-4ecd-831a-1149497cd1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:57.143237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e7ed1-01aa-4044-a421-e25126c03cf0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:57.144024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd25f03-b773-4ecd-831a-1149497cd1f2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:57.166837 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1935/3890] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:57.167075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18034169-aac7-4e42-8225-521503ca329a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:57.167075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18034169-aac7-4e42-8225-521503ca329a service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:57.167075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18034169-aac7-4e42-8225-521503ca329a service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:57.167075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18034169-aac7-4e42-8225-521503ca329a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:57.167750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-18034169-aac7-4e42-8225-521503ca329a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:57.167906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd25f03-b773-4ecd-831a-1149497cd1f2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:57.188581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd25f03-b773-4ecd-831a-1149497cd1f2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:57.212235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfd975-5c3b-41ba-8a36-2663002886d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:57.216178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18034169-aac7-4e42-8225-521503ca329a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:57.218762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfd975-5c3b-41ba-8a36-2663002886d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:57.219680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfd975-5c3b-41ba-8a36-2663002886d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:57.219680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfd975-5c3b-41ba-8a36-2663002886d3 admin admin] PATH_INFO: `/v3/projects/a80628f057534f38865c2c74bdf8017f/users/c2513f2064f9444f90a909f341adfa0f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:57.221695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18034169-aac7-4e42-8225-521503ca329a service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:57.262755 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1956/3891] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:15:57.272330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfd975-5c3b-41ba-8a36-2663002886d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80628f057534f38865c2c74bdf8017f, user_id=c2513f2064f9444f90a909f341adfa0f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:57.276726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfd975-5c3b-41ba-8a36-2663002886d3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:57.306578 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1936/3892] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:15:57 2022] PUT /identity/v3/projects/a80628f057534f38865c2c74bdf8017f/users/c2513f2064f9444f90a909f341adfa0f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:57.323683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4588-a4fc-441e-bb40-f8ba4d14be55 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:57.324227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4588-a4fc-441e-bb40-f8ba4d14be55 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:57.324405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4588-a4fc-441e-bb40-f8ba4d14be55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:57.396370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5d7b4588-a4fc-441e-bb40-f8ba4d14be55 None None] MFA Rules not processed for user `c2513f2064f9444f90a909f341adfa0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:57.397554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5d7b4588-a4fc-441e-bb40-f8ba4d14be55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:57.563464 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1957/3893] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:15:57.567978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfd975-5c3b-41ba-8a36-2663002886d3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:57.573877 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:57.583627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfd975-5c3b-41ba-8a36-2663002886d3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:57.598024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1e889-20da-447e-a871-c7e0d206c1f9 tempest-IdentityCatalogTest-1988893523 tempest-IdentityCatalogTest-1988893523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2513f2064f9444f90a909f341adfa0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80628f057534f38865c2c74bdf8017f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:57.598670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1e889-20da-447e-a871-c7e0d206c1f9 tempest-IdentityCatalogTest-1988893523 tempest-IdentityCatalogTest-1988893523-project] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:57.598974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1e889-20da-447e-a871-c7e0d206c1f9 tempest-IdentityCatalogTest-1988893523 tempest-IdentityCatalogTest-1988893523-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:57.599308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1e889-20da-447e-a871-c7e0d206c1f9 tempest-IdentityCatalogTest-1988893523 tempest-IdentityCatalogTest-1988893523-project] PATH_INFO: `/v3/auth/catalog` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:57.599894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1e889-20da-447e-a871-c7e0d206c1f9 tempest-IdentityCatalogTest-1988893523 tempest-IdentityCatalogTest-1988893523-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:57.601129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1e889-20da-447e-a871-c7e0d206c1f9 tempest-IdentityCatalogTest-1988893523 tempest-IdentityCatalogTest-1988893523-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:57.602951 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1937/3894] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:15:57 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:15:57.610469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4588-a4fc-441e-bb40-f8ba4d14be55 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:57.772106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4588-a4fc-441e-bb40-f8ba4d14be55 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:57.800248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670814a-6497-47d5-b0c0-c48a7497e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:57.800951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670814a-6497-47d5-b0c0-c48a7497e664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:57.801591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670814a-6497-47d5-b0c0-c48a7497e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:57.801968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670814a-6497-47d5-b0c0-c48a7497e664 admin admin] PATH_INFO: `/v3/users/c2513f2064f9444f90a909f341adfa0f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:57.803602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670814a-6497-47d5-b0c0-c48a7497e664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2513f2064f9444f90a909f341adfa0f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:57.805654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670814a-6497-47d5-b0c0-c48a7497e664 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:57.881788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1e889-20da-447e-a871-c7e0d206c1f9 tempest-IdentityCatalogTest-1988893523 tempest-IdentityCatalogTest-1988893523-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:57.884974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bfa1e889-20da-447e-a871-c7e0d206c1f9 tempest-IdentityCatalogTest-1988893523 tempest-IdentityCatalogTest-1988893523-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:57.916696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7670814a-6497-47d5-b0c0-c48a7497e664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2513f2064f9444f90a909f341adfa0f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:57.917420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1e889-20da-447e-a871-c7e0d206c1f9 tempest-IdentityCatalogTest-1988893523 tempest-IdentityCatalogTest-1988893523-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:57.917675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7670814a-6497-47d5-b0c0-c48a7497e664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2513f2064f9444f90a909f341adfa0f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:57.919190 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:57.945242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7670814a-6497-47d5-b0c0-c48a7497e664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2513f2064f9444f90a909f341adfa0f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:57.946857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:57.947544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:57.948301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:57.948301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] PATH_INFO: `/v3/users/1cb1f704f82b46bd85d0f117f1686b5d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:57.953302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cb1f704f82b46bd85d0f117f1686b5d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:57.957974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7670814a-6497-47d5-b0c0-c48a7497e664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2513f2064f9444f90a909f341adfa0f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:57.958903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7670814a-6497-47d5-b0c0-c48a7497e664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2513f2064f9444f90a909f341adfa0f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:57.961211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:57.991482 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1958/3895] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:57 2022] DELETE /identity/v3/users/c2513f2064f9444f90a909f341adfa0f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:57.996855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36087b3-ccc7-41fc-993d-57818ac0aa47 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:57.998460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36087b3-ccc7-41fc-993d-57818ac0aa47 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:57.998847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36087b3-ccc7-41fc-993d-57818ac0aa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:58.061230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e36087b3-ccc7-41fc-993d-57818ac0aa47 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:58.064102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e36087b3-ccc7-41fc-993d-57818ac0aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:58.065818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cb1f704f82b46bd85d0f117f1686b5d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:58.067368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cb1f704f82b46bd85d0f117f1686b5d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:58.127870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cb1f704f82b46bd85d0f117f1686b5d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:58.146799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cb1f704f82b46bd85d0f117f1686b5d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:58.147832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cb1f704f82b46bd85d0f117f1686b5d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:58.190498 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1938/3896] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:15:57 2022] DELETE /identity/v3/users/1cb1f704f82b46bd85d0f117f1686b5d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:58.205493 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1959/3897] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:15:58.244009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:58.246557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:58.463091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44c6f2-d2bb-4a21-af79-5d10c7714da0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:58.476911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7ae09-84dd-481e-9df6-b70cb7165d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:58.478897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7ae09-84dd-481e-9df6-b70cb7165d9c service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:58.479797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7ae09-84dd-481e-9df6-b70cb7165d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:58.480086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7ae09-84dd-481e-9df6-b70cb7165d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:58.635539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7ae09-84dd-481e-9df6-b70cb7165d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:58.637191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7ae09-84dd-481e-9df6-b70cb7165d9c service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:58.658753 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1939/3898] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:15:59.532463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36087b3-ccc7-41fc-993d-57818ac0aa47 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:59.536228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e36087b3-ccc7-41fc-993d-57818ac0aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:59.555934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36087b3-ccc7-41fc-993d-57818ac0aa47 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:59.572425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bddf58-e953-4b3c-aa6f-5b2105adc89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:59.573225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bddf58-e953-4b3c-aa6f-5b2105adc89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:59.573596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bddf58-e953-4b3c-aa6f-5b2105adc89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:59.573974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bddf58-e953-4b3c-aa6f-5b2105adc89f admin admin] PATH_INFO: `/v3/projects/82d1c738ddf642ed8febdb236f5bf8f3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:59.575580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bddf58-e953-4b3c-aa6f-5b2105adc89f admin admin] RBAC: Authorizing `identity:delete_project(project_id=82d1c738ddf642ed8febdb236f5bf8f3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:59.582774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bddf58-e953-4b3c-aa6f-5b2105adc89f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:59.709439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20bddf58-e953-4b3c-aa6f-5b2105adc89f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82d1c738ddf642ed8febdb236f5bf8f3', 'request_id': 'req-20bddf58-e953-4b3c-aa6f-5b2105adc89f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:59.738332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20bddf58-e953-4b3c-aa6f-5b2105adc89f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82d1c738ddf642ed8febdb236f5bf8f3', 'request_id': 'req-20bddf58-e953-4b3c-aa6f-5b2105adc89f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:59.785398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20bddf58-e953-4b3c-aa6f-5b2105adc89f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82d1c738ddf642ed8febdb236f5bf8f3', 'request_id': 'req-20bddf58-e953-4b3c-aa6f-5b2105adc89f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:59.826230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20bddf58-e953-4b3c-aa6f-5b2105adc89f admin admin] The token cache is being invalidate because project 82d1c738ddf642ed8febdb236f5bf8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:15:59.826230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20bddf58-e953-4b3c-aa6f-5b2105adc89f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:59.834215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20bddf58-e953-4b3c-aa6f-5b2105adc89f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:15:59.840232 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1960/3899] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:59 2022] DELETE /identity/v3/projects/82d1c738ddf642ed8febdb236f5bf8f3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:15:59.844844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd9365-0f15-4be9-be37-c9236b2c3475 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:59.845364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd9365-0f15-4be9-be37-c9236b2c3475 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:59.845979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd9365-0f15-4be9-be37-c9236b2c3475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:59.922262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b5bd9365-0f15-4be9-be37-c9236b2c3475 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:15:59.932826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b5bd9365-0f15-4be9-be37-c9236b2c3475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:59.997822 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:00.135570 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1940/3900] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:00.145782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fe4d5-3c3b-4afa-a512-c9c2614c8a30 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:00.145782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fe4d5-3c3b-4afa-a512-c9c2614c8a30 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:00.146221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fe4d5-3c3b-4afa-a512-c9c2614c8a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:00.187782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4c2fe4d5-3c3b-4afa-a512-c9c2614c8a30 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:00.193164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4c2fe4d5-3c3b-4afa-a512-c9c2614c8a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:00.217965 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1961/3901] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:00.222702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd9365-0f15-4be9-be37-c9236b2c3475 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:00.235165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd9365-0f15-4be9-be37-c9236b2c3475 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:00.242456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60329736-a443-4ebf-a63f-bdc52dd67b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:00.243372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60329736-a443-4ebf-a63f-bdc52dd67b62 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:00.243759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60329736-a443-4ebf-a63f-bdc52dd67b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:00.244131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60329736-a443-4ebf-a63f-bdc52dd67b62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:00.244877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60329736-a443-4ebf-a63f-bdc52dd67b62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:16:00.245990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60329736-a443-4ebf-a63f-bdc52dd67b62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:00.248153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60329736-a443-4ebf-a63f-bdc52dd67b62 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:00.270154 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1941/3902] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:16:00.275979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fe4d5-3c3b-4afa-a512-c9c2614c8a30 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:00.288382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fe4d5-3c3b-4afa-a512-c9c2614c8a30 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:00.295104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e138d-9a5e-478a-a50e-ee09df2387ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:00.295951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e138d-9a5e-478a-a50e-ee09df2387ab admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:00.296389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e138d-9a5e-478a-a50e-ee09df2387ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:00.296770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e138d-9a5e-478a-a50e-ee09df2387ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:00.297525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e138d-9a5e-478a-a50e-ee09df2387ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:00.302716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e138d-9a5e-478a-a50e-ee09df2387ab admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:00.394015 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1962/3903] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:16:00 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:00.397196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60329736-a443-4ebf-a63f-bdc52dd67b62 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:00.420614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60329736-a443-4ebf-a63f-bdc52dd67b62 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:00.588660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fea785-2cb5-48ea-ba84-2888fbf90fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:00.591609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fea785-2cb5-48ea-ba84-2888fbf90fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:00.592112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fea785-2cb5-48ea-ba84-2888fbf90fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:00.594335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fea785-2cb5-48ea-ba84-2888fbf90fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:00.595139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fea785-2cb5-48ea-ba84-2888fbf90fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:00.598510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fea785-2cb5-48ea-ba84-2888fbf90fd8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:00.641890 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1942/3904] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:16:00 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:16:00.646516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e138d-9a5e-478a-a50e-ee09df2387ab admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:00.664452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e138d-9a5e-478a-a50e-ee09df2387ab admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:00.675911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642e0a7-e2a2-427a-8475-b714a90c86d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:00.675911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642e0a7-e2a2-427a-8475-b714a90c86d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:00.676136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642e0a7-e2a2-427a-8475-b714a90c86d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:00.677988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642e0a7-e2a2-427a-8475-b714a90c86d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:00.678473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642e0a7-e2a2-427a-8475-b714a90c86d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:00.682455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642e0a7-e2a2-427a-8475-b714a90c86d3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:00.710560 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1963/3905] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:00.714375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fea785-2cb5-48ea-ba84-2888fbf90fd8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:00.731008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fea785-2cb5-48ea-ba84-2888fbf90fd8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:00.735748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642e0a7-e2a2-427a-8475-b714a90c86d3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:00.738198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4642e0a7-e2a2-427a-8475-b714a90c86d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:00.747690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd1b78-cd33-49a1-a8e0-d29bfebf42b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:00.748332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd1b78-cd33-49a1-a8e0-d29bfebf42b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:00.748614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd1b78-cd33-49a1-a8e0-d29bfebf42b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:00.748889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd1b78-cd33-49a1-a8e0-d29bfebf42b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:00.755899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd1b78-cd33-49a1-a8e0-d29bfebf42b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:00.758284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd1b78-cd33-49a1-a8e0-d29bfebf42b5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:00.777407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642e0a7-e2a2-427a-8475-b714a90c86d3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:00.788411 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1943/3906] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:00.792939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd1b78-cd33-49a1-a8e0-d29bfebf42b5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:00.804585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:00.805249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:00.805534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:00.805812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a admin admin] PATH_INFO: `/v3/projects/a80628f057534f38865c2c74bdf8017f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:00.815470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80628f057534f38865c2c74bdf8017f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:00.819171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd1b78-cd33-49a1-a8e0-d29bfebf42b5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:00.826739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:00.831416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2a781-95c8-456b-aedc-3ebac2834ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:00.833649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a781-95c8-456b-aedc-3ebac2834ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:00.833937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a781-95c8-456b-aedc-3ebac2834ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:00.834214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a781-95c8-456b-aedc-3ebac2834ab5 admin admin] PATH_INFO: `/v3/projects/16773b3925f648bbade2e6bf967a3fbf/users/f1bfe0b4f344485ab6de52f7b1423118/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:00.837095 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:00.874808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2a781-95c8-456b-aedc-3ebac2834ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16773b3925f648bbade2e6bf967a3fbf, user_id=f1bfe0b4f344485ab6de52f7b1423118, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:00.882957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2a781-95c8-456b-aedc-3ebac2834ab5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:00.942330 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1944/3907] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:16:00 2022] PUT /identity/v3/projects/16773b3925f648bbade2e6bf967a3fbf/users/f1bfe0b4f344485ab6de52f7b1423118/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:00.947350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88eac4-e72c-4c9b-b131-bfd903054197 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:00.947681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88eac4-e72c-4c9b-b131-bfd903054197 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:00.947907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88eac4-e72c-4c9b-b131-bfd903054197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:00.964657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80628f057534f38865c2c74bdf8017f', 'request_id': 'req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:00.985440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80628f057534f38865c2c74bdf8017f', 'request_id': 'req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:00.996944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1c88eac4-e72c-4c9b-b131-bfd903054197 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:01.002559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1c88eac4-e72c-4c9b-b131-bfd903054197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:01.005639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80628f057534f38865c2c74bdf8017f', 'request_id': 'req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:01.035132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a admin admin] The token cache is being invalidate because project a80628f057534f38865c2c74bdf8017f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:16:01.035584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:01.036875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff96e07e-3959-40b7-bfac-c5e4a2013a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:01.042812 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1964/3908] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:00 2022] DELETE /identity/v3/projects/a80628f057534f38865c2c74bdf8017f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:01.045130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fb952-fd46-41cb-ac15-ff80876d8a19 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:01.045433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fb952-fd46-41cb-ac15-ff80876d8a19 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:01.045775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fb952-fd46-41cb-ac15-ff80876d8a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:01.089114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-455fb952-fd46-41cb-ac15-ff80876d8a19 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:01.097412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-455fb952-fd46-41cb-ac15-ff80876d8a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:01.255181 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1945/3909] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:01.294699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88eac4-e72c-4c9b-b131-bfd903054197 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:01.296746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1c88eac4-e72c-4c9b-b131-bfd903054197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:01.302956 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1965/3910] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:16:01.304324 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:01.310844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ce88-bffe-497f-8fbd-8161176acd6e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:01.311505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ce88-bffe-497f-8fbd-8161176acd6e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:01.312450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ce88-bffe-497f-8fbd-8161176acd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:01.373424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ffc0ce88-bffe-497f-8fbd-8161176acd6e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:01.374966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ffc0ce88-bffe-497f-8fbd-8161176acd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:01.394740 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1966/3911] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:01.403429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0ce88-bffe-497f-8fbd-8161176acd6e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:01.420711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0ce88-bffe-497f-8fbd-8161176acd6e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:01.437680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a66ea-75a2-4a3f-a99e-d6a01b62d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:01.438709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a66ea-75a2-4a3f-a99e-d6a01b62d7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:01.439226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a66ea-75a2-4a3f-a99e-d6a01b62d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:01.442671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a66ea-75a2-4a3f-a99e-d6a01b62d7b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:01.443633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a66ea-75a2-4a3f-a99e-d6a01b62d7b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:16:01.444231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a66ea-75a2-4a3f-a99e-d6a01b62d7b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:01.444774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88eac4-e72c-4c9b-b131-bfd903054197 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:01.449054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a66ea-75a2-4a3f-a99e-d6a01b62d7b4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:01.453582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e51049-178e-4317-a5f7-78d5d434fc9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:01.454123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e51049-178e-4317-a5f7-78d5d434fc9b service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:01.454405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e51049-178e-4317-a5f7-78d5d434fc9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:01.454679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e51049-178e-4317-a5f7-78d5d434fc9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:01.481971 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1967/3912] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:16:01.487340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a66ea-75a2-4a3f-a99e-d6a01b62d7b4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:01.492314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e51049-178e-4317-a5f7-78d5d434fc9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:01.494267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e51049-178e-4317-a5f7-78d5d434fc9b service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:01.512189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a66ea-75a2-4a3f-a99e-d6a01b62d7b4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:01.521343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fa8c6-28fb-4c4e-97e3-f02168c06e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:01.522262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fa8c6-28fb-4c4e-97e3-f02168c06e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:01.522722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fa8c6-28fb-4c4e-97e3-f02168c06e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:01.523186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fa8c6-28fb-4c4e-97e3-f02168c06e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:01.524045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fa8c6-28fb-4c4e-97e3-f02168c06e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:01.525070 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1946/3913] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:01.526523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fa8c6-28fb-4c4e-97e3-f02168c06e64 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:01.583630 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1968/3914] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:16:01 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:01.587573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e51049-178e-4317-a5f7-78d5d434fc9b service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:01.623959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e51049-178e-4317-a5f7-78d5d434fc9b service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:01.810255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98004900-ac5e-4543-9157-ce397dbe20f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:01.812173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98004900-ac5e-4543-9157-ce397dbe20f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:01.812567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98004900-ac5e-4543-9157-ce397dbe20f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:01.812916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98004900-ac5e-4543-9157-ce397dbe20f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:01.813633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98004900-ac5e-4543-9157-ce397dbe20f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:01.820455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98004900-ac5e-4543-9157-ce397dbe20f3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:01.864791 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1947/3915] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:16:01 2022] POST /identity/v3/users => generated 299 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:01.866016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fa8c6-28fb-4c4e-97e3-f02168c06e64 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:01.884555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fa8c6-28fb-4c4e-97e3-f02168c06e64 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:01.904832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dba8e2-0a0d-41a2-8756-812812a487cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:01.905794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dba8e2-0a0d-41a2-8756-812812a487cf admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:01.906295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dba8e2-0a0d-41a2-8756-812812a487cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:01.906762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dba8e2-0a0d-41a2-8756-812812a487cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:01.907805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dba8e2-0a0d-41a2-8756-812812a487cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:01.909724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dba8e2-0a0d-41a2-8756-812812a487cf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:01.963785 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1969/3916] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:01.964602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98004900-ac5e-4543-9157-ce397dbe20f3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:01.979728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98004900-ac5e-4543-9157-ce397dbe20f3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:01.987386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68af87f-8b33-4458-bdd5-db9d2cc511e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:01.991354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68af87f-8b33-4458-bdd5-db9d2cc511e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:01.991714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68af87f-8b33-4458-bdd5-db9d2cc511e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:01.991996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68af87f-8b33-4458-bdd5-db9d2cc511e8 admin admin] PATH_INFO: `/v3/projects/66a9f2917bb647a0a3b2ba4ecdbd5578/users/1e4957b7a6d447ff9a15488e038a4194/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:02.027573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68af87f-8b33-4458-bdd5-db9d2cc511e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a9f2917bb647a0a3b2ba4ecdbd5578, user_id=1e4957b7a6d447ff9a15488e038a4194, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:02.027573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68af87f-8b33-4458-bdd5-db9d2cc511e8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:02.061051 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1948/3917] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:16:01 2022] PUT /identity/v3/projects/66a9f2917bb647a0a3b2ba4ecdbd5578/users/1e4957b7a6d447ff9a15488e038a4194/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:02.066164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dba8e2-0a0d-41a2-8756-812812a487cf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:02.094892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dba8e2-0a0d-41a2-8756-812812a487cf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:02.106596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68af87f-8b33-4458-bdd5-db9d2cc511e8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:02.108695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c68af87f-8b33-4458-bdd5-db9d2cc511e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:02.212314 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:02.285945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842ae70-6983-4672-8af0-efcdbcd4eb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:02.288952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842ae70-6983-4672-8af0-efcdbcd4eb0d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:02.291087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842ae70-6983-4672-8af0-efcdbcd4eb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:02.292895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842ae70-6983-4672-8af0-efcdbcd4eb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:02.295661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842ae70-6983-4672-8af0-efcdbcd4eb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:02.300114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842ae70-6983-4672-8af0-efcdbcd4eb0d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:02.334025 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1970/3918] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:02.339913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842ae70-6983-4672-8af0-efcdbcd4eb0d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:02.358479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68af87f-8b33-4458-bdd5-db9d2cc511e8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:02.369191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842ae70-6983-4672-8af0-efcdbcd4eb0d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:02.378304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:02.379240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:02.379535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:02.379805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] PATH_INFO: `/v3/users/3714a80dffe147b5b683e6a3419d0df3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:02.380939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdc528-2dd1-473b-bd5b-6629ea05bd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:02.381081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3714a80dffe147b5b683e6a3419d0df3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:02.382184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdc528-2dd1-473b-bd5b-6629ea05bd68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:02.382727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdc528-2dd1-473b-bd5b-6629ea05bd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:02.383120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:02.384409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdc528-2dd1-473b-bd5b-6629ea05bd68 admin admin] PATH_INFO: `/v3/projects/66a9f2917bb647a0a3b2ba4ecdbd5578/users/1e4957b7a6d447ff9a15488e038a4194/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:02.388287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdc528-2dd1-473b-bd5b-6629ea05bd68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a9f2917bb647a0a3b2ba4ecdbd5578, user_id=1e4957b7a6d447ff9a15488e038a4194, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:02.392339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdc528-2dd1-473b-bd5b-6629ea05bd68 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:02.415795 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:02.436336 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1971/3919] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:16:02 2022] PUT /identity/v3/projects/66a9f2917bb647a0a3b2ba4ecdbd5578/users/1e4957b7a6d447ff9a15488e038a4194/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:02.446766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c65788-71dd-4fa5-b005-ce5513568cd0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:02.447152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c65788-71dd-4fa5-b005-ce5513568cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:02.448504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c65788-71dd-4fa5-b005-ce5513568cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:02.532240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3714a80dffe147b5b683e6a3419d0df3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:02.535380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3714a80dffe147b5b683e6a3419d0df3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:02.568349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-31c65788-71dd-4fa5-b005-ce5513568cd0 None None] MFA Rules not processed for user `1e4957b7a6d447ff9a15488e038a4194`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:02.569742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-31c65788-71dd-4fa5-b005-ce5513568cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:02.583144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3714a80dffe147b5b683e6a3419d0df3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:02.601569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3714a80dffe147b5b683e6a3419d0df3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:02.602268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3714a80dffe147b5b683e6a3419d0df3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:02.631615 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1949/3920] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:16:02 2022] DELETE /identity/v3/users/3714a80dffe147b5b683e6a3419d0df3 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:16:02.735900 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1972/3921] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:02.740507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:02.742377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:02.908799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf19cd-1d81-4f8d-afaf-a926bfd624a4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:02.920388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a23d-bf16-4231-99c1-61992d63cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:02.922188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a23d-bf16-4231-99c1-61992d63cb4a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:02.924039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a23d-bf16-4231-99c1-61992d63cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:02.924366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a23d-bf16-4231-99c1-61992d63cb4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:02.925397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a23d-bf16-4231-99c1-61992d63cb4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:02.929929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a23d-bf16-4231-99c1-61992d63cb4a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:03.021127 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1950/3922] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:16:02 2022] POST /identity/v3/projects => generated 387 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:03.025835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c65788-71dd-4fa5-b005-ce5513568cd0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:03.204140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c65788-71dd-4fa5-b005-ce5513568cd0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:03.375452 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:03.387070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081d219-81c1-4998-a405-ac8ce7b62225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:03.388132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081d219-81c1-4998-a405-ac8ce7b62225 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:03.390124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081d219-81c1-4998-a405-ac8ce7b62225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:03.390637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081d219-81c1-4998-a405-ac8ce7b62225 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:03.392263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081d219-81c1-4998-a405-ac8ce7b62225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:03.397059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081d219-81c1-4998-a405-ac8ce7b62225 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:03.440655 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1973/3923] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:16:03 2022] POST /identity/v3/users => generated 294 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:03.444660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a23d-bf16-4231-99c1-61992d63cb4a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:03.456772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a23d-bf16-4231-99c1-61992d63cb4a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:03.481022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e97337-62ee-497c-bc8b-0605a33aed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:03.482588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e97337-62ee-497c-bc8b-0605a33aed52 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:03.484588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e97337-62ee-497c-bc8b-0605a33aed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:03.485508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e97337-62ee-497c-bc8b-0605a33aed52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:03.487317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e97337-62ee-497c-bc8b-0605a33aed52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:03.493113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e97337-62ee-497c-bc8b-0605a33aed52 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:03.530628 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1951/3924] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:03.532545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081d219-81c1-4998-a405-ac8ce7b62225 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:03.552082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081d219-81c1-4998-a405-ac8ce7b62225 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:03.578824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e725f9a-bc9a-4553-8b6b-4eb9a4881ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:03.579646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e725f9a-bc9a-4553-8b6b-4eb9a4881ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:03.580254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e725f9a-bc9a-4553-8b6b-4eb9a4881ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:03.580990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e725f9a-bc9a-4553-8b6b-4eb9a4881ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:03.588134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e725f9a-bc9a-4553-8b6b-4eb9a4881ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:03.594285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e725f9a-bc9a-4553-8b6b-4eb9a4881ee2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:03.621466 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1974/3925] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:03.623385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e97337-62ee-497c-bc8b-0605a33aed52 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:03.641161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e97337-62ee-497c-bc8b-0605a33aed52 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:03.659217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b588b57-470e-4fed-a16a-dfccf6f1073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:03.659833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b588b57-470e-4fed-a16a-dfccf6f1073f admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:03.660116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b588b57-470e-4fed-a16a-dfccf6f1073f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:03.660393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b588b57-470e-4fed-a16a-dfccf6f1073f admin admin] PATH_INFO: `/v3/projects/63fc0f72d25145a8b169b5fac494a5f2/users/2252900fbc7b4a098a681a740d47e053/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:03.690113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b588b57-470e-4fed-a16a-dfccf6f1073f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fc0f72d25145a8b169b5fac494a5f2, user_id=2252900fbc7b4a098a681a740d47e053, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:03.692490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b588b57-470e-4fed-a16a-dfccf6f1073f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:03.719263 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1952/3926] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:16:03 2022] PUT /identity/v3/projects/63fc0f72d25145a8b169b5fac494a5f2/users/2252900fbc7b4a098a681a740d47e053/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:03.730744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea283f0-180d-4918-a597-28789e844452 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:03.731062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea283f0-180d-4918-a597-28789e844452 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:03.731339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea283f0-180d-4918-a597-28789e844452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:03.807852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9ea283f0-180d-4918-a597-28789e844452 None None] MFA Rules not processed for user `2252900fbc7b4a098a681a740d47e053`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:03.809279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9ea283f0-180d-4918-a597-28789e844452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:03.928969 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1975/3927] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:03.943441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b588b57-470e-4fed-a16a-dfccf6f1073f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:03.945366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8b588b57-470e-4fed-a16a-dfccf6f1073f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:04.038807 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:04.109331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b588b57-470e-4fed-a16a-dfccf6f1073f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:04.125032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170e332-a622-4bfa-a76f-337965930bec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:04.125791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170e332-a622-4bfa-a76f-337965930bec service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:04.126144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170e332-a622-4bfa-a76f-337965930bec service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:04.126509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170e332-a622-4bfa-a76f-337965930bec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:04.286493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170e332-a622-4bfa-a76f-337965930bec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:04.287908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170e332-a622-4bfa-a76f-337965930bec service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:04.316422 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1953/3928] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:05.107727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea283f0-180d-4918-a597-28789e844452 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:05.110495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9ea283f0-180d-4918-a597-28789e844452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:05.307916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea283f0-180d-4918-a597-28789e844452 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:05.320742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:05.322032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:05.322032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:05.324538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] PATH_INFO: `/v3/projects/cfee6c66b8f5495a8eb29e4136ec3ed7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:05.328042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfee6c66b8f5495a8eb29e4136ec3ed7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:05.330601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:05.559002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'request_id': 'req-2669df90-6a69-47ca-8220-7845d5107df9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:05.591144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'request_id': 'req-2669df90-6a69-47ca-8220-7845d5107df9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:05.612999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'request_id': 'req-2669df90-6a69-47ca-8220-7845d5107df9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:05.628966 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:05.663775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] The token cache is being invalidate because project cfee6c66b8f5495a8eb29e4136ec3ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:16:05.664072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:05.673665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:05.690797 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1976/3929] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:05 2022] DELETE /identity/v3/projects/cfee6c66b8f5495a8eb29e4136ec3ed7 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:05.692517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b4b77-d60f-476d-b091-57e6c05dbcc4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:05.693016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b4b77-d60f-476d-b091-57e6c05dbcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:05.693119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b4b77-d60f-476d-b091-57e6c05dbcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:05.742045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ee2b4b77-d60f-476d-b091-57e6c05dbcc4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:05.747963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ee2b4b77-d60f-476d-b091-57e6c05dbcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:05.904243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:05.910753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:05.991537 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1954/3930] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:06.002136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af873b0a-2eb3-414c-a1d3-72764cd8a13b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:06.002664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af873b0a-2eb3-414c-a1d3-72764cd8a13b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:06.002961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af873b0a-2eb3-414c-a1d3-72764cd8a13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:06.053603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-af873b0a-2eb3-414c-a1d3-72764cd8a13b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:06.056334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-af873b0a-2eb3-414c-a1d3-72764cd8a13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:06.076359 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1955/3931] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:16:06.081049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af873b0a-2eb3-414c-a1d3-72764cd8a13b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:06.105823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af873b0a-2eb3-414c-a1d3-72764cd8a13b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:06.113769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669df90-6a69-47ca-8220-7845d5107df9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:06.120163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc658deb-3548-4149-b16b-524659bb12bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:06.120806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc658deb-3548-4149-b16b-524659bb12bc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:06.121080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc658deb-3548-4149-b16b-524659bb12bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:06.121347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc658deb-3548-4149-b16b-524659bb12bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:06.122002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc658deb-3548-4149-b16b-524659bb12bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:16:06.122300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc658deb-3548-4149-b16b-524659bb12bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:06.128933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc658deb-3548-4149-b16b-524659bb12bc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:06.129185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bda3e6-e4c2-45d6-a64c-8daeced871c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:06.129944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bda3e6-e4c2-45d6-a64c-8daeced871c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:06.130241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bda3e6-e4c2-45d6-a64c-8daeced871c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:06.130516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bda3e6-e4c2-45d6-a64c-8daeced871c0 admin admin] PATH_INFO: `/v3/users/1e4957b7a6d447ff9a15488e038a4194` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:06.132494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bda3e6-e4c2-45d6-a64c-8daeced871c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4957b7a6d447ff9a15488e038a4194)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:06.136356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bda3e6-e4c2-45d6-a64c-8daeced871c0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:06.155330 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1956/3932] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:16:06.158715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc658deb-3548-4149-b16b-524659bb12bc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:06.178766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc658deb-3548-4149-b16b-524659bb12bc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:06.191310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7f9c5-bf7b-42b3-826b-441991035e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:06.191991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7f9c5-bf7b-42b3-826b-441991035e4e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:06.192274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7f9c5-bf7b-42b3-826b-441991035e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:06.192542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7f9c5-bf7b-42b3-826b-441991035e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:06.195440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7f9c5-bf7b-42b3-826b-441991035e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:06.202227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7f9c5-bf7b-42b3-826b-441991035e4e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:06.275689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8bda3e6-e4c2-45d6-a64c-8daeced871c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4957b7a6d447ff9a15488e038a4194'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:06.276974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8bda3e6-e4c2-45d6-a64c-8daeced871c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4957b7a6d447ff9a15488e038a4194'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:06.291460 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1957/3933] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:16:06 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:06.301176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7f9c5-bf7b-42b3-826b-441991035e4e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:06.310066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-45d7f9c5-bf7b-42b3-826b-441991035e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:06.334315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8bda3e6-e4c2-45d6-a64c-8daeced871c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4957b7a6d447ff9a15488e038a4194'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:06.364223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8bda3e6-e4c2-45d6-a64c-8daeced871c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4957b7a6d447ff9a15488e038a4194'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:06.365148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8bda3e6-e4c2-45d6-a64c-8daeced871c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4957b7a6d447ff9a15488e038a4194'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:06.427634 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1977/3934] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:16:05 2022] DELETE /identity/v3/users/1e4957b7a6d447ff9a15488e038a4194 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:06.435308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723151d-f3a3-44e0-b214-48406f754316 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:06.435614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723151d-f3a3-44e0-b214-48406f754316 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:06.435888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723151d-f3a3-44e0-b214-48406f754316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:06.459001 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:06.509540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7f9c5-bf7b-42b3-826b-441991035e4e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:06.566348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a723151d-f3a3-44e0-b214-48406f754316 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:06.567815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a723151d-f3a3-44e0-b214-48406f754316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:06.761306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a99578-8504-4b6a-91b2-9ce4aa166042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:06.766235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a99578-8504-4b6a-91b2-9ce4aa166042 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:06.766235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a99578-8504-4b6a-91b2-9ce4aa166042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:06.766525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a99578-8504-4b6a-91b2-9ce4aa166042 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:06.767284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a99578-8504-4b6a-91b2-9ce4aa166042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:06.769270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a99578-8504-4b6a-91b2-9ce4aa166042 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:06.833152 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1958/3935] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:16:06 2022] POST /identity/v3/users => generated 289 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:16:06.837136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a99578-8504-4b6a-91b2-9ce4aa166042 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:06.863769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a99578-8504-4b6a-91b2-9ce4aa166042 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:06.884075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0345f-cb56-43e9-b52c-549c3e7aa01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:06.884854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0345f-cb56-43e9-b52c-549c3e7aa01a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:06.885144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0345f-cb56-43e9-b52c-549c3e7aa01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:06.885418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0345f-cb56-43e9-b52c-549c3e7aa01a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:06.886111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0345f-cb56-43e9-b52c-549c3e7aa01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:06.889682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0345f-cb56-43e9-b52c-549c3e7aa01a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:06.891035 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1978/3936] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:06.930578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723151d-f3a3-44e0-b214-48406f754316 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:06.932764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a723151d-f3a3-44e0-b214-48406f754316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:06.969771 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1959/3937] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:06.971880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0345f-cb56-43e9-b52c-549c3e7aa01a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:06.993567 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:06.993751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0345f-cb56-43e9-b52c-549c3e7aa01a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:07.005219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeebe0-7a95-44ee-b54b-26de126958e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:07.005882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeebe0-7a95-44ee-b54b-26de126958e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:07.006093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeebe0-7a95-44ee-b54b-26de126958e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:07.006390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeebe0-7a95-44ee-b54b-26de126958e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:07.012072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aeebe0-7a95-44ee-b54b-26de126958e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:07.013706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aeebe0-7a95-44ee-b54b-26de126958e9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:07.044758 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1960/3938] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:07.045775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeebe0-7a95-44ee-b54b-26de126958e9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:07.076469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeebe0-7a95-44ee-b54b-26de126958e9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:07.098326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247da31-ef9b-4629-a22c-c303b87014d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:07.099035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247da31-ef9b-4629-a22c-c303b87014d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:07.099314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247da31-ef9b-4629-a22c-c303b87014d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:07.099581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247da31-ef9b-4629-a22c-c303b87014d9 admin admin] PATH_INFO: `/v3/projects/ba3c4e3bdfdc43cea845dab830afc479/users/374430fde21f45418245b0848be3f34b/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:07.147373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247da31-ef9b-4629-a22c-c303b87014d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3c4e3bdfdc43cea845dab830afc479, user_id=374430fde21f45418245b0848be3f34b, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:07.153813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247da31-ef9b-4629-a22c-c303b87014d9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:07.165399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723151d-f3a3-44e0-b214-48406f754316 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:07.175260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e24a1-f81c-434a-a7c9-1641bc897545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:07.175901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e24a1-f81c-434a-a7c9-1641bc897545 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:07.178493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e24a1-f81c-434a-a7c9-1641bc897545 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:07.178835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e24a1-f81c-434a-a7c9-1641bc897545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:07.180555 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1961/3939] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:16:07 2022] PUT /identity/v3/projects/ba3c4e3bdfdc43cea845dab830afc479/users/374430fde21f45418245b0848be3f34b/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:07.192371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34303c-9657-4a65-b118-9e48019a3af6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:07.192690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34303c-9657-4a65-b118-9e48019a3af6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:07.192972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34303c-9657-4a65-b118-9e48019a3af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:07.219812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e24a1-f81c-434a-a7c9-1641bc897545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:07.219812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e24a1-f81c-434a-a7c9-1641bc897545 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:07.244501 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1979/3940] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:16:07.253601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8e34303c-9657-4a65-b118-9e48019a3af6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:07.255007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8e34303c-9657-4a65-b118-9e48019a3af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:07.721715 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1962/3941] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:07.825900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e24a1-f81c-434a-a7c9-1641bc897545 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:07.840044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e24a1-f81c-434a-a7c9-1641bc897545 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:07.982087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77491d-9be3-4e58-8be4-5f8f13948598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:07.982713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77491d-9be3-4e58-8be4-5f8f13948598 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:07.983170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77491d-9be3-4e58-8be4-5f8f13948598 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:07.983443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77491d-9be3-4e58-8be4-5f8f13948598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:08.012417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77491d-9be3-4e58-8be4-5f8f13948598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:08.016265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77491d-9be3-4e58-8be4-5f8f13948598 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:08.043723 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1980/3942] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:11.735337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34303c-9657-4a65-b118-9e48019a3af6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:11.738642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8e34303c-9657-4a65-b118-9e48019a3af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:11.764141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34303c-9657-4a65-b118-9e48019a3af6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:11.789901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:11.790563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:11.790847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:11.791148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] PATH_INFO: `/v3/projects/66a9f2917bb647a0a3b2ba4ecdbd5578` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:11.799965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a9f2917bb647a0a3b2ba4ecdbd5578)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:11.806415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:11.912861 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:11.953153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a9f2917bb647a0a3b2ba4ecdbd5578', 'request_id': 'req-be254d36-e287-4f5c-9964-5932ef3c9dfa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:11.969483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a9f2917bb647a0a3b2ba4ecdbd5578', 'request_id': 'req-be254d36-e287-4f5c-9964-5932ef3c9dfa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:11.996123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a9f2917bb647a0a3b2ba4ecdbd5578', 'request_id': 'req-be254d36-e287-4f5c-9964-5932ef3c9dfa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:12.028463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] The token cache is being invalidate because project 66a9f2917bb647a0a3b2ba4ecdbd5578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:16:12.028709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:12.029487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:12.031585 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1963/3943] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:11 2022] DELETE /identity/v3/projects/66a9f2917bb647a0a3b2ba4ecdbd5578 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:12.036228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77491d-9be3-4e58-8be4-5f8f13948598 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:12.053246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77491d-9be3-4e58-8be4-5f8f13948598 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:12.238513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:12.242248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:12.243425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:12.243939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] PATH_INFO: `/v3/users/2252900fbc7b4a098a681a740d47e053` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:12.246528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] RBAC: Authorizing `identity:delete_user(user_id=2252900fbc7b4a098a681a740d47e053)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:12.252038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:12.435483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2252900fbc7b4a098a681a740d47e053'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:12.438987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2252900fbc7b4a098a681a740d47e053'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:12.489123 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:12.496729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2252900fbc7b4a098a681a740d47e053'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:12.524854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2252900fbc7b4a098a681a740d47e053'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:12.525659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2252900fbc7b4a098a681a740d47e053'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:12.569863 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1981/3944] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:16:12 2022] DELETE /identity/v3/users/2252900fbc7b4a098a681a740d47e053 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:14.357585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:14.363133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:14.604945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be254d36-e287-4f5c-9964-5932ef3c9dfa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:14.716756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c74da8-fe7d-43f5-b8a2-6d7d016e2d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:14.719832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c74da8-fe7d-43f5-b8a2-6d7d016e2d78 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:14.723003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c74da8-fe7d-43f5-b8a2-6d7d016e2d78 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:14.723548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c74da8-fe7d-43f5-b8a2-6d7d016e2d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:14.727631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-93c74da8-fe7d-43f5-b8a2-6d7d016e2d78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:14.747387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c74da8-fe7d-43f5-b8a2-6d7d016e2d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:14.750143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c74da8-fe7d-43f5-b8a2-6d7d016e2d78 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:14.766495 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1964/3945] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:16.359907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:16.362869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:16.875444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ccd73-4058-41a5-9a39-e876b013f7de admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:16.892568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b5d72-6cff-4636-943a-8dd3e3e28c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:16.893435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b5d72-6cff-4636-943a-8dd3e3e28c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:16.893692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b5d72-6cff-4636-943a-8dd3e3e28c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:16.893968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b5d72-6cff-4636-943a-8dd3e3e28c97 admin admin] PATH_INFO: `/v3/projects/63fc0f72d25145a8b169b5fac494a5f2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:16.896628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b5d72-6cff-4636-943a-8dd3e3e28c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63fc0f72d25145a8b169b5fac494a5f2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:16.898570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b5d72-6cff-4636-943a-8dd3e3e28c97 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:17.034234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-913b5d72-6cff-4636-943a-8dd3e3e28c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63fc0f72d25145a8b169b5fac494a5f2', 'request_id': 'req-913b5d72-6cff-4636-943a-8dd3e3e28c97'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:17.047564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-913b5d72-6cff-4636-943a-8dd3e3e28c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63fc0f72d25145a8b169b5fac494a5f2', 'request_id': 'req-913b5d72-6cff-4636-943a-8dd3e3e28c97'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:17.066186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-913b5d72-6cff-4636-943a-8dd3e3e28c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63fc0f72d25145a8b169b5fac494a5f2', 'request_id': 'req-913b5d72-6cff-4636-943a-8dd3e3e28c97'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:17.090662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-913b5d72-6cff-4636-943a-8dd3e3e28c97 admin admin] The token cache is being invalidate because project 63fc0f72d25145a8b169b5fac494a5f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:16:17.091091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-913b5d72-6cff-4636-943a-8dd3e3e28c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:17.091908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-913b5d72-6cff-4636-943a-8dd3e3e28c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:17.100172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbec181-7bb9-477d-b077-17922b83b950 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:17.100773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbec181-7bb9-477d-b077-17922b83b950 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:17.100773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbec181-7bb9-477d-b077-17922b83b950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:17.103590 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1982/3946] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:16 2022] DELETE /identity/v3/projects/63fc0f72d25145a8b169b5fac494a5f2 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:17.133903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-edbec181-7bb9-477d-b077-17922b83b950 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:17.135212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-edbec181-7bb9-477d-b077-17922b83b950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:17.255524 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:17.351681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d48c6-0639-44a5-8acf-8fb286cde90b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:17.352051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d48c6-0639-44a5-8acf-8fb286cde90b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:17.352335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d48c6-0639-44a5-8acf-8fb286cde90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:17.357718 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1965/3947] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:17.398405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3e5d48c6-0639-44a5-8acf-8fb286cde90b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:17.403459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3e5d48c6-0639-44a5-8acf-8fb286cde90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:17.430671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbec181-7bb9-477d-b077-17922b83b950 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:17.441708 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1983/3948] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:17.445134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbec181-7bb9-477d-b077-17922b83b950 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:17.462369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0d360-51ff-46f6-9e36-99cafa29fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:17.463366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0d360-51ff-46f6-9e36-99cafa29fdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:17.463921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0d360-51ff-46f6-9e36-99cafa29fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:17.464614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0d360-51ff-46f6-9e36-99cafa29fdc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:17.465987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0d360-51ff-46f6-9e36-99cafa29fdc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:16:17.466615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0d360-51ff-46f6-9e36-99cafa29fdc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:17.468731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0d360-51ff-46f6-9e36-99cafa29fdc2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:17.528339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d48c6-0639-44a5-8acf-8fb286cde90b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:17.536382 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1966/3949] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:16:17.546334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d48c6-0639-44a5-8acf-8fb286cde90b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:17.564422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ae70f-a13d-449f-bb64-f5e06247dffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:17.565462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ae70f-a13d-449f-bb64-f5e06247dffd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:17.565897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ae70f-a13d-449f-bb64-f5e06247dffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:17.566323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ae70f-a13d-449f-bb64-f5e06247dffd admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:17.567152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ae70f-a13d-449f-bb64-f5e06247dffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:17.571299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ae70f-a13d-449f-bb64-f5e06247dffd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:17.649103 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1984/3950] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:16:17 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:17.650748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0d360-51ff-46f6-9e36-99cafa29fdc2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:17.663293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0d360-51ff-46f6-9e36-99cafa29fdc2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:17.742943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d093c-2385-4a2f-8694-ae586f5733e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:17.743914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d093c-2385-4a2f-8694-ae586f5733e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:17.744354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d093c-2385-4a2f-8694-ae586f5733e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:17.745488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d093c-2385-4a2f-8694-ae586f5733e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:17.746493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d093c-2385-4a2f-8694-ae586f5733e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:17.749135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d093c-2385-4a2f-8694-ae586f5733e5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:17.792704 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1967/3951] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:16:17 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:17.793098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ae70f-a13d-449f-bb64-f5e06247dffd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:17.810645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ae70f-a13d-449f-bb64-f5e06247dffd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:17.816884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961a554-0fda-4400-b893-394e2c19190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:17.817741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961a554-0fda-4400-b893-394e2c19190c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:17.818425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961a554-0fda-4400-b893-394e2c19190c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:17.820840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961a554-0fda-4400-b893-394e2c19190c admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:17.821707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961a554-0fda-4400-b893-394e2c19190c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:17.824074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961a554-0fda-4400-b893-394e2c19190c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:17.844566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d093c-2385-4a2f-8694-ae586f5733e5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:17.855958 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1985/3952] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:17.858799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d093c-2385-4a2f-8694-ae586f5733e5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:17.867486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88af8d-e09a-40ae-896c-d93b2d802319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:17.868471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88af8d-e09a-40ae-896c-d93b2d802319 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:17.869055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88af8d-e09a-40ae-896c-d93b2d802319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:17.869559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88af8d-e09a-40ae-896c-d93b2d802319 admin admin] PATH_INFO: `/v3/projects/a41172d1845d4b468c6d5fea9f9fc8e8/users/e8c70b10730f4b0ca6170aabf7c057e8/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:17.894427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88af8d-e09a-40ae-896c-d93b2d802319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41172d1845d4b468c6d5fea9f9fc8e8, user_id=e8c70b10730f4b0ca6170aabf7c057e8, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:17.897891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88af8d-e09a-40ae-896c-d93b2d802319 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:17.921444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961a554-0fda-4400-b893-394e2c19190c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:17.934192 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1968/3953] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:16:17 2022] PUT /identity/v3/projects/a41172d1845d4b468c6d5fea9f9fc8e8/users/e8c70b10730f4b0ca6170aabf7c057e8/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:17.941292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961a554-0fda-4400-b893-394e2c19190c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:18.021697 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:18.134317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462be3da-ec89-41e1-aa2d-eafb6d3126c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:18.134876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be3da-ec89-41e1-aa2d-eafb6d3126c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:18.135280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be3da-ec89-41e1-aa2d-eafb6d3126c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:18.135561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be3da-ec89-41e1-aa2d-eafb6d3126c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:18.136311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462be3da-ec89-41e1-aa2d-eafb6d3126c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:18.138202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462be3da-ec89-41e1-aa2d-eafb6d3126c3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:18.189511 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1986/3954] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:18.193693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88af8d-e09a-40ae-896c-d93b2d802319 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:18.232640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88af8d-e09a-40ae-896c-d93b2d802319 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:18.247371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eafe73-e4ac-4d7b-aa2b-494b789a79dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:18.248170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eafe73-e4ac-4d7b-aa2b-494b789a79dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:18.248829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eafe73-e4ac-4d7b-aa2b-494b789a79dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:18.249214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eafe73-e4ac-4d7b-aa2b-494b789a79dd admin admin] PATH_INFO: `/v3/projects/a41172d1845d4b468c6d5fea9f9fc8e8/users/e8c70b10730f4b0ca6170aabf7c057e8/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:18.256834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eafe73-e4ac-4d7b-aa2b-494b789a79dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41172d1845d4b468c6d5fea9f9fc8e8, user_id=e8c70b10730f4b0ca6170aabf7c057e8, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:18.263129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eafe73-e4ac-4d7b-aa2b-494b789a79dd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:18.310851 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1969/3955] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:16:18 2022] PUT /identity/v3/projects/a41172d1845d4b468c6d5fea9f9fc8e8/users/e8c70b10730f4b0ca6170aabf7c057e8/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:18.311524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829fc37-6ba8-4626-8f05-332d78fa5177 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:18.311816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829fc37-6ba8-4626-8f05-332d78fa5177 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:18.312095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829fc37-6ba8-4626-8f05-332d78fa5177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:18.413372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9829fc37-6ba8-4626-8f05-332d78fa5177 None None] MFA Rules not processed for user `e8c70b10730f4b0ca6170aabf7c057e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:18.414630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9829fc37-6ba8-4626-8f05-332d78fa5177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:18.676190 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1987/3956] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:18.681008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eafe73-e4ac-4d7b-aa2b-494b789a79dd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:18.936660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eafe73-e4ac-4d7b-aa2b-494b789a79dd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:18.945669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12519309-d76a-421c-aacd-168978d3fcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:18.946498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12519309-d76a-421c-aacd-168978d3fcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:18.946782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12519309-d76a-421c-aacd-168978d3fcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:18.947082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12519309-d76a-421c-aacd-168978d3fcc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:18.947718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12519309-d76a-421c-aacd-168978d3fcc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:18.949622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12519309-d76a-421c-aacd-168978d3fcc7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:19.052306 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1970/3957] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:16:18 2022] POST /identity/v3/projects => generated 385 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:19.056563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829fc37-6ba8-4626-8f05-332d78fa5177 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:19.073037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829fc37-6ba8-4626-8f05-332d78fa5177 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:19.289762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956ab97-3182-46e1-b80c-bedc05a67e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:19.290404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956ab97-3182-46e1-b80c-bedc05a67e88 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:19.290765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956ab97-3182-46e1-b80c-bedc05a67e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:19.290975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956ab97-3182-46e1-b80c-bedc05a67e88 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:19.291642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956ab97-3182-46e1-b80c-bedc05a67e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:19.325291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956ab97-3182-46e1-b80c-bedc05a67e88 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:19.431727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12519309-d76a-421c-aacd-168978d3fcc7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:19.434057 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1988/3958] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:16:19 2022] POST /identity/v3/users => generated 293 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:19.440267 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:19.449824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12519309-d76a-421c-aacd-168978d3fcc7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:19.468619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13a4c6-6beb-4577-a773-b117e2949e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:19.469433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13a4c6-6beb-4577-a773-b117e2949e00 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:19.498190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13a4c6-6beb-4577-a773-b117e2949e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:19.498190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13a4c6-6beb-4577-a773-b117e2949e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:19.498190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13a4c6-6beb-4577-a773-b117e2949e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:19.498190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13a4c6-6beb-4577-a773-b117e2949e00 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:19.526538 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1971/3959] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:19.526841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956ab97-3182-46e1-b80c-bedc05a67e88 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:19.555170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956ab97-3182-46e1-b80c-bedc05a67e88 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:19.575365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86b5fd-003e-482a-9292-20cd94d53965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:19.575999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b5fd-003e-482a-9292-20cd94d53965 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:19.583337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b5fd-003e-482a-9292-20cd94d53965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:19.583623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b5fd-003e-482a-9292-20cd94d53965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:19.584331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86b5fd-003e-482a-9292-20cd94d53965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:19.585950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86b5fd-003e-482a-9292-20cd94d53965 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:19.661193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13a4c6-6beb-4577-a773-b117e2949e00 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:19.673215 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1989/3960] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:19.683591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13a4c6-6beb-4577-a773-b117e2949e00 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:19.707268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9b176-e385-4622-b28e-ef649b0301f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:19.709460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9b176-e385-4622-b28e-ef649b0301f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:19.709812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9b176-e385-4622-b28e-ef649b0301f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:19.715997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9b176-e385-4622-b28e-ef649b0301f5 admin admin] PATH_INFO: `/v3/projects/40355e64b7af47c2a5ad0b0d2e9d1de9/users/5626d60161ed4eb48a619ad8f1e66c61/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:19.788930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9b176-e385-4622-b28e-ef649b0301f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40355e64b7af47c2a5ad0b0d2e9d1de9, user_id=5626d60161ed4eb48a619ad8f1e66c61, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:19.800987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9b176-e385-4622-b28e-ef649b0301f5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:19.853368 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1972/3961] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:16:19 2022] PUT /identity/v3/projects/40355e64b7af47c2a5ad0b0d2e9d1de9/users/5626d60161ed4eb48a619ad8f1e66c61/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:16:19.875417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a72c0-6e73-433e-8dee-3a9f30a13b6e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:19.876935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a72c0-6e73-433e-8dee-3a9f30a13b6e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:19.877589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a72c0-6e73-433e-8dee-3a9f30a13b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:19.975307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-106a72c0-6e73-433e-8dee-3a9f30a13b6e None None] MFA Rules not processed for user `5626d60161ed4eb48a619ad8f1e66c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:19.980603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-106a72c0-6e73-433e-8dee-3a9f30a13b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:20.050688 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:20.220665 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1990/3962] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:20.247436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9b176-e385-4622-b28e-ef649b0301f5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:20.249470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-81c9b176-e385-4622-b28e-ef649b0301f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:20.390639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9b176-e385-4622-b28e-ef649b0301f5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:20.399060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038decc-2ae2-4fc6-a754-e7eadb088029 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:20.399752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038decc-2ae2-4fc6-a754-e7eadb088029 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:20.400026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038decc-2ae2-4fc6-a754-e7eadb088029 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:20.400289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038decc-2ae2-4fc6-a754-e7eadb088029 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:20.628868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038decc-2ae2-4fc6-a754-e7eadb088029 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:20.630524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038decc-2ae2-4fc6-a754-e7eadb088029 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:20.672078 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1973/3963] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:21.787110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a72c0-6e73-433e-8dee-3a9f30a13b6e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:21.981254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a72c0-6e73-433e-8dee-3a9f30a13b6e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:21.992431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:21.993100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:21.993365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:21.993635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] PATH_INFO: `/v3/users/e8c70b10730f4b0ca6170aabf7c057e8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:22.000286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c70b10730f4b0ca6170aabf7c057e8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:22.005126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:22.102782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c70b10730f4b0ca6170aabf7c057e8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:22.103528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c70b10730f4b0ca6170aabf7c057e8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:22.144021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c70b10730f4b0ca6170aabf7c057e8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:22.160386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c70b10730f4b0ca6170aabf7c057e8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:22.161083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c70b10730f4b0ca6170aabf7c057e8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:22.183399 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1991/3964] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:16:21 2022] DELETE /identity/v3/users/e8c70b10730f4b0ca6170aabf7c057e8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:22.187938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062e8d-c56f-4736-9d6c-502831fa7077 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:22.188511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062e8d-c56f-4736-9d6c-502831fa7077 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:22.188511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062e8d-c56f-4736-9d6c-502831fa7077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:22.244089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a8062e8d-c56f-4736-9d6c-502831fa7077 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:22.246784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a8062e8d-c56f-4736-9d6c-502831fa7077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:22.412370 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1974/3965] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:22.509616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:22.512311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:22.692156 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:22.736884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9fda1-6350-4113-8a9b-e2c22951be39 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:22.747712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe575aeb-fa8a-4dc8-ac27-db5e8cf49b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:22.748315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe575aeb-fa8a-4dc8-ac27-db5e8cf49b0c service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:22.749179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe575aeb-fa8a-4dc8-ac27-db5e8cf49b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:22.749467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe575aeb-fa8a-4dc8-ac27-db5e8cf49b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:22.785471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe575aeb-fa8a-4dc8-ac27-db5e8cf49b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:22.786959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe575aeb-fa8a-4dc8-ac27-db5e8cf49b0c service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:22.815999 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1992/3966] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:25.831843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8062e8d-c56f-4736-9d6c-502831fa7077 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:25.834076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a8062e8d-c56f-4736-9d6c-502831fa7077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:25.863699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8062e8d-c56f-4736-9d6c-502831fa7077 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:25.891748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:25.892561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:25.892836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:25.893101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] PATH_INFO: `/v3/projects/a41172d1845d4b468c6d5fea9f9fc8e8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:25.897963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41172d1845d4b468c6d5fea9f9fc8e8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:25.904566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:25.954308 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:26.097701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41172d1845d4b468c6d5fea9f9fc8e8', 'request_id': 'req-2af44dd9-c985-425f-ab36-0cf435d62eed'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:26.121763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41172d1845d4b468c6d5fea9f9fc8e8', 'request_id': 'req-2af44dd9-c985-425f-ab36-0cf435d62eed'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:26.150908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41172d1845d4b468c6d5fea9f9fc8e8', 'request_id': 'req-2af44dd9-c985-425f-ab36-0cf435d62eed'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:26.210233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] The token cache is being invalidate because project a41172d1845d4b468c6d5fea9f9fc8e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:16:26.212416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:26.216643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:26.228522 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1975/3967] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:25 2022] DELETE /identity/v3/projects/a41172d1845d4b468c6d5fea9f9fc8e8 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:26.230050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe575aeb-fa8a-4dc8-ac27-db5e8cf49b0c service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:26.245798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe575aeb-fa8a-4dc8-ac27-db5e8cf49b0c service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:26.401530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7533ce6-cb06-476c-99fd-434c5a9fbf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:26.402399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7533ce6-cb06-476c-99fd-434c5a9fbf47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:26.402857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7533ce6-cb06-476c-99fd-434c5a9fbf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:26.403352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7533ce6-cb06-476c-99fd-434c5a9fbf47 admin admin] PATH_INFO: `/v3/users/5626d60161ed4eb48a619ad8f1e66c61` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:26.404744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7533ce6-cb06-476c-99fd-434c5a9fbf47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5626d60161ed4eb48a619ad8f1e66c61)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:26.406864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7533ce6-cb06-476c-99fd-434c5a9fbf47 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:26.515982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7533ce6-cb06-476c-99fd-434c5a9fbf47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5626d60161ed4eb48a619ad8f1e66c61'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:26.518505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7533ce6-cb06-476c-99fd-434c5a9fbf47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5626d60161ed4eb48a619ad8f1e66c61'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:26.574742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7533ce6-cb06-476c-99fd-434c5a9fbf47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5626d60161ed4eb48a619ad8f1e66c61'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:26.594508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7533ce6-cb06-476c-99fd-434c5a9fbf47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5626d60161ed4eb48a619ad8f1e66c61'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:26.596386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7533ce6-cb06-476c-99fd-434c5a9fbf47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5626d60161ed4eb48a619ad8f1e66c61'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:26.642297 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1993/3968] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:16:26 2022] DELETE /identity/v3/users/5626d60161ed4eb48a619ad8f1e66c61 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:29.353007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:29.354614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:29.403057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af44dd9-c985-425f-ab36-0cf435d62eed admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:29.549972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ee24d-db68-429e-84bf-bff3a63a7e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:29.551722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ee24d-db68-429e-84bf-bff3a63a7e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:29.559080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ee24d-db68-429e-84bf-bff3a63a7e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:29.565721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ee24d-db68-429e-84bf-bff3a63a7e3e admin admin] PATH_INFO: `/v3/projects/40355e64b7af47c2a5ad0b0d2e9d1de9` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:29.569102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ee24d-db68-429e-84bf-bff3a63a7e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=40355e64b7af47c2a5ad0b0d2e9d1de9)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:29.586477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ee24d-db68-429e-84bf-bff3a63a7e3e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:29.779330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-938ee24d-db68-429e-84bf-bff3a63a7e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40355e64b7af47c2a5ad0b0d2e9d1de9', 'request_id': 'req-938ee24d-db68-429e-84bf-bff3a63a7e3e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:29.788226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-938ee24d-db68-429e-84bf-bff3a63a7e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40355e64b7af47c2a5ad0b0d2e9d1de9', 'request_id': 'req-938ee24d-db68-429e-84bf-bff3a63a7e3e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:29.815850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-938ee24d-db68-429e-84bf-bff3a63a7e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40355e64b7af47c2a5ad0b0d2e9d1de9', 'request_id': 'req-938ee24d-db68-429e-84bf-bff3a63a7e3e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:29.832178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-938ee24d-db68-429e-84bf-bff3a63a7e3e admin admin] The token cache is being invalidate because project 40355e64b7af47c2a5ad0b0d2e9d1de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:16:29.832474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-938ee24d-db68-429e-84bf-bff3a63a7e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:29.835288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-938ee24d-db68-429e-84bf-bff3a63a7e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:29.842198 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1976/3969] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:29 2022] DELETE /identity/v3/projects/40355e64b7af47c2a5ad0b0d2e9d1de9 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:29.843991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad71ce1-5851-4b59-83a5-d20ccea5df36 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:29.844482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad71ce1-5851-4b59-83a5-d20ccea5df36 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:29.844576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad71ce1-5851-4b59-83a5-d20ccea5df36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:29.907099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9ad71ce1-5851-4b59-83a5-d20ccea5df36 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:29.924181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9ad71ce1-5851-4b59-83a5-d20ccea5df36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:30.100771 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1994/3970] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:30.102523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46aff-198e-442f-9267-c9683e1344bd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:30.102817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46aff-198e-442f-9267-c9683e1344bd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:30.108716 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:30.109845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46aff-198e-442f-9267-c9683e1344bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:30.231574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dfa46aff-198e-442f-9267-c9683e1344bd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:30.237005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dfa46aff-198e-442f-9267-c9683e1344bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:30.261642 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1977/3971] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:30.268203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad71ce1-5851-4b59-83a5-d20ccea5df36 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:30.293327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad71ce1-5851-4b59-83a5-d20ccea5df36 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:30.325953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190c797-3567-410c-af29-3906053fd80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:30.326584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190c797-3567-410c-af29-3906053fd80a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:30.326947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190c797-3567-410c-af29-3906053fd80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:30.327218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190c797-3567-410c-af29-3906053fd80a admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:30.327929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190c797-3567-410c-af29-3906053fd80a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:16:30.328237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190c797-3567-410c-af29-3906053fd80a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:30.334866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190c797-3567-410c-af29-3906053fd80a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:30.394994 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1995/3972] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:16:30.397418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa46aff-198e-442f-9267-c9683e1344bd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:30.409733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa46aff-198e-442f-9267-c9683e1344bd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:30.433062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8ed98-3b0f-4833-b996-bebb3c7ecdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:30.433732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ed98-3b0f-4833-b996-bebb3c7ecdb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:30.434089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ed98-3b0f-4833-b996-bebb3c7ecdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:30.434327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ed98-3b0f-4833-b996-bebb3c7ecdb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:30.434990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8ed98-3b0f-4833-b996-bebb3c7ecdb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:30.436910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8ed98-3b0f-4833-b996-bebb3c7ecdb7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:30.513389 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1978/3973] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:16:30 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:30.518136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190c797-3567-410c-af29-3906053fd80a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:30.533799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190c797-3567-410c-af29-3906053fd80a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:30.687511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74038d1f-b097-402c-811e-23e94d584dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:30.688076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74038d1f-b097-402c-811e-23e94d584dbf admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:30.690015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74038d1f-b097-402c-811e-23e94d584dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:30.690403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74038d1f-b097-402c-811e-23e94d584dbf admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:30.691197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74038d1f-b097-402c-811e-23e94d584dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:30.697118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74038d1f-b097-402c-811e-23e94d584dbf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:30.749347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8ed98-3b0f-4833-b996-bebb3c7ecdb7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:30.749575 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1996/3974] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:16:30 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:30.755005 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:30.765609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8ed98-3b0f-4833-b996-bebb3c7ecdb7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:30.786391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc0dfe-e689-48f9-a424-995b32e4ddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:30.787400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc0dfe-e689-48f9-a424-995b32e4ddbc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:30.787853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc0dfe-e689-48f9-a424-995b32e4ddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:30.788282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc0dfe-e689-48f9-a424-995b32e4ddbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:30.789089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc0dfe-e689-48f9-a424-995b32e4ddbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:30.793954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc0dfe-e689-48f9-a424-995b32e4ddbc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:30.885655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74038d1f-b097-402c-811e-23e94d584dbf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:30.886283 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1979/3975] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:30.905895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74038d1f-b097-402c-811e-23e94d584dbf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:30.920898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267dc46-d156-42d9-8bc5-917a142ed7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:30.922072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267dc46-d156-42d9-8bc5-917a142ed7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:30.922707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267dc46-d156-42d9-8bc5-917a142ed7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:30.924067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267dc46-d156-42d9-8bc5-917a142ed7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:30.925706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267dc46-d156-42d9-8bc5-917a142ed7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:30.931019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267dc46-d156-42d9-8bc5-917a142ed7c9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:30.955866 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1997/3976] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:30.959932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc0dfe-e689-48f9-a424-995b32e4ddbc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:30.976270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc0dfe-e689-48f9-a424-995b32e4ddbc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:30.992697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056653e-cc4b-4794-a189-23b3832204b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:30.993455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056653e-cc4b-4794-a189-23b3832204b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:30.993738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056653e-cc4b-4794-a189-23b3832204b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:30.994757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056653e-cc4b-4794-a189-23b3832204b1 admin admin] PATH_INFO: `/v3/projects/11e23a1b196d48929aa5abd91874c28d/users/fb192b6025444b9eae59476a8701ed9a/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:31.044878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056653e-cc4b-4794-a189-23b3832204b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e23a1b196d48929aa5abd91874c28d, user_id=fb192b6025444b9eae59476a8701ed9a, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:31.049342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056653e-cc4b-4794-a189-23b3832204b1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:31.079236 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1980/3977] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:16:30 2022] PUT /identity/v3/projects/11e23a1b196d48929aa5abd91874c28d/users/fb192b6025444b9eae59476a8701ed9a/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:31.089534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39edb96-516a-45b8-9a3a-9607f506ac38 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:31.089957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39edb96-516a-45b8-9a3a-9607f506ac38 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:31.090342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39edb96-516a-45b8-9a3a-9607f506ac38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:31.144982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c39edb96-516a-45b8-9a3a-9607f506ac38 None None] MFA Rules not processed for user `fb192b6025444b9eae59476a8701ed9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:31.146304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c39edb96-516a-45b8-9a3a-9607f506ac38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:31.323327 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1998/3978] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:31.328856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056653e-cc4b-4794-a189-23b3832204b1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:31.487053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056653e-cc4b-4794-a189-23b3832204b1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:31.503321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a786c69-95e8-4454-a092-2283e2a2a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:31.504560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a786c69-95e8-4454-a092-2283e2a2a874 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:31.505089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a786c69-95e8-4454-a092-2283e2a2a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:31.505592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a786c69-95e8-4454-a092-2283e2a2a874 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:31.507515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a786c69-95e8-4454-a092-2283e2a2a874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:31.516001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a786c69-95e8-4454-a092-2283e2a2a874 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:31.589819 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1981/3979] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:16:31 2022] POST /identity/v3/projects => generated 369 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:31.592412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39edb96-516a-45b8-9a3a-9607f506ac38 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:31.607437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39edb96-516a-45b8-9a3a-9607f506ac38 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:31.682476 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:31.696574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b1552-0cfe-4e28-a89e-3d0cd1977bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:31.697199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b1552-0cfe-4e28-a89e-3d0cd1977bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:31.697479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b1552-0cfe-4e28-a89e-3d0cd1977bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:31.697753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b1552-0cfe-4e28-a89e-3d0cd1977bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:31.698799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b1552-0cfe-4e28-a89e-3d0cd1977bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:31.701474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b1552-0cfe-4e28-a89e-3d0cd1977bb0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:31.754107 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1999/3980] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:16:31 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:31.754431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a786c69-95e8-4454-a092-2283e2a2a874 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:31.770362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a786c69-95e8-4454-a092-2283e2a2a874 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:31.775796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d1d2e-5d47-47dd-9ea7-7659f121d370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:31.777317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d1d2e-5d47-47dd-9ea7-7659f121d370 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:31.779814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d1d2e-5d47-47dd-9ea7-7659f121d370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:31.780641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d1d2e-5d47-47dd-9ea7-7659f121d370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:31.781743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d1d2e-5d47-47dd-9ea7-7659f121d370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:31.784608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d1d2e-5d47-47dd-9ea7-7659f121d370 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:31.801253 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1982/3981] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:16:31.812282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b1552-0cfe-4e28-a89e-3d0cd1977bb0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:31.853104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b1552-0cfe-4e28-a89e-3d0cd1977bb0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:31.872442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc68393-91cc-4575-81ba-d4f130a488ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:31.874322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc68393-91cc-4575-81ba-d4f130a488ce admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:31.880518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc68393-91cc-4575-81ba-d4f130a488ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:31.881513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc68393-91cc-4575-81ba-d4f130a488ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:31.884060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc68393-91cc-4575-81ba-d4f130a488ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:31.887805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc68393-91cc-4575-81ba-d4f130a488ce admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:31.951228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d1d2e-5d47-47dd-9ea7-7659f121d370 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:31.966882 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2000/3982] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:31.971329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35556da-d006-4c6f-93c4-7419fc3564fa None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:31.974814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d1d2e-5d47-47dd-9ea7-7659f121d370 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:31.977059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35556da-d006-4c6f-93c4-7419fc3564fa None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:31.979232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35556da-d006-4c6f-93c4-7419fc3564fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:32.002174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582d99-b2a0-4d8f-9ff6-b24f96f77b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:32.002855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582d99-b2a0-4d8f-9ff6-b24f96f77b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:32.004751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582d99-b2a0-4d8f-9ff6-b24f96f77b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:32.007371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582d99-b2a0-4d8f-9ff6-b24f96f77b4f admin admin] PATH_INFO: `/v3/projects/d1f1f98c8d524f64a8e47188b4857adb/users/2dad4b0e02d5474b8195c29a684b2f83/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:32.073138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582d99-b2a0-4d8f-9ff6-b24f96f77b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f1f98c8d524f64a8e47188b4857adb, user_id=2dad4b0e02d5474b8195c29a684b2f83, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:32.076460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582d99-b2a0-4d8f-9ff6-b24f96f77b4f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:32.081352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f35556da-d006-4c6f-93c4-7419fc3564fa None None] MFA Rules not processed for user `374430fde21f45418245b0848be3f34b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:32.083764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f35556da-d006-4c6f-93c4-7419fc3564fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:32.125498 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1983/3983] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:16:31 2022] PUT /identity/v3/projects/d1f1f98c8d524f64a8e47188b4857adb/users/2dad4b0e02d5474b8195c29a684b2f83/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:32.141204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bdccf-bfd8-407d-ba62-d76847d4d3e9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:32.141489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bdccf-bfd8-407d-ba62-d76847d4d3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:32.141798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bdccf-bfd8-407d-ba62-d76847d4d3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:32.202670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-930bdccf-bfd8-407d-ba62-d76847d4d3e9 None None] MFA Rules not processed for user `2dad4b0e02d5474b8195c29a684b2f83`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:32.204362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-930bdccf-bfd8-407d-ba62-d76847d4d3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:32.295715 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2001/3984] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:32.309631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c251d-0a8f-4e01-baf7-763126ab6862 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:32.310050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c251d-0a8f-4e01-baf7-763126ab6862 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:32.310246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c251d-0a8f-4e01-baf7-763126ab6862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:32.351025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-154c251d-0a8f-4e01-baf7-763126ab6862 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:32.352262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-154c251d-0a8f-4e01-baf7-763126ab6862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:32.353586 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1984/3985] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:32.367143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bdccf-bfd8-407d-ba62-d76847d4d3e9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:32.369160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-930bdccf-bfd8-407d-ba62-d76847d4d3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:32.392960 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:32.517803 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2002/3986] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:16:32.536638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c251d-0a8f-4e01-baf7-763126ab6862 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:32.538683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-154c251d-0a8f-4e01-baf7-763126ab6862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:32.548366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bdccf-bfd8-407d-ba62-d76847d4d3e9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:32.563960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebe05d-ee5f-48a7-ae99-1b02d776f8f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:32.565783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebe05d-ee5f-48a7-ae99-1b02d776f8f9 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:32.566302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebe05d-ee5f-48a7-ae99-1b02d776f8f9 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:32.566881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebe05d-ee5f-48a7-ae99-1b02d776f8f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:32.755597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebe05d-ee5f-48a7-ae99-1b02d776f8f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:32.757148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebe05d-ee5f-48a7-ae99-1b02d776f8f9 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:32.777457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c251d-0a8f-4e01-baf7-763126ab6862 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:32.777670 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1985/3987] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:32.825210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddd1d7-c0e9-4f27-9fa4-df3d4ce96825 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:32.825958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddd1d7-c0e9-4f27-9fa4-df3d4ce96825 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:32.826251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddd1d7-c0e9-4f27-9fa4-df3d4ce96825 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:32.826533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddd1d7-c0e9-4f27-9fa4-df3d4ce96825 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:32.888691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddd1d7-c0e9-4f27-9fa4-df3d4ce96825 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:32.894702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddd1d7-c0e9-4f27-9fa4-df3d4ce96825 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:32.922186 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:32.945504 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2003/3988] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:16:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:16:33.202217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebe05d-ee5f-48a7-ae99-1b02d776f8f9 service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:33.221048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebe05d-ee5f-48a7-ae99-1b02d776f8f9 service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:33.226127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d40eef-1772-48c0-872c-90eb96509279 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:33.227801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d40eef-1772-48c0-872c-90eb96509279 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:33.228096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d40eef-1772-48c0-872c-90eb96509279 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:33.228365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d40eef-1772-48c0-872c-90eb96509279 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:33.233780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddd1d7-c0e9-4f27-9fa4-df3d4ce96825 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:33.236102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-41ddd1d7-c0e9-4f27-9fa4-df3d4ce96825 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:33.255251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d40eef-1772-48c0-872c-90eb96509279 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:33.256880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d40eef-1772-48c0-872c-90eb96509279 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:33.286069 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1986/3989] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:33.494693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddd1d7-c0e9-4f27-9fa4-df3d4ce96825 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:33.504695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e68c50-924c-4028-b71d-ca6123bb2b30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:33.505900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68c50-924c-4028-b71d-ca6123bb2b30 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:33.506143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68c50-924c-4028-b71d-ca6123bb2b30 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:33.506555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68c50-924c-4028-b71d-ca6123bb2b30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:33.691999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e68c50-924c-4028-b71d-ca6123bb2b30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:33.693985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e68c50-924c-4028-b71d-ca6123bb2b30 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:33.740565 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2004/3990] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:35.786363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9a293-0b7c-4f2f-988a-538073848c44 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:35.788079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9a293-0b7c-4f2f-988a-538073848c44 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:35.788532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9a293-0b7c-4f2f-988a-538073848c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:35.901778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5bf9a293-0b7c-4f2f-988a-538073848c44 None None] MFA Rules not processed for user `f1bfe0b4f344485ab6de52f7b1423118`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:35.903731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5bf9a293-0b7c-4f2f-988a-538073848c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:36.087609 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1987/3991] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:36.090378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f52b3-59e8-423d-bcb9-b6027e0cbab6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:36.090887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f52b3-59e8-423d-bcb9-b6027e0cbab6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:36.091015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f52b3-59e8-423d-bcb9-b6027e0cbab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:36.150338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d45f52b3-59e8-423d-bcb9-b6027e0cbab6 None None] MFA Rules not processed for user `f1bfe0b4f344485ab6de52f7b1423118`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:36.151923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d45f52b3-59e8-423d-bcb9-b6027e0cbab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:36.179793 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2005/3992] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:36.188097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9a293-0b7c-4f2f-988a-538073848c44 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:36.294896 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:36.364535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9a293-0b7c-4f2f-988a-538073848c44 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:36.370156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11fafc-9dae-49a1-ba2e-99a0fccd788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:36.370810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11fafc-9dae-49a1-ba2e-99a0fccd788b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:36.371120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11fafc-9dae-49a1-ba2e-99a0fccd788b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:36.371393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11fafc-9dae-49a1-ba2e-99a0fccd788b admin admin] PATH_INFO: `/v3/users/fb192b6025444b9eae59476a8701ed9a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:36.373113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11fafc-9dae-49a1-ba2e-99a0fccd788b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb192b6025444b9eae59476a8701ed9a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:36.375124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11fafc-9dae-49a1-ba2e-99a0fccd788b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:36.481053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e11fafc-9dae-49a1-ba2e-99a0fccd788b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb192b6025444b9eae59476a8701ed9a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:36.481539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e11fafc-9dae-49a1-ba2e-99a0fccd788b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb192b6025444b9eae59476a8701ed9a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:36.518051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e11fafc-9dae-49a1-ba2e-99a0fccd788b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb192b6025444b9eae59476a8701ed9a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:36.532093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e11fafc-9dae-49a1-ba2e-99a0fccd788b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb192b6025444b9eae59476a8701ed9a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:36.532513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e11fafc-9dae-49a1-ba2e-99a0fccd788b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb192b6025444b9eae59476a8701ed9a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:36.583926 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1988/3993] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:16:36 2022] DELETE /identity/v3/users/fb192b6025444b9eae59476a8701ed9a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:36.595506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526f75-1d60-483c-aa01-ee47ccc3948c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:36.596338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526f75-1d60-483c-aa01-ee47ccc3948c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:36.596795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526f75-1d60-483c-aa01-ee47ccc3948c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:36.649332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-35526f75-1d60-483c-aa01-ee47ccc3948c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:36.650960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-35526f75-1d60-483c-aa01-ee47ccc3948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:36.778643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14056cb2-6fd3-48f7-9f27-a9e5b0f87cb3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:36.779219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14056cb2-6fd3-48f7-9f27-a9e5b0f87cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:36.779659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14056cb2-6fd3-48f7-9f27-a9e5b0f87cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:36.781278 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2006/3994] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:36.815998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-14056cb2-6fd3-48f7-9f27-a9e5b0f87cb3 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:36.818560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-14056cb2-6fd3-48f7-9f27-a9e5b0f87cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:36.849121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35526f75-1d60-483c-aa01-ee47ccc3948c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:36.850570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-35526f75-1d60-483c-aa01-ee47ccc3948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:36.959457 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:37.028128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35526f75-1d60-483c-aa01-ee47ccc3948c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:37.032817 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1989/3995] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:37.045546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f10d3a-6ffc-482e-ade4-e1c42e2053b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:37.046151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f10d3a-6ffc-482e-ade4-e1c42e2053b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:37.046436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f10d3a-6ffc-482e-ade4-e1c42e2053b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:37.046706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f10d3a-6ffc-482e-ade4-e1c42e2053b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:37.053593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14056cb2-6fd3-48f7-9f27-a9e5b0f87cb3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:37.060174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-14056cb2-6fd3-48f7-9f27-a9e5b0f87cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:37.069955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f10d3a-6ffc-482e-ade4-e1c42e2053b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:37.071438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f10d3a-6ffc-482e-ade4-e1c42e2053b2 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:37.106493 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2007/3996] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:37.241497 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:37.250147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14056cb2-6fd3-48f7-9f27-a9e5b0f87cb3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:37.262777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd46fc-4a58-4c0e-98a3-3203084e3008 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:37.263738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd46fc-4a58-4c0e-98a3-3203084e3008 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:37.264971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd46fc-4a58-4c0e-98a3-3203084e3008 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:37.264971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd46fc-4a58-4c0e-98a3-3203084e3008 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:37.305965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd46fc-4a58-4c0e-98a3-3203084e3008 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:37.310167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd46fc-4a58-4c0e-98a3-3203084e3008 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:37.338182 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1990/3997] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:16:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:16:37.362448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f10d3a-6ffc-482e-ade4-e1c42e2053b2 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:37.363949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f2f10d3a-6ffc-482e-ade4-e1c42e2053b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:37.480926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f10d3a-6ffc-482e-ade4-e1c42e2053b2 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:37.487635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d069a37-805e-401c-98c6-e2c003f82cb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:37.488419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d069a37-805e-401c-98c6-e2c003f82cb6 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:37.488806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d069a37-805e-401c-98c6-e2c003f82cb6 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:37.489146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d069a37-805e-401c-98c6-e2c003f82cb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:37.491863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1d069a37-805e-401c-98c6-e2c003f82cb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:37.524863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d069a37-805e-401c-98c6-e2c003f82cb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:37.527959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d069a37-805e-401c-98c6-e2c003f82cb6 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:37.554193 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2008/3998] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:37.837635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd46fc-4a58-4c0e-98a3-3203084e3008 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:37.839717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7ecd46fc-4a58-4c0e-98a3-3203084e3008 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:37.957395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d069a37-805e-401c-98c6-e2c003f82cb6 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:37.959672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1d069a37-805e-401c-98c6-e2c003f82cb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:38.022317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd46fc-4a58-4c0e-98a3-3203084e3008 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:38.034529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e169e-a44e-4bfa-abb1-acee895086df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:38.035476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e169e-a44e-4bfa-abb1-acee895086df service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:38.035990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e169e-a44e-4bfa-abb1-acee895086df service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:38.036597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e169e-a44e-4bfa-abb1-acee895086df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:38.040732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bb2e169e-a44e-4bfa-abb1-acee895086df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:38.146329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d069a37-805e-401c-98c6-e2c003f82cb6 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:38.174190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f05020-a569-425d-8654-d56a0bedf3aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:38.177373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f05020-a569-425d-8654-d56a0bedf3aa service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:38.179035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f05020-a569-425d-8654-d56a0bedf3aa service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:38.179725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f05020-a569-425d-8654-d56a0bedf3aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:38.187737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-56f05020-a569-425d-8654-d56a0bedf3aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:38.214647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e169e-a44e-4bfa-abb1-acee895086df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:38.218166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e169e-a44e-4bfa-abb1-acee895086df service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:38.224397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f05020-a569-425d-8654-d56a0bedf3aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:38.228302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f05020-a569-425d-8654-d56a0bedf3aa service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:38.259131 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1991/3999] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:38.284867 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2009/4000] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:16:39.560199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e169e-a44e-4bfa-abb1-acee895086df service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:39.562867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bb2e169e-a44e-4bfa-abb1-acee895086df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:39.589621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e169e-a44e-4bfa-abb1-acee895086df service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:39.595947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe98910-9887-4f1f-90f2-7937787d802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:39.596865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe98910-9887-4f1f-90f2-7937787d802d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:39.597302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe98910-9887-4f1f-90f2-7937787d802d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:39.598376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe98910-9887-4f1f-90f2-7937787d802d admin admin] PATH_INFO: `/v3/projects/11e23a1b196d48929aa5abd91874c28d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:39.599960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe98910-9887-4f1f-90f2-7937787d802d admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e23a1b196d48929aa5abd91874c28d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:39.603296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe98910-9887-4f1f-90f2-7937787d802d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:39.674889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ebe98910-9887-4f1f-90f2-7937787d802d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e23a1b196d48929aa5abd91874c28d', 'request_id': 'req-ebe98910-9887-4f1f-90f2-7937787d802d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:39.693942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ebe98910-9887-4f1f-90f2-7937787d802d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e23a1b196d48929aa5abd91874c28d', 'request_id': 'req-ebe98910-9887-4f1f-90f2-7937787d802d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:39.714176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ebe98910-9887-4f1f-90f2-7937787d802d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e23a1b196d48929aa5abd91874c28d', 'request_id': 'req-ebe98910-9887-4f1f-90f2-7937787d802d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:39.742203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ebe98910-9887-4f1f-90f2-7937787d802d admin admin] The token cache is being invalidate because project 11e23a1b196d48929aa5abd91874c28d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:16:39.742203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ebe98910-9887-4f1f-90f2-7937787d802d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:39.742203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ebe98910-9887-4f1f-90f2-7937787d802d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:39.742203 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1992/4001] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:39 2022] DELETE /identity/v3/projects/11e23a1b196d48929aa5abd91874c28d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:39.743677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f05020-a569-425d-8654-d56a0bedf3aa service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:39.748123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc788d-ab35-457f-908c-15be0a04ba52 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:39.748123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc788d-ab35-457f-908c-15be0a04ba52 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:39.748417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc788d-ab35-457f-908c-15be0a04ba52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:39.806858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-20fc788d-ab35-457f-908c-15be0a04ba52 None None] MFA Rules not processed for user `374430fde21f45418245b0848be3f34b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:39.809432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-20fc788d-ab35-457f-908c-15be0a04ba52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:39.820731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f05020-a569-425d-8654-d56a0bedf3aa service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:39.828717 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:39.909637 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:39.967874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:39.968959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:39.969489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:39.970134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] PATH_INFO: `/v3/users/2dad4b0e02d5474b8195c29a684b2f83` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:39.973291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dad4b0e02d5474b8195c29a684b2f83)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:39.975495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:40.022179 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1993/4002] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:40.076999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dad4b0e02d5474b8195c29a684b2f83'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:40.077673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dad4b0e02d5474b8195c29a684b2f83'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:40.104218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dad4b0e02d5474b8195c29a684b2f83'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:40.123877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dad4b0e02d5474b8195c29a684b2f83'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:40.124763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dad4b0e02d5474b8195c29a684b2f83'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:40.146525 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2010/4003] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:16:39 2022] DELETE /identity/v3/users/2dad4b0e02d5474b8195c29a684b2f83 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:40.366367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc788d-ab35-457f-908c-15be0a04ba52 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:40.369597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-20fc788d-ab35-457f-908c-15be0a04ba52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:40.537912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc788d-ab35-457f-908c-15be0a04ba52 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:40.689606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5133cc1-1721-4d79-bbc6-916842f62c46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:40.690373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5133cc1-1721-4d79-bbc6-916842f62c46 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:40.691327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5133cc1-1721-4d79-bbc6-916842f62c46 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:40.691607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5133cc1-1721-4d79-bbc6-916842f62c46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:40.694308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c5133cc1-1721-4d79-bbc6-916842f62c46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:40.710414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5133cc1-1721-4d79-bbc6-916842f62c46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:40.712769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5133cc1-1721-4d79-bbc6-916842f62c46 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:40.738662 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1994/4004] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:40.800384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:40.802718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:40.905766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038424a-138f-44a2-933c-7e8da8844338 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:40.914824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba6279-2881-4f24-a18b-ab7eed0f0b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:40.915978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6279-2881-4f24-a18b-ab7eed0f0b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:40.916629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6279-2881-4f24-a18b-ab7eed0f0b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:40.917170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6279-2881-4f24-a18b-ab7eed0f0b23 admin admin] PATH_INFO: `/v3/projects/d1f1f98c8d524f64a8e47188b4857adb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:40.918717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba6279-2881-4f24-a18b-ab7eed0f0b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f1f98c8d524f64a8e47188b4857adb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:40.921685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba6279-2881-4f24-a18b-ab7eed0f0b23 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:40.997395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-53ba6279-2881-4f24-a18b-ab7eed0f0b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f1f98c8d524f64a8e47188b4857adb', 'request_id': 'req-53ba6279-2881-4f24-a18b-ab7eed0f0b23'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:41.009402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-53ba6279-2881-4f24-a18b-ab7eed0f0b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f1f98c8d524f64a8e47188b4857adb', 'request_id': 'req-53ba6279-2881-4f24-a18b-ab7eed0f0b23'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:41.017851 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:41.024910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-53ba6279-2881-4f24-a18b-ab7eed0f0b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f1f98c8d524f64a8e47188b4857adb', 'request_id': 'req-53ba6279-2881-4f24-a18b-ab7eed0f0b23'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:41.043628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-53ba6279-2881-4f24-a18b-ab7eed0f0b23 admin admin] The token cache is being invalidate because project d1f1f98c8d524f64a8e47188b4857adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:16:41.044031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-53ba6279-2881-4f24-a18b-ab7eed0f0b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:41.044726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-53ba6279-2881-4f24-a18b-ab7eed0f0b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:41.046957 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2011/4005] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:40 2022] DELETE /identity/v3/projects/d1f1f98c8d524f64a8e47188b4857adb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:41.054736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c0f8c-4cd2-48e9-9fbd-6b69789dac74 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:41.055298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c0f8c-4cd2-48e9-9fbd-6b69789dac74 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:41.060208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c0f8c-4cd2-48e9-9fbd-6b69789dac74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:41.118445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-db3c0f8c-4cd2-48e9-9fbd-6b69789dac74 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:41.119998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-db3c0f8c-4cd2-48e9-9fbd-6b69789dac74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:41.207240 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:41.239464 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1995/4006] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:41.248845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533d6e-7e1f-4a38-a9c4-08c647384093 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:41.248845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533d6e-7e1f-4a38-a9c4-08c647384093 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:41.248845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533d6e-7e1f-4a38-a9c4-08c647384093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:41.269820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2b533d6e-7e1f-4a38-a9c4-08c647384093 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:41.271579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2b533d6e-7e1f-4a38-a9c4-08c647384093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:41.280832 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2012/4007] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:41.286516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c0f8c-4cd2-48e9-9fbd-6b69789dac74 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:41.298741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c0f8c-4cd2-48e9-9fbd-6b69789dac74 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:41.305412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e88d56-1597-4e58-95c5-ade24eb01180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:41.306274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88d56-1597-4e58-95c5-ade24eb01180 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:41.306710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88d56-1597-4e58-95c5-ade24eb01180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:41.307122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88d56-1597-4e58-95c5-ade24eb01180 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:41.307929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e88d56-1597-4e58-95c5-ade24eb01180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:16:41.308317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e88d56-1597-4e58-95c5-ade24eb01180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:41.310458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e88d56-1597-4e58-95c5-ade24eb01180 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:41.331360 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1996/4008] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:16:41.332921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533d6e-7e1f-4a38-a9c4-08c647384093 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:41.350005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533d6e-7e1f-4a38-a9c4-08c647384093 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:41.359392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4670124-231b-422d-9704-c0d468e30533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:41.360123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4670124-231b-422d-9704-c0d468e30533 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:41.360312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4670124-231b-422d-9704-c0d468e30533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:41.360718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4670124-231b-422d-9704-c0d468e30533 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:41.361320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4670124-231b-422d-9704-c0d468e30533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:41.363233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4670124-231b-422d-9704-c0d468e30533 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:41.421960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e88d56-1597-4e58-95c5-ade24eb01180 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:41.435672 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2013/4009] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:16:41 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:16:41.442013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e88d56-1597-4e58-95c5-ade24eb01180 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:41.542353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c7150-0845-4675-9545-2608aaea985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:41.543472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c7150-0845-4675-9545-2608aaea985d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:41.543941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c7150-0845-4675-9545-2608aaea985d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:41.544597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c7150-0845-4675-9545-2608aaea985d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:41.552541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c7150-0845-4675-9545-2608aaea985d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:41.552541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c7150-0845-4675-9545-2608aaea985d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:41.557469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4670124-231b-422d-9704-c0d468e30533 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:41.560829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d4670124-231b-422d-9704-c0d468e30533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:41.584818 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1997/4010] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:16:41 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:41.589192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c7150-0845-4675-9545-2608aaea985d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:41.611479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c7150-0845-4675-9545-2608aaea985d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:41.628162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3026b-c2d5-40e0-aebc-dc8f53f69706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:41.629160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3026b-c2d5-40e0-aebc-dc8f53f69706 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:41.629505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3026b-c2d5-40e0-aebc-dc8f53f69706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:41.630532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3026b-c2d5-40e0-aebc-dc8f53f69706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:41.631298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3026b-c2d5-40e0-aebc-dc8f53f69706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:41.635432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3026b-c2d5-40e0-aebc-dc8f53f69706 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:41.661550 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1998/4011] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:16:41.663288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3026b-c2d5-40e0-aebc-dc8f53f69706 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:41.698487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3026b-c2d5-40e0-aebc-dc8f53f69706 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:41.712674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64994939-dfb7-4cc2-87ac-9fe45763a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:41.713586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64994939-dfb7-4cc2-87ac-9fe45763a71a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:41.714045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64994939-dfb7-4cc2-87ac-9fe45763a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:41.714662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64994939-dfb7-4cc2-87ac-9fe45763a71a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:41.716146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64994939-dfb7-4cc2-87ac-9fe45763a71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:41.721641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64994939-dfb7-4cc2-87ac-9fe45763a71a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:41.727880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4670124-231b-422d-9704-c0d468e30533 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:41.741405 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1999/4012] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:41.743231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64994939-dfb7-4cc2-87ac-9fe45763a71a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:41.743961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8e64c-0a29-4d1b-9528-63e92fe69851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:41.744830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8e64c-0a29-4d1b-9528-63e92fe69851 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:41.745691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8e64c-0a29-4d1b-9528-63e92fe69851 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:41.746065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8e64c-0a29-4d1b-9528-63e92fe69851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:41.752126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4ea8e64c-0a29-4d1b-9528-63e92fe69851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:41.765967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64994939-dfb7-4cc2-87ac-9fe45763a71a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:41.772670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2341452-5d7a-43c6-97a5-80c0bb4d6169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:41.773621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2341452-5d7a-43c6-97a5-80c0bb4d6169 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:41.773902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2341452-5d7a-43c6-97a5-80c0bb4d6169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:41.774170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2341452-5d7a-43c6-97a5-80c0bb4d6169 admin admin] PATH_INFO: `/v3/projects/28a97de94cc240b3ac90b6a604239267/users/bad54e74ec524050911003665aa289db/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:41.799175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8e64c-0a29-4d1b-9528-63e92fe69851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:41.801612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8e64c-0a29-4d1b-9528-63e92fe69851 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:41.809988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2341452-5d7a-43c6-97a5-80c0bb4d6169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a97de94cc240b3ac90b6a604239267, user_id=bad54e74ec524050911003665aa289db, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:41.815279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2341452-5d7a-43c6-97a5-80c0bb4d6169 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:41.833350 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2014/4013] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:41.851165 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2000/4014] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:16:41 2022] PUT /identity/v3/projects/28a97de94cc240b3ac90b6a604239267/users/bad54e74ec524050911003665aa289db/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:41.852461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6a613-a009-45d1-b4df-7bada187e414 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:41.852885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6a613-a009-45d1-b4df-7bada187e414 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:41.853257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6a613-a009-45d1-b4df-7bada187e414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:41.925721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-14d6a613-a009-45d1-b4df-7bada187e414 None None] MFA Rules not processed for user `bad54e74ec524050911003665aa289db`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:41.927404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-14d6a613-a009-45d1-b4df-7bada187e414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:42.055759 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2015/4015] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:16:42.068409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2341452-5d7a-43c6-97a5-80c0bb4d6169 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:42.070326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a2341452-5d7a-43c6-97a5-80c0bb4d6169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:42.194384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2341452-5d7a-43c6-97a5-80c0bb4d6169 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:42.205562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb701f8-c824-41c3-be93-a73fea77fdd8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:42.206200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb701f8-c824-41c3-be93-a73fea77fdd8 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:42.206480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb701f8-c824-41c3-be93-a73fea77fdd8 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:42.206749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb701f8-c824-41c3-be93-a73fea77fdd8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:42.222175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb701f8-c824-41c3-be93-a73fea77fdd8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:42.223672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb701f8-c824-41c3-be93-a73fea77fdd8 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:42.243532 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2001/4016] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:42.748933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6a613-a009-45d1-b4df-7bada187e414 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:42.882620 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:42.910177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6a613-a009-45d1-b4df-7bada187e414 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:42.929300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:42.929779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:42.930056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:42.930321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] PATH_INFO: `/v3/users/bad54e74ec524050911003665aa289db` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:42.931677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad54e74ec524050911003665aa289db)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:42.934456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:43.055630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad54e74ec524050911003665aa289db'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:43.056525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad54e74ec524050911003665aa289db'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:43.116804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad54e74ec524050911003665aa289db'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:43.133560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad54e74ec524050911003665aa289db'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:43.135687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad54e74ec524050911003665aa289db'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:43.167237 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2016/4017] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:16:42 2022] DELETE /identity/v3/users/bad54e74ec524050911003665aa289db => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:43.171981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa59152-f64e-49e9-bc13-66fa91d02b5d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:43.173046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa59152-f64e-49e9-bc13-66fa91d02b5d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:43.173233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa59152-f64e-49e9-bc13-66fa91d02b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:43.221438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5aa59152-f64e-49e9-bc13-66fa91d02b5d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:43.222665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5aa59152-f64e-49e9-bc13-66fa91d02b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:43.276040 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:43.415626 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2002/4018] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:43.473656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:43.475357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:43.721460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709967c0-5b1e-438f-ac2d-03a6f7f72aff admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:43.737676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c8def-5722-42f9-9ace-bd9528381b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:43.738362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c8def-5722-42f9-9ace-bd9528381b65 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:43.738852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c8def-5722-42f9-9ace-bd9528381b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:43.739183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c8def-5722-42f9-9ace-bd9528381b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:43.756968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c8def-5722-42f9-9ace-bd9528381b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:43.758785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c8def-5722-42f9-9ace-bd9528381b65 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:43.790196 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2017/4019] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:45.834345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa59152-f64e-49e9-bc13-66fa91d02b5d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:45.835819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5aa59152-f64e-49e9-bc13-66fa91d02b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:45.859188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa59152-f64e-49e9-bc13-66fa91d02b5d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:45.866160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2961c6-3654-4533-a309-6f6c753bd195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:45.866949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2961c6-3654-4533-a309-6f6c753bd195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:45.867219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2961c6-3654-4533-a309-6f6c753bd195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:45.867493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2961c6-3654-4533-a309-6f6c753bd195 admin admin] PATH_INFO: `/v3/projects/28a97de94cc240b3ac90b6a604239267` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:45.868806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2961c6-3654-4533-a309-6f6c753bd195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a97de94cc240b3ac90b6a604239267)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:45.870746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2961c6-3654-4533-a309-6f6c753bd195 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:45.970215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef2961c6-3654-4533-a309-6f6c753bd195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a97de94cc240b3ac90b6a604239267', 'request_id': 'req-ef2961c6-3654-4533-a309-6f6c753bd195'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:45.977194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef2961c6-3654-4533-a309-6f6c753bd195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a97de94cc240b3ac90b6a604239267', 'request_id': 'req-ef2961c6-3654-4533-a309-6f6c753bd195'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:45.986459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef2961c6-3654-4533-a309-6f6c753bd195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a97de94cc240b3ac90b6a604239267', 'request_id': 'req-ef2961c6-3654-4533-a309-6f6c753bd195'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:45.998559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef2961c6-3654-4533-a309-6f6c753bd195 admin admin] The token cache is being invalidate because project 28a97de94cc240b3ac90b6a604239267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:16:45.999260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef2961c6-3654-4533-a309-6f6c753bd195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:46.000005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef2961c6-3654-4533-a309-6f6c753bd195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:46.002044 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2003/4020] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:45 2022] DELETE /identity/v3/projects/28a97de94cc240b3ac90b6a604239267 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:46.008025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4566c-4321-4cf1-b0d6-c65896f1009b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:46.008499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4566c-4321-4cf1-b0d6-c65896f1009b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:46.009073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4566c-4321-4cf1-b0d6-c65896f1009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:46.034520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-81e4566c-4321-4cf1-b0d6-c65896f1009b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:46.036340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-81e4566c-4321-4cf1-b0d6-c65896f1009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:46.127070 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2018/4021] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:16:46.134487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c89f9-fe53-4245-a3ec-6d13b650cb6e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:46.134808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c89f9-fe53-4245-a3ec-6d13b650cb6e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:46.135067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c89f9-fe53-4245-a3ec-6d13b650cb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:46.162167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a30c89f9-fe53-4245-a3ec-6d13b650cb6e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:46.163808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a30c89f9-fe53-4245-a3ec-6d13b650cb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:46.175373 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2004/4022] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:46.179710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4566c-4321-4cf1-b0d6-c65896f1009b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:46.193270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4566c-4321-4cf1-b0d6-c65896f1009b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:46.213462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35753e-c6bb-4238-a371-7e11863501da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:46.214300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35753e-c6bb-4238-a371-7e11863501da admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:46.214766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35753e-c6bb-4238-a371-7e11863501da admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:46.215231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35753e-c6bb-4238-a371-7e11863501da admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:46.216036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35753e-c6bb-4238-a371-7e11863501da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:16:46.216513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35753e-c6bb-4238-a371-7e11863501da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:46.218396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35753e-c6bb-4238-a371-7e11863501da admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:46.234392 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:46.240936 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2019/4023] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:16:46.243553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c89f9-fe53-4245-a3ec-6d13b650cb6e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:46.276209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c89f9-fe53-4245-a3ec-6d13b650cb6e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:46.299301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5b2db-cff2-4f84-af3d-f115bdfdda9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:46.300018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5b2db-cff2-4f84-af3d-f115bdfdda9b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:46.300267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5b2db-cff2-4f84-af3d-f115bdfdda9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:46.300550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5b2db-cff2-4f84-af3d-f115bdfdda9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:46.301180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5b2db-cff2-4f84-af3d-f115bdfdda9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:46.308382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5b2db-cff2-4f84-af3d-f115bdfdda9b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:46.376577 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2005/4024] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:16:46 2022] POST /identity/v3/projects => generated 393 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:46.381745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35753e-c6bb-4238-a371-7e11863501da admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:46.403189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35753e-c6bb-4238-a371-7e11863501da admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:46.586667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbc5b4-917a-4806-8a34-b382b74e8685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:46.587327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbc5b4-917a-4806-8a34-b382b74e8685 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:46.587602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbc5b4-917a-4806-8a34-b382b74e8685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:46.587872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbc5b4-917a-4806-8a34-b382b74e8685 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:46.588505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbc5b4-917a-4806-8a34-b382b74e8685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:46.590431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbc5b4-917a-4806-8a34-b382b74e8685 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:46.637514 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2020/4025] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:16:46 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:46.638684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5b2db-cff2-4f84-af3d-f115bdfdda9b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:46.656264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5b2db-cff2-4f84-af3d-f115bdfdda9b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:46.665294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e5383-2fd3-4509-9d29-1ed288ab213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:46.669374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e5383-2fd3-4509-9d29-1ed288ab213e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:46.669653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e5383-2fd3-4509-9d29-1ed288ab213e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:46.672062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e5383-2fd3-4509-9d29-1ed288ab213e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:46.672816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e5383-2fd3-4509-9d29-1ed288ab213e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:46.677140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e5383-2fd3-4509-9d29-1ed288ab213e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:46.693917 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2006/4026] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:46.698106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbc5b4-917a-4806-8a34-b382b74e8685 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:46.723401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbc5b4-917a-4806-8a34-b382b74e8685 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:46.733773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9bbf7-c71b-48de-baf2-43864d9d1c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:46.735228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9bbf7-c71b-48de-baf2-43864d9d1c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:46.735802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9bbf7-c71b-48de-baf2-43864d9d1c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:46.736310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9bbf7-c71b-48de-baf2-43864d9d1c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:46.737301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9bbf7-c71b-48de-baf2-43864d9d1c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:46.742873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9bbf7-c71b-48de-baf2-43864d9d1c51 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:46.760168 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2021/4027] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:46.764498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e5383-2fd3-4509-9d29-1ed288ab213e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:46.777380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e5383-2fd3-4509-9d29-1ed288ab213e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:46.786520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf381d22-a878-43d9-be90-0f2f07c4dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:46.787393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf381d22-a878-43d9-be90-0f2f07c4dab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:46.787681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf381d22-a878-43d9-be90-0f2f07c4dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:46.787954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf381d22-a878-43d9-be90-0f2f07c4dab6 admin admin] PATH_INFO: `/v3/projects/c0277877f8e9446eab80467f42a8369c/users/814543e519fd49adb2d77a53fcbfc789/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:46.804681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf381d22-a878-43d9-be90-0f2f07c4dab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0277877f8e9446eab80467f42a8369c, user_id=814543e519fd49adb2d77a53fcbfc789, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:46.807389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf381d22-a878-43d9-be90-0f2f07c4dab6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:46.835750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e390c0a-7b3d-4b63-a091-284eb4deb870 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:46.837379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e390c0a-7b3d-4b63-a091-284eb4deb870 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:46.838934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e390c0a-7b3d-4b63-a091-284eb4deb870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:46.841982 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2007/4028] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:16:46 2022] PUT /identity/v3/projects/c0277877f8e9446eab80467f42a8369c/users/814543e519fd49adb2d77a53fcbfc789/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:16:46.898691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1e390c0a-7b3d-4b63-a091-284eb4deb870 None None] MFA Rules not processed for user `814543e519fd49adb2d77a53fcbfc789`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:46.899965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1e390c0a-7b3d-4b63-a091-284eb4deb870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:47.008320 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2022/4029] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:16:47.066379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf381d22-a878-43d9-be90-0f2f07c4dab6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:47.068287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cf381d22-a878-43d9-be90-0f2f07c4dab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:47.140782 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:47.163771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf381d22-a878-43d9-be90-0f2f07c4dab6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:47.168032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05592848-fd41-495a-91f8-b6fbc137ab29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:47.168802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592848-fd41-495a-91f8-b6fbc137ab29 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:47.169298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592848-fd41-495a-91f8-b6fbc137ab29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:47.169775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592848-fd41-495a-91f8-b6fbc137ab29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:47.181767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05592848-fd41-495a-91f8-b6fbc137ab29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:47.183965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05592848-fd41-495a-91f8-b6fbc137ab29 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:47.196201 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2008/4030] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:47.278643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e390c0a-7b3d-4b63-a091-284eb4deb870 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:47.278643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1e390c0a-7b3d-4b63-a091-284eb4deb870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:47.380068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e390c0a-7b3d-4b63-a091-284eb4deb870 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:47.387238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:47.388189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:47.388493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:47.388768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] PATH_INFO: `/v3/users/7c1e0fc9ff7e4c0da77439e27166264f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:47.390497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1e0fc9ff7e4c0da77439e27166264f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:47.394017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:47.421951 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:47.489946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1e0fc9ff7e4c0da77439e27166264f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:47.490654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1e0fc9ff7e4c0da77439e27166264f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:47.509086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1e0fc9ff7e4c0da77439e27166264f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:47.519056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1e0fc9ff7e4c0da77439e27166264f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:47.519837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1e0fc9ff7e4c0da77439e27166264f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:47.540248 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2023/4031] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:16:47 2022] DELETE /identity/v3/users/7c1e0fc9ff7e4c0da77439e27166264f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:47.544444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d51533-e365-4c7e-a768-a9c62247d061 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:47.544960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d51533-e365-4c7e-a768-a9c62247d061 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:47.545471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d51533-e365-4c7e-a768-a9c62247d061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:47.592849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-70d51533-e365-4c7e-a768-a9c62247d061 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:47.596144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-70d51533-e365-4c7e-a768-a9c62247d061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:47.696258 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2009/4032] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:47.809777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:47.811287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:47.899527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f2294-236b-4359-937a-173d6aad992e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:47.905858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929c1de-9605-4f04-9572-d3b2b6c46fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:47.907473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929c1de-9605-4f04-9572-d3b2b6c46fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:47.907922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929c1de-9605-4f04-9572-d3b2b6c46fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:47.908379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929c1de-9605-4f04-9572-d3b2b6c46fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:47.924606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929c1de-9605-4f04-9572-d3b2b6c46fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:47.927549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929c1de-9605-4f04-9572-d3b2b6c46fd3 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:47.942560 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2024/4033] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:16:49.204221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d51533-e365-4c7e-a768-a9c62247d061 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:49.205994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-70d51533-e365-4c7e-a768-a9c62247d061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:49.221442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d51533-e365-4c7e-a768-a9c62247d061 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:49.227615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d866bc-6373-448c-9125-9a42a295317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:49.228985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d866bc-6373-448c-9125-9a42a295317d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:49.229970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d866bc-6373-448c-9125-9a42a295317d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:49.230417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d866bc-6373-448c-9125-9a42a295317d admin admin] PATH_INFO: `/v3/projects/ec64ba1a19d54d38aecbabcd25b075da` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:49.232236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d866bc-6373-448c-9125-9a42a295317d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec64ba1a19d54d38aecbabcd25b075da)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:49.236453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d866bc-6373-448c-9125-9a42a295317d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:49.314345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74d866bc-6373-448c-9125-9a42a295317d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec64ba1a19d54d38aecbabcd25b075da', 'request_id': 'req-74d866bc-6373-448c-9125-9a42a295317d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:49.322276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74d866bc-6373-448c-9125-9a42a295317d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec64ba1a19d54d38aecbabcd25b075da', 'request_id': 'req-74d866bc-6373-448c-9125-9a42a295317d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:49.335351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74d866bc-6373-448c-9125-9a42a295317d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec64ba1a19d54d38aecbabcd25b075da', 'request_id': 'req-74d866bc-6373-448c-9125-9a42a295317d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:49.348689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74d866bc-6373-448c-9125-9a42a295317d admin admin] The token cache is being invalidate because project ec64ba1a19d54d38aecbabcd25b075da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:16:49.349097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74d866bc-6373-448c-9125-9a42a295317d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:49.349863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74d866bc-6373-448c-9125-9a42a295317d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:16:49.352829 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2010/4034] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:49 2022] DELETE /identity/v3/projects/ec64ba1a19d54d38aecbabcd25b075da => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:16:49.357656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eefd79-62b1-4402-86e5-0a7d17ae10cb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:49.358174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eefd79-62b1-4402-86e5-0a7d17ae10cb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:49.358284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eefd79-62b1-4402-86e5-0a7d17ae10cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:49.385918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e8eefd79-62b1-4402-86e5-0a7d17ae10cb None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:49.387073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e8eefd79-62b1-4402-86e5-0a7d17ae10cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:49.502722 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2025/4035] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:49.504521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00698855-f8ba-4513-a6d4-1315ffb1819d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:49.504993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00698855-f8ba-4513-a6d4-1315ffb1819d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:49.505475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00698855-f8ba-4513-a6d4-1315ffb1819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:49.549560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-00698855-f8ba-4513-a6d4-1315ffb1819d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:49.550723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-00698855-f8ba-4513-a6d4-1315ffb1819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:49.583066 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2011/4036] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:49.583309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eefd79-62b1-4402-86e5-0a7d17ae10cb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:49.594122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eefd79-62b1-4402-86e5-0a7d17ae10cb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:49.606281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593dc7-8bc9-4971-b1ec-04840b2a4bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:49.607642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593dc7-8bc9-4971-b1ec-04840b2a4bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:49.608613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593dc7-8bc9-4971-b1ec-04840b2a4bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:49.609453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593dc7-8bc9-4971-b1ec-04840b2a4bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:49.611692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593dc7-8bc9-4971-b1ec-04840b2a4bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:16:49.613454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593dc7-8bc9-4971-b1ec-04840b2a4bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:49.619262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593dc7-8bc9-4971-b1ec-04840b2a4bdd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:49.639975 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2026/4037] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:16:49.641982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00698855-f8ba-4513-a6d4-1315ffb1819d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:49.651910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00698855-f8ba-4513-a6d4-1315ffb1819d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:49.668205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d1095-6f5b-4cc7-8d17-d49d012cee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:49.668832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d1095-6f5b-4cc7-8d17-d49d012cee11 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:49.669110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d1095-6f5b-4cc7-8d17-d49d012cee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:49.669379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d1095-6f5b-4cc7-8d17-d49d012cee11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:49.670024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d1095-6f5b-4cc7-8d17-d49d012cee11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:49.671964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d1095-6f5b-4cc7-8d17-d49d012cee11 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:49.732279 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2012/4038] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:16:49 2022] POST /identity/v3/projects => generated 399 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:49.738140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593dc7-8bc9-4971-b1ec-04840b2a4bdd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:49.751636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593dc7-8bc9-4971-b1ec-04840b2a4bdd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:49.808127 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:49.902287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586ba19-c311-423a-8c01-f54d54201037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:49.903581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586ba19-c311-423a-8c01-f54d54201037 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:49.903962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586ba19-c311-423a-8c01-f54d54201037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:49.904309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586ba19-c311-423a-8c01-f54d54201037 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:49.905014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586ba19-c311-423a-8c01-f54d54201037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:49.908175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586ba19-c311-423a-8c01-f54d54201037 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:49.944171 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2027/4039] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:16:49 2022] POST /identity/v3/users => generated 300 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:16:49.945364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d1095-6f5b-4cc7-8d17-d49d012cee11 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:49.957199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d1095-6f5b-4cc7-8d17-d49d012cee11 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:49.963242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d83e0-67b1-4d5c-a310-3a2bbf549cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:49.963929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d83e0-67b1-4d5c-a310-3a2bbf549cca admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:49.964270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d83e0-67b1-4d5c-a310-3a2bbf549cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:49.964625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d83e0-67b1-4d5c-a310-3a2bbf549cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:49.965332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d83e0-67b1-4d5c-a310-3a2bbf549cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:49.967031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d83e0-67b1-4d5c-a310-3a2bbf549cca admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:49.980208 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2013/4040] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:16:49.986224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586ba19-c311-423a-8c01-f54d54201037 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:50.001897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586ba19-c311-423a-8c01-f54d54201037 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:50.010096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e29a1-2774-485e-931c-191a6ebd75aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:50.010642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e29a1-2774-485e-931c-191a6ebd75aa admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:50.011044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e29a1-2774-485e-931c-191a6ebd75aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:50.011416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e29a1-2774-485e-931c-191a6ebd75aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:50.012678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e29a1-2774-485e-931c-191a6ebd75aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:50.014423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e29a1-2774-485e-931c-191a6ebd75aa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:50.032655 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2028/4041] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:16:50.037619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d83e0-67b1-4d5c-a310-3a2bbf549cca admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:50.056056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d83e0-67b1-4d5c-a310-3a2bbf549cca admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:50.062232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe2c2a-2e72-41f5-bba0-8629f18f00f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:50.062633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2c2a-2e72-41f5-bba0-8629f18f00f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:50.062832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2c2a-2e72-41f5-bba0-8629f18f00f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:50.063334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2c2a-2e72-41f5-bba0-8629f18f00f4 admin admin] PATH_INFO: `/v3/projects/131d702dc0e34408bf3e58809c5cfb0d/users/b7cdbf32b68a44a28e4cc9c4210b5e56/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:50.098537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe2c2a-2e72-41f5-bba0-8629f18f00f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=131d702dc0e34408bf3e58809c5cfb0d, user_id=b7cdbf32b68a44a28e4cc9c4210b5e56, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:50.104249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe2c2a-2e72-41f5-bba0-8629f18f00f4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:50.129743 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2014/4042] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:16:50 2022] PUT /identity/v3/projects/131d702dc0e34408bf3e58809c5cfb0d/users/b7cdbf32b68a44a28e4cc9c4210b5e56/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:16:50.132050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee64d32-4f84-493b-a5b8-32c04b9ea5fe None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:50.132349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee64d32-4f84-493b-a5b8-32c04b9ea5fe None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:50.132682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee64d32-4f84-493b-a5b8-32c04b9ea5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:50.158383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7ee64d32-4f84-493b-a5b8-32c04b9ea5fe None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:16:50.159573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7ee64d32-4f84-493b-a5b8-32c04b9ea5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:50.264932 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2029/4043] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:16:50.279515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe2c2a-2e72-41f5-bba0-8629f18f00f4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:16:50.285016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a8fe2c2a-2e72-41f5-bba0-8629f18f00f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:16:50.310995 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:50.418822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe2c2a-2e72-41f5-bba0-8629f18f00f4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:16:50.426303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3c9f4-3b62-4393-9d9b-71f4171b319b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:16:50.426813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3c9f4-3b62-4393-9d9b-71f4171b319b service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:16:50.427024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3c9f4-3b62-4393-9d9b-71f4171b319b service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:16:50.427239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3c9f4-3b62-4393-9d9b-71f4171b319b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:16:50.445698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3c9f4-3b62-4393-9d9b-71f4171b319b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:16:50.447180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3c9f4-3b62-4393-9d9b-71f4171b319b service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:16:50.461565 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2015/4044] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:00.243020 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:00.455402 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=24 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:01.700144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee64d32-4f84-493b-a5b8-32c04b9ea5fe None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:01.718659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee64d32-4f84-493b-a5b8-32c04b9ea5fe None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:01.724150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95795e53-3f75-4755-b7e7-f37aa511e717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:01.725518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95795e53-3f75-4755-b7e7-f37aa511e717 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:01.725972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95795e53-3f75-4755-b7e7-f37aa511e717 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:01.726494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95795e53-3f75-4755-b7e7-f37aa511e717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:01.728892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-95795e53-3f75-4755-b7e7-f37aa511e717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:01.745652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95795e53-3f75-4755-b7e7-f37aa511e717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:01.747347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95795e53-3f75-4755-b7e7-f37aa511e717 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:01.771761 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2030/4045] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:05.264187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3c9f4-3b62-4393-9d9b-71f4171b319b service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:05.271483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-96a3c9f4-3b62-4393-9d9b-71f4171b319b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:05.305860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3c9f4-3b62-4393-9d9b-71f4171b319b service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:05.318827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:05.323864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:05.324190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:05.325764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] PATH_INFO: `/v3/users/814543e519fd49adb2d77a53fcbfc789` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:05.328040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=814543e519fd49adb2d77a53fcbfc789)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:05.362132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:05.480777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814543e519fd49adb2d77a53fcbfc789'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:05.481835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814543e519fd49adb2d77a53fcbfc789'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:05.504225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814543e519fd49adb2d77a53fcbfc789'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:05.519461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814543e519fd49adb2d77a53fcbfc789'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:05.520327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814543e519fd49adb2d77a53fcbfc789'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:05.558109 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2016/4046] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:17:05 2022] DELETE /identity/v3/users/814543e519fd49adb2d77a53fcbfc789 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:05.560615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6db99-4c24-4d09-a935-0b076dcc8fbc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:05.561454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6db99-4c24-4d09-a935-0b076dcc8fbc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:05.561955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6db99-4c24-4d09-a935-0b076dcc8fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:05.593298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-85d6db99-4c24-4d09-a935-0b076dcc8fbc None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:05.594596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-85d6db99-4c24-4d09-a935-0b076dcc8fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:05.676820 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2031/4047] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:05.687088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:05.690658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:05.763431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc01c5e-51d3-438c-8d17-43b750da9d1e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:05.769195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260ca19-5e74-486b-8462-a768286fa9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:05.770353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260ca19-5e74-486b-8462-a768286fa9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:05.770353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260ca19-5e74-486b-8462-a768286fa9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:05.770615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260ca19-5e74-486b-8462-a768286fa9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:05.783582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260ca19-5e74-486b-8462-a768286fa9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:05.784956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260ca19-5e74-486b-8462-a768286fa9e7 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:05.795295 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2017/4048] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:05.992332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6db99-4c24-4d09-a935-0b076dcc8fbc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:05.993844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-85d6db99-4c24-4d09-a935-0b076dcc8fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:06.008136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6db99-4c24-4d09-a935-0b076dcc8fbc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:06.014194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753fa45-9dc4-4068-8f9c-ff79d537f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:06.014830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753fa45-9dc4-4068-8f9c-ff79d537f543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:06.015451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753fa45-9dc4-4068-8f9c-ff79d537f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:06.015785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753fa45-9dc4-4068-8f9c-ff79d537f543 admin admin] PATH_INFO: `/v3/projects/c0277877f8e9446eab80467f42a8369c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:06.016902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753fa45-9dc4-4068-8f9c-ff79d537f543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0277877f8e9446eab80467f42a8369c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:06.018885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753fa45-9dc4-4068-8f9c-ff79d537f543 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:06.079724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4753fa45-9dc4-4068-8f9c-ff79d537f543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0277877f8e9446eab80467f42a8369c', 'request_id': 'req-4753fa45-9dc4-4068-8f9c-ff79d537f543'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:06.086767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4753fa45-9dc4-4068-8f9c-ff79d537f543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0277877f8e9446eab80467f42a8369c', 'request_id': 'req-4753fa45-9dc4-4068-8f9c-ff79d537f543'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:06.097883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4753fa45-9dc4-4068-8f9c-ff79d537f543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0277877f8e9446eab80467f42a8369c', 'request_id': 'req-4753fa45-9dc4-4068-8f9c-ff79d537f543'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:06.131023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4753fa45-9dc4-4068-8f9c-ff79d537f543 admin admin] The token cache is being invalidate because project c0277877f8e9446eab80467f42a8369c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:17:06.131539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4753fa45-9dc4-4068-8f9c-ff79d537f543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:06.132422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4753fa45-9dc4-4068-8f9c-ff79d537f543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:06.134675 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2032/4049] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:17:05 2022] DELETE /identity/v3/projects/c0277877f8e9446eab80467f42a8369c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:06.139494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535b65e-b7e9-4dc2-82f1-ff805c2a7746 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:06.139853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535b65e-b7e9-4dc2-82f1-ff805c2a7746 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:06.140210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535b65e-b7e9-4dc2-82f1-ff805c2a7746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:06.172948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9535b65e-b7e9-4dc2-82f1-ff805c2a7746 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:06.174894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9535b65e-b7e9-4dc2-82f1-ff805c2a7746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:06.266558 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2018/4050] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:06.274838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4a41c-e33a-438d-b516-425fbd431d72 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:06.275266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4a41c-e33a-438d-b516-425fbd431d72 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:06.275435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4a41c-e33a-438d-b516-425fbd431d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:06.300178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-75e4a41c-e33a-438d-b516-425fbd431d72 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:06.301247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-75e4a41c-e33a-438d-b516-425fbd431d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:06.312136 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2033/4051] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:06.316830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535b65e-b7e9-4dc2-82f1-ff805c2a7746 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:06.327713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535b65e-b7e9-4dc2-82f1-ff805c2a7746 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:06.333069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e656a-9016-4a14-bc19-171d8c0a304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:06.333695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e656a-9016-4a14-bc19-171d8c0a304d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:06.333979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e656a-9016-4a14-bc19-171d8c0a304d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:06.334245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e656a-9016-4a14-bc19-171d8c0a304d admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:06.335263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e656a-9016-4a14-bc19-171d8c0a304d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:17:06.335685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e656a-9016-4a14-bc19-171d8c0a304d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:06.337375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e656a-9016-4a14-bc19-171d8c0a304d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:06.354903 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2019/4052] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:17:06.356167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4a41c-e33a-438d-b516-425fbd431d72 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:06.367256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4a41c-e33a-438d-b516-425fbd431d72 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:06.372858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebae03-755c-4a65-8f66-6aa71aca164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:06.374264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebae03-755c-4a65-8f66-6aa71aca164c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:06.374264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebae03-755c-4a65-8f66-6aa71aca164c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:06.374264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebae03-755c-4a65-8f66-6aa71aca164c admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:06.375265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebae03-755c-4a65-8f66-6aa71aca164c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:06.377385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebae03-755c-4a65-8f66-6aa71aca164c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:06.414966 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2034/4053] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:17:06 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:17:06.419148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e656a-9016-4a14-bc19-171d8c0a304d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:06.425646 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:06.432827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e656a-9016-4a14-bc19-171d8c0a304d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:06.498391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d941a83-01f6-40db-b865-1d4a5c7305d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:06.499214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d941a83-01f6-40db-b865-1d4a5c7305d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:06.499673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d941a83-01f6-40db-b865-1d4a5c7305d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:06.500045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d941a83-01f6-40db-b865-1d4a5c7305d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:06.501262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d941a83-01f6-40db-b865-1d4a5c7305d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:06.503345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d941a83-01f6-40db-b865-1d4a5c7305d3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:06.535638 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2020/4054] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:17:06 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:17:06.539964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebae03-755c-4a65-8f66-6aa71aca164c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:06.556733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebae03-755c-4a65-8f66-6aa71aca164c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:06.563722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30855077-169c-45f5-82a1-f7e9834d2841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:06.564414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30855077-169c-45f5-82a1-f7e9834d2841 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:06.564787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30855077-169c-45f5-82a1-f7e9834d2841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:06.565135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30855077-169c-45f5-82a1-f7e9834d2841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:06.565875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30855077-169c-45f5-82a1-f7e9834d2841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:06.567791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30855077-169c-45f5-82a1-f7e9834d2841 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:06.583587 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2035/4055] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:17:06.584917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d941a83-01f6-40db-b865-1d4a5c7305d3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:06.596781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d941a83-01f6-40db-b865-1d4a5c7305d3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:06.602506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6ac3c-11e2-4f98-a7a4-dc6b9a073aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:06.602506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6ac3c-11e2-4f98-a7a4-dc6b9a073aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:06.602811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6ac3c-11e2-4f98-a7a4-dc6b9a073aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:06.603153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6ac3c-11e2-4f98-a7a4-dc6b9a073aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:06.603891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6ac3c-11e2-4f98-a7a4-dc6b9a073aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:06.605580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6ac3c-11e2-4f98-a7a4-dc6b9a073aa2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:06.621152 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2021/4056] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:17:06.623556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30855077-169c-45f5-82a1-f7e9834d2841 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:06.642086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30855077-169c-45f5-82a1-f7e9834d2841 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:06.650796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bb67c-5b68-4ee4-b907-be0ce4f807ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:06.651563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bb67c-5b68-4ee4-b907-be0ce4f807ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:06.651848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bb67c-5b68-4ee4-b907-be0ce4f807ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:06.652131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bb67c-5b68-4ee4-b907-be0ce4f807ff admin admin] PATH_INFO: `/v3/projects/4bd3cd83557c45579af99d0317d640a4/users/6eddc5173bac438785209750756f2fdb/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:06.686847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bb67c-5b68-4ee4-b907-be0ce4f807ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd3cd83557c45579af99d0317d640a4, user_id=6eddc5173bac438785209750756f2fdb, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:06.692892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bb67c-5b68-4ee4-b907-be0ce4f807ff admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:06.719567 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2036/4057] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:17:06 2022] PUT /identity/v3/projects/4bd3cd83557c45579af99d0317d640a4/users/6eddc5173bac438785209750756f2fdb/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:06.731190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05ccb1-dbb5-49b8-9ce3-492656c6969e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:06.731551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05ccb1-dbb5-49b8-9ce3-492656c6969e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:06.731788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05ccb1-dbb5-49b8-9ce3-492656c6969e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:06.766185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dd05ccb1-dbb5-49b8-9ce3-492656c6969e None None] MFA Rules not processed for user `6eddc5173bac438785209750756f2fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:06.768444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dd05ccb1-dbb5-49b8-9ce3-492656c6969e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:06.851818 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2022/4058] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:06.864235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bb67c-5b68-4ee4-b907-be0ce4f807ff admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:06.866441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-007bb67c-5b68-4ee4-b907-be0ce4f807ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:06.877025 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:06.950146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bb67c-5b68-4ee4-b907-be0ce4f807ff admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:06.956594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482079db-6369-49f6-9bc6-a7a1ad567875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:06.957728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482079db-6369-49f6-9bc6-a7a1ad567875 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:06.958178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482079db-6369-49f6-9bc6-a7a1ad567875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:06.958615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482079db-6369-49f6-9bc6-a7a1ad567875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:06.972893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482079db-6369-49f6-9bc6-a7a1ad567875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:06.974859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482079db-6369-49f6-9bc6-a7a1ad567875 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:06.987683 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2037/4059] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:17:08.817651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83435dd7-a4df-41a7-9953-4fcb367f4b14 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:08.818229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83435dd7-a4df-41a7-9953-4fcb367f4b14 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:08.818435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83435dd7-a4df-41a7-9953-4fcb367f4b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:08.866261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-83435dd7-a4df-41a7-9953-4fcb367f4b14 None None] MFA Rules not processed for user `b7cdbf32b68a44a28e4cc9c4210b5e56`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:08.867754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-83435dd7-a4df-41a7-9953-4fcb367f4b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:08.960072 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:08.967504 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2023/4060] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:08.978934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d46b54-e4b7-4655-a10a-e768cf7f6db9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:08.979739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d46b54-e4b7-4655-a10a-e768cf7f6db9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:08.979739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d46b54-e4b7-4655-a10a-e768cf7f6db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:09.000903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-04d46b54-e4b7-4655-a10a-e768cf7f6db9 None None] MFA Rules not processed for user `b7cdbf32b68a44a28e4cc9c4210b5e56`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:09.002504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-04d46b54-e4b7-4655-a10a-e768cf7f6db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:09.017070 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2038/4061] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:09.024985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83435dd7-a4df-41a7-9953-4fcb367f4b14 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:09.026622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-83435dd7-a4df-41a7-9953-4fcb367f4b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:09.147951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83435dd7-a4df-41a7-9953-4fcb367f4b14 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:09.162930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902af9a-15d3-42a8-98c3-50805fa1ad27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:09.163772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902af9a-15d3-42a8-98c3-50805fa1ad27 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:09.164173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902af9a-15d3-42a8-98c3-50805fa1ad27 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:09.164524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902af9a-15d3-42a8-98c3-50805fa1ad27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:09.179008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902af9a-15d3-42a8-98c3-50805fa1ad27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:09.181625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902af9a-15d3-42a8-98c3-50805fa1ad27 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:09.196224 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2024/4062] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:11.582381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d46b54-e4b7-4655-a10a-e768cf7f6db9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:11.584614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-04d46b54-e4b7-4655-a10a-e768cf7f6db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:11.748791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d46b54-e4b7-4655-a10a-e768cf7f6db9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:11.757925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9456d-264b-4dba-91a0-00d2050d810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:11.759605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9456d-264b-4dba-91a0-00d2050d810b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:11.760998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9456d-264b-4dba-91a0-00d2050d810b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:11.762086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9456d-264b-4dba-91a0-00d2050d810b admin admin] PATH_INFO: `/v3/users/0c8da9a32cb54d0a87d914234b1e9f40` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:11.798411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9456d-264b-4dba-91a0-00d2050d810b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c8da9a32cb54d0a87d914234b1e9f40)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:11.823007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9456d-264b-4dba-91a0-00d2050d810b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:11.957485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-86a9456d-264b-4dba-91a0-00d2050d810b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c8da9a32cb54d0a87d914234b1e9f40'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:11.958446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-86a9456d-264b-4dba-91a0-00d2050d810b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c8da9a32cb54d0a87d914234b1e9f40'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:12.013971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-86a9456d-264b-4dba-91a0-00d2050d810b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c8da9a32cb54d0a87d914234b1e9f40'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:12.025906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-86a9456d-264b-4dba-91a0-00d2050d810b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c8da9a32cb54d0a87d914234b1e9f40'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:12.054504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-86a9456d-264b-4dba-91a0-00d2050d810b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c8da9a32cb54d0a87d914234b1e9f40'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:12.112520 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2039/4063] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:17:11 2022] DELETE /identity/v3/users/0c8da9a32cb54d0a87d914234b1e9f40 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:12.686374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902af9a-15d3-42a8-98c3-50805fa1ad27 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:12.711814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902af9a-15d3-42a8-98c3-50805fa1ad27 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:12.825052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cedc6c-9982-4b67-b2e4-bf0320b37c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:12.825724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cedc6c-9982-4b67-b2e4-bf0320b37c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:12.826008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cedc6c-9982-4b67-b2e4-bf0320b37c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:12.826285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cedc6c-9982-4b67-b2e4-bf0320b37c49 admin admin] PATH_INFO: `/v3/projects/cb799a0263a14d1a93ba6e3fd37c260a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:12.869836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cedc6c-9982-4b67-b2e4-bf0320b37c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb799a0263a14d1a93ba6e3fd37c260a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:12.871901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cedc6c-9982-4b67-b2e4-bf0320b37c49 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:12.985051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06cedc6c-9982-4b67-b2e4-bf0320b37c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb799a0263a14d1a93ba6e3fd37c260a', 'request_id': 'req-06cedc6c-9982-4b67-b2e4-bf0320b37c49'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:12.998571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06cedc6c-9982-4b67-b2e4-bf0320b37c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb799a0263a14d1a93ba6e3fd37c260a', 'request_id': 'req-06cedc6c-9982-4b67-b2e4-bf0320b37c49'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:13.011403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06cedc6c-9982-4b67-b2e4-bf0320b37c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb799a0263a14d1a93ba6e3fd37c260a', 'request_id': 'req-06cedc6c-9982-4b67-b2e4-bf0320b37c49'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:13.025796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06cedc6c-9982-4b67-b2e4-bf0320b37c49 admin admin] The token cache is being invalidate because project cb799a0263a14d1a93ba6e3fd37c260a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:17:13.026298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06cedc6c-9982-4b67-b2e4-bf0320b37c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:13.027527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06cedc6c-9982-4b67-b2e4-bf0320b37c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:13.035238 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2025/4064] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:17:12 2022] DELETE /identity/v3/projects/cb799a0263a14d1a93ba6e3fd37c260a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:13.035416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd36d8-e824-4497-b3ce-d61a5adbb908 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:13.035881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd36d8-e824-4497-b3ce-d61a5adbb908 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:13.035881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd36d8-e824-4497-b3ce-d61a5adbb908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:13.074973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b8cd36d8-e824-4497-b3ce-d61a5adbb908 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:13.076315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b8cd36d8-e824-4497-b3ce-d61a5adbb908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:13.083850 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:13.179018 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2040/4065] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:13.277926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8304d-4708-4c8f-9933-a424c995ba6f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:13.278206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8304d-4708-4c8f-9933-a424c995ba6f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:13.278482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8304d-4708-4c8f-9933-a424c995ba6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:13.306357 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:13.328791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-22b8304d-4708-4c8f-9933-a424c995ba6f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:13.332170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-22b8304d-4708-4c8f-9933-a424c995ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:13.349459 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2026/4066] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:17:13.353240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd36d8-e824-4497-b3ce-d61a5adbb908 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:13.367477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd36d8-e824-4497-b3ce-d61a5adbb908 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:13.374650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69c134-db9e-41d0-9626-763f706d0033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:13.375807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69c134-db9e-41d0-9626-763f706d0033 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:13.376316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69c134-db9e-41d0-9626-763f706d0033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:13.376760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69c134-db9e-41d0-9626-763f706d0033 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:13.377570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69c134-db9e-41d0-9626-763f706d0033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:17:13.378571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69c134-db9e-41d0-9626-763f706d0033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:13.380405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69c134-db9e-41d0-9626-763f706d0033 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:13.400779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8304d-4708-4c8f-9933-a424c995ba6f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:13.410900 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2041/4067] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:17:13.412817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8304d-4708-4c8f-9933-a424c995ba6f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:13.419062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69e2b1-ca81-4019-8f1f-b180d71d8f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:13.419932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69e2b1-ca81-4019-8f1f-b180d71d8f11 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:13.420411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69e2b1-ca81-4019-8f1f-b180d71d8f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:13.420848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69e2b1-ca81-4019-8f1f-b180d71d8f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:13.421940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69e2b1-ca81-4019-8f1f-b180d71d8f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:13.425271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69e2b1-ca81-4019-8f1f-b180d71d8f11 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:13.471452 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2027/4068] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:17:13 2022] POST /identity/v3/projects => generated 393 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:17:13.475600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69c134-db9e-41d0-9626-763f706d0033 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:13.491627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69c134-db9e-41d0-9626-763f706d0033 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:13.585411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08d33e-23e1-4409-ab52-0654c0febdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:13.587375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08d33e-23e1-4409-ab52-0654c0febdbe admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:13.587375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08d33e-23e1-4409-ab52-0654c0febdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:13.587375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08d33e-23e1-4409-ab52-0654c0febdbe admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:13.587375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08d33e-23e1-4409-ab52-0654c0febdbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:13.590383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08d33e-23e1-4409-ab52-0654c0febdbe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:13.653404 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2042/4069] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:17:13 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:17:13.653936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69e2b1-ca81-4019-8f1f-b180d71d8f11 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:13.664770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69e2b1-ca81-4019-8f1f-b180d71d8f11 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:13.670406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a4e57-e0c5-44cf-a373-763532a5b910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:13.671157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a4e57-e0c5-44cf-a373-763532a5b910 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:13.671636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a4e57-e0c5-44cf-a373-763532a5b910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:13.672234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a4e57-e0c5-44cf-a373-763532a5b910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:13.673380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a4e57-e0c5-44cf-a373-763532a5b910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:13.675388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a4e57-e0c5-44cf-a373-763532a5b910 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:13.691693 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2028/4070] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:17:13.696278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08d33e-23e1-4409-ab52-0654c0febdbe admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:13.710181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08d33e-23e1-4409-ab52-0654c0febdbe admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:13.719912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6e75d-0815-4189-a59e-f59e9ed6c080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:13.720614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e75d-0815-4189-a59e-f59e9ed6c080 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:13.720965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e75d-0815-4189-a59e-f59e9ed6c080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:13.721315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e75d-0815-4189-a59e-f59e9ed6c080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:13.722205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6e75d-0815-4189-a59e-f59e9ed6c080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:13.724109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6e75d-0815-4189-a59e-f59e9ed6c080 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:13.738961 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2043/4071] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:17:13.740948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a4e57-e0c5-44cf-a373-763532a5b910 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:13.755670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a4e57-e0c5-44cf-a373-763532a5b910 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:13.761862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424cd01-3cd3-41d6-996d-d0bca3afd6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:13.762636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424cd01-3cd3-41d6-996d-d0bca3afd6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:13.762951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424cd01-3cd3-41d6-996d-d0bca3afd6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:13.763229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424cd01-3cd3-41d6-996d-d0bca3afd6d0 admin admin] PATH_INFO: `/v3/projects/01cfed1efa1c408287e3e10f4e0afcb2/users/50a92243b35f45a6bbcab9d288ae5271/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:13.788008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424cd01-3cd3-41d6-996d-d0bca3afd6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01cfed1efa1c408287e3e10f4e0afcb2, user_id=50a92243b35f45a6bbcab9d288ae5271, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:13.791120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424cd01-3cd3-41d6-996d-d0bca3afd6d0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:13.808300 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2029/4072] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:17:13 2022] PUT /identity/v3/projects/01cfed1efa1c408287e3e10f4e0afcb2/users/50a92243b35f45a6bbcab9d288ae5271/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:17:13.814271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71208c-ace7-4bc7-87ea-14b879d9397c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:13.814843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71208c-ace7-4bc7-87ea-14b879d9397c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:13.815346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71208c-ace7-4bc7-87ea-14b879d9397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:13.842023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8f71208c-ace7-4bc7-87ea-14b879d9397c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:13.844735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8f71208c-ace7-4bc7-87ea-14b879d9397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:13.935019 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2044/4073] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:13.944793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424cd01-3cd3-41d6-996d-d0bca3afd6d0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:13.946544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8424cd01-3cd3-41d6-996d-d0bca3afd6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:14.017112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424cd01-3cd3-41d6-996d-d0bca3afd6d0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:14.021201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d908b-9558-4828-be12-44b82d2aef31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:14.021826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d908b-9558-4828-be12-44b82d2aef31 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:14.022725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d908b-9558-4828-be12-44b82d2aef31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:14.023041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d908b-9558-4828-be12-44b82d2aef31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:14.034268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d908b-9558-4828-be12-44b82d2aef31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:14.035827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d908b-9558-4828-be12-44b82d2aef31 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:14.048618 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2030/4074] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:23.910406 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:24.048638 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:24.115097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebfa27-74c8-4721-b448-9e28ed8c798a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:24.115674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebfa27-74c8-4721-b448-9e28ed8c798a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:24.116158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebfa27-74c8-4721-b448-9e28ed8c798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:24.261260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ebebfa27-74c8-4721-b448-9e28ed8c798a None None] MFA Rules not processed for user `50a92243b35f45a6bbcab9d288ae5271`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:24.268782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ebebfa27-74c8-4721-b448-9e28ed8c798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:24.436540 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2045/4075] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:24.456282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9c726-4a4f-4ef6-98b1-4436961b47fe None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:24.456564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9c726-4a4f-4ef6-98b1-4436961b47fe None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:24.458584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9c726-4a4f-4ef6-98b1-4436961b47fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:24.543707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fab9c726-4a4f-4ef6-98b1-4436961b47fe None None] MFA Rules not processed for user `50a92243b35f45a6bbcab9d288ae5271`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:24.546390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fab9c726-4a4f-4ef6-98b1-4436961b47fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:24.562828 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2031/4076] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:24.673279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebfa27-74c8-4721-b448-9e28ed8c798a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:24.674988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ebebfa27-74c8-4721-b448-9e28ed8c798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:24.834685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebfa27-74c8-4721-b448-9e28ed8c798a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:24.845576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6effd1e-d9b7-454c-b675-d31dc59cf1c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:24.848871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6effd1e-d9b7-454c-b675-d31dc59cf1c9 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:24.848871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6effd1e-d9b7-454c-b675-d31dc59cf1c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:24.848871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6effd1e-d9b7-454c-b675-d31dc59cf1c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:24.858781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6effd1e-d9b7-454c-b675-d31dc59cf1c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:24.862896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6effd1e-d9b7-454c-b675-d31dc59cf1c9 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:24.877080 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2046/4077] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:27.191062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41624-cc1e-418a-83e6-70739ebedffd None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:27.192099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41624-cc1e-418a-83e6-70739ebedffd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:27.192610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41624-cc1e-418a-83e6-70739ebedffd None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:27.195772 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2032/4078] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:17:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:17:27.202124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3d46a-fa2a-42cd-b58a-c016f97266c8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:27.202596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3d46a-fa2a-42cd-b58a-c016f97266c8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:27.203540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3d46a-fa2a-42cd-b58a-c016f97266c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:27.300016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-47f3d46a-fa2a-42cd-b58a-c016f97266c8 None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:27.303174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47f3d46a-fa2a-42cd-b58a-c016f97266c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:27.330206 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2047/4079] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:17:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:27.380061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41624-cc1e-418a-83e6-70739ebedffd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:27.382443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-10f41624-cc1e-418a-83e6-70739ebedffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:27.418327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41624-cc1e-418a-83e6-70739ebedffd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:27.424108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4be8bc-aa74-494a-921b-59fb213e31cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:27.424862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4be8bc-aa74-494a-921b-59fb213e31cb service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:27.425141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4be8bc-aa74-494a-921b-59fb213e31cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:27.425502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4be8bc-aa74-494a-921b-59fb213e31cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:27.447310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4be8bc-aa74-494a-921b-59fb213e31cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:27.452859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4be8bc-aa74-494a-921b-59fb213e31cb service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:27.486402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3d46a-fa2a-42cd-b58a-c016f97266c8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:27.487947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47f3d46a-fa2a-42cd-b58a-c016f97266c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:27.498316 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2033/4080] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:27.511073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3d46a-fa2a-42cd-b58a-c016f97266c8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:27.518854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:27.519563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:27.519841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:27.520115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] PATH_INFO: `/v3/users/6eddc5173bac438785209750756f2fdb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:27.522148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eddc5173bac438785209750756f2fdb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:27.524686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:27.651852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eddc5173bac438785209750756f2fdb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:27.652523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eddc5173bac438785209750756f2fdb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:27.657970 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:27.688192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eddc5173bac438785209750756f2fdb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:27.699798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eddc5173bac438785209750756f2fdb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:27.702138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eddc5173bac438785209750756f2fdb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:27.723478 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2048/4081] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:17:27 2022] DELETE /identity/v3/users/6eddc5173bac438785209750756f2fdb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:27.728000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463fc92-8ecd-4456-96e8-f7deb2c84818 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:27.728315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463fc92-8ecd-4456-96e8-f7deb2c84818 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:27.728557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463fc92-8ecd-4456-96e8-f7deb2c84818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:27.758475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4463fc92-8ecd-4456-96e8-f7deb2c84818 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:27.760088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4463fc92-8ecd-4456-96e8-f7deb2c84818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:27.933566 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2034/4082] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:27.955898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:27.957675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:28.085629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9bcb0-c619-4ad3-b44d-77c576fc86bd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:28.096132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0e662-61b5-4651-8921-aebe093f5526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:28.096777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0e662-61b5-4651-8921-aebe093f5526 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:28.097318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0e662-61b5-4651-8921-aebe093f5526 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:28.097688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0e662-61b5-4651-8921-aebe093f5526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:28.127331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0e662-61b5-4651-8921-aebe093f5526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:28.128922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0e662-61b5-4651-8921-aebe093f5526 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:28.173262 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2049/4083] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:28.956406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463fc92-8ecd-4456-96e8-f7deb2c84818 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:28.958521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4463fc92-8ecd-4456-96e8-f7deb2c84818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:28.981003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463fc92-8ecd-4456-96e8-f7deb2c84818 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:28.990342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1af5ee-10a4-4b49-b9b7-911e115f1060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:28.991025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1af5ee-10a4-4b49-b9b7-911e115f1060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:28.991301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1af5ee-10a4-4b49-b9b7-911e115f1060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:28.991565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1af5ee-10a4-4b49-b9b7-911e115f1060 admin admin] PATH_INFO: `/v3/projects/4bd3cd83557c45579af99d0317d640a4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:28.997261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1af5ee-10a4-4b49-b9b7-911e115f1060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd3cd83557c45579af99d0317d640a4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:29.002452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1af5ee-10a4-4b49-b9b7-911e115f1060 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:29.139459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da1af5ee-10a4-4b49-b9b7-911e115f1060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd3cd83557c45579af99d0317d640a4', 'request_id': 'req-da1af5ee-10a4-4b49-b9b7-911e115f1060'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:29.154602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da1af5ee-10a4-4b49-b9b7-911e115f1060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd3cd83557c45579af99d0317d640a4', 'request_id': 'req-da1af5ee-10a4-4b49-b9b7-911e115f1060'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:29.202580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da1af5ee-10a4-4b49-b9b7-911e115f1060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd3cd83557c45579af99d0317d640a4', 'request_id': 'req-da1af5ee-10a4-4b49-b9b7-911e115f1060'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:29.238434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da1af5ee-10a4-4b49-b9b7-911e115f1060 admin admin] The token cache is being invalidate because project 4bd3cd83557c45579af99d0317d640a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:17:29.246648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da1af5ee-10a4-4b49-b9b7-911e115f1060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:29.250381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da1af5ee-10a4-4b49-b9b7-911e115f1060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:29.253172 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2035/4084] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:17:28 2022] DELETE /identity/v3/projects/4bd3cd83557c45579af99d0317d640a4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:29.258205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a38cf-347d-4f12-b13b-157b98c2fa33 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:29.258750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a38cf-347d-4f12-b13b-157b98c2fa33 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:29.258750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a38cf-347d-4f12-b13b-157b98c2fa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:29.303057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ed0a38cf-347d-4f12-b13b-157b98c2fa33 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:29.304311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ed0a38cf-347d-4f12-b13b-157b98c2fa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:29.481386 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2050/4085] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:29.489494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d1a24-7e5f-47b1-9664-37cca1656a66 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:29.489824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d1a24-7e5f-47b1-9664-37cca1656a66 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:29.490100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d1a24-7e5f-47b1-9664-37cca1656a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:29.543146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c13d1a24-7e5f-47b1-9664-37cca1656a66 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:29.545930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c13d1a24-7e5f-47b1-9664-37cca1656a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:29.571306 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2036/4086] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:29.575537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a38cf-347d-4f12-b13b-157b98c2fa33 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:29.592620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a38cf-347d-4f12-b13b-157b98c2fa33 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:29.605583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a58ccc-b0cf-438b-b518-d9670c81acdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:29.607459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a58ccc-b0cf-438b-b518-d9670c81acdd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:29.608559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a58ccc-b0cf-438b-b518-d9670c81acdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:29.609857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a58ccc-b0cf-438b-b518-d9670c81acdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:29.611373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a58ccc-b0cf-438b-b518-d9670c81acdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:17:29.611875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a58ccc-b0cf-438b-b518-d9670c81acdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:29.614267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a58ccc-b0cf-438b-b518-d9670c81acdd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:29.650225 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2051/4087] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:17:29.652796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d1a24-7e5f-47b1-9664-37cca1656a66 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:29.668615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d1a24-7e5f-47b1-9664-37cca1656a66 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:29.676301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e95e8-116e-4a08-9643-9393d390b7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:29.696122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e95e8-116e-4a08-9643-9393d390b7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:29.696682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e95e8-116e-4a08-9643-9393d390b7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:29.698145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e95e8-116e-4a08-9643-9393d390b7b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:29.699167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e95e8-116e-4a08-9643-9393d390b7b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:29.717915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e95e8-116e-4a08-9643-9393d390b7b4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:29.848706 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2037/4088] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:17:29 2022] POST /identity/v3/projects => generated 371 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:17:29.852869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a58ccc-b0cf-438b-b518-d9670c81acdd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:29.868212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a58ccc-b0cf-438b-b518-d9670c81acdd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:29.989674 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:29.997825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6392-00a0-47c0-a7da-d77d36ded4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:29.999228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6392-00a0-47c0-a7da-d77d36ded4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:30.000375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6392-00a0-47c0-a7da-d77d36ded4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:30.000674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6392-00a0-47c0-a7da-d77d36ded4c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:30.001534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f6392-00a0-47c0-a7da-d77d36ded4c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:30.003645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f6392-00a0-47c0-a7da-d77d36ded4c7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:30.062048 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2052/4089] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:17:29 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:17:30.066473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e95e8-116e-4a08-9643-9393d390b7b4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:30.082344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e95e8-116e-4a08-9643-9393d390b7b4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:30.087506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf8ad8-2b6e-493a-bc03-98ddee2a012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:30.088192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf8ad8-2b6e-493a-bc03-98ddee2a012d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:30.088692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf8ad8-2b6e-493a-bc03-98ddee2a012d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:30.089127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf8ad8-2b6e-493a-bc03-98ddee2a012d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:30.090263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf8ad8-2b6e-493a-bc03-98ddee2a012d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:30.092188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf8ad8-2b6e-493a-bc03-98ddee2a012d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:30.110349 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2038/4090] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:17:30.114505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6392-00a0-47c0-a7da-d77d36ded4c7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:30.126267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6392-00a0-47c0-a7da-d77d36ded4c7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:30.140378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5e7d3-adcd-4e98-bc92-f75dc1f347b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:30.141538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5e7d3-adcd-4e98-bc92-f75dc1f347b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:30.141996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5e7d3-adcd-4e98-bc92-f75dc1f347b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:30.142446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5e7d3-adcd-4e98-bc92-f75dc1f347b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:30.143297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5e7d3-adcd-4e98-bc92-f75dc1f347b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:30.145119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5e7d3-adcd-4e98-bc92-f75dc1f347b1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:30.180517 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2053/4091] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:17:30.184845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf8ad8-2b6e-493a-bc03-98ddee2a012d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:30.196241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf8ad8-2b6e-493a-bc03-98ddee2a012d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:30.201149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b0663-adde-45f4-84d1-3f63123e93ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:30.201821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0663-adde-45f4-84d1-3f63123e93ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:30.202361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0663-adde-45f4-84d1-3f63123e93ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:30.203026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0663-adde-45f4-84d1-3f63123e93ad admin admin] PATH_INFO: `/v3/projects/c5d82cee88304968a3a7c9ed85846cd2/users/c9b46f42638f4fab96f767528b07a2b5/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:30.233282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b0663-adde-45f4-84d1-3f63123e93ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d82cee88304968a3a7c9ed85846cd2, user_id=c9b46f42638f4fab96f767528b07a2b5, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:30.237012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b0663-adde-45f4-84d1-3f63123e93ad admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:30.261825 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:30.285253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9e88-84b5-4a06-ae65-4e7de3991b08 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:30.285822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9e88-84b5-4a06-ae65-4e7de3991b08 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:30.285822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9e88-84b5-4a06-ae65-4e7de3991b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:30.298081 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2039/4092] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:17:30 2022] PUT /identity/v3/projects/c5d82cee88304968a3a7c9ed85846cd2/users/c9b46f42638f4fab96f767528b07a2b5/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:30.383965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e56d9e88-84b5-4a06-ae65-4e7de3991b08 None None] MFA Rules not processed for user `c9b46f42638f4fab96f767528b07a2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:30.385288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e56d9e88-84b5-4a06-ae65-4e7de3991b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:30.562280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b0663-adde-45f4-84d1-3f63123e93ad admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:30.564460 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2054/4093] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:30.636135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b0663-adde-45f4-84d1-3f63123e93ad admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:30.643337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b12cd4-f2c7-432d-9706-e1f3d7e9a2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:30.644093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b12cd4-f2c7-432d-9706-e1f3d7e9a2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:30.644470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b12cd4-f2c7-432d-9706-e1f3d7e9a2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:30.645046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b12cd4-f2c7-432d-9706-e1f3d7e9a2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:30.646476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b12cd4-f2c7-432d-9706-e1f3d7e9a2d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:30.649048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b12cd4-f2c7-432d-9706-e1f3d7e9a2d4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:30.703293 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2040/4094] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:17:30 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:17:30.705679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d9e88-84b5-4a06-ae65-4e7de3991b08 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:30.724225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d9e88-84b5-4a06-ae65-4e7de3991b08 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:30.851755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac64b6-1501-47e8-a9e7-bc455a2a70a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:30.852577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac64b6-1501-47e8-a9e7-bc455a2a70a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:30.852968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac64b6-1501-47e8-a9e7-bc455a2a70a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:30.853337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac64b6-1501-47e8-a9e7-bc455a2a70a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:30.854109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac64b6-1501-47e8-a9e7-bc455a2a70a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:30.856383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac64b6-1501-47e8-a9e7-bc455a2a70a8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:30.899472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b12cd4-f2c7-432d-9706-e1f3d7e9a2d4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:30.900850 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2055/4095] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:17:30 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:17:30.923085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b12cd4-f2c7-432d-9706-e1f3d7e9a2d4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:30.940740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cd615-8532-4bdb-b367-488ecd5f4c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:30.941454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd615-8532-4bdb-b367-488ecd5f4c21 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:30.941740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd615-8532-4bdb-b367-488ecd5f4c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:30.942013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd615-8532-4bdb-b367-488ecd5f4c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:30.942954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cd615-8532-4bdb-b367-488ecd5f4c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:30.944475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cd615-8532-4bdb-b367-488ecd5f4c21 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:30.976063 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2041/4096] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:17:30.977475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac64b6-1501-47e8-a9e7-bc455a2a70a8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:31.003321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac64b6-1501-47e8-a9e7-bc455a2a70a8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:31.010166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b449f-731c-4857-999c-04bce9170af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:31.011230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b449f-731c-4857-999c-04bce9170af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:31.011754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b449f-731c-4857-999c-04bce9170af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:31.013035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b449f-731c-4857-999c-04bce9170af1 admin admin] PATH_INFO: `/v3/projects/16628aab2cb54c538182a331a7934b94/users/70d6db8acf4a4a85af69dfcb13580c99/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:31.032805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b449f-731c-4857-999c-04bce9170af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16628aab2cb54c538182a331a7934b94, user_id=70d6db8acf4a4a85af69dfcb13580c99, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:31.037541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b449f-731c-4857-999c-04bce9170af1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:31.061660 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2056/4097] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:17:30 2022] PUT /identity/v3/projects/16628aab2cb54c538182a331a7934b94/users/70d6db8acf4a4a85af69dfcb13580c99/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:31.063530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cd615-8532-4bdb-b367-488ecd5f4c21 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:31.078167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cd615-8532-4bdb-b367-488ecd5f4c21 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:31.160589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55648d-cfc0-4ca4-b467-395c13dc887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:31.161695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55648d-cfc0-4ca4-b467-395c13dc887a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:31.162215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55648d-cfc0-4ca4-b467-395c13dc887a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:31.162626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55648d-cfc0-4ca4-b467-395c13dc887a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:31.163537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55648d-cfc0-4ca4-b467-395c13dc887a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:31.166369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55648d-cfc0-4ca4-b467-395c13dc887a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:31.184987 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2042/4098] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:17:31.186600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b449f-731c-4857-999c-04bce9170af1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:31.204847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b449f-731c-4857-999c-04bce9170af1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:31.213103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58290c2e-955c-4613-860d-428c05472cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:31.214666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58290c2e-955c-4613-860d-428c05472cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:31.215242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58290c2e-955c-4613-860d-428c05472cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:31.215737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58290c2e-955c-4613-860d-428c05472cb5 admin admin] PATH_INFO: `/v3/projects/16628aab2cb54c538182a331a7934b94/users/70d6db8acf4a4a85af69dfcb13580c99/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:31.220215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58290c2e-955c-4613-860d-428c05472cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16628aab2cb54c538182a331a7934b94, user_id=70d6db8acf4a4a85af69dfcb13580c99, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:31.223805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58290c2e-955c-4613-860d-428c05472cb5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:31.250401 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2057/4099] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:17:31 2022] PUT /identity/v3/projects/16628aab2cb54c538182a331a7934b94/users/70d6db8acf4a4a85af69dfcb13580c99/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:31.252888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd149239-0828-4bd1-8bbb-2017086d3916 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:31.253185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd149239-0828-4bd1-8bbb-2017086d3916 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:31.253518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd149239-0828-4bd1-8bbb-2017086d3916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:31.295393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fd149239-0828-4bd1-8bbb-2017086d3916 None None] MFA Rules not processed for user `70d6db8acf4a4a85af69dfcb13580c99`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:31.297420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fd149239-0828-4bd1-8bbb-2017086d3916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:31.401913 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:31.417002 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2043/4100] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:17:31.430755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58290c2e-955c-4613-860d-428c05472cb5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:31.432531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-58290c2e-955c-4613-860d-428c05472cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:31.477999 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:31.598854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58290c2e-955c-4613-860d-428c05472cb5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:31.606068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242711d-f3db-4022-8eb7-2b5d1412583b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:31.606710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242711d-f3db-4022-8eb7-2b5d1412583b service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:31.607000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242711d-f3db-4022-8eb7-2b5d1412583b service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:31.607305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242711d-f3db-4022-8eb7-2b5d1412583b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:31.631729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242711d-f3db-4022-8eb7-2b5d1412583b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:31.634708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242711d-f3db-4022-8eb7-2b5d1412583b service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:31.648990 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2058/4101] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:32.360472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd149239-0828-4bd1-8bbb-2017086d3916 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:32.550835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd149239-0828-4bd1-8bbb-2017086d3916 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:32.559269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:32.559931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:32.560202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:32.560647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] PATH_INFO: `/v3/users/c9b46f42638f4fab96f767528b07a2b5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:32.566802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b46f42638f4fab96f767528b07a2b5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:32.570990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:32.711025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b46f42638f4fab96f767528b07a2b5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:32.711971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b46f42638f4fab96f767528b07a2b5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:32.751953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b46f42638f4fab96f767528b07a2b5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:32.779440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b46f42638f4fab96f767528b07a2b5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:32.795578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b46f42638f4fab96f767528b07a2b5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:32.822163 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2044/4102] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:17:32 2022] DELETE /identity/v3/users/c9b46f42638f4fab96f767528b07a2b5 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:32.829971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d61ea-ecc8-4651-a262-0a6bb74de38b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:32.830865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d61ea-ecc8-4651-a262-0a6bb74de38b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:32.831172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d61ea-ecc8-4651-a262-0a6bb74de38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:32.856576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-891d61ea-ecc8-4651-a262-0a6bb74de38b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:32.857838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-891d61ea-ecc8-4651-a262-0a6bb74de38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:32.944602 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2059/4103] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:32.964142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:32.966260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:33.096869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7466a-d06f-47ed-bb6f-bfcde68f0ee7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:33.106173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d413ac-ea10-4ec0-8d7a-c43bdb2a75e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:33.107012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d413ac-ea10-4ec0-8d7a-c43bdb2a75e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:33.107297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d413ac-ea10-4ec0-8d7a-c43bdb2a75e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:33.107566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d413ac-ea10-4ec0-8d7a-c43bdb2a75e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:33.130302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d413ac-ea10-4ec0-8d7a-c43bdb2a75e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:33.132034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d413ac-ea10-4ec0-8d7a-c43bdb2a75e7 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:33.144657 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2045/4104] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:34.103219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d61ea-ecc8-4651-a262-0a6bb74de38b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:34.104727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-891d61ea-ecc8-4651-a262-0a6bb74de38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:34.119782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d61ea-ecc8-4651-a262-0a6bb74de38b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:34.125830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:34.127070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:34.127568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:34.128049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] PATH_INFO: `/v3/projects/c5d82cee88304968a3a7c9ed85846cd2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:34.129456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d82cee88304968a3a7c9ed85846cd2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:34.131971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:34.225251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d82cee88304968a3a7c9ed85846cd2', 'request_id': 'req-501f0b59-0ef0-4ac7-8baa-a228949bf467'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:34.232197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d82cee88304968a3a7c9ed85846cd2', 'request_id': 'req-501f0b59-0ef0-4ac7-8baa-a228949bf467'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:34.242711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d82cee88304968a3a7c9ed85846cd2', 'request_id': 'req-501f0b59-0ef0-4ac7-8baa-a228949bf467'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:34.256594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] The token cache is being invalidate because project c5d82cee88304968a3a7c9ed85846cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:17:34.257278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:34.258183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:34.260052 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2060/4105] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:17:34 2022] DELETE /identity/v3/projects/c5d82cee88304968a3a7c9ed85846cd2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:34.264833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d413ac-ea10-4ec0-8d7a-c43bdb2a75e7 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:34.279768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d413ac-ea10-4ec0-8d7a-c43bdb2a75e7 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:34.298897 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:34.386608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c68a7-3dcf-401a-9a22-d0b1ed4ae554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:34.387836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c68a7-3dcf-401a-9a22-d0b1ed4ae554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:34.388307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c68a7-3dcf-401a-9a22-d0b1ed4ae554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:34.388771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c68a7-3dcf-401a-9a22-d0b1ed4ae554 admin admin] PATH_INFO: `/v3/users/70d6db8acf4a4a85af69dfcb13580c99` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:34.392384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c68a7-3dcf-401a-9a22-d0b1ed4ae554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d6db8acf4a4a85af69dfcb13580c99)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:34.402164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c68a7-3dcf-401a-9a22-d0b1ed4ae554 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:34.490006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd6c68a7-3dcf-401a-9a22-d0b1ed4ae554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d6db8acf4a4a85af69dfcb13580c99'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:34.491098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd6c68a7-3dcf-401a-9a22-d0b1ed4ae554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d6db8acf4a4a85af69dfcb13580c99'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:34.510303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd6c68a7-3dcf-401a-9a22-d0b1ed4ae554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d6db8acf4a4a85af69dfcb13580c99'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:34.521055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd6c68a7-3dcf-401a-9a22-d0b1ed4ae554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d6db8acf4a4a85af69dfcb13580c99'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:34.522027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd6c68a7-3dcf-401a-9a22-d0b1ed4ae554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d6db8acf4a4a85af69dfcb13580c99'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:34.555020 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2046/4106] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:17:34 2022] DELETE /identity/v3/users/70d6db8acf4a4a85af69dfcb13580c99 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:17:34.902487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:34.904245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:34.955327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0b59-0ef0-4ac7-8baa-a228949bf467 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:35.002092 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:35.057792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b40420-c469-4716-a031-6b4f32767576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:35.058395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b40420-c469-4716-a031-6b4f32767576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:35.058673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b40420-c469-4716-a031-6b4f32767576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:35.058974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b40420-c469-4716-a031-6b4f32767576 admin admin] PATH_INFO: `/v3/projects/16628aab2cb54c538182a331a7934b94` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:35.060096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b40420-c469-4716-a031-6b4f32767576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16628aab2cb54c538182a331a7934b94)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:35.062680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b40420-c469-4716-a031-6b4f32767576 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:35.122387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-34b40420-c469-4716-a031-6b4f32767576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16628aab2cb54c538182a331a7934b94', 'request_id': 'req-34b40420-c469-4716-a031-6b4f32767576'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:35.131533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-34b40420-c469-4716-a031-6b4f32767576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16628aab2cb54c538182a331a7934b94', 'request_id': 'req-34b40420-c469-4716-a031-6b4f32767576'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:35.140874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-34b40420-c469-4716-a031-6b4f32767576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16628aab2cb54c538182a331a7934b94', 'request_id': 'req-34b40420-c469-4716-a031-6b4f32767576'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:35.159794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-34b40420-c469-4716-a031-6b4f32767576 admin admin] The token cache is being invalidate because project 16628aab2cb54c538182a331a7934b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:17:35.160365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-34b40420-c469-4716-a031-6b4f32767576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:35.161647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-34b40420-c469-4716-a031-6b4f32767576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:35.162878 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2061/4107] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:17:34 2022] DELETE /identity/v3/projects/16628aab2cb54c538182a331a7934b94 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:35.167734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68d537-dccf-4688-aacb-17ab65dad667 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:35.168763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68d537-dccf-4688-aacb-17ab65dad667 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:35.168763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68d537-dccf-4688-aacb-17ab65dad667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:35.190639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-db68d537-dccf-4688-aacb-17ab65dad667 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:35.191448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-db68d537-dccf-4688-aacb-17ab65dad667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:35.283102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c5f7d-3c7f-4bf4-950b-f129fe4cbdab None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:35.283532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c5f7d-3c7f-4bf4-950b-f129fe4cbdab None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:35.283968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c5f7d-3c7f-4bf4-950b-f129fe4cbdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:35.287850 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2047/4108] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:17:35.311668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2f7c5f7d-3c7f-4bf4-950b-f129fe4cbdab None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:35.313226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2f7c5f7d-3c7f-4bf4-950b-f129fe4cbdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:35.326306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68d537-dccf-4688-aacb-17ab65dad667 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:35.327131 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2062/4109] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:35.337370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68d537-dccf-4688-aacb-17ab65dad667 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:35.342183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470902d2-7e71-4942-894e-4c94bd18cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:35.343002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470902d2-7e71-4942-894e-4c94bd18cabe admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:35.343950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470902d2-7e71-4942-894e-4c94bd18cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:35.344655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470902d2-7e71-4942-894e-4c94bd18cabe admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:35.345356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470902d2-7e71-4942-894e-4c94bd18cabe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:17:35.345690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470902d2-7e71-4942-894e-4c94bd18cabe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:35.347270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470902d2-7e71-4942-894e-4c94bd18cabe admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:35.359715 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2048/4110] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:17:35.364473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c5f7d-3c7f-4bf4-950b-f129fe4cbdab None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:35.375512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c5f7d-3c7f-4bf4-950b-f129fe4cbdab None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:35.382663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660755a-89c8-4417-813a-6984d4f2f843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:35.383654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660755a-89c8-4417-813a-6984d4f2f843 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:35.384114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660755a-89c8-4417-813a-6984d4f2f843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:35.384638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660755a-89c8-4417-813a-6984d4f2f843 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:35.385527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660755a-89c8-4417-813a-6984d4f2f843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:35.388704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660755a-89c8-4417-813a-6984d4f2f843 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:35.418407 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2063/4111] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:17:35 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:17:35.423013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470902d2-7e71-4942-894e-4c94bd18cabe admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:35.449163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470902d2-7e71-4942-894e-4c94bd18cabe admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:35.472917 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:35.519244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db300a5-f746-470b-8ec5-5dde2c7dac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:35.520110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db300a5-f746-470b-8ec5-5dde2c7dac97 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:35.520383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db300a5-f746-470b-8ec5-5dde2c7dac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:35.520661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db300a5-f746-470b-8ec5-5dde2c7dac97 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:35.521293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db300a5-f746-470b-8ec5-5dde2c7dac97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:35.523232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db300a5-f746-470b-8ec5-5dde2c7dac97 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:35.553359 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2049/4112] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:17:35 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:17:35.566458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660755a-89c8-4417-813a-6984d4f2f843 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:35.579620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660755a-89c8-4417-813a-6984d4f2f843 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:35.584696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2fc3f-d6dc-4ebf-b4f8-d3f25f9cc49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:35.585388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2fc3f-d6dc-4ebf-b4f8-d3f25f9cc49b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:35.585662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2fc3f-d6dc-4ebf-b4f8-d3f25f9cc49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:35.585932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2fc3f-d6dc-4ebf-b4f8-d3f25f9cc49b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:35.586561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2fc3f-d6dc-4ebf-b4f8-d3f25f9cc49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:35.588193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2fc3f-d6dc-4ebf-b4f8-d3f25f9cc49b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:35.599972 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2064/4113] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:17:35.605387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db300a5-f746-470b-8ec5-5dde2c7dac97 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:35.617054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db300a5-f746-470b-8ec5-5dde2c7dac97 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:35.622873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41046d02-e01b-4ece-ba1d-1768f52e58bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:35.623517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41046d02-e01b-4ece-ba1d-1768f52e58bc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:35.623791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41046d02-e01b-4ece-ba1d-1768f52e58bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:35.624059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41046d02-e01b-4ece-ba1d-1768f52e58bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:35.625471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41046d02-e01b-4ece-ba1d-1768f52e58bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:35.627739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41046d02-e01b-4ece-ba1d-1768f52e58bc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:35.645315 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2050/4114] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:17:35.649700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2fc3f-d6dc-4ebf-b4f8-d3f25f9cc49b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:35.668673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2fc3f-d6dc-4ebf-b4f8-d3f25f9cc49b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:35.683555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beab39-e9d7-486c-9985-7c3a71810867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:35.684360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beab39-e9d7-486c-9985-7c3a71810867 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:35.684578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beab39-e9d7-486c-9985-7c3a71810867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:35.684857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beab39-e9d7-486c-9985-7c3a71810867 admin admin] PATH_INFO: `/v3/projects/a82be4de055440adbeda4e686b25085f/users/e8f699104f324cd699e40e20dac875d0/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:35.719236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4beab39-e9d7-486c-9985-7c3a71810867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a82be4de055440adbeda4e686b25085f, user_id=e8f699104f324cd699e40e20dac875d0, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:35.723407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4beab39-e9d7-486c-9985-7c3a71810867 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:35.753289 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2065/4115] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:17:35 2022] PUT /identity/v3/projects/a82be4de055440adbeda4e686b25085f/users/e8f699104f324cd699e40e20dac875d0/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:35.764801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0e4f9-48ea-4b4c-aa94-4d97c74d49db None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:35.765828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0e4f9-48ea-4b4c-aa94-4d97c74d49db None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:35.766371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0e4f9-48ea-4b4c-aa94-4d97c74d49db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:35.833883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-72b0e4f9-48ea-4b4c-aa94-4d97c74d49db None None] MFA Rules not processed for user `e8f699104f324cd699e40e20dac875d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:35.835342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-72b0e4f9-48ea-4b4c-aa94-4d97c74d49db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:35.951471 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2051/4116] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:35.956420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beab39-e9d7-486c-9985-7c3a71810867 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:36.079763 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:36.103623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beab39-e9d7-486c-9985-7c3a71810867 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:36.109859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f22c3-b90a-47aa-8024-602563efbf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:36.110809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f22c3-b90a-47aa-8024-602563efbf34 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:36.111347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f22c3-b90a-47aa-8024-602563efbf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:36.111847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f22c3-b90a-47aa-8024-602563efbf34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:36.112920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f22c3-b90a-47aa-8024-602563efbf34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:36.116291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f22c3-b90a-47aa-8024-602563efbf34 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:36.172049 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2066/4117] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:17:35 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:17:36.176197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0e4f9-48ea-4b4c-aa94-4d97c74d49db None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:36.197358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0e4f9-48ea-4b4c-aa94-4d97c74d49db None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:36.353187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0ea1e-47e5-4580-925e-9b89ca2cfe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:36.353956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0ea1e-47e5-4580-925e-9b89ca2cfe55 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:36.354246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0ea1e-47e5-4580-925e-9b89ca2cfe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:36.355780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0ea1e-47e5-4580-925e-9b89ca2cfe55 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:36.356450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0ea1e-47e5-4580-925e-9b89ca2cfe55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:36.358408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0ea1e-47e5-4580-925e-9b89ca2cfe55 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:36.428156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f22c3-b90a-47aa-8024-602563efbf34 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:36.443242 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2052/4118] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:17:36 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:17:36.448340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f22c3-b90a-47aa-8024-602563efbf34 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:36.457308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e198c-e60b-43d8-9e53-3160820e06eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:36.457937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e198c-e60b-43d8-9e53-3160820e06eb admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:36.458217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e198c-e60b-43d8-9e53-3160820e06eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:36.458598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e198c-e60b-43d8-9e53-3160820e06eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:36.459519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e198c-e60b-43d8-9e53-3160820e06eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:36.461161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e198c-e60b-43d8-9e53-3160820e06eb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:36.479096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0ea1e-47e5-4580-925e-9b89ca2cfe55 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:36.488951 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2067/4119] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:17:36.495666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0ea1e-47e5-4580-925e-9b89ca2cfe55 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:36.504578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce1790-37e8-4254-aea6-b19b541f2343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:36.505390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce1790-37e8-4254-aea6-b19b541f2343 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:36.505686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce1790-37e8-4254-aea6-b19b541f2343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:36.506122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce1790-37e8-4254-aea6-b19b541f2343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:36.506955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce1790-37e8-4254-aea6-b19b541f2343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:36.509429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce1790-37e8-4254-aea6-b19b541f2343 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:36.570120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e198c-e60b-43d8-9e53-3160820e06eb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:36.583520 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2053/4120] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:17:36.587865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e198c-e60b-43d8-9e53-3160820e06eb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:36.605962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76774186-656c-408e-a26f-262c32c318a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:36.606672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76774186-656c-408e-a26f-262c32c318a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:36.607008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76774186-656c-408e-a26f-262c32c318a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:36.607950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76774186-656c-408e-a26f-262c32c318a3 admin admin] PATH_INFO: `/v3/projects/d8f04fdc72754a61a0d29bf07b0f7e83/users/53f62c73fc6c4471a74dfb34eb99a871/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:36.644660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76774186-656c-408e-a26f-262c32c318a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f04fdc72754a61a0d29bf07b0f7e83, user_id=53f62c73fc6c4471a74dfb34eb99a871, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:36.647946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76774186-656c-408e-a26f-262c32c318a3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:36.677265 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2068/4121] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:17:36 2022] PUT /identity/v3/projects/d8f04fdc72754a61a0d29bf07b0f7e83/users/53f62c73fc6c4471a74dfb34eb99a871/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:17:36.689413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f3af1-ae76-4e40-bcec-676c948d3215 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:36.689704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f3af1-ae76-4e40-bcec-676c948d3215 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:36.689981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f3af1-ae76-4e40-bcec-676c948d3215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:36.724213 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:36.746059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ba5f3af1-ae76-4e40-bcec-676c948d3215 None None] MFA Rules not processed for user `53f62c73fc6c4471a74dfb34eb99a871`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:36.747305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba5f3af1-ae76-4e40-bcec-676c948d3215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:36.870048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76774186-656c-408e-a26f-262c32c318a3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:36.870328 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2054/4122] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:37.005075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76774186-656c-408e-a26f-262c32c318a3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:37.023724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eefc36-dfc0-47ce-8318-1046da06e7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:37.024368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eefc36-dfc0-47ce-8318-1046da06e7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:37.024650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eefc36-dfc0-47ce-8318-1046da06e7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:37.025116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eefc36-dfc0-47ce-8318-1046da06e7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:37.025769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eefc36-dfc0-47ce-8318-1046da06e7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:37.029980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eefc36-dfc0-47ce-8318-1046da06e7e8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:37.074986 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2069/4123] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:17:36 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:17:37.076368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f3af1-ae76-4e40-bcec-676c948d3215 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:37.090823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f3af1-ae76-4e40-bcec-676c948d3215 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:37.221603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba9f73-de1b-4b9d-8b8e-0dce8f1a5772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:37.222950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9f73-de1b-4b9d-8b8e-0dce8f1a5772 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:37.224347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9f73-de1b-4b9d-8b8e-0dce8f1a5772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:37.226784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9f73-de1b-4b9d-8b8e-0dce8f1a5772 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:37.227643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba9f73-de1b-4b9d-8b8e-0dce8f1a5772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:37.230403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba9f73-de1b-4b9d-8b8e-0dce8f1a5772 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:37.272788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eefc36-dfc0-47ce-8318-1046da06e7e8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:37.277470 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2055/4124] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:17:37 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:17:37.286128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eefc36-dfc0-47ce-8318-1046da06e7e8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:37.291406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4978a-4f18-4c45-80a9-f044dd01a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:37.292353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4978a-4f18-4c45-80a9-f044dd01a1fb admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:37.292850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4978a-4f18-4c45-80a9-f044dd01a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:37.293381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4978a-4f18-4c45-80a9-f044dd01a1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:37.294249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4978a-4f18-4c45-80a9-f044dd01a1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:37.297451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4978a-4f18-4c45-80a9-f044dd01a1fb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:37.311707 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2070/4125] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:17:37.316274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba9f73-de1b-4b9d-8b8e-0dce8f1a5772 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:37.333406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba9f73-de1b-4b9d-8b8e-0dce8f1a5772 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:37.341139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e50428-84e7-43eb-b03e-61c633cf6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:37.342014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e50428-84e7-43eb-b03e-61c633cf6290 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:37.342476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e50428-84e7-43eb-b03e-61c633cf6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:37.343575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e50428-84e7-43eb-b03e-61c633cf6290 admin admin] PATH_INFO: `/v3/projects/c2cda3d1179c497e8c9535fefc8ccd03/users/d03cd5060f6e4d92a6dba9d49e8f86d0/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:37.369767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e50428-84e7-43eb-b03e-61c633cf6290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2cda3d1179c497e8c9535fefc8ccd03, user_id=d03cd5060f6e4d92a6dba9d49e8f86d0, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:37.374021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e50428-84e7-43eb-b03e-61c633cf6290 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:37.410488 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2056/4126] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:17:37 2022] PUT /identity/v3/projects/c2cda3d1179c497e8c9535fefc8ccd03/users/d03cd5060f6e4d92a6dba9d49e8f86d0/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:17:37.414357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4978a-4f18-4c45-80a9-f044dd01a1fb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:37.435779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4978a-4f18-4c45-80a9-f044dd01a1fb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:37.544005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033127b9-f706-4874-90d7-a527f8225e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:37.545064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033127b9-f706-4874-90d7-a527f8225e47 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:37.545639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033127b9-f706-4874-90d7-a527f8225e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:37.548537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033127b9-f706-4874-90d7-a527f8225e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:37.549629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033127b9-f706-4874-90d7-a527f8225e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:37.551518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033127b9-f706-4874-90d7-a527f8225e47 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:37.581950 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2071/4127] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:17:37.588622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e50428-84e7-43eb-b03e-61c633cf6290 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:37.611187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e50428-84e7-43eb-b03e-61c633cf6290 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:37.617363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3dd9c-4c2e-48a8-8907-87286646887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:37.618403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3dd9c-4c2e-48a8-8907-87286646887d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:37.618847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3dd9c-4c2e-48a8-8907-87286646887d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:37.619306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3dd9c-4c2e-48a8-8907-87286646887d admin admin] PATH_INFO: `/v3/projects/c2cda3d1179c497e8c9535fefc8ccd03/users/d03cd5060f6e4d92a6dba9d49e8f86d0/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:37.621845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3dd9c-4c2e-48a8-8907-87286646887d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2cda3d1179c497e8c9535fefc8ccd03, user_id=d03cd5060f6e4d92a6dba9d49e8f86d0, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:37.626148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3dd9c-4c2e-48a8-8907-87286646887d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:37.642982 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2057/4128] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:17:37 2022] PUT /identity/v3/projects/c2cda3d1179c497e8c9535fefc8ccd03/users/d03cd5060f6e4d92a6dba9d49e8f86d0/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:37.653270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22cacd-f73f-4450-b6fd-bc02f7b1c981 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:37.653535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22cacd-f73f-4450-b6fd-bc02f7b1c981 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:37.653808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22cacd-f73f-4450-b6fd-bc02f7b1c981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:37.694451 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:37.709206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cc22cacd-f73f-4450-b6fd-bc02f7b1c981 None None] MFA Rules not processed for user `d03cd5060f6e4d92a6dba9d49e8f86d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:37.711992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc22cacd-f73f-4450-b6fd-bc02f7b1c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:37.871728 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2072/4129] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:37.884128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3dd9c-4c2e-48a8-8907-87286646887d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:37.887298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-64b3dd9c-4c2e-48a8-8907-87286646887d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:37.987496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3dd9c-4c2e-48a8-8907-87286646887d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:37.993184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38cb6d-bd41-4cfc-82a8-a4dc234fa816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:37.993899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38cb6d-bd41-4cfc-82a8-a4dc234fa816 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:37.994459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38cb6d-bd41-4cfc-82a8-a4dc234fa816 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:37.994459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38cb6d-bd41-4cfc-82a8-a4dc234fa816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:38.004248 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:38.008304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38cb6d-bd41-4cfc-82a8-a4dc234fa816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:38.009858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38cb6d-bd41-4cfc-82a8-a4dc234fa816 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:38.033398 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2058/4130] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:38.852785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22cacd-f73f-4450-b6fd-bc02f7b1c981 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:38.854398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc22cacd-f73f-4450-b6fd-bc02f7b1c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:38.880895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22cacd-f73f-4450-b6fd-bc02f7b1c981 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:38.886235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3478a72-b66c-4ef5-90c1-08d3dd8e18b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:38.887591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3478a72-b66c-4ef5-90c1-08d3dd8e18b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:38.888122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3478a72-b66c-4ef5-90c1-08d3dd8e18b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:38.888618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3478a72-b66c-4ef5-90c1-08d3dd8e18b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:39.076918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3478a72-b66c-4ef5-90c1-08d3dd8e18b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:39.078508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3478a72-b66c-4ef5-90c1-08d3dd8e18b8 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:39.098297 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2073/4131] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:48.024797 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:48.122815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56b9bc-228f-41b9-9bda-a61093a8f350 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:48.123460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56b9bc-228f-41b9-9bda-a61093a8f350 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:48.124703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56b9bc-228f-41b9-9bda-a61093a8f350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:48.170221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9b56b9bc-228f-41b9-9bda-a61093a8f350 None None] MFA Rules not processed for user `f1bfe0b4f344485ab6de52f7b1423118`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:48.171887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9b56b9bc-228f-41b9-9bda-a61093a8f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:48.300297 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2059/4132] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:48.768047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3478a72-b66c-4ef5-90c1-08d3dd8e18b8 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:48.778296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3478a72-b66c-4ef5-90c1-08d3dd8e18b8 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:48.789520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2298524-f5fa-4480-812a-370de1b94b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:48.790151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2298524-f5fa-4480-812a-370de1b94b07 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:48.790432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2298524-f5fa-4480-812a-370de1b94b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:48.795161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2298524-f5fa-4480-812a-370de1b94b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:48.912843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2298524-f5fa-4480-812a-370de1b94b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:48.919688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2298524-f5fa-4480-812a-370de1b94b07 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:48.956109 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2074/4133] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:49.331161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56b9bc-228f-41b9-9bda-a61093a8f350 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:49.332669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9b56b9bc-228f-41b9-9bda-a61093a8f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:49.509300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56b9bc-228f-41b9-9bda-a61093a8f350 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:49.518151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baca5c2-d411-44d9-8213-6b26f4b03d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:49.520811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baca5c2-d411-44d9-8213-6b26f4b03d01 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:49.522523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baca5c2-d411-44d9-8213-6b26f4b03d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:49.523093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baca5c2-d411-44d9-8213-6b26f4b03d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:49.527710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8baca5c2-d411-44d9-8213-6b26f4b03d01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:49.559690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baca5c2-d411-44d9-8213-6b26f4b03d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:49.563887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baca5c2-d411-44d9-8213-6b26f4b03d01 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:49.586324 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2060/4134] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:51.608825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bdcd4-3ca7-48dd-9c15-20de33741e8c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:51.609548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bdcd4-3ca7-48dd-9c15-20de33741e8c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:51.609548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bdcd4-3ca7-48dd-9c15-20de33741e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:51.647701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fa7bdcd4-3ca7-48dd-9c15-20de33741e8c None None] MFA Rules not processed for user `b7cdbf32b68a44a28e4cc9c4210b5e56`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:51.648960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fa7bdcd4-3ca7-48dd-9c15-20de33741e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:51.714669 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:51.765749 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2075/4135] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:55.444934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baca5c2-d411-44d9-8213-6b26f4b03d01 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:55.598421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baca5c2-d411-44d9-8213-6b26f4b03d01 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:55.611654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:55.613213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:55.613717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:55.614200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] PATH_INFO: `/v3/users/e8f699104f324cd699e40e20dac875d0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:55.618374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f699104f324cd699e40e20dac875d0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:55.622866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:55.735237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f699104f324cd699e40e20dac875d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:55.739337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f699104f324cd699e40e20dac875d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:55.743162 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:55.767927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f699104f324cd699e40e20dac875d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:55.782441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f699104f324cd699e40e20dac875d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:55.783140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f699104f324cd699e40e20dac875d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:55.809290 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2061/4136] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:17:55 2022] DELETE /identity/v3/users/e8f699104f324cd699e40e20dac875d0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:55.815304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28ab20-3ca2-4f8e-b0d1-73813a5858a6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:55.815791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28ab20-3ca2-4f8e-b0d1-73813a5858a6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:55.815791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28ab20-3ca2-4f8e-b0d1-73813a5858a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:55.864991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cb28ab20-3ca2-4f8e-b0d1-73813a5858a6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:17:55.867935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cb28ab20-3ca2-4f8e-b0d1-73813a5858a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:56.013253 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2076/4137] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:17:56.087970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:56.090525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:56.224582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f3011-c7e4-438b-85de-29292f0e00d0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:56.234326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a694d15-dc9a-489f-8344-04df06f08476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:56.235102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a694d15-dc9a-489f-8344-04df06f08476 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:56.237332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a694d15-dc9a-489f-8344-04df06f08476 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:56.237714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a694d15-dc9a-489f-8344-04df06f08476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:56.260780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a694d15-dc9a-489f-8344-04df06f08476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:56.264288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a694d15-dc9a-489f-8344-04df06f08476 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:56.293360 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2062/4138] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:17:57.353022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28ab20-3ca2-4f8e-b0d1-73813a5858a6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:57.354291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cb28ab20-3ca2-4f8e-b0d1-73813a5858a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:57.383655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28ab20-3ca2-4f8e-b0d1-73813a5858a6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:57.396709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:57.397362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:57.397695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:57.398243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] PATH_INFO: `/v3/projects/a82be4de055440adbeda4e686b25085f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:57.399895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a82be4de055440adbeda4e686b25085f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:57.402017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:57.476658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a82be4de055440adbeda4e686b25085f', 'request_id': 'req-78ace6c6-8d0c-40d4-9412-0744e739a4d1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:57.484799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a82be4de055440adbeda4e686b25085f', 'request_id': 'req-78ace6c6-8d0c-40d4-9412-0744e739a4d1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:57.503267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a82be4de055440adbeda4e686b25085f', 'request_id': 'req-78ace6c6-8d0c-40d4-9412-0744e739a4d1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:57.529863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] The token cache is being invalidate because project a82be4de055440adbeda4e686b25085f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:17:57.530654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:57.531393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:57.536262 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2077/4139] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:17:57 2022] DELETE /identity/v3/projects/a82be4de055440adbeda4e686b25085f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:57.537411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a694d15-dc9a-489f-8344-04df06f08476 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:57.551314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a694d15-dc9a-489f-8344-04df06f08476 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:57.674578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:57.676527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:57.677258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:57.677713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] PATH_INFO: `/v3/users/53f62c73fc6c4471a74dfb34eb99a871` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:57.679706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f62c73fc6c4471a74dfb34eb99a871)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:57.681825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:57.826896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f62c73fc6c4471a74dfb34eb99a871'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:57.828639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f62c73fc6c4471a74dfb34eb99a871'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:57.871662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f62c73fc6c4471a74dfb34eb99a871'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:57.893642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f62c73fc6c4471a74dfb34eb99a871'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:57.895589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f62c73fc6c4471a74dfb34eb99a871'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:57.897271 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:57.944613 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2063/4140] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:17:57 2022] DELETE /identity/v3/users/53f62c73fc6c4471a74dfb34eb99a871 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:17:59.403952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:59.406268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:59.481325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ace6c6-8d0c-40d4-9412-0744e739a4d1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:59.596510 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:59.637681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:59.639116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:59.639782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:59.640326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] PATH_INFO: `/v3/projects/d8f04fdc72754a61a0d29bf07b0f7e83` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:59.643122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f04fdc72754a61a0d29bf07b0f7e83)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:59.646695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:17:59.734082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f04fdc72754a61a0d29bf07b0f7e83', 'request_id': 'req-17639f9e-7b45-40ab-919b-72ec9466ad3a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:59.756033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f04fdc72754a61a0d29bf07b0f7e83', 'request_id': 'req-17639f9e-7b45-40ab-919b-72ec9466ad3a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:59.768219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f04fdc72754a61a0d29bf07b0f7e83', 'request_id': 'req-17639f9e-7b45-40ab-919b-72ec9466ad3a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:59.791779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] The token cache is being invalidate because project d8f04fdc72754a61a0d29bf07b0f7e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:17:59.792387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:59.793376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:17:59.796048 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2078/4141] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:17:59 2022] DELETE /identity/v3/projects/d8f04fdc72754a61a0d29bf07b0f7e83 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:17:59.800752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:17:59.805306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:17:59.866879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda032ee-d9d2-4e55-8520-971effb1108e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:17:59.950703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:17:59.951537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:17:59.952682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:17:59.953278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] PATH_INFO: `/v3/users/d03cd5060f6e4d92a6dba9d49e8f86d0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:17:59.955161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d03cd5060f6e4d92a6dba9d49e8f86d0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:17:59.957287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:00.082426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd03cd5060f6e4d92a6dba9d49e8f86d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:00.086314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd03cd5060f6e4d92a6dba9d49e8f86d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:00.131138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd03cd5060f6e4d92a6dba9d49e8f86d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:00.152636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd03cd5060f6e4d92a6dba9d49e8f86d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:00.153643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd03cd5060f6e4d92a6dba9d49e8f86d0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:00.204637 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2064/4142] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:17:59 2022] DELETE /identity/v3/users/d03cd5060f6e4d92a6dba9d49e8f86d0 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:00.664124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:00.666560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:00.704851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17639f9e-7b45-40ab-919b-72ec9466ad3a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:00.897831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e54e0-cc26-42c9-a0e0-902de9ad1ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:00.898810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e54e0-cc26-42c9-a0e0-902de9ad1ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:00.899343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e54e0-cc26-42c9-a0e0-902de9ad1ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:00.899813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e54e0-cc26-42c9-a0e0-902de9ad1ed8 admin admin] PATH_INFO: `/v3/users/374430fde21f45418245b0848be3f34b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:00.901640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e54e0-cc26-42c9-a0e0-902de9ad1ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=374430fde21f45418245b0848be3f34b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:00.904324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e54e0-cc26-42c9-a0e0-902de9ad1ed8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:01.038832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a43e54e0-cc26-42c9-a0e0-902de9ad1ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '374430fde21f45418245b0848be3f34b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:01.041624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a43e54e0-cc26-42c9-a0e0-902de9ad1ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '374430fde21f45418245b0848be3f34b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:01.064562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a43e54e0-cc26-42c9-a0e0-902de9ad1ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '374430fde21f45418245b0848be3f34b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:01.071772 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:01.081539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a43e54e0-cc26-42c9-a0e0-902de9ad1ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '374430fde21f45418245b0848be3f34b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:01.082722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a43e54e0-cc26-42c9-a0e0-902de9ad1ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '374430fde21f45418245b0848be3f34b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:01.108595 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2079/4143] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:18:00 2022] DELETE /identity/v3/users/374430fde21f45418245b0848be3f34b => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:01.391293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:01.392862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:01.444266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ddef3-40d8-46c0-8a31-f5758e8d7832 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:01.555186 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:01.625179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:01.626059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:01.627343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:01.627648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] PATH_INFO: `/v3/projects/c2cda3d1179c497e8c9535fefc8ccd03` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:01.631405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2cda3d1179c497e8c9535fefc8ccd03)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:01.633386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:01.745786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2cda3d1179c497e8c9535fefc8ccd03', 'request_id': 'req-7586aea5-78e0-41f9-ab7c-476a7f36e38c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:01.777453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2cda3d1179c497e8c9535fefc8ccd03', 'request_id': 'req-7586aea5-78e0-41f9-ab7c-476a7f36e38c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:01.797418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2cda3d1179c497e8c9535fefc8ccd03', 'request_id': 'req-7586aea5-78e0-41f9-ab7c-476a7f36e38c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:01.817155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] The token cache is being invalidate because project c2cda3d1179c497e8c9535fefc8ccd03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:18:01.817851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:01.818841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:01.826281 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2065/4144] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:18:01 2022] DELETE /identity/v3/projects/c2cda3d1179c497e8c9535fefc8ccd03 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:01.828762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3f366-248b-49d9-bb82-6e79473b56ed None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:01.829245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3f366-248b-49d9-bb82-6e79473b56ed None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:01.829363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3f366-248b-49d9-bb82-6e79473b56ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:01.898470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-efa3f366-248b-49d9-bb82-6e79473b56ed None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:01.899857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-efa3f366-248b-49d9-bb82-6e79473b56ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:01.984064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:01.986380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:02.052168 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2080/4145] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:02.053828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04d27-a922-4dac-a032-01b856395dea None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.054212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04d27-a922-4dac-a032-01b856395dea None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.054586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04d27-a922-4dac-a032-01b856395dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.085255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d3c04d27-a922-4dac-a032-01b856395dea None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:02.087906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d3c04d27-a922-4dac-a032-01b856395dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:02.112195 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2081/4146] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:02.113712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c04d27-a922-4dac-a032-01b856395dea None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:02.149316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c04d27-a922-4dac-a032-01b856395dea None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:02.149773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586aea5-78e0-41f9-ab7c-476a7f36e38c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:02.157307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:02.158430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.158860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.159242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff admin admin] PATH_INFO: `/v3/projects/ba3c4e3bdfdc43cea845dab830afc479` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.160000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e659077-3395-4525-9702-3d9d5d7312d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:02.160662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3c4e3bdfdc43cea845dab830afc479)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:02.162046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659077-3395-4525-9702-3d9d5d7312d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.162415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659077-3395-4525-9702-3d9d5d7312d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.163061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:02.164318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659077-3395-4525-9702-3d9d5d7312d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.165286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e659077-3395-4525-9702-3d9d5d7312d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:18:02.165787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e659077-3395-4525-9702-3d9d5d7312d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:02.169313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e659077-3395-4525-9702-3d9d5d7312d8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:02.213345 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2082/4147] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:18:02.218348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e659077-3395-4525-9702-3d9d5d7312d8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:02.234654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e659077-3395-4525-9702-3d9d5d7312d8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:02.237550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3c4e3bdfdc43cea845dab830afc479', 'request_id': 'req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:02.247007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3c4e3bdfdc43cea845dab830afc479', 'request_id': 'req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:02.255909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3c4e3bdfdc43cea845dab830afc479', 'request_id': 'req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:02.267498 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:02.283062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff admin admin] The token cache is being invalidate because project ba3c4e3bdfdc43cea845dab830afc479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:18:02.283417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:02.284425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-02996b2c-f244-40f2-bdf0-d1fcca1c96ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:02.292750 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2066/4148] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:18:01 2022] DELETE /identity/v3/projects/ba3c4e3bdfdc43cea845dab830afc479 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:18:02.294874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6f716-1270-4416-a5d8-b1d4ac37b106 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.294874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6f716-1270-4416-a5d8-b1d4ac37b106 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.297169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6f716-1270-4416-a5d8-b1d4ac37b106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.325661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b6a6f716-1270-4416-a5d8-b1d4ac37b106 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:02.327644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b6a6f716-1270-4416-a5d8-b1d4ac37b106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:02.333803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cecab-d5e2-402c-8814-0970f74d335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:02.335509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cecab-d5e2-402c-8814-0970f74d335c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.336397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cecab-d5e2-402c-8814-0970f74d335c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.336897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cecab-d5e2-402c-8814-0970f74d335c admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.337658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cecab-d5e2-402c-8814-0970f74d335c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:02.338963 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2067/4149] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:18:02.340821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cecab-d5e2-402c-8814-0970f74d335c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:02.347864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379c59-9054-46f3-9977-ad396ef71703 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.348873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379c59-9054-46f3-9977-ad396ef71703 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.349227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379c59-9054-46f3-9977-ad396ef71703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.383556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-30379c59-9054-46f3-9977-ad396ef71703 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:02.385214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-30379c59-9054-46f3-9977-ad396ef71703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:02.385515 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2083/4150] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:18:02 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:18:02.392259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cecab-d5e2-402c-8814-0970f74d335c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:02.394467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-475cecab-d5e2-402c-8814-0970f74d335c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:02.488551 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:02.512687 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2068/4151] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:18:02.515372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30379c59-9054-46f3-9977-ad396ef71703 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:02.538392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cecab-d5e2-402c-8814-0970f74d335c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:02.557905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30379c59-9054-46f3-9977-ad396ef71703 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:02.558812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ea70b-a120-4f06-b59d-fa290bd2e066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:02.562718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ea70b-a120-4f06-b59d-fa290bd2e066 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.562718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ea70b-a120-4f06-b59d-fa290bd2e066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.562718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ea70b-a120-4f06-b59d-fa290bd2e066 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.563304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ea70b-a120-4f06-b59d-fa290bd2e066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:02.566311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ea70b-a120-4f06-b59d-fa290bd2e066 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:02.573324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570bc04-1b3a-4ccc-8a4c-38b7e9139488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:02.574339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570bc04-1b3a-4ccc-8a4c-38b7e9139488 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.575614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570bc04-1b3a-4ccc-8a4c-38b7e9139488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.576107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570bc04-1b3a-4ccc-8a4c-38b7e9139488 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.577575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570bc04-1b3a-4ccc-8a4c-38b7e9139488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:18:02.578097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570bc04-1b3a-4ccc-8a4c-38b7e9139488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:02.579784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570bc04-1b3a-4ccc-8a4c-38b7e9139488 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:02.603274 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2069/4152] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:18:02.606982 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2084/4153] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:18:02 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:18:02.607176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570bc04-1b3a-4ccc-8a4c-38b7e9139488 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:02.611568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ea70b-a120-4f06-b59d-fa290bd2e066 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:02.617237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570bc04-1b3a-4ccc-8a4c-38b7e9139488 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:02.622439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6917e-8d0a-461e-aeb4-8e731f1e3828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:02.623106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6917e-8d0a-461e-aeb4-8e731f1e3828 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.623385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6917e-8d0a-461e-aeb4-8e731f1e3828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.624359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6917e-8d0a-461e-aeb4-8e731f1e3828 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.625597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6917e-8d0a-461e-aeb4-8e731f1e3828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:02.627427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6917e-8d0a-461e-aeb4-8e731f1e3828 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:02.635292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ea70b-a120-4f06-b59d-fa290bd2e066 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:02.642650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766edd22-065c-4741-ba15-3bded55ef914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:02.643827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766edd22-065c-4741-ba15-3bded55ef914 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.644219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766edd22-065c-4741-ba15-3bded55ef914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.644567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766edd22-065c-4741-ba15-3bded55ef914 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.645452 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2070/4154] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:02.646383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766edd22-065c-4741-ba15-3bded55ef914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:02.649676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766edd22-065c-4741-ba15-3bded55ef914 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:02.649841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6917e-8d0a-461e-aeb4-8e731f1e3828 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:02.660891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6917e-8d0a-461e-aeb4-8e731f1e3828 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:02.666816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329c6d4-0b33-4a6b-aef7-bfc26a769472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:02.667661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329c6d4-0b33-4a6b-aef7-bfc26a769472 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.668009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329c6d4-0b33-4a6b-aef7-bfc26a769472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.668352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329c6d4-0b33-4a6b-aef7-bfc26a769472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.669617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329c6d4-0b33-4a6b-aef7-bfc26a769472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:02.671359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329c6d4-0b33-4a6b-aef7-bfc26a769472 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:02.692037 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2071/4155] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:02.694001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329c6d4-0b33-4a6b-aef7-bfc26a769472 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:02.704367 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2085/4156] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:18:02 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:18:02.707061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766edd22-065c-4741-ba15-3bded55ef914 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:02.716508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329c6d4-0b33-4a6b-aef7-bfc26a769472 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:02.818732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766edd22-065c-4741-ba15-3bded55ef914 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:02.834819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b312a2-5906-4793-ac1e-e6d67f35f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:02.836395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b312a2-5906-4793-ac1e-e6d67f35f40c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.837387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b312a2-5906-4793-ac1e-e6d67f35f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.839903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b312a2-5906-4793-ac1e-e6d67f35f40c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.840813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b312a2-5906-4793-ac1e-e6d67f35f40c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:02.843161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b312a2-5906-4793-ac1e-e6d67f35f40c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:02.852568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6667c3-0b14-44a9-bd2e-1fa2b58765c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:02.854110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6667c3-0b14-44a9-bd2e-1fa2b58765c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.856222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6667c3-0b14-44a9-bd2e-1fa2b58765c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.856550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6667c3-0b14-44a9-bd2e-1fa2b58765c5 admin admin] PATH_INFO: `/v3/projects/175247df801a4d189382ba300d75da20/users/cbb04b3ceb0a4b5483dbcbadd62651ea/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.896675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6667c3-0b14-44a9-bd2e-1fa2b58765c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=175247df801a4d189382ba300d75da20, user_id=cbb04b3ceb0a4b5483dbcbadd62651ea, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:02.899616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6667c3-0b14-44a9-bd2e-1fa2b58765c5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:02.901960 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2086/4157] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:18:02 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:18:02.902849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b312a2-5906-4793-ac1e-e6d67f35f40c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:02.925731 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2072/4158] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:18:02 2022] PUT /identity/v3/projects/175247df801a4d189382ba300d75da20/users/cbb04b3ceb0a4b5483dbcbadd62651ea/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:02.929689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b312a2-5906-4793-ac1e-e6d67f35f40c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:02.939707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e19ff-c884-4235-a225-83a1651ff2b4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:02.940035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e19ff-c884-4235-a225-83a1651ff2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:02.940330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e19ff-c884-4235-a225-83a1651ff2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:02.994321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0f6e19ff-c884-4235-a225-83a1651ff2b4 None None] MFA Rules not processed for user `cbb04b3ceb0a4b5483dbcbadd62651ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:02.995587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0f6e19ff-c884-4235-a225-83a1651ff2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:03.028475 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:03.059412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd2944-67cd-431e-b660-196a8f15761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:03.060257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd2944-67cd-431e-b660-196a8f15761e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:03.060787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd2944-67cd-431e-b660-196a8f15761e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:03.062380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd2944-67cd-431e-b660-196a8f15761e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:03.062841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd2944-67cd-431e-b660-196a8f15761e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:03.064855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd2944-67cd-431e-b660-196a8f15761e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:03.080771 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2087/4159] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:03.085187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd2944-67cd-431e-b660-196a8f15761e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:03.099910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd2944-67cd-431e-b660-196a8f15761e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:03.101531 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2073/4160] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:18:03.105928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068544ea-e4ad-4d57-a97d-cd0e1d426d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:03.106600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068544ea-e4ad-4d57-a97d-cd0e1d426d77 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:03.107296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068544ea-e4ad-4d57-a97d-cd0e1d426d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:03.107653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068544ea-e4ad-4d57-a97d-cd0e1d426d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:03.108779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e19ff-c884-4235-a225-83a1651ff2b4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:03.109295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068544ea-e4ad-4d57-a97d-cd0e1d426d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:03.115482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068544ea-e4ad-4d57-a97d-cd0e1d426d77 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:03.123005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e19ff-c884-4235-a225-83a1651ff2b4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:03.130590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64eddd9-579b-434c-9730-1bfed55d26b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:03.131674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64eddd9-579b-434c-9730-1bfed55d26b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:03.132182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64eddd9-579b-434c-9730-1bfed55d26b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:03.132968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64eddd9-579b-434c-9730-1bfed55d26b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:03.133957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64eddd9-579b-434c-9730-1bfed55d26b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:03.136909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64eddd9-579b-434c-9730-1bfed55d26b8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:03.147546 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2088/4161] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:03.148512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068544ea-e4ad-4d57-a97d-cd0e1d426d77 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:03.182086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068544ea-e4ad-4d57-a97d-cd0e1d426d77 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:03.189511 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2074/4162] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:18:03 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:18:03.194092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64eddd9-579b-434c-9730-1bfed55d26b8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:03.203092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720f3b6-1fe6-4571-a3ed-88b13bc46f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:03.207370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720f3b6-1fe6-4571-a3ed-88b13bc46f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:03.210236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720f3b6-1fe6-4571-a3ed-88b13bc46f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:03.211131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720f3b6-1fe6-4571-a3ed-88b13bc46f92 admin admin] PATH_INFO: `/v3/projects/1d22602edce34f6390374c40afcfd113/users/1cf0ec54a3f54abd90ece8de2aa70ffc/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:03.283478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720f3b6-1fe6-4571-a3ed-88b13bc46f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d22602edce34f6390374c40afcfd113, user_id=1cf0ec54a3f54abd90ece8de2aa70ffc, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:03.293712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720f3b6-1fe6-4571-a3ed-88b13bc46f92 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:03.336542 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2089/4163] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:18:03 2022] PUT /identity/v3/projects/1d22602edce34f6390374c40afcfd113/users/1cf0ec54a3f54abd90ece8de2aa70ffc/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:03.342288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3d97-ff37-4691-9874-1b7f5d1f5d30 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:03.342802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3d97-ff37-4691-9874-1b7f5d1f5d30 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:03.343985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3d97-ff37-4691-9874-1b7f5d1f5d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:03.357242 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:03.382398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64eddd9-579b-434c-9730-1bfed55d26b8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:03.393620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-eebf3d97-ff37-4691-9874-1b7f5d1f5d30 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:03.400443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eebf3d97-ff37-4691-9874-1b7f5d1f5d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:03.493432 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2090/4164] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:18:03.507427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3d97-ff37-4691-9874-1b7f5d1f5d30 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:03.513990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eebf3d97-ff37-4691-9874-1b7f5d1f5d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:03.517780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6aaeb-acdf-49f9-97a7-bbb045312b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:03.519188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6aaeb-acdf-49f9-97a7-bbb045312b50 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:03.519903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6aaeb-acdf-49f9-97a7-bbb045312b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:03.520376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6aaeb-acdf-49f9-97a7-bbb045312b50 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:03.521304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6aaeb-acdf-49f9-97a7-bbb045312b50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:03.523485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6aaeb-acdf-49f9-97a7-bbb045312b50 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:03.599605 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2075/4165] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:18:03 2022] POST /identity/v3/users => generated 298 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:18:03.601575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6aaeb-acdf-49f9-97a7-bbb045312b50 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:03.620133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3d97-ff37-4691-9874-1b7f5d1f5d30 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:03.624640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a87cd-23f1-448e-8335-03b8db1997cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:03.625588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a87cd-23f1-448e-8335-03b8db1997cb service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:03.625982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a87cd-23f1-448e-8335-03b8db1997cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:03.626182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6aaeb-acdf-49f9-97a7-bbb045312b50 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:03.626517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a87cd-23f1-448e-8335-03b8db1997cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:03.633678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9c09c-5a10-41a7-99d1-769abadcc35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:03.635263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9c09c-5a10-41a7-99d1-769abadcc35f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:03.635701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9c09c-5a10-41a7-99d1-769abadcc35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:03.636134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9c09c-5a10-41a7-99d1-769abadcc35f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:03.637881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9c09c-5a10-41a7-99d1-769abadcc35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:03.640977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a87cd-23f1-448e-8335-03b8db1997cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:03.643004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a87cd-23f1-448e-8335-03b8db1997cb service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:03.644558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9c09c-5a10-41a7-99d1-769abadcc35f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:03.659923 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2091/4166] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:18:03.672174 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2076/4167] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:03.674314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a87cd-23f1-448e-8335-03b8db1997cb service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:03.691569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a87cd-23f1-448e-8335-03b8db1997cb service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:03.698561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71165a-12bf-4f8c-aa5e-a634a7f16334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:03.700287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71165a-12bf-4f8c-aa5e-a634a7f16334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:03.701267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71165a-12bf-4f8c-aa5e-a634a7f16334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:03.701727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71165a-12bf-4f8c-aa5e-a634a7f16334 admin admin] PATH_INFO: `/v3/projects/e91dd8d448314a218eb841229c763e05/users/c9445119bd9a4d248db1f3e02446f02b/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:03.731696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71165a-12bf-4f8c-aa5e-a634a7f16334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91dd8d448314a218eb841229c763e05, user_id=c9445119bd9a4d248db1f3e02446f02b, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:03.736942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71165a-12bf-4f8c-aa5e-a634a7f16334 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:03.762823 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2092/4168] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:18:03 2022] PUT /identity/v3/projects/e91dd8d448314a218eb841229c763e05/users/c9445119bd9a4d248db1f3e02446f02b/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:03.765344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9c09c-5a10-41a7-99d1-769abadcc35f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:03.779123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9c09c-5a10-41a7-99d1-769abadcc35f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:03.825346 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:03.892503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e8827-ae28-4ee5-8c0e-1af180fef01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:03.893392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e8827-ae28-4ee5-8c0e-1af180fef01b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:03.893700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e8827-ae28-4ee5-8c0e-1af180fef01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:03.894036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e8827-ae28-4ee5-8c0e-1af180fef01b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:03.894954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e8827-ae28-4ee5-8c0e-1af180fef01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:03.897116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e8827-ae28-4ee5-8c0e-1af180fef01b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:03.921796 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2077/4169] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:03.927136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71165a-12bf-4f8c-aa5e-a634a7f16334 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:03.954597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71165a-12bf-4f8c-aa5e-a634a7f16334 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:03.961268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b55df2-51a1-45dc-9f54-25836e86b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:03.962104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b55df2-51a1-45dc-9f54-25836e86b4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:03.962787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b55df2-51a1-45dc-9f54-25836e86b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:03.976489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b55df2-51a1-45dc-9f54-25836e86b4a1 admin admin] PATH_INFO: `/v3/projects/e91dd8d448314a218eb841229c763e05/users/c9445119bd9a4d248db1f3e02446f02b/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:03.979701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b55df2-51a1-45dc-9f54-25836e86b4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91dd8d448314a218eb841229c763e05, user_id=c9445119bd9a4d248db1f3e02446f02b, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:03.990071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b55df2-51a1-45dc-9f54-25836e86b4a1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:04.016958 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2093/4170] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:18:03 2022] PUT /identity/v3/projects/e91dd8d448314a218eb841229c763e05/users/c9445119bd9a4d248db1f3e02446f02b/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:04.027006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283c512-7e38-43a9-ae5c-4a160a7a5459 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:04.027661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283c512-7e38-43a9-ae5c-4a160a7a5459 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:04.028272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283c512-7e38-43a9-ae5c-4a160a7a5459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:04.082533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e283c512-7e38-43a9-ae5c-4a160a7a5459 None None] MFA Rules not processed for user `c9445119bd9a4d248db1f3e02446f02b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:04.086309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e283c512-7e38-43a9-ae5c-4a160a7a5459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:04.294103 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2078/4171] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:04.308354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b55df2-51a1-45dc-9f54-25836e86b4a1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:04.310894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b4b55df2-51a1-45dc-9f54-25836e86b4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:04.388579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b55df2-51a1-45dc-9f54-25836e86b4a1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:04.395358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054220-d48e-4d5e-ad03-0f54979edfc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:04.396153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054220-d48e-4d5e-ad03-0f54979edfc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:04.396340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054220-d48e-4d5e-ad03-0f54979edfc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:04.396596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054220-d48e-4d5e-ad03-0f54979edfc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:04.406396 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:04.409568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b054220-d48e-4d5e-ad03-0f54979edfc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:04.413525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b054220-d48e-4d5e-ad03-0f54979edfc7 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:04.445490 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2094/4172] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:18:04.585728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283c512-7e38-43a9-ae5c-4a160a7a5459 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:04.601976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283c512-7e38-43a9-ae5c-4a160a7a5459 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:04.610875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04d7d7-c12c-4278-be95-85613c52aff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:04.611540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04d7d7-c12c-4278-be95-85613c52aff5 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:04.611990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04d7d7-c12c-4278-be95-85613c52aff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:04.612121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04d7d7-c12c-4278-be95-85613c52aff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:04.731945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04d7d7-c12c-4278-be95-85613c52aff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:04.733809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04d7d7-c12c-4278-be95-85613c52aff5 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:04.752415 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2079/4173] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:18:11.047637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054220-d48e-4d5e-ad03-0f54979edfc7 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:11.215775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054220-d48e-4d5e-ad03-0f54979edfc7 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:11.224879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:11.228567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:11.228861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:11.229144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] PATH_INFO: `/v3/users/cbb04b3ceb0a4b5483dbcbadd62651ea` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:11.232081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb04b3ceb0a4b5483dbcbadd62651ea)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:11.238674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:11.354542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb04b3ceb0a4b5483dbcbadd62651ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:11.356427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb04b3ceb0a4b5483dbcbadd62651ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:11.390285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb04b3ceb0a4b5483dbcbadd62651ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:11.413163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb04b3ceb0a4b5483dbcbadd62651ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:11.413803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb04b3ceb0a4b5483dbcbadd62651ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:11.444654 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2095/4174] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:18:11 2022] DELETE /identity/v3/users/cbb04b3ceb0a4b5483dbcbadd62651ea => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:11.449621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb295-0b9a-41fb-a9a3-f1e07f18f5c1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:11.450127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb295-0b9a-41fb-a9a3-f1e07f18f5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:11.450231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb295-0b9a-41fb-a9a3-f1e07f18f5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:11.493719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7c2eb295-0b9a-41fb-a9a3-f1e07f18f5c1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:11.496197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7c2eb295-0b9a-41fb-a9a3-f1e07f18f5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:11.613405 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:11.651712 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2080/4175] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:11.670131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:11.672268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:11.821538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaf07b-64cb-49c1-8d94-a8646db89560 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:11.844178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3edc70-29aa-48a1-b464-822e605039f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:11.844811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3edc70-29aa-48a1-b464-822e605039f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:11.845089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3edc70-29aa-48a1-b464-822e605039f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:11.845371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3edc70-29aa-48a1-b464-822e605039f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:11.872603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3edc70-29aa-48a1-b464-822e605039f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:11.874141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3edc70-29aa-48a1-b464-822e605039f7 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:11.895873 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2096/4176] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:18:12.327187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2eb295-0b9a-41fb-a9a3-f1e07f18f5c1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:12.329031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7c2eb295-0b9a-41fb-a9a3-f1e07f18f5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:12.566280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2eb295-0b9a-41fb-a9a3-f1e07f18f5c1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:12.584979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e048459-6f47-436f-a799-bfa51f03f935 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:12.585646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e048459-6f47-436f-a799-bfa51f03f935 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:12.585935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e048459-6f47-436f-a799-bfa51f03f935 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:12.586206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e048459-6f47-436f-a799-bfa51f03f935 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:12.588339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6e048459-6f47-436f-a799-bfa51f03f935 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:12.621690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e048459-6f47-436f-a799-bfa51f03f935 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:12.624781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e048459-6f47-436f-a799-bfa51f03f935 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:12.657652 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2081/4177] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:18:13.875396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3edc70-29aa-48a1-b464-822e605039f7 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:13.897688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3edc70-29aa-48a1-b464-822e605039f7 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:13.920019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec527fd9-ef24-4488-81ca-b4131d22c849 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:13.922139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec527fd9-ef24-4488-81ca-b4131d22c849 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:13.923168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec527fd9-ef24-4488-81ca-b4131d22c849 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:13.923608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec527fd9-ef24-4488-81ca-b4131d22c849 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:13.928061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ec527fd9-ef24-4488-81ca-b4131d22c849 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:13.949698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec527fd9-ef24-4488-81ca-b4131d22c849 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:13.951567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec527fd9-ef24-4488-81ca-b4131d22c849 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:13.970360 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2097/4178] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:18:13.997420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e048459-6f47-436f-a799-bfa51f03f935 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:14.000189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6e048459-6f47-436f-a799-bfa51f03f935 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:14.031803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e048459-6f47-436f-a799-bfa51f03f935 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:14.039327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:14.040177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:14.040613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:14.040873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] PATH_INFO: `/v3/projects/175247df801a4d189382ba300d75da20` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:14.042180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=175247df801a4d189382ba300d75da20)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:14.044458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:14.146163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175247df801a4d189382ba300d75da20', 'request_id': 'req-5b67b192-97d4-41f4-bbd9-322935cac7a9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:14.163437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175247df801a4d189382ba300d75da20', 'request_id': 'req-5b67b192-97d4-41f4-bbd9-322935cac7a9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:14.181340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175247df801a4d189382ba300d75da20', 'request_id': 'req-5b67b192-97d4-41f4-bbd9-322935cac7a9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:14.234635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] The token cache is being invalidate because project 175247df801a4d189382ba300d75da20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:18:14.236374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:14.238094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:14.243514 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2082/4179] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:18:13 2022] DELETE /identity/v3/projects/175247df801a4d189382ba300d75da20 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:14.249956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec527fd9-ef24-4488-81ca-b4131d22c849 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:14.258040 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:14.282057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec527fd9-ef24-4488-81ca-b4131d22c849 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:14.408451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e02993-61ad-4a72-8680-ce5bcb87e25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:14.409266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e02993-61ad-4a72-8680-ce5bcb87e25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:14.409950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e02993-61ad-4a72-8680-ce5bcb87e25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:14.410351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e02993-61ad-4a72-8680-ce5bcb87e25b admin admin] PATH_INFO: `/v3/users/c9445119bd9a4d248db1f3e02446f02b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:14.411743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e02993-61ad-4a72-8680-ce5bcb87e25b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9445119bd9a4d248db1f3e02446f02b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:14.414223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e02993-61ad-4a72-8680-ce5bcb87e25b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:14.508905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-16e02993-61ad-4a72-8680-ce5bcb87e25b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9445119bd9a4d248db1f3e02446f02b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:14.509943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-16e02993-61ad-4a72-8680-ce5bcb87e25b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9445119bd9a4d248db1f3e02446f02b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:14.548071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-16e02993-61ad-4a72-8680-ce5bcb87e25b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9445119bd9a4d248db1f3e02446f02b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:14.575157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-16e02993-61ad-4a72-8680-ce5bcb87e25b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9445119bd9a4d248db1f3e02446f02b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:14.577211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-16e02993-61ad-4a72-8680-ce5bcb87e25b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9445119bd9a4d248db1f3e02446f02b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:14.615975 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2098/4180] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:18:14 2022] DELETE /identity/v3/users/c9445119bd9a4d248db1f3e02446f02b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:15.433083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:15.437511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:15.459163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67b192-97d4-41f4-bbd9-322935cac7a9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:15.567491 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:15.587109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538d680-4b43-42a6-aa0f-6b8803916814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:15.587785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538d680-4b43-42a6-aa0f-6b8803916814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:15.588160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538d680-4b43-42a6-aa0f-6b8803916814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:15.588529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538d680-4b43-42a6-aa0f-6b8803916814 admin admin] PATH_INFO: `/v3/projects/e91dd8d448314a218eb841229c763e05` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:15.591222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538d680-4b43-42a6-aa0f-6b8803916814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91dd8d448314a218eb841229c763e05)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:15.593309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538d680-4b43-42a6-aa0f-6b8803916814 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:15.676779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f538d680-4b43-42a6-aa0f-6b8803916814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91dd8d448314a218eb841229c763e05', 'request_id': 'req-f538d680-4b43-42a6-aa0f-6b8803916814'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:15.691317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f538d680-4b43-42a6-aa0f-6b8803916814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91dd8d448314a218eb841229c763e05', 'request_id': 'req-f538d680-4b43-42a6-aa0f-6b8803916814'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:15.711508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f538d680-4b43-42a6-aa0f-6b8803916814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91dd8d448314a218eb841229c763e05', 'request_id': 'req-f538d680-4b43-42a6-aa0f-6b8803916814'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:15.732198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f538d680-4b43-42a6-aa0f-6b8803916814 admin admin] The token cache is being invalidate because project e91dd8d448314a218eb841229c763e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:18:15.732653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f538d680-4b43-42a6-aa0f-6b8803916814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:15.734648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f538d680-4b43-42a6-aa0f-6b8803916814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:15.738967 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2083/4181] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:18:15 2022] DELETE /identity/v3/projects/e91dd8d448314a218eb841229c763e05 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:15.741686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caa99f-8171-47ec-a86a-5fd2a9669cff None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:15.742114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caa99f-8171-47ec-a86a-5fd2a9669cff None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:15.742645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caa99f-8171-47ec-a86a-5fd2a9669cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:15.773510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-23caa99f-8171-47ec-a86a-5fd2a9669cff None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:15.774879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-23caa99f-8171-47ec-a86a-5fd2a9669cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:15.886617 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2099/4182] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:15.915435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7c402-05f1-423b-9e0c-49de04c09558 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:15.915735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7c402-05f1-423b-9e0c-49de04c09558 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:15.916016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7c402-05f1-423b-9e0c-49de04c09558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:16.024615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b0e7c402-05f1-423b-9e0c-49de04c09558 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:16.026173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b0e7c402-05f1-423b-9e0c-49de04c09558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:16.041883 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2084/4183] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:16.044141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caa99f-8171-47ec-a86a-5fd2a9669cff None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:16.070156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caa99f-8171-47ec-a86a-5fd2a9669cff None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:16.096334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c253a-5b85-4675-b2fa-77701d5ad215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:16.097935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c253a-5b85-4675-b2fa-77701d5ad215 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:16.099495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c253a-5b85-4675-b2fa-77701d5ad215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:16.099968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c253a-5b85-4675-b2fa-77701d5ad215 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:16.101476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c253a-5b85-4675-b2fa-77701d5ad215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:18:16.103286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c253a-5b85-4675-b2fa-77701d5ad215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:16.109665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c253a-5b85-4675-b2fa-77701d5ad215 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:16.156743 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2100/4184] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:18:16.165469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7c402-05f1-423b-9e0c-49de04c09558 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:16.196261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7c402-05f1-423b-9e0c-49de04c09558 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:16.215220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d1ae6-be44-4c9b-b953-841f8e346ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:16.215857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d1ae6-be44-4c9b-b953-841f8e346ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:16.218898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d1ae6-be44-4c9b-b953-841f8e346ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:16.220268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d1ae6-be44-4c9b-b953-841f8e346ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:16.221639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d1ae6-be44-4c9b-b953-841f8e346ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:16.229278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d1ae6-be44-4c9b-b953-841f8e346ec2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:16.316258 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2085/4185] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:18:16 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:18:16.325497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c253a-5b85-4675-b2fa-77701d5ad215 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:16.369737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c253a-5b85-4675-b2fa-77701d5ad215 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:16.402431 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:16.552481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12493248-2969-4bf3-b83c-704f988cfe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:16.553270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12493248-2969-4bf3-b83c-704f988cfe1b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:16.553550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12493248-2969-4bf3-b83c-704f988cfe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:16.553823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12493248-2969-4bf3-b83c-704f988cfe1b admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:16.554481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12493248-2969-4bf3-b83c-704f988cfe1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:16.568006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12493248-2969-4bf3-b83c-704f988cfe1b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:16.608410 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2101/4186] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:18:16 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:18:16.608799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d1ae6-be44-4c9b-b953-841f8e346ec2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:16.624733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d1ae6-be44-4c9b-b953-841f8e346ec2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:16.630973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29d518-5c47-4f78-a605-9fcad1a4ef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:16.631884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29d518-5c47-4f78-a605-9fcad1a4ef91 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:16.632774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29d518-5c47-4f78-a605-9fcad1a4ef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:16.633262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29d518-5c47-4f78-a605-9fcad1a4ef91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:16.634330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29d518-5c47-4f78-a605-9fcad1a4ef91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:16.636485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29d518-5c47-4f78-a605-9fcad1a4ef91 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:16.668429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12493248-2969-4bf3-b83c-704f988cfe1b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:16.679566 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2086/4187] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:18:16.686339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12493248-2969-4bf3-b83c-704f988cfe1b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:16.697093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d8eb6-0e42-4dd9-ad58-f68e4b79a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:16.698191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d8eb6-0e42-4dd9-ad58-f68e4b79a73b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:16.699178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d8eb6-0e42-4dd9-ad58-f68e4b79a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:16.699969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d8eb6-0e42-4dd9-ad58-f68e4b79a73b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:16.701508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d8eb6-0e42-4dd9-ad58-f68e4b79a73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:16.704694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d8eb6-0e42-4dd9-ad58-f68e4b79a73b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:16.726810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29d518-5c47-4f78-a605-9fcad1a4ef91 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:16.736924 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2102/4188] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:16.751252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29d518-5c47-4f78-a605-9fcad1a4ef91 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:16.761689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c064d5-1684-4204-936d-ffe713f8265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:16.762690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c064d5-1684-4204-936d-ffe713f8265f admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:16.763169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c064d5-1684-4204-936d-ffe713f8265f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:16.763616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c064d5-1684-4204-936d-ffe713f8265f admin admin] PATH_INFO: `/v3/projects/14ba6a428a0446519843b3608518cd50/users/fe41541c29bc47b588a3f58c187d6c97/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:16.805872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c064d5-1684-4204-936d-ffe713f8265f admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ba6a428a0446519843b3608518cd50, user_id=fe41541c29bc47b588a3f58c187d6c97, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:16.808761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c064d5-1684-4204-936d-ffe713f8265f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:16.837797 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2087/4189] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:18:16 2022] PUT /identity/v3/projects/14ba6a428a0446519843b3608518cd50/users/fe41541c29bc47b588a3f58c187d6c97/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:16.848978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321d834-de16-4676-8f30-6d3385d25d12 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:16.849573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321d834-de16-4676-8f30-6d3385d25d12 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:16.849573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321d834-de16-4676-8f30-6d3385d25d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:16.923584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f321d834-de16-4676-8f30-6d3385d25d12 None None] MFA Rules not processed for user `fe41541c29bc47b588a3f58c187d6c97`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:16.926177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f321d834-de16-4676-8f30-6d3385d25d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:17.121289 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2103/4190] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:17.122543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c064d5-1684-4204-936d-ffe713f8265f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:17.261088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c064d5-1684-4204-936d-ffe713f8265f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:17.273346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db3c82-f472-48cc-bf27-dd5330c92c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:17.274116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db3c82-f472-48cc-bf27-dd5330c92c98 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:17.274483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db3c82-f472-48cc-bf27-dd5330c92c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:17.274952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db3c82-f472-48cc-bf27-dd5330c92c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:17.275739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db3c82-f472-48cc-bf27-dd5330c92c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:17.277840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db3c82-f472-48cc-bf27-dd5330c92c98 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:17.340205 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2088/4191] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:18:17 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:18:17.342361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321d834-de16-4676-8f30-6d3385d25d12 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:17.360114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321d834-de16-4676-8f30-6d3385d25d12 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:17.504200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ada5dc-5a1d-4962-bf77-b80c0a85358c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:17.506327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ada5dc-5a1d-4962-bf77-b80c0a85358c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:17.506605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ada5dc-5a1d-4962-bf77-b80c0a85358c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:17.506871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ada5dc-5a1d-4962-bf77-b80c0a85358c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:17.510128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ada5dc-5a1d-4962-bf77-b80c0a85358c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:17.516128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ada5dc-5a1d-4962-bf77-b80c0a85358c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:17.565332 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2104/4192] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:18:17 2022] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:18:17.569393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db3c82-f472-48cc-bf27-dd5330c92c98 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:17.584847 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:17.589108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db3c82-f472-48cc-bf27-dd5330c92c98 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:17.609468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629af7b-56c2-48dd-bbb5-53ca3622c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:17.610244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629af7b-56c2-48dd-bbb5-53ca3622c435 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:17.610587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629af7b-56c2-48dd-bbb5-53ca3622c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:17.610882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629af7b-56c2-48dd-bbb5-53ca3622c435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:17.611767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629af7b-56c2-48dd-bbb5-53ca3622c435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:17.613487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629af7b-56c2-48dd-bbb5-53ca3622c435 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:17.645385 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2089/4193] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:17.647007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ada5dc-5a1d-4962-bf77-b80c0a85358c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:17.698826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ada5dc-5a1d-4962-bf77-b80c0a85358c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:17.716057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7749d08-620a-43ed-9ad8-0c0ed99e12fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:17.718140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7749d08-620a-43ed-9ad8-0c0ed99e12fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:17.718140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7749d08-620a-43ed-9ad8-0c0ed99e12fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:17.718726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7749d08-620a-43ed-9ad8-0c0ed99e12fa admin admin] PATH_INFO: `/v3/projects/dcfa8d86c3f9452baa3f59759271477f/users/d2eaca6edeab4655987ca88da8157513/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:17.724227 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:17.778851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7749d08-620a-43ed-9ad8-0c0ed99e12fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcfa8d86c3f9452baa3f59759271477f, user_id=d2eaca6edeab4655987ca88da8157513, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:17.793776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7749d08-620a-43ed-9ad8-0c0ed99e12fa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:17.824983 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2105/4194] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:18:17 2022] PUT /identity/v3/projects/dcfa8d86c3f9452baa3f59759271477f/users/d2eaca6edeab4655987ca88da8157513/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:17.826252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629af7b-56c2-48dd-bbb5-53ca3622c435 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:17.838796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629af7b-56c2-48dd-bbb5-53ca3622c435 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:17.961126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca5d6c-5ed1-4dad-b470-659eebcaabdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:17.961843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca5d6c-5ed1-4dad-b470-659eebcaabdf admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:17.962122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca5d6c-5ed1-4dad-b470-659eebcaabdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:17.962498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca5d6c-5ed1-4dad-b470-659eebcaabdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:17.963571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca5d6c-5ed1-4dad-b470-659eebcaabdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:17.965135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca5d6c-5ed1-4dad-b470-659eebcaabdf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:17.985623 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2090/4195] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:17.989920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7749d08-620a-43ed-9ad8-0c0ed99e12fa admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:18.004025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7749d08-620a-43ed-9ad8-0c0ed99e12fa admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:18.025588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5d44a-4ec2-4001-8c63-5a032bc2f2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:18.026365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5d44a-4ec2-4001-8c63-5a032bc2f2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:18.026557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5d44a-4ec2-4001-8c63-5a032bc2f2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:18.026828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5d44a-4ec2-4001-8c63-5a032bc2f2bd admin admin] PATH_INFO: `/v3/projects/dcfa8d86c3f9452baa3f59759271477f/users/d2eaca6edeab4655987ca88da8157513/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:18.043691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5d44a-4ec2-4001-8c63-5a032bc2f2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcfa8d86c3f9452baa3f59759271477f, user_id=d2eaca6edeab4655987ca88da8157513, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:18.049518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5d44a-4ec2-4001-8c63-5a032bc2f2bd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:18.081963 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2106/4196] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:18:17 2022] PUT /identity/v3/projects/dcfa8d86c3f9452baa3f59759271477f/users/d2eaca6edeab4655987ca88da8157513/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:18.093466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c923d4-fd8a-461c-b8e8-1a3384e6be38 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:18.094619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c923d4-fd8a-461c-b8e8-1a3384e6be38 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:18.095537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c923d4-fd8a-461c-b8e8-1a3384e6be38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:18.164290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e0c923d4-fd8a-461c-b8e8-1a3384e6be38 None None] MFA Rules not processed for user `d2eaca6edeab4655987ca88da8157513`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:18.169734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e0c923d4-fd8a-461c-b8e8-1a3384e6be38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:18.309184 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2091/4197] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:18.321460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5d44a-4ec2-4001-8c63-5a032bc2f2bd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:18.329134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7fd5d44a-4ec2-4001-8c63-5a032bc2f2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:18.417368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5d44a-4ec2-4001-8c63-5a032bc2f2bd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:18.422265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c297f0-a9b6-441d-ab22-39b746fa0482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:18.423140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c297f0-a9b6-441d-ab22-39b746fa0482 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:18.423571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c297f0-a9b6-441d-ab22-39b746fa0482 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:18.423992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c297f0-a9b6-441d-ab22-39b746fa0482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:18.441823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c297f0-a9b6-441d-ab22-39b746fa0482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:18.451886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c297f0-a9b6-441d-ab22-39b746fa0482 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:18.467974 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2107/4198] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:18:19.413853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c923d4-fd8a-461c-b8e8-1a3384e6be38 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:19.518267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c923d4-fd8a-461c-b8e8-1a3384e6be38 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:19.523332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3295dd8-aa89-4ed4-ba94-b792405ca4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:19.524035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3295dd8-aa89-4ed4-ba94-b792405ca4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:19.524319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3295dd8-aa89-4ed4-ba94-b792405ca4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:19.524593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3295dd8-aa89-4ed4-ba94-b792405ca4d8 admin admin] PATH_INFO: `/v3/users/fe41541c29bc47b588a3f58c187d6c97` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:19.526280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3295dd8-aa89-4ed4-ba94-b792405ca4d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe41541c29bc47b588a3f58c187d6c97)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:19.529501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3295dd8-aa89-4ed4-ba94-b792405ca4d8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:19.559549 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:19.625842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60830675-d07a-4168-94a0-8a54025337a0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:19.626787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60830675-d07a-4168-94a0-8a54025337a0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:19.627178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60830675-d07a-4168-94a0-8a54025337a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:19.633043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b3295dd8-aa89-4ed4-ba94-b792405ca4d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe41541c29bc47b588a3f58c187d6c97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:19.633748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b3295dd8-aa89-4ed4-ba94-b792405ca4d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe41541c29bc47b588a3f58c187d6c97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:19.660541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b3295dd8-aa89-4ed4-ba94-b792405ca4d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe41541c29bc47b588a3f58c187d6c97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:19.676990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b3295dd8-aa89-4ed4-ba94-b792405ca4d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe41541c29bc47b588a3f58c187d6c97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:19.678098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b3295dd8-aa89-4ed4-ba94-b792405ca4d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe41541c29bc47b588a3f58c187d6c97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:19.699513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-60830675-d07a-4168-94a0-8a54025337a0 None None] MFA Rules not processed for user `1cf0ec54a3f54abd90ece8de2aa70ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:19.700845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-60830675-d07a-4168-94a0-8a54025337a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:19.709830 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2092/4199] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:18:19 2022] DELETE /identity/v3/users/fe41541c29bc47b588a3f58c187d6c97 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:19.711925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339858e-fee6-42b1-83f3-9e3801daee3b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:19.712213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339858e-fee6-42b1-83f3-9e3801daee3b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:19.712489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339858e-fee6-42b1-83f3-9e3801daee3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:19.744908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1339858e-fee6-42b1-83f3-9e3801daee3b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:19.746134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1339858e-fee6-42b1-83f3-9e3801daee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:19.854396 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2108/4200] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:19.870333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60830675-d07a-4168-94a0-8a54025337a0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:19.872554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-60830675-d07a-4168-94a0-8a54025337a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:19.883202 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2093/4201] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:19.891496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339858e-fee6-42b1-83f3-9e3801daee3b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:19.894016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1339858e-fee6-42b1-83f3-9e3801daee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:20.040327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60830675-d07a-4168-94a0-8a54025337a0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:20.045720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f53cba-5f36-4116-bcad-94bf2b4fd548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:20.046450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f53cba-5f36-4116-bcad-94bf2b4fd548 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:20.046730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f53cba-5f36-4116-bcad-94bf2b4fd548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:20.047024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f53cba-5f36-4116-bcad-94bf2b4fd548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:20.055924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339858e-fee6-42b1-83f3-9e3801daee3b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:20.063269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e14c0-e91b-4937-a493-f4a4d0c87b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:20.063901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e14c0-e91b-4937-a493-f4a4d0c87b51 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:20.064157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e14c0-e91b-4937-a493-f4a4d0c87b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:20.064440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e14c0-e91b-4937-a493-f4a4d0c87b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:20.065307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f53cba-5f36-4116-bcad-94bf2b4fd548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:20.066771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f53cba-5f36-4116-bcad-94bf2b4fd548 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:20.090147 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2109/4202] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:18:20.098415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e14c0-e91b-4937-a493-f4a4d0c87b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:20.099927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e14c0-e91b-4937-a493-f4a4d0c87b51 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:20.148830 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2094/4203] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:18:22.097883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f53cba-5f36-4116-bcad-94bf2b4fd548 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:22.100329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e5f53cba-5f36-4116-bcad-94bf2b4fd548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:22.134788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f53cba-5f36-4116-bcad-94bf2b4fd548 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:22.166429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:22.168569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:22.168853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:22.172887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] PATH_INFO: `/v3/projects/14ba6a428a0446519843b3608518cd50` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:22.186671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ba6a428a0446519843b3608518cd50)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:22.192605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:22.198984 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:22.317567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ba6a428a0446519843b3608518cd50', 'request_id': 'req-b7993e39-efe1-46b9-9d0d-514bd89240a7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:22.328821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ba6a428a0446519843b3608518cd50', 'request_id': 'req-b7993e39-efe1-46b9-9d0d-514bd89240a7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:22.344539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ba6a428a0446519843b3608518cd50', 'request_id': 'req-b7993e39-efe1-46b9-9d0d-514bd89240a7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:22.372512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] The token cache is being invalidate because project 14ba6a428a0446519843b3608518cd50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:18:22.373536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:22.376481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:22.381193 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2110/4204] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:18:22 2022] DELETE /identity/v3/projects/14ba6a428a0446519843b3608518cd50 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:22.385545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e14c0-e91b-4937-a493-f4a4d0c87b51 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:22.418438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e14c0-e91b-4937-a493-f4a4d0c87b51 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:22.527045 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:22.604362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55927f2-d0f6-4e74-bc09-291e03afbb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:22.605042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55927f2-d0f6-4e74-bc09-291e03afbb56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:22.605323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55927f2-d0f6-4e74-bc09-291e03afbb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:22.605593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55927f2-d0f6-4e74-bc09-291e03afbb56 admin admin] PATH_INFO: `/v3/users/d2eaca6edeab4655987ca88da8157513` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:22.608791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55927f2-d0f6-4e74-bc09-291e03afbb56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2eaca6edeab4655987ca88da8157513)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:22.610777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55927f2-d0f6-4e74-bc09-291e03afbb56 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:22.692640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a55927f2-d0f6-4e74-bc09-291e03afbb56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2eaca6edeab4655987ca88da8157513'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:22.693408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a55927f2-d0f6-4e74-bc09-291e03afbb56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2eaca6edeab4655987ca88da8157513'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:22.711338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a55927f2-d0f6-4e74-bc09-291e03afbb56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2eaca6edeab4655987ca88da8157513'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:22.721534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a55927f2-d0f6-4e74-bc09-291e03afbb56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2eaca6edeab4655987ca88da8157513'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:22.722284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a55927f2-d0f6-4e74-bc09-291e03afbb56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2eaca6edeab4655987ca88da8157513'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:22.771387 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2095/4205] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:18:22 2022] DELETE /identity/v3/users/d2eaca6edeab4655987ca88da8157513 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:24.576493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:24.579510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:24.605241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7993e39-efe1-46b9-9d0d-514bd89240a7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:24.715525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745e9b4-0aa2-4522-ae5b-b022fa03121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:24.716627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745e9b4-0aa2-4522-ae5b-b022fa03121c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:24.717275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745e9b4-0aa2-4522-ae5b-b022fa03121c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:24.718192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745e9b4-0aa2-4522-ae5b-b022fa03121c admin admin] PATH_INFO: `/v3/projects/dcfa8d86c3f9452baa3f59759271477f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:24.720158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745e9b4-0aa2-4522-ae5b-b022fa03121c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcfa8d86c3f9452baa3f59759271477f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:24.722724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745e9b4-0aa2-4522-ae5b-b022fa03121c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:24.811415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2745e9b4-0aa2-4522-ae5b-b022fa03121c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcfa8d86c3f9452baa3f59759271477f', 'request_id': 'req-2745e9b4-0aa2-4522-ae5b-b022fa03121c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:24.823105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2745e9b4-0aa2-4522-ae5b-b022fa03121c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcfa8d86c3f9452baa3f59759271477f', 'request_id': 'req-2745e9b4-0aa2-4522-ae5b-b022fa03121c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:24.835202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2745e9b4-0aa2-4522-ae5b-b022fa03121c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcfa8d86c3f9452baa3f59759271477f', 'request_id': 'req-2745e9b4-0aa2-4522-ae5b-b022fa03121c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:24.869512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2745e9b4-0aa2-4522-ae5b-b022fa03121c admin admin] The token cache is being invalidate because project dcfa8d86c3f9452baa3f59759271477f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:18:24.870070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2745e9b4-0aa2-4522-ae5b-b022fa03121c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:24.871108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2745e9b4-0aa2-4522-ae5b-b022fa03121c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:24.877980 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2111/4206] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:18:24 2022] DELETE /identity/v3/projects/dcfa8d86c3f9452baa3f59759271477f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:24.879194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a68bf-e9ec-44e4-8321-79fc5e2a9535 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:24.879753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a68bf-e9ec-44e4-8321-79fc5e2a9535 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:24.879845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a68bf-e9ec-44e4-8321-79fc5e2a9535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:24.924166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3b3a68bf-e9ec-44e4-8321-79fc5e2a9535 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:24.925496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b3a68bf-e9ec-44e4-8321-79fc5e2a9535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:25.070256 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2096/4207] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:18:25.086972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf334b3-8e1e-4645-bc33-fad6957dc3fd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:25.088412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf334b3-8e1e-4645-bc33-fad6957dc3fd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:25.089676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf334b3-8e1e-4645-bc33-fad6957dc3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:25.158032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2bf334b3-8e1e-4645-bc33-fad6957dc3fd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:25.160344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2bf334b3-8e1e-4645-bc33-fad6957dc3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:25.195396 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2112/4208] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:18:25.197081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a68bf-e9ec-44e4-8321-79fc5e2a9535 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:25.219057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a68bf-e9ec-44e4-8321-79fc5e2a9535 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:25.234508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6b47a-07cd-48d5-8e38-eb5ae317375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:25.236276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6b47a-07cd-48d5-8e38-eb5ae317375c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:25.237918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6b47a-07cd-48d5-8e38-eb5ae317375c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:25.239794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6b47a-07cd-48d5-8e38-eb5ae317375c admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:25.241797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6b47a-07cd-48d5-8e38-eb5ae317375c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:18:25.243226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6b47a-07cd-48d5-8e38-eb5ae317375c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:25.248109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6b47a-07cd-48d5-8e38-eb5ae317375c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:25.287799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf334b3-8e1e-4645-bc33-fad6957dc3fd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:25.300238 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2097/4209] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:18:25.300373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf334b3-8e1e-4645-bc33-fad6957dc3fd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:25.305635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951eaf6b-5c96-4ca3-b3a6-33462749cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:25.306258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eaf6b-5c96-4ca3-b3a6-33462749cfce admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:25.306536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eaf6b-5c96-4ca3-b3a6-33462749cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:25.306821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eaf6b-5c96-4ca3-b3a6-33462749cfce admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:25.307504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951eaf6b-5c96-4ca3-b3a6-33462749cfce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:25.309453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951eaf6b-5c96-4ca3-b3a6-33462749cfce admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:25.323075 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:25.354307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6b47a-07cd-48d5-8e38-eb5ae317375c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:25.361752 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2113/4210] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:18:25 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:18:25.369171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6b47a-07cd-48d5-8e38-eb5ae317375c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:25.495367 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:25.553191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db05e2e-161b-4a8a-bbac-ca228a36ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:25.553191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db05e2e-161b-4a8a-bbac-ca228a36ba7a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:25.553191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db05e2e-161b-4a8a-bbac-ca228a36ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:25.553191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db05e2e-161b-4a8a-bbac-ca228a36ba7a admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:25.553833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db05e2e-161b-4a8a-bbac-ca228a36ba7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:25.553833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db05e2e-161b-4a8a-bbac-ca228a36ba7a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:25.606083 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2098/4211] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:18:25 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:18:25.609303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951eaf6b-5c96-4ca3-b3a6-33462749cfce admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:25.636428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951eaf6b-5c96-4ca3-b3a6-33462749cfce admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:25.678252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45372105-74f8-4705-aba7-3e14f394b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:25.678252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45372105-74f8-4705-aba7-3e14f394b303 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:25.678252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45372105-74f8-4705-aba7-3e14f394b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:25.678252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45372105-74f8-4705-aba7-3e14f394b303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:25.678647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45372105-74f8-4705-aba7-3e14f394b303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:25.684376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45372105-74f8-4705-aba7-3e14f394b303 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:25.726211 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2114/4212] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:25.727516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db05e2e-161b-4a8a-bbac-ca228a36ba7a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:25.744671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db05e2e-161b-4a8a-bbac-ca228a36ba7a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:25.769703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1b95d-6d01-4904-a812-72d86dd8b9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:25.769929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b95d-6d01-4904-a812-72d86dd8b9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:25.770175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b95d-6d01-4904-a812-72d86dd8b9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:25.770542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b95d-6d01-4904-a812-72d86dd8b9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:25.776649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1b95d-6d01-4904-a812-72d86dd8b9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:25.778342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1b95d-6d01-4904-a812-72d86dd8b9fc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:25.847746 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2099/4213] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:25.852800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45372105-74f8-4705-aba7-3e14f394b303 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:25.865059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45372105-74f8-4705-aba7-3e14f394b303 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:25.875920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c9e77-32ca-412a-a45a-a6321cec3af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:25.878153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c9e77-32ca-412a-a45a-a6321cec3af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:25.878525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c9e77-32ca-412a-a45a-a6321cec3af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:25.879266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c9e77-32ca-412a-a45a-a6321cec3af8 admin admin] PATH_INFO: `/v3/projects/70badce1a2e24053bf73930ad23bd986/users/27722c5f061d441fb0e2cd05a8b42e5f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:25.955573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c9e77-32ca-412a-a45a-a6321cec3af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70badce1a2e24053bf73930ad23bd986, user_id=27722c5f061d441fb0e2cd05a8b42e5f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:25.968225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c9e77-32ca-412a-a45a-a6321cec3af8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:26.020416 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2115/4214] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:18:25 2022] PUT /identity/v3/projects/70badce1a2e24053bf73930ad23bd986/users/27722c5f061d441fb0e2cd05a8b42e5f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:18:26.035160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da79eb-33fa-4157-83ac-71734283a802 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:26.035160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da79eb-33fa-4157-83ac-71734283a802 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:26.035160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da79eb-33fa-4157-83ac-71734283a802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:26.136141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f3da79eb-33fa-4157-83ac-71734283a802 None None] MFA Rules not processed for user `27722c5f061d441fb0e2cd05a8b42e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:26.140386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f3da79eb-33fa-4157-83ac-71734283a802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:26.361488 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2100/4215] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:26.361580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c9e77-32ca-412a-a45a-a6321cec3af8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:26.363100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f07a0d-031a-4820-9040-f36d3c90e277 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:26.363395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f07a0d-031a-4820-9040-f36d3c90e277 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:26.363826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f07a0d-031a-4820-9040-f36d3c90e277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:26.366701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8c4c9e77-32ca-412a-a45a-a6321cec3af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:26.402462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a6f07a0d-031a-4820-9040-f36d3c90e277 None None] MFA Rules not processed for user `1cf0ec54a3f54abd90ece8de2aa70ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:26.404014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a6f07a0d-031a-4820-9040-f36d3c90e277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:26.513040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c9e77-32ca-412a-a45a-a6321cec3af8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:26.522002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4b6df-60da-4ecb-b700-fa2c9fbfbbc3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:26.522633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b6df-60da-4ecb-b700-fa2c9fbfbbc3 service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:26.523064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b6df-60da-4ecb-b700-fa2c9fbfbbc3 service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:26.523566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b6df-60da-4ecb-b700-fa2c9fbfbbc3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:26.540577 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2101/4216] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:18:26.579969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4b6df-60da-4ecb-b700-fa2c9fbfbbc3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:26.585561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4b6df-60da-4ecb-b700-fa2c9fbfbbc3 service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:26.632298 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2116/4217] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:18:31.221494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cccd60-9b21-495f-9fc4-ddf86221c6a4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:31.222063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cccd60-9b21-495f-9fc4-ddf86221c6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:31.222142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cccd60-9b21-495f-9fc4-ddf86221c6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:31.258887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b2cccd60-9b21-495f-9fc4-ddf86221c6a4 None None] MFA Rules not processed for user `b7cdbf32b68a44a28e4cc9c4210b5e56`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:31.260143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b2cccd60-9b21-495f-9fc4-ddf86221c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:31.465373 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2102/4218] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:35.794160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e9425-13ff-470e-bade-9641c2f3a37a None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:35.794683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e9425-13ff-470e-bade-9641c2f3a37a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:35.794841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e9425-13ff-470e-bade-9641c2f3a37a None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:35.796983 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2117/4219] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:18:35.804255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5e6c-18b3-45f6-baaa-30a812c4ffec None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:35.804780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5e6c-18b3-45f6-baaa-30a812c4ffec None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:35.805242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5e6c-18b3-45f6-baaa-30a812c4ffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:35.814224 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:35.879992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f75d5e6c-18b3-45f6-baaa-30a812c4ffec None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:35.882550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f75d5e6c-18b3-45f6-baaa-30a812c4ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:35.970829 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2103/4220] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:18:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:35.988382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e9425-13ff-470e-bade-9641c2f3a37a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:35.990272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ef7e9425-13ff-470e-bade-9641c2f3a37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:36.005201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e9425-13ff-470e-bade-9641c2f3a37a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:36.009173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261615a-41c0-47c6-8239-d5ff54b65c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:36.009955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261615a-41c0-47c6-8239-d5ff54b65c5b service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:36.010371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261615a-41c0-47c6-8239-d5ff54b65c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:36.010812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261615a-41c0-47c6-8239-d5ff54b65c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:36.019999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261615a-41c0-47c6-8239-d5ff54b65c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:36.021718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261615a-41c0-47c6-8239-d5ff54b65c5b service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:36.031294 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2118/4221] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:18:41.311515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5e6c-18b3-45f6-baaa-30a812c4ffec None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:41.312979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f75d5e6c-18b3-45f6-baaa-30a812c4ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:41.454396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5e6c-18b3-45f6-baaa-30a812c4ffec None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:41.460391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:41.461182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:41.461576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:41.461922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] PATH_INFO: `/v3/users/513ff7ce16284c9c8b90c4b3f19c595d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:41.463188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=513ff7ce16284c9c8b90c4b3f19c595d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:41.465345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:41.562330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513ff7ce16284c9c8b90c4b3f19c595d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:41.563674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513ff7ce16284c9c8b90c4b3f19c595d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:41.603061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513ff7ce16284c9c8b90c4b3f19c595d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:41.614285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513ff7ce16284c9c8b90c4b3f19c595d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:41.615089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513ff7ce16284c9c8b90c4b3f19c595d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:41.638100 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2104/4222] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:18:41 2022] DELETE /identity/v3/users/513ff7ce16284c9c8b90c4b3f19c595d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:41.644969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0bc55-3e24-446e-9ea2-e5b7e8b2c1de None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:41.646214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0bc55-3e24-446e-9ea2-e5b7e8b2c1de None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:41.646995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0bc55-3e24-446e-9ea2-e5b7e8b2c1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:41.732561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f0a0bc55-3e24-446e-9ea2-e5b7e8b2c1de None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:41.734135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f0a0bc55-3e24-446e-9ea2-e5b7e8b2c1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:41.909648 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2119/4223] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:41.933559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:41.936873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:41.942552 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:42.114031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7d391-e64c-4dd1-9bae-d67b191ac3d0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:42.119959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9882a-0a76-45fb-b5a0-406ca2b1a185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:42.120665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9882a-0a76-45fb-b5a0-406ca2b1a185 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:42.120942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9882a-0a76-45fb-b5a0-406ca2b1a185 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:42.121212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9882a-0a76-45fb-b5a0-406ca2b1a185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:42.134870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9882a-0a76-45fb-b5a0-406ca2b1a185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:42.136539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9882a-0a76-45fb-b5a0-406ca2b1a185 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:42.166453 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2105/4224] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:18:42.792713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0bc55-3e24-446e-9ea2-e5b7e8b2c1de None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:42.797070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f0a0bc55-3e24-446e-9ea2-e5b7e8b2c1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:42.811694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0bc55-3e24-446e-9ea2-e5b7e8b2c1de None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:42.817911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:42.827709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:42.828240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:42.828726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1 admin admin] PATH_INFO: `/v3/projects/b273f53385bf4ef5832d45d755e749c0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:42.831046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b273f53385bf4ef5832d45d755e749c0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:42.833171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:42.913851 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:42.937245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b273f53385bf4ef5832d45d755e749c0', 'request_id': 'req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:42.944377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b273f53385bf4ef5832d45d755e749c0', 'request_id': 'req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:42.954069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b273f53385bf4ef5832d45d755e749c0', 'request_id': 'req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:42.968268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1 admin admin] The token cache is being invalidate because project b273f53385bf4ef5832d45d755e749c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:18:42.968793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:42.969675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84ba0bfc-dc05-4456-90e2-84ee0c53cbb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:42.978120 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2120/4225] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:18:42 2022] DELETE /identity/v3/projects/b273f53385bf4ef5832d45d755e749c0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:42.980109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954922f-66bb-49a1-8b89-a89566cdc2f5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:42.980608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954922f-66bb-49a1-8b89-a89566cdc2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:42.980608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954922f-66bb-49a1-8b89-a89566cdc2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:43.042447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b954922f-66bb-49a1-8b89-a89566cdc2f5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:43.044241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b954922f-66bb-49a1-8b89-a89566cdc2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:43.143960 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2106/4226] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:43.153037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc23d8-3670-43a4-9e35-bdcb6e0222c4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:43.153817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc23d8-3670-43a4-9e35-bdcb6e0222c4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:43.154614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc23d8-3670-43a4-9e35-bdcb6e0222c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:43.200351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-babc23d8-3670-43a4-9e35-bdcb6e0222c4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:43.201834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-babc23d8-3670-43a4-9e35-bdcb6e0222c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:43.213326 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2121/4227] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:43.218402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954922f-66bb-49a1-8b89-a89566cdc2f5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:43.230268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954922f-66bb-49a1-8b89-a89566cdc2f5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:43.237632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f6a70-fa22-457f-b207-cb6b588cd0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:43.238666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f6a70-fa22-457f-b207-cb6b588cd0ce admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:43.238666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f6a70-fa22-457f-b207-cb6b588cd0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:43.238851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f6a70-fa22-457f-b207-cb6b588cd0ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:43.241141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f6a70-fa22-457f-b207-cb6b588cd0ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:18:43.241678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f6a70-fa22-457f-b207-cb6b588cd0ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:43.244677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f6a70-fa22-457f-b207-cb6b588cd0ce admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:43.262668 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2107/4228] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:18:43.267136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc23d8-3670-43a4-9e35-bdcb6e0222c4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:43.280542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc23d8-3670-43a4-9e35-bdcb6e0222c4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:43.299616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2708e87-b69d-45ca-9eca-28c1545b9495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:43.302150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2708e87-b69d-45ca-9eca-28c1545b9495 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:43.304690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2708e87-b69d-45ca-9eca-28c1545b9495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:43.306325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2708e87-b69d-45ca-9eca-28c1545b9495 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:43.308980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2708e87-b69d-45ca-9eca-28c1545b9495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:43.315669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2708e87-b69d-45ca-9eca-28c1545b9495 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:43.395720 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2122/4229] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:18:43 2022] POST /identity/v3/projects => generated 359 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:18:43.401526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f6a70-fa22-457f-b207-cb6b588cd0ce admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:43.423129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f6a70-fa22-457f-b207-cb6b588cd0ce admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:43.580124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f5efe-4afa-48ba-bee2-c46b3aa96ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:43.580552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f5efe-4afa-48ba-bee2-c46b3aa96ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:43.580837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f5efe-4afa-48ba-bee2-c46b3aa96ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:43.581109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f5efe-4afa-48ba-bee2-c46b3aa96ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:43.581852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f5efe-4afa-48ba-bee2-c46b3aa96ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:43.584574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f5efe-4afa-48ba-bee2-c46b3aa96ab9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:43.599247 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:43.626968 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2108/4230] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:18:43 2022] POST /identity/v3/users => generated 280 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:18:43.628899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2708e87-b69d-45ca-9eca-28c1545b9495 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:43.642069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2708e87-b69d-45ca-9eca-28c1545b9495 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:43.653762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69781b79-ce08-4174-89ac-8f21834487d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:43.655035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69781b79-ce08-4174-89ac-8f21834487d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:43.657337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69781b79-ce08-4174-89ac-8f21834487d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:43.683396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69781b79-ce08-4174-89ac-8f21834487d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:43.696195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69781b79-ce08-4174-89ac-8f21834487d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:43.697851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69781b79-ce08-4174-89ac-8f21834487d0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:43.759345 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2123/4231] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:43.763147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f5efe-4afa-48ba-bee2-c46b3aa96ab9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:43.787135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f5efe-4afa-48ba-bee2-c46b3aa96ab9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:43.827173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f9878-d730-4f2d-b99f-cdb9da2ae3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:43.827810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f9878-d730-4f2d-b99f-cdb9da2ae3fe admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:43.832213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f9878-d730-4f2d-b99f-cdb9da2ae3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:43.836026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f9878-d730-4f2d-b99f-cdb9da2ae3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:43.837986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f9878-d730-4f2d-b99f-cdb9da2ae3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:43.842706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f9878-d730-4f2d-b99f-cdb9da2ae3fe admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:43.874777 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2109/4232] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:43.875839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69781b79-ce08-4174-89ac-8f21834487d0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:43.890278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69781b79-ce08-4174-89ac-8f21834487d0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:43.907132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a1d43-2bfe-4b47-b897-8c5a1d9ae931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:43.908206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a1d43-2bfe-4b47-b897-8c5a1d9ae931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:43.908909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a1d43-2bfe-4b47-b897-8c5a1d9ae931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:43.909331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a1d43-2bfe-4b47-b897-8c5a1d9ae931 admin admin] PATH_INFO: `/v3/projects/0c0a00cb20204370816182cbfde61b28/users/caf9f3f309d24beca62915115e1cf71f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:43.955885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a1d43-2bfe-4b47-b897-8c5a1d9ae931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0a00cb20204370816182cbfde61b28, user_id=caf9f3f309d24beca62915115e1cf71f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:43.960722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a1d43-2bfe-4b47-b897-8c5a1d9ae931 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:43.982699 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2124/4233] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:18:43 2022] PUT /identity/v3/projects/0c0a00cb20204370816182cbfde61b28/users/caf9f3f309d24beca62915115e1cf71f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:18:43.993154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcdab0-930e-47c9-a5b8-a78300d4377d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:43.995511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcdab0-930e-47c9-a5b8-a78300d4377d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:43.998944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcdab0-930e-47c9-a5b8-a78300d4377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:44.062343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e8dcdab0-930e-47c9-a5b8-a78300d4377d None None] MFA Rules not processed for user `caf9f3f309d24beca62915115e1cf71f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:44.065096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e8dcdab0-930e-47c9-a5b8-a78300d4377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:44.165779 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2110/4234] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:44.191638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a1d43-2bfe-4b47-b897-8c5a1d9ae931 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:44.194905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-757a1d43-2bfe-4b47-b897-8c5a1d9ae931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:44.323400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a1d43-2bfe-4b47-b897-8c5a1d9ae931 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:44.337071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5b045-ac75-4ac3-9608-1e99b182eb41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:44.337841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5b045-ac75-4ac3-9608-1e99b182eb41 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:44.338979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5b045-ac75-4ac3-9608-1e99b182eb41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:44.340863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5b045-ac75-4ac3-9608-1e99b182eb41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:44.370370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5b045-ac75-4ac3-9608-1e99b182eb41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:44.372814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5b045-ac75-4ac3-9608-1e99b182eb41 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:44.400133 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2125/4235] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:18:50.503450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1fe12-6354-4eb2-b9f8-db6b728a5298 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:50.504584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1fe12-6354-4eb2-b9f8-db6b728a5298 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:50.505399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1fe12-6354-4eb2-b9f8-db6b728a5298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:50.557448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-94a1fe12-6354-4eb2-b9f8-db6b728a5298 None None] MFA Rules not processed for user `f1bfe0b4f344485ab6de52f7b1423118`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:50.561256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-94a1fe12-6354-4eb2-b9f8-db6b728a5298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:50.665598 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2111/4236] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:51.225406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5b045-ac75-4ac3-9608-1e99b182eb41 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:51.227989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-30e5b045-ac75-4ac3-9608-1e99b182eb41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:51.383570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5b045-ac75-4ac3-9608-1e99b182eb41 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:51.391987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e727a-3482-45c7-afa3-a8b8172b56e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:51.392830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e727a-3482-45c7-afa3-a8b8172b56e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:51.393341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e727a-3482-45c7-afa3-a8b8172b56e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:51.393681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e727a-3482-45c7-afa3-a8b8172b56e7 admin admin] PATH_INFO: `/v3/users/50a92243b35f45a6bbcab9d288ae5271` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:51.397404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e727a-3482-45c7-afa3-a8b8172b56e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a92243b35f45a6bbcab9d288ae5271)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:51.399443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e727a-3482-45c7-afa3-a8b8172b56e7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:51.405011 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:51.524860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dc7e727a-3482-45c7-afa3-a8b8172b56e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a92243b35f45a6bbcab9d288ae5271'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:51.525871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dc7e727a-3482-45c7-afa3-a8b8172b56e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a92243b35f45a6bbcab9d288ae5271'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:51.551205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dc7e727a-3482-45c7-afa3-a8b8172b56e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a92243b35f45a6bbcab9d288ae5271'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:51.567757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dc7e727a-3482-45c7-afa3-a8b8172b56e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a92243b35f45a6bbcab9d288ae5271'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:51.568564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dc7e727a-3482-45c7-afa3-a8b8172b56e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a92243b35f45a6bbcab9d288ae5271'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:51.586274 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2126/4237] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:18:51 2022] DELETE /identity/v3/users/50a92243b35f45a6bbcab9d288ae5271 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:52.261947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1fe12-6354-4eb2-b9f8-db6b728a5298 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:52.283919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1fe12-6354-4eb2-b9f8-db6b728a5298 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:52.473183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d2a07-c223-4075-84bb-900782871c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:52.475343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d2a07-c223-4075-84bb-900782871c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:52.476439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d2a07-c223-4075-84bb-900782871c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:52.476735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d2a07-c223-4075-84bb-900782871c00 admin admin] PATH_INFO: `/v3/projects/01cfed1efa1c408287e3e10f4e0afcb2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:52.480465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d2a07-c223-4075-84bb-900782871c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01cfed1efa1c408287e3e10f4e0afcb2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:52.487790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d2a07-c223-4075-84bb-900782871c00 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:52.546570 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:52.608299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b4d2a07-c223-4075-84bb-900782871c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01cfed1efa1c408287e3e10f4e0afcb2', 'request_id': 'req-6b4d2a07-c223-4075-84bb-900782871c00'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:52.623375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b4d2a07-c223-4075-84bb-900782871c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01cfed1efa1c408287e3e10f4e0afcb2', 'request_id': 'req-6b4d2a07-c223-4075-84bb-900782871c00'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:52.635647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b4d2a07-c223-4075-84bb-900782871c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01cfed1efa1c408287e3e10f4e0afcb2', 'request_id': 'req-6b4d2a07-c223-4075-84bb-900782871c00'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:52.675925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b4d2a07-c223-4075-84bb-900782871c00 admin admin] The token cache is being invalidate because project 01cfed1efa1c408287e3e10f4e0afcb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:18:52.676365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b4d2a07-c223-4075-84bb-900782871c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:52.684923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b4d2a07-c223-4075-84bb-900782871c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:52.691253 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2112/4238] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:18:52 2022] DELETE /identity/v3/projects/01cfed1efa1c408287e3e10f4e0afcb2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:52.697663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e8516-432e-4a1f-aabc-40733aa72c4d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:52.698549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e8516-432e-4a1f-aabc-40733aa72c4d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:52.699288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e8516-432e-4a1f-aabc-40733aa72c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:52.749490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-103e8516-432e-4a1f-aabc-40733aa72c4d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:52.752214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-103e8516-432e-4a1f-aabc-40733aa72c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:53.023660 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2127/4239] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:53.025719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd050f1-5efb-4b77-8da9-ac1c5bfe146b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:53.026007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd050f1-5efb-4b77-8da9-ac1c5bfe146b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:53.026290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd050f1-5efb-4b77-8da9-ac1c5bfe146b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:53.067962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6fd050f1-5efb-4b77-8da9-ac1c5bfe146b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:53.071828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6fd050f1-5efb-4b77-8da9-ac1c5bfe146b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:53.106819 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2113/4240] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:53.112070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e8516-432e-4a1f-aabc-40733aa72c4d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:53.126049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e8516-432e-4a1f-aabc-40733aa72c4d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:53.132171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d21205-18b4-456f-8efc-642408271f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:53.133283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d21205-18b4-456f-8efc-642408271f1b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:53.133775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d21205-18b4-456f-8efc-642408271f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:53.134218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d21205-18b4-456f-8efc-642408271f1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:53.135321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d21205-18b4-456f-8efc-642408271f1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:18:53.135821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d21205-18b4-456f-8efc-642408271f1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:53.139542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d21205-18b4-456f-8efc-642408271f1b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:53.157959 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2128/4241] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:18:53.163004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd050f1-5efb-4b77-8da9-ac1c5bfe146b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:53.173540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd050f1-5efb-4b77-8da9-ac1c5bfe146b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:53.195204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c186f3-1181-4331-8ec8-1ca26eb2b8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:53.196729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c186f3-1181-4331-8ec8-1ca26eb2b8da admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:53.197418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c186f3-1181-4331-8ec8-1ca26eb2b8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:53.198030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c186f3-1181-4331-8ec8-1ca26eb2b8da admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:53.199232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c186f3-1181-4331-8ec8-1ca26eb2b8da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:53.205490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c186f3-1181-4331-8ec8-1ca26eb2b8da admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:53.287104 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2114/4242] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:18:53 2022] POST /identity/v3/projects => generated 361 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:18:53.291893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d21205-18b4-456f-8efc-642408271f1b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:53.309981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d21205-18b4-456f-8efc-642408271f1b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:53.477174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4d08-a111-4f06-86b9-e0a8f2a5e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:53.478054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4d08-a111-4f06-86b9-e0a8f2a5e5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:53.478054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4d08-a111-4f06-86b9-e0a8f2a5e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:53.478312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4d08-a111-4f06-86b9-e0a8f2a5e5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:53.478991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead4d08-a111-4f06-86b9-e0a8f2a5e5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:53.480931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead4d08-a111-4f06-86b9-e0a8f2a5e5f8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:53.532286 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:53.542279 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2129/4243] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:18:53 2022] POST /identity/v3/users => generated 281 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:18:53.543410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c186f3-1181-4331-8ec8-1ca26eb2b8da admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:53.567957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c186f3-1181-4331-8ec8-1ca26eb2b8da admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:53.573924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e7085-283e-4541-8ead-2f963905f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:53.574876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7085-283e-4541-8ead-2f963905f3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:53.577249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7085-283e-4541-8ead-2f963905f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:53.577728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7085-283e-4541-8ead-2f963905f3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:53.578749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e7085-283e-4541-8ead-2f963905f3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:53.581552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e7085-283e-4541-8ead-2f963905f3b1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:53.598470 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2115/4244] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:53.602576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4d08-a111-4f06-86b9-e0a8f2a5e5f8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:53.626954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4d08-a111-4f06-86b9-e0a8f2a5e5f8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:53.634521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ea424-52f4-486c-b438-494791786c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:53.635193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea424-52f4-486c-b438-494791786c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:53.635475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea424-52f4-486c-b438-494791786c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:53.636323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea424-52f4-486c-b438-494791786c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:53.636987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ea424-52f4-486c-b438-494791786c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:53.639407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ea424-52f4-486c-b438-494791786c4e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:53.653405 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2130/4245] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:18:53.657780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e7085-283e-4541-8ead-2f963905f3b1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:53.674414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e7085-283e-4541-8ead-2f963905f3b1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:53.685902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ede76a-06ea-41ba-96b4-88d4da7cf3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:53.686626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ede76a-06ea-41ba-96b4-88d4da7cf3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:53.687182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ede76a-06ea-41ba-96b4-88d4da7cf3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:53.687634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ede76a-06ea-41ba-96b4-88d4da7cf3a3 admin admin] PATH_INFO: `/v3/projects/e25aef09c7514b3fb6f680974b31f0a3/users/7b0b873c04da4ae4b9f357083e846340/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:53.708420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ede76a-06ea-41ba-96b4-88d4da7cf3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25aef09c7514b3fb6f680974b31f0a3, user_id=7b0b873c04da4ae4b9f357083e846340, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:53.711886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ede76a-06ea-41ba-96b4-88d4da7cf3a3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:53.732067 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2116/4246] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:18:53 2022] PUT /identity/v3/projects/e25aef09c7514b3fb6f680974b31f0a3/users/7b0b873c04da4ae4b9f357083e846340/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:18:53.743416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b42c-2af0-40fd-a3bf-6e255ae3fe88 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:53.744367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b42c-2af0-40fd-a3bf-6e255ae3fe88 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:53.744823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b42c-2af0-40fd-a3bf-6e255ae3fe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:53.792182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d8b2b42c-2af0-40fd-a3bf-6e255ae3fe88 None None] MFA Rules not processed for user `7b0b873c04da4ae4b9f357083e846340`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:53.793781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d8b2b42c-2af0-40fd-a3bf-6e255ae3fe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:53.907089 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2131/4247] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:53.955891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ede76a-06ea-41ba-96b4-88d4da7cf3a3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:54.036221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ede76a-06ea-41ba-96b4-88d4da7cf3a3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:54.041203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:54.042080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:54.042433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:54.042973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] PATH_INFO: `/v3/users/7b0b873c04da4ae4b9f357083e846340` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:54.044349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0b873c04da4ae4b9f357083e846340)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:54.047085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:54.114599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0b873c04da4ae4b9f357083e846340'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:54.115572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0b873c04da4ae4b9f357083e846340'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:54.116760 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:54.150815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0b873c04da4ae4b9f357083e846340'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:54.162776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0b873c04da4ae4b9f357083e846340'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:54.163679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0b873c04da4ae4b9f357083e846340'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:54.187912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6c9f7-9241-4ea8-8339-08d481a02608 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:54.188076 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2117/4248] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:18:53 2022] DELETE /identity/v3/users/7b0b873c04da4ae4b9f357083e846340 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:54.188183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6c9f7-9241-4ea8-8339-08d481a02608 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:54.188472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6c9f7-9241-4ea8-8339-08d481a02608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:54.232946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-72f6c9f7-9241-4ea8-8339-08d481a02608 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:54.234704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-72f6c9f7-9241-4ea8-8339-08d481a02608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:54.413672 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2132/4249] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:18:54.422687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:54.424345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:54.593281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30452d10-7642-4a2a-9e81-4836bbefa782 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:54.604948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeed10c-ef46-4718-8449-1b7c5ca60c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:54.605830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeed10c-ef46-4718-8449-1b7c5ca60c0b service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:54.606172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeed10c-ef46-4718-8449-1b7c5ca60c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:54.607616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeed10c-ef46-4718-8449-1b7c5ca60c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:54.633141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeed10c-ef46-4718-8449-1b7c5ca60c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:54.637527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeed10c-ef46-4718-8449-1b7c5ca60c0b service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:54.652472 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2118/4250] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:18:55.372826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6c9f7-9241-4ea8-8339-08d481a02608 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:55.375133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-72f6c9f7-9241-4ea8-8339-08d481a02608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:55.399759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6c9f7-9241-4ea8-8339-08d481a02608 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:55.408672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:55.409971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:55.411280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:55.411893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f admin admin] PATH_INFO: `/v3/projects/e25aef09c7514b3fb6f680974b31f0a3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:55.415540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25aef09c7514b3fb6f680974b31f0a3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:55.418699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:55.481196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25aef09c7514b3fb6f680974b31f0a3', 'request_id': 'req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:55.490173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25aef09c7514b3fb6f680974b31f0a3', 'request_id': 'req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:55.503204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25aef09c7514b3fb6f680974b31f0a3', 'request_id': 'req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:55.508584 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:55.515263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f admin admin] The token cache is being invalidate because project e25aef09c7514b3fb6f680974b31f0a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:18:55.515812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:55.516539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1be26b4-bf9c-45c8-9b2d-a3b9b1c7cc1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:55.518353 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2133/4251] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:18:55 2022] DELETE /identity/v3/projects/e25aef09c7514b3fb6f680974b31f0a3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:55.526476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1d819-e0f6-44dc-b82d-95209a5466c9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:55.527010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1d819-e0f6-44dc-b82d-95209a5466c9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:55.527381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1d819-e0f6-44dc-b82d-95209a5466c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:55.550488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a7a1d819-e0f6-44dc-b82d-95209a5466c9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:55.552100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a7a1d819-e0f6-44dc-b82d-95209a5466c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:55.631573 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2119/4252] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:55.640469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871cc4b-6b4b-4e97-9bd7-c70372eed37b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:55.640786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871cc4b-6b4b-4e97-9bd7-c70372eed37b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:55.641187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871cc4b-6b4b-4e97-9bd7-c70372eed37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:55.673284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1871cc4b-6b4b-4e97-9bd7-c70372eed37b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:55.675011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1871cc4b-6b4b-4e97-9bd7-c70372eed37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:55.684329 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2134/4253] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:55.689103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1d819-e0f6-44dc-b82d-95209a5466c9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:55.702741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1d819-e0f6-44dc-b82d-95209a5466c9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:55.712221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc642a-52cb-4150-b0a6-9cbec85e9afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:55.714364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc642a-52cb-4150-b0a6-9cbec85e9afc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:55.714597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc642a-52cb-4150-b0a6-9cbec85e9afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:55.714869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc642a-52cb-4150-b0a6-9cbec85e9afc admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:55.715554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc642a-52cb-4150-b0a6-9cbec85e9afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:18:55.715860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc642a-52cb-4150-b0a6-9cbec85e9afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:55.718068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc642a-52cb-4150-b0a6-9cbec85e9afc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:55.745993 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2120/4254] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:18:55.746813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871cc4b-6b4b-4e97-9bd7-c70372eed37b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:55.759909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871cc4b-6b4b-4e97-9bd7-c70372eed37b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:55.768312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d805cec-532b-4787-8abf-cde0c83e5e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:55.769082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d805cec-532b-4787-8abf-cde0c83e5e1d admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:55.769402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d805cec-532b-4787-8abf-cde0c83e5e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:55.769743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d805cec-532b-4787-8abf-cde0c83e5e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:55.770442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d805cec-532b-4787-8abf-cde0c83e5e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:55.772937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d805cec-532b-4787-8abf-cde0c83e5e1d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:55.812835 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2135/4255] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:18:55 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:18:55.820273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc642a-52cb-4150-b0a6-9cbec85e9afc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:55.834898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc642a-52cb-4150-b0a6-9cbec85e9afc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:55.940499 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:55.963572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4f035-eb58-40c5-b43d-92859285a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:55.964361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4f035-eb58-40c5-b43d-92859285a1eb admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:55.964648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4f035-eb58-40c5-b43d-92859285a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:55.966349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4f035-eb58-40c5-b43d-92859285a1eb admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:55.970428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4f035-eb58-40c5-b43d-92859285a1eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:55.972581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4f035-eb58-40c5-b43d-92859285a1eb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:56.009391 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2121/4256] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:18:55 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:18:56.011042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d805cec-532b-4787-8abf-cde0c83e5e1d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:56.026758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d805cec-532b-4787-8abf-cde0c83e5e1d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:56.038578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7893a-5431-431b-a8a6-84f1c9ab3045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:56.039256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7893a-5431-431b-a8a6-84f1c9ab3045 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:56.039536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7893a-5431-431b-a8a6-84f1c9ab3045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:56.039807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7893a-5431-431b-a8a6-84f1c9ab3045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:56.042681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7893a-5431-431b-a8a6-84f1c9ab3045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:56.046725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7893a-5431-431b-a8a6-84f1c9ab3045 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:56.072279 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2136/4257] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:56.076573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4f035-eb58-40c5-b43d-92859285a1eb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:56.102900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4f035-eb58-40c5-b43d-92859285a1eb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:56.125128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089209e-4d43-4141-a6ea-49c19c7c133d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:56.125766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089209e-4d43-4141-a6ea-49c19c7c133d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:56.126047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089209e-4d43-4141-a6ea-49c19c7c133d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:56.126325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089209e-4d43-4141-a6ea-49c19c7c133d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:56.127052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089209e-4d43-4141-a6ea-49c19c7c133d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:56.129316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089209e-4d43-4141-a6ea-49c19c7c133d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:56.164458 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2122/4258] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:18:56.168276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7893a-5431-431b-a8a6-84f1c9ab3045 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:56.181325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7893a-5431-431b-a8a6-84f1c9ab3045 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:56.199841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9e729-078c-4f58-83b4-0fb8d52bf72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:56.200551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9e729-078c-4f58-83b4-0fb8d52bf72d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:56.201275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9e729-078c-4f58-83b4-0fb8d52bf72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:56.201724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9e729-078c-4f58-83b4-0fb8d52bf72d admin admin] PATH_INFO: `/v3/projects/e664ea80daaf450886978f25b2d9e373/users/d5e97960c4eb488b900951e0898f34c8/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:56.235352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9e729-078c-4f58-83b4-0fb8d52bf72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e664ea80daaf450886978f25b2d9e373, user_id=d5e97960c4eb488b900951e0898f34c8, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:56.243483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9e729-078c-4f58-83b4-0fb8d52bf72d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:56.273903 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2137/4259] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:18:56 2022] PUT /identity/v3/projects/e664ea80daaf450886978f25b2d9e373/users/d5e97960c4eb488b900951e0898f34c8/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:56.279058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e0f07-6cca-4166-b9b5-606208b7eb22 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:56.279551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e0f07-6cca-4166-b9b5-606208b7eb22 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:56.279973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e0f07-6cca-4166-b9b5-606208b7eb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:56.316176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d16e0f07-6cca-4166-b9b5-606208b7eb22 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:56.317739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d16e0f07-6cca-4166-b9b5-606208b7eb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:56.441570 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2123/4260] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:56.530611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9e729-078c-4f58-83b4-0fb8d52bf72d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:56.532839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cad9e729-078c-4f58-83b4-0fb8d52bf72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:56.628657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9e729-078c-4f58-83b4-0fb8d52bf72d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:56.634715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a9cfe-f28c-437c-8ebd-fb2a94341fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:56.635423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a9cfe-f28c-437c-8ebd-fb2a94341fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:56.635756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a9cfe-f28c-437c-8ebd-fb2a94341fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:56.636128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a9cfe-f28c-437c-8ebd-fb2a94341fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:56.662445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a9cfe-f28c-437c-8ebd-fb2a94341fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:56.666001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a9cfe-f28c-437c-8ebd-fb2a94341fd5 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:56.680210 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2138/4261] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:18:59.058723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e0f07-6cca-4166-b9b5-606208b7eb22 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:59.061254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d16e0f07-6cca-4166-b9b5-606208b7eb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:59.094677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e0f07-6cca-4166-b9b5-606208b7eb22 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:59.102711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:59.103873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:59.104800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:59.105224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] PATH_INFO: `/v3/users/27722c5f061d441fb0e2cd05a8b42e5f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:59.106826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] RBAC: Authorizing `identity:delete_user(user_id=27722c5f061d441fb0e2cd05a8b42e5f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:59.111416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:59.193126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27722c5f061d441fb0e2cd05a8b42e5f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:59.194170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27722c5f061d441fb0e2cd05a8b42e5f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:59.218772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27722c5f061d441fb0e2cd05a8b42e5f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:59.234263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27722c5f061d441fb0e2cd05a8b42e5f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:59.235399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27722c5f061d441fb0e2cd05a8b42e5f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:18:59.255515 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2124/4262] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:18:59 2022] DELETE /identity/v3/users/27722c5f061d441fb0e2cd05a8b42e5f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:18:59.260223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56f6b6-0bfe-41f9-86c7-2df51e855d35 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:59.261143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56f6b6-0bfe-41f9-86c7-2df51e855d35 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:59.261418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56f6b6-0bfe-41f9-86c7-2df51e855d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:59.282233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fe56f6b6-0bfe-41f9-86c7-2df51e855d35 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:18:59.283894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fe56f6b6-0bfe-41f9-86c7-2df51e855d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:59.397773 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2139/4263] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:18:59.411894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:18:59.413355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:18:59.535223 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:59.550458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067ed78-02b1-41ec-b151-891656ac811d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:18:59.570258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee97002-8080-4056-9e67-6cb7b203d2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:18:59.570258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee97002-8080-4056-9e67-6cb7b203d2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:18:59.570258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee97002-8080-4056-9e67-6cb7b203d2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:18:59.570258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee97002-8080-4056-9e67-6cb7b203d2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:18:59.580907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee97002-8080-4056-9e67-6cb7b203d2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:18:59.582988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee97002-8080-4056-9e67-6cb7b203d2a7 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:18:59.595119 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2125/4264] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:00.708222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56f6b6-0bfe-41f9-86c7-2df51e855d35 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:00.710087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fe56f6b6-0bfe-41f9-86c7-2df51e855d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:00.740530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56f6b6-0bfe-41f9-86c7-2df51e855d35 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:00.755205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d85717-fd19-45b0-b9f4-946feaee9b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:00.756731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85717-fd19-45b0-b9f4-946feaee9b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:00.757253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85717-fd19-45b0-b9f4-946feaee9b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:00.757745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85717-fd19-45b0-b9f4-946feaee9b34 admin admin] PATH_INFO: `/v3/projects/70badce1a2e24053bf73930ad23bd986` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:00.759676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d85717-fd19-45b0-b9f4-946feaee9b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70badce1a2e24053bf73930ad23bd986)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:00.762294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d85717-fd19-45b0-b9f4-946feaee9b34 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:00.847594 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:00.867043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e0d85717-fd19-45b0-b9f4-946feaee9b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70badce1a2e24053bf73930ad23bd986', 'request_id': 'req-e0d85717-fd19-45b0-b9f4-946feaee9b34'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:00.876415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e0d85717-fd19-45b0-b9f4-946feaee9b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70badce1a2e24053bf73930ad23bd986', 'request_id': 'req-e0d85717-fd19-45b0-b9f4-946feaee9b34'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:00.888787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e0d85717-fd19-45b0-b9f4-946feaee9b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70badce1a2e24053bf73930ad23bd986', 'request_id': 'req-e0d85717-fd19-45b0-b9f4-946feaee9b34'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:00.907856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e0d85717-fd19-45b0-b9f4-946feaee9b34 admin admin] The token cache is being invalidate because project 70badce1a2e24053bf73930ad23bd986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:19:00.908810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e0d85717-fd19-45b0-b9f4-946feaee9b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:00.909576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e0d85717-fd19-45b0-b9f4-946feaee9b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:00.912223 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2140/4265] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:19:00 2022] DELETE /identity/v3/projects/70badce1a2e24053bf73930ad23bd986 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:00.917840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5390-713e-4316-9e97-208a2381ad8e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:00.918363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5390-713e-4316-9e97-208a2381ad8e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:00.918363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5390-713e-4316-9e97-208a2381ad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:00.946471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ccfd5390-713e-4316-9e97-208a2381ad8e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:00.948191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ccfd5390-713e-4316-9e97-208a2381ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:01.103076 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2126/4266] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:01.108320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c66b-214c-4257-a9b4-badebd81500a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:01.108602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c66b-214c-4257-a9b4-badebd81500a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:01.108876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c66b-214c-4257-a9b4-badebd81500a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:01.149598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3544c66b-214c-4257-a9b4-badebd81500a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:01.151271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3544c66b-214c-4257-a9b4-badebd81500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:01.177699 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2141/4267] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:01.182140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd5390-713e-4316-9e97-208a2381ad8e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:01.196147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd5390-713e-4316-9e97-208a2381ad8e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:01.209200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfce8c-0ba3-4483-9ccc-e233a18a8b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:01.210126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfce8c-0ba3-4483-9ccc-e233a18a8b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:01.210616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfce8c-0ba3-4483-9ccc-e233a18a8b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:01.211153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfce8c-0ba3-4483-9ccc-e233a18a8b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:01.212746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfce8c-0ba3-4483-9ccc-e233a18a8b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:19:01.213282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfce8c-0ba3-4483-9ccc-e233a18a8b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:01.215507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfce8c-0ba3-4483-9ccc-e233a18a8b06 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:01.231056 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2127/4268] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:19:01.234529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544c66b-214c-4257-a9b4-badebd81500a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:01.253037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544c66b-214c-4257-a9b4-badebd81500a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:01.261207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c15eb-eb70-4bc9-8c3c-deea9dd25bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:01.261986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c15eb-eb70-4bc9-8c3c-deea9dd25bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:01.262374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c15eb-eb70-4bc9-8c3c-deea9dd25bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:01.262751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c15eb-eb70-4bc9-8c3c-deea9dd25bb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:01.263573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c15eb-eb70-4bc9-8c3c-deea9dd25bb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:01.265627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c15eb-eb70-4bc9-8c3c-deea9dd25bb7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:01.318897 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2142/4269] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:19:01 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:19:01.319130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfce8c-0ba3-4483-9ccc-e233a18a8b06 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:01.330579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfce8c-0ba3-4483-9ccc-e233a18a8b06 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:01.417289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e7def-6c9f-4613-aedc-67a80a00570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:01.418294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e7def-6c9f-4613-aedc-67a80a00570f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:01.418750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e7def-6c9f-4613-aedc-67a80a00570f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:01.419177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e7def-6c9f-4613-aedc-67a80a00570f admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:01.420442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e7def-6c9f-4613-aedc-67a80a00570f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:01.422419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e7def-6c9f-4613-aedc-67a80a00570f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:01.478015 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2128/4270] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:19:01 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:19:01.479495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c15eb-eb70-4bc9-8c3c-deea9dd25bb7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:01.492539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c15eb-eb70-4bc9-8c3c-deea9dd25bb7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:01.498858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e19ce3-454b-4f61-ae44-6da2ea9c6864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:01.499746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e19ce3-454b-4f61-ae44-6da2ea9c6864 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:01.500346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e19ce3-454b-4f61-ae44-6da2ea9c6864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:01.501413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e19ce3-454b-4f61-ae44-6da2ea9c6864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:01.502804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e19ce3-454b-4f61-ae44-6da2ea9c6864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:01.511352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e19ce3-454b-4f61-ae44-6da2ea9c6864 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:01.530459 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2143/4271] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:19:01.535488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e7def-6c9f-4613-aedc-67a80a00570f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:01.583598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e7def-6c9f-4613-aedc-67a80a00570f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:01.601956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5539a-9110-4d51-bcf0-ab3dcc088fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:01.603181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5539a-9110-4d51-bcf0-ab3dcc088fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:01.604114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5539a-9110-4d51-bcf0-ab3dcc088fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:01.606321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5539a-9110-4d51-bcf0-ab3dcc088fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:01.608457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5539a-9110-4d51-bcf0-ab3dcc088fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:01.610511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5539a-9110-4d51-bcf0-ab3dcc088fc0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:01.630843 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2129/4272] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:19:01.637012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e19ce3-454b-4f61-ae44-6da2ea9c6864 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:01.651174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e19ce3-454b-4f61-ae44-6da2ea9c6864 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:01.656531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d694d2a-2b8d-4610-9d66-77373a259431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:01.657198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d694d2a-2b8d-4610-9d66-77373a259431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:01.657475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d694d2a-2b8d-4610-9d66-77373a259431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:01.658040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d694d2a-2b8d-4610-9d66-77373a259431 admin admin] PATH_INFO: `/v3/projects/5043adb0a7d9494cb822412bfdd3a960/users/b36b899d4c5a4f4ebaa4537074c6b139/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:01.742139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d694d2a-2b8d-4610-9d66-77373a259431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5043adb0a7d9494cb822412bfdd3a960, user_id=b36b899d4c5a4f4ebaa4537074c6b139, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:01.751802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d694d2a-2b8d-4610-9d66-77373a259431 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:01.801107 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2144/4273] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:19:01 2022] PUT /identity/v3/projects/5043adb0a7d9494cb822412bfdd3a960/users/b36b899d4c5a4f4ebaa4537074c6b139/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:01.803899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a603-fbbd-477a-9090-c93dc86822f9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:01.804197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a603-fbbd-477a-9090-c93dc86822f9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:01.806957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a603-fbbd-477a-9090-c93dc86822f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:01.892996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5cf2a603-fbbd-477a-9090-c93dc86822f9 None None] MFA Rules not processed for user `b36b899d4c5a4f4ebaa4537074c6b139`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:01.894240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5cf2a603-fbbd-477a-9090-c93dc86822f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:01.997116 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:02.040981 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2130/4274] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:19:02.054020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d694d2a-2b8d-4610-9d66-77373a259431 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:02.056039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3d694d2a-2b8d-4610-9d66-77373a259431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:02.182622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d694d2a-2b8d-4610-9d66-77373a259431 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:02.197132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88173427-d267-4c5d-b7e3-821fbfa77826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:02.197683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88173427-d267-4c5d-b7e3-821fbfa77826 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:02.197965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88173427-d267-4c5d-b7e3-821fbfa77826 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:02.198542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88173427-d267-4c5d-b7e3-821fbfa77826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:02.219506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88173427-d267-4c5d-b7e3-821fbfa77826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:02.221003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88173427-d267-4c5d-b7e3-821fbfa77826 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:02.236391 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2145/4275] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:02.527139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2a603-fbbd-477a-9090-c93dc86822f9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:02.529990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5cf2a603-fbbd-477a-9090-c93dc86822f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:02.804598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2a603-fbbd-477a-9090-c93dc86822f9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:02.817402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:02.818224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:02.819012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:02.819520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] PATH_INFO: `/v3/users/caf9f3f309d24beca62915115e1cf71f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:02.820867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf9f3f309d24beca62915115e1cf71f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:02.823590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:02.923529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf9f3f309d24beca62915115e1cf71f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:02.928265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf9f3f309d24beca62915115e1cf71f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:02.947065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf9f3f309d24beca62915115e1cf71f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:02.963484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf9f3f309d24beca62915115e1cf71f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:02.964374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf9f3f309d24beca62915115e1cf71f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:02.999799 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2131/4276] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:19:02 2022] DELETE /identity/v3/users/caf9f3f309d24beca62915115e1cf71f => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:03.001925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c9db9-a57c-40a9-a521-9bb53d459b05 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:03.002998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c9db9-a57c-40a9-a521-9bb53d459b05 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:03.003412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c9db9-a57c-40a9-a521-9bb53d459b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:03.044033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-020c9db9-a57c-40a9-a521-9bb53d459b05 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:03.046454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-020c9db9-a57c-40a9-a521-9bb53d459b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:03.185198 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2146/4277] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:03.203005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:03.204777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:03.348471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ffab1-985b-455b-8029-e108026a91aa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:03.362277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cf2f5-db05-400a-8670-f8c0fd262009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:03.363206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cf2f5-db05-400a-8670-f8c0fd262009 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:03.363962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cf2f5-db05-400a-8670-f8c0fd262009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:03.366333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cf2f5-db05-400a-8670-f8c0fd262009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:03.389574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cf2f5-db05-400a-8670-f8c0fd262009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:03.392026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cf2f5-db05-400a-8670-f8c0fd262009 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:03.407481 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2132/4278] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:04.022192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c9db9-a57c-40a9-a521-9bb53d459b05 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:04.024003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-020c9db9-a57c-40a9-a521-9bb53d459b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:04.047367 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:04.057747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c9db9-a57c-40a9-a521-9bb53d459b05 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:04.082049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233e5c4-eb34-444f-96c1-96d03f792ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:04.083308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e5c4-eb34-444f-96c1-96d03f792ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:04.083751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e5c4-eb34-444f-96c1-96d03f792ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:04.084178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e5c4-eb34-444f-96c1-96d03f792ca3 admin admin] PATH_INFO: `/v3/projects/0c0a00cb20204370816182cbfde61b28` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:04.086217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233e5c4-eb34-444f-96c1-96d03f792ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0a00cb20204370816182cbfde61b28)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:04.088879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233e5c4-eb34-444f-96c1-96d03f792ca3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:04.228479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8233e5c4-eb34-444f-96c1-96d03f792ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0a00cb20204370816182cbfde61b28', 'request_id': 'req-8233e5c4-eb34-444f-96c1-96d03f792ca3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:04.240224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8233e5c4-eb34-444f-96c1-96d03f792ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0a00cb20204370816182cbfde61b28', 'request_id': 'req-8233e5c4-eb34-444f-96c1-96d03f792ca3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:04.251052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8233e5c4-eb34-444f-96c1-96d03f792ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0a00cb20204370816182cbfde61b28', 'request_id': 'req-8233e5c4-eb34-444f-96c1-96d03f792ca3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:04.280274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8233e5c4-eb34-444f-96c1-96d03f792ca3 admin admin] The token cache is being invalidate because project 0c0a00cb20204370816182cbfde61b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:19:04.281655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8233e5c4-eb34-444f-96c1-96d03f792ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:04.283971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8233e5c4-eb34-444f-96c1-96d03f792ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:04.287960 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2147/4279] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:19:04 2022] DELETE /identity/v3/projects/0c0a00cb20204370816182cbfde61b28 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:04.293251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79082f63-c519-4c7e-8cf7-5908b351a4a9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:04.293830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79082f63-c519-4c7e-8cf7-5908b351a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:04.293830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79082f63-c519-4c7e-8cf7-5908b351a4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:04.343299 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:04.358693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-79082f63-c519-4c7e-8cf7-5908b351a4a9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:04.361854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-79082f63-c519-4c7e-8cf7-5908b351a4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:04.516098 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2133/4280] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:04.522336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d52a96-f88c-49db-8c66-4e0804781e68 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:04.523095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d52a96-f88c-49db-8c66-4e0804781e68 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:04.523806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d52a96-f88c-49db-8c66-4e0804781e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:04.566714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-43d52a96-f88c-49db-8c66-4e0804781e68 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:04.568168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-43d52a96-f88c-49db-8c66-4e0804781e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:04.590785 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2148/4281] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:04.596458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79082f63-c519-4c7e-8cf7-5908b351a4a9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:04.612262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79082f63-c519-4c7e-8cf7-5908b351a4a9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:04.626604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf4e91-5aa3-4ddb-907a-52a5c6ea07b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:04.632400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf4e91-5aa3-4ddb-907a-52a5c6ea07b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:04.632955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf4e91-5aa3-4ddb-907a-52a5c6ea07b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:04.634828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf4e91-5aa3-4ddb-907a-52a5c6ea07b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:04.640084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf4e91-5aa3-4ddb-907a-52a5c6ea07b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:19:04.642665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf4e91-5aa3-4ddb-907a-52a5c6ea07b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:04.646453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf4e91-5aa3-4ddb-907a-52a5c6ea07b2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:04.674944 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2134/4282] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:19:04.679223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d52a96-f88c-49db-8c66-4e0804781e68 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:04.694186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d52a96-f88c-49db-8c66-4e0804781e68 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:04.706009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4c9cc-6147-4caf-8207-4619e1020099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:04.706645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4c9cc-6147-4caf-8207-4619e1020099 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:04.706954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4c9cc-6147-4caf-8207-4619e1020099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:04.707223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4c9cc-6147-4caf-8207-4619e1020099 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:04.707935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4c9cc-6147-4caf-8207-4619e1020099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:04.712978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4c9cc-6147-4caf-8207-4619e1020099 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:04.771420 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2149/4283] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:19:04 2022] POST /identity/v3/projects => generated 351 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:19:04.772973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf4e91-5aa3-4ddb-907a-52a5c6ea07b2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:04.786305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf4e91-5aa3-4ddb-907a-52a5c6ea07b2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:04.865246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a5b26-0c15-4075-85d4-75c466ca823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:04.866220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a5b26-0c15-4075-85d4-75c466ca823b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:04.866965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a5b26-0c15-4075-85d4-75c466ca823b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:04.867557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a5b26-0c15-4075-85d4-75c466ca823b admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:04.868664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a5b26-0c15-4075-85d4-75c466ca823b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:04.871257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a5b26-0c15-4075-85d4-75c466ca823b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:04.915639 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2135/4284] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:19:04 2022] POST /identity/v3/users => generated 276 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:19:04.917686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4c9cc-6147-4caf-8207-4619e1020099 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:04.930214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4c9cc-6147-4caf-8207-4619e1020099 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:04.946473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a75cb-72da-43eb-802c-6fe3eeefc23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:04.947126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a75cb-72da-43eb-802c-6fe3eeefc23e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:04.947406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a75cb-72da-43eb-802c-6fe3eeefc23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:04.947679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a75cb-72da-43eb-802c-6fe3eeefc23e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:04.948326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a75cb-72da-43eb-802c-6fe3eeefc23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:04.950479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a75cb-72da-43eb-802c-6fe3eeefc23e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:04.972544 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2150/4285] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:19:04.976713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a5b26-0c15-4075-85d4-75c466ca823b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:04.992806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a5b26-0c15-4075-85d4-75c466ca823b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:05.008245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8c665-efa7-4655-bd34-7021a9ab693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:05.009643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8c665-efa7-4655-bd34-7021a9ab693e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:05.010090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8c665-efa7-4655-bd34-7021a9ab693e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:05.010557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8c665-efa7-4655-bd34-7021a9ab693e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:05.011391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8c665-efa7-4655-bd34-7021a9ab693e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:05.014863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8c665-efa7-4655-bd34-7021a9ab693e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:05.043261 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2136/4286] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:19:05.046722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a75cb-72da-43eb-802c-6fe3eeefc23e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:05.057938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a75cb-72da-43eb-802c-6fe3eeefc23e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:05.073872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd4732-babc-49ba-a526-659270b341c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:05.074651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd4732-babc-49ba-a526-659270b341c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:05.074969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd4732-babc-49ba-a526-659270b341c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:05.075254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd4732-babc-49ba-a526-659270b341c6 admin admin] PATH_INFO: `/v3/projects/c45351c0bf8c45d6b3327b4aa886432a/users/3b54a56ba71141ebb93cc611d31234c4/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:05.109723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd4732-babc-49ba-a526-659270b341c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45351c0bf8c45d6b3327b4aa886432a, user_id=3b54a56ba71141ebb93cc611d31234c4, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:05.120798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd4732-babc-49ba-a526-659270b341c6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:05.149110 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2151/4287] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:19:05 2022] PUT /identity/v3/projects/c45351c0bf8c45d6b3327b4aa886432a/users/3b54a56ba71141ebb93cc611d31234c4/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:05.159998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b22f5d-ad51-4e6b-aeae-15a2df969e34 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:05.160480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b22f5d-ad51-4e6b-aeae-15a2df969e34 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:05.162495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b22f5d-ad51-4e6b-aeae-15a2df969e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:05.226556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c2b22f5d-ad51-4e6b-aeae-15a2df969e34 None None] MFA Rules not processed for user `3b54a56ba71141ebb93cc611d31234c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:05.229469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c2b22f5d-ad51-4e6b-aeae-15a2df969e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:05.395285 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2137/4288] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:05.412205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd4732-babc-49ba-a526-659270b341c6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:05.414687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a5bd4732-babc-49ba-a526-659270b341c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:05.551889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd4732-babc-49ba-a526-659270b341c6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:05.557482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccfd2e-e508-42f4-ba52-5adfffec5fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:05.572243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccfd2e-e508-42f4-ba52-5adfffec5fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:05.572745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccfd2e-e508-42f4-ba52-5adfffec5fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:05.574175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccfd2e-e508-42f4-ba52-5adfffec5fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:05.627270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccfd2e-e508-42f4-ba52-5adfffec5fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:05.628729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccfd2e-e508-42f4-ba52-5adfffec5fd1 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:05.664754 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2152/4289] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:06.804079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb7180-1f72-4ae9-b525-206242645945 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:06.804617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb7180-1f72-4ae9-b525-206242645945 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:06.804617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb7180-1f72-4ae9-b525-206242645945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:06.814527 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:06.858571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fdfb7180-1f72-4ae9-b525-206242645945 None None] MFA Rules not processed for user `d5e97960c4eb488b900951e0898f34c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:06.862709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fdfb7180-1f72-4ae9-b525-206242645945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:07.049425 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2138/4290] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:07.056515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccfd2e-e508-42f4-ba52-5adfffec5fd1 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:07.058705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-deccfd2e-e508-42f4-ba52-5adfffec5fd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:07.109533 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:07.235640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccfd2e-e508-42f4-ba52-5adfffec5fd1 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:07.251915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2096a-9a94-421a-83a8-8963b0a50e15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:07.252964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2096a-9a94-421a-83a8-8963b0a50e15 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:07.253396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2096a-9a94-421a-83a8-8963b0a50e15 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:07.253808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2096a-9a94-421a-83a8-8963b0a50e15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:07.264023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2096a-9a94-421a-83a8-8963b0a50e15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:07.265902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2096a-9a94-421a-83a8-8963b0a50e15 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:07.276912 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2153/4291] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:11.477477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb7180-1f72-4ae9-b525-206242645945 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:11.481835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fdfb7180-1f72-4ae9-b525-206242645945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:11.719463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb7180-1f72-4ae9-b525-206242645945 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:11.742826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:11.743557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:11.743901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:11.744095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] PATH_INFO: `/v3/users/b7cdbf32b68a44a28e4cc9c4210b5e56` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:11.745421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7cdbf32b68a44a28e4cc9c4210b5e56)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:11.754766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:11.922198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7cdbf32b68a44a28e4cc9c4210b5e56'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:11.925612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7cdbf32b68a44a28e4cc9c4210b5e56'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:11.977029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7cdbf32b68a44a28e4cc9c4210b5e56'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:11.993186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7cdbf32b68a44a28e4cc9c4210b5e56'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:11.993806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7cdbf32b68a44a28e4cc9c4210b5e56'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:12.032471 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2139/4292] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:19:11 2022] DELETE /identity/v3/users/b7cdbf32b68a44a28e4cc9c4210b5e56 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:12.113341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2096a-9a94-421a-83a8-8963b0a50e15 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:12.115108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-02b2096a-9a94-421a-83a8-8963b0a50e15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:12.299513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2096a-9a94-421a-83a8-8963b0a50e15 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:12.453629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12141c-137a-4692-bf4f-3aebada15e3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:12.454270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12141c-137a-4692-bf4f-3aebada15e3d service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:12.455808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12141c-137a-4692-bf4f-3aebada15e3d service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:12.456117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12141c-137a-4692-bf4f-3aebada15e3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:12.460616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0e12141c-137a-4692-bf4f-3aebada15e3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:12.492803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12141c-137a-4692-bf4f-3aebada15e3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:12.497092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12141c-137a-4692-bf4f-3aebada15e3d service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:12.552393 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2154/4293] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:12.806588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:12.808682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:12.841153 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:12.966738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17424-bfea-45a5-b55f-e3ea3aad138c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:12.975057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5188d6-8de2-4f7f-85e8-c4ac514d8be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:12.992929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5188d6-8de2-4f7f-85e8-c4ac514d8be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:12.994954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5188d6-8de2-4f7f-85e8-c4ac514d8be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:12.996577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5188d6-8de2-4f7f-85e8-c4ac514d8be9 admin admin] PATH_INFO: `/v3/users/3b54a56ba71141ebb93cc611d31234c4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.002124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5188d6-8de2-4f7f-85e8-c4ac514d8be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b54a56ba71141ebb93cc611d31234c4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:13.013846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5188d6-8de2-4f7f-85e8-c4ac514d8be9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:13.018295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12141c-137a-4692-bf4f-3aebada15e3d service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:13.022387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0e12141c-137a-4692-bf4f-3aebada15e3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:13.055250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12141c-137a-4692-bf4f-3aebada15e3d service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:13.071300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221abd98-7091-4698-9e6d-69784b66cf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:13.071991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221abd98-7091-4698-9e6d-69784b66cf32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:13.073591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221abd98-7091-4698-9e6d-69784b66cf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:13.074058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221abd98-7091-4698-9e6d-69784b66cf32 admin admin] PATH_INFO: `/v3/projects/131d702dc0e34408bf3e58809c5cfb0d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.077577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221abd98-7091-4698-9e6d-69784b66cf32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=131d702dc0e34408bf3e58809c5cfb0d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:13.083515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221abd98-7091-4698-9e6d-69784b66cf32 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:13.147602 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:13.160150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fe5188d6-8de2-4f7f-85e8-c4ac514d8be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b54a56ba71141ebb93cc611d31234c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:13.162483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fe5188d6-8de2-4f7f-85e8-c4ac514d8be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b54a56ba71141ebb93cc611d31234c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:13.202841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fe5188d6-8de2-4f7f-85e8-c4ac514d8be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b54a56ba71141ebb93cc611d31234c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:13.211576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-221abd98-7091-4698-9e6d-69784b66cf32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131d702dc0e34408bf3e58809c5cfb0d', 'request_id': 'req-221abd98-7091-4698-9e6d-69784b66cf32'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:13.214117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fe5188d6-8de2-4f7f-85e8-c4ac514d8be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b54a56ba71141ebb93cc611d31234c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:13.214865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fe5188d6-8de2-4f7f-85e8-c4ac514d8be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b54a56ba71141ebb93cc611d31234c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:13.227202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-221abd98-7091-4698-9e6d-69784b66cf32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131d702dc0e34408bf3e58809c5cfb0d', 'request_id': 'req-221abd98-7091-4698-9e6d-69784b66cf32'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:13.239311 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2140/4294] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:19:12 2022] DELETE /identity/v3/users/3b54a56ba71141ebb93cc611d31234c4 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:13.242617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-221abd98-7091-4698-9e6d-69784b66cf32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131d702dc0e34408bf3e58809c5cfb0d', 'request_id': 'req-221abd98-7091-4698-9e6d-69784b66cf32'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:13.244460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee46c-2fcf-4691-a2b0-5188b2ab3f68 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:13.244854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee46c-2fcf-4691-a2b0-5188b2ab3f68 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:13.245377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee46c-2fcf-4691-a2b0-5188b2ab3f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.264859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-221abd98-7091-4698-9e6d-69784b66cf32 admin admin] The token cache is being invalidate because project 131d702dc0e34408bf3e58809c5cfb0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:19:13.264859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-221abd98-7091-4698-9e6d-69784b66cf32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:13.264859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-221abd98-7091-4698-9e6d-69784b66cf32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:13.265420 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2155/4295] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:19:13 2022] DELETE /identity/v3/projects/131d702dc0e34408bf3e58809c5cfb0d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:19:13.267164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66386706-76ce-4b68-8147-ce7c486d8814 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:13.267604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66386706-76ce-4b68-8147-ce7c486d8814 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:13.268049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66386706-76ce-4b68-8147-ce7c486d8814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.279958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-98bee46c-2fcf-4691-a2b0-5188b2ab3f68 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:13.282164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-98bee46c-2fcf-4691-a2b0-5188b2ab3f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:13.297113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-66386706-76ce-4b68-8147-ce7c486d8814 None None] MFA Rules not processed for user `d5e97960c4eb488b900951e0898f34c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:13.298568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-66386706-76ce-4b68-8147-ce7c486d8814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:13.370751 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2156/4296] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:13.376373 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2141/4297] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:13.376373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5735af-3bf4-4e3b-b102-75c01148cc62 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:13.385495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66386706-76ce-4b68-8147-ce7c486d8814 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:13.387144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-66386706-76ce-4b68-8147-ce7c486d8814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:13.389784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5735af-3bf4-4e3b-b102-75c01148cc62 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:13.390207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5735af-3bf4-4e3b-b102-75c01148cc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.463643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0e5735af-3bf4-4e3b-b102-75c01148cc62 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:13.464863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0e5735af-3bf4-4e3b-b102-75c01148cc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:13.478617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66386706-76ce-4b68-8147-ce7c486d8814 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:13.485083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fdc28-c5f6-471c-a2f4-87f586154838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:13.486053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fdc28-c5f6-471c-a2f4-87f586154838 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:13.486475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fdc28-c5f6-471c-a2f4-87f586154838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:13.486887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fdc28-c5f6-471c-a2f4-87f586154838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.489111 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2142/4298] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:13.501206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fdc28-c5f6-471c-a2f4-87f586154838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:13.503072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fdc28-c5f6-471c-a2f4-87f586154838 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:13.503854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66d685-0db1-46ca-bb52-585511816edd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:13.504142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66d685-0db1-46ca-bb52-585511816edd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:13.504422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66d685-0db1-46ca-bb52-585511816edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.521852 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2157/4299] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:13.556567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bf66d685-0db1-46ca-bb52-585511816edd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:13.557869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bf66d685-0db1-46ca-bb52-585511816edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:13.570279 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2143/4300] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:13.574522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fdc28-c5f6-471c-a2f4-87f586154838 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:13.584799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fdc28-c5f6-471c-a2f4-87f586154838 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:13.590132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460404c-3399-4ac1-a97e-4e5c2072df9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:13.590726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460404c-3399-4ac1-a97e-4e5c2072df9f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:13.591139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460404c-3399-4ac1-a97e-4e5c2072df9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:13.591491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460404c-3399-4ac1-a97e-4e5c2072df9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.592703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460404c-3399-4ac1-a97e-4e5c2072df9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:19:13.593274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460404c-3399-4ac1-a97e-4e5c2072df9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:13.594996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460404c-3399-4ac1-a97e-4e5c2072df9f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:13.612734 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2158/4301] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:19:13.618555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66d685-0db1-46ca-bb52-585511816edd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:13.632231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66d685-0db1-46ca-bb52-585511816edd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:13.640624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708a7be-67b8-4dc6-bb42-de072ed3afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:13.641331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708a7be-67b8-4dc6-bb42-de072ed3afae admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:13.641676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708a7be-67b8-4dc6-bb42-de072ed3afae admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:13.642015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708a7be-67b8-4dc6-bb42-de072ed3afae admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.642720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708a7be-67b8-4dc6-bb42-de072ed3afae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:13.644990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708a7be-67b8-4dc6-bb42-de072ed3afae admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:13.667672 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:13.689067 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2144/4302] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:19:13 2022] POST /identity/v3/projects => generated 401 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:19:13.693330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460404c-3399-4ac1-a97e-4e5c2072df9f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:13.706154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460404c-3399-4ac1-a97e-4e5c2072df9f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:13.781840 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:13.793229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708a7be-67b8-4dc6-bb42-de072ed3afae admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:13.795342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f708a7be-67b8-4dc6-bb42-de072ed3afae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:13.834529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151084a-f1a6-47e5-8a36-ad74e54e9439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:13.835434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151084a-f1a6-47e5-8a36-ad74e54e9439 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:13.835712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151084a-f1a6-47e5-8a36-ad74e54e9439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:13.835979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151084a-f1a6-47e5-8a36-ad74e54e9439 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.836612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151084a-f1a6-47e5-8a36-ad74e54e9439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:13.839116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151084a-f1a6-47e5-8a36-ad74e54e9439 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:13.868138 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2159/4303] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:19:13 2022] POST /identity/v3/users => generated 301 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:19:13.871749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151084a-f1a6-47e5-8a36-ad74e54e9439 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:13.884400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151084a-f1a6-47e5-8a36-ad74e54e9439 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:13.891504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1ea0a-9496-4f2c-9fbe-51f741b66388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:13.892172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1ea0a-9496-4f2c-9fbe-51f741b66388 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:13.892565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1ea0a-9496-4f2c-9fbe-51f741b66388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:13.893255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1ea0a-9496-4f2c-9fbe-51f741b66388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.893599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1ea0a-9496-4f2c-9fbe-51f741b66388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:13.895397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1ea0a-9496-4f2c-9fbe-51f741b66388 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:13.908701 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2160/4304] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:19:13.912326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1ea0a-9496-4f2c-9fbe-51f741b66388 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:13.923501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1ea0a-9496-4f2c-9fbe-51f741b66388 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:13.928935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a743852-c381-48a4-a4cc-0f166940c10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:13.930296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a743852-c381-48a4-a4cc-0f166940c10a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:13.930583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a743852-c381-48a4-a4cc-0f166940c10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:13.930854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a743852-c381-48a4-a4cc-0f166940c10a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.931528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a743852-c381-48a4-a4cc-0f166940c10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:13.933999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a743852-c381-48a4-a4cc-0f166940c10a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:13.946097 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2161/4305] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:19:13.948529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708a7be-67b8-4dc6-bb42-de072ed3afae admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:13.952533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a743852-c381-48a4-a4cc-0f166940c10a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:13.959828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:13.960491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:13.960772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:13.961044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43 admin admin] PATH_INFO: `/v3/projects/c45351c0bf8c45d6b3327b4aa886432a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.964798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45351c0bf8c45d6b3327b4aa886432a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:13.965674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a743852-c381-48a4-a4cc-0f166940c10a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:13.966791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:13.972511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0073d8-06ea-4630-8fcf-3c1655170fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:13.973340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0073d8-06ea-4630-8fcf-3c1655170fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:13.973836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0073d8-06ea-4630-8fcf-3c1655170fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:13.974180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0073d8-06ea-4630-8fcf-3c1655170fdc admin admin] PATH_INFO: `/v3/projects/9fa9afc8930a498b903ff5dc6d0fcc01/users/8eedf325213940439cdc24ae2882156d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:13.997025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0073d8-06ea-4630-8fcf-3c1655170fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa9afc8930a498b903ff5dc6d0fcc01, user_id=8eedf325213940439cdc24ae2882156d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:14.000571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0073d8-06ea-4630-8fcf-3c1655170fdc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:14.032492 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2162/4306] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:19:13 2022] PUT /identity/v3/projects/9fa9afc8930a498b903ff5dc6d0fcc01/users/8eedf325213940439cdc24ae2882156d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:14.040483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069be26-7a35-4f2e-a5b2-774fd23a0a49 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:14.040770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069be26-7a35-4f2e-a5b2-774fd23a0a49 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:14.041046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069be26-7a35-4f2e-a5b2-774fd23a0a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:14.103843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45351c0bf8c45d6b3327b4aa886432a', 'request_id': 'req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:14.109325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a069be26-7a35-4f2e-a5b2-774fd23a0a49 None None] MFA Rules not processed for user `8eedf325213940439cdc24ae2882156d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:14.110563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a069be26-7a35-4f2e-a5b2-774fd23a0a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:14.118713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45351c0bf8c45d6b3327b4aa886432a', 'request_id': 'req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:14.135376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45351c0bf8c45d6b3327b4aa886432a', 'request_id': 'req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:14.155348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43 admin admin] The token cache is being invalidate because project c45351c0bf8c45d6b3327b4aa886432a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:19:14.159108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:14.159838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3ded6e08-fa2b-48b3-94e7-4a289cae7a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:14.165504 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2145/4307] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:19:13 2022] DELETE /identity/v3/projects/c45351c0bf8c45d6b3327b4aa886432a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:19:14.172256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c539c6-37b8-4dae-bfec-fd6ef896fa81 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:14.173296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c539c6-37b8-4dae-bfec-fd6ef896fa81 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:14.173468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c539c6-37b8-4dae-bfec-fd6ef896fa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:14.208672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-63c539c6-37b8-4dae-bfec-fd6ef896fa81 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:14.211088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-63c539c6-37b8-4dae-bfec-fd6ef896fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:14.243043 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2163/4308] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:14.285331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069be26-7a35-4f2e-a5b2-774fd23a0a49 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:14.287033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a069be26-7a35-4f2e-a5b2-774fd23a0a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:14.303794 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2146/4309] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:19:14.313274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4cef-5a75-407f-a548-ef73eccc5ec6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:14.313656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4cef-5a75-407f-a548-ef73eccc5ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:14.314102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4cef-5a75-407f-a548-ef73eccc5ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:14.338092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-30fb4cef-5a75-407f-a548-ef73eccc5ec6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:14.339748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-30fb4cef-5a75-407f-a548-ef73eccc5ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:14.354703 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2147/4310] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:14.360165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb4cef-5a75-407f-a548-ef73eccc5ec6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:14.391893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb4cef-5a75-407f-a548-ef73eccc5ec6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:14.397556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218d034-a05f-49b3-8ea1-3ae7153de89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:14.398170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218d034-a05f-49b3-8ea1-3ae7153de89e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:14.398527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218d034-a05f-49b3-8ea1-3ae7153de89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:14.398800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218d034-a05f-49b3-8ea1-3ae7153de89e admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:14.399486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218d034-a05f-49b3-8ea1-3ae7153de89e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:19:14.399784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218d034-a05f-49b3-8ea1-3ae7153de89e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:14.401406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218d034-a05f-49b3-8ea1-3ae7153de89e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:14.405779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069be26-7a35-4f2e-a5b2-774fd23a0a49 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:14.411938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591b754-92b5-4146-b8fd-27077e352fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:14.412639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591b754-92b5-4146-b8fd-27077e352fa5 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:14.412985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591b754-92b5-4146-b8fd-27077e352fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:14.413350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591b754-92b5-4146-b8fd-27077e352fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:14.415851 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2148/4311] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:19:14.421471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218d034-a05f-49b3-8ea1-3ae7153de89e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:14.438014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591b754-92b5-4146-b8fd-27077e352fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:14.442013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218d034-a05f-49b3-8ea1-3ae7153de89e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:14.445162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591b754-92b5-4146-b8fd-27077e352fa5 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:14.448602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d83859-a04f-48f1-b7dd-5c6509a2dbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:14.448602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83859-a04f-48f1-b7dd-5c6509a2dbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:14.448602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83859-a04f-48f1-b7dd-5c6509a2dbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:14.448895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83859-a04f-48f1-b7dd-5c6509a2dbc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:14.449728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d83859-a04f-48f1-b7dd-5c6509a2dbc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:14.452618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d83859-a04f-48f1-b7dd-5c6509a2dbc1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:14.461201 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:14.483932 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:14.502245 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2164/4312] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:14 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:14.506909 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2149/4313] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:19:14 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:19:14.510723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591b754-92b5-4146-b8fd-27077e352fa5 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:14.528108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591b754-92b5-4146-b8fd-27077e352fa5 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:14.610551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d83859-a04f-48f1-b7dd-5c6509a2dbc1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:14.616751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e8d83859-a04f-48f1-b7dd-5c6509a2dbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:14.638156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4996be-e92b-4375-9c76-e527d9937b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:14.639522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4996be-e92b-4375-9c76-e527d9937b72 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:14.639894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4996be-e92b-4375-9c76-e527d9937b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:14.640243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4996be-e92b-4375-9c76-e527d9937b72 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:14.640962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4996be-e92b-4375-9c76-e527d9937b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:14.643511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4996be-e92b-4375-9c76-e527d9937b72 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:14.684019 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2165/4314] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:19:14 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:19:14.688459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4996be-e92b-4375-9c76-e527d9937b72 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:14.704907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4996be-e92b-4375-9c76-e527d9937b72 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:14.709985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c7800-7784-4b50-a8b4-9d084ef03d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:14.710578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c7800-7784-4b50-a8b4-9d084ef03d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:14.710983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c7800-7784-4b50-a8b4-9d084ef03d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:14.711268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c7800-7784-4b50-a8b4-9d084ef03d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:14.711896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c7800-7784-4b50-a8b4-9d084ef03d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:14.713704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c7800-7784-4b50-a8b4-9d084ef03d04 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:14.730342 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2166/4315] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:19:14.731534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c7800-7784-4b50-a8b4-9d084ef03d04 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:14.743096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c7800-7784-4b50-a8b4-9d084ef03d04 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:14.748880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90d88d-ec1e-4e7b-becf-784f81671b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:14.749845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90d88d-ec1e-4e7b-becf-784f81671b15 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:14.750266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90d88d-ec1e-4e7b-becf-784f81671b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:14.750681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90d88d-ec1e-4e7b-becf-784f81671b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:14.751651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90d88d-ec1e-4e7b-becf-784f81671b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:14.753375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90d88d-ec1e-4e7b-becf-784f81671b15 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:14.761584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d83859-a04f-48f1-b7dd-5c6509a2dbc1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:14.766868 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2167/4316] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:19:14.770005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052353f0-7fba-48f1-8932-4b478c58d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:14.770757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052353f0-7fba-48f1-8932-4b478c58d741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:14.771096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052353f0-7fba-48f1-8932-4b478c58d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:14.771371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052353f0-7fba-48f1-8932-4b478c58d741 admin admin] PATH_INFO: `/v3/users/8eedf325213940439cdc24ae2882156d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:14.772838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90d88d-ec1e-4e7b-becf-784f81671b15 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:14.784377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052353f0-7fba-48f1-8932-4b478c58d741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eedf325213940439cdc24ae2882156d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:14.792585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052353f0-7fba-48f1-8932-4b478c58d741 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:14.809935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90d88d-ec1e-4e7b-becf-784f81671b15 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:14.837531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636f244-99c2-4c01-9eba-9c9077ee5b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:14.839331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636f244-99c2-4c01-9eba-9c9077ee5b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:14.839610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636f244-99c2-4c01-9eba-9c9077ee5b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:14.842170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636f244-99c2-4c01-9eba-9c9077ee5b4c admin admin] PATH_INFO: `/v3/projects/b7b6585ef9424e7f92861c072542e4f3/users/35c78d1882c34bb0ba5d7994bc5dd9d6/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:14.894428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636f244-99c2-4c01-9eba-9c9077ee5b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b6585ef9424e7f92861c072542e4f3, user_id=35c78d1882c34bb0ba5d7994bc5dd9d6, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:14.904635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636f244-99c2-4c01-9eba-9c9077ee5b4c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:14.919399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-052353f0-7fba-48f1-8932-4b478c58d741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eedf325213940439cdc24ae2882156d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:14.920875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-052353f0-7fba-48f1-8932-4b478c58d741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eedf325213940439cdc24ae2882156d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:14.939501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-052353f0-7fba-48f1-8932-4b478c58d741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eedf325213940439cdc24ae2882156d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:14.952119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-052353f0-7fba-48f1-8932-4b478c58d741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eedf325213940439cdc24ae2882156d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:14.953125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-052353f0-7fba-48f1-8932-4b478c58d741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eedf325213940439cdc24ae2882156d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:14.961371 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2168/4317] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:19:14 2022] PUT /identity/v3/projects/b7b6585ef9424e7f92861c072542e4f3/users/35c78d1882c34bb0ba5d7994bc5dd9d6/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:14.972754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a4cb3-4c7b-4762-bf81-01ad720d902b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:14.973044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a4cb3-4c7b-4762-bf81-01ad720d902b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:14.973381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a4cb3-4c7b-4762-bf81-01ad720d902b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:14.979511 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2150/4318] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:19:14 2022] DELETE /identity/v3/users/8eedf325213940439cdc24ae2882156d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:14.984854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97290fcc-f2f0-4258-ab48-4ba45bf4b529 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:14.985161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97290fcc-f2f0-4258-ab48-4ba45bf4b529 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:14.985508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97290fcc-f2f0-4258-ab48-4ba45bf4b529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:15.010035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-97290fcc-f2f0-4258-ab48-4ba45bf4b529 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:15.011454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-97290fcc-f2f0-4258-ab48-4ba45bf4b529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:15.020496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-344a4cb3-4c7b-4762-bf81-01ad720d902b None None] MFA Rules not processed for user `35c78d1882c34bb0ba5d7994bc5dd9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:15.021824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-344a4cb3-4c7b-4762-bf81-01ad720d902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:15.110742 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2151/4319] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:19:15.116904 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2169/4320] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:15.126379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a4cb3-4c7b-4762-bf81-01ad720d902b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:15.126960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97290fcc-f2f0-4258-ab48-4ba45bf4b529 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:15.129719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-344a4cb3-4c7b-4762-bf81-01ad720d902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:15.130383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-97290fcc-f2f0-4258-ab48-4ba45bf4b529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:15.149376 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:15.156460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97290fcc-f2f0-4258-ab48-4ba45bf4b529 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:15.168388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1630ff7-f164-4ccb-8264-4e149d201731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:15.170196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1630ff7-f164-4ccb-8264-4e149d201731 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:15.170553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1630ff7-f164-4ccb-8264-4e149d201731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:15.170831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1630ff7-f164-4ccb-8264-4e149d201731 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:15.171509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1630ff7-f164-4ccb-8264-4e149d201731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:15.173723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1630ff7-f164-4ccb-8264-4e149d201731 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:15.188848 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:15.225637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a4cb3-4c7b-4762-bf81-01ad720d902b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:15.227390 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2152/4321] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:19:15 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:19:15.231089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1630ff7-f164-4ccb-8264-4e149d201731 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:15.302720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026cd99-0664-4736-8d8c-45ce44d7d023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:15.304767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026cd99-0664-4736-8d8c-45ce44d7d023 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:15.305559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026cd99-0664-4736-8d8c-45ce44d7d023 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:15.306508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026cd99-0664-4736-8d8c-45ce44d7d023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:15.338600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1630ff7-f164-4ccb-8264-4e149d201731 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:15.347715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d00994-ed8e-4f22-ba58-edf4de707f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:15.348635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d00994-ed8e-4f22-ba58-edf4de707f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:15.348970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d00994-ed8e-4f22-ba58-edf4de707f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:15.349381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d00994-ed8e-4f22-ba58-edf4de707f5c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:15.350721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d00994-ed8e-4f22-ba58-edf4de707f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:15.353618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d00994-ed8e-4f22-ba58-edf4de707f5c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:15.416129 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2153/4322] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:19:15 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:19:15.417107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d00994-ed8e-4f22-ba58-edf4de707f5c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:15.446172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d00994-ed8e-4f22-ba58-edf4de707f5c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:15.450730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026cd99-0664-4736-8d8c-45ce44d7d023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:15.452930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026cd99-0664-4736-8d8c-45ce44d7d023 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:15.460657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2b6d-0bcf-4a30-aca0-6a6d62ba3368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:15.461440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2b6d-0bcf-4a30-aca0-6a6d62ba3368 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:15.461719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2b6d-0bcf-4a30-aca0-6a6d62ba3368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:15.461988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2b6d-0bcf-4a30-aca0-6a6d62ba3368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:15.462633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e2b6d-0bcf-4a30-aca0-6a6d62ba3368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:15.464265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e2b6d-0bcf-4a30-aca0-6a6d62ba3368 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:15.493269 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2170/4323] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:15.500579 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2154/4324] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:19:15.503800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026cd99-0664-4736-8d8c-45ce44d7d023 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:15.518786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026cd99-0664-4736-8d8c-45ce44d7d023 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:15.525522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8703f-89c5-4351-98f7-d667d39bd241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:15.526366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8703f-89c5-4351-98f7-d667d39bd241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:15.526769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8703f-89c5-4351-98f7-d667d39bd241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:15.527175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8703f-89c5-4351-98f7-d667d39bd241 admin admin] PATH_INFO: `/v3/projects/674a6d9425fa4c42996147b5d657fa14/users/dfa504d86b3945d6a925b703fa348498/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:15.580044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8703f-89c5-4351-98f7-d667d39bd241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674a6d9425fa4c42996147b5d657fa14, user_id=dfa504d86b3945d6a925b703fa348498, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:15.585614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8703f-89c5-4351-98f7-d667d39bd241 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:15.617220 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2171/4325] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:19:15 2022] PUT /identity/v3/projects/674a6d9425fa4c42996147b5d657fa14/users/dfa504d86b3945d6a925b703fa348498/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:19:15.621437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2b6d-0bcf-4a30-aca0-6a6d62ba3368 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:15.635805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2b6d-0bcf-4a30-aca0-6a6d62ba3368 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:15.743437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a676059-ac73-4516-89ed-4e9b337a4d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:15.744641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a676059-ac73-4516-89ed-4e9b337a4d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:15.746027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a676059-ac73-4516-89ed-4e9b337a4d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:15.746485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a676059-ac73-4516-89ed-4e9b337a4d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:15.747532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a676059-ac73-4516-89ed-4e9b337a4d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:15.753437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a676059-ac73-4516-89ed-4e9b337a4d47 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:15.766544 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2155/4326] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:19:15.770681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8703f-89c5-4351-98f7-d667d39bd241 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:15.785907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8703f-89c5-4351-98f7-d667d39bd241 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:15.799123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329d482-63b9-4e8f-80a5-2e8a6daf1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:15.802368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329d482-63b9-4e8f-80a5-2e8a6daf1cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:15.803438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329d482-63b9-4e8f-80a5-2e8a6daf1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:15.806637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329d482-63b9-4e8f-80a5-2e8a6daf1cd1 admin admin] PATH_INFO: `/v3/projects/674a6d9425fa4c42996147b5d657fa14/users/dfa504d86b3945d6a925b703fa348498/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:15.811305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329d482-63b9-4e8f-80a5-2e8a6daf1cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674a6d9425fa4c42996147b5d657fa14, user_id=dfa504d86b3945d6a925b703fa348498, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:15.814494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329d482-63b9-4e8f-80a5-2e8a6daf1cd1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:15.850947 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2172/4327] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:19:15 2022] PUT /identity/v3/projects/674a6d9425fa4c42996147b5d657fa14/users/dfa504d86b3945d6a925b703fa348498/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:15.960924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa70d0-5451-4a08-b452-b038e6ca151a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:15.961400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa70d0-5451-4a08-b452-b038e6ca151a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:15.961577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa70d0-5451-4a08-b452-b038e6ca151a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:16.027759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-79fa70d0-5451-4a08-b452-b038e6ca151a None None] MFA Rules not processed for user `dfa504d86b3945d6a925b703fa348498`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:16.029680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-79fa70d0-5451-4a08-b452-b038e6ca151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:16.093302 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:16.137056 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2156/4328] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:16.149053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329d482-63b9-4e8f-80a5-2e8a6daf1cd1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:16.151096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8329d482-63b9-4e8f-80a5-2e8a6daf1cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:16.279331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329d482-63b9-4e8f-80a5-2e8a6daf1cd1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:16.291867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87d595-6901-4865-9890-6024f7ed09cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:16.292865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87d595-6901-4865-9890-6024f7ed09cc service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:16.293248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87d595-6901-4865-9890-6024f7ed09cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:16.293730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87d595-6901-4865-9890-6024f7ed09cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:16.314961 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:16.386363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa70d0-5451-4a08-b452-b038e6ca151a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:16.389079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-79fa70d0-5451-4a08-b452-b038e6ca151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:16.397282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87d595-6901-4865-9890-6024f7ed09cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:16.399257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87d595-6901-4865-9890-6024f7ed09cc service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:16.412497 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2173/4329] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:16.526964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa70d0-5451-4a08-b452-b038e6ca151a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:16.542027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:16.542686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:16.544651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:16.544961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3 admin admin] PATH_INFO: `/v3/projects/9fa9afc8930a498b903ff5dc6d0fcc01` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:16.550447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa9afc8930a498b903ff5dc6d0fcc01)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:16.556177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:16.698323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa9afc8930a498b903ff5dc6d0fcc01', 'request_id': 'req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:16.715287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa9afc8930a498b903ff5dc6d0fcc01', 'request_id': 'req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:16.733156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa9afc8930a498b903ff5dc6d0fcc01', 'request_id': 'req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:16.766510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3 admin admin] The token cache is being invalidate because project 9fa9afc8930a498b903ff5dc6d0fcc01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:19:16.766811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:16.770194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ff675ee-9b07-4424-98f9-a4ff5d4f8fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:16.778151 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2157/4330] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:19:16 2022] DELETE /identity/v3/projects/9fa9afc8930a498b903ff5dc6d0fcc01 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:19:16.780740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130626f6-bce4-4922-977a-a1205a9bd3f3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:16.781027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130626f6-bce4-4922-977a-a1205a9bd3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:16.781305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130626f6-bce4-4922-977a-a1205a9bd3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:16.822115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-130626f6-bce4-4922-977a-a1205a9bd3f3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:16.823716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-130626f6-bce4-4922-977a-a1205a9bd3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:16.964682 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2174/4331] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:19:16.973038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fed1a5-f5b8-4055-b6ce-6180fb6c9b60 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:16.973586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fed1a5-f5b8-4055-b6ce-6180fb6c9b60 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:16.973825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fed1a5-f5b8-4055-b6ce-6180fb6c9b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:17.023057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d4fed1a5-f5b8-4055-b6ce-6180fb6c9b60 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:17.023057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d4fed1a5-f5b8-4055-b6ce-6180fb6c9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:17.043375 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2158/4332] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:17.051474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130626f6-bce4-4922-977a-a1205a9bd3f3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:17.068607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130626f6-bce4-4922-977a-a1205a9bd3f3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:17.085446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8307c0-3a50-4c59-b72b-c99b2a8583bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:17.086274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8307c0-3a50-4c59-b72b-c99b2a8583bc admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:17.086706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8307c0-3a50-4c59-b72b-c99b2a8583bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:17.087166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8307c0-3a50-4c59-b72b-c99b2a8583bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:17.087985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8307c0-3a50-4c59-b72b-c99b2a8583bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:19:17.088439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8307c0-3a50-4c59-b72b-c99b2a8583bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:17.090217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8307c0-3a50-4c59-b72b-c99b2a8583bc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:17.123721 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2175/4333] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:19:17.125582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fed1a5-f5b8-4055-b6ce-6180fb6c9b60 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:17.152644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fed1a5-f5b8-4055-b6ce-6180fb6c9b60 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:17.152644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cad9ab-609c-4f1f-bc96-f827398778c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:17.152644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cad9ab-609c-4f1f-bc96-f827398778c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:17.152644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cad9ab-609c-4f1f-bc96-f827398778c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:17.153124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cad9ab-609c-4f1f-bc96-f827398778c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:17.160632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cad9ab-609c-4f1f-bc96-f827398778c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:17.166128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cad9ab-609c-4f1f-bc96-f827398778c7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:17.259777 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2159/4334] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:19:17 2022] POST /identity/v3/projects => generated 391 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:19:17.264668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8307c0-3a50-4c59-b72b-c99b2a8583bc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:17.283449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8307c0-3a50-4c59-b72b-c99b2a8583bc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:17.443158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9315c1-29ea-4434-99d7-fbc76017946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:17.445087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9315c1-29ea-4434-99d7-fbc76017946e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:17.445238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9315c1-29ea-4434-99d7-fbc76017946e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:17.445888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9315c1-29ea-4434-99d7-fbc76017946e admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:17.447067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9315c1-29ea-4434-99d7-fbc76017946e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:17.453311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9315c1-29ea-4434-99d7-fbc76017946e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:17.479790 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2176/4335] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:19:17 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:19:17.484509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cad9ab-609c-4f1f-bc96-f827398778c7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:17.498328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cad9ab-609c-4f1f-bc96-f827398778c7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:17.517923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082fc22-a090-4dcb-85b4-0458749168be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:17.518658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082fc22-a090-4dcb-85b4-0458749168be admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:17.519290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082fc22-a090-4dcb-85b4-0458749168be admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:17.519574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082fc22-a090-4dcb-85b4-0458749168be admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:17.520226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082fc22-a090-4dcb-85b4-0458749168be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:17.521945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082fc22-a090-4dcb-85b4-0458749168be admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:17.539180 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2160/4336] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:19:17.544715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9315c1-29ea-4434-99d7-fbc76017946e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:17.568526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9315c1-29ea-4434-99d7-fbc76017946e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:17.587631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadbd39-3562-4035-a1ea-5983e965a6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:17.588264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadbd39-3562-4035-a1ea-5983e965a6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:17.588547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadbd39-3562-4035-a1ea-5983e965a6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:17.588824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadbd39-3562-4035-a1ea-5983e965a6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:17.589479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadbd39-3562-4035-a1ea-5983e965a6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:17.593175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadbd39-3562-4035-a1ea-5983e965a6f4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:17.642809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082fc22-a090-4dcb-85b4-0458749168be admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:17.645019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2082fc22-a090-4dcb-85b4-0458749168be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:17.658991 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2177/4337] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:19:17.663467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadbd39-3562-4035-a1ea-5983e965a6f4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:17.692890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadbd39-3562-4035-a1ea-5983e965a6f4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:17.710202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a371d-139c-463c-921c-b57a246d24cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:17.712124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a371d-139c-463c-921c-b57a246d24cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:17.712261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a371d-139c-463c-921c-b57a246d24cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:17.712570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a371d-139c-463c-921c-b57a246d24cb admin admin] PATH_INFO: `/v3/projects/0426937b803f46279c2cb410ba6c5de4/users/d5e73ffbd1e84f3a9d1bc147f47b3abe/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:17.731691 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:17.767158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a371d-139c-463c-921c-b57a246d24cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0426937b803f46279c2cb410ba6c5de4, user_id=d5e73ffbd1e84f3a9d1bc147f47b3abe, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:17.785883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a371d-139c-463c-921c-b57a246d24cb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:17.819075 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:17.842102 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2178/4338] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:19:17 2022] PUT /identity/v3/projects/0426937b803f46279c2cb410ba6c5de4/users/d5e73ffbd1e84f3a9d1bc147f47b3abe/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:17.848183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f7cd7-1a82-4a57-aedb-02e85914bb5f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:17.848971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f7cd7-1a82-4a57-aedb-02e85914bb5f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:17.849351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f7cd7-1a82-4a57-aedb-02e85914bb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:17.868998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082fc22-a090-4dcb-85b4-0458749168be admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:17.877072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2b6f7cd7-1a82-4a57-aedb-02e85914bb5f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:17.879990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2b6f7cd7-1a82-4a57-aedb-02e85914bb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:18.008990 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2179/4339] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:18.012041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f2e13-df3f-4ce8-be1e-fe90ac605102 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:18.013735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f2e13-df3f-4ce8-be1e-fe90ac605102 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:18.014165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f2e13-df3f-4ce8-be1e-fe90ac605102 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:18.014586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f2e13-df3f-4ce8-be1e-fe90ac605102 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:18.016816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d47f2e13-df3f-4ce8-be1e-fe90ac605102 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:18.019283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f7cd7-1a82-4a57-aedb-02e85914bb5f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:18.020760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2b6f7cd7-1a82-4a57-aedb-02e85914bb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:18.051128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f2e13-df3f-4ce8-be1e-fe90ac605102 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:18.053554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f2e13-df3f-4ce8-be1e-fe90ac605102 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:18.089439 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2161/4340] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:18.139677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f7cd7-1a82-4a57-aedb-02e85914bb5f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:18.151916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e324b-f1fb-45bf-be7a-cef520f7b633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:18.152692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e324b-f1fb-45bf-be7a-cef520f7b633 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:18.153144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e324b-f1fb-45bf-be7a-cef520f7b633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:18.155017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e324b-f1fb-45bf-be7a-cef520f7b633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:18.180648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e324b-f1fb-45bf-be7a-cef520f7b633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:18.182363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e324b-f1fb-45bf-be7a-cef520f7b633 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:18.215673 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2180/4341] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:19:22.915561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f2e13-df3f-4ce8-be1e-fe90ac605102 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:22.918091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d47f2e13-df3f-4ce8-be1e-fe90ac605102 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:23.172818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f2e13-df3f-4ce8-be1e-fe90ac605102 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:23.187929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd62cb1-3ecb-4bf0-8173-3ad57de2f092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:23.188573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd62cb1-3ecb-4bf0-8173-3ad57de2f092 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:23.188901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd62cb1-3ecb-4bf0-8173-3ad57de2f092 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:23.189225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd62cb1-3ecb-4bf0-8173-3ad57de2f092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:23.196123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fdd62cb1-3ecb-4bf0-8173-3ad57de2f092 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:23.376169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd62cb1-3ecb-4bf0-8173-3ad57de2f092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:23.377859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd62cb1-3ecb-4bf0-8173-3ad57de2f092 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:23.421781 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2162/4342] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:25.797009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad165e19-f799-4ba3-a1d5-d5b0c15332eb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:25.798943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad165e19-f799-4ba3-a1d5-d5b0c15332eb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:25.799421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad165e19-f799-4ba3-a1d5-d5b0c15332eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:25.872585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ad165e19-f799-4ba3-a1d5-d5b0c15332eb None None] MFA Rules not processed for user `1cf0ec54a3f54abd90ece8de2aa70ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:25.885069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ad165e19-f799-4ba3-a1d5-d5b0c15332eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:26.102826 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2181/4343] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:27.217659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd62cb1-3ecb-4bf0-8173-3ad57de2f092 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:27.221075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fdd62cb1-3ecb-4bf0-8173-3ad57de2f092 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:27.253755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd62cb1-3ecb-4bf0-8173-3ad57de2f092 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:27.265111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f145a-113d-451e-a28d-b1a692cd0dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:27.266104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f145a-113d-451e-a28d-b1a692cd0dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:27.267721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f145a-113d-451e-a28d-b1a692cd0dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:27.268218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f145a-113d-451e-a28d-b1a692cd0dc7 admin admin] PATH_INFO: `/v3/users/f1bfe0b4f344485ab6de52f7b1423118` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:27.269654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f145a-113d-451e-a28d-b1a692cd0dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1bfe0b4f344485ab6de52f7b1423118)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:27.272009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f145a-113d-451e-a28d-b1a692cd0dc7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:27.306428 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:27.417059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c2f145a-113d-451e-a28d-b1a692cd0dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1bfe0b4f344485ab6de52f7b1423118'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:27.417899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c2f145a-113d-451e-a28d-b1a692cd0dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1bfe0b4f344485ab6de52f7b1423118'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:27.456244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c2f145a-113d-451e-a28d-b1a692cd0dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1bfe0b4f344485ab6de52f7b1423118'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:27.477073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c2f145a-113d-451e-a28d-b1a692cd0dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1bfe0b4f344485ab6de52f7b1423118'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:27.479097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c2f145a-113d-451e-a28d-b1a692cd0dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1bfe0b4f344485ab6de52f7b1423118'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:27.501970 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2163/4344] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:19:27 2022] DELETE /identity/v3/users/f1bfe0b4f344485ab6de52f7b1423118 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:28.035266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad165e19-f799-4ba3-a1d5-d5b0c15332eb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:28.054992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad165e19-f799-4ba3-a1d5-d5b0c15332eb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:28.179041 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:28.211427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:28.212578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:28.212866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:28.214574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48 admin admin] PATH_INFO: `/v3/projects/16773b3925f648bbade2e6bf967a3fbf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:28.217445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16773b3925f648bbade2e6bf967a3fbf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:28.219438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:28.342591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16773b3925f648bbade2e6bf967a3fbf', 'request_id': 'req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:28.356377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16773b3925f648bbade2e6bf967a3fbf', 'request_id': 'req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:28.381912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16773b3925f648bbade2e6bf967a3fbf', 'request_id': 'req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:28.407170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48 admin admin] The token cache is being invalidate because project 16773b3925f648bbade2e6bf967a3fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:19:28.407475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:28.408307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fcf653ce-5e42-4a47-8a3c-bc1bf9b30d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:28.411118 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2182/4345] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:19:28 2022] DELETE /identity/v3/projects/16773b3925f648bbade2e6bf967a3fbf => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:28.416279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ef4c2-e8bb-4433-b473-6d8e614c742d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:28.416758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ef4c2-e8bb-4433-b473-6d8e614c742d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:28.416914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ef4c2-e8bb-4433-b473-6d8e614c742d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:28.507364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5e1ef4c2-e8bb-4433-b473-6d8e614c742d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:28.516047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5e1ef4c2-e8bb-4433-b473-6d8e614c742d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:28.668509 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2164/4346] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:28.677365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c731bf4-577c-46ee-965f-352ef3ce8c58 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:28.678235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c731bf4-577c-46ee-965f-352ef3ce8c58 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:28.678343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c731bf4-577c-46ee-965f-352ef3ce8c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:28.720896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8c731bf4-577c-46ee-965f-352ef3ce8c58 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:28.723019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8c731bf4-577c-46ee-965f-352ef3ce8c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:28.746525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ef4c2-e8bb-4433-b473-6d8e614c742d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:28.763149 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2183/4347] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:28.770183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ef4c2-e8bb-4433-b473-6d8e614c742d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:28.786350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8a5e4-a0bf-4687-b98b-ec68a2d0e1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:28.787354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8a5e4-a0bf-4687-b98b-ec68a2d0e1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:28.787354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8a5e4-a0bf-4687-b98b-ec68a2d0e1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:28.787590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8a5e4-a0bf-4687-b98b-ec68a2d0e1f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:28.788368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8a5e4-a0bf-4687-b98b-ec68a2d0e1f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:19:28.788676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8a5e4-a0bf-4687-b98b-ec68a2d0e1f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:28.793534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8a5e4-a0bf-4687-b98b-ec68a2d0e1f7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:28.826613 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2165/4348] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:19:28.829091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c731bf4-577c-46ee-965f-352ef3ce8c58 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:28.840941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c731bf4-577c-46ee-965f-352ef3ce8c58 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:28.847814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33461291-dbd8-4b9b-a494-f907bd39649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:28.850024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461291-dbd8-4b9b-a494-f907bd39649b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:28.850307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461291-dbd8-4b9b-a494-f907bd39649b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:28.850582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461291-dbd8-4b9b-a494-f907bd39649b admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:28.851455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33461291-dbd8-4b9b-a494-f907bd39649b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:28.853846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33461291-dbd8-4b9b-a494-f907bd39649b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:28.904212 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2184/4349] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:19:28 2022] POST /identity/v3/projects => generated 399 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:19:28.904407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8a5e4-a0bf-4687-b98b-ec68a2d0e1f7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:28.919719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8a5e4-a0bf-4687-b98b-ec68a2d0e1f7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:29.005019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda2292-defa-4f0e-9f6e-c835b24d5a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:29.006033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda2292-defa-4f0e-9f6e-c835b24d5a02 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:29.007127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda2292-defa-4f0e-9f6e-c835b24d5a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:29.007448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda2292-defa-4f0e-9f6e-c835b24d5a02 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:29.008209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda2292-defa-4f0e-9f6e-c835b24d5a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:29.014515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda2292-defa-4f0e-9f6e-c835b24d5a02 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:29.049194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33461291-dbd8-4b9b-a494-f907bd39649b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:29.067796 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2166/4350] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:19:28 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:19:29.071731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33461291-dbd8-4b9b-a494-f907bd39649b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:29.077678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2534ad-7499-45da-a897-a3367988bf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:29.078220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2534ad-7499-45da-a897-a3367988bf5e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:29.078496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2534ad-7499-45da-a897-a3367988bf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:29.078967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2534ad-7499-45da-a897-a3367988bf5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:29.079980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2534ad-7499-45da-a897-a3367988bf5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:29.081871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2534ad-7499-45da-a897-a3367988bf5e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:29.098760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda2292-defa-4f0e-9f6e-c835b24d5a02 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:29.099350 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2185/4351] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:19:29.105761 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:29.120457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda2292-defa-4f0e-9f6e-c835b24d5a02 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:29.131661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28fa7c-55d7-4df8-9d02-0746b998800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:29.132519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28fa7c-55d7-4df8-9d02-0746b998800a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:29.133954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28fa7c-55d7-4df8-9d02-0746b998800a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:29.134441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28fa7c-55d7-4df8-9d02-0746b998800a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:29.136010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28fa7c-55d7-4df8-9d02-0746b998800a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:29.139331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28fa7c-55d7-4df8-9d02-0746b998800a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:29.152962 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2167/4352] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:19:29.156904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2534ad-7499-45da-a897-a3367988bf5e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:29.170487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2534ad-7499-45da-a897-a3367988bf5e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:29.179061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd5ece-b0fc-49de-830b-06e286f26510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:29.179735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd5ece-b0fc-49de-830b-06e286f26510 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:29.191943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd5ece-b0fc-49de-830b-06e286f26510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:29.193680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd5ece-b0fc-49de-830b-06e286f26510 admin admin] PATH_INFO: `/v3/projects/3accb70d34644a70a56bab34c8ef57bf/users/8ab02499c2b64768878fa1d06909e682/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:29.248110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd5ece-b0fc-49de-830b-06e286f26510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3accb70d34644a70a56bab34c8ef57bf, user_id=8ab02499c2b64768878fa1d06909e682, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:29.253914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd5ece-b0fc-49de-830b-06e286f26510 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:29.288670 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2186/4353] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:19:29 2022] PUT /identity/v3/projects/3accb70d34644a70a56bab34c8ef57bf/users/8ab02499c2b64768878fa1d06909e682/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:29.295135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e24a07-6919-43e5-9c86-53d50f4b0ede None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:29.295450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e24a07-6919-43e5-9c86-53d50f4b0ede None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:29.295726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e24a07-6919-43e5-9c86-53d50f4b0ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:29.338649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c3e24a07-6919-43e5-9c86-53d50f4b0ede None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:29.340871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c3e24a07-6919-43e5-9c86-53d50f4b0ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:29.522706 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2168/4354] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:29.532164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd5ece-b0fc-49de-830b-06e286f26510 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:29.535784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4ccd5ece-b0fc-49de-830b-06e286f26510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:29.693133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd5ece-b0fc-49de-830b-06e286f26510 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:29.703670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4904d7-cef4-4a10-a357-670e5d5bed18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:29.704505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4904d7-cef4-4a10-a357-670e5d5bed18 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:29.704884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4904d7-cef4-4a10-a357-670e5d5bed18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:29.706700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4904d7-cef4-4a10-a357-670e5d5bed18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:29.743211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4904d7-cef4-4a10-a357-670e5d5bed18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:29.747749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4904d7-cef4-4a10-a357-670e5d5bed18 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:29.788233 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2187/4355] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:30.113068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e24a07-6919-43e5-9c86-53d50f4b0ede None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:30.114965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c3e24a07-6919-43e5-9c86-53d50f4b0ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:30.257849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e24a07-6919-43e5-9c86-53d50f4b0ede None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:30.271438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822a11a-db46-47e5-9149-89b540459e3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:30.272066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822a11a-db46-47e5-9149-89b540459e3a service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:30.272345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822a11a-db46-47e5-9149-89b540459e3a service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:30.272616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822a11a-db46-47e5-9149-89b540459e3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:30.282233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4822a11a-db46-47e5-9149-89b540459e3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:30.405435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822a11a-db46-47e5-9149-89b540459e3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:30.407654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822a11a-db46-47e5-9149-89b540459e3a service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:30.498320 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2169/4356] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:38.719414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18af3e1-fb9a-4913-921e-b6af29ef9f45 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:38.720293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18af3e1-fb9a-4913-921e-b6af29ef9f45 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:38.720903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18af3e1-fb9a-4913-921e-b6af29ef9f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:38.832982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c18af3e1-fb9a-4913-921e-b6af29ef9f45 None None] MFA Rules not processed for user `d5e73ffbd1e84f3a9d1bc147f47b3abe`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:38.834240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c18af3e1-fb9a-4913-921e-b6af29ef9f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:38.851284 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:39.072955 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2188/4357] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:39.081339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff16f81-97d7-46ff-a25c-7e916eca14fe None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:39.082210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff16f81-97d7-46ff-a25c-7e916eca14fe None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:39.082656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff16f81-97d7-46ff-a25c-7e916eca14fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:39.117951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dff16f81-97d7-46ff-a25c-7e916eca14fe None None] MFA Rules not processed for user `d5e73ffbd1e84f3a9d1bc147f47b3abe`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:39.120236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dff16f81-97d7-46ff-a25c-7e916eca14fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:39.149232 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2170/4358] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:19:39.161152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18af3e1-fb9a-4913-921e-b6af29ef9f45 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:39.189298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18af3e1-fb9a-4913-921e-b6af29ef9f45 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:39.215927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708c997-11d1-46a5-b1f0-3d9985aaccef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:39.216405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708c997-11d1-46a5-b1f0-3d9985aaccef service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:39.216623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708c997-11d1-46a5-b1f0-3d9985aaccef service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:39.216983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708c997-11d1-46a5-b1f0-3d9985aaccef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:39.254969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708c997-11d1-46a5-b1f0-3d9985aaccef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:39.259336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708c997-11d1-46a5-b1f0-3d9985aaccef service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:39.283470 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2189/4359] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:19:49.103099 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:49.269762 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=31 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:58.362002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff16f81-97d7-46ff-a25c-7e916eca14fe None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:58.364937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dff16f81-97d7-46ff-a25c-7e916eca14fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:58.385476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff16f81-97d7-46ff-a25c-7e916eca14fe None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:58.392412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:58.393413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:58.393903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:58.394382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] PATH_INFO: `/v3/users/b36b899d4c5a4f4ebaa4537074c6b139` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:58.395977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b36b899d4c5a4f4ebaa4537074c6b139)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:58.399894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:58.476271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b36b899d4c5a4f4ebaa4537074c6b139'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:58.477361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b36b899d4c5a4f4ebaa4537074c6b139'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:58.494277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b36b899d4c5a4f4ebaa4537074c6b139'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:58.507897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b36b899d4c5a4f4ebaa4537074c6b139'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:58.508946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b36b899d4c5a4f4ebaa4537074c6b139'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:19:58.529931 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2171/4360] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:19:58 2022] DELETE /identity/v3/users/b36b899d4c5a4f4ebaa4537074c6b139 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:19:58.535109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d61bc-6763-4885-bfc6-eb3d55581e15 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:58.535578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d61bc-6763-4885-bfc6-eb3d55581e15 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:58.535655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d61bc-6763-4885-bfc6-eb3d55581e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:58.563676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a62d61bc-6763-4885-bfc6-eb3d55581e15 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:19:58.565219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a62d61bc-6763-4885-bfc6-eb3d55581e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:58.659594 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2190/4361] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:19:58.669947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:19:58.672817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:19:58.765773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f1762-d05b-4da1-a989-c3f6c715dd0b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:19:58.770910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8fe35-8fc0-491b-b67a-66893c764738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:19:58.771812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8fe35-8fc0-491b-b67a-66893c764738 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:19:58.772669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8fe35-8fc0-491b-b67a-66893c764738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:19:58.773045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8fe35-8fc0-491b-b67a-66893c764738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:19:58.788658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8fe35-8fc0-491b-b67a-66893c764738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:19:58.790591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8fe35-8fc0-491b-b67a-66893c764738 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:19:58.830319 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2172/4362] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:20:00.362319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d61bc-6763-4885-bfc6-eb3d55581e15 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:00.364593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a62d61bc-6763-4885-bfc6-eb3d55581e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:00.385777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d61bc-6763-4885-bfc6-eb3d55581e15 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:00.392097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90e474-bd80-43cd-a450-260f7b2f80df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:00.393105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e474-bd80-43cd-a450-260f7b2f80df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:00.393589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e474-bd80-43cd-a450-260f7b2f80df admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:00.394086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e474-bd80-43cd-a450-260f7b2f80df admin admin] PATH_INFO: `/v3/projects/5043adb0a7d9494cb822412bfdd3a960` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:00.400708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90e474-bd80-43cd-a450-260f7b2f80df admin admin] RBAC: Authorizing `identity:delete_project(project_id=5043adb0a7d9494cb822412bfdd3a960)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:00.403390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90e474-bd80-43cd-a450-260f7b2f80df admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:00.503941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ba90e474-bd80-43cd-a450-260f7b2f80df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5043adb0a7d9494cb822412bfdd3a960', 'request_id': 'req-ba90e474-bd80-43cd-a450-260f7b2f80df'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:00.518388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ba90e474-bd80-43cd-a450-260f7b2f80df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5043adb0a7d9494cb822412bfdd3a960', 'request_id': 'req-ba90e474-bd80-43cd-a450-260f7b2f80df'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:00.543756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ba90e474-bd80-43cd-a450-260f7b2f80df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5043adb0a7d9494cb822412bfdd3a960', 'request_id': 'req-ba90e474-bd80-43cd-a450-260f7b2f80df'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:00.574083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ba90e474-bd80-43cd-a450-260f7b2f80df admin admin] The token cache is being invalidate because project 5043adb0a7d9494cb822412bfdd3a960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:20:00.574354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ba90e474-bd80-43cd-a450-260f7b2f80df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:00.579512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ba90e474-bd80-43cd-a450-260f7b2f80df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:00.581383 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2191/4363] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:20:00 2022] DELETE /identity/v3/projects/5043adb0a7d9494cb822412bfdd3a960 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:20:00.588048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63bc62-c1aa-4564-a2c6-e22fa37e5e74 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:00.589204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63bc62-c1aa-4564-a2c6-e22fa37e5e74 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:00.589726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63bc62-c1aa-4564-a2c6-e22fa37e5e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:00.620856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ca63bc62-c1aa-4564-a2c6-e22fa37e5e74 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:00.622953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ca63bc62-c1aa-4564-a2c6-e22fa37e5e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:00.759540 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2173/4364] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:00.767642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbc152-62ff-4b96-b61a-0ffbf65e6ad6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:00.768086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbc152-62ff-4b96-b61a-0ffbf65e6ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:00.768505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbc152-62ff-4b96-b61a-0ffbf65e6ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:00.800690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-66cbc152-62ff-4b96-b61a-0ffbf65e6ad6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:00.802312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-66cbc152-62ff-4b96-b61a-0ffbf65e6ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:00.813849 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2192/4365] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:00.817757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63bc62-c1aa-4564-a2c6-e22fa37e5e74 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:00.835262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63bc62-c1aa-4564-a2c6-e22fa37e5e74 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:00.844021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82496101-e7f8-4805-8f09-6d8cea43bba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:00.844642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82496101-e7f8-4805-8f09-6d8cea43bba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:00.845840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82496101-e7f8-4805-8f09-6d8cea43bba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:00.846147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82496101-e7f8-4805-8f09-6d8cea43bba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:00.846795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82496101-e7f8-4805-8f09-6d8cea43bba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:20:00.847126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82496101-e7f8-4805-8f09-6d8cea43bba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:00.848742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82496101-e7f8-4805-8f09-6d8cea43bba5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:00.877879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbc152-62ff-4b96-b61a-0ffbf65e6ad6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:00.883766 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2174/4366] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:20:00.887943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbc152-62ff-4b96-b61a-0ffbf65e6ad6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:00.920126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a057e5-44f3-4fa2-a7e3-4722bfc05c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:00.920904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a057e5-44f3-4fa2-a7e3-4722bfc05c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:00.921292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a057e5-44f3-4fa2-a7e3-4722bfc05c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:00.921669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a057e5-44f3-4fa2-a7e3-4722bfc05c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:00.922415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a057e5-44f3-4fa2-a7e3-4722bfc05c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:00.924474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a057e5-44f3-4fa2-a7e3-4722bfc05c05 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:00.993474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82496101-e7f8-4805-8f09-6d8cea43bba5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:01.002148 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:01.007404 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2193/4367] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:20:00 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:01.014035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82496101-e7f8-4805-8f09-6d8cea43bba5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:01.107335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b4bca-ecb0-40ca-8f66-5cc1130c603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:01.107953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b4bca-ecb0-40ca-8f66-5cc1130c603c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:01.108235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b4bca-ecb0-40ca-8f66-5cc1130c603c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:01.108685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b4bca-ecb0-40ca-8f66-5cc1130c603c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:01.109320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b4bca-ecb0-40ca-8f66-5cc1130c603c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:01.111439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b4bca-ecb0-40ca-8f66-5cc1130c603c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:01.154267 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2175/4368] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:20:00 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:01.158399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a057e5-44f3-4fa2-a7e3-4722bfc05c05 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:01.173258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a057e5-44f3-4fa2-a7e3-4722bfc05c05 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:01.178880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa7ffc-2e13-4611-abf3-77238fbcf279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:01.179557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa7ffc-2e13-4611-abf3-77238fbcf279 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:01.179839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa7ffc-2e13-4611-abf3-77238fbcf279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:01.180902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa7ffc-2e13-4611-abf3-77238fbcf279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:01.180902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa7ffc-2e13-4611-abf3-77238fbcf279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:01.182362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa7ffc-2e13-4611-abf3-77238fbcf279 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:01.193107 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2194/4369] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:01.197322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b4bca-ecb0-40ca-8f66-5cc1130c603c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:01.208812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b4bca-ecb0-40ca-8f66-5cc1130c603c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:01.213682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0110ca8-faeb-413b-a0fb-5ec3ae2afb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:01.214299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0110ca8-faeb-413b-a0fb-5ec3ae2afb83 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:01.214580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0110ca8-faeb-413b-a0fb-5ec3ae2afb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:01.214943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0110ca8-faeb-413b-a0fb-5ec3ae2afb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:01.216987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0110ca8-faeb-413b-a0fb-5ec3ae2afb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:01.218601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0110ca8-faeb-413b-a0fb-5ec3ae2afb83 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:01.233498 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2176/4370] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:01.237686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa7ffc-2e13-4611-abf3-77238fbcf279 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:01.249500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa7ffc-2e13-4611-abf3-77238fbcf279 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:01.254480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250babd3-bf04-4c65-be03-ab7b17e986db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:01.255170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250babd3-bf04-4c65-be03-ab7b17e986db admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:01.255478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250babd3-bf04-4c65-be03-ab7b17e986db admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:01.255729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250babd3-bf04-4c65-be03-ab7b17e986db admin admin] PATH_INFO: `/v3/projects/10216704ff22448e93628e0f33bafadf/users/ed2ca2d2ea974dbfa6efaf9375303685/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:01.271079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250babd3-bf04-4c65-be03-ab7b17e986db admin admin] RBAC: Authorizing `identity:create_grant(project_id=10216704ff22448e93628e0f33bafadf, user_id=ed2ca2d2ea974dbfa6efaf9375303685, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:01.273756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250babd3-bf04-4c65-be03-ab7b17e986db admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:01.289285 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2195/4371] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:01 2022] PUT /identity/v3/projects/10216704ff22448e93628e0f33bafadf/users/ed2ca2d2ea974dbfa6efaf9375303685/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:01.300209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7f815-e51c-4b7b-8933-b9687f693e27 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:01.300496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7f815-e51c-4b7b-8933-b9687f693e27 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:01.300770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7f815-e51c-4b7b-8933-b9687f693e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:01.330167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5af7f815-e51c-4b7b-8933-b9687f693e27 None None] MFA Rules not processed for user `ed2ca2d2ea974dbfa6efaf9375303685`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:01.331808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5af7f815-e51c-4b7b-8933-b9687f693e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:01.453774 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2177/4372] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:01.489575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c092f6-01ed-4686-9a43-ec6057ceeed8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:01.490341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c092f6-01ed-4686-9a43-ec6057ceeed8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:01.490758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c092f6-01ed-4686-9a43-ec6057ceeed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:01.555794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-47c092f6-01ed-4686-9a43-ec6057ceeed8 None None] MFA Rules not processed for user `8ab02499c2b64768878fa1d06909e682`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:01.555995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7f815-e51c-4b7b-8933-b9687f693e27 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:01.557495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47c092f6-01ed-4686-9a43-ec6057ceeed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:01.566043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5af7f815-e51c-4b7b-8933-b9687f693e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:01.573986 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:01.721678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7f815-e51c-4b7b-8933-b9687f693e27 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:01.723015 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2196/4373] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:01.732759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b05c83-4c52-4761-bead-7af9baeb9438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:01.733567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b05c83-4c52-4761-bead-7af9baeb9438 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:01.733947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b05c83-4c52-4761-bead-7af9baeb9438 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:01.734074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd63db-932a-4d15-81cb-a9df9de5a810 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:01.734376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd63db-932a-4d15-81cb-a9df9de5a810 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:01.734483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b05c83-4c52-4761-bead-7af9baeb9438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:01.734654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd63db-932a-4d15-81cb-a9df9de5a810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:01.747187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b05c83-4c52-4761-bead-7af9baeb9438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:01.749763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b05c83-4c52-4761-bead-7af9baeb9438 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:01.770956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-96bd63db-932a-4d15-81cb-a9df9de5a810 None None] MFA Rules not processed for user `8ab02499c2b64768878fa1d06909e682`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:01.774780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-96bd63db-932a-4d15-81cb-a9df9de5a810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:01.787208 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2178/4374] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:20:01.795654 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2197/4375] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:20:01.933636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b05c83-4c52-4761-bead-7af9baeb9438 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:01.938910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e5b05c83-4c52-4761-bead-7af9baeb9438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:01.957054 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:02.087967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b05c83-4c52-4761-bead-7af9baeb9438 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:02.098457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d66ba-2616-4004-8940-10e5e4a71b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:02.099855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d66ba-2616-4004-8940-10e5e4a71b26 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:02.100619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d66ba-2616-4004-8940-10e5e4a71b26 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:02.101284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d66ba-2616-4004-8940-10e5e4a71b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:02.113519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d66ba-2616-4004-8940-10e5e4a71b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:02.115273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d66ba-2616-4004-8940-10e5e4a71b26 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:02.127719 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2179/4376] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:20:06.028540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd63db-932a-4d15-81cb-a9df9de5a810 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:06.030653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-96bd63db-932a-4d15-81cb-a9df9de5a810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:06.237748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd63db-932a-4d15-81cb-a9df9de5a810 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:06.251551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:06.253631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:06.253775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:06.253976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] PATH_INFO: `/v3/users/35c78d1882c34bb0ba5d7994bc5dd9d6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:06.258219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c78d1882c34bb0ba5d7994bc5dd9d6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:06.265338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:06.437008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c78d1882c34bb0ba5d7994bc5dd9d6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:06.439363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c78d1882c34bb0ba5d7994bc5dd9d6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:06.475086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c78d1882c34bb0ba5d7994bc5dd9d6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:06.492207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c78d1882c34bb0ba5d7994bc5dd9d6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:06.492898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c78d1882c34bb0ba5d7994bc5dd9d6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:06.526629 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2198/4377] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:20:06 2022] DELETE /identity/v3/users/35c78d1882c34bb0ba5d7994bc5dd9d6 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:06.529322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b74e9-feb7-497f-a996-37688ab133ab None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:06.529910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b74e9-feb7-497f-a996-37688ab133ab None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:06.530293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b74e9-feb7-497f-a996-37688ab133ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:06.591319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-871b74e9-feb7-497f-a996-37688ab133ab None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:06.592597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-871b74e9-feb7-497f-a996-37688ab133ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:06.746993 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2180/4378] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:06.971375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:06.973004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:07.068593 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:07.174482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0805a50-49b3-40fc-b057-36d1fb22c4f5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:07.187090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fb378-fc73-4f8c-ac0b-7f58a3c1d664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:07.189214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fb378-fc73-4f8c-ac0b-7f58a3c1d664 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:07.189443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fb378-fc73-4f8c-ac0b-7f58a3c1d664 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:07.189717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fb378-fc73-4f8c-ac0b-7f58a3c1d664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:07.218216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fb378-fc73-4f8c-ac0b-7f58a3c1d664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:07.219769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fb378-fc73-4f8c-ac0b-7f58a3c1d664 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:07.245791 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2199/4379] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:20:08.406816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b74e9-feb7-497f-a996-37688ab133ab None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:08.408999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-871b74e9-feb7-497f-a996-37688ab133ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:08.427505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b74e9-feb7-497f-a996-37688ab133ab None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:08.443359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:08.444026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:08.444357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:08.444570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] PATH_INFO: `/v3/projects/b7b6585ef9424e7f92861c072542e4f3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:08.445876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b6585ef9424e7f92861c072542e4f3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:08.447845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:08.576160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b6585ef9424e7f92861c072542e4f3', 'request_id': 'req-daa86f39-093f-4ca8-b47d-9b022a889208'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:08.607604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b6585ef9424e7f92861c072542e4f3', 'request_id': 'req-daa86f39-093f-4ca8-b47d-9b022a889208'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:08.627297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b6585ef9424e7f92861c072542e4f3', 'request_id': 'req-daa86f39-093f-4ca8-b47d-9b022a889208'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:08.645716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] The token cache is being invalidate because project b7b6585ef9424e7f92861c072542e4f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:20:08.646008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:08.648745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:08.651689 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2181/4380] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:20:08 2022] DELETE /identity/v3/projects/b7b6585ef9424e7f92861c072542e4f3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:08.656529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fb378-fc73-4f8c-ac0b-7f58a3c1d664 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:08.671561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fb378-fc73-4f8c-ac0b-7f58a3c1d664 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:08.871652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecd616-d97e-468b-9ba0-78c14560764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:08.873312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecd616-d97e-468b-9ba0-78c14560764d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:08.874268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecd616-d97e-468b-9ba0-78c14560764d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:08.882147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecd616-d97e-468b-9ba0-78c14560764d admin admin] PATH_INFO: `/v3/users/dfa504d86b3945d6a925b703fa348498` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:08.883603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecd616-d97e-468b-9ba0-78c14560764d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa504d86b3945d6a925b703fa348498)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:08.888811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecd616-d97e-468b-9ba0-78c14560764d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:08.998989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-41ecd616-d97e-468b-9ba0-78c14560764d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa504d86b3945d6a925b703fa348498'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:08.999762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-41ecd616-d97e-468b-9ba0-78c14560764d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa504d86b3945d6a925b703fa348498'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:09.031634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-41ecd616-d97e-468b-9ba0-78c14560764d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa504d86b3945d6a925b703fa348498'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:09.051768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-41ecd616-d97e-468b-9ba0-78c14560764d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa504d86b3945d6a925b703fa348498'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:09.052449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-41ecd616-d97e-468b-9ba0-78c14560764d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa504d86b3945d6a925b703fa348498'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:09.077791 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2200/4381] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:20:08 2022] DELETE /identity/v3/users/dfa504d86b3945d6a925b703fa348498 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:09.864317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:09.865741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:09.884225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa86f39-093f-4ca8-b47d-9b022a889208 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:09.932379 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:09.989545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:09.990194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:09.990474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:09.990881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff admin admin] PATH_INFO: `/v3/projects/674a6d9425fa4c42996147b5d657fa14` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:09.992187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=674a6d9425fa4c42996147b5d657fa14)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:09.994637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:10.067234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674a6d9425fa4c42996147b5d657fa14', 'request_id': 'req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:10.075179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674a6d9425fa4c42996147b5d657fa14', 'request_id': 'req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:10.087104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674a6d9425fa4c42996147b5d657fa14', 'request_id': 'req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:10.118825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff admin admin] The token cache is being invalidate because project 674a6d9425fa4c42996147b5d657fa14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:20:10.119162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:10.120602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cb05d7a7-0a12-4dc0-bf73-4f9b850970ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:10.125029 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2182/4382] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:20:09 2022] DELETE /identity/v3/projects/674a6d9425fa4c42996147b5d657fa14 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:10.129814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402b3c3-135f-4159-8243-2dddef8080f3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:10.130264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402b3c3-135f-4159-8243-2dddef8080f3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:10.130355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402b3c3-135f-4159-8243-2dddef8080f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:10.165737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6402b3c3-135f-4159-8243-2dddef8080f3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:10.167150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6402b3c3-135f-4159-8243-2dddef8080f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:10.281981 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:10.362555 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2201/4383] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:10.370377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dadfcb-28e9-4585-ba2f-11f9492030e2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:10.370905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dadfcb-28e9-4585-ba2f-11f9492030e2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:10.371444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dadfcb-28e9-4585-ba2f-11f9492030e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:10.459772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-29dadfcb-28e9-4585-ba2f-11f9492030e2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:10.461086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-29dadfcb-28e9-4585-ba2f-11f9492030e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:10.492256 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2183/4384] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:10.493544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402b3c3-135f-4159-8243-2dddef8080f3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:10.516651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402b3c3-135f-4159-8243-2dddef8080f3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:10.545800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3810f1-29c7-47e5-b8ee-84cbe48a603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:10.546834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3810f1-29c7-47e5-b8ee-84cbe48a603f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:10.547616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3810f1-29c7-47e5-b8ee-84cbe48a603f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:10.548379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3810f1-29c7-47e5-b8ee-84cbe48a603f admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:10.550397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3810f1-29c7-47e5-b8ee-84cbe48a603f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:20:10.555712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3810f1-29c7-47e5-b8ee-84cbe48a603f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:10.557626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3810f1-29c7-47e5-b8ee-84cbe48a603f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:10.610714 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2202/4385] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:20:10.611704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dadfcb-28e9-4585-ba2f-11f9492030e2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:10.624250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dadfcb-28e9-4585-ba2f-11f9492030e2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:10.637837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f3674-5a13-48f0-976f-28684aba3a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:10.638466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f3674-5a13-48f0-976f-28684aba3a21 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:10.638754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f3674-5a13-48f0-976f-28684aba3a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:10.639033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f3674-5a13-48f0-976f-28684aba3a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:10.639678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f3674-5a13-48f0-976f-28684aba3a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:10.641825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f3674-5a13-48f0-976f-28684aba3a21 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:10.729987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3810f1-29c7-47e5-b8ee-84cbe48a603f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:10.732853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1e3810f1-29c7-47e5-b8ee-84cbe48a603f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:10.751012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3810f1-29c7-47e5-b8ee-84cbe48a603f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:10.763267 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2184/4386] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:20:10 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:10.782000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f3674-5a13-48f0-976f-28684aba3a21 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:10.796085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc3501-8043-4094-945a-e048d3ff4246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:10.797609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc3501-8043-4094-945a-e048d3ff4246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:10.797906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc3501-8043-4094-945a-e048d3ff4246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:10.798187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc3501-8043-4094-945a-e048d3ff4246 admin admin] PATH_INFO: `/v3/users/ed2ca2d2ea974dbfa6efaf9375303685` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:10.801601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc3501-8043-4094-945a-e048d3ff4246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2ca2d2ea974dbfa6efaf9375303685)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:10.812591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc3501-8043-4094-945a-e048d3ff4246 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:10.912109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2bc3501-8043-4094-945a-e048d3ff4246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2ca2d2ea974dbfa6efaf9375303685'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:10.913365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2bc3501-8043-4094-945a-e048d3ff4246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2ca2d2ea974dbfa6efaf9375303685'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:10.930030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2bc3501-8043-4094-945a-e048d3ff4246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2ca2d2ea974dbfa6efaf9375303685'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:10.939274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f3674-5a13-48f0-976f-28684aba3a21 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:10.943338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2bc3501-8043-4094-945a-e048d3ff4246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2ca2d2ea974dbfa6efaf9375303685'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:10.944689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2bc3501-8043-4094-945a-e048d3ff4246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2ca2d2ea974dbfa6efaf9375303685'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:10.947447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4f45c-6367-4d84-8330-0d8b322565d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:10.948621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4f45c-6367-4d84-8330-0d8b322565d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:10.950138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4f45c-6367-4d84-8330-0d8b322565d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:10.951569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4f45c-6367-4d84-8330-0d8b322565d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:10.952436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4f45c-6367-4d84-8330-0d8b322565d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:10.955806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4f45c-6367-4d84-8330-0d8b322565d5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:10.979272 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2203/4387] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:20:10 2022] DELETE /identity/v3/users/ed2ca2d2ea974dbfa6efaf9375303685 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:20:10.984880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5f150-5876-40aa-a532-49212486bd30 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:10.985456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5f150-5876-40aa-a532-49212486bd30 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:10.985733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5f150-5876-40aa-a532-49212486bd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:10.990594 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2185/4388] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:20:10 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:10.994265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4f45c-6367-4d84-8330-0d8b322565d5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:11.000834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5ff4f45c-6367-4d84-8330-0d8b322565d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:11.016060 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:11.020576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4f45c-6367-4d84-8330-0d8b322565d5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:11.032684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ecc5f150-5876-40aa-a532-49212486bd30 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:11.034046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ecc5f150-5876-40aa-a532-49212486bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:11.126766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d58957-38ba-4725-9ded-7b8bd85eaf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:11.127650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d58957-38ba-4725-9ded-7b8bd85eaf01 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:11.128124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d58957-38ba-4725-9ded-7b8bd85eaf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:11.128519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d58957-38ba-4725-9ded-7b8bd85eaf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:11.129260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d58957-38ba-4725-9ded-7b8bd85eaf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:11.130993 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2204/4389] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:11.131492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d58957-38ba-4725-9ded-7b8bd85eaf01 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:11.144175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5f150-5876-40aa-a532-49212486bd30 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:11.149112 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2186/4390] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:11.159974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d58957-38ba-4725-9ded-7b8bd85eaf01 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:11.162719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ecc5f150-5876-40aa-a532-49212486bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:11.183262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d58957-38ba-4725-9ded-7b8bd85eaf01 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:11.199741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4accfe-5b3c-4fd3-9b3c-3534eeee57cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:11.200775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4accfe-5b3c-4fd3-9b3c-3534eeee57cf admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:11.201640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4accfe-5b3c-4fd3-9b3c-3534eeee57cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:11.202026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4accfe-5b3c-4fd3-9b3c-3534eeee57cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:11.202951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4accfe-5b3c-4fd3-9b3c-3534eeee57cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:11.207219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4accfe-5b3c-4fd3-9b3c-3534eeee57cf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:11.227435 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:11.238128 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2187/4391] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:11.239242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4accfe-5b3c-4fd3-9b3c-3534eeee57cf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:11.258722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4accfe-5b3c-4fd3-9b3c-3534eeee57cf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:11.261525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5f150-5876-40aa-a532-49212486bd30 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:11.271056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33d423-5d35-4a24-a4ba-21e2ba99d6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:11.272969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33d423-5d35-4a24-a4ba-21e2ba99d6ed service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:11.273944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15151c11-2c83-4035-ac45-f72981f0fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:11.274406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33d423-5d35-4a24-a4ba-21e2ba99d6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:11.274835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33d423-5d35-4a24-a4ba-21e2ba99d6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:11.275668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15151c11-2c83-4035-ac45-f72981f0fb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:11.277294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15151c11-2c83-4035-ac45-f72981f0fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:11.278214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15151c11-2c83-4035-ac45-f72981f0fb50 admin admin] PATH_INFO: `/v3/projects/ed675a5bb0644b6ba30b431fc7d13146/users/26b99377b6ef491d823ba38a790b807c/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:11.301327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15151c11-2c83-4035-ac45-f72981f0fb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed675a5bb0644b6ba30b431fc7d13146, user_id=26b99377b6ef491d823ba38a790b807c, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:11.304661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15151c11-2c83-4035-ac45-f72981f0fb50 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:11.305782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33d423-5d35-4a24-a4ba-21e2ba99d6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:11.307811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33d423-5d35-4a24-a4ba-21e2ba99d6ed service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:11.323261 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2205/4392] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:20:11.338991 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2188/4393] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:11 2022] PUT /identity/v3/projects/ed675a5bb0644b6ba30b431fc7d13146/users/26b99377b6ef491d823ba38a790b807c/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:11.342308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2153079-d1ff-496f-a05c-e67a177b6e55 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:11.342746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2153079-d1ff-496f-a05c-e67a177b6e55 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:11.343250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2153079-d1ff-496f-a05c-e67a177b6e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:11.383191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a2153079-d1ff-496f-a05c-e67a177b6e55 None None] MFA Rules not processed for user `26b99377b6ef491d823ba38a790b807c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:11.384751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a2153079-d1ff-496f-a05c-e67a177b6e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:11.483933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15151c11-2c83-4035-ac45-f72981f0fb50 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:11.484308 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2206/4394] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:11.626561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15151c11-2c83-4035-ac45-f72981f0fb50 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:11.636378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3558d-7a95-451f-b181-cc0621619420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:11.637114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3558d-7a95-451f-b181-cc0621619420 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:11.637804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3558d-7a95-451f-b181-cc0621619420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:11.637804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3558d-7a95-451f-b181-cc0621619420 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:11.638578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3558d-7a95-451f-b181-cc0621619420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:11.640372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3558d-7a95-451f-b181-cc0621619420 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:11.686662 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2189/4395] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:20:11 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:20:11.688370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2153079-d1ff-496f-a05c-e67a177b6e55 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:11.704414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2153079-d1ff-496f-a05c-e67a177b6e55 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:11.819778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e33d3-87f0-47bd-97da-9fa143bb6b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:11.820795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e33d3-87f0-47bd-97da-9fa143bb6b46 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:11.821326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e33d3-87f0-47bd-97da-9fa143bb6b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:11.821981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e33d3-87f0-47bd-97da-9fa143bb6b46 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:11.823121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e33d3-87f0-47bd-97da-9fa143bb6b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:11.825732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e33d3-87f0-47bd-97da-9fa143bb6b46 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:11.866341 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2207/4396] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:20:11 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:11.868030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3558d-7a95-451f-b181-cc0621619420 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:11.881539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3558d-7a95-451f-b181-cc0621619420 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:11.887244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a8de4-c318-47bf-a6e2-ef1e54f15a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:11.888480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a8de4-c318-47bf-a6e2-ef1e54f15a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:11.888763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a8de4-c318-47bf-a6e2-ef1e54f15a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:11.889088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a8de4-c318-47bf-a6e2-ef1e54f15a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:11.890525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a8de4-c318-47bf-a6e2-ef1e54f15a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:11.892194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a8de4-c318-47bf-a6e2-ef1e54f15a44 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:11.910961 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2190/4397] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:11.913937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e33d3-87f0-47bd-97da-9fa143bb6b46 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:11.935152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e33d3-87f0-47bd-97da-9fa143bb6b46 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:11.942524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b0dc5-d2ee-49e1-adff-4f0938f2d132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:11.943243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b0dc5-d2ee-49e1-adff-4f0938f2d132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:11.943524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b0dc5-d2ee-49e1-adff-4f0938f2d132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:11.943798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b0dc5-d2ee-49e1-adff-4f0938f2d132 admin admin] PATH_INFO: `/v3/projects/c87d37e0200449209cb88f54379eceed/users/69d5c5d707e84db6af15062e0de1eff3/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:11.968899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b0dc5-d2ee-49e1-adff-4f0938f2d132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87d37e0200449209cb88f54379eceed, user_id=69d5c5d707e84db6af15062e0de1eff3, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:11.971797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b0dc5-d2ee-49e1-adff-4f0938f2d132 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:11.993540 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2208/4398] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:11 2022] PUT /identity/v3/projects/c87d37e0200449209cb88f54379eceed/users/69d5c5d707e84db6af15062e0de1eff3/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:11.994761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a8de4-c318-47bf-a6e2-ef1e54f15a44 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:12.014227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a8de4-c318-47bf-a6e2-ef1e54f15a44 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:12.050513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b0dc5-d2ee-49e1-adff-4f0938f2d132 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:12.052301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-591b0dc5-d2ee-49e1-adff-4f0938f2d132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:12.097308 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:12.154683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f5c95-0c1a-4368-affb-72ae3bb67a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:12.155492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f5c95-0c1a-4368-affb-72ae3bb67a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:12.156019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f5c95-0c1a-4368-affb-72ae3bb67a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:12.156402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f5c95-0c1a-4368-affb-72ae3bb67a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:12.157151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f5c95-0c1a-4368-affb-72ae3bb67a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:12.162797 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:12.165217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f5c95-0c1a-4368-affb-72ae3bb67a17 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:12.195927 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2191/4399] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:12.205209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f5c95-0c1a-4368-affb-72ae3bb67a17 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:12.207080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b0dc5-d2ee-49e1-adff-4f0938f2d132 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:12.212072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:12.212731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:12.213011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:12.213449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba admin admin] PATH_INFO: `/v3/projects/10216704ff22448e93628e0f33bafadf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:12.214644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=10216704ff22448e93628e0f33bafadf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:12.217848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:12.247428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f5c95-0c1a-4368-affb-72ae3bb67a17 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:12.256619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc7e18-a97f-4d1f-be21-ab576ee82897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:12.257862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc7e18-a97f-4d1f-be21-ab576ee82897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:12.258244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc7e18-a97f-4d1f-be21-ab576ee82897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:12.258665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc7e18-a97f-4d1f-be21-ab576ee82897 admin admin] PATH_INFO: `/v3/projects/c87d37e0200449209cb88f54379eceed/users/69d5c5d707e84db6af15062e0de1eff3/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:12.263549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc7e18-a97f-4d1f-be21-ab576ee82897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87d37e0200449209cb88f54379eceed, user_id=69d5c5d707e84db6af15062e0de1eff3, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:12.266853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc7e18-a97f-4d1f-be21-ab576ee82897 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:12.283838 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2192/4400] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:12 2022] PUT /identity/v3/projects/c87d37e0200449209cb88f54379eceed/users/69d5c5d707e84db6af15062e0de1eff3/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:12.295081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dc392-6021-41a0-af64-d7750e15486f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:12.295983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dc392-6021-41a0-af64-d7750e15486f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:12.296762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dc392-6021-41a0-af64-d7750e15486f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:12.299437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10216704ff22448e93628e0f33bafadf', 'request_id': 'req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:12.307495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10216704ff22448e93628e0f33bafadf', 'request_id': 'req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:12.318322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10216704ff22448e93628e0f33bafadf', 'request_id': 'req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:12.344315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d29dc392-6021-41a0-af64-d7750e15486f None None] MFA Rules not processed for user `69d5c5d707e84db6af15062e0de1eff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:12.346372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d29dc392-6021-41a0-af64-d7750e15486f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:12.362484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba admin admin] The token cache is being invalidate because project 10216704ff22448e93628e0f33bafadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:20:12.363235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:12.364390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2edb3a45-fd51-45a1-8f26-08cbc88cc8ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:12.367688 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2209/4401] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:20:12 2022] DELETE /identity/v3/projects/10216704ff22448e93628e0f33bafadf => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:20:12.376694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049780b5-d0b5-4784-a126-ee51f0b0154b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:12.377183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049780b5-d0b5-4784-a126-ee51f0b0154b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:12.377615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049780b5-d0b5-4784-a126-ee51f0b0154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:12.403350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-049780b5-d0b5-4784-a126-ee51f0b0154b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:12.406070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-049780b5-d0b5-4784-a126-ee51f0b0154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:12.449288 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2193/4402] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:12.471299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dc392-6021-41a0-af64-d7750e15486f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:12.472870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d29dc392-6021-41a0-af64-d7750e15486f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:12.521799 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2210/4403] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:12.538492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59ec8f-02a9-45e3-997e-e7476b402a3e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:12.542902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59ec8f-02a9-45e3-997e-e7476b402a3e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:12.546937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59ec8f-02a9-45e3-997e-e7476b402a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:12.566558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dc392-6021-41a0-af64-d7750e15486f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:12.572229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca18970-f2c0-4ae6-98da-54ec459822b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:12.579369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca18970-f2c0-4ae6-98da-54ec459822b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:12.579923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca18970-f2c0-4ae6-98da-54ec459822b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:12.580462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca18970-f2c0-4ae6-98da-54ec459822b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:12.603547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca18970-f2c0-4ae6-98da-54ec459822b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:12.606605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca18970-f2c0-4ae6-98da-54ec459822b1 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:12.608604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cd59ec8f-02a9-45e3-997e-e7476b402a3e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:12.609816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cd59ec8f-02a9-45e3-997e-e7476b402a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:12.620133 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2194/4404] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:20:12.636180 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2211/4405] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:12.638178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca18970-f2c0-4ae6-98da-54ec459822b1 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:12.667256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca18970-f2c0-4ae6-98da-54ec459822b1 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:12.675172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3e9cd-c3fb-45fb-8a23-1db9a6f145c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:12.676446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3e9cd-c3fb-45fb-8a23-1db9a6f145c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:12.677000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3e9cd-c3fb-45fb-8a23-1db9a6f145c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:12.677388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3e9cd-c3fb-45fb-8a23-1db9a6f145c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:12.678532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3e9cd-c3fb-45fb-8a23-1db9a6f145c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:20:12.678947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3e9cd-c3fb-45fb-8a23-1db9a6f145c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:12.681119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3e9cd-c3fb-45fb-8a23-1db9a6f145c8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:12.711218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59ec8f-02a9-45e3-997e-e7476b402a3e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:12.719134 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2195/4406] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:20:12.730600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59ec8f-02a9-45e3-997e-e7476b402a3e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:12.743306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625465c3-a50a-42b9-99ab-a4e95bb559fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:12.744287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625465c3-a50a-42b9-99ab-a4e95bb559fd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:12.744801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625465c3-a50a-42b9-99ab-a4e95bb559fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:12.745331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625465c3-a50a-42b9-99ab-a4e95bb559fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:12.747044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625465c3-a50a-42b9-99ab-a4e95bb559fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:12.751080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625465c3-a50a-42b9-99ab-a4e95bb559fd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:12.793986 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2212/4407] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:20:12 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:12.796727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3e9cd-c3fb-45fb-8a23-1db9a6f145c8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:12.823576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3e9cd-c3fb-45fb-8a23-1db9a6f145c8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:12.833666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625465c3-a50a-42b9-99ab-a4e95bb559fd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:12.835677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-625465c3-a50a-42b9-99ab-a4e95bb559fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:12.907013 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:12.907376 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:12.943177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da5399-b2b2-4c0d-8e1d-458a305edddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:12.943926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da5399-b2b2-4c0d-8e1d-458a305edddd admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:12.944333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da5399-b2b2-4c0d-8e1d-458a305edddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:12.944612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da5399-b2b2-4c0d-8e1d-458a305edddd admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:12.945245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da5399-b2b2-4c0d-8e1d-458a305edddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:12.946664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625465c3-a50a-42b9-99ab-a4e95bb559fd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:12.948807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da5399-b2b2-4c0d-8e1d-458a305edddd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:12.952710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76829711-d7e8-4ee2-82c3-c311137094f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:12.953501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76829711-d7e8-4ee2-82c3-c311137094f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:12.953878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76829711-d7e8-4ee2-82c3-c311137094f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:12.954253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76829711-d7e8-4ee2-82c3-c311137094f4 admin admin] PATH_INFO: `/v3/users/26b99377b6ef491d823ba38a790b807c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:12.956650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76829711-d7e8-4ee2-82c3-c311137094f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b99377b6ef491d823ba38a790b807c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:12.959032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76829711-d7e8-4ee2-82c3-c311137094f4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:12.983757 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2196/4408] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:20:12 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:12.984929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da5399-b2b2-4c0d-8e1d-458a305edddd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:12.998582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da5399-b2b2-4c0d-8e1d-458a305edddd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:13.005641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d85099-e20a-4219-8735-1039c80320c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:13.006253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d85099-e20a-4219-8735-1039c80320c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:13.006528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d85099-e20a-4219-8735-1039c80320c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:13.006796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d85099-e20a-4219-8735-1039c80320c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:13.007789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d85099-e20a-4219-8735-1039c80320c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:13.009516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d85099-e20a-4219-8735-1039c80320c6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:13.023102 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2197/4409] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:13.025436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76829711-d7e8-4ee2-82c3-c311137094f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b99377b6ef491d823ba38a790b807c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:13.026255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76829711-d7e8-4ee2-82c3-c311137094f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b99377b6ef491d823ba38a790b807c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:13.026398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d85099-e20a-4219-8735-1039c80320c6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:13.029034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-46d85099-e20a-4219-8735-1039c80320c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:13.044076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76829711-d7e8-4ee2-82c3-c311137094f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b99377b6ef491d823ba38a790b807c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:13.045181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d85099-e20a-4219-8735-1039c80320c6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:13.051084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05453c4d-b92a-492a-bc9b-32a87fcacca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:13.052057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05453c4d-b92a-492a-bc9b-32a87fcacca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:13.052430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05453c4d-b92a-492a-bc9b-32a87fcacca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:13.052654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05453c4d-b92a-492a-bc9b-32a87fcacca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:13.053811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05453c4d-b92a-492a-bc9b-32a87fcacca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:13.055677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76829711-d7e8-4ee2-82c3-c311137094f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b99377b6ef491d823ba38a790b807c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:13.056411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05453c4d-b92a-492a-bc9b-32a87fcacca0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:13.057103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76829711-d7e8-4ee2-82c3-c311137094f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b99377b6ef491d823ba38a790b807c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:13.071127 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2198/4410] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:13.073786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05453c4d-b92a-492a-bc9b-32a87fcacca0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:13.080440 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2213/4411] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:20:12 2022] DELETE /identity/v3/users/26b99377b6ef491d823ba38a790b807c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:13.084547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4662592-fe73-47f0-bb16-f5379f1d1488 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:13.084828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4662592-fe73-47f0-bb16-f5379f1d1488 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:13.085100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4662592-fe73-47f0-bb16-f5379f1d1488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:13.091938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05453c4d-b92a-492a-bc9b-32a87fcacca0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:13.112715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f4662592-fe73-47f0-bb16-f5379f1d1488 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:13.114801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f4662592-fe73-47f0-bb16-f5379f1d1488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:13.214000 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2214/4412] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:13.218177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea7bf9-a1c8-47c7-bad3-ecb20239823c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:13.218863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea7bf9-a1c8-47c7-bad3-ecb20239823c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:13.219160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea7bf9-a1c8-47c7-bad3-ecb20239823c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:13.219431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea7bf9-a1c8-47c7-bad3-ecb20239823c admin admin] PATH_INFO: `/v3/projects/1ad20c8fe9e54bffbfeffcf7950e132a/users/9775f23ac7e34bd2ad5bad5a60aa8785/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:13.226174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4662592-fe73-47f0-bb16-f5379f1d1488 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:13.228075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f4662592-fe73-47f0-bb16-f5379f1d1488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:13.240191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea7bf9-a1c8-47c7-bad3-ecb20239823c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad20c8fe9e54bffbfeffcf7950e132a, user_id=9775f23ac7e34bd2ad5bad5a60aa8785, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:13.243362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea7bf9-a1c8-47c7-bad3-ecb20239823c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:13.264792 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2199/4413] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:13 2022] PUT /identity/v3/projects/1ad20c8fe9e54bffbfeffcf7950e132a/users/9775f23ac7e34bd2ad5bad5a60aa8785/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:13.269693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca752ac-c0bb-49e8-a6aa-0b37146acb00 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:13.270030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca752ac-c0bb-49e8-a6aa-0b37146acb00 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:13.270312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca752ac-c0bb-49e8-a6aa-0b37146acb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:13.300883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cca752ac-c0bb-49e8-a6aa-0b37146acb00 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:13.302253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cca752ac-c0bb-49e8-a6aa-0b37146acb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:13.352211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4662592-fe73-47f0-bb16-f5379f1d1488 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:13.378640 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:13.383333 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2200/4414] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:20:13.394153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca752ac-c0bb-49e8-a6aa-0b37146acb00 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:13.448185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e9abc-1af7-4519-9d24-19f6b100dc4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:13.450865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e9abc-1af7-4519-9d24-19f6b100dc4d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:13.451180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e9abc-1af7-4519-9d24-19f6b100dc4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:13.451473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e9abc-1af7-4519-9d24-19f6b100dc4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:13.456602 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:13.482429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e9abc-1af7-4519-9d24-19f6b100dc4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:13.488349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e9abc-1af7-4519-9d24-19f6b100dc4d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:13.498362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca752ac-c0bb-49e8-a6aa-0b37146acb00 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:13.504074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f381-0ae3-4556-a02b-6ea5f4c83080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:13.504951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f381-0ae3-4556-a02b-6ea5f4c83080 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:13.505435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f381-0ae3-4556-a02b-6ea5f4c83080 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:13.505911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f381-0ae3-4556-a02b-6ea5f4c83080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:13.523324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34f381-0ae3-4556-a02b-6ea5f4c83080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:13.526416 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2215/4415] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:20:13.539141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34f381-0ae3-4556-a02b-6ea5f4c83080 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:13.569069 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2201/4416] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:20:14.029314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e9abc-1af7-4519-9d24-19f6b100dc4d service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:14.032173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-650e9abc-1af7-4519-9d24-19f6b100dc4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:14.065009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e9abc-1af7-4519-9d24-19f6b100dc4d service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:14.074673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:14.075622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:14.076092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:14.091888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] PATH_INFO: `/v3/projects/ed675a5bb0644b6ba30b431fc7d13146` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:14.095506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed675a5bb0644b6ba30b431fc7d13146)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:14.100610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:14.256013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed675a5bb0644b6ba30b431fc7d13146', 'request_id': 'req-398aea78-2d70-44b7-bd68-e9a4c1c5c804'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:14.267695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed675a5bb0644b6ba30b431fc7d13146', 'request_id': 'req-398aea78-2d70-44b7-bd68-e9a4c1c5c804'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:14.280229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed675a5bb0644b6ba30b431fc7d13146', 'request_id': 'req-398aea78-2d70-44b7-bd68-e9a4c1c5c804'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:14.306880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] The token cache is being invalidate because project ed675a5bb0644b6ba30b431fc7d13146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:20:14.307614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:14.309407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:14.312532 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2216/4417] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:20:14 2022] DELETE /identity/v3/projects/ed675a5bb0644b6ba30b431fc7d13146 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:14.316688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f381-0ae3-4556-a02b-6ea5f4c83080 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:14.329146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f381-0ae3-4556-a02b-6ea5f4c83080 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:14.372007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:14.373903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:14.468886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:14.470219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:14.470219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:14.470219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] PATH_INFO: `/v3/users/69d5c5d707e84db6af15062e0de1eff3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:14.471624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d5c5d707e84db6af15062e0de1eff3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:14.473768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:14.550052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398aea78-2d70-44b7-bd68-e9a4c1c5c804 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:14.568250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488146a-6f82-4d56-ac56-6185166677fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:14.569409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488146a-6f82-4d56-ac56-6185166677fd service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:14.569890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488146a-6f82-4d56-ac56-6185166677fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:14.570376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488146a-6f82-4d56-ac56-6185166677fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:14.574653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f488146a-6f82-4d56-ac56-6185166677fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:14.595045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d5c5d707e84db6af15062e0de1eff3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:14.595994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d5c5d707e84db6af15062e0de1eff3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:14.629025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d5c5d707e84db6af15062e0de1eff3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:14.642454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d5c5d707e84db6af15062e0de1eff3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:14.643472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d5c5d707e84db6af15062e0de1eff3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:14.709856 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2202/4418] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:20:14 2022] DELETE /identity/v3/users/69d5c5d707e84db6af15062e0de1eff3 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:14.711783 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:14.740225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488146a-6f82-4d56-ac56-6185166677fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:14.743010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488146a-6f82-4d56-ac56-6185166677fd service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:14.758779 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2217/4419] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:20:15.380710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:15.382180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:15.556563 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:15.585425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bb727-9dc2-4132-bf21-30f0f89902e5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:15.598280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd42c2-93db-4753-9558-6c00d2358c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:15.599458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd42c2-93db-4753-9558-6c00d2358c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:15.601042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd42c2-93db-4753-9558-6c00d2358c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:15.601042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd42c2-93db-4753-9558-6c00d2358c66 admin admin] PATH_INFO: `/v3/projects/c87d37e0200449209cb88f54379eceed` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:15.606931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd42c2-93db-4753-9558-6c00d2358c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c87d37e0200449209cb88f54379eceed)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:15.609044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd42c2-93db-4753-9558-6c00d2358c66 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:15.750417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bacd42c2-93db-4753-9558-6c00d2358c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c87d37e0200449209cb88f54379eceed', 'request_id': 'req-bacd42c2-93db-4753-9558-6c00d2358c66'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:15.763777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bacd42c2-93db-4753-9558-6c00d2358c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c87d37e0200449209cb88f54379eceed', 'request_id': 'req-bacd42c2-93db-4753-9558-6c00d2358c66'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:15.789415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bacd42c2-93db-4753-9558-6c00d2358c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c87d37e0200449209cb88f54379eceed', 'request_id': 'req-bacd42c2-93db-4753-9558-6c00d2358c66'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:15.806642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bacd42c2-93db-4753-9558-6c00d2358c66 admin admin] The token cache is being invalidate because project c87d37e0200449209cb88f54379eceed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:20:15.808931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bacd42c2-93db-4753-9558-6c00d2358c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:15.810112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bacd42c2-93db-4753-9558-6c00d2358c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:15.812660 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2203/4420] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:20:15 2022] DELETE /identity/v3/projects/c87d37e0200449209cb88f54379eceed => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:15.817612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830cb9c-4798-4fc1-b295-6d87d1b4ff54 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:15.818109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830cb9c-4798-4fc1-b295-6d87d1b4ff54 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:15.818225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830cb9c-4798-4fc1-b295-6d87d1b4ff54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:15.849089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a830cb9c-4798-4fc1-b295-6d87d1b4ff54 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:15.852242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a830cb9c-4798-4fc1-b295-6d87d1b4ff54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:16.065990 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2218/4421] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:16.073658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f18c5-b14b-41c9-9ce6-3d093ba89578 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:16.074049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f18c5-b14b-41c9-9ce6-3d093ba89578 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:16.075076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f18c5-b14b-41c9-9ce6-3d093ba89578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:16.116849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6a6f18c5-b14b-41c9-9ce6-3d093ba89578 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:16.122574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6a6f18c5-b14b-41c9-9ce6-3d093ba89578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:16.143078 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2204/4422] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:20:16.147618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830cb9c-4798-4fc1-b295-6d87d1b4ff54 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:16.161147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830cb9c-4798-4fc1-b295-6d87d1b4ff54 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:16.178404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b5806-9951-4083-b77e-21eda2e94cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:16.179253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b5806-9951-4083-b77e-21eda2e94cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:16.179683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b5806-9951-4083-b77e-21eda2e94cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:16.180114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b5806-9951-4083-b77e-21eda2e94cb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:16.180950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b5806-9951-4083-b77e-21eda2e94cb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:20:16.181407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b5806-9951-4083-b77e-21eda2e94cb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:16.183264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b5806-9951-4083-b77e-21eda2e94cb2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:16.217648 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2219/4423] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:20:16.218595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f18c5-b14b-41c9-9ce6-3d093ba89578 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:16.236180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f18c5-b14b-41c9-9ce6-3d093ba89578 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:16.251396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266d516-423c-4366-a4c0-95241eb72b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:16.252167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266d516-423c-4366-a4c0-95241eb72b10 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:16.252560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266d516-423c-4366-a4c0-95241eb72b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:16.253402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266d516-423c-4366-a4c0-95241eb72b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:16.254296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266d516-423c-4366-a4c0-95241eb72b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:16.256479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266d516-423c-4366-a4c0-95241eb72b10 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:16.320191 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2205/4424] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:20:16 2022] POST /identity/v3/projects => generated 407 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:20:16.322887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b5806-9951-4083-b77e-21eda2e94cb2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:16.333834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b5806-9951-4083-b77e-21eda2e94cb2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:16.414893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68558e3-eca7-4143-9a4f-4f6fcef11b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:16.415837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68558e3-eca7-4143-9a4f-4f6fcef11b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:16.416269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68558e3-eca7-4143-9a4f-4f6fcef11b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:16.417563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68558e3-eca7-4143-9a4f-4f6fcef11b89 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:16.419015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68558e3-eca7-4143-9a4f-4f6fcef11b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:16.421735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68558e3-eca7-4143-9a4f-4f6fcef11b89 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:16.454634 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2220/4425] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:20:16 2022] POST /identity/v3/users => generated 304 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:16.460587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266d516-423c-4366-a4c0-95241eb72b10 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:16.475596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266d516-423c-4366-a4c0-95241eb72b10 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:16.492221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c84eab-2c6b-4164-a0e5-b9f7aa9cac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:16.494203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c84eab-2c6b-4164-a0e5-b9f7aa9cac13 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:16.494666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c84eab-2c6b-4164-a0e5-b9f7aa9cac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:16.495263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c84eab-2c6b-4164-a0e5-b9f7aa9cac13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:16.496285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c84eab-2c6b-4164-a0e5-b9f7aa9cac13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:16.502810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c84eab-2c6b-4164-a0e5-b9f7aa9cac13 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:16.531232 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2206/4426] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:16.535563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68558e3-eca7-4143-9a4f-4f6fcef11b89 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:16.553040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68558e3-eca7-4143-9a4f-4f6fcef11b89 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:16.565683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98ec0a-d20c-46fd-94c7-5c79f54e3022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:16.566416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98ec0a-d20c-46fd-94c7-5c79f54e3022 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:16.566763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98ec0a-d20c-46fd-94c7-5c79f54e3022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:16.567135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98ec0a-d20c-46fd-94c7-5c79f54e3022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:16.567861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98ec0a-d20c-46fd-94c7-5c79f54e3022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:16.569554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98ec0a-d20c-46fd-94c7-5c79f54e3022 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:16.597852 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2221/4427] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:16.601762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c84eab-2c6b-4164-a0e5-b9f7aa9cac13 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:16.614233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c84eab-2c6b-4164-a0e5-b9f7aa9cac13 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:16.620583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b4894-261d-4267-a848-c30005579182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:16.621417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b4894-261d-4267-a848-c30005579182 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:16.621690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b4894-261d-4267-a848-c30005579182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:16.622109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b4894-261d-4267-a848-c30005579182 admin admin] PATH_INFO: `/v3/projects/21adaf65423045b0b3a65c84b6029812/users/7c4f0c461242436fa97b23c935d1fda1/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:16.644457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b4894-261d-4267-a848-c30005579182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21adaf65423045b0b3a65c84b6029812, user_id=7c4f0c461242436fa97b23c935d1fda1, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:16.647305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b4894-261d-4267-a848-c30005579182 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:16.692485 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2207/4428] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:16 2022] PUT /identity/v3/projects/21adaf65423045b0b3a65c84b6029812/users/7c4f0c461242436fa97b23c935d1fda1/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:16.693255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a73d1-4337-4920-ae76-98d26c13704e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:16.693619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a73d1-4337-4920-ae76-98d26c13704e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:16.693842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a73d1-4337-4920-ae76-98d26c13704e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:16.753033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-557a73d1-4337-4920-ae76-98d26c13704e None None] MFA Rules not processed for user `7c4f0c461242436fa97b23c935d1fda1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:16.754388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-557a73d1-4337-4920-ae76-98d26c13704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:16.874700 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:16.932353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b4894-261d-4267-a848-c30005579182 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:16.938171 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2222/4429] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:17.028327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b4894-261d-4267-a848-c30005579182 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:17.035056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf3fc4-08fa-43a2-aad6-0acd2fb42161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:17.036739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf3fc4-08fa-43a2-aad6-0acd2fb42161 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:17.037125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf3fc4-08fa-43a2-aad6-0acd2fb42161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:17.037640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf3fc4-08fa-43a2-aad6-0acd2fb42161 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:17.038850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf3fc4-08fa-43a2-aad6-0acd2fb42161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:17.040880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf3fc4-08fa-43a2-aad6-0acd2fb42161 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:17.076357 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2208/4430] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:20:16 2022] POST /identity/v3/projects => generated 409 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:17.080569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a73d1-4337-4920-ae76-98d26c13704e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:17.092818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a73d1-4337-4920-ae76-98d26c13704e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:17.169576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba5f24-f04b-4acc-9628-81512b664d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:17.170212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba5f24-f04b-4acc-9628-81512b664d8d admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:17.170490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba5f24-f04b-4acc-9628-81512b664d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:17.170841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba5f24-f04b-4acc-9628-81512b664d8d admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:17.171549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba5f24-f04b-4acc-9628-81512b664d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:17.173511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba5f24-f04b-4acc-9628-81512b664d8d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:17.202445 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2223/4431] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:20:17 2022] POST /identity/v3/users => generated 311 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:20:17.206682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf3fc4-08fa-43a2-aad6-0acd2fb42161 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:17.222202 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:17.228235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf3fc4-08fa-43a2-aad6-0acd2fb42161 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:17.235506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d48850-706c-4fc3-bd3e-8eced24cd6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:17.236122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d48850-706c-4fc3-bd3e-8eced24cd6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:17.236429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d48850-706c-4fc3-bd3e-8eced24cd6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:17.236724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d48850-706c-4fc3-bd3e-8eced24cd6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:17.237381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d48850-706c-4fc3-bd3e-8eced24cd6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:17.239084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d48850-706c-4fc3-bd3e-8eced24cd6bf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:17.251900 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2209/4432] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:17.256044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba5f24-f04b-4acc-9628-81512b664d8d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:17.267449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba5f24-f04b-4acc-9628-81512b664d8d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:17.272765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd5518-6e98-4c81-9713-0e086d47549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:17.273531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd5518-6e98-4c81-9713-0e086d47549c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:17.273871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd5518-6e98-4c81-9713-0e086d47549c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:17.274204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd5518-6e98-4c81-9713-0e086d47549c admin admin] PATH_INFO: `/v3/projects/3d0ceffb92824ca3a564bb22974af977/users/2d8a9b5ee1d8486aac78a020ada07da1/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:17.291947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd5518-6e98-4c81-9713-0e086d47549c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0ceffb92824ca3a564bb22974af977, user_id=2d8a9b5ee1d8486aac78a020ada07da1, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:17.295525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd5518-6e98-4c81-9713-0e086d47549c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:17.315094 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2224/4433] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:17 2022] PUT /identity/v3/projects/3d0ceffb92824ca3a564bb22974af977/users/2d8a9b5ee1d8486aac78a020ada07da1/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:20:17.318658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d48850-706c-4fc3-bd3e-8eced24cd6bf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:17.331638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d48850-706c-4fc3-bd3e-8eced24cd6bf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:17.463716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7677e-016b-4e9e-97f8-babd44ba727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:17.464383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7677e-016b-4e9e-97f8-babd44ba727f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:17.464679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7677e-016b-4e9e-97f8-babd44ba727f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:17.465093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7677e-016b-4e9e-97f8-babd44ba727f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:17.465941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7677e-016b-4e9e-97f8-babd44ba727f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:17.467702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7677e-016b-4e9e-97f8-babd44ba727f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:17.486413 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2210/4434] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:17.487623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd5518-6e98-4c81-9713-0e086d47549c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:17.502130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd5518-6e98-4c81-9713-0e086d47549c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:17.516258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3614a-ea14-4054-86c0-bad21c26758d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:17.516942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3614a-ea14-4054-86c0-bad21c26758d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:17.517227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3614a-ea14-4054-86c0-bad21c26758d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:17.517485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3614a-ea14-4054-86c0-bad21c26758d admin admin] PATH_INFO: `/v3/projects/3d0ceffb92824ca3a564bb22974af977/users/2d8a9b5ee1d8486aac78a020ada07da1/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:17.519513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3614a-ea14-4054-86c0-bad21c26758d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0ceffb92824ca3a564bb22974af977, user_id=2d8a9b5ee1d8486aac78a020ada07da1, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:17.522835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3614a-ea14-4054-86c0-bad21c26758d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:17.546959 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2225/4435] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:17 2022] PUT /identity/v3/projects/3d0ceffb92824ca3a564bb22974af977/users/2d8a9b5ee1d8486aac78a020ada07da1/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:17.555234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b253573-b186-420e-b774-61b951bf48ae None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:17.555523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b253573-b186-420e-b774-61b951bf48ae None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:17.556438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b253573-b186-420e-b774-61b951bf48ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:17.603931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4b253573-b186-420e-b774-61b951bf48ae None None] MFA Rules not processed for user `2d8a9b5ee1d8486aac78a020ada07da1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:17.605072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4b253573-b186-420e-b774-61b951bf48ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:17.692421 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2211/4436] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:17.703499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3614a-ea14-4054-86c0-bad21c26758d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:17.705260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5be3614a-ea14-4054-86c0-bad21c26758d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:17.791420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3614a-ea14-4054-86c0-bad21c26758d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:17.797337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba501a2-5f47-4944-9c83-f9f4332f745d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:17.798237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba501a2-5f47-4944-9c83-f9f4332f745d service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:17.799233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba501a2-5f47-4944-9c83-f9f4332f745d service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:17.799835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba501a2-5f47-4944-9c83-f9f4332f745d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:17.813490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba501a2-5f47-4944-9c83-f9f4332f745d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:17.815344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba501a2-5f47-4944-9c83-f9f4332f745d service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:17.838489 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2226/4437] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:17 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:20:18.085030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b253573-b186-420e-b774-61b951bf48ae None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:18.109549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b253573-b186-420e-b774-61b951bf48ae None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:18.115621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea19ecf-6b0f-4318-814d-0c07c0b88b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:18.116418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19ecf-6b0f-4318-814d-0c07c0b88b07 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:18.116798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19ecf-6b0f-4318-814d-0c07c0b88b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:18.117173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19ecf-6b0f-4318-814d-0c07c0b88b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:18.336131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea19ecf-6b0f-4318-814d-0c07c0b88b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:18.337575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea19ecf-6b0f-4318-814d-0c07c0b88b07 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:18.367439 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2212/4438] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:18 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:20:24.664086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba501a2-5f47-4944-9c83-f9f4332f745d service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:24.665819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eba501a2-5f47-4944-9c83-f9f4332f745d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:24.755211 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:24.790279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba501a2-5f47-4944-9c83-f9f4332f745d service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:24.812935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea67a7f-8217-4d90-a60d-addfbc7fc09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:24.814014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea67a7f-8217-4d90-a60d-addfbc7fc09b service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:24.814570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea67a7f-8217-4d90-a60d-addfbc7fc09b service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:24.815162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea67a7f-8217-4d90-a60d-addfbc7fc09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:24.817994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0ea67a7f-8217-4d90-a60d-addfbc7fc09b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:24.845863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea67a7f-8217-4d90-a60d-addfbc7fc09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:24.848067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea67a7f-8217-4d90-a60d-addfbc7fc09b service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:24.872009 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2227/4439] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:20:26.672587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4330c-134a-49cf-a139-ad859031f63a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:26.673106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4330c-134a-49cf-a139-ad859031f63a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:26.673190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4330c-134a-49cf-a139-ad859031f63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:26.741722 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:26.765641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-79e4330c-134a-49cf-a139-ad859031f63a None None] MFA Rules not processed for user `9775f23ac7e34bd2ad5bad5a60aa8785`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:26.766862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-79e4330c-134a-49cf-a139-ad859031f63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:26.913558 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2213/4440] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:26.915705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea67a7f-8217-4d90-a60d-addfbc7fc09b service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:26.918376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0ea67a7f-8217-4d90-a60d-addfbc7fc09b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:27.104909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea67a7f-8217-4d90-a60d-addfbc7fc09b service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:27.128927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694d1ec-a858-46f3-9fdd-e0f68dbbda93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:27.129553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694d1ec-a858-46f3-9fdd-e0f68dbbda93 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:27.129834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694d1ec-a858-46f3-9fdd-e0f68dbbda93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:27.130104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694d1ec-a858-46f3-9fdd-e0f68dbbda93 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:27.130737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694d1ec-a858-46f3-9fdd-e0f68dbbda93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:27.132710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694d1ec-a858-46f3-9fdd-e0f68dbbda93 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:27.178459 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2228/4441] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:20:26 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:27.182541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4330c-134a-49cf-a139-ad859031f63a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:27.196650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4330c-134a-49cf-a139-ad859031f63a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:27.217504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f89bd-760c-4ee7-abcc-c746ed94b81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:27.221410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f89bd-760c-4ee7-abcc-c746ed94b81a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:27.222261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f89bd-760c-4ee7-abcc-c746ed94b81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:27.223427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f89bd-760c-4ee7-abcc-c746ed94b81a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:27.226161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f89bd-760c-4ee7-abcc-c746ed94b81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:27.231776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f89bd-760c-4ee7-abcc-c746ed94b81a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:27.257688 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2214/4442] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:27.261061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694d1ec-a858-46f3-9fdd-e0f68dbbda93 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:27.277160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694d1ec-a858-46f3-9fdd-e0f68dbbda93 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:27.289662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f922b-ec94-410c-9f1e-502c410a2fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:27.290425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f922b-ec94-410c-9f1e-502c410a2fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:27.292961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f922b-ec94-410c-9f1e-502c410a2fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:27.293747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f922b-ec94-410c-9f1e-502c410a2fb7 admin admin] PATH_INFO: `/v3/system/users/2fa6e7c2236e4814be84b931b8313ac6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:27.381166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f922b-ec94-410c-9f1e-502c410a2fb7 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2fa6e7c2236e4814be84b931b8313ac6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:27.385961 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-ac8f922b-ec94-410c-9f1e-502c410a2fb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:20:27.385961 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:20:27.385961 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:20:27.387143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f922b-ec94-410c-9f1e-502c410a2fb7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:27.418484 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2229/4443] 10.222.0.39 () {60 vars in 1378 bytes} [Sun Oct 16 01:20:27 2022] PUT /identity/v3/system/users/2fa6e7c2236e4814be84b931b8313ac6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:27.430412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedd2a9-0ace-4ed5-b1b0-bf34512cf99e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:27.430607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedd2a9-0ace-4ed5-b1b0-bf34512cf99e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:27.431134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedd2a9-0ace-4ed5-b1b0-bf34512cf99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:27.519947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-aaedd2a9-0ace-4ed5-b1b0-bf34512cf99e None None] MFA Rules not processed for user `2fa6e7c2236e4814be84b931b8313ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:27.521640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aaedd2a9-0ace-4ed5-b1b0-bf34512cf99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:27.831547 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2215/4444] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:27 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 01:20:27.836042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f922b-ec94-410c-9f1e-502c410a2fb7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:28.019277 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:28.025955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f922b-ec94-410c-9f1e-502c410a2fb7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:28.131348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13ff42-aa8a-4bfe-a36c-3aad90164863 None tempest-ImageQuotaTest-184799849-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa6e7c2236e4814be84b931b8313ac6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:28.132163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13ff42-aa8a-4bfe-a36c-3aad90164863 None tempest-ImageQuotaTest-184799849-system-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:28.132446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13ff42-aa8a-4bfe-a36c-3aad90164863 None tempest-ImageQuotaTest-184799849-system-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:28.133165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13ff42-aa8a-4bfe-a36c-3aad90164863 None tempest-ImageQuotaTest-184799849-system-admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:28.134442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13ff42-aa8a-4bfe-a36c-3aad90164863 None tempest-ImageQuotaTest-184799849-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:28.137108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13ff42-aa8a-4bfe-a36c-3aad90164863 None tempest-ImageQuotaTest-184799849-system-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:28.146562 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2230/4445] 10.222.0.39 () {58 vars in 1110 bytes} [Sun Oct 16 01:20:27 2022] GET /identity/v3/services => generated 2191 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:28.150543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedd2a9-0ace-4ed5-b1b0-bf34512cf99e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:28.319308 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:28.472286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedd2a9-0ace-4ed5-b1b0-bf34512cf99e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:28.576454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a947580-2825-47b7-9a5c-415e9c01cb9d None tempest-ImageQuotaTest-184799849-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa6e7c2236e4814be84b931b8313ac6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:28.577087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a947580-2825-47b7-9a5c-415e9c01cb9d None tempest-ImageQuotaTest-184799849-system-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:28.577360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a947580-2825-47b7-9a5c-415e9c01cb9d None tempest-ImageQuotaTest-184799849-system-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:28.577626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a947580-2825-47b7-9a5c-415e9c01cb9d None tempest-ImageQuotaTest-184799849-system-admin] PATH_INFO: `/v3/limits` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:28.578297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a947580-2825-47b7-9a5c-415e9c01cb9d None tempest-ImageQuotaTest-184799849-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:28.583799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a947580-2825-47b7-9a5c-415e9c01cb9d None tempest-ImageQuotaTest-184799849-system-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-3a947580-2825-47b7-9a5c-415e9c01cb9d None tempest-ImageQuotaTest-184799849-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 16 01:20:28.701946 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 16 01:20:28.702879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:20:28.702879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:20:28.702879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 16 01:20:28.702879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 16 01:20:28.702879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 01:20:28.702879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 01:20:28.702879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 16 01:20:28.702879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 16 01:20:28.702879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 16 01:20:28.702879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 16 01:20:28.702879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 16 01:20:28.702879 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:20:28.703618 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2216/4446] 10.222.0.39 () {60 vars in 1126 bytes} [Sun Oct 16 01:20:28 2022] POST /identity/v3/limits => generated 124 bytes in 553 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:20:28.708769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13ff42-aa8a-4bfe-a36c-3aad90164863 None tempest-ImageQuotaTest-184799849-system-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:29.042143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13ff42-aa8a-4bfe-a36c-3aad90164863 None tempest-ImageQuotaTest-184799849-system-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:29.139755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66841a-46d6-4260-9d9e-a5e000601b12 None tempest-ImageQuotaTest-184799849-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa6e7c2236e4814be84b931b8313ac6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:29.140391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66841a-46d6-4260-9d9e-a5e000601b12 None tempest-ImageQuotaTest-184799849-system-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:29.140667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66841a-46d6-4260-9d9e-a5e000601b12 None tempest-ImageQuotaTest-184799849-system-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:29.140937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66841a-46d6-4260-9d9e-a5e000601b12 None tempest-ImageQuotaTest-184799849-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:29.144950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66841a-46d6-4260-9d9e-a5e000601b12 None tempest-ImageQuotaTest-184799849-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:29.149693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66841a-46d6-4260-9d9e-a5e000601b12 None tempest-ImageQuotaTest-184799849-system-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:29.172179 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2231/4447] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:20:28 2022] GET /identity/v3/registered_limits => generated 129 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:20:29.179231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a947580-2825-47b7-9a5c-415e9c01cb9d None tempest-ImageQuotaTest-184799849-system-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:29.443256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a947580-2825-47b7-9a5c-415e9c01cb9d None tempest-ImageQuotaTest-184799849-system-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:29.463721 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:29.490424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc3762-a94c-4081-9bd3-219b3440bc38 None tempest-ImageQuotaTest-184799849-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa6e7c2236e4814be84b931b8313ac6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:29.491128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc3762-a94c-4081-9bd3-219b3440bc38 None tempest-ImageQuotaTest-184799849-system-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:29.491476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc3762-a94c-4081-9bd3-219b3440bc38 None tempest-ImageQuotaTest-184799849-system-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:29.491817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc3762-a94c-4081-9bd3-219b3440bc38 None tempest-ImageQuotaTest-184799849-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:29.492506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc3762-a94c-4081-9bd3-219b3440bc38 None tempest-ImageQuotaTest-184799849-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:29.493983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc3762-a94c-4081-9bd3-219b3440bc38 None tempest-ImageQuotaTest-184799849-system-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:29.501357 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2217/4448] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:20:29 2022] GET /identity/v3/registered_limits => generated 129 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:20:35.561994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66841a-46d6-4260-9d9e-a5e000601b12 None tempest-ImageQuotaTest-184799849-system-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:35.595256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66841a-46d6-4260-9d9e-a5e000601b12 None tempest-ImageQuotaTest-184799849-system-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:35.603103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:35.603813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:35.604095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:35.604373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] PATH_INFO: `/v3/users/7c4f0c461242436fa97b23c935d1fda1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:35.607378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4f0c461242436fa97b23c935d1fda1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:35.609401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:35.663042 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:35.729438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4f0c461242436fa97b23c935d1fda1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:35.730714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4f0c461242436fa97b23c935d1fda1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:35.756132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4f0c461242436fa97b23c935d1fda1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:35.767360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4f0c461242436fa97b23c935d1fda1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:35.767975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4f0c461242436fa97b23c935d1fda1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:35.793716 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2232/4449] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:20:35 2022] DELETE /identity/v3/users/7c4f0c461242436fa97b23c935d1fda1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:35.795559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88e8b-c911-42a3-8a95-00c26a0e1e5b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:35.796359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88e8b-c911-42a3-8a95-00c26a0e1e5b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:35.796792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88e8b-c911-42a3-8a95-00c26a0e1e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:35.850831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-14a88e8b-c911-42a3-8a95-00c26a0e1e5b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:35.852070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-14a88e8b-c911-42a3-8a95-00c26a0e1e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:36.012282 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2218/4450] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:36.038506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:36.040159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:36.237604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e83b46-bdd6-4131-b564-e77302d6ca40 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:36.251123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5fa58-fc4e-409f-996c-6592157c8ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:36.251969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5fa58-fc4e-409f-996c-6592157c8ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:36.252394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5fa58-fc4e-409f-996c-6592157c8ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:36.252807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5fa58-fc4e-409f-996c-6592157c8ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:36.277378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5fa58-fc4e-409f-996c-6592157c8ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:36.279167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5fa58-fc4e-409f-996c-6592157c8ed9 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:36.304123 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2233/4451] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:20:37.791230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a88e8b-c911-42a3-8a95-00c26a0e1e5b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:37.793283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-14a88e8b-c911-42a3-8a95-00c26a0e1e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:37.816185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a88e8b-c911-42a3-8a95-00c26a0e1e5b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:37.851829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:37.853611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:37.853899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:37.854180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] PATH_INFO: `/v3/projects/21adaf65423045b0b3a65c84b6029812` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:37.856306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] RBAC: Authorizing `identity:delete_project(project_id=21adaf65423045b0b3a65c84b6029812)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:37.858357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:38.003651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21adaf65423045b0b3a65c84b6029812', 'request_id': 'req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:38.018522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21adaf65423045b0b3a65c84b6029812', 'request_id': 'req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:38.045810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21adaf65423045b0b3a65c84b6029812', 'request_id': 'req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:38.074688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] The token cache is being invalidate because project 21adaf65423045b0b3a65c84b6029812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:20:38.076089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:38.077908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:38.094371 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2219/4452] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:20:37 2022] DELETE /identity/v3/projects/21adaf65423045b0b3a65c84b6029812 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:38.097376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5fa58-fc4e-409f-996c-6592157c8ed9 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:38.110754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5fa58-fc4e-409f-996c-6592157c8ed9 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:38.145372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:38.146802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:38.242750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:38.245432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:38.246432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:38.246868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] PATH_INFO: `/v3/users/2d8a9b5ee1d8486aac78a020ada07da1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:38.248697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8a9b5ee1d8486aac78a020ada07da1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:38.253615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:38.281701 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:38.355106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3c4b2-2c8f-403e-a3cf-4ff444cd067f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:38.362162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27705165-fadd-4366-b207-4a37bd8f60ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:38.362960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27705165-fadd-4366-b207-4a37bd8f60ef service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:38.364130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27705165-fadd-4366-b207-4a37bd8f60ef service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:38.364711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27705165-fadd-4366-b207-4a37bd8f60ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:38.367744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-27705165-fadd-4366-b207-4a37bd8f60ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:38.377329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8a9b5ee1d8486aac78a020ada07da1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:38.378265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8a9b5ee1d8486aac78a020ada07da1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:38.380798 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:38.414866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8a9b5ee1d8486aac78a020ada07da1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:38.433139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8a9b5ee1d8486aac78a020ada07da1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:38.434519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8a9b5ee1d8486aac78a020ada07da1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:38.463272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27705165-fadd-4366-b207-4a37bd8f60ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:38.465490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27705165-fadd-4366-b207-4a37bd8f60ef service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:38.471949 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2234/4453] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:20:38 2022] DELETE /identity/v3/users/2d8a9b5ee1d8486aac78a020ada07da1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:20:38.493790 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2220/4454] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:20:39.490891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:39.493191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:39.653868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9b827-dccc-42b1-938b-7daaa7f5e5bc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:39.658858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8e78c-f04b-43b9-8644-3b2dd1d60859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:39.659618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8e78c-f04b-43b9-8644-3b2dd1d60859 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:39.659919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8e78c-f04b-43b9-8644-3b2dd1d60859 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:39.660895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8e78c-f04b-43b9-8644-3b2dd1d60859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:39.663263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1af8e78c-f04b-43b9-8644-3b2dd1d60859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:39.767356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8e78c-f04b-43b9-8644-3b2dd1d60859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:39.769669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8e78c-f04b-43b9-8644-3b2dd1d60859 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:39.784923 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2235/4455] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:20:40.312048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27705165-fadd-4366-b207-4a37bd8f60ef service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:40.313566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-27705165-fadd-4366-b207-4a37bd8f60ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:40.330639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27705165-fadd-4366-b207-4a37bd8f60ef service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:40.476446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:40.480722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:40.481238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:40.482970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] PATH_INFO: `/v3/users/9775f23ac7e34bd2ad5bad5a60aa8785` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:40.485013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9775f23ac7e34bd2ad5bad5a60aa8785)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:40.488784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:40.531377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8e78c-f04b-43b9-8644-3b2dd1d60859 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:40.533964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1af8e78c-f04b-43b9-8644-3b2dd1d60859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:40.581060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8e78c-f04b-43b9-8644-3b2dd1d60859 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:40.593119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:40.594477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:40.594643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:40.594954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] PATH_INFO: `/v3/users/8ab02499c2b64768878fa1d06909e682` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:40.598677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab02499c2b64768878fa1d06909e682)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:40.599304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9775f23ac7e34bd2ad5bad5a60aa8785'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:40.601093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9775f23ac7e34bd2ad5bad5a60aa8785'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:40.617419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:40.630061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9775f23ac7e34bd2ad5bad5a60aa8785'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:40.642593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9775f23ac7e34bd2ad5bad5a60aa8785'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:40.643774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9775f23ac7e34bd2ad5bad5a60aa8785'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:40.660666 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2221/4456] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:20:40 2022] DELETE /identity/v3/users/9775f23ac7e34bd2ad5bad5a60aa8785 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:40.716714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab02499c2b64768878fa1d06909e682'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:40.717411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab02499c2b64768878fa1d06909e682'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:40.740048 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:40.747022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab02499c2b64768878fa1d06909e682'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:40.776857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab02499c2b64768878fa1d06909e682'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:40.780295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab02499c2b64768878fa1d06909e682'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:40.816155 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2236/4457] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:20:40 2022] DELETE /identity/v3/users/8ab02499c2b64768878fa1d06909e682 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:41.064484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:41.066460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:41.073582 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:41.186857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dcf84-0497-48d7-bc07-2500074805bf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:41.245856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:41.247547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:41.360949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:41.362154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:41.362632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:41.363219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] PATH_INFO: `/v3/projects/3d0ceffb92824ca3a564bb22974af977` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:41.364598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d0ceffb92824ca3a564bb22974af977)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:41.366830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:41.461662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1304b7-8319-41c8-b57c-79e496801b92 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:41.461879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d0ceffb92824ca3a564bb22974af977', 'request_id': 'req-0fb02cef-8796-4623-aab0-a3f72199153a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.481040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d0ceffb92824ca3a564bb22974af977', 'request_id': 'req-0fb02cef-8796-4623-aab0-a3f72199153a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.498225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d0ceffb92824ca3a564bb22974af977', 'request_id': 'req-0fb02cef-8796-4623-aab0-a3f72199153a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.515403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] The token cache is being invalidate because project 3d0ceffb92824ca3a564bb22974af977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:20:41.515712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.516351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.519186 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2222/4458] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:20:41 2022] DELETE /identity/v3/projects/3d0ceffb92824ca3a564bb22974af977 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:41.520291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:41.522835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:41.582743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a354c8-8034-40fe-9793-6f12c8ac5478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:41.584932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a354c8-8034-40fe-9793-6f12c8ac5478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:41.586714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a354c8-8034-40fe-9793-6f12c8ac5478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:41.588162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a354c8-8034-40fe-9793-6f12c8ac5478 admin admin] PATH_INFO: `/v3/projects/1ad20c8fe9e54bffbfeffcf7950e132a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:41.591823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a354c8-8034-40fe-9793-6f12c8ac5478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad20c8fe9e54bffbfeffcf7950e132a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:41.594955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a354c8-8034-40fe-9793-6f12c8ac5478 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:41.607326 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:41.654071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb02cef-8796-4623-aab0-a3f72199153a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:41.660484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:41.661143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:41.661421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:41.661692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] PATH_INFO: `/v3/projects/3accb70d34644a70a56bab34c8ef57bf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:41.663620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3accb70d34644a70a56bab34c8ef57bf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:41.671752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:41.737192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-90a354c8-8034-40fe-9793-6f12c8ac5478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad20c8fe9e54bffbfeffcf7950e132a', 'request_id': 'req-90a354c8-8034-40fe-9793-6f12c8ac5478'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.746454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-90a354c8-8034-40fe-9793-6f12c8ac5478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad20c8fe9e54bffbfeffcf7950e132a', 'request_id': 'req-90a354c8-8034-40fe-9793-6f12c8ac5478'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.756816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-90a354c8-8034-40fe-9793-6f12c8ac5478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad20c8fe9e54bffbfeffcf7950e132a', 'request_id': 'req-90a354c8-8034-40fe-9793-6f12c8ac5478'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.772574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3accb70d34644a70a56bab34c8ef57bf', 'request_id': 'req-8b28093e-2fa5-405e-a2f7-848a836a3c59'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.774694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-90a354c8-8034-40fe-9793-6f12c8ac5478 admin admin] The token cache is being invalidate because project 1ad20c8fe9e54bffbfeffcf7950e132a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:20:41.776049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-90a354c8-8034-40fe-9793-6f12c8ac5478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.777029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-90a354c8-8034-40fe-9793-6f12c8ac5478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.781613 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2237/4459] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:20:41 2022] DELETE /identity/v3/projects/1ad20c8fe9e54bffbfeffcf7950e132a => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:41.781613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381aadc-8cf7-4c20-9fa7-fbb1f7d253f6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:41.781897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3accb70d34644a70a56bab34c8ef57bf', 'request_id': 'req-8b28093e-2fa5-405e-a2f7-848a836a3c59'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.781999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381aadc-8cf7-4c20-9fa7-fbb1f7d253f6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:41.781999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381aadc-8cf7-4c20-9fa7-fbb1f7d253f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:41.794839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3accb70d34644a70a56bab34c8ef57bf', 'request_id': 'req-8b28093e-2fa5-405e-a2f7-848a836a3c59'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.809270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c381aadc-8cf7-4c20-9fa7-fbb1f7d253f6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:41.811001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c381aadc-8cf7-4c20-9fa7-fbb1f7d253f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:41.814874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] The token cache is being invalidate because project 3accb70d34644a70a56bab34c8ef57bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:20:41.815217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.817806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:41.820324 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2223/4460] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:20:41 2022] DELETE /identity/v3/projects/3accb70d34644a70a56bab34c8ef57bf => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:41.829680 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:41.834579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:41.842253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:41.896444 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2238/4461] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:41.898275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242416a8-2493-4179-8d2d-9c00358661b7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:41.898667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242416a8-2493-4179-8d2d-9c00358661b7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:41.899080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242416a8-2493-4179-8d2d-9c00358661b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:41.925001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-242416a8-2493-4179-8d2d-9c00358661b7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:41.926409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-242416a8-2493-4179-8d2d-9c00358661b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:41.944480 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2239/4462] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:41.944480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0dd75-f224-4fce-9788-a5b0cef0a19f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:41.944480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0dd75-f224-4fce-9788-a5b0cef0a19f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:41.944480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0dd75-f224-4fce-9788-a5b0cef0a19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:41.966390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28093e-2fa5-405e-a2f7-848a836a3c59 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:41.968187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-09f0dd75-f224-4fce-9788-a5b0cef0a19f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:41.970019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-09f0dd75-f224-4fce-9788-a5b0cef0a19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:41.975892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:41.978038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:41.978335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:41.978610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] PATH_INFO: `/v3/users/2fa6e7c2236e4814be84b931b8313ac6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:41.979819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fa6e7c2236e4814be84b931b8313ac6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:41.981500 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2240/4463] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:41.983016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465609f6-1c8a-4776-ab6b-91e5ef1e0ec5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:41.983527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465609f6-1c8a-4776-ab6b-91e5ef1e0ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:41.984005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465609f6-1c8a-4776-ab6b-91e5ef1e0ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:41.986402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:42.010003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-465609f6-1c8a-4776-ab6b-91e5ef1e0ec5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:42.011346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-465609f6-1c8a-4776-ab6b-91e5ef1e0ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:42.025368 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2241/4464] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:42.026320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465609f6-1c8a-4776-ab6b-91e5ef1e0ec5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:42.039215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465609f6-1c8a-4776-ab6b-91e5ef1e0ec5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:42.046828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dac425-439b-484f-86d7-6430866a1be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:42.046828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dac425-439b-484f-86d7-6430866a1be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.047157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dac425-439b-484f-86d7-6430866a1be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.047244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dac425-439b-484f-86d7-6430866a1be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.048890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dac425-439b-484f-86d7-6430866a1be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:20:42.049300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dac425-439b-484f-86d7-6430866a1be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:42.052908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dac425-439b-484f-86d7-6430866a1be9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:42.077691 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2242/4465] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:20:42.079477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dac425-439b-484f-86d7-6430866a1be9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:42.084199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fa6e7c2236e4814be84b931b8313ac6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:42.084947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fa6e7c2236e4814be84b931b8313ac6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:42.101136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dac425-439b-484f-86d7-6430866a1be9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:42.103709 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:42.105687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fa6e7c2236e4814be84b931b8313ac6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:42.111825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad56e2-8a21-456a-8bca-3066d8673557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:42.113438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad56e2-8a21-456a-8bca-3066d8673557 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.113753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad56e2-8a21-456a-8bca-3066d8673557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.114082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad56e2-8a21-456a-8bca-3066d8673557 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.114839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad56e2-8a21-456a-8bca-3066d8673557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:20:42.115224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad56e2-8a21-456a-8bca-3066d8673557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:42.117595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad56e2-8a21-456a-8bca-3066d8673557 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:42.118486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fa6e7c2236e4814be84b931b8313ac6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:42.119774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fa6e7c2236e4814be84b931b8313ac6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:42.140285 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2243/4466] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:20:42.140285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad56e2-8a21-456a-8bca-3066d8673557 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:42.140939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-82ad56e2-8a21-456a-8bca-3066d8673557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:42.146644 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2224/4467] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:20:41 2022] DELETE /identity/v3/users/2fa6e7c2236e4814be84b931b8313ac6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:42.147744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:42.149416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:42.156716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad56e2-8a21-456a-8bca-3066d8673557 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:42.287981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb72139-54a1-41fe-ad72-7ddcf639a969 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:42.297692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49026e-6598-48cc-a83a-847d8fd3f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:42.298328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49026e-6598-48cc-a83a-847d8fd3f099 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.300437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef05193-457b-4616-9a81-2541d52706e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:42.301183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49026e-6598-48cc-a83a-847d8fd3f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.301474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49026e-6598-48cc-a83a-847d8fd3f099 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.301690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef05193-457b-4616-9a81-2541d52706e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.302146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49026e-6598-48cc-a83a-847d8fd3f099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:42.302377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef05193-457b-4616-9a81-2541d52706e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.302807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef05193-457b-4616-9a81-2541d52706e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.303883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef05193-457b-4616-9a81-2541d52706e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:42.306572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49026e-6598-48cc-a83a-847d8fd3f099 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:42.307093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef05193-457b-4616-9a81-2541d52706e7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:42.356990 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2225/4468] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:20:42 2022] POST /identity/v3/projects => generated 391 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:42.360965 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2244/4469] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:20:42 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:42.361480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49026e-6598-48cc-a83a-847d8fd3f099 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:42.365366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef05193-457b-4616-9a81-2541d52706e7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:42.505869 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:42.512145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49026e-6598-48cc-a83a-847d8fd3f099 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:42.512340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef05193-457b-4616-9a81-2541d52706e7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:42.519909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6a0c3-8e24-4c6c-bb6a-493a9fe13f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:42.521189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6a0c3-8e24-4c6c-bb6a-493a9fe13f35 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.521189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6a0c3-8e24-4c6c-bb6a-493a9fe13f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.521189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6a0c3-8e24-4c6c-bb6a-493a9fe13f35 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.522074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6a0c3-8e24-4c6c-bb6a-493a9fe13f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:42.524571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6a0c3-8e24-4c6c-bb6a-493a9fe13f35 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:42.531314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76811654-189d-44b6-a28b-b4fa44fb7e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:42.531967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76811654-189d-44b6-a28b-b4fa44fb7e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.532347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76811654-189d-44b6-a28b-b4fa44fb7e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.532682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76811654-189d-44b6-a28b-b4fa44fb7e59 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.533401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76811654-189d-44b6-a28b-b4fa44fb7e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:42.536064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76811654-189d-44b6-a28b-b4fa44fb7e59 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:42.566004 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2245/4470] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:20:42 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:42.570084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6a0c3-8e24-4c6c-bb6a-493a9fe13f35 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:42.589295 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2226/4471] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:20:42 2022] POST /identity/v3/users => generated 296 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:42.589569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6a0c3-8e24-4c6c-bb6a-493a9fe13f35 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:42.591090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76811654-189d-44b6-a28b-b4fa44fb7e59 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:42.604460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615c28c-e5ca-428c-a204-8259ca8aadbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:42.605418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615c28c-e5ca-428c-a204-8259ca8aadbe admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.607686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615c28c-e5ca-428c-a204-8259ca8aadbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.608050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615c28c-e5ca-428c-a204-8259ca8aadbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.608802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615c28c-e5ca-428c-a204-8259ca8aadbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:42.610488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615c28c-e5ca-428c-a204-8259ca8aadbe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:42.611271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76811654-189d-44b6-a28b-b4fa44fb7e59 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:42.635047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81952cb7-3449-4fda-84e4-f17c02940bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:42.636779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81952cb7-3449-4fda-84e4-f17c02940bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.637225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81952cb7-3449-4fda-84e4-f17c02940bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.638284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81952cb7-3449-4fda-84e4-f17c02940bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.639153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81952cb7-3449-4fda-84e4-f17c02940bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:42.640776 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2246/4472] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:42.641805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81952cb7-3449-4fda-84e4-f17c02940bb5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:42.643687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615c28c-e5ca-428c-a204-8259ca8aadbe admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:42.656216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615c28c-e5ca-428c-a204-8259ca8aadbe admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:42.665628 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2227/4473] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:42.665852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f999d-47f9-42d0-9fa3-4f0ff5d515fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:42.665852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f999d-47f9-42d0-9fa3-4f0ff5d515fe admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.665852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f999d-47f9-42d0-9fa3-4f0ff5d515fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.665852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f999d-47f9-42d0-9fa3-4f0ff5d515fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.666215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f999d-47f9-42d0-9fa3-4f0ff5d515fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:42.668072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f999d-47f9-42d0-9fa3-4f0ff5d515fe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:42.668381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81952cb7-3449-4fda-84e4-f17c02940bb5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:42.679960 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2247/4474] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:42.684570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81952cb7-3449-4fda-84e4-f17c02940bb5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:42.685095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f999d-47f9-42d0-9fa3-4f0ff5d515fe admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:42.691198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316b5eb-0a56-4cc5-b8d4-7158bb0a4439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:42.691816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b5eb-0a56-4cc5-b8d4-7158bb0a4439 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.692094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b5eb-0a56-4cc5-b8d4-7158bb0a4439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.692368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b5eb-0a56-4cc5-b8d4-7158bb0a4439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.693008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316b5eb-0a56-4cc5-b8d4-7158bb0a4439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:42.695112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316b5eb-0a56-4cc5-b8d4-7158bb0a4439 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:42.698096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f999d-47f9-42d0-9fa3-4f0ff5d515fe admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:42.703553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335c69c-e64c-4b43-a091-411540df3a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:42.704336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c69c-e64c-4b43-a091-411540df3a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.704941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c69c-e64c-4b43-a091-411540df3a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.705317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c69c-e64c-4b43-a091-411540df3a59 admin admin] PATH_INFO: `/v3/projects/7afb716a6c634c18b247d1d0749a70cd/users/300fbec9d5cb41de9a36adad1056bc68/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.711242 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2228/4475] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:42.715772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316b5eb-0a56-4cc5-b8d4-7158bb0a4439 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:42.729397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316b5eb-0a56-4cc5-b8d4-7158bb0a4439 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:42.739513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335c69c-e64c-4b43-a091-411540df3a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7afb716a6c634c18b247d1d0749a70cd, user_id=300fbec9d5cb41de9a36adad1056bc68, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:42.743244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335c69c-e64c-4b43-a091-411540df3a59 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:42.757144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b3f69-15a8-4d59-8bdb-68df13c96177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:42.758218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b3f69-15a8-4d59-8bdb-68df13c96177 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.760666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b3f69-15a8-4d59-8bdb-68df13c96177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.761081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b3f69-15a8-4d59-8bdb-68df13c96177 admin admin] PATH_INFO: `/v3/projects/07213ca67c6a4616babc77d721d2cae5/users/7e7cdaa2d85d4ce698950075b98d5eb8/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.783022 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2248/4476] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:42 2022] PUT /identity/v3/projects/7afb716a6c634c18b247d1d0749a70cd/users/300fbec9d5cb41de9a36adad1056bc68/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:42.785718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fcac9-a05e-4449-a4a9-104c3770bdcd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.786011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fcac9-a05e-4449-a4a9-104c3770bdcd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.786430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fcac9-a05e-4449-a4a9-104c3770bdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.799878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b3f69-15a8-4d59-8bdb-68df13c96177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07213ca67c6a4616babc77d721d2cae5, user_id=7e7cdaa2d85d4ce698950075b98d5eb8, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:42.802783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b3f69-15a8-4d59-8bdb-68df13c96177 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:42.826386 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2229/4477] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:42 2022] PUT /identity/v3/projects/07213ca67c6a4616babc77d721d2cae5/users/7e7cdaa2d85d4ce698950075b98d5eb8/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:42.834275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca16dd-3981-431d-8f4c-04987eecc968 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:42.834636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca16dd-3981-431d-8f4c-04987eecc968 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:42.835584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca16dd-3981-431d-8f4c-04987eecc968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:42.885201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-af6fcac9-a05e-4449-a4a9-104c3770bdcd None None] MFA Rules not processed for user `300fbec9d5cb41de9a36adad1056bc68`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:42.888594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0eca16dd-3981-431d-8f4c-04987eecc968 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:42.890155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0eca16dd-3981-431d-8f4c-04987eecc968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:42.891591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-af6fcac9-a05e-4449-a4a9-104c3770bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:42.894961 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:43.049934 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2230/4478] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:20:43.086108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca16dd-3981-431d-8f4c-04987eecc968 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:43.087163 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2249/4479] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:43.089208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0eca16dd-3981-431d-8f4c-04987eecc968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:43.091664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fcac9-a05e-4449-a4a9-104c3770bdcd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:43.119109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fcac9-a05e-4449-a4a9-104c3770bdcd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:43.136778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5197d-cc8b-4591-8590-f9bfa68236c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:43.137499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5197d-cc8b-4591-8590-f9bfa68236c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:43.137887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5197d-cc8b-4591-8590-f9bfa68236c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:43.138226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5197d-cc8b-4591-8590-f9bfa68236c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:43.138953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5197d-cc8b-4591-8590-f9bfa68236c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:43.142500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5197d-cc8b-4591-8590-f9bfa68236c1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:43.202190 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2250/4480] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:20:43 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:43.205247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5197d-cc8b-4591-8590-f9bfa68236c1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:43.244931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca16dd-3981-431d-8f4c-04987eecc968 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:43.335532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f13bb-a7a8-41f2-b81f-8055d3a00e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:43.336146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f13bb-a7a8-41f2-b81f-8055d3a00e62 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:43.336426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f13bb-a7a8-41f2-b81f-8055d3a00e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:43.336697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f13bb-a7a8-41f2-b81f-8055d3a00e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:43.359227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5197d-cc8b-4591-8590-f9bfa68236c1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:43.381049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf7a1a-6c04-4d88-a1cd-115694672039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:43.381685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf7a1a-6c04-4d88-a1cd-115694672039 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:43.382150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf7a1a-6c04-4d88-a1cd-115694672039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:43.382541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf7a1a-6c04-4d88-a1cd-115694672039 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:43.383339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf7a1a-6c04-4d88-a1cd-115694672039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:43.385372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf7a1a-6c04-4d88-a1cd-115694672039 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:43.410400 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:43.430023 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2251/4481] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:20:43 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:43.432807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf7a1a-6c04-4d88-a1cd-115694672039 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:43.447361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf7a1a-6c04-4d88-a1cd-115694672039 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:43.452468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2696ba-c5fc-4fde-b298-abc196c691a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:43.453211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2696ba-c5fc-4fde-b298-abc196c691a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:43.453584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2696ba-c5fc-4fde-b298-abc196c691a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:43.453952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2696ba-c5fc-4fde-b298-abc196c691a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:43.455422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2696ba-c5fc-4fde-b298-abc196c691a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:43.457148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2696ba-c5fc-4fde-b298-abc196c691a6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:43.469484 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2252/4482] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:43.474876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2696ba-c5fc-4fde-b298-abc196c691a6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:43.489914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2696ba-c5fc-4fde-b298-abc196c691a6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:43.490499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f13bb-a7a8-41f2-b81f-8055d3a00e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:43.492025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f13bb-a7a8-41f2-b81f-8055d3a00e62 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:43.500839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee75ac3-14f1-43db-92cb-b382dc65b336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:43.501535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75ac3-14f1-43db-92cb-b382dc65b336 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:43.501892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75ac3-14f1-43db-92cb-b382dc65b336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:43.502247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75ac3-14f1-43db-92cb-b382dc65b336 admin admin] PATH_INFO: `/v3/projects/7270f1c1259f4fb3a8f80f03a9e74bb8/users/8d3029e9d5544e4680494c84ab2c03a4/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:43.519283 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2231/4483] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:20:43.524946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee75ac3-14f1-43db-92cb-b382dc65b336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7270f1c1259f4fb3a8f80f03a9e74bb8, user_id=8d3029e9d5544e4680494c84ab2c03a4, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:43.530453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee75ac3-14f1-43db-92cb-b382dc65b336 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:43.566607 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2253/4484] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:43 2022] PUT /identity/v3/projects/7270f1c1259f4fb3a8f80f03a9e74bb8/users/8d3029e9d5544e4680494c84ab2c03a4/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:43.571430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f13bb-a7a8-41f2-b81f-8055d3a00e62 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:43.583898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f13bb-a7a8-41f2-b81f-8055d3a00e62 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:43.612463 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:43.691485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfb4b8-7692-4490-b0f2-d564a3db9c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:43.692244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfb4b8-7692-4490-b0f2-d564a3db9c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:43.692620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfb4b8-7692-4490-b0f2-d564a3db9c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:43.692987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfb4b8-7692-4490-b0f2-d564a3db9c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:43.693720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfb4b8-7692-4490-b0f2-d564a3db9c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:43.695539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfb4b8-7692-4490-b0f2-d564a3db9c5c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:43.710604 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2232/4485] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:43.714424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee75ac3-14f1-43db-92cb-b382dc65b336 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:43.746506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee75ac3-14f1-43db-92cb-b382dc65b336 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:43.753932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a31535-6f3a-4152-8824-413e57ae3194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:43.754697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31535-6f3a-4152-8824-413e57ae3194 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:43.755071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31535-6f3a-4152-8824-413e57ae3194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:43.755358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31535-6f3a-4152-8824-413e57ae3194 admin admin] PATH_INFO: `/v3/projects/7270f1c1259f4fb3a8f80f03a9e74bb8/users/8d3029e9d5544e4680494c84ab2c03a4/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:43.757488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a31535-6f3a-4152-8824-413e57ae3194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7270f1c1259f4fb3a8f80f03a9e74bb8, user_id=8d3029e9d5544e4680494c84ab2c03a4, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:43.763897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a31535-6f3a-4152-8824-413e57ae3194 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:43.803798 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2254/4486] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:43 2022] PUT /identity/v3/projects/7270f1c1259f4fb3a8f80f03a9e74bb8/users/8d3029e9d5544e4680494c84ab2c03a4/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:20:43.807482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ad482-5fa9-4830-961a-d909f3dfcc84 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:43.807772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ad482-5fa9-4830-961a-d909f3dfcc84 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:43.808304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ad482-5fa9-4830-961a-d909f3dfcc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:43.884614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ac6ad482-5fa9-4830-961a-d909f3dfcc84 None None] MFA Rules not processed for user `8d3029e9d5544e4680494c84ab2c03a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:43.888341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ac6ad482-5fa9-4830-961a-d909f3dfcc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:44.120482 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2233/4487] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:44.129881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a31535-6f3a-4152-8824-413e57ae3194 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:44.132492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e7a31535-6f3a-4152-8824-413e57ae3194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:44.238689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a31535-6f3a-4152-8824-413e57ae3194 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:44.245581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a176f-bc68-42fc-bd77-a7af69e4fd14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:44.246457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a176f-bc68-42fc-bd77-a7af69e4fd14 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:44.246902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a176f-bc68-42fc-bd77-a7af69e4fd14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:44.247404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a176f-bc68-42fc-bd77-a7af69e4fd14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:44.356015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a176f-bc68-42fc-bd77-a7af69e4fd14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:44.358036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a176f-bc68-42fc-bd77-a7af69e4fd14 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:44.393063 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2255/4488] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:20:46.978157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41110-aa88-40bc-bbf9-dd619de59d20 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:46.978697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41110-aa88-40bc-bbf9-dd619de59d20 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:46.978782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41110-aa88-40bc-bbf9-dd619de59d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:47.021738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dcc41110-aa88-40bc-bbf9-dd619de59d20 None None] MFA Rules not processed for user `d5e97960c4eb488b900951e0898f34c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:47.025681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dcc41110-aa88-40bc-bbf9-dd619de59d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:47.159909 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2234/4489] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:50.943091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a176f-bc68-42fc-bd77-a7af69e4fd14 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:51.158509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a176f-bc68-42fc-bd77-a7af69e4fd14 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:51.178299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b5888-01f4-43a5-b1ac-10a5d4557721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:51.180672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b5888-01f4-43a5-b1ac-10a5d4557721 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:51.180958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b5888-01f4-43a5-b1ac-10a5d4557721 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:51.181238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b5888-01f4-43a5-b1ac-10a5d4557721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:51.186080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2f4b5888-01f4-43a5-b1ac-10a5d4557721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:51.251906 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:51.453297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b5888-01f4-43a5-b1ac-10a5d4557721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:51.475563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b5888-01f4-43a5-b1ac-10a5d4557721 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:51.512974 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2256/4490] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:20:53.494113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc41110-aa88-40bc-bbf9-dd619de59d20 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:53.496771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dcc41110-aa88-40bc-bbf9-dd619de59d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:53.514820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc41110-aa88-40bc-bbf9-dd619de59d20 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:53.519963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d575d2-098d-44d2-8dae-6fe16de19135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:53.520611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d575d2-098d-44d2-8dae-6fe16de19135 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:53.520907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d575d2-098d-44d2-8dae-6fe16de19135 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:53.521222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d575d2-098d-44d2-8dae-6fe16de19135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:53.536678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d575d2-098d-44d2-8dae-6fe16de19135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:53.538613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d575d2-098d-44d2-8dae-6fe16de19135 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:53.568038 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2235/4491] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:20:53.980771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b5888-01f4-43a5-b1ac-10a5d4557721 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:53.984906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2f4b5888-01f4-43a5-b1ac-10a5d4557721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:54.021055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b5888-01f4-43a5-b1ac-10a5d4557721 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:54.033500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:54.037210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:54.037702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:54.038184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] PATH_INFO: `/v3/users/d5e73ffbd1e84f3a9d1bc147f47b3abe` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:54.042357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e73ffbd1e84f3a9d1bc147f47b3abe)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:54.046697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:54.159822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e73ffbd1e84f3a9d1bc147f47b3abe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:54.161679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e73ffbd1e84f3a9d1bc147f47b3abe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:54.191312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e73ffbd1e84f3a9d1bc147f47b3abe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:54.204920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e73ffbd1e84f3a9d1bc147f47b3abe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:54.206030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e73ffbd1e84f3a9d1bc147f47b3abe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:54.236877 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2257/4492] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:20:53 2022] DELETE /identity/v3/users/d5e73ffbd1e84f3a9d1bc147f47b3abe => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:54.669261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d575d2-098d-44d2-8dae-6fe16de19135 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:54.670693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f4d575d2-098d-44d2-8dae-6fe16de19135 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:54.684388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d575d2-098d-44d2-8dae-6fe16de19135 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:54.712925 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:54.743451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e21f91-a101-41dc-a622-0a88517c56e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:54.744521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21f91-a101-41dc-a622-0a88517c56e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:54.747127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21f91-a101-41dc-a622-0a88517c56e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:54.748022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21f91-a101-41dc-a622-0a88517c56e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:54.750251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-65e21f91-a101-41dc-a622-0a88517c56e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:54.761648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e21f91-a101-41dc-a622-0a88517c56e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:54.763125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e21f91-a101-41dc-a622-0a88517c56e6 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:54.773210 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2236/4493] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:20:55.414748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:55.416281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:55.570235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e21f91-a101-41dc-a622-0a88517c56e6 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:55.571768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-65e21f91-a101-41dc-a622-0a88517c56e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:55.595177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d89132-1e36-4e6d-b4b1-520aeafe352c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:55.600824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a38dd-c4ff-43a3-ad7f-6f744645774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:55.601772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a38dd-c4ff-43a3-ad7f-6f744645774c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:55.602560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a38dd-c4ff-43a3-ad7f-6f744645774c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:55.603071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a38dd-c4ff-43a3-ad7f-6f744645774c admin admin] PATH_INFO: `/v3/users/1cf0ec54a3f54abd90ece8de2aa70ffc` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:55.603859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e21f91-a101-41dc-a622-0a88517c56e6 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:55.606821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a38dd-c4ff-43a3-ad7f-6f744645774c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf0ec54a3f54abd90ece8de2aa70ffc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:55.609482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a38dd-c4ff-43a3-ad7f-6f744645774c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:55.613681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c1565-25fd-4a41-8809-1a85f1ff9df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:55.614506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c1565-25fd-4a41-8809-1a85f1ff9df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:55.614832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c1565-25fd-4a41-8809-1a85f1ff9df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:55.615171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c1565-25fd-4a41-8809-1a85f1ff9df8 admin admin] PATH_INFO: `/v3/projects/0426937b803f46279c2cb410ba6c5de4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:55.616695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c1565-25fd-4a41-8809-1a85f1ff9df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0426937b803f46279c2cb410ba6c5de4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:55.619131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c1565-25fd-4a41-8809-1a85f1ff9df8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:55.656910 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:55.709074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-700a38dd-c4ff-43a3-ad7f-6f744645774c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf0ec54a3f54abd90ece8de2aa70ffc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:55.709924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-700a38dd-c4ff-43a3-ad7f-6f744645774c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf0ec54a3f54abd90ece8de2aa70ffc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:55.722313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-901c1565-25fd-4a41-8809-1a85f1ff9df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0426937b803f46279c2cb410ba6c5de4', 'request_id': 'req-901c1565-25fd-4a41-8809-1a85f1ff9df8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:55.725628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-700a38dd-c4ff-43a3-ad7f-6f744645774c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf0ec54a3f54abd90ece8de2aa70ffc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:55.730471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-901c1565-25fd-4a41-8809-1a85f1ff9df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0426937b803f46279c2cb410ba6c5de4', 'request_id': 'req-901c1565-25fd-4a41-8809-1a85f1ff9df8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:55.746810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-700a38dd-c4ff-43a3-ad7f-6f744645774c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf0ec54a3f54abd90ece8de2aa70ffc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:55.746810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-700a38dd-c4ff-43a3-ad7f-6f744645774c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf0ec54a3f54abd90ece8de2aa70ffc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:55.755938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-901c1565-25fd-4a41-8809-1a85f1ff9df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0426937b803f46279c2cb410ba6c5de4', 'request_id': 'req-901c1565-25fd-4a41-8809-1a85f1ff9df8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:55.767515 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2258/4494] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:20:55 2022] DELETE /identity/v3/users/1cf0ec54a3f54abd90ece8de2aa70ffc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:55.775836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-901c1565-25fd-4a41-8809-1a85f1ff9df8 admin admin] The token cache is being invalidate because project 0426937b803f46279c2cb410ba6c5de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:20:55.776111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-901c1565-25fd-4a41-8809-1a85f1ff9df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:55.777532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-901c1565-25fd-4a41-8809-1a85f1ff9df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:55.779333 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2237/4495] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:20:55 2022] DELETE /identity/v3/projects/0426937b803f46279c2cb410ba6c5de4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:20:55.784042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a047786-2c72-4c4e-8be1-d84bccfe14e8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:55.784325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a047786-2c72-4c4e-8be1-d84bccfe14e8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:55.784610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a047786-2c72-4c4e-8be1-d84bccfe14e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:55.805727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3a047786-2c72-4c4e-8be1-d84bccfe14e8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:55.807014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3a047786-2c72-4c4e-8be1-d84bccfe14e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:55.882330 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2259/4496] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:55.905966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6114fa-a0cf-454e-8616-1b35a41de986 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:55.910661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6114fa-a0cf-454e-8616-1b35a41de986 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:55.911164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6114fa-a0cf-454e-8616-1b35a41de986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:55.978445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ad6114fa-a0cf-454e-8616-1b35a41de986 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:55.979880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ad6114fa-a0cf-454e-8616-1b35a41de986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:56.004487 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2238/4497] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:56.011628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a047786-2c72-4c4e-8be1-d84bccfe14e8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:56.025437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a047786-2c72-4c4e-8be1-d84bccfe14e8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:56.032245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091bb88-4e98-4f7f-94ce-f2a75827a47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:56.032977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091bb88-4e98-4f7f-94ce-f2a75827a47d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:56.033312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091bb88-4e98-4f7f-94ce-f2a75827a47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:56.033658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091bb88-4e98-4f7f-94ce-f2a75827a47d admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:56.034227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091bb88-4e98-4f7f-94ce-f2a75827a47d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:20:56.034528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091bb88-4e98-4f7f-94ce-f2a75827a47d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:56.036236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091bb88-4e98-4f7f-94ce-f2a75827a47d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:56.051190 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2260/4498] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:20:56.057506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6114fa-a0cf-454e-8616-1b35a41de986 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:56.071443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6114fa-a0cf-454e-8616-1b35a41de986 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:56.087557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bb126-3d0a-4c82-bcb2-8a52ef338d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:56.088717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bb126-3d0a-4c82-bcb2-8a52ef338d88 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:56.088717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bb126-3d0a-4c82-bcb2-8a52ef338d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:56.089363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bb126-3d0a-4c82-bcb2-8a52ef338d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:56.090567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bb126-3d0a-4c82-bcb2-8a52ef338d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:56.093220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bb126-3d0a-4c82-bcb2-8a52ef338d88 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:56.150504 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2239/4499] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:20:56 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:56.156711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091bb88-4e98-4f7f-94ce-f2a75827a47d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:56.170895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091bb88-4e98-4f7f-94ce-f2a75827a47d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:56.302536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c1e97-0e20-4e59-94d3-b0df47607f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:56.303205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1e97-0e20-4e59-94d3-b0df47607f24 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:56.303732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1e97-0e20-4e59-94d3-b0df47607f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:56.304015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1e97-0e20-4e59-94d3-b0df47607f24 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:56.304655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c1e97-0e20-4e59-94d3-b0df47607f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:56.306593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c1e97-0e20-4e59-94d3-b0df47607f24 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:56.360734 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2261/4500] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:20:56 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:56.362024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bb126-3d0a-4c82-bcb2-8a52ef338d88 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:56.363432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c1e97-0e20-4e59-94d3-b0df47607f24 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:56.367357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c91c1e97-0e20-4e59-94d3-b0df47607f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:56.384671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bb126-3d0a-4c82-bcb2-8a52ef338d88 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:56.394492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f37955-2ac9-49fc-85e6-be8627bbef25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:56.395322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f37955-2ac9-49fc-85e6-be8627bbef25 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:56.395608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f37955-2ac9-49fc-85e6-be8627bbef25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:56.395883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f37955-2ac9-49fc-85e6-be8627bbef25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:56.396553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f37955-2ac9-49fc-85e6-be8627bbef25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:56.398401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f37955-2ac9-49fc-85e6-be8627bbef25 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:56.398714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c1e97-0e20-4e59-94d3-b0df47607f24 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:56.405844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b725cdc-c5ff-4002-8483-7090de4a602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:56.406662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b725cdc-c5ff-4002-8483-7090de4a602b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:56.407096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b725cdc-c5ff-4002-8483-7090de4a602b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:56.407468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b725cdc-c5ff-4002-8483-7090de4a602b admin admin] PATH_INFO: `/v3/projects/1d22602edce34f6390374c40afcfd113` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:56.408803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b725cdc-c5ff-4002-8483-7090de4a602b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d22602edce34f6390374c40afcfd113)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:56.411997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b725cdc-c5ff-4002-8483-7090de4a602b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:56.440399 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:56.445427 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2240/4501] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:56.457860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f37955-2ac9-49fc-85e6-be8627bbef25 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:56.494042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f37955-2ac9-49fc-85e6-be8627bbef25 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:56.529994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7b725cdc-c5ff-4002-8483-7090de4a602b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d22602edce34f6390374c40afcfd113', 'request_id': 'req-7b725cdc-c5ff-4002-8483-7090de4a602b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:56.550080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7b725cdc-c5ff-4002-8483-7090de4a602b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d22602edce34f6390374c40afcfd113', 'request_id': 'req-7b725cdc-c5ff-4002-8483-7090de4a602b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:56.570336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7b725cdc-c5ff-4002-8483-7090de4a602b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d22602edce34f6390374c40afcfd113', 'request_id': 'req-7b725cdc-c5ff-4002-8483-7090de4a602b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:56.586285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7b725cdc-c5ff-4002-8483-7090de4a602b admin admin] The token cache is being invalidate because project 1d22602edce34f6390374c40afcfd113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:20:56.586785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7b725cdc-c5ff-4002-8483-7090de4a602b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:56.587829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7b725cdc-c5ff-4002-8483-7090de4a602b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:20:56.595649 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2262/4502] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:20:56 2022] DELETE /identity/v3/projects/1d22602edce34f6390374c40afcfd113 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:56.601057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c984a6-94fd-4cdc-8a04-4dcba0fe1a83 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:56.601553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c984a6-94fd-4cdc-8a04-4dcba0fe1a83 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:56.602004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c984a6-94fd-4cdc-8a04-4dcba0fe1a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:56.633114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835e51b-bb96-4623-ad32-30b55dc8fc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:56.634281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835e51b-bb96-4623-ad32-30b55dc8fc1f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:56.634791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835e51b-bb96-4623-ad32-30b55dc8fc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:56.642949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835e51b-bb96-4623-ad32-30b55dc8fc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:56.645898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-63c984a6-94fd-4cdc-8a04-4dcba0fe1a83 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:56.647320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-63c984a6-94fd-4cdc-8a04-4dcba0fe1a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:56.647930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835e51b-bb96-4623-ad32-30b55dc8fc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:56.654152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835e51b-bb96-4623-ad32-30b55dc8fc1f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:56.669939 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2263/4503] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:56.674838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814ef8-2f4f-41c8-9d24-cab87dba94ab None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:56.675171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814ef8-2f4f-41c8-9d24-cab87dba94ab None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:56.675446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814ef8-2f4f-41c8-9d24-cab87dba94ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:56.689148 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2241/4504] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:56.695464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835e51b-bb96-4623-ad32-30b55dc8fc1f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:56.698621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4835e51b-bb96-4623-ad32-30b55dc8fc1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:56.710377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a4814ef8-2f4f-41c8-9d24-cab87dba94ab None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:56.711695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a4814ef8-2f4f-41c8-9d24-cab87dba94ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:56.723581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835e51b-bb96-4623-ad32-30b55dc8fc1f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:56.725123 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2264/4505] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:56.728658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4814ef8-2f4f-41c8-9d24-cab87dba94ab None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:56.743173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba276a-2205-4f95-a0a4-9c46fc32cc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:56.744053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba276a-2205-4f95-a0a4-9c46fc32cc42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:56.744198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba276a-2205-4f95-a0a4-9c46fc32cc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:56.744398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba276a-2205-4f95-a0a4-9c46fc32cc42 admin admin] PATH_INFO: `/v3/projects/46e1305700024ba791659001cdce0542/users/0de7257c0cb54a7cb3d55edbeec5682a/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:56.747811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4814ef8-2f4f-41c8-9d24-cab87dba94ab None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:56.762360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f0570-a49c-407d-9494-79293aa3de38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:56.763017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f0570-a49c-407d-9494-79293aa3de38 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:56.763299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f0570-a49c-407d-9494-79293aa3de38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:56.763571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f0570-a49c-407d-9494-79293aa3de38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:56.764285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f0570-a49c-407d-9494-79293aa3de38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:20:56.764590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f0570-a49c-407d-9494-79293aa3de38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:56.766795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f0570-a49c-407d-9494-79293aa3de38 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:56.785405 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:56.805859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba276a-2205-4f95-a0a4-9c46fc32cc42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e1305700024ba791659001cdce0542, user_id=0de7257c0cb54a7cb3d55edbeec5682a, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:56.814817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba276a-2205-4f95-a0a4-9c46fc32cc42 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:56.815595 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2265/4506] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:20:56.820341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f0570-a49c-407d-9494-79293aa3de38 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:56.852042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f0570-a49c-407d-9494-79293aa3de38 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:56.887067 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2242/4507] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:56 2022] PUT /identity/v3/projects/46e1305700024ba791659001cdce0542/users/0de7257c0cb54a7cb3d55edbeec5682a/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:20:56.892407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50fd0-c999-473c-97ae-70d0dadb38ca None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:56.896494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50fd0-c999-473c-97ae-70d0dadb38ca None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:56.897547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50fd0-c999-473c-97ae-70d0dadb38ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:56.965556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ccd50fd0-c999-473c-97ae-70d0dadb38ca None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:56.972906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ccd50fd0-c999-473c-97ae-70d0dadb38ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:57.050398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b0d75-1044-42d0-9980-de4496a66ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:57.051250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b0d75-1044-42d0-9980-de4496a66ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:57.051578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b0d75-1044-42d0-9980-de4496a66ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:57.051951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b0d75-1044-42d0-9980-de4496a66ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:57.052699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b0d75-1044-42d0-9980-de4496a66ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:57.054995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b0d75-1044-42d0-9980-de4496a66ee2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:57.103082 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2243/4508] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:57.114481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd50fd0-c999-473c-97ae-70d0dadb38ca None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:57.115362 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2266/4509] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:20:56 2022] POST /identity/v3/projects => generated 377 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:20:57.125738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd50fd0-c999-473c-97ae-70d0dadb38ca None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:57.137932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b0d75-1044-42d0-9980-de4496a66ee2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:57.139710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d29b0d75-1044-42d0-9980-de4496a66ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:57.200785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cba6ec-ece0-4740-a407-23fdc185b5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:57.201436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cba6ec-ece0-4740-a407-23fdc185b5ef admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:57.201713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cba6ec-ece0-4740-a407-23fdc185b5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:57.201981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cba6ec-ece0-4740-a407-23fdc185b5ef admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:57.202606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cba6ec-ece0-4740-a407-23fdc185b5ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:57.204950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cba6ec-ece0-4740-a407-23fdc185b5ef admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:57.215335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b0d75-1044-42d0-9980-de4496a66ee2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:57.220206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6736eba-30cd-4425-96f6-39142484f1f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:57.221131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736eba-30cd-4425-96f6-39142484f1f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:57.221432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736eba-30cd-4425-96f6-39142484f1f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:57.221729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736eba-30cd-4425-96f6-39142484f1f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:57.233935 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2244/4510] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:20:57 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:20:57.239097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cba6ec-ece0-4740-a407-23fdc185b5ef admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:57.240958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6736eba-30cd-4425-96f6-39142484f1f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:57.242494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6736eba-30cd-4425-96f6-39142484f1f9 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:57.259169 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2267/4511] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:20:57.262025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cba6ec-ece0-4740-a407-23fdc185b5ef admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:57.278909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9eefeb-9765-485d-b6c2-0a5e911f3bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:57.280111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eefeb-9765-485d-b6c2-0a5e911f3bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:57.280858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eefeb-9765-485d-b6c2-0a5e911f3bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:57.282987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eefeb-9765-485d-b6c2-0a5e911f3bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:57.284264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9eefeb-9765-485d-b6c2-0a5e911f3bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:57.287248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9eefeb-9765-485d-b6c2-0a5e911f3bf9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:57.322192 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2245/4512] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:20:57.328679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6736eba-30cd-4425-96f6-39142484f1f9 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:57.340399 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:57.347400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6736eba-30cd-4425-96f6-39142484f1f9 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:57.361282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca1c8c-5e99-43a6-8bcb-6b21ae20a6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:57.363295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca1c8c-5e99-43a6-8bcb-6b21ae20a6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:57.363539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca1c8c-5e99-43a6-8bcb-6b21ae20a6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:57.363813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca1c8c-5e99-43a6-8bcb-6b21ae20a6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:57.364457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca1c8c-5e99-43a6-8bcb-6b21ae20a6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:57.370763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca1c8c-5e99-43a6-8bcb-6b21ae20a6f1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:57.396752 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2268/4513] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:20:57.403492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9eefeb-9765-485d-b6c2-0a5e911f3bf9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:57.425708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9eefeb-9765-485d-b6c2-0a5e911f3bf9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:57.438081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b19e59-6094-452b-8eb5-09a9d851fa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:57.438969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b19e59-6094-452b-8eb5-09a9d851fa9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:57.441013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b19e59-6094-452b-8eb5-09a9d851fa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:57.441373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b19e59-6094-452b-8eb5-09a9d851fa9a admin admin] PATH_INFO: `/v3/projects/b0304839bb0f444a9786183ba8b4e446/users/a3ac1408c91c4db59f4639abdca2c98f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:57.486382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b19e59-6094-452b-8eb5-09a9d851fa9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0304839bb0f444a9786183ba8b4e446, user_id=a3ac1408c91c4db59f4639abdca2c98f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:57.491371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b19e59-6094-452b-8eb5-09a9d851fa9a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:57.525303 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2246/4514] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:20:57 2022] PUT /identity/v3/projects/b0304839bb0f444a9786183ba8b4e446/users/a3ac1408c91c4db59f4639abdca2c98f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:20:57.532267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07bd66-6377-469b-bcab-650455785255 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:57.533019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07bd66-6377-469b-bcab-650455785255 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:57.533218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07bd66-6377-469b-bcab-650455785255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:57.599182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4b07bd66-6377-469b-bcab-650455785255 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:20:57.601097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4b07bd66-6377-469b-bcab-650455785255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:20:57.890160 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2269/4515] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:20:58.015497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b19e59-6094-452b-8eb5-09a9d851fa9a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:20:58.101273 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:58.124309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b19e59-6094-452b-8eb5-09a9d851fa9a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:20:58.130623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65df1f8-b95c-4887-90c1-8e364070c13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:20:58.131583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65df1f8-b95c-4887-90c1-8e364070c13f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:20:58.132027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65df1f8-b95c-4887-90c1-8e364070c13f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:20:58.133559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65df1f8-b95c-4887-90c1-8e364070c13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:20:58.158664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65df1f8-b95c-4887-90c1-8e364070c13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:20:58.160166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65df1f8-b95c-4887-90c1-8e364070c13f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:20:58.195985 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2247/4516] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:03.940891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b55d77-4020-48bd-a27d-b1cfc53e67b3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:03.941356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b55d77-4020-48bd-a27d-b1cfc53e67b3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:03.941465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b55d77-4020-48bd-a27d-b1cfc53e67b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:04.028246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-55b55d77-4020-48bd-a27d-b1cfc53e67b3 None None] MFA Rules not processed for user `7e7cdaa2d85d4ce698950075b98d5eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:04.029661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-55b55d77-4020-48bd-a27d-b1cfc53e67b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:04.192105 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2270/4517] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:04.202752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be47e85-b581-421f-820a-3412f4102c36 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:04.203314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be47e85-b581-421f-820a-3412f4102c36 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:04.203426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be47e85-b581-421f-820a-3412f4102c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:04.241967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0be47e85-b581-421f-820a-3412f4102c36 None None] MFA Rules not processed for user `7e7cdaa2d85d4ce698950075b98d5eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:04.243279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0be47e85-b581-421f-820a-3412f4102c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:04.262775 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2248/4518] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:04.274642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b55d77-4020-48bd-a27d-b1cfc53e67b3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:04.276075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-55b55d77-4020-48bd-a27d-b1cfc53e67b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:04.467775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b55d77-4020-48bd-a27d-b1cfc53e67b3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:04.493938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108a71e-48ea-4f50-8551-3fa71bc2226d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:04.494570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108a71e-48ea-4f50-8551-3fa71bc2226d service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:04.494843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108a71e-48ea-4f50-8551-3fa71bc2226d service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:04.495179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108a71e-48ea-4f50-8551-3fa71bc2226d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:04.524881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108a71e-48ea-4f50-8551-3fa71bc2226d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:04.526567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108a71e-48ea-4f50-8551-3fa71bc2226d service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:04.561421 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2271/4519] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:07.967615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e51a8-eb90-413e-9888-d67bec06eed7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:07.968180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e51a8-eb90-413e-9888-d67bec06eed7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:07.968266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e51a8-eb90-413e-9888-d67bec06eed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:08.079320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2b5e51a8-eb90-413e-9888-d67bec06eed7 None None] MFA Rules not processed for user `7e7cdaa2d85d4ce698950075b98d5eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:08.088066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2b5e51a8-eb90-413e-9888-d67bec06eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:08.134808 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2249/4520] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:12.784540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108a71e-48ea-4f50-8551-3fa71bc2226d service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:12.802339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108a71e-48ea-4f50-8551-3fa71bc2226d service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:12.821487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c887b3-28c6-4a81-a989-8b0c784dd3c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:12.822390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c887b3-28c6-4a81-a989-8b0c784dd3c8 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:12.822827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c887b3-28c6-4a81-a989-8b0c784dd3c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:12.824067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c887b3-28c6-4a81-a989-8b0c784dd3c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:12.826167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-85c887b3-28c6-4a81-a989-8b0c784dd3c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:12.848604 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:12.860999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c887b3-28c6-4a81-a989-8b0c784dd3c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:12.862896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c887b3-28c6-4a81-a989-8b0c784dd3c8 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:12.899370 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2272/4521] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:13.472220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e51a8-eb90-413e-9888-d67bec06eed7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:13.474873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2b5e51a8-eb90-413e-9888-d67bec06eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:13.536170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e51a8-eb90-413e-9888-d67bec06eed7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:13.567729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:13.569893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:13.580991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:13.597170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] PATH_INFO: `/v3/users/300fbec9d5cb41de9a36adad1056bc68` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:13.600824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=300fbec9d5cb41de9a36adad1056bc68)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:13.610049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:13.755288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300fbec9d5cb41de9a36adad1056bc68'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:13.755997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300fbec9d5cb41de9a36adad1056bc68'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:13.786128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300fbec9d5cb41de9a36adad1056bc68'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:13.827087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300fbec9d5cb41de9a36adad1056bc68'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:13.828084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300fbec9d5cb41de9a36adad1056bc68'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:13.864882 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2250/4522] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:21:13 2022] DELETE /identity/v3/users/300fbec9d5cb41de9a36adad1056bc68 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:21:13.869250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1caf19-df06-4298-b2f6-bc00bb00eaaf None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:13.869759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1caf19-df06-4298-b2f6-bc00bb00eaaf None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:13.869847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1caf19-df06-4298-b2f6-bc00bb00eaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:13.908149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9d1caf19-df06-4298-b2f6-bc00bb00eaaf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:13.909397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d1caf19-df06-4298-b2f6-bc00bb00eaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:14.013602 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2273/4523] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:14.025643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:14.028428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:14.176577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c2ef2-d843-415a-adc9-9a5a030b4b57 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:14.184693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653bbb6-d7b9-4410-b037-bb9604470c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:14.186145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653bbb6-d7b9-4410-b037-bb9604470c1b service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:14.186541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653bbb6-d7b9-4410-b037-bb9604470c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:14.187036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653bbb6-d7b9-4410-b037-bb9604470c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:14.201730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653bbb6-d7b9-4410-b037-bb9604470c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:14.204164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653bbb6-d7b9-4410-b037-bb9604470c1b service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:14.228731 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2251/4524] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:16.572517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1caf19-df06-4298-b2f6-bc00bb00eaaf None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:16.586420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d1caf19-df06-4298-b2f6-bc00bb00eaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:16.616414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1caf19-df06-4298-b2f6-bc00bb00eaaf None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:16.634031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:16.643103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:16.645651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:16.646103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] PATH_INFO: `/v3/projects/7afb716a6c634c18b247d1d0749a70cd` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:16.647655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7afb716a6c634c18b247d1d0749a70cd)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:16.649800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:16.792917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7afb716a6c634c18b247d1d0749a70cd', 'request_id': 'req-56162a59-ac83-4c13-b9a3-4022e1d52fac'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:16.815819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7afb716a6c634c18b247d1d0749a70cd', 'request_id': 'req-56162a59-ac83-4c13-b9a3-4022e1d52fac'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:16.834266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7afb716a6c634c18b247d1d0749a70cd', 'request_id': 'req-56162a59-ac83-4c13-b9a3-4022e1d52fac'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:16.850546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] The token cache is being invalidate because project 7afb716a6c634c18b247d1d0749a70cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:21:16.851208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:16.852270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:16.854245 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2274/4525] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:21:16 2022] DELETE /identity/v3/projects/7afb716a6c634c18b247d1d0749a70cd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:21:16.858877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653bbb6-d7b9-4410-b037-bb9604470c1b service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:16.873243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653bbb6-d7b9-4410-b037-bb9604470c1b service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:16.935463 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:16.959563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:16.960212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:16.962987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:16.963276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] PATH_INFO: `/v3/users/8d3029e9d5544e4680494c84ab2c03a4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:16.976355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d3029e9d5544e4680494c84ab2c03a4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:16.978483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:17.018659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:17.021216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:17.145396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d3029e9d5544e4680494c84ab2c03a4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:17.146001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d3029e9d5544e4680494c84ab2c03a4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:17.183897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d3029e9d5544e4680494c84ab2c03a4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:17.212420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d3029e9d5544e4680494c84ab2c03a4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:17.214596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d3029e9d5544e4680494c84ab2c03a4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:17.266617 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2252/4526] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:21:16 2022] DELETE /identity/v3/users/8d3029e9d5544e4680494c84ab2c03a4 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:21:17.276170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56162a59-ac83-4c13-b9a3-4022e1d52fac admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:17.311503 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:17.533007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac19271-2a02-4060-8b4d-c6d56c681ce9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:17.534436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac19271-2a02-4060-8b4d-c6d56c681ce9 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:17.534872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac19271-2a02-4060-8b4d-c6d56c681ce9 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:17.535350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac19271-2a02-4060-8b4d-c6d56c681ce9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:17.538204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0ac19271-2a02-4060-8b4d-c6d56c681ce9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:17.610124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac19271-2a02-4060-8b4d-c6d56c681ce9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:17.611841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac19271-2a02-4060-8b4d-c6d56c681ce9 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:17.639950 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2275/4527] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:18.920561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:18.923171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:19.092416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a3189-c29f-4d13-8f3e-88a93e8f23cc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:19.099871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:19.100700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:19.101129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:19.101563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06 admin admin] PATH_INFO: `/v3/projects/7270f1c1259f4fb3a8f80f03a9e74bb8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:19.102862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7270f1c1259f4fb3a8f80f03a9e74bb8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:19.105950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:19.186552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7270f1c1259f4fb3a8f80f03a9e74bb8', 'request_id': 'req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:19.197363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7270f1c1259f4fb3a8f80f03a9e74bb8', 'request_id': 'req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:19.208711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7270f1c1259f4fb3a8f80f03a9e74bb8', 'request_id': 'req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:19.221450 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:19.248847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06 admin admin] The token cache is being invalidate because project 7270f1c1259f4fb3a8f80f03a9e74bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:21:19.250716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:19.251958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7b1a4364-87e5-4ac2-b978-c7ffd7082a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:19.256711 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2253/4528] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:21:18 2022] DELETE /identity/v3/projects/7270f1c1259f4fb3a8f80f03a9e74bb8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:21:19.263932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b83dc-5172-4a22-b1e2-67e3683ef076 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:19.265765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b83dc-5172-4a22-b1e2-67e3683ef076 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:19.266384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b83dc-5172-4a22-b1e2-67e3683ef076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:19.321030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0a8b83dc-5172-4a22-b1e2-67e3683ef076 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:19.331424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0a8b83dc-5172-4a22-b1e2-67e3683ef076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:19.662463 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2276/4529] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:19.669120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98942-ed63-4a93-9565-ad038d6f63e2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:19.669407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98942-ed63-4a93-9565-ad038d6f63e2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:19.669684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98942-ed63-4a93-9565-ad038d6f63e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:19.706870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0bd98942-ed63-4a93-9565-ad038d6f63e2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:19.710087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0bd98942-ed63-4a93-9565-ad038d6f63e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:19.722942 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2254/4530] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:19.726668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b83dc-5172-4a22-b1e2-67e3683ef076 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:19.752541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b83dc-5172-4a22-b1e2-67e3683ef076 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:19.767331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39766032-39c0-4390-a719-a5ff897d4165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:19.769396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39766032-39c0-4390-a719-a5ff897d4165 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:19.769863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39766032-39c0-4390-a719-a5ff897d4165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:19.770537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39766032-39c0-4390-a719-a5ff897d4165 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:19.772180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39766032-39c0-4390-a719-a5ff897d4165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:21:19.774074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39766032-39c0-4390-a719-a5ff897d4165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:19.779877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39766032-39c0-4390-a719-a5ff897d4165 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:19.836747 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2277/4531] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:21:19.841176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd98942-ed63-4a93-9565-ad038d6f63e2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:19.855711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd98942-ed63-4a93-9565-ad038d6f63e2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:19.893343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9d50b-c364-452d-9948-89cc53468960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:19.899235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9d50b-c364-452d-9948-89cc53468960 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:19.899579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9d50b-c364-452d-9948-89cc53468960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:19.899864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9d50b-c364-452d-9948-89cc53468960 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:19.912515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9d50b-c364-452d-9948-89cc53468960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:19.919236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9d50b-c364-452d-9948-89cc53468960 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:20.000250 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2255/4532] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:21:19 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:21:20.001272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39766032-39c0-4390-a719-a5ff897d4165 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:20.021156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39766032-39c0-4390-a719-a5ff897d4165 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:20.243488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e01625-e2c2-4758-aa75-11ddd90d1db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:20.244259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e01625-e2c2-4758-aa75-11ddd90d1db3 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:20.244525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e01625-e2c2-4758-aa75-11ddd90d1db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:20.244960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e01625-e2c2-4758-aa75-11ddd90d1db3 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:20.246553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e01625-e2c2-4758-aa75-11ddd90d1db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:20.248694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e01625-e2c2-4758-aa75-11ddd90d1db3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:20.295778 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2278/4533] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:21:20 2022] POST /identity/v3/users => generated 292 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:21:20.299706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9d50b-c364-452d-9948-89cc53468960 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:20.317620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9d50b-c364-452d-9948-89cc53468960 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:20.334859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e1d3d-201f-4eed-8617-56461398f4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:20.335508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e1d3d-201f-4eed-8617-56461398f4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:20.335792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e1d3d-201f-4eed-8617-56461398f4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:20.336066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e1d3d-201f-4eed-8617-56461398f4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:20.336720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e1d3d-201f-4eed-8617-56461398f4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:20.338354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e1d3d-201f-4eed-8617-56461398f4d9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:20.360386 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2256/4534] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:21:20.364165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e01625-e2c2-4758-aa75-11ddd90d1db3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:20.384403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e01625-e2c2-4758-aa75-11ddd90d1db3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:20.395106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce45c5-354c-41df-ad91-ec18daffd312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:20.396145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce45c5-354c-41df-ad91-ec18daffd312 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:20.396585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce45c5-354c-41df-ad91-ec18daffd312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:20.398111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce45c5-354c-41df-ad91-ec18daffd312 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:20.399863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce45c5-354c-41df-ad91-ec18daffd312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:20.403714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce45c5-354c-41df-ad91-ec18daffd312 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:20.440150 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2279/4535] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:21:20.444611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e1d3d-201f-4eed-8617-56461398f4d9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:20.467947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e1d3d-201f-4eed-8617-56461398f4d9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:20.479419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8af19-990f-47f4-ad5c-ebb5527827cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:20.480495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8af19-990f-47f4-ad5c-ebb5527827cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:20.482807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8af19-990f-47f4-ad5c-ebb5527827cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:20.483345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8af19-990f-47f4-ad5c-ebb5527827cd admin admin] PATH_INFO: `/v3/projects/38cd303184b540d1bd5816e7cadc11e0/users/565fd12744544992aeca64d3bb19c970/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:20.517571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8af19-990f-47f4-ad5c-ebb5527827cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=38cd303184b540d1bd5816e7cadc11e0, user_id=565fd12744544992aeca64d3bb19c970, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:20.525006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8af19-990f-47f4-ad5c-ebb5527827cd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:20.566362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336f1a0-dfa7-4310-90ec-4f50f931dce9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:20.566650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336f1a0-dfa7-4310-90ec-4f50f931dce9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:20.567042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336f1a0-dfa7-4310-90ec-4f50f931dce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:20.569785 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2257/4536] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:21:20 2022] PUT /identity/v3/projects/38cd303184b540d1bd5816e7cadc11e0/users/565fd12744544992aeca64d3bb19c970/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:21:20.601283 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:20.617594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c336f1a0-dfa7-4310-90ec-4f50f931dce9 None None] MFA Rules not processed for user `565fd12744544992aeca64d3bb19c970`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:20.618930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c336f1a0-dfa7-4310-90ec-4f50f931dce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:20.801557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8af19-990f-47f4-ad5c-ebb5527827cd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:20.803699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-24b8af19-990f-47f4-ad5c-ebb5527827cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:20.816024 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2280/4537] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:20.956351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8af19-990f-47f4-ad5c-ebb5527827cd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:20.970574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374b188-21f9-4f8f-8ea8-78ab1acbeaa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:20.971421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374b188-21f9-4f8f-8ea8-78ab1acbeaa0 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:20.971801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374b188-21f9-4f8f-8ea8-78ab1acbeaa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:20.972317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374b188-21f9-4f8f-8ea8-78ab1acbeaa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:21.002349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374b188-21f9-4f8f-8ea8-78ab1acbeaa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:21.004371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374b188-21f9-4f8f-8ea8-78ab1acbeaa0 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:21.040368 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2258/4538] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:21.792399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2e436-99de-4a49-8421-28742fc0157c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:21.794060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2e436-99de-4a49-8421-28742fc0157c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:21.794489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2e436-99de-4a49-8421-28742fc0157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:21.865502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-40e2e436-99de-4a49-8421-28742fc0157c None None] MFA Rules not processed for user `a3ac1408c91c4db59f4639abdca2c98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:21.866734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-40e2e436-99de-4a49-8421-28742fc0157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:22.068032 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2281/4539] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:22.082075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b2e85-029e-46b7-917a-462f865da39b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:22.082603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b2e85-029e-46b7-917a-462f865da39b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:22.082826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b2e85-029e-46b7-917a-462f865da39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:22.112611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-728b2e85-029e-46b7-917a-462f865da39b None None] MFA Rules not processed for user `a3ac1408c91c4db59f4639abdca2c98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:22.116932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-728b2e85-029e-46b7-917a-462f865da39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:22.134115 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2259/4540] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:22.147286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2e436-99de-4a49-8421-28742fc0157c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:22.149137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-40e2e436-99de-4a49-8421-28742fc0157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:22.317997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2e436-99de-4a49-8421-28742fc0157c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:22.333902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12220a13-50cb-4b4d-a1d9-8ea970ed1af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:22.334537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12220a13-50cb-4b4d-a1d9-8ea970ed1af3 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:22.334814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12220a13-50cb-4b4d-a1d9-8ea970ed1af3 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:22.335115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12220a13-50cb-4b4d-a1d9-8ea970ed1af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:22.360214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12220a13-50cb-4b4d-a1d9-8ea970ed1af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:22.365635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12220a13-50cb-4b4d-a1d9-8ea970ed1af3 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:22.384779 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2282/4541] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:23.586963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9ddea-e3d7-4a67-8a18-d8e1ae226b13 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:23.587693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9ddea-e3d7-4a67-8a18-d8e1ae226b13 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:23.587693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9ddea-e3d7-4a67-8a18-d8e1ae226b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:23.658158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4cd9ddea-e3d7-4a67-8a18-d8e1ae226b13 None None] MFA Rules not processed for user `0de7257c0cb54a7cb3d55edbeec5682a`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:23.659599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4cd9ddea-e3d7-4a67-8a18-d8e1ae226b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:23.822012 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2260/4542] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:23.833136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d82ec-e4df-45ed-b3cd-7bc0c07ff22a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:23.835112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d82ec-e4df-45ed-b3cd-7bc0c07ff22a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:23.835697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d82ec-e4df-45ed-b3cd-7bc0c07ff22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:24.254245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ee8d82ec-e4df-45ed-b3cd-7bc0c07ff22a None None] MFA Rules not processed for user `0de7257c0cb54a7cb3d55edbeec5682a`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:24.258662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ee8d82ec-e4df-45ed-b3cd-7bc0c07ff22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:24.288354 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2283/4543] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:24.301977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9ddea-e3d7-4a67-8a18-d8e1ae226b13 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:24.324385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9ddea-e3d7-4a67-8a18-d8e1ae226b13 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:24.352817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465d760-b2f2-4f5b-8636-81b35c5ea178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:24.355625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465d760-b2f2-4f5b-8636-81b35c5ea178 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:24.355969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465d760-b2f2-4f5b-8636-81b35c5ea178 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:24.360172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465d760-b2f2-4f5b-8636-81b35c5ea178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:24.386480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465d760-b2f2-4f5b-8636-81b35c5ea178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:24.394241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465d760-b2f2-4f5b-8636-81b35c5ea178 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:24.432865 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2261/4544] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:27.577940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d82ec-e4df-45ed-b3cd-7bc0c07ff22a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:27.579597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ee8d82ec-e4df-45ed-b3cd-7bc0c07ff22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:27.624483 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:27.885863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d82ec-e4df-45ed-b3cd-7bc0c07ff22a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:27.911057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:27.911722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:27.912001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:27.912732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] PATH_INFO: `/v3/users/49b3edfc62e747a8a21e76bfde79f40e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:27.921250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b3edfc62e747a8a21e76bfde79f40e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:27.923360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:28.092581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b3edfc62e747a8a21e76bfde79f40e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:28.101724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b3edfc62e747a8a21e76bfde79f40e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:28.171006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b3edfc62e747a8a21e76bfde79f40e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:28.214292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b3edfc62e747a8a21e76bfde79f40e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:28.215284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b3edfc62e747a8a21e76bfde79f40e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:28.256057 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2284/4545] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:21:27 2022] DELETE /identity/v3/users/49b3edfc62e747a8a21e76bfde79f40e => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:21:29.649555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465d760-b2f2-4f5b-8636-81b35c5ea178 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:29.657220 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:29.662835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465d760-b2f2-4f5b-8636-81b35c5ea178 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:29.824346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:29.825289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:29.826021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:29.827312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] PATH_INFO: `/v3/projects/3078012968784295bc15ee359b50fd67` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:29.830092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3078012968784295bc15ee359b50fd67)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:29.832670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:30.010110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3078012968784295bc15ee359b50fd67', 'request_id': 'req-6dbab89c-82f5-4ea4-b72d-746a14619f82'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:30.022799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3078012968784295bc15ee359b50fd67', 'request_id': 'req-6dbab89c-82f5-4ea4-b72d-746a14619f82'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:30.041188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3078012968784295bc15ee359b50fd67', 'request_id': 'req-6dbab89c-82f5-4ea4-b72d-746a14619f82'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:30.081866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] The token cache is being invalidate because project 3078012968784295bc15ee359b50fd67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:21:30.082585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:30.083316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:30.085632 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2262/4546] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:21:29 2022] DELETE /identity/v3/projects/3078012968784295bc15ee359b50fd67 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:21:30.090554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:30.092227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:30.118646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194187e-30e6-4931-a5ef-91fe97b15a17 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:30.366300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937a3f9-8c19-44a9-be8d-0aa0e7ba1fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:30.367260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937a3f9-8c19-44a9-be8d-0aa0e7ba1fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:30.367260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937a3f9-8c19-44a9-be8d-0aa0e7ba1fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:30.367940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937a3f9-8c19-44a9-be8d-0aa0e7ba1fa2 admin admin] PATH_INFO: `/v3/users/a5a864e596cb43b89de3638aa25e0555` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:30.371901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937a3f9-8c19-44a9-be8d-0aa0e7ba1fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a864e596cb43b89de3638aa25e0555)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:30.374595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937a3f9-8c19-44a9-be8d-0aa0e7ba1fa2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:30.451629 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:30.508811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9937a3f9-8c19-44a9-be8d-0aa0e7ba1fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a864e596cb43b89de3638aa25e0555'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:30.509553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9937a3f9-8c19-44a9-be8d-0aa0e7ba1fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a864e596cb43b89de3638aa25e0555'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:30.540176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9937a3f9-8c19-44a9-be8d-0aa0e7ba1fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a864e596cb43b89de3638aa25e0555'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:30.553114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9937a3f9-8c19-44a9-be8d-0aa0e7ba1fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a864e596cb43b89de3638aa25e0555'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:30.555015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9937a3f9-8c19-44a9-be8d-0aa0e7ba1fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a864e596cb43b89de3638aa25e0555'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:30.619604 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2285/4547] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:21:30 2022] DELETE /identity/v3/users/a5a864e596cb43b89de3638aa25e0555 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:21:31.189847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:31.191403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:31.216112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbab89c-82f5-4ea4-b72d-746a14619f82 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:31.332815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647910e4-558d-49a2-aa59-fa5da1598c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:31.333858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647910e4-558d-49a2-aa59-fa5da1598c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:31.334392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647910e4-558d-49a2-aa59-fa5da1598c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:31.334887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647910e4-558d-49a2-aa59-fa5da1598c8d admin admin] PATH_INFO: `/v3/projects/7cb95dba529544919ecc28e834172965` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:31.337331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647910e4-558d-49a2-aa59-fa5da1598c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb95dba529544919ecc28e834172965)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:31.341289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647910e4-558d-49a2-aa59-fa5da1598c8d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:31.424308 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:31.453845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-647910e4-558d-49a2-aa59-fa5da1598c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb95dba529544919ecc28e834172965', 'request_id': 'req-647910e4-558d-49a2-aa59-fa5da1598c8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:31.463482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-647910e4-558d-49a2-aa59-fa5da1598c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb95dba529544919ecc28e834172965', 'request_id': 'req-647910e4-558d-49a2-aa59-fa5da1598c8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:31.476678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-647910e4-558d-49a2-aa59-fa5da1598c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb95dba529544919ecc28e834172965', 'request_id': 'req-647910e4-558d-49a2-aa59-fa5da1598c8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:31.492613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-647910e4-558d-49a2-aa59-fa5da1598c8d admin admin] The token cache is being invalidate because project 7cb95dba529544919ecc28e834172965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:21:31.493054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-647910e4-558d-49a2-aa59-fa5da1598c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:31.494137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-647910e4-558d-49a2-aa59-fa5da1598c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:31.497132 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2263/4548] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:21:31 2022] DELETE /identity/v3/projects/7cb95dba529544919ecc28e834172965 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:21:31.502091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefe8ea-cbc3-4112-b5b4-9ff1cd810642 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:31.502574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefe8ea-cbc3-4112-b5b4-9ff1cd810642 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:31.502849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefe8ea-cbc3-4112-b5b4-9ff1cd810642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:31.538052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dcefe8ea-cbc3-4112-b5b4-9ff1cd810642 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:31.539696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dcefe8ea-cbc3-4112-b5b4-9ff1cd810642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:31.641249 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2286/4549] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:31.649521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0916847-a988-4f64-a1fb-338555f34afd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:31.650203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0916847-a988-4f64-a1fb-338555f34afd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:31.650720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0916847-a988-4f64-a1fb-338555f34afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:31.691763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d0916847-a988-4f64-a1fb-338555f34afd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:31.693810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d0916847-a988-4f64-a1fb-338555f34afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:31.707557 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2264/4550] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:31.711539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefe8ea-cbc3-4112-b5b4-9ff1cd810642 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:31.728712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefe8ea-cbc3-4112-b5b4-9ff1cd810642 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:31.740923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe3379-b99c-4499-a87f-0f4f39d721e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:31.742644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe3379-b99c-4499-a87f-0f4f39d721e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:31.743456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe3379-b99c-4499-a87f-0f4f39d721e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:31.744562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe3379-b99c-4499-a87f-0f4f39d721e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:31.746667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe3379-b99c-4499-a87f-0f4f39d721e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:21:31.750762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe3379-b99c-4499-a87f-0f4f39d721e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:31.754339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe3379-b99c-4499-a87f-0f4f39d721e8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:31.774696 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2287/4551] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:21:31.779642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0916847-a988-4f64-a1fb-338555f34afd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:31.795105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0916847-a988-4f64-a1fb-338555f34afd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:31.802097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37d125-65b6-44b7-a611-eac3658f0bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:31.803061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37d125-65b6-44b7-a611-eac3658f0bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:31.803698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37d125-65b6-44b7-a611-eac3658f0bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:31.804799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37d125-65b6-44b7-a611-eac3658f0bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:31.805633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37d125-65b6-44b7-a611-eac3658f0bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:31.809419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37d125-65b6-44b7-a611-eac3658f0bf4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:31.884355 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2265/4552] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:21:31 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:21:31.888937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe3379-b99c-4499-a87f-0f4f39d721e8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:31.906477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe3379-b99c-4499-a87f-0f4f39d721e8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:32.024354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5be4c-9850-43bb-8069-829f7eb1245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:32.025457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5be4c-9850-43bb-8069-829f7eb1245f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:32.025825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5be4c-9850-43bb-8069-829f7eb1245f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:32.026241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5be4c-9850-43bb-8069-829f7eb1245f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:32.027148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5be4c-9850-43bb-8069-829f7eb1245f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:32.029521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5be4c-9850-43bb-8069-829f7eb1245f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:32.095898 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2288/4553] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:21:31 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:21:32.097293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37d125-65b6-44b7-a611-eac3658f0bf4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:32.114717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37d125-65b6-44b7-a611-eac3658f0bf4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:32.139360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e4d82-8419-43ac-9e31-421416986ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:32.139896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e4d82-8419-43ac-9e31-421416986ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:32.140176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e4d82-8419-43ac-9e31-421416986ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:32.140448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e4d82-8419-43ac-9e31-421416986ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:32.141100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e4d82-8419-43ac-9e31-421416986ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:32.143425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e4d82-8419-43ac-9e31-421416986ae9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:32.171921 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2266/4554] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:21:32.183539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5be4c-9850-43bb-8069-829f7eb1245f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:32.206795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5be4c-9850-43bb-8069-829f7eb1245f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:32.227412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bec0e-f853-4f90-b5fd-26cb713420d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:32.228054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bec0e-f853-4f90-b5fd-26cb713420d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:32.228332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bec0e-f853-4f90-b5fd-26cb713420d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:32.228604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bec0e-f853-4f90-b5fd-26cb713420d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:32.229780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bec0e-f853-4f90-b5fd-26cb713420d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:32.244400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bec0e-f853-4f90-b5fd-26cb713420d7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:32.305035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e4d82-8419-43ac-9e31-421416986ae9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:32.321009 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2289/4555] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:21:32.327176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e4d82-8419-43ac-9e31-421416986ae9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:32.345746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b27a81-5a66-4eb1-8cc8-4229c34eb932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:32.346436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b27a81-5a66-4eb1-8cc8-4229c34eb932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:32.346796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b27a81-5a66-4eb1-8cc8-4229c34eb932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:32.347144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b27a81-5a66-4eb1-8cc8-4229c34eb932 admin admin] PATH_INFO: `/v3/projects/0379a874918747449f5bbe24b6016495/users/cad50112141243a6a27812344e12cfec/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:32.386771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b27a81-5a66-4eb1-8cc8-4229c34eb932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0379a874918747449f5bbe24b6016495, user_id=cad50112141243a6a27812344e12cfec, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:32.394347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b27a81-5a66-4eb1-8cc8-4229c34eb932 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:32.440233 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2267/4556] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:21:32 2022] PUT /identity/v3/projects/0379a874918747449f5bbe24b6016495/users/cad50112141243a6a27812344e12cfec/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:21:32.446389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce0ae-1e89-4d86-8544-515809c42b13 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:32.446389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce0ae-1e89-4d86-8544-515809c42b13 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:32.446634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce0ae-1e89-4d86-8544-515809c42b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:32.488266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0f3ce0ae-1e89-4d86-8544-515809c42b13 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:32.489524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0f3ce0ae-1e89-4d86-8544-515809c42b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:32.518475 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:32.653218 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2290/4557] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:32.719258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b27a81-5a66-4eb1-8cc8-4229c34eb932 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:32.720987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-15b27a81-5a66-4eb1-8cc8-4229c34eb932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:32.864943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b27a81-5a66-4eb1-8cc8-4229c34eb932 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:32.873471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d081b-fb51-4b39-a2ed-cc43fd15841f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:32.874903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d081b-fb51-4b39-a2ed-cc43fd15841f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:32.875430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d081b-fb51-4b39-a2ed-cc43fd15841f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:32.875982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d081b-fb51-4b39-a2ed-cc43fd15841f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:32.888415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d081b-fb51-4b39-a2ed-cc43fd15841f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:32.890678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d081b-fb51-4b39-a2ed-cc43fd15841f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:32.908633 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2268/4558] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:34.092152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996382d3-0f34-47d0-b105-106f21846979 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:34.093780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996382d3-0f34-47d0-b105-106f21846979 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:34.094211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996382d3-0f34-47d0-b105-106f21846979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:34.127524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-996382d3-0f34-47d0-b105-106f21846979 None None] MFA Rules not processed for user `cad50112141243a6a27812344e12cfec`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:34.129034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-996382d3-0f34-47d0-b105-106f21846979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:34.206019 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2291/4559] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:34.218137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ebb7e-cbb8-44c2-8f9c-aca1e1f8b7c7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:34.218861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ebb7e-cbb8-44c2-8f9c-aca1e1f8b7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:34.218861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ebb7e-cbb8-44c2-8f9c-aca1e1f8b7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:34.244998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-171ebb7e-cbb8-44c2-8f9c-aca1e1f8b7c7 None None] MFA Rules not processed for user `cad50112141243a6a27812344e12cfec`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:34.246493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-171ebb7e-cbb8-44c2-8f9c-aca1e1f8b7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:34.256883 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2269/4560] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:34.267612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcaf94-7e53-49d3-81c3-0314dd08612d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:34.268158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcaf94-7e53-49d3-81c3-0314dd08612d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:34.268707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcaf94-7e53-49d3-81c3-0314dd08612d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:34.308442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-74fcaf94-7e53-49d3-81c3-0314dd08612d None None] MFA Rules not processed for user `cad50112141243a6a27812344e12cfec`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:34.310296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-74fcaf94-7e53-49d3-81c3-0314dd08612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:34.323073 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2292/4561] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:34.337657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ebb7e-cbb8-44c2-8f9c-aca1e1f8b7c7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:34.340075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-171ebb7e-cbb8-44c2-8f9c-aca1e1f8b7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:34.489660 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:34.533350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ebb7e-cbb8-44c2-8f9c-aca1e1f8b7c7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:34.545775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff905a60-3ae4-4284-ba9d-784a70e94984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:34.546665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff905a60-3ae4-4284-ba9d-784a70e94984 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:34.547155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff905a60-3ae4-4284-ba9d-784a70e94984 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:34.547575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff905a60-3ae4-4284-ba9d-784a70e94984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:34.561691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff905a60-3ae4-4284-ba9d-784a70e94984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:34.564154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff905a60-3ae4-4284-ba9d-784a70e94984 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:34.576399 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2270/4562] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:35.707694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c29cc5-93ef-48b1-aac0-7571dd410f5c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:35.708625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c29cc5-93ef-48b1-aac0-7571dd410f5c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:35.709040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c29cc5-93ef-48b1-aac0-7571dd410f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:35.748803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-99c29cc5-93ef-48b1-aac0-7571dd410f5c None None] MFA Rules not processed for user `cad50112141243a6a27812344e12cfec`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:35.750059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-99c29cc5-93ef-48b1-aac0-7571dd410f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:35.771134 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2293/4563] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:37.664868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28152d-6527-424d-81b8-6b73a05f5b0e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:37.665383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28152d-6527-424d-81b8-6b73a05f5b0e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:37.665518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28152d-6527-424d-81b8-6b73a05f5b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:37.701297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4f28152d-6527-424d-81b8-6b73a05f5b0e None None] MFA Rules not processed for user `cad50112141243a6a27812344e12cfec`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:37.702551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4f28152d-6527-424d-81b8-6b73a05f5b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:37.743282 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2271/4564] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:37.880942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c29cc5-93ef-48b1-aac0-7571dd410f5c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:37.882394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-99c29cc5-93ef-48b1-aac0-7571dd410f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:37.913075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c29cc5-93ef-48b1-aac0-7571dd410f5c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:37.935344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:37.936115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:37.936326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:37.936801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] PATH_INFO: `/v3/users/565fd12744544992aeca64d3bb19c970` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:37.938128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=565fd12744544992aeca64d3bb19c970)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:37.941852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:38.027713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565fd12744544992aeca64d3bb19c970'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:38.028497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565fd12744544992aeca64d3bb19c970'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:38.077904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565fd12744544992aeca64d3bb19c970'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:38.101722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565fd12744544992aeca64d3bb19c970'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:38.106831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565fd12744544992aeca64d3bb19c970'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:38.130805 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:38.144522 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2294/4565] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:21:37 2022] DELETE /identity/v3/users/565fd12744544992aeca64d3bb19c970 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:21:38.166227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c3ca0-c45f-4391-b25d-4cf276755bf0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:38.166558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c3ca0-c45f-4391-b25d-4cf276755bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:38.166876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c3ca0-c45f-4391-b25d-4cf276755bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:38.210686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-931c3ca0-c45f-4391-b25d-4cf276755bf0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:38.212561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-931c3ca0-c45f-4391-b25d-4cf276755bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:38.375951 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2272/4566] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:38.532109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:38.534388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:38.632669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecf3d0-cb84-4118-a8ae-1c76c403f3f2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:38.638262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b3a25-d56e-4904-8b6a-797af9a73db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:38.638983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b3a25-d56e-4904-8b6a-797af9a73db7 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:38.639264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b3a25-d56e-4904-8b6a-797af9a73db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:38.639830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b3a25-d56e-4904-8b6a-797af9a73db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:38.676650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b3a25-d56e-4904-8b6a-797af9a73db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:38.678255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b3a25-d56e-4904-8b6a-797af9a73db7 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:38.696508 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2295/4567] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:40.610693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c3ca0-c45f-4391-b25d-4cf276755bf0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:40.613359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-931c3ca0-c45f-4391-b25d-4cf276755bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:40.756902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c3ca0-c45f-4391-b25d-4cf276755bf0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:40.763434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2c617-1b41-4f15-90ca-46770fba1d4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:40.764159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2c617-1b41-4f15-90ca-46770fba1d4d service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:40.764432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2c617-1b41-4f15-90ca-46770fba1d4d service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:40.764885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2c617-1b41-4f15-90ca-46770fba1d4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:40.767697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eaf2c617-1b41-4f15-90ca-46770fba1d4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:40.792754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2c617-1b41-4f15-90ca-46770fba1d4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:40.795186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2c617-1b41-4f15-90ca-46770fba1d4d service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:40.813291 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2273/4568] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:41.013443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b3a25-d56e-4904-8b6a-797af9a73db7 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:41.016841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-700b3a25-d56e-4904-8b6a-797af9a73db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:41.097194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b3a25-d56e-4904-8b6a-797af9a73db7 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:41.112315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f2c2-17b5-4367-b060-e2b9e65c9727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:41.112968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f2c2-17b5-4367-b060-e2b9e65c9727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:41.121218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f2c2-17b5-4367-b060-e2b9e65c9727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:41.121742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f2c2-17b5-4367-b060-e2b9e65c9727 admin admin] PATH_INFO: `/v3/projects/38cd303184b540d1bd5816e7cadc11e0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:41.123655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f2c2-17b5-4367-b060-e2b9e65c9727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38cd303184b540d1bd5816e7cadc11e0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:41.130011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f2c2-17b5-4367-b060-e2b9e65c9727 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:41.214643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6c37f2c2-17b5-4367-b060-e2b9e65c9727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38cd303184b540d1bd5816e7cadc11e0', 'request_id': 'req-6c37f2c2-17b5-4367-b060-e2b9e65c9727'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:41.228443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6c37f2c2-17b5-4367-b060-e2b9e65c9727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38cd303184b540d1bd5816e7cadc11e0', 'request_id': 'req-6c37f2c2-17b5-4367-b060-e2b9e65c9727'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:41.246395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6c37f2c2-17b5-4367-b060-e2b9e65c9727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38cd303184b540d1bd5816e7cadc11e0', 'request_id': 'req-6c37f2c2-17b5-4367-b060-e2b9e65c9727'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:41.279654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6c37f2c2-17b5-4367-b060-e2b9e65c9727 admin admin] The token cache is being invalidate because project 38cd303184b540d1bd5816e7cadc11e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:21:41.280205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6c37f2c2-17b5-4367-b060-e2b9e65c9727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:41.281112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6c37f2c2-17b5-4367-b060-e2b9e65c9727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:21:41.283202 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2296/4569] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:21:41 2022] DELETE /identity/v3/projects/38cd303184b540d1bd5816e7cadc11e0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:21:41.288392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd6cd3-6561-4bd3-b901-cfdf2d2d61a6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:41.288789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd6cd3-6561-4bd3-b901-cfdf2d2d61a6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:41.289069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd6cd3-6561-4bd3-b901-cfdf2d2d61a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:41.357210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-48bd6cd3-6561-4bd3-b901-cfdf2d2d61a6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:41.359245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-48bd6cd3-6561-4bd3-b901-cfdf2d2d61a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:41.479329 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2274/4570] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:41.487229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ab7d-cba4-4705-8a79-743392602175 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:41.487519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ab7d-cba4-4705-8a79-743392602175 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:41.487933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ab7d-cba4-4705-8a79-743392602175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:41.526652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1d31ab7d-cba4-4705-8a79-743392602175 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:41.527949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1d31ab7d-cba4-4705-8a79-743392602175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:41.538006 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2297/4571] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:41.542204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd6cd3-6561-4bd3-b901-cfdf2d2d61a6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:41.561114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd6cd3-6561-4bd3-b901-cfdf2d2d61a6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:41.574049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428651d6-2c79-4478-93eb-e8db1e6f5318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:41.574743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428651d6-2c79-4478-93eb-e8db1e6f5318 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:41.575067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428651d6-2c79-4478-93eb-e8db1e6f5318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:41.575335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428651d6-2c79-4478-93eb-e8db1e6f5318 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:41.575991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428651d6-2c79-4478-93eb-e8db1e6f5318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:21:41.576290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428651d6-2c79-4478-93eb-e8db1e6f5318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:41.578066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428651d6-2c79-4478-93eb-e8db1e6f5318 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:41.586695 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:41.594571 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2275/4572] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:21:41.599493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31ab7d-cba4-4705-8a79-743392602175 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:41.613754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31ab7d-cba4-4705-8a79-743392602175 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:41.620072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302893c-b363-4ac4-8826-fb442c81c9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:41.620910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302893c-b363-4ac4-8826-fb442c81c9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:41.621286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302893c-b363-4ac4-8826-fb442c81c9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:41.621563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302893c-b363-4ac4-8826-fb442c81c9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:41.622454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302893c-b363-4ac4-8826-fb442c81c9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:41.624989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302893c-b363-4ac4-8826-fb442c81c9b7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:41.672959 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2298/4573] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:21:41 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:21:41.677350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428651d6-2c79-4478-93eb-e8db1e6f5318 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:41.699775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428651d6-2c79-4478-93eb-e8db1e6f5318 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:41.920077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840b183-0d87-4fef-91aa-0de8458cb612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:41.921768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b183-0d87-4fef-91aa-0de8458cb612 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:41.922057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b183-0d87-4fef-91aa-0de8458cb612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:41.922331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b183-0d87-4fef-91aa-0de8458cb612 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:41.923013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840b183-0d87-4fef-91aa-0de8458cb612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:41.927383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840b183-0d87-4fef-91aa-0de8458cb612 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:41.977734 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2276/4574] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:21:41 2022] POST /identity/v3/users => generated 289 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:21:41.984536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302893c-b363-4ac4-8826-fb442c81c9b7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:41.999115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302893c-b363-4ac4-8826-fb442c81c9b7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:42.006397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e45a0-50c3-486a-9dce-153bdcd73109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:42.007060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e45a0-50c3-486a-9dce-153bdcd73109 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:42.007337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e45a0-50c3-486a-9dce-153bdcd73109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:42.007604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e45a0-50c3-486a-9dce-153bdcd73109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:42.008238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e45a0-50c3-486a-9dce-153bdcd73109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:42.010200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e45a0-50c3-486a-9dce-153bdcd73109 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:42.026751 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2299/4575] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:21:42.030782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840b183-0d87-4fef-91aa-0de8458cb612 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:42.064868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840b183-0d87-4fef-91aa-0de8458cb612 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:42.070302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dcbaa-f827-404c-8981-b2cfdecd3be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:42.071305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dcbaa-f827-404c-8981-b2cfdecd3be0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:42.071830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dcbaa-f827-404c-8981-b2cfdecd3be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:42.072320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dcbaa-f827-404c-8981-b2cfdecd3be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:42.073886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dcbaa-f827-404c-8981-b2cfdecd3be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:42.076172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dcbaa-f827-404c-8981-b2cfdecd3be0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:42.101309 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2277/4576] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:21:42.107065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e45a0-50c3-486a-9dce-153bdcd73109 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:42.124760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e45a0-50c3-486a-9dce-153bdcd73109 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:42.136470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcad1f-f957-4f5a-a34b-8795e311fd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:42.137522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcad1f-f957-4f5a-a34b-8795e311fd12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:42.140177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcad1f-f957-4f5a-a34b-8795e311fd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:42.140815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcad1f-f957-4f5a-a34b-8795e311fd12 admin admin] PATH_INFO: `/v3/projects/106fa570fa4443eca19731dcae1460c1/users/b6df024260584082b0c18f7fcc54c3fe/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:42.210435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcad1f-f957-4f5a-a34b-8795e311fd12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106fa570fa4443eca19731dcae1460c1, user_id=b6df024260584082b0c18f7fcc54c3fe, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:42.213602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcad1f-f957-4f5a-a34b-8795e311fd12 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:42.232251 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2300/4577] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:21:42 2022] PUT /identity/v3/projects/106fa570fa4443eca19731dcae1460c1/users/b6df024260584082b0c18f7fcc54c3fe/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:21:42.237348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409f13-b6e0-436b-9b0a-eac1201776d4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:42.237631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409f13-b6e0-436b-9b0a-eac1201776d4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:42.237899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409f13-b6e0-436b-9b0a-eac1201776d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:42.295949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a8409f13-b6e0-436b-9b0a-eac1201776d4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:42.300787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a8409f13-b6e0-436b-9b0a-eac1201776d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:42.458239 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2278/4578] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:21:42.499478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcad1f-f957-4f5a-a34b-8795e311fd12 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:42.501215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-53dcad1f-f957-4f5a-a34b-8795e311fd12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:42.553712 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:42.609912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcad1f-f957-4f5a-a34b-8795e311fd12 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:42.614710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adce273-cbab-4169-9d4c-fb006d6c71c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:42.615526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce273-cbab-4169-9d4c-fb006d6c71c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:42.616866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce273-cbab-4169-9d4c-fb006d6c71c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:42.617603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce273-cbab-4169-9d4c-fb006d6c71c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:42.631755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adce273-cbab-4169-9d4c-fb006d6c71c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:42.633968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adce273-cbab-4169-9d4c-fb006d6c71c7 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:42.649237 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2301/4579] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:43.538286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409f13-b6e0-436b-9b0a-eac1201776d4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:43.539974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a8409f13-b6e0-436b-9b0a-eac1201776d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:43.675101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409f13-b6e0-436b-9b0a-eac1201776d4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:43.681707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387277d-40d1-403f-8939-8d106c0ee49a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:43.683467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387277d-40d1-403f-8939-8d106c0ee49a service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:43.683467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387277d-40d1-403f-8939-8d106c0ee49a service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:43.683467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387277d-40d1-403f-8939-8d106c0ee49a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:43.684873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6387277d-40d1-403f-8939-8d106c0ee49a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:43.699693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387277d-40d1-403f-8939-8d106c0ee49a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:43.701895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387277d-40d1-403f-8939-8d106c0ee49a service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:43.708148 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:43.719368 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2279/4580] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:51.770357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec849ecd-e79f-4cca-8674-09f3074cfb41 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:51.770987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec849ecd-e79f-4cca-8674-09f3074cfb41 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:51.770987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec849ecd-e79f-4cca-8674-09f3074cfb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:51.800392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ec849ecd-e79f-4cca-8674-09f3074cfb41 None None] MFA Rules not processed for user `a3ac1408c91c4db59f4639abdca2c98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:51.815448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ec849ecd-e79f-4cca-8674-09f3074cfb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:51.966936 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2302/4581] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:21:52.893792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387277d-40d1-403f-8939-8d106c0ee49a service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:52.895402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6387277d-40d1-403f-8939-8d106c0ee49a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:52.919888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387277d-40d1-403f-8939-8d106c0ee49a service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:52.935303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc114815-a616-4251-8b30-000d031b6a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:52.936350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc114815-a616-4251-8b30-000d031b6a62 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:52.936827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc114815-a616-4251-8b30-000d031b6a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:52.937296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc114815-a616-4251-8b30-000d031b6a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:52.944638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bc114815-a616-4251-8b30-000d031b6a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:52.963706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc114815-a616-4251-8b30-000d031b6a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:52.966260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc114815-a616-4251-8b30-000d031b6a62 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:52.982260 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2280/4582] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:21:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:21:55.036748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06584d8b-3fdf-4d84-a203-de810aafc626 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:55.037371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06584d8b-3fdf-4d84-a203-de810aafc626 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:55.037371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06584d8b-3fdf-4d84-a203-de810aafc626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:55.074098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-06584d8b-3fdf-4d84-a203-de810aafc626 None None] MFA Rules not processed for user `b6df024260584082b0c18f7fcc54c3fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:21:55.075459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-06584d8b-3fdf-4d84-a203-de810aafc626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:21:55.238052 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2303/4583] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:21:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:21:55.246761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc114815-a616-4251-8b30-000d031b6a62 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:55.256512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc114815-a616-4251-8b30-000d031b6a62 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:55.265255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97dc38-e108-4057-9f41-ebea152472b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:55.267096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97dc38-e108-4057-9f41-ebea152472b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:55.267096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97dc38-e108-4057-9f41-ebea152472b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:55.267096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97dc38-e108-4057-9f41-ebea152472b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:55.267742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97dc38-e108-4057-9f41-ebea152472b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:55.269840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97dc38-e108-4057-9f41-ebea152472b4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:55.413103 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2281/4584] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:21:55 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:21:55.413969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06584d8b-3fdf-4d84-a203-de810aafc626 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:55.489011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06584d8b-3fdf-4d84-a203-de810aafc626 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:55.803586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d93d59-ccd0-4bcd-a4b7-72bdcfd4f9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:55.804822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d93d59-ccd0-4bcd-a4b7-72bdcfd4f9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:55.806328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d93d59-ccd0-4bcd-a4b7-72bdcfd4f9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:55.806539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d93d59-ccd0-4bcd-a4b7-72bdcfd4f9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:55.821308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d93d59-ccd0-4bcd-a4b7-72bdcfd4f9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:55.826988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d93d59-ccd0-4bcd-a4b7-72bdcfd4f9d5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:55.848474 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:55.898402 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2304/4585] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:21:55 2022] POST /identity/v3/users => generated 297 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:21:55.899064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97dc38-e108-4057-9f41-ebea152472b4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:55.919199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97dc38-e108-4057-9f41-ebea152472b4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:55.954394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4ccdc-5cd0-4a12-857a-27cd8e88571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:55.956759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4ccdc-5cd0-4a12-857a-27cd8e88571c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:55.957231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4ccdc-5cd0-4a12-857a-27cd8e88571c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:55.957523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4ccdc-5cd0-4a12-857a-27cd8e88571c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:55.958207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4ccdc-5cd0-4a12-857a-27cd8e88571c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:55.970826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4ccdc-5cd0-4a12-857a-27cd8e88571c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:56.038973 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2282/4586] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:21:56.043411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d93d59-ccd0-4bcd-a4b7-72bdcfd4f9d5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:56.067428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d93d59-ccd0-4bcd-a4b7-72bdcfd4f9d5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:56.077834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dad394-e942-4cc0-84b2-8b206c07971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:56.080765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dad394-e942-4cc0-84b2-8b206c07971f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:56.081369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dad394-e942-4cc0-84b2-8b206c07971f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:56.081793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dad394-e942-4cc0-84b2-8b206c07971f admin admin] PATH_INFO: `/v3/projects/3210b552007d4889bd3921227d5eb3e9/users/df77c201bc0642c3befa09a7026c2efb/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:56.111014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dad394-e942-4cc0-84b2-8b206c07971f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3210b552007d4889bd3921227d5eb3e9, user_id=df77c201bc0642c3befa09a7026c2efb, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:56.115036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dad394-e942-4cc0-84b2-8b206c07971f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:56.147045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4ccdc-5cd0-4a12-857a-27cd8e88571c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:56.148013 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2305/4587] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:21:56 2022] PUT /identity/v3/projects/3210b552007d4889bd3921227d5eb3e9/users/df77c201bc0642c3befa09a7026c2efb/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:21:56.162529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4ccdc-5cd0-4a12-857a-27cd8e88571c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:56.269816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c85739-4523-459b-838d-4e24febede2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:56.271370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85739-4523-459b-838d-4e24febede2f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:56.272535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85739-4523-459b-838d-4e24febede2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:56.273009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85739-4523-459b-838d-4e24febede2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:56.274274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c85739-4523-459b-838d-4e24febede2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:56.276850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c85739-4523-459b-838d-4e24febede2f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:56.306087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dad394-e942-4cc0-84b2-8b206c07971f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:21:56.316793 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2283/4588] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:21:56.323094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dad394-e942-4cc0-84b2-8b206c07971f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:21:56.337737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fb845-c1c0-4ec9-a39a-d8da7cab5c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:21:56.338637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fb845-c1c0-4ec9-a39a-d8da7cab5c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:21:56.338944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fb845-c1c0-4ec9-a39a-d8da7cab5c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:21:56.339211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fb845-c1c0-4ec9-a39a-d8da7cab5c0b admin admin] PATH_INFO: `/v3/projects/3210b552007d4889bd3921227d5eb3e9/users/df77c201bc0642c3befa09a7026c2efb/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:21:56.343864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fb845-c1c0-4ec9-a39a-d8da7cab5c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3210b552007d4889bd3921227d5eb3e9, user_id=df77c201bc0642c3befa09a7026c2efb, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:21:56.352730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fb845-c1c0-4ec9-a39a-d8da7cab5c0b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:21:56.382876 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2306/4589] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:21:56 2022] PUT /identity/v3/projects/3210b552007d4889bd3921227d5eb3e9/users/df77c201bc0642c3befa09a7026c2efb/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:00.029426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c85739-4523-459b-838d-4e24febede2f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:00.161400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c85739-4523-459b-838d-4e24febede2f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:00.323705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddd552-e21f-4bae-a3d8-5372231b331a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:00.325559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd552-e21f-4bae-a3d8-5372231b331a service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:00.326449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd552-e21f-4bae-a3d8-5372231b331a service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:00.327876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd552-e21f-4bae-a3d8-5372231b331a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:00.335440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a1ddd552-e21f-4bae-a3d8-5372231b331a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:00.394649 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:00.531284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ddd552-e21f-4bae-a3d8-5372231b331a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:00.532715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ddd552-e21f-4bae-a3d8-5372231b331a service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:00.559488 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2284/4590] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:22:06.367479 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=5,keystone:SELECT=17 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:07.721744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fb845-c1c0-4ec9-a39a-d8da7cab5c0b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:07.723609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0a9fb845-c1c0-4ec9-a39a-d8da7cab5c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:07.764533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fb845-c1c0-4ec9-a39a-d8da7cab5c0b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:07.777727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265aacf-3eb7-4464-8751-4a0775db682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:07.778372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265aacf-3eb7-4464-8751-4a0775db682b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:07.778645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265aacf-3eb7-4464-8751-4a0775db682b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:07.778928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265aacf-3eb7-4464-8751-4a0775db682b admin admin] PATH_INFO: `/v3/users/0de7257c0cb54a7cb3d55edbeec5682a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:07.785640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265aacf-3eb7-4464-8751-4a0775db682b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de7257c0cb54a7cb3d55edbeec5682a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:07.788687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265aacf-3eb7-4464-8751-4a0775db682b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:07.915431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5265aacf-3eb7-4464-8751-4a0775db682b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de7257c0cb54a7cb3d55edbeec5682a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:07.916163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5265aacf-3eb7-4464-8751-4a0775db682b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de7257c0cb54a7cb3d55edbeec5682a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:07.955938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5265aacf-3eb7-4464-8751-4a0775db682b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de7257c0cb54a7cb3d55edbeec5682a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:07.976371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5265aacf-3eb7-4464-8751-4a0775db682b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de7257c0cb54a7cb3d55edbeec5682a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:07.977083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5265aacf-3eb7-4464-8751-4a0775db682b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de7257c0cb54a7cb3d55edbeec5682a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:08.023642 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2307/4591] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:22:07 2022] DELETE /identity/v3/users/0de7257c0cb54a7cb3d55edbeec5682a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:08.735700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddd552-e21f-4bae-a3d8-5372231b331a service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:08.770120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddd552-e21f-4bae-a3d8-5372231b331a service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:08.956387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c97ca-e3a7-4ca0-806c-fe65554b44ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:08.957368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c97ca-e3a7-4ca0-806c-fe65554b44ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:08.957778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c97ca-e3a7-4ca0-806c-fe65554b44ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:08.958239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c97ca-e3a7-4ca0-806c-fe65554b44ee admin admin] PATH_INFO: `/v3/projects/46e1305700024ba791659001cdce0542` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:08.962221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c97ca-e3a7-4ca0-806c-fe65554b44ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e1305700024ba791659001cdce0542)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:08.980685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c97ca-e3a7-4ca0-806c-fe65554b44ee admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:09.112792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-585c97ca-e3a7-4ca0-806c-fe65554b44ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e1305700024ba791659001cdce0542', 'request_id': 'req-585c97ca-e3a7-4ca0-806c-fe65554b44ee'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:09.124872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-585c97ca-e3a7-4ca0-806c-fe65554b44ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e1305700024ba791659001cdce0542', 'request_id': 'req-585c97ca-e3a7-4ca0-806c-fe65554b44ee'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:09.143808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-585c97ca-e3a7-4ca0-806c-fe65554b44ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e1305700024ba791659001cdce0542', 'request_id': 'req-585c97ca-e3a7-4ca0-806c-fe65554b44ee'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:09.168407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-585c97ca-e3a7-4ca0-806c-fe65554b44ee admin admin] The token cache is being invalidate because project 46e1305700024ba791659001cdce0542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:22:09.168544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-585c97ca-e3a7-4ca0-806c-fe65554b44ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:09.169244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-585c97ca-e3a7-4ca0-806c-fe65554b44ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:09.176964 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2285/4592] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:22:08 2022] DELETE /identity/v3/projects/46e1305700024ba791659001cdce0542 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:22:09.179847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bea162-2d16-4c98-add8-c03c1db7aace None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:09.180656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bea162-2d16-4c98-add8-c03c1db7aace None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:09.181080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bea162-2d16-4c98-add8-c03c1db7aace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:09.211732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-27bea162-2d16-4c98-add8-c03c1db7aace None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:09.213784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-27bea162-2d16-4c98-add8-c03c1db7aace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:09.292260 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2308/4593] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:09.301383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553970-f04d-4d70-a7be-20cde615bb1b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:09.301672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553970-f04d-4d70-a7be-20cde615bb1b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:09.301951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553970-f04d-4d70-a7be-20cde615bb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:09.339099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-aa553970-f04d-4d70-a7be-20cde615bb1b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:09.341645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aa553970-f04d-4d70-a7be-20cde615bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:09.379902 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2286/4594] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:09.380276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bea162-2d16-4c98-add8-c03c1db7aace None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:09.396100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bea162-2d16-4c98-add8-c03c1db7aace None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:09.408468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d1b60-cc30-4fff-8440-d38116464188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:09.409112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d1b60-cc30-4fff-8440-d38116464188 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:09.409389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d1b60-cc30-4fff-8440-d38116464188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:09.409656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d1b60-cc30-4fff-8440-d38116464188 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:09.410396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d1b60-cc30-4fff-8440-d38116464188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:22:09.410595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d1b60-cc30-4fff-8440-d38116464188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:09.412258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d1b60-cc30-4fff-8440-d38116464188 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:09.437232 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2309/4595] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:22:09.444466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553970-f04d-4d70-a7be-20cde615bb1b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:09.461649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553970-f04d-4d70-a7be-20cde615bb1b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:09.473645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8988e-a794-4a8e-a422-ef25f5d74948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:09.475618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8988e-a794-4a8e-a422-ef25f5d74948 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:09.477079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8988e-a794-4a8e-a422-ef25f5d74948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:09.477557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8988e-a794-4a8e-a422-ef25f5d74948 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:09.481659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8988e-a794-4a8e-a422-ef25f5d74948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:09.484076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8988e-a794-4a8e-a422-ef25f5d74948 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:09.531864 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2287/4596] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:22:09 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:22:09.532856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d1b60-cc30-4fff-8440-d38116464188 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:09.565013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d1b60-cc30-4fff-8440-d38116464188 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:09.683964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a22690-127d-411c-9e1f-dc12026103b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:09.684823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a22690-127d-411c-9e1f-dc12026103b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:09.685727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a22690-127d-411c-9e1f-dc12026103b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:09.686737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a22690-127d-411c-9e1f-dc12026103b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:09.687483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a22690-127d-411c-9e1f-dc12026103b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:09.689924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a22690-127d-411c-9e1f-dc12026103b5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:09.703770 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:09.736826 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2310/4597] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:22:09 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:22:09.740497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8988e-a794-4a8e-a422-ef25f5d74948 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:09.756303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8988e-a794-4a8e-a422-ef25f5d74948 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:09.769358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e977a6-ed03-44b4-9c1b-16843b1d4b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:09.769606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e977a6-ed03-44b4-9c1b-16843b1d4b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:09.769949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e977a6-ed03-44b4-9c1b-16843b1d4b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:09.770098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e977a6-ed03-44b4-9c1b-16843b1d4b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:09.770666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e977a6-ed03-44b4-9c1b-16843b1d4b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:09.773115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e977a6-ed03-44b4-9c1b-16843b1d4b6e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:09.791077 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2288/4598] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:22:09.791738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a22690-127d-411c-9e1f-dc12026103b5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:09.805954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a22690-127d-411c-9e1f-dc12026103b5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:09.817923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975be94-9b8a-4308-a4ab-2539d879ee09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:09.818723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975be94-9b8a-4308-a4ab-2539d879ee09 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:09.819223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975be94-9b8a-4308-a4ab-2539d879ee09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:09.819798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975be94-9b8a-4308-a4ab-2539d879ee09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:09.820619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975be94-9b8a-4308-a4ab-2539d879ee09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:09.827782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975be94-9b8a-4308-a4ab-2539d879ee09 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:09.849627 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2311/4599] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:22:09.856479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e977a6-ed03-44b4-9c1b-16843b1d4b6e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:09.868878 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:09.877018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e977a6-ed03-44b4-9c1b-16843b1d4b6e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:09.891880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddf053-9a98-49b9-a0b3-a490be98deec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:09.894849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddf053-9a98-49b9-a0b3-a490be98deec admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:09.897026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddf053-9a98-49b9-a0b3-a490be98deec admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:09.897305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddf053-9a98-49b9-a0b3-a490be98deec admin admin] PATH_INFO: `/v3/projects/fc93a361db0a42c0ac90b82d20b91cff/users/85cb1d720ba24d7f908a93fffe29427b/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:09.955768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ddf053-9a98-49b9-a0b3-a490be98deec admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc93a361db0a42c0ac90b82d20b91cff, user_id=85cb1d720ba24d7f908a93fffe29427b, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:09.959157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ddf053-9a98-49b9-a0b3-a490be98deec admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:10.019955 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2289/4600] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:22:09 2022] PUT /identity/v3/projects/fc93a361db0a42c0ac90b82d20b91cff/users/85cb1d720ba24d7f908a93fffe29427b/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:10.023025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b4e7e-dc3a-47e0-93fd-25b32bbd2791 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:10.023311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b4e7e-dc3a-47e0-93fd-25b32bbd2791 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:10.023756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b4e7e-dc3a-47e0-93fd-25b32bbd2791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:10.059865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cd1b4e7e-dc3a-47e0-93fd-25b32bbd2791 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:10.061094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cd1b4e7e-dc3a-47e0-93fd-25b32bbd2791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:10.242825 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2312/4601] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:10.257861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddf053-9a98-49b9-a0b3-a490be98deec admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:10.259768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f2ddf053-9a98-49b9-a0b3-a490be98deec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:10.378125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddf053-9a98-49b9-a0b3-a490be98deec admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:10.390569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084b136-4cbf-403f-80b5-b4108bffca22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:10.391572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084b136-4cbf-403f-80b5-b4108bffca22 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:10.392024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084b136-4cbf-403f-80b5-b4108bffca22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:10.392487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084b136-4cbf-403f-80b5-b4108bffca22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:10.413308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084b136-4cbf-403f-80b5-b4108bffca22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:10.414905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084b136-4cbf-403f-80b5-b4108bffca22 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:10.441345 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2290/4602] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:22:13.287873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa0cf7-09da-4e46-ac20-5b4e2948e33f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:13.288946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa0cf7-09da-4e46-ac20-5b4e2948e33f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:13.289401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa0cf7-09da-4e46-ac20-5b4e2948e33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:13.365404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-40fa0cf7-09da-4e46-ac20-5b4e2948e33f None None] MFA Rules not processed for user `df77c201bc0642c3befa09a7026c2efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:13.367024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-40fa0cf7-09da-4e46-ac20-5b4e2948e33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:13.517872 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2313/4603] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:14.176186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084b136-4cbf-403f-80b5-b4108bffca22 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:14.178904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2084b136-4cbf-403f-80b5-b4108bffca22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:14.405575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084b136-4cbf-403f-80b5-b4108bffca22 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:14.413632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8928d-821a-4a5f-afed-7fdf0a2d86c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:14.414650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8928d-821a-4a5f-afed-7fdf0a2d86c5 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:14.415316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8928d-821a-4a5f-afed-7fdf0a2d86c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:14.415840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8928d-821a-4a5f-afed-7fdf0a2d86c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:14.430352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8928d-821a-4a5f-afed-7fdf0a2d86c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:14.432334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8928d-821a-4a5f-afed-7fdf0a2d86c5 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:14.452095 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2291/4604] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:22:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:22:15.443068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa0cf7-09da-4e46-ac20-5b4e2948e33f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:15.444550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-40fa0cf7-09da-4e46-ac20-5b4e2948e33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:15.636044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa0cf7-09da-4e46-ac20-5b4e2948e33f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:15.647813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535f995-960f-436b-ae91-82ff872b7c34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:15.649726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535f995-960f-436b-ae91-82ff872b7c34 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:15.649961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535f995-960f-436b-ae91-82ff872b7c34 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:15.650293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535f995-960f-436b-ae91-82ff872b7c34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:15.654638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7535f995-960f-436b-ae91-82ff872b7c34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:15.672043 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:15.687909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535f995-960f-436b-ae91-82ff872b7c34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:15.689806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535f995-960f-436b-ae91-82ff872b7c34 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:15.716953 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2314/4605] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:22:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:22:23.884214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8928d-821a-4a5f-afed-7fdf0a2d86c5 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:23.887414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3fa8928d-821a-4a5f-afed-7fdf0a2d86c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:23.920203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8928d-821a-4a5f-afed-7fdf0a2d86c5 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:23.939189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:23.939955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:23.940328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:23.941080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] PATH_INFO: `/v3/users/d0213371a83f4a85bacc0ecdec5b2535` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:23.942595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0213371a83f4a85bacc0ecdec5b2535)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:23.949574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:24.072460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0213371a83f4a85bacc0ecdec5b2535'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:24.076034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0213371a83f4a85bacc0ecdec5b2535'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:24.128951 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:24.155553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0213371a83f4a85bacc0ecdec5b2535'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:24.183377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0213371a83f4a85bacc0ecdec5b2535'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:24.184138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0213371a83f4a85bacc0ecdec5b2535'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:24.221367 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2292/4606] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:22:23 2022] DELETE /identity/v3/users/d0213371a83f4a85bacc0ecdec5b2535 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:25.011199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535f995-960f-436b-ae91-82ff872b7c34 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:25.035158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535f995-960f-436b-ae91-82ff872b7c34 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:25.202949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:25.206494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:25.208194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:25.208655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843 admin admin] PATH_INFO: `/v3/projects/50faaea815f44af798f20a9977157801` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:25.211679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50faaea815f44af798f20a9977157801)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:25.217988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:25.354817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50faaea815f44af798f20a9977157801', 'request_id': 'req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:25.372376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50faaea815f44af798f20a9977157801', 'request_id': 'req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:25.392081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50faaea815f44af798f20a9977157801', 'request_id': 'req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:25.418180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843 admin admin] The token cache is being invalidate because project 50faaea815f44af798f20a9977157801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:22:25.419284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:25.421002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4529532-8aad-4fe1-bb7e-7d2dc38b4843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:25.427894 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2315/4607] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:22:25 2022] DELETE /identity/v3/projects/50faaea815f44af798f20a9977157801 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:25.433216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:25.435670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:25.463092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bca5d-64c8-40ed-bb22-f74920e53f8b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:25.466948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c71660-e4d6-442c-9759-099ddb94bd5b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:25.467233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c71660-e4d6-442c-9759-099ddb94bd5b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:25.467490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c71660-e4d6-442c-9759-099ddb94bd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:25.508763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-11c71660-e4d6-442c-9759-099ddb94bd5b None None] MFA Rules not processed for user `d5e97960c4eb488b900951e0898f34c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:25.510835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-11c71660-e4d6-442c-9759-099ddb94bd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:25.551714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae27bc7-24e9-4018-b9dc-ef38014a302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:25.552736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae27bc7-24e9-4018-b9dc-ef38014a302f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:25.553228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae27bc7-24e9-4018-b9dc-ef38014a302f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:25.553705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae27bc7-24e9-4018-b9dc-ef38014a302f admin admin] PATH_INFO: `/v3/users/e57fa00acff741b59c2abb7be4e7c6d8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:25.555369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae27bc7-24e9-4018-b9dc-ef38014a302f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e57fa00acff741b59c2abb7be4e7c6d8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:25.558671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae27bc7-24e9-4018-b9dc-ef38014a302f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:25.629032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ae27bc7-24e9-4018-b9dc-ef38014a302f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e57fa00acff741b59c2abb7be4e7c6d8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:25.629792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ae27bc7-24e9-4018-b9dc-ef38014a302f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e57fa00acff741b59c2abb7be4e7c6d8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:25.645153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ae27bc7-24e9-4018-b9dc-ef38014a302f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e57fa00acff741b59c2abb7be4e7c6d8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:25.668595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ae27bc7-24e9-4018-b9dc-ef38014a302f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e57fa00acff741b59c2abb7be4e7c6d8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:25.669551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9ae27bc7-24e9-4018-b9dc-ef38014a302f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e57fa00acff741b59c2abb7be4e7c6d8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:25.691522 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2293/4608] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:22:25 2022] DELETE /identity/v3/users/e57fa00acff741b59c2abb7be4e7c6d8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:25.714885 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2316/4609] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:26.875727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e612c2-16e1-4838-a64f-d11d1191e452 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:26.876216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e612c2-16e1-4838-a64f-d11d1191e452 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:26.876475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e612c2-16e1-4838-a64f-d11d1191e452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:26.939970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-85e612c2-16e1-4838-a64f-d11d1191e452 None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:26.941249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-85e612c2-16e1-4838-a64f-d11d1191e452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:27.053559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c71660-e4d6-442c-9759-099ddb94bd5b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:27.055317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-11c71660-e4d6-442c-9759-099ddb94bd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:27.071301 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:27.082779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c71660-e4d6-442c-9759-099ddb94bd5b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:27.121524 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2294/4610] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:27.123655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875eeda-5d8c-4734-b2c8-10c65ad9c55d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:27.124422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875eeda-5d8c-4734-b2c8-10c65ad9c55d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:27.126212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875eeda-5d8c-4734-b2c8-10c65ad9c55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:27.167545 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:27.175940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7875eeda-5d8c-4734-b2c8-10c65ad9c55d None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:27.178104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7875eeda-5d8c-4734-b2c8-10c65ad9c55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:27.192491 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2295/4611] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:27.208869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875eeda-5d8c-4734-b2c8-10c65ad9c55d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:27.210450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7875eeda-5d8c-4734-b2c8-10c65ad9c55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:27.239590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea627b-92eb-4cfc-b195-2a6900c9fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:27.240238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea627b-92eb-4cfc-b195-2a6900c9fe72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:27.240521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea627b-92eb-4cfc-b195-2a6900c9fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:27.240802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea627b-92eb-4cfc-b195-2a6900c9fe72 admin admin] PATH_INFO: `/v3/projects/211fbadd72b0429fadc3de0e7dcabef3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:27.242141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea627b-92eb-4cfc-b195-2a6900c9fe72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=211fbadd72b0429fadc3de0e7dcabef3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:27.250567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea627b-92eb-4cfc-b195-2a6900c9fe72 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:27.375718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ea627b-92eb-4cfc-b195-2a6900c9fe72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211fbadd72b0429fadc3de0e7dcabef3', 'request_id': 'req-10ea627b-92eb-4cfc-b195-2a6900c9fe72'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:27.390073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875eeda-5d8c-4734-b2c8-10c65ad9c55d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:27.391311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ea627b-92eb-4cfc-b195-2a6900c9fe72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211fbadd72b0429fadc3de0e7dcabef3', 'request_id': 'req-10ea627b-92eb-4cfc-b195-2a6900c9fe72'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:27.407346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ea627b-92eb-4cfc-b195-2a6900c9fe72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211fbadd72b0429fadc3de0e7dcabef3', 'request_id': 'req-10ea627b-92eb-4cfc-b195-2a6900c9fe72'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:27.428470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ea627b-92eb-4cfc-b195-2a6900c9fe72 admin admin] The token cache is being invalidate because project 211fbadd72b0429fadc3de0e7dcabef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:22:27.428810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ea627b-92eb-4cfc-b195-2a6900c9fe72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:27.429864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ea627b-92eb-4cfc-b195-2a6900c9fe72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:27.439872 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2317/4612] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:22:27 2022] DELETE /identity/v3/projects/211fbadd72b0429fadc3de0e7dcabef3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:27.441475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707dafc-2df5-413c-8385-e74e2d21b3eb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:27.441769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707dafc-2df5-413c-8385-e74e2d21b3eb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:27.442092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707dafc-2df5-413c-8385-e74e2d21b3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:27.465406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8707dafc-2df5-413c-8385-e74e2d21b3eb None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:27.466801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8707dafc-2df5-413c-8385-e74e2d21b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:27.562247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b531-4830-4498-bfc5-46d36aeb8ab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:27.563884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b531-4830-4498-bfc5-46d36aeb8ab6 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:27.569153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b531-4830-4498-bfc5-46d36aeb8ab6 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:27.569997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b531-4830-4498-bfc5-46d36aeb8ab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:27.578795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7ac7b531-4830-4498-bfc5-46d36aeb8ab6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:27.642247 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2318/4613] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:27.654179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87378579-6155-4315-aece-80c5c236e98a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:27.654636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87378579-6155-4315-aece-80c5c236e98a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:27.654840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87378579-6155-4315-aece-80c5c236e98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:27.699993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-87378579-6155-4315-aece-80c5c236e98a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:27.702111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-87378579-6155-4315-aece-80c5c236e98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:27.716019 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2319/4614] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:27.716946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87378579-6155-4315-aece-80c5c236e98a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:27.734550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87378579-6155-4315-aece-80c5c236e98a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:27.744711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68019e3f-da94-4c24-8edb-07510f10b1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:27.745785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68019e3f-da94-4c24-8edb-07510f10b1ba admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:27.746128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68019e3f-da94-4c24-8edb-07510f10b1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:27.746721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68019e3f-da94-4c24-8edb-07510f10b1ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:27.747616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68019e3f-da94-4c24-8edb-07510f10b1ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:22:27.747754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7b531-4830-4498-bfc5-46d36aeb8ab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:27.748114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68019e3f-da94-4c24-8edb-07510f10b1ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:27.749639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7b531-4830-4498-bfc5-46d36aeb8ab6 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:27.750482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68019e3f-da94-4c24-8edb-07510f10b1ba admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:27.772080 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2320/4615] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:22:27.775039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68019e3f-da94-4c24-8edb-07510f10b1ba admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:27.783712 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2296/4616] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:22:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:22:27.826699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68019e3f-da94-4c24-8edb-07510f10b1ba admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:27.845770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228787d-146f-4fbb-817f-e83bf36b5db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:27.846391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228787d-146f-4fbb-817f-e83bf36b5db0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:27.846668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228787d-146f-4fbb-817f-e83bf36b5db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:27.846963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228787d-146f-4fbb-817f-e83bf36b5db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:27.847615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228787d-146f-4fbb-817f-e83bf36b5db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:27.849520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228787d-146f-4fbb-817f-e83bf36b5db0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:27.895757 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2321/4617] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:22:27 2022] POST /identity/v3/projects => generated 395 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:22:27.896548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b531-4830-4498-bfc5-46d36aeb8ab6 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:27.911058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b531-4830-4498-bfc5-46d36aeb8ab6 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:27.935795 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:27.996202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52437c37-41a0-4465-a8e9-a258b13da8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:27.996933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52437c37-41a0-4465-a8e9-a258b13da8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:27.997221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52437c37-41a0-4465-a8e9-a258b13da8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:27.997705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52437c37-41a0-4465-a8e9-a258b13da8c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:27.998197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52437c37-41a0-4465-a8e9-a258b13da8c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:28.000223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52437c37-41a0-4465-a8e9-a258b13da8c9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:28.034265 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2297/4618] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:22:27 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:22:28.038032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228787d-146f-4fbb-817f-e83bf36b5db0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:28.050095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228787d-146f-4fbb-817f-e83bf36b5db0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:28.056538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5183fb-6dda-486e-aa5c-4b78c57b7e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:28.058746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5183fb-6dda-486e-aa5c-4b78c57b7e6e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:28.059372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5183fb-6dda-486e-aa5c-4b78c57b7e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:28.060040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5183fb-6dda-486e-aa5c-4b78c57b7e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:28.062064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5183fb-6dda-486e-aa5c-4b78c57b7e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:28.064253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5183fb-6dda-486e-aa5c-4b78c57b7e6e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:28.081040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52437c37-41a0-4465-a8e9-a258b13da8c9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:28.081735 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2322/4619] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:22:28.097111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52437c37-41a0-4465-a8e9-a258b13da8c9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:28.109839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98fd08-00ae-40ce-a306-bdc6b52ccbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:28.111237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98fd08-00ae-40ce-a306-bdc6b52ccbfa admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:28.111924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98fd08-00ae-40ce-a306-bdc6b52ccbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:28.112442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98fd08-00ae-40ce-a306-bdc6b52ccbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:28.114120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98fd08-00ae-40ce-a306-bdc6b52ccbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:28.117497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98fd08-00ae-40ce-a306-bdc6b52ccbfa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:28.141560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5183fb-6dda-486e-aa5c-4b78c57b7e6e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:28.152581 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2298/4620] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:22:28.155865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5183fb-6dda-486e-aa5c-4b78c57b7e6e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:28.162563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb6d3f-a550-49fb-8610-efa79237dbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:28.163474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb6d3f-a550-49fb-8610-efa79237dbf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:28.163824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb6d3f-a550-49fb-8610-efa79237dbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:28.164636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb6d3f-a550-49fb-8610-efa79237dbf3 admin admin] PATH_INFO: `/v3/projects/f6ebbc8c81b34f09ae5df924df3097b6/users/2368cc38b0d74026b9414edfc10e7be6/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:28.170737 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:28.195210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb6d3f-a550-49fb-8610-efa79237dbf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ebbc8c81b34f09ae5df924df3097b6, user_id=2368cc38b0d74026b9414edfc10e7be6, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:28.198823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb6d3f-a550-49fb-8610-efa79237dbf3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:28.221686 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2323/4621] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:22:28 2022] PUT /identity/v3/projects/f6ebbc8c81b34f09ae5df924df3097b6/users/2368cc38b0d74026b9414edfc10e7be6/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:28.226777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab57b6-5acc-4157-83c5-08d4f7aaa4d7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:28.227136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab57b6-5acc-4157-83c5-08d4f7aaa4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:28.227588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab57b6-5acc-4157-83c5-08d4f7aaa4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:28.256074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-87ab57b6-5acc-4157-83c5-08d4f7aaa4d7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:28.257305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-87ab57b6-5acc-4157-83c5-08d4f7aaa4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:28.339619 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2299/4622] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:22:28.354322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb6d3f-a550-49fb-8610-efa79237dbf3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:28.357360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9eeb6d3f-a550-49fb-8610-efa79237dbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:28.430534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb6d3f-a550-49fb-8610-efa79237dbf3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:28.434793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea58bf-464d-4f9a-96b3-c1a0a71a2b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:28.435447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea58bf-464d-4f9a-96b3-c1a0a71a2b55 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:28.435723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea58bf-464d-4f9a-96b3-c1a0a71a2b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:28.436049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea58bf-464d-4f9a-96b3-c1a0a71a2b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:28.452681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea58bf-464d-4f9a-96b3-c1a0a71a2b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:28.454811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea58bf-464d-4f9a-96b3-c1a0a71a2b55 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:28.479321 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2324/4623] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:22:38.099683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab57b6-5acc-4157-83c5-08d4f7aaa4d7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:38.102587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-87ab57b6-5acc-4157-83c5-08d4f7aaa4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:38.129505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab57b6-5acc-4157-83c5-08d4f7aaa4d7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:38.148564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:38.153696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:38.159764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:38.160289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] PATH_INFO: `/v3/users/b6df024260584082b0c18f7fcc54c3fe` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:38.164753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6df024260584082b0c18f7fcc54c3fe)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:38.173458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:38.296660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6df024260584082b0c18f7fcc54c3fe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:38.298351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6df024260584082b0c18f7fcc54c3fe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:38.336715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6df024260584082b0c18f7fcc54c3fe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:38.356503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6df024260584082b0c18f7fcc54c3fe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:38.357709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6df024260584082b0c18f7fcc54c3fe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:38.387490 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2300/4624] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:22:38 2022] DELETE /identity/v3/users/b6df024260584082b0c18f7fcc54c3fe => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:38.466390 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:39.425808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea58bf-464d-4f9a-96b3-c1a0a71a2b55 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:39.450951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea58bf-464d-4f9a-96b3-c1a0a71a2b55 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:39.592343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:39.593941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:39.594398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:39.594817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] PATH_INFO: `/v3/projects/106fa570fa4443eca19731dcae1460c1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:39.598904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] RBAC: Authorizing `identity:delete_project(project_id=106fa570fa4443eca19731dcae1460c1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:39.601295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:39.728991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106fa570fa4443eca19731dcae1460c1', 'request_id': 'req-a5005480-a118-4ea3-8093-9e767a97febb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:39.747625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106fa570fa4443eca19731dcae1460c1', 'request_id': 'req-a5005480-a118-4ea3-8093-9e767a97febb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:39.763505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106fa570fa4443eca19731dcae1460c1', 'request_id': 'req-a5005480-a118-4ea3-8093-9e767a97febb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:39.781496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] The token cache is being invalidate because project 106fa570fa4443eca19731dcae1460c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:22:39.781834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:39.789294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:39.791725 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2325/4625] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:22:39 2022] DELETE /identity/v3/projects/106fa570fa4443eca19731dcae1460c1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:39.795788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:39.797207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:39.815014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96f0b8-7474-4b52-9806-d9dd98cc6f9c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:39.822407 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:39.947893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd1148-5b81-41b0-ac52-18e52eea3e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:39.950874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd1148-5b81-41b0-ac52-18e52eea3e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:39.951686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd1148-5b81-41b0-ac52-18e52eea3e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:39.952141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd1148-5b81-41b0-ac52-18e52eea3e30 admin admin] PATH_INFO: `/v3/users/df77c201bc0642c3befa09a7026c2efb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:39.954470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd1148-5b81-41b0-ac52-18e52eea3e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df77c201bc0642c3befa09a7026c2efb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:39.957072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd1148-5b81-41b0-ac52-18e52eea3e30 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:40.054308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22cd1148-5b81-41b0-ac52-18e52eea3e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df77c201bc0642c3befa09a7026c2efb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:40.057276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22cd1148-5b81-41b0-ac52-18e52eea3e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df77c201bc0642c3befa09a7026c2efb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:40.086814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22cd1148-5b81-41b0-ac52-18e52eea3e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df77c201bc0642c3befa09a7026c2efb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:40.103222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22cd1148-5b81-41b0-ac52-18e52eea3e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df77c201bc0642c3befa09a7026c2efb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:40.105178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22cd1148-5b81-41b0-ac52-18e52eea3e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df77c201bc0642c3befa09a7026c2efb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:40.135769 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2301/4626] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:22:39 2022] DELETE /identity/v3/users/df77c201bc0642c3befa09a7026c2efb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:40.887828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:40.890500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:40.914717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5005480-a118-4ea3-8093-9e767a97febb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:41.105982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856f95-f402-4b92-9894-93c67f0a681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:41.106636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856f95-f402-4b92-9894-93c67f0a681e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:41.106943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856f95-f402-4b92-9894-93c67f0a681e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:41.107219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856f95-f402-4b92-9894-93c67f0a681e admin admin] PATH_INFO: `/v3/projects/3210b552007d4889bd3921227d5eb3e9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:41.108358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856f95-f402-4b92-9894-93c67f0a681e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3210b552007d4889bd3921227d5eb3e9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:41.110454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856f95-f402-4b92-9894-93c67f0a681e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:41.176413 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:41.216307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1856f95-f402-4b92-9894-93c67f0a681e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3210b552007d4889bd3921227d5eb3e9', 'request_id': 'req-f1856f95-f402-4b92-9894-93c67f0a681e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:41.230447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1856f95-f402-4b92-9894-93c67f0a681e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3210b552007d4889bd3921227d5eb3e9', 'request_id': 'req-f1856f95-f402-4b92-9894-93c67f0a681e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:41.245079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1856f95-f402-4b92-9894-93c67f0a681e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3210b552007d4889bd3921227d5eb3e9', 'request_id': 'req-f1856f95-f402-4b92-9894-93c67f0a681e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:41.268915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1856f95-f402-4b92-9894-93c67f0a681e admin admin] The token cache is being invalidate because project 3210b552007d4889bd3921227d5eb3e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:22:41.269221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1856f95-f402-4b92-9894-93c67f0a681e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:41.274014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1856f95-f402-4b92-9894-93c67f0a681e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:22:41.276400 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2326/4627] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:22:40 2022] DELETE /identity/v3/projects/3210b552007d4889bd3921227d5eb3e9 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:41.283259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcde8f-1e81-4add-ba34-bec6fe0c2972 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:41.283749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcde8f-1e81-4add-ba34-bec6fe0c2972 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:41.284240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcde8f-1e81-4add-ba34-bec6fe0c2972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:41.321118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-14fcde8f-1e81-4add-ba34-bec6fe0c2972 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:41.324925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-14fcde8f-1e81-4add-ba34-bec6fe0c2972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:41.419763 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2302/4628] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:41.428261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf6281-2f3f-47ca-b036-53c62c3cef58 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:41.428836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf6281-2f3f-47ca-b036-53c62c3cef58 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:41.429269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf6281-2f3f-47ca-b036-53c62c3cef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:41.465454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-47bf6281-2f3f-47ca-b036-53c62c3cef58 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:41.471960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47bf6281-2f3f-47ca-b036-53c62c3cef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:41.503527 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2327/4629] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:41.508148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcde8f-1e81-4add-ba34-bec6fe0c2972 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:41.545509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcde8f-1e81-4add-ba34-bec6fe0c2972 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:41.574828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e781dd6-9cfd-4208-b98a-322d47e4162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:41.575500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781dd6-9cfd-4208-b98a-322d47e4162a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:41.575785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781dd6-9cfd-4208-b98a-322d47e4162a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:41.576702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781dd6-9cfd-4208-b98a-322d47e4162a admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:41.576826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e781dd6-9cfd-4208-b98a-322d47e4162a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:22:41.577065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e781dd6-9cfd-4208-b98a-322d47e4162a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:41.582095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e781dd6-9cfd-4208-b98a-322d47e4162a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:41.636040 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2303/4630] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:22:41.641508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf6281-2f3f-47ca-b036-53c62c3cef58 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:41.672720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf6281-2f3f-47ca-b036-53c62c3cef58 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:41.703246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e435dcf-9ac0-46f0-887c-436fa393bed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:41.703869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435dcf-9ac0-46f0-887c-436fa393bed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:41.706988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435dcf-9ac0-46f0-887c-436fa393bed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:41.709964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435dcf-9ac0-46f0-887c-436fa393bed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:41.713661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e435dcf-9ac0-46f0-887c-436fa393bed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:41.724162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e435dcf-9ac0-46f0-887c-436fa393bed5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:41.830706 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2328/4631] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:22:41 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:22:41.831693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e781dd6-9cfd-4208-b98a-322d47e4162a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:41.857799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e781dd6-9cfd-4208-b98a-322d47e4162a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:41.894959 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:42.096399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f842142-411c-478d-9cef-c77f0b953512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:42.097390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f842142-411c-478d-9cef-c77f0b953512 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:42.097951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f842142-411c-478d-9cef-c77f0b953512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:42.098489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f842142-411c-478d-9cef-c77f0b953512 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:42.099613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f842142-411c-478d-9cef-c77f0b953512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:42.101750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f842142-411c-478d-9cef-c77f0b953512 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:42.141445 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2304/4632] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:22:41 2022] POST /identity/v3/users => generated 287 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:22:42.141680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e435dcf-9ac0-46f0-887c-436fa393bed5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:42.155461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e435dcf-9ac0-46f0-887c-436fa393bed5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:42.164659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92c507-2c6b-4fad-a11d-7fc42949192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:42.166694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92c507-2c6b-4fad-a11d-7fc42949192f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:42.167793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92c507-2c6b-4fad-a11d-7fc42949192f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:42.168237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92c507-2c6b-4fad-a11d-7fc42949192f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:42.169640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92c507-2c6b-4fad-a11d-7fc42949192f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:42.172197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92c507-2c6b-4fad-a11d-7fc42949192f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:42.198951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f842142-411c-478d-9cef-c77f0b953512 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:42.202403 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2329/4633] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:22:42.210685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f842142-411c-478d-9cef-c77f0b953512 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:42.226280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320997c-62c9-4670-b2a1-0e9e0266b0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:42.227431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320997c-62c9-4670-b2a1-0e9e0266b0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:42.228464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320997c-62c9-4670-b2a1-0e9e0266b0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:42.229059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320997c-62c9-4670-b2a1-0e9e0266b0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:42.230140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320997c-62c9-4670-b2a1-0e9e0266b0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:42.233639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320997c-62c9-4670-b2a1-0e9e0266b0d5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:42.257374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92c507-2c6b-4fad-a11d-7fc42949192f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:42.267027 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2305/4634] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:22:42.271698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92c507-2c6b-4fad-a11d-7fc42949192f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:42.278847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe37b-1326-4baa-8680-d607f52b166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:42.280792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe37b-1326-4baa-8680-d607f52b166c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:42.281460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe37b-1326-4baa-8680-d607f52b166c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:42.282152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe37b-1326-4baa-8680-d607f52b166c admin admin] PATH_INFO: `/v3/projects/0d53034488714fc8980132211d0d5c0b/users/88d5c0890ae64fd6aa7e7e547e9bf736/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:42.318870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfe37b-1326-4baa-8680-d607f52b166c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d53034488714fc8980132211d0d5c0b, user_id=88d5c0890ae64fd6aa7e7e547e9bf736, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:42.321888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfe37b-1326-4baa-8680-d607f52b166c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:42.360396 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2330/4635] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:22:42 2022] PUT /identity/v3/projects/0d53034488714fc8980132211d0d5c0b/users/88d5c0890ae64fd6aa7e7e547e9bf736/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:42.371068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790d62f-c231-4bd2-bff6-371b69f64d7d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:42.371957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790d62f-c231-4bd2-bff6-371b69f64d7d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:42.372398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790d62f-c231-4bd2-bff6-371b69f64d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:42.407472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6790d62f-c231-4bd2-bff6-371b69f64d7d None None] MFA Rules not processed for user `88d5c0890ae64fd6aa7e7e547e9bf736`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:42.409142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6790d62f-c231-4bd2-bff6-371b69f64d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:42.578127 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2306/4636] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:42.579700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe37b-1326-4baa-8680-d607f52b166c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:42.696983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe37b-1326-4baa-8680-d607f52b166c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:42.704970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f2d2e-0789-4816-a6be-b660fac015d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:42.706351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2d2e-0789-4816-a6be-b660fac015d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:42.706634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2d2e-0789-4816-a6be-b660fac015d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:42.706909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2d2e-0789-4816-a6be-b660fac015d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:42.707574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f2d2e-0789-4816-a6be-b660fac015d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:42.713699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f2d2e-0789-4816-a6be-b660fac015d8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:42.799435 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2331/4637] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:22:42 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:22:42.803725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790d62f-c231-4bd2-bff6-371b69f64d7d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:42.826706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790d62f-c231-4bd2-bff6-371b69f64d7d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:42.945309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d0009-a355-44f5-8611-8544fc405ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:42.945865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d0009-a355-44f5-8611-8544fc405ded admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:42.946149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d0009-a355-44f5-8611-8544fc405ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:42.946438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d0009-a355-44f5-8611-8544fc405ded admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:42.947138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d0009-a355-44f5-8611-8544fc405ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:42.949177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d0009-a355-44f5-8611-8544fc405ded admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:42.983098 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2307/4638] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:22:42 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:22:42.983924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f2d2e-0789-4816-a6be-b660fac015d8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:42.997095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f2d2e-0789-4816-a6be-b660fac015d8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:43.025147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0301ff-6507-4f7d-9566-c109a50d54e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:43.026054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0301ff-6507-4f7d-9566-c109a50d54e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:43.026545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0301ff-6507-4f7d-9566-c109a50d54e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:43.027080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0301ff-6507-4f7d-9566-c109a50d54e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:43.027945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0301ff-6507-4f7d-9566-c109a50d54e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:43.029794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0301ff-6507-4f7d-9566-c109a50d54e7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:43.056272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da5696-fea8-4068-abd6-e4d30c40e14d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:43.056667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da5696-fea8-4068-abd6-e4d30c40e14d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:43.057044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da5696-fea8-4068-abd6-e4d30c40e14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:43.098573 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2332/4639] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:22:43.099604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0301ff-6507-4f7d-9566-c109a50d54e7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:43.110402 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:43.115150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0301ff-6507-4f7d-9566-c109a50d54e7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:43.118510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b2da5696-fea8-4068-abd6-e4d30c40e14d None None] MFA Rules not processed for user `2368cc38b0d74026b9414edfc10e7be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:43.120623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b2da5696-fea8-4068-abd6-e4d30c40e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:43.146322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0c023-fa89-47a2-a615-e986ea64ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:43.147039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0c023-fa89-47a2-a615-e986ea64ec11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:43.147321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0c023-fa89-47a2-a615-e986ea64ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:43.147594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0c023-fa89-47a2-a615-e986ea64ec11 admin admin] PATH_INFO: `/v3/projects/bde8798c6adc4297805fbb316f563785/users/1054183fb3d7417998116c710da08448/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:43.192078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0c023-fa89-47a2-a615-e986ea64ec11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde8798c6adc4297805fbb316f563785, user_id=1054183fb3d7417998116c710da08448, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:43.196001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0c023-fa89-47a2-a615-e986ea64ec11 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:43.259693 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2333/4640] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:22:43 2022] PUT /identity/v3/projects/bde8798c6adc4297805fbb316f563785/users/1054183fb3d7417998116c710da08448/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:43.263983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0c023-fa89-47a2-a615-e986ea64ec11 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:43.283117 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:43.314695 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2308/4641] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:22:43.327076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070ff38-9f49-41da-92f7-86ef844324d4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:43.327509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070ff38-9f49-41da-92f7-86ef844324d4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:43.327891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070ff38-9f49-41da-92f7-86ef844324d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:43.370390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1070ff38-9f49-41da-92f7-86ef844324d4 None None] MFA Rules not processed for user `2368cc38b0d74026b9414edfc10e7be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:43.372572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1070ff38-9f49-41da-92f7-86ef844324d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:43.419723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0c023-fa89-47a2-a615-e986ea64ec11 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:43.434673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eec3f-c054-44b9-be60-69f409769cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:43.435597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eec3f-c054-44b9-be60-69f409769cad admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:43.436138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eec3f-c054-44b9-be60-69f409769cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:43.437320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eec3f-c054-44b9-be60-69f409769cad admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:43.438519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682eec3f-c054-44b9-be60-69f409769cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:43.442537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682eec3f-c054-44b9-be60-69f409769cad admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:43.474240 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2334/4642] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:22:43.476322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eec3f-c054-44b9-be60-69f409769cad admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:43.497160 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2309/4643] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:22:43.503487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eec3f-c054-44b9-be60-69f409769cad admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:43.510778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345958ba-96fe-4c0f-8550-643e2652627b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:43.511789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345958ba-96fe-4c0f-8550-643e2652627b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:43.512274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345958ba-96fe-4c0f-8550-643e2652627b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:43.512801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345958ba-96fe-4c0f-8550-643e2652627b admin admin] PATH_INFO: `/v3/projects/bde8798c6adc4297805fbb316f563785/users/1054183fb3d7417998116c710da08448/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:43.517438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345958ba-96fe-4c0f-8550-643e2652627b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde8798c6adc4297805fbb316f563785, user_id=1054183fb3d7417998116c710da08448, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:43.522348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345958ba-96fe-4c0f-8550-643e2652627b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:43.563414 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2335/4644] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:22:43 2022] PUT /identity/v3/projects/bde8798c6adc4297805fbb316f563785/users/1054183fb3d7417998116c710da08448/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:22:43.573719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a15844-1515-4b61-9a48-e250c1dc3e2f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:43.574016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a15844-1515-4b61-9a48-e250c1dc3e2f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:43.574295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a15844-1515-4b61-9a48-e250c1dc3e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:43.625093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-52a15844-1515-4b61-9a48-e250c1dc3e2f None None] MFA Rules not processed for user `1054183fb3d7417998116c710da08448`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:43.626814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-52a15844-1515-4b61-9a48-e250c1dc3e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:43.751548 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2310/4645] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:43.771557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345958ba-96fe-4c0f-8550-643e2652627b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:43.776531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-345958ba-96fe-4c0f-8550-643e2652627b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:43.803617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a15844-1515-4b61-9a48-e250c1dc3e2f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:43.805343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-52a15844-1515-4b61-9a48-e250c1dc3e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:43.893419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345958ba-96fe-4c0f-8550-643e2652627b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:43.902114 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:43.908939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cf24f-617b-47f5-ad7e-bdd60c42432d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:43.909571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf24f-617b-47f5-ad7e-bdd60c42432d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:43.909906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf24f-617b-47f5-ad7e-bdd60c42432d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:43.910180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf24f-617b-47f5-ad7e-bdd60c42432d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:43.992083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a15844-1515-4b61-9a48-e250c1dc3e2f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:44.010600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff49ae-0ead-4f96-b2e3-0436c6d66645 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:44.011626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff49ae-0ead-4f96-b2e3-0436c6d66645 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:44.011980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff49ae-0ead-4f96-b2e3-0436c6d66645 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:44.012600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff49ae-0ead-4f96-b2e3-0436c6d66645 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:44.060750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cf24f-617b-47f5-ad7e-bdd60c42432d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:44.063206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cf24f-617b-47f5-ad7e-bdd60c42432d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:44.078476 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2336/4646] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:22:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:22:44.185644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff49ae-0ead-4f96-b2e3-0436c6d66645 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:44.190070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff49ae-0ead-4f96-b2e3-0436c6d66645 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:44.221333 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2311/4647] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:22:43 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:22:45.961634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab68120-ca2a-449b-9e75-57e66e423c59 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:45.962236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab68120-ca2a-449b-9e75-57e66e423c59 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:45.962236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab68120-ca2a-449b-9e75-57e66e423c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:46.001236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9ab68120-ca2a-449b-9e75-57e66e423c59 None None] MFA Rules not processed for user `a3ac1408c91c4db59f4639abdca2c98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:46.003068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9ab68120-ca2a-449b-9e75-57e66e423c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:46.095765 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:46.136164 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2337/4648] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:48.193908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff49ae-0ead-4f96-b2e3-0436c6d66645 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:48.195417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f1ff49ae-0ead-4f96-b2e3-0436c6d66645 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:48.290601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff49ae-0ead-4f96-b2e3-0436c6d66645 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:48.305242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb12b53-22f9-4ba0-b6ce-f9d72c952f06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:48.308909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb12b53-22f9-4ba0-b6ce-f9d72c952f06 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:48.309486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb12b53-22f9-4ba0-b6ce-f9d72c952f06 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:48.311311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb12b53-22f9-4ba0-b6ce-f9d72c952f06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:48.316122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aeb12b53-22f9-4ba0-b6ce-f9d72c952f06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:48.331882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab68120-ca2a-449b-9e75-57e66e423c59 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:48.336021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9ab68120-ca2a-449b-9e75-57e66e423c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:48.352574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb12b53-22f9-4ba0-b6ce-f9d72c952f06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:48.354402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb12b53-22f9-4ba0-b6ce-f9d72c952f06 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:48.359808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab68120-ca2a-449b-9e75-57e66e423c59 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:48.369582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef5c3b-6cba-4564-a59b-f39030d8577d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:48.370761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef5c3b-6cba-4564-a59b-f39030d8577d service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:48.372170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef5c3b-6cba-4564-a59b-f39030d8577d service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:48.372670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef5c3b-6cba-4564-a59b-f39030d8577d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:48.375672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-29ef5c3b-6cba-4564-a59b-f39030d8577d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:48.394182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef5c3b-6cba-4564-a59b-f39030d8577d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:48.399324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef5c3b-6cba-4564-a59b-f39030d8577d service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:48.407098 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2312/4649] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:22:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:22:48.440107 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2338/4650] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:22:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:22:48.622591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867e1ca-bcee-4d7a-b2ea-d7e952147bc1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:48.622983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867e1ca-bcee-4d7a-b2ea-d7e952147bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:48.623368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867e1ca-bcee-4d7a-b2ea-d7e952147bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:48.670844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e867e1ca-bcee-4d7a-b2ea-d7e952147bc1 None None] MFA Rules not processed for user `a3ac1408c91c4db59f4639abdca2c98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:48.672325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e867e1ca-bcee-4d7a-b2ea-d7e952147bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:48.686765 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2313/4651] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:22:49.588923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef5c3b-6cba-4564-a59b-f39030d8577d service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:22:49.591242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-29ef5c3b-6cba-4564-a59b-f39030d8577d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:49.607854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef5c3b-6cba-4564-a59b-f39030d8577d service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:22:49.612626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2960294-81fd-4ab3-90aa-b0fe3963a4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:22:49.613969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2960294-81fd-4ab3-90aa-b0fe3963a4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:49.614257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2960294-81fd-4ab3-90aa-b0fe3963a4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:49.614546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2960294-81fd-4ab3-90aa-b0fe3963a4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:49.627565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2960294-81fd-4ab3-90aa-b0fe3963a4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:22:49.629229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2960294-81fd-4ab3-90aa-b0fe3963a4b2 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:22:49.642036 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2339/4652] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:22:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:22:50.677888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8bd7b-ff6d-4589-9073-64352870ec7c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:22:50.678513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8bd7b-ff6d-4589-9073-64352870ec7c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:22:50.678513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8bd7b-ff6d-4589-9073-64352870ec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:22:50.725409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-60c8bd7b-ff6d-4589-9073-64352870ec7c None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:22:50.726671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-60c8bd7b-ff6d-4589-9073-64352870ec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:22:50.798136 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:50.812788 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2314/4653] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:22:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:22:59.636304 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=17 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:00.803506 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:01.022582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42778e-46e1-4099-8ee8-be4a9cb82810 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:01.023600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42778e-46e1-4099-8ee8-be4a9cb82810 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:01.024139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42778e-46e1-4099-8ee8-be4a9cb82810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:01.060918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6a42778e-46e1-4099-8ee8-be4a9cb82810 None None] MFA Rules not processed for user `88d5c0890ae64fd6aa7e7e547e9bf736`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:01.064968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6a42778e-46e1-4099-8ee8-be4a9cb82810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:01.081166 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2340/4654] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:03.218307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320d840-ae9d-404e-b21f-76a28557ac67 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:03.218847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320d840-ae9d-404e-b21f-76a28557ac67 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:03.219208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320d840-ae9d-404e-b21f-76a28557ac67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:03.251850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7320d840-ae9d-404e-b21f-76a28557ac67 None None] MFA Rules not processed for user `2368cc38b0d74026b9414edfc10e7be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:03.253312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7320d840-ae9d-404e-b21f-76a28557ac67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:03.273487 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2315/4655] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:03.405235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f46aa3-ff02-48e4-8391-df8fe3eb85ff None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:03.405721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f46aa3-ff02-48e4-8391-df8fe3eb85ff None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:03.405807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f46aa3-ff02-48e4-8391-df8fe3eb85ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:03.436650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461209-bd4b-43f3-bb44-b652ac6558b9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:03.437191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461209-bd4b-43f3-bb44-b652ac6558b9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:03.438016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461209-bd4b-43f3-bb44-b652ac6558b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:03.452546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-84f46aa3-ff02-48e4-8391-df8fe3eb85ff None None] MFA Rules not processed for user `7e7cdaa2d85d4ce698950075b98d5eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:03.454338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-84f46aa3-ff02-48e4-8391-df8fe3eb85ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:03.466365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-87461209-bd4b-43f3-bb44-b652ac6558b9 None None] MFA Rules not processed for user `2368cc38b0d74026b9414edfc10e7be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:03.468421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-87461209-bd4b-43f3-bb44-b652ac6558b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:03.483478 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2316/4656] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:03.516358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3567c-d59c-43be-8aaf-8eff1d7f0922 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:03.516780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3567c-d59c-43be-8aaf-8eff1d7f0922 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:03.517131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3567c-d59c-43be-8aaf-8eff1d7f0922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:03.554488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-51a3567c-d59c-43be-8aaf-8eff1d7f0922 None None] MFA Rules not processed for user `2368cc38b0d74026b9414edfc10e7be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:03.562258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-51a3567c-d59c-43be-8aaf-8eff1d7f0922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:03.598258 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2317/4657] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:03.604351 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2341/4658] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:03.629873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0690dac-c22f-4be2-b819-deda8b276412 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:03.630164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0690dac-c22f-4be2-b819-deda8b276412 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:03.631410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0690dac-c22f-4be2-b819-deda8b276412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:03.656547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a0690dac-c22f-4be2-b819-deda8b276412 None None] MFA Rules not processed for user `2368cc38b0d74026b9414edfc10e7be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:03.657755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a0690dac-c22f-4be2-b819-deda8b276412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:03.666048 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2318/4659] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:23:03.700009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98173dbf-e93b-4f64-9eba-18d6d4f6dc16 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:03.700298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98173dbf-e93b-4f64-9eba-18d6d4f6dc16 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:03.700585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98173dbf-e93b-4f64-9eba-18d6d4f6dc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:03.724294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-98173dbf-e93b-4f64-9eba-18d6d4f6dc16 None None] MFA Rules not processed for user `2368cc38b0d74026b9414edfc10e7be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:03.726077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-98173dbf-e93b-4f64-9eba-18d6d4f6dc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:03.737427 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2342/4660] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:04.158052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0690dac-c22f-4be2-b819-deda8b276412 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:04.168323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0690dac-c22f-4be2-b819-deda8b276412 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:04.171909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be6e27-a337-46f6-ab2f-31da2bbb74c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:04.172577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be6e27-a337-46f6-ab2f-31da2bbb74c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:04.172915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be6e27-a337-46f6-ab2f-31da2bbb74c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:04.173250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be6e27-a337-46f6-ab2f-31da2bbb74c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:04.175114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-40be6e27-a337-46f6-ab2f-31da2bbb74c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:04.186175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be6e27-a337-46f6-ab2f-31da2bbb74c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:04.187617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be6e27-a337-46f6-ab2f-31da2bbb74c9 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:04.196056 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2319/4661] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:23:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:23:05.756209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98173dbf-e93b-4f64-9eba-18d6d4f6dc16 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:05.758497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-98173dbf-e93b-4f64-9eba-18d6d4f6dc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:05.881837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98173dbf-e93b-4f64-9eba-18d6d4f6dc16 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:05.890998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d3c22-8105-49e4-a175-223ef9ab36ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:05.891920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d3c22-8105-49e4-a175-223ef9ab36ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:05.892376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d3c22-8105-49e4-a175-223ef9ab36ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:05.892811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d3c22-8105-49e4-a175-223ef9ab36ba admin admin] PATH_INFO: `/v3/users/cad50112141243a6a27812344e12cfec` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:05.894178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d3c22-8105-49e4-a175-223ef9ab36ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad50112141243a6a27812344e12cfec)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:05.896585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d3c22-8105-49e4-a175-223ef9ab36ba admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:05.991860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-224d3c22-8105-49e4-a175-223ef9ab36ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad50112141243a6a27812344e12cfec'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:05.992889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-224d3c22-8105-49e4-a175-223ef9ab36ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad50112141243a6a27812344e12cfec'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:06.030135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-224d3c22-8105-49e4-a175-223ef9ab36ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad50112141243a6a27812344e12cfec'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:06.046078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-224d3c22-8105-49e4-a175-223ef9ab36ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad50112141243a6a27812344e12cfec'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:06.047767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-224d3c22-8105-49e4-a175-223ef9ab36ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad50112141243a6a27812344e12cfec'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:06.067024 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2343/4662] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:23:05 2022] DELETE /identity/v3/users/cad50112141243a6a27812344e12cfec => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:06.440267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be6e27-a337-46f6-ab2f-31da2bbb74c9 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:06.458392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be6e27-a337-46f6-ab2f-31da2bbb74c9 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:06.605087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24417c2d-c0ee-4f08-a777-b3031884e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:06.606108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24417c2d-c0ee-4f08-a777-b3031884e7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:06.606108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24417c2d-c0ee-4f08-a777-b3031884e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:06.606341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24417c2d-c0ee-4f08-a777-b3031884e7f3 admin admin] PATH_INFO: `/v3/projects/0379a874918747449f5bbe24b6016495` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:06.607483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24417c2d-c0ee-4f08-a777-b3031884e7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0379a874918747449f5bbe24b6016495)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:06.610012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24417c2d-c0ee-4f08-a777-b3031884e7f3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:06.686858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-24417c2d-c0ee-4f08-a777-b3031884e7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0379a874918747449f5bbe24b6016495', 'request_id': 'req-24417c2d-c0ee-4f08-a777-b3031884e7f3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:06.697225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-24417c2d-c0ee-4f08-a777-b3031884e7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0379a874918747449f5bbe24b6016495', 'request_id': 'req-24417c2d-c0ee-4f08-a777-b3031884e7f3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:06.708495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-24417c2d-c0ee-4f08-a777-b3031884e7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0379a874918747449f5bbe24b6016495', 'request_id': 'req-24417c2d-c0ee-4f08-a777-b3031884e7f3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:06.724620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-24417c2d-c0ee-4f08-a777-b3031884e7f3 admin admin] The token cache is being invalidate because project 0379a874918747449f5bbe24b6016495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:06.724992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-24417c2d-c0ee-4f08-a777-b3031884e7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:06.725791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-24417c2d-c0ee-4f08-a777-b3031884e7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:06.727708 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2320/4663] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:06 2022] DELETE /identity/v3/projects/0379a874918747449f5bbe24b6016495 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:06.732371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c544ccb-ebf9-437b-bb49-5773b30b0f38 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:06.732659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c544ccb-ebf9-437b-bb49-5773b30b0f38 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:06.732961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c544ccb-ebf9-437b-bb49-5773b30b0f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:06.757050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2c544ccb-ebf9-437b-bb49-5773b30b0f38 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:06.760465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2c544ccb-ebf9-437b-bb49-5773b30b0f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:06.776796 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:06.891308 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2344/4664] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:06.895029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6466e0-58b6-464c-bb78-0d594601abe8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:06.896086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6466e0-58b6-464c-bb78-0d594601abe8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:06.896414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6466e0-58b6-464c-bb78-0d594601abe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:06.945712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ee6466e0-58b6-464c-bb78-0d594601abe8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:06.948569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ee6466e0-58b6-464c-bb78-0d594601abe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:06.975846 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2321/4665] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:06.977249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c544ccb-ebf9-437b-bb49-5773b30b0f38 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:06.993936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c544ccb-ebf9-437b-bb49-5773b30b0f38 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:07.007370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b6bae-b92f-49b5-8201-6115a404eaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:07.008381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6bae-b92f-49b5-8201-6115a404eaea admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:07.009481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6bae-b92f-49b5-8201-6115a404eaea admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:07.009953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6bae-b92f-49b5-8201-6115a404eaea admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:07.011144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b6bae-b92f-49b5-8201-6115a404eaea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:23:07.011878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b6bae-b92f-49b5-8201-6115a404eaea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:07.017604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b6bae-b92f-49b5-8201-6115a404eaea admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:07.045960 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2345/4666] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:07.049447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6466e0-58b6-464c-bb78-0d594601abe8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:07.063975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6466e0-58b6-464c-bb78-0d594601abe8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:07.076885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ba5d0-2254-4c3d-aa8b-92ec1bb14a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:07.077636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ba5d0-2254-4c3d-aa8b-92ec1bb14a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:07.078574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ba5d0-2254-4c3d-aa8b-92ec1bb14a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:07.079279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ba5d0-2254-4c3d-aa8b-92ec1bb14a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:07.082428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ba5d0-2254-4c3d-aa8b-92ec1bb14a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:07.089561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ba5d0-2254-4c3d-aa8b-92ec1bb14a1f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:07.149640 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2322/4667] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:07 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:07.154828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b6bae-b92f-49b5-8201-6115a404eaea admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:07.174321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b6bae-b92f-49b5-8201-6115a404eaea admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:07.264564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e25711-ef4c-4c40-ae76-6bcbcd0ff99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:07.265239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e25711-ef4c-4c40-ae76-6bcbcd0ff99b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:07.265522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e25711-ef4c-4c40-ae76-6bcbcd0ff99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:07.265788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e25711-ef4c-4c40-ae76-6bcbcd0ff99b admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:07.266412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e25711-ef4c-4c40-ae76-6bcbcd0ff99b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:07.268430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e25711-ef4c-4c40-ae76-6bcbcd0ff99b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:07.291596 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2346/4668] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:23:07 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:23:07.295764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ba5d0-2254-4c3d-aa8b-92ec1bb14a1f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:07.308893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ba5d0-2254-4c3d-aa8b-92ec1bb14a1f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:07.314562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea6b05-c4fd-46c8-9f9f-80fd4f6e4983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:07.315383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea6b05-c4fd-46c8-9f9f-80fd4f6e4983 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:07.315656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea6b05-c4fd-46c8-9f9f-80fd4f6e4983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:07.315924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea6b05-c4fd-46c8-9f9f-80fd4f6e4983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:07.316754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea6b05-c4fd-46c8-9f9f-80fd4f6e4983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:07.318347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea6b05-c4fd-46c8-9f9f-80fd4f6e4983 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:07.348276 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2323/4669] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:23:07.352164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e25711-ef4c-4c40-ae76-6bcbcd0ff99b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:07.363028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e25711-ef4c-4c40-ae76-6bcbcd0ff99b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:07.370375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524e7c0-d16f-4a51-b9d9-fcaf3eec263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:07.371263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524e7c0-d16f-4a51-b9d9-fcaf3eec263a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:07.371851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524e7c0-d16f-4a51-b9d9-fcaf3eec263a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:07.372304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524e7c0-d16f-4a51-b9d9-fcaf3eec263a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:07.373118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524e7c0-d16f-4a51-b9d9-fcaf3eec263a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:07.375558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524e7c0-d16f-4a51-b9d9-fcaf3eec263a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:07.388033 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2347/4670] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:23:07.392323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea6b05-c4fd-46c8-9f9f-80fd4f6e4983 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:07.402815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea6b05-c4fd-46c8-9f9f-80fd4f6e4983 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:07.408283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4118c2e-4f59-46d8-b373-a96794b7a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:07.408953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4118c2e-4f59-46d8-b373-a96794b7a5b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:07.409234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4118c2e-4f59-46d8-b373-a96794b7a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:07.409508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4118c2e-4f59-46d8-b373-a96794b7a5b1 admin admin] PATH_INFO: `/v3/projects/918ff4a0b6c34c4bbfd6e31f32967d70/users/baca0537d1844a8ea771011a6c062b30/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:07.419017 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:07.426848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4118c2e-4f59-46d8-b373-a96794b7a5b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918ff4a0b6c34c4bbfd6e31f32967d70, user_id=baca0537d1844a8ea771011a6c062b30, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:07.430423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4118c2e-4f59-46d8-b373-a96794b7a5b1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:07.447620 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2324/4671] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:23:07 2022] PUT /identity/v3/projects/918ff4a0b6c34c4bbfd6e31f32967d70/users/baca0537d1844a8ea771011a6c062b30/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:07.452885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50951a72-4e5b-40c1-b473-21566ea941ef None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:07.453176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50951a72-4e5b-40c1-b473-21566ea941ef None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:07.453455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50951a72-4e5b-40c1-b473-21566ea941ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:07.474431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-50951a72-4e5b-40c1-b473-21566ea941ef None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:07.476336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-50951a72-4e5b-40c1-b473-21566ea941ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:07.540307 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2348/4672] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:07.556398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4118c2e-4f59-46d8-b373-a96794b7a5b1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:07.558633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d4118c2e-4f59-46d8-b373-a96794b7a5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:07.642096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4118c2e-4f59-46d8-b373-a96794b7a5b1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:07.646786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715796b-7adc-45b4-8fdc-c125b5412729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:07.647689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715796b-7adc-45b4-8fdc-c125b5412729 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:07.647972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715796b-7adc-45b4-8fdc-c125b5412729 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:07.648241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715796b-7adc-45b4-8fdc-c125b5412729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:07.659349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715796b-7adc-45b4-8fdc-c125b5412729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:07.660907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715796b-7adc-45b4-8fdc-c125b5412729 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:07.678760 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2325/4673] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:23:13.461309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02a8ad-34ce-4626-b42e-e2c42e730282 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:13.462501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02a8ad-34ce-4626-b42e-e2c42e730282 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:13.462501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02a8ad-34ce-4626-b42e-e2c42e730282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:13.483670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7b02a8ad-34ce-4626-b42e-e2c42e730282 None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:13.484950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7b02a8ad-34ce-4626-b42e-e2c42e730282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:13.505423 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:13.559778 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2349/4674] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:17.675123 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:18.053891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d71437-7507-4f02-b348-33129c8625e3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:18.054293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d71437-7507-4f02-b348-33129c8625e3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:18.054690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d71437-7507-4f02-b348-33129c8625e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:18.110446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-14d71437-7507-4f02-b348-33129c8625e3 None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:18.112197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-14d71437-7507-4f02-b348-33129c8625e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:18.134699 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2326/4675] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:18.395244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458c8e4-d2cb-4e9f-bf31-e5d845215f79 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:18.396142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458c8e4-d2cb-4e9f-bf31-e5d845215f79 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:18.396622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458c8e4-d2cb-4e9f-bf31-e5d845215f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:18.420364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8458c8e4-d2cb-4e9f-bf31-e5d845215f79 None None] MFA Rules not processed for user `a3ac1408c91c4db59f4639abdca2c98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:18.421580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8458c8e4-d2cb-4e9f-bf31-e5d845215f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:18.487511 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2350/4676] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:19.896773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fa615-4fdf-4039-834a-28a8ec6638dd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:19.898240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fa615-4fdf-4039-834a-28a8ec6638dd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:19.898745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fa615-4fdf-4039-834a-28a8ec6638dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:19.934057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-115fa615-4fdf-4039-834a-28a8ec6638dd None None] MFA Rules not processed for user `baca0537d1844a8ea771011a6c062b30`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:19.936645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-115fa615-4fdf-4039-834a-28a8ec6638dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:20.049639 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2327/4677] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:20.061786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c86c24-8578-441d-ab83-04df134e03b0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:20.062791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c86c24-8578-441d-ab83-04df134e03b0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:20.063301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c86c24-8578-441d-ab83-04df134e03b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:20.108723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a3c86c24-8578-441d-ab83-04df134e03b0 None None] MFA Rules not processed for user `baca0537d1844a8ea771011a6c062b30`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:20.110248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a3c86c24-8578-441d-ab83-04df134e03b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:20.129706 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2351/4678] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:20.339254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fa615-4fdf-4039-834a-28a8ec6638dd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:20.341510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-115fa615-4fdf-4039-834a-28a8ec6638dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:20.658447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fa615-4fdf-4039-834a-28a8ec6638dd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:20.671207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da998cb-575e-4d27-94ed-92efa375caec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:20.673538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da998cb-575e-4d27-94ed-92efa375caec service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:20.674005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da998cb-575e-4d27-94ed-92efa375caec service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:20.678278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da998cb-575e-4d27-94ed-92efa375caec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:20.704575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da998cb-575e-4d27-94ed-92efa375caec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:20.715812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da998cb-575e-4d27-94ed-92efa375caec service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:20.738216 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2328/4679] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:23:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:23:21.676168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c86c24-8578-441d-ab83-04df134e03b0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:21.678129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a3c86c24-8578-441d-ab83-04df134e03b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:21.831168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da998cb-575e-4d27-94ed-92efa375caec service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:21.833284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1da998cb-575e-4d27-94ed-92efa375caec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:21.863174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da998cb-575e-4d27-94ed-92efa375caec service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:21.865669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c86c24-8578-441d-ab83-04df134e03b0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:21.879541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:21.880711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:21.881234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:21.882034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] PATH_INFO: `/v3/users/2368cc38b0d74026b9414edfc10e7be6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:21.887998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2368cc38b0d74026b9414edfc10e7be6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:21.888389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58fcc3-3165-41b7-8588-fbbfe2bb6aec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:21.889026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58fcc3-3165-41b7-8588-fbbfe2bb6aec service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:21.889304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58fcc3-3165-41b7-8588-fbbfe2bb6aec service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:21.889574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58fcc3-3165-41b7-8588-fbbfe2bb6aec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:21.893266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7a58fcc3-3165-41b7-8588-fbbfe2bb6aec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:21.896533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:21.920995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58fcc3-3165-41b7-8588-fbbfe2bb6aec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:21.925425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58fcc3-3165-41b7-8588-fbbfe2bb6aec service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:21.951775 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2352/4680] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:23:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:23:22.049651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2368cc38b0d74026b9414edfc10e7be6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:22.051976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2368cc38b0d74026b9414edfc10e7be6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:22.110217 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:22.117388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2368cc38b0d74026b9414edfc10e7be6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:22.141146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2368cc38b0d74026b9414edfc10e7be6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:22.143105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2368cc38b0d74026b9414edfc10e7be6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:22.169891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58fcc3-3165-41b7-8588-fbbfe2bb6aec service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:22.191817 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2329/4681] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:23:21 2022] DELETE /identity/v3/users/2368cc38b0d74026b9414edfc10e7be6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:23:22.195241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58fcc3-3165-41b7-8588-fbbfe2bb6aec service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:22.370512 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:22.401345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df39d32-71a2-4d93-863d-b932cdca3f38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:22.402240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df39d32-71a2-4d93-863d-b932cdca3f38 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:22.402658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df39d32-71a2-4d93-863d-b932cdca3f38 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:22.403308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df39d32-71a2-4d93-863d-b932cdca3f38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:22.405716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8df39d32-71a2-4d93-863d-b932cdca3f38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:22.460379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df39d32-71a2-4d93-863d-b932cdca3f38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:22.462389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df39d32-71a2-4d93-863d-b932cdca3f38 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:22.493724 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2353/4682] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:23:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:23:23.030702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:23.033809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:23.350954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d6f37-656f-40e8-93f4-ed915167d07b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:23.361396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e4023-5bb6-4360-a03d-a1a39c373261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:23.362749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e4023-5bb6-4360-a03d-a1a39c373261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:23.363433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e4023-5bb6-4360-a03d-a1a39c373261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:23.365152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e4023-5bb6-4360-a03d-a1a39c373261 admin admin] PATH_INFO: `/v3/projects/f6ebbc8c81b34f09ae5df924df3097b6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:23.367477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e4023-5bb6-4360-a03d-a1a39c373261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ebbc8c81b34f09ae5df924df3097b6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:23.370200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e4023-5bb6-4360-a03d-a1a39c373261 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:23.519859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9b6e4023-5bb6-4360-a03d-a1a39c373261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ebbc8c81b34f09ae5df924df3097b6', 'request_id': 'req-9b6e4023-5bb6-4360-a03d-a1a39c373261'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:23.532126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9b6e4023-5bb6-4360-a03d-a1a39c373261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ebbc8c81b34f09ae5df924df3097b6', 'request_id': 'req-9b6e4023-5bb6-4360-a03d-a1a39c373261'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:23.553815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9b6e4023-5bb6-4360-a03d-a1a39c373261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ebbc8c81b34f09ae5df924df3097b6', 'request_id': 'req-9b6e4023-5bb6-4360-a03d-a1a39c373261'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:23.588881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9b6e4023-5bb6-4360-a03d-a1a39c373261 admin admin] The token cache is being invalidate because project f6ebbc8c81b34f09ae5df924df3097b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:23.589377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9b6e4023-5bb6-4360-a03d-a1a39c373261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:23.590347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9b6e4023-5bb6-4360-a03d-a1a39c373261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:23.593236 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2330/4683] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:23 2022] DELETE /identity/v3/projects/f6ebbc8c81b34f09ae5df924df3097b6 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:23.599304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378b7b-f9ca-4dac-8c2b-1336b4b3e89d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:23.599886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378b7b-f9ca-4dac-8c2b-1336b4b3e89d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:23.600057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378b7b-f9ca-4dac-8c2b-1336b4b3e89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:23.651938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c9378b7b-f9ca-4dac-8c2b-1336b4b3e89d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:23.653642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c9378b7b-f9ca-4dac-8c2b-1336b4b3e89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:23.858964 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2354/4684] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:23.862614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfce63-07b1-40c8-bbee-e45fba0fdb4c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:23.863125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfce63-07b1-40c8-bbee-e45fba0fdb4c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:23.863552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfce63-07b1-40c8-bbee-e45fba0fdb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:23.928675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fdcfce63-07b1-40c8-bbee-e45fba0fdb4c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:23.934230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fdcfce63-07b1-40c8-bbee-e45fba0fdb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:23.979895 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2331/4685] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:23:23.995208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378b7b-f9ca-4dac-8c2b-1336b4b3e89d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:23.998171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e23be-203b-42cf-931b-9d6b49edd751 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:23.998453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e23be-203b-42cf-931b-9d6b49edd751 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:23.998727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e23be-203b-42cf-931b-9d6b49edd751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:24.004468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378b7b-f9ca-4dac-8c2b-1336b4b3e89d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:24.028491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354f3cf-6604-413a-9509-2e22e46145e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:24.029478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f3cf-6604-413a-9509-2e22e46145e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:24.029931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f3cf-6604-413a-9509-2e22e46145e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:24.030684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f3cf-6604-413a-9509-2e22e46145e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:24.031719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354f3cf-6604-413a-9509-2e22e46145e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:23:24.032172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354f3cf-6604-413a-9509-2e22e46145e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:24.035824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354f3cf-6604-413a-9509-2e22e46145e1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:24.060336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0c6e23be-203b-42cf-931b-9d6b49edd751 None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:24.061560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0c6e23be-203b-42cf-931b-9d6b49edd751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:24.073196 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2355/4686] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:24.074599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354f3cf-6604-413a-9509-2e22e46145e1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:24.109137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354f3cf-6604-413a-9509-2e22e46145e1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:24.118843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e1125-6432-41b0-a0eb-5247a6a556ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:24.119995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e1125-6432-41b0-a0eb-5247a6a556ca admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:24.120496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e1125-6432-41b0-a0eb-5247a6a556ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:24.121019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e1125-6432-41b0-a0eb-5247a6a556ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:24.123174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e1125-6432-41b0-a0eb-5247a6a556ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:24.129070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e1125-6432-41b0-a0eb-5247a6a556ca admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:24.218520 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2356/4687] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:24 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:24.270809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e1125-6432-41b0-a0eb-5247a6a556ca admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:24.274080 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2332/4688] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:24.438025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e1125-6432-41b0-a0eb-5247a6a556ca admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:24.449690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbd52b-2f47-4bc9-868b-554adb4d2d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:24.450311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbd52b-2f47-4bc9-868b-554adb4d2d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:24.450590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbd52b-2f47-4bc9-868b-554adb4d2d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:24.450862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbd52b-2f47-4bc9-868b-554adb4d2d7d admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:24.451691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbd52b-2f47-4bc9-868b-554adb4d2d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:24.453648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbd52b-2f47-4bc9-868b-554adb4d2d7d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:24.507530 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2357/4689] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:23:24 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:24.513427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e23be-203b-42cf-931b-9d6b49edd751 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:24.533947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e23be-203b-42cf-931b-9d6b49edd751 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:24.539501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629d90a-1c4e-42d5-ae13-a3e62af933ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:24.540914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629d90a-1c4e-42d5-ae13-a3e62af933ec admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:24.541249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629d90a-1c4e-42d5-ae13-a3e62af933ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:24.541613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629d90a-1c4e-42d5-ae13-a3e62af933ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:24.542506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629d90a-1c4e-42d5-ae13-a3e62af933ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:24.545594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629d90a-1c4e-42d5-ae13-a3e62af933ec admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:24.559858 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:24.586376 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2333/4690] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:23:24.591011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbd52b-2f47-4bc9-868b-554adb4d2d7d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:24.608813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbd52b-2f47-4bc9-868b-554adb4d2d7d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:24.640902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515215e-e908-4c0b-8083-ca739fe0b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:24.642866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515215e-e908-4c0b-8083-ca739fe0b6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:24.643190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515215e-e908-4c0b-8083-ca739fe0b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:24.643452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515215e-e908-4c0b-8083-ca739fe0b6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:24.644137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515215e-e908-4c0b-8083-ca739fe0b6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:24.651253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515215e-e908-4c0b-8083-ca739fe0b6c6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:24.673926 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2358/4691] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:23:24.678197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629d90a-1c4e-42d5-ae13-a3e62af933ec admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:24.698438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629d90a-1c4e-42d5-ae13-a3e62af933ec admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:24.704741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23087cad-a5c4-43da-8b31-6bf295a2d940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:24.705974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23087cad-a5c4-43da-8b31-6bf295a2d940 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:24.706653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23087cad-a5c4-43da-8b31-6bf295a2d940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:24.707582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23087cad-a5c4-43da-8b31-6bf295a2d940 admin admin] PATH_INFO: `/v3/projects/09382aca0c684d049e3f5defd29e8b72/users/54adae8e56bc4e61b4c5bafd8f09ce5e/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:24.728792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23087cad-a5c4-43da-8b31-6bf295a2d940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09382aca0c684d049e3f5defd29e8b72, user_id=54adae8e56bc4e61b4c5bafd8f09ce5e, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:24.731723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23087cad-a5c4-43da-8b31-6bf295a2d940 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:24.752544 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2334/4692] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:23:24 2022] PUT /identity/v3/projects/09382aca0c684d049e3f5defd29e8b72/users/54adae8e56bc4e61b4c5bafd8f09ce5e/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:24.764103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ad841-bcbd-4e1b-8e81-e455fd1aa710 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:24.764388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ad841-bcbd-4e1b-8e81-e455fd1aa710 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:24.764840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ad841-bcbd-4e1b-8e81-e455fd1aa710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:24.844044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-aa2ad841-bcbd-4e1b-8e81-e455fd1aa710 None None] MFA Rules not processed for user `54adae8e56bc4e61b4c5bafd8f09ce5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:24.845364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aa2ad841-bcbd-4e1b-8e81-e455fd1aa710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:24.904796 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:25.052066 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2359/4693] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:25.176555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23087cad-a5c4-43da-8b31-6bf295a2d940 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:25.183723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-23087cad-a5c4-43da-8b31-6bf295a2d940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:25.412573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23087cad-a5c4-43da-8b31-6bf295a2d940 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:25.451327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7530bf8-142f-481d-8d43-bd479f3518de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:25.451973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530bf8-142f-481d-8d43-bd479f3518de service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:25.452252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530bf8-142f-481d-8d43-bd479f3518de service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:25.458642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530bf8-142f-481d-8d43-bd479f3518de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:25.506732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7530bf8-142f-481d-8d43-bd479f3518de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:25.509307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7530bf8-142f-481d-8d43-bd479f3518de service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:25.554521 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2335/4694] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:23:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:23:26.167195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e8aa-3d11-494b-bfed-66d67d173831 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:26.168238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e8aa-3d11-494b-bfed-66d67d173831 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:26.168677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e8aa-3d11-494b-bfed-66d67d173831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:26.235750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e703e8aa-3d11-494b-bfed-66d67d173831 None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:26.237745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e703e8aa-3d11-494b-bfed-66d67d173831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:26.437840 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2360/4695] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:27.925322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa551dc3-6b99-4fdf-8ca9-475dbc368c85 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:27.925778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa551dc3-6b99-4fdf-8ca9-475dbc368c85 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:27.926431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa551dc3-6b99-4fdf-8ca9-475dbc368c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:27.956151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fa551dc3-6b99-4fdf-8ca9-475dbc368c85 None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:27.957661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fa551dc3-6b99-4fdf-8ca9-475dbc368c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:27.970028 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2336/4696] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:29.036602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63d14c-0ab2-4ad7-93dc-ab768b5dd35b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:29.037067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63d14c-0ab2-4ad7-93dc-ab768b5dd35b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:29.037152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63d14c-0ab2-4ad7-93dc-ab768b5dd35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:29.072762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2d63d14c-0ab2-4ad7-93dc-ab768b5dd35b None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:29.074632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2d63d14c-0ab2-4ad7-93dc-ab768b5dd35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:29.089292 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2361/4697] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:30.778910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb4f24-28f8-44c6-b669-05f2ad8559e5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:30.779421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb4f24-28f8-44c6-b669-05f2ad8559e5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:30.779519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb4f24-28f8-44c6-b669-05f2ad8559e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:30.809734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ccbb4f24-28f8-44c6-b669-05f2ad8559e5 None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:30.811060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ccbb4f24-28f8-44c6-b669-05f2ad8559e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:30.833151 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2337/4698] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:23:31.765688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602318b-afd0-4d28-a393-444b29424db4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:31.766223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602318b-afd0-4d28-a393-444b29424db4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:31.767828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602318b-afd0-4d28-a393-444b29424db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:31.810225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2602318b-afd0-4d28-a393-444b29424db4 None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:31.812469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2602318b-afd0-4d28-a393-444b29424db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:31.822227 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2362/4699] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:32.612586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677ffe5-3753-4dfa-bd7b-fb0de683b615 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:32.613534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677ffe5-3753-4dfa-bd7b-fb0de683b615 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:32.614326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677ffe5-3753-4dfa-bd7b-fb0de683b615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:32.657198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e677ffe5-3753-4dfa-bd7b-fb0de683b615 None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:32.664435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e677ffe5-3753-4dfa-bd7b-fb0de683b615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:32.689698 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2338/4700] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:33.941352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cc8bf-a236-46d9-9d0e-14b69b4ee87a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:33.941889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cc8bf-a236-46d9-9d0e-14b69b4ee87a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:33.941889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cc8bf-a236-46d9-9d0e-14b69b4ee87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:33.963398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-433cc8bf-a236-46d9-9d0e-14b69b4ee87a None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:33.964656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-433cc8bf-a236-46d9-9d0e-14b69b4ee87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:33.971634 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2363/4701] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:37.952668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5595080-0f47-46be-92bf-da6b47265a9e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:37.953215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5595080-0f47-46be-92bf-da6b47265a9e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:37.953215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5595080-0f47-46be-92bf-da6b47265a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:37.975007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c5595080-0f47-46be-92bf-da6b47265a9e None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:37.976243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c5595080-0f47-46be-92bf-da6b47265a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:37.983440 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2339/4702] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:38.404773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb5c14-67c7-4b82-8e9d-34cccee43cf8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:38.405267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb5c14-67c7-4b82-8e9d-34cccee43cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:38.405365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb5c14-67c7-4b82-8e9d-34cccee43cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:38.428325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0abb5c14-67c7-4b82-8e9d-34cccee43cf8 None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:38.431180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0abb5c14-67c7-4b82-8e9d-34cccee43cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:38.439924 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2364/4703] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:39.243173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5595080-0f47-46be-92bf-da6b47265a9e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:39.355805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5595080-0f47-46be-92bf-da6b47265a9e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:39.363184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:39.363913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:39.364285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:39.364630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] PATH_INFO: `/v3/users/54adae8e56bc4e61b4c5bafd8f09ce5e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:39.366542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=54adae8e56bc4e61b4c5bafd8f09ce5e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:39.369259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:39.434754 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:39.449198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54adae8e56bc4e61b4c5bafd8f09ce5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:39.450641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54adae8e56bc4e61b4c5bafd8f09ce5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:39.466781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54adae8e56bc4e61b4c5bafd8f09ce5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:39.477103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54adae8e56bc4e61b4c5bafd8f09ce5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:39.478058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54adae8e56bc4e61b4c5bafd8f09ce5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:39.491211 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2340/4704] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:23:39 2022] DELETE /identity/v3/users/54adae8e56bc4e61b4c5bafd8f09ce5e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:39.496230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23acaf-00ce-48b0-80b2-7216d0b58e91 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:39.496714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23acaf-00ce-48b0-80b2-7216d0b58e91 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:39.496810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23acaf-00ce-48b0-80b2-7216d0b58e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:39.519443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-eb23acaf-00ce-48b0-80b2-7216d0b58e91 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:39.520817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eb23acaf-00ce-48b0-80b2-7216d0b58e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:39.596313 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2365/4705] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:39.613219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:39.614567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:39.679258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d65dbe-6313-4967-8b9c-00f29abfc3cc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:39.683994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51f669-4f8a-40a0-a14e-6fb579a42afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:39.684776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51f669-4f8a-40a0-a14e-6fb579a42afc service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:39.685057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51f669-4f8a-40a0-a14e-6fb579a42afc service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:39.685412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51f669-4f8a-40a0-a14e-6fb579a42afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:39.698741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51f669-4f8a-40a0-a14e-6fb579a42afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:39.700468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51f669-4f8a-40a0-a14e-6fb579a42afc service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:39.711316 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2341/4706] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:23:40.145469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23acaf-00ce-48b0-80b2-7216d0b58e91 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:40.147200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eb23acaf-00ce-48b0-80b2-7216d0b58e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:40.160523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23acaf-00ce-48b0-80b2-7216d0b58e91 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:40.165837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:40.166461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:40.166733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:40.167038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9 admin admin] PATH_INFO: `/v3/projects/09382aca0c684d049e3f5defd29e8b72` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:40.168659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09382aca0c684d049e3f5defd29e8b72)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:40.170998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:40.216498 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:40.234420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09382aca0c684d049e3f5defd29e8b72', 'request_id': 'req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:40.240956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09382aca0c684d049e3f5defd29e8b72', 'request_id': 'req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:40.248836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09382aca0c684d049e3f5defd29e8b72', 'request_id': 'req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:40.259099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9 admin admin] The token cache is being invalidate because project 09382aca0c684d049e3f5defd29e8b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:40.259408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:40.260002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a0a1a21-c236-4107-bc00-a95b6a3c79a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:40.261469 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2366/4707] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:40 2022] DELETE /identity/v3/projects/09382aca0c684d049e3f5defd29e8b72 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:40.266265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cadf0-be05-4559-b0f6-2f5c7dc9cf36 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:40.266741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cadf0-be05-4559-b0f6-2f5c7dc9cf36 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:40.266842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cadf0-be05-4559-b0f6-2f5c7dc9cf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:40.286794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b08cadf0-be05-4559-b0f6-2f5c7dc9cf36 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:40.288033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b08cadf0-be05-4559-b0f6-2f5c7dc9cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:40.348380 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2342/4708] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:40.356559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b148c8a-6441-4761-a2f4-3cc71c49adf2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:40.356844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b148c8a-6441-4761-a2f4-3cc71c49adf2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:40.357114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b148c8a-6441-4761-a2f4-3cc71c49adf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:40.376980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7b148c8a-6441-4761-a2f4-3cc71c49adf2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:40.378163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7b148c8a-6441-4761-a2f4-3cc71c49adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:40.386555 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2367/4709] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:40.390735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cadf0-be05-4559-b0f6-2f5c7dc9cf36 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:40.402552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cadf0-be05-4559-b0f6-2f5c7dc9cf36 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:40.407595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245493a-48ca-4980-9287-3d09a83e1571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:40.408197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245493a-48ca-4980-9287-3d09a83e1571 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:40.408474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245493a-48ca-4980-9287-3d09a83e1571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:40.408744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245493a-48ca-4980-9287-3d09a83e1571 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:40.409409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245493a-48ca-4980-9287-3d09a83e1571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:23:40.409708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245493a-48ca-4980-9287-3d09a83e1571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:40.412298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245493a-48ca-4980-9287-3d09a83e1571 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:40.425170 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2343/4710] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:40.429566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b148c8a-6441-4761-a2f4-3cc71c49adf2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:40.439916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b148c8a-6441-4761-a2f4-3cc71c49adf2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:40.445031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9ac3b-5b7d-434d-a4d6-f893f7aa9659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:40.446264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ac3b-5b7d-434d-a4d6-f893f7aa9659 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:40.446897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ac3b-5b7d-434d-a4d6-f893f7aa9659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:40.447357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ac3b-5b7d-434d-a4d6-f893f7aa9659 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:40.448087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9ac3b-5b7d-434d-a4d6-f893f7aa9659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:40.450224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9ac3b-5b7d-434d-a4d6-f893f7aa9659 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:40.491392 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2368/4711] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:40 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:40.495798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245493a-48ca-4980-9287-3d09a83e1571 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:40.505891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245493a-48ca-4980-9287-3d09a83e1571 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:40.553310 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:40.580379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d38498-efee-482d-bc22-6a28be088132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:40.581089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d38498-efee-482d-bc22-6a28be088132 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:40.581437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d38498-efee-482d-bc22-6a28be088132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:40.581777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d38498-efee-482d-bc22-6a28be088132 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:40.582611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d38498-efee-482d-bc22-6a28be088132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:40.584677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d38498-efee-482d-bc22-6a28be088132 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:40.607280 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2344/4712] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:23:40 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:40.611137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9ac3b-5b7d-434d-a4d6-f893f7aa9659 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:40.621719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9ac3b-5b7d-434d-a4d6-f893f7aa9659 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:40.629168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc8311-9a59-4435-94b0-944f774dbc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:40.629766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc8311-9a59-4435-94b0-944f774dbc82 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:40.630044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc8311-9a59-4435-94b0-944f774dbc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:40.630315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc8311-9a59-4435-94b0-944f774dbc82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:40.630979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc8311-9a59-4435-94b0-944f774dbc82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:40.632571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc8311-9a59-4435-94b0-944f774dbc82 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:40.642993 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2369/4713] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:23:40.647525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d38498-efee-482d-bc22-6a28be088132 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:40.658226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d38498-efee-482d-bc22-6a28be088132 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:40.662834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39d18d-2547-4f8e-8b10-e3c0ce5aefa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:40.663450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39d18d-2547-4f8e-8b10-e3c0ce5aefa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:40.663728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39d18d-2547-4f8e-8b10-e3c0ce5aefa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:40.663997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39d18d-2547-4f8e-8b10-e3c0ce5aefa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:40.664767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39d18d-2547-4f8e-8b10-e3c0ce5aefa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:40.666346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39d18d-2547-4f8e-8b10-e3c0ce5aefa4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:40.676755 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2345/4714] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:23:40.681624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc8311-9a59-4435-94b0-944f774dbc82 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:40.691527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc8311-9a59-4435-94b0-944f774dbc82 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:40.696772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addcb09-e30b-4939-9364-5f963378e4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:40.697441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addcb09-e30b-4939-9364-5f963378e4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:40.697716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addcb09-e30b-4939-9364-5f963378e4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:40.698017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addcb09-e30b-4939-9364-5f963378e4a0 admin admin] PATH_INFO: `/v3/projects/f637b16359e340469b60068e8c8caaf3/users/8e01199172ea4ab9861edf9f7dc347ad/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:40.714315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addcb09-e30b-4939-9364-5f963378e4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f637b16359e340469b60068e8c8caaf3, user_id=8e01199172ea4ab9861edf9f7dc347ad, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:40.717317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addcb09-e30b-4939-9364-5f963378e4a0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:40.732975 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2370/4715] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:23:40 2022] PUT /identity/v3/projects/f637b16359e340469b60068e8c8caaf3/users/8e01199172ea4ab9861edf9f7dc347ad/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:40.740980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04014c-44c6-4ae5-a0ec-f88949470102 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:40.741270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04014c-44c6-4ae5-a0ec-f88949470102 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:40.741545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04014c-44c6-4ae5-a0ec-f88949470102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:40.770260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2a04014c-44c6-4ae5-a0ec-f88949470102 None None] MFA Rules not processed for user `8e01199172ea4ab9861edf9f7dc347ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:40.771503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2a04014c-44c6-4ae5-a0ec-f88949470102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:40.837863 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2346/4716] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:40.842286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addcb09-e30b-4939-9364-5f963378e4a0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:40.903796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addcb09-e30b-4939-9364-5f963378e4a0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:40.908456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a18d82-a689-40cb-b961-83a3c5d50d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:40.909055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a18d82-a689-40cb-b961-83a3c5d50d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:40.909336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a18d82-a689-40cb-b961-83a3c5d50d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:40.909609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a18d82-a689-40cb-b961-83a3c5d50d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:40.910230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a18d82-a689-40cb-b961-83a3c5d50d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:40.912155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a18d82-a689-40cb-b961-83a3c5d50d36 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:40.939368 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2371/4717] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:40 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:40.943620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04014c-44c6-4ae5-a0ec-f88949470102 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:40.954830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04014c-44c6-4ae5-a0ec-f88949470102 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.010053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0886bb3-f88b-42bf-96d9-c7cfb7f14197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.010587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0886bb3-f88b-42bf-96d9-c7cfb7f14197 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.010867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0886bb3-f88b-42bf-96d9-c7cfb7f14197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.011196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0886bb3-f88b-42bf-96d9-c7cfb7f14197 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.011819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0886bb3-f88b-42bf-96d9-c7cfb7f14197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.013730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0886bb3-f88b-42bf-96d9-c7cfb7f14197 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.034529 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2347/4718] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:23:40 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:23:41.038720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a18d82-a689-40cb-b961-83a3c5d50d36 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.049120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a18d82-a689-40cb-b961-83a3c5d50d36 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.053746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3dde2-4eea-4aa4-8e63-636b25e292d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.054338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3dde2-4eea-4aa4-8e63-636b25e292d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.054619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3dde2-4eea-4aa4-8e63-636b25e292d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.054890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3dde2-4eea-4aa4-8e63-636b25e292d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.056376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3dde2-4eea-4aa4-8e63-636b25e292d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.057954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3dde2-4eea-4aa4-8e63-636b25e292d1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.068669 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2372/4719] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:23:41.073565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0886bb3-f88b-42bf-96d9-c7cfb7f14197 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.083757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0886bb3-f88b-42bf-96d9-c7cfb7f14197 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.088553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7c029-146e-4d34-9431-d5bd70479a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.089256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c029-146e-4d34-9431-d5bd70479a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.089635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c029-146e-4d34-9431-d5bd70479a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.089923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c029-146e-4d34-9431-d5bd70479a3e admin admin] PATH_INFO: `/v3/projects/45a20a9c19184a47b6f7c5d1512214d9/users/da0930876bbc4dd58765e5b836c5d3fc/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.106106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7c029-146e-4d34-9431-d5bd70479a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a20a9c19184a47b6f7c5d1512214d9, user_id=da0930876bbc4dd58765e5b836c5d3fc, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.109295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7c029-146e-4d34-9431-d5bd70479a3e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.123644 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2348/4720] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:23:41 2022] PUT /identity/v3/projects/45a20a9c19184a47b6f7c5d1512214d9/users/da0930876bbc4dd58765e5b836c5d3fc/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:41.129224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3dde2-4eea-4aa4-8e63-636b25e292d1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.142026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3dde2-4eea-4aa4-8e63-636b25e292d1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.171674 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:41.210464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2626f62-da68-4af7-bb12-f5585475837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.211111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2626f62-da68-4af7-bb12-f5585475837a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.211422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2626f62-da68-4af7-bb12-f5585475837a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.211696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2626f62-da68-4af7-bb12-f5585475837a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.212326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2626f62-da68-4af7-bb12-f5585475837a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.213913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2626f62-da68-4af7-bb12-f5585475837a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.224369 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2373/4721] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:23:41.229549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7c029-146e-4d34-9431-d5bd70479a3e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.241378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7c029-146e-4d34-9431-d5bd70479a3e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.247641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5caff-8a3c-4e13-9bb6-11af4bc67ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.248319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5caff-8a3c-4e13-9bb6-11af4bc67ade admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.248596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5caff-8a3c-4e13-9bb6-11af4bc67ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.248866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5caff-8a3c-4e13-9bb6-11af4bc67ade admin admin] PATH_INFO: `/v3/projects/45a20a9c19184a47b6f7c5d1512214d9/users/da0930876bbc4dd58765e5b836c5d3fc/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.250753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5caff-8a3c-4e13-9bb6-11af4bc67ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a20a9c19184a47b6f7c5d1512214d9, user_id=da0930876bbc4dd58765e5b836c5d3fc, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.265652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5caff-8a3c-4e13-9bb6-11af4bc67ade admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.278732 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2349/4722] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:23:41 2022] PUT /identity/v3/projects/45a20a9c19184a47b6f7c5d1512214d9/users/da0930876bbc4dd58765e5b836c5d3fc/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:41.297273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1407a9-23dd-451f-b7b8-d094e8e3e24b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.297554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1407a9-23dd-451f-b7b8-d094e8e3e24b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.297826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1407a9-23dd-451f-b7b8-d094e8e3e24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.331631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2b1407a9-23dd-451f-b7b8-d094e8e3e24b None None] MFA Rules not processed for user `da0930876bbc4dd58765e5b836c5d3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:41.332768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2b1407a9-23dd-451f-b7b8-d094e8e3e24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:41.414972 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2374/4723] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:41.419582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5caff-8a3c-4e13-9bb6-11af4bc67ade admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.425902 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:41.438384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5caff-8a3c-4e13-9bb6-11af4bc67ade admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.443636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e1ca6-ad5e-46c3-8684-28cb15062fda tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.444526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e1ca6-ad5e-46c3-8684-28cb15062fda tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.445193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e1ca6-ad5e-46c3-8684-28cb15062fda tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.445193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e1ca6-ad5e-46c3-8684-28cb15062fda tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.445882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e1ca6-ad5e-46c3-8684-28cb15062fda tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.447930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e1ca6-ad5e-46c3-8684-28cb15062fda tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.469707 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2350/4724] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:41 2022] POST /identity/v3/services => generated 287 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:23:41.473514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1407a9-23dd-451f-b7b8-d094e8e3e24b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.485641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1407a9-23dd-451f-b7b8-d094e8e3e24b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.505433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb10399-3c75-4fc3-bb94-bbcb7d22865a tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.506051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb10399-3c75-4fc3-bb94-bbcb7d22865a tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.506332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb10399-3c75-4fc3-bb94-bbcb7d22865a tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.506602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb10399-3c75-4fc3-bb94-bbcb7d22865a tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.507304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb10399-3c75-4fc3-bb94-bbcb7d22865a tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.508312 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-6cb10399-3c75-4fc3-bb94-bbcb7d22865a tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:23:41.508312 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:23:41.508312 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:23:41.509928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb10399-3c75-4fc3-bb94-bbcb7d22865a tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.522315 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2375/4725] 10.222.0.39 () {60 vars in 1213 bytes} [Sun Oct 16 01:23:41 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:41.527407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e1ca6-ad5e-46c3-8684-28cb15062fda tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.538178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e1ca6-ad5e-46c3-8684-28cb15062fda tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.547231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9d866-3069-4291-85af-18cae922cdb5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.547231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9d866-3069-4291-85af-18cae922cdb5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.547231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9d866-3069-4291-85af-18cae922cdb5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.547517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9d866-3069-4291-85af-18cae922cdb5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.547517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9d866-3069-4291-85af-18cae922cdb5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.547759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9d866-3069-4291-85af-18cae922cdb5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.569410 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2351/4726] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:41 2022] POST /identity/v3/services => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:41.574146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb10399-3c75-4fc3-bb94-bbcb7d22865a tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.587107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb10399-3c75-4fc3-bb94-bbcb7d22865a tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.602950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f69f18-7ccb-441c-9b0d-787af1b45675 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.603574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f69f18-7ccb-441c-9b0d-787af1b45675 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.603836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f69f18-7ccb-441c-9b0d-787af1b45675 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.604104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f69f18-7ccb-441c-9b0d-787af1b45675 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.604760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f69f18-7ccb-441c-9b0d-787af1b45675 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.606334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f69f18-7ccb-441c-9b0d-787af1b45675 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.633152 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2376/4727] 10.222.0.39 () {60 vars in 1213 bytes} [Sun Oct 16 01:23:41 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:41.637481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9d866-3069-4291-85af-18cae922cdb5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.649610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9d866-3069-4291-85af-18cae922cdb5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.654714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0707a6-1bf7-4723-b435-2d4e6dbc07e6 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.655723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0707a6-1bf7-4723-b435-2d4e6dbc07e6 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.656036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0707a6-1bf7-4723-b435-2d4e6dbc07e6 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.656261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0707a6-1bf7-4723-b435-2d4e6dbc07e6 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.656891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0707a6-1bf7-4723-b435-2d4e6dbc07e6 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.657916 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-cc0707a6-1bf7-4723-b435-2d4e6dbc07e6 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:23:41.657916 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:23:41.657916 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:23:41.658953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0707a6-1bf7-4723-b435-2d4e6dbc07e6 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.668421 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2352/4728] 10.222.0.39 () {58 vars in 1191 bytes} [Sun Oct 16 01:23:41 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 763 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:41.676009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f69f18-7ccb-441c-9b0d-787af1b45675 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.688781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f69f18-7ccb-441c-9b0d-787af1b45675 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.693757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eb081-7bfb-4374-8bb2-c27a6c3722f3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.694419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eb081-7bfb-4374-8bb2-c27a6c3722f3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.694699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eb081-7bfb-4374-8bb2-c27a6c3722f3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.694998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eb081-7bfb-4374-8bb2-c27a6c3722f3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f12821a7420144f6a5a21dc6ecd8aa9a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.696209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578eb081-7bfb-4374-8bb2-c27a6c3722f3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=f12821a7420144f6a5a21dc6ecd8aa9a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.697384 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-578eb081-7bfb-4374-8bb2-c27a6c3722f3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:23:41.697384 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:23:41.697384 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:23:41.698597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578eb081-7bfb-4374-8bb2-c27a6c3722f3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.706231 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2377/4729] 10.222.0.39 () {58 vars in 1290 bytes} [Sun Oct 16 01:23:41 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/f12821a7420144f6a5a21dc6ecd8aa9a => generated 333 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:41.710378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0707a6-1bf7-4723-b435-2d4e6dbc07e6 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.721531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0707a6-1bf7-4723-b435-2d4e6dbc07e6 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.726238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98af13-d8a8-4810-aadf-c53f66d32c67 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.726893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98af13-d8a8-4810-aadf-c53f66d32c67 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.727976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98af13-d8a8-4810-aadf-c53f66d32c67 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.728259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98af13-d8a8-4810-aadf-c53f66d32c67 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f12821a7420144f6a5a21dc6ecd8aa9a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.728861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98af13-d8a8-4810-aadf-c53f66d32c67 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=f12821a7420144f6a5a21dc6ecd8aa9a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.729875 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-ca98af13-d8a8-4810-aadf-c53f66d32c67 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:23:41.729875 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:23:41.729875 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:23:41.730776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98af13-d8a8-4810-aadf-c53f66d32c67 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.736841 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2353/4730] 10.222.0.39 () {58 vars in 1291 bytes} [Sun Oct 16 01:23:41 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/f12821a7420144f6a5a21dc6ecd8aa9a => generated 0 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 16 01:23:41.741156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eb081-7bfb-4374-8bb2-c27a6c3722f3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.752435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eb081-7bfb-4374-8bb2-c27a6c3722f3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.757207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bb783-ca3c-420e-8f0b-6a1aadb205ef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.757904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bb783-ca3c-420e-8f0b-6a1aadb205ef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.758385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bb783-ca3c-420e-8f0b-6a1aadb205ef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.759048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bb783-ca3c-420e-8f0b-6a1aadb205ef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f12821a7420144f6a5a21dc6ecd8aa9a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.759450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bb783-ca3c-420e-8f0b-6a1aadb205ef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=f12821a7420144f6a5a21dc6ecd8aa9a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.760520 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-230bb783-ca3c-420e-8f0b-6a1aadb205ef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:23:41.760520 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:23:41.760520 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:23:41.761582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bb783-ca3c-420e-8f0b-6a1aadb205ef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.772276 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2378/4731] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Oct 16 01:23:41 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/f12821a7420144f6a5a21dc6ecd8aa9a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:41.777722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98af13-d8a8-4810-aadf-c53f66d32c67 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.788116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98af13-d8a8-4810-aadf-c53f66d32c67 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.793894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecb0ff-73e3-4d8a-87d6-7e070db1e0d5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.794497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecb0ff-73e3-4d8a-87d6-7e070db1e0d5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.794804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecb0ff-73e3-4d8a-87d6-7e070db1e0d5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.795115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecb0ff-73e3-4d8a-87d6-7e070db1e0d5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.796634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecb0ff-73e3-4d8a-87d6-7e070db1e0d5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.799834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecb0ff-73e3-4d8a-87d6-7e070db1e0d5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.815346 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2354/4732] 10.222.0.39 () {58 vars in 1191 bytes} [Sun Oct 16 01:23:41 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 449 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:41.824416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bb783-ca3c-420e-8f0b-6a1aadb205ef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.838791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bb783-ca3c-420e-8f0b-6a1aadb205ef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.844787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812ba11-ca0e-4273-b8af-062da21ce466 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.845491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812ba11-ca0e-4273-b8af-062da21ce466 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.845770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812ba11-ca0e-4273-b8af-062da21ce466 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.846045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812ba11-ca0e-4273-b8af-062da21ce466 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f12821a7420144f6a5a21dc6ecd8aa9a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.846652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812ba11-ca0e-4273-b8af-062da21ce466 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=f12821a7420144f6a5a21dc6ecd8aa9a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.848286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812ba11-ca0e-4273-b8af-062da21ce466 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b812ba11-ca0e-4273-b8af-062da21ce466 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Could not find Endpoint Group: f12821a7420144f6a5a21dc6ecd8aa9a.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: f12821a7420144f6a5a21dc6ecd8aa9a. Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 16 01:23:41.865425 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 16 01:23:41.866593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 16 01:23:41.866593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 16 01:23:41.866593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 16 01:23:41.866593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 16 01:23:41.866593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: f12821a7420144f6a5a21dc6ecd8aa9a. Oct 16 01:23:41.866593 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:41.866593 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2379/4733] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Oct 16 01:23:41 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/f12821a7420144f6a5a21dc6ecd8aa9a => generated 120 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:23:41.871136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecb0ff-73e3-4d8a-87d6-7e070db1e0d5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.881355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecb0ff-73e3-4d8a-87d6-7e070db1e0d5 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.886863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886e78b-71eb-4d8d-8c93-9fdadc912679 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.887510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886e78b-71eb-4d8d-8c93-9fdadc912679 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.887785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886e78b-71eb-4d8d-8c93-9fdadc912679 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.888050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886e78b-71eb-4d8d-8c93-9fdadc912679 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/services/b6e91bf9aa554d64b0ee2b1ceaa91200` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.888622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886e78b-71eb-4d8d-8c93-9fdadc912679 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b6e91bf9aa554d64b0ee2b1ceaa91200)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.890181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886e78b-71eb-4d8d-8c93-9fdadc912679 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.923568 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2355/4734] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:41 2022] DELETE /identity/v3/services/b6e91bf9aa554d64b0ee2b1ceaa91200 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:41.928273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812ba11-ca0e-4273-b8af-062da21ce466 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:41.941355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812ba11-ca0e-4273-b8af-062da21ce466 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:41.961163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69984159-d04c-42b4-ad4d-b0f2daf9fc53 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:41.962409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69984159-d04c-42b4-ad4d-b0f2daf9fc53 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:41.962774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69984159-d04c-42b4-ad4d-b0f2daf9fc53 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:41.963143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69984159-d04c-42b4-ad4d-b0f2daf9fc53 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:41.963874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69984159-d04c-42b4-ad4d-b0f2daf9fc53 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:41.965540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69984159-d04c-42b4-ad4d-b0f2daf9fc53 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:41.985351 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2380/4735] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:41 2022] POST /identity/v3/services => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:23:41.989718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886e78b-71eb-4d8d-8c93-9fdadc912679 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:42.001618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886e78b-71eb-4d8d-8c93-9fdadc912679 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:42.019413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c3ea-42f2-43e3-b547-27e5c317ab34 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:42.020470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c3ea-42f2-43e3-b547-27e5c317ab34 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:42.021021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c3ea-42f2-43e3-b547-27e5c317ab34 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:42.021497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c3ea-42f2-43e3-b547-27e5c317ab34 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:42.022429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94c3ea-42f2-43e3-b547-27e5c317ab34 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:42.024572 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-7a94c3ea-42f2-43e3-b547-27e5c317ab34 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:23:42.024572 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:23:42.024572 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:23:42.025506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94c3ea-42f2-43e3-b547-27e5c317ab34 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:42.039277 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2356/4736] 10.222.0.39 () {60 vars in 1213 bytes} [Sun Oct 16 01:23:41 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:42.044043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69984159-d04c-42b4-ad4d-b0f2daf9fc53 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:42.056963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69984159-d04c-42b4-ad4d-b0f2daf9fc53 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:42.061746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a8846-7508-461f-9c55-6031cb103eef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:42.062458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a8846-7508-461f-9c55-6031cb103eef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:42.062798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a8846-7508-461f-9c55-6031cb103eef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:42.063191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a8846-7508-461f-9c55-6031cb103eef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:42.063902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a8846-7508-461f-9c55-6031cb103eef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:42.065571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a8846-7508-461f-9c55-6031cb103eef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:42.082863 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2381/4737] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:42 2022] POST /identity/v3/services => generated 289 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:42.088426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c3ea-42f2-43e3-b547-27e5c317ab34 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:42.113252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c3ea-42f2-43e3-b547-27e5c317ab34 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:42.127897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b054f-a7f2-421f-ba75-bcfe54473cde tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:42.128539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b054f-a7f2-421f-ba75-bcfe54473cde tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:42.128812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b054f-a7f2-421f-ba75-bcfe54473cde tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:42.129079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b054f-a7f2-421f-ba75-bcfe54473cde tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3a5cd148a36a42758ca7387cb48a6519` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:42.131347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b054f-a7f2-421f-ba75-bcfe54473cde tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=3a5cd148a36a42758ca7387cb48a6519)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:42.132453 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-861b054f-a7f2-421f-ba75-bcfe54473cde tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:23:42.132453 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:23:42.132453 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:23:42.133937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b054f-a7f2-421f-ba75-bcfe54473cde tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:42.150346 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2357/4738] 10.222.0.39 () {60 vars in 1313 bytes} [Sun Oct 16 01:23:42 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/3a5cd148a36a42758ca7387cb48a6519 => generated 336 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:42.154732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a8846-7508-461f-9c55-6031cb103eef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:42.171875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a8846-7508-461f-9c55-6031cb103eef tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:42.177757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633b755-6d3e-4148-a779-c8e680090a35 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:42.178393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633b755-6d3e-4148-a779-c8e680090a35 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:42.178674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633b755-6d3e-4148-a779-c8e680090a35 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:42.181524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633b755-6d3e-4148-a779-c8e680090a35 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/services/3dd3be0468234f66ba82f456c1bf0025` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:42.181524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633b755-6d3e-4148-a779-c8e680090a35 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3dd3be0468234f66ba82f456c1bf0025)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:42.181524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633b755-6d3e-4148-a779-c8e680090a35 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:42.183180 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:42.223788 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2382/4739] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:42 2022] DELETE /identity/v3/services/3dd3be0468234f66ba82f456c1bf0025 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:42.228048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b054f-a7f2-421f-ba75-bcfe54473cde tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:42.238990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b054f-a7f2-421f-ba75-bcfe54473cde tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:42.260464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfeece0-eb01-4c47-afee-e3bac3858dc3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:42.261110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfeece0-eb01-4c47-afee-e3bac3858dc3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:42.261393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfeece0-eb01-4c47-afee-e3bac3858dc3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:42.261670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfeece0-eb01-4c47-afee-e3bac3858dc3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3a5cd148a36a42758ca7387cb48a6519` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:42.262260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfeece0-eb01-4c47-afee-e3bac3858dc3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3a5cd148a36a42758ca7387cb48a6519)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:42.263360 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-3dfeece0-eb01-4c47-afee-e3bac3858dc3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:23:42.263360 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:23:42.263360 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:23:42.264244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfeece0-eb01-4c47-afee-e3bac3858dc3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:42.278149 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2358/4740] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Oct 16 01:23:42 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3a5cd148a36a42758ca7387cb48a6519 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:42.282585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633b755-6d3e-4148-a779-c8e680090a35 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:42.294839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633b755-6d3e-4148-a779-c8e680090a35 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:42.299548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c94d7-37f5-40fb-a3fb-42026a8a2db2 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:42.300177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c94d7-37f5-40fb-a3fb-42026a8a2db2 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:42.300793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c94d7-37f5-40fb-a3fb-42026a8a2db2 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:42.301112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c94d7-37f5-40fb-a3fb-42026a8a2db2 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/services/0fdf6a8b3cfd4c73b3f06304c4e0e1a5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:42.303218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c94d7-37f5-40fb-a3fb-42026a8a2db2 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0fdf6a8b3cfd4c73b3f06304c4e0e1a5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:42.305483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c94d7-37f5-40fb-a3fb-42026a8a2db2 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:42.331548 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2383/4741] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:42 2022] DELETE /identity/v3/services/0fdf6a8b3cfd4c73b3f06304c4e0e1a5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:42.336794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfeece0-eb01-4c47-afee-e3bac3858dc3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:42.349942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfeece0-eb01-4c47-afee-e3bac3858dc3 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:42.371646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d78ec9-4d9b-4078-bfe4-a949bf5656a4 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:42.372250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d78ec9-4d9b-4078-bfe4-a949bf5656a4 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:42.372529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d78ec9-4d9b-4078-bfe4-a949bf5656a4 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:42.372801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d78ec9-4d9b-4078-bfe4-a949bf5656a4 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/85d6c56b8b3b4f0aa8265929af24b8ca` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:42.373377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d78ec9-4d9b-4078-bfe4-a949bf5656a4 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=85d6c56b8b3b4f0aa8265929af24b8ca)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:42.375124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d78ec9-4d9b-4078-bfe4-a949bf5656a4 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:42.389808 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2359/4742] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Oct 16 01:23:42 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/85d6c56b8b3b4f0aa8265929af24b8ca => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:42.393754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c94d7-37f5-40fb-a3fb-42026a8a2db2 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:42.405900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c94d7-37f5-40fb-a3fb-42026a8a2db2 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:42.412086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f24e9-8536-494a-a140-0aaaefaa6d4d tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0930876bbc4dd58765e5b836c5d3fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45a20a9c19184a47b6f7c5d1512214d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:42.412704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f24e9-8536-494a-a140-0aaaefaa6d4d tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:42.412982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f24e9-8536-494a-a140-0aaaefaa6d4d tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:42.413270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f24e9-8536-494a-a140-0aaaefaa6d4d tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] PATH_INFO: `/v3/services/c8c3f6215e10419da881f149d492ff54` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:42.413828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f24e9-8536-494a-a140-0aaaefaa6d4d tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c8c3f6215e10419da881f149d492ff54)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:42.415690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f24e9-8536-494a-a140-0aaaefaa6d4d tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:42.453600 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2384/4743] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:42 2022] DELETE /identity/v3/services/c8c3f6215e10419da881f149d492ff54 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:42.454697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d78ec9-4d9b-4078-bfe4-a949bf5656a4 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:42.576207 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:42.584549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d78ec9-4d9b-4078-bfe4-a949bf5656a4 tempest-EndPointGroupsTest-951854688 tempest-EndPointGroupsTest-951854688-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:42.615850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:42.616921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:42.617212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:42.618024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] PATH_INFO: `/v3/users/8e01199172ea4ab9861edf9f7dc347ad` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:42.619854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e01199172ea4ab9861edf9f7dc347ad)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:42.622394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:42.684725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e01199172ea4ab9861edf9f7dc347ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:42.685506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e01199172ea4ab9861edf9f7dc347ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:42.700423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e01199172ea4ab9861edf9f7dc347ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:42.708562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e01199172ea4ab9861edf9f7dc347ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:42.709675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e01199172ea4ab9861edf9f7dc347ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:42.725729 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2360/4744] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:23:42 2022] DELETE /identity/v3/users/8e01199172ea4ab9861edf9f7dc347ad => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:42.730733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abfd19-517a-4f00-b72f-6dcc96985898 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:42.731261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abfd19-517a-4f00-b72f-6dcc96985898 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:42.731347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abfd19-517a-4f00-b72f-6dcc96985898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:42.751764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b8abfd19-517a-4f00-b72f-6dcc96985898 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:42.753363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b8abfd19-517a-4f00-b72f-6dcc96985898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:42.826017 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2385/4745] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:23:42.837880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:42.844438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:42.925497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c09c6-06a7-43b2-8112-f35a8dce0d62 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:42.929444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca203081-af82-49d5-b858-82dde50bbe72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:42.930956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca203081-af82-49d5-b858-82dde50bbe72 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:42.931312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca203081-af82-49d5-b858-82dde50bbe72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:42.931652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca203081-af82-49d5-b858-82dde50bbe72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:42.941860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca203081-af82-49d5-b858-82dde50bbe72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:42.943424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca203081-af82-49d5-b858-82dde50bbe72 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:42.953812 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2361/4746] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:23:43.393946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abfd19-517a-4f00-b72f-6dcc96985898 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:43.395391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b8abfd19-517a-4f00-b72f-6dcc96985898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:43.408304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abfd19-517a-4f00-b72f-6dcc96985898 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:43.414374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:43.415241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:43.415523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:43.415799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] PATH_INFO: `/v3/projects/f637b16359e340469b60068e8c8caaf3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:43.416986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f637b16359e340469b60068e8c8caaf3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:43.419047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:43.487496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f637b16359e340469b60068e8c8caaf3', 'request_id': 'req-640d07b5-1fa4-41d0-91e1-b9e1853479aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:43.494980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f637b16359e340469b60068e8c8caaf3', 'request_id': 'req-640d07b5-1fa4-41d0-91e1-b9e1853479aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:43.506031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f637b16359e340469b60068e8c8caaf3', 'request_id': 'req-640d07b5-1fa4-41d0-91e1-b9e1853479aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:43.521922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] The token cache is being invalidate because project f637b16359e340469b60068e8c8caaf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:43.522214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:43.523116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:43.525968 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2386/4747] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:43 2022] DELETE /identity/v3/projects/f637b16359e340469b60068e8c8caaf3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:43.529897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca203081-af82-49d5-b858-82dde50bbe72 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:43.546808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca203081-af82-49d5-b858-82dde50bbe72 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:43.630845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9a52a-7edc-4b00-b12c-79a1fba42e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:43.631514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9a52a-7edc-4b00-b12c-79a1fba42e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:43.631802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9a52a-7edc-4b00-b12c-79a1fba42e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:43.632061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9a52a-7edc-4b00-b12c-79a1fba42e01 admin admin] PATH_INFO: `/v3/users/da0930876bbc4dd58765e5b836c5d3fc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:43.633238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9a52a-7edc-4b00-b12c-79a1fba42e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da0930876bbc4dd58765e5b836c5d3fc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:43.636123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9a52a-7edc-4b00-b12c-79a1fba42e01 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:43.637896 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:43.707437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-51a9a52a-7edc-4b00-b12c-79a1fba42e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da0930876bbc4dd58765e5b836c5d3fc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:43.708396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-51a9a52a-7edc-4b00-b12c-79a1fba42e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da0930876bbc4dd58765e5b836c5d3fc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:43.725773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-51a9a52a-7edc-4b00-b12c-79a1fba42e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da0930876bbc4dd58765e5b836c5d3fc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:43.736550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-51a9a52a-7edc-4b00-b12c-79a1fba42e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da0930876bbc4dd58765e5b836c5d3fc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:43.737441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-51a9a52a-7edc-4b00-b12c-79a1fba42e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da0930876bbc4dd58765e5b836c5d3fc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:43.754734 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2362/4748] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:23:43 2022] DELETE /identity/v3/users/da0930876bbc4dd58765e5b836c5d3fc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:44.092390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:44.094599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:44.116815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d07b5-1fa4-41d0-91e1-b9e1853479aa admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:44.142145 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:44.205177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3f96b-bcef-448f-8ead-c8f29f62815f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:44.206974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3f96b-bcef-448f-8ead-c8f29f62815f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:44.207598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3f96b-bcef-448f-8ead-c8f29f62815f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:44.208153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3f96b-bcef-448f-8ead-c8f29f62815f admin admin] PATH_INFO: `/v3/projects/45a20a9c19184a47b6f7c5d1512214d9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:44.209582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3f96b-bcef-448f-8ead-c8f29f62815f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a20a9c19184a47b6f7c5d1512214d9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:44.212790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3f96b-bcef-448f-8ead-c8f29f62815f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:44.292343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-05c3f96b-bcef-448f-8ead-c8f29f62815f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a20a9c19184a47b6f7c5d1512214d9', 'request_id': 'req-05c3f96b-bcef-448f-8ead-c8f29f62815f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:44.301107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-05c3f96b-bcef-448f-8ead-c8f29f62815f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a20a9c19184a47b6f7c5d1512214d9', 'request_id': 'req-05c3f96b-bcef-448f-8ead-c8f29f62815f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:44.314214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-05c3f96b-bcef-448f-8ead-c8f29f62815f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a20a9c19184a47b6f7c5d1512214d9', 'request_id': 'req-05c3f96b-bcef-448f-8ead-c8f29f62815f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:44.328767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-05c3f96b-bcef-448f-8ead-c8f29f62815f admin admin] The token cache is being invalidate because project 45a20a9c19184a47b6f7c5d1512214d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:44.329089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-05c3f96b-bcef-448f-8ead-c8f29f62815f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:44.329709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-05c3f96b-bcef-448f-8ead-c8f29f62815f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:44.331649 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2387/4749] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:44 2022] DELETE /identity/v3/projects/45a20a9c19184a47b6f7c5d1512214d9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:44.337247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06437636-6816-4668-bbfb-d440c792cff9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:44.337880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06437636-6816-4668-bbfb-d440c792cff9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:44.338387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06437636-6816-4668-bbfb-d440c792cff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:44.365086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-06437636-6816-4668-bbfb-d440c792cff9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:44.366666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-06437636-6816-4668-bbfb-d440c792cff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:44.466846 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2363/4750] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:44.474312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfe2c6-addc-4155-bc2b-aa0855ad0938 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:44.474787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfe2c6-addc-4155-bc2b-aa0855ad0938 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:44.475495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfe2c6-addc-4155-bc2b-aa0855ad0938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:44.512352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1dbfe2c6-addc-4155-bc2b-aa0855ad0938 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:44.513652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1dbfe2c6-addc-4155-bc2b-aa0855ad0938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:44.525019 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2388/4751] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:23:44.529326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06437636-6816-4668-bbfb-d440c792cff9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:44.541467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06437636-6816-4668-bbfb-d440c792cff9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:44.555572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c532d-0b9a-44a7-8e19-163fe2eb1e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:44.556744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c532d-0b9a-44a7-8e19-163fe2eb1e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:44.557351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c532d-0b9a-44a7-8e19-163fe2eb1e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:44.557773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c532d-0b9a-44a7-8e19-163fe2eb1e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:44.558583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c532d-0b9a-44a7-8e19-163fe2eb1e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:23:44.558893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c532d-0b9a-44a7-8e19-163fe2eb1e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:44.560525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c532d-0b9a-44a7-8e19-163fe2eb1e30 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:44.576466 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2364/4752] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:44.581906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfe2c6-addc-4155-bc2b-aa0855ad0938 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:44.592497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfe2c6-addc-4155-bc2b-aa0855ad0938 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:44.597493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845db0b-cf89-4845-9b12-7fbf5dbb7185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:44.598108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845db0b-cf89-4845-9b12-7fbf5dbb7185 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:44.598391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845db0b-cf89-4845-9b12-7fbf5dbb7185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:44.598664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845db0b-cf89-4845-9b12-7fbf5dbb7185 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:44.599330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845db0b-cf89-4845-9b12-7fbf5dbb7185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:44.601250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845db0b-cf89-4845-9b12-7fbf5dbb7185 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:44.639413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d26a5-dc00-4e9e-b042-82a81d6aac18 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:44.639695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d26a5-dc00-4e9e-b042-82a81d6aac18 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:44.640123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d26a5-dc00-4e9e-b042-82a81d6aac18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:44.647628 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2389/4753] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:44 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:44.651569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845db0b-cf89-4845-9b12-7fbf5dbb7185 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:44.683172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b48d26a5-dc00-4e9e-b042-82a81d6aac18 None None] MFA Rules not processed for user `baca0537d1844a8ea771011a6c062b30`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:44.688821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b48d26a5-dc00-4e9e-b042-82a81d6aac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:44.756164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845db0b-cf89-4845-9b12-7fbf5dbb7185 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:44.764790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313c1b4-f270-4a42-8854-4f7f90039cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:44.765527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313c1b4-f270-4a42-8854-4f7f90039cee admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:44.765805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313c1b4-f270-4a42-8854-4f7f90039cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:44.766071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313c1b4-f270-4a42-8854-4f7f90039cee admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:44.767116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313c1b4-f270-4a42-8854-4f7f90039cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:44.769669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313c1b4-f270-4a42-8854-4f7f90039cee admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:44.797543 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2365/4754] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:23:44.808404 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2390/4755] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:23:44 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:23:44.812263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d26a5-dc00-4e9e-b042-82a81d6aac18 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:44.818499 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:44.826695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d26a5-dc00-4e9e-b042-82a81d6aac18 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:44.833252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83fe56-c404-48af-b5a0-6dcedb6fb3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:44.833866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83fe56-c404-48af-b5a0-6dcedb6fb3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:44.834171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83fe56-c404-48af-b5a0-6dcedb6fb3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:44.834442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83fe56-c404-48af-b5a0-6dcedb6fb3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:44.835104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83fe56-c404-48af-b5a0-6dcedb6fb3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:44.837311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83fe56-c404-48af-b5a0-6dcedb6fb3f4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:44.848473 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2366/4756] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:23:44.852873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313c1b4-f270-4a42-8854-4f7f90039cee admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:44.868247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313c1b4-f270-4a42-8854-4f7f90039cee admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:44.876267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24326e43-30fe-47b2-baf4-13adb789bfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:44.876882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326e43-30fe-47b2-baf4-13adb789bfba admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:44.877234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326e43-30fe-47b2-baf4-13adb789bfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:44.877878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326e43-30fe-47b2-baf4-13adb789bfba admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:44.878323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24326e43-30fe-47b2-baf4-13adb789bfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:44.880938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24326e43-30fe-47b2-baf4-13adb789bfba admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:44.885232 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:44.903431 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2391/4757] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:23:44.904022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83fe56-c404-48af-b5a0-6dcedb6fb3f4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:44.915133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83fe56-c404-48af-b5a0-6dcedb6fb3f4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:44.920384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de213ab3-34ce-4c4d-8af3-2b88d66c4cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:44.920884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213ab3-34ce-4c4d-8af3-2b88d66c4cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:44.921161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213ab3-34ce-4c4d-8af3-2b88d66c4cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:44.921432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213ab3-34ce-4c4d-8af3-2b88d66c4cd4 admin admin] PATH_INFO: `/v3/projects/dfc008141c2c40dcb5e708edcdbd6351/users/abc06b545d304951969c0c8f92282471/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:44.938881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de213ab3-34ce-4c4d-8af3-2b88d66c4cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc008141c2c40dcb5e708edcdbd6351, user_id=abc06b545d304951969c0c8f92282471, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:44.941736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de213ab3-34ce-4c4d-8af3-2b88d66c4cd4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:44.958995 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2367/4758] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:23:44 2022] PUT /identity/v3/projects/dfc008141c2c40dcb5e708edcdbd6351/users/abc06b545d304951969c0c8f92282471/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:44.970187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8715394-d75d-484a-8b57-eefbc068a613 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:44.970455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8715394-d75d-484a-8b57-eefbc068a613 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:44.970731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8715394-d75d-484a-8b57-eefbc068a613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:45.008243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b8715394-d75d-484a-8b57-eefbc068a613 None None] MFA Rules not processed for user `abc06b545d304951969c0c8f92282471`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:45.010356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b8715394-d75d-484a-8b57-eefbc068a613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:45.142081 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2392/4759] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:45.142886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de213ab3-34ce-4c4d-8af3-2b88d66c4cd4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:45.229032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de213ab3-34ce-4c4d-8af3-2b88d66c4cd4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:45.233931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226caf-be4e-4be8-bfdb-da134201ee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:45.234542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226caf-be4e-4be8-bfdb-da134201ee15 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:45.234818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226caf-be4e-4be8-bfdb-da134201ee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:45.235119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226caf-be4e-4be8-bfdb-da134201ee15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:45.235750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b226caf-be4e-4be8-bfdb-da134201ee15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:45.237647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b226caf-be4e-4be8-bfdb-da134201ee15 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:45.270904 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2368/4760] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:45 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:23:45.275463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8715394-d75d-484a-8b57-eefbc068a613 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:45.288183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8715394-d75d-484a-8b57-eefbc068a613 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:45.354439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b705d-aac4-4d00-9421-a3c97769726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:45.355288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b705d-aac4-4d00-9421-a3c97769726c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:45.355617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b705d-aac4-4d00-9421-a3c97769726c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:45.356566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b705d-aac4-4d00-9421-a3c97769726c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:45.357323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b705d-aac4-4d00-9421-a3c97769726c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:45.359357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b705d-aac4-4d00-9421-a3c97769726c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:45.387861 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2393/4761] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:23:45 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:45.391547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226caf-be4e-4be8-bfdb-da134201ee15 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:45.406291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226caf-be4e-4be8-bfdb-da134201ee15 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:45.412863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235adb5c-b86a-4bef-b9b4-4dc97ce2fdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:45.414234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235adb5c-b86a-4bef-b9b4-4dc97ce2fdad admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:45.415234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235adb5c-b86a-4bef-b9b4-4dc97ce2fdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:45.415682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235adb5c-b86a-4bef-b9b4-4dc97ce2fdad admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:45.416395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235adb5c-b86a-4bef-b9b4-4dc97ce2fdad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:45.418256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235adb5c-b86a-4bef-b9b4-4dc97ce2fdad admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:45.435268 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2369/4762] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:23:45.439248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b705d-aac4-4d00-9421-a3c97769726c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:45.450807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b705d-aac4-4d00-9421-a3c97769726c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:45.458826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5decbf-3c9b-470a-82a8-7ba864e01e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:45.459734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5decbf-3c9b-470a-82a8-7ba864e01e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:45.460368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5decbf-3c9b-470a-82a8-7ba864e01e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:45.460812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5decbf-3c9b-470a-82a8-7ba864e01e6b admin admin] PATH_INFO: `/v3/projects/696e3eb695d94717b191241305e31745/users/a25987b942c049299a07bb422d0f6a17/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:45.483121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5decbf-3c9b-470a-82a8-7ba864e01e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=696e3eb695d94717b191241305e31745, user_id=a25987b942c049299a07bb422d0f6a17, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:45.486702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5decbf-3c9b-470a-82a8-7ba864e01e6b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:45.505712 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2394/4763] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:23:45 2022] PUT /identity/v3/projects/696e3eb695d94717b191241305e31745/users/a25987b942c049299a07bb422d0f6a17/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:45.509842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235adb5c-b86a-4bef-b9b4-4dc97ce2fdad admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:45.521453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235adb5c-b86a-4bef-b9b4-4dc97ce2fdad admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:45.615382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb9556-7943-4584-b152-0fe1a1830b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:45.616677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb9556-7943-4584-b152-0fe1a1830b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:45.617030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb9556-7943-4584-b152-0fe1a1830b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:45.617370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb9556-7943-4584-b152-0fe1a1830b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:45.619042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb9556-7943-4584-b152-0fe1a1830b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:45.621371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb9556-7943-4584-b152-0fe1a1830b09 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:45.639564 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2370/4764] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:23:45.640965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5decbf-3c9b-470a-82a8-7ba864e01e6b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:45.653073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5decbf-3c9b-470a-82a8-7ba864e01e6b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:45.658863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986a988-ab9a-4d79-97ec-7a6d1cb6a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:45.659531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986a988-ab9a-4d79-97ec-7a6d1cb6a032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:45.659808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986a988-ab9a-4d79-97ec-7a6d1cb6a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:45.660085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986a988-ab9a-4d79-97ec-7a6d1cb6a032 admin admin] PATH_INFO: `/v3/projects/696e3eb695d94717b191241305e31745/users/a25987b942c049299a07bb422d0f6a17/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:45.668296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986a988-ab9a-4d79-97ec-7a6d1cb6a032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=696e3eb695d94717b191241305e31745, user_id=a25987b942c049299a07bb422d0f6a17, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:45.668296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986a988-ab9a-4d79-97ec-7a6d1cb6a032 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:45.681120 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2395/4765] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:23:45 2022] PUT /identity/v3/projects/696e3eb695d94717b191241305e31745/users/a25987b942c049299a07bb422d0f6a17/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:45.692193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1f53e-8f4c-4c1d-8f47-d1cc966481ba None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:45.692517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1f53e-8f4c-4c1d-8f47-d1cc966481ba None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:45.692742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1f53e-8f4c-4c1d-8f47-d1cc966481ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:45.754225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ccf1f53e-8f4c-4c1d-8f47-d1cc966481ba None None] MFA Rules not processed for user `a25987b942c049299a07bb422d0f6a17`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:45.755455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ccf1f53e-8f4c-4c1d-8f47-d1cc966481ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:45.828830 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:45.918435 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2371/4766] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:45.922389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986a988-ab9a-4d79-97ec-7a6d1cb6a032 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:45.936968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986a988-ab9a-4d79-97ec-7a6d1cb6a032 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:45.959702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613836d-f2d8-4724-a85a-d50314accf1b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:45.960636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613836d-f2d8-4724-a85a-d50314accf1b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:45.960636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613836d-f2d8-4724-a85a-d50314accf1b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:45.963120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613836d-f2d8-4724-a85a-d50314accf1b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:45.963857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613836d-f2d8-4724-a85a-d50314accf1b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:45.967435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613836d-f2d8-4724-a85a-d50314accf1b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:45.997590 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2396/4767] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:45 2022] POST /identity/v3/services => generated 287 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:23:46.001915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1f53e-8f4c-4c1d-8f47-d1cc966481ba None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:46.016574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1f53e-8f4c-4c1d-8f47-d1cc966481ba None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:46.043927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f849-a7a8-4406-9f18-ab87bf44f430 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:46.049884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f849-a7a8-4406-9f18-ab87bf44f430 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:46.050286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f849-a7a8-4406-9f18-ab87bf44f430 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:46.050719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f849-a7a8-4406-9f18-ab87bf44f430 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:46.052881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7f849-a7a8-4406-9f18-ab87bf44f430 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:46.054741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7f849-a7a8-4406-9f18-ab87bf44f430 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-13c7f849-a7a8-4406-9f18-ab87bf44f430 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: On instance['enabled']: Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: On instance['enabled']: Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: 'False' Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise error Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application On instance['enabled']: Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application 'False' Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.062685 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 16 01:23:46.064937 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 16 01:23:46.066237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 16 01:23:46.066237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 16 01:23:46.066237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.066237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.066237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.066237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.066237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application On instance['enabled']: Oct 16 01:23:46.066237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application 'False' Oct 16 01:23:46.066237 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.071530 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2372/4768] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Oct 16 01:23:46 2022] POST /identity/v3/endpoints => generated 283 bytes in 70 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 16 01:23:46.072919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613836d-f2d8-4724-a85a-d50314accf1b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:46.084137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613836d-f2d8-4724-a85a-d50314accf1b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:46.101601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a15cb2-32e9-4025-802f-19d49c89b7b9 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:46.103148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a15cb2-32e9-4025-802f-19d49c89b7b9 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:46.104700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a15cb2-32e9-4025-802f-19d49c89b7b9 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:46.104988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a15cb2-32e9-4025-802f-19d49c89b7b9 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:46.105704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a15cb2-32e9-4025-802f-19d49c89b7b9 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:46.107371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a15cb2-32e9-4025-802f-19d49c89b7b9 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f0a15cb2-32e9-4025-802f-19d49c89b7b9 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: On instance['enabled']: Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: On instance['enabled']: Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: 'True' Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise error Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application On instance['enabled']: Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application 'True' Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.114407 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 16 01:23:46.116290 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 16 01:23:46.117350 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 16 01:23:46.117350 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 16 01:23:46.117350 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.117350 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.117350 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.117350 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.117350 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application On instance['enabled']: Oct 16 01:23:46.117350 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application 'True' Oct 16 01:23:46.117350 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.120840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f849-a7a8-4406-9f18-ab87bf44f430 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:46.137485 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2397/4769] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Oct 16 01:23:46 2022] POST /identity/v3/endpoints => generated 281 bytes in 65 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 16 01:23:46.141968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f849-a7a8-4406-9f18-ab87bf44f430 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:46.148615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8785c-bfcb-41d1-afa4-350cd22ee512 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:46.148615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8785c-bfcb-41d1-afa4-350cd22ee512 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:46.148615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8785c-bfcb-41d1-afa4-350cd22ee512 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:46.149581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8785c-bfcb-41d1-afa4-350cd22ee512 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:46.149673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8785c-bfcb-41d1-afa4-350cd22ee512 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:46.151282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8785c-bfcb-41d1-afa4-350cd22ee512 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:46.170301 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-4ee8785c-bfcb-41d1-afa4-350cd22ee512 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1514082814. To ensure interoperability, identifiers should be a valid uuid. Oct 16 01:23:46.170301 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 16 01:23:46.170301 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:23:46.224399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a15cb2-32e9-4025-802f-19d49c89b7b9 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:46.232561 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2373/4770] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Oct 16 01:23:46 2022] POST /identity/v3/endpoints => generated 361 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:46.237593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a15cb2-32e9-4025-802f-19d49c89b7b9 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:46.256179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3fd86-d963-480d-9fc6-bd739e173566 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:46.257116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3fd86-d963-480d-9fc6-bd739e173566 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:46.257584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3fd86-d963-480d-9fc6-bd739e173566 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:46.258132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3fd86-d963-480d-9fc6-bd739e173566 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/regions/tempest-region-1514082814` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:46.259052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3fd86-d963-480d-9fc6-bd739e173566 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1514082814)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:46.260508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3fd86-d963-480d-9fc6-bd739e173566 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:46.263350 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2398/4771] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Oct 16 01:23:46 2022] GET /identity/v3/regions/tempest-region-1514082814 => generated 180 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:46.268235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8785c-bfcb-41d1-afa4-350cd22ee512 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:46.282722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8785c-bfcb-41d1-afa4-350cd22ee512 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:46.290416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bed4a-1af3-49b7-b8ff-0e7447af97a2 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:46.291632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bed4a-1af3-49b7-b8ff-0e7447af97a2 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:46.292565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bed4a-1af3-49b7-b8ff-0e7447af97a2 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:46.293201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bed4a-1af3-49b7-b8ff-0e7447af97a2 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/endpoints/bf74ce5f9a9c45c7803cc0a775cb7112` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:46.300288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bed4a-1af3-49b7-b8ff-0e7447af97a2 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=bf74ce5f9a9c45c7803cc0a775cb7112)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:46.301954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bed4a-1af3-49b7-b8ff-0e7447af97a2 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-5e0bed4a-1af3-49b7-b8ff-0e7447af97a2 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: On instance['enabled']: Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: On instance['enabled']: Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: 'False' Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise error Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application On instance['enabled']: Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application 'False' Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.310443 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 16 01:23:46.311933 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 16 01:23:46.313019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 16 01:23:46.313019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 16 01:23:46.313019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.313019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.313019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.313019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.313019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application On instance['enabled']: Oct 16 01:23:46.313019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application 'False' Oct 16 01:23:46.313019 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:46.313019 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2374/4772] 10.222.0.39 () {60 vars in 1255 bytes} [Sun Oct 16 01:23:46 2022] PATCH /identity/v3/endpoints/bf74ce5f9a9c45c7803cc0a775cb7112 => generated 283 bytes in 44 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 16 01:23:46.315850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3fd86-d963-480d-9fc6-bd739e173566 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:46.326634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3fd86-d963-480d-9fc6-bd739e173566 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:46.332454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9355e2-babf-48ec-9524-8cb6cd215f5b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:46.333090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9355e2-babf-48ec-9524-8cb6cd215f5b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:46.333375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9355e2-babf-48ec-9524-8cb6cd215f5b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:46.333651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9355e2-babf-48ec-9524-8cb6cd215f5b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/endpoints/bf74ce5f9a9c45c7803cc0a775cb7112` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:46.334983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9355e2-babf-48ec-9524-8cb6cd215f5b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=bf74ce5f9a9c45c7803cc0a775cb7112)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:46.339332 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-cb9355e2-babf-48ec-9524-8cb6cd215f5b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:23:46.339332 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:23:46.339332 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:23:46.340513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9355e2-babf-48ec-9524-8cb6cd215f5b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:46.352479 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:46.364437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cb9355e2-babf-48ec-9524-8cb6cd215f5b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'bf74ce5f9a9c45c7803cc0a775cb7112', 'request_id': 'req-cb9355e2-babf-48ec-9524-8cb6cd215f5b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:46.381324 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2399/4773] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:46 2022] DELETE /identity/v3/endpoints/bf74ce5f9a9c45c7803cc0a775cb7112 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:23:46.384685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bed4a-1af3-49b7-b8ff-0e7447af97a2 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:46.398223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bed4a-1af3-49b7-b8ff-0e7447af97a2 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:46.427636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e9574-4a04-4d1a-af7b-91b5a89e1d2d tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:46.428847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e9574-4a04-4d1a-af7b-91b5a89e1d2d tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:46.429206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e9574-4a04-4d1a-af7b-91b5a89e1d2d tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:46.429590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e9574-4a04-4d1a-af7b-91b5a89e1d2d tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/regions/tempest-region-1514082814` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:46.431855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e9574-4a04-4d1a-af7b-91b5a89e1d2d tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1514082814)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:46.433848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e9574-4a04-4d1a-af7b-91b5a89e1d2d tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:46.464277 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2375/4774] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Oct 16 01:23:46 2022] DELETE /identity/v3/regions/tempest-region-1514082814 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:23:46.469577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9355e2-babf-48ec-9524-8cb6cd215f5b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:46.483767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9355e2-babf-48ec-9524-8cb6cd215f5b tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:46.503403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973c6d1-4189-492f-a58b-d24739df7bbc tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:46.504428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973c6d1-4189-492f-a58b-d24739df7bbc tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:46.505059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973c6d1-4189-492f-a58b-d24739df7bbc tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:46.505543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973c6d1-4189-492f-a58b-d24739df7bbc tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:46.506423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973c6d1-4189-492f-a58b-d24739df7bbc tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:46.508397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973c6d1-4189-492f-a58b-d24739df7bbc tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:46.530800 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-1973c6d1-4189-492f-a58b-d24739df7bbc tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1483853241. To ensure interoperability, identifiers should be a valid uuid. Oct 16 01:23:46.530800 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 16 01:23:46.530800 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:23:46.580716 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2400/4775] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Oct 16 01:23:46 2022] POST /identity/v3/endpoints => generated 360 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:46.584783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e9574-4a04-4d1a-af7b-91b5a89e1d2d tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:46.599931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e9574-4a04-4d1a-af7b-91b5a89e1d2d tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:46.624624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cccba-ee77-4937-b6d5-dfaeebd29746 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:46.626181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cccba-ee77-4937-b6d5-dfaeebd29746 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:46.626693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cccba-ee77-4937-b6d5-dfaeebd29746 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:46.627247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cccba-ee77-4937-b6d5-dfaeebd29746 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/regions/tempest-region-1483853241` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:46.628571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cccba-ee77-4937-b6d5-dfaeebd29746 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1483853241)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:46.629989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cccba-ee77-4937-b6d5-dfaeebd29746 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:46.632366 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2376/4776] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Oct 16 01:23:46 2022] GET /identity/v3/regions/tempest-region-1483853241 => generated 180 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:46.637773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973c6d1-4189-492f-a58b-d24739df7bbc tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:46.650681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973c6d1-4189-492f-a58b-d24739df7bbc tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:46.657502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42077c30-bddf-4bc7-a948-22f7cb244fee tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:46.659907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42077c30-bddf-4bc7-a948-22f7cb244fee tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:46.660436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42077c30-bddf-4bc7-a948-22f7cb244fee tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:46.660640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42077c30-bddf-4bc7-a948-22f7cb244fee tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/endpoints/b673fdc23005463796557ba4ed88074a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:46.668348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42077c30-bddf-4bc7-a948-22f7cb244fee tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=b673fdc23005463796557ba4ed88074a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:46.670444 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-42077c30-bddf-4bc7-a948-22f7cb244fee tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:23:46.670444 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:23:46.670444 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:23:46.671083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42077c30-bddf-4bc7-a948-22f7cb244fee tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-42077c30-bddf-4bc7-a948-22f7cb244fee tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: On instance['enabled']: Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: On instance['enabled']: Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: 'True' Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise error Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application On instance['enabled']: Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application 'True' Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.699472 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 16 01:23:46.701648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 16 01:23:46.703045 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 16 01:23:46.703045 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 16 01:23:46.703045 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.703045 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 16 01:23:46.703045 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 16 01:23:46.703045 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.703045 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application On instance['enabled']: Oct 16 01:23:46.703045 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application 'True' Oct 16 01:23:46.703045 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:46.703045 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2401/4777] 10.222.0.39 () {60 vars in 1255 bytes} [Sun Oct 16 01:23:46 2022] PATCH /identity/v3/endpoints/b673fdc23005463796557ba4ed88074a => generated 281 bytes in 65 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 16 01:23:46.705805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cccba-ee77-4937-b6d5-dfaeebd29746 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:46.725392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cccba-ee77-4937-b6d5-dfaeebd29746 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:46.733342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69302383-a50b-48ad-9dc4-583f1c51e713 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:46.734122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69302383-a50b-48ad-9dc4-583f1c51e713 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:46.734498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69302383-a50b-48ad-9dc4-583f1c51e713 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:46.734877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69302383-a50b-48ad-9dc4-583f1c51e713 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/endpoints/b673fdc23005463796557ba4ed88074a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:46.736305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69302383-a50b-48ad-9dc4-583f1c51e713 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=b673fdc23005463796557ba4ed88074a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:46.738084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69302383-a50b-48ad-9dc4-583f1c51e713 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:46.749461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-69302383-a50b-48ad-9dc4-583f1c51e713 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'b673fdc23005463796557ba4ed88074a', 'request_id': 'req-69302383-a50b-48ad-9dc4-583f1c51e713'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:46.764098 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2377/4778] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:46 2022] DELETE /identity/v3/endpoints/b673fdc23005463796557ba4ed88074a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:46.768965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42077c30-bddf-4bc7-a948-22f7cb244fee tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:46.782301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42077c30-bddf-4bc7-a948-22f7cb244fee tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:46.802331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374450a0-8ca4-4755-80bf-cf2c4002e8c8 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:46.803130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374450a0-8ca4-4755-80bf-cf2c4002e8c8 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:46.803885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374450a0-8ca4-4755-80bf-cf2c4002e8c8 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:46.804362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374450a0-8ca4-4755-80bf-cf2c4002e8c8 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/regions/tempest-region-1483853241` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:46.806939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374450a0-8ca4-4755-80bf-cf2c4002e8c8 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1483853241)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:46.809563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374450a0-8ca4-4755-80bf-cf2c4002e8c8 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:46.835339 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2402/4779] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Oct 16 01:23:46 2022] DELETE /identity/v3/regions/tempest-region-1483853241 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:46.840559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69302383-a50b-48ad-9dc4-583f1c51e713 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:46.857022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69302383-a50b-48ad-9dc4-583f1c51e713 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:46.886421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d271d29-1358-410a-a894-38b8758e79e0 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25987b942c049299a07bb422d0f6a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '696e3eb695d94717b191241305e31745', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:46.887331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271d29-1358-410a-a894-38b8758e79e0 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:46.887784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271d29-1358-410a-a894-38b8758e79e0 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:46.888370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271d29-1358-410a-a894-38b8758e79e0 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] PATH_INFO: `/v3/services/2ea140fb1f8a4e82a402c3a24fb4a822` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:46.889642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d271d29-1358-410a-a894-38b8758e79e0 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2ea140fb1f8a4e82a402c3a24fb4a822)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:46.891901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d271d29-1358-410a-a894-38b8758e79e0 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:46.938529 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2378/4780] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:46 2022] DELETE /identity/v3/services/2ea140fb1f8a4e82a402c3a24fb4a822 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:46.942665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374450a0-8ca4-4755-80bf-cf2c4002e8c8 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:47.092814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374450a0-8ca4-4755-80bf-cf2c4002e8c8 tempest-EndpointsNegativeTestJSON-490681302 tempest-EndpointsNegativeTestJSON-490681302-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:47.114887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:47.115580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:47.115858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:47.116134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] PATH_INFO: `/v3/users/abc06b545d304951969c0c8f92282471` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:47.118229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc06b545d304951969c0c8f92282471)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:47.120461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:47.199699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc06b545d304951969c0c8f92282471'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:47.200576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc06b545d304951969c0c8f92282471'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:47.211844 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:47.225731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc06b545d304951969c0c8f92282471'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:47.245404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc06b545d304951969c0c8f92282471'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:47.246459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc06b545d304951969c0c8f92282471'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:47.276588 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2403/4781] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:23:46 2022] DELETE /identity/v3/users/abc06b545d304951969c0c8f92282471 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:23:47.282001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fbe09-d77f-4763-8b38-0bac85afa376 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:47.282300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fbe09-d77f-4763-8b38-0bac85afa376 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:47.282580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fbe09-d77f-4763-8b38-0bac85afa376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:47.317225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a43fbe09-d77f-4763-8b38-0bac85afa376 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:47.318905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a43fbe09-d77f-4763-8b38-0bac85afa376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:47.343530 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:47.417221 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2379/4782] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:47.451304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:47.453139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:47.580498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80073a29-93db-48ab-90c8-d395a8c6d366 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:47.584540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b3435-5973-4369-b04b-437876a18ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:47.585267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b3435-5973-4369-b04b-437876a18ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:47.585642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b3435-5973-4369-b04b-437876a18ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:47.586004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b3435-5973-4369-b04b-437876a18ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:47.596683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b3435-5973-4369-b04b-437876a18ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:47.597664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b3435-5973-4369-b04b-437876a18ac6 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:47.608647 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2404/4783] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:23:49.340134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fbe09-d77f-4763-8b38-0bac85afa376 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:49.342641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a43fbe09-d77f-4763-8b38-0bac85afa376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:49.394367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fbe09-d77f-4763-8b38-0bac85afa376 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:49.403223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:49.403963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:49.405526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:49.406316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] PATH_INFO: `/v3/projects/dfc008141c2c40dcb5e708edcdbd6351` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:49.407805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc008141c2c40dcb5e708edcdbd6351)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:49.410879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:49.517166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f1b37-510e-4dbc-b61d-7e9be83db143 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:49.517957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f1b37-510e-4dbc-b61d-7e9be83db143 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:49.518410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f1b37-510e-4dbc-b61d-7e9be83db143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:49.529627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc008141c2c40dcb5e708edcdbd6351', 'request_id': 'req-a55adc3c-7a42-4200-8259-732529ef4f1d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:49.541661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc008141c2c40dcb5e708edcdbd6351', 'request_id': 'req-a55adc3c-7a42-4200-8259-732529ef4f1d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:49.551666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cd5f1b37-510e-4dbc-b61d-7e9be83db143 None None] MFA Rules not processed for user `85cb1d720ba24d7f908a93fffe29427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:49.553212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cd5f1b37-510e-4dbc-b61d-7e9be83db143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:49.564999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc008141c2c40dcb5e708edcdbd6351', 'request_id': 'req-a55adc3c-7a42-4200-8259-732529ef4f1d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:49.590402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] The token cache is being invalidate because project dfc008141c2c40dcb5e708edcdbd6351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:49.590842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:49.591669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:49.593704 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2380/4784] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:49 2022] DELETE /identity/v3/projects/dfc008141c2c40dcb5e708edcdbd6351 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:49.597523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:49.598952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:49.685540 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2405/4785] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:23:49.716107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55adc3c-7a42-4200-8259-732529ef4f1d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:49.720936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb62d4-e39c-43ff-a24e-a410d3f17e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:49.721579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb62d4-e39c-43ff-a24e-a410d3f17e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:49.725206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb62d4-e39c-43ff-a24e-a410d3f17e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:49.725523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb62d4-e39c-43ff-a24e-a410d3f17e3d admin admin] PATH_INFO: `/v3/users/a25987b942c049299a07bb422d0f6a17` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:49.738836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb62d4-e39c-43ff-a24e-a410d3f17e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25987b942c049299a07bb422d0f6a17)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:49.741247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb62d4-e39c-43ff-a24e-a410d3f17e3d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:49.864355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bfeb62d4-e39c-43ff-a24e-a410d3f17e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25987b942c049299a07bb422d0f6a17'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:49.865864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bfeb62d4-e39c-43ff-a24e-a410d3f17e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25987b942c049299a07bb422d0f6a17'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:49.870218 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:49.891766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bfeb62d4-e39c-43ff-a24e-a410d3f17e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25987b942c049299a07bb422d0f6a17'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:49.904729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bfeb62d4-e39c-43ff-a24e-a410d3f17e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25987b942c049299a07bb422d0f6a17'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:49.909054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bfeb62d4-e39c-43ff-a24e-a410d3f17e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25987b942c049299a07bb422d0f6a17'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:49.930445 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2381/4786] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:23:49 2022] DELETE /identity/v3/users/a25987b942c049299a07bb422d0f6a17 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:23:50.594504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f1b37-510e-4dbc-b61d-7e9be83db143 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:50.606776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f1b37-510e-4dbc-b61d-7e9be83db143 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:50.726021 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:50.737969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:50.743508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:50.744505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:50.745087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8 admin admin] PATH_INFO: `/v3/projects/696e3eb695d94717b191241305e31745` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:50.747650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=696e3eb695d94717b191241305e31745)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:50.750273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:50.816103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '696e3eb695d94717b191241305e31745', 'request_id': 'req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:50.824318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '696e3eb695d94717b191241305e31745', 'request_id': 'req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:50.832928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '696e3eb695d94717b191241305e31745', 'request_id': 'req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:50.845038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8 admin admin] The token cache is being invalidate because project 696e3eb695d94717b191241305e31745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:50.845496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:50.846247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1b8ea372-d8a8-477a-9cd9-a1bab598a2d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:50.848975 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2406/4787] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:50 2022] DELETE /identity/v3/projects/696e3eb695d94717b191241305e31745 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:23:50.854510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0e22e-f690-4490-9ada-11cf2d8f1ecf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:50.855374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0e22e-f690-4490-9ada-11cf2d8f1ecf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:50.855646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0e22e-f690-4490-9ada-11cf2d8f1ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:50.880895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-daf0e22e-f690-4490-9ada-11cf2d8f1ecf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:50.882114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-daf0e22e-f690-4490-9ada-11cf2d8f1ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:50.955111 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2382/4788] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:23:50.963762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06474f4d-5f20-45be-8499-63dc4e579bc9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:50.964266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06474f4d-5f20-45be-8499-63dc4e579bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:50.964744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06474f4d-5f20-45be-8499-63dc4e579bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:50.985967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-06474f4d-5f20-45be-8499-63dc4e579bc9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:50.987259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-06474f4d-5f20-45be-8499-63dc4e579bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:50.996604 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2407/4789] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:23:51.001263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0e22e-f690-4490-9ada-11cf2d8f1ecf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:51.014775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0e22e-f690-4490-9ada-11cf2d8f1ecf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:51.019773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19705d4-aabd-42d0-95ce-259e0f9c001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:51.021534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19705d4-aabd-42d0-95ce-259e0f9c001c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:51.021991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19705d4-aabd-42d0-95ce-259e0f9c001c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:51.022504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19705d4-aabd-42d0-95ce-259e0f9c001c admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:51.023323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19705d4-aabd-42d0-95ce-259e0f9c001c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:23:51.024431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19705d4-aabd-42d0-95ce-259e0f9c001c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:51.026184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19705d4-aabd-42d0-95ce-259e0f9c001c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:51.041822 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2383/4790] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:51.046430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06474f4d-5f20-45be-8499-63dc4e579bc9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:51.061215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06474f4d-5f20-45be-8499-63dc4e579bc9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:51.075663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4297c-ec56-4e2e-85bc-863897117249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:51.076783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4297c-ec56-4e2e-85bc-863897117249 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:51.077302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4297c-ec56-4e2e-85bc-863897117249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:51.078875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4297c-ec56-4e2e-85bc-863897117249 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:51.080064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4297c-ec56-4e2e-85bc-863897117249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:51.082091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4297c-ec56-4e2e-85bc-863897117249 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:51.141248 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2408/4791] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:51 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:51.144322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19705d4-aabd-42d0-95ce-259e0f9c001c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:51.162150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19705d4-aabd-42d0-95ce-259e0f9c001c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:51.296946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd634d-86db-4006-9c92-251fb87600f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:51.297721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd634d-86db-4006-9c92-251fb87600f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:51.297858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd634d-86db-4006-9c92-251fb87600f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:51.298090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd634d-86db-4006-9c92-251fb87600f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:51.299376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd634d-86db-4006-9c92-251fb87600f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:51.301310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd634d-86db-4006-9c92-251fb87600f1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:51.329428 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2384/4792] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:23:51 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:51.334302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4297c-ec56-4e2e-85bc-863897117249 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:51.347642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4297c-ec56-4e2e-85bc-863897117249 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:51.353051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f5ab5-53c8-4cca-abb3-056b3c365815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:51.353928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f5ab5-53c8-4cca-abb3-056b3c365815 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:51.354268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f5ab5-53c8-4cca-abb3-056b3c365815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:51.354608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f5ab5-53c8-4cca-abb3-056b3c365815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:51.355346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f5ab5-53c8-4cca-abb3-056b3c365815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:51.357048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f5ab5-53c8-4cca-abb3-056b3c365815 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:51.372873 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2409/4793] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:23:51.374341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd634d-86db-4006-9c92-251fb87600f1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:51.385715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd634d-86db-4006-9c92-251fb87600f1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:51.391180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e13aa-d04e-43e6-ba1b-376d38ac86fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:51.392143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e13aa-d04e-43e6-ba1b-376d38ac86fa admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:51.392143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e13aa-d04e-43e6-ba1b-376d38ac86fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:51.392391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e13aa-d04e-43e6-ba1b-376d38ac86fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:51.392955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e13aa-d04e-43e6-ba1b-376d38ac86fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:51.394556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e13aa-d04e-43e6-ba1b-376d38ac86fa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:51.408000 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2385/4794] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:23:51.412262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f5ab5-53c8-4cca-abb3-056b3c365815 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:51.424341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f5ab5-53c8-4cca-abb3-056b3c365815 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:51.432036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3408b-3d9e-49b1-8249-5fee0173f18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:51.433363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3408b-3d9e-49b1-8249-5fee0173f18c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:51.433748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3408b-3d9e-49b1-8249-5fee0173f18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:51.435103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3408b-3d9e-49b1-8249-5fee0173f18c admin admin] PATH_INFO: `/v3/projects/cd7f1bfdf8454c3990d1883816d5ffeb/users/32b628d3020c4b3697d7a540abe31a85/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:51.455530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3408b-3d9e-49b1-8249-5fee0173f18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7f1bfdf8454c3990d1883816d5ffeb, user_id=32b628d3020c4b3697d7a540abe31a85, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:51.458401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3408b-3d9e-49b1-8249-5fee0173f18c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:51.484253 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2410/4795] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:23:51 2022] PUT /identity/v3/projects/cd7f1bfdf8454c3990d1883816d5ffeb/users/32b628d3020c4b3697d7a540abe31a85/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:51.496411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb1031-ff28-43e5-bb54-a72b90ebfb93 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:51.496702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb1031-ff28-43e5-bb54-a72b90ebfb93 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:51.496982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb1031-ff28-43e5-bb54-a72b90ebfb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:51.530100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fdeb1031-ff28-43e5-bb54-a72b90ebfb93 None None] MFA Rules not processed for user `32b628d3020c4b3697d7a540abe31a85`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:51.531442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fdeb1031-ff28-43e5-bb54-a72b90ebfb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:51.573933 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:51.665846 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2386/4796] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:51.670304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3408b-3d9e-49b1-8249-5fee0173f18c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:51.808642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3408b-3d9e-49b1-8249-5fee0173f18c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:51.814320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea68f1a-c4aa-4965-9470-60f2139f24d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:51.815597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea68f1a-c4aa-4965-9470-60f2139f24d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:51.815744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea68f1a-c4aa-4965-9470-60f2139f24d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:51.816204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea68f1a-c4aa-4965-9470-60f2139f24d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:51.817316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea68f1a-c4aa-4965-9470-60f2139f24d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:51.820029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea68f1a-c4aa-4965-9470-60f2139f24d3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:51.855382 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2411/4797] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:51 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:23:51.859622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb1031-ff28-43e5-bb54-a72b90ebfb93 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:51.874089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb1031-ff28-43e5-bb54-a72b90ebfb93 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:51.940402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc63448-1492-4b63-8480-d31d5d2ef029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:51.941121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc63448-1492-4b63-8480-d31d5d2ef029 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:51.941402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc63448-1492-4b63-8480-d31d5d2ef029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:51.941672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc63448-1492-4b63-8480-d31d5d2ef029 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:51.942300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc63448-1492-4b63-8480-d31d5d2ef029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:51.944245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc63448-1492-4b63-8480-d31d5d2ef029 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:51.971664 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2387/4798] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:23:51 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:51.973048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea68f1a-c4aa-4965-9470-60f2139f24d3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:51.984093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea68f1a-c4aa-4965-9470-60f2139f24d3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:51.988688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9a02b-f2c2-4fa8-8f75-bd8d842ae737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:51.989286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9a02b-f2c2-4fa8-8f75-bd8d842ae737 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:51.989559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9a02b-f2c2-4fa8-8f75-bd8d842ae737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:51.989824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9a02b-f2c2-4fa8-8f75-bd8d842ae737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:51.990452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9a02b-f2c2-4fa8-8f75-bd8d842ae737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:51.992060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9a02b-f2c2-4fa8-8f75-bd8d842ae737 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:51.995039 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:52.005473 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2412/4799] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:23:52.009527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc63448-1492-4b63-8480-d31d5d2ef029 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:52.020455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc63448-1492-4b63-8480-d31d5d2ef029 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:52.025722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce01ea3-1a3b-4964-bea3-7f4a76af85e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:52.026421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce01ea3-1a3b-4964-bea3-7f4a76af85e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:52.026824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce01ea3-1a3b-4964-bea3-7f4a76af85e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:52.027125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce01ea3-1a3b-4964-bea3-7f4a76af85e6 admin admin] PATH_INFO: `/v3/projects/97497cccc53342abb06071c1fb18087f/users/77d06f9d140e400fb43bf0b49428647e/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:52.044347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce01ea3-1a3b-4964-bea3-7f4a76af85e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97497cccc53342abb06071c1fb18087f, user_id=77d06f9d140e400fb43bf0b49428647e, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:52.047083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce01ea3-1a3b-4964-bea3-7f4a76af85e6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:52.063942 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2388/4800] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:23:52 2022] PUT /identity/v3/projects/97497cccc53342abb06071c1fb18087f/users/77d06f9d140e400fb43bf0b49428647e/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:52.067724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9a02b-f2c2-4fa8-8f75-bd8d842ae737 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:52.079915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9a02b-f2c2-4fa8-8f75-bd8d842ae737 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:52.145497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851c52c-7770-49c5-b63f-4727d810e1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:52.146508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c52c-7770-49c5-b63f-4727d810e1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:52.146508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c52c-7770-49c5-b63f-4727d810e1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:52.146719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c52c-7770-49c5-b63f-4727d810e1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:52.147494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851c52c-7770-49c5-b63f-4727d810e1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:52.149855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851c52c-7770-49c5-b63f-4727d810e1b1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:52.169201 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2413/4801] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:23:52.189429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce01ea3-1a3b-4964-bea3-7f4a76af85e6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:52.200775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce01ea3-1a3b-4964-bea3-7f4a76af85e6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:52.207000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020edc66-930f-4df6-a7ab-3bdf6ff1ac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:52.207000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020edc66-930f-4df6-a7ab-3bdf6ff1ac75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:52.207296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020edc66-930f-4df6-a7ab-3bdf6ff1ac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:52.207460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020edc66-930f-4df6-a7ab-3bdf6ff1ac75 admin admin] PATH_INFO: `/v3/projects/97497cccc53342abb06071c1fb18087f/users/77d06f9d140e400fb43bf0b49428647e/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:52.209642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020edc66-930f-4df6-a7ab-3bdf6ff1ac75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97497cccc53342abb06071c1fb18087f, user_id=77d06f9d140e400fb43bf0b49428647e, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:52.213031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020edc66-930f-4df6-a7ab-3bdf6ff1ac75 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:52.227619 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2389/4802] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:23:52 2022] PUT /identity/v3/projects/97497cccc53342abb06071c1fb18087f/users/77d06f9d140e400fb43bf0b49428647e/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:52.237071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d37985-cc43-483c-b388-7609ac232def None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:52.237360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d37985-cc43-483c-b388-7609ac232def None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:52.237636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d37985-cc43-483c-b388-7609ac232def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:52.274238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-52d37985-cc43-483c-b388-7609ac232def None None] MFA Rules not processed for user `77d06f9d140e400fb43bf0b49428647e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:52.275617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-52d37985-cc43-483c-b388-7609ac232def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:52.348704 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2414/4803] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:52.354482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020edc66-930f-4df6-a7ab-3bdf6ff1ac75 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:52.365189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020edc66-930f-4df6-a7ab-3bdf6ff1ac75 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:52.370056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b187a62-89f2-43b2-af9f-e1c2351f67de tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:52.370661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b187a62-89f2-43b2-af9f-e1c2351f67de tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:52.370987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b187a62-89f2-43b2-af9f-e1c2351f67de tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:52.371267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b187a62-89f2-43b2-af9f-e1c2351f67de tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:52.371881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b187a62-89f2-43b2-af9f-e1c2351f67de tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:52.373726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b187a62-89f2-43b2-af9f-e1c2351f67de tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:52.423323 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2390/4804] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:52 2022] POST /identity/v3/projects => generated 359 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:52.424783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d37985-cc43-483c-b388-7609ac232def None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:52.435005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d37985-cc43-483c-b388-7609ac232def None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:52.496381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48b427-565e-4f55-a4b0-44d0bfefa2bc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:52.497162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48b427-565e-4f55-a4b0-44d0bfefa2bc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:52.497547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48b427-565e-4f55-a4b0-44d0bfefa2bc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:52.497942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48b427-565e-4f55-a4b0-44d0bfefa2bc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:52.498683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48b427-565e-4f55-a4b0-44d0bfefa2bc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:52.500790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48b427-565e-4f55-a4b0-44d0bfefa2bc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:52.530965 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2415/4805] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:23:52 2022] POST /identity/v3/users => generated 416 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:23:52.535128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b187a62-89f2-43b2-af9f-e1c2351f67de tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:52.546031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b187a62-89f2-43b2-af9f-e1c2351f67de tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:52.551910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885ce0a-e66c-4705-8b3b-edf04ebfa7ee tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:52.552522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885ce0a-e66c-4705-8b3b-edf04ebfa7ee tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:52.552877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885ce0a-e66c-4705-8b3b-edf04ebfa7ee tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:52.553220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885ce0a-e66c-4705-8b3b-edf04ebfa7ee tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/users/b61d2164035443a6a935ab5d0bbeb533` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:52.568690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885ce0a-e66c-4705-8b3b-edf04ebfa7ee tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:get_user(user_id=b61d2164035443a6a935ab5d0bbeb533)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:52.571741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885ce0a-e66c-4705-8b3b-edf04ebfa7ee tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:52.576608 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2391/4806] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:23:52 2022] GET /identity/v3/users/b61d2164035443a6a935ab5d0bbeb533 => generated 416 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:23:52.578162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48b427-565e-4f55-a4b0-44d0bfefa2bc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:52.590447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48b427-565e-4f55-a4b0-44d0bfefa2bc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:52.595613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca5cb2-5f18-4687-8432-d4c8ce591b07 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:52.596251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5cb2-5f18-4687-8432-d4c8ce591b07 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:52.596531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5cb2-5f18-4687-8432-d4c8ce591b07 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:52.596806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5cb2-5f18-4687-8432-d4c8ce591b07 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/users/b61d2164035443a6a935ab5d0bbeb533` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:52.597962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca5cb2-5f18-4687-8432-d4c8ce591b07 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b61d2164035443a6a935ab5d0bbeb533)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:52.600309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca5cb2-5f18-4687-8432-d4c8ce591b07 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:52.603074 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:52.658932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fdca5cb2-5f18-4687-8432-d4c8ce591b07 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b61d2164035443a6a935ab5d0bbeb533'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:52.660057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fdca5cb2-5f18-4687-8432-d4c8ce591b07 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b61d2164035443a6a935ab5d0bbeb533'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:52.676188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fdca5cb2-5f18-4687-8432-d4c8ce591b07 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b61d2164035443a6a935ab5d0bbeb533'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:52.684648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fdca5cb2-5f18-4687-8432-d4c8ce591b07 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b61d2164035443a6a935ab5d0bbeb533'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:52.685376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fdca5cb2-5f18-4687-8432-d4c8ce591b07 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b61d2164035443a6a935ab5d0bbeb533'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:52.699892 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2416/4807] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:23:52 2022] DELETE /identity/v3/users/b61d2164035443a6a935ab5d0bbeb533 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:52.705527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885ce0a-e66c-4705-8b3b-edf04ebfa7ee tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:52.707972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d885ce0a-e66c-4705-8b3b-edf04ebfa7ee tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:52.724127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885ce0a-e66c-4705-8b3b-edf04ebfa7ee tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:52.762209 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:52.787698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:52.788334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:52.788615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:52.788889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/2914dbd1c1e3492ebb70481cfccb5c5c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:52.790100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2914dbd1c1e3492ebb70481cfccb5c5c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:52.792131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:52.841140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2914dbd1c1e3492ebb70481cfccb5c5c', 'request_id': 'req-5ec37717-584a-412e-993f-96cb3bd0af18'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:52.849726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2914dbd1c1e3492ebb70481cfccb5c5c', 'request_id': 'req-5ec37717-584a-412e-993f-96cb3bd0af18'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:52.858312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2914dbd1c1e3492ebb70481cfccb5c5c', 'request_id': 'req-5ec37717-584a-412e-993f-96cb3bd0af18'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:52.869766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project 2914dbd1c1e3492ebb70481cfccb5c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:52.870383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:52.870817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:52.872403 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2392/4808] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:52 2022] DELETE /identity/v3/projects/2914dbd1c1e3492ebb70481cfccb5c5c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:52.878391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca5cb2-5f18-4687-8432-d4c8ce591b07 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:52.890833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca5cb2-5f18-4687-8432-d4c8ce591b07 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:52.987239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cb426-e653-4699-88e3-09cb40f1c39a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:52.987912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cb426-e653-4699-88e3-09cb40f1c39a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:52.988249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cb426-e653-4699-88e3-09cb40f1c39a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:52.988520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cb426-e653-4699-88e3-09cb40f1c39a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:52.989163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cb426-e653-4699-88e3-09cb40f1c39a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:52.990961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cb426-e653-4699-88e3-09cb40f1c39a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:53.011534 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2417/4809] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:52 2022] POST /identity/v3/projects => generated 347 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:53.015518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:53.025976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:53.047973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec37717-584a-412e-993f-96cb3bd0af18 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:53.111642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf652c13-79e2-45ab-8406-83f72a4570ca tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:53.112522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf652c13-79e2-45ab-8406-83f72a4570ca tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:53.113029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf652c13-79e2-45ab-8406-83f72a4570ca tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:53.113306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf652c13-79e2-45ab-8406-83f72a4570ca tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:53.114123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf652c13-79e2-45ab-8406-83f72a4570ca tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:23:53.114587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf652c13-79e2-45ab-8406-83f72a4570ca tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:53.116658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf652c13-79e2-45ab-8406-83f72a4570ca tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:53.135557 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2393/4810] 10.222.0.39 () {58 vars in 1160 bytes} [Sun Oct 16 01:23:53 2022] GET /identity/v3/projects?is_domain=True => generated 1019 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:23:53.139621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cb426-e653-4699-88e3-09cb40f1c39a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:53.150758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cb426-e653-4699-88e3-09cb40f1c39a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:53.155482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34871d8a-304e-46aa-b282-8afc786c1006 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:53.156082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34871d8a-304e-46aa-b282-8afc786c1006 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:53.156367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34871d8a-304e-46aa-b282-8afc786c1006 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:53.156642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34871d8a-304e-46aa-b282-8afc786c1006 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:53.157267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34871d8a-304e-46aa-b282-8afc786c1006 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:53.158860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34871d8a-304e-46aa-b282-8afc786c1006 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:53.177813 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2418/4811] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Oct 16 01:23:53 2022] GET /identity/v3/domains => generated 828 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:23:53.182531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf652c13-79e2-45ab-8406-83f72a4570ca tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:53.193724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf652c13-79e2-45ab-8406-83f72a4570ca tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:53.203245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cca07e-ff0a-4a37-a7ef-d8d80e25ea05 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:53.204073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca07e-ff0a-4a37-a7ef-d8d80e25ea05 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:53.204252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca07e-ff0a-4a37-a7ef-d8d80e25ea05 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:53.204559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca07e-ff0a-4a37-a7ef-d8d80e25ea05 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/2838dad9f6434a6e8ee34fa04c258740` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:53.210228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cca07e-ff0a-4a37-a7ef-d8d80e25ea05 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:update_project(project_id=2838dad9f6434a6e8ee34fa04c258740)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:53.212910 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-37cca07e-ff0a-4a37-a7ef-d8d80e25ea05 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:23:53.212910 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:23:53.212910 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:23:53.213925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cca07e-ff0a-4a37-a7ef-d8d80e25ea05 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:53.228792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37cca07e-ff0a-4a37-a7ef-d8d80e25ea05 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2838dad9f6434a6e8ee34fa04c258740'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.230451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37cca07e-ff0a-4a37-a7ef-d8d80e25ea05 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2838dad9f6434a6e8ee34fa04c258740'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.278871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37cca07e-ff0a-4a37-a7ef-d8d80e25ea05 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2838dad9f6434a6e8ee34fa04c258740'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.279541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37cca07e-ff0a-4a37-a7ef-d8d80e25ea05 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2838dad9f6434a6e8ee34fa04c258740'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.282256 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2394/4812] 10.222.0.39 () {60 vars in 1252 bytes} [Sun Oct 16 01:23:53 2022] PATCH /identity/v3/projects/2838dad9f6434a6e8ee34fa04c258740 => generated 361 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:53.286367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34871d8a-304e-46aa-b282-8afc786c1006 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:53.290293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-34871d8a-304e-46aa-b282-8afc786c1006 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:53.309237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34871d8a-304e-46aa-b282-8afc786c1006 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:53.388068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:53.388992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:53.389346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:53.389770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/2838dad9f6434a6e8ee34fa04c258740` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:53.393396 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:53.406795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2838dad9f6434a6e8ee34fa04c258740)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:53.408933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:53.473743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2838dad9f6434a6e8ee34fa04c258740'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.489117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2838dad9f6434a6e8ee34fa04c258740'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.534869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2838dad9f6434a6e8ee34fa04c258740', 'request_id': 'req-77a848ac-6dff-42b4-83fc-6fe621332a4e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.549512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2838dad9f6434a6e8ee34fa04c258740', 'request_id': 'req-77a848ac-6dff-42b4-83fc-6fe621332a4e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.554626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2838dad9f6434a6e8ee34fa04c258740', 'request_id': 'req-77a848ac-6dff-42b4-83fc-6fe621332a4e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.569601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project 2838dad9f6434a6e8ee34fa04c258740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:53.569788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.571229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.583146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2838dad9f6434a6e8ee34fa04c258740', 'request_id': 'req-77a848ac-6dff-42b4-83fc-6fe621332a4e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.584322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2838dad9f6434a6e8ee34fa04c258740', 'request_id': 'req-77a848ac-6dff-42b4-83fc-6fe621332a4e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.585280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2838dad9f6434a6e8ee34fa04c258740', 'request_id': 'req-77a848ac-6dff-42b4-83fc-6fe621332a4e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:53.596638 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2419/4813] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:53 2022] DELETE /identity/v3/projects/2838dad9f6434a6e8ee34fa04c258740 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:53.601639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cca07e-ff0a-4a37-a7ef-d8d80e25ea05 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:53.612321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cca07e-ff0a-4a37-a7ef-d8d80e25ea05 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:53.642359 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:53.686999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f520c-8a12-4632-be4d-f9503c45c4cc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:53.687791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f520c-8a12-4632-be4d-f9503c45c4cc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:53.688152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f520c-8a12-4632-be4d-f9503c45c4cc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:53.688615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f520c-8a12-4632-be4d-f9503c45c4cc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:53.689508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f520c-8a12-4632-be4d-f9503c45c4cc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:53.691662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f520c-8a12-4632-be4d-f9503c45c4cc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:53.762965 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2395/4814] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:53 2022] POST /identity/v3/projects => generated 358 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:23:53.765347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:53.766813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:53.782586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a848ac-6dff-42b4-83fc-6fe621332a4e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:53.858992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b3ade-62ff-497b-9517-192a73a65d97 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:53.859636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b3ade-62ff-497b-9517-192a73a65d97 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:53.859933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b3ade-62ff-497b-9517-192a73a65d97 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:53.860192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b3ade-62ff-497b-9517-192a73a65d97 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/d5bd92a1e29b4e9d9fcf07b824c96dc5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:53.861737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b3ade-62ff-497b-9517-192a73a65d97 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:get_project(project_id=d5bd92a1e29b4e9d9fcf07b824c96dc5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:53.863989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b3ade-62ff-497b-9517-192a73a65d97 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:53.865836 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2420/4815] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:23:53 2022] GET /identity/v3/projects/d5bd92a1e29b4e9d9fcf07b824c96dc5 => generated 358 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:53.871059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f520c-8a12-4632-be4d-f9503c45c4cc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:53.891543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f520c-8a12-4632-be4d-f9503c45c4cc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:53.909949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:53.910837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:53.911470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:53.912464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/d5bd92a1e29b4e9d9fcf07b824c96dc5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:53.916431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d5bd92a1e29b4e9d9fcf07b824c96dc5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:53.919297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:54.002978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5bd92a1e29b4e9d9fcf07b824c96dc5', 'request_id': 'req-912e921a-0114-4a4f-be04-4997efb247f8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.016085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5bd92a1e29b4e9d9fcf07b824c96dc5', 'request_id': 'req-912e921a-0114-4a4f-be04-4997efb247f8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.027437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5bd92a1e29b4e9d9fcf07b824c96dc5', 'request_id': 'req-912e921a-0114-4a4f-be04-4997efb247f8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.041075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project d5bd92a1e29b4e9d9fcf07b824c96dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:54.041367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.042143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.044924 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2396/4816] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:53 2022] DELETE /identity/v3/projects/d5bd92a1e29b4e9d9fcf07b824c96dc5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:54.049838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b3ade-62ff-497b-9517-192a73a65d97 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:54.051628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-874b3ade-62ff-497b-9517-192a73a65d97 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:54.066566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b3ade-62ff-497b-9517-192a73a65d97 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:54.126709 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:54.155765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e1cfe-92f4-40d1-bf63-416eacee231c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:54.156381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1cfe-92f4-40d1-bf63-416eacee231c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:54.156749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1cfe-92f4-40d1-bf63-416eacee231c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:54.156932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1cfe-92f4-40d1-bf63-416eacee231c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:54.157562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e1cfe-92f4-40d1-bf63-416eacee231c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:54.159434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e1cfe-92f4-40d1-bf63-416eacee231c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:54.212618 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2421/4817] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:54 2022] POST /identity/v3/projects => generated 360 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:54.215790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:54.244334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e921a-0114-4a4f-be04-4997efb247f8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:54.308020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ded502-796a-4f6e-b995-949d5bdee4ac tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:54.308922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ded502-796a-4f6e-b995-949d5bdee4ac tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:54.309364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ded502-796a-4f6e-b995-949d5bdee4ac tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:54.309806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ded502-796a-4f6e-b995-949d5bdee4ac tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/9a969cd2eceb4d119c29699d44956fcf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:54.311118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ded502-796a-4f6e-b995-949d5bdee4ac tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:get_project(project_id=9a969cd2eceb4d119c29699d44956fcf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:54.313840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ded502-796a-4f6e-b995-949d5bdee4ac tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:54.315621 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2397/4818] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:23:54 2022] GET /identity/v3/projects/9a969cd2eceb4d119c29699d44956fcf => generated 360 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:54.319814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e1cfe-92f4-40d1-bf63-416eacee231c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:54.330736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e1cfe-92f4-40d1-bf63-416eacee231c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:54.335777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:54.335957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:54.336735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:54.337154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/9a969cd2eceb4d119c29699d44956fcf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:54.338292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9a969cd2eceb4d119c29699d44956fcf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:54.340399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:54.394725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a969cd2eceb4d119c29699d44956fcf', 'request_id': 'req-b81bbfce-edc4-4803-9952-808188e40779'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.403259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a969cd2eceb4d119c29699d44956fcf', 'request_id': 'req-b81bbfce-edc4-4803-9952-808188e40779'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.415048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a969cd2eceb4d119c29699d44956fcf', 'request_id': 'req-b81bbfce-edc4-4803-9952-808188e40779'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.427749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project 9a969cd2eceb4d119c29699d44956fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:54.428067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.428790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.431208 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2422/4819] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:54 2022] DELETE /identity/v3/projects/9a969cd2eceb4d119c29699d44956fcf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:54.436065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ded502-796a-4f6e-b995-949d5bdee4ac tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:54.438893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-36ded502-796a-4f6e-b995-949d5bdee4ac tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:54.451329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ded502-796a-4f6e-b995-949d5bdee4ac tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:54.491718 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:54.513775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8d022-5ff8-4168-aee4-e9c05bf57ae1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:54.514392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8d022-5ff8-4168-aee4-e9c05bf57ae1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:54.514676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8d022-5ff8-4168-aee4-e9c05bf57ae1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:54.514985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8d022-5ff8-4168-aee4-e9c05bf57ae1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:54.515614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8d022-5ff8-4168-aee4-e9c05bf57ae1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:54.517474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8d022-5ff8-4168-aee4-e9c05bf57ae1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:54.556568 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2398/4820] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:23:54 2022] POST /identity/v3/projects => generated 347 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:54.562967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:54.581939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bbfce-edc4-4803-9952-808188e40779 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:54.652928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c19a8-c89f-4c13-8c74-c2eb21f8695a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:54.653613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c19a8-c89f-4c13-8c74-c2eb21f8695a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:54.653994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c19a8-c89f-4c13-8c74-c2eb21f8695a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:54.654284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c19a8-c89f-4c13-8c74-c2eb21f8695a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/538d86ead1e34979b9e5a6fd97fb9f4f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:54.655466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c19a8-c89f-4c13-8c74-c2eb21f8695a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:get_project(project_id=538d86ead1e34979b9e5a6fd97fb9f4f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:54.657675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c19a8-c89f-4c13-8c74-c2eb21f8695a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:54.659354 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2423/4821] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:23:54 2022] GET /identity/v3/projects/538d86ead1e34979b9e5a6fd97fb9f4f => generated 347 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:54.663571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8d022-5ff8-4168-aee4-e9c05bf57ae1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:54.675382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8d022-5ff8-4168-aee4-e9c05bf57ae1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:54.684542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:54.685193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:54.685478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:54.685903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/538d86ead1e34979b9e5a6fd97fb9f4f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:54.687179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=538d86ead1e34979b9e5a6fd97fb9f4f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:54.690367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:54.748717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538d86ead1e34979b9e5a6fd97fb9f4f', 'request_id': 'req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.755798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538d86ead1e34979b9e5a6fd97fb9f4f', 'request_id': 'req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.770220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538d86ead1e34979b9e5a6fd97fb9f4f', 'request_id': 'req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.785066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project 538d86ead1e34979b9e5a6fd97fb9f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:54.785066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.785066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:54.786092 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2399/4822] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:54 2022] DELETE /identity/v3/projects/538d86ead1e34979b9e5a6fd97fb9f4f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:54.791772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c19a8-c89f-4c13-8c74-c2eb21f8695a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:54.796308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ff9c19a8-c89f-4c13-8c74-c2eb21f8695a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:54.812451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c19a8-c89f-4c13-8c74-c2eb21f8695a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:54.861215 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:54.873181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be69782-bbb1-447b-a410-12b995c234b2 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:54.873803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be69782-bbb1-447b-a410-12b995c234b2 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:54.874259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be69782-bbb1-447b-a410-12b995c234b2 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:54.874633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be69782-bbb1-447b-a410-12b995c234b2 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:54.875414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be69782-bbb1-447b-a410-12b995c234b2 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:54.877195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be69782-bbb1-447b-a410-12b995c234b2 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:54.894234 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2424/4823] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:23:54 2022] POST /identity/v3/domains => generated 276 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:54.898321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:54.913286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a5714-2a9d-4e0f-b361-2d3fb0b9463a tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:54.978680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96522de2-87f1-4e2b-a620-42172b73e743 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:54.979390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96522de2-87f1-4e2b-a620-42172b73e743 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:54.979770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96522de2-87f1-4e2b-a620-42172b73e743 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:54.980096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96522de2-87f1-4e2b-a620-42172b73e743 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:54.982255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96522de2-87f1-4e2b-a620-42172b73e743 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:54.983250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96522de2-87f1-4e2b-a620-42172b73e743 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:55.051161 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2400/4824] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:54 2022] POST /identity/v3/projects => generated 403 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:55.051369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be69782-bbb1-447b-a410-12b995c234b2 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:55.063779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be69782-bbb1-447b-a410-12b995c234b2 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:55.127009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8349fc4-58a4-4f8f-b868-4c69d6474ff3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:55.127588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8349fc4-58a4-4f8f-b868-4c69d6474ff3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:55.127873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8349fc4-58a4-4f8f-b868-4c69d6474ff3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:55.128151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8349fc4-58a4-4f8f-b868-4c69d6474ff3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/f92b58df19f64b49bf812e687486fdc2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:55.129288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8349fc4-58a4-4f8f-b868-4c69d6474ff3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:get_project(project_id=f92b58df19f64b49bf812e687486fdc2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:55.131394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8349fc4-58a4-4f8f-b868-4c69d6474ff3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:55.133125 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2425/4825] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:23:55 2022] GET /identity/v3/projects/f92b58df19f64b49bf812e687486fdc2 => generated 403 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:55.137501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96522de2-87f1-4e2b-a620-42172b73e743 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:55.147925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96522de2-87f1-4e2b-a620-42172b73e743 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:55.153257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:55.153889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:55.154173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:55.154479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/f92b58df19f64b49bf812e687486fdc2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:55.155633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f92b58df19f64b49bf812e687486fdc2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:55.157690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:55.181805 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:55.210891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92b58df19f64b49bf812e687486fdc2', 'request_id': 'req-601b3a75-d22b-4c01-b9a2-97bf9e760c36'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.218416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92b58df19f64b49bf812e687486fdc2', 'request_id': 'req-601b3a75-d22b-4c01-b9a2-97bf9e760c36'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.226514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92b58df19f64b49bf812e687486fdc2', 'request_id': 'req-601b3a75-d22b-4c01-b9a2-97bf9e760c36'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.239439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project f92b58df19f64b49bf812e687486fdc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:55.239730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.240408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.242003 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2401/4826] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:55 2022] DELETE /identity/v3/projects/f92b58df19f64b49bf812e687486fdc2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:55.246258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8349fc4-58a4-4f8f-b868-4c69d6474ff3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:55.248078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c8349fc4-58a4-4f8f-b868-4c69d6474ff3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:55.267216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8349fc4-58a4-4f8f-b868-4c69d6474ff3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:55.328176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d7f0f-a86c-41e4-8ffb-e49ee4c72c90 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:55.328931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d7f0f-a86c-41e4-8ffb-e49ee4c72c90 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:55.329283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d7f0f-a86c-41e4-8ffb-e49ee4c72c90 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:55.329627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d7f0f-a86c-41e4-8ffb-e49ee4c72c90 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/domains/b1c0a21fa87040f790387673ef154d57` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:55.331029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d7f0f-a86c-41e4-8ffb-e49ee4c72c90 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b1c0a21fa87040f790387673ef154d57)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:55.360155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d7f0f-a86c-41e4-8ffb-e49ee4c72c90 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:55.388012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e51d7f0f-a86c-41e4-8ffb-e49ee4c72c90 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b1c0a21fa87040f790387673ef154d57'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.388749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e51d7f0f-a86c-41e4-8ffb-e49ee4c72c90 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b1c0a21fa87040f790387673ef154d57'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.420526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e51d7f0f-a86c-41e4-8ffb-e49ee4c72c90 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b1c0a21fa87040f790387673ef154d57'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.421371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e51d7f0f-a86c-41e4-8ffb-e49ee4c72c90 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b1c0a21fa87040f790387673ef154d57'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.423812 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2426/4827] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:23:55 2022] PATCH /identity/v3/domains/b1c0a21fa87040f790387673ef154d57 => generated 277 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:55.427825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:55.439636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b3a75-d22b-4c01-b9a2-97bf9e760c36 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:55.507815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:55.509245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:55.509660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:55.511021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/domains/b1c0a21fa87040f790387673ef154d57` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:55.521796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b1c0a21fa87040f790387673ef154d57)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:55.523436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:55.571998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b1c0a21fa87040f790387673ef154d57'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.587250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b1c0a21fa87040f790387673ef154d57'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.630367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c0a21fa87040f790387673ef154d57', 'request_id': 'req-46922c7c-0eb7-4501-b5b8-475653783b16'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.638893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c0a21fa87040f790387673ef154d57', 'request_id': 'req-46922c7c-0eb7-4501-b5b8-475653783b16'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.646887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c0a21fa87040f790387673ef154d57', 'request_id': 'req-46922c7c-0eb7-4501-b5b8-475653783b16'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.658042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project b1c0a21fa87040f790387673ef154d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:55.658328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.658986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.661831 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:55.668793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b1c0a21fa87040f790387673ef154d57', 'request_id': 'req-46922c7c-0eb7-4501-b5b8-475653783b16'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.669571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b1c0a21fa87040f790387673ef154d57', 'request_id': 'req-46922c7c-0eb7-4501-b5b8-475653783b16'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.670868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b1c0a21fa87040f790387673ef154d57', 'request_id': 'req-46922c7c-0eb7-4501-b5b8-475653783b16'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:55.681884 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2402/4828] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:23:55 2022] DELETE /identity/v3/domains/b1c0a21fa87040f790387673ef154d57 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:55.686964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d7f0f-a86c-41e4-8ffb-e49ee4c72c90 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:55.688382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e51d7f0f-a86c-41e4-8ffb-e49ee4c72c90 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:55.702307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d7f0f-a86c-41e4-8ffb-e49ee4c72c90 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:55.754184 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:55.763506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5748a9-2890-4664-8df5-315514b6505c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:55.764244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5748a9-2890-4664-8df5-315514b6505c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:55.764539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5748a9-2890-4664-8df5-315514b6505c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:55.765096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5748a9-2890-4664-8df5-315514b6505c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:55.766334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5748a9-2890-4664-8df5-315514b6505c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:55.768086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5748a9-2890-4664-8df5-315514b6505c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:55.784478 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2427/4829] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:23:55 2022] POST /identity/v3/domains => generated 277 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:55.788646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:55.790333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:55.802987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46922c7c-0eb7-4501-b5b8-475653783b16 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:55.863624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be6ffd-375c-4494-b785-0c08412a1dc8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:55.864243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6ffd-375c-4494-b785-0c08412a1dc8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:55.864526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6ffd-375c-4494-b785-0c08412a1dc8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:55.864802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6ffd-375c-4494-b785-0c08412a1dc8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:55.865466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be6ffd-375c-4494-b785-0c08412a1dc8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:55.868127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be6ffd-375c-4494-b785-0c08412a1dc8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:55.910410 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2403/4830] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:55 2022] POST /identity/v3/projects => generated 409 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:23:55.911542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5748a9-2890-4664-8df5-315514b6505c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:55.922323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5748a9-2890-4664-8df5-315514b6505c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:56.017964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9299a-be77-4180-98c1-f1c5c43a508e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:56.019220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9299a-be77-4180-98c1-f1c5c43a508e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:56.019508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9299a-be77-4180-98c1-f1c5c43a508e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:56.019779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9299a-be77-4180-98c1-f1c5c43a508e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:56.020983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9299a-be77-4180-98c1-f1c5c43a508e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:56.022944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9299a-be77-4180-98c1-f1c5c43a508e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:56.073412 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2428/4831] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:55 2022] POST /identity/v3/projects => generated 405 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:56.075090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be6ffd-375c-4494-b785-0c08412a1dc8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:56.086801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be6ffd-375c-4494-b785-0c08412a1dc8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:56.157468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:56.158110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:56.158388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:56.158658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/cbebd538f88042208638192e8fe41b0e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:56.160578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cbebd538f88042208638192e8fe41b0e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:56.162673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:56.229847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbebd538f88042208638192e8fe41b0e', 'request_id': 'req-6ef81647-6026-4bef-bcce-4c2cb7633115'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.237688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbebd538f88042208638192e8fe41b0e', 'request_id': 'req-6ef81647-6026-4bef-bcce-4c2cb7633115'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.249782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbebd538f88042208638192e8fe41b0e', 'request_id': 'req-6ef81647-6026-4bef-bcce-4c2cb7633115'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.257335 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:56.276494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project cbebd538f88042208638192e8fe41b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:56.276657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.277220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.278975 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2404/4832] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:56 2022] DELETE /identity/v3/projects/cbebd538f88042208638192e8fe41b0e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:56.282849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9299a-be77-4180-98c1-f1c5c43a508e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:56.284571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1ac9299a-be77-4180-98c1-f1c5c43a508e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:56.299468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9299a-be77-4180-98c1-f1c5c43a508e tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:56.387066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:56.387770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:56.388058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:56.388345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/bf2c701c0ba94c77aae535b4ed20613f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:56.389479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bf2c701c0ba94c77aae535b4ed20613f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:56.391512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:56.458901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2c701c0ba94c77aae535b4ed20613f', 'request_id': 'req-dce793ce-30ae-4a13-a11d-4d8cf0121171'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.468996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2c701c0ba94c77aae535b4ed20613f', 'request_id': 'req-dce793ce-30ae-4a13-a11d-4d8cf0121171'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.479587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2c701c0ba94c77aae535b4ed20613f', 'request_id': 'req-dce793ce-30ae-4a13-a11d-4d8cf0121171'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.489256 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:56.497107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project bf2c701c0ba94c77aae535b4ed20613f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:56.498890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.500021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.502114 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2429/4833] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:56 2022] DELETE /identity/v3/projects/bf2c701c0ba94c77aae535b4ed20613f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:56.507025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:56.521140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef81647-6026-4bef-bcce-4c2cb7633115 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:56.635929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fb5b1-db4b-41d8-9998-c8bb98c62210 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:56.637333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fb5b1-db4b-41d8-9998-c8bb98c62210 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:56.637637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fb5b1-db4b-41d8-9998-c8bb98c62210 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:56.637920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fb5b1-db4b-41d8-9998-c8bb98c62210 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/domains/da0cc60dc5394015b15865870c99e3fa` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:56.643009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fb5b1-db4b-41d8-9998-c8bb98c62210 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=da0cc60dc5394015b15865870c99e3fa)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:56.644651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fb5b1-db4b-41d8-9998-c8bb98c62210 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:56.718205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1b5fb5b1-db4b-41d8-9998-c8bb98c62210 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'da0cc60dc5394015b15865870c99e3fa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.720349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1b5fb5b1-db4b-41d8-9998-c8bb98c62210 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'da0cc60dc5394015b15865870c99e3fa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.782973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1b5fb5b1-db4b-41d8-9998-c8bb98c62210 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'da0cc60dc5394015b15865870c99e3fa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.784909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1b5fb5b1-db4b-41d8-9998-c8bb98c62210 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'da0cc60dc5394015b15865870c99e3fa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.799502 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2405/4834] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:23:56 2022] PATCH /identity/v3/domains/da0cc60dc5394015b15865870c99e3fa => generated 278 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:56.803635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:56.806147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:56.820292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce793ce-30ae-4a13-a11d-4d8cf0121171 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:56.895838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:56.896663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:56.896663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:56.896663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/domains/da0cc60dc5394015b15865870c99e3fa` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:56.918505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=da0cc60dc5394015b15865870c99e3fa)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:56.921038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:56.955006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'da0cc60dc5394015b15865870c99e3fa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:56.970813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'da0cc60dc5394015b15865870c99e3fa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.054200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0cc60dc5394015b15865870c99e3fa', 'request_id': 'req-a4e18538-0c00-4d12-a983-b715cd06f80f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.062934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0cc60dc5394015b15865870c99e3fa', 'request_id': 'req-a4e18538-0c00-4d12-a983-b715cd06f80f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.071275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0cc60dc5394015b15865870c99e3fa', 'request_id': 'req-a4e18538-0c00-4d12-a983-b715cd06f80f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.083960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project da0cc60dc5394015b15865870c99e3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:57.084331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.085741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.094858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'da0cc60dc5394015b15865870c99e3fa', 'request_id': 'req-a4e18538-0c00-4d12-a983-b715cd06f80f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.095859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'da0cc60dc5394015b15865870c99e3fa', 'request_id': 'req-a4e18538-0c00-4d12-a983-b715cd06f80f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.096595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'da0cc60dc5394015b15865870c99e3fa', 'request_id': 'req-a4e18538-0c00-4d12-a983-b715cd06f80f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.107691 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2430/4835] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:23:56 2022] DELETE /identity/v3/domains/da0cc60dc5394015b15865870c99e3fa => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:57.112591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fb5b1-db4b-41d8-9998-c8bb98c62210 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:57.114516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1b5fb5b1-db4b-41d8-9998-c8bb98c62210 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:57.130654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fb5b1-db4b-41d8-9998-c8bb98c62210 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:57.197759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76269c42-e071-4f95-bc63-9a6bd349fa1d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:57.198643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76269c42-e071-4f95-bc63-9a6bd349fa1d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:57.198958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76269c42-e071-4f95-bc63-9a6bd349fa1d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:57.199225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76269c42-e071-4f95-bc63-9a6bd349fa1d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:57.200044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76269c42-e071-4f95-bc63-9a6bd349fa1d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:57.201916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76269c42-e071-4f95-bc63-9a6bd349fa1d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:57.240634 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2406/4836] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:57 2022] POST /identity/v3/projects => generated 378 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:57.245592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:57.247048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:57.260154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e18538-0c00-4d12-a983-b715cd06f80f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:57.297619 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:57.330552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fc094-5104-4efa-8d97-a024fcd88826 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:57.331302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fc094-5104-4efa-8d97-a024fcd88826 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:57.331651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fc094-5104-4efa-8d97-a024fcd88826 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:57.331994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fc094-5104-4efa-8d97-a024fcd88826 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/f9585cbdfb0a4d519cb49c29366ad767` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:57.333418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fc094-5104-4efa-8d97-a024fcd88826 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:get_project(project_id=f9585cbdfb0a4d519cb49c29366ad767)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:57.335636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fc094-5104-4efa-8d97-a024fcd88826 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:57.341041 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2431/4837] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:23:57 2022] GET /identity/v3/projects/f9585cbdfb0a4d519cb49c29366ad767 => generated 378 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:57.343548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76269c42-e071-4f95-bc63-9a6bd349fa1d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:57.355687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76269c42-e071-4f95-bc63-9a6bd349fa1d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:57.360509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ce7de-9213-4bc7-b864-7117ba516b6c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:57.361212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce7de-9213-4bc7-b864-7117ba516b6c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:57.361421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce7de-9213-4bc7-b864-7117ba516b6c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:57.361694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce7de-9213-4bc7-b864-7117ba516b6c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:57.362332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ce7de-9213-4bc7-b864-7117ba516b6c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:57.364445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ce7de-9213-4bc7-b864-7117ba516b6c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:57.385249 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2407/4838] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Oct 16 01:23:57 2022] GET /identity/v3/projects => generated 6212 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:23:57.389921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fc094-5104-4efa-8d97-a024fcd88826 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:57.402172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fc094-5104-4efa-8d97-a024fcd88826 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:57.407360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:57.409019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:57.409464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:57.409923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/f9585cbdfb0a4d519cb49c29366ad767` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:57.411295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f9585cbdfb0a4d519cb49c29366ad767)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:57.413468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:57.482505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9585cbdfb0a4d519cb49c29366ad767', 'request_id': 'req-c920e40b-afeb-4805-871c-d1ad7314e8fc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.489403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9585cbdfb0a4d519cb49c29366ad767', 'request_id': 'req-c920e40b-afeb-4805-871c-d1ad7314e8fc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.501217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9585cbdfb0a4d519cb49c29366ad767', 'request_id': 'req-c920e40b-afeb-4805-871c-d1ad7314e8fc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.515033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project f9585cbdfb0a4d519cb49c29366ad767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:57.515476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.516272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.517883 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2432/4839] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:57 2022] DELETE /identity/v3/projects/f9585cbdfb0a4d519cb49c29366ad767 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:57.523167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ce7de-9213-4bc7-b864-7117ba516b6c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:57.525869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b55ce7de-9213-4bc7-b864-7117ba516b6c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:57.540128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ce7de-9213-4bc7-b864-7117ba516b6c tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:57.576939 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:57.620549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6d645-b6d3-4cee-9a07-16dde3a4dfd0 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:57.621174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6d645-b6d3-4cee-9a07-16dde3a4dfd0 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:57.621457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6d645-b6d3-4cee-9a07-16dde3a4dfd0 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:57.621734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6d645-b6d3-4cee-9a07-16dde3a4dfd0 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:57.622585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6d645-b6d3-4cee-9a07-16dde3a4dfd0 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:57.624280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6d645-b6d3-4cee-9a07-16dde3a4dfd0 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:57.661892 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2408/4840] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:23:57 2022] POST /identity/v3/projects => generated 347 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:57.666163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:57.676872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920e40b-afeb-4805-871c-d1ad7314e8fc tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:57.748991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ae9f7-c4c5-4e5a-8325-f0844fd17980 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:57.749634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ae9f7-c4c5-4e5a-8325-f0844fd17980 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:57.749914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ae9f7-c4c5-4e5a-8325-f0844fd17980 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:57.750186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ae9f7-c4c5-4e5a-8325-f0844fd17980 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/cf421d103ea544068b2601c1860495b3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:57.751458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ae9f7-c4c5-4e5a-8325-f0844fd17980 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:update_project(project_id=cf421d103ea544068b2601c1860495b3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:57.762007 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-b07ae9f7-c4c5-4e5a-8325-f0844fd17980 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:23:57.762007 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:23:57.762007 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:23:57.762007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ae9f7-c4c5-4e5a-8325-f0844fd17980 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:57.764591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22851a-11f1-4d39-adad-de17a83ab7cf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:57.765115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22851a-11f1-4d39-adad-de17a83ab7cf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:57.765698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22851a-11f1-4d39-adad-de17a83ab7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:57.792218 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2433/4841] 10.222.0.39 () {60 vars in 1252 bytes} [Sun Oct 16 01:23:57 2022] PATCH /identity/v3/projects/cf421d103ea544068b2601c1860495b3 => generated 361 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:23:57.799749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ae9f7-c4c5-4e5a-8325-f0844fd17980 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:57.808711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0d22851a-11f1-4d39-adad-de17a83ab7cf None None] MFA Rules not processed for user `d5e97960c4eb488b900951e0898f34c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:57.811469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0d22851a-11f1-4d39-adad-de17a83ab7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:57.815180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ae9f7-c4c5-4e5a-8325-f0844fd17980 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:57.821382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af8c16-76cf-4ddd-a41c-b7b42e7bb080 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:57.822186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af8c16-76cf-4ddd-a41c-b7b42e7bb080 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:57.822680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af8c16-76cf-4ddd-a41c-b7b42e7bb080 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:57.823100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af8c16-76cf-4ddd-a41c-b7b42e7bb080 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/cf421d103ea544068b2601c1860495b3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:57.838948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af8c16-76cf-4ddd-a41c-b7b42e7bb080 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:get_project(project_id=cf421d103ea544068b2601c1860495b3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:57.841394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af8c16-76cf-4ddd-a41c-b7b42e7bb080 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:57.843882 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2434/4842] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:23:57 2022] GET /identity/v3/projects/cf421d103ea544068b2601c1860495b3 => generated 348 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:57.849234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af8c16-76cf-4ddd-a41c-b7b42e7bb080 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:57.877526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af8c16-76cf-4ddd-a41c-b7b42e7bb080 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:57.883913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:57.884678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:57.885061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:57.885436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/cf421d103ea544068b2601c1860495b3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:57.886838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cf421d103ea544068b2601c1860495b3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:57.889089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:57.914080 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:57.939548 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2409/4843] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:57.978243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf421d103ea544068b2601c1860495b3', 'request_id': 'req-3ea5856c-9b2f-4ff9-922e-231a06e206c3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.987812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf421d103ea544068b2601c1860495b3', 'request_id': 'req-3ea5856c-9b2f-4ff9-922e-231a06e206c3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:57.999865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf421d103ea544068b2601c1860495b3', 'request_id': 'req-3ea5856c-9b2f-4ff9-922e-231a06e206c3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:58.015245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project cf421d103ea544068b2601c1860495b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:58.015845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:58.016864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:58.025084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22851a-11f1-4d39-adad-de17a83ab7cf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:58.029488 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2435/4844] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:57 2022] DELETE /identity/v3/projects/cf421d103ea544068b2601c1860495b3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:58.062880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22851a-11f1-4d39-adad-de17a83ab7cf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:58.173473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2b4d6-2a62-45dc-9fc5-f66cfb12785d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:58.174158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2b4d6-2a62-45dc-9fc5-f66cfb12785d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:58.174370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2b4d6-2a62-45dc-9fc5-f66cfb12785d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:58.174633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2b4d6-2a62-45dc-9fc5-f66cfb12785d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:58.175524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2b4d6-2a62-45dc-9fc5-f66cfb12785d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:58.178445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2b4d6-2a62-45dc-9fc5-f66cfb12785d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:58.225454 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2410/4845] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:58 2022] POST /identity/v3/projects => generated 359 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:58.229353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:58.230747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:58.248800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5856c-9b2f-4ff9-922e-231a06e206c3 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:58.319934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab965af9-dde0-4af8-8e96-d39c7d9a8d4f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:58.321845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab965af9-dde0-4af8-8e96-d39c7d9a8d4f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:58.322740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab965af9-dde0-4af8-8e96-d39c7d9a8d4f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:58.323279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab965af9-dde0-4af8-8e96-d39c7d9a8d4f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/c032e34919d546bf95e4e4086e4ff98f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:58.325020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab965af9-dde0-4af8-8e96-d39c7d9a8d4f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:update_project(project_id=c032e34919d546bf95e4e4086e4ff98f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:58.327415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab965af9-dde0-4af8-8e96-d39c7d9a8d4f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:58.410830 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2436/4846] 10.222.0.39 () {60 vars in 1252 bytes} [Sun Oct 16 01:23:58 2022] PATCH /identity/v3/projects/c032e34919d546bf95e4e4086e4ff98f => generated 371 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:58.420428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2b4d6-2a62-45dc-9fc5-f66cfb12785d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:58.442727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2b4d6-2a62-45dc-9fc5-f66cfb12785d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:58.451142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e87de3-0d9c-4f9e-8c0f-5513e3ff3d11 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:58.451949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e87de3-0d9c-4f9e-8c0f-5513e3ff3d11 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:58.452239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e87de3-0d9c-4f9e-8c0f-5513e3ff3d11 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:58.452570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e87de3-0d9c-4f9e-8c0f-5513e3ff3d11 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/c032e34919d546bf95e4e4086e4ff98f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:58.483807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e87de3-0d9c-4f9e-8c0f-5513e3ff3d11 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:get_project(project_id=c032e34919d546bf95e4e4086e4ff98f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:58.485932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e87de3-0d9c-4f9e-8c0f-5513e3ff3d11 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:58.487914 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2411/4847] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:23:58 2022] GET /identity/v3/projects/c032e34919d546bf95e4e4086e4ff98f => generated 358 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:58.493532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab965af9-dde0-4af8-8e96-d39c7d9a8d4f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:58.504392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab965af9-dde0-4af8-8e96-d39c7d9a8d4f tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:58.510620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:58.511910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:58.511910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:58.511910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/c032e34919d546bf95e4e4086e4ff98f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:58.513082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c032e34919d546bf95e4e4086e4ff98f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:58.515039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:58.582432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c032e34919d546bf95e4e4086e4ff98f', 'request_id': 'req-f313958c-7316-48ab-9cb1-db2ee9700cc5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:58.609252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c032e34919d546bf95e4e4086e4ff98f', 'request_id': 'req-f313958c-7316-48ab-9cb1-db2ee9700cc5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:58.624660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c032e34919d546bf95e4e4086e4ff98f', 'request_id': 'req-f313958c-7316-48ab-9cb1-db2ee9700cc5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:58.635942 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:58.645178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project c032e34919d546bf95e4e4086e4ff98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:58.645178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:58.646479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:58.651515 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2437/4848] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:58 2022] DELETE /identity/v3/projects/c032e34919d546bf95e4e4086e4ff98f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:58.652959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e87de3-0d9c-4f9e-8c0f-5513e3ff3d11 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:58.654998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-36e87de3-0d9c-4f9e-8c0f-5513e3ff3d11 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:58.672688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e87de3-0d9c-4f9e-8c0f-5513e3ff3d11 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:58.692099 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:58.757983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8cf8e-662b-4b4b-9b31-21ad93ba6195 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:58.763713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8cf8e-662b-4b4b-9b31-21ad93ba6195 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:58.764005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8cf8e-662b-4b4b-9b31-21ad93ba6195 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:58.764390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8cf8e-662b-4b4b-9b31-21ad93ba6195 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:58.764906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8cf8e-662b-4b4b-9b31-21ad93ba6195 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:58.766864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8cf8e-662b-4b4b-9b31-21ad93ba6195 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:58.823429 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2412/4849] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:23:58 2022] POST /identity/v3/projects => generated 354 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:23:58.827464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:58.844006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313958c-7316-48ab-9cb1-db2ee9700cc5 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:58.987771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb500c7a-c046-4f9e-853b-a3584a56778d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:58.988792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb500c7a-c046-4f9e-853b-a3584a56778d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:58.988792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb500c7a-c046-4f9e-853b-a3584a56778d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:58.988998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb500c7a-c046-4f9e-853b-a3584a56778d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/95168d1caa83448e9dddfd825b6b21f9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:58.991196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb500c7a-c046-4f9e-853b-a3584a56778d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:update_project(project_id=95168d1caa83448e9dddfd825b6b21f9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:58.995987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb500c7a-c046-4f9e-853b-a3584a56778d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:59.076199 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2438/4850] 10.222.0.39 () {60 vars in 1252 bytes} [Sun Oct 16 01:23:58 2022] PATCH /identity/v3/projects/95168d1caa83448e9dddfd825b6b21f9 => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:59.080367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8cf8e-662b-4b4b-9b31-21ad93ba6195 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:59.094352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8cf8e-662b-4b4b-9b31-21ad93ba6195 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:59.099137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626e311-1d61-40b8-af8f-5b5878782de8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:59.099789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626e311-1d61-40b8-af8f-5b5878782de8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:59.100149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626e311-1d61-40b8-af8f-5b5878782de8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:59.100433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626e311-1d61-40b8-af8f-5b5878782de8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/95168d1caa83448e9dddfd825b6b21f9` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:59.118465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626e311-1d61-40b8-af8f-5b5878782de8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:get_project(project_id=95168d1caa83448e9dddfd825b6b21f9)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:59.120731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626e311-1d61-40b8-af8f-5b5878782de8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:59.122832 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2413/4851] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:23:59 2022] GET /identity/v3/projects/95168d1caa83448e9dddfd825b6b21f9 => generated 355 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:23:59.127529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb500c7a-c046-4f9e-853b-a3584a56778d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:59.144818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb500c7a-c046-4f9e-853b-a3584a56778d tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:59.154061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:59.154783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:59.155000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:59.155281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/projects/95168d1caa83448e9dddfd825b6b21f9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:59.157672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=95168d1caa83448e9dddfd825b6b21f9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:59.159716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:59.253800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95168d1caa83448e9dddfd825b6b21f9', 'request_id': 'req-7b209c15-826e-4d08-84a2-dc3d5a6421da'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:59.263307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95168d1caa83448e9dddfd825b6b21f9', 'request_id': 'req-7b209c15-826e-4d08-84a2-dc3d5a6421da'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:59.277765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95168d1caa83448e9dddfd825b6b21f9', 'request_id': 'req-7b209c15-826e-4d08-84a2-dc3d5a6421da'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:59.317299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] The token cache is being invalidate because project 95168d1caa83448e9dddfd825b6b21f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:23:59.317673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:59.319123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:59.321458 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2439/4852] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:23:59 2022] DELETE /identity/v3/projects/95168d1caa83448e9dddfd825b6b21f9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:59.326075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626e311-1d61-40b8-af8f-5b5878782de8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:59.328124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5626e311-1d61-40b8-af8f-5b5878782de8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:59.348748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626e311-1d61-40b8-af8f-5b5878782de8 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:59.435989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c9acb-0129-42bc-9ee4-751ac02107f1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:59.436689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c9acb-0129-42bc-9ee4-751ac02107f1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:59.436976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c9acb-0129-42bc-9ee4-751ac02107f1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:59.437258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c9acb-0129-42bc-9ee4-751ac02107f1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/domains/da0cc60dc5394015b15865870c99e3fa` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:59.449772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c9acb-0129-42bc-9ee4-751ac02107f1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e62c9acb-0129-42bc-9ee4-751ac02107f1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Could not find domain: da0cc60dc5394015b15865870c99e3fa.: keystone.exception.DomainNotFound: Could not find domain: da0cc60dc5394015b15865870c99e3fa. Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: da0cc60dc5394015b15865870c99e3fa. Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:23:59.457715 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:23:59.459362 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: da0cc60dc5394015b15865870c99e3fa. Oct 16 01:23:59.460358 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:23:59.462335 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2414/4853] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:23:59 2022] PATCH /identity/v3/domains/da0cc60dc5394015b15865870c99e3fa => generated 112 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:23:59.464578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:59.505767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b209c15-826e-4d08-84a2-dc3d5a6421da tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:59.523307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b146171-faab-40b6-8865-0a28df93cbb4 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77d06f9d140e400fb43bf0b49428647e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97497cccc53342abb06071c1fb18087f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:59.524051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b146171-faab-40b6-8865-0a28df93cbb4 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:59.524327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b146171-faab-40b6-8865-0a28df93cbb4 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:59.524600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b146171-faab-40b6-8865-0a28df93cbb4 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] PATH_INFO: `/v3/domains/b1c0a21fa87040f790387673ef154d57` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:59.544408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b146171-faab-40b6-8865-0a28df93cbb4 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-6b146171-faab-40b6-8865-0a28df93cbb4 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Could not find domain: b1c0a21fa87040f790387673ef154d57.: keystone.exception.DomainNotFound: Could not find domain: b1c0a21fa87040f790387673ef154d57. Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b1c0a21fa87040f790387673ef154d57. Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:23:59.549028 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:23:59.550264 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b1c0a21fa87040f790387673ef154d57. Oct 16 01:23:59.551356 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:23:59.552392 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2440/4854] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:23:59 2022] PATCH /identity/v3/domains/b1c0a21fa87040f790387673ef154d57 => generated 112 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:23:59.557497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c9acb-0129-42bc-9ee4-751ac02107f1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:59.565663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e62c9acb-0129-42bc-9ee4-751ac02107f1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:59.700976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c9acb-0129-42bc-9ee4-751ac02107f1 tempest-ProjectsTestJSON-256487475 tempest-ProjectsTestJSON-256487475-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:23:59.706876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:23:59.707955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:59.708433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:59.708908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] PATH_INFO: `/v3/users/32b628d3020c4b3697d7a540abe31a85` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:59.710371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b628d3020c4b3697d7a540abe31a85)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:23:59.712949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:23:59.761106 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:59.779235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b628d3020c4b3697d7a540abe31a85'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:59.780535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b628d3020c4b3697d7a540abe31a85'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:59.793730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b628d3020c4b3697d7a540abe31a85'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:59.810616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b628d3020c4b3697d7a540abe31a85'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:59.811590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b628d3020c4b3697d7a540abe31a85'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:23:59.833306 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2415/4855] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:23:59 2022] DELETE /identity/v3/users/32b628d3020c4b3697d7a540abe31a85 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:23:59.838662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f604b6-e657-426d-8ee3-37b07fc4d055 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:23:59.838962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f604b6-e657-426d-8ee3-37b07fc4d055 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:23:59.839245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f604b6-e657-426d-8ee3-37b07fc4d055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:23:59.858823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-11f604b6-e657-426d-8ee3-37b07fc4d055 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:23:59.860708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-11f604b6-e657-426d-8ee3-37b07fc4d055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:23:59.931394 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:59.968694 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2441/4856] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:23:59.976490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:23:59.978555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:00.085225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0f21-5f85-4e9a-be14-b6e7afb5094b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:00.089658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db04cf-5124-4e14-af4b-ba3dd3648ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:00.090479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db04cf-5124-4e14-af4b-ba3dd3648ecd service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:00.090867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db04cf-5124-4e14-af4b-ba3dd3648ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:00.091279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db04cf-5124-4e14-af4b-ba3dd3648ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:00.106762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db04cf-5124-4e14-af4b-ba3dd3648ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:00.108381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db04cf-5124-4e14-af4b-ba3dd3648ecd service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:00.132666 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2416/4857] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:00.816291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f604b6-e657-426d-8ee3-37b07fc4d055 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:00.818359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-11f604b6-e657-426d-8ee3-37b07fc4d055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:00.845510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f604b6-e657-426d-8ee3-37b07fc4d055 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:00.861045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:00.862085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:00.862604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:00.863124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] PATH_INFO: `/v3/projects/cd7f1bfdf8454c3990d1883816d5ffeb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:00.865574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7f1bfdf8454c3990d1883816d5ffeb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:00.868677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:00.997456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7f1bfdf8454c3990d1883816d5ffeb', 'request_id': 'req-aababf77-40a7-4c90-84a6-5f16ecf2a495'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:01.005555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7f1bfdf8454c3990d1883816d5ffeb', 'request_id': 'req-aababf77-40a7-4c90-84a6-5f16ecf2a495'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:01.030761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7f1bfdf8454c3990d1883816d5ffeb', 'request_id': 'req-aababf77-40a7-4c90-84a6-5f16ecf2a495'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:01.081847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] The token cache is being invalidate because project cd7f1bfdf8454c3990d1883816d5ffeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:01.082152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:01.083923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:01.087473 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2442/4858] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:00 2022] DELETE /identity/v3/projects/cd7f1bfdf8454c3990d1883816d5ffeb => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:01.091065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db04cf-5124-4e14-af4b-ba3dd3648ecd service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:01.104522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db04cf-5124-4e14-af4b-ba3dd3648ecd service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:01.216955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8c841-b4e2-40ca-b153-2dee5ec471e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:01.217982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c841-b4e2-40ca-b153-2dee5ec471e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:01.218435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c841-b4e2-40ca-b153-2dee5ec471e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:01.219394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c841-b4e2-40ca-b153-2dee5ec471e1 admin admin] PATH_INFO: `/v3/users/77d06f9d140e400fb43bf0b49428647e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:01.220944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8c841-b4e2-40ca-b153-2dee5ec471e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d06f9d140e400fb43bf0b49428647e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:01.223445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8c841-b4e2-40ca-b153-2dee5ec471e1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:01.337694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cdb8c841-b4e2-40ca-b153-2dee5ec471e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d06f9d140e400fb43bf0b49428647e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:01.338876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cdb8c841-b4e2-40ca-b153-2dee5ec471e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d06f9d140e400fb43bf0b49428647e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:01.351610 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:01.368285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cdb8c841-b4e2-40ca-b153-2dee5ec471e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d06f9d140e400fb43bf0b49428647e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:01.384304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cdb8c841-b4e2-40ca-b153-2dee5ec471e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d06f9d140e400fb43bf0b49428647e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:01.385229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cdb8c841-b4e2-40ca-b153-2dee5ec471e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d06f9d140e400fb43bf0b49428647e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:01.421068 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2417/4859] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:01 2022] DELETE /identity/v3/users/77d06f9d140e400fb43bf0b49428647e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:02.030595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:02.032895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:02.050039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aababf77-40a7-4c90-84a6-5f16ecf2a495 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:02.160089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956df6a1-f1e3-4c32-a285-04930533e32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:02.160759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956df6a1-f1e3-4c32-a285-04930533e32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:02.165886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956df6a1-f1e3-4c32-a285-04930533e32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:02.166246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956df6a1-f1e3-4c32-a285-04930533e32a admin admin] PATH_INFO: `/v3/projects/97497cccc53342abb06071c1fb18087f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:02.167884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956df6a1-f1e3-4c32-a285-04930533e32a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97497cccc53342abb06071c1fb18087f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:02.173032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956df6a1-f1e3-4c32-a285-04930533e32a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:02.321072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-956df6a1-f1e3-4c32-a285-04930533e32a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97497cccc53342abb06071c1fb18087f', 'request_id': 'req-956df6a1-f1e3-4c32-a285-04930533e32a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:02.332448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-956df6a1-f1e3-4c32-a285-04930533e32a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97497cccc53342abb06071c1fb18087f', 'request_id': 'req-956df6a1-f1e3-4c32-a285-04930533e32a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:02.347247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-956df6a1-f1e3-4c32-a285-04930533e32a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97497cccc53342abb06071c1fb18087f', 'request_id': 'req-956df6a1-f1e3-4c32-a285-04930533e32a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:02.361727 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:02.370057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-956df6a1-f1e3-4c32-a285-04930533e32a admin admin] The token cache is being invalidate because project 97497cccc53342abb06071c1fb18087f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:02.370573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-956df6a1-f1e3-4c32-a285-04930533e32a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:02.371962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-956df6a1-f1e3-4c32-a285-04930533e32a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:02.377642 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2443/4860] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:02 2022] DELETE /identity/v3/projects/97497cccc53342abb06071c1fb18087f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:02.379593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5776543-4607-44b8-b797-17e4b128db6c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:02.380068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5776543-4607-44b8-b797-17e4b128db6c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:02.380156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5776543-4607-44b8-b797-17e4b128db6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:02.439860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b5776543-4607-44b8-b797-17e4b128db6c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:02.442455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b5776543-4607-44b8-b797-17e4b128db6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:02.575493 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2418/4861] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:02.583073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfd521-7eb7-4650-9e1c-55878f5af2f3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:02.583752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfd521-7eb7-4650-9e1c-55878f5af2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:02.584191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfd521-7eb7-4650-9e1c-55878f5af2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:02.627341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a5bfd521-7eb7-4650-9e1c-55878f5af2f3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:02.628713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a5bfd521-7eb7-4650-9e1c-55878f5af2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:02.639365 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2444/4862] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:02.643686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5776543-4607-44b8-b797-17e4b128db6c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:02.657597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5776543-4607-44b8-b797-17e4b128db6c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:02.662702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6298f13-4496-4a80-9a9e-a50a4d5ac3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:02.663632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6298f13-4496-4a80-9a9e-a50a4d5ac3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:02.664199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6298f13-4496-4a80-9a9e-a50a4d5ac3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:02.664704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6298f13-4496-4a80-9a9e-a50a4d5ac3e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:02.665596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6298f13-4496-4a80-9a9e-a50a4d5ac3e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:02.666112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6298f13-4496-4a80-9a9e-a50a4d5ac3e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:02.668542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6298f13-4496-4a80-9a9e-a50a4d5ac3e2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:02.687832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfd521-7eb7-4650-9e1c-55878f5af2f3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:02.689065 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2419/4863] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:02.699855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfd521-7eb7-4650-9e1c-55878f5af2f3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:02.720535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a0463-35e7-4d3c-9eee-800c5afea149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:02.721461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a0463-35e7-4d3c-9eee-800c5afea149 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:02.722558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a0463-35e7-4d3c-9eee-800c5afea149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:02.723287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a0463-35e7-4d3c-9eee-800c5afea149 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:02.724170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a0463-35e7-4d3c-9eee-800c5afea149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:02.727374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a0463-35e7-4d3c-9eee-800c5afea149 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:02.774985 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2445/4864] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:02 2022] POST /identity/v3/projects => generated 395 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:02.779345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6298f13-4496-4a80-9a9e-a50a4d5ac3e2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:02.798669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6298f13-4496-4a80-9a9e-a50a4d5ac3e2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:02.912589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ae3ff-5ca2-4d15-afca-f94c6cdc9fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:02.913587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ae3ff-5ca2-4d15-afca-f94c6cdc9fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:02.914608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ae3ff-5ca2-4d15-afca-f94c6cdc9fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:02.915205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ae3ff-5ca2-4d15-afca-f94c6cdc9fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:02.916665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ae3ff-5ca2-4d15-afca-f94c6cdc9fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:02.920276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ae3ff-5ca2-4d15-afca-f94c6cdc9fa4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:02.965861 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2420/4865] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:02 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:02.970263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a0463-35e7-4d3c-9eee-800c5afea149 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:02.992606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a0463-35e7-4d3c-9eee-800c5afea149 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:03.003339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e293f-9052-48f7-8bb8-304040ed1ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:03.005165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e293f-9052-48f7-8bb8-304040ed1ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:03.005943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e293f-9052-48f7-8bb8-304040ed1ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:03.006766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e293f-9052-48f7-8bb8-304040ed1ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:03.009532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e293f-9052-48f7-8bb8-304040ed1ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:03.014009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e293f-9052-48f7-8bb8-304040ed1ec4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:03.082782 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2446/4866] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:03.117448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ae3ff-5ca2-4d15-afca-f94c6cdc9fa4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:03.131296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ae3ff-5ca2-4d15-afca-f94c6cdc9fa4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:03.142318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59d844-d3da-4312-869f-703fe21895b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:03.148137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59d844-d3da-4312-869f-703fe21895b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:03.149063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59d844-d3da-4312-869f-703fe21895b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:03.149356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59d844-d3da-4312-869f-703fe21895b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:03.150059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59d844-d3da-4312-869f-703fe21895b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:03.151728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59d844-d3da-4312-869f-703fe21895b7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:03.180117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e293f-9052-48f7-8bb8-304040ed1ec4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:03.190876 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2421/4867] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:03.198040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e293f-9052-48f7-8bb8-304040ed1ec4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:03.214252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4780484-69d9-4d85-ab19-04459db0ebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:03.215196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4780484-69d9-4d85-ab19-04459db0ebb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:03.215486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4780484-69d9-4d85-ab19-04459db0ebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:03.215811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4780484-69d9-4d85-ab19-04459db0ebb9 admin admin] PATH_INFO: `/v3/projects/10bfc8f6c78943a9badb2a09d75cc137/users/39f6517f7def48c7ad2049fb88412a8d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:03.254489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4780484-69d9-4d85-ab19-04459db0ebb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bfc8f6c78943a9badb2a09d75cc137, user_id=39f6517f7def48c7ad2049fb88412a8d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:03.257469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4780484-69d9-4d85-ab19-04459db0ebb9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:03.342509 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2447/4868] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:03 2022] PUT /identity/v3/projects/10bfc8f6c78943a9badb2a09d75cc137/users/39f6517f7def48c7ad2049fb88412a8d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:03.348942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5cec-dc1a-4543-a629-187717593e0a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:03.349593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5cec-dc1a-4543-a629-187717593e0a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:03.350058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5cec-dc1a-4543-a629-187717593e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:03.447245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b34d5cec-dc1a-4543-a629-187717593e0a None None] MFA Rules not processed for user `39f6517f7def48c7ad2049fb88412a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:03.460692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b34d5cec-dc1a-4543-a629-187717593e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:03.581823 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:03.720234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4780484-69d9-4d85-ab19-04459db0ebb9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:03.722733 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2422/4869] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:03.925288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4780484-69d9-4d85-ab19-04459db0ebb9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:03.938062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf65afb-c927-49bc-a340-fbba66d7808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:03.938734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf65afb-c927-49bc-a340-fbba66d7808e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:03.939136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf65afb-c927-49bc-a340-fbba66d7808e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:03.939329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf65afb-c927-49bc-a340-fbba66d7808e admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:03.939941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf65afb-c927-49bc-a340-fbba66d7808e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:03.946568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf65afb-c927-49bc-a340-fbba66d7808e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:04.008261 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2448/4870] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:03 2022] POST /identity/v3/projects => generated 397 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:04.013796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d5cec-dc1a-4543-a629-187717593e0a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:04.031457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d5cec-dc1a-4543-a629-187717593e0a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:04.188636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca12952-9a46-4cdc-a4b2-95cfe13f6e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:04.189269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca12952-9a46-4cdc-a4b2-95cfe13f6e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:04.189541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca12952-9a46-4cdc-a4b2-95cfe13f6e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:04.189997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca12952-9a46-4cdc-a4b2-95cfe13f6e86 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:04.191094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca12952-9a46-4cdc-a4b2-95cfe13f6e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:04.192782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c46cb-d1d2-4e63-b10e-d25c356cc40b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:04.194207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca12952-9a46-4cdc-a4b2-95cfe13f6e86 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:04.194684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c46cb-d1d2-4e63-b10e-d25c356cc40b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:04.195460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c46cb-d1d2-4e63-b10e-d25c356cc40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:04.239431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-378c46cb-d1d2-4e63-b10e-d25c356cc40b None None] MFA Rules not processed for user `88d5c0890ae64fd6aa7e7e547e9bf736`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:04.242507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-378c46cb-d1d2-4e63-b10e-d25c356cc40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:04.265040 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2423/4871] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:04 2022] POST /identity/v3/users => generated 305 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:04.269635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca12952-9a46-4cdc-a4b2-95cfe13f6e86 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:04.292238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca12952-9a46-4cdc-a4b2-95cfe13f6e86 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:04.300587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e7101-f202-4574-9f53-85b9a0156efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:04.301728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7101-f202-4574-9f53-85b9a0156efa admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:04.302448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7101-f202-4574-9f53-85b9a0156efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:04.302621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7101-f202-4574-9f53-85b9a0156efa admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:04.303883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e7101-f202-4574-9f53-85b9a0156efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:04.307214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e7101-f202-4574-9f53-85b9a0156efa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:04.340043 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2424/4872] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:04.341016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e7101-f202-4574-9f53-85b9a0156efa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:04.362906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e7101-f202-4574-9f53-85b9a0156efa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:04.376589 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2449/4873] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:04.376856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378e8a9-8e47-4a5e-a316-467107c9e891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:04.376856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378e8a9-8e47-4a5e-a316-467107c9e891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:04.376856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378e8a9-8e47-4a5e-a316-467107c9e891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:04.376856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378e8a9-8e47-4a5e-a316-467107c9e891 admin admin] PATH_INFO: `/v3/projects/92a2876416ca4ec38bae7f446f574eb6/users/67b604e9fc55478e970f3a3d5520f1c9/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:04.405082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378e8a9-8e47-4a5e-a316-467107c9e891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a2876416ca4ec38bae7f446f574eb6, user_id=67b604e9fc55478e970f3a3d5520f1c9, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:04.410438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378e8a9-8e47-4a5e-a316-467107c9e891 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:04.431299 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2425/4874] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:04 2022] PUT /identity/v3/projects/92a2876416ca4ec38bae7f446f574eb6/users/67b604e9fc55478e970f3a3d5520f1c9/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:04.437269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c46cb-d1d2-4e63-b10e-d25c356cc40b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:04.452764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c46cb-d1d2-4e63-b10e-d25c356cc40b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:04.473750 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:04.541417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009adaa2-794a-431d-af8a-1f682dcd6d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:04.542053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009adaa2-794a-431d-af8a-1f682dcd6d08 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:04.542395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009adaa2-794a-431d-af8a-1f682dcd6d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:04.542684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009adaa2-794a-431d-af8a-1f682dcd6d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:04.552618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009adaa2-794a-431d-af8a-1f682dcd6d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:04.561902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009adaa2-794a-431d-af8a-1f682dcd6d08 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:04.582195 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2450/4875] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:24:04.584551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378e8a9-8e47-4a5e-a316-467107c9e891 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:04.598573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378e8a9-8e47-4a5e-a316-467107c9e891 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:04.608275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b7399-32b9-475b-bf9e-3a778773012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:04.609073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b7399-32b9-475b-bf9e-3a778773012d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:04.609420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b7399-32b9-475b-bf9e-3a778773012d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:04.609767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b7399-32b9-475b-bf9e-3a778773012d admin admin] PATH_INFO: `/v3/projects/92a2876416ca4ec38bae7f446f574eb6/users/67b604e9fc55478e970f3a3d5520f1c9/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:04.611854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b7399-32b9-475b-bf9e-3a778773012d admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a2876416ca4ec38bae7f446f574eb6, user_id=67b604e9fc55478e970f3a3d5520f1c9, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:04.614801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b7399-32b9-475b-bf9e-3a778773012d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:04.636132 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2426/4876] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:04 2022] PUT /identity/v3/projects/92a2876416ca4ec38bae7f446f574eb6/users/67b604e9fc55478e970f3a3d5520f1c9/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:04.639005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be9604-e8a3-42fb-b684-c8e14b065e9d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:04.639283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be9604-e8a3-42fb-b684-c8e14b065e9d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:04.639562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be9604-e8a3-42fb-b684-c8e14b065e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:04.694049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-85be9604-e8a3-42fb-b684-c8e14b065e9d None None] MFA Rules not processed for user `67b604e9fc55478e970f3a3d5520f1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:04.705603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-85be9604-e8a3-42fb-b684-c8e14b065e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:04.812490 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2451/4877] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:04.817996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b7399-32b9-475b-bf9e-3a778773012d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:04.903838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b7399-32b9-475b-bf9e-3a778773012d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:04.910162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe2068-441c-4247-9978-deb7b05a568c tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f6517f7def48c7ad2049fb88412a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10bfc8f6c78943a9badb2a09d75cc137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:04.914808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe2068-441c-4247-9978-deb7b05a568c tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:04.915132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe2068-441c-4247-9978-deb7b05a568c tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:04.915414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe2068-441c-4247-9978-deb7b05a568c tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:04.916046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe2068-441c-4247-9978-deb7b05a568c tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-1bfe2068-441c-4247-9978-deb7b05a568c tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 16 01:24:04.921762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 16 01:24:04.928818 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 16 01:24:04.928818 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 16 01:24:04.928818 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 16 01:24:04.928818 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 16 01:24:04.928818 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:24:04.928818 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 16 01:24:04.928818 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 16 01:24:04.928818 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:04.928818 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2427/4878] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:24:04 2022] POST /identity/v3/projects => generated 136 bytes in 106 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:24:04.932660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be9604-e8a3-42fb-b684-c8e14b065e9d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:04.947005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be9604-e8a3-42fb-b684-c8e14b065e9d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:04.951981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a61bf-a79d-4b66-8531-6bf6edd78afc tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b604e9fc55478e970f3a3d5520f1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92a2876416ca4ec38bae7f446f574eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:04.952606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a61bf-a79d-4b66-8531-6bf6edd78afc tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:04.952876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a61bf-a79d-4b66-8531-6bf6edd78afc tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:04.953138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a61bf-a79d-4b66-8531-6bf6edd78afc tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:04.953752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a61bf-a79d-4b66-8531-6bf6edd78afc tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:04.955811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a61bf-a79d-4b66-8531-6bf6edd78afc tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e80a61bf-a79d-4b66-8531-6bf6edd78afc tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Invalid input for field 'name': '' is too short Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: Failed validating 'minLength' in schema['properties']['name']: Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: On instance['name']: Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: Failed validating 'minLength' in schema['properties']['name']: Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: On instance['name']: Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: '' Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise error Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application On instance['name']: Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application '' Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:04.963545 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 16 01:24:04.969698 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 16 01:24:04.971065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 16 01:24:04.971065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 16 01:24:04.971065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:04.971065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 16 01:24:04.971065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:24:04.971065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:04.971065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application On instance['name']: Oct 16 01:24:04.971065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application '' Oct 16 01:24:04.971065 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:04.971065 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2452/4879] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:24:04 2022] POST /identity/v3/projects => generated 283 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 16 01:24:04.971864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe2068-441c-4247-9978-deb7b05a568c tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:04.982963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe2068-441c-4247-9978-deb7b05a568c tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:04.987315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4241c0-d3ee-4fc7-a59d-45853a75bb43 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b604e9fc55478e970f3a3d5520f1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92a2876416ca4ec38bae7f446f574eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:04.987919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4241c0-d3ee-4fc7-a59d-45853a75bb43 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:04.988198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4241c0-d3ee-4fc7-a59d-45853a75bb43 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:04.988600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4241c0-d3ee-4fc7-a59d-45853a75bb43 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:04.989717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4241c0-d3ee-4fc7-a59d-45853a75bb43 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:04.991062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4241c0-d3ee-4fc7-a59d-45853a75bb43 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-4f4241c0-d3ee-4fc7-a59d-45853a75bb43 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: Failed validating 'maxLength' in schema['properties']['name']: Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: On instance['name']: Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: Failed validating 'maxLength' in schema['properties']['name']: Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: On instance['name']: Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise error Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 16 01:24:05.000130 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application On instance['name']: Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:24:05.001616 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application On instance['name']: Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.002969 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2428/4880] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:24:04 2022] POST /identity/v3/projects => generated 412 bytes in 32 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 16 01:24:05.006493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a61bf-a79d-4b66-8531-6bf6edd78afc tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:05.021639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a61bf-a79d-4b66-8531-6bf6edd78afc tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:05.028029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e6200-d194-4113-952e-0ae7e730e720 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b604e9fc55478e970f3a3d5520f1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92a2876416ca4ec38bae7f446f574eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:05.028981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e6200-d194-4113-952e-0ae7e730e720 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:05.028981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e6200-d194-4113-952e-0ae7e730e720 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:05.029236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e6200-d194-4113-952e-0ae7e730e720 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] PATH_INFO: `/v3/projects/c15cf9357bd646c4ae9d3ad95a6c4e69` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:05.038006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e6200-d194-4113-952e-0ae7e730e720 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c15cf9357bd646c4ae9d3ad95a6c4e69)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:05.040038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e6200-d194-4113-952e-0ae7e730e720 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f16e6200-d194-4113-952e-0ae7e730e720 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Could not find project: c15cf9357bd646c4ae9d3ad95a6c4e69.: keystone.exception.ProjectNotFound: Could not find project: c15cf9357bd646c4ae9d3ad95a6c4e69. Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 16 01:24:05.052285 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 16 01:24:05.053504 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:24:05.053504 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:24:05.053504 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 16 01:24:05.053504 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 16 01:24:05.053504 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:24:05.053504 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:24:05.053504 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:24:05.053504 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:24:05.053504 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c15cf9357bd646c4ae9d3ad95a6c4e69. Oct 16 01:24:05.053504 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:05.056195 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2453/4881] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:05 2022] DELETE /identity/v3/projects/c15cf9357bd646c4ae9d3ad95a6c4e69 => generated 113 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:24:05.061400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4241c0-d3ee-4fc7-a59d-45853a75bb43 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:05.077783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4241c0-d3ee-4fc7-a59d-45853a75bb43 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:05.082808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab28fa-fdb6-419c-8197-33350de585de tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f6517f7def48c7ad2049fb88412a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10bfc8f6c78943a9badb2a09d75cc137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:05.083663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab28fa-fdb6-419c-8197-33350de585de tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:05.083954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab28fa-fdb6-419c-8197-33350de585de tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:05.084374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab28fa-fdb6-419c-8197-33350de585de tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:05.085440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab28fa-fdb6-419c-8197-33350de585de tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-0dab28fa-fdb6-419c-8197-33350de585de tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 16 01:24:05.092539 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._list_projects() Oct 16 01:24:05.093651 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 16 01:24:05.093651 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 16 01:24:05.093651 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 16 01:24:05.093651 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 16 01:24:05.093651 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 16 01:24:05.093651 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 16 01:24:05.093651 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:24:05.093651 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 16 01:24:05.093651 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 16 01:24:05.093651 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.094517 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2429/4882] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Oct 16 01:24:05 2022] GET /identity/v3/projects => generated 135 bytes in 33 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:24:05.098754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e6200-d194-4113-952e-0ae7e730e720 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:05.111333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e6200-d194-4113-952e-0ae7e730e720 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:05.120835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a7d87-d74f-40ec-b864-13a3039fe303 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b604e9fc55478e970f3a3d5520f1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92a2876416ca4ec38bae7f446f574eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:05.123168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a7d87-d74f-40ec-b864-13a3039fe303 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:05.123790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a7d87-d74f-40ec-b864-13a3039fe303 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:05.124752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a7d87-d74f-40ec-b864-13a3039fe303 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:05.127147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a7d87-d74f-40ec-b864-13a3039fe303 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:05.132213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a7d87-d74f-40ec-b864-13a3039fe303 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:05.183788 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2454/4883] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:05 2022] POST /identity/v3/projects => generated 358 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:05.187957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab28fa-fdb6-419c-8197-33350de585de tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:05.219525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab28fa-fdb6-419c-8197-33350de585de tempest-ProjectsNegativeStaticTestJSON-931900309 tempest-ProjectsNegativeStaticTestJSON-931900309-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:05.224950 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:05.310308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f44660-8d06-41c1-b4b9-737587fcab66 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b604e9fc55478e970f3a3d5520f1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92a2876416ca4ec38bae7f446f574eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:05.310860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f44660-8d06-41c1-b4b9-737587fcab66 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:05.311198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f44660-8d06-41c1-b4b9-737587fcab66 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:05.311474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f44660-8d06-41c1-b4b9-737587fcab66 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:05.312792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f44660-8d06-41c1-b4b9-737587fcab66 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:05.314710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f44660-8d06-41c1-b4b9-737587fcab66 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:05.337515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.sql.core [None req-47f44660-8d06-41c1-b4b9-737587fcab66 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-112015800' for key 'project.ixu_project_name_domain_id'") Oct 16 01:24:05.337515 n-d-master-1 devstack@keystone.service[81805]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 01:24:05.337515 n-d-master-1 devstack@keystone.service[81805]: [parameters: {'id': 'b54ad6c96b0f4aa7bc49449578f5e9c4', 'name': 'tempest-project-dup-112015800', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 16 01:24:05.337515 n-d-master-1 devstack@keystone.service[81805]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81805) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 01:24:05.347658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-47f44660-8d06-41c1-b4b9-737587fcab66 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-112015800, project id b54ad6c96b0f4aa7bc49449578f5e9c4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-112015800, project id b54ad6c96b0f4aa7bc49449578f5e9c4. Oct 16 01:24:05.347658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:05.347658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 01:24:05.347658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 01:24:05.347658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 01:24:05.347658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 01:24:05.347658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 01:24:05.347658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 01:24:05.347658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 01:24:05.347658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application conn.query(q) Oct 16 01:24:05.347658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 01:24:05.347658 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result.read() Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-112015800' for key 'project.ixu_project_name_domain_id'") Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 01:24:05.348705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application next(self.gen) Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application yield resource Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application next(self.gen) Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise self.value Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 01:24:05.349817 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application session.commit() Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.session.flush() Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application compat.raise_( Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 01:24:05.351084 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 01:24:05.353367 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application conn.query(q) Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application result.read() Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 01:24:05.354650 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-112015800' for key 'project.ixu_project_name_domain_id'") Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [parameters: {'id': 'b54ad6c96b0f4aa7bc49449578f5e9c4', 'name': 'tempest-project-dup-112015800', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:05.356353 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-112015800 at domain ID default. Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:24:05.357554 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:24:05.360039 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:24:05.360039 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 16 01:24:05.360039 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 16 01:24:05.360039 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:24:05.360039 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:24:05.360039 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 16 01:24:05.360039 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 16 01:24:05.360039 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-112015800, project id b54ad6c96b0f4aa7bc49449578f5e9c4. Oct 16 01:24:05.360039 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:05.360039 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2430/4884] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:24:05 2022] POST /identity/v3/projects => generated 284 bytes in 165 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 16 01:24:05.361739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a7d87-d74f-40ec-b864-13a3039fe303 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:05.369990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a7d87-d74f-40ec-b864-13a3039fe303 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:05.375130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd8e7-1c23-4c81-816f-914d97b5e085 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b604e9fc55478e970f3a3d5520f1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92a2876416ca4ec38bae7f446f574eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:05.376019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd8e7-1c23-4c81-816f-914d97b5e085 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:05.376414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd8e7-1c23-4c81-816f-914d97b5e085 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:05.376770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd8e7-1c23-4c81-816f-914d97b5e085 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] PATH_INFO: `/v3/projects/6d6cbbf3643e49989b6d246cea059f61` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:05.378011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd8e7-1c23-4c81-816f-914d97b5e085 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d6cbbf3643e49989b6d246cea059f61)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:05.380233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd8e7-1c23-4c81-816f-914d97b5e085 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:05.434475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2eebd8e7-1c23-4c81-816f-914d97b5e085 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6cbbf3643e49989b6d246cea059f61', 'request_id': 'req-2eebd8e7-1c23-4c81-816f-914d97b5e085'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:05.441924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2eebd8e7-1c23-4c81-816f-914d97b5e085 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6cbbf3643e49989b6d246cea059f61', 'request_id': 'req-2eebd8e7-1c23-4c81-816f-914d97b5e085'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:05.443960 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:05.451693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2eebd8e7-1c23-4c81-816f-914d97b5e085 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6cbbf3643e49989b6d246cea059f61', 'request_id': 'req-2eebd8e7-1c23-4c81-816f-914d97b5e085'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:05.466216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2eebd8e7-1c23-4c81-816f-914d97b5e085 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] The token cache is being invalidate because project 6d6cbbf3643e49989b6d246cea059f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:05.466535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2eebd8e7-1c23-4c81-816f-914d97b5e085 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:05.468524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2eebd8e7-1c23-4c81-816f-914d97b5e085 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:05.474307 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2455/4885] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:05 2022] DELETE /identity/v3/projects/6d6cbbf3643e49989b6d246cea059f61 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:05.477879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f44660-8d06-41c1-b4b9-737587fcab66 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:05.480021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-47f44660-8d06-41c1-b4b9-737587fcab66 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:05.577278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f44660-8d06-41c1-b4b9-737587fcab66 tempest-ProjectsNegativeStaticTestJSON-1749681480 tempest-ProjectsNegativeStaticTestJSON-1749681480-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:05.644860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:05.645752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:05.646458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:05.646721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] PATH_INFO: `/v3/users/39f6517f7def48c7ad2049fb88412a8d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:05.648016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f6517f7def48c7ad2049fb88412a8d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:05.651473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:05.710112 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:05.716554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f6517f7def48c7ad2049fb88412a8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:05.720649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f6517f7def48c7ad2049fb88412a8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:05.734769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f6517f7def48c7ad2049fb88412a8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:05.744796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f6517f7def48c7ad2049fb88412a8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:05.745443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f6517f7def48c7ad2049fb88412a8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:05.761530 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2431/4886] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:05 2022] DELETE /identity/v3/users/39f6517f7def48c7ad2049fb88412a8d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:05.766071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484277-fab0-4a2e-a1e2-431731096374 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:05.766431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484277-fab0-4a2e-a1e2-431731096374 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:05.766779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484277-fab0-4a2e-a1e2-431731096374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:05.787340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-04484277-fab0-4a2e-a1e2-431731096374 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:05.789109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-04484277-fab0-4a2e-a1e2-431731096374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:05.855947 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2456/4887] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:05.869310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:05.872515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:05.946086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc62de-a57a-483b-8d86-d3a6758565e7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:05.965274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc09cf1-2eec-4601-aaac-02dfc0f49af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:05.966002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc09cf1-2eec-4601-aaac-02dfc0f49af8 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:05.966285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc09cf1-2eec-4601-aaac-02dfc0f49af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:05.966556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc09cf1-2eec-4601-aaac-02dfc0f49af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:05.979740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc09cf1-2eec-4601-aaac-02dfc0f49af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:05.981271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc09cf1-2eec-4601-aaac-02dfc0f49af8 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:05.992524 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2432/4888] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:06.361071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04484277-fab0-4a2e-a1e2-431731096374 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:06.362755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-04484277-fab0-4a2e-a1e2-431731096374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:06.378671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04484277-fab0-4a2e-a1e2-431731096374 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:06.385182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:06.386068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:06.386677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:06.387185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] PATH_INFO: `/v3/projects/10bfc8f6c78943a9badb2a09d75cc137` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:06.389911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=10bfc8f6c78943a9badb2a09d75cc137)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:06.392110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:06.463318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10bfc8f6c78943a9badb2a09d75cc137', 'request_id': 'req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:06.471224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10bfc8f6c78943a9badb2a09d75cc137', 'request_id': 'req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:06.487136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10bfc8f6c78943a9badb2a09d75cc137', 'request_id': 'req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:06.499901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] The token cache is being invalidate because project 10bfc8f6c78943a9badb2a09d75cc137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:06.500216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:06.500849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:06.502358 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2457/4889] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:06 2022] DELETE /identity/v3/projects/10bfc8f6c78943a9badb2a09d75cc137 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:06.506724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc09cf1-2eec-4601-aaac-02dfc0f49af8 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:06.518557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc09cf1-2eec-4601-aaac-02dfc0f49af8 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:06.586423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8eafd-ed4f-454e-b44d-06cfab148a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:06.587712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8eafd-ed4f-454e-b44d-06cfab148a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:06.587986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8eafd-ed4f-454e-b44d-06cfab148a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:06.588262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8eafd-ed4f-454e-b44d-06cfab148a95 admin admin] PATH_INFO: `/v3/users/67b604e9fc55478e970f3a3d5520f1c9` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:06.589454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8eafd-ed4f-454e-b44d-06cfab148a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b604e9fc55478e970f3a3d5520f1c9)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:06.591366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8eafd-ed4f-454e-b44d-06cfab148a95 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:06.648056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-82a8eafd-ed4f-454e-b44d-06cfab148a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b604e9fc55478e970f3a3d5520f1c9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:06.649299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-82a8eafd-ed4f-454e-b44d-06cfab148a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b604e9fc55478e970f3a3d5520f1c9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:06.662357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-82a8eafd-ed4f-454e-b44d-06cfab148a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b604e9fc55478e970f3a3d5520f1c9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:06.666060 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:06.672777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-82a8eafd-ed4f-454e-b44d-06cfab148a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b604e9fc55478e970f3a3d5520f1c9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:06.673954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-82a8eafd-ed4f-454e-b44d-06cfab148a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b604e9fc55478e970f3a3d5520f1c9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:06.688671 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2433/4890] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:06 2022] DELETE /identity/v3/users/67b604e9fc55478e970f3a3d5520f1c9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:07.020194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:07.022118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:07.040396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24f6d2-3d08-4583-8c92-8f33b8cafb2c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:07.105380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933b9a1-7de6-4691-afb1-f6709e148781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:07.105988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933b9a1-7de6-4691-afb1-f6709e148781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:07.106265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933b9a1-7de6-4691-afb1-f6709e148781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:07.106553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933b9a1-7de6-4691-afb1-f6709e148781 admin admin] PATH_INFO: `/v3/projects/92a2876416ca4ec38bae7f446f574eb6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:07.107945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933b9a1-7de6-4691-afb1-f6709e148781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92a2876416ca4ec38bae7f446f574eb6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:07.109832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933b9a1-7de6-4691-afb1-f6709e148781 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:07.118210 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:07.158649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0933b9a1-7de6-4691-afb1-f6709e148781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92a2876416ca4ec38bae7f446f574eb6', 'request_id': 'req-0933b9a1-7de6-4691-afb1-f6709e148781'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:07.164933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0933b9a1-7de6-4691-afb1-f6709e148781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92a2876416ca4ec38bae7f446f574eb6', 'request_id': 'req-0933b9a1-7de6-4691-afb1-f6709e148781'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:07.172901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0933b9a1-7de6-4691-afb1-f6709e148781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92a2876416ca4ec38bae7f446f574eb6', 'request_id': 'req-0933b9a1-7de6-4691-afb1-f6709e148781'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:07.184420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0933b9a1-7de6-4691-afb1-f6709e148781 admin admin] The token cache is being invalidate because project 92a2876416ca4ec38bae7f446f574eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:07.184711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0933b9a1-7de6-4691-afb1-f6709e148781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:07.185344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0933b9a1-7de6-4691-afb1-f6709e148781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:07.187076 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2458/4891] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:07 2022] DELETE /identity/v3/projects/92a2876416ca4ec38bae7f446f574eb6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:07.192043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc3eaa-3b61-4273-8800-f08ff077093a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:07.192331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc3eaa-3b61-4273-8800-f08ff077093a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:07.192628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc3eaa-3b61-4273-8800-f08ff077093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:07.214654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f0dc3eaa-3b61-4273-8800-f08ff077093a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:07.215905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f0dc3eaa-3b61-4273-8800-f08ff077093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:07.276695 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2434/4892] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:07.284579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cceab7-deb1-4df5-9dd9-80833f82d8de None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:07.285081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cceab7-deb1-4df5-9dd9-80833f82d8de None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:07.285460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cceab7-deb1-4df5-9dd9-80833f82d8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:07.306575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-93cceab7-deb1-4df5-9dd9-80833f82d8de None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:07.307815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-93cceab7-deb1-4df5-9dd9-80833f82d8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:07.315811 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2459/4893] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:07.320001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc3eaa-3b61-4273-8800-f08ff077093a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:07.330389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc3eaa-3b61-4273-8800-f08ff077093a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:07.334994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906110b-ffbc-4041-9b36-e996400252ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:07.335590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906110b-ffbc-4041-9b36-e996400252ec admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:07.335905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906110b-ffbc-4041-9b36-e996400252ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:07.336264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906110b-ffbc-4041-9b36-e996400252ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:07.337101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906110b-ffbc-4041-9b36-e996400252ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:07.337400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906110b-ffbc-4041-9b36-e996400252ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:07.339007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906110b-ffbc-4041-9b36-e996400252ec admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:07.360322 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2435/4894] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:07.364003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cceab7-deb1-4df5-9dd9-80833f82d8de None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:07.374127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cceab7-deb1-4df5-9dd9-80833f82d8de None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:07.384659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed45f59-c54b-4b8a-8d1b-36b407ace076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:07.385275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed45f59-c54b-4b8a-8d1b-36b407ace076 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:07.385551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed45f59-c54b-4b8a-8d1b-36b407ace076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:07.385823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed45f59-c54b-4b8a-8d1b-36b407ace076 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:07.386459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed45f59-c54b-4b8a-8d1b-36b407ace076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:07.388377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed45f59-c54b-4b8a-8d1b-36b407ace076 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:07.417386 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2460/4895] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:07 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:07.421499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906110b-ffbc-4041-9b36-e996400252ec admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:07.433206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906110b-ffbc-4041-9b36-e996400252ec admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:07.464355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed45f59-c54b-4b8a-8d1b-36b407ace076 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:07.469022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9ed45f59-c54b-4b8a-8d1b-36b407ace076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:07.530414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67780d8-0ec1-4552-a6b1-f048c0900e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:07.531489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67780d8-0ec1-4552-a6b1-f048c0900e83 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:07.531489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67780d8-0ec1-4552-a6b1-f048c0900e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:07.531710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67780d8-0ec1-4552-a6b1-f048c0900e83 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:07.532457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67780d8-0ec1-4552-a6b1-f048c0900e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:07.534545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67780d8-0ec1-4552-a6b1-f048c0900e83 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:07.576750 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2436/4896] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:07 2022] POST /identity/v3/users => generated 282 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:07.578602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67780d8-0ec1-4552-a6b1-f048c0900e83 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:07.610134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67780d8-0ec1-4552-a6b1-f048c0900e83 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:07.621080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed45f59-c54b-4b8a-8d1b-36b407ace076 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:07.623723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14b3e9-945d-436d-9598-86449b858b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:07.624492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14b3e9-945d-436d-9598-86449b858b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:07.624650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14b3e9-945d-436d-9598-86449b858b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:07.624994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14b3e9-945d-436d-9598-86449b858b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:07.625742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14b3e9-945d-436d-9598-86449b858b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:07.628548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14b3e9-945d-436d-9598-86449b858b3b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:07.635378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c0c4-10e7-4dfc-9929-62728968734c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:07.636018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c0c4-10e7-4dfc-9929-62728968734c service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:07.636306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c0c4-10e7-4dfc-9929-62728968734c service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:07.636580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c0c4-10e7-4dfc-9929-62728968734c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:07.640415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2dc0c0c4-10e7-4dfc-9929-62728968734c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:07.647718 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2437/4897] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:07.651954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14b3e9-945d-436d-9598-86449b858b3b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:07.673552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14b3e9-945d-436d-9598-86449b858b3b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:07.685604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012e6bc-add4-4ae2-8cb4-d47bfcf1956f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:07.686239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012e6bc-add4-4ae2-8cb4-d47bfcf1956f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:07.688119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012e6bc-add4-4ae2-8cb4-d47bfcf1956f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:07.688436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012e6bc-add4-4ae2-8cb4-d47bfcf1956f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:07.692322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012e6bc-add4-4ae2-8cb4-d47bfcf1956f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:07.696112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012e6bc-add4-4ae2-8cb4-d47bfcf1956f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:07.744176 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2438/4898] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:24:07.745496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012e6bc-add4-4ae2-8cb4-d47bfcf1956f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:07.771595 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:07.783942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0c0c4-10e7-4dfc-9929-62728968734c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:07.785727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0c0c4-10e7-4dfc-9929-62728968734c service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:07.786827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012e6bc-add4-4ae2-8cb4-d47bfcf1956f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:07.799033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443f86e-3ef4-41b6-a6fc-34f9c2608f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:07.799402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f86e-3ef4-41b6-a6fc-34f9c2608f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:07.799685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f86e-3ef4-41b6-a6fc-34f9c2608f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:07.802835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f86e-3ef4-41b6-a6fc-34f9c2608f94 admin admin] PATH_INFO: `/v3/projects/c6561d0d988449b7b166c6c8d3120ff3/users/30285667ffca4114855e88dce5cad3d7/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:07.814135 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2461/4899] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:07.864629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443f86e-3ef4-41b6-a6fc-34f9c2608f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6561d0d988449b7b166c6c8d3120ff3, user_id=30285667ffca4114855e88dce5cad3d7, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:07.872747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443f86e-3ef4-41b6-a6fc-34f9c2608f94 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:07.909629 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2439/4900] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:07 2022] PUT /identity/v3/projects/c6561d0d988449b7b166c6c8d3120ff3/users/30285667ffca4114855e88dce5cad3d7/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:07.923151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd1e7-b7ac-400c-8711-5a09cf01cb2c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:07.923775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd1e7-b7ac-400c-8711-5a09cf01cb2c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:07.924198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd1e7-b7ac-400c-8711-5a09cf01cb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:07.967215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b26bd1e7-b7ac-400c-8711-5a09cf01cb2c None None] MFA Rules not processed for user `30285667ffca4114855e88dce5cad3d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:07.970606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b26bd1e7-b7ac-400c-8711-5a09cf01cb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:08.076077 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2462/4901] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:08.077648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443f86e-3ef4-41b6-a6fc-34f9c2608f94 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:08.098963 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:08.157320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443f86e-3ef4-41b6-a6fc-34f9c2608f94 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:08.162643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212abd30-4fe9-44a9-9292-15615fd009ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:08.163457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212abd30-4fe9-44a9-9292-15615fd009ff admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:08.164509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212abd30-4fe9-44a9-9292-15615fd009ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:08.165616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212abd30-4fe9-44a9-9292-15615fd009ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:08.166354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212abd30-4fe9-44a9-9292-15615fd009ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:08.168479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212abd30-4fe9-44a9-9292-15615fd009ff admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:08.202104 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2440/4902] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:08 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:08.205767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd1e7-b7ac-400c-8711-5a09cf01cb2c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:08.217422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd1e7-b7ac-400c-8711-5a09cf01cb2c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:08.302174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86057fcc-7684-441a-9985-7b34dcdd9014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:08.303141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86057fcc-7684-441a-9985-7b34dcdd9014 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:08.303584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86057fcc-7684-441a-9985-7b34dcdd9014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:08.304043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86057fcc-7684-441a-9985-7b34dcdd9014 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:08.304927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86057fcc-7684-441a-9985-7b34dcdd9014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:08.308940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86057fcc-7684-441a-9985-7b34dcdd9014 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:08.342970 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2463/4903] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:08 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:08.344428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212abd30-4fe9-44a9-9292-15615fd009ff admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:08.356964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212abd30-4fe9-44a9-9292-15615fd009ff admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:08.364246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc38012-b50e-4e23-9493-2d7ff80a961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:08.365199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc38012-b50e-4e23-9493-2d7ff80a961e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:08.367281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc38012-b50e-4e23-9493-2d7ff80a961e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:08.369105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc38012-b50e-4e23-9493-2d7ff80a961e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:08.370586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc38012-b50e-4e23-9493-2d7ff80a961e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:08.373082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc38012-b50e-4e23-9493-2d7ff80a961e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:08.395541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86057fcc-7684-441a-9985-7b34dcdd9014 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:08.404899 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2441/4904] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:08.411190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86057fcc-7684-441a-9985-7b34dcdd9014 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:08.419127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e62e34-d272-4248-a0a1-37ca114a0560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:08.421161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e62e34-d272-4248-a0a1-37ca114a0560 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:08.421661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e62e34-d272-4248-a0a1-37ca114a0560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:08.422329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e62e34-d272-4248-a0a1-37ca114a0560 admin admin] PATH_INFO: `/v3/projects/c65b03d77a664c7480e7deb30793d5a3/users/9cdd1714da0544978aa50896aa4cc9b3/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:08.446003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e62e34-d272-4248-a0a1-37ca114a0560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65b03d77a664c7480e7deb30793d5a3, user_id=9cdd1714da0544978aa50896aa4cc9b3, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:08.450299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e62e34-d272-4248-a0a1-37ca114a0560 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:08.478093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc38012-b50e-4e23-9493-2d7ff80a961e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:08.479390 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2464/4905] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:08 2022] PUT /identity/v3/projects/c65b03d77a664c7480e7deb30793d5a3/users/9cdd1714da0544978aa50896aa4cc9b3/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:08.491408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc38012-b50e-4e23-9493-2d7ff80a961e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:08.607738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9a230-fd53-4551-959f-c831478d8e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:08.608540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9a230-fd53-4551-959f-c831478d8e26 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:08.608971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9a230-fd53-4551-959f-c831478d8e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:08.609376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9a230-fd53-4551-959f-c831478d8e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:08.610602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9a230-fd53-4551-959f-c831478d8e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:08.612893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9a230-fd53-4551-959f-c831478d8e26 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:08.631523 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2442/4906] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:08.634299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e62e34-d272-4248-a0a1-37ca114a0560 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:08.647702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e62e34-d272-4248-a0a1-37ca114a0560 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:08.654518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e35d8-0328-4b35-8346-c36e11b2b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:08.655597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e35d8-0328-4b35-8346-c36e11b2b3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:08.656186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e35d8-0328-4b35-8346-c36e11b2b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:08.657425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e35d8-0328-4b35-8346-c36e11b2b3ab admin admin] PATH_INFO: `/v3/projects/c65b03d77a664c7480e7deb30793d5a3/users/9cdd1714da0544978aa50896aa4cc9b3/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:08.661041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e35d8-0328-4b35-8346-c36e11b2b3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65b03d77a664c7480e7deb30793d5a3, user_id=9cdd1714da0544978aa50896aa4cc9b3, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:08.664793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e35d8-0328-4b35-8346-c36e11b2b3ab admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:08.683485 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2465/4907] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:08 2022] PUT /identity/v3/projects/c65b03d77a664c7480e7deb30793d5a3/users/9cdd1714da0544978aa50896aa4cc9b3/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:08.690537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572426f1-aa1f-4334-9d1d-5553cf766c54 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:08.691140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572426f1-aa1f-4334-9d1d-5553cf766c54 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:08.691853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572426f1-aa1f-4334-9d1d-5553cf766c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:08.740373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-572426f1-aa1f-4334-9d1d-5553cf766c54 None None] MFA Rules not processed for user `9cdd1714da0544978aa50896aa4cc9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:08.743580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-572426f1-aa1f-4334-9d1d-5553cf766c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:08.845414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e35d8-0328-4b35-8346-c36e11b2b3ab admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:08.857811 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2443/4908] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:08.862848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e35d8-0328-4b35-8346-c36e11b2b3ab admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:08.870580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5019e1-e6fa-4814-854e-18d5af1e35d6 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:08.871341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5019e1-e6fa-4814-854e-18d5af1e35d6 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:08.871629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5019e1-e6fa-4814-854e-18d5af1e35d6 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:08.871963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5019e1-e6fa-4814-854e-18d5af1e35d6 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:08.872652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5019e1-e6fa-4814-854e-18d5af1e35d6 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:08.874793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5019e1-e6fa-4814-854e-18d5af1e35d6 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:08.919157 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2466/4909] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:24:08 2022] POST /identity/v3/roles => generated 234 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:08.921508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572426f1-aa1f-4334-9d1d-5553cf766c54 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:08.935031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572426f1-aa1f-4334-9d1d-5553cf766c54 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:08.963947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e5a51-7872-4aa9-b1ab-6f2330980eba tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:08.964659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e5a51-7872-4aa9-b1ab-6f2330980eba tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:08.964797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e5a51-7872-4aa9-b1ab-6f2330980eba tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:08.965080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e5a51-7872-4aa9-b1ab-6f2330980eba tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:08.965814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e5a51-7872-4aa9-b1ab-6f2330980eba tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:08.967721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e5a51-7872-4aa9-b1ab-6f2330980eba tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:08.998225 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:09.015396 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2444/4910] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:24:08 2022] POST /identity/v3/roles => generated 235 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:09.021503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5019e1-e6fa-4814-854e-18d5af1e35d6 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:09.033942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5019e1-e6fa-4814-854e-18d5af1e35d6 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:09.051236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89181d8-b5a6-44db-a5d7-8da3d88b8071 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:09.052137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89181d8-b5a6-44db-a5d7-8da3d88b8071 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:09.053010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89181d8-b5a6-44db-a5d7-8da3d88b8071 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:09.053010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89181d8-b5a6-44db-a5d7-8da3d88b8071 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:09.054819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89181d8-b5a6-44db-a5d7-8da3d88b8071 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:09.056987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89181d8-b5a6-44db-a5d7-8da3d88b8071 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:09.084423 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2467/4911] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:24:09 2022] POST /identity/v3/roles => generated 234 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:09.090030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e5a51-7872-4aa9-b1ab-6f2330980eba tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:09.101752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e5a51-7872-4aa9-b1ab-6f2330980eba tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:09.111190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3f420-42bd-466f-ade5-7826f1e8e000 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:09.112152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3f420-42bd-466f-ade5-7826f1e8e000 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:09.112595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3f420-42bd-466f-ade5-7826f1e8e000 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:09.113014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3f420-42bd-466f-ade5-7826f1e8e000 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:09.113840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3f420-42bd-466f-ade5-7826f1e8e000 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:09.115759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3f420-42bd-466f-ade5-7826f1e8e000 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:09.144340 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2445/4912] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:24:09 2022] POST /identity/v3/domains => generated 275 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:09.148059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89181d8-b5a6-44db-a5d7-8da3d88b8071 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:09.161651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89181d8-b5a6-44db-a5d7-8da3d88b8071 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:09.171047 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:09.233454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716c2e1-5ff8-412e-8a1a-1604d4bca8fa tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:09.234083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716c2e1-5ff8-412e-8a1a-1604d4bca8fa tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:09.234438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716c2e1-5ff8-412e-8a1a-1604d4bca8fa tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:09.234785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716c2e1-5ff8-412e-8a1a-1604d4bca8fa tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:09.235525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716c2e1-5ff8-412e-8a1a-1604d4bca8fa tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:09.237876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716c2e1-5ff8-412e-8a1a-1604d4bca8fa tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:09.309637 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2468/4913] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:09 2022] POST /identity/v3/projects => generated 400 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:09.312878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3f420-42bd-466f-ade5-7826f1e8e000 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:09.327327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3f420-42bd-466f-ade5-7826f1e8e000 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:09.411946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c2629-0f1c-475c-b718-c09b40d438b4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:09.412893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c2629-0f1c-475c-b718-c09b40d438b4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:09.413667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c2629-0f1c-475c-b718-c09b40d438b4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:09.413667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c2629-0f1c-475c-b718-c09b40d438b4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/groups` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:09.414675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c2629-0f1c-475c-b718-c09b40d438b4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:09.416462 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-fc2c2629-0f1c-475c-b718-c09b40d438b4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:09.416462 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:09.416462 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:09.418196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c2629-0f1c-475c-b718-c09b40d438b4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:09.442640 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2446/4914] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:24:09 2022] POST /identity/v3/groups => generated 300 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:09.449682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716c2e1-5ff8-412e-8a1a-1604d4bca8fa tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:09.462535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716c2e1-5ff8-412e-8a1a-1604d4bca8fa tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:09.468400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f9dfe-9a11-4595-90c5-3580c785d4e1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:09.469129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f9dfe-9a11-4595-90c5-3580c785d4e1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:09.469464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f9dfe-9a11-4595-90c5-3580c785d4e1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:09.469818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f9dfe-9a11-4595-90c5-3580c785d4e1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:09.471045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f9dfe-9a11-4595-90c5-3580c785d4e1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:09.473980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f9dfe-9a11-4595-90c5-3580c785d4e1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:09.491135 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2469/4915] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:24:09 2022] POST /identity/v3/roles => generated 235 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:09.497247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c2629-0f1c-475c-b718-c09b40d438b4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:09.525787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c2629-0f1c-475c-b718-c09b40d438b4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:09.540676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0eada-c545-4213-bbd7-5799c38f41e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:09.542187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0eada-c545-4213-bbd7-5799c38f41e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:09.542633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0eada-c545-4213-bbd7-5799c38f41e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:09.543112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0eada-c545-4213-bbd7-5799c38f41e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:09.544178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0eada-c545-4213-bbd7-5799c38f41e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:09.546415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0eada-c545-4213-bbd7-5799c38f41e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:09.595002 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2447/4916] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:09 2022] POST /identity/v3/users => generated 442 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:09.599872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f9dfe-9a11-4595-90c5-3580c785d4e1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:09.621356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f9dfe-9a11-4595-90c5-3580c785d4e1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:09.632435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719099ad-008b-4359-af44-7936200e0ebf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:09.633840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719099ad-008b-4359-af44-7936200e0ebf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:09.634516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719099ad-008b-4359-af44-7936200e0ebf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:09.634844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719099ad-008b-4359-af44-7936200e0ebf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:09.635554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719099ad-008b-4359-af44-7936200e0ebf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:09.636566 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-719099ad-008b-4359-af44-7936200e0ebf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:09.636566 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:24:09.636566 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:24:09.637469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719099ad-008b-4359-af44-7936200e0ebf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:09.657437 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2470/4917] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:24:09 2022] POST /identity/v3/roles => generated 270 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:09.665137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0eada-c545-4213-bbd7-5799c38f41e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:09.686280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0eada-c545-4213-bbd7-5799c38f41e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:09.693176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa87b4-1f0a-4b56-bfce-10e4aa2b7082 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:09.693868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa87b4-1f0a-4b56-bfce-10e4aa2b7082 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:09.694307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa87b4-1f0a-4b56-bfce-10e4aa2b7082 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:09.694681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa87b4-1f0a-4b56-bfce-10e4aa2b7082 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/676fc9b6b3f3491fac50aa59a5609e95` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:09.716966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa87b4-1f0a-4b56-bfce-10e4aa2b7082 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_grant(project_id=939ef2cea14f440ea9a4171080487e01, user_id=82980c93ebd5482d9d1f4a4be46a8842, role_id=676fc9b6b3f3491fac50aa59a5609e95)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:09.721947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa87b4-1f0a-4b56-bfce-10e4aa2b7082 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:09.764706 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2448/4918] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:09 2022] PUT /identity/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/676fc9b6b3f3491fac50aa59a5609e95 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:09.788202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719099ad-008b-4359-af44-7936200e0ebf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:09.803169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719099ad-008b-4359-af44-7936200e0ebf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:09.893749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaaf13-fb3e-48f8-9297-a7e6b50b80a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:09.894650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaaf13-fb3e-48f8-9297-a7e6b50b80a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:09.895015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaaf13-fb3e-48f8-9297-a7e6b50b80a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:09.895319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaaf13-fb3e-48f8-9297-a7e6b50b80a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:09.896186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaaf13-fb3e-48f8-9297-a7e6b50b80a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Adding query filter params (scope.project.id=939ef2cea14f440ea9a4171080487e01, user.id=82980c93ebd5482d9d1f4a4be46a8842) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:09.896560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaaf13-fb3e-48f8-9297-a7e6b50b80a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:09.900085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaaf13-fb3e-48f8-9297-a7e6b50b80a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:09.966609 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2471/4919] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Oct 16 01:24:09 2022] GET /identity/v3/role_assignments?scope.project.id=939ef2cea14f440ea9a4171080487e01&user.id=82980c93ebd5482d9d1f4a4be46a8842&effective => generated 228 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:09.967755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa87b4-1f0a-4b56-bfce-10e4aa2b7082 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:09.987482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa87b4-1f0a-4b56-bfce-10e4aa2b7082 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:10.000923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbccee1-66fe-4fbe-922a-bcabd0932fde tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:10.008671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbccee1-66fe-4fbe-922a-bcabd0932fde tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:10.010211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbccee1-66fe-4fbe-922a-bcabd0932fde tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:10.012678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbccee1-66fe-4fbe-922a-bcabd0932fde tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/676fc9b6b3f3491fac50aa59a5609e95` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:10.036105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbccee1-66fe-4fbe-922a-bcabd0932fde tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=939ef2cea14f440ea9a4171080487e01, user_id=82980c93ebd5482d9d1f4a4be46a8842, role_id=676fc9b6b3f3491fac50aa59a5609e95)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:10.061176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbccee1-66fe-4fbe-922a-bcabd0932fde tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:10.093736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5fbccee1-66fe-4fbe-922a-bcabd0932fde tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role 676fc9b6b3f3491fac50aa59a5609e95 was removed from user 82980c93ebd5482d9d1f4a4be46a8842 on project 939ef2cea14f440ea9a4171080487e01. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:10.094161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5fbccee1-66fe-4fbe-922a-bcabd0932fde tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:10.094891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5fbccee1-66fe-4fbe-922a-bcabd0932fde tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:10.152620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaaf13-fb3e-48f8-9297-a7e6b50b80a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:10.152842 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2449/4920] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Oct 16 01:24:09 2022] DELETE /identity/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/676fc9b6b3f3491fac50aa59a5609e95 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:10.154871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-64aaaf13-fb3e-48f8-9297-a7e6b50b80a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:10.176165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaaf13-fb3e-48f8-9297-a7e6b50b80a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:10.204164 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:10.281121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1c6a0-2390-4a6b-bfb3-116e98846477 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:10.281861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c6a0-2390-4a6b-bfb3-116e98846477 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:10.282145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c6a0-2390-4a6b-bfb3-116e98846477 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:10.282417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c6a0-2390-4a6b-bfb3-116e98846477 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/676fc9b6b3f3491fac50aa59a5609e95` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:10.283918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1c6a0-2390-4a6b-bfb3-116e98846477 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=676fc9b6b3f3491fac50aa59a5609e95)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:10.284937 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-85f1c6a0-2390-4a6b-bfb3-116e98846477 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:10.284937 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:24:10.284937 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:24:10.285825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1c6a0-2390-4a6b-bfb3-116e98846477 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:10.355720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-85f1c6a0-2390-4a6b-bfb3-116e98846477 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role 676fc9b6b3f3491fac50aa59a5609e95 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:10.356024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-85f1c6a0-2390-4a6b-bfb3-116e98846477 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:10.356683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-85f1c6a0-2390-4a6b-bfb3-116e98846477 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:10.358952 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2472/4921] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:10 2022] DELETE /identity/v3/roles/676fc9b6b3f3491fac50aa59a5609e95 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:10.363697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbccee1-66fe-4fbe-922a-bcabd0932fde tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:10.377559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbccee1-66fe-4fbe-922a-bcabd0932fde tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:10.453069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff29ef-351a-4ace-98f8-0fee4d28e7d7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:10.453740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff29ef-351a-4ace-98f8-0fee4d28e7d7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:10.454023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff29ef-351a-4ace-98f8-0fee4d28e7d7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:10.454298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff29ef-351a-4ace-98f8-0fee4d28e7d7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/c80682ad7c424b1bb2e04b6e0b419754` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:10.456528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff29ef-351a-4ace-98f8-0fee4d28e7d7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_grant(project_id=939ef2cea14f440ea9a4171080487e01, user_id=82980c93ebd5482d9d1f4a4be46a8842, role_id=c80682ad7c424b1bb2e04b6e0b419754)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:10.459867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff29ef-351a-4ace-98f8-0fee4d28e7d7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:10.479392 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2450/4922] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:10 2022] PUT /identity/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/c80682ad7c424b1bb2e04b6e0b419754 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:10.483217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1c6a0-2390-4a6b-bfb3-116e98846477 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:10.485208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-85f1c6a0-2390-4a6b-bfb3-116e98846477 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:10.500331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1c6a0-2390-4a6b-bfb3-116e98846477 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:10.591045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6549e1e-5918-4e9c-a4fa-b3fb719bcc52 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:10.592191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6549e1e-5918-4e9c-a4fa-b3fb719bcc52 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:10.594037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6549e1e-5918-4e9c-a4fa-b3fb719bcc52 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:10.594505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6549e1e-5918-4e9c-a4fa-b3fb719bcc52 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:10.596592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6549e1e-5918-4e9c-a4fa-b3fb719bcc52 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:10.597974 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-f6549e1e-5918-4e9c-a4fa-b3fb719bcc52 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:10.597974 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:24:10.597974 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:24:10.599480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6549e1e-5918-4e9c-a4fa-b3fb719bcc52 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:10.644179 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2473/4923] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Oct 16 01:24:10 2022] PUT /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603 => generated 520 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:10.648124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff29ef-351a-4ace-98f8-0fee4d28e7d7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:10.662488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff29ef-351a-4ace-98f8-0fee4d28e7d7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:10.674323 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:10.780449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d2a01-31d4-4645-b38d-10a1e99c96dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:10.781770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d2a01-31d4-4645-b38d-10a1e99c96dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:10.782060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d2a01-31d4-4645-b38d-10a1e99c96dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:10.782339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d2a01-31d4-4645-b38d-10a1e99c96dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:10.783433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d2a01-31d4-4645-b38d-10a1e99c96dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Adding query filter params (scope.project.id=939ef2cea14f440ea9a4171080487e01, user.id=82980c93ebd5482d9d1f4a4be46a8842) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:10.783746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d2a01-31d4-4645-b38d-10a1e99c96dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:10.785786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d2a01-31d4-4645-b38d-10a1e99c96dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:10.860700 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2451/4924] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Oct 16 01:24:10 2022] GET /identity/v3/role_assignments?scope.project.id=939ef2cea14f440ea9a4171080487e01&user.id=82980c93ebd5482d9d1f4a4be46a8842&effective => generated 1061 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:10.864407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6549e1e-5918-4e9c-a4fa-b3fb719bcc52 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:10.877571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6549e1e-5918-4e9c-a4fa-b3fb719bcc52 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:10.882514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03032b3e-1093-4f42-89d3-deb4a30d2aec tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:10.884064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03032b3e-1093-4f42-89d3-deb4a30d2aec tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:10.884413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03032b3e-1093-4f42-89d3-deb4a30d2aec tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:10.884757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03032b3e-1093-4f42-89d3-deb4a30d2aec tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:10.886535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03032b3e-1093-4f42-89d3-deb4a30d2aec tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:10.887720 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-03032b3e-1093-4f42-89d3-deb4a30d2aec tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:10.887720 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:24:10.887720 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:24:10.888785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03032b3e-1093-4f42-89d3-deb4a30d2aec tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:10.900796 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2474/4925] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Oct 16 01:24:10 2022] DELETE /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:10.904495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d2a01-31d4-4645-b38d-10a1e99c96dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:10.914989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d2a01-31d4-4645-b38d-10a1e99c96dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:10.985862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006fe9e-3a9d-49ca-8eaf-7068365af870 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:10.987019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006fe9e-3a9d-49ca-8eaf-7068365af870 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:10.987019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006fe9e-3a9d-49ca-8eaf-7068365af870 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:10.987239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006fe9e-3a9d-49ca-8eaf-7068365af870 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:10.987857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006fe9e-3a9d-49ca-8eaf-7068365af870 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Adding query filter params (scope.project.id=939ef2cea14f440ea9a4171080487e01, user.id=82980c93ebd5482d9d1f4a4be46a8842) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:10.988156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006fe9e-3a9d-49ca-8eaf-7068365af870 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:10.990035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006fe9e-3a9d-49ca-8eaf-7068365af870 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:11.045076 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2452/4926] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Oct 16 01:24:10 2022] GET /identity/v3/role_assignments?scope.project.id=939ef2cea14f440ea9a4171080487e01&user.id=82980c93ebd5482d9d1f4a4be46a8842&effective => generated 577 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:11.046582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03032b3e-1093-4f42-89d3-deb4a30d2aec tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:11.057665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03032b3e-1093-4f42-89d3-deb4a30d2aec tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:11.062320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404b5de-19d8-4c4e-bf33-6a1c2e60c8b0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:11.062986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404b5de-19d8-4c4e-bf33-6a1c2e60c8b0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:11.063274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404b5de-19d8-4c4e-bf33-6a1c2e60c8b0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:11.063558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404b5de-19d8-4c4e-bf33-6a1c2e60c8b0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:11.065223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404b5de-19d8-4c4e-bf33-6a1c2e60c8b0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:11.066817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404b5de-19d8-4c4e-bf33-6a1c2e60c8b0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f404b5de-19d8-4c4e-bf33-6a1c2e60c8b0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] c80682ad7c424b1bb2e04b6e0b419754 does not imply fa93199e39094e469355c620cdb83603.: keystone.exception.ImpliedRoleNotFound: c80682ad7c424b1bb2e04b6e0b419754 does not imply fa93199e39094e469355c620cdb83603. Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = query.one() Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._iter().one() Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._only_one_row( Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:11.078382 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 16 01:24:11.079524 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 16 01:24:11.084685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 16 01:24:11.084685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 16 01:24:11.084685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 16 01:24:11.084685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c80682ad7c424b1bb2e04b6e0b419754 does not imply fa93199e39094e469355c620cdb83603. Oct 16 01:24:11.084685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:11.084685 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2475/4927] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Oct 16 01:24:11 2022] DELETE /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603 => generated 137 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:24:11.085483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006fe9e-3a9d-49ca-8eaf-7068365af870 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:11.095826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006fe9e-3a9d-49ca-8eaf-7068365af870 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:11.100576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b6af7-bd7a-4c5d-b74a-a0770bc2b963 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:11.101232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b6af7-bd7a-4c5d-b74a-a0770bc2b963 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:11.102165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b6af7-bd7a-4c5d-b74a-a0770bc2b963 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:11.102625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b6af7-bd7a-4c5d-b74a-a0770bc2b963 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/c80682ad7c424b1bb2e04b6e0b419754` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:11.104882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b6af7-bd7a-4c5d-b74a-a0770bc2b963 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=939ef2cea14f440ea9a4171080487e01, user_id=82980c93ebd5482d9d1f4a4be46a8842, role_id=c80682ad7c424b1bb2e04b6e0b419754)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:11.107662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b6af7-bd7a-4c5d-b74a-a0770bc2b963 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:11.113190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-253b6af7-bd7a-4c5d-b74a-a0770bc2b963 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role c80682ad7c424b1bb2e04b6e0b419754 was removed from user 82980c93ebd5482d9d1f4a4be46a8842 on project 939ef2cea14f440ea9a4171080487e01. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:11.113481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-253b6af7-bd7a-4c5d-b74a-a0770bc2b963 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:11.114157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-253b6af7-bd7a-4c5d-b74a-a0770bc2b963 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:11.127391 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2453/4928] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Oct 16 01:24:11 2022] DELETE /identity/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/c80682ad7c424b1bb2e04b6e0b419754 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:11.132560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404b5de-19d8-4c4e-bf33-6a1c2e60c8b0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:11.135537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f404b5de-19d8-4c4e-bf33-6a1c2e60c8b0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:11.150465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404b5de-19d8-4c4e-bf33-6a1c2e60c8b0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:11.194380 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:11.209373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1689a-ea66-4336-ad67-7f5f2a5a82db tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:11.209978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1689a-ea66-4336-ad67-7f5f2a5a82db tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:11.210261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1689a-ea66-4336-ad67-7f5f2a5a82db tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:11.210536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1689a-ea66-4336-ad67-7f5f2a5a82db tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:11.211829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1689a-ea66-4336-ad67-7f5f2a5a82db tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:11.213409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1689a-ea66-4336-ad67-7f5f2a5a82db tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:11.227236 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2476/4929] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:11 2022] POST /identity/v3/roles => generated 271 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:11.231398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b6af7-bd7a-4c5d-b74a-a0770bc2b963 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:11.241474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b6af7-bd7a-4c5d-b74a-a0770bc2b963 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:11.246593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da1da5-f0e4-4acc-ae82-b19e6dc884e2 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:11.247234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da1da5-f0e4-4acc-ae82-b19e6dc884e2 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:11.247513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da1da5-f0e4-4acc-ae82-b19e6dc884e2 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:11.247785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da1da5-f0e4-4acc-ae82-b19e6dc884e2 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:11.248427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da1da5-f0e4-4acc-ae82-b19e6dc884e2 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Adding query filter params (domain_id=915b33b278fe4c6caeec4afa2c3ed794) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:11.248729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da1da5-f0e4-4acc-ae82-b19e6dc884e2 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:11.249724 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-a1da1da5-f0e4-4acc-ae82-b19e6dc884e2 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:11.249724 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:11.249724 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:11.250586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da1da5-f0e4-4acc-ae82-b19e6dc884e2 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:11.252670 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:11.260820 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2454/4930] 10.222.0.39 () {58 vars in 1207 bytes} [Sun Oct 16 01:24:11 2022] GET /identity/v3/roles?domain_id=915b33b278fe4c6caeec4afa2c3ed794 => generated 408 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:11.264359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1689a-ea66-4336-ad67-7f5f2a5a82db tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:11.275354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1689a-ea66-4336-ad67-7f5f2a5a82db tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:11.279968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2ce7d-dedd-485e-b7a9-737c670137c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:11.280575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2ce7d-dedd-485e-b7a9-737c670137c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:11.280859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2ce7d-dedd-485e-b7a9-737c670137c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:11.281134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2ce7d-dedd-485e-b7a9-737c670137c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/19e39ba3a6ab4b4780bc164f90eae8c2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:11.282265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2ce7d-dedd-485e-b7a9-737c670137c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=19e39ba3a6ab4b4780bc164f90eae8c2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:11.283916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2ce7d-dedd-485e-b7a9-737c670137c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:11.321502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-51c2ce7d-dedd-485e-b7a9-737c670137c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role 19e39ba3a6ab4b4780bc164f90eae8c2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:11.321780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-51c2ce7d-dedd-485e-b7a9-737c670137c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:11.322483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-51c2ce7d-dedd-485e-b7a9-737c670137c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:11.325090 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2477/4931] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:11 2022] DELETE /identity/v3/roles/19e39ba3a6ab4b4780bc164f90eae8c2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:11.328882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da1da5-f0e4-4acc-ae82-b19e6dc884e2 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:11.330634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a1da1da5-f0e4-4acc-ae82-b19e6dc884e2 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:11.344651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da1da5-f0e4-4acc-ae82-b19e6dc884e2 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:11.416338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb7566-6d5a-487c-92c5-84924e1b846a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:11.417560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb7566-6d5a-487c-92c5-84924e1b846a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:11.417845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb7566-6d5a-487c-92c5-84924e1b846a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:11.418121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb7566-6d5a-487c-92c5-84924e1b846a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:11.418816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb7566-6d5a-487c-92c5-84924e1b846a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Adding query filter params (domain_id=915b33b278fe4c6caeec4afa2c3ed794) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:11.419165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb7566-6d5a-487c-92c5-84924e1b846a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:11.420991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb7566-6d5a-487c-92c5-84924e1b846a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:11.430944 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2455/4932] 10.222.0.39 () {58 vars in 1207 bytes} [Sun Oct 16 01:24:11 2022] GET /identity/v3/roles?domain_id=915b33b278fe4c6caeec4afa2c3ed794 => generated 148 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:11.432288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2ce7d-dedd-485e-b7a9-737c670137c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:11.444827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2ce7d-dedd-485e-b7a9-737c670137c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:11.453371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e78305-ab31-497d-99b9-9cbf216bb523 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:11.454085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e78305-ab31-497d-99b9-9cbf216bb523 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:11.454559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e78305-ab31-497d-99b9-9cbf216bb523 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:11.454904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e78305-ab31-497d-99b9-9cbf216bb523 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/19e39ba3a6ab4b4780bc164f90eae8c2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:11.477420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e78305-ab31-497d-99b9-9cbf216bb523 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-52e78305-ab31-497d-99b9-9cbf216bb523 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Could not find role: 19e39ba3a6ab4b4780bc164f90eae8c2.: keystone.exception.RoleNotFound: Could not find role: 19e39ba3a6ab4b4780bc164f90eae8c2. Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 16 01:24:11.487208 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:24:11.488711 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:24:11.489882 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:24:11.489882 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:24:11.489882 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:24:11.489882 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:24:11.489882 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 01:24:11.489882 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 01:24:11.489882 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 01:24:11.489882 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 01:24:11.489882 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 01:24:11.489882 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 01:24:11.489882 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 19e39ba3a6ab4b4780bc164f90eae8c2. Oct 16 01:24:11.489882 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:11.492471 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2478/4933] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:11 2022] DELETE /identity/v3/roles/19e39ba3a6ab4b4780bc164f90eae8c2 => generated 110 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:24:11.499619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb7566-6d5a-487c-92c5-84924e1b846a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:11.517283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb7566-6d5a-487c-92c5-84924e1b846a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:11.521970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665408b-9bb4-433e-a7ee-018d09996126 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:11.522749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665408b-9bb4-433e-a7ee-018d09996126 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:11.523073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665408b-9bb4-433e-a7ee-018d09996126 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:11.524543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665408b-9bb4-433e-a7ee-018d09996126 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:11.536839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665408b-9bb4-433e-a7ee-018d09996126 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=915b33b278fe4c6caeec4afa2c3ed794, group_id=5629a45db6b445ccb96bf56de732c8ac, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:11.540358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665408b-9bb4-433e-a7ee-018d09996126 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:11.564391 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2456/4934] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:11 2022] PUT /identity/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:11.565581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e78305-ab31-497d-99b9-9cbf216bb523 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:11.579972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e78305-ab31-497d-99b9-9cbf216bb523 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:11.674276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cd765-121b-4bfc-9fce-b505963c1663 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:11.675176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cd765-121b-4bfc-9fce-b505963c1663 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:11.675461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cd765-121b-4bfc-9fce-b505963c1663 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:11.675844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cd765-121b-4bfc-9fce-b505963c1663 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/groups/5629a45db6b445ccb96bf56de732c8ac/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:11.679503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cd765-121b-4bfc-9fce-b505963c1663 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=915b33b278fe4c6caeec4afa2c3ed794, group_id=5629a45db6b445ccb96bf56de732c8ac)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:11.682011 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-fa3cd765-121b-4bfc-9fce-b505963c1663 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:11.682011 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:24:11.682011 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:24:11.684509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cd765-121b-4bfc-9fce-b505963c1663 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:11.699384 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2479/4935] 10.222.0.39 () {58 vars in 1365 bytes} [Sun Oct 16 01:24:11 2022] GET /identity/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/groups/5629a45db6b445ccb96bf56de732c8ac/roles => generated 410 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:11.703570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665408b-9bb4-433e-a7ee-018d09996126 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:11.717610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665408b-9bb4-433e-a7ee-018d09996126 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:11.735246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188cc8e-60df-4aea-8464-1ace50d30573 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:11.735931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188cc8e-60df-4aea-8464-1ace50d30573 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:11.736215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188cc8e-60df-4aea-8464-1ace50d30573 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:11.736611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188cc8e-60df-4aea-8464-1ace50d30573 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:11.738889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188cc8e-60df-4aea-8464-1ace50d30573 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=915b33b278fe4c6caeec4afa2c3ed794, group_id=5629a45db6b445ccb96bf56de732c8ac, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:11.741595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188cc8e-60df-4aea-8464-1ace50d30573 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:11.748471 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2457/4936] 10.222.0.39 () {58 vars in 1465 bytes} [Sun Oct 16 01:24:11 2022] HEAD /identity/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:11.752595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cd765-121b-4bfc-9fce-b505963c1663 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:11.770592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cd765-121b-4bfc-9fce-b505963c1663 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:11.777045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec08843-8f9d-4e27-b207-d0a62c3feeaf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:11.777959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec08843-8f9d-4e27-b207-d0a62c3feeaf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:11.778547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec08843-8f9d-4e27-b207-d0a62c3feeaf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:11.779387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec08843-8f9d-4e27-b207-d0a62c3feeaf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:11.783332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec08843-8f9d-4e27-b207-d0a62c3feeaf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=915b33b278fe4c6caeec4afa2c3ed794, group_id=5629a45db6b445ccb96bf56de732c8ac, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:11.787252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec08843-8f9d-4e27-b207-d0a62c3feeaf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:11.796836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fec08843-8f9d-4e27-b207-d0a62c3feeaf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role 3125a62a25b74470a53a557e86216cd8 was removed from group 5629a45db6b445ccb96bf56de732c8ac on domain 915b33b278fe4c6caeec4afa2c3ed794. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:11.797179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fec08843-8f9d-4e27-b207-d0a62c3feeaf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:11.797923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fec08843-8f9d-4e27-b207-d0a62c3feeaf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:11.840945 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2480/4937] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Oct 16 01:24:11 2022] DELETE /identity/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:11.842314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188cc8e-60df-4aea-8464-1ace50d30573 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:11.846198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0188cc8e-60df-4aea-8464-1ace50d30573 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:11.865795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188cc8e-60df-4aea-8464-1ace50d30573 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:12.000833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19097a2-e895-48a5-92a8-4a40acbbb2fb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:12.003602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19097a2-e895-48a5-92a8-4a40acbbb2fb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:12.003891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19097a2-e895-48a5-92a8-4a40acbbb2fb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:12.004170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19097a2-e895-48a5-92a8-4a40acbbb2fb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects/939ef2cea14f440ea9a4171080487e01/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:12.007126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19097a2-e895-48a5-92a8-4a40acbbb2fb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_grant(project_id=939ef2cea14f440ea9a4171080487e01, group_id=5629a45db6b445ccb96bf56de732c8ac, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:12.013214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19097a2-e895-48a5-92a8-4a40acbbb2fb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:12.052554 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2458/4938] 10.222.0.39 () {60 vars in 1486 bytes} [Sun Oct 16 01:24:11 2022] PUT /identity/v3/projects/939ef2cea14f440ea9a4171080487e01/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:12.056763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec08843-8f9d-4e27-b207-d0a62c3feeaf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:12.072347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec08843-8f9d-4e27-b207-d0a62c3feeaf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:12.158943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40126389-76af-40fc-bd3a-c574d69bd665 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:12.159818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126389-76af-40fc-bd3a-c574d69bd665 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:12.160268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126389-76af-40fc-bd3a-c574d69bd665 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:12.160698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126389-76af-40fc-bd3a-c574d69bd665 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects/939ef2cea14f440ea9a4171080487e01/groups/5629a45db6b445ccb96bf56de732c8ac/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:12.163460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40126389-76af-40fc-bd3a-c574d69bd665 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_grants(project_id=939ef2cea14f440ea9a4171080487e01, group_id=5629a45db6b445ccb96bf56de732c8ac)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:12.166936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40126389-76af-40fc-bd3a-c574d69bd665 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:12.169564 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:12.188726 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2481/4939] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Oct 16 01:24:12 2022] GET /identity/v3/projects/939ef2cea14f440ea9a4171080487e01/groups/5629a45db6b445ccb96bf56de732c8ac/roles => generated 411 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:12.193725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19097a2-e895-48a5-92a8-4a40acbbb2fb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:12.210268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19097a2-e895-48a5-92a8-4a40acbbb2fb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:12.220790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18593f1-93d1-418c-8855-b63c7ae33b5d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:12.221725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18593f1-93d1-418c-8855-b63c7ae33b5d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:12.222905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18593f1-93d1-418c-8855-b63c7ae33b5d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:12.223290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18593f1-93d1-418c-8855-b63c7ae33b5d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/groups/5629a45db6b445ccb96bf56de732c8ac/users/82980c93ebd5482d9d1f4a4be46a8842` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:12.225612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18593f1-93d1-418c-8855-b63c7ae33b5d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=5629a45db6b445ccb96bf56de732c8ac, user_id=82980c93ebd5482d9d1f4a4be46a8842)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:12.229439 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-b18593f1-93d1-418c-8855-b63c7ae33b5d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:12.229439 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:12.229439 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:12.231732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18593f1-93d1-418c-8855-b63c7ae33b5d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:12.266014 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2459/4940] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Oct 16 01:24:12 2022] PUT /identity/v3/groups/5629a45db6b445ccb96bf56de732c8ac/users/82980c93ebd5482d9d1f4a4be46a8842 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:12.270193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f551f6-b002-4501-8e65-c51ffe1f3b66 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:12.270483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f551f6-b002-4501-8e65-c51ffe1f3b66 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:12.270848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f551f6-b002-4501-8e65-c51ffe1f3b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:12.322942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-61f551f6-b002-4501-8e65-c51ffe1f3b66 None None] MFA Rules not processed for user `82980c93ebd5482d9d1f4a4be46a8842`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:12.322942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-61f551f6-b002-4501-8e65-c51ffe1f3b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:12.423591 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2482/4941] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:12 2022] POST /identity/v3/auth/tokens => generated 3265 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:12.428243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18593f1-93d1-418c-8855-b63c7ae33b5d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:12.475348 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:12.495349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18593f1-93d1-418c-8855-b63c7ae33b5d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:12.500634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eddb39-a24a-4dea-b763-df512d2304f4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:12.501305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eddb39-a24a-4dea-b763-df512d2304f4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:12.501584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eddb39-a24a-4dea-b763-df512d2304f4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:12.501858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eddb39-a24a-4dea-b763-df512d2304f4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects/939ef2cea14f440ea9a4171080487e01/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:12.504429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eddb39-a24a-4dea-b763-df512d2304f4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:check_grant(project_id=939ef2cea14f440ea9a4171080487e01, group_id=5629a45db6b445ccb96bf56de732c8ac, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:12.507383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eddb39-a24a-4dea-b763-df512d2304f4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:12.514620 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2460/4942] 10.222.0.39 () {58 vars in 1468 bytes} [Sun Oct 16 01:24:12 2022] HEAD /identity/v3/projects/939ef2cea14f440ea9a4171080487e01/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:12.518726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f551f6-b002-4501-8e65-c51ffe1f3b66 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:12.531442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f551f6-b002-4501-8e65-c51ffe1f3b66 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:12.536215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424cc0d-ff93-4c2a-b869-56ef0a0662f8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:12.536869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424cc0d-ff93-4c2a-b869-56ef0a0662f8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:12.537145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424cc0d-ff93-4c2a-b869-56ef0a0662f8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:12.537446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424cc0d-ff93-4c2a-b869-56ef0a0662f8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects/939ef2cea14f440ea9a4171080487e01/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:12.540902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424cc0d-ff93-4c2a-b869-56ef0a0662f8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=939ef2cea14f440ea9a4171080487e01, group_id=5629a45db6b445ccb96bf56de732c8ac, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:12.549779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424cc0d-ff93-4c2a-b869-56ef0a0662f8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:12.549779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a424cc0d-ff93-4c2a-b869-56ef0a0662f8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role 3125a62a25b74470a53a557e86216cd8 was removed from group 5629a45db6b445ccb96bf56de732c8ac on project 939ef2cea14f440ea9a4171080487e01. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:12.550077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a424cc0d-ff93-4c2a-b869-56ef0a0662f8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:12.550770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a424cc0d-ff93-4c2a-b869-56ef0a0662f8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:12.568543 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2483/4943] 10.222.0.39 () {58 vars in 1470 bytes} [Sun Oct 16 01:24:12 2022] DELETE /identity/v3/projects/939ef2cea14f440ea9a4171080487e01/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:12.572807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eddb39-a24a-4dea-b763-df512d2304f4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:12.574569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-50eddb39-a24a-4dea-b763-df512d2304f4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:12.592900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eddb39-a24a-4dea-b763-df512d2304f4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:12.654957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278674c-e794-4a1f-a67d-425dc3662586 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:12.654957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278674c-e794-4a1f-a67d-425dc3662586 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:12.654957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278674c-e794-4a1f-a67d-425dc3662586 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:12.655399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278674c-e794-4a1f-a67d-425dc3662586 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/groups/5629a45db6b445ccb96bf56de732c8ac/users/82980c93ebd5482d9d1f4a4be46a8842` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:12.656264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278674c-e794-4a1f-a67d-425dc3662586 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=5629a45db6b445ccb96bf56de732c8ac, user_id=82980c93ebd5482d9d1f4a4be46a8842)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:12.657308 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-3278674c-e794-4a1f-a67d-425dc3662586 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:12.657308 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:12.657308 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:12.658690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278674c-e794-4a1f-a67d-425dc3662586 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:12.672478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3278674c-e794-4a1f-a67d-425dc3662586 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '82980c93ebd5482d9d1f4a4be46a8842'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:12.692458 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2461/4944] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Oct 16 01:24:12 2022] DELETE /identity/v3/groups/5629a45db6b445ccb96bf56de732c8ac/users/82980c93ebd5482d9d1f4a4be46a8842 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:12.697927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424cc0d-ff93-4c2a-b869-56ef0a0662f8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:12.708536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424cc0d-ff93-4c2a-b869-56ef0a0662f8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:12.768563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0ad3e-c902-4121-8a09-b20fdb814b67 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:12.769244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0ad3e-c902-4121-8a09-b20fdb814b67 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:12.769552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0ad3e-c902-4121-8a09-b20fdb814b67 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:12.769833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0ad3e-c902-4121-8a09-b20fdb814b67 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/system/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:12.771536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0ad3e-c902-4121-8a09-b20fdb814b67 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=5629a45db6b445ccb96bf56de732c8ac, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:12.772554 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-f0a0ad3e-c902-4121-8a09-b20fdb814b67 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:12.772554 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:24:12.772554 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:24:12.773788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0ad3e-c902-4121-8a09-b20fdb814b67 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:12.781503 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2484/4945] 10.222.0.39 () {60 vars in 1381 bytes} [Sun Oct 16 01:24:12 2022] PUT /identity/v3/system/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:12.785531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278674c-e794-4a1f-a67d-425dc3662586 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:12.796801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278674c-e794-4a1f-a67d-425dc3662586 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:12.803612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af65e97-aa2b-4e35-8a8a-a405c26eb786 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:12.804259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af65e97-aa2b-4e35-8a8a-a405c26eb786 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:12.805234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af65e97-aa2b-4e35-8a8a-a405c26eb786 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:12.806356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af65e97-aa2b-4e35-8a8a-a405c26eb786 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/system/groups/5629a45db6b445ccb96bf56de732c8ac/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:12.807659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af65e97-aa2b-4e35-8a8a-a405c26eb786 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=5629a45db6b445ccb96bf56de732c8ac)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:12.808639 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-2af65e97-aa2b-4e35-8a8a-a405c26eb786 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:12.808639 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:12.808639 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:12.809520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af65e97-aa2b-4e35-8a8a-a405c26eb786 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:12.823886 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2462/4946] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:24:12 2022] GET /identity/v3/system/groups/5629a45db6b445ccb96bf56de732c8ac/roles => generated 376 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:12.827895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0ad3e-c902-4121-8a09-b20fdb814b67 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:12.838385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0ad3e-c902-4121-8a09-b20fdb814b67 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:12.843053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c287dbb-c4bd-431e-b6d2-9b4afc61be46 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:12.843698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c287dbb-c4bd-431e-b6d2-9b4afc61be46 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:12.843978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c287dbb-c4bd-431e-b6d2-9b4afc61be46 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:12.844250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c287dbb-c4bd-431e-b6d2-9b4afc61be46 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/system/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:12.846241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c287dbb-c4bd-431e-b6d2-9b4afc61be46 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=5629a45db6b445ccb96bf56de732c8ac, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:12.847287 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-9c287dbb-c4bd-431e-b6d2-9b4afc61be46 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:12.847287 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:24:12.847287 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:24:12.848170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c287dbb-c4bd-431e-b6d2-9b4afc61be46 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:12.855602 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2485/4947] 10.222.0.39 () {58 vars in 1363 bytes} [Sun Oct 16 01:24:12 2022] HEAD /identity/v3/system/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:12.859721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af65e97-aa2b-4e35-8a8a-a405c26eb786 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:12.870314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af65e97-aa2b-4e35-8a8a-a405c26eb786 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:12.875274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af79ac8-805e-48db-8150-4ab676a07365 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:12.875927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af79ac8-805e-48db-8150-4ab676a07365 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:12.876215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af79ac8-805e-48db-8150-4ab676a07365 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:12.876489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af79ac8-805e-48db-8150-4ab676a07365 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/system/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:12.878271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af79ac8-805e-48db-8150-4ab676a07365 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=5629a45db6b445ccb96bf56de732c8ac, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:12.879326 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-0af79ac8-805e-48db-8150-4ab676a07365 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:12.879326 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:12.879326 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:12.880200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af79ac8-805e-48db-8150-4ab676a07365 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:12.889512 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2463/4948] 10.222.0.39 () {58 vars in 1365 bytes} [Sun Oct 16 01:24:12 2022] DELETE /identity/v3/system/groups/5629a45db6b445ccb96bf56de732c8ac/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:12.894728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c287dbb-c4bd-431e-b6d2-9b4afc61be46 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:12.904806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c287dbb-c4bd-431e-b6d2-9b4afc61be46 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:12.909448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9f0ea-cf20-4cea-bda5-74d019d5f841 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:12.910091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9f0ea-cf20-4cea-bda5-74d019d5f841 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:12.910373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9f0ea-cf20-4cea-bda5-74d019d5f841 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:12.910651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9f0ea-cf20-4cea-bda5-74d019d5f841 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:12.912896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9f0ea-cf20-4cea-bda5-74d019d5f841 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=915b33b278fe4c6caeec4afa2c3ed794, user_id=82980c93ebd5482d9d1f4a4be46a8842, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:12.916103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9f0ea-cf20-4cea-bda5-74d019d5f841 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:12.931920 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2486/4949] 10.222.0.39 () {60 vars in 1480 bytes} [Sun Oct 16 01:24:12 2022] PUT /identity/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:12.935953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af79ac8-805e-48db-8150-4ab676a07365 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:12.947133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af79ac8-805e-48db-8150-4ab676a07365 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:13.021215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd25ee1-0063-4720-8ab0-eafde64865bd tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:13.021870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd25ee1-0063-4720-8ab0-eafde64865bd tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:13.022149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd25ee1-0063-4720-8ab0-eafde64865bd tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:13.022420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd25ee1-0063-4720-8ab0-eafde64865bd tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/users/82980c93ebd5482d9d1f4a4be46a8842/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:13.024579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd25ee1-0063-4720-8ab0-eafde64865bd tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=915b33b278fe4c6caeec4afa2c3ed794, user_id=82980c93ebd5482d9d1f4a4be46a8842)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:13.027102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd25ee1-0063-4720-8ab0-eafde64865bd tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:13.040632 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2464/4950] 10.222.0.39 () {58 vars in 1362 bytes} [Sun Oct 16 01:24:12 2022] GET /identity/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/users/82980c93ebd5482d9d1f4a4be46a8842/roles => generated 409 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:13.044723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9f0ea-cf20-4cea-bda5-74d019d5f841 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:13.057861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9f0ea-cf20-4cea-bda5-74d019d5f841 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:13.062768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a4418-17d7-4a15-bb00-0cc544be865e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:13.063543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a4418-17d7-4a15-bb00-0cc544be865e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:13.063828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a4418-17d7-4a15-bb00-0cc544be865e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:13.064104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a4418-17d7-4a15-bb00-0cc544be865e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:13.066371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a4418-17d7-4a15-bb00-0cc544be865e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=915b33b278fe4c6caeec4afa2c3ed794, user_id=82980c93ebd5482d9d1f4a4be46a8842, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:13.069051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a4418-17d7-4a15-bb00-0cc544be865e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:13.071685 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:13.079462 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2487/4951] 10.222.0.39 () {58 vars in 1462 bytes} [Sun Oct 16 01:24:13 2022] HEAD /identity/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:13.081412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd25ee1-0063-4720-8ab0-eafde64865bd tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:13.092875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd25ee1-0063-4720-8ab0-eafde64865bd tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:13.098397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8ae2b-827e-4f6d-a4ef-34a6dc02b166 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:13.099595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8ae2b-827e-4f6d-a4ef-34a6dc02b166 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:13.099595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8ae2b-827e-4f6d-a4ef-34a6dc02b166 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:13.099787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8ae2b-827e-4f6d-a4ef-34a6dc02b166 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:13.102848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8ae2b-827e-4f6d-a4ef-34a6dc02b166 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=915b33b278fe4c6caeec4afa2c3ed794, user_id=82980c93ebd5482d9d1f4a4be46a8842, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:13.106653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8ae2b-827e-4f6d-a4ef-34a6dc02b166 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:13.111782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a4a8ae2b-827e-4f6d-a4ef-34a6dc02b166 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role 3125a62a25b74470a53a557e86216cd8 was removed from user 82980c93ebd5482d9d1f4a4be46a8842 on domain 915b33b278fe4c6caeec4afa2c3ed794. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:13.112145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a4a8ae2b-827e-4f6d-a4ef-34a6dc02b166 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:13.112969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a4a8ae2b-827e-4f6d-a4ef-34a6dc02b166 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:13.132901 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2465/4952] 10.222.0.39 () {58 vars in 1464 bytes} [Sun Oct 16 01:24:13 2022] DELETE /identity/v3/domains/915b33b278fe4c6caeec4afa2c3ed794/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:13.134196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a4418-17d7-4a15-bb00-0cc544be865e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:13.136123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c02a4418-17d7-4a15-bb00-0cc544be865e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:13.151117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a4418-17d7-4a15-bb00-0cc544be865e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:13.219844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88794315-5adf-4830-a872-0951d53e57e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:13.220667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88794315-5adf-4830-a872-0951d53e57e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:13.221580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88794315-5adf-4830-a872-0951d53e57e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:13.221960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88794315-5adf-4830-a872-0951d53e57e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:13.225063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88794315-5adf-4830-a872-0951d53e57e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_grant(project_id=939ef2cea14f440ea9a4171080487e01, user_id=82980c93ebd5482d9d1f4a4be46a8842, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:13.228816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88794315-5adf-4830-a872-0951d53e57e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:13.249771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8ae2b-827e-4f6d-a4ef-34a6dc02b166 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:13.251003 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2488/4953] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:13 2022] PUT /identity/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:13.263902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8ae2b-827e-4f6d-a4ef-34a6dc02b166 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:13.328590 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:13.464448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99531654-edda-4255-badf-34904881ac82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:13.465149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99531654-edda-4255-badf-34904881ac82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:13.465441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99531654-edda-4255-badf-34904881ac82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:13.465778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99531654-edda-4255-badf-34904881ac82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:13.469708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99531654-edda-4255-badf-34904881ac82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_grants(project_id=939ef2cea14f440ea9a4171080487e01, user_id=82980c93ebd5482d9d1f4a4be46a8842)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:13.477844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99531654-edda-4255-badf-34904881ac82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:13.511578 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2466/4954] 10.222.0.39 () {58 vars in 1365 bytes} [Sun Oct 16 01:24:13 2022] GET /identity/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles => generated 410 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:13.512299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88794315-5adf-4830-a872-0951d53e57e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:13.525776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88794315-5adf-4830-a872-0951d53e57e0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:13.540426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e1b05-d275-4148-a7d8-d0fe7e512fea tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:13.540844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1b05-d275-4148-a7d8-d0fe7e512fea tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:13.541141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1b05-d275-4148-a7d8-d0fe7e512fea tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:13.541427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1b05-d275-4148-a7d8-d0fe7e512fea tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:13.546440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e1b05-d275-4148-a7d8-d0fe7e512fea tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:check_grant(project_id=939ef2cea14f440ea9a4171080487e01, user_id=82980c93ebd5482d9d1f4a4be46a8842, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:13.559509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e1b05-d275-4148-a7d8-d0fe7e512fea tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:13.589711 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2489/4955] 10.222.0.39 () {58 vars in 1465 bytes} [Sun Oct 16 01:24:13 2022] HEAD /identity/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:13.591171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99531654-edda-4255-badf-34904881ac82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:13.607035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99531654-edda-4255-badf-34904881ac82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:13.616869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20d09e-0b42-4f34-85e5-d6a9bc79858e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:13.618793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20d09e-0b42-4f34-85e5-d6a9bc79858e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:13.619325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20d09e-0b42-4f34-85e5-d6a9bc79858e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:13.619818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20d09e-0b42-4f34-85e5-d6a9bc79858e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:13.626078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20d09e-0b42-4f34-85e5-d6a9bc79858e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=939ef2cea14f440ea9a4171080487e01, user_id=82980c93ebd5482d9d1f4a4be46a8842, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:13.632006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20d09e-0b42-4f34-85e5-d6a9bc79858e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:13.649897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb20d09e-0b42-4f34-85e5-d6a9bc79858e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role 3125a62a25b74470a53a557e86216cd8 was removed from user 82980c93ebd5482d9d1f4a4be46a8842 on project 939ef2cea14f440ea9a4171080487e01. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:13.650525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb20d09e-0b42-4f34-85e5-d6a9bc79858e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:13.651590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bb20d09e-0b42-4f34-85e5-d6a9bc79858e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:13.685674 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2467/4956] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Oct 16 01:24:13 2022] DELETE /identity/v3/projects/939ef2cea14f440ea9a4171080487e01/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:13.686644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e1b05-d275-4148-a7d8-d0fe7e512fea tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:13.688558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-107e1b05-d275-4148-a7d8-d0fe7e512fea tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:13.725752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e1b05-d275-4148-a7d8-d0fe7e512fea tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:14.000242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07270b55-3489-4472-a111-ea761866bc4c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:14.000917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07270b55-3489-4472-a111-ea761866bc4c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:14.001204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07270b55-3489-4472-a111-ea761866bc4c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:14.001485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07270b55-3489-4472-a111-ea761866bc4c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/system/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:14.008019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07270b55-3489-4472-a111-ea761866bc4c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=82980c93ebd5482d9d1f4a4be46a8842, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:14.010202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07270b55-3489-4472-a111-ea761866bc4c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:14.026182 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2490/4957] 10.222.0.39 () {60 vars in 1378 bytes} [Sun Oct 16 01:24:13 2022] PUT /identity/v3/system/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:14.030195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20d09e-0b42-4f34-85e5-d6a9bc79858e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:14.046830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20d09e-0b42-4f34-85e5-d6a9bc79858e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:14.057176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978856c4-c6d6-4dff-bbca-51bd185f49a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:14.057954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978856c4-c6d6-4dff-bbca-51bd185f49a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:14.061839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978856c4-c6d6-4dff-bbca-51bd185f49a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:14.062277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978856c4-c6d6-4dff-bbca-51bd185f49a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/system/users/82980c93ebd5482d9d1f4a4be46a8842/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:14.063743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978856c4-c6d6-4dff-bbca-51bd185f49a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=82980c93ebd5482d9d1f4a4be46a8842)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:14.064875 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-978856c4-c6d6-4dff-bbca-51bd185f49a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:14.064875 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:14.064875 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:14.072269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978856c4-c6d6-4dff-bbca-51bd185f49a7 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:14.095249 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2468/4958] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:24:14 2022] GET /identity/v3/system/users/82980c93ebd5482d9d1f4a4be46a8842/roles => generated 375 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:14.099142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07270b55-3489-4472-a111-ea761866bc4c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:14.106542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70966-1237-4b53-b8c3-fe924eae1058 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:14.106738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70966-1237-4b53-b8c3-fe924eae1058 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:14.107026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70966-1237-4b53-b8c3-fe924eae1058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:14.126161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07270b55-3489-4472-a111-ea761866bc4c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:14.140942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f044f-af47-46a6-a6a6-c7a7b96f427a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:14.142372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f044f-af47-46a6-a6a6-c7a7b96f427a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:14.142372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f044f-af47-46a6-a6a6-c7a7b96f427a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:14.142372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f044f-af47-46a6-a6a6-c7a7b96f427a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/system/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:14.144997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f044f-af47-46a6-a6a6-c7a7b96f427a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=82980c93ebd5482d9d1f4a4be46a8842, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:14.150278 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-181f044f-af47-46a6-a6a6-c7a7b96f427a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:14.150278 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:24:14.150278 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:24:14.151263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f044f-af47-46a6-a6a6-c7a7b96f427a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:14.167048 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2491/4959] 10.222.0.39 () {58 vars in 1360 bytes} [Sun Oct 16 01:24:14 2022] HEAD /identity/v3/system/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:14.171276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f044f-af47-46a6-a6a6-c7a7b96f427a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:14.189504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f044f-af47-46a6-a6a6-c7a7b96f427a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:14.205943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e43661-c610-4271-a401-f45040ddd95f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:14.206952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e43661-c610-4271-a401-f45040ddd95f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:14.207261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e43661-c610-4271-a401-f45040ddd95f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:14.207563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e43661-c610-4271-a401-f45040ddd95f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/system/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:14.213552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e43661-c610-4271-a401-f45040ddd95f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=82980c93ebd5482d9d1f4a4be46a8842, role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:14.214680 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-e4e43661-c610-4271-a401-f45040ddd95f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:14.214680 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:24:14.214680 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:24:14.216050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e43661-c610-4271-a401-f45040ddd95f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:14.236090 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2492/4960] 10.222.0.39 () {58 vars in 1362 bytes} [Sun Oct 16 01:24:14 2022] DELETE /identity/v3/system/users/82980c93ebd5482d9d1f4a4be46a8842/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:14.238166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e43661-c610-4271-a401-f45040ddd95f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:14.249035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bee70966-1237-4b53-b8c3-fe924eae1058 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:14.250271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bee70966-1237-4b53-b8c3-fe924eae1058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:14.258769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e43661-c610-4271-a401-f45040ddd95f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:14.270064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62c11b-c188-41be-8fb4-06231ba55934 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:14.270694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62c11b-c188-41be-8fb4-06231ba55934 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:14.271002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62c11b-c188-41be-8fb4-06231ba55934 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:14.271875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62c11b-c188-41be-8fb4-06231ba55934 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:14.275158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62c11b-c188-41be-8fb4-06231ba55934 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:14.276803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62c11b-c188-41be-8fb4-06231ba55934 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:14.313833 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2493/4961] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:24:14 2022] POST /identity/v3/roles => generated 269 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:14.315076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62c11b-c188-41be-8fb4-06231ba55934 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:14.340272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62c11b-c188-41be-8fb4-06231ba55934 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:14.351937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c84b10-19ee-4c96-97bc-1a5c37aee726 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:14.353850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c84b10-19ee-4c96-97bc-1a5c37aee726 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:14.354129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c84b10-19ee-4c96-97bc-1a5c37aee726 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:14.354402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c84b10-19ee-4c96-97bc-1a5c37aee726 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:14.355983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c84b10-19ee-4c96-97bc-1a5c37aee726 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:14.357941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c84b10-19ee-4c96-97bc-1a5c37aee726 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:14.396826 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2494/4962] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:24:14 2022] POST /identity/v3/roles => generated 269 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:14.397581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c84b10-19ee-4c96-97bc-1a5c37aee726 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:14.412293 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2469/4963] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:24:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:14.416240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c84b10-19ee-4c96-97bc-1a5c37aee726 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:14.423138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bacf45-8b1b-46b0-82e7-cff4bb3c0423 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:14.423890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bacf45-8b1b-46b0-82e7-cff4bb3c0423 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:14.424273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bacf45-8b1b-46b0-82e7-cff4bb3c0423 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:14.424645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bacf45-8b1b-46b0-82e7-cff4bb3c0423 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584/implies/f98d2228210541bd80f7bb9945e27ddc` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:14.433954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bacf45-8b1b-46b0-82e7-cff4bb3c0423 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=db4b1bc40ea84d59a0bdf904ff0b7584, implied_role_id=f98d2228210541bd80f7bb9945e27ddc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:14.435976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bacf45-8b1b-46b0-82e7-cff4bb3c0423 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:14.499644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee70966-1237-4b53-b8c3-fe924eae1058 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:14.501536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bee70966-1237-4b53-b8c3-fe924eae1058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:14.518396 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2495/4964] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Oct 16 01:24:14 2022] PUT /identity/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584/implies/f98d2228210541bd80f7bb9945e27ddc => generated 529 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:14.524883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bacf45-8b1b-46b0-82e7-cff4bb3c0423 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:14.569387 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:14.641314 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:14.729762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bacf45-8b1b-46b0-82e7-cff4bb3c0423 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:14.765376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d418f1-4e99-4c35-9ec1-77845b4e0bfb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:14.766035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d418f1-4e99-4c35-9ec1-77845b4e0bfb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:14.766319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d418f1-4e99-4c35-9ec1-77845b4e0bfb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:14.766597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d418f1-4e99-4c35-9ec1-77845b4e0bfb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:14.768422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d418f1-4e99-4c35-9ec1-77845b4e0bfb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:14.776013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d418f1-4e99-4c35-9ec1-77845b4e0bfb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:14.800280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee70966-1237-4b53-b8c3-fe924eae1058 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:14.827235 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2496/4965] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:24:14 2022] POST /identity/v3/domains => generated 276 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:14.833044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d418f1-4e99-4c35-9ec1-77845b4e0bfb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:14.995624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae88ae2-bf57-4280-86bd-e3e88911b589 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:14.996264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae88ae2-bf57-4280-86bd-e3e88911b589 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:14.996542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae88ae2-bf57-4280-86bd-e3e88911b589 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:14.996814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae88ae2-bf57-4280-86bd-e3e88911b589 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:15.002376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d418f1-4e99-4c35-9ec1-77845b4e0bfb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:15.016218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0022c9-8c42-4b03-af77-bf352722405b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:15.020636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0022c9-8c42-4b03-af77-bf352722405b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:15.022007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0022c9-8c42-4b03-af77-bf352722405b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:15.024607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0022c9-8c42-4b03-af77-bf352722405b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:15.024607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0022c9-8c42-4b03-af77-bf352722405b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:15.026605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0022c9-8c42-4b03-af77-bf352722405b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:15.060518 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2497/4966] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:24:14 2022] POST /identity/v3/roles => generated 270 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:15.073316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0022c9-8c42-4b03-af77-bf352722405b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:15.098517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0022c9-8c42-4b03-af77-bf352722405b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:15.111707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c8cc6-957e-4ef1-98ba-9ef9fcebac80 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:15.115152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c8cc6-957e-4ef1-98ba-9ef9fcebac80 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:15.116687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c8cc6-957e-4ef1-98ba-9ef9fcebac80 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:15.117256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c8cc6-957e-4ef1-98ba-9ef9fcebac80 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584/implies/0e02076b2a3a440e88f0551f7cf79338` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:15.121794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c8cc6-957e-4ef1-98ba-9ef9fcebac80 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=db4b1bc40ea84d59a0bdf904ff0b7584, implied_role_id=0e02076b2a3a440e88f0551f7cf79338)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:15.124645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c8cc6-957e-4ef1-98ba-9ef9fcebac80 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:15.187885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae88ae2-bf57-4280-86bd-e3e88911b589 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:15.189554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae88ae2-bf57-4280-86bd-e3e88911b589 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:15.205829 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2498/4967] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Oct 16 01:24:15 2022] PUT /identity/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584/implies/0e02076b2a3a440e88f0551f7cf79338 => generated 530 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:15.208096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c8cc6-957e-4ef1-98ba-9ef9fcebac80 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:15.219148 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2470/4968] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:24:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 720 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:24:15.430244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c8cc6-957e-4ef1-98ba-9ef9fcebac80 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:15.441902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bf8bc-04d3-45cd-bf68-2cbb633cd955 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:15.447032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bf8bc-04d3-45cd-bf68-2cbb633cd955 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:15.447455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bf8bc-04d3-45cd-bf68-2cbb633cd955 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:15.447862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bf8bc-04d3-45cd-bf68-2cbb633cd955 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584/implies/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:15.450842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bf8bc-04d3-45cd-bf68-2cbb633cd955 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=db4b1bc40ea84d59a0bdf904ff0b7584, implied_role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:15.453266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bf8bc-04d3-45cd-bf68-2cbb633cd955 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:15.489499 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:15.513379 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2499/4969] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Oct 16 01:24:15 2022] PUT /identity/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584/implies/3125a62a25b74470a53a557e86216cd8 => generated 525 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:15.514570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae88ae2-bf57-4280-86bd-e3e88911b589 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:15.533693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae88ae2-bf57-4280-86bd-e3e88911b589 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:15.771817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184a319-2b12-4a35-b6e0-5812c9c9ed16 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:15.772504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184a319-2b12-4a35-b6e0-5812c9c9ed16 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:15.772781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184a319-2b12-4a35-b6e0-5812c9c9ed16 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:15.773050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184a319-2b12-4a35-b6e0-5812c9c9ed16 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/3125a62a25b74470a53a557e86216cd8/implies/db4b1bc40ea84d59a0bdf904ff0b7584` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:15.781019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184a319-2b12-4a35-b6e0-5812c9c9ed16 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3125a62a25b74470a53a557e86216cd8, implied_role_id=db4b1bc40ea84d59a0bdf904ff0b7584)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:15.782073 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-a184a319-2b12-4a35-b6e0-5812c9c9ed16 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:15.782073 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:15.782073 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:15.782993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184a319-2b12-4a35-b6e0-5812c9c9ed16 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:15.838395 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-a184a319-2b12-4a35-b6e0-5812c9c9ed16 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] db4b1bc40ea84d59a0bdf904ff0b7584 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: db4b1bc40ea84d59a0bdf904ff0b7584 cannot be an implied roles. Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 16 01:24:15.876403 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 16 01:24:15.877638 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:24:15.877638 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:24:15.877638 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 16 01:24:15.877638 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 16 01:24:15.877638 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: db4b1bc40ea84d59a0bdf904ff0b7584 cannot be an implied roles. Oct 16 01:24:15.877638 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:15.891466 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2471/4970] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Oct 16 01:24:15 2022] PUT /identity/v3/roles/3125a62a25b74470a53a557e86216cd8/implies/db4b1bc40ea84d59a0bdf904ff0b7584 => generated 116 bytes in 377 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:24:15.895194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bf8bc-04d3-45cd-bf68-2cbb633cd955 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:15.932692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bf8bc-04d3-45cd-bf68-2cbb633cd955 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:15.963423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60ea53-4c67-494e-9ba0-ff9361a91410 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:15.964011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60ea53-4c67-494e-9ba0-ff9361a91410 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:15.964292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60ea53-4c67-494e-9ba0-ff9361a91410 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:15.964569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60ea53-4c67-494e-9ba0-ff9361a91410 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584/implies/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:15.972327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60ea53-4c67-494e-9ba0-ff9361a91410 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=db4b1bc40ea84d59a0bdf904ff0b7584, implied_role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:15.973961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60ea53-4c67-494e-9ba0-ff9361a91410 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:15.994420 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2500/4971] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Oct 16 01:24:15 2022] DELETE /identity/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584/implies/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:15.998969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184a319-2b12-4a35-b6e0-5812c9c9ed16 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:16.020226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184a319-2b12-4a35-b6e0-5812c9c9ed16 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:16.232630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c4c33-5a6d-442b-a6ae-73a6f97a9df1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:16.233336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c4c33-5a6d-442b-a6ae-73a6f97a9df1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:16.233592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c4c33-5a6d-442b-a6ae-73a6f97a9df1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:16.233903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c4c33-5a6d-442b-a6ae-73a6f97a9df1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584/implies/0e02076b2a3a440e88f0551f7cf79338` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:16.237087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c4c33-5a6d-442b-a6ae-73a6f97a9df1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=db4b1bc40ea84d59a0bdf904ff0b7584, implied_role_id=0e02076b2a3a440e88f0551f7cf79338)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:16.238281 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-670c4c33-5a6d-442b-a6ae-73a6f97a9df1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:16.238281 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:16.238281 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:16.239386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c4c33-5a6d-442b-a6ae-73a6f97a9df1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:16.260126 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2472/4972] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Oct 16 01:24:15 2022] DELETE /identity/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584/implies/0e02076b2a3a440e88f0551f7cf79338 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:16.264170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60ea53-4c67-494e-9ba0-ff9361a91410 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:16.278410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60ea53-4c67-494e-9ba0-ff9361a91410 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:16.377237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222e72e-b516-4c51-8963-466029e2f53d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:16.378334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222e72e-b516-4c51-8963-466029e2f53d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:16.378696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222e72e-b516-4c51-8963-466029e2f53d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:16.379587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222e72e-b516-4c51-8963-466029e2f53d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/0e02076b2a3a440e88f0551f7cf79338` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:16.380625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222e72e-b516-4c51-8963-466029e2f53d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=0e02076b2a3a440e88f0551f7cf79338)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:16.383507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222e72e-b516-4c51-8963-466029e2f53d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:16.451118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f222e72e-b516-4c51-8963-466029e2f53d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role 0e02076b2a3a440e88f0551f7cf79338 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:16.451424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f222e72e-b516-4c51-8963-466029e2f53d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:16.454674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f222e72e-b516-4c51-8963-466029e2f53d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:16.459452 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2501/4973] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:16 2022] DELETE /identity/v3/roles/0e02076b2a3a440e88f0551f7cf79338 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:16.464110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c4c33-5a6d-442b-a6ae-73a6f97a9df1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:16.466961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-670c4c33-5a6d-442b-a6ae-73a6f97a9df1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:16.497753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c4c33-5a6d-442b-a6ae-73a6f97a9df1 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:16.615354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898bfe3-ee9d-4b52-9c6d-40a2e8dd5e0c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:16.616594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898bfe3-ee9d-4b52-9c6d-40a2e8dd5e0c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:16.617707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898bfe3-ee9d-4b52-9c6d-40a2e8dd5e0c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:16.618250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898bfe3-ee9d-4b52-9c6d-40a2e8dd5e0c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains/d0c7f5bf979a43e1a21cac73e626154c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:16.658458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898bfe3-ee9d-4b52-9c6d-40a2e8dd5e0c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d0c7f5bf979a43e1a21cac73e626154c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:16.660616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898bfe3-ee9d-4b52-9c6d-40a2e8dd5e0c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:16.720065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9898bfe3-ee9d-4b52-9c6d-40a2e8dd5e0c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd0c7f5bf979a43e1a21cac73e626154c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:16.722888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9898bfe3-ee9d-4b52-9c6d-40a2e8dd5e0c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd0c7f5bf979a43e1a21cac73e626154c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:16.816806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9898bfe3-ee9d-4b52-9c6d-40a2e8dd5e0c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd0c7f5bf979a43e1a21cac73e626154c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:16.817955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9898bfe3-ee9d-4b52-9c6d-40a2e8dd5e0c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd0c7f5bf979a43e1a21cac73e626154c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:16.827887 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2473/4974] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:24:16 2022] PATCH /identity/v3/domains/d0c7f5bf979a43e1a21cac73e626154c => generated 277 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:16.830214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222e72e-b516-4c51-8963-466029e2f53d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:16.846705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222e72e-b516-4c51-8963-466029e2f53d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:17.028822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:17.029527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:17.031497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:17.032332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains/d0c7f5bf979a43e1a21cac73e626154c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:17.048714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d0c7f5bf979a43e1a21cac73e626154c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:17.050534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:17.081872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd0c7f5bf979a43e1a21cac73e626154c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:17.100197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd0c7f5bf979a43e1a21cac73e626154c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:17.113982 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:17.202469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c7f5bf979a43e1a21cac73e626154c', 'request_id': 'req-e3b629ab-a18d-4ca6-82d4-e647ff658827'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:17.223111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c7f5bf979a43e1a21cac73e626154c', 'request_id': 'req-e3b629ab-a18d-4ca6-82d4-e647ff658827'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:17.246973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c7f5bf979a43e1a21cac73e626154c', 'request_id': 'req-e3b629ab-a18d-4ca6-82d4-e647ff658827'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:17.275793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] The token cache is being invalidate because project d0c7f5bf979a43e1a21cac73e626154c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:17.276178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:17.278251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:17.303781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd0c7f5bf979a43e1a21cac73e626154c', 'request_id': 'req-e3b629ab-a18d-4ca6-82d4-e647ff658827'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:17.305914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd0c7f5bf979a43e1a21cac73e626154c', 'request_id': 'req-e3b629ab-a18d-4ca6-82d4-e647ff658827'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:17.308776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd0c7f5bf979a43e1a21cac73e626154c', 'request_id': 'req-e3b629ab-a18d-4ca6-82d4-e647ff658827'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:17.328300 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2502/4975] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:24:16 2022] DELETE /identity/v3/domains/d0c7f5bf979a43e1a21cac73e626154c => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:17.332394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898bfe3-ee9d-4b52-9c6d-40a2e8dd5e0c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:17.334014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9898bfe3-ee9d-4b52-9c6d-40a2e8dd5e0c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:17.356639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898bfe3-ee9d-4b52-9c6d-40a2e8dd5e0c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:17.466627 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:17.494817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19504d8-154b-4934-b0a4-9eb404d8fe1a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:17.495690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19504d8-154b-4934-b0a4-9eb404d8fe1a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:17.495984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19504d8-154b-4934-b0a4-9eb404d8fe1a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:17.496270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19504d8-154b-4934-b0a4-9eb404d8fe1a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584/implies/f98d2228210541bd80f7bb9945e27ddc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:17.500115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19504d8-154b-4934-b0a4-9eb404d8fe1a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=db4b1bc40ea84d59a0bdf904ff0b7584, implied_role_id=f98d2228210541bd80f7bb9945e27ddc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:17.501933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19504d8-154b-4934-b0a4-9eb404d8fe1a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:17.530419 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2474/4976] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Oct 16 01:24:17 2022] DELETE /identity/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584/implies/f98d2228210541bd80f7bb9945e27ddc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:17.531795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:17.533382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:17.577854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b629ab-a18d-4ca6-82d4-e647ff658827 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:17.747112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ae90f-2626-48fe-a1fe-3d032d5b5b9b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:17.747768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae90f-2626-48fe-a1fe-3d032d5b5b9b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:17.748049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae90f-2626-48fe-a1fe-3d032d5b5b9b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:17.748322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae90f-2626-48fe-a1fe-3d032d5b5b9b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/f98d2228210541bd80f7bb9945e27ddc` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:17.756252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ae90f-2626-48fe-a1fe-3d032d5b5b9b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=f98d2228210541bd80f7bb9945e27ddc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:17.758137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ae90f-2626-48fe-a1fe-3d032d5b5b9b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:17.848664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-321ae90f-2626-48fe-a1fe-3d032d5b5b9b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role f98d2228210541bd80f7bb9945e27ddc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:17.849054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-321ae90f-2626-48fe-a1fe-3d032d5b5b9b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:17.849819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-321ae90f-2626-48fe-a1fe-3d032d5b5b9b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:17.852351 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2503/4977] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:17 2022] DELETE /identity/v3/roles/f98d2228210541bd80f7bb9945e27ddc => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:17.856154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19504d8-154b-4934-b0a4-9eb404d8fe1a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:17.859985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c19504d8-154b-4934-b0a4-9eb404d8fe1a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:17.879840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19504d8-154b-4934-b0a4-9eb404d8fe1a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:18.029115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16615f5a-276e-4a44-8337-5bbfdbec8b00 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:18.029775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16615f5a-276e-4a44-8337-5bbfdbec8b00 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:18.030054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16615f5a-276e-4a44-8337-5bbfdbec8b00 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:18.030325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16615f5a-276e-4a44-8337-5bbfdbec8b00 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:18.034755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16615f5a-276e-4a44-8337-5bbfdbec8b00 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=db4b1bc40ea84d59a0bdf904ff0b7584)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:18.035837 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-16615f5a-276e-4a44-8337-5bbfdbec8b00 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:18.035837 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:18.035837 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:18.036725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16615f5a-276e-4a44-8337-5bbfdbec8b00 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:18.136161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-16615f5a-276e-4a44-8337-5bbfdbec8b00 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role db4b1bc40ea84d59a0bdf904ff0b7584 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:18.136460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-16615f5a-276e-4a44-8337-5bbfdbec8b00 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:18.138103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-16615f5a-276e-4a44-8337-5bbfdbec8b00 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:18.141463 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2475/4978] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:17 2022] DELETE /identity/v3/roles/db4b1bc40ea84d59a0bdf904ff0b7584 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:18.146933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ae90f-2626-48fe-a1fe-3d032d5b5b9b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:18.162333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ae90f-2626-48fe-a1fe-3d032d5b5b9b tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:18.335936 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:18.360163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eefe6a-607e-4868-8bcf-aeac2c5c0ddf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:18.362029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eefe6a-607e-4868-8bcf-aeac2c5c0ddf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:18.363051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eefe6a-607e-4868-8bcf-aeac2c5c0ddf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:18.363391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eefe6a-607e-4868-8bcf-aeac2c5c0ddf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:18.373726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eefe6a-607e-4868-8bcf-aeac2c5c0ddf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:18.376649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eefe6a-607e-4868-8bcf-aeac2c5c0ddf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:18.476226 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2504/4979] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Oct 16 01:24:18 2022] PUT /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603 => generated 520 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:18.477691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16615f5a-276e-4a44-8337-5bbfdbec8b00 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:18.479309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-16615f5a-276e-4a44-8337-5bbfdbec8b00 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:18.497516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16615f5a-276e-4a44-8337-5bbfdbec8b00 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:18.652861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80da0a0-d105-4b59-a082-abc4fed7fb82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:18.653548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80da0a0-d105-4b59-a082-abc4fed7fb82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:18.653838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80da0a0-d105-4b59-a082-abc4fed7fb82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:18.654111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80da0a0-d105-4b59-a082-abc4fed7fb82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:18.656430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80da0a0-d105-4b59-a082-abc4fed7fb82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:18.657901 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-c80da0a0-d105-4b59-a082-abc4fed7fb82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:18.657901 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:18.657901 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:18.663136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80da0a0-d105-4b59-a082-abc4fed7fb82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:18.664745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80da0a0-d105-4b59-a082-abc4fed7fb82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:18.666317 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-c80da0a0-d105-4b59-a082-abc4fed7fb82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:18.666317 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:18.666317 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:18.667343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80da0a0-d105-4b59-a082-abc4fed7fb82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:18.683692 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2476/4980] 10.222.0.39 () {58 vars in 1345 bytes} [Sun Oct 16 01:24:18 2022] HEAD /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:18.684757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eefe6a-607e-4868-8bcf-aeac2c5c0ddf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:18.705617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eefe6a-607e-4868-8bcf-aeac2c5c0ddf tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:18.725891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d06f-896a-4985-a215-0f579c0c76c0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:18.735517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d06f-896a-4985-a215-0f579c0c76c0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:18.735758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d06f-896a-4985-a215-0f579c0c76c0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:18.736038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d06f-896a-4985-a215-0f579c0c76c0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:18.747563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d06f-896a-4985-a215-0f579c0c76c0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:18.748461 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-5211d06f-896a-4985-a215-0f579c0c76c0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:18.748461 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:24:18.748461 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:24:18.751968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d06f-896a-4985-a215-0f579c0c76c0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:18.771697 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2505/4981] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Oct 16 01:24:18 2022] GET /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603 => generated 520 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:18.772902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80da0a0-d105-4b59-a082-abc4fed7fb82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:18.792996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80da0a0-d105-4b59-a082-abc4fed7fb82 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:18.812600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7805ad-d92b-404b-abfc-2b438ef2866f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:18.813344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7805ad-d92b-404b-abfc-2b438ef2866f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:18.813627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7805ad-d92b-404b-abfc-2b438ef2866f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:18.813955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7805ad-d92b-404b-abfc-2b438ef2866f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:18.819694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7805ad-d92b-404b-abfc-2b438ef2866f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:18.822105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7805ad-d92b-404b-abfc-2b438ef2866f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:18.849015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d06f-896a-4985-a215-0f579c0c76c0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:18.859178 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2477/4982] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Oct 16 01:24:18 2022] DELETE /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:18.860989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d06f-896a-4985-a215-0f579c0c76c0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:18.962042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d668b-bc1d-49e2-ae1d-ce11476652c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:18.963639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d668b-bc1d-49e2-ae1d-ce11476652c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:18.963814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d668b-bc1d-49e2-ae1d-ce11476652c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:18.964350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d668b-bc1d-49e2-ae1d-ce11476652c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:18.966820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d668b-bc1d-49e2-ae1d-ce11476652c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:18.968713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d668b-bc1d-49e2-ae1d-ce11476652c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-1a7d668b-bc1d-49e2-ae1d-ce11476652c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] c80682ad7c424b1bb2e04b6e0b419754 does not imply fa93199e39094e469355c620cdb83603.: keystone.exception.ImpliedRoleNotFound: c80682ad7c424b1bb2e04b6e0b419754 does not imply fa93199e39094e469355c620cdb83603. Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = query.one() Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._iter().one() Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._only_one_row( Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:18.979132 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 16 01:24:18.980429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 16 01:24:18.981782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 16 01:24:18.981782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c80682ad7c424b1bb2e04b6e0b419754 does not imply fa93199e39094e469355c620cdb83603. Oct 16 01:24:18.981782 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:18.985074 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2506/4983] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Oct 16 01:24:18 2022] GET /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603 => generated 137 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:24:18.987306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7805ad-d92b-404b-abfc-2b438ef2866f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:19.005029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7805ad-d92b-404b-abfc-2b438ef2866f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:19.014089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed5fbf-3c91-446c-be45-335c46dce865 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:19.014884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed5fbf-3c91-446c-be45-335c46dce865 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:19.015436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed5fbf-3c91-446c-be45-335c46dce865 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:19.015815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed5fbf-3c91-446c-be45-335c46dce865 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:19.018151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed5fbf-3c91-446c-be45-335c46dce865 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:19.021124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed5fbf-3c91-446c-be45-335c46dce865 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-64ed5fbf-3c91-446c-be45-335c46dce865 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] c80682ad7c424b1bb2e04b6e0b419754 does not imply fa93199e39094e469355c620cdb83603.: keystone.exception.ImpliedRoleNotFound: c80682ad7c424b1bb2e04b6e0b419754 does not imply fa93199e39094e469355c620cdb83603. Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = query.one() Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._iter().one() Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._only_one_row( Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:19.035417 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 16 01:24:19.036826 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 16 01:24:19.038127 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 16 01:24:19.038127 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 16 01:24:19.038127 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 16 01:24:19.038127 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c80682ad7c424b1bb2e04b6e0b419754 does not imply fa93199e39094e469355c620cdb83603. Oct 16 01:24:19.038127 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:24:19.041770 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2478/4984] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Oct 16 01:24:18 2022] DELETE /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603 => generated 137 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:24:19.041948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d668b-bc1d-49e2-ae1d-ce11476652c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:19.062206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d668b-bc1d-49e2-ae1d-ce11476652c3 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:19.068622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af8e8c-ffaa-416a-9d7c-8449b43e1d14 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:19.069376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af8e8c-ffaa-416a-9d7c-8449b43e1d14 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:19.069722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af8e8c-ffaa-416a-9d7c-8449b43e1d14 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:19.070124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af8e8c-ffaa-416a-9d7c-8449b43e1d14 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:19.072223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af8e8c-ffaa-416a-9d7c-8449b43e1d14 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:19.074501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af8e8c-ffaa-416a-9d7c-8449b43e1d14 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:19.136703 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2507/4985] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Oct 16 01:24:19 2022] PUT /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603 => generated 520 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:19.141094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed5fbf-3c91-446c-be45-335c46dce865 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:19.166401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed5fbf-3c91-446c-be45-335c46dce865 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:19.259646 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:19.325033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917f7cd-94c0-4344-9dfc-9c00535c3d2a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:19.326133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f7cd-94c0-4344-9dfc-9c00535c3d2a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:19.326626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f7cd-94c0-4344-9dfc-9c00535c3d2a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:19.327547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f7cd-94c0-4344-9dfc-9c00535c3d2a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/77fd10857dd145fcac0fb4a51a54b9a6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:19.329767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917f7cd-94c0-4344-9dfc-9c00535c3d2a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=77fd10857dd145fcac0fb4a51a54b9a6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:19.332002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917f7cd-94c0-4344-9dfc-9c00535c3d2a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:19.373237 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2479/4986] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Oct 16 01:24:19 2022] PUT /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/77fd10857dd145fcac0fb4a51a54b9a6 => generated 519 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:19.375202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af8e8c-ffaa-416a-9d7c-8449b43e1d14 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:19.410692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af8e8c-ffaa-416a-9d7c-8449b43e1d14 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:19.506177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179dbbf-5720-4b19-a2f0-c54d1232d53a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:19.506751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179dbbf-5720-4b19-a2f0-c54d1232d53a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:19.507080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179dbbf-5720-4b19-a2f0-c54d1232d53a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:19.507357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179dbbf-5720-4b19-a2f0-c54d1232d53a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/77fd10857dd145fcac0fb4a51a54b9a6/implies/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:19.510110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179dbbf-5720-4b19-a2f0-c54d1232d53a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=77fd10857dd145fcac0fb4a51a54b9a6, implied_role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:19.512580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179dbbf-5720-4b19-a2f0-c54d1232d53a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:19.616034 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2508/4987] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Oct 16 01:24:19 2022] PUT /identity/v3/roles/77fd10857dd145fcac0fb4a51a54b9a6/implies/3125a62a25b74470a53a557e86216cd8 => generated 520 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:19.617375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917f7cd-94c0-4344-9dfc-9c00535c3d2a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:19.638992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917f7cd-94c0-4344-9dfc-9c00535c3d2a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:19.764281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908daa-4943-4520-96f1-186f03b8212f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:19.765340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908daa-4943-4520-96f1-186f03b8212f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:19.765864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908daa-4943-4520-96f1-186f03b8212f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:19.766241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908daa-4943-4520-96f1-186f03b8212f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:19.766942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da908daa-4943-4520-96f1-186f03b8212f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:19.768061 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-da908daa-4943-4520-96f1-186f03b8212f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:19.768061 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:19.768061 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:19.769209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da908daa-4943-4520-96f1-186f03b8212f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:19.796954 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2480/4988] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:24:19 2022] GET /identity/v3/role_inferences => generated 1605 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:19.798183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179dbbf-5720-4b19-a2f0-c54d1232d53a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:19.824888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179dbbf-5720-4b19-a2f0-c54d1232d53a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:19.833742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaa78c-3636-4182-85b6-47d49def189c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:19.834715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaa78c-3636-4182-85b6-47d49def189c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:19.834715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaa78c-3636-4182-85b6-47d49def189c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:19.834977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaa78c-3636-4182-85b6-47d49def189c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/77fd10857dd145fcac0fb4a51a54b9a6/implies/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:19.837449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfaa78c-3636-4182-85b6-47d49def189c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=77fd10857dd145fcac0fb4a51a54b9a6, implied_role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:19.839310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfaa78c-3636-4182-85b6-47d49def189c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:19.855235 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2509/4989] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Oct 16 01:24:19 2022] DELETE /identity/v3/roles/77fd10857dd145fcac0fb4a51a54b9a6/implies/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:19.859148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908daa-4943-4520-96f1-186f03b8212f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:19.876800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908daa-4943-4520-96f1-186f03b8212f tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:19.959022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa45554-d24f-4421-8f7e-2b86d1d31bbc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:19.962397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa45554-d24f-4421-8f7e-2b86d1d31bbc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:19.962397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa45554-d24f-4421-8f7e-2b86d1d31bbc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:19.962397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa45554-d24f-4421-8f7e-2b86d1d31bbc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/77fd10857dd145fcac0fb4a51a54b9a6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:19.963752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa45554-d24f-4421-8f7e-2b86d1d31bbc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=77fd10857dd145fcac0fb4a51a54b9a6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:19.965406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa45554-d24f-4421-8f7e-2b86d1d31bbc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:19.975598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaa78c-3636-4182-85b6-47d49def189c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:19.979627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3cfaa78c-3636-4182-85b6-47d49def189c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:19.982810 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2481/4990] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Oct 16 01:24:19 2022] DELETE /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/77fd10857dd145fcac0fb4a51a54b9a6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:19.987736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa45554-d24f-4421-8f7e-2b86d1d31bbc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:19.996247 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:20.095424 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:20.127877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa45554-d24f-4421-8f7e-2b86d1d31bbc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:20.135090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b7584-89a2-4e49-8006-3be61260f59a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:20.135749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b7584-89a2-4e49-8006-3be61260f59a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:20.136385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b7584-89a2-4e49-8006-3be61260f59a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:20.136659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b7584-89a2-4e49-8006-3be61260f59a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:20.140325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b7584-89a2-4e49-8006-3be61260f59a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:20.142037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b7584-89a2-4e49-8006-3be61260f59a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:20.153236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaa78c-3636-4182-85b6-47d49def189c tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:20.159979 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2482/4991] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Oct 16 01:24:19 2022] DELETE /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:20.159979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b7584-89a2-4e49-8006-3be61260f59a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:20.166301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-475b7584-89a2-4e49-8006-3be61260f59a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:20.312390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610cabc-1190-47ae-95a1-99634177efe3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:20.313061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610cabc-1190-47ae-95a1-99634177efe3 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:20.313345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610cabc-1190-47ae-95a1-99634177efe3 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:20.316575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610cabc-1190-47ae-95a1-99634177efe3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:20.323309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6610cabc-1190-47ae-95a1-99634177efe3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:20.327504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b7584-89a2-4e49-8006-3be61260f59a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:20.333662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760f7cb-4f56-44a5-b65f-dfc4963a578d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:20.334587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760f7cb-4f56-44a5-b65f-dfc4963a578d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:20.335075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760f7cb-4f56-44a5-b65f-dfc4963a578d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:20.335389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610cabc-1190-47ae-95a1-99634177efe3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:20.336123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760f7cb-4f56-44a5-b65f-dfc4963a578d admin admin] PATH_INFO: `/v3/users/baca0537d1844a8ea771011a6c062b30` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:20.337807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610cabc-1190-47ae-95a1-99634177efe3 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:20.339453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760f7cb-4f56-44a5-b65f-dfc4963a578d admin admin] RBAC: Authorizing `identity:delete_user(user_id=baca0537d1844a8ea771011a6c062b30)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:20.341589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760f7cb-4f56-44a5-b65f-dfc4963a578d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:20.360060 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2510/4992] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:24:20.361146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610cabc-1190-47ae-95a1-99634177efe3 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:20.416045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f760f7cb-4f56-44a5-b65f-dfc4963a578d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baca0537d1844a8ea771011a6c062b30'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:20.416882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f760f7cb-4f56-44a5-b65f-dfc4963a578d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baca0537d1844a8ea771011a6c062b30'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:20.449464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f760f7cb-4f56-44a5-b65f-dfc4963a578d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baca0537d1844a8ea771011a6c062b30'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:20.458073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610cabc-1190-47ae-95a1-99634177efe3 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:20.465776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c8825-dc8d-46f6-ba87-a410780de55e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:20.466562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c8825-dc8d-46f6-ba87-a410780de55e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:20.467569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c8825-dc8d-46f6-ba87-a410780de55e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:20.467901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c8825-dc8d-46f6-ba87-a410780de55e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:20.468335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f760f7cb-4f56-44a5-b65f-dfc4963a578d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baca0537d1844a8ea771011a6c062b30'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:20.468542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c8825-dc8d-46f6-ba87-a410780de55e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:20.470158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f760f7cb-4f56-44a5-b65f-dfc4963a578d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baca0537d1844a8ea771011a6c062b30'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:20.470353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c8825-dc8d-46f6-ba87-a410780de55e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:20.491559 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2511/4993] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:20 2022] GET /identity/v3/roles => generated 2322 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:20.496086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c8825-dc8d-46f6-ba87-a410780de55e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:20.500605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-de8c8825-dc8d-46f6-ba87-a410780de55e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:20.507656 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2483/4994] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:20 2022] DELETE /identity/v3/users/baca0537d1844a8ea771011a6c062b30 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:20.571576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c8825-dc8d-46f6-ba87-a410780de55e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:20.614077 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:20.687474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f91d1-a642-40c3-a548-6ddb330959cb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:20.688207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f91d1-a642-40c3-a548-6ddb330959cb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:20.688552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f91d1-a642-40c3-a548-6ddb330959cb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:20.688919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f91d1-a642-40c3-a548-6ddb330959cb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:20.689669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f91d1-a642-40c3-a548-6ddb330959cb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:20.691434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f91d1-a642-40c3-a548-6ddb330959cb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:20.715970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760f7cb-4f56-44a5-b65f-dfc4963a578d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:20.719503 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2512/4995] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:24:20 2022] POST /identity/v3/roles => generated 235 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:20.737178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760f7cb-4f56-44a5-b65f-dfc4963a578d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:20.744198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd43192-8278-4517-92bc-6ded43c3e1e8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:20.745661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd43192-8278-4517-92bc-6ded43c3e1e8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:20.746077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd43192-8278-4517-92bc-6ded43c3e1e8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:20.746626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd43192-8278-4517-92bc-6ded43c3e1e8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/8a4222f3977348729b131775ebccb758` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:20.749043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd43192-8278-4517-92bc-6ded43c3e1e8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:update_role(role_id=8a4222f3977348729b131775ebccb758)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:20.750358 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-ddd43192-8278-4517-92bc-6ded43c3e1e8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:20.750358 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:24:20.750358 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:24:20.751846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd43192-8278-4517-92bc-6ded43c3e1e8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:20.788444 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2484/4996] 10.222.0.39 () {60 vars in 1243 bytes} [Sun Oct 16 01:24:20 2022] PATCH /identity/v3/roles/8a4222f3977348729b131775ebccb758 => generated 238 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:24:20.790523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f91d1-a642-40c3-a548-6ddb330959cb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:20.801859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f91d1-a642-40c3-a548-6ddb330959cb tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:20.819391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9e7b1-d6d5-43ce-b38a-801432f98847 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:20.821237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9e7b1-d6d5-43ce-b38a-801432f98847 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:20.831172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd43192-8278-4517-92bc-6ded43c3e1e8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:20.833773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9e7b1-d6d5-43ce-b38a-801432f98847 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:20.834430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9e7b1-d6d5-43ce-b38a-801432f98847 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/8a4222f3977348729b131775ebccb758` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:20.838427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ddd43192-8278-4517-92bc-6ded43c3e1e8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:20.853514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9e7b1-d6d5-43ce-b38a-801432f98847 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:get_role(role_id=8a4222f3977348729b131775ebccb758)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:20.854765 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-a1a9e7b1-d6d5-43ce-b38a-801432f98847 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:20.854765 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:24:20.854765 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:24:20.856132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9e7b1-d6d5-43ce-b38a-801432f98847 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:20.859181 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2513/4997] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:24:20 2022] GET /identity/v3/roles/8a4222f3977348729b131775ebccb758 => generated 238 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:20.862617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9e7b1-d6d5-43ce-b38a-801432f98847 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:20.889133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9e7b1-d6d5-43ce-b38a-801432f98847 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:20.903263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbdc1f-3c80-4535-aa61-9b4412b694be tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:20.903886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdc1f-3c80-4535-aa61-9b4412b694be tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:20.904256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdc1f-3c80-4535-aa61-9b4412b694be tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:20.904485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdc1f-3c80-4535-aa61-9b4412b694be tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:20.905059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbdc1f-3c80-4535-aa61-9b4412b694be tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:20.906722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbdc1f-3c80-4535-aa61-9b4412b694be tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:20.915426 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:20.924456 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2514/4998] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:20 2022] GET /identity/v3/roles => generated 2551 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:20.926579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbdc1f-3c80-4535-aa61-9b4412b694be tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:20.939842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbdc1f-3c80-4535-aa61-9b4412b694be tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:20.944770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ca2f-9f5f-47df-b6f6-6807f17e2437 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:20.946041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ca2f-9f5f-47df-b6f6-6807f17e2437 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:20.946424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ca2f-9f5f-47df-b6f6-6807f17e2437 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:20.946862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ca2f-9f5f-47df-b6f6-6807f17e2437 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/8a4222f3977348729b131775ebccb758` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:20.948907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269ca2f-9f5f-47df-b6f6-6807f17e2437 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8a4222f3977348729b131775ebccb758)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:20.951181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269ca2f-9f5f-47df-b6f6-6807f17e2437 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:20.999133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd43192-8278-4517-92bc-6ded43c3e1e8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:21.005832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e269ca2f-9f5f-47df-b6f6-6807f17e2437 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role 8a4222f3977348729b131775ebccb758 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:21.006396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e269ca2f-9f5f-47df-b6f6-6807f17e2437 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:21.006955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859ec92-4f9f-4035-9632-0b6a249cca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:21.008168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e269ca2f-9f5f-47df-b6f6-6807f17e2437 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:21.008319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859ec92-4f9f-4035-9632-0b6a249cca59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:21.009170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859ec92-4f9f-4035-9632-0b6a249cca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:21.009452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859ec92-4f9f-4035-9632-0b6a249cca59 admin admin] PATH_INFO: `/v3/projects/918ff4a0b6c34c4bbfd6e31f32967d70` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:21.011176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859ec92-4f9f-4035-9632-0b6a249cca59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=918ff4a0b6c34c4bbfd6e31f32967d70)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:21.015098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859ec92-4f9f-4035-9632-0b6a249cca59 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:21.016615 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2515/4999] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:20 2022] DELETE /identity/v3/roles/8a4222f3977348729b131775ebccb758 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:21.018081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ca2f-9f5f-47df-b6f6-6807f17e2437 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:21.019691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e269ca2f-9f5f-47df-b6f6-6807f17e2437 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:21.136047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9859ec92-4f9f-4035-9632-0b6a249cca59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918ff4a0b6c34c4bbfd6e31f32967d70', 'request_id': 'req-9859ec92-4f9f-4035-9632-0b6a249cca59'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:21.143980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9859ec92-4f9f-4035-9632-0b6a249cca59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918ff4a0b6c34c4bbfd6e31f32967d70', 'request_id': 'req-9859ec92-4f9f-4035-9632-0b6a249cca59'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:21.152970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ca2f-9f5f-47df-b6f6-6807f17e2437 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:21.157014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9859ec92-4f9f-4035-9632-0b6a249cca59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918ff4a0b6c34c4bbfd6e31f32967d70', 'request_id': 'req-9859ec92-4f9f-4035-9632-0b6a249cca59'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:21.180687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9859ec92-4f9f-4035-9632-0b6a249cca59 admin admin] The token cache is being invalidate because project 918ff4a0b6c34c4bbfd6e31f32967d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:21.181078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9859ec92-4f9f-4035-9632-0b6a249cca59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:21.182125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9859ec92-4f9f-4035-9632-0b6a249cca59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:21.185727 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2485/5000] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:20 2022] DELETE /identity/v3/projects/918ff4a0b6c34c4bbfd6e31f32967d70 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:21.190125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ec4ea-f619-45b5-bd7c-75bfd7ea5c59 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:21.190527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ec4ea-f619-45b5-bd7c-75bfd7ea5c59 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:21.190898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ec4ea-f619-45b5-bd7c-75bfd7ea5c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:21.217183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-004ec4ea-f619-45b5-bd7c-75bfd7ea5c59 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:21.218496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-004ec4ea-f619-45b5-bd7c-75bfd7ea5c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:21.284337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686e555-c1da-4c9d-93d0-65044b70bf8d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:21.285410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686e555-c1da-4c9d-93d0-65044b70bf8d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:21.286425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686e555-c1da-4c9d-93d0-65044b70bf8d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:21.287015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686e555-c1da-4c9d-93d0-65044b70bf8d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:21.289426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686e555-c1da-4c9d-93d0-65044b70bf8d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:21.291431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686e555-c1da-4c9d-93d0-65044b70bf8d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:21.294348 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:21.302309 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2486/5001] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:21.322968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a4fc6-3164-4999-acbe-812d9e2296b6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:21.323248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a4fc6-3164-4999-acbe-812d9e2296b6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:21.323619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a4fc6-3164-4999-acbe-812d9e2296b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:21.333564 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2516/5002] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Oct 16 01:24:21 2022] PUT /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603 => generated 520 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:21.337969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686e555-c1da-4c9d-93d0-65044b70bf8d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:21.345347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d686e555-c1da-4c9d-93d0-65044b70bf8d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:21.348265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b36a4fc6-3164-4999-acbe-812d9e2296b6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:21.349386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b36a4fc6-3164-4999-acbe-812d9e2296b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:21.447185 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2487/5003] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:21.450555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a4fc6-3164-4999-acbe-812d9e2296b6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:21.451054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686e555-c1da-4c9d-93d0-65044b70bf8d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:21.457763 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:21.463956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a4fc6-3164-4999-acbe-812d9e2296b6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:21.467201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb84d50-8f1c-42ff-8e1d-208cf1c2e1c4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:21.467201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84d50-8f1c-42ff-8e1d-208cf1c2e1c4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:21.467201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84d50-8f1c-42ff-8e1d-208cf1c2e1c4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:21.468551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84d50-8f1c-42ff-8e1d-208cf1c2e1c4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/77fd10857dd145fcac0fb4a51a54b9a6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:21.470474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb84d50-8f1c-42ff-8e1d-208cf1c2e1c4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=77fd10857dd145fcac0fb4a51a54b9a6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:21.487240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242b891-ff13-4bd5-a9ef-df464275b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:21.487424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb84d50-8f1c-42ff-8e1d-208cf1c2e1c4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:21.487524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242b891-ff13-4bd5-a9ef-df464275b129 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:21.487524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242b891-ff13-4bd5-a9ef-df464275b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:21.487524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242b891-ff13-4bd5-a9ef-df464275b129 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:21.487524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242b891-ff13-4bd5-a9ef-df464275b129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:21.487524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242b891-ff13-4bd5-a9ef-df464275b129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:21.487524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242b891-ff13-4bd5-a9ef-df464275b129 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:21.493715 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2488/5004] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:24:21.501106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242b891-ff13-4bd5-a9ef-df464275b129 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:21.509766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242b891-ff13-4bd5-a9ef-df464275b129 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:21.516153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c33e9-f777-483b-996c-a643c4d3eb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:21.516868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c33e9-f777-483b-996c-a643c4d3eb88 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:21.517181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c33e9-f777-483b-996c-a643c4d3eb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:21.517574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c33e9-f777-483b-996c-a643c4d3eb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:21.518340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c33e9-f777-483b-996c-a643c4d3eb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:21.521563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c33e9-f777-483b-996c-a643c4d3eb88 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:21.531440 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2517/5005] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Oct 16 01:24:21 2022] PUT /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/77fd10857dd145fcac0fb4a51a54b9a6 => generated 519 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:21.536501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb84d50-8f1c-42ff-8e1d-208cf1c2e1c4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:21.590276 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2489/5006] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:21 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:21.594999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c33e9-f777-483b-996c-a643c4d3eb88 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:21.684070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb84d50-8f1c-42ff-8e1d-208cf1c2e1c4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:21.756231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c33e9-f777-483b-996c-a643c4d3eb88 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:21.768605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2f20c-f20c-4bb1-8760-62e125e70d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:21.770253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f20c-f20c-4bb1-8760-62e125e70d11 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:21.775068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f20c-f20c-4bb1-8760-62e125e70d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:21.775068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f20c-f20c-4bb1-8760-62e125e70d11 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:21.775068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2f20c-f20c-4bb1-8760-62e125e70d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:21.780458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2f20c-f20c-4bb1-8760-62e125e70d11 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:21.829415 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2490/5007] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:21 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:21.831385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7240c99-5cb1-4417-a812-cf2c55fe850e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:21.832207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240c99-5cb1-4417-a812-cf2c55fe850e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:21.832596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240c99-5cb1-4417-a812-cf2c55fe850e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:21.833810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2f20c-f20c-4bb1-8760-62e125e70d11 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:21.834519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240c99-5cb1-4417-a812-cf2c55fe850e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/77fd10857dd145fcac0fb4a51a54b9a6/implies/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:21.841449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7240c99-5cb1-4417-a812-cf2c55fe850e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=77fd10857dd145fcac0fb4a51a54b9a6, implied_role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:21.843363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7240c99-5cb1-4417-a812-cf2c55fe850e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:21.853551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2f20c-f20c-4bb1-8760-62e125e70d11 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:21.861975 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:21.867871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe8e3c-1055-437a-9fa2-41cb52fb09e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:21.868531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe8e3c-1055-437a-9fa2-41cb52fb09e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:21.868785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe8e3c-1055-437a-9fa2-41cb52fb09e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:21.869044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe8e3c-1055-437a-9fa2-41cb52fb09e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:21.869684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe8e3c-1055-437a-9fa2-41cb52fb09e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:21.871318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe8e3c-1055-437a-9fa2-41cb52fb09e1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:21.889324 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2518/5008] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Oct 16 01:24:21 2022] PUT /identity/v3/roles/77fd10857dd145fcac0fb4a51a54b9a6/implies/3125a62a25b74470a53a557e86216cd8 => generated 520 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:21.892466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7240c99-5cb1-4417-a812-cf2c55fe850e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:21.900014 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2491/5009] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:21 2022] GET /identity/v3/roles => generated 2322 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:21.902260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe8e3c-1055-437a-9fa2-41cb52fb09e1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:21.914241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe8e3c-1055-437a-9fa2-41cb52fb09e1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:22.005860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7240c99-5cb1-4417-a812-cf2c55fe850e tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:22.013209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8d5d0-bc14-4fbc-a4c2-b14299d3c029 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:22.014176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8d5d0-bc14-4fbc-a4c2-b14299d3c029 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:22.014626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8d5d0-bc14-4fbc-a4c2-b14299d3c029 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:22.015107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8d5d0-bc14-4fbc-a4c2-b14299d3c029 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/77fd10857dd145fcac0fb4a51a54b9a6/implies` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:22.016034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09141343-f6ac-4610-be9a-4e29eff6467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:22.016587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8d5d0-bc14-4fbc-a4c2-b14299d3c029 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=77fd10857dd145fcac0fb4a51a54b9a6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:22.016729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09141343-f6ac-4610-be9a-4e29eff6467f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:22.016916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09141343-f6ac-4610-be9a-4e29eff6467f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:22.018066 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-5fa8d5d0-bc14-4fbc-a4c2-b14299d3c029 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:24:22.018066 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:24:22.018066 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:24:22.018353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09141343-f6ac-4610-be9a-4e29eff6467f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:22.018834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09141343-f6ac-4610-be9a-4e29eff6467f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:22.019576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8d5d0-bc14-4fbc-a4c2-b14299d3c029 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:22.020727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09141343-f6ac-4610-be9a-4e29eff6467f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:22.027604 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2519/5010] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:24:21 2022] GET /identity/v3/roles/77fd10857dd145fcac0fb4a51a54b9a6/implies => generated 489 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:22.031699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8d5d0-bc14-4fbc-a4c2-b14299d3c029 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:22.040957 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2492/5011] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:21 2022] GET /identity/v3/roles => generated 2322 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:22.044018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8d5d0-bc14-4fbc-a4c2-b14299d3c029 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:22.044728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09141343-f6ac-4610-be9a-4e29eff6467f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:22.049247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260fc7e-d999-4879-b023-96d734757fa8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:22.050263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260fc7e-d999-4879-b023-96d734757fa8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:22.050840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260fc7e-d999-4879-b023-96d734757fa8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:22.051319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260fc7e-d999-4879-b023-96d734757fa8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:22.053537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260fc7e-d999-4879-b023-96d734757fa8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:22.056455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09141343-f6ac-4610-be9a-4e29eff6467f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:22.057208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260fc7e-d999-4879-b023-96d734757fa8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:22.066242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d3392-5eed-4f6e-8dbb-45c098b81487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:22.067239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3392-5eed-4f6e-8dbb-45c098b81487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:22.069160 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2520/5012] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:24:22 2022] GET /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies => generated 659 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:24:22.069622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3392-5eed-4f6e-8dbb-45c098b81487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:22.070203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3392-5eed-4f6e-8dbb-45c098b81487 admin admin] PATH_INFO: `/v3/projects/7b9c69693c7d4ee595104571ec6843e6/users/d6230942d9ee420a9c0c5fa203259f64/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:22.074076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260fc7e-d999-4879-b023-96d734757fa8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:22.089111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d3392-5eed-4f6e-8dbb-45c098b81487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9c69693c7d4ee595104571ec6843e6, user_id=d6230942d9ee420a9c0c5fa203259f64, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:22.092073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d3392-5eed-4f6e-8dbb-45c098b81487 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:22.097177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260fc7e-d999-4879-b023-96d734757fa8 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:22.105095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d385b2-1638-4822-a95e-3632b6519df4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:22.105989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d385b2-1638-4822-a95e-3632b6519df4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:22.106393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d385b2-1638-4822-a95e-3632b6519df4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:22.106747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d385b2-1638-4822-a95e-3632b6519df4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/77fd10857dd145fcac0fb4a51a54b9a6/implies/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:22.108842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d385b2-1638-4822-a95e-3632b6519df4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=77fd10857dd145fcac0fb4a51a54b9a6, implied_role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:22.110821 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2493/5013] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:22 2022] PUT /identity/v3/projects/7b9c69693c7d4ee595104571ec6843e6/users/d6230942d9ee420a9c0c5fa203259f64/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:22.111008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d385b2-1638-4822-a95e-3632b6519df4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:22.121822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b6a7b-5e15-4c7d-b04a-580001027c22 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:22.122246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b6a7b-5e15-4c7d-b04a-580001027c22 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:22.122756 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2521/5014] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Oct 16 01:24:22 2022] DELETE /identity/v3/roles/77fd10857dd145fcac0fb4a51a54b9a6/implies/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:22.122906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b6a7b-5e15-4c7d-b04a-580001027c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:22.127374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d385b2-1638-4822-a95e-3632b6519df4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:22.158248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-933b6a7b-5e15-4c7d-b04a-580001027c22 None None] MFA Rules not processed for user `d6230942d9ee420a9c0c5fa203259f64`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:22.160772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-933b6a7b-5e15-4c7d-b04a-580001027c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:22.174327 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:22.211998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d385b2-1638-4822-a95e-3632b6519df4 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:22.217442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81314773-9897-4c9b-b613-c61b05e0e0d0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:22.218309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81314773-9897-4c9b-b613-c61b05e0e0d0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:22.218660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81314773-9897-4c9b-b613-c61b05e0e0d0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:22.219063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81314773-9897-4c9b-b613-c61b05e0e0d0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/77fd10857dd145fcac0fb4a51a54b9a6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:22.220948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81314773-9897-4c9b-b613-c61b05e0e0d0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=77fd10857dd145fcac0fb4a51a54b9a6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:22.222686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81314773-9897-4c9b-b613-c61b05e0e0d0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:22.240909 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2522/5015] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Oct 16 01:24:22 2022] DELETE /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/77fd10857dd145fcac0fb4a51a54b9a6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:22.242684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81314773-9897-4c9b-b613-c61b05e0e0d0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:22.303676 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2494/5016] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:22.305527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04cd0f-5747-43b1-aa9b-df8fe9a3beb4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:22.305910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04cd0f-5747-43b1-aa9b-df8fe9a3beb4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:22.306512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04cd0f-5747-43b1-aa9b-df8fe9a3beb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:22.331835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ef04cd0f-5747-43b1-aa9b-df8fe9a3beb4 None None] MFA Rules not processed for user `d6230942d9ee420a9c0c5fa203259f64`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:22.333888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef04cd0f-5747-43b1-aa9b-df8fe9a3beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:22.334600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81314773-9897-4c9b-b613-c61b05e0e0d0 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:22.342062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b770e17-a6ef-4b01-8eb4-d1c819235161 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:22.342983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b770e17-a6ef-4b01-8eb4-d1c819235161 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:22.343345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b770e17-a6ef-4b01-8eb4-d1c819235161 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:22.343760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b770e17-a6ef-4b01-8eb4-d1c819235161 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:22.345589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b770e17-a6ef-4b01-8eb4-d1c819235161 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c80682ad7c424b1bb2e04b6e0b419754, implied_role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:22.348260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b770e17-a6ef-4b01-8eb4-d1c819235161 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:22.366986 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2523/5017] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Oct 16 01:24:22 2022] DELETE /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754/implies/fa93199e39094e469355c620cdb83603 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:22.372785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b770e17-a6ef-4b01-8eb4-d1c819235161 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:22.380259 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:22.427379 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2495/5018] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:22.439794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04cd0f-5747-43b1-aa9b-df8fe9a3beb4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:22.441208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef04cd0f-5747-43b1-aa9b-df8fe9a3beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:22.475421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b770e17-a6ef-4b01-8eb4-d1c819235161 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:22.482373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8d29f-7fee-4376-993c-d8cc8052bd76 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:22.483169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d29f-7fee-4376-993c-d8cc8052bd76 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:22.483462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d29f-7fee-4376-993c-d8cc8052bd76 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:22.483736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d29f-7fee-4376-993c-d8cc8052bd76 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains/d0c7f5bf979a43e1a21cac73e626154c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:22.493816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8d29f-7fee-4376-993c-d8cc8052bd76 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b8e8d29f-7fee-4376-993c-d8cc8052bd76 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Could not find domain: d0c7f5bf979a43e1a21cac73e626154c.: keystone.exception.DomainNotFound: Could not find domain: d0c7f5bf979a43e1a21cac73e626154c. Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d0c7f5bf979a43e1a21cac73e626154c. Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:24:22.499429 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:24:22.500605 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d0c7f5bf979a43e1a21cac73e626154c. Oct 16 01:24:22.505367 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:24:22.506519 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2524/5019] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:24:22 2022] PATCH /identity/v3/domains/d0c7f5bf979a43e1a21cac73e626154c => generated 112 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:24:22.516306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8d29f-7fee-4376-993c-d8cc8052bd76 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:22.545081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8d29f-7fee-4376-993c-d8cc8052bd76 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:22.555467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:22.556108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:22.557234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:22.557442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/users/82980c93ebd5482d9d1f4a4be46a8842` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:22.559587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_user(user_id=82980c93ebd5482d9d1f4a4be46a8842)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:22.562126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:22.579170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04cd0f-5747-43b1-aa9b-df8fe9a3beb4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:22.645040 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:22.647598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82980c93ebd5482d9d1f4a4be46a8842'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:22.648786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82980c93ebd5482d9d1f4a4be46a8842'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:22.671178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82980c93ebd5482d9d1f4a4be46a8842'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:22.680322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a49ae-2159-4fe2-907d-92154e3212ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:22.681958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a49ae-2159-4fe2-907d-92154e3212ce service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:22.682321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a49ae-2159-4fe2-907d-92154e3212ce service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:22.682598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a49ae-2159-4fe2-907d-92154e3212ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:22.685601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-be9a49ae-2159-4fe2-907d-92154e3212ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:22.692829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82980c93ebd5482d9d1f4a4be46a8842'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:22.694653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82980c93ebd5482d9d1f4a4be46a8842'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:22.719264 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2525/5020] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:22 2022] DELETE /identity/v3/users/82980c93ebd5482d9d1f4a4be46a8842 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:22.723034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:22.725553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:22.774528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a49ae-2159-4fe2-907d-92154e3212ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:22.776876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a49ae-2159-4fe2-907d-92154e3212ce service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:22.795573 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2496/5021] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:22.911154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9e51a-df86-4da7-a2bf-1eb91c7c307d tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:22.925761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab5d83-2734-47dc-ad0c-c4f1dd139b02 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:22.926558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab5d83-2734-47dc-ad0c-c4f1dd139b02 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:22.926974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab5d83-2734-47dc-ad0c-c4f1dd139b02 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:22.927669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab5d83-2734-47dc-ad0c-c4f1dd139b02 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/3125a62a25b74470a53a557e86216cd8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:22.932110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab5d83-2734-47dc-ad0c-c4f1dd139b02 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3125a62a25b74470a53a557e86216cd8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:22.934208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab5d83-2734-47dc-ad0c-c4f1dd139b02 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:22.964024 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:23.014681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2aab5d83-2734-47dc-ad0c-c4f1dd139b02 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role 3125a62a25b74470a53a557e86216cd8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:23.015159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2aab5d83-2734-47dc-ad0c-c4f1dd139b02 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:23.016649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2aab5d83-2734-47dc-ad0c-c4f1dd139b02 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:23.026978 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2526/5022] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:22 2022] DELETE /identity/v3/roles/3125a62a25b74470a53a557e86216cd8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:23.028305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a49ae-2159-4fe2-907d-92154e3212ce service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:23.048757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a49ae-2159-4fe2-907d-92154e3212ce service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:23.211504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d575476-4be6-4cdd-b82c-ba86bd2d2153 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:23.212160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d575476-4be6-4cdd-b82c-ba86bd2d2153 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:23.212437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d575476-4be6-4cdd-b82c-ba86bd2d2153 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:23.212746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d575476-4be6-4cdd-b82c-ba86bd2d2153 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/groups/5629a45db6b445ccb96bf56de732c8ac` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:23.214508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d575476-4be6-4cdd-b82c-ba86bd2d2153 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5629a45db6b445ccb96bf56de732c8ac)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:23.218638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d575476-4be6-4cdd-b82c-ba86bd2d2153 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:23.307524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab5d83-2734-47dc-ad0c-c4f1dd139b02 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:23.308051 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2497/5023] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:24:23 2022] DELETE /identity/v3/groups/5629a45db6b445ccb96bf56de732c8ac => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:23.309470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2aab5d83-2734-47dc-ad0c-c4f1dd139b02 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:23.327166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab5d83-2734-47dc-ad0c-c4f1dd139b02 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:23.418301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:23.419305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:23.419580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:23.419852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/projects/939ef2cea14f440ea9a4171080487e01` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:23.421316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=939ef2cea14f440ea9a4171080487e01)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:23.423494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:23.509947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939ef2cea14f440ea9a4171080487e01', 'request_id': 'req-8a6e34f5-1c14-485c-ab18-11ded612bb75'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:23.535886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939ef2cea14f440ea9a4171080487e01', 'request_id': 'req-8a6e34f5-1c14-485c-ab18-11ded612bb75'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:23.558007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939ef2cea14f440ea9a4171080487e01', 'request_id': 'req-8a6e34f5-1c14-485c-ab18-11ded612bb75'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:23.612470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] The token cache is being invalidate because project 939ef2cea14f440ea9a4171080487e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:23.613265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:23.614470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:23.621021 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2527/5024] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:23 2022] DELETE /identity/v3/projects/939ef2cea14f440ea9a4171080487e01 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:23.626704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d575476-4be6-4cdd-b82c-ba86bd2d2153 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:23.629145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9d575476-4be6-4cdd-b82c-ba86bd2d2153 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:23.671062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d575476-4be6-4cdd-b82c-ba86bd2d2153 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:23.781189 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:23.812589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48156f7-13b4-4e00-9779-d44cf6213655 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:23.813788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48156f7-13b4-4e00-9779-d44cf6213655 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:23.814905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48156f7-13b4-4e00-9779-d44cf6213655 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:23.816117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48156f7-13b4-4e00-9779-d44cf6213655 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains/915b33b278fe4c6caeec4afa2c3ed794` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:23.819589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48156f7-13b4-4e00-9779-d44cf6213655 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=915b33b278fe4c6caeec4afa2c3ed794)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:23.822379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48156f7-13b4-4e00-9779-d44cf6213655 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:23.873474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d48156f7-13b4-4e00-9779-d44cf6213655 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '915b33b278fe4c6caeec4afa2c3ed794'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:23.875352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d48156f7-13b4-4e00-9779-d44cf6213655 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '915b33b278fe4c6caeec4afa2c3ed794'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:23.929433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d48156f7-13b4-4e00-9779-d44cf6213655 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '915b33b278fe4c6caeec4afa2c3ed794'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:23.931005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d48156f7-13b4-4e00-9779-d44cf6213655 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '915b33b278fe4c6caeec4afa2c3ed794'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:23.940899 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2498/5025] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:24:23 2022] PATCH /identity/v3/domains/915b33b278fe4c6caeec4afa2c3ed794 => generated 276 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:23.942191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:23.958539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e34f5-1c14-485c-ab18-11ded612bb75 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:24.122517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:24.123624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:24.124134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:24.124644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/domains/915b33b278fe4c6caeec4afa2c3ed794` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:24.138602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=915b33b278fe4c6caeec4afa2c3ed794)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:24.143618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:24.145728 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:24.179567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '915b33b278fe4c6caeec4afa2c3ed794'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.190362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48156f7-13b4-4e00-9779-d44cf6213655 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:24.191828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d48156f7-13b4-4e00-9779-d44cf6213655 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:24.192260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '915b33b278fe4c6caeec4afa2c3ed794'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.261741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915b33b278fe4c6caeec4afa2c3ed794', 'request_id': 'req-ffec25ad-11db-40f9-afdb-82c121e9ca6a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.282603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915b33b278fe4c6caeec4afa2c3ed794', 'request_id': 'req-ffec25ad-11db-40f9-afdb-82c121e9ca6a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.310023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915b33b278fe4c6caeec4afa2c3ed794', 'request_id': 'req-ffec25ad-11db-40f9-afdb-82c121e9ca6a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.330657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] The token cache is being invalidate because project 915b33b278fe4c6caeec4afa2c3ed794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:24.331041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.333908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.352321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '915b33b278fe4c6caeec4afa2c3ed794', 'request_id': 'req-ffec25ad-11db-40f9-afdb-82c121e9ca6a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.353615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '915b33b278fe4c6caeec4afa2c3ed794', 'request_id': 'req-ffec25ad-11db-40f9-afdb-82c121e9ca6a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.354411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '915b33b278fe4c6caeec4afa2c3ed794', 'request_id': 'req-ffec25ad-11db-40f9-afdb-82c121e9ca6a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.369849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48156f7-13b4-4e00-9779-d44cf6213655 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:24.371143 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2528/5026] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:24:23 2022] DELETE /identity/v3/domains/915b33b278fe4c6caeec4afa2c3ed794 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:24.375421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:24.377779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:24.520778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454af10-fa61-45fd-bd7a-3e39fa869602 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:24.521685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454af10-fa61-45fd-bd7a-3e39fa869602 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:24.522593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454af10-fa61-45fd-bd7a-3e39fa869602 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:24.525587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454af10-fa61-45fd-bd7a-3e39fa869602 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:24.532017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b454af10-fa61-45fd-bd7a-3e39fa869602 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:24.553719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec25ad-11db-40f9-afdb-82c121e9ca6a tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:24.580806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454af10-fa61-45fd-bd7a-3e39fa869602 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:24.584013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c1051-e909-4125-a92b-2eee59410200 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:24.586318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1051-e909-4125-a92b-2eee59410200 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:24.586906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1051-e909-4125-a92b-2eee59410200 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:24.587474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1051-e909-4125-a92b-2eee59410200 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/77fd10857dd145fcac0fb4a51a54b9a6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:24.589436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454af10-fa61-45fd-bd7a-3e39fa869602 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:24.590841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c1051-e909-4125-a92b-2eee59410200 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_role(role_id=77fd10857dd145fcac0fb4a51a54b9a6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:24.597306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c1051-e909-4125-a92b-2eee59410200 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:24.613792 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2499/5027] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:24.678765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ef5c1051-e909-4125-a92b-2eee59410200 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role 77fd10857dd145fcac0fb4a51a54b9a6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:24.680533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ef5c1051-e909-4125-a92b-2eee59410200 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.693591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ef5c1051-e909-4125-a92b-2eee59410200 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.699992 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2529/5028] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:24 2022] DELETE /identity/v3/roles/77fd10857dd145fcac0fb4a51a54b9a6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:24.701272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454af10-fa61-45fd-bd7a-3e39fa869602 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:24.718381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454af10-fa61-45fd-bd7a-3e39fa869602 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:24.810084 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:24.833167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c45b6f-4409-42be-a0e2-b3c4f7d1a5dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:24.834670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c45b6f-4409-42be-a0e2-b3c4f7d1a5dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:24.839431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c45b6f-4409-42be-a0e2-b3c4f7d1a5dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:24.839718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c45b6f-4409-42be-a0e2-b3c4f7d1a5dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/fa93199e39094e469355c620cdb83603` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:24.843239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c45b6f-4409-42be-a0e2-b3c4f7d1a5dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fa93199e39094e469355c620cdb83603)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:24.845882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c45b6f-4409-42be-a0e2-b3c4f7d1a5dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:24.921172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77c45b6f-4409-42be-a0e2-b3c4f7d1a5dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role fa93199e39094e469355c620cdb83603 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:24.921447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77c45b6f-4409-42be-a0e2-b3c4f7d1a5dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.926258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-77c45b6f-4409-42be-a0e2-b3c4f7d1a5dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:24.928659 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2500/5029] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:24 2022] DELETE /identity/v3/roles/fa93199e39094e469355c620cdb83603 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:24.933405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c1051-e909-4125-a92b-2eee59410200 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:24.935181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ef5c1051-e909-4125-a92b-2eee59410200 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:24.953812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c1051-e909-4125-a92b-2eee59410200 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:24.966034 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:25.103942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ea106-9de8-4ecb-a205-f7d71fd56245 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cdd1714da0544978aa50896aa4cc9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c65b03d77a664c7480e7deb30793d5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:25.104601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ea106-9de8-4ecb-a205-f7d71fd56245 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:25.104882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ea106-9de8-4ecb-a205-f7d71fd56245 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:25.105259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ea106-9de8-4ecb-a205-f7d71fd56245 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] PATH_INFO: `/v3/roles/c80682ad7c424b1bb2e04b6e0b419754` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:25.110997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ea106-9de8-4ecb-a205-f7d71fd56245 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c80682ad7c424b1bb2e04b6e0b419754)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:25.116236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ea106-9de8-4ecb-a205-f7d71fd56245 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:25.209768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b22ea106-9de8-4ecb-a205-f7d71fd56245 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invalidating the token cache because role c80682ad7c424b1bb2e04b6e0b419754 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:25.210120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b22ea106-9de8-4ecb-a205-f7d71fd56245 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:25.211270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b22ea106-9de8-4ecb-a205-f7d71fd56245 tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:25.213880 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2530/5030] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:24 2022] DELETE /identity/v3/roles/c80682ad7c424b1bb2e04b6e0b419754 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:25.217913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c45b6f-4409-42be-a0e2-b3c4f7d1a5dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:25.219381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-77c45b6f-4409-42be-a0e2-b3c4f7d1a5dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:25.349261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c45b6f-4409-42be-a0e2-b3c4f7d1a5dc tempest-RolesV3TestJSON-1397143168 tempest-RolesV3TestJSON-1397143168-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:25.450871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:25.452915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:25.453479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:25.454019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] PATH_INFO: `/v3/users/30285667ffca4114855e88dce5cad3d7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:25.470843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] RBAC: Authorizing `identity:delete_user(user_id=30285667ffca4114855e88dce5cad3d7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:25.475833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:25.644884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30285667ffca4114855e88dce5cad3d7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:25.647617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30285667ffca4114855e88dce5cad3d7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:25.663177 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:25.694232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30285667ffca4114855e88dce5cad3d7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:25.717978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30285667ffca4114855e88dce5cad3d7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:25.718603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30285667ffca4114855e88dce5cad3d7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:25.747652 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2501/5031] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:25 2022] DELETE /identity/v3/users/30285667ffca4114855e88dce5cad3d7 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:25.752151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e537b-ae24-4654-9f2a-08647cc8b847 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:25.752694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e537b-ae24-4654-9f2a-08647cc8b847 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:25.752694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e537b-ae24-4654-9f2a-08647cc8b847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:25.799971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6a6e537b-ae24-4654-9f2a-08647cc8b847 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:25.802270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6a6e537b-ae24-4654-9f2a-08647cc8b847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:25.937256 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2531/5032] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:25.949355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:25.951031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:26.105981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd3363-bfda-4401-9355-4fcbfc18982f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:26.124206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176aaf7e-d16d-4623-96cd-f496fca0f234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:26.125175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aaf7e-d16d-4623-96cd-f496fca0f234 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:26.125678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aaf7e-d16d-4623-96cd-f496fca0f234 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:26.126192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aaf7e-d16d-4623-96cd-f496fca0f234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:26.144304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176aaf7e-d16d-4623-96cd-f496fca0f234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:26.153917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176aaf7e-d16d-4623-96cd-f496fca0f234 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:26.166706 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2502/5033] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:26.952151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e537b-ae24-4654-9f2a-08647cc8b847 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:26.953661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6a6e537b-ae24-4654-9f2a-08647cc8b847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:26.973729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e537b-ae24-4654-9f2a-08647cc8b847 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:26.984340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718144a-1ed6-4b68-9106-d2f7564695b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:26.984998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718144a-1ed6-4b68-9106-d2f7564695b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:26.985278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718144a-1ed6-4b68-9106-d2f7564695b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:26.985549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718144a-1ed6-4b68-9106-d2f7564695b0 admin admin] PATH_INFO: `/v3/projects/c6561d0d988449b7b166c6c8d3120ff3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:26.986692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718144a-1ed6-4b68-9106-d2f7564695b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6561d0d988449b7b166c6c8d3120ff3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:26.988744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718144a-1ed6-4b68-9106-d2f7564695b0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:27.067723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2718144a-1ed6-4b68-9106-d2f7564695b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6561d0d988449b7b166c6c8d3120ff3', 'request_id': 'req-2718144a-1ed6-4b68-9106-d2f7564695b0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:27.076917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2718144a-1ed6-4b68-9106-d2f7564695b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6561d0d988449b7b166c6c8d3120ff3', 'request_id': 'req-2718144a-1ed6-4b68-9106-d2f7564695b0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:27.097152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2718144a-1ed6-4b68-9106-d2f7564695b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6561d0d988449b7b166c6c8d3120ff3', 'request_id': 'req-2718144a-1ed6-4b68-9106-d2f7564695b0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:27.108111 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:27.120023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2718144a-1ed6-4b68-9106-d2f7564695b0 admin admin] The token cache is being invalidate because project c6561d0d988449b7b166c6c8d3120ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:27.121828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2718144a-1ed6-4b68-9106-d2f7564695b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:27.125135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2718144a-1ed6-4b68-9106-d2f7564695b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:27.127088 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2532/5034] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:26 2022] DELETE /identity/v3/projects/c6561d0d988449b7b166c6c8d3120ff3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:27.131334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176aaf7e-d16d-4623-96cd-f496fca0f234 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:27.142980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176aaf7e-d16d-4623-96cd-f496fca0f234 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:27.238171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:27.239353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:27.239883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:27.240380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] PATH_INFO: `/v3/users/9cdd1714da0544978aa50896aa4cc9b3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:27.241861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cdd1714da0544978aa50896aa4cc9b3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:27.245006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:27.319968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cdd1714da0544978aa50896aa4cc9b3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:27.320748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cdd1714da0544978aa50896aa4cc9b3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:27.348341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cdd1714da0544978aa50896aa4cc9b3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:27.365478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cdd1714da0544978aa50896aa4cc9b3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:27.378688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cdd1714da0544978aa50896aa4cc9b3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:27.409187 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:27.427009 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2503/5035] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:27 2022] DELETE /identity/v3/users/9cdd1714da0544978aa50896aa4cc9b3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:27.543296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f146c-1e60-4a8e-846b-1c52bbf6b6fc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:27.543894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f146c-1e60-4a8e-846b-1c52bbf6b6fc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:27.544330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f146c-1e60-4a8e-846b-1c52bbf6b6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:27.629038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2d7f146c-1e60-4a8e-846b-1c52bbf6b6fc None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:27.631890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2d7f146c-1e60-4a8e-846b-1c52bbf6b6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:27.754140 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2533/5036] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:27.768573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:27.770199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:27.952812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f146c-1e60-4a8e-846b-1c52bbf6b6fc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:27.954240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2d7f146c-1e60-4a8e-846b-1c52bbf6b6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:27.978469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d29c26-bbae-4618-8cbe-620dda09aab9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:27.994530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a9a0b-0282-4a9a-b15b-2cf1d2a5ccf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:27.994530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a9a0b-0282-4a9a-b15b-2cf1d2a5ccf6 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:27.994530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a9a0b-0282-4a9a-b15b-2cf1d2a5ccf6 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:27.994530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a9a0b-0282-4a9a-b15b-2cf1d2a5ccf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:28.012085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a9a0b-0282-4a9a-b15b-2cf1d2a5ccf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:28.034445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a9a0b-0282-4a9a-b15b-2cf1d2a5ccf6 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:28.052926 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2504/5037] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:24:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:24:28.121932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f146c-1e60-4a8e-846b-1c52bbf6b6fc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:28.131782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526ba87-66be-4f58-bf12-c8d4384db1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:28.132762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526ba87-66be-4f58-bf12-c8d4384db1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:28.133590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526ba87-66be-4f58-bf12-c8d4384db1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:28.134094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526ba87-66be-4f58-bf12-c8d4384db1fa admin admin] PATH_INFO: `/v3/projects/c65b03d77a664c7480e7deb30793d5a3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:28.139075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526ba87-66be-4f58-bf12-c8d4384db1fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65b03d77a664c7480e7deb30793d5a3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:28.141335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526ba87-66be-4f58-bf12-c8d4384db1fa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:28.239608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7526ba87-66be-4f58-bf12-c8d4384db1fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65b03d77a664c7480e7deb30793d5a3', 'request_id': 'req-7526ba87-66be-4f58-bf12-c8d4384db1fa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:28.263685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7526ba87-66be-4f58-bf12-c8d4384db1fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65b03d77a664c7480e7deb30793d5a3', 'request_id': 'req-7526ba87-66be-4f58-bf12-c8d4384db1fa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:28.274722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7526ba87-66be-4f58-bf12-c8d4384db1fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65b03d77a664c7480e7deb30793d5a3', 'request_id': 'req-7526ba87-66be-4f58-bf12-c8d4384db1fa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:28.292957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7526ba87-66be-4f58-bf12-c8d4384db1fa admin admin] The token cache is being invalidate because project c65b03d77a664c7480e7deb30793d5a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:28.293306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7526ba87-66be-4f58-bf12-c8d4384db1fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:28.295573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7526ba87-66be-4f58-bf12-c8d4384db1fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:28.301187 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2534/5038] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:27 2022] DELETE /identity/v3/projects/c65b03d77a664c7480e7deb30793d5a3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:28.302803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc738ac-7a9d-45b3-b37a-29d1f1f8aa7c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:28.303307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc738ac-7a9d-45b3-b37a-29d1f1f8aa7c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:28.303543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc738ac-7a9d-45b3-b37a-29d1f1f8aa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:28.364089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5dc738ac-7a9d-45b3-b37a-29d1f1f8aa7c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:28.368672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5dc738ac-7a9d-45b3-b37a-29d1f1f8aa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:28.539202 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2505/5039] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:28.551573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cc031-9dcd-478c-968e-31d924899609 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:28.551865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cc031-9dcd-478c-968e-31d924899609 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:28.552286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cc031-9dcd-478c-968e-31d924899609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:28.624486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b31cc031-9dcd-478c-968e-31d924899609 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:28.625730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b31cc031-9dcd-478c-968e-31d924899609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:28.653073 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2535/5040] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:28.656963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc738ac-7a9d-45b3-b37a-29d1f1f8aa7c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:28.673127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc738ac-7a9d-45b3-b37a-29d1f1f8aa7c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:28.683981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f8184-b262-482e-b21f-cd2b001566bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:28.705914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f8184-b262-482e-b21f-cd2b001566bf admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:28.706406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f8184-b262-482e-b21f-cd2b001566bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:28.706763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f8184-b262-482e-b21f-cd2b001566bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:28.707693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f8184-b262-482e-b21f-cd2b001566bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:28.709931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f8184-b262-482e-b21f-cd2b001566bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:28.715803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f8184-b262-482e-b21f-cd2b001566bf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:28.764515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cc031-9dcd-478c-968e-31d924899609 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:28.770316 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2506/5041] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:28.775651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cc031-9dcd-478c-968e-31d924899609 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:28.787260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4695c-eaee-4e75-9f12-55a03fe012d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:28.788027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4695c-eaee-4e75-9f12-55a03fe012d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:28.788416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4695c-eaee-4e75-9f12-55a03fe012d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:28.788945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4695c-eaee-4e75-9f12-55a03fe012d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:28.789923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4695c-eaee-4e75-9f12-55a03fe012d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:28.797679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4695c-eaee-4e75-9f12-55a03fe012d0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:28.842394 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2536/5042] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:28 2022] POST /identity/v3/projects => generated 393 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:28.843913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f8184-b262-482e-b21f-cd2b001566bf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:28.857825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f8184-b262-482e-b21f-cd2b001566bf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:28.968852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5cbc3-8136-4e93-b792-79a3df8e655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:28.969705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5cbc3-8136-4e93-b792-79a3df8e655b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:28.970116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5cbc3-8136-4e93-b792-79a3df8e655b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:28.970477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5cbc3-8136-4e93-b792-79a3df8e655b admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:28.971447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5cbc3-8136-4e93-b792-79a3df8e655b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:28.976062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5cbc3-8136-4e93-b792-79a3df8e655b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:29.043272 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2507/5043] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:28 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:29.044785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4695c-eaee-4e75-9f12-55a03fe012d0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:29.060075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4695c-eaee-4e75-9f12-55a03fe012d0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:29.072858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ec801-e28d-42f1-af3a-8d808e72954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:29.073914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ec801-e28d-42f1-af3a-8d808e72954c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:29.074542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ec801-e28d-42f1-af3a-8d808e72954c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:29.075048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ec801-e28d-42f1-af3a-8d808e72954c admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:29.075937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ec801-e28d-42f1-af3a-8d808e72954c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:29.080610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ec801-e28d-42f1-af3a-8d808e72954c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:29.086204 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:29.153753 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2537/5044] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:29.157781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5cbc3-8136-4e93-b792-79a3df8e655b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:29.175960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5cbc3-8136-4e93-b792-79a3df8e655b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:29.183972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4bd70-22a3-4990-a060-d3aca733931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:29.186215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4bd70-22a3-4990-a060-d3aca733931e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:29.186739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4bd70-22a3-4990-a060-d3aca733931e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:29.188097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4bd70-22a3-4990-a060-d3aca733931e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:29.189003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4bd70-22a3-4990-a060-d3aca733931e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:29.192037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4bd70-22a3-4990-a060-d3aca733931e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:29.195724 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:29.241625 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2508/5045] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:24:29.247081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ec801-e28d-42f1-af3a-8d808e72954c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:29.262821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ec801-e28d-42f1-af3a-8d808e72954c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:29.293322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d9965-b5d3-43ee-8c3b-2d51463575a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:29.294012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d9965-b5d3-43ee-8c3b-2d51463575a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:29.294298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d9965-b5d3-43ee-8c3b-2d51463575a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:29.294877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d9965-b5d3-43ee-8c3b-2d51463575a0 admin admin] PATH_INFO: `/v3/projects/1bbf630bb25a481e8b26ab8a2d14cd15/users/198198996c2d4b1ab702223acef7f090/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:29.372782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d9965-b5d3-43ee-8c3b-2d51463575a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbf630bb25a481e8b26ab8a2d14cd15, user_id=198198996c2d4b1ab702223acef7f090, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:29.375580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d9965-b5d3-43ee-8c3b-2d51463575a0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:29.419630 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2538/5046] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:29 2022] PUT /identity/v3/projects/1bbf630bb25a481e8b26ab8a2d14cd15/users/198198996c2d4b1ab702223acef7f090/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:29.430210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c59760-d86f-47ea-b1f7-bedbe7e825e7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:29.430787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c59760-d86f-47ea-b1f7-bedbe7e825e7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:29.430787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c59760-d86f-47ea-b1f7-bedbe7e825e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:29.515592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f2c59760-d86f-47ea-b1f7-bedbe7e825e7 None None] MFA Rules not processed for user `198198996c2d4b1ab702223acef7f090`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:29.520488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f2c59760-d86f-47ea-b1f7-bedbe7e825e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:29.819314 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2509/5047] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:29.825089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d9965-b5d3-43ee-8c3b-2d51463575a0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:29.856815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d9965-b5d3-43ee-8c3b-2d51463575a0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:29.885294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839846f7-42d2-49aa-9e1c-d60ab354b424 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:29.885960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839846f7-42d2-49aa-9e1c-d60ab354b424 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:29.886256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839846f7-42d2-49aa-9e1c-d60ab354b424 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:29.886519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839846f7-42d2-49aa-9e1c-d60ab354b424 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:29.887219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839846f7-42d2-49aa-9e1c-d60ab354b424 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:create_application_credential(user_id=198198996c2d4b1ab702223acef7f090)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:29.888377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839846f7-42d2-49aa-9e1c-d60ab354b424 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:30.084964 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2539/5048] 10.222.0.39 () {60 vars in 1314 bytes} [Sun Oct 16 01:24:29 2022] POST /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials => generated 789 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:30.089411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c59760-d86f-47ea-b1f7-bedbe7e825e7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:30.120323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c59760-d86f-47ea-b1f7-bedbe7e825e7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:30.139268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd9864-ab97-4df0-b6ba-b1aeba94a512 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:30.142932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd9864-ab97-4df0-b6ba-b1aeba94a512 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:30.143217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd9864-ab97-4df0-b6ba-b1aeba94a512 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:30.143496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd9864-ab97-4df0-b6ba-b1aeba94a512 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/00a5784f2ad9470c907a7518dc1fdcb5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:30.185427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd9864-ab97-4df0-b6ba-b1aeba94a512 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:get_application_credential(user_id=198198996c2d4b1ab702223acef7f090, application_credential_id=00a5784f2ad9470c907a7518dc1fdcb5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:30.187430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd9864-ab97-4df0-b6ba-b1aeba94a512 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:30.197109 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2510/5049] 10.222.0.39 () {58 vars in 1392 bytes} [Sun Oct 16 01:24:30 2022] GET /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/00a5784f2ad9470c907a7518dc1fdcb5 => generated 689 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:24:30.201235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf48eb-1b10-4ec6-be9d-bea4dfc5c1bf None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:30.201506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf48eb-1b10-4ec6-be9d-bea4dfc5c1bf None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:30.201990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf48eb-1b10-4ec6-be9d-bea4dfc5c1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:30.266562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7bdf48eb-1b10-4ec6-be9d-bea4dfc5c1bf None None] MFA Rules not processed for user `198198996c2d4b1ab702223acef7f090`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:30.274607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7bdf48eb-1b10-4ec6-be9d-bea4dfc5c1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:30.609326 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2540/5050] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Oct 16 01:24:30.610850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd9864-ab97-4df0-b6ba-b1aeba94a512 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:30.633853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd9864-ab97-4df0-b6ba-b1aeba94a512 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:30.643944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aab222-4223-4de8-a5b9-1b8d411ef7f8 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:30.644960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aab222-4223-4de8-a5b9-1b8d411ef7f8 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:30.645434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aab222-4223-4de8-a5b9-1b8d411ef7f8 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:30.645874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aab222-4223-4de8-a5b9-1b8d411ef7f8 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/00a5784f2ad9470c907a7518dc1fdcb5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:30.647398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aab222-4223-4de8-a5b9-1b8d411ef7f8 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:delete_application_credential(user_id=198198996c2d4b1ab702223acef7f090, application_credential_id=00a5784f2ad9470c907a7518dc1fdcb5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:30.649382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aab222-4223-4de8-a5b9-1b8d411ef7f8 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:30.693928 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2511/5051] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Oct 16 01:24:30 2022] DELETE /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/00a5784f2ad9470c907a7518dc1fdcb5 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:30.694952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf48eb-1b10-4ec6-be9d-bea4dfc5c1bf None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:30.710083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf48eb-1b10-4ec6-be9d-bea4dfc5c1bf None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:30.724799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f022c6-e3c9-4658-8785-1d5f40d88bf0 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:30.727053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f022c6-e3c9-4658-8785-1d5f40d88bf0 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:30.727334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f022c6-e3c9-4658-8785-1d5f40d88bf0 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:30.729211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f022c6-e3c9-4658-8785-1d5f40d88bf0 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:30.731742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f022c6-e3c9-4658-8785-1d5f40d88bf0 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:create_application_credential(user_id=198198996c2d4b1ab702223acef7f090)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:30.735127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f022c6-e3c9-4658-8785-1d5f40d88bf0 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:30.837757 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:31.035589 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2541/5052] 10.222.0.39 () {60 vars in 1315 bytes} [Sun Oct 16 01:24:30 2022] POST /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials => generated 920 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:31.037249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aab222-4223-4de8-a5b9-1b8d411ef7f8 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:31.049560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aab222-4223-4de8-a5b9-1b8d411ef7f8 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:31.073844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bf2b5-311f-4416-a2ea-401ea48042d3 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:31.077027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bf2b5-311f-4416-a2ea-401ea48042d3 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:31.077500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bf2b5-311f-4416-a2ea-401ea48042d3 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:31.077784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bf2b5-311f-4416-a2ea-401ea48042d3 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/ea20b7eb9b814597a8c5dfdf2a02db76` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:31.164953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bf2b5-311f-4416-a2ea-401ea48042d3 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:delete_application_credential(user_id=198198996c2d4b1ab702223acef7f090, application_credential_id=ea20b7eb9b814597a8c5dfdf2a02db76)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:31.183414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bf2b5-311f-4416-a2ea-401ea48042d3 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:31.247963 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2512/5053] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Oct 16 01:24:31 2022] DELETE /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/ea20b7eb9b814597a8c5dfdf2a02db76 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:31.253094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f022c6-e3c9-4658-8785-1d5f40d88bf0 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:31.272006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f022c6-e3c9-4658-8785-1d5f40d88bf0 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:31.298038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac58959-b85d-4c4b-a9ec-d51eac5e3403 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:31.298708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58959-b85d-4c4b-a9ec-d51eac5e3403 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:31.299016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58959-b85d-4c4b-a9ec-d51eac5e3403 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:31.299295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58959-b85d-4c4b-a9ec-d51eac5e3403 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:31.310808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac58959-b85d-4c4b-a9ec-d51eac5e3403 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:create_application_credential(user_id=198198996c2d4b1ab702223acef7f090)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:31.313961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac58959-b85d-4c4b-a9ec-d51eac5e3403 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:31.490195 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2542/5054] 10.222.0.39 () {60 vars in 1315 bytes} [Sun Oct 16 01:24:31 2022] POST /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials => generated 813 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:31.494209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bf2b5-311f-4416-a2ea-401ea48042d3 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:31.505089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bf2b5-311f-4416-a2ea-401ea48042d3 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:31.526979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2035542-90d6-48fe-be74-b8fcf58f933c tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:31.527639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2035542-90d6-48fe-be74-b8fcf58f933c tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:31.527924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2035542-90d6-48fe-be74-b8fcf58f933c tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:31.528198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2035542-90d6-48fe-be74-b8fcf58f933c tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/4e11a21efeeb457b985caf107051adb4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:31.539951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2035542-90d6-48fe-be74-b8fcf58f933c tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:delete_application_credential(user_id=198198996c2d4b1ab702223acef7f090, application_credential_id=4e11a21efeeb457b985caf107051adb4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:31.541538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2035542-90d6-48fe-be74-b8fcf58f933c tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:31.591887 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2513/5055] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Oct 16 01:24:31 2022] DELETE /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/4e11a21efeeb457b985caf107051adb4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:31.596627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac58959-b85d-4c4b-a9ec-d51eac5e3403 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:31.610789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac58959-b85d-4c4b-a9ec-d51eac5e3403 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:31.622967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a074ffd-d8d1-487e-bad8-287e80b42f28 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:31.623799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074ffd-d8d1-487e-bad8-287e80b42f28 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:31.624091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074ffd-d8d1-487e-bad8-287e80b42f28 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:31.624368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074ffd-d8d1-487e-bad8-287e80b42f28 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:31.625072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a074ffd-d8d1-487e-bad8-287e80b42f28 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:create_application_credential(user_id=198198996c2d4b1ab702223acef7f090)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:31.626488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a074ffd-d8d1-487e-bad8-287e80b42f28 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:31.815206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2035542-90d6-48fe-be74-b8fcf58f933c tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:31.815838 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2543/5056] 10.222.0.39 () {60 vars in 1314 bytes} [Sun Oct 16 01:24:31 2022] POST /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials => generated 789 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:31.830650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2035542-90d6-48fe-be74-b8fcf58f933c tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:31.836360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30038a7f-db90-48ff-9f98-9722ea2ea9d9 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:31.837905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30038a7f-db90-48ff-9f98-9722ea2ea9d9 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:31.838300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30038a7f-db90-48ff-9f98-9722ea2ea9d9 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:31.838688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30038a7f-db90-48ff-9f98-9722ea2ea9d9 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:31.841586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30038a7f-db90-48ff-9f98-9722ea2ea9d9 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:create_application_credential(user_id=198198996c2d4b1ab702223acef7f090)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:31.844207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30038a7f-db90-48ff-9f98-9722ea2ea9d9 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:31.931846 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:32.005839 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2514/5057] 10.222.0.39 () {60 vars in 1314 bytes} [Sun Oct 16 01:24:31 2022] POST /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials => generated 788 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:32.014090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a074ffd-d8d1-487e-bad8-287e80b42f28 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:32.041228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a074ffd-d8d1-487e-bad8-287e80b42f28 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:32.046472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183423c1-e8fb-4741-ba81-df8755ce0865 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:32.047579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183423c1-e8fb-4741-ba81-df8755ce0865 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:32.048251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183423c1-e8fb-4741-ba81-df8755ce0865 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:32.048772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183423c1-e8fb-4741-ba81-df8755ce0865 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:32.049722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183423c1-e8fb-4741-ba81-df8755ce0865 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:list_application_credentials(user_id=198198996c2d4b1ab702223acef7f090)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:32.051799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183423c1-e8fb-4741-ba81-df8755ce0865 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:32.092641 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2544/5058] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Oct 16 01:24:32 2022] GET /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials => generated 1501 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:32.094785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30038a7f-db90-48ff-9f98-9722ea2ea9d9 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:32.106098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30038a7f-db90-48ff-9f98-9722ea2ea9d9 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:32.113535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88a3f3-4b8a-422b-a4bc-153cc613f690 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:32.114568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a3f3-4b8a-422b-a4bc-153cc613f690 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:32.115112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a3f3-4b8a-422b-a4bc-153cc613f690 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:32.115633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a3f3-4b8a-422b-a4bc-153cc613f690 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/f9224ef6eba940aebbc7d7a7d76496dd` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:32.135387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88a3f3-4b8a-422b-a4bc-153cc613f690 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:delete_application_credential(user_id=198198996c2d4b1ab702223acef7f090, application_credential_id=f9224ef6eba940aebbc7d7a7d76496dd)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:32.145945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88a3f3-4b8a-422b-a4bc-153cc613f690 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:32.204884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183423c1-e8fb-4741-ba81-df8755ce0865 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:32.206852 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2515/5059] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Oct 16 01:24:32 2022] DELETE /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/f9224ef6eba940aebbc7d7a7d76496dd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:32.218141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183423c1-e8fb-4741-ba81-df8755ce0865 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:32.236994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a03dcf-0e72-45ca-b32a-e17ef865e33d tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:32.238500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a03dcf-0e72-45ca-b32a-e17ef865e33d tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:32.241575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a03dcf-0e72-45ca-b32a-e17ef865e33d tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:32.242804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a03dcf-0e72-45ca-b32a-e17ef865e33d tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/aea714a1a1be4487aed05ffc3a49a2dd` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:32.273649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a03dcf-0e72-45ca-b32a-e17ef865e33d tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:delete_application_credential(user_id=198198996c2d4b1ab702223acef7f090, application_credential_id=aea714a1a1be4487aed05ffc3a49a2dd)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:32.275547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a03dcf-0e72-45ca-b32a-e17ef865e33d tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:32.292350 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:32.324103 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2545/5060] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Oct 16 01:24:32 2022] DELETE /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/aea714a1a1be4487aed05ffc3a49a2dd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:32.329356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88a3f3-4b8a-422b-a4bc-153cc613f690 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:32.341493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88a3f3-4b8a-422b-a4bc-153cc613f690 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:32.356478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5342ac9-66d2-4ed5-a4e8-7d6329990a24 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:32.357131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5342ac9-66d2-4ed5-a4e8-7d6329990a24 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:32.357407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5342ac9-66d2-4ed5-a4e8-7d6329990a24 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:32.357677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5342ac9-66d2-4ed5-a4e8-7d6329990a24 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:32.358331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5342ac9-66d2-4ed5-a4e8-7d6329990a24 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:create_application_credential(user_id=198198996c2d4b1ab702223acef7f090)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:32.359657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5342ac9-66d2-4ed5-a4e8-7d6329990a24 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:32.553670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a03dcf-0e72-45ca-b32a-e17ef865e33d tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:32.558451 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2516/5061] 10.222.0.39 () {60 vars in 1314 bytes} [Sun Oct 16 01:24:32 2022] POST /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials => generated 788 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:32.590576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a03dcf-0e72-45ca-b32a-e17ef865e33d tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:32.647157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9761441-2aa3-4976-8dff-6ef05e9adcbc tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:32.647157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9761441-2aa3-4976-8dff-6ef05e9adcbc tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:32.647157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9761441-2aa3-4976-8dff-6ef05e9adcbc tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:32.647817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9761441-2aa3-4976-8dff-6ef05e9adcbc tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:32.647817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9761441-2aa3-4976-8dff-6ef05e9adcbc tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:create_application_credential(user_id=198198996c2d4b1ab702223acef7f090)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:32.647817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9761441-2aa3-4976-8dff-6ef05e9adcbc tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:32.797669 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2546/5062] 10.222.0.39 () {60 vars in 1314 bytes} [Sun Oct 16 01:24:32 2022] POST /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials => generated 788 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:32.803226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5342ac9-66d2-4ed5-a4e8-7d6329990a24 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:32.818963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5342ac9-66d2-4ed5-a4e8-7d6329990a24 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:32.846262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c4a42-8dc5-44bd-ba77-bc8809f01ca6 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:32.847299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c4a42-8dc5-44bd-ba77-bc8809f01ca6 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:32.847846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c4a42-8dc5-44bd-ba77-bc8809f01ca6 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:32.848394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c4a42-8dc5-44bd-ba77-bc8809f01ca6 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:32.849322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c4a42-8dc5-44bd-ba77-bc8809f01ca6 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Adding query filter params (name=tempest-application_credential-104711336) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:32.849885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c4a42-8dc5-44bd-ba77-bc8809f01ca6 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:list_application_credentials(user_id=198198996c2d4b1ab702223acef7f090)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:32.856453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c4a42-8dc5-44bd-ba77-bc8809f01ca6 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:32.908552 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2517/5063] 10.222.0.39 () {58 vars in 1384 bytes} [Sun Oct 16 01:24:32 2022] GET /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials?name=tempest-application_credential-104711336 => generated 885 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:32.915458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9761441-2aa3-4976-8dff-6ef05e9adcbc tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:32.930867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9761441-2aa3-4976-8dff-6ef05e9adcbc tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:32.940218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e0a65-f6de-4d0f-905d-830eeb91789a tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:32.940884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e0a65-f6de-4d0f-905d-830eeb91789a tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:32.941163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e0a65-f6de-4d0f-905d-830eeb91789a tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:32.941440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e0a65-f6de-4d0f-905d-830eeb91789a tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/6e3d94f4ea41434c867b0a82543abf38` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:32.962253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e0a65-f6de-4d0f-905d-830eeb91789a tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:delete_application_credential(user_id=198198996c2d4b1ab702223acef7f090, application_credential_id=6e3d94f4ea41434c867b0a82543abf38)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:32.963846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e0a65-f6de-4d0f-905d-830eeb91789a tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:33.000562 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2547/5064] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Oct 16 01:24:32 2022] DELETE /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/6e3d94f4ea41434c867b0a82543abf38 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:33.004804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c4a42-8dc5-44bd-ba77-bc8809f01ca6 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:33.019865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c4a42-8dc5-44bd-ba77-bc8809f01ca6 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:33.032864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f05e62-ab02-4484-bd23-8dd23b59cb58 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198198996c2d4b1ab702223acef7f090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbf630bb25a481e8b26ab8a2d14cd15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:33.045660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f05e62-ab02-4484-bd23-8dd23b59cb58 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:33.046289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f05e62-ab02-4484-bd23-8dd23b59cb58 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:33.046664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f05e62-ab02-4484-bd23-8dd23b59cb58 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/eb379351edb648b6805c7e122b2c0fd5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:33.079297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f05e62-ab02-4484-bd23-8dd23b59cb58 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorizing `identity:delete_application_credential(user_id=198198996c2d4b1ab702223acef7f090, application_credential_id=eb379351edb648b6805c7e122b2c0fd5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:33.085052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f05e62-ab02-4484-bd23-8dd23b59cb58 tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:33.172836 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2518/5065] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Oct 16 01:24:33 2022] DELETE /identity/v3/users/198198996c2d4b1ab702223acef7f090/application_credentials/eb379351edb648b6805c7e122b2c0fd5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:33.177393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e0a65-f6de-4d0f-905d-830eeb91789a tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:33.332475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e0a65-f6de-4d0f-905d-830eeb91789a tempest-ApplicationCredentialsV3Test-2084459813 tempest-ApplicationCredentialsV3Test-2084459813-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:33.376133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:33.386983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:33.386983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:33.386983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] PATH_INFO: `/v3/users/198198996c2d4b1ab702223acef7f090` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:33.386983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=198198996c2d4b1ab702223acef7f090)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:33.386983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:33.503365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '198198996c2d4b1ab702223acef7f090'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:33.508132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '198198996c2d4b1ab702223acef7f090'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:33.527465 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:33.550061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '198198996c2d4b1ab702223acef7f090'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:33.590349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '198198996c2d4b1ab702223acef7f090'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:33.598633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '198198996c2d4b1ab702223acef7f090'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:33.622752 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2548/5066] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:33 2022] DELETE /identity/v3/users/198198996c2d4b1ab702223acef7f090 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:33.628940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6e2a8-6c40-4d16-8124-20cdf6d89868 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:33.629404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6e2a8-6c40-4d16-8124-20cdf6d89868 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:33.629852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6e2a8-6c40-4d16-8124-20cdf6d89868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:33.659460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bfb6e2a8-6c40-4d16-8124-20cdf6d89868 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:33.660789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bfb6e2a8-6c40-4d16-8124-20cdf6d89868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:33.764345 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2519/5067] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:33.771218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:33.773219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:33.886835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26471324-5403-47c3-85d5-bb3731b0ab7e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:33.892232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a898c2-d6d7-4800-9fc3-c207291d62ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:33.893434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a898c2-d6d7-4800-9fc3-c207291d62ee service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:33.893892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a898c2-d6d7-4800-9fc3-c207291d62ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:33.894316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a898c2-d6d7-4800-9fc3-c207291d62ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:33.910758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a898c2-d6d7-4800-9fc3-c207291d62ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:33.914374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a898c2-d6d7-4800-9fc3-c207291d62ee service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:33.927854 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2549/5068] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:34.494425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6e2a8-6c40-4d16-8124-20cdf6d89868 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:34.500791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bfb6e2a8-6c40-4d16-8124-20cdf6d89868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:34.514465 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:34.543294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6e2a8-6c40-4d16-8124-20cdf6d89868 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:34.551293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4248de-6473-4307-9eed-f15178f88ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:34.552267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4248de-6473-4307-9eed-f15178f88ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:34.552717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4248de-6473-4307-9eed-f15178f88ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:34.553235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4248de-6473-4307-9eed-f15178f88ee0 admin admin] PATH_INFO: `/v3/projects/1bbf630bb25a481e8b26ab8a2d14cd15` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:34.554829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4248de-6473-4307-9eed-f15178f88ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bbf630bb25a481e8b26ab8a2d14cd15)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:34.557648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4248de-6473-4307-9eed-f15178f88ee0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:34.644175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd4248de-6473-4307-9eed-f15178f88ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bbf630bb25a481e8b26ab8a2d14cd15', 'request_id': 'req-dd4248de-6473-4307-9eed-f15178f88ee0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:34.653972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd4248de-6473-4307-9eed-f15178f88ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bbf630bb25a481e8b26ab8a2d14cd15', 'request_id': 'req-dd4248de-6473-4307-9eed-f15178f88ee0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:34.671512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd4248de-6473-4307-9eed-f15178f88ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bbf630bb25a481e8b26ab8a2d14cd15', 'request_id': 'req-dd4248de-6473-4307-9eed-f15178f88ee0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:34.686436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd4248de-6473-4307-9eed-f15178f88ee0 admin admin] The token cache is being invalidate because project 1bbf630bb25a481e8b26ab8a2d14cd15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:34.686990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd4248de-6473-4307-9eed-f15178f88ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:34.687658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd4248de-6473-4307-9eed-f15178f88ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:34.689721 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2520/5069] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:34 2022] DELETE /identity/v3/projects/1bbf630bb25a481e8b26ab8a2d14cd15 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:34.696491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d018d6-d791-480a-85b1-43721b7b0cd7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:34.697046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d018d6-d791-480a-85b1-43721b7b0cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:34.697263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d018d6-d791-480a-85b1-43721b7b0cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:34.726875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d2d018d6-d791-480a-85b1-43721b7b0cd7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:34.728689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d2d018d6-d791-480a-85b1-43721b7b0cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:34.845500 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2550/5070] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:34.846570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4088-c32d-4b56-9872-1f13bc93c19a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:34.846859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4088-c32d-4b56-9872-1f13bc93c19a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:34.847156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4088-c32d-4b56-9872-1f13bc93c19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:34.885956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-97db4088-c32d-4b56-9872-1f13bc93c19a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:34.887205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-97db4088-c32d-4b56-9872-1f13bc93c19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:34.900485 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2521/5071] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:34.902945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d018d6-d791-480a-85b1-43721b7b0cd7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:34.915729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d018d6-d791-480a-85b1-43721b7b0cd7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:34.923086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdb25b-7d90-4d19-be4d-27c632835b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:34.924084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb25b-7d90-4d19-be4d-27c632835b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:34.924581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb25b-7d90-4d19-be4d-27c632835b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:34.925372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb25b-7d90-4d19-be4d-27c632835b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:34.926347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdb25b-7d90-4d19-be4d-27c632835b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:34.926881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdb25b-7d90-4d19-be4d-27c632835b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:34.947724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdb25b-7d90-4d19-be4d-27c632835b53 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:34.972952 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2551/5072] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:34.974720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db4088-c32d-4b56-9872-1f13bc93c19a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:34.985133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db4088-c32d-4b56-9872-1f13bc93c19a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:34.990892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae8fd-365e-4a22-b8b7-c163de99dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:34.991297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae8fd-365e-4a22-b8b7-c163de99dc8f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:34.991541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae8fd-365e-4a22-b8b7-c163de99dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:34.992335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae8fd-365e-4a22-b8b7-c163de99dc8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:34.993103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ae8fd-365e-4a22-b8b7-c163de99dc8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:34.995589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ae8fd-365e-4a22-b8b7-c163de99dc8f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:35.051536 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2522/5073] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:34 2022] POST /identity/v3/projects => generated 395 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:35.051947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdb25b-7d90-4d19-be4d-27c632835b53 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:35.068122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdb25b-7d90-4d19-be4d-27c632835b53 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:35.214231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65634216-e437-4134-a7b9-7a84aac87a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:35.215510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65634216-e437-4134-a7b9-7a84aac87a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:35.215510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65634216-e437-4134-a7b9-7a84aac87a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:35.215713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65634216-e437-4134-a7b9-7a84aac87a01 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:35.216625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65634216-e437-4134-a7b9-7a84aac87a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:35.219460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65634216-e437-4134-a7b9-7a84aac87a01 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:35.235730 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:35.257086 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2552/5074] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:35 2022] POST /identity/v3/users => generated 304 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:35.260580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae8fd-365e-4a22-b8b7-c163de99dc8f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:35.271841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae8fd-365e-4a22-b8b7-c163de99dc8f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:35.294669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61c4c2-c75c-4e9e-a5c2-28a4b6ec5b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:35.295345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c4c2-c75c-4e9e-a5c2-28a4b6ec5b1c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:35.295769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c4c2-c75c-4e9e-a5c2-28a4b6ec5b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:35.296048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c4c2-c75c-4e9e-a5c2-28a4b6ec5b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:35.296692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61c4c2-c75c-4e9e-a5c2-28a4b6ec5b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:35.298367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61c4c2-c75c-4e9e-a5c2-28a4b6ec5b1c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:35.325373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65634216-e437-4134-a7b9-7a84aac87a01 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:35.341995 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2523/5075] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:35.358904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65634216-e437-4134-a7b9-7a84aac87a01 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:35.366934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfa350-6696-4b8c-89c6-2ce6fa8c4796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:35.368074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfa350-6696-4b8c-89c6-2ce6fa8c4796 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:35.368353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfa350-6696-4b8c-89c6-2ce6fa8c4796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:35.368624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfa350-6696-4b8c-89c6-2ce6fa8c4796 admin admin] PATH_INFO: `/v3/projects/adb6d7f1c6d740df9ad2eb21892c72ff/users/be7872a96a18483eb543fb4bb58b0bff/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:35.388222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfa350-6696-4b8c-89c6-2ce6fa8c4796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb6d7f1c6d740df9ad2eb21892c72ff, user_id=be7872a96a18483eb543fb4bb58b0bff, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:35.391139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfa350-6696-4b8c-89c6-2ce6fa8c4796 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:35.411615 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2553/5076] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:35 2022] PUT /identity/v3/projects/adb6d7f1c6d740df9ad2eb21892c72ff/users/be7872a96a18483eb543fb4bb58b0bff/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:35.416209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61c4c2-c75c-4e9e-a5c2-28a4b6ec5b1c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:35.427129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61c4c2-c75c-4e9e-a5c2-28a4b6ec5b1c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:35.534240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc609b22-a26c-44e9-bca2-bb4163d333a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:35.536282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc609b22-a26c-44e9-bca2-bb4163d333a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:35.536761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc609b22-a26c-44e9-bca2-bb4163d333a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:35.537197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc609b22-a26c-44e9-bca2-bb4163d333a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:35.538947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc609b22-a26c-44e9-bca2-bb4163d333a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:35.542205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc609b22-a26c-44e9-bca2-bb4163d333a8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:35.558714 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2524/5077] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:35.561188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfa350-6696-4b8c-89c6-2ce6fa8c4796 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:35.573554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfa350-6696-4b8c-89c6-2ce6fa8c4796 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:35.585669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051100ad-f480-47df-b87d-6220fafdf7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:35.586732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051100ad-f480-47df-b87d-6220fafdf7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:35.590628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051100ad-f480-47df-b87d-6220fafdf7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:35.590875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051100ad-f480-47df-b87d-6220fafdf7c7 admin admin] PATH_INFO: `/v3/projects/adb6d7f1c6d740df9ad2eb21892c72ff/users/be7872a96a18483eb543fb4bb58b0bff/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:35.596881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051100ad-f480-47df-b87d-6220fafdf7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb6d7f1c6d740df9ad2eb21892c72ff, user_id=be7872a96a18483eb543fb4bb58b0bff, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:35.599285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051100ad-f480-47df-b87d-6220fafdf7c7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:35.623137 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2554/5078] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:35 2022] PUT /identity/v3/projects/adb6d7f1c6d740df9ad2eb21892c72ff/users/be7872a96a18483eb543fb4bb58b0bff/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:35.624496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a015e-09c4-40a6-9653-cb7d41c25821 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:35.625015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a015e-09c4-40a6-9653-cb7d41c25821 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:35.626157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a015e-09c4-40a6-9653-cb7d41c25821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:35.672605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e09a015e-09c4-40a6-9653-cb7d41c25821 None None] MFA Rules not processed for user `be7872a96a18483eb543fb4bb58b0bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:35.673736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e09a015e-09c4-40a6-9653-cb7d41c25821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:35.717416 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:35.766285 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2525/5079] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:35.770686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051100ad-f480-47df-b87d-6220fafdf7c7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:35.851924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051100ad-f480-47df-b87d-6220fafdf7c7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:35.857533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bd396-1227-4de6-9f71-160d145620b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:35.858146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd396-1227-4de6-9f71-160d145620b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:35.858427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd396-1227-4de6-9f71-160d145620b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:35.858709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd396-1227-4de6-9f71-160d145620b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:35.859381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bd396-1227-4de6-9f71-160d145620b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:35.863055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bd396-1227-4de6-9f71-160d145620b7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:35.894350 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2555/5080] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:35 2022] POST /identity/v3/projects => generated 395 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:35.898359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a015e-09c4-40a6-9653-cb7d41c25821 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:35.910368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a015e-09c4-40a6-9653-cb7d41c25821 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:35.983153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1c168-17e6-4b54-ac00-1af9e46d8c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:35.983774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1c168-17e6-4b54-ac00-1af9e46d8c7d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:35.984054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1c168-17e6-4b54-ac00-1af9e46d8c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:35.984330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1c168-17e6-4b54-ac00-1af9e46d8c7d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:35.986031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1c168-17e6-4b54-ac00-1af9e46d8c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:35.986900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1c168-17e6-4b54-ac00-1af9e46d8c7d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:36.015909 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2526/5081] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:35 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:36.020844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bd396-1227-4de6-9f71-160d145620b7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:36.036079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bd396-1227-4de6-9f71-160d145620b7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:36.044050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf4d1b-7d24-4bf6-9933-08fffb91198e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:36.045173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf4d1b-7d24-4bf6-9933-08fffb91198e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:36.045661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf4d1b-7d24-4bf6-9933-08fffb91198e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:36.046406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf4d1b-7d24-4bf6-9933-08fffb91198e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:36.047331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf4d1b-7d24-4bf6-9933-08fffb91198e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:36.049365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf4d1b-7d24-4bf6-9933-08fffb91198e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:36.064813 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2556/5082] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:36.070104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1c168-17e6-4b54-ac00-1af9e46d8c7d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:36.084528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1c168-17e6-4b54-ac00-1af9e46d8c7d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:36.097650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91c107-e7c4-4dff-b1cb-e9b64e0050f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:36.098284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91c107-e7c4-4dff-b1cb-e9b64e0050f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:36.098627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91c107-e7c4-4dff-b1cb-e9b64e0050f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:36.098939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91c107-e7c4-4dff-b1cb-e9b64e0050f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:36.103723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91c107-e7c4-4dff-b1cb-e9b64e0050f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:36.105497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91c107-e7c4-4dff-b1cb-e9b64e0050f4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:36.129873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf4d1b-7d24-4bf6-9933-08fffb91198e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:36.131406 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2527/5083] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:36.143006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf4d1b-7d24-4bf6-9933-08fffb91198e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:36.149450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ce0b8-2a78-4753-aa48-408b3ea30a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:36.150119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ce0b8-2a78-4753-aa48-408b3ea30a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:36.150395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ce0b8-2a78-4753-aa48-408b3ea30a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:36.150676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ce0b8-2a78-4753-aa48-408b3ea30a69 admin admin] PATH_INFO: `/v3/projects/be19dfd7c8b9474384e5bd84c0219f5d/users/dad85881affe48a6976539d0428c9f36/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:36.166875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ce0b8-2a78-4753-aa48-408b3ea30a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be19dfd7c8b9474384e5bd84c0219f5d, user_id=dad85881affe48a6976539d0428c9f36, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:36.169594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ce0b8-2a78-4753-aa48-408b3ea30a69 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:36.190950 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2557/5084] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:36 2022] PUT /identity/v3/projects/be19dfd7c8b9474384e5bd84c0219f5d/users/dad85881affe48a6976539d0428c9f36/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:36.201830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecf7f9-740a-4592-8814-0a352be32d4d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:36.202106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecf7f9-740a-4592-8814-0a352be32d4d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:36.202388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecf7f9-740a-4592-8814-0a352be32d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:36.235719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4cecf7f9-740a-4592-8814-0a352be32d4d None None] MFA Rules not processed for user `dad85881affe48a6976539d0428c9f36`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:36.236830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4cecf7f9-740a-4592-8814-0a352be32d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:36.319371 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2528/5085] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:36.333115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ce0b8-2a78-4753-aa48-408b3ea30a69 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:36.334880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-de5ce0b8-2a78-4753-aa48-408b3ea30a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:36.459497 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:36.472364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ce0b8-2a78-4753-aa48-408b3ea30a69 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:36.477211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e828e-45a2-4ce5-a34f-85f8b6c0945d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:36.477958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e828e-45a2-4ce5-a34f-85f8b6c0945d service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:36.478449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e828e-45a2-4ce5-a34f-85f8b6c0945d service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:36.478826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e828e-45a2-4ce5-a34f-85f8b6c0945d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:36.570584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e828e-45a2-4ce5-a34f-85f8b6c0945d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:36.572322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e828e-45a2-4ce5-a34f-85f8b6c0945d service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:36.594098 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2558/5086] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:36 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:37.378665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecf7f9-740a-4592-8814-0a352be32d4d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:37.499222 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:37.578819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecf7f9-740a-4592-8814-0a352be32d4d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:37.584657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:37.586788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:37.587133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:37.587415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] PATH_INFO: `/v3/users/be7872a96a18483eb543fb4bb58b0bff` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:37.588775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7872a96a18483eb543fb4bb58b0bff)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:37.604782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:37.720163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7872a96a18483eb543fb4bb58b0bff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:37.720942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7872a96a18483eb543fb4bb58b0bff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:37.762684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7872a96a18483eb543fb4bb58b0bff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:37.775907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7872a96a18483eb543fb4bb58b0bff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:37.776784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7872a96a18483eb543fb4bb58b0bff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:37.802381 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2529/5087] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:37 2022] DELETE /identity/v3/users/be7872a96a18483eb543fb4bb58b0bff => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:37.807595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9db74-3859-4101-8779-c82a6ce8d2bc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:37.808115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9db74-3859-4101-8779-c82a6ce8d2bc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:37.808223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9db74-3859-4101-8779-c82a6ce8d2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:37.832716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-56f9db74-3859-4101-8779-c82a6ce8d2bc None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:37.834045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-56f9db74-3859-4101-8779-c82a6ce8d2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:37.930878 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2559/5088] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:37.941364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:37.942806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:38.030337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472f7a0-7f06-404b-b002-7484410b6aa1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:38.057399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828a36a-94ce-40d3-836b-2f3dd2892842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:38.058136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828a36a-94ce-40d3-836b-2f3dd2892842 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:38.058412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828a36a-94ce-40d3-836b-2f3dd2892842 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:38.058789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828a36a-94ce-40d3-836b-2f3dd2892842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:38.084919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828a36a-94ce-40d3-836b-2f3dd2892842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:38.088020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828a36a-94ce-40d3-836b-2f3dd2892842 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:38.129829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead6b3b-3607-4423-8a94-ec57ce23a9ab None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:38.130206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead6b3b-3607-4423-8a94-ec57ce23a9ab None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:38.130484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead6b3b-3607-4423-8a94-ec57ce23a9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:38.138413 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2530/5089] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:38.170249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-aead6b3b-3607-4423-8a94-ec57ce23a9ab None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:38.176022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aead6b3b-3607-4423-8a94-ec57ce23a9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:38.307444 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2560/5090] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:24:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:38.334207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828a36a-94ce-40d3-836b-2f3dd2892842 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:38.338228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f828a36a-94ce-40d3-836b-2f3dd2892842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:38.465855 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:38.484874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828a36a-94ce-40d3-836b-2f3dd2892842 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:38.497456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c149f7-5b7d-4d32-a703-8e6ce1dc1004 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:38.498090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c149f7-5b7d-4d32-a703-8e6ce1dc1004 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:38.498374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c149f7-5b7d-4d32-a703-8e6ce1dc1004 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:38.498648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c149f7-5b7d-4d32-a703-8e6ce1dc1004 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:38.508940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c149f7-5b7d-4d32-a703-8e6ce1dc1004 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:38.510747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c149f7-5b7d-4d32-a703-8e6ce1dc1004 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:38.527356 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2531/5091] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:24:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:24:38.886494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead6b3b-3607-4423-8a94-ec57ce23a9ab None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:38.887997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aead6b3b-3607-4423-8a94-ec57ce23a9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:38.910267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead6b3b-3607-4423-8a94-ec57ce23a9ab None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:38.920950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:38.921855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:38.923133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:38.923540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] PATH_INFO: `/v3/projects/adb6d7f1c6d740df9ad2eb21892c72ff` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:38.925571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb6d7f1c6d740df9ad2eb21892c72ff)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:38.944569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:39.060331 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:39.086716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb6d7f1c6d740df9ad2eb21892c72ff', 'request_id': 'req-25a28329-cca2-402f-904e-37420bc611ef'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.102687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb6d7f1c6d740df9ad2eb21892c72ff', 'request_id': 'req-25a28329-cca2-402f-904e-37420bc611ef'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.129057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb6d7f1c6d740df9ad2eb21892c72ff', 'request_id': 'req-25a28329-cca2-402f-904e-37420bc611ef'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.151947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] The token cache is being invalidate because project adb6d7f1c6d740df9ad2eb21892c72ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:39.152348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.154206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.160268 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2561/5092] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:38 2022] DELETE /identity/v3/projects/adb6d7f1c6d740df9ad2eb21892c72ff => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:39.161711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c149f7-5b7d-4d32-a703-8e6ce1dc1004 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:39.182641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c149f7-5b7d-4d32-a703-8e6ce1dc1004 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:39.271289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:39.273550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:39.274775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fb8b4-b08f-454a-85e8-7d8f316c0699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:39.275340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fb8b4-b08f-454a-85e8-7d8f316c0699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:39.275603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fb8b4-b08f-454a-85e8-7d8f316c0699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:39.275872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fb8b4-b08f-454a-85e8-7d8f316c0699 admin admin] PATH_INFO: `/v3/users/dad85881affe48a6976539d0428c9f36` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:39.277142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fb8b4-b08f-454a-85e8-7d8f316c0699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad85881affe48a6976539d0428c9f36)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:39.279106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fb8b4-b08f-454a-85e8-7d8f316c0699 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:39.294140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a28329-cca2-402f-904e-37420bc611ef admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:39.310627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:39.311756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:39.312143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:39.312525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] PATH_INFO: `/v3/users/d6230942d9ee420a9c0c5fa203259f64` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:39.313819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6230942d9ee420a9c0c5fa203259f64)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:39.319020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:39.374109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a75fb8b4-b08f-454a-85e8-7d8f316c0699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad85881affe48a6976539d0428c9f36'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.374868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a75fb8b4-b08f-454a-85e8-7d8f316c0699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad85881affe48a6976539d0428c9f36'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.402221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a75fb8b4-b08f-454a-85e8-7d8f316c0699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad85881affe48a6976539d0428c9f36'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.403434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6230942d9ee420a9c0c5fa203259f64'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.404506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6230942d9ee420a9c0c5fa203259f64'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.416381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a75fb8b4-b08f-454a-85e8-7d8f316c0699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad85881affe48a6976539d0428c9f36'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.417839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a75fb8b4-b08f-454a-85e8-7d8f316c0699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad85881affe48a6976539d0428c9f36'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.441293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6230942d9ee420a9c0c5fa203259f64'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.446847 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2532/5093] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:39 2022] DELETE /identity/v3/users/dad85881affe48a6976539d0428c9f36 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:39.468186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6230942d9ee420a9c0c5fa203259f64'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.468966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6230942d9ee420a9c0c5fa203259f64'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:39.484512 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2562/5094] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:39 2022] DELETE /identity/v3/users/d6230942d9ee420a9c0c5fa203259f64 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:39.488847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a470190-9ca2-4ae6-8df6-0633bf2de230 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:39.489318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a470190-9ca2-4ae6-8df6-0633bf2de230 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:39.489448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a470190-9ca2-4ae6-8df6-0633bf2de230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:39.517491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8a470190-9ca2-4ae6-8df6-0633bf2de230 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:39.518845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8a470190-9ca2-4ae6-8df6-0633bf2de230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:39.635781 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2533/5095] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:39.642225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:39.643674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:39.721562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28f46c-ab5c-4008-9659-fe78996372fb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:39.728293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7185e67-ca43-41e6-a833-1100b34a1164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:39.729021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7185e67-ca43-41e6-a833-1100b34a1164 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:39.729298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7185e67-ca43-41e6-a833-1100b34a1164 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:39.730723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7185e67-ca43-41e6-a833-1100b34a1164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:39.753417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7185e67-ca43-41e6-a833-1100b34a1164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:39.755676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7185e67-ca43-41e6-a833-1100b34a1164 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:39.787471 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2563/5096] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:40.261524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a470190-9ca2-4ae6-8df6-0633bf2de230 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:40.263076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8a470190-9ca2-4ae6-8df6-0633bf2de230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:40.285491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a470190-9ca2-4ae6-8df6-0633bf2de230 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:40.293997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:40.294901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:40.295279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:40.295649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] PATH_INFO: `/v3/projects/be19dfd7c8b9474384e5bd84c0219f5d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:40.297138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] RBAC: Authorizing `identity:delete_project(project_id=be19dfd7c8b9474384e5bd84c0219f5d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:40.299320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:40.317864 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:40.394364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be19dfd7c8b9474384e5bd84c0219f5d', 'request_id': 'req-99e9b8d5-bf84-48ee-bda1-7904af52036d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:40.403617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be19dfd7c8b9474384e5bd84c0219f5d', 'request_id': 'req-99e9b8d5-bf84-48ee-bda1-7904af52036d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:40.419066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be19dfd7c8b9474384e5bd84c0219f5d', 'request_id': 'req-99e9b8d5-bf84-48ee-bda1-7904af52036d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:40.434206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] The token cache is being invalidate because project be19dfd7c8b9474384e5bd84c0219f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:40.434206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:40.435340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:40.445748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1c9f1-97bc-490f-a62a-81c2c2923bbd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:40.446823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1c9f1-97bc-490f-a62a-81c2c2923bbd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:40.447317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1c9f1-97bc-490f-a62a-81c2c2923bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:40.455280 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2534/5097] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:40 2022] DELETE /identity/v3/projects/be19dfd7c8b9474384e5bd84c0219f5d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:40.485021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:40.490721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:40.508604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a8c1c9f1-97bc-490f-a62a-81c2c2923bbd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:40.509952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a8c1c9f1-97bc-490f-a62a-81c2c2923bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:40.615527 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:40.642476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9b8d5-bf84-48ee-bda1-7904af52036d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:40.652184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:40.652931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:40.653497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:40.653669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5 admin admin] PATH_INFO: `/v3/projects/7b9c69693c7d4ee595104571ec6843e6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:40.655219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9c69693c7d4ee595104571ec6843e6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:40.657736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:40.672435 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2564/5098] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:40.677749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ba2ff-53ad-40ca-8d44-0361799415d7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:40.678168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ba2ff-53ad-40ca-8d44-0361799415d7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:40.679013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ba2ff-53ad-40ca-8d44-0361799415d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:40.723096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-641ba2ff-53ad-40ca-8d44-0361799415d7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:40.724597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-641ba2ff-53ad-40ca-8d44-0361799415d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:40.750965 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2565/5099] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:40.758648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ba2ff-53ad-40ca-8d44-0361799415d7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:40.762530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9c69693c7d4ee595104571ec6843e6', 'request_id': 'req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:40.771870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ba2ff-53ad-40ca-8d44-0361799415d7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:40.772586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9c69693c7d4ee595104571ec6843e6', 'request_id': 'req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:40.788259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9c69693c7d4ee595104571ec6843e6', 'request_id': 'req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:40.817865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5 admin admin] The token cache is being invalidate because project 7b9c69693c7d4ee595104571ec6843e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:40.820075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:40.822140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b34ba26f-b4f7-41f0-b646-9b192f2fc2e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:40.824698 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2535/5100] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:40 2022] DELETE /identity/v3/projects/7b9c69693c7d4ee595104571ec6843e6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:40.831515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de9b24-c579-4a6f-aed5-979c5c9fbc9f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:40.831870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de9b24-c579-4a6f-aed5-979c5c9fbc9f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:40.832212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de9b24-c579-4a6f-aed5-979c5c9fbc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:40.870611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad5c1a-c79d-4ee8-b7a1-7213f81ceca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:40.871456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5c1a-c79d-4ee8-b7a1-7213f81ceca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:40.871993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5c1a-c79d-4ee8-b7a1-7213f81ceca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:40.872131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-74de9b24-c579-4a6f-aed5-979c5c9fbc9f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:40.872398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5c1a-c79d-4ee8-b7a1-7213f81ceca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:40.873150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad5c1a-c79d-4ee8-b7a1-7213f81ceca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:40.873304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-74de9b24-c579-4a6f-aed5-979c5c9fbc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:40.873575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad5c1a-c79d-4ee8-b7a1-7213f81ceca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:40.883085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad5c1a-c79d-4ee8-b7a1-7213f81ceca0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:40.889386 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2566/5101] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:24:40.890753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc525a13-06e7-42d3-94b3-0bcda414fcc1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:40.891138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc525a13-06e7-42d3-94b3-0bcda414fcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:40.891487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc525a13-06e7-42d3-94b3-0bcda414fcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:40.902434 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2536/5102] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:40.905799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de9b24-c579-4a6f-aed5-979c5c9fbc9f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:40.910735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-74de9b24-c579-4a6f-aed5-979c5c9fbc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:40.924427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cc525a13-06e7-42d3-94b3-0bcda414fcc1 None None] MFA Rules not processed for user `a3ac1408c91c4db59f4639abdca2c98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:40.924995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de9b24-c579-4a6f-aed5-979c5c9fbc9f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:40.927090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc525a13-06e7-42d3-94b3-0bcda414fcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:40.931939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291bb1-d798-4e9d-a1ba-ded621dc4e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:40.932562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291bb1-d798-4e9d-a1ba-ded621dc4e19 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:40.932848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291bb1-d798-4e9d-a1ba-ded621dc4e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:40.933123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291bb1-d798-4e9d-a1ba-ded621dc4e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:40.933760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca291bb1-d798-4e9d-a1ba-ded621dc4e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:40.936402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca291bb1-d798-4e9d-a1ba-ded621dc4e19 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:40.950701 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:40.978399 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2537/5103] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:40 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:40.980501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faa269-53f5-4b43-af70-3e1448460321 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:40.981250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faa269-53f5-4b43-af70-3e1448460321 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:40.981543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faa269-53f5-4b43-af70-3e1448460321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:41.017369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-43faa269-53f5-4b43-af70-3e1448460321 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:41.018824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-43faa269-53f5-4b43-af70-3e1448460321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:41.045776 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2567/5104] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:41.047178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc525a13-06e7-42d3-94b3-0bcda414fcc1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:41.067116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc525a13-06e7-42d3-94b3-0bcda414fcc1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:41.147163 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2538/5105] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:41.217069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faa269-53f5-4b43-af70-3e1448460321 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:41.227375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faa269-53f5-4b43-af70-3e1448460321 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:41.237375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff79aaa-f8c3-4c3c-8c46-6dbd6d8f415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:41.238145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff79aaa-f8c3-4c3c-8c46-6dbd6d8f415f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:41.238543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff79aaa-f8c3-4c3c-8c46-6dbd6d8f415f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:41.240442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff79aaa-f8c3-4c3c-8c46-6dbd6d8f415f admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:41.241253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff79aaa-f8c3-4c3c-8c46-6dbd6d8f415f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:41.242268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff79aaa-f8c3-4c3c-8c46-6dbd6d8f415f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:41.244695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff79aaa-f8c3-4c3c-8c46-6dbd6d8f415f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:41.245241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09a7c7-ee52-4bce-9dfc-acaca0af04fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:41.245865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09a7c7-ee52-4bce-9dfc-acaca0af04fd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:41.246147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09a7c7-ee52-4bce-9dfc-acaca0af04fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:41.246420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09a7c7-ee52-4bce-9dfc-acaca0af04fd admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:41.247225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09a7c7-ee52-4bce-9dfc-acaca0af04fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:41.249145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09a7c7-ee52-4bce-9dfc-acaca0af04fd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:41.266175 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:41.279448 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2539/5106] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:24:41.280814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff79aaa-f8c3-4c3c-8c46-6dbd6d8f415f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:41.290009 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2568/5107] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:41 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:41.293237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09a7c7-ee52-4bce-9dfc-acaca0af04fd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:41.309272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff79aaa-f8c3-4c3c-8c46-6dbd6d8f415f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:41.316684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09a7c7-ee52-4bce-9dfc-acaca0af04fd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:41.320333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fb2e6-2f01-4786-8c77-c063551b3f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:41.321571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb2e6-2f01-4786-8c77-c063551b3f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:41.323052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb2e6-2f01-4786-8c77-c063551b3f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:41.323052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb2e6-2f01-4786-8c77-c063551b3f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:41.323420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fb2e6-2f01-4786-8c77-c063551b3f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:41.325892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fb2e6-2f01-4786-8c77-c063551b3f2e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:41.330553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869c209-c6ae-4d32-a647-852f16f02fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:41.331474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869c209-c6ae-4d32-a647-852f16f02fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:41.331770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869c209-c6ae-4d32-a647-852f16f02fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:41.332037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869c209-c6ae-4d32-a647-852f16f02fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:41.332740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869c209-c6ae-4d32-a647-852f16f02fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:41.335453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869c209-c6ae-4d32-a647-852f16f02fc2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:41.355544 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2569/5108] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:41.359429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869c209-c6ae-4d32-a647-852f16f02fc2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:41.380723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869c209-c6ae-4d32-a647-852f16f02fc2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:41.391411 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2540/5109] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:41 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:41.394385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fb2e6-2f01-4786-8c77-c063551b3f2e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:41.406406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca02916-3252-4235-be0c-173582ebf159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:41.406973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca02916-3252-4235-be0c-173582ebf159 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:41.407265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca02916-3252-4235-be0c-173582ebf159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:41.407543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca02916-3252-4235-be0c-173582ebf159 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:41.408200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca02916-3252-4235-be0c-173582ebf159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:41.409824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca02916-3252-4235-be0c-173582ebf159 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:41.433016 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2570/5110] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:24:41.434835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca02916-3252-4235-be0c-173582ebf159 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:41.454247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca02916-3252-4235-be0c-173582ebf159 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:41.542521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fb2e6-2f01-4786-8c77-c063551b3f2e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:41.549174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0077e9-daea-4ede-83ec-e6f49d2969fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:41.552052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0077e9-daea-4ede-83ec-e6f49d2969fd admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:41.552943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0077e9-daea-4ede-83ec-e6f49d2969fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:41.553230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0077e9-daea-4ede-83ec-e6f49d2969fd admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:41.553877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0077e9-daea-4ede-83ec-e6f49d2969fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:41.558325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0077e9-daea-4ede-83ec-e6f49d2969fd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:41.585415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996b6ad-af91-465c-b62d-e19f70a3bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:41.586656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996b6ad-af91-465c-b62d-e19f70a3bb35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:41.587055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996b6ad-af91-465c-b62d-e19f70a3bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:41.587497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996b6ad-af91-465c-b62d-e19f70a3bb35 admin admin] PATH_INFO: `/v3/projects/f74b95427e04411cb1eae84d7fcadc8f/users/cbd70caa82cb415c87e0419afa9abdad/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:41.596720 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2541/5111] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:41 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:41.603595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0077e9-daea-4ede-83ec-e6f49d2969fd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:41.621892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0077e9-daea-4ede-83ec-e6f49d2969fd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:41.625125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996b6ad-af91-465c-b62d-e19f70a3bb35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74b95427e04411cb1eae84d7fcadc8f, user_id=cbd70caa82cb415c87e0419afa9abdad, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:41.629703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996b6ad-af91-465c-b62d-e19f70a3bb35 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:41.639268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4168e2c-79da-4435-adca-835dc2a2fc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:41.639945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4168e2c-79da-4435-adca-835dc2a2fc08 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:41.640219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4168e2c-79da-4435-adca-835dc2a2fc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:41.640483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4168e2c-79da-4435-adca-835dc2a2fc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:41.641359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4168e2c-79da-4435-adca-835dc2a2fc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:41.643467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4168e2c-79da-4435-adca-835dc2a2fc08 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:41.660319 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2571/5112] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:41 2022] PUT /identity/v3/projects/f74b95427e04411cb1eae84d7fcadc8f/users/cbd70caa82cb415c87e0419afa9abdad/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:41.661741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f60802-b902-47f6-bd69-bb52810a1c29 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:41.662019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f60802-b902-47f6-bd69-bb52810a1c29 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:41.662284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f60802-b902-47f6-bd69-bb52810a1c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:41.702291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d5f60802-b902-47f6-bd69-bb52810a1c29 None None] MFA Rules not processed for user `cbd70caa82cb415c87e0419afa9abdad`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:41.703590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d5f60802-b902-47f6-bd69-bb52810a1c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:41.715936 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2542/5113] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:41.716885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4168e2c-79da-4435-adca-835dc2a2fc08 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:41.734697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4168e2c-79da-4435-adca-835dc2a2fc08 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:41.803010 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:41.818810 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2572/5114] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:41.849064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f60802-b902-47f6-bd69-bb52810a1c29 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:41.850555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d5f60802-b902-47f6-bd69-bb52810a1c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:41.863610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9dad2-d7c4-4c29-8574-a45b03716c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:41.864242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9dad2-d7c4-4c29-8574-a45b03716c69 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:41.864520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9dad2-d7c4-4c29-8574-a45b03716c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:41.864785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9dad2-d7c4-4c29-8574-a45b03716c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:41.865430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9dad2-d7c4-4c29-8574-a45b03716c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:41.874352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9dad2-d7c4-4c29-8574-a45b03716c69 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:41.891879 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2543/5115] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:41.896530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9dad2-d7c4-4c29-8574-a45b03716c69 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:41.908510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9dad2-d7c4-4c29-8574-a45b03716c69 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:41.914025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ec98b-2178-4542-b1d5-576b524fc57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:41.914814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ec98b-2178-4542-b1d5-576b524fc57d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:41.915134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ec98b-2178-4542-b1d5-576b524fc57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:41.915413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ec98b-2178-4542-b1d5-576b524fc57d admin admin] PATH_INFO: `/v3/projects/e0751d3ff2014be3ba106590c6abe65d/users/c68d50afc01442eb9dbf1d306bba7052/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:41.955340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ec98b-2178-4542-b1d5-576b524fc57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0751d3ff2014be3ba106590c6abe65d, user_id=c68d50afc01442eb9dbf1d306bba7052, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:41.959057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ec98b-2178-4542-b1d5-576b524fc57d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:41.972523 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:42.002124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f60802-b902-47f6-bd69-bb52810a1c29 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:42.011465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b03a4-bf1e-4ed7-bb31-7d46ab51910e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:42.013400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b03a4-bf1e-4ed7-bb31-7d46ab51910e service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:42.013951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b03a4-bf1e-4ed7-bb31-7d46ab51910e service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:42.014526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b03a4-bf1e-4ed7-bb31-7d46ab51910e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:42.028184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b03a4-bf1e-4ed7-bb31-7d46ab51910e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:42.029813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b03a4-bf1e-4ed7-bb31-7d46ab51910e service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:42.036353 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2544/5116] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:41 2022] PUT /identity/v3/projects/e0751d3ff2014be3ba106590c6abe65d/users/c68d50afc01442eb9dbf1d306bba7052/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:42.041600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a0edd-019e-4662-93ca-34eab3c6b6a1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:42.042535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a0edd-019e-4662-93ca-34eab3c6b6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:42.043113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a0edd-019e-4662-93ca-34eab3c6b6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:42.055552 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2573/5117] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:42.067861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-688a0edd-019e-4662-93ca-34eab3c6b6a1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:42.069180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-688a0edd-019e-4662-93ca-34eab3c6b6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:42.191341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b03a4-bf1e-4ed7-bb31-7d46ab51910e service glance] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:42.204410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b03a4-bf1e-4ed7-bb31-7d46ab51910e service glance] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:42.239403 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2545/5118] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:42.253966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a0edd-019e-4662-93ca-34eab3c6b6a1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:42.255396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-688a0edd-019e-4662-93ca-34eab3c6b6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:42.337086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a0edd-019e-4662-93ca-34eab3c6b6a1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:42.338416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:42.338937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:42.339223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:42.339615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] PATH_INFO: `/v3/users/cbd70caa82cb415c87e0419afa9abdad` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:42.341184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd70caa82cb415c87e0419afa9abdad)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:42.343652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:42.349713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b37a81-7bc1-4058-96d1-83f44018be80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:42.350330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37a81-7bc1-4058-96d1-83f44018be80 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:42.350605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37a81-7bc1-4058-96d1-83f44018be80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:42.351032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37a81-7bc1-4058-96d1-83f44018be80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:42.369655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b37a81-7bc1-4058-96d1-83f44018be80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:42.371394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b37a81-7bc1-4058-96d1-83f44018be80 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:42.398639 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2546/5119] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:24:42.449038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd70caa82cb415c87e0419afa9abdad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:42.449933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd70caa82cb415c87e0419afa9abdad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:42.485052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd70caa82cb415c87e0419afa9abdad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:42.509962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd70caa82cb415c87e0419afa9abdad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:42.511205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd70caa82cb415c87e0419afa9abdad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:42.556838 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2574/5120] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:42 2022] DELETE /identity/v3/users/cbd70caa82cb415c87e0419afa9abdad => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:42.564525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce1b3-eafc-411b-a28a-60fd08a0f629 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:42.565116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce1b3-eafc-411b-a28a-60fd08a0f629 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:42.565116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce1b3-eafc-411b-a28a-60fd08a0f629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:42.605003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7dbce1b3-eafc-411b-a28a-60fd08a0f629 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:42.616346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7dbce1b3-eafc-411b-a28a-60fd08a0f629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:42.720386 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:42.746937 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2547/5121] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:42.764709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:42.766158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:42.915146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0073e-8efa-4272-8117-72c0aae18852 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:42.925846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a8e1f-208d-46bd-91d4-34ee842ed6b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:42.926675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a8e1f-208d-46bd-91d4-34ee842ed6b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:42.927157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a8e1f-208d-46bd-91d4-34ee842ed6b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:42.927571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a8e1f-208d-46bd-91d4-34ee842ed6b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:42.951820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a8e1f-208d-46bd-91d4-34ee842ed6b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:42.953704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a8e1f-208d-46bd-91d4-34ee842ed6b6 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:42.980401 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2575/5122] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:43.581645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbce1b3-eafc-411b-a28a-60fd08a0f629 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:43.585908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7dbce1b3-eafc-411b-a28a-60fd08a0f629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:43.621589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbce1b3-eafc-411b-a28a-60fd08a0f629 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:43.630458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:43.631668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:43.632237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:43.632774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4 admin admin] PATH_INFO: `/v3/projects/f74b95427e04411cb1eae84d7fcadc8f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:43.634203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74b95427e04411cb1eae84d7fcadc8f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:43.636341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:43.717346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74b95427e04411cb1eae84d7fcadc8f', 'request_id': 'req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:43.743773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74b95427e04411cb1eae84d7fcadc8f', 'request_id': 'req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:43.763115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74b95427e04411cb1eae84d7fcadc8f', 'request_id': 'req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:43.781338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4 admin admin] The token cache is being invalidate because project f74b95427e04411cb1eae84d7fcadc8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:43.782774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:43.783686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ee23a6d-d954-4039-a6db-76b64f5ce7c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:43.785579 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2548/5123] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:43 2022] DELETE /identity/v3/projects/f74b95427e04411cb1eae84d7fcadc8f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:43.792342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880e063-3e4a-4a37-a5af-ed776489563a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:43.792865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880e063-3e4a-4a37-a5af-ed776489563a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:43.802581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880e063-3e4a-4a37-a5af-ed776489563a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:43.817916 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:43.837785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2880e063-3e4a-4a37-a5af-ed776489563a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:43.839381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2880e063-3e4a-4a37-a5af-ed776489563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:43.915510 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2576/5124] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:43.923381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac83a3e-4b79-47f6-8433-2613d26cae5e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:43.923674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac83a3e-4b79-47f6-8433-2613d26cae5e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:43.923956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac83a3e-4b79-47f6-8433-2613d26cae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:43.955927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0ac83a3e-4b79-47f6-8433-2613d26cae5e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:43.958900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0ac83a3e-4b79-47f6-8433-2613d26cae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:43.972687 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2549/5125] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:43.982015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880e063-3e4a-4a37-a5af-ed776489563a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:43.992911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880e063-3e4a-4a37-a5af-ed776489563a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:44.000150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a9fd1-b265-4b1e-8071-20859d4c9efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:44.000958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a9fd1-b265-4b1e-8071-20859d4c9efc admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:44.001344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a9fd1-b265-4b1e-8071-20859d4c9efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:44.002039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a9fd1-b265-4b1e-8071-20859d4c9efc admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:44.002575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a9fd1-b265-4b1e-8071-20859d4c9efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:44.005970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a9fd1-b265-4b1e-8071-20859d4c9efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:44.012095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a9fd1-b265-4b1e-8071-20859d4c9efc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:44.031821 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2577/5126] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:24:44.036263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac83a3e-4b79-47f6-8433-2613d26cae5e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:44.048553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac83a3e-4b79-47f6-8433-2613d26cae5e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:44.055703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae867ab-219b-463f-b08a-3052d2cd716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:44.056728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae867ab-219b-463f-b08a-3052d2cd716d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:44.057124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae867ab-219b-463f-b08a-3052d2cd716d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:44.057485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae867ab-219b-463f-b08a-3052d2cd716d admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:44.058228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae867ab-219b-463f-b08a-3052d2cd716d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:44.060876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae867ab-219b-463f-b08a-3052d2cd716d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:44.100780 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2550/5127] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:44 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:44.105514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a9fd1-b265-4b1e-8071-20859d4c9efc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:44.118414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a9fd1-b265-4b1e-8071-20859d4c9efc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:44.248927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48078d6-12e3-40aa-9167-6d09f5053376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:44.249558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48078d6-12e3-40aa-9167-6d09f5053376 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:44.249926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48078d6-12e3-40aa-9167-6d09f5053376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:44.250260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48078d6-12e3-40aa-9167-6d09f5053376 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:44.251398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48078d6-12e3-40aa-9167-6d09f5053376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:44.254391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48078d6-12e3-40aa-9167-6d09f5053376 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:44.283290 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2578/5128] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:44 2022] POST /identity/v3/users => generated 282 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:44.288554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae867ab-219b-463f-b08a-3052d2cd716d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:44.308096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae867ab-219b-463f-b08a-3052d2cd716d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:44.319075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23d7d9-c030-406a-99ff-cda230d6e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:44.320998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d7d9-c030-406a-99ff-cda230d6e981 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:44.321147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d7d9-c030-406a-99ff-cda230d6e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:44.321422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d7d9-c030-406a-99ff-cda230d6e981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:44.322076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23d7d9-c030-406a-99ff-cda230d6e981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:44.325307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23d7d9-c030-406a-99ff-cda230d6e981 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:44.339517 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2551/5129] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:44.343413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48078d6-12e3-40aa-9167-6d09f5053376 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:44.354839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48078d6-12e3-40aa-9167-6d09f5053376 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:44.362548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c3c81-7624-4051-b81e-04f60b9b0aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:44.363163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c3c81-7624-4051-b81e-04f60b9b0aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:44.363163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c3c81-7624-4051-b81e-04f60b9b0aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:44.363546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c3c81-7624-4051-b81e-04f60b9b0aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:44.364268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c3c81-7624-4051-b81e-04f60b9b0aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:44.366236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c3c81-7624-4051-b81e-04f60b9b0aeb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:44.378446 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2579/5130] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:24:44.383435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23d7d9-c030-406a-99ff-cda230d6e981 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:44.394611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23d7d9-c030-406a-99ff-cda230d6e981 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:44.401344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae8a3a-632d-4c52-a74b-850d004c6771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:44.402147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8a3a-632d-4c52-a74b-850d004c6771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:44.402534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8a3a-632d-4c52-a74b-850d004c6771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:44.403131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8a3a-632d-4c52-a74b-850d004c6771 admin admin] PATH_INFO: `/v3/projects/fdf9a71980d54aa0b03d3b542da48047/users/ea9d5b6b133147b6898f60eca5e8218f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:44.423747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae8a3a-632d-4c52-a74b-850d004c6771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf9a71980d54aa0b03d3b542da48047, user_id=ea9d5b6b133147b6898f60eca5e8218f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:44.426627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae8a3a-632d-4c52-a74b-850d004c6771 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:44.443272 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2552/5131] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:44 2022] PUT /identity/v3/projects/fdf9a71980d54aa0b03d3b542da48047/users/ea9d5b6b133147b6898f60eca5e8218f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:44.458705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2189496-87cc-4eca-a4fa-c1824be01413 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:44.458705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2189496-87cc-4eca-a4fa-c1824be01413 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:44.458986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2189496-87cc-4eca-a4fa-c1824be01413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:44.577757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b2189496-87cc-4eca-a4fa-c1824be01413 None None] MFA Rules not processed for user `ea9d5b6b133147b6898f60eca5e8218f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:44.579676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b2189496-87cc-4eca-a4fa-c1824be01413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:44.733757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae8a3a-632d-4c52-a74b-850d004c6771 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:44.734766 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2580/5132] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:44.736052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6dae8a3a-632d-4c52-a74b-850d004c6771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:44.852004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae8a3a-632d-4c52-a74b-850d004c6771 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:44.857075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336efd6-fa5f-4cb7-8b3f-628ed74dd238 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:44.857901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336efd6-fa5f-4cb7-8b3f-628ed74dd238 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:44.858280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336efd6-fa5f-4cb7-8b3f-628ed74dd238 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:44.858681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336efd6-fa5f-4cb7-8b3f-628ed74dd238 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:44.871469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336efd6-fa5f-4cb7-8b3f-628ed74dd238 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:44.873468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336efd6-fa5f-4cb7-8b3f-628ed74dd238 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:44.905282 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2553/5133] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:24:45.473137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2189496-87cc-4eca-a4fa-c1824be01413 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:45.480207 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:45.640549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2189496-87cc-4eca-a4fa-c1824be01413 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:45.662021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:45.663422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:45.663812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:45.664087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] PATH_INFO: `/v3/users/ea9d5b6b133147b6898f60eca5e8218f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:45.665652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9d5b6b133147b6898f60eca5e8218f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:45.671580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:45.733191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9d5b6b133147b6898f60eca5e8218f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:45.734183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9d5b6b133147b6898f60eca5e8218f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:45.752373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9d5b6b133147b6898f60eca5e8218f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:45.761811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9d5b6b133147b6898f60eca5e8218f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:45.763027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9d5b6b133147b6898f60eca5e8218f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:45.782590 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2581/5134] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:45 2022] DELETE /identity/v3/users/ea9d5b6b133147b6898f60eca5e8218f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:45.785045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87accfff-230c-4dbe-b4a4-2d55e9d6facf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:45.785545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87accfff-230c-4dbe-b4a4-2d55e9d6facf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:45.785669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87accfff-230c-4dbe-b4a4-2d55e9d6facf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:45.809228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-87accfff-230c-4dbe-b4a4-2d55e9d6facf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:45.810731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-87accfff-230c-4dbe-b4a4-2d55e9d6facf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:45.823880 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:45.899723 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2554/5135] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:45.906799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:45.908866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:45.979299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43105f-d7cd-41c9-af9e-751c0b9c3538 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:45.983185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c2d25-66dd-4cf3-9f43-d34b637ffaa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:45.983887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c2d25-66dd-4cf3-9f43-d34b637ffaa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:45.984213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c2d25-66dd-4cf3-9f43-d34b637ffaa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:45.984550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c2d25-66dd-4cf3-9f43-d34b637ffaa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:45.996820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c2d25-66dd-4cf3-9f43-d34b637ffaa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:45.998549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c2d25-66dd-4cf3-9f43-d34b637ffaa3 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:46.010531 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2582/5136] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:24:46.396451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87accfff-230c-4dbe-b4a4-2d55e9d6facf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:46.399009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-87accfff-230c-4dbe-b4a4-2d55e9d6facf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:46.417923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87accfff-230c-4dbe-b4a4-2d55e9d6facf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:46.423301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:46.424186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:46.424625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:46.425078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116 admin admin] PATH_INFO: `/v3/projects/fdf9a71980d54aa0b03d3b542da48047` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:46.426447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf9a71980d54aa0b03d3b542da48047)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:46.428758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:46.487501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf9a71980d54aa0b03d3b542da48047', 'request_id': 'req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:46.496182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf9a71980d54aa0b03d3b542da48047', 'request_id': 'req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:46.507834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf9a71980d54aa0b03d3b542da48047', 'request_id': 'req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:46.522246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116 admin admin] The token cache is being invalidate because project fdf9a71980d54aa0b03d3b542da48047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:46.522426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:46.523993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-61d0aa19-57da-48bb-a0a5-1a7aaee7f116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:46.526236 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2555/5137] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:46 2022] DELETE /identity/v3/projects/fdf9a71980d54aa0b03d3b542da48047 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:46.530937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fb36f-2ed4-4a09-9ead-816f75f686b4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:46.531618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fb36f-2ed4-4a09-9ead-816f75f686b4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:46.531618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fb36f-2ed4-4a09-9ead-816f75f686b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:46.563018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-955fb36f-2ed4-4a09-9ead-816f75f686b4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:46.563018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-955fb36f-2ed4-4a09-9ead-816f75f686b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:46.596644 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:46.682573 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2583/5138] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:46.778562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062586cd-0f17-4341-af0e-e2f057b75abd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:46.778855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062586cd-0f17-4341-af0e-e2f057b75abd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:46.779160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062586cd-0f17-4341-af0e-e2f057b75abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:46.808262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-062586cd-0f17-4341-af0e-e2f057b75abd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:46.809638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-062586cd-0f17-4341-af0e-e2f057b75abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:46.818899 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2556/5139] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:46.823650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fb36f-2ed4-4a09-9ead-816f75f686b4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:46.837261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fb36f-2ed4-4a09-9ead-816f75f686b4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:46.843901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe91b8-424d-434d-bc7e-5b88abcd873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:46.844525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe91b8-424d-434d-bc7e-5b88abcd873d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:46.844852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe91b8-424d-434d-bc7e-5b88abcd873d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:46.845092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe91b8-424d-434d-bc7e-5b88abcd873d admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:46.845816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe91b8-424d-434d-bc7e-5b88abcd873d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:46.846193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe91b8-424d-434d-bc7e-5b88abcd873d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:46.848169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe91b8-424d-434d-bc7e-5b88abcd873d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:46.865945 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2584/5140] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:24:46.870740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062586cd-0f17-4341-af0e-e2f057b75abd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:46.879978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062586cd-0f17-4341-af0e-e2f057b75abd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:46.886387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d7387-fa4f-42cb-a48b-4206cdd95975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:46.887047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d7387-fa4f-42cb-a48b-4206cdd95975 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:46.887323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d7387-fa4f-42cb-a48b-4206cdd95975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:46.887590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d7387-fa4f-42cb-a48b-4206cdd95975 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:46.888221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d7387-fa4f-42cb-a48b-4206cdd95975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:46.890254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d7387-fa4f-42cb-a48b-4206cdd95975 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:46.922196 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2557/5141] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:46 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:46.923570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe91b8-424d-434d-bc7e-5b88abcd873d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:46.935171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe91b8-424d-434d-bc7e-5b88abcd873d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:47.006258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1d262-b524-4e58-a307-87d2902aee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:47.006899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d262-b524-4e58-a307-87d2902aee79 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:47.009259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d262-b524-4e58-a307-87d2902aee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:47.009259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d262-b524-4e58-a307-87d2902aee79 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:47.009259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1d262-b524-4e58-a307-87d2902aee79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:47.011067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1d262-b524-4e58-a307-87d2902aee79 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:47.037655 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2585/5142] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:46 2022] POST /identity/v3/users => generated 281 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:47.039246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d7387-fa4f-42cb-a48b-4206cdd95975 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:47.050120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d7387-fa4f-42cb-a48b-4206cdd95975 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:47.055865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da57c21-6f98-43f9-84a6-631c1ded57e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:47.059708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da57c21-6f98-43f9-84a6-631c1ded57e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:47.059708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da57c21-6f98-43f9-84a6-631c1ded57e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:47.059708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da57c21-6f98-43f9-84a6-631c1ded57e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:47.059708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da57c21-6f98-43f9-84a6-631c1ded57e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:47.060163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da57c21-6f98-43f9-84a6-631c1ded57e1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:47.074334 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2558/5143] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:47.075537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1d262-b524-4e58-a307-87d2902aee79 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:47.085845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1d262-b524-4e58-a307-87d2902aee79 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:47.090494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd6522-816e-4c5d-a2a2-a1d9369c3723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:47.091116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd6522-816e-4c5d-a2a2-a1d9369c3723 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:47.091395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd6522-816e-4c5d-a2a2-a1d9369c3723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:47.091666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd6522-816e-4c5d-a2a2-a1d9369c3723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:47.092302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd6522-816e-4c5d-a2a2-a1d9369c3723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:47.093889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd6522-816e-4c5d-a2a2-a1d9369c3723 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:47.104992 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2586/5144] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:47.109365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da57c21-6f98-43f9-84a6-631c1ded57e1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:47.120450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da57c21-6f98-43f9-84a6-631c1ded57e1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:47.125019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169de4c-1490-49d9-9a49-19b180d52b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:47.125660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169de4c-1490-49d9-9a49-19b180d52b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:47.125919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169de4c-1490-49d9-9a49-19b180d52b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:47.126185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169de4c-1490-49d9-9a49-19b180d52b99 admin admin] PATH_INFO: `/v3/projects/e858178f86b84eb4971a4a5e9aa604c1/users/9c2361f8432346cb8866db75d43a7a08/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:47.144663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169de4c-1490-49d9-9a49-19b180d52b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e858178f86b84eb4971a4a5e9aa604c1, user_id=9c2361f8432346cb8866db75d43a7a08, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:47.148060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169de4c-1490-49d9-9a49-19b180d52b99 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:47.178319 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2559/5145] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:47 2022] PUT /identity/v3/projects/e858178f86b84eb4971a4a5e9aa604c1/users/9c2361f8432346cb8866db75d43a7a08/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:47.189564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33341b9d-43da-4e8c-9491-351b5e36fbb5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:47.189857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33341b9d-43da-4e8c-9491-351b5e36fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:47.190251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33341b9d-43da-4e8c-9491-351b5e36fbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:47.223353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-33341b9d-43da-4e8c-9491-351b5e36fbb5 None None] MFA Rules not processed for user `9c2361f8432346cb8866db75d43a7a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:47.224607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-33341b9d-43da-4e8c-9491-351b5e36fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:47.352646 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2587/5146] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:47.361745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169de4c-1490-49d9-9a49-19b180d52b99 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:47.467850 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:47.535954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169de4c-1490-49d9-9a49-19b180d52b99 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:47.563621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:47.564460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:47.564747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:47.565022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] PATH_INFO: `/v3/users/9c2361f8432346cb8866db75d43a7a08` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:47.566855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2361f8432346cb8866db75d43a7a08)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:47.568430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:47.637983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2361f8432346cb8866db75d43a7a08'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:47.639952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2361f8432346cb8866db75d43a7a08'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:47.659258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2361f8432346cb8866db75d43a7a08'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:47.673974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2361f8432346cb8866db75d43a7a08'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:47.675179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2361f8432346cb8866db75d43a7a08'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:47.695975 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2560/5147] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:47 2022] DELETE /identity/v3/users/9c2361f8432346cb8866db75d43a7a08 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:47.700417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3ad56-f914-452f-b223-6f087247654f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:47.700912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3ad56-f914-452f-b223-6f087247654f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:47.701242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3ad56-f914-452f-b223-6f087247654f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:47.729220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-77c3ad56-f914-452f-b223-6f087247654f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:47.733184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-77c3ad56-f914-452f-b223-6f087247654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:47.750585 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:47.822096 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2588/5148] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:47.874663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:47.874663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:48.020585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64f12-29e9-4e6a-8cde-d859f1cebbfd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:48.030434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c11951-d7ea-4784-9914-50384f6ca27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:48.033667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c11951-d7ea-4784-9914-50384f6ca27f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:48.034422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c11951-d7ea-4784-9914-50384f6ca27f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:48.036516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c11951-d7ea-4784-9914-50384f6ca27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:48.052192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c11951-d7ea-4784-9914-50384f6ca27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:48.054734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c11951-d7ea-4784-9914-50384f6ca27f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:48.073814 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2561/5149] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:49.452104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5258b-33cd-464d-9d78-6d56b09c7960 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:49.452583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5258b-33cd-464d-9d78-6d56b09c7960 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:49.452809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5258b-33cd-464d-9d78-6d56b09c7960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:49.509853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7da5258b-33cd-464d-9d78-6d56b09c7960 None None] MFA Rules not processed for user `c68d50afc01442eb9dbf1d306bba7052`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:49.511117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7da5258b-33cd-464d-9d78-6d56b09c7960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:49.606111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c11951-d7ea-4784-9914-50384f6ca27f service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:49.608357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-61c11951-d7ea-4784-9914-50384f6ca27f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:49.610876 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2589/5150] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:49.629658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c11951-d7ea-4784-9914-50384f6ca27f service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:49.639958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e36fe4-4080-412d-a712-b3470d14a0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:49.640830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36fe4-4080-412d-a712-b3470d14a0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:49.641322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36fe4-4080-412d-a712-b3470d14a0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:49.641767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36fe4-4080-412d-a712-b3470d14a0fa admin admin] PATH_INFO: `/v3/projects/e858178f86b84eb4971a4a5e9aa604c1` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:49.643492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e36fe4-4080-412d-a712-b3470d14a0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e858178f86b84eb4971a4a5e9aa604c1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:49.646205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e36fe4-4080-412d-a712-b3470d14a0fa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:49.706551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c0e36fe4-4080-412d-a712-b3470d14a0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e858178f86b84eb4971a4a5e9aa604c1', 'request_id': 'req-c0e36fe4-4080-412d-a712-b3470d14a0fa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:49.707891 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:49.716209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c0e36fe4-4080-412d-a712-b3470d14a0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e858178f86b84eb4971a4a5e9aa604c1', 'request_id': 'req-c0e36fe4-4080-412d-a712-b3470d14a0fa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:49.727600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c0e36fe4-4080-412d-a712-b3470d14a0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e858178f86b84eb4971a4a5e9aa604c1', 'request_id': 'req-c0e36fe4-4080-412d-a712-b3470d14a0fa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:49.741249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c0e36fe4-4080-412d-a712-b3470d14a0fa admin admin] The token cache is being invalidate because project e858178f86b84eb4971a4a5e9aa604c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:49.741626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c0e36fe4-4080-412d-a712-b3470d14a0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:49.743138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c0e36fe4-4080-412d-a712-b3470d14a0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:49.745401 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2562/5151] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:49 2022] DELETE /identity/v3/projects/e858178f86b84eb4971a4a5e9aa604c1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:24:49.751199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53f0f2-1958-4860-a08c-748031153847 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:49.751946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53f0f2-1958-4860-a08c-748031153847 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:49.752417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53f0f2-1958-4860-a08c-748031153847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:49.775716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fc53f0f2-1958-4860-a08c-748031153847 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:49.777108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fc53f0f2-1958-4860-a08c-748031153847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:49.858973 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2590/5152] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:49.861224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f65741-20c8-43f0-868c-a883474c5fb1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:49.861509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f65741-20c8-43f0-868c-a883474c5fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:49.861810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f65741-20c8-43f0-868c-a883474c5fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:49.894485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-26f65741-20c8-43f0-868c-a883474c5fb1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:49.895734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-26f65741-20c8-43f0-868c-a883474c5fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:49.904688 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2563/5153] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:49.908666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53f0f2-1958-4860-a08c-748031153847 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:49.921864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53f0f2-1958-4860-a08c-748031153847 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:49.927691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e47ce-df79-4124-a22b-22b0425b56b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:49.928317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e47ce-df79-4124-a22b-22b0425b56b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:49.928593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e47ce-df79-4124-a22b-22b0425b56b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:49.928875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e47ce-df79-4124-a22b-22b0425b56b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:49.930126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e47ce-df79-4124-a22b-22b0425b56b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:24:49.930446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e47ce-df79-4124-a22b-22b0425b56b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:49.932783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e47ce-df79-4124-a22b-22b0425b56b7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:49.951057 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2591/5154] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:24:49.952215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f65741-20c8-43f0-868c-a883474c5fb1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:49.963395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f65741-20c8-43f0-868c-a883474c5fb1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:49.968720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378473f-707f-498f-a9e4-8c30c460bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:49.969470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378473f-707f-498f-a9e4-8c30c460bbba admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:49.969821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378473f-707f-498f-a9e4-8c30c460bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:49.970168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378473f-707f-498f-a9e4-8c30c460bbba admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:49.971049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378473f-707f-498f-a9e4-8c30c460bbba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:49.973200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378473f-707f-498f-a9e4-8c30c460bbba admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:50.008006 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2564/5155] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:49 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:50.012187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e47ce-df79-4124-a22b-22b0425b56b7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:50.023410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e47ce-df79-4124-a22b-22b0425b56b7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:50.065954 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:50.093076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c849f51-f7be-4d55-9033-4ec48f7a19f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:50.093688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c849f51-f7be-4d55-9033-4ec48f7a19f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:50.093966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c849f51-f7be-4d55-9033-4ec48f7a19f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:50.094239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c849f51-f7be-4d55-9033-4ec48f7a19f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:50.094888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c849f51-f7be-4d55-9033-4ec48f7a19f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:50.097129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c849f51-f7be-4d55-9033-4ec48f7a19f0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:50.124181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378473f-707f-498f-a9e4-8c30c460bbba admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:50.127043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c378473f-707f-498f-a9e4-8c30c460bbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:50.157801 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2592/5156] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:50 2022] POST /identity/v3/users => generated 284 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:50.162504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c849f51-f7be-4d55-9033-4ec48f7a19f0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:50.180762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c849f51-f7be-4d55-9033-4ec48f7a19f0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:50.209915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448d085-0108-4683-a43c-7c20b0a837fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:50.215771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448d085-0108-4683-a43c-7c20b0a837fd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:50.216360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448d085-0108-4683-a43c-7c20b0a837fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:50.216645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448d085-0108-4683-a43c-7c20b0a837fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:50.218361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448d085-0108-4683-a43c-7c20b0a837fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:50.221839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448d085-0108-4683-a43c-7c20b0a837fd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:50.245990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378473f-707f-498f-a9e4-8c30c460bbba admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:50.249919 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2593/5157] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:50.250967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448d085-0108-4683-a43c-7c20b0a837fd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:50.257829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899326e-fdd0-4b4f-8e07-7c7b701e8d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:50.258998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899326e-fdd0-4b4f-8e07-7c7b701e8d42 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:50.259254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899326e-fdd0-4b4f-8e07-7c7b701e8d42 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:50.259600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899326e-fdd0-4b4f-8e07-7c7b701e8d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:50.261508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c899326e-fdd0-4b4f-8e07-7c7b701e8d42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:50.264208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448d085-0108-4683-a43c-7c20b0a837fd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:50.277207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52569ecd-13e0-46ae-bf77-cf335d331988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:50.278516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52569ecd-13e0-46ae-bf77-cf335d331988 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:50.279518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52569ecd-13e0-46ae-bf77-cf335d331988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:50.279984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52569ecd-13e0-46ae-bf77-cf335d331988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:50.280791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52569ecd-13e0-46ae-bf77-cf335d331988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:50.283084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52569ecd-13e0-46ae-bf77-cf335d331988 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:50.316221 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2594/5158] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:50.317749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52569ecd-13e0-46ae-bf77-cf335d331988 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:50.336351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899326e-fdd0-4b4f-8e07-7c7b701e8d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:50.338192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899326e-fdd0-4b4f-8e07-7c7b701e8d42 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:50.340592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52569ecd-13e0-46ae-bf77-cf335d331988 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:50.346701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57369f-f368-4982-aa80-f1b0ba200f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:50.348027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57369f-f368-4982-aa80-f1b0ba200f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:50.348571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57369f-f368-4982-aa80-f1b0ba200f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:50.349044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57369f-f368-4982-aa80-f1b0ba200f2b admin admin] PATH_INFO: `/v3/projects/d01dbb01436f4b2aae966d7594622d18/users/5ca6db481ac846c084bb095545f6def0/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:50.349532 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2565/5159] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:24:50.369327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57369f-f368-4982-aa80-f1b0ba200f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01dbb01436f4b2aae966d7594622d18, user_id=5ca6db481ac846c084bb095545f6def0, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:50.373910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57369f-f368-4982-aa80-f1b0ba200f2b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:50.403631 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2595/5160] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:50 2022] PUT /identity/v3/projects/d01dbb01436f4b2aae966d7594622d18/users/5ca6db481ac846c084bb095545f6def0/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:50.406718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d434e-c5a9-4391-8c69-6d5501b57f1d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:50.407268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d434e-c5a9-4391-8c69-6d5501b57f1d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:50.407435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d434e-c5a9-4391-8c69-6d5501b57f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:50.465962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d22d434e-c5a9-4391-8c69-6d5501b57f1d None None] MFA Rules not processed for user `5ca6db481ac846c084bb095545f6def0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:50.467226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d22d434e-c5a9-4391-8c69-6d5501b57f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:50.557887 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:50.620330 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2566/5161] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:50.622859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57369f-f368-4982-aa80-f1b0ba200f2b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:50.641150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d434e-c5a9-4391-8c69-6d5501b57f1d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:50.643481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d22d434e-c5a9-4391-8c69-6d5501b57f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:50.751623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57369f-f368-4982-aa80-f1b0ba200f2b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:50.752458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d434e-c5a9-4391-8c69-6d5501b57f1d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:50.756806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea9adb-704a-4f5e-80d4-d175fab807fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:50.757328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea9adb-704a-4f5e-80d4-d175fab807fe admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:50.757618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea9adb-704a-4f5e-80d4-d175fab807fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:50.757953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea9adb-704a-4f5e-80d4-d175fab807fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:50.758684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea9adb-704a-4f5e-80d4-d175fab807fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:50.759082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c5192-240f-4779-a304-bf6ba10ba5ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:50.759796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c5192-240f-4779-a304-bf6ba10ba5ba service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:50.760171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c5192-240f-4779-a304-bf6ba10ba5ba service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:50.760533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c5192-240f-4779-a304-bf6ba10ba5ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:50.760772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea9adb-704a-4f5e-80d4-d175fab807fe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:50.770058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a10c5192-240f-4779-a304-bf6ba10ba5ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:50.799312 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2596/5162] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:24:50 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:24:50.804135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea9adb-704a-4f5e-80d4-d175fab807fe admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:50.878819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c5192-240f-4779-a304-bf6ba10ba5ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:50.880476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c5192-240f-4779-a304-bf6ba10ba5ba service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:50.888481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea9adb-704a-4f5e-80d4-d175fab807fe admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:50.894338 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2567/5163] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:50.894642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4ae38-9985-4c26-9e05-36ef81689b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:50.895374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4ae38-9985-4c26-9e05-36ef81689b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:50.895655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4ae38-9985-4c26-9e05-36ef81689b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:50.895930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4ae38-9985-4c26-9e05-36ef81689b01 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:50.896566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4ae38-9985-4c26-9e05-36ef81689b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:50.899182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4ae38-9985-4c26-9e05-36ef81689b01 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:50.911297 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:50.928656 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2597/5164] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:24:50 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:24:50.945576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c5192-240f-4779-a304-bf6ba10ba5ba service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:50.959711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c5192-240f-4779-a304-bf6ba10ba5ba service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:50.966392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95dda5-6331-47ba-b5a0-f28c2689e867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:50.971562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95dda5-6331-47ba-b5a0-f28c2689e867 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:50.971935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95dda5-6331-47ba-b5a0-f28c2689e867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:50.972208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95dda5-6331-47ba-b5a0-f28c2689e867 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:50.972871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95dda5-6331-47ba-b5a0-f28c2689e867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:50.974584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95dda5-6331-47ba-b5a0-f28c2689e867 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:50.984226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4ae38-9985-4c26-9e05-36ef81689b01 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:50.986389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b8c4ae38-9985-4c26-9e05-36ef81689b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:50.993934 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2568/5165] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:50.994860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95dda5-6331-47ba-b5a0-f28c2689e867 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:51.006351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95dda5-6331-47ba-b5a0-f28c2689e867 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:51.012210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d394166-1cb6-4546-9f0b-e432a1bf4c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:51.012962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d394166-1cb6-4546-9f0b-e432a1bf4c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:51.013319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d394166-1cb6-4546-9f0b-e432a1bf4c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:51.013666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d394166-1cb6-4546-9f0b-e432a1bf4c89 admin admin] PATH_INFO: `/v3/projects/5c985010ecd54984986e8dae728da40a/users/ca21c689690840569d131166901e7549/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:51.059793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d394166-1cb6-4546-9f0b-e432a1bf4c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c985010ecd54984986e8dae728da40a, user_id=ca21c689690840569d131166901e7549, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:51.062837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4ae38-9985-4c26-9e05-36ef81689b01 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:51.065377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d394166-1cb6-4546-9f0b-e432a1bf4c89 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:51.067955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed94f64-3093-4f69-a568-e058af7611e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:51.068720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94f64-3093-4f69-a568-e058af7611e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:51.069073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94f64-3093-4f69-a568-e058af7611e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:51.069417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94f64-3093-4f69-a568-e058af7611e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:51.072037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bed94f64-3093-4f69-a568-e058af7611e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:51.088901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed94f64-3093-4f69-a568-e058af7611e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:51.092427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed94f64-3093-4f69-a568-e058af7611e9 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:51.111638 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2569/5166] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:50 2022] PUT /identity/v3/projects/5c985010ecd54984986e8dae728da40a/users/ca21c689690840569d131166901e7549/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:51.117727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d394166-1cb6-4546-9f0b-e432a1bf4c89 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:51.118066 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2598/5167] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:24:51.253828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed94f64-3093-4f69-a568-e058af7611e9 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:51.267590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed94f64-3093-4f69-a568-e058af7611e9 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:51.308731 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:51.389418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d394166-1cb6-4546-9f0b-e432a1bf4c89 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:51.401478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65daba7-7034-460b-ab61-783dd44c92d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:51.405692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65daba7-7034-460b-ab61-783dd44c92d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:51.406058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65daba7-7034-460b-ab61-783dd44c92d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:51.406341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65daba7-7034-460b-ab61-783dd44c92d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:51.407679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65daba7-7034-460b-ab61-783dd44c92d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:51.408677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65daba7-7034-460b-ab61-783dd44c92d7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:51.458799 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2570/5168] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:24:51.461747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65daba7-7034-460b-ab61-783dd44c92d7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:51.465580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094820c6-3718-43a9-a6f9-e54323751f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:51.466205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094820c6-3718-43a9-a6f9-e54323751f8f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:51.466483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094820c6-3718-43a9-a6f9-e54323751f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:51.466750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094820c6-3718-43a9-a6f9-e54323751f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:51.475117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-094820c6-3718-43a9-a6f9-e54323751f8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:51.485897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65daba7-7034-460b-ab61-783dd44c92d7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:51.500803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01137e2d-fa03-436f-b851-c393414924b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:51.501878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01137e2d-fa03-436f-b851-c393414924b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:51.502256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01137e2d-fa03-436f-b851-c393414924b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:51.502629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01137e2d-fa03-436f-b851-c393414924b3 admin admin] PATH_INFO: `/v3/projects/5c985010ecd54984986e8dae728da40a/users/ca21c689690840569d131166901e7549/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:51.506244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01137e2d-fa03-436f-b851-c393414924b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c985010ecd54984986e8dae728da40a, user_id=ca21c689690840569d131166901e7549, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:51.515776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01137e2d-fa03-436f-b851-c393414924b3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:51.545437 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2571/5169] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:24:51 2022] PUT /identity/v3/projects/5c985010ecd54984986e8dae728da40a/users/ca21c689690840569d131166901e7549/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:51.558241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b9591-cb56-4852-af5f-881b54d021ed None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:51.558521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b9591-cb56-4852-af5f-881b54d021ed None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:51.558787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b9591-cb56-4852-af5f-881b54d021ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:51.626070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1b1b9591-cb56-4852-af5f-881b54d021ed None None] MFA Rules not processed for user `ca21c689690840569d131166901e7549`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:51.629522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1b1b9591-cb56-4852-af5f-881b54d021ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:51.655059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094820c6-3718-43a9-a6f9-e54323751f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:51.659199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094820c6-3718-43a9-a6f9-e54323751f8f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:51.690733 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2599/5170] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:24:51.821147 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2572/5171] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:51.841862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094820c6-3718-43a9-a6f9-e54323751f8f service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:51.855278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094820c6-3718-43a9-a6f9-e54323751f8f service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:52.060358 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:52.117148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12927f9-9d18-438c-96fb-0356e416478c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:52.117327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12927f9-9d18-438c-96fb-0356e416478c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:52.117603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12927f9-9d18-438c-96fb-0356e416478c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:52.134042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2994cdf-9bfe-4c40-adf7-c4209da4a938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:52.134678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2994cdf-9bfe-4c40-adf7-c4209da4a938 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:52.134983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2994cdf-9bfe-4c40-adf7-c4209da4a938 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:52.135265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2994cdf-9bfe-4c40-adf7-c4209da4a938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:52.179568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b12927f9-9d18-438c-96fb-0356e416478c None None] MFA Rules not processed for user `7e7cdaa2d85d4ce698950075b98d5eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:52.179568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b12927f9-9d18-438c-96fb-0356e416478c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:52.186801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2994cdf-9bfe-4c40-adf7-c4209da4a938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:52.194489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2994cdf-9bfe-4c40-adf7-c4209da4a938 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:52.235774 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2600/5172] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:52.411067 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2573/5173] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:52.915124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff61b1d-b02b-4da6-b4c3-e56eb644a277 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:52.915746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff61b1d-b02b-4da6-b4c3-e56eb644a277 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:52.915746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff61b1d-b02b-4da6-b4c3-e56eb644a277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:52.960918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5ff61b1d-b02b-4da6-b4c3-e56eb644a277 None None] MFA Rules not processed for user `c68d50afc01442eb9dbf1d306bba7052`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:52.962277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5ff61b1d-b02b-4da6-b4c3-e56eb644a277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:53.094488 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2601/5174] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:24:56.532907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12927f9-9d18-438c-96fb-0356e416478c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:56.647155 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:56.662188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae62e24-1783-44f8-bb47-28e1b86d3f6f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:56.663409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae62e24-1783-44f8-bb47-28e1b86d3f6f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:56.663706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae62e24-1783-44f8-bb47-28e1b86d3f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:56.690438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12927f9-9d18-438c-96fb-0356e416478c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:56.703629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8ae62e24-1783-44f8-bb47-28e1b86d3f6f None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:56.705152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8ae62e24-1783-44f8-bb47-28e1b86d3f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:56.709890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6134f4-ef9b-476e-a1e6-77a7a377bd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:56.711102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6134f4-ef9b-476e-a1e6-77a7a377bd6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:56.711771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6134f4-ef9b-476e-a1e6-77a7a377bd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:56.712409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6134f4-ef9b-476e-a1e6-77a7a377bd6c admin admin] PATH_INFO: `/v3/users/5ca6db481ac846c084bb095545f6def0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:56.713764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6134f4-ef9b-476e-a1e6-77a7a377bd6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca6db481ac846c084bb095545f6def0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:56.716290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6134f4-ef9b-476e-a1e6-77a7a377bd6c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:56.796012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce6134f4-ef9b-476e-a1e6-77a7a377bd6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca6db481ac846c084bb095545f6def0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:56.797277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce6134f4-ef9b-476e-a1e6-77a7a377bd6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca6db481ac846c084bb095545f6def0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:56.817905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce6134f4-ef9b-476e-a1e6-77a7a377bd6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca6db481ac846c084bb095545f6def0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:56.837002 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2602/5175] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:56.838205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae62e24-1783-44f8-bb47-28e1b86d3f6f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:56.839756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8ae62e24-1783-44f8-bb47-28e1b86d3f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:56.843290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce6134f4-ef9b-476e-a1e6-77a7a377bd6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca6db481ac846c084bb095545f6def0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:56.843921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce6134f4-ef9b-476e-a1e6-77a7a377bd6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca6db481ac846c084bb095545f6def0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:56.862654 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2574/5176] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:56 2022] DELETE /identity/v3/users/5ca6db481ac846c084bb095545f6def0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:56.864305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f9264-3836-44de-86c1-73f702c6c3a6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:56.864754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f9264-3836-44de-86c1-73f702c6c3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:56.865048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f9264-3836-44de-86c1-73f702c6c3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:56.927529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-854f9264-3836-44de-86c1-73f702c6c3a6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:24:56.928764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-854f9264-3836-44de-86c1-73f702c6c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:56.948403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae62e24-1783-44f8-bb47-28e1b86d3f6f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:57.024654 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:57.068512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211546-851d-4d34-9429-6b0d8b25bd1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:57.068512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211546-851d-4d34-9429-6b0d8b25bd1f service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:57.068512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211546-851d-4d34-9429-6b0d8b25bd1f service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:57.068981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211546-851d-4d34-9429-6b0d8b25bd1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:57.107675 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2575/5177] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:24:57.124358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f9264-3836-44de-86c1-73f702c6c3a6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:57.145151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-854f9264-3836-44de-86c1-73f702c6c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:57.165168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12211546-851d-4d34-9429-6b0d8b25bd1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:57.166989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12211546-851d-4d34-9429-6b0d8b25bd1f service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:57.179640 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2603/5178] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:24:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:24:57.309260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f9264-3836-44de-86c1-73f702c6c3a6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:57.334456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26e069-8231-49f6-8a6b-2e0715bdceaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:57.341390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26e069-8231-49f6-8a6b-2e0715bdceaa service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:57.341896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26e069-8231-49f6-8a6b-2e0715bdceaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:57.343572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26e069-8231-49f6-8a6b-2e0715bdceaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:57.388655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26e069-8231-49f6-8a6b-2e0715bdceaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:57.396926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26e069-8231-49f6-8a6b-2e0715bdceaa service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:57.456752 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2576/5179] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:24:58.278226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211546-851d-4d34-9429-6b0d8b25bd1f service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:58.280231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-12211546-851d-4d34-9429-6b0d8b25bd1f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:24:58.309386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211546-851d-4d34-9429-6b0d8b25bd1f service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:58.321831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:58.323501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:58.323786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:58.324095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] PATH_INFO: `/v3/projects/d01dbb01436f4b2aae966d7594622d18` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:58.327823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d01dbb01436f4b2aae966d7594622d18)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:58.342965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:58.485967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd01dbb01436f4b2aae966d7594622d18', 'request_id': 'req-09da0b65-fef8-4217-b583-9742d519ea17'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:58.511938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd01dbb01436f4b2aae966d7594622d18', 'request_id': 'req-09da0b65-fef8-4217-b583-9742d519ea17'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:58.523777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd01dbb01436f4b2aae966d7594622d18', 'request_id': 'req-09da0b65-fef8-4217-b583-9742d519ea17'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:58.549397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] The token cache is being invalidate because project d01dbb01436f4b2aae966d7594622d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:24:58.549707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:58.552397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:58.555396 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2604/5180] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:24:58 2022] DELETE /identity/v3/projects/d01dbb01436f4b2aae966d7594622d18 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:24:58.559588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26e069-8231-49f6-8a6b-2e0715bdceaa service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:24:58.573093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26e069-8231-49f6-8a6b-2e0715bdceaa service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:24:58.605918 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:58.860843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8511e-83c3-4ea1-975d-394529a99ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:24:58.861677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8511e-83c3-4ea1-975d-394529a99ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:24:58.863541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8511e-83c3-4ea1-975d-394529a99ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:24:58.863875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8511e-83c3-4ea1-975d-394529a99ee7 admin admin] PATH_INFO: `/v3/users/ca21c689690840569d131166901e7549` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:24:58.866446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8511e-83c3-4ea1-975d-394529a99ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca21c689690840569d131166901e7549)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:24:58.871657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8511e-83c3-4ea1-975d-394529a99ee7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:24:59.031719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-89a8511e-83c3-4ea1-975d-394529a99ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca21c689690840569d131166901e7549'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:59.032420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-89a8511e-83c3-4ea1-975d-394529a99ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca21c689690840569d131166901e7549'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:59.078148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-89a8511e-83c3-4ea1-975d-394529a99ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca21c689690840569d131166901e7549'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:59.103429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-89a8511e-83c3-4ea1-975d-394529a99ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca21c689690840569d131166901e7549'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:59.105735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-89a8511e-83c3-4ea1-975d-394529a99ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca21c689690840569d131166901e7549'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:24:59.152428 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2577/5181] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:24:58 2022] DELETE /identity/v3/users/ca21c689690840569d131166901e7549 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:25:01.474673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:01.478541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:01.501055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da0b65-fef8-4217-b583-9742d519ea17 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:01.708425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:01.709220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:01.709613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:01.709994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf admin admin] PATH_INFO: `/v3/projects/5c985010ecd54984986e8dae728da40a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:01.712100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c985010ecd54984986e8dae728da40a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:01.714160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:01.718504 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:01.850591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c985010ecd54984986e8dae728da40a', 'request_id': 'req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:01.876339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c985010ecd54984986e8dae728da40a', 'request_id': 'req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:01.896866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c985010ecd54984986e8dae728da40a', 'request_id': 'req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:01.950487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf admin admin] The token cache is being invalidate because project 5c985010ecd54984986e8dae728da40a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:25:01.965858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:01.965858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b58affa3-33f1-4fa7-8d90-fd69a3bce8bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:01.965858 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2605/5182] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:25:01 2022] DELETE /identity/v3/projects/5c985010ecd54984986e8dae728da40a => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:25:01.973331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370189a-e9f6-4462-be38-922af0dd4924 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:01.974736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370189a-e9f6-4462-be38-922af0dd4924 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:01.975327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370189a-e9f6-4462-be38-922af0dd4924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:02.004042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b370189a-e9f6-4462-be38-922af0dd4924 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:02.005744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b370189a-e9f6-4462-be38-922af0dd4924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:02.103140 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2578/5183] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:02.111958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6ddb9-29d4-4699-af5d-2dfabcc1c198 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:02.112242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6ddb9-29d4-4699-af5d-2dfabcc1c198 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:02.112543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6ddb9-29d4-4699-af5d-2dfabcc1c198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:02.176349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e7b6ddb9-29d4-4699-af5d-2dfabcc1c198 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:02.177775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e7b6ddb9-29d4-4699-af5d-2dfabcc1c198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:02.226704 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2606/5184] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:02.231857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370189a-e9f6-4462-be38-922af0dd4924 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:02.253986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370189a-e9f6-4462-be38-922af0dd4924 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:02.274769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9723d-b1e6-4ef1-bd17-e1b7c1426118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:02.275606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9723d-b1e6-4ef1-bd17-e1b7c1426118 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:02.275987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9723d-b1e6-4ef1-bd17-e1b7c1426118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:02.276365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9723d-b1e6-4ef1-bd17-e1b7c1426118 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:02.277121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9723d-b1e6-4ef1-bd17-e1b7c1426118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:25:02.277526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9723d-b1e6-4ef1-bd17-e1b7c1426118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:02.279335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9723d-b1e6-4ef1-bd17-e1b7c1426118 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:02.308709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6ddb9-29d4-4699-af5d-2dfabcc1c198 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:02.309278 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2579/5185] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:25:02.325851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6ddb9-29d4-4699-af5d-2dfabcc1c198 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:02.345886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c80a49-b47c-4468-8f6c-726896a983f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:02.346672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c80a49-b47c-4468-8f6c-726896a983f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:02.347184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c80a49-b47c-4468-8f6c-726896a983f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:02.347590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c80a49-b47c-4468-8f6c-726896a983f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:02.348311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c80a49-b47c-4468-8f6c-726896a983f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:02.350344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c80a49-b47c-4468-8f6c-726896a983f7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:02.413025 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2607/5186] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:25:02 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:25:02.418139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9723d-b1e6-4ef1-bd17-e1b7c1426118 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:02.437284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9723d-b1e6-4ef1-bd17-e1b7c1426118 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:02.462474 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:02.610397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea8823-86cf-4dd3-bccc-348cb25626af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:02.610961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea8823-86cf-4dd3-bccc-348cb25626af admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:02.611243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea8823-86cf-4dd3-bccc-348cb25626af admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:02.611510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea8823-86cf-4dd3-bccc-348cb25626af admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:02.612146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea8823-86cf-4dd3-bccc-348cb25626af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:02.614046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea8823-86cf-4dd3-bccc-348cb25626af admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:02.666784 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2580/5187] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:25:02 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:25:02.668620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c80a49-b47c-4468-8f6c-726896a983f7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:02.707224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c80a49-b47c-4468-8f6c-726896a983f7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:02.719486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a8ff5-c183-4c92-b0f8-e2f92a5a0fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:02.720448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a8ff5-c183-4c92-b0f8-e2f92a5a0fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:02.721976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a8ff5-c183-4c92-b0f8-e2f92a5a0fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:02.722215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a8ff5-c183-4c92-b0f8-e2f92a5a0fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:02.724437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a8ff5-c183-4c92-b0f8-e2f92a5a0fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:02.733507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a8ff5-c183-4c92-b0f8-e2f92a5a0fd6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:02.767474 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2608/5188] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:25:02.773115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea8823-86cf-4dd3-bccc-348cb25626af admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:02.797678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea8823-86cf-4dd3-bccc-348cb25626af admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:02.816026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037206a-0bfa-4362-aedc-513954745d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:02.816642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037206a-0bfa-4362-aedc-513954745d7e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:02.816916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037206a-0bfa-4362-aedc-513954745d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:02.817185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037206a-0bfa-4362-aedc-513954745d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:02.817827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037206a-0bfa-4362-aedc-513954745d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:02.819508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037206a-0bfa-4362-aedc-513954745d7e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:02.856044 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2581/5189] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:25:02.860283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a8ff5-c183-4c92-b0f8-e2f92a5a0fd6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:02.883567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a8ff5-c183-4c92-b0f8-e2f92a5a0fd6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:02.889366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cc743-3b40-48c2-8794-94a487644b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:02.890037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cc743-3b40-48c2-8794-94a487644b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:02.890500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cc743-3b40-48c2-8794-94a487644b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:02.890986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cc743-3b40-48c2-8794-94a487644b16 admin admin] PATH_INFO: `/v3/projects/fbc7f530006f435ea19a30255ca10eef/users/c6a775085a174d51a19beaa02cb1d4e1/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:02.935929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cc743-3b40-48c2-8794-94a487644b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc7f530006f435ea19a30255ca10eef, user_id=c6a775085a174d51a19beaa02cb1d4e1, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:02.950963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cc743-3b40-48c2-8794-94a487644b16 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:02.983243 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2609/5190] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:25:02 2022] PUT /identity/v3/projects/fbc7f530006f435ea19a30255ca10eef/users/c6a775085a174d51a19beaa02cb1d4e1/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:25:02.986624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7ea5a-9842-4160-b80c-595762530e5f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:02.987255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7ea5a-9842-4160-b80c-595762530e5f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:02.987538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7ea5a-9842-4160-b80c-595762530e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:03.055686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-42b7ea5a-9842-4160-b80c-595762530e5f None None] MFA Rules not processed for user `c6a775085a174d51a19beaa02cb1d4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:03.060575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-42b7ea5a-9842-4160-b80c-595762530e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:03.186162 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2582/5191] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:03.190468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cc743-3b40-48c2-8794-94a487644b16 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:03.352640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cc743-3b40-48c2-8794-94a487644b16 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:03.368979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962978-3166-463c-93ac-8c5c93e7522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:03.369752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962978-3166-463c-93ac-8c5c93e7522a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:03.370551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962978-3166-463c-93ac-8c5c93e7522a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:03.370965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962978-3166-463c-93ac-8c5c93e7522a admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:03.373104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b962978-3166-463c-93ac-8c5c93e7522a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:03.375253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b962978-3166-463c-93ac-8c5c93e7522a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:03.445028 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2610/5192] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:25:03 2022] POST /identity/v3/projects => generated 375 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:25:03.448405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7ea5a-9842-4160-b80c-595762530e5f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:03.465657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7ea5a-9842-4160-b80c-595762530e5f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:03.615506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f524-ce1b-4df3-8a08-6314075a9460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:03.616191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f524-ce1b-4df3-8a08-6314075a9460 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:03.619692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f524-ce1b-4df3-8a08-6314075a9460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:03.619997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f524-ce1b-4df3-8a08-6314075a9460 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:03.620730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00f524-ce1b-4df3-8a08-6314075a9460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:03.622614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00f524-ce1b-4df3-8a08-6314075a9460 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:03.692912 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2583/5193] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:25:03 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:25:03.698262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962978-3166-463c-93ac-8c5c93e7522a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:03.712638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962978-3166-463c-93ac-8c5c93e7522a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:03.740130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb8fb2-8ce7-42a6-9843-c732a1895423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:03.740738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb8fb2-8ce7-42a6-9843-c732a1895423 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:03.741055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb8fb2-8ce7-42a6-9843-c732a1895423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:03.742027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb8fb2-8ce7-42a6-9843-c732a1895423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:03.743340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb8fb2-8ce7-42a6-9843-c732a1895423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:03.744961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb8fb2-8ce7-42a6-9843-c732a1895423 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:03.775396 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:03.797759 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2611/5194] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:25:03.798845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f524-ce1b-4df3-8a08-6314075a9460 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:03.815783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f524-ce1b-4df3-8a08-6314075a9460 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:03.827236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8e9a1-37e5-425f-b555-13340c1df098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:03.828065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8e9a1-37e5-425f-b555-13340c1df098 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:03.828392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8e9a1-37e5-425f-b555-13340c1df098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:03.828617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8e9a1-37e5-425f-b555-13340c1df098 admin admin] PATH_INFO: `/v3/projects/dae6df8f51c145f8a035d96887196ecd/users/953b1f75a5574a9f9a2580349f00cba6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:03.852954 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:03.864563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8e9a1-37e5-425f-b555-13340c1df098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae6df8f51c145f8a035d96887196ecd, user_id=953b1f75a5574a9f9a2580349f00cba6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:03.883684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8e9a1-37e5-425f-b555-13340c1df098 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:03.915627 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2584/5195] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:25:03 2022] PUT /identity/v3/projects/dae6df8f51c145f8a035d96887196ecd/users/953b1f75a5574a9f9a2580349f00cba6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:25:03.917101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb8fb2-8ce7-42a6-9843-c732a1895423 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:03.935263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb8fb2-8ce7-42a6-9843-c732a1895423 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:04.087923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b42a4-e428-4081-ac1a-2f9f0c8cc5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:04.088535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b42a4-e428-4081-ac1a-2f9f0c8cc5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:04.088813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b42a4-e428-4081-ac1a-2f9f0c8cc5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:04.089086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b42a4-e428-4081-ac1a-2f9f0c8cc5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:04.089799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b42a4-e428-4081-ac1a-2f9f0c8cc5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:04.091427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b42a4-e428-4081-ac1a-2f9f0c8cc5c6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:04.122253 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2612/5196] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:25:04.124182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8e9a1-37e5-425f-b555-13340c1df098 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:04.137421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8e9a1-37e5-425f-b555-13340c1df098 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:04.154987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a0899-2d2e-48a9-bb18-dfb248e92fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:04.155814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a0899-2d2e-48a9-bb18-dfb248e92fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:04.156097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a0899-2d2e-48a9-bb18-dfb248e92fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:04.156359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a0899-2d2e-48a9-bb18-dfb248e92fa3 admin admin] PATH_INFO: `/v3/projects/dae6df8f51c145f8a035d96887196ecd/users/953b1f75a5574a9f9a2580349f00cba6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:04.162403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a0899-2d2e-48a9-bb18-dfb248e92fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae6df8f51c145f8a035d96887196ecd, user_id=953b1f75a5574a9f9a2580349f00cba6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:04.166613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a0899-2d2e-48a9-bb18-dfb248e92fa3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:04.200182 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2585/5197] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:25:04 2022] PUT /identity/v3/projects/dae6df8f51c145f8a035d96887196ecd/users/953b1f75a5574a9f9a2580349f00cba6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:25:04.201834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf54d60-b52d-4f59-ad96-b5b58369c432 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:04.202122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf54d60-b52d-4f59-ad96-b5b58369c432 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:04.202398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf54d60-b52d-4f59-ad96-b5b58369c432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:04.272266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4bf54d60-b52d-4f59-ad96-b5b58369c432 None None] MFA Rules not processed for user `953b1f75a5574a9f9a2580349f00cba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:04.274929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4bf54d60-b52d-4f59-ad96-b5b58369c432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:04.502528 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2613/5198] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:04.656120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a0899-2d2e-48a9-bb18-dfb248e92fa3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:04.658087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-930a0899-2d2e-48a9-bb18-dfb248e92fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:04.793725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a0899-2d2e-48a9-bb18-dfb248e92fa3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:04.803581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f876c-c928-4f85-9621-530c2fac56da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:04.808344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f876c-c928-4f85-9621-530c2fac56da service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:04.808634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f876c-c928-4f85-9621-530c2fac56da service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:04.808911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f876c-c928-4f85-9621-530c2fac56da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:04.836402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f876c-c928-4f85-9621-530c2fac56da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:04.839401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f876c-c928-4f85-9621-530c2fac56da service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:04.862177 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2586/5199] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:25:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:25:14.487850 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=63 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:14.775423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf54d60-b52d-4f59-ad96-b5b58369c432 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:14.788857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf54d60-b52d-4f59-ad96-b5b58369c432 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:14.793993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7d010-9737-4ab4-b204-4653575c2f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:14.795097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d010-9737-4ab4-b204-4653575c2f58 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:14.795632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d010-9737-4ab4-b204-4653575c2f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:14.796402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d010-9737-4ab4-b204-4653575c2f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:14.800183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a3d7d010-9737-4ab4-b204-4653575c2f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:14.857267 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=35,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:14.972921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7d010-9737-4ab4-b204-4653575c2f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:14.978988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7d010-9737-4ab4-b204-4653575c2f58 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:15.039278 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2614/5200] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:25:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:25:15.114310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f876c-c928-4f85-9621-530c2fac56da service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:15.143906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f876c-c928-4f85-9621-530c2fac56da service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:15.159965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbe3a4-1f8b-465c-9d88-0fe697a43ff9 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953b1f75a5574a9f9a2580349f00cba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae6df8f51c145f8a035d96887196ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:15.160593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbe3a4-1f8b-465c-9d88-0fe697a43ff9 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:15.160876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbe3a4-1f8b-465c-9d88-0fe697a43ff9 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:15.161145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbe3a4-1f8b-465c-9d88-0fe697a43ff9 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:15.162001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbe3a4-1f8b-465c-9d88-0fe697a43ff9 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:25:15.162495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbe3a4-1f8b-465c-9d88-0fe697a43ff9 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:15.171848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbe3a4-1f8b-465c-9d88-0fe697a43ff9 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:15.209053 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2587/5201] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:25:15.214568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7d010-9737-4ab4-b204-4653575c2f58 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:15.236331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7d010-9737-4ab4-b204-4653575c2f58 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:15.252194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df626fbe-43b7-4093-89a8-b7d50a174c50 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953b1f75a5574a9f9a2580349f00cba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae6df8f51c145f8a035d96887196ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:15.253282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df626fbe-43b7-4093-89a8-b7d50a174c50 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:15.253794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df626fbe-43b7-4093-89a8-b7d50a174c50 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:15.254604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df626fbe-43b7-4093-89a8-b7d50a174c50 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:15.255625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df626fbe-43b7-4093-89a8-b7d50a174c50 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:15.258571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df626fbe-43b7-4093-89a8-b7d50a174c50 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:15.346189 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2615/5202] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:25:15 2022] POST /identity/v3/projects => generated 347 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:25:15.350539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbe3a4-1f8b-465c-9d88-0fe697a43ff9 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:15.363299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbe3a4-1f8b-465c-9d88-0fe697a43ff9 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:15.462772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a939-7519-43e6-8614-3ef68fc6d916 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953b1f75a5574a9f9a2580349f00cba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae6df8f51c145f8a035d96887196ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:15.462772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a939-7519-43e6-8614-3ef68fc6d916 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:15.462772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a939-7519-43e6-8614-3ef68fc6d916 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:15.463867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a939-7519-43e6-8614-3ef68fc6d916 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:15.463867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a939-7519-43e6-8614-3ef68fc6d916 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:25:15.463867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a939-7519-43e6-8614-3ef68fc6d916 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:15.463867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a939-7519-43e6-8614-3ef68fc6d916 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:15.495727 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2588/5203] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:25:16.086064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df626fbe-43b7-4093-89a8-b7d50a174c50 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:16.100687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df626fbe-43b7-4093-89a8-b7d50a174c50 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:16.112644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183d16b-2cee-4587-bbdd-bc4ff8235208 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953b1f75a5574a9f9a2580349f00cba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae6df8f51c145f8a035d96887196ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:16.113553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183d16b-2cee-4587-bbdd-bc4ff8235208 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:16.114079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183d16b-2cee-4587-bbdd-bc4ff8235208 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:16.114723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183d16b-2cee-4587-bbdd-bc4ff8235208 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] PATH_INFO: `/v3/projects/4839fb3a0a8e4f708e665c6624f5a980` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:16.118149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183d16b-2cee-4587-bbdd-bc4ff8235208 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4839fb3a0a8e4f708e665c6624f5a980)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:16.121441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183d16b-2cee-4587-bbdd-bc4ff8235208 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:16.175644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9183d16b-2cee-4587-bbdd-bc4ff8235208 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4839fb3a0a8e4f708e665c6624f5a980', 'request_id': 'req-9183d16b-2cee-4587-bbdd-bc4ff8235208'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:16.183232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9183d16b-2cee-4587-bbdd-bc4ff8235208 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4839fb3a0a8e4f708e665c6624f5a980', 'request_id': 'req-9183d16b-2cee-4587-bbdd-bc4ff8235208'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:16.191113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9183d16b-2cee-4587-bbdd-bc4ff8235208 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4839fb3a0a8e4f708e665c6624f5a980', 'request_id': 'req-9183d16b-2cee-4587-bbdd-bc4ff8235208'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:16.203863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9183d16b-2cee-4587-bbdd-bc4ff8235208 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] The token cache is being invalidate because project 4839fb3a0a8e4f708e665c6624f5a980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:25:16.204260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9183d16b-2cee-4587-bbdd-bc4ff8235208 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:16.205018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9183d16b-2cee-4587-bbdd-bc4ff8235208 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:16.207287 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2616/5204] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:25:16 2022] DELETE /identity/v3/projects/4839fb3a0a8e4f708e665c6624f5a980 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:25:16.220120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a939-7519-43e6-8614-3ef68fc6d916 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:16.222574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8986a939-7519-43e6-8614-3ef68fc6d916 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:16.287791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a939-7519-43e6-8614-3ef68fc6d916 tempest-RoutersIpV6AdminTest-128851712 tempest-RoutersIpV6AdminTest-128851712-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:16.339489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8a15b-1dc4-4a0c-85ef-5075b63423f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:16.340188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8a15b-1dc4-4a0c-85ef-5075b63423f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:16.340502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8a15b-1dc4-4a0c-85ef-5075b63423f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:16.340776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8a15b-1dc4-4a0c-85ef-5075b63423f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:16.342515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5ca8a15b-1dc4-4a0c-85ef-5075b63423f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:16.397200 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:16.411879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8a15b-1dc4-4a0c-85ef-5075b63423f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:16.413423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8a15b-1dc4-4a0c-85ef-5075b63423f5 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:16.423263 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2589/5205] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:25:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:25:18.982204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e90261-04aa-4b70-bd8a-08c376a791f1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:18.983335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e90261-04aa-4b70-bd8a-08c376a791f1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:18.983922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e90261-04aa-4b70-bd8a-08c376a791f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:19.025234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-58e90261-04aa-4b70-bd8a-08c376a791f1 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:19.027145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-58e90261-04aa-4b70-bd8a-08c376a791f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:19.100837 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:19.142118 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2617/5206] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:25:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:19.167377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8a15b-1dc4-4a0c-85ef-5075b63423f5 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:19.176593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5ca8a15b-1dc4-4a0c-85ef-5075b63423f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:19.326297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8a15b-1dc4-4a0c-85ef-5075b63423f5 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:19.340815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83b95b-24b4-4f27-8b47-220de63e8616 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:19.341832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83b95b-24b4-4f27-8b47-220de63e8616 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:19.342213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83b95b-24b4-4f27-8b47-220de63e8616 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:19.342588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83b95b-24b4-4f27-8b47-220de63e8616 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:19.360083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83b95b-24b4-4f27-8b47-220de63e8616 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:19.361772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83b95b-24b4-4f27-8b47-220de63e8616 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:19.390361 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2590/5207] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:25:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:24.324849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e90261-04aa-4b70-bd8a-08c376a791f1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:24.340779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e90261-04aa-4b70-bd8a-08c376a791f1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:24.349175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ea910-5f42-4dee-b795-9e8da84f5138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:24.350383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ea910-5f42-4dee-b795-9e8da84f5138 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:24.351453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ea910-5f42-4dee-b795-9e8da84f5138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:24.352641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ea910-5f42-4dee-b795-9e8da84f5138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:24.358310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a45ea910-5f42-4dee-b795-9e8da84f5138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:24.383174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ea910-5f42-4dee-b795-9e8da84f5138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:24.386233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ea910-5f42-4dee-b795-9e8da84f5138 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:24.408831 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2618/5208] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:25:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:25:29.368007 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=36 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:30.756874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83b95b-24b4-4f27-8b47-220de63e8616 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:30.758749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-da83b95b-24b4-4f27-8b47-220de63e8616 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:30.842819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83b95b-24b4-4f27-8b47-220de63e8616 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:30.847830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f89603-6170-43e7-9a4a-fc8a99e031e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:30.848310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f89603-6170-43e7-9a4a-fc8a99e031e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:30.848637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f89603-6170-43e7-9a4a-fc8a99e031e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:30.848918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f89603-6170-43e7-9a4a-fc8a99e031e1 admin admin] PATH_INFO: `/v3/users/c68d50afc01442eb9dbf1d306bba7052` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:30.850076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f89603-6170-43e7-9a4a-fc8a99e031e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68d50afc01442eb9dbf1d306bba7052)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:30.852374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f89603-6170-43e7-9a4a-fc8a99e031e1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:30.912241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f1f89603-6170-43e7-9a4a-fc8a99e031e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68d50afc01442eb9dbf1d306bba7052'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:30.913600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f1f89603-6170-43e7-9a4a-fc8a99e031e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68d50afc01442eb9dbf1d306bba7052'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:30.935939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f1f89603-6170-43e7-9a4a-fc8a99e031e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68d50afc01442eb9dbf1d306bba7052'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:30.944876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f1f89603-6170-43e7-9a4a-fc8a99e031e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68d50afc01442eb9dbf1d306bba7052'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:30.945584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f1f89603-6170-43e7-9a4a-fc8a99e031e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68d50afc01442eb9dbf1d306bba7052'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:30.961344 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2591/5209] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:25:30 2022] DELETE /identity/v3/users/c68d50afc01442eb9dbf1d306bba7052 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:25:31.467018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ea910-5f42-4dee-b795-9e8da84f5138 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:31.485491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ea910-5f42-4dee-b795-9e8da84f5138 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:31.692069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831859a-0b62-4d91-8bab-5ef9c1b159f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:31.693485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831859a-0b62-4d91-8bab-5ef9c1b159f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:31.698256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831859a-0b62-4d91-8bab-5ef9c1b159f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:31.699348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831859a-0b62-4d91-8bab-5ef9c1b159f2 admin admin] PATH_INFO: `/v3/projects/e0751d3ff2014be3ba106590c6abe65d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:31.703014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831859a-0b62-4d91-8bab-5ef9c1b159f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0751d3ff2014be3ba106590c6abe65d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:31.727072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831859a-0b62-4d91-8bab-5ef9c1b159f2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:31.911123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1831859a-0b62-4d91-8bab-5ef9c1b159f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0751d3ff2014be3ba106590c6abe65d', 'request_id': 'req-1831859a-0b62-4d91-8bab-5ef9c1b159f2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:31.927178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1831859a-0b62-4d91-8bab-5ef9c1b159f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0751d3ff2014be3ba106590c6abe65d', 'request_id': 'req-1831859a-0b62-4d91-8bab-5ef9c1b159f2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:31.956029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1831859a-0b62-4d91-8bab-5ef9c1b159f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0751d3ff2014be3ba106590c6abe65d', 'request_id': 'req-1831859a-0b62-4d91-8bab-5ef9c1b159f2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:31.980849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1831859a-0b62-4d91-8bab-5ef9c1b159f2 admin admin] The token cache is being invalidate because project e0751d3ff2014be3ba106590c6abe65d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:25:31.981197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1831859a-0b62-4d91-8bab-5ef9c1b159f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:31.981816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1831859a-0b62-4d91-8bab-5ef9c1b159f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:31.983909 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2619/5210] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:25:31 2022] DELETE /identity/v3/projects/e0751d3ff2014be3ba106590c6abe65d => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:25:31.988443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a400cb0-63f7-4e35-bea2-3e1472caad7f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:31.988869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a400cb0-63f7-4e35-bea2-3e1472caad7f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:31.989127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a400cb0-63f7-4e35-bea2-3e1472caad7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:32.025635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4a400cb0-63f7-4e35-bea2-3e1472caad7f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:32.026879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4a400cb0-63f7-4e35-bea2-3e1472caad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:32.189461 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2592/5211] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:32.198992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872561f-774d-4074-89fb-7dd7d976d5a2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:32.199283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872561f-774d-4074-89fb-7dd7d976d5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:32.199568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872561f-774d-4074-89fb-7dd7d976d5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:32.256966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4872561f-774d-4074-89fb-7dd7d976d5a2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:32.262308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4872561f-774d-4074-89fb-7dd7d976d5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:32.287518 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2620/5212] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:32.288952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a400cb0-63f7-4e35-bea2-3e1472caad7f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:32.304597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a400cb0-63f7-4e35-bea2-3e1472caad7f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:32.317740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a99edf-f4f6-4151-950f-9f7c59f4e4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:32.319767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a99edf-f4f6-4151-950f-9f7c59f4e4bc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:32.320065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a99edf-f4f6-4151-950f-9f7c59f4e4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:32.320365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a99edf-f4f6-4151-950f-9f7c59f4e4bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:32.321153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a99edf-f4f6-4151-950f-9f7c59f4e4bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:25:32.321466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a99edf-f4f6-4151-950f-9f7c59f4e4bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:32.324693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a99edf-f4f6-4151-950f-9f7c59f4e4bc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:32.352273 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2593/5213] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:25:32.355629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872561f-774d-4074-89fb-7dd7d976d5a2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:32.367760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872561f-774d-4074-89fb-7dd7d976d5a2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:32.385654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7fe66-c3d3-4d34-8a5b-14ed4fd82509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:32.387377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7fe66-c3d3-4d34-8a5b-14ed4fd82509 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:32.387377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7fe66-c3d3-4d34-8a5b-14ed4fd82509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:32.387377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7fe66-c3d3-4d34-8a5b-14ed4fd82509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:32.387716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7fe66-c3d3-4d34-8a5b-14ed4fd82509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:32.389420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7fe66-c3d3-4d34-8a5b-14ed4fd82509 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:32.474667 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2621/5214] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:25:32 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:25:32.477893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a99edf-f4f6-4151-950f-9f7c59f4e4bc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:32.493568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a99edf-f4f6-4151-950f-9f7c59f4e4bc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:32.501861 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:32.717901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d649a4-e862-4fdb-9575-c48e9149919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:32.718544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d649a4-e862-4fdb-9575-c48e9149919f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:32.718939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d649a4-e862-4fdb-9575-c48e9149919f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:32.719115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d649a4-e862-4fdb-9575-c48e9149919f admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:32.719773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d649a4-e862-4fdb-9575-c48e9149919f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:32.721873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d649a4-e862-4fdb-9575-c48e9149919f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:32.773054 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2594/5215] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:25:32 2022] POST /identity/v3/users => generated 282 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:25:32.774948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7fe66-c3d3-4d34-8a5b-14ed4fd82509 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:32.790120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7fe66-c3d3-4d34-8a5b-14ed4fd82509 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:32.802372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b74dd-e7cb-4a7c-bc89-a175f20214a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:32.803040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b74dd-e7cb-4a7c-bc89-a175f20214a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:32.803695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b74dd-e7cb-4a7c-bc89-a175f20214a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:32.803695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b74dd-e7cb-4a7c-bc89-a175f20214a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:32.804408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b74dd-e7cb-4a7c-bc89-a175f20214a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:32.806026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b74dd-e7cb-4a7c-bc89-a175f20214a2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:32.834187 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2622/5216] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:25:32.835986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d649a4-e862-4fdb-9575-c48e9149919f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:32.849351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d649a4-e862-4fdb-9575-c48e9149919f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:32.862471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d5f51-1bf4-4ad2-94a1-cb3a0b4a18b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:32.863303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d5f51-1bf4-4ad2-94a1-cb3a0b4a18b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:32.863586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d5f51-1bf4-4ad2-94a1-cb3a0b4a18b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:32.863951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d5f51-1bf4-4ad2-94a1-cb3a0b4a18b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:32.864637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d5f51-1bf4-4ad2-94a1-cb3a0b4a18b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:32.870948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d5f51-1bf4-4ad2-94a1-cb3a0b4a18b6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:32.892587 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2595/5217] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:25:32.896865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b74dd-e7cb-4a7c-bc89-a175f20214a2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:32.911055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b74dd-e7cb-4a7c-bc89-a175f20214a2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:32.924358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218969a-3648-4ebd-abae-ff4ab87a6e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:32.925790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218969a-3648-4ebd-abae-ff4ab87a6e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:32.926081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218969a-3648-4ebd-abae-ff4ab87a6e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:32.926377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218969a-3648-4ebd-abae-ff4ab87a6e81 admin admin] PATH_INFO: `/v3/projects/49b137214679475b8afbae82fd4900db/users/6ad333699d5f49d1b8fe8e2a298ad344/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:32.964337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218969a-3648-4ebd-abae-ff4ab87a6e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b137214679475b8afbae82fd4900db, user_id=6ad333699d5f49d1b8fe8e2a298ad344, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:32.968387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218969a-3648-4ebd-abae-ff4ab87a6e81 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:32.996425 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2623/5218] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:25:32 2022] PUT /identity/v3/projects/49b137214679475b8afbae82fd4900db/users/6ad333699d5f49d1b8fe8e2a298ad344/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:25:33.006144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f53f7e-bb21-4f5b-aba5-4f327a18937a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:33.007272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f53f7e-bb21-4f5b-aba5-4f327a18937a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:33.007530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f53f7e-bb21-4f5b-aba5-4f327a18937a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:33.070895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-73f53f7e-bb21-4f5b-aba5-4f327a18937a None None] MFA Rules not processed for user `6ad333699d5f49d1b8fe8e2a298ad344`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:33.080836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-73f53f7e-bb21-4f5b-aba5-4f327a18937a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:33.298097 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2596/5219] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:33.306687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218969a-3648-4ebd-abae-ff4ab87a6e81 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:33.308741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5218969a-3648-4ebd-abae-ff4ab87a6e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:33.321342 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:33.574753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218969a-3648-4ebd-abae-ff4ab87a6e81 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:33.580990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32985f9-974e-453c-ad09-b1e00d7a44b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:33.581618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32985f9-974e-453c-ad09-b1e00d7a44b3 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:33.581912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32985f9-974e-453c-ad09-b1e00d7a44b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:33.582176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32985f9-974e-453c-ad09-b1e00d7a44b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:33.600832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32985f9-974e-453c-ad09-b1e00d7a44b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:33.610229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32985f9-974e-453c-ad09-b1e00d7a44b3 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:33.626557 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2624/5220] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:25:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:25:33.644170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa58b4-6ccb-48d5-9a7f-4e9cd32fce39 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:33.644781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa58b4-6ccb-48d5-9a7f-4e9cd32fce39 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:33.645557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa58b4-6ccb-48d5-9a7f-4e9cd32fce39 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:33.648327 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2597/5221] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:25:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:25:33.655366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32985f9-974e-453c-ad09-b1e00d7a44b3 service nova] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:25:33.673361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32985f9-974e-453c-ad09-b1e00d7a44b3 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:33.689204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32985f9-974e-453c-ad09-b1e00d7a44b3 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:33.704840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b74c-2b0f-4a54-9fea-9f7ba7cd6530 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad333699d5f49d1b8fe8e2a298ad344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b137214679475b8afbae82fd4900db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:33.705532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b74c-2b0f-4a54-9fea-9f7ba7cd6530 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:33.705819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b74c-2b0f-4a54-9fea-9f7ba7cd6530 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:33.706096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b74c-2b0f-4a54-9fea-9f7ba7cd6530 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] PATH_INFO: `/v3/projects/49b137214679475b8afbae82fd4900db` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:33.707507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66b74c-2b0f-4a54-9fea-9f7ba7cd6530 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: Authorizing `identity:get_project(project_id=49b137214679475b8afbae82fd4900db)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:33.710124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66b74c-2b0f-4a54-9fea-9f7ba7cd6530 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:33.716885 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2625/5222] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:25:33 2022] GET /identity/v3/projects/49b137214679475b8afbae82fd4900db => generated 363 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:25:33.773865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da690738-4ecb-46b2-af03-3ef9d6659c4b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:33.774192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da690738-4ecb-46b2-af03-3ef9d6659c4b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:33.774444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da690738-4ecb-46b2-af03-3ef9d6659c4b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:33.776230 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2598/5223] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:25:33.784953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b74c-2b0f-4a54-9fea-9f7ba7cd6530 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:25:33.807872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b74c-2b0f-4a54-9fea-9f7ba7cd6530 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:33.828143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b74c-2b0f-4a54-9fea-9f7ba7cd6530 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:33.845252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af7ebc-c04e-40aa-afb1-533e74058940 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad333699d5f49d1b8fe8e2a298ad344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b137214679475b8afbae82fd4900db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:33.845984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af7ebc-c04e-40aa-afb1-533e74058940 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:33.847982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af7ebc-c04e-40aa-afb1-533e74058940 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:33.848471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af7ebc-c04e-40aa-afb1-533e74058940 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] PATH_INFO: `/v3/projects/49b137214679475b8afbae82fd4900db` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:33.859038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af7ebc-c04e-40aa-afb1-533e74058940 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: Authorizing `identity:get_project(project_id=49b137214679475b8afbae82fd4900db)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:33.860485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af7ebc-c04e-40aa-afb1-533e74058940 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:33.863441 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2626/5224] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:25:33 2022] GET /identity/v3/projects/49b137214679475b8afbae82fd4900db => generated 363 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:25:33.905978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02673f2e-eb09-48f2-baf2-f31659f6a3d0 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:33.906586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02673f2e-eb09-48f2-baf2-f31659f6a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:33.907161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02673f2e-eb09-48f2-baf2-f31659f6a3d0 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:33.909000 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2599/5225] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:25:33.914882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af7ebc-c04e-40aa-afb1-533e74058940 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:25:33.931170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af7ebc-c04e-40aa-afb1-533e74058940 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:33.941608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af7ebc-c04e-40aa-afb1-533e74058940 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:33.947315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c0f1f-5bde-4dd9-93b6-a3bc820752ae tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad333699d5f49d1b8fe8e2a298ad344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b137214679475b8afbae82fd4900db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:33.948304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c0f1f-5bde-4dd9-93b6-a3bc820752ae tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:33.948806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c0f1f-5bde-4dd9-93b6-a3bc820752ae tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:33.949321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c0f1f-5bde-4dd9-93b6-a3bc820752ae tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] PATH_INFO: `/v3/projects/49b137214679475b8afbae82fd4900db` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:33.950790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c0f1f-5bde-4dd9-93b6-a3bc820752ae tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: Authorizing `identity:get_project(project_id=49b137214679475b8afbae82fd4900db)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:33.952839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c0f1f-5bde-4dd9-93b6-a3bc820752ae tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:33.963330 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2627/5226] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:25:33 2022] GET /identity/v3/projects/49b137214679475b8afbae82fd4900db => generated 363 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:25:33.989339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df03c9c-0d4a-487f-8187-7ccc2f136708 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:33.989659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df03c9c-0d4a-487f-8187-7ccc2f136708 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:33.989896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df03c9c-0d4a-487f-8187-7ccc2f136708 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:33.992756 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2600/5227] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:25:34.007290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c0f1f-5bde-4dd9-93b6-a3bc820752ae tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:25:34.032326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c0f1f-5bde-4dd9-93b6-a3bc820752ae tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:34.046760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c0f1f-5bde-4dd9-93b6-a3bc820752ae tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:34.065510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1aef4-a63f-4eb1-8efe-35f2e8e5aca8 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad333699d5f49d1b8fe8e2a298ad344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b137214679475b8afbae82fd4900db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:34.066510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1aef4-a63f-4eb1-8efe-35f2e8e5aca8 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:34.067670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1aef4-a63f-4eb1-8efe-35f2e8e5aca8 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:34.068129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1aef4-a63f-4eb1-8efe-35f2e8e5aca8 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] PATH_INFO: `/v3/projects/49b137214679475b8afbae82fd4900db` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:34.069996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1aef4-a63f-4eb1-8efe-35f2e8e5aca8 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: Authorizing `identity:get_project(project_id=49b137214679475b8afbae82fd4900db)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:34.072655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1aef4-a63f-4eb1-8efe-35f2e8e5aca8 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:34.089020 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2628/5228] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:25:34 2022] GET /identity/v3/projects/49b137214679475b8afbae82fd4900db => generated 363 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:25:34.279611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa327d56-d2c5-4b40-803f-a5e3437ceeb7 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:34.280157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa327d56-d2c5-4b40-803f-a5e3437ceeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:34.280955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa327d56-d2c5-4b40-803f-a5e3437ceeb7 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:34.282554 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2601/5229] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:25:34.288779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1aef4-a63f-4eb1-8efe-35f2e8e5aca8 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:25:34.291080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1be1aef4-a63f-4eb1-8efe-35f2e8e5aca8 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:34.320855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1aef4-a63f-4eb1-8efe-35f2e8e5aca8 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:34.347260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1aef4-a63f-4eb1-8efe-35f2e8e5aca8 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:34.357985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e8b3e-efc6-4654-ba5b-bebdc38b9b27 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad333699d5f49d1b8fe8e2a298ad344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b137214679475b8afbae82fd4900db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:34.359801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e8b3e-efc6-4654-ba5b-bebdc38b9b27 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:34.360086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e8b3e-efc6-4654-ba5b-bebdc38b9b27 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:34.360356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e8b3e-efc6-4654-ba5b-bebdc38b9b27 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] PATH_INFO: `/v3/projects/49b137214679475b8afbae82fd4900db` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:34.369015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e8b3e-efc6-4654-ba5b-bebdc38b9b27 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: Authorizing `identity:get_project(project_id=49b137214679475b8afbae82fd4900db)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:34.370838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e8b3e-efc6-4654-ba5b-bebdc38b9b27 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:34.373029 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2629/5230] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:25:34 2022] GET /identity/v3/projects/49b137214679475b8afbae82fd4900db => generated 363 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:25:34.425910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa327d56-d2c5-4b40-803f-a5e3437ceeb7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:34.590404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa327d56-d2c5-4b40-803f-a5e3437ceeb7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:34.595651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:34.596511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:34.599229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:34.599910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] PATH_INFO: `/v3/users/6ad333699d5f49d1b8fe8e2a298ad344` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:34.602591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad333699d5f49d1b8fe8e2a298ad344)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:34.609766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:34.649487 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:34.716115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad333699d5f49d1b8fe8e2a298ad344'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:34.717256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad333699d5f49d1b8fe8e2a298ad344'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:34.734038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad333699d5f49d1b8fe8e2a298ad344'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:34.757442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad333699d5f49d1b8fe8e2a298ad344'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:34.758512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad333699d5f49d1b8fe8e2a298ad344'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:34.779725 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2602/5231] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:25:34 2022] DELETE /identity/v3/users/6ad333699d5f49d1b8fe8e2a298ad344 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:25:34.781453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52a7fd-b8ee-4406-b07d-34409b4bfc66 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:34.781937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52a7fd-b8ee-4406-b07d-34409b4bfc66 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:34.782050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52a7fd-b8ee-4406-b07d-34409b4bfc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:34.808891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ba52a7fd-b8ee-4406-b07d-34409b4bfc66 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:34.810112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ba52a7fd-b8ee-4406-b07d-34409b4bfc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:35.018012 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2630/5232] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:35.076702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:35.078146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:35.244230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409c8e5-e3dd-4a45-bee8-09d18b693e25 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:35.251818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273ce8f-6f61-48e4-97d4-837ef1a18daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:35.252475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273ce8f-6f61-48e4-97d4-837ef1a18daa service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:35.252755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273ce8f-6f61-48e4-97d4-837ef1a18daa service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:35.253034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273ce8f-6f61-48e4-97d4-837ef1a18daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:35.275341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273ce8f-6f61-48e4-97d4-837ef1a18daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:35.276804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273ce8f-6f61-48e4-97d4-837ef1a18daa service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:35.310440 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2603/5233] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:25:37.437966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52a7fd-b8ee-4406-b07d-34409b4bfc66 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:37.439608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ba52a7fd-b8ee-4406-b07d-34409b4bfc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:37.461112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52a7fd-b8ee-4406-b07d-34409b4bfc66 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:37.479317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1583e97-4965-45f2-b4ee-cf30785f7dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:37.480474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583e97-4965-45f2-b4ee-cf30785f7dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:37.481092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583e97-4965-45f2-b4ee-cf30785f7dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:37.481476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583e97-4965-45f2-b4ee-cf30785f7dab admin admin] PATH_INFO: `/v3/projects/49b137214679475b8afbae82fd4900db` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:37.484530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1583e97-4965-45f2-b4ee-cf30785f7dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b137214679475b8afbae82fd4900db)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:37.487091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1583e97-4965-45f2-b4ee-cf30785f7dab admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:37.588423 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:37.609251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1583e97-4965-45f2-b4ee-cf30785f7dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b137214679475b8afbae82fd4900db', 'request_id': 'req-f1583e97-4965-45f2-b4ee-cf30785f7dab'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:37.619106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1583e97-4965-45f2-b4ee-cf30785f7dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b137214679475b8afbae82fd4900db', 'request_id': 'req-f1583e97-4965-45f2-b4ee-cf30785f7dab'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:37.643358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1583e97-4965-45f2-b4ee-cf30785f7dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b137214679475b8afbae82fd4900db', 'request_id': 'req-f1583e97-4965-45f2-b4ee-cf30785f7dab'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:37.670410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1583e97-4965-45f2-b4ee-cf30785f7dab admin admin] The token cache is being invalidate because project 49b137214679475b8afbae82fd4900db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:25:37.670716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1583e97-4965-45f2-b4ee-cf30785f7dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:37.671652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1583e97-4965-45f2-b4ee-cf30785f7dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:25:37.674411 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2631/5234] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:25:37 2022] DELETE /identity/v3/projects/49b137214679475b8afbae82fd4900db => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:25:37.681915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c418c0-c4ab-4319-9de3-0d7a12ce557e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:37.683625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c418c0-c4ab-4319-9de3-0d7a12ce557e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:37.684651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c418c0-c4ab-4319-9de3-0d7a12ce557e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:37.728519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-05c418c0-c4ab-4319-9de3-0d7a12ce557e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:37.730348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-05c418c0-c4ab-4319-9de3-0d7a12ce557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:37.827122 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2604/5235] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:25:37.835692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a127c5-8fdc-4148-897d-81cb4fc9f48d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:37.835692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a127c5-8fdc-4148-897d-81cb4fc9f48d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:37.836058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a127c5-8fdc-4148-897d-81cb4fc9f48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:37.860835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-90a127c5-8fdc-4148-897d-81cb4fc9f48d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:37.862059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-90a127c5-8fdc-4148-897d-81cb4fc9f48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:37.886556 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2632/5236] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:37.890748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c418c0-c4ab-4319-9de3-0d7a12ce557e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:37.905325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c418c0-c4ab-4319-9de3-0d7a12ce557e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:37.912593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139e172-80cc-4f1f-8c27-4a1b7cf6da70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:37.913418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139e172-80cc-4f1f-8c27-4a1b7cf6da70 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:37.913515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139e172-80cc-4f1f-8c27-4a1b7cf6da70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:37.913767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139e172-80cc-4f1f-8c27-4a1b7cf6da70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:37.915352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139e172-80cc-4f1f-8c27-4a1b7cf6da70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:25:37.916037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139e172-80cc-4f1f-8c27-4a1b7cf6da70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:37.920878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139e172-80cc-4f1f-8c27-4a1b7cf6da70 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:37.939564 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2605/5237] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:25:37.942962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a127c5-8fdc-4148-897d-81cb4fc9f48d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:37.961990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a127c5-8fdc-4148-897d-81cb4fc9f48d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:37.977749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05528d-9145-4cd2-8893-ab7778ffb782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:37.978380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05528d-9145-4cd2-8893-ab7778ffb782 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:37.978655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05528d-9145-4cd2-8893-ab7778ffb782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:37.978977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05528d-9145-4cd2-8893-ab7778ffb782 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:37.979582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05528d-9145-4cd2-8893-ab7778ffb782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:37.988790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05528d-9145-4cd2-8893-ab7778ffb782 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:38.072338 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2633/5238] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:25:37 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:25:38.073923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139e172-80cc-4f1f-8c27-4a1b7cf6da70 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:38.094532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139e172-80cc-4f1f-8c27-4a1b7cf6da70 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:38.157816 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:38.250957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1cb81-de8a-4505-8c5c-ca19613930fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:38.251898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1cb81-de8a-4505-8c5c-ca19613930fe admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:38.252258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1cb81-de8a-4505-8c5c-ca19613930fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:38.252603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1cb81-de8a-4505-8c5c-ca19613930fe admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:38.253448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1cb81-de8a-4505-8c5c-ca19613930fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:38.257845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1cb81-de8a-4505-8c5c-ca19613930fe admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:38.291092 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2606/5239] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:25:38 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:25:38.294724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05528d-9145-4cd2-8893-ab7778ffb782 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:38.313012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05528d-9145-4cd2-8893-ab7778ffb782 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:38.321869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dead4e-ee9d-4916-8962-a4c3a0d5690d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:38.322789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dead4e-ee9d-4916-8962-a4c3a0d5690d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:38.323323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dead4e-ee9d-4916-8962-a4c3a0d5690d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:38.323824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dead4e-ee9d-4916-8962-a4c3a0d5690d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:38.325133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dead4e-ee9d-4916-8962-a4c3a0d5690d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:38.327595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dead4e-ee9d-4916-8962-a4c3a0d5690d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:38.341859 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2634/5240] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:25:38.346477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1cb81-de8a-4505-8c5c-ca19613930fe admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:38.375950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1cb81-de8a-4505-8c5c-ca19613930fe admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:38.390247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50c460-7bf2-4797-9c1b-6707667674c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:38.390879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50c460-7bf2-4797-9c1b-6707667674c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:38.391190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50c460-7bf2-4797-9c1b-6707667674c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:38.391611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50c460-7bf2-4797-9c1b-6707667674c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:38.392202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50c460-7bf2-4797-9c1b-6707667674c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:38.393817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50c460-7bf2-4797-9c1b-6707667674c9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:38.418900 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2607/5241] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:25:38.423071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dead4e-ee9d-4916-8962-a4c3a0d5690d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:38.440826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dead4e-ee9d-4916-8962-a4c3a0d5690d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:38.456690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265769ab-63c1-4bd0-b807-bad85af603e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:38.457624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265769ab-63c1-4bd0-b807-bad85af603e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:38.458149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265769ab-63c1-4bd0-b807-bad85af603e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:38.458655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265769ab-63c1-4bd0-b807-bad85af603e3 admin admin] PATH_INFO: `/v3/projects/cff8886e6a5f4728806b806cb3459ac5/users/1fbc6af4172d4f3d95ae57485bf6d7a2/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:38.517914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265769ab-63c1-4bd0-b807-bad85af603e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff8886e6a5f4728806b806cb3459ac5, user_id=1fbc6af4172d4f3d95ae57485bf6d7a2, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:38.520905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265769ab-63c1-4bd0-b807-bad85af603e3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:38.562108 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2635/5242] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:25:38 2022] PUT /identity/v3/projects/cff8886e6a5f4728806b806cb3459ac5/users/1fbc6af4172d4f3d95ae57485bf6d7a2/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:25:38.563980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677184-af7e-40be-a4b8-c7854b88cb3a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:38.564345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677184-af7e-40be-a4b8-c7854b88cb3a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:38.564668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677184-af7e-40be-a4b8-c7854b88cb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:38.617006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e3677184-af7e-40be-a4b8-c7854b88cb3a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:38.622773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e3677184-af7e-40be-a4b8-c7854b88cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:38.754227 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2608/5243] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:38.811020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265769ab-63c1-4bd0-b807-bad85af603e3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:38.813296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-265769ab-63c1-4bd0-b807-bad85af603e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:39.061657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265769ab-63c1-4bd0-b807-bad85af603e3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:39.068302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5196593-4708-4cf7-8b3b-0210e14fab84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:39.071747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5196593-4708-4cf7-8b3b-0210e14fab84 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:39.072064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5196593-4708-4cf7-8b3b-0210e14fab84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:39.072347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5196593-4708-4cf7-8b3b-0210e14fab84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:39.148308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5196593-4708-4cf7-8b3b-0210e14fab84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:39.149805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5196593-4708-4cf7-8b3b-0210e14fab84 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:39.208930 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2636/5244] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:25:39.656614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3677184-af7e-40be-a4b8-c7854b88cb3a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:39.676882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3677184-af7e-40be-a4b8-c7854b88cb3a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:39.689711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48ea58-bed0-4c45-ac4c-dd331271d2e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:39.690828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48ea58-bed0-4c45-ac4c-dd331271d2e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:39.691314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48ea58-bed0-4c45-ac4c-dd331271d2e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:39.691762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48ea58-bed0-4c45-ac4c-dd331271d2e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:39.693806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6a48ea58-bed0-4c45-ac4c-dd331271d2e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:39.879147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48ea58-bed0-4c45-ac4c-dd331271d2e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:39.881231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48ea58-bed0-4c45-ac4c-dd331271d2e1 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:39.907672 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2609/5245] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:25:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:25:40.485368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c41f2-84c8-48d0-b18f-37c9e12ee977 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:40.485939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c41f2-84c8-48d0-b18f-37c9e12ee977 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:40.486180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c41f2-84c8-48d0-b18f-37c9e12ee977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:40.536058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-686c41f2-84c8-48d0-b18f-37c9e12ee977 None None] MFA Rules not processed for user `a3ac1408c91c4db59f4639abdca2c98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:40.540215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-686c41f2-84c8-48d0-b18f-37c9e12ee977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:40.711805 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2637/5246] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:48.016439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b154c-11fb-404d-a44a-3b3a1d45df32 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:48.016995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b154c-11fb-404d-a44a-3b3a1d45df32 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:48.016995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b154c-11fb-404d-a44a-3b3a1d45df32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:48.058374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8b1b154c-11fb-404d-a44a-3b3a1d45df32 None None] MFA Rules not processed for user `88d5c0890ae64fd6aa7e7e547e9bf736`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:48.060166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8b1b154c-11fb-404d-a44a-3b3a1d45df32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:48.131945 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:48.226952 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2610/5247] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:50.693847 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:53.204641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c96522-078b-41c4-b01d-0c61a69ff822 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:53.205748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c96522-078b-41c4-b01d-0c61a69ff822 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:53.206431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c96522-078b-41c4-b01d-0c61a69ff822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:53.272110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-77c96522-078b-41c4-b01d-0c61a69ff822 None None] MFA Rules not processed for user `1fbc6af4172d4f3d95ae57485bf6d7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:53.273707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-77c96522-078b-41c4-b01d-0c61a69ff822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:53.440865 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2638/5248] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:53.455675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b154c-11fb-404d-a44a-3b3a1d45df32 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:53.457108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8b1b154c-11fb-404d-a44a-3b3a1d45df32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:53.498206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b154c-11fb-404d-a44a-3b3a1d45df32 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:53.514340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2722a84-bcae-44d0-8b75-d37863179f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:53.515003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2722a84-bcae-44d0-8b75-d37863179f5f service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:53.515290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2722a84-bcae-44d0-8b75-d37863179f5f service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:53.515567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2722a84-bcae-44d0-8b75-d37863179f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:53.530630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2722a84-bcae-44d0-8b75-d37863179f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:53.533644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2722a84-bcae-44d0-8b75-d37863179f5f service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:53.573424 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2611/5249] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:25:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:25:56.994766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c96522-078b-41c4-b01d-0c61a69ff822 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:57.015587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c96522-078b-41c4-b01d-0c61a69ff822 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:57.027700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838cdd3-18ec-4aa6-a2c1-9438f0ad8b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:57.028344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838cdd3-18ec-4aa6-a2c1-9438f0ad8b30 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:57.028639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838cdd3-18ec-4aa6-a2c1-9438f0ad8b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:57.029475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838cdd3-18ec-4aa6-a2c1-9438f0ad8b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:57.033764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7838cdd3-18ec-4aa6-a2c1-9438f0ad8b30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:57.069572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838cdd3-18ec-4aa6-a2c1-9438f0ad8b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:57.073273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838cdd3-18ec-4aa6-a2c1-9438f0ad8b30 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:57.099229 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2639/5250] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:25:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:25:58.141932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e953c-8ddb-479d-ac5a-4a6f1aeba312 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:58.142996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e953c-8ddb-479d-ac5a-4a6f1aeba312 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:58.144876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e953c-8ddb-479d-ac5a-4a6f1aeba312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:58.185014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9e8e953c-8ddb-479d-ac5a-4a6f1aeba312 None None] MFA Rules not processed for user `1fbc6af4172d4f3d95ae57485bf6d7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:25:58.186521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9e8e953c-8ddb-479d-ac5a-4a6f1aeba312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:58.210696 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2612/5251] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:25:59.829145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838cdd3-18ec-4aa6-a2c1-9438f0ad8b30 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:25:59.831281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7838cdd3-18ec-4aa6-a2c1-9438f0ad8b30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:59.848849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838cdd3-18ec-4aa6-a2c1-9438f0ad8b30 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:25:59.863739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71c807-c20b-4b62-9e4b-ca6c5c5dcdd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:25:59.864750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c807-c20b-4b62-9e4b-ca6c5c5dcdd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:25:59.865288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c807-c20b-4b62-9e4b-ca6c5c5dcdd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:25:59.865981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c807-c20b-4b62-9e4b-ca6c5c5dcdd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:25:59.869525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fe71c807-c20b-4b62-9e4b-ca6c5c5dcdd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:25:59.894008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71c807-c20b-4b62-9e4b-ca6c5c5dcdd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:25:59.896485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71c807-c20b-4b62-9e4b-ca6c5c5dcdd5 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:25:59.943330 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2640/5252] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:04.285644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e953c-8ddb-479d-ac5a-4a6f1aeba312 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:04.288381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9e8e953c-8ddb-479d-ac5a-4a6f1aeba312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:04.439521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e953c-8ddb-479d-ac5a-4a6f1aeba312 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:04.444399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3241-baf1-4640-8d4b-22e9371b13ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:04.445017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3241-baf1-4640-8d4b-22e9371b13ae service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:04.445425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3241-baf1-4640-8d4b-22e9371b13ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:04.445697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3241-baf1-4640-8d4b-22e9371b13ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:04.447778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bf4b3241-baf1-4640-8d4b-22e9371b13ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:04.539873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b3241-baf1-4640-8d4b-22e9371b13ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:04.541908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b3241-baf1-4640-8d4b-22e9371b13ae service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:04.553699 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2613/5253] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:07.383719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71c807-c20b-4b62-9e4b-ca6c5c5dcdd5 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:07.385352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fe71c807-c20b-4b62-9e4b-ca6c5c5dcdd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:07.407185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71c807-c20b-4b62-9e4b-ca6c5c5dcdd5 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:07.413238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1a4e8-9389-4809-8e2d-ba383305dd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:07.414409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1a4e8-9389-4809-8e2d-ba383305dd90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:07.414409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1a4e8-9389-4809-8e2d-ba383305dd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:07.414409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1a4e8-9389-4809-8e2d-ba383305dd90 admin admin] PATH_INFO: `/v3/users/d5e97960c4eb488b900951e0898f34c8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:07.415681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1a4e8-9389-4809-8e2d-ba383305dd90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e97960c4eb488b900951e0898f34c8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:07.417787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1a4e8-9389-4809-8e2d-ba383305dd90 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:07.515622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7c1a4e8-9389-4809-8e2d-ba383305dd90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e97960c4eb488b900951e0898f34c8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:07.516356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7c1a4e8-9389-4809-8e2d-ba383305dd90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e97960c4eb488b900951e0898f34c8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:07.544893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7c1a4e8-9389-4809-8e2d-ba383305dd90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e97960c4eb488b900951e0898f34c8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:07.570553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7c1a4e8-9389-4809-8e2d-ba383305dd90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e97960c4eb488b900951e0898f34c8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:07.571425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b7c1a4e8-9389-4809-8e2d-ba383305dd90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e97960c4eb488b900951e0898f34c8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:07.586378 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2641/5254] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:07 2022] DELETE /identity/v3/users/d5e97960c4eb488b900951e0898f34c8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:08.139993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3241-baf1-4640-8d4b-22e9371b13ae service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:08.170401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3241-baf1-4640-8d4b-22e9371b13ae service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:08.298634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:08.299316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:08.299898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:08.300012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e admin admin] PATH_INFO: `/v3/projects/e664ea80daaf450886978f25b2d9e373` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:08.302243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e664ea80daaf450886978f25b2d9e373)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:08.304879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:08.306754 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:08.405207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e664ea80daaf450886978f25b2d9e373', 'request_id': 'req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:08.415100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e664ea80daaf450886978f25b2d9e373', 'request_id': 'req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:08.426412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e664ea80daaf450886978f25b2d9e373', 'request_id': 'req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:08.444768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e admin admin] The token cache is being invalidate because project e664ea80daaf450886978f25b2d9e373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:08.445073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:08.448264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4a6c9801-fb2e-4aec-9102-85e8a35bfb6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:08.453123 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2614/5255] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:08 2022] DELETE /identity/v3/projects/e664ea80daaf450886978f25b2d9e373 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:08.454810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac944ae6-021d-4fa3-97ba-008d7b1278d8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:08.455338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac944ae6-021d-4fa3-97ba-008d7b1278d8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:08.455449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac944ae6-021d-4fa3-97ba-008d7b1278d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:08.487669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ac944ae6-021d-4fa3-97ba-008d7b1278d8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:08.488935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ac944ae6-021d-4fa3-97ba-008d7b1278d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:08.524484 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:08.602172 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2642/5256] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:08.610448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe03fa8-2015-42c4-aaa4-73119af2e56e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:08.610763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe03fa8-2015-42c4-aaa4-73119af2e56e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:08.611118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe03fa8-2015-42c4-aaa4-73119af2e56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:08.638034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bbe03fa8-2015-42c4-aaa4-73119af2e56e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:08.639313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bbe03fa8-2015-42c4-aaa4-73119af2e56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:08.648621 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2615/5257] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:08.652698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac944ae6-021d-4fa3-97ba-008d7b1278d8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:08.664077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac944ae6-021d-4fa3-97ba-008d7b1278d8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:08.670065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bda072-dd6d-4022-922a-e31170b1457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:08.670964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda072-dd6d-4022-922a-e31170b1457c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:08.671744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda072-dd6d-4022-922a-e31170b1457c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:08.671744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda072-dd6d-4022-922a-e31170b1457c admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:08.672573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bda072-dd6d-4022-922a-e31170b1457c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:08.672884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bda072-dd6d-4022-922a-e31170b1457c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:08.675143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bda072-dd6d-4022-922a-e31170b1457c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:08.691293 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2643/5258] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:26:08.694852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe03fa8-2015-42c4-aaa4-73119af2e56e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:08.705239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe03fa8-2015-42c4-aaa4-73119af2e56e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:08.710287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe19a94-8edf-4978-bdb5-87996df5401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:08.711222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe19a94-8edf-4978-bdb5-87996df5401f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:08.711574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe19a94-8edf-4978-bdb5-87996df5401f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:08.711962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe19a94-8edf-4978-bdb5-87996df5401f admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:08.712654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe19a94-8edf-4978-bdb5-87996df5401f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:08.718868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe19a94-8edf-4978-bdb5-87996df5401f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:08.753576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bda072-dd6d-4022-922a-e31170b1457c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:08.755098 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2616/5259] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:08 2022] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:08.767698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bda072-dd6d-4022-922a-e31170b1457c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:08.846805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5ef22-3423-448e-99d4-a061d52a3415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:08.847562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5ef22-3423-448e-99d4-a061d52a3415 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:08.847916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5ef22-3423-448e-99d4-a061d52a3415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:08.848259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5ef22-3423-448e-99d4-a061d52a3415 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:08.848983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5ef22-3423-448e-99d4-a061d52a3415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:08.851825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5ef22-3423-448e-99d4-a061d52a3415 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:08.901096 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2644/5260] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:08 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:08.904924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe19a94-8edf-4978-bdb5-87996df5401f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:08.921340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe19a94-8edf-4978-bdb5-87996df5401f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:08.926695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06299b3-616e-4cfc-9c6f-4e64dcedb007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:08.927390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06299b3-616e-4cfc-9c6f-4e64dcedb007 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:08.929116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06299b3-616e-4cfc-9c6f-4e64dcedb007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:08.929116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06299b3-616e-4cfc-9c6f-4e64dcedb007 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:08.929116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06299b3-616e-4cfc-9c6f-4e64dcedb007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:08.930712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06299b3-616e-4cfc-9c6f-4e64dcedb007 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:08.948520 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2617/5261] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:08.952607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5ef22-3423-448e-99d4-a061d52a3415 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:08.965929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5ef22-3423-448e-99d4-a061d52a3415 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:08.974897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9824ca0-5d4a-45ce-93bc-008c2f609682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:08.975630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9824ca0-5d4a-45ce-93bc-008c2f609682 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:08.975979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9824ca0-5d4a-45ce-93bc-008c2f609682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:08.976322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9824ca0-5d4a-45ce-93bc-008c2f609682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:08.977718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9824ca0-5d4a-45ce-93bc-008c2f609682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:08.979499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9824ca0-5d4a-45ce-93bc-008c2f609682 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:08.999664 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2645/5262] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:26:09.000822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06299b3-616e-4cfc-9c6f-4e64dcedb007 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:09.014479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06299b3-616e-4cfc-9c6f-4e64dcedb007 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:09.019763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78db7b4-60c1-4b12-a3b4-2e4bfbb08abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:09.020552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78db7b4-60c1-4b12-a3b4-2e4bfbb08abc admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:09.020955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78db7b4-60c1-4b12-a3b4-2e4bfbb08abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:09.021329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78db7b4-60c1-4b12-a3b4-2e4bfbb08abc admin admin] PATH_INFO: `/v3/projects/5daf4e43d3524115b09ce4ea1b1255d0/users/82de667879f841e5af2e1522388296ce/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:09.039959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78db7b4-60c1-4b12-a3b4-2e4bfbb08abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5daf4e43d3524115b09ce4ea1b1255d0, user_id=82de667879f841e5af2e1522388296ce, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:09.042970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78db7b4-60c1-4b12-a3b4-2e4bfbb08abc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:09.071567 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2618/5263] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:08 2022] PUT /identity/v3/projects/5daf4e43d3524115b09ce4ea1b1255d0/users/82de667879f841e5af2e1522388296ce/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:09.083020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b58e9-4601-4025-8a27-ead0079d443b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:09.083367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b58e9-4601-4025-8a27-ead0079d443b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:09.083575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b58e9-4601-4025-8a27-ead0079d443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:09.129007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-517b58e9-4601-4025-8a27-ead0079d443b None None] MFA Rules not processed for user `82de667879f841e5af2e1522388296ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:09.132710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-517b58e9-4601-4025-8a27-ead0079d443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:09.252472 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2646/5264] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:09.258718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78db7b4-60c1-4b12-a3b4-2e4bfbb08abc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:09.373389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78db7b4-60c1-4b12-a3b4-2e4bfbb08abc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:09.388071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcd68f-33e3-43c7-a59e-1a4be85bb6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:09.389292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcd68f-33e3-43c7-a59e-1a4be85bb6bc admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:09.390700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcd68f-33e3-43c7-a59e-1a4be85bb6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:09.391035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcd68f-33e3-43c7-a59e-1a4be85bb6bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:09.391752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcd68f-33e3-43c7-a59e-1a4be85bb6bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:09.393685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcd68f-33e3-43c7-a59e-1a4be85bb6bc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:09.482809 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2619/5265] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:09 2022] POST /identity/v3/projects => generated 389 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:09.486777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b58e9-4601-4025-8a27-ead0079d443b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:09.511164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b58e9-4601-4025-8a27-ead0079d443b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:09.580695 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:09.658814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfcfda-ff49-460d-84f8-74bc050e015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:09.663100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfcfda-ff49-460d-84f8-74bc050e015b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:09.663839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfcfda-ff49-460d-84f8-74bc050e015b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:09.664668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfcfda-ff49-460d-84f8-74bc050e015b admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:09.667179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfcfda-ff49-460d-84f8-74bc050e015b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:09.672989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfcfda-ff49-460d-84f8-74bc050e015b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:09.715466 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2647/5266] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:09 2022] POST /identity/v3/users => generated 301 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:09.716944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcd68f-33e3-43c7-a59e-1a4be85bb6bc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:09.732962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcd68f-33e3-43c7-a59e-1a4be85bb6bc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:09.737657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ff46f-b51b-4dfa-9efc-13551a50af8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:09.738275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ff46f-b51b-4dfa-9efc-13551a50af8b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:09.738750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ff46f-b51b-4dfa-9efc-13551a50af8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:09.739227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ff46f-b51b-4dfa-9efc-13551a50af8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:09.749515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ff46f-b51b-4dfa-9efc-13551a50af8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:09.752183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ff46f-b51b-4dfa-9efc-13551a50af8b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:09.762527 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:09.769387 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2620/5267] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:09.779320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfcfda-ff49-460d-84f8-74bc050e015b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:09.793789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfcfda-ff49-460d-84f8-74bc050e015b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:09.800283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aed809-8cbb-41b1-9c83-2cf0f5863b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:09.801270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aed809-8cbb-41b1-9c83-2cf0f5863b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:09.801733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aed809-8cbb-41b1-9c83-2cf0f5863b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:09.802179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aed809-8cbb-41b1-9c83-2cf0f5863b17 admin admin] PATH_INFO: `/v3/projects/619597fd69d140f0a81d04b0b5e7c069/users/b95379225eea4d5ba0e5f02c53036898/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:09.831085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aed809-8cbb-41b1-9c83-2cf0f5863b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619597fd69d140f0a81d04b0b5e7c069, user_id=b95379225eea4d5ba0e5f02c53036898, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:09.836721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aed809-8cbb-41b1-9c83-2cf0f5863b17 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:09.859281 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2648/5268] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:09 2022] PUT /identity/v3/projects/619597fd69d140f0a81d04b0b5e7c069/users/b95379225eea4d5ba0e5f02c53036898/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:09.862458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ff46f-b51b-4dfa-9efc-13551a50af8b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:09.875118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ff46f-b51b-4dfa-9efc-13551a50af8b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:09.950180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4576e-bf92-4bf6-bbfc-9f204cb4f77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:09.950854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4576e-bf92-4bf6-bbfc-9f204cb4f77b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:09.951185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4576e-bf92-4bf6-bbfc-9f204cb4f77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:09.951459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4576e-bf92-4bf6-bbfc-9f204cb4f77b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:09.952100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4576e-bf92-4bf6-bbfc-9f204cb4f77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:09.953755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4576e-bf92-4bf6-bbfc-9f204cb4f77b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:09.971470 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2621/5269] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:26:09.972677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aed809-8cbb-41b1-9c83-2cf0f5863b17 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:09.985063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aed809-8cbb-41b1-9c83-2cf0f5863b17 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:09.992297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fcf33-51d9-47e7-85fb-2bacf6b9fca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:09.993828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fcf33-51d9-47e7-85fb-2bacf6b9fca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:09.993828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fcf33-51d9-47e7-85fb-2bacf6b9fca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:09.993828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fcf33-51d9-47e7-85fb-2bacf6b9fca8 admin admin] PATH_INFO: `/v3/projects/619597fd69d140f0a81d04b0b5e7c069/users/b95379225eea4d5ba0e5f02c53036898/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:09.996690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fcf33-51d9-47e7-85fb-2bacf6b9fca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619597fd69d140f0a81d04b0b5e7c069, user_id=b95379225eea4d5ba0e5f02c53036898, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:09.999389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fcf33-51d9-47e7-85fb-2bacf6b9fca8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:10.011733 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2649/5270] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:09 2022] PUT /identity/v3/projects/619597fd69d140f0a81d04b0b5e7c069/users/b95379225eea4d5ba0e5f02c53036898/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:10.024064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812acba4-b391-4f32-bc55-98a88970603d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:10.024690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812acba4-b391-4f32-bc55-98a88970603d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:10.025340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812acba4-b391-4f32-bc55-98a88970603d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:10.065274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-812acba4-b391-4f32-bc55-98a88970603d None None] MFA Rules not processed for user `b95379225eea4d5ba0e5f02c53036898`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:10.067620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-812acba4-b391-4f32-bc55-98a88970603d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:10.195428 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2622/5271] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:10.199354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fcf33-51d9-47e7-85fb-2bacf6b9fca8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:10.215196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fcf33-51d9-47e7-85fb-2bacf6b9fca8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:10.223351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55db7f-d520-477e-a810-ac2cecaaa9e8 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95379225eea4d5ba0e5f02c53036898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '619597fd69d140f0a81d04b0b5e7c069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:10.224207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55db7f-d520-477e-a810-ac2cecaaa9e8 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:10.224490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55db7f-d520-477e-a810-ac2cecaaa9e8 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:10.225474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55db7f-d520-477e-a810-ac2cecaaa9e8 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] PATH_INFO: `/v3/projects/5daf4e43d3524115b09ce4ea1b1255d0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:10.228124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55db7f-d520-477e-a810-ac2cecaaa9e8 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorizing `identity:get_project(project_id=5daf4e43d3524115b09ce4ea1b1255d0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:10.231801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55db7f-d520-477e-a810-ac2cecaaa9e8 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:10.239680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812acba4-b391-4f32-bc55-98a88970603d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:10.246753 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2650/5272] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:26:10 2022] GET /identity/v3/projects/5daf4e43d3524115b09ce4ea1b1255d0 => generated 389 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:10.251722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812acba4-b391-4f32-bc55-98a88970603d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:10.265411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf08a2d-52c6-46f8-bc27-167b949cad76 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95379225eea4d5ba0e5f02c53036898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '619597fd69d140f0a81d04b0b5e7c069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:10.266201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf08a2d-52c6-46f8-bc27-167b949cad76 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:10.266475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf08a2d-52c6-46f8-bc27-167b949cad76 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:10.266746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf08a2d-52c6-46f8-bc27-167b949cad76 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:10.270138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf08a2d-52c6-46f8-bc27-167b949cad76 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:10.276409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf08a2d-52c6-46f8-bc27-167b949cad76 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:10.319179 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2623/5273] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:26:10 2022] POST /identity/v3/projects => generated 339 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:10.324837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55db7f-d520-477e-a810-ac2cecaaa9e8 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:10.340309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55db7f-d520-477e-a810-ac2cecaaa9e8 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:10.414858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c6505-c120-4efd-bc8a-87e5d0ce502b tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95379225eea4d5ba0e5f02c53036898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '619597fd69d140f0a81d04b0b5e7c069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:10.415512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6505-c120-4efd-bc8a-87e5d0ce502b tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:10.415793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6505-c120-4efd-bc8a-87e5d0ce502b tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:10.416702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6505-c120-4efd-bc8a-87e5d0ce502b tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:10.419734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c6505-c120-4efd-bc8a-87e5d0ce502b tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:10.420834 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-4e7c6505-c120-4efd-bc8a-87e5d0ce502b tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:26:10.420834 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:26:10.420834 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:26:10.422362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c6505-c120-4efd-bc8a-87e5d0ce502b tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:10.452700 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2651/5274] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Oct 16 01:26:10 2022] GET /identity/v3/projects => generated 6574 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:10.461141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf08a2d-52c6-46f8-bc27-167b949cad76 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:10.474051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf08a2d-52c6-46f8-bc27-167b949cad76 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:10.481534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638346f-21b1-4441-b668-cc5a0c3a22f0 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95379225eea4d5ba0e5f02c53036898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '619597fd69d140f0a81d04b0b5e7c069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:10.482187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638346f-21b1-4441-b668-cc5a0c3a22f0 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:10.483036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638346f-21b1-4441-b668-cc5a0c3a22f0 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:10.483375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638346f-21b1-4441-b668-cc5a0c3a22f0 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] PATH_INFO: `/v3/projects/5daf4e43d3524115b09ce4ea1b1255d0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:10.487674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638346f-21b1-4441-b668-cc5a0c3a22f0 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorizing `identity:get_project(project_id=5daf4e43d3524115b09ce4ea1b1255d0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:10.492829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638346f-21b1-4441-b668-cc5a0c3a22f0 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:10.498721 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2624/5275] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:26:10 2022] GET /identity/v3/projects/5daf4e43d3524115b09ce4ea1b1255d0 => generated 389 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:10.499793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c6505-c120-4efd-bc8a-87e5d0ce502b tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:10.510750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c6505-c120-4efd-bc8a-87e5d0ce502b tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:10.515796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f5041-adb4-43de-8def-85b23e533501 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95379225eea4d5ba0e5f02c53036898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '619597fd69d140f0a81d04b0b5e7c069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:10.517093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f5041-adb4-43de-8def-85b23e533501 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:10.517093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f5041-adb4-43de-8def-85b23e533501 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:10.517360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f5041-adb4-43de-8def-85b23e533501 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] PATH_INFO: `/v3/projects/e61b8692273e456cacbaabf6ddf31c54` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:10.518589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f5041-adb4-43de-8def-85b23e533501 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorizing `identity:get_project(project_id=e61b8692273e456cacbaabf6ddf31c54)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:10.534310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f5041-adb4-43de-8def-85b23e533501 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:10.542029 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2652/5276] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:26:10 2022] GET /identity/v3/projects/e61b8692273e456cacbaabf6ddf31c54 => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:10.544166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638346f-21b1-4441-b668-cc5a0c3a22f0 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:10.557396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638346f-21b1-4441-b668-cc5a0c3a22f0 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:10.562866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f5d5c-dd43-4989-b8bb-a704d9a55d63 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95379225eea4d5ba0e5f02c53036898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '619597fd69d140f0a81d04b0b5e7c069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:10.563509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f5d5c-dd43-4989-b8bb-a704d9a55d63 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:10.563787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f5d5c-dd43-4989-b8bb-a704d9a55d63 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:10.564077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f5d5c-dd43-4989-b8bb-a704d9a55d63 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:10.565073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f5d5c-dd43-4989-b8bb-a704d9a55d63 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:10.567016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f5d5c-dd43-4989-b8bb-a704d9a55d63 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:10.622971 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2625/5277] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Oct 16 01:26:10 2022] GET /identity/v3/projects => generated 6574 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:10.627776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f5041-adb4-43de-8def-85b23e533501 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:10.643188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f5041-adb4-43de-8def-85b23e533501 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:10.651502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308c042-bc34-4042-ae2d-aeb782a66be2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95379225eea4d5ba0e5f02c53036898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '619597fd69d140f0a81d04b0b5e7c069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:10.652974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308c042-bc34-4042-ae2d-aeb782a66be2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:10.653257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308c042-bc34-4042-ae2d-aeb782a66be2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:10.653661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308c042-bc34-4042-ae2d-aeb782a66be2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:10.654337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308c042-bc34-4042-ae2d-aeb782a66be2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:10.654641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308c042-bc34-4042-ae2d-aeb782a66be2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:10.656656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308c042-bc34-4042-ae2d-aeb782a66be2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:10.690343 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2653/5278] 10.222.0.39 () {58 vars in 1166 bytes} [Sun Oct 16 01:26:10 2022] GET /identity/v3/projects?domain_id=default => generated 6243 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:10.695313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f5d5c-dd43-4989-b8bb-a704d9a55d63 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:10.706197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f5d5c-dd43-4989-b8bb-a704d9a55d63 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:10.711824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930ba67-9b9f-4d26-8081-02d389b76413 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95379225eea4d5ba0e5f02c53036898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '619597fd69d140f0a81d04b0b5e7c069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:10.712459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930ba67-9b9f-4d26-8081-02d389b76413 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:10.712737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930ba67-9b9f-4d26-8081-02d389b76413 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:10.713003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930ba67-9b9f-4d26-8081-02d389b76413 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:10.713635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930ba67-9b9f-4d26-8081-02d389b76413 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:10.715645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930ba67-9b9f-4d26-8081-02d389b76413 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:10.734294 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2626/5279] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Oct 16 01:26:10 2022] GET /identity/v3/projects => generated 6574 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:10.748693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308c042-bc34-4042-ae2d-aeb782a66be2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:10.762028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308c042-bc34-4042-ae2d-aeb782a66be2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:10.767034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89a505-cfc6-498c-aa0b-1b20cfce72c2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95379225eea4d5ba0e5f02c53036898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '619597fd69d140f0a81d04b0b5e7c069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:10.767647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89a505-cfc6-498c-aa0b-1b20cfce72c2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:10.767927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89a505-cfc6-498c-aa0b-1b20cfce72c2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:10.768198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89a505-cfc6-498c-aa0b-1b20cfce72c2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:10.768861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89a505-cfc6-498c-aa0b-1b20cfce72c2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:10.769646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89a505-cfc6-498c-aa0b-1b20cfce72c2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:10.772269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89a505-cfc6-498c-aa0b-1b20cfce72c2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:10.791593 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2654/5280] 10.222.0.39 () {58 vars in 1166 bytes} [Sun Oct 16 01:26:10 2022] GET /identity/v3/projects?domain_id=default => generated 6243 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:10.797882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930ba67-9b9f-4d26-8081-02d389b76413 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:10.810084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930ba67-9b9f-4d26-8081-02d389b76413 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:10.815166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea4fdf-b742-490e-ae1b-dd3e6df19cb7 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95379225eea4d5ba0e5f02c53036898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '619597fd69d140f0a81d04b0b5e7c069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:10.815805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea4fdf-b742-490e-ae1b-dd3e6df19cb7 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:10.816072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea4fdf-b742-490e-ae1b-dd3e6df19cb7 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:10.816481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea4fdf-b742-490e-ae1b-dd3e6df19cb7 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:10.817216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea4fdf-b742-490e-ae1b-dd3e6df19cb7 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:10.820047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea4fdf-b742-490e-ae1b-dd3e6df19cb7 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:10.840589 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2627/5281] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Oct 16 01:26:10 2022] GET /identity/v3/projects => generated 6574 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:10.845430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89a505-cfc6-498c-aa0b-1b20cfce72c2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:10.857930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89a505-cfc6-498c-aa0b-1b20cfce72c2 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:10.863328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b53dfb-8ce4-4106-b5d2-a0ffaf9c3ec1 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95379225eea4d5ba0e5f02c53036898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '619597fd69d140f0a81d04b0b5e7c069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:10.863886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b53dfb-8ce4-4106-b5d2-a0ffaf9c3ec1 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:10.864162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b53dfb-8ce4-4106-b5d2-a0ffaf9c3ec1 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:10.864432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b53dfb-8ce4-4106-b5d2-a0ffaf9c3ec1 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:10.865090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b53dfb-8ce4-4106-b5d2-a0ffaf9c3ec1 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1488285226) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:10.865925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b53dfb-8ce4-4106-b5d2-a0ffaf9c3ec1 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:10.868400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b53dfb-8ce4-4106-b5d2-a0ffaf9c3ec1 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:10.887302 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2655/5282] 10.222.0.39 () {58 vars in 1232 bytes} [Sun Oct 16 01:26:10 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1488285226 => generated 537 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:26:10.892746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea4fdf-b742-490e-ae1b-dd3e6df19cb7 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:10.904044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea4fdf-b742-490e-ae1b-dd3e6df19cb7 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:10.908759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95379225eea4d5ba0e5f02c53036898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '619597fd69d140f0a81d04b0b5e7c069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:10.909473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:10.909838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:10.910177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] PATH_INFO: `/v3/projects/e61b8692273e456cacbaabf6ddf31c54` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:10.912299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e61b8692273e456cacbaabf6ddf31c54)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:10.914944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:10.931447 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:10.991233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61b8692273e456cacbaabf6ddf31c54', 'request_id': 'req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:11.000473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61b8692273e456cacbaabf6ddf31c54', 'request_id': 'req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:11.016287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61b8692273e456cacbaabf6ddf31c54', 'request_id': 'req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:11.032012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] The token cache is being invalidate because project e61b8692273e456cacbaabf6ddf31c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:11.032475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:11.033260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e721bc1-e6c0-48c3-a561-cde0e87e7dcd tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:11.038270 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2628/5283] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:10 2022] DELETE /identity/v3/projects/e61b8692273e456cacbaabf6ddf31c54 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:11.039511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b53dfb-8ce4-4106-b5d2-a0ffaf9c3ec1 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:11.041511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b0b53dfb-8ce4-4106-b5d2-a0ffaf9c3ec1 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:11.088990 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:11.151589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b53dfb-8ce4-4106-b5d2-a0ffaf9c3ec1 tempest-ListProjectsStaticTestJSON-1848593462 tempest-ListProjectsStaticTestJSON-1848593462-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:11.316765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:11.318786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:11.320061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:11.320483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] PATH_INFO: `/v3/users/82de667879f841e5af2e1522388296ce` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:11.323235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=82de667879f841e5af2e1522388296ce)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:11.327124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:11.425942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82de667879f841e5af2e1522388296ce'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:11.427956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82de667879f841e5af2e1522388296ce'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:11.452492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82de667879f841e5af2e1522388296ce'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:11.480161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82de667879f841e5af2e1522388296ce'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:11.480909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82de667879f841e5af2e1522388296ce'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:11.510991 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2656/5284] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:11 2022] DELETE /identity/v3/users/82de667879f841e5af2e1522388296ce => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:11.516875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3ae17-9ec9-44ad-afd7-e408a6a3417f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:11.517403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3ae17-9ec9-44ad-afd7-e408a6a3417f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:11.517753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3ae17-9ec9-44ad-afd7-e408a6a3417f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:11.567262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fff3ae17-9ec9-44ad-afd7-e408a6a3417f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:11.568536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fff3ae17-9ec9-44ad-afd7-e408a6a3417f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:11.718423 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2629/5285] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:11.829739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:11.831638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:12.044194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3ba2e-cb5c-4a7b-8eb9-446aa589d4fd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:12.058959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9047c-2816-46e4-9832-7a4da04417ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:12.060621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9047c-2816-46e4-9832-7a4da04417ee service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:12.060621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9047c-2816-46e4-9832-7a4da04417ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:12.060621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9047c-2816-46e4-9832-7a4da04417ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:12.081058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9047c-2816-46e4-9832-7a4da04417ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:12.083259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9047c-2816-46e4-9832-7a4da04417ee service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:12.090776 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:12.102530 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2657/5286] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:12.812848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3ae17-9ec9-44ad-afd7-e408a6a3417f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:12.815785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fff3ae17-9ec9-44ad-afd7-e408a6a3417f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:12.847460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3ae17-9ec9-44ad-afd7-e408a6a3417f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:12.856765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:12.859170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:12.859655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:12.860226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] PATH_INFO: `/v3/users/85cb1d720ba24d7f908a93fffe29427b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:12.862566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cb1d720ba24d7f908a93fffe29427b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:12.866603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:12.886655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9047c-2816-46e4-9832-7a4da04417ee service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:12.888920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1be9047c-2816-46e4-9832-7a4da04417ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:12.920965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9047c-2816-46e4-9832-7a4da04417ee service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:12.940098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:12.941403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:12.941858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:12.942339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] PATH_INFO: `/v3/projects/5daf4e43d3524115b09ce4ea1b1255d0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:12.945442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5daf4e43d3524115b09ce4ea1b1255d0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:12.953249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:12.989727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cb1d720ba24d7f908a93fffe29427b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:12.993214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cb1d720ba24d7f908a93fffe29427b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.018694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cb1d720ba24d7f908a93fffe29427b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.032466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cb1d720ba24d7f908a93fffe29427b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.044407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cb1d720ba24d7f908a93fffe29427b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.050797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5daf4e43d3524115b09ce4ea1b1255d0', 'request_id': 'req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.060161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5daf4e43d3524115b09ce4ea1b1255d0', 'request_id': 'req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.073609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5daf4e43d3524115b09ce4ea1b1255d0', 'request_id': 'req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.076316 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2630/5287] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:12 2022] DELETE /identity/v3/users/85cb1d720ba24d7f908a93fffe29427b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:13.095398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] The token cache is being invalidate because project 5daf4e43d3524115b09ce4ea1b1255d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:13.095936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.096889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.098857 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2658/5288] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:12 2022] DELETE /identity/v3/projects/5daf4e43d3524115b09ce4ea1b1255d0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:13.103770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:13.105452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:13.125333 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:13.218117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec38946-34bd-406c-a159-1827bc3d3d6b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:13.219380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:13.221187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:13.221187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:13.221187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] PATH_INFO: `/v3/users/b95379225eea4d5ba0e5f02c53036898` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:13.223203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95379225eea4d5ba0e5f02c53036898)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:13.225126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:13.313059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95379225eea4d5ba0e5f02c53036898'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.314171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95379225eea4d5ba0e5f02c53036898'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.355248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95379225eea4d5ba0e5f02c53036898'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.377195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95379225eea4d5ba0e5f02c53036898'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.377884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95379225eea4d5ba0e5f02c53036898'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:13.409649 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2631/5289] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:13 2022] DELETE /identity/v3/users/b95379225eea4d5ba0e5f02c53036898 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:13.934294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:13.936074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:14.080006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed6ad0-5a31-4496-b19d-8ff4cdf489ce admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:14.170359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce59054-3141-4280-b934-e110d2b9c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:14.170359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce59054-3141-4280-b934-e110d2b9c55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:14.170359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce59054-3141-4280-b934-e110d2b9c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:14.170359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce59054-3141-4280-b934-e110d2b9c55d admin admin] PATH_INFO: `/v3/projects/fc93a361db0a42c0ac90b82d20b91cff` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:14.170780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce59054-3141-4280-b934-e110d2b9c55d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc93a361db0a42c0ac90b82d20b91cff)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:14.171630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:14.173031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce59054-3141-4280-b934-e110d2b9c55d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:14.173160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:14.195890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec264e-30f8-40cf-b44d-5480c3db60a1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:14.223417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c757c4-f48f-4e80-80af-7fb0bba85f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:14.226151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c757c4-f48f-4e80-80af-7fb0bba85f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:14.226951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c757c4-f48f-4e80-80af-7fb0bba85f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:14.227453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c757c4-f48f-4e80-80af-7fb0bba85f73 admin admin] PATH_INFO: `/v3/projects/619597fd69d140f0a81d04b0b5e7c069` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:14.229089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c757c4-f48f-4e80-80af-7fb0bba85f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619597fd69d140f0a81d04b0b5e7c069)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:14.231036 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:14.232741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c757c4-f48f-4e80-80af-7fb0bba85f73 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:14.267569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cce59054-3141-4280-b934-e110d2b9c55d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc93a361db0a42c0ac90b82d20b91cff', 'request_id': 'req-cce59054-3141-4280-b934-e110d2b9c55d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:14.284165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cce59054-3141-4280-b934-e110d2b9c55d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc93a361db0a42c0ac90b82d20b91cff', 'request_id': 'req-cce59054-3141-4280-b934-e110d2b9c55d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:14.304046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cce59054-3141-4280-b934-e110d2b9c55d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc93a361db0a42c0ac90b82d20b91cff', 'request_id': 'req-cce59054-3141-4280-b934-e110d2b9c55d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:14.306088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b9c757c4-f48f-4e80-80af-7fb0bba85f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619597fd69d140f0a81d04b0b5e7c069', 'request_id': 'req-b9c757c4-f48f-4e80-80af-7fb0bba85f73'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:14.324187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b9c757c4-f48f-4e80-80af-7fb0bba85f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619597fd69d140f0a81d04b0b5e7c069', 'request_id': 'req-b9c757c4-f48f-4e80-80af-7fb0bba85f73'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:14.325148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cce59054-3141-4280-b934-e110d2b9c55d admin admin] The token cache is being invalidate because project fc93a361db0a42c0ac90b82d20b91cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:14.325453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cce59054-3141-4280-b934-e110d2b9c55d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:14.326276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cce59054-3141-4280-b934-e110d2b9c55d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:14.327851 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2659/5290] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:13 2022] DELETE /identity/v3/projects/fc93a361db0a42c0ac90b82d20b91cff => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:26:14.333089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76cdaa-259f-4e3b-a4a6-25a075005c9f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:14.334030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76cdaa-259f-4e3b-a4a6-25a075005c9f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:14.335121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76cdaa-259f-4e3b-a4a6-25a075005c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:14.338569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b9c757c4-f48f-4e80-80af-7fb0bba85f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619597fd69d140f0a81d04b0b5e7c069', 'request_id': 'req-b9c757c4-f48f-4e80-80af-7fb0bba85f73'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:14.359234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b9c757c4-f48f-4e80-80af-7fb0bba85f73 admin admin] The token cache is being invalidate because project 619597fd69d140f0a81d04b0b5e7c069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:14.359959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b9c757c4-f48f-4e80-80af-7fb0bba85f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:14.360766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b9c757c4-f48f-4e80-80af-7fb0bba85f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:14.362668 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2632/5291] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:14 2022] DELETE /identity/v3/projects/619597fd69d140f0a81d04b0b5e7c069 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:26:14.367719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8c4b3-0c52-4ea7-9191-202e2f9ca2fe None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:14.368351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8c4b3-0c52-4ea7-9191-202e2f9ca2fe None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:14.368885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8c4b3-0c52-4ea7-9191-202e2f9ca2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:14.379701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ad76cdaa-259f-4e3b-a4a6-25a075005c9f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:14.383158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ad76cdaa-259f-4e3b-a4a6-25a075005c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:14.409982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cfd8c4b3-0c52-4ea7-9191-202e2f9ca2fe None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:14.414577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cfd8c4b3-0c52-4ea7-9191-202e2f9ca2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:14.436238 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:14.535806 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2660/5292] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:14.553280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda6741-bc4a-4d43-8c2a-34012f14f5ab None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:14.554004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda6741-bc4a-4d43-8c2a-34012f14f5ab None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:14.554284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda6741-bc4a-4d43-8c2a-34012f14f5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:14.588869 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2633/5293] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:26:14.594974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5557e64-e54f-497d-b8dc-b8f69355bb9b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:14.595386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5557e64-e54f-497d-b8dc-b8f69355bb9b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:14.595758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5557e64-e54f-497d-b8dc-b8f69355bb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:14.615121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5fda6741-bc4a-4d43-8c2a-34012f14f5ab None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:14.618653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5fda6741-bc4a-4d43-8c2a-34012f14f5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:14.640287 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2661/5294] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:14.641350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c5557e64-e54f-497d-b8dc-b8f69355bb9b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:14.642679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c5557e64-e54f-497d-b8dc-b8f69355bb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:14.644349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda6741-bc4a-4d43-8c2a-34012f14f5ab None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:14.657286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda6741-bc4a-4d43-8c2a-34012f14f5ab None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:14.666123 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2634/5295] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:14.670317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5557e64-e54f-497d-b8dc-b8f69355bb9b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:14.676019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318784f-db7f-4102-80f8-d72d00d6646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:14.676781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318784f-db7f-4102-80f8-d72d00d6646c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:14.678957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318784f-db7f-4102-80f8-d72d00d6646c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:14.679321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318784f-db7f-4102-80f8-d72d00d6646c admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:14.680091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318784f-db7f-4102-80f8-d72d00d6646c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:14.681064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318784f-db7f-4102-80f8-d72d00d6646c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:14.684220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318784f-db7f-4102-80f8-d72d00d6646c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:14.690950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5557e64-e54f-497d-b8dc-b8f69355bb9b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:14.703624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211bf1d-9559-411c-aa26-e721ff57823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:14.704411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211bf1d-9559-411c-aa26-e721ff57823e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:14.704781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211bf1d-9559-411c-aa26-e721ff57823e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:14.705147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211bf1d-9559-411c-aa26-e721ff57823e admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:14.706077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211bf1d-9559-411c-aa26-e721ff57823e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:14.708327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211bf1d-9559-411c-aa26-e721ff57823e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:14.710812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211bf1d-9559-411c-aa26-e721ff57823e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:14.711283 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2662/5296] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:14.712716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318784f-db7f-4102-80f8-d72d00d6646c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:14.734558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318784f-db7f-4102-80f8-d72d00d6646c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:14.742260 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2635/5297] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:14.742618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82409af7-77a0-47ab-9100-00ea90df230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:14.743789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211bf1d-9559-411c-aa26-e721ff57823e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:14.744484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82409af7-77a0-47ab-9100-00ea90df230e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:14.745202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82409af7-77a0-47ab-9100-00ea90df230e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:14.749866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82409af7-77a0-47ab-9100-00ea90df230e admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:14.750784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82409af7-77a0-47ab-9100-00ea90df230e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:14.752810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82409af7-77a0-47ab-9100-00ea90df230e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:14.784943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211bf1d-9559-411c-aa26-e721ff57823e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:14.809290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0ca96-ee3e-4a45-93a9-ff3c01e02ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:14.810026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0ca96-ee3e-4a45-93a9-ff3c01e02ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:14.810403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0ca96-ee3e-4a45-93a9-ff3c01e02ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:14.810900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0ca96-ee3e-4a45-93a9-ff3c01e02ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:14.811635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0ca96-ee3e-4a45-93a9-ff3c01e02ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:14.821686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0ca96-ee3e-4a45-93a9-ff3c01e02ddc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:14.875019 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2663/5298] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:14 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:14.876030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82409af7-77a0-47ab-9100-00ea90df230e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:14.884681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-82409af7-77a0-47ab-9100-00ea90df230e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:14.888530 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2636/5299] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:14 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:14.889747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0ca96-ee3e-4a45-93a9-ff3c01e02ddc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:15.049646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82409af7-77a0-47ab-9100-00ea90df230e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:15.050473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0ca96-ee3e-4a45-93a9-ff3c01e02ddc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:15.057448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44244fc-827c-4fc6-ae59-315e9f72f22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:15.058424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44244fc-827c-4fc6-ae59-315e9f72f22c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.058763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44244fc-827c-4fc6-ae59-315e9f72f22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.059129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44244fc-827c-4fc6-ae59-315e9f72f22c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.060598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44244fc-827c-4fc6-ae59-315e9f72f22c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:15.062965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44244fc-827c-4fc6-ae59-315e9f72f22c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:15.067755 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:15.113447 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2637/5300] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:14 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:15.114621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44244fc-827c-4fc6-ae59-315e9f72f22c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:15.135378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44244fc-827c-4fc6-ae59-315e9f72f22c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:15.150066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8d10-c982-4fa1-b174-18e3a0e8cd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:15.150703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8d10-c982-4fa1-b174-18e3a0e8cd6f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.151264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8d10-c982-4fa1-b174-18e3a0e8cd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.151536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8d10-c982-4fa1-b174-18e3a0e8cd6f admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.153300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db8d10-c982-4fa1-b174-18e3a0e8cd6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:15.156040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db8d10-c982-4fa1-b174-18e3a0e8cd6f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:15.189944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdefc5-36ce-4e1a-8aa7-f986f3b50fe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:15.191275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdefc5-36ce-4e1a-8aa7-f986f3b50fe7 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.191979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdefc5-36ce-4e1a-8aa7-f986f3b50fe7 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.192768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdefc5-36ce-4e1a-8aa7-f986f3b50fe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.196599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d4fdefc5-36ce-4e1a-8aa7-f986f3b50fe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:15.206043 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2638/5301] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:15 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:15.207957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8d10-c982-4fa1-b174-18e3a0e8cd6f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:15.214650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdefc5-36ce-4e1a-8aa7-f986f3b50fe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:15.216926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdefc5-36ce-4e1a-8aa7-f986f3b50fe7 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:15.236087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8d10-c982-4fa1-b174-18e3a0e8cd6f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:15.244392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077c9bd-a833-4a80-a71a-b3aa22e1eff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:15.246056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077c9bd-a833-4a80-a71a-b3aa22e1eff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.246507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077c9bd-a833-4a80-a71a-b3aa22e1eff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.247124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077c9bd-a833-4a80-a71a-b3aa22e1eff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.247711 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2664/5302] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:15.250109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdefc5-36ce-4e1a-8aa7-f986f3b50fe7 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:15.263823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077c9bd-a833-4a80-a71a-b3aa22e1eff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:15.267792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077c9bd-a833-4a80-a71a-b3aa22e1eff6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:15.280369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdefc5-36ce-4e1a-8aa7-f986f3b50fe7 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:15.297391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6d991-9eea-4158-bee9-db7b0c90282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:15.298394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6d991-9eea-4158-bee9-db7b0c90282f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.298901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6d991-9eea-4158-bee9-db7b0c90282f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.299457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6d991-9eea-4158-bee9-db7b0c90282f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.300342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6d991-9eea-4158-bee9-db7b0c90282f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:15.302205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6d991-9eea-4158-bee9-db7b0c90282f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:15.319374 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2639/5303] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:15.320925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077c9bd-a833-4a80-a71a-b3aa22e1eff6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:15.328533 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2665/5304] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:15.330672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6d991-9eea-4158-bee9-db7b0c90282f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:15.348909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6d991-9eea-4158-bee9-db7b0c90282f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:15.349251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077c9bd-a833-4a80-a71a-b3aa22e1eff6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:15.361704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b56b4-647a-49f2-8e15-35e1d2daaed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:15.362467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b56b4-647a-49f2-8e15-35e1d2daaed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.362754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b56b4-647a-49f2-8e15-35e1d2daaed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.363058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b56b4-647a-49f2-8e15-35e1d2daaed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.363701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b56b4-647a-49f2-8e15-35e1d2daaed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:15.364373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16570b-9d9f-4370-b164-1afb53cfd0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:15.366063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b56b4-647a-49f2-8e15-35e1d2daaed1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:15.367093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16570b-9d9f-4370-b164-1afb53cfd0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.367814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16570b-9d9f-4370-b164-1afb53cfd0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.368252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16570b-9d9f-4370-b164-1afb53cfd0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.369488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16570b-9d9f-4370-b164-1afb53cfd0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:15.375419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16570b-9d9f-4370-b164-1afb53cfd0c2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:15.407702 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2666/5305] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:15.409956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b56b4-647a-49f2-8e15-35e1d2daaed1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:15.414776 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2640/5306] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:15.418776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16570b-9d9f-4370-b164-1afb53cfd0c2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:15.436751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16570b-9d9f-4370-b164-1afb53cfd0c2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:15.442524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed4f8f-ffd3-4544-ae8c-0e99bb5d234e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:15.443574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed4f8f-ffd3-4544-ae8c-0e99bb5d234e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.444690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed4f8f-ffd3-4544-ae8c-0e99bb5d234e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.445208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed4f8f-ffd3-4544-ae8c-0e99bb5d234e admin admin] PATH_INFO: `/v3/projects/b1bfe4e657aa42b589e76d574fc48b02/users/bd16fd0aeb6b4914846b60f87f953344/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.446144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b56b4-647a-49f2-8e15-35e1d2daaed1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:15.453211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b2f51-ee12-493a-9d3c-383fc274b1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:15.454049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b2f51-ee12-493a-9d3c-383fc274b1ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.454341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b2f51-ee12-493a-9d3c-383fc274b1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.454616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b2f51-ee12-493a-9d3c-383fc274b1ff admin admin] PATH_INFO: `/v3/projects/4eae2195e3e14eb898f957910477ffca/users/6b4f90da858042ad910dce344bce0840/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.473046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed4f8f-ffd3-4544-ae8c-0e99bb5d234e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1bfe4e657aa42b589e76d574fc48b02, user_id=bd16fd0aeb6b4914846b60f87f953344, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:15.478387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b2f51-ee12-493a-9d3c-383fc274b1ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eae2195e3e14eb898f957910477ffca, user_id=6b4f90da858042ad910dce344bce0840, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:15.482324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b2f51-ee12-493a-9d3c-383fc274b1ff admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:15.484065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed4f8f-ffd3-4544-ae8c-0e99bb5d234e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:15.500487 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:15.506201 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2667/5307] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:15 2022] PUT /identity/v3/projects/4eae2195e3e14eb898f957910477ffca/users/6b4f90da858042ad910dce344bce0840/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:15.520386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bc488-3fd5-4c7a-bb3f-74265410c150 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.520593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bc488-3fd5-4c7a-bb3f-74265410c150 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.520854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bc488-3fd5-4c7a-bb3f-74265410c150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.524822 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2641/5308] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:15 2022] PUT /identity/v3/projects/b1bfe4e657aa42b589e76d574fc48b02/users/bd16fd0aeb6b4914846b60f87f953344/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:26:15.532365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea38c7-f836-4b09-bec2-e560cec5b927 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.532739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea38c7-f836-4b09-bec2-e560cec5b927 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.533597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea38c7-f836-4b09-bec2-e560cec5b927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.574228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-12ea38c7-f836-4b09-bec2-e560cec5b927 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:15.575471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-12ea38c7-f836-4b09-bec2-e560cec5b927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:15.594275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bc7bc488-3fd5-4c7a-bb3f-74265410c150 None None] MFA Rules not processed for user `6b4f90da858042ad910dce344bce0840`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:15.595595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bc7bc488-3fd5-4c7a-bb3f-74265410c150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:15.686653 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2642/5309] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:15.717728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea38c7-f836-4b09-bec2-e560cec5b927 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:15.721022 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2668/5310] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:15.721301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-12ea38c7-f836-4b09-bec2-e560cec5b927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:15.728996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bc488-3fd5-4c7a-bb3f-74265410c150 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:15.756421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bc488-3fd5-4c7a-bb3f-74265410c150 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:15.768557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeef9f-1473-416a-8a20-f5ae869b9aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:15.771176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeef9f-1473-416a-8a20-f5ae869b9aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.771619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeef9f-1473-416a-8a20-f5ae869b9aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.771999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeef9f-1473-416a-8a20-f5ae869b9aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.772936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeef9f-1473-416a-8a20-f5ae869b9aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:15.776623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeef9f-1473-416a-8a20-f5ae869b9aa2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:15.825811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea38c7-f836-4b09-bec2-e560cec5b927 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:15.831171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e609ed-6181-486e-b7e0-c0dd0fe22f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:15.832180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e609ed-6181-486e-b7e0-c0dd0fe22f8f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.832694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e609ed-6181-486e-b7e0-c0dd0fe22f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.833141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e609ed-6181-486e-b7e0-c0dd0fe22f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.841233 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2669/5311] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:15 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:15.843983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeef9f-1473-416a-8a20-f5ae869b9aa2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:15.848603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e609ed-6181-486e-b7e0-c0dd0fe22f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:15.850443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e609ed-6181-486e-b7e0-c0dd0fe22f8f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:15.873889 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2643/5312] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:15.879435 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:15.977064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeef9f-1473-416a-8a20-f5ae869b9aa2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:15.986901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9dac6-c749-4031-8c9e-2701c056379e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:15.987549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9dac6-c749-4031-8c9e-2701c056379e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:15.987824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9dac6-c749-4031-8c9e-2701c056379e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:15.988091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9dac6-c749-4031-8c9e-2701c056379e admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:15.989341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9dac6-c749-4031-8c9e-2701c056379e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:15.992036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9dac6-c749-4031-8c9e-2701c056379e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:16.031280 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2670/5313] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:15 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:16.031861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e609ed-6181-486e-b7e0-c0dd0fe22f8f service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:16.048429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e609ed-6181-486e-b7e0-c0dd0fe22f8f service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:16.056273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010cfb0-1a26-4adf-a2b6-c36578b4fb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:16.056912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010cfb0-1a26-4adf-a2b6-c36578b4fb95 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:16.057417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010cfb0-1a26-4adf-a2b6-c36578b4fb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:16.058069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010cfb0-1a26-4adf-a2b6-c36578b4fb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:16.058741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010cfb0-1a26-4adf-a2b6-c36578b4fb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:16.061221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010cfb0-1a26-4adf-a2b6-c36578b4fb95 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:16.086689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9dac6-c749-4031-8c9e-2701c056379e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:16.097924 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2644/5314] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:26:16.102110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9dac6-c749-4031-8c9e-2701c056379e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:16.110723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de56c5e-62bf-4e68-8809-7399848529dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:16.111545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de56c5e-62bf-4e68-8809-7399848529dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:16.111832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de56c5e-62bf-4e68-8809-7399848529dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:16.112477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de56c5e-62bf-4e68-8809-7399848529dd admin admin] PATH_INFO: `/v3/projects/df7d1c860967435198afe367c04c135e/users/f27b94a4d37042a5b30ecfcabfa4ebf6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:16.139626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de56c5e-62bf-4e68-8809-7399848529dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7d1c860967435198afe367c04c135e, user_id=f27b94a4d37042a5b30ecfcabfa4ebf6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:16.143797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de56c5e-62bf-4e68-8809-7399848529dd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:16.170356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010cfb0-1a26-4adf-a2b6-c36578b4fb95 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:16.171139 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2671/5315] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:16 2022] PUT /identity/v3/projects/df7d1c860967435198afe367c04c135e/users/f27b94a4d37042a5b30ecfcabfa4ebf6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:16.184733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010cfb0-1a26-4adf-a2b6-c36578b4fb95 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:16.283148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d3ac4-27e2-4264-8174-a6b32f0bc661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:16.283148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3ac4-27e2-4264-8174-a6b32f0bc661 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:16.283922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3ac4-27e2-4264-8174-a6b32f0bc661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:16.283922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3ac4-27e2-4264-8174-a6b32f0bc661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:16.284600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d3ac4-27e2-4264-8174-a6b32f0bc661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:16.286796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d3ac4-27e2-4264-8174-a6b32f0bc661 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:16.306380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de56c5e-62bf-4e68-8809-7399848529dd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:16.313968 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2645/5316] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:16.322792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de56c5e-62bf-4e68-8809-7399848529dd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:16.328134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a10b6f-25a7-4537-91fe-99d76acd45a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:16.328827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a10b6f-25a7-4537-91fe-99d76acd45a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:16.329180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a10b6f-25a7-4537-91fe-99d76acd45a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:16.330005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a10b6f-25a7-4537-91fe-99d76acd45a6 admin admin] PATH_INFO: `/v3/projects/df7d1c860967435198afe367c04c135e/users/f27b94a4d37042a5b30ecfcabfa4ebf6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:16.331616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a10b6f-25a7-4537-91fe-99d76acd45a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7d1c860967435198afe367c04c135e, user_id=f27b94a4d37042a5b30ecfcabfa4ebf6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:16.335649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a10b6f-25a7-4537-91fe-99d76acd45a6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:16.361433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021532c1-e180-45e4-8781-d445be701193 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:16.361791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021532c1-e180-45e4-8781-d445be701193 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:16.362032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021532c1-e180-45e4-8781-d445be701193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:16.364757 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2672/5317] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:16 2022] PUT /identity/v3/projects/df7d1c860967435198afe367c04c135e/users/f27b94a4d37042a5b30ecfcabfa4ebf6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:16.409009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-021532c1-e180-45e4-8781-d445be701193 None None] MFA Rules not processed for user `f27b94a4d37042a5b30ecfcabfa4ebf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:16.410411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-021532c1-e180-45e4-8781-d445be701193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:16.433349 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:16.531751 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2646/5318] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:16.534251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a10b6f-25a7-4537-91fe-99d76acd45a6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:16.547422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a10b6f-25a7-4537-91fe-99d76acd45a6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:16.554626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4d9aa-e896-468c-9079-75eb6b2213a1 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:16.556257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4d9aa-e896-468c-9079-75eb6b2213a1 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:16.557267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4d9aa-e896-468c-9079-75eb6b2213a1 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:16.559007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4d9aa-e896-468c-9079-75eb6b2213a1 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:16.559455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4d9aa-e896-468c-9079-75eb6b2213a1 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:16.561585 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-ddf4d9aa-e896-468c-9079-75eb6b2213a1 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:26:16.561585 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:26:16.561585 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:26:16.571043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4d9aa-e896-468c-9079-75eb6b2213a1 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:16.634399 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2673/5319] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:26:16 2022] POST /identity/v3/regions => generated 223 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:16.634599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021532c1-e180-45e4-8781-d445be701193 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:16.650429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021532c1-e180-45e4-8781-d445be701193 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:16.698279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e69f1-2ecb-4b82-8740-bac39b251f27 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:16.701107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e69f1-2ecb-4b82-8740-bac39b251f27 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:16.701107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e69f1-2ecb-4b82-8740-bac39b251f27 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:16.701107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e69f1-2ecb-4b82-8740-bac39b251f27 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:16.705813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e69f1-2ecb-4b82-8740-bac39b251f27 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:16.712477 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-d87e69f1-2ecb-4b82-8740-bac39b251f27 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:26:16.712477 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:26:16.712477 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:26:16.729087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e69f1-2ecb-4b82-8740-bac39b251f27 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:16.816271 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2647/5320] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:26:16 2022] POST /identity/v3/regions => generated 224 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:16.816801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4d9aa-e896-468c-9079-75eb6b2213a1 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:16.840259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4d9aa-e896-468c-9079-75eb6b2213a1 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:16.899869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0e362-314d-4528-934b-3ec1b01f2cc0 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:16.903845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e362-314d-4528-934b-3ec1b01f2cc0 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:16.904278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e362-314d-4528-934b-3ec1b01f2cc0 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:16.905145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e362-314d-4528-934b-3ec1b01f2cc0 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions/e18d85ba-4362-40f9-afb8-94fc5f98d3ef` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:16.907307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0e362-314d-4528-934b-3ec1b01f2cc0 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:create_region(region_id=e18d85ba-4362-40f9-afb8-94fc5f98d3ef)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:16.912361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0e362-314d-4528-934b-3ec1b01f2cc0 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:16.958768 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2674/5321] 10.222.0.39 () {60 vars in 1259 bytes} [Sun Oct 16 01:26:16 2022] PUT /identity/v3/regions/e18d85ba-4362-40f9-afb8-94fc5f98d3ef => generated 231 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:16.959173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e69f1-2ecb-4b82-8740-bac39b251f27 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:16.974978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e69f1-2ecb-4b82-8740-bac39b251f27 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:17.017457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f04888-0e8f-4cdd-9b10-e67d82680236 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:17.019740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f04888-0e8f-4cdd-9b10-e67d82680236 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:17.020122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f04888-0e8f-4cdd-9b10-e67d82680236 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:17.020414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f04888-0e8f-4cdd-9b10-e67d82680236 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions/e18d85ba-4362-40f9-afb8-94fc5f98d3ef` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:17.023603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f04888-0e8f-4cdd-9b10-e67d82680236 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:delete_region(region_id=e18d85ba-4362-40f9-afb8-94fc5f98d3ef)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:17.025627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f04888-0e8f-4cdd-9b10-e67d82680236 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:17.066432 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2648/5322] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:26:16 2022] DELETE /identity/v3/regions/e18d85ba-4362-40f9-afb8-94fc5f98d3ef => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:17.072450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0e362-314d-4528-934b-3ec1b01f2cc0 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:17.091698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0e362-314d-4528-934b-3ec1b01f2cc0 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:17.127792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a7b51-8e58-4f17-ae8f-4f671cadec4c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:17.128451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a7b51-8e58-4f17-ae8f-4f671cadec4c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:17.128726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a7b51-8e58-4f17-ae8f-4f671cadec4c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:17.129004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a7b51-8e58-4f17-ae8f-4f671cadec4c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:17.129671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a7b51-8e58-4f17-ae8f-4f671cadec4c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:17.131921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a7b51-8e58-4f17-ae8f-4f671cadec4c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:17.180176 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2675/5323] 10.222.0.39 () {60 vars in 1150 bytes} [Sun Oct 16 01:26:17 2022] POST /identity/v3/regions => generated 253 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:17.180830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f04888-0e8f-4cdd-9b10-e67d82680236 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:17.195571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f04888-0e8f-4cdd-9b10-e67d82680236 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:17.241469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6db828-2dba-476c-abbd-0a1e67282230 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:17.242463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6db828-2dba-476c-abbd-0a1e67282230 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:17.243380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6db828-2dba-476c-abbd-0a1e67282230 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:17.243858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6db828-2dba-476c-abbd-0a1e67282230 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions/edd5ba72289b4295a259193e5c077cb0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:17.245561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6db828-2dba-476c-abbd-0a1e67282230 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:update_region(region_id=edd5ba72289b4295a259193e5c077cb0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:17.246891 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-ca6db828-2dba-476c-abbd-0a1e67282230 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:26:17.246891 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:26:17.246891 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:26:17.248527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6db828-2dba-476c-abbd-0a1e67282230 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:17.284546 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2649/5324] 10.222.0.39 () {60 vars in 1250 bytes} [Sun Oct 16 01:26:17 2022] PATCH /identity/v3/regions/edd5ba72289b4295a259193e5c077cb0 => generated 253 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:26:17.288951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a7b51-8e58-4f17-ae8f-4f671cadec4c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:17.301068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a7b51-8e58-4f17-ae8f-4f671cadec4c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:17.339841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d688f-fe54-4cd2-a858-cef7fd823ae9 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:17.340118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d688f-fe54-4cd2-a858-cef7fd823ae9 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:17.340343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d688f-fe54-4cd2-a858-cef7fd823ae9 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:17.340619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d688f-fe54-4cd2-a858-cef7fd823ae9 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions/edd5ba72289b4295a259193e5c077cb0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:17.341218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d688f-fe54-4cd2-a858-cef7fd823ae9 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:get_region(region_id=edd5ba72289b4295a259193e5c077cb0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:17.342326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d688f-fe54-4cd2-a858-cef7fd823ae9 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:17.361625 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2676/5325] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:26:17 2022] GET /identity/v3/regions/edd5ba72289b4295a259193e5c077cb0 => generated 253 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:17.367210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6db828-2dba-476c-abbd-0a1e67282230 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:17.381637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6db828-2dba-476c-abbd-0a1e67282230 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:17.398211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa763d-503b-4d5f-8a15-81b95de067fc tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:17.398872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa763d-503b-4d5f-8a15-81b95de067fc tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:17.399440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa763d-503b-4d5f-8a15-81b95de067fc tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:17.399724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa763d-503b-4d5f-8a15-81b95de067fc tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions/edd5ba72289b4295a259193e5c077cb0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:17.400321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa763d-503b-4d5f-8a15-81b95de067fc tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:delete_region(region_id=edd5ba72289b4295a259193e5c077cb0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:17.402163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa763d-503b-4d5f-8a15-81b95de067fc tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:17.439666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d688f-fe54-4cd2-a858-cef7fd823ae9 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:17.440731 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2650/5326] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:26:17 2022] DELETE /identity/v3/regions/edd5ba72289b4295a259193e5c077cb0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:17.452743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d688f-fe54-4cd2-a858-cef7fd823ae9 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:17.480907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddad1ba-886c-44b7-adca-da322f234259 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:17.481523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddad1ba-886c-44b7-adca-da322f234259 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:17.481853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddad1ba-886c-44b7-adca-da322f234259 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:17.482188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddad1ba-886c-44b7-adca-da322f234259 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:17.482794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddad1ba-886c-44b7-adca-da322f234259 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:17.484067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddad1ba-886c-44b7-adca-da322f234259 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:17.507283 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2677/5327] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Oct 16 01:26:17 2022] GET /identity/v3/regions => generated 669 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:17.508712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa763d-503b-4d5f-8a15-81b95de067fc tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:17.528068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa763d-503b-4d5f-8a15-81b95de067fc tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:17.552483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b843e-b129-4e3c-a610-24200591dcc2 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:17.553666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b843e-b129-4e3c-a610-24200591dcc2 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:17.553972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b843e-b129-4e3c-a610-24200591dcc2 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:17.554214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b843e-b129-4e3c-a610-24200591dcc2 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions/edd5ba72289b4295a259193e5c077cb0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:17.554823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b843e-b129-4e3c-a610-24200591dcc2 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:delete_region(region_id=edd5ba72289b4295a259193e5c077cb0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:17.566023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b843e-b129-4e3c-a610-24200591dcc2 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-410b843e-b129-4e3c-a610-24200591dcc2 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Could not find region: edd5ba72289b4295a259193e5c077cb0.: keystone.exception.RegionNotFound: Could not find region: edd5ba72289b4295a259193e5c077cb0. Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: edd5ba72289b4295a259193e5c077cb0. Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:26:17.587762 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: edd5ba72289b4295a259193e5c077cb0. Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:26:17.589503 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2651/5328] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:26:17 2022] DELETE /identity/v3/regions/edd5ba72289b4295a259193e5c077cb0 => generated 112 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 16 01:26:17.594376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddad1ba-886c-44b7-adca-da322f234259 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:17.606319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddad1ba-886c-44b7-adca-da322f234259 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:17.612585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bddb28-6966-4253-bbb9-88c381281019 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:17.614780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bddb28-6966-4253-bbb9-88c381281019 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:17.615114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bddb28-6966-4253-bbb9-88c381281019 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:17.618508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bddb28-6966-4253-bbb9-88c381281019 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:17.619335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bddb28-6966-4253-bbb9-88c381281019 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:17.620472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bddb28-6966-4253-bbb9-88c381281019 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:17.639208 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2678/5329] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Oct 16 01:26:17 2022] GET /identity/v3/regions => generated 669 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:17.643801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b843e-b129-4e3c-a610-24200591dcc2 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:17.661733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b843e-b129-4e3c-a610-24200591dcc2 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:17.675709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aa9a5-6961-4747-abe8-28a44e7f1829 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:17.676338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa9a5-6961-4747-abe8-28a44e7f1829 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:17.676624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa9a5-6961-4747-abe8-28a44e7f1829 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:17.676900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa9a5-6961-4747-abe8-28a44e7f1829 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:17.677571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aa9a5-6961-4747-abe8-28a44e7f1829 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:17.679823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aa9a5-6961-4747-abe8-28a44e7f1829 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:17.738173 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2652/5330] 10.222.0.39 () {60 vars in 1150 bytes} [Sun Oct 16 01:26:17 2022] POST /identity/v3/regions => generated 253 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:17.743134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bddb28-6966-4253-bbb9-88c381281019 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:17.759691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bddb28-6966-4253-bbb9-88c381281019 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:17.797570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d372f-94c5-48ab-a32a-d6cd1ce2124c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:17.798349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d372f-94c5-48ab-a32a-d6cd1ce2124c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:17.799137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d372f-94c5-48ab-a32a-d6cd1ce2124c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:17.800489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d372f-94c5-48ab-a32a-d6cd1ce2124c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:17.803834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d372f-94c5-48ab-a32a-d6cd1ce2124c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Adding query filter params (parent_region_id=dd2f57a0279e420397e033a648ecc552) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:17.805814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d372f-94c5-48ab-a32a-d6cd1ce2124c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:17.812029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d372f-94c5-48ab-a32a-d6cd1ce2124c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:17.815493 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:17.821551 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2679/5331] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:26:17 2022] GET /identity/v3/regions?parent_region_id=dd2f57a0279e420397e033a648ecc552 => generated 399 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:17.826596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aa9a5-6961-4747-abe8-28a44e7f1829 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:17.843266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aa9a5-6961-4747-abe8-28a44e7f1829 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:17.849345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb686421-3972-42db-b13b-1e2aec499697 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:17.849857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb686421-3972-42db-b13b-1e2aec499697 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:17.850143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb686421-3972-42db-b13b-1e2aec499697 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:17.850458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb686421-3972-42db-b13b-1e2aec499697 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions/d96e33f9ee574af68e8f231e8668bc8b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:17.851314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb686421-3972-42db-b13b-1e2aec499697 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d96e33f9ee574af68e8f231e8668bc8b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:17.852981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb686421-3972-42db-b13b-1e2aec499697 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:17.887695 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2653/5332] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:26:17 2022] DELETE /identity/v3/regions/d96e33f9ee574af68e8f231e8668bc8b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:17.888283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d372f-94c5-48ab-a32a-d6cd1ce2124c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:17.900834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d372f-94c5-48ab-a32a-d6cd1ce2124c tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:17.929573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b30e0d-1956-4b4f-9a92-a7d6a8ca1f35 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:17.930267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b30e0d-1956-4b4f-9a92-a7d6a8ca1f35 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:17.930549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b30e0d-1956-4b4f-9a92-a7d6a8ca1f35 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:17.930828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b30e0d-1956-4b4f-9a92-a7d6a8ca1f35 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions/9dc6114f19fa404caf44fec017ef7be1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:17.931454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b30e0d-1956-4b4f-9a92-a7d6a8ca1f35 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:delete_region(region_id=9dc6114f19fa404caf44fec017ef7be1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:17.933285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b30e0d-1956-4b4f-9a92-a7d6a8ca1f35 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:17.961959 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2680/5333] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:26:17 2022] DELETE /identity/v3/regions/9dc6114f19fa404caf44fec017ef7be1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:17.966461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb686421-3972-42db-b13b-1e2aec499697 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:17.986469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb686421-3972-42db-b13b-1e2aec499697 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:18.206233 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:18.218206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d5b2b-fa36-4913-8c13-f4d89242b9b7 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27b94a4d37042a5b30ecfcabfa4ebf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df7d1c860967435198afe367c04c135e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:18.219938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d5b2b-fa36-4913-8c13-f4d89242b9b7 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:18.223688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d5b2b-fa36-4913-8c13-f4d89242b9b7 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:18.224254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d5b2b-fa36-4913-8c13-f4d89242b9b7 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] PATH_INFO: `/v3/regions/dd2f57a0279e420397e033a648ecc552` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:18.238418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d5b2b-fa36-4913-8c13-f4d89242b9b7 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorizing `identity:delete_region(region_id=dd2f57a0279e420397e033a648ecc552)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:18.244454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d5b2b-fa36-4913-8c13-f4d89242b9b7 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:18.292502 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2654/5334] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:26:17 2022] DELETE /identity/v3/regions/dd2f57a0279e420397e033a648ecc552 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:18.293238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b30e0d-1956-4b4f-9a92-a7d6a8ca1f35 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:18.539501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b30e0d-1956-4b4f-9a92-a7d6a8ca1f35 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:18.582383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40367f8c-d4a9-48e7-8840-c02770069aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:18.582997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d5b2b-fa36-4913-8c13-f4d89242b9b7 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:18.583185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40367f8c-d4a9-48e7-8840-c02770069aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:18.583376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40367f8c-d4a9-48e7-8840-c02770069aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:18.583742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40367f8c-d4a9-48e7-8840-c02770069aa8 admin admin] PATH_INFO: `/v3/users/6b4f90da858042ad910dce344bce0840` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:18.585785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-043d5b2b-fa36-4913-8c13-f4d89242b9b7 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:18.586839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40367f8c-d4a9-48e7-8840-c02770069aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4f90da858042ad910dce344bce0840)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:18.589729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40367f8c-d4a9-48e7-8840-c02770069aa8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:18.689627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-40367f8c-d4a9-48e7-8840-c02770069aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4f90da858042ad910dce344bce0840'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:18.689853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-40367f8c-d4a9-48e7-8840-c02770069aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4f90da858042ad910dce344bce0840'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:18.719260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-40367f8c-d4a9-48e7-8840-c02770069aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4f90da858042ad910dce344bce0840'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:18.733556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-40367f8c-d4a9-48e7-8840-c02770069aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4f90da858042ad910dce344bce0840'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:18.734519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-40367f8c-d4a9-48e7-8840-c02770069aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4f90da858042ad910dce344bce0840'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:18.763404 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2681/5335] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:18 2022] DELETE /identity/v3/users/6b4f90da858042ad910dce344bce0840 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:18.767673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08a111-7ba4-4beb-a2db-6a5c29998c6f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:18.768028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08a111-7ba4-4beb-a2db-6a5c29998c6f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:18.768396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08a111-7ba4-4beb-a2db-6a5c29998c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:18.838659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2c08a111-7ba4-4beb-a2db-6a5c29998c6f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:18.841836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2c08a111-7ba4-4beb-a2db-6a5c29998c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:18.860700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d5b2b-fa36-4913-8c13-f4d89242b9b7 tempest-RegionsTestJSON-206617557 tempest-RegionsTestJSON-206617557-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:18.935846 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:19.042868 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2682/5336] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:19.064884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08a111-7ba4-4beb-a2db-6a5c29998c6f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:19.066712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2c08a111-7ba4-4beb-a2db-6a5c29998c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:19.076911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8feb84-38ee-4ba2-9053-137d7ba658c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:19.077877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8feb84-38ee-4ba2-9053-137d7ba658c2 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:19.078258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8feb84-38ee-4ba2-9053-137d7ba658c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:19.078533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8feb84-38ee-4ba2-9053-137d7ba658c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:19.084327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2d8feb84-38ee-4ba2-9053-137d7ba658c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:19.132153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8feb84-38ee-4ba2-9053-137d7ba658c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:19.134480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8feb84-38ee-4ba2-9053-137d7ba658c2 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:19.181731 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2655/5337] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:26:19.268505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08a111-7ba4-4beb-a2db-6a5c29998c6f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:19.277538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538035c-e39c-4ac7-90dc-920c1fb63010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:19.279273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538035c-e39c-4ac7-90dc-920c1fb63010 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:19.281455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538035c-e39c-4ac7-90dc-920c1fb63010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:19.281919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538035c-e39c-4ac7-90dc-920c1fb63010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:19.307610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538035c-e39c-4ac7-90dc-920c1fb63010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:19.313255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538035c-e39c-4ac7-90dc-920c1fb63010 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:19.343046 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2683/5338] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:26:19.534278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8feb84-38ee-4ba2-9053-137d7ba658c2 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:19.536122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2d8feb84-38ee-4ba2-9053-137d7ba658c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:19.572353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8feb84-38ee-4ba2-9053-137d7ba658c2 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:19.584063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92551343-bc6d-45d6-a88b-9468c8dda489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:19.585432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92551343-bc6d-45d6-a88b-9468c8dda489 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:19.598674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92551343-bc6d-45d6-a88b-9468c8dda489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:19.599121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92551343-bc6d-45d6-a88b-9468c8dda489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:19.614712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-92551343-bc6d-45d6-a88b-9468c8dda489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:19.639546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92551343-bc6d-45d6-a88b-9468c8dda489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:19.641164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92551343-bc6d-45d6-a88b-9468c8dda489 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:19.659016 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2656/5339] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:20.257887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538035c-e39c-4ac7-90dc-920c1fb63010 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:20.273089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538035c-e39c-4ac7-90dc-920c1fb63010 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:20.277651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde750e3-b888-4a53-98db-6da8cf29c096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:20.279168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde750e3-b888-4a53-98db-6da8cf29c096 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:20.279676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde750e3-b888-4a53-98db-6da8cf29c096 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:20.280177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde750e3-b888-4a53-98db-6da8cf29c096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:20.282569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cde750e3-b888-4a53-98db-6da8cf29c096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:20.297388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde750e3-b888-4a53-98db-6da8cf29c096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:20.299729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde750e3-b888-4a53-98db-6da8cf29c096 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:20.312133 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2684/5340] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:20.634519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92551343-bc6d-45d6-a88b-9468c8dda489 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:20.637304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-92551343-bc6d-45d6-a88b-9468c8dda489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:20.666222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92551343-bc6d-45d6-a88b-9468c8dda489 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:20.680896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:20.682796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:20.683516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:20.684275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] PATH_INFO: `/v3/projects/4eae2195e3e14eb898f957910477ffca` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:20.686541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eae2195e3e14eb898f957910477ffca)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:20.689341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:20.752973 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:20.764305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eae2195e3e14eb898f957910477ffca', 'request_id': 'req-600c0e44-e42e-4b62-b3de-7341dc94f3dd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:20.777266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eae2195e3e14eb898f957910477ffca', 'request_id': 'req-600c0e44-e42e-4b62-b3de-7341dc94f3dd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:20.789663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eae2195e3e14eb898f957910477ffca', 'request_id': 'req-600c0e44-e42e-4b62-b3de-7341dc94f3dd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:20.805187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] The token cache is being invalidate because project 4eae2195e3e14eb898f957910477ffca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:20.805680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:20.806460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:20.812039 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2657/5341] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:20 2022] DELETE /identity/v3/projects/4eae2195e3e14eb898f957910477ffca => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:20.812942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde750e3-b888-4a53-98db-6da8cf29c096 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:20.823262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde750e3-b888-4a53-98db-6da8cf29c096 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:20.888158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a91734-fb48-4e47-a25f-7ef1ca60142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:20.888852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a91734-fb48-4e47-a25f-7ef1ca60142a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:20.889138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a91734-fb48-4e47-a25f-7ef1ca60142a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:20.889409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a91734-fb48-4e47-a25f-7ef1ca60142a admin admin] PATH_INFO: `/v3/users/f27b94a4d37042a5b30ecfcabfa4ebf6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:20.890599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a91734-fb48-4e47-a25f-7ef1ca60142a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f27b94a4d37042a5b30ecfcabfa4ebf6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:20.892758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a91734-fb48-4e47-a25f-7ef1ca60142a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:20.971004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56a91734-fb48-4e47-a25f-7ef1ca60142a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f27b94a4d37042a5b30ecfcabfa4ebf6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:20.971722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56a91734-fb48-4e47-a25f-7ef1ca60142a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f27b94a4d37042a5b30ecfcabfa4ebf6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:20.979347 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:20.988423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56a91734-fb48-4e47-a25f-7ef1ca60142a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f27b94a4d37042a5b30ecfcabfa4ebf6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:21.004425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56a91734-fb48-4e47-a25f-7ef1ca60142a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f27b94a4d37042a5b30ecfcabfa4ebf6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:21.006110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56a91734-fb48-4e47-a25f-7ef1ca60142a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f27b94a4d37042a5b30ecfcabfa4ebf6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:21.025303 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2685/5342] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:20 2022] DELETE /identity/v3/users/f27b94a4d37042a5b30ecfcabfa4ebf6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:22.605955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:22.607790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:22.645011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c0e44-e42e-4b62-b3de-7341dc94f3dd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:22.809019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42787a4d-f573-4295-926d-a6051cb2f676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:22.809773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42787a4d-f573-4295-926d-a6051cb2f676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:22.810125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42787a4d-f573-4295-926d-a6051cb2f676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:22.811231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42787a4d-f573-4295-926d-a6051cb2f676 admin admin] PATH_INFO: `/v3/projects/df7d1c860967435198afe367c04c135e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:22.813518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42787a4d-f573-4295-926d-a6051cb2f676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7d1c860967435198afe367c04c135e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:22.816340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42787a4d-f573-4295-926d-a6051cb2f676 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:22.945980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-42787a4d-f573-4295-926d-a6051cb2f676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7d1c860967435198afe367c04c135e', 'request_id': 'req-42787a4d-f573-4295-926d-a6051cb2f676'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:22.960570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-42787a4d-f573-4295-926d-a6051cb2f676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7d1c860967435198afe367c04c135e', 'request_id': 'req-42787a4d-f573-4295-926d-a6051cb2f676'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:22.977127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-42787a4d-f573-4295-926d-a6051cb2f676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7d1c860967435198afe367c04c135e', 'request_id': 'req-42787a4d-f573-4295-926d-a6051cb2f676'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:23.007306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-42787a4d-f573-4295-926d-a6051cb2f676 admin admin] The token cache is being invalidate because project df7d1c860967435198afe367c04c135e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:23.007587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-42787a4d-f573-4295-926d-a6051cb2f676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:23.008251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-42787a4d-f573-4295-926d-a6051cb2f676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:23.010082 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2658/5343] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:22 2022] DELETE /identity/v3/projects/df7d1c860967435198afe367c04c135e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:23.014838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff6df9-75c4-4f46-8820-2c83565fd627 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:23.015740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff6df9-75c4-4f46-8820-2c83565fd627 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:23.016215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff6df9-75c4-4f46-8820-2c83565fd627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:23.060054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-80ff6df9-75c4-4f46-8820-2c83565fd627 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:23.061538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-80ff6df9-75c4-4f46-8820-2c83565fd627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:23.179574 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2686/5344] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:23.181148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72e611-7743-4cb0-b817-638b5fc36242 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:23.181148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72e611-7743-4cb0-b817-638b5fc36242 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:23.181462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72e611-7743-4cb0-b817-638b5fc36242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:23.228274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5e72e611-7743-4cb0-b817-638b5fc36242 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:23.229824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5e72e611-7743-4cb0-b817-638b5fc36242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:23.239409 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2659/5345] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:26:23.244468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff6df9-75c4-4f46-8820-2c83565fd627 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:23.260324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff6df9-75c4-4f46-8820-2c83565fd627 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:23.268053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465907d-b774-4ab2-8780-fd52454ef05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:23.269539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465907d-b774-4ab2-8780-fd52454ef05f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:23.270406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465907d-b774-4ab2-8780-fd52454ef05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:23.270955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465907d-b774-4ab2-8780-fd52454ef05f admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:23.272116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465907d-b774-4ab2-8780-fd52454ef05f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:23.272668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465907d-b774-4ab2-8780-fd52454ef05f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:23.275024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465907d-b774-4ab2-8780-fd52454ef05f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:23.296444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72e611-7743-4cb0-b817-638b5fc36242 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:23.308763 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2687/5346] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:23.311981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72e611-7743-4cb0-b817-638b5fc36242 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:23.320186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977fa03-37f1-419c-b51c-d4311546dfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:23.321221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977fa03-37f1-419c-b51c-d4311546dfba admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:23.321724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977fa03-37f1-419c-b51c-d4311546dfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:23.322234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977fa03-37f1-419c-b51c-d4311546dfba admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:23.323139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977fa03-37f1-419c-b51c-d4311546dfba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:23.325890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977fa03-37f1-419c-b51c-d4311546dfba admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:23.364285 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2660/5347] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:23 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:23.369087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465907d-b774-4ab2-8780-fd52454ef05f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:23.381089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465907d-b774-4ab2-8780-fd52454ef05f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:23.454663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f4d57-01c4-42b7-9cbe-253d63e39b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:23.455804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f4d57-01c4-42b7-9cbe-253d63e39b2d admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:23.456258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f4d57-01c4-42b7-9cbe-253d63e39b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:23.457051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f4d57-01c4-42b7-9cbe-253d63e39b2d admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:23.458175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f4d57-01c4-42b7-9cbe-253d63e39b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:23.461184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f4d57-01c4-42b7-9cbe-253d63e39b2d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:23.501104 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2688/5348] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:23 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:23.502152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977fa03-37f1-419c-b51c-d4311546dfba admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:23.514085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977fa03-37f1-419c-b51c-d4311546dfba admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:23.518844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb066f1b-96e3-46a8-8e97-a3f455a567d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:23.519482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb066f1b-96e3-46a8-8e97-a3f455a567d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:23.519756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb066f1b-96e3-46a8-8e97-a3f455a567d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:23.520022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb066f1b-96e3-46a8-8e97-a3f455a567d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:23.520652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb066f1b-96e3-46a8-8e97-a3f455a567d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:23.522650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb066f1b-96e3-46a8-8e97-a3f455a567d8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:23.540932 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2661/5349] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:26:23.543126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f4d57-01c4-42b7-9cbe-253d63e39b2d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:23.559967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f4d57-01c4-42b7-9cbe-253d63e39b2d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:23.570594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb490a-3585-4c86-9831-747003354bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:23.572075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb490a-3585-4c86-9831-747003354bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:23.572363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb490a-3585-4c86-9831-747003354bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:23.572921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb490a-3585-4c86-9831-747003354bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:23.573588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb490a-3585-4c86-9831-747003354bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:23.575576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb490a-3585-4c86-9831-747003354bf5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:23.592374 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2689/5350] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:23.595512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb066f1b-96e3-46a8-8e97-a3f455a567d8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:23.608026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb066f1b-96e3-46a8-8e97-a3f455a567d8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:23.614324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09421d86-49b4-4829-ba9d-e56326ef4ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:23.616228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421d86-49b4-4829-ba9d-e56326ef4ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:23.616629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421d86-49b4-4829-ba9d-e56326ef4ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:23.617005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421d86-49b4-4829-ba9d-e56326ef4ae0 admin admin] PATH_INFO: `/v3/projects/52b69abc93834deab1280fe3ba9fa97c/users/e34c8170ed244806932e9f5a4147b5cc/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:23.646162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09421d86-49b4-4829-ba9d-e56326ef4ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b69abc93834deab1280fe3ba9fa97c, user_id=e34c8170ed244806932e9f5a4147b5cc, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:23.649084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09421d86-49b4-4829-ba9d-e56326ef4ae0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:23.651597 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:23.669319 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2662/5351] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:23 2022] PUT /identity/v3/projects/52b69abc93834deab1280fe3ba9fa97c/users/e34c8170ed244806932e9f5a4147b5cc/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:23.680437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059bd0c-257f-467c-a138-97ff89ef55d5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:23.680732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059bd0c-257f-467c-a138-97ff89ef55d5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:23.681005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059bd0c-257f-467c-a138-97ff89ef55d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:23.716827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e059bd0c-257f-467c-a138-97ff89ef55d5 None None] MFA Rules not processed for user `e34c8170ed244806932e9f5a4147b5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:23.718224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e059bd0c-257f-467c-a138-97ff89ef55d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:23.778594 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:23.838988 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2690/5352] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:23.839489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09421d86-49b4-4829-ba9d-e56326ef4ae0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:23.851827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09421d86-49b4-4829-ba9d-e56326ef4ae0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:23.857172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd6a03-acb8-4f62-8d91-ff4fea61fd0a tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34c8170ed244806932e9f5a4147b5cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b69abc93834deab1280fe3ba9fa97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:23.858022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd6a03-acb8-4f62-8d91-ff4fea61fd0a tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:23.858022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd6a03-acb8-4f62-8d91-ff4fea61fd0a tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:23.858382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd6a03-acb8-4f62-8d91-ff4fea61fd0a tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] PATH_INFO: `/v3/users/e34c8170ed244806932e9f5a4147b5cc/application_credentials` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:23.858995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd6a03-acb8-4f62-8d91-ff4fea61fd0a tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorizing `identity:create_application_credential(user_id=e34c8170ed244806932e9f5a4147b5cc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:23.860214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd6a03-acb8-4f62-8d91-ff4fea61fd0a tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:23.963756 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2663/5353] 10.222.0.39 () {60 vars in 1315 bytes} [Sun Oct 16 01:26:23 2022] POST /identity/v3/users/e34c8170ed244806932e9f5a4147b5cc/application_credentials => generated 920 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:23.970694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059bd0c-257f-467c-a138-97ff89ef55d5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:23.982739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059bd0c-257f-467c-a138-97ff89ef55d5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:23.987478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521afa6-eef8-4755-a5f9-2bca5fd20da0 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34c8170ed244806932e9f5a4147b5cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b69abc93834deab1280fe3ba9fa97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:23.988142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521afa6-eef8-4755-a5f9-2bca5fd20da0 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:23.988432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521afa6-eef8-4755-a5f9-2bca5fd20da0 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:23.988714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521afa6-eef8-4755-a5f9-2bca5fd20da0 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] PATH_INFO: `/v3/users/e34c8170ed244806932e9f5a4147b5cc/access_rules/1c6c4e6e7a154c11b04ad0a152b76763` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:23.990295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521afa6-eef8-4755-a5f9-2bca5fd20da0 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorizing `identity:delete_access_rule(user_id=e34c8170ed244806932e9f5a4147b5cc, access_rule_id=1c6c4e6e7a154c11b04ad0a152b76763)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:23.991533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521afa6-eef8-4755-a5f9-2bca5fd20da0 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e521afa6-eef8-4755-a5f9-2bca5fd20da0 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application session.delete(ref) Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application next(self.gen) Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application yield resource Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application next(self.gen) Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:26:24.019955 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise self.value Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application session.commit() Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.session.flush() Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 01:26:24.026655 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application compat.raise_( Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._synchronize( Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise AssertionError( Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 16 01:26:24.029343 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:26:24.030584 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:26:24.032008 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 16 01:26:24.032008 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 16 01:26:24.032008 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 16 01:26:24.032008 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 16 01:26:24.032008 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 16 01:26:24.032008 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:26:24.032008 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2691/5354] 10.222.0.39 () {58 vars in 1362 bytes} [Sun Oct 16 01:26:23 2022] DELETE /identity/v3/users/e34c8170ed244806932e9f5a4147b5cc/access_rules/1c6c4e6e7a154c11b04ad0a152b76763 => generated 89 bytes in 53 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 16 01:26:24.032820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd6a03-acb8-4f62-8d91-ff4fea61fd0a tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:24.038873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd6a03-acb8-4f62-8d91-ff4fea61fd0a tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:24.043722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092516a0-ae53-48dc-8f6f-400c833efff3 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34c8170ed244806932e9f5a4147b5cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b69abc93834deab1280fe3ba9fa97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:24.044417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092516a0-ae53-48dc-8f6f-400c833efff3 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:24.045106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092516a0-ae53-48dc-8f6f-400c833efff3 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:24.045106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092516a0-ae53-48dc-8f6f-400c833efff3 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] PATH_INFO: `/v3/users/e34c8170ed244806932e9f5a4147b5cc/application_credentials/5e532d64146b4d50ac01433ef1145c4d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:24.057634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092516a0-ae53-48dc-8f6f-400c833efff3 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e34c8170ed244806932e9f5a4147b5cc, application_credential_id=5e532d64146b4d50ac01433ef1145c4d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:24.060321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092516a0-ae53-48dc-8f6f-400c833efff3 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:24.095770 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2664/5355] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Oct 16 01:26:24 2022] DELETE /identity/v3/users/e34c8170ed244806932e9f5a4147b5cc/application_credentials/5e532d64146b4d50ac01433ef1145c4d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:24.096891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521afa6-eef8-4755-a5f9-2bca5fd20da0 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:24.119344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521afa6-eef8-4755-a5f9-2bca5fd20da0 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:24.134590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a83c4-149e-4025-81d6-7320a71e57d9 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34c8170ed244806932e9f5a4147b5cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b69abc93834deab1280fe3ba9fa97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:24.135302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a83c4-149e-4025-81d6-7320a71e57d9 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:24.135974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a83c4-149e-4025-81d6-7320a71e57d9 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:24.136452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a83c4-149e-4025-81d6-7320a71e57d9 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] PATH_INFO: `/v3/users/e34c8170ed244806932e9f5a4147b5cc/access_rules` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:24.137889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a83c4-149e-4025-81d6-7320a71e57d9 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorizing `identity:list_access_rules(user_id=e34c8170ed244806932e9f5a4147b5cc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:24.140729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a83c4-149e-4025-81d6-7320a71e57d9 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:24.149114 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2692/5356] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:26:24 2022] GET /identity/v3/users/e34c8170ed244806932e9f5a4147b5cc/access_rules => generated 369 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:24.152622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092516a0-ae53-48dc-8f6f-400c833efff3 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:24.172592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092516a0-ae53-48dc-8f6f-400c833efff3 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:24.183922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b80ba4-7337-4873-8412-ab3c8c89b70d tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34c8170ed244806932e9f5a4147b5cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b69abc93834deab1280fe3ba9fa97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:24.184887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b80ba4-7337-4873-8412-ab3c8c89b70d tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:24.185215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b80ba4-7337-4873-8412-ab3c8c89b70d tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:24.185890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b80ba4-7337-4873-8412-ab3c8c89b70d tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] PATH_INFO: `/v3/users/e34c8170ed244806932e9f5a4147b5cc/access_rules/1c6c4e6e7a154c11b04ad0a152b76763` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:24.187286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b80ba4-7337-4873-8412-ab3c8c89b70d tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorizing `identity:delete_access_rule(user_id=e34c8170ed244806932e9f5a4147b5cc, access_rule_id=1c6c4e6e7a154c11b04ad0a152b76763)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:24.189643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b80ba4-7337-4873-8412-ab3c8c89b70d tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:24.216533 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2665/5357] 10.222.0.39 () {58 vars in 1362 bytes} [Sun Oct 16 01:26:24 2022] DELETE /identity/v3/users/e34c8170ed244806932e9f5a4147b5cc/access_rules/1c6c4e6e7a154c11b04ad0a152b76763 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:24.220588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a83c4-149e-4025-81d6-7320a71e57d9 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:24.235796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a83c4-149e-4025-81d6-7320a71e57d9 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:24.249760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92d4bf-dcb8-49a7-8bb8-403b481dd0c4 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34c8170ed244806932e9f5a4147b5cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b69abc93834deab1280fe3ba9fa97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:24.250798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92d4bf-dcb8-49a7-8bb8-403b481dd0c4 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:24.251283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92d4bf-dcb8-49a7-8bb8-403b481dd0c4 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:24.251924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92d4bf-dcb8-49a7-8bb8-403b481dd0c4 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] PATH_INFO: `/v3/users/e34c8170ed244806932e9f5a4147b5cc/access_rules` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:24.254030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92d4bf-dcb8-49a7-8bb8-403b481dd0c4 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorizing `identity:list_access_rules(user_id=e34c8170ed244806932e9f5a4147b5cc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:24.256938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92d4bf-dcb8-49a7-8bb8-403b481dd0c4 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:24.266217 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2693/5358] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:26:24 2022] GET /identity/v3/users/e34c8170ed244806932e9f5a4147b5cc/access_rules => generated 158 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:24.272634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b80ba4-7337-4873-8412-ab3c8c89b70d tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:24.289520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b80ba4-7337-4873-8412-ab3c8c89b70d tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:24.303149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675088dd-0ff6-4274-bdd5-9f4523cdef85 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34c8170ed244806932e9f5a4147b5cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b69abc93834deab1280fe3ba9fa97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:24.304332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675088dd-0ff6-4274-bdd5-9f4523cdef85 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:24.305082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675088dd-0ff6-4274-bdd5-9f4523cdef85 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:24.305728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675088dd-0ff6-4274-bdd5-9f4523cdef85 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] PATH_INFO: `/v3/users/e34c8170ed244806932e9f5a4147b5cc/application_credentials` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:24.308718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675088dd-0ff6-4274-bdd5-9f4523cdef85 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorizing `identity:create_application_credential(user_id=e34c8170ed244806932e9f5a4147b5cc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:24.310721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675088dd-0ff6-4274-bdd5-9f4523cdef85 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:24.574022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92d4bf-dcb8-49a7-8bb8-403b481dd0c4 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:24.575827 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2666/5359] 10.222.0.39 () {60 vars in 1315 bytes} [Sun Oct 16 01:26:24 2022] POST /identity/v3/users/e34c8170ed244806932e9f5a4147b5cc/application_credentials => generated 920 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:24.589674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92d4bf-dcb8-49a7-8bb8-403b481dd0c4 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:24.594700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709a83-bf6a-42d5-9d6b-71e27422a794 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34c8170ed244806932e9f5a4147b5cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b69abc93834deab1280fe3ba9fa97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:24.595734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709a83-bf6a-42d5-9d6b-71e27422a794 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:24.596203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709a83-bf6a-42d5-9d6b-71e27422a794 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:24.596599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709a83-bf6a-42d5-9d6b-71e27422a794 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] PATH_INFO: `/v3/users/e34c8170ed244806932e9f5a4147b5cc/access_rules` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:24.598006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac709a83-bf6a-42d5-9d6b-71e27422a794 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorizing `identity:list_access_rules(user_id=e34c8170ed244806932e9f5a4147b5cc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:24.599695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac709a83-bf6a-42d5-9d6b-71e27422a794 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:24.609516 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2694/5360] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:26:24 2022] GET /identity/v3/users/e34c8170ed244806932e9f5a4147b5cc/access_rules => generated 369 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:26:24.615909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675088dd-0ff6-4274-bdd5-9f4523cdef85 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:24.633964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675088dd-0ff6-4274-bdd5-9f4523cdef85 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:24.646004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc837c65-7024-4812-ba62-ce0fcbe703c2 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34c8170ed244806932e9f5a4147b5cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b69abc93834deab1280fe3ba9fa97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:24.646726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc837c65-7024-4812-ba62-ce0fcbe703c2 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:24.647088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc837c65-7024-4812-ba62-ce0fcbe703c2 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:24.647402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc837c65-7024-4812-ba62-ce0fcbe703c2 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] PATH_INFO: `/v3/users/e34c8170ed244806932e9f5a4147b5cc/application_credentials` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:24.648146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc837c65-7024-4812-ba62-ce0fcbe703c2 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorizing `identity:create_application_credential(user_id=e34c8170ed244806932e9f5a4147b5cc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:24.649413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc837c65-7024-4812-ba62-ce0fcbe703c2 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:24.676930 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=9,keystone:SELECT=87,keystone:DELETE=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:24.832699 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2667/5361] 10.222.0.39 () {60 vars in 1315 bytes} [Sun Oct 16 01:26:24 2022] POST /identity/v3/users/e34c8170ed244806932e9f5a4147b5cc/application_credentials => generated 920 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:24.837004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709a83-bf6a-42d5-9d6b-71e27422a794 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:24.857387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709a83-bf6a-42d5-9d6b-71e27422a794 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:24.882055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa00b2c-59cc-4076-98a0-7fab36df08a7 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34c8170ed244806932e9f5a4147b5cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b69abc93834deab1280fe3ba9fa97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:24.884766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa00b2c-59cc-4076-98a0-7fab36df08a7 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:24.885235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa00b2c-59cc-4076-98a0-7fab36df08a7 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:24.886039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa00b2c-59cc-4076-98a0-7fab36df08a7 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] PATH_INFO: `/v3/users/e34c8170ed244806932e9f5a4147b5cc/access_rules/b62d7a22c61c4f989ca825fede845645` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:24.892681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa00b2c-59cc-4076-98a0-7fab36df08a7 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorizing `identity:get_access_rule(user_id=e34c8170ed244806932e9f5a4147b5cc, access_rule_id=b62d7a22c61c4f989ca825fede845645)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:24.894455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa00b2c-59cc-4076-98a0-7fab36df08a7 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:24.914049 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2695/5362] 10.222.0.39 () {58 vars in 1359 bytes} [Sun Oct 16 01:26:24 2022] GET /identity/v3/users/e34c8170ed244806932e9f5a4147b5cc/access_rules/b62d7a22c61c4f989ca825fede845645 => generated 229 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:26:24.919958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc837c65-7024-4812-ba62-ce0fcbe703c2 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:25.027549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc837c65-7024-4812-ba62-ce0fcbe703c2 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:25.034106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c92df9-1828-43b2-9373-c34d58d98571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:25.035493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c92df9-1828-43b2-9373-c34d58d98571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:25.035895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c92df9-1828-43b2-9373-c34d58d98571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:25.036263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c92df9-1828-43b2-9373-c34d58d98571 admin admin] PATH_INFO: `/v3/users/e34c8170ed244806932e9f5a4147b5cc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:25.037923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c92df9-1828-43b2-9373-c34d58d98571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34c8170ed244806932e9f5a4147b5cc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:25.040513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c92df9-1828-43b2-9373-c34d58d98571 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:25.158592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12c92df9-1828-43b2-9373-c34d58d98571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34c8170ed244806932e9f5a4147b5cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:25.161669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12c92df9-1828-43b2-9373-c34d58d98571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34c8170ed244806932e9f5a4147b5cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:25.231649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa00b2c-59cc-4076-98a0-7fab36df08a7 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:25.235104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8fa00b2c-59cc-4076-98a0-7fab36df08a7 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:25.266828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa00b2c-59cc-4076-98a0-7fab36df08a7 tempest-AccessRulesV3Test-1636281132 tempest-AccessRulesV3Test-1636281132-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:25.279319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:25.280247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:25.280741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:25.281171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] PATH_INFO: `/v3/users/7e7cdaa2d85d4ce698950075b98d5eb8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:25.283699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7cdaa2d85d4ce698950075b98d5eb8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:25.284499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12c92df9-1828-43b2-9373-c34d58d98571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34c8170ed244806932e9f5a4147b5cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:25.295875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:25.305350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12c92df9-1828-43b2-9373-c34d58d98571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34c8170ed244806932e9f5a4147b5cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:25.306128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12c92df9-1828-43b2-9373-c34d58d98571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34c8170ed244806932e9f5a4147b5cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:25.314558 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:25.338288 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2668/5363] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:24 2022] DELETE /identity/v3/users/e34c8170ed244806932e9f5a4147b5cc => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:25.341717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133c35d-5264-4753-9db4-cd0b324732b3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:25.342964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133c35d-5264-4753-9db4-cd0b324732b3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:25.342964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133c35d-5264-4753-9db4-cd0b324732b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:25.401159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7cdaa2d85d4ce698950075b98d5eb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:25.402381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7cdaa2d85d4ce698950075b98d5eb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:25.402520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6133c35d-5264-4753-9db4-cd0b324732b3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:25.406311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6133c35d-5264-4753-9db4-cd0b324732b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:25.434494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7cdaa2d85d4ce698950075b98d5eb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:25.451888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7cdaa2d85d4ce698950075b98d5eb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:25.452516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7cdaa2d85d4ce698950075b98d5eb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:25.473865 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2696/5364] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:25 2022] DELETE /identity/v3/users/7e7cdaa2d85d4ce698950075b98d5eb8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:26:25.550035 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2669/5365] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:25.595602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:25.597024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:25.769299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e783a-2984-4c1a-926c-120cc9db3b48 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:25.781111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635aca7-ac4f-470e-8e69-b85fce6d7082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:25.781746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635aca7-ac4f-470e-8e69-b85fce6d7082 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:25.782234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635aca7-ac4f-470e-8e69-b85fce6d7082 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:25.782514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635aca7-ac4f-470e-8e69-b85fce6d7082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:25.802379 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:25.895591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133c35d-5264-4753-9db4-cd0b324732b3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:25.897883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6133c35d-5264-4753-9db4-cd0b324732b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:25.925920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133c35d-5264-4753-9db4-cd0b324732b3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:25.958068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635aca7-ac4f-470e-8e69-b85fce6d7082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:25.962343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635aca7-ac4f-470e-8e69-b85fce6d7082 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:25.992695 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2697/5366] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:26.051157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4116f-c62d-44f5-820e-511ac2927cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:26.051916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4116f-c62d-44f5-820e-511ac2927cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:26.052257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4116f-c62d-44f5-820e-511ac2927cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:26.053553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4116f-c62d-44f5-820e-511ac2927cb7 admin admin] PATH_INFO: `/v3/projects/07213ca67c6a4616babc77d721d2cae5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:26.055987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4116f-c62d-44f5-820e-511ac2927cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07213ca67c6a4616babc77d721d2cae5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:26.061062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4116f-c62d-44f5-820e-511ac2927cb7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:26.136719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d7e4116f-c62d-44f5-820e-511ac2927cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07213ca67c6a4616babc77d721d2cae5', 'request_id': 'req-d7e4116f-c62d-44f5-820e-511ac2927cb7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:26.146467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d7e4116f-c62d-44f5-820e-511ac2927cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07213ca67c6a4616babc77d721d2cae5', 'request_id': 'req-d7e4116f-c62d-44f5-820e-511ac2927cb7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:26.172359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d7e4116f-c62d-44f5-820e-511ac2927cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07213ca67c6a4616babc77d721d2cae5', 'request_id': 'req-d7e4116f-c62d-44f5-820e-511ac2927cb7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:26.198517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d7e4116f-c62d-44f5-820e-511ac2927cb7 admin admin] The token cache is being invalidate because project 07213ca67c6a4616babc77d721d2cae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:26.198812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d7e4116f-c62d-44f5-820e-511ac2927cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:26.200092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d7e4116f-c62d-44f5-820e-511ac2927cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:26.202968 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2670/5367] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:25 2022] DELETE /identity/v3/projects/07213ca67c6a4616babc77d721d2cae5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:26.207491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7f4ac-c253-4dfb-b804-1f31b4a11e45 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:26.207781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7f4ac-c253-4dfb-b804-1f31b4a11e45 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:26.208061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7f4ac-c253-4dfb-b804-1f31b4a11e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:26.247393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9cf7f4ac-c253-4dfb-b804-1f31b4a11e45 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:26.248646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9cf7f4ac-c253-4dfb-b804-1f31b4a11e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:26.427150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607c608-e8ce-4f54-8765-c8b7c45cf4fd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:26.427476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607c608-e8ce-4f54-8765-c8b7c45cf4fd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:26.427784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607c608-e8ce-4f54-8765-c8b7c45cf4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:26.437398 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2698/5368] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:26.476450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6607c608-e8ce-4f54-8765-c8b7c45cf4fd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:26.477810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6607c608-e8ce-4f54-8765-c8b7c45cf4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:26.508804 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2671/5369] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:26.513413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7f4ac-c253-4dfb-b804-1f31b4a11e45 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:26.536494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7f4ac-c253-4dfb-b804-1f31b4a11e45 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:26.568833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2bc1d-0ad2-437e-a7aa-fc7ff3ade59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:26.569431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2bc1d-0ad2-437e-a7aa-fc7ff3ade59b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:26.569744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2bc1d-0ad2-437e-a7aa-fc7ff3ade59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:26.570074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2bc1d-0ad2-437e-a7aa-fc7ff3ade59b admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:26.570776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2bc1d-0ad2-437e-a7aa-fc7ff3ade59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:26.571164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2bc1d-0ad2-437e-a7aa-fc7ff3ade59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:26.572923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2bc1d-0ad2-437e-a7aa-fc7ff3ade59b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:26.588861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607c608-e8ce-4f54-8765-c8b7c45cf4fd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:26.590254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6607c608-e8ce-4f54-8765-c8b7c45cf4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:26.616139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607c608-e8ce-4f54-8765-c8b7c45cf4fd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:26.624287 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2699/5370] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:26.625037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2bc1d-0ad2-437e-a7aa-fc7ff3ade59b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:26.638295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0107e-6422-43cf-aad6-9d357abf1511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:26.638978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0107e-6422-43cf-aad6-9d357abf1511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:26.639263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0107e-6422-43cf-aad6-9d357abf1511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:26.639534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0107e-6422-43cf-aad6-9d357abf1511 admin admin] PATH_INFO: `/v3/projects/52b69abc93834deab1280fe3ba9fa97c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:26.640758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0107e-6422-43cf-aad6-9d357abf1511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b69abc93834deab1280fe3ba9fa97c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:26.642679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0107e-6422-43cf-aad6-9d357abf1511 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:26.655892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2bc1d-0ad2-437e-a7aa-fc7ff3ade59b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:26.683532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132f45c-fe6c-4146-a9e0-f74e50fd2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:26.684482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132f45c-fe6c-4146-a9e0-f74e50fd2dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:26.684975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132f45c-fe6c-4146-a9e0-f74e50fd2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:26.685431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132f45c-fe6c-4146-a9e0-f74e50fd2dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:26.686255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132f45c-fe6c-4146-a9e0-f74e50fd2dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:26.689903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132f45c-fe6c-4146-a9e0-f74e50fd2dd0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:26.691364 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:26.781826 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2700/5371] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:26 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:26.785951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132f45c-fe6c-4146-a9e0-f74e50fd2dd0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:26.811430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bda0107e-6422-43cf-aad6-9d357abf1511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b69abc93834deab1280fe3ba9fa97c', 'request_id': 'req-bda0107e-6422-43cf-aad6-9d357abf1511'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:26.826456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bda0107e-6422-43cf-aad6-9d357abf1511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b69abc93834deab1280fe3ba9fa97c', 'request_id': 'req-bda0107e-6422-43cf-aad6-9d357abf1511'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:26.848420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bda0107e-6422-43cf-aad6-9d357abf1511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b69abc93834deab1280fe3ba9fa97c', 'request_id': 'req-bda0107e-6422-43cf-aad6-9d357abf1511'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:26.875399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bda0107e-6422-43cf-aad6-9d357abf1511 admin admin] The token cache is being invalidate because project 52b69abc93834deab1280fe3ba9fa97c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:26.875669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bda0107e-6422-43cf-aad6-9d357abf1511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:26.876846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bda0107e-6422-43cf-aad6-9d357abf1511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:26.878386 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2672/5372] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:26 2022] DELETE /identity/v3/projects/52b69abc93834deab1280fe3ba9fa97c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:26.883268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb777-1844-498c-8240-90779f313e15 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:26.883559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb777-1844-498c-8240-90779f313e15 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:26.883818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb777-1844-498c-8240-90779f313e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:26.922134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-467cb777-1844-498c-8240-90779f313e15 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:26.923320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-467cb777-1844-498c-8240-90779f313e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:27.012542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132f45c-fe6c-4146-a9e0-f74e50fd2dd0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:27.032937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c51572-91bc-48a7-b780-68ea3d08c87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:27.032937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c51572-91bc-48a7-b780-68ea3d08c87f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:27.035071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c51572-91bc-48a7-b780-68ea3d08c87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:27.035520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c51572-91bc-48a7-b780-68ea3d08c87f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:27.036478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c51572-91bc-48a7-b780-68ea3d08c87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:27.040831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c51572-91bc-48a7-b780-68ea3d08c87f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:27.055916 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2673/5373] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:26:27.063622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270855f8-fb6e-463a-8a63-ae1f791e3fbb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:27.063909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270855f8-fb6e-463a-8a63-ae1f791e3fbb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:27.064465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270855f8-fb6e-463a-8a63-ae1f791e3fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:27.091743 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:27.105282 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2701/5374] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:26 2022] POST /identity/v3/users => generated 287 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:27.106326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c51572-91bc-48a7-b780-68ea3d08c87f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:27.107974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-270855f8-fb6e-463a-8a63-ae1f791e3fbb None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:27.109242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-270855f8-fb6e-463a-8a63-ae1f791e3fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:27.110185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-65c51572-91bc-48a7-b780-68ea3d08c87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:27.133070 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2674/5375] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:27.137336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270855f8-fb6e-463a-8a63-ae1f791e3fbb None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:27.139983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c51572-91bc-48a7-b780-68ea3d08c87f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:27.156199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270855f8-fb6e-463a-8a63-ae1f791e3fbb None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:27.160498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7e04d-dd26-4815-9a8b-f2ebea1ac3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:27.161261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7e04d-dd26-4815-9a8b-f2ebea1ac3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:27.161639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7e04d-dd26-4815-9a8b-f2ebea1ac3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:27.162573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7e04d-dd26-4815-9a8b-f2ebea1ac3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:27.164953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7e04d-dd26-4815-9a8b-f2ebea1ac3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:27.169565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7e04d-dd26-4815-9a8b-f2ebea1ac3e0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:27.170610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3306dd6-5250-4414-9d4f-af062e297ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:27.171269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3306dd6-5250-4414-9d4f-af062e297ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:27.171550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3306dd6-5250-4414-9d4f-af062e297ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:27.171819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3306dd6-5250-4414-9d4f-af062e297ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:27.172586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3306dd6-5250-4414-9d4f-af062e297ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:27.172820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3306dd6-5250-4414-9d4f-af062e297ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:27.176608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3306dd6-5250-4414-9d4f-af062e297ce0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:27.195381 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2675/5376] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:27.201318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3306dd6-5250-4414-9d4f-af062e297ce0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:27.201652 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2702/5377] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:27.202580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7e04d-dd26-4815-9a8b-f2ebea1ac3e0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:27.212839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3306dd6-5250-4414-9d4f-af062e297ce0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:27.218815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b739a-620b-4d8f-882e-dbd2bd9716cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:27.219776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b739a-620b-4d8f-882e-dbd2bd9716cc admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:27.220065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b739a-620b-4d8f-882e-dbd2bd9716cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:27.220336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b739a-620b-4d8f-882e-dbd2bd9716cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:27.221027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b739a-620b-4d8f-882e-dbd2bd9716cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:27.225109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b739a-620b-4d8f-882e-dbd2bd9716cc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:27.232262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7e04d-dd26-4815-9a8b-f2ebea1ac3e0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:27.249747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed55bf1-d221-44aa-b59d-7d060ed2c176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:27.251245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed55bf1-d221-44aa-b59d-7d060ed2c176 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:27.251993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed55bf1-d221-44aa-b59d-7d060ed2c176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:27.258319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed55bf1-d221-44aa-b59d-7d060ed2c176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:27.259338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed55bf1-d221-44aa-b59d-7d060ed2c176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:27.268763 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2676/5378] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:27 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:27.269464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed55bf1-d221-44aa-b59d-7d060ed2c176 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:27.270296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b739a-620b-4d8f-882e-dbd2bd9716cc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:27.305183 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2703/5379] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:27.309520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed55bf1-d221-44aa-b59d-7d060ed2c176 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:27.327027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed55bf1-d221-44aa-b59d-7d060ed2c176 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:27.447743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b739a-620b-4d8f-882e-dbd2bd9716cc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:27.484337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048e84b-b946-4387-882a-9241ab370d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:27.484870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048e84b-b946-4387-882a-9241ab370d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:27.485156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048e84b-b946-4387-882a-9241ab370d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:27.485577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048e84b-b946-4387-882a-9241ab370d36 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:27.486207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048e84b-b946-4387-882a-9241ab370d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:27.488321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048e84b-b946-4387-882a-9241ab370d36 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:27.510909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3c762-625a-45ba-9ccd-fa16ad557e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:27.511711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3c762-625a-45ba-9ccd-fa16ad557e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:27.512008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3c762-625a-45ba-9ccd-fa16ad557e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:27.512288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3c762-625a-45ba-9ccd-fa16ad557e9a admin admin] PATH_INFO: `/v3/projects/e0ad8ba45c374500b4224168c73793b8/users/fe6f97cacf104ff19ada4bc7e4fe0e01/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:27.525315 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:27.553682 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2677/5380] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:27 2022] POST /identity/v3/users => generated 284 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:27.554108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3c762-625a-45ba-9ccd-fa16ad557e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ad8ba45c374500b4224168c73793b8, user_id=fe6f97cacf104ff19ada4bc7e4fe0e01, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:27.559078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3c762-625a-45ba-9ccd-fa16ad557e9a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:27.559302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048e84b-b946-4387-882a-9241ab370d36 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:27.582248 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2704/5381] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:27 2022] PUT /identity/v3/projects/e0ad8ba45c374500b4224168c73793b8/users/fe6f97cacf104ff19ada4bc7e4fe0e01/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:27.584489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43c1fd-e239-45f1-a870-e223f7a1108c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:27.584800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43c1fd-e239-45f1-a870-e223f7a1108c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:27.585178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43c1fd-e239-45f1-a870-e223f7a1108c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:27.588878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048e84b-b946-4387-882a-9241ab370d36 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:27.613293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8e43c1fd-e239-45f1-a870-e223f7a1108c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:27.615965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8e43c1fd-e239-45f1-a870-e223f7a1108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:27.719608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bd186-01ee-4857-9c8a-87d0deb4db04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:27.722586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bd186-01ee-4857-9c8a-87d0deb4db04 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:27.723457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bd186-01ee-4857-9c8a-87d0deb4db04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:27.723813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bd186-01ee-4857-9c8a-87d0deb4db04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:27.725108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bd186-01ee-4857-9c8a-87d0deb4db04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:27.727512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bd186-01ee-4857-9c8a-87d0deb4db04 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:27.744362 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2705/5382] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:27.747253 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2678/5383] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:27.750851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43c1fd-e239-45f1-a870-e223f7a1108c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:27.769219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43c1fd-e239-45f1-a870-e223f7a1108c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:27.775880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3750743-078c-4246-a387-fdb34914c57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:27.776561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750743-078c-4246-a387-fdb34914c57b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:27.776712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bd186-01ee-4857-9c8a-87d0deb4db04 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:27.776986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750743-078c-4246-a387-fdb34914c57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:27.777261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750743-078c-4246-a387-fdb34914c57b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:27.777906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3750743-078c-4246-a387-fdb34914c57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:27.781821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-036bd186-01ee-4857-9c8a-87d0deb4db04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:27.789025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3750743-078c-4246-a387-fdb34914c57b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:27.805913 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2706/5384] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:26:27.807343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3750743-078c-4246-a387-fdb34914c57b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:27.827831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3750743-078c-4246-a387-fdb34914c57b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:27.837391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a43690-7b83-4f9a-8b1b-9c4083348856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:27.846467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a43690-7b83-4f9a-8b1b-9c4083348856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:27.853823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a43690-7b83-4f9a-8b1b-9c4083348856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:27.854172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a43690-7b83-4f9a-8b1b-9c4083348856 admin admin] PATH_INFO: `/v3/projects/0346c9f7481043c6b8e96fc15f1b7a9f/users/2bead60df7354729a4e818b2ca13f79d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:27.877606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a43690-7b83-4f9a-8b1b-9c4083348856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0346c9f7481043c6b8e96fc15f1b7a9f, user_id=2bead60df7354729a4e818b2ca13f79d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:27.880956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a43690-7b83-4f9a-8b1b-9c4083348856 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:27.938852 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2707/5385] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:27 2022] PUT /identity/v3/projects/0346c9f7481043c6b8e96fc15f1b7a9f/users/2bead60df7354729a4e818b2ca13f79d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:26:27.950765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279450d-6c69-4e21-8a67-cadf9f85fabb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:27.951088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279450d-6c69-4e21-8a67-cadf9f85fabb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:27.951364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279450d-6c69-4e21-8a67-cadf9f85fabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:27.964012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bd186-01ee-4857-9c8a-87d0deb4db04 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:27.997654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0279450d-6c69-4e21-8a67-cadf9f85fabb None None] MFA Rules not processed for user `2bead60df7354729a4e818b2ca13f79d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:27.998906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0279450d-6c69-4e21-8a67-cadf9f85fabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:28.014752 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:28.082615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b239a0-222e-4134-b103-25574429e2be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:28.083440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b239a0-222e-4134-b103-25574429e2be service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:28.083722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b239a0-222e-4134-b103-25574429e2be service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:28.084554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b239a0-222e-4134-b103-25574429e2be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:28.160439 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2708/5386] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:28.166024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279450d-6c69-4e21-8a67-cadf9f85fabb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:28.176630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279450d-6c69-4e21-8a67-cadf9f85fabb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:28.181623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737792c-2cce-4858-a00a-63923f501b77 tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bead60df7354729a4e818b2ca13f79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0346c9f7481043c6b8e96fc15f1b7a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:28.182408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737792c-2cce-4858-a00a-63923f501b77 tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:28.182570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737792c-2cce-4858-a00a-63923f501b77 tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:28.182770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737792c-2cce-4858-a00a-63923f501b77 tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] PATH_INFO: `/v3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:28.188993 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2709/5387] 10.222.0.39 () {58 vars in 1104 bytes} [Sun Oct 16 01:26:28 2022] GET /identity/v3 => generated 255 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:26:28.190357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737792c-2cce-4858-a00a-63923f501b77 tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:28.216191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737792c-2cce-4858-a00a-63923f501b77 tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:28.221330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28f0c8-958f-4563-b357-e64a337cd43f tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bead60df7354729a4e818b2ca13f79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0346c9f7481043c6b8e96fc15f1b7a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:28.221939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28f0c8-958f-4563-b357-e64a337cd43f tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:28.222372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28f0c8-958f-4563-b357-e64a337cd43f tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:28.222504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28f0c8-958f-4563-b357-e64a337cd43f tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] PATH_INFO: `/v3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:28.224050 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2710/5388] 10.222.0.39 () {58 vars in 1104 bytes} [Sun Oct 16 01:26:28 2022] GET /identity/v3 => generated 255 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:28.229012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28f0c8-958f-4563-b357-e64a337cd43f tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:28.230186 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:28.244338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28f0c8-958f-4563-b357-e64a337cd43f tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:28.254354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7806b-9ae4-4a68-92c9-b963d9677bc3 tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bead60df7354729a4e818b2ca13f79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0346c9f7481043c6b8e96fc15f1b7a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:28.255053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7806b-9ae4-4a68-92c9-b963d9677bc3 tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:28.255285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7806b-9ae4-4a68-92c9-b963d9677bc3 tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:28.255559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7806b-9ae4-4a68-92c9-b963d9677bc3 tempest-TestApiDiscovery-922262743 tempest-TestApiDiscovery-922262743-project] PATH_INFO: `/v3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:28.261595 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2711/5389] 10.222.0.39 () {58 vars in 1104 bytes} [Sun Oct 16 01:26:28 2022] GET /identity/v3 => generated 255 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:28.263174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af9e8f-242d-4845-a614-d4a49901ab37 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:28.263463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af9e8f-242d-4845-a614-d4a49901ab37 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:28.263820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af9e8f-242d-4845-a614-d4a49901ab37 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:28.266048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b239a0-222e-4134-b103-25574429e2be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:28.268756 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2712/5390] 10.222.0.39 () {56 vars in 895 bytes} [Sun Oct 16 01:26:28 2022] GET /identity/ => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:26:28.270229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cba51d-7f20-43be-bc49-57d0aac374db None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:28.270535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cba51d-7f20-43be-bc49-57d0aac374db None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:28.270889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cba51d-7f20-43be-bc49-57d0aac374db None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:28.273558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b239a0-222e-4134-b103-25574429e2be service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:28.278767 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2713/5391] 10.222.0.39 () {56 vars in 895 bytes} [Sun Oct 16 01:26:28 2022] GET /identity/ => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:26:28.283913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cba51d-7f20-43be-bc49-57d0aac374db None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:28.291652 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2679/5392] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:28.306692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cba51d-7f20-43be-bc49-57d0aac374db None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:28.312165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:28.312951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:28.313229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:28.313897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] PATH_INFO: `/v3/users/2bead60df7354729a4e818b2ca13f79d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:28.316319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bead60df7354729a4e818b2ca13f79d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:28.319946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:28.403870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bead60df7354729a4e818b2ca13f79d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:28.404738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bead60df7354729a4e818b2ca13f79d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:28.424076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bead60df7354729a4e818b2ca13f79d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:28.441023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bead60df7354729a4e818b2ca13f79d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:28.441667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bead60df7354729a4e818b2ca13f79d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:28.461416 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2714/5393] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:28 2022] DELETE /identity/v3/users/2bead60df7354729a4e818b2ca13f79d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:28.465936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc335-ec88-4b2c-bf87-8af501c4de2f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:28.466217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc335-ec88-4b2c-bf87-8af501c4de2f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:28.466517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc335-ec88-4b2c-bf87-8af501c4de2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:28.512150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9f4bc335-ec88-4b2c-bf87-8af501c4de2f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:28.513377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9f4bc335-ec88-4b2c-bf87-8af501c4de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:28.656655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:28.657733 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2680/5394] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:28.660368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:28.685111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bc335-ec88-4b2c-bf87-8af501c4de2f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:28.686644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9f4bc335-ec88-4b2c-bf87-8af501c4de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:28.705380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be547c2c-3558-4e12-a2b0-af5f91a70fd6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:28.717977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:28.718791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:28.719155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:28.719431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] PATH_INFO: `/v3/users/c6a775085a174d51a19beaa02cb1d4e1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:28.723922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a775085a174d51a19beaa02cb1d4e1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:28.726850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:28.815046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bc335-ec88-4b2c-bf87-8af501c4de2f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:28.837139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3caa8-a671-48e1-995d-8e83b457e3c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:28.838483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3caa8-a671-48e1-995d-8e83b457e3c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:28.838804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3caa8-a671-48e1-995d-8e83b457e3c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:28.840201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3caa8-a671-48e1-995d-8e83b457e3c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:28.851681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a775085a174d51a19beaa02cb1d4e1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:28.855175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a775085a174d51a19beaa02cb1d4e1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:28.866676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3caa8-a671-48e1-995d-8e83b457e3c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:28.870083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3caa8-a671-48e1-995d-8e83b457e3c2 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:28.884422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a775085a174d51a19beaa02cb1d4e1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:28.888973 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:28.894043 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2681/5395] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:26:28.902124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a775085a174d51a19beaa02cb1d4e1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:28.904494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a775085a174d51a19beaa02cb1d4e1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:28.931672 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2715/5396] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:28 2022] DELETE /identity/v3/users/c6a775085a174d51a19beaa02cb1d4e1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:26:28.936136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74222b-74d5-4591-bc72-4e01cb32a3a4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:28.936425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74222b-74d5-4591-bc72-4e01cb32a3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:28.936689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74222b-74d5-4591-bc72-4e01cb32a3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:28.964130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1d74222b-74d5-4591-bc72-4e01cb32a3a4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:28.965428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1d74222b-74d5-4591-bc72-4e01cb32a3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:29.066754 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2682/5397] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:29.081775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:29.084535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:29.202931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911c668-8baa-44c8-a621-46efa3ae6caf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:29.217199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447b045-343f-4e55-906d-a0789bfee3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:29.217828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b045-343f-4e55-906d-a0789bfee3bc service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:29.218286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b045-343f-4e55-906d-a0789bfee3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:29.218694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b045-343f-4e55-906d-a0789bfee3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:29.261833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447b045-343f-4e55-906d-a0789bfee3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:29.264453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447b045-343f-4e55-906d-a0789bfee3bc service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:29.299059 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2716/5398] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:29.651003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74222b-74d5-4591-bc72-4e01cb32a3a4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:29.653289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1d74222b-74d5-4591-bc72-4e01cb32a3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:29.667620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74222b-74d5-4591-bc72-4e01cb32a3a4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:29.673893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:29.675002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:29.675167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:29.675401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd admin admin] PATH_INFO: `/v3/projects/0346c9f7481043c6b8e96fc15f1b7a9f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:29.676584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0346c9f7481043c6b8e96fc15f1b7a9f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:29.679451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:29.775961 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:29.826528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0346c9f7481043c6b8e96fc15f1b7a9f', 'request_id': 'req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:29.857708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0346c9f7481043c6b8e96fc15f1b7a9f', 'request_id': 'req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:29.868992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0346c9f7481043c6b8e96fc15f1b7a9f', 'request_id': 'req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:29.893735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd admin admin] The token cache is being invalidate because project 0346c9f7481043c6b8e96fc15f1b7a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:29.894647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:29.896021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-36bac41e-53cb-417e-bfa5-1e0c5e72fbfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:29.903450 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2683/5399] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:29 2022] DELETE /identity/v3/projects/0346c9f7481043c6b8e96fc15f1b7a9f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:29.906475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a51f32-6840-4435-8e1a-af0ade356e80 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:29.910614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a51f32-6840-4435-8e1a-af0ade356e80 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:29.917109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a51f32-6840-4435-8e1a-af0ade356e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:29.957995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-59a51f32-6840-4435-8e1a-af0ade356e80 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:29.960021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-59a51f32-6840-4435-8e1a-af0ade356e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:30.059299 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2717/5400] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:30.062633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21645-abf4-41ec-b389-496e4f72845f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:30.063126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21645-abf4-41ec-b389-496e4f72845f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:30.063238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21645-abf4-41ec-b389-496e4f72845f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:30.113664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b8e21645-abf4-41ec-b389-496e4f72845f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:30.115345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b8e21645-abf4-41ec-b389-496e4f72845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:30.139748 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2684/5401] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:30.143726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a51f32-6840-4435-8e1a-af0ade356e80 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:30.157764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a51f32-6840-4435-8e1a-af0ade356e80 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:30.168957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d891d67-d7e7-4d49-9cbd-a6e7d5ce857d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:30.170137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d891d67-d7e7-4d49-9cbd-a6e7d5ce857d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:30.171108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d891d67-d7e7-4d49-9cbd-a6e7d5ce857d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:30.171553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d891d67-d7e7-4d49-9cbd-a6e7d5ce857d admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:30.172487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d891d67-d7e7-4d49-9cbd-a6e7d5ce857d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:30.173970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d891d67-d7e7-4d49-9cbd-a6e7d5ce857d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:30.177326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d891d67-d7e7-4d49-9cbd-a6e7d5ce857d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:30.214226 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2718/5402] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:30.215111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21645-abf4-41ec-b389-496e4f72845f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:30.227731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21645-abf4-41ec-b389-496e4f72845f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:30.254421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3295c-d53b-4893-9ce6-b442f52c1b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:30.256300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3295c-d53b-4893-9ce6-b442f52c1b00 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:30.256735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3295c-d53b-4893-9ce6-b442f52c1b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:30.257066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3295c-d53b-4893-9ce6-b442f52c1b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:30.258068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3295c-d53b-4893-9ce6-b442f52c1b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:30.260517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3295c-d53b-4893-9ce6-b442f52c1b00 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:30.319522 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2685/5403] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:30 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:30.324143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d891d67-d7e7-4d49-9cbd-a6e7d5ce857d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:30.337679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d891d67-d7e7-4d49-9cbd-a6e7d5ce857d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:30.381709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3295c-d53b-4893-9ce6-b442f52c1b00 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:30.385035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b1e3295c-d53b-4893-9ce6-b442f52c1b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:30.487827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169a5ec-5277-4340-95f3-cd650f9a1262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:30.499395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169a5ec-5277-4340-95f3-cd650f9a1262 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:30.502665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3295c-d53b-4893-9ce6-b442f52c1b00 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:30.502858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169a5ec-5277-4340-95f3-cd650f9a1262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:30.504067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169a5ec-5277-4340-95f3-cd650f9a1262 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:30.505118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169a5ec-5277-4340-95f3-cd650f9a1262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:30.509779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169a5ec-5277-4340-95f3-cd650f9a1262 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:30.519108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:30.520098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:30.520572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:30.521049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] PATH_INFO: `/v3/projects/fbc7f530006f435ea19a30255ca10eef` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:30.525672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc7f530006f435ea19a30255ca10eef)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:30.527983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:30.545940 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2719/5404] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:30 2022] POST /identity/v3/users => generated 296 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:30.550844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169a5ec-5277-4340-95f3-cd650f9a1262 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:30.564514 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:30.570765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169a5ec-5277-4340-95f3-cd650f9a1262 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:30.579375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0197a83-f7e3-441d-9f56-6898c5345aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:30.580058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0197a83-f7e3-441d-9f56-6898c5345aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:30.580570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0197a83-f7e3-441d-9f56-6898c5345aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:30.581072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0197a83-f7e3-441d-9f56-6898c5345aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:30.581941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0197a83-f7e3-441d-9f56-6898c5345aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:30.585382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0197a83-f7e3-441d-9f56-6898c5345aa8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:30.600632 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2720/5405] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:26:30.604404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0197a83-f7e3-441d-9f56-6898c5345aa8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:30.621657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0197a83-f7e3-441d-9f56-6898c5345aa8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:30.638236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc7f530006f435ea19a30255ca10eef', 'request_id': 'req-886898c9-7e95-4d49-90eb-de7de1d8c11a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:30.651998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc7f530006f435ea19a30255ca10eef', 'request_id': 'req-886898c9-7e95-4d49-90eb-de7de1d8c11a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:30.674284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc7f530006f435ea19a30255ca10eef', 'request_id': 'req-886898c9-7e95-4d49-90eb-de7de1d8c11a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:30.692296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] The token cache is being invalidate because project fbc7f530006f435ea19a30255ca10eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:30.692588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:30.693897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:30.699031 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2686/5406] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:30 2022] DELETE /identity/v3/projects/fbc7f530006f435ea19a30255ca10eef => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:26:30.702524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:30.704690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:30.761138 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:30.781350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d7461-a653-4fb8-ab4f-fe4d305be6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:30.782790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d7461-a653-4fb8-ab4f-fe4d305be6ef admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:30.783111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d7461-a653-4fb8-ab4f-fe4d305be6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:30.783385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d7461-a653-4fb8-ab4f-fe4d305be6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:30.784304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d7461-a653-4fb8-ab4f-fe4d305be6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:30.791474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d7461-a653-4fb8-ab4f-fe4d305be6ef admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:30.823971 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2721/5407] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:30.825816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d7461-a653-4fb8-ab4f-fe4d305be6ef admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:30.829700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d18d7461-a653-4fb8-ab4f-fe4d305be6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:30.871137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d7461-a653-4fb8-ab4f-fe4d305be6ef admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:30.883957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886898c9-7e95-4d49-90eb-de7de1d8c11a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:30.887177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ae484-bf17-419a-a003-e1d0fd8cd6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:30.888046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ae484-bf17-419a-a003-e1d0fd8cd6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:30.888541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ae484-bf17-419a-a003-e1d0fd8cd6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:30.888973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ae484-bf17-419a-a003-e1d0fd8cd6cd admin admin] PATH_INFO: `/v3/projects/56e483f281a844c9b62f5520ae688f3d/users/b59d3354067344658d409d45d985cd34/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:30.900000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:30.901322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:30.901322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:30.924606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] PATH_INFO: `/v3/users/953b1f75a5574a9f9a2580349f00cba6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:30.925344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ae484-bf17-419a-a003-e1d0fd8cd6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e483f281a844c9b62f5520ae688f3d, user_id=b59d3354067344658d409d45d985cd34, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:30.930045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=953b1f75a5574a9f9a2580349f00cba6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:30.932951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ae484-bf17-419a-a003-e1d0fd8cd6cd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:30.935692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:30.988683 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2722/5408] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:30 2022] PUT /identity/v3/projects/56e483f281a844c9b62f5520ae688f3d/users/b59d3354067344658d409d45d985cd34/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:30.999801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a58fa-982f-476e-afea-91b6276eb9a0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:30.999801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a58fa-982f-476e-afea-91b6276eb9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:31.000171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a58fa-982f-476e-afea-91b6276eb9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:31.043695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953b1f75a5574a9f9a2580349f00cba6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:31.044679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953b1f75a5574a9f9a2580349f00cba6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:31.050779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-223a58fa-982f-476e-afea-91b6276eb9a0 None None] MFA Rules not processed for user `b59d3354067344658d409d45d985cd34`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:31.053077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-223a58fa-982f-476e-afea-91b6276eb9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:31.061784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953b1f75a5574a9f9a2580349f00cba6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:31.091941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953b1f75a5574a9f9a2580349f00cba6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:31.093500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953b1f75a5574a9f9a2580349f00cba6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:31.124909 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2687/5409] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:30 2022] DELETE /identity/v3/users/953b1f75a5574a9f9a2580349f00cba6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:31.192623 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2723/5410] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:31.193229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:31.194872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:31.379996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a28ff-ddbf-4953-99b2-1fc6e1656b25 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:31.386005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f67cf-2568-4c04-9587-676d1902bbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:31.386787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f67cf-2568-4c04-9587-676d1902bbe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:31.387098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f67cf-2568-4c04-9587-676d1902bbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:31.387369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f67cf-2568-4c04-9587-676d1902bbe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:31.388008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f67cf-2568-4c04-9587-676d1902bbe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:31.390103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f67cf-2568-4c04-9587-676d1902bbe0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:31.436406 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2688/5411] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:31 2022] POST /identity/v3/projects => generated 391 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:31.439485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a58fa-982f-476e-afea-91b6276eb9a0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:31.576199 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:31.588617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a58fa-982f-476e-afea-91b6276eb9a0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:31.677108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603023a-9b2a-49cb-95c9-255f5661d64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:31.678116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603023a-9b2a-49cb-95c9-255f5661d64b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:31.679912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603023a-9b2a-49cb-95c9-255f5661d64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:31.680681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603023a-9b2a-49cb-95c9-255f5661d64b admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:31.681598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603023a-9b2a-49cb-95c9-255f5661d64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:31.685671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603023a-9b2a-49cb-95c9-255f5661d64b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:31.720203 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2724/5412] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:31 2022] POST /identity/v3/users => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:31.723685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f67cf-2568-4c04-9587-676d1902bbe0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:31.737653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f67cf-2568-4c04-9587-676d1902bbe0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:31.744168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba8c3f-237c-49d4-8daf-d6f31638b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:31.745646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba8c3f-237c-49d4-8daf-d6f31638b076 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:31.746151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba8c3f-237c-49d4-8daf-d6f31638b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:31.746814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba8c3f-237c-49d4-8daf-d6f31638b076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:31.749266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba8c3f-237c-49d4-8daf-d6f31638b076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:31.779470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba8c3f-237c-49d4-8daf-d6f31638b076 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:31.793630 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2689/5413] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:26:31.798778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603023a-9b2a-49cb-95c9-255f5661d64b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:31.812940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603023a-9b2a-49cb-95c9-255f5661d64b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:31.821003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79227b9f-e3a2-4976-8aaa-261c8aa68606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:31.821776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79227b9f-e3a2-4976-8aaa-261c8aa68606 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:31.822056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79227b9f-e3a2-4976-8aaa-261c8aa68606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:31.822413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79227b9f-e3a2-4976-8aaa-261c8aa68606 admin admin] PATH_INFO: `/v3/projects/ce25232b63544795a9318ffb2d3ad8f5/users/33172207a0f345b38ed66bdf61f6b11c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:31.843954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79227b9f-e3a2-4976-8aaa-261c8aa68606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce25232b63544795a9318ffb2d3ad8f5, user_id=33172207a0f345b38ed66bdf61f6b11c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:31.847889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79227b9f-e3a2-4976-8aaa-261c8aa68606 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:31.868690 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2725/5414] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:31 2022] PUT /identity/v3/projects/ce25232b63544795a9318ffb2d3ad8f5/users/33172207a0f345b38ed66bdf61f6b11c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:26:31.872303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba8c3f-237c-49d4-8daf-d6f31638b076 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:31.886587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba8c3f-237c-49d4-8daf-d6f31638b076 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:31.919960 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:31.999367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74bb1d-ade7-4e61-b89b-40eb9a0709f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:32.000130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74bb1d-ade7-4e61-b89b-40eb9a0709f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:32.000415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74bb1d-ade7-4e61-b89b-40eb9a0709f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:32.000735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74bb1d-ade7-4e61-b89b-40eb9a0709f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:32.001484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74bb1d-ade7-4e61-b89b-40eb9a0709f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:32.003417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74bb1d-ade7-4e61-b89b-40eb9a0709f6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:32.020960 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2690/5415] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:32.023031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79227b9f-e3a2-4976-8aaa-261c8aa68606 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:32.044383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79227b9f-e3a2-4976-8aaa-261c8aa68606 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:32.053935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75beab1b-ce8b-4701-bd02-90c27686c1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:32.054668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beab1b-ce8b-4701-bd02-90c27686c1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:32.057236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beab1b-ce8b-4701-bd02-90c27686c1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:32.057753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beab1b-ce8b-4701-bd02-90c27686c1ef admin admin] PATH_INFO: `/v3/projects/ce25232b63544795a9318ffb2d3ad8f5/users/33172207a0f345b38ed66bdf61f6b11c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:32.061626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75beab1b-ce8b-4701-bd02-90c27686c1ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce25232b63544795a9318ffb2d3ad8f5, user_id=33172207a0f345b38ed66bdf61f6b11c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:32.070717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75beab1b-ce8b-4701-bd02-90c27686c1ef admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:32.095648 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2726/5416] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:32 2022] PUT /identity/v3/projects/ce25232b63544795a9318ffb2d3ad8f5/users/33172207a0f345b38ed66bdf61f6b11c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:32.110456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc246718-49e3-484f-b4dc-333df2f5d5ec None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:32.110943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc246718-49e3-484f-b4dc-333df2f5d5ec None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:32.111562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc246718-49e3-484f-b4dc-333df2f5d5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:32.116161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75beab1b-ce8b-4701-bd02-90c27686c1ef admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:32.118780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-75beab1b-ce8b-4701-bd02-90c27686c1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:32.188409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cc246718-49e3-484f-b4dc-333df2f5d5ec None None] MFA Rules not processed for user `33172207a0f345b38ed66bdf61f6b11c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:32.189888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cc246718-49e3-484f-b4dc-333df2f5d5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:32.233049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75beab1b-ce8b-4701-bd02-90c27686c1ef admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:32.252846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:32.254151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:32.254676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:32.255217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] PATH_INFO: `/v3/users/a3ac1408c91c4db59f4639abdca2c98f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:32.257353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ac1408c91c4db59f4639abdca2c98f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:32.261050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:32.357090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ac1408c91c4db59f4639abdca2c98f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:32.358214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ac1408c91c4db59f4639abdca2c98f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:32.381326 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:32.396438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ac1408c91c4db59f4639abdca2c98f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:32.408678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ac1408c91c4db59f4639abdca2c98f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:32.409521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ac1408c91c4db59f4639abdca2c98f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:32.432536 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2691/5417] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:32.434339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4de551-403d-4e9c-ba3b-bfba124c2f47 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:32.438452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4de551-403d-4e9c-ba3b-bfba124c2f47 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:32.438733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4de551-403d-4e9c-ba3b-bfba124c2f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:32.449943 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2727/5418] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:32 2022] DELETE /identity/v3/users/a3ac1408c91c4db59f4639abdca2c98f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:32.450942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:32.460676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:32.561628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7b4de551-403d-4e9c-ba3b-bfba124c2f47 None None] MFA Rules not processed for user `bd16fd0aeb6b4914846b60f87f953344`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:32.561628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b4de551-403d-4e9c-ba3b-bfba124c2f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:32.617489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655ccff-4c3f-4e7a-8508-8e1769443980 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:32.630528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643ce0c-947a-4275-b279-d07123112833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:32.631782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643ce0c-947a-4275-b279-d07123112833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:32.632068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643ce0c-947a-4275-b279-d07123112833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:32.633966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643ce0c-947a-4275-b279-d07123112833 admin admin] PATH_INFO: `/v3/projects/dae6df8f51c145f8a035d96887196ecd` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:32.637921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643ce0c-947a-4275-b279-d07123112833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae6df8f51c145f8a035d96887196ecd)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:32.641630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643ce0c-947a-4275-b279-d07123112833 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:32.744782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0643ce0c-947a-4275-b279-d07123112833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae6df8f51c145f8a035d96887196ecd', 'request_id': 'req-0643ce0c-947a-4275-b279-d07123112833'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:32.760680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0643ce0c-947a-4275-b279-d07123112833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae6df8f51c145f8a035d96887196ecd', 'request_id': 'req-0643ce0c-947a-4275-b279-d07123112833'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:32.776502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0643ce0c-947a-4275-b279-d07123112833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae6df8f51c145f8a035d96887196ecd', 'request_id': 'req-0643ce0c-947a-4275-b279-d07123112833'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:32.777773 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2692/5419] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:32.779213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4de551-403d-4e9c-ba3b-bfba124c2f47 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:32.783348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b4de551-403d-4e9c-ba3b-bfba124c2f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:32.814050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0643ce0c-947a-4275-b279-d07123112833 admin admin] The token cache is being invalidate because project dae6df8f51c145f8a035d96887196ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:32.814356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0643ce0c-947a-4275-b279-d07123112833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:32.815075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0643ce0c-947a-4275-b279-d07123112833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:32.818021 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2728/5420] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:32 2022] DELETE /identity/v3/projects/dae6df8f51c145f8a035d96887196ecd => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:32.825705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c38bf-5590-4ef7-9305-efcd82a27c66 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:32.825998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c38bf-5590-4ef7-9305-efcd82a27c66 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:32.826277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c38bf-5590-4ef7-9305-efcd82a27c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:32.879121 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:32.881478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b25c38bf-5590-4ef7-9305-efcd82a27c66 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:32.885369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b25c38bf-5590-4ef7-9305-efcd82a27c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:32.923722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4de551-403d-4e9c-ba3b-bfba124c2f47 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:33.009579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439db06-e429-47d0-a29b-0865964fd3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:33.010717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439db06-e429-47d0-a29b-0865964fd3ff service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:33.011066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439db06-e429-47d0-a29b-0865964fd3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:33.011440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439db06-e429-47d0-a29b-0865964fd3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:33.014164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e439db06-e429-47d0-a29b-0865964fd3ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:33.030245 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2729/5421] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:33.031321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c38bf-5590-4ef7-9305-efcd82a27c66 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:33.032624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b25c38bf-5590-4ef7-9305-efcd82a27c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:33.045049 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:33.049665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c38bf-5590-4ef7-9305-efcd82a27c66 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:33.063960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd1098-abb6-4ed9-b168-74418894bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:33.064871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd1098-abb6-4ed9-b168-74418894bcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:33.065089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd1098-abb6-4ed9-b168-74418894bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:33.065361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd1098-abb6-4ed9-b168-74418894bcb1 admin admin] PATH_INFO: `/v3/projects/b0304839bb0f444a9786183ba8b4e446` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:33.067298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd1098-abb6-4ed9-b168-74418894bcb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0304839bb0f444a9786183ba8b4e446)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:33.069444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd1098-abb6-4ed9-b168-74418894bcb1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:33.140663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439db06-e429-47d0-a29b-0865964fd3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:33.140663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439db06-e429-47d0-a29b-0865964fd3ff service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:33.182350 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2693/5422] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:33.188090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c3cd1098-abb6-4ed9-b168-74418894bcb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0304839bb0f444a9786183ba8b4e446', 'request_id': 'req-c3cd1098-abb6-4ed9-b168-74418894bcb1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:33.197138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7835328-cd9f-49b2-b0e7-9fb6c5e2fdf6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:33.197422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7835328-cd9f-49b2-b0e7-9fb6c5e2fdf6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:33.197697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7835328-cd9f-49b2-b0e7-9fb6c5e2fdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:33.202213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c3cd1098-abb6-4ed9-b168-74418894bcb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0304839bb0f444a9786183ba8b4e446', 'request_id': 'req-c3cd1098-abb6-4ed9-b168-74418894bcb1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:33.219006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c3cd1098-abb6-4ed9-b168-74418894bcb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0304839bb0f444a9786183ba8b4e446', 'request_id': 'req-c3cd1098-abb6-4ed9-b168-74418894bcb1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:33.243229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a7835328-cd9f-49b2-b0e7-9fb6c5e2fdf6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:33.244461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a7835328-cd9f-49b2-b0e7-9fb6c5e2fdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:33.250754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c3cd1098-abb6-4ed9-b168-74418894bcb1 admin admin] The token cache is being invalidate because project b0304839bb0f444a9786183ba8b4e446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:33.253406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c3cd1098-abb6-4ed9-b168-74418894bcb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:33.257547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c3cd1098-abb6-4ed9-b168-74418894bcb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:33.262125 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2730/5423] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:33 2022] DELETE /identity/v3/projects/b0304839bb0f444a9786183ba8b4e446 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:33.265196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35fb26-d0a8-4027-b660-e0b48d1ef1ed None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:33.265548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35fb26-d0a8-4027-b660-e0b48d1ef1ed None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:33.266511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35fb26-d0a8-4027-b660-e0b48d1ef1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:33.320219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4f35fb26-d0a8-4027-b660-e0b48d1ef1ed None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:33.323805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4f35fb26-d0a8-4027-b660-e0b48d1ef1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:33.384293 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2694/5424] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:33.389436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7835328-cd9f-49b2-b0e7-9fb6c5e2fdf6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:33.438706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7835328-cd9f-49b2-b0e7-9fb6c5e2fdf6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:33.454688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b8a0-0719-4b67-9473-b8ba424c763e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:33.456142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b8a0-0719-4b67-9473-b8ba424c763e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:33.456422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b8a0-0719-4b67-9473-b8ba424c763e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:33.457093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b8a0-0719-4b67-9473-b8ba424c763e admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:33.457852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b8a0-0719-4b67-9473-b8ba424c763e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:33.458181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b8a0-0719-4b67-9473-b8ba424c763e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:33.468165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b8a0-0719-4b67-9473-b8ba424c763e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:33.495626 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2695/5425] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:33.497538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b8a0-0719-4b67-9473-b8ba424c763e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:33.503653 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2731/5426] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:33.512862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b0527-10d3-4195-a956-268f0196efa1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:33.513560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b0527-10d3-4195-a956-268f0196efa1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:33.514245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b0527-10d3-4195-a956-268f0196efa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:33.525267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b8a0-0719-4b67-9473-b8ba424c763e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:33.536813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f766fb8-1db4-4a57-8722-cb42eb7b289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:33.538216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f766fb8-1db4-4a57-8722-cb42eb7b289b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:33.538216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f766fb8-1db4-4a57-8722-cb42eb7b289b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:33.538432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f766fb8-1db4-4a57-8722-cb42eb7b289b admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:33.539632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f766fb8-1db4-4a57-8722-cb42eb7b289b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:33.541343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f766fb8-1db4-4a57-8722-cb42eb7b289b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:33.561777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-359b0527-10d3-4195-a956-268f0196efa1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:33.564553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-359b0527-10d3-4195-a956-268f0196efa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:33.589536 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2732/5427] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:26:33.591656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b0527-10d3-4195-a956-268f0196efa1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:33.602253 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:33.613146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b0527-10d3-4195-a956-268f0196efa1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:33.621548 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2696/5428] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:33 2022] POST /identity/v3/projects => generated 397 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:33.622905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f766fb8-1db4-4a57-8722-cb42eb7b289b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:33.727620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bdf27-e69a-48bb-88fd-7d25dd0669d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:33.729365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bdf27-e69a-48bb-88fd-7d25dd0669d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:33.729648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bdf27-e69a-48bb-88fd-7d25dd0669d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:33.730486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bdf27-e69a-48bb-88fd-7d25dd0669d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:33.730828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bdf27-e69a-48bb-88fd-7d25dd0669d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:33.731180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bdf27-e69a-48bb-88fd-7d25dd0669d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:33.733795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bdf27-e69a-48bb-88fd-7d25dd0669d8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:33.752331 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2733/5429] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:33.758304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bdf27-e69a-48bb-88fd-7d25dd0669d8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:33.769246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f766fb8-1db4-4a57-8722-cb42eb7b289b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:33.776258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c674a7-1d99-454f-9676-b33772a0ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:33.777485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c674a7-1d99-454f-9676-b33772a0ce49 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:33.778395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c674a7-1d99-454f-9676-b33772a0ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:33.778998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c674a7-1d99-454f-9676-b33772a0ce49 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:33.779849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c674a7-1d99-454f-9676-b33772a0ce49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:33.782189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c674a7-1d99-454f-9676-b33772a0ce49 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:33.784267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bdf27-e69a-48bb-88fd-7d25dd0669d8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:33.796570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ccd45-e083-4101-96e1-05902ac34269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:33.796778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ccd45-e083-4101-96e1-05902ac34269 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:33.796999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ccd45-e083-4101-96e1-05902ac34269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:33.798865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ccd45-e083-4101-96e1-05902ac34269 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:33.799900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ccd45-e083-4101-96e1-05902ac34269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:33.812823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ccd45-e083-4101-96e1-05902ac34269 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:33.824575 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2697/5430] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:33 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:33.828366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c674a7-1d99-454f-9676-b33772a0ce49 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:33.858909 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:33.862589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c674a7-1d99-454f-9676-b33772a0ce49 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:33.881896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b4f4-1393-4c03-b647-1ffdbdf4c39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:33.883248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b4f4-1393-4c03-b647-1ffdbdf4c39a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:33.892973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b4f4-1393-4c03-b647-1ffdbdf4c39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:33.895009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b4f4-1393-4c03-b647-1ffdbdf4c39a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:33.895992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b4f4-1393-4c03-b647-1ffdbdf4c39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:33.899818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b4f4-1393-4c03-b647-1ffdbdf4c39a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:33.904829 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2734/5431] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:33 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:33.908653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ccd45-e083-4101-96e1-05902ac34269 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:33.930037 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2698/5432] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:33.934259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b4f4-1393-4c03-b647-1ffdbdf4c39a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:33.958336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b4f4-1393-4c03-b647-1ffdbdf4c39a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:34.046421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ccd45-e083-4101-96e1-05902ac34269 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:34.061166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a630388-2c6a-4d49-9c58-41228ed790dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:34.061860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a630388-2c6a-4d49-9c58-41228ed790dd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:34.062145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a630388-2c6a-4d49-9c58-41228ed790dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:34.062435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a630388-2c6a-4d49-9c58-41228ed790dd admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:34.063099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a630388-2c6a-4d49-9c58-41228ed790dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:34.065044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a630388-2c6a-4d49-9c58-41228ed790dd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:34.115601 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2735/5433] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:33 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:34.119872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a630388-2c6a-4d49-9c58-41228ed790dd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:34.149403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a630388-2c6a-4d49-9c58-41228ed790dd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:34.157406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a60c6-6bf7-47b3-a86c-eff51dab6e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:34.158978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165bbf4-63b5-4c5a-8948-a4e730202c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:34.159125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a60c6-6bf7-47b3-a86c-eff51dab6e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:34.159601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165bbf4-63b5-4c5a-8948-a4e730202c00 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:34.159877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165bbf4-63b5-4c5a-8948-a4e730202c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:34.160145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165bbf4-63b5-4c5a-8948-a4e730202c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:34.160713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a60c6-6bf7-47b3-a86c-eff51dab6e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:34.160864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165bbf4-63b5-4c5a-8948-a4e730202c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:34.161041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a60c6-6bf7-47b3-a86c-eff51dab6e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:34.161704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a60c6-6bf7-47b3-a86c-eff51dab6e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:34.163998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165bbf4-63b5-4c5a-8948-a4e730202c00 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:34.167843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a60c6-6bf7-47b3-a86c-eff51dab6e87 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:34.196372 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2736/5434] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:34.199709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165bbf4-63b5-4c5a-8948-a4e730202c00 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:34.201490 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2699/5435] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:34.206894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a60c6-6bf7-47b3-a86c-eff51dab6e87 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:34.218313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165bbf4-63b5-4c5a-8948-a4e730202c00 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:34.224721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410b774-ddae-4410-9e77-6caee3e88faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:34.225686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b774-ddae-4410-9e77-6caee3e88faa admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:34.225915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a60c6-6bf7-47b3-a86c-eff51dab6e87 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:34.226304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b774-ddae-4410-9e77-6caee3e88faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:34.226736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b774-ddae-4410-9e77-6caee3e88faa admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:34.228377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410b774-ddae-4410-9e77-6caee3e88faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:34.230202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410b774-ddae-4410-9e77-6caee3e88faa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:34.244835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140078a-6ae1-415b-ac2d-ff87656aae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:34.245536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140078a-6ae1-415b-ac2d-ff87656aae4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:34.245817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140078a-6ae1-415b-ac2d-ff87656aae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:34.246091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140078a-6ae1-415b-ac2d-ff87656aae4d admin admin] PATH_INFO: `/v3/projects/5a378b67fde14fc4867b4b9143abbfcf/users/a206e426d3e74c04a2248e2410a152c6/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:34.263214 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2737/5436] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:26:34.269336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410b774-ddae-4410-9e77-6caee3e88faa admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:34.284395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140078a-6ae1-415b-ac2d-ff87656aae4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a378b67fde14fc4867b4b9143abbfcf, user_id=a206e426d3e74c04a2248e2410a152c6, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:34.288959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410b774-ddae-4410-9e77-6caee3e88faa admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:34.294727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140078a-6ae1-415b-ac2d-ff87656aae4d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:34.305251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa3418-661b-46ea-b5e2-bf519d4c88e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:34.306575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa3418-661b-46ea-b5e2-bf519d4c88e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:34.307194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa3418-661b-46ea-b5e2-bf519d4c88e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:34.307930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa3418-661b-46ea-b5e2-bf519d4c88e0 admin admin] PATH_INFO: `/v3/projects/3eaf7d9670874e5d92db84283b262d57/users/04fa49711754440c9e889ad13dc4d7d3/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:34.323509 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2700/5437] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:34 2022] PUT /identity/v3/projects/5a378b67fde14fc4867b4b9143abbfcf/users/a206e426d3e74c04a2248e2410a152c6/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:34.335521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1983b1d-83ff-4c02-8126-5f16422129ca None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:34.335521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1983b1d-83ff-4c02-8126-5f16422129ca None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:34.335789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1983b1d-83ff-4c02-8126-5f16422129ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:34.336682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa3418-661b-46ea-b5e2-bf519d4c88e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eaf7d9670874e5d92db84283b262d57, user_id=04fa49711754440c9e889ad13dc4d7d3, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:34.343762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa3418-661b-46ea-b5e2-bf519d4c88e0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:34.371174 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2738/5438] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:34 2022] PUT /identity/v3/projects/3eaf7d9670874e5d92db84283b262d57/users/04fa49711754440c9e889ad13dc4d7d3/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:34.378304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be46d2-10c9-4ba4-a4a9-7202d943e545 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:34.381491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be46d2-10c9-4ba4-a4a9-7202d943e545 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:34.381491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be46d2-10c9-4ba4-a4a9-7202d943e545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:34.388289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f1983b1d-83ff-4c02-8126-5f16422129ca None None] MFA Rules not processed for user `a206e426d3e74c04a2248e2410a152c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:34.389527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f1983b1d-83ff-4c02-8126-5f16422129ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:34.432631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-13be46d2-10c9-4ba4-a4a9-7202d943e545 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:34.436619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-13be46d2-10c9-4ba4-a4a9-7202d943e545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:34.451651 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:34.498964 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2701/5439] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:26:34.561194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1983b1d-83ff-4c02-8126-5f16422129ca None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:34.563411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f1983b1d-83ff-4c02-8126-5f16422129ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:34.630491 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2739/5440] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:34.643339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be46d2-10c9-4ba4-a4a9-7202d943e545 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:34.644767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-13be46d2-10c9-4ba4-a4a9-7202d943e545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:34.691365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1983b1d-83ff-4c02-8126-5f16422129ca None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:34.705431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f253c2-5c31-4ebb-930a-e9ff47a13a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:34.706061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f253c2-5c31-4ebb-930a-e9ff47a13a7f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:34.706333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f253c2-5c31-4ebb-930a-e9ff47a13a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:34.706618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f253c2-5c31-4ebb-930a-e9ff47a13a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:34.730316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f253c2-5c31-4ebb-930a-e9ff47a13a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:34.734247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f253c2-5c31-4ebb-930a-e9ff47a13a7f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:34.744855 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:34.766947 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2702/5441] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:26:34.781501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be46d2-10c9-4ba4-a4a9-7202d943e545 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:34.787576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccaa53-06ab-4397-898c-bd67cfec6656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:34.788409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccaa53-06ab-4397-898c-bd67cfec6656 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:34.788749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccaa53-06ab-4397-898c-bd67cfec6656 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:34.789083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccaa53-06ab-4397-898c-bd67cfec6656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:34.804725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccaa53-06ab-4397-898c-bd67cfec6656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:34.809437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccaa53-06ab-4397-898c-bd67cfec6656 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:34.822727 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2740/5442] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:37.919159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f253c2-5c31-4ebb-930a-e9ff47a13a7f service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:37.929518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f253c2-5c31-4ebb-930a-e9ff47a13a7f service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:37.945509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dd985-664f-4555-9998-4af7b03af8cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:37.946238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dd985-664f-4555-9998-4af7b03af8cd service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:37.946943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dd985-664f-4555-9998-4af7b03af8cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:37.947315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dd985-664f-4555-9998-4af7b03af8cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:37.954101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-062dd985-664f-4555-9998-4af7b03af8cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:38.159776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dd985-664f-4555-9998-4af7b03af8cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:38.163986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dd985-664f-4555-9998-4af7b03af8cd service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:38.191403 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2703/5443] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:40.517642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb73583-3383-4907-90fb-ba8a339121b8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:40.518197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb73583-3383-4907-90fb-ba8a339121b8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:40.518380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb73583-3383-4907-90fb-ba8a339121b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:40.602292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6eb73583-3383-4907-90fb-ba8a339121b8 None None] MFA Rules not processed for user `fe6f97cacf104ff19ada4bc7e4fe0e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:40.605269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6eb73583-3383-4907-90fb-ba8a339121b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:40.730498 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2741/5444] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:40.741650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f94078-491c-46c3-9fd0-25cebc4d09bf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:40.742271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f94078-491c-46c3-9fd0-25cebc4d09bf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:40.742271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f94078-491c-46c3-9fd0-25cebc4d09bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:40.789236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-46f94078-491c-46c3-9fd0-25cebc4d09bf None None] MFA Rules not processed for user `fe6f97cacf104ff19ada4bc7e4fe0e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:40.790466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-46f94078-491c-46c3-9fd0-25cebc4d09bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:40.809324 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2704/5445] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:26:40.821981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb73583-3383-4907-90fb-ba8a339121b8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:40.824003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6eb73583-3383-4907-90fb-ba8a339121b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:40.989124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb73583-3383-4907-90fb-ba8a339121b8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:41.008480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec882bc-3ebc-4278-9f98-3dd88bf48315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:41.009115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec882bc-3ebc-4278-9f98-3dd88bf48315 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:41.009392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec882bc-3ebc-4278-9f98-3dd88bf48315 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:41.009661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec882bc-3ebc-4278-9f98-3dd88bf48315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:41.025307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec882bc-3ebc-4278-9f98-3dd88bf48315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:41.027347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec882bc-3ebc-4278-9f98-3dd88bf48315 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:41.050183 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2742/5446] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:42.118357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f94078-491c-46c3-9fd0-25cebc4d09bf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:42.120564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-46f94078-491c-46c3-9fd0-25cebc4d09bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:42.316433 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:42.321045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f94078-491c-46c3-9fd0-25cebc4d09bf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:42.329142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6c860-74d4-4941-97e6-2138bcde38ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:42.330243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6c860-74d4-4941-97e6-2138bcde38ef service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:42.331188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6c860-74d4-4941-97e6-2138bcde38ef service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:42.331684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6c860-74d4-4941-97e6-2138bcde38ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:42.335735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bca6c860-74d4-4941-97e6-2138bcde38ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:42.353789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6c860-74d4-4941-97e6-2138bcde38ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:42.356152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6c860-74d4-4941-97e6-2138bcde38ef service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:42.405897 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2705/5447] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:44.184336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec882bc-3ebc-4278-9f98-3dd88bf48315 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:44.187296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0ec882bc-3ebc-4278-9f98-3dd88bf48315 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:44.222101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec882bc-3ebc-4278-9f98-3dd88bf48315 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:44.242124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d02a5b-fb09-4a35-b24e-3b28fb176b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:44.242943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d02a5b-fb09-4a35-b24e-3b28fb176b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:44.243219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d02a5b-fb09-4a35-b24e-3b28fb176b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:44.243515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d02a5b-fb09-4a35-b24e-3b28fb176b77 admin admin] PATH_INFO: `/v3/users/bd16fd0aeb6b4914846b60f87f953344` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:44.245397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d02a5b-fb09-4a35-b24e-3b28fb176b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd16fd0aeb6b4914846b60f87f953344)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:44.280915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d02a5b-fb09-4a35-b24e-3b28fb176b77 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:44.460638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a0d02a5b-fb09-4a35-b24e-3b28fb176b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd16fd0aeb6b4914846b60f87f953344'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:44.470502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a0d02a5b-fb09-4a35-b24e-3b28fb176b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd16fd0aeb6b4914846b60f87f953344'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:44.476135 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:44.582139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a0d02a5b-fb09-4a35-b24e-3b28fb176b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd16fd0aeb6b4914846b60f87f953344'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:44.594957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a0d02a5b-fb09-4a35-b24e-3b28fb176b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd16fd0aeb6b4914846b60f87f953344'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:44.595829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a0d02a5b-fb09-4a35-b24e-3b28fb176b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd16fd0aeb6b4914846b60f87f953344'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:44.659029 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2743/5448] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:44 2022] DELETE /identity/v3/users/bd16fd0aeb6b4914846b60f87f953344 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:26:45.071648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6c860-74d4-4941-97e6-2138bcde38ef service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:45.087834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bca6c860-74d4-4941-97e6-2138bcde38ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:45.124866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6c860-74d4-4941-97e6-2138bcde38ef service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:45.268085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:45.269061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:45.269978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:45.270475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] PATH_INFO: `/v3/users/b59d3354067344658d409d45d985cd34` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:45.273581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59d3354067344658d409d45d985cd34)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:45.275880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:45.406096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59d3354067344658d409d45d985cd34'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:45.407193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59d3354067344658d409d45d985cd34'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:45.436855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59d3354067344658d409d45d985cd34'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:45.450773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59d3354067344658d409d45d985cd34'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:45.451577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59d3354067344658d409d45d985cd34'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:45.481560 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2706/5449] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:45 2022] DELETE /identity/v3/users/b59d3354067344658d409d45d985cd34 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:45.486807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd65c4e-477a-45bb-b5c9-9fa5e04a2f84 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:45.487883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd65c4e-477a-45bb-b5c9-9fa5e04a2f84 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:45.488440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd65c4e-477a-45bb-b5c9-9fa5e04a2f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:45.528618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5dd65c4e-477a-45bb-b5c9-9fa5e04a2f84 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:45.531042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5dd65c4e-477a-45bb-b5c9-9fa5e04a2f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:45.684836 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2744/5450] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:45.700132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:45.702211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:45.723449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd65c4e-477a-45bb-b5c9-9fa5e04a2f84 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:45.725632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5dd65c4e-477a-45bb-b5c9-9fa5e04a2f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:45.745317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd65c4e-477a-45bb-b5c9-9fa5e04a2f84 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:45.760834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f80c2-62e4-4ac1-b575-556e15cc9358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:45.761488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f80c2-62e4-4ac1-b575-556e15cc9358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:45.761894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f80c2-62e4-4ac1-b575-556e15cc9358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:45.762237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f80c2-62e4-4ac1-b575-556e15cc9358 admin admin] PATH_INFO: `/v3/projects/b1bfe4e657aa42b589e76d574fc48b02` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:45.774539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f80c2-62e4-4ac1-b575-556e15cc9358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1bfe4e657aa42b589e76d574fc48b02)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:45.776679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f80c2-62e4-4ac1-b575-556e15cc9358 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:45.842904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28641472-f3f4-44d5-8eed-22b6b076c525 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:45.854907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12086b42-f353-4c6a-af10-3fc332632cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:45.855748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12086b42-f353-4c6a-af10-3fc332632cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:45.856032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12086b42-f353-4c6a-af10-3fc332632cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:45.858129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12086b42-f353-4c6a-af10-3fc332632cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:45.873461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-756f80c2-62e4-4ac1-b575-556e15cc9358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1bfe4e657aa42b589e76d574fc48b02', 'request_id': 'req-756f80c2-62e4-4ac1-b575-556e15cc9358'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:45.887593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12086b42-f353-4c6a-af10-3fc332632cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:45.898012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-756f80c2-62e4-4ac1-b575-556e15cc9358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1bfe4e657aa42b589e76d574fc48b02', 'request_id': 'req-756f80c2-62e4-4ac1-b575-556e15cc9358'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:45.905322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12086b42-f353-4c6a-af10-3fc332632cc9 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:45.925357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-756f80c2-62e4-4ac1-b575-556e15cc9358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1bfe4e657aa42b589e76d574fc48b02', 'request_id': 'req-756f80c2-62e4-4ac1-b575-556e15cc9358'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:45.941614 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2707/5451] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:26:45.945599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-756f80c2-62e4-4ac1-b575-556e15cc9358 admin admin] The token cache is being invalidate because project b1bfe4e657aa42b589e76d574fc48b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:45.945898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-756f80c2-62e4-4ac1-b575-556e15cc9358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:45.947302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-756f80c2-62e4-4ac1-b575-556e15cc9358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:45.956319 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2745/5452] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:45 2022] DELETE /identity/v3/projects/b1bfe4e657aa42b589e76d574fc48b02 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:45.962287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225b6a-75e2-495d-af22-f1567a38faca None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:45.962687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225b6a-75e2-495d-af22-f1567a38faca None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:45.963762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225b6a-75e2-495d-af22-f1567a38faca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:46.023375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3b225b6a-75e2-495d-af22-f1567a38faca None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:46.024819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b225b6a-75e2-495d-af22-f1567a38faca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:46.049989 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:46.194470 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2708/5453] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:46.202178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55aef5-fff0-4f58-bcf6-8c4bf45edeca None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:46.202967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55aef5-fff0-4f58-bcf6-8c4bf45edeca None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:46.202967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55aef5-fff0-4f58-bcf6-8c4bf45edeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:46.256785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5b55aef5-fff0-4f58-bcf6-8c4bf45edeca None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:46.258152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5b55aef5-fff0-4f58-bcf6-8c4bf45edeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:46.280401 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2746/5454] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:46.285943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b225b6a-75e2-495d-af22-f1567a38faca None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:46.315428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b225b6a-75e2-495d-af22-f1567a38faca None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:46.325635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70807de4-da29-48ca-bb81-cd6634549b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:46.326602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70807de4-da29-48ca-bb81-cd6634549b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:46.327091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70807de4-da29-48ca-bb81-cd6634549b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:46.327599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70807de4-da29-48ca-bb81-cd6634549b28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:46.328440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70807de4-da29-48ca-bb81-cd6634549b28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:46.328919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70807de4-da29-48ca-bb81-cd6634549b28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:46.331024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70807de4-da29-48ca-bb81-cd6634549b28 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:46.345922 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2709/5455] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:26:46.350399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55aef5-fff0-4f58-bcf6-8c4bf45edeca None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:46.366678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55aef5-fff0-4f58-bcf6-8c4bf45edeca None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:46.377677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5742514-79d1-4b6f-b719-b0755dd4291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:46.378538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5742514-79d1-4b6f-b719-b0755dd4291e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:46.378825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5742514-79d1-4b6f-b719-b0755dd4291e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:46.379185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5742514-79d1-4b6f-b719-b0755dd4291e admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:46.379982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5742514-79d1-4b6f-b719-b0755dd4291e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:46.382093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5742514-79d1-4b6f-b719-b0755dd4291e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:46.432993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70807de4-da29-48ca-bb81-cd6634549b28 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:46.436182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-70807de4-da29-48ca-bb81-cd6634549b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:46.460307 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2747/5456] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:46 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:46.460986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70807de4-da29-48ca-bb81-cd6634549b28 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:46.464526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5742514-79d1-4b6f-b719-b0755dd4291e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:46.515409 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:46.602083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5742514-79d1-4b6f-b719-b0755dd4291e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:46.619628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a57f6-b722-4963-995a-d9c7d2ce9579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:46.619998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:46.620630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a57f6-b722-4963-995a-d9c7d2ce9579 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:46.620809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:46.621083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:46.621397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] PATH_INFO: `/v3/projects/56e483f281a844c9b62f5520ae688f3d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:46.621548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a57f6-b722-4963-995a-d9c7d2ce9579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:46.623077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a57f6-b722-4963-995a-d9c7d2ce9579 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:46.623821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a57f6-b722-4963-995a-d9c7d2ce9579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:46.626406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e483f281a844c9b62f5520ae688f3d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:46.628411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a57f6-b722-4963-995a-d9c7d2ce9579 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:46.629013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:46.697393 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2748/5457] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:46 2022] POST /identity/v3/users => generated 302 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:46.699893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a57f6-b722-4963-995a-d9c7d2ce9579 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:46.707422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e483f281a844c9b62f5520ae688f3d', 'request_id': 'req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:46.715796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e483f281a844c9b62f5520ae688f3d', 'request_id': 'req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:46.726717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e483f281a844c9b62f5520ae688f3d', 'request_id': 'req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:46.735231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a57f6-b722-4963-995a-d9c7d2ce9579 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:46.752839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] The token cache is being invalidate because project 56e483f281a844c9b62f5520ae688f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:46.753136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:46.755763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:46.772311 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2710/5458] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:46 2022] DELETE /identity/v3/projects/56e483f281a844c9b62f5520ae688f3d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:46.776230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:46.779684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:46.886639 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:46.928012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b2950-26ef-4877-b5b3-4b827b4fdb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:46.928641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2950-26ef-4877-b5b3-4b827b4fdb4e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:46.928988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2950-26ef-4877-b5b3-4b827b4fdb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:46.929268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2950-26ef-4877-b5b3-4b827b4fdb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:46.936728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b2950-26ef-4877-b5b3-4b827b4fdb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:46.941655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b2950-26ef-4877-b5b3-4b827b4fdb4e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:46.975619 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2749/5459] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:46.979746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b2950-26ef-4877-b5b3-4b827b4fdb4e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:46.982493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f64b2950-26ef-4877-b5b3-4b827b4fdb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:46.999683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdb93c-9ed4-4648-bb95-d43e26e182e0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:47.007497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:47.008163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:47.008441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:47.008714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] PATH_INFO: `/v3/users/33172207a0f345b38ed66bdf61f6b11c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:47.014162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] RBAC: Authorizing `identity:delete_user(user_id=33172207a0f345b38ed66bdf61f6b11c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:47.016453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:47.023307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b2950-26ef-4877-b5b3-4b827b4fdb4e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:47.033591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c47c6-0db1-4f30-91e8-9807ca01d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:47.035411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c47c6-0db1-4f30-91e8-9807ca01d04e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:47.035982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c47c6-0db1-4f30-91e8-9807ca01d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:47.036456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c47c6-0db1-4f30-91e8-9807ca01d04e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:47.039334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c47c6-0db1-4f30-91e8-9807ca01d04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:47.042849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c47c6-0db1-4f30-91e8-9807ca01d04e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:47.060991 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2750/5460] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:47.067080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c47c6-0db1-4f30-91e8-9807ca01d04e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:47.088134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c47c6-0db1-4f30-91e8-9807ca01d04e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:47.097222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e7d8c-8d90-4bbe-bf91-ad5b5b62713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:47.098272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e7d8c-8d90-4bbe-bf91-ad5b5b62713c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:47.098780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e7d8c-8d90-4bbe-bf91-ad5b5b62713c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:47.100239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e7d8c-8d90-4bbe-bf91-ad5b5b62713c admin admin] PATH_INFO: `/v3/projects/9633aa9e525148cb8f73a7f53585719f/users/a15bc9f29cf04fc48a516479a6b1bf6c/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:47.111966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33172207a0f345b38ed66bdf61f6b11c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:47.112729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33172207a0f345b38ed66bdf61f6b11c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:47.129719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e7d8c-8d90-4bbe-bf91-ad5b5b62713c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9633aa9e525148cb8f73a7f53585719f, user_id=a15bc9f29cf04fc48a516479a6b1bf6c, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:47.144763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33172207a0f345b38ed66bdf61f6b11c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:47.144894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e7d8c-8d90-4bbe-bf91-ad5b5b62713c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:47.213121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33172207a0f345b38ed66bdf61f6b11c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:47.216441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33172207a0f345b38ed66bdf61f6b11c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:47.239548 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2751/5461] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:47 2022] PUT /identity/v3/projects/9633aa9e525148cb8f73a7f53585719f/users/a15bc9f29cf04fc48a516479a6b1bf6c/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:47.250227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8931-acb5-4880-b460-ffb7b9801a0c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:47.250541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8931-acb5-4880-b460-ffb7b9801a0c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:47.250812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8931-acb5-4880-b460-ffb7b9801a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:47.279686 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2711/5462] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:46 2022] DELETE /identity/v3/users/33172207a0f345b38ed66bdf61f6b11c => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:47.363499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bdec8931-acb5-4880-b460-ffb7b9801a0c None None] MFA Rules not processed for user `a15bc9f29cf04fc48a516479a6b1bf6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:47.364941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bdec8931-acb5-4880-b460-ffb7b9801a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:47.532792 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2752/5463] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:47 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:26:47.548241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:47.549939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:47.721723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbadf9-ccc6-447b-b7b2-b70a9d1c42db admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:47.727360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:47.727920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:47.728198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:47.728469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] PATH_INFO: `/v3/users/a15bc9f29cf04fc48a516479a6b1bf6c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:47.732106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a15bc9f29cf04fc48a516479a6b1bf6c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:47.733757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:47.838253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a15bc9f29cf04fc48a516479a6b1bf6c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:47.839656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a15bc9f29cf04fc48a516479a6b1bf6c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:47.850277 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:47.864301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a15bc9f29cf04fc48a516479a6b1bf6c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:47.879712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a15bc9f29cf04fc48a516479a6b1bf6c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:47.882689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a15bc9f29cf04fc48a516479a6b1bf6c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:47.955609 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2712/5464] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:47 2022] DELETE /identity/v3/users/a15bc9f29cf04fc48a516479a6b1bf6c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:47.957210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d6e3f-e47f-4521-9c3e-0d5daa93cc74 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:47.957512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d6e3f-e47f-4521-9c3e-0d5daa93cc74 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:47.957775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d6e3f-e47f-4521-9c3e-0d5daa93cc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:47.980724 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:48.019690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3b7d6e3f-e47f-4521-9c3e-0d5daa93cc74 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:48.031913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3b7d6e3f-e47f-4521-9c3e-0d5daa93cc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:48.219519 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2753/5465] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:48.494183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:48.496431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:48.663005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4afc24-b639-4dd8-9f6d-450d53b01fd1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:48.680641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243df4d-431d-4258-aeee-df0c6a1ebaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:48.681281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243df4d-431d-4258-aeee-df0c6a1ebaaa service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:48.681559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243df4d-431d-4258-aeee-df0c6a1ebaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:48.682283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243df4d-431d-4258-aeee-df0c6a1ebaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:48.720449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243df4d-431d-4258-aeee-df0c6a1ebaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:48.721996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243df4d-431d-4258-aeee-df0c6a1ebaaa service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:48.755195 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2713/5466] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:49.030466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d6e3f-e47f-4521-9c3e-0d5daa93cc74 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:49.033335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3b7d6e3f-e47f-4521-9c3e-0d5daa93cc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:49.062404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d6e3f-e47f-4521-9c3e-0d5daa93cc74 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:49.077125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:49.079483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:49.079969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:49.080514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0 admin admin] PATH_INFO: `/v3/projects/ce25232b63544795a9318ffb2d3ad8f5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:49.082257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce25232b63544795a9318ffb2d3ad8f5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:49.086354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:49.159821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758dc93-8ccd-44ff-9ba7-a08829e0a78f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:49.160031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758dc93-8ccd-44ff-9ba7-a08829e0a78f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:49.160302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758dc93-8ccd-44ff-9ba7-a08829e0a78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:49.246948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e758dc93-8ccd-44ff-9ba7-a08829e0a78f None None] MFA Rules not processed for user `04fa49711754440c9e889ad13dc4d7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:49.248797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce25232b63544795a9318ffb2d3ad8f5', 'request_id': 'req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:49.252663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e758dc93-8ccd-44ff-9ba7-a08829e0a78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:49.277057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce25232b63544795a9318ffb2d3ad8f5', 'request_id': 'req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:49.306429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce25232b63544795a9318ffb2d3ad8f5', 'request_id': 'req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:49.352339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0 admin admin] The token cache is being invalidate because project ce25232b63544795a9318ffb2d3ad8f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:49.365909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:49.369643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5f8b1bba-29df-4a60-bbd7-74e47d8453b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:49.377908 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2754/5467] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:49 2022] DELETE /identity/v3/projects/ce25232b63544795a9318ffb2d3ad8f5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:49.379828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d9eeb-46f2-4845-b7e0-f966217f8e19 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:49.380122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d9eeb-46f2-4845-b7e0-f966217f8e19 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:49.380911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d9eeb-46f2-4845-b7e0-f966217f8e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:49.437686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8b6d9eeb-46f2-4845-b7e0-f966217f8e19 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:49.448512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8b6d9eeb-46f2-4845-b7e0-f966217f8e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:49.509032 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2714/5468] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:49.523703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da290-9220-4d75-8633-abeb709e629f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:49.524205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da290-9220-4d75-8633-abeb709e629f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:49.524702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da290-9220-4d75-8633-abeb709e629f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:49.588187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-114da290-9220-4d75-8633-abeb709e629f None None] MFA Rules not processed for user `04fa49711754440c9e889ad13dc4d7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:49.590174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-114da290-9220-4d75-8633-abeb709e629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:49.610862 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2715/5469] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:49.613599 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2755/5470] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:49.623808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61852b9e-3ee2-46e8-962e-faf72e544f6c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:49.623808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61852b9e-3ee2-46e8-962e-faf72e544f6c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:49.623808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61852b9e-3ee2-46e8-962e-faf72e544f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:49.631789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d9eeb-46f2-4845-b7e0-f966217f8e19 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:49.633478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8b6d9eeb-46f2-4845-b7e0-f966217f8e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:49.664554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-61852b9e-3ee2-46e8-962e-faf72e544f6c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:49.665780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-61852b9e-3ee2-46e8-962e-faf72e544f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:49.681872 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2716/5471] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:49.686000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61852b9e-3ee2-46e8-962e-faf72e544f6c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:49.700416 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:49.704135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61852b9e-3ee2-46e8-962e-faf72e544f6c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:49.716630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e343011-0c8e-4811-8b10-f159401a4833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:49.717258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343011-0c8e-4811-8b10-f159401a4833 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:49.717535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343011-0c8e-4811-8b10-f159401a4833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:49.717807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343011-0c8e-4811-8b10-f159401a4833 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:49.718458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e343011-0c8e-4811-8b10-f159401a4833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:49.718759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e343011-0c8e-4811-8b10-f159401a4833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:49.720567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e343011-0c8e-4811-8b10-f159401a4833 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:49.756783 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2717/5472] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:26:49.761171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e343011-0c8e-4811-8b10-f159401a4833 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:49.778429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e343011-0c8e-4811-8b10-f159401a4833 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:49.793376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e2978-b44e-4a64-91f2-350c593785c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:49.794016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e2978-b44e-4a64-91f2-350c593785c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:49.794295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e2978-b44e-4a64-91f2-350c593785c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:49.795246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e2978-b44e-4a64-91f2-350c593785c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:49.795895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e2978-b44e-4a64-91f2-350c593785c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:49.798088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e2978-b44e-4a64-91f2-350c593785c8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:49.829151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d9eeb-46f2-4845-b7e0-f966217f8e19 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:49.851231 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2718/5473] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:49 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:49.855555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e2978-b44e-4a64-91f2-350c593785c8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:49.862593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0ccfe-135a-44ea-95ca-532deb820080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:49.863262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0ccfe-135a-44ea-95ca-532deb820080 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:49.863544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0ccfe-135a-44ea-95ca-532deb820080 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:49.863816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0ccfe-135a-44ea-95ca-532deb820080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:49.886867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0ccfe-135a-44ea-95ca-532deb820080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:49.888523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0ccfe-135a-44ea-95ca-532deb820080 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:49.896217 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:49.925751 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2756/5474] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:50.004076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e2978-b44e-4a64-91f2-350c593785c8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:50.018865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec0b8a-5708-40bd-9257-445f2a7a8810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:50.019742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec0b8a-5708-40bd-9257-445f2a7a8810 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:50.020100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec0b8a-5708-40bd-9257-445f2a7a8810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:50.020452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec0b8a-5708-40bd-9257-445f2a7a8810 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:50.022374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec0b8a-5708-40bd-9257-445f2a7a8810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:50.024841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec0b8a-5708-40bd-9257-445f2a7a8810 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:50.069566 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2719/5475] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:49 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:50.073003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0ccfe-135a-44ea-95ca-532deb820080 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:50.094698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0ccfe-135a-44ea-95ca-532deb820080 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:50.109214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d2232-2e9d-41f5-9fca-6b11b7324128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:50.109830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d2232-2e9d-41f5-9fca-6b11b7324128 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:50.110578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d2232-2e9d-41f5-9fca-6b11b7324128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:50.110860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d2232-2e9d-41f5-9fca-6b11b7324128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:50.113297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d2232-2e9d-41f5-9fca-6b11b7324128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:50.116848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d2232-2e9d-41f5-9fca-6b11b7324128 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:50.145216 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2757/5476] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:50.152036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec0b8a-5708-40bd-9257-445f2a7a8810 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:50.166553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec0b8a-5708-40bd-9257-445f2a7a8810 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:50.175520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d51af-08ad-4120-ac8f-db40b6f2c5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:50.176481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d51af-08ad-4120-ac8f-db40b6f2c5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:50.179154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d51af-08ad-4120-ac8f-db40b6f2c5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:50.180216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d51af-08ad-4120-ac8f-db40b6f2c5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:50.180984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d51af-08ad-4120-ac8f-db40b6f2c5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:50.184149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d51af-08ad-4120-ac8f-db40b6f2c5c5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:50.209891 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2720/5477] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:50.214296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d2232-2e9d-41f5-9fca-6b11b7324128 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:50.232661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d2232-2e9d-41f5-9fca-6b11b7324128 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:50.247261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e41b2-e142-4d91-9945-0cf1abda90ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:50.248049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e41b2-e142-4d91-9945-0cf1abda90ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:50.248452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e41b2-e142-4d91-9945-0cf1abda90ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:50.248827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e41b2-e142-4d91-9945-0cf1abda90ee admin admin] PATH_INFO: `/v3/projects/2a415e9255ed4465aaa8675197529870/users/6996fb89baee4171ac947efb7cbfe145/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:50.292073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e41b2-e142-4d91-9945-0cf1abda90ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a415e9255ed4465aaa8675197529870, user_id=6996fb89baee4171ac947efb7cbfe145, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:50.295785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e41b2-e142-4d91-9945-0cf1abda90ee admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:50.325213 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2758/5478] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:50 2022] PUT /identity/v3/projects/2a415e9255ed4465aaa8675197529870/users/6996fb89baee4171ac947efb7cbfe145/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:50.336382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edffee2-386f-4df5-9f20-7bd8e04f7d82 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:50.337514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edffee2-386f-4df5-9f20-7bd8e04f7d82 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:50.338019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edffee2-386f-4df5-9f20-7bd8e04f7d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:50.428642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3edffee2-386f-4df5-9f20-7bd8e04f7d82 None None] MFA Rules not processed for user `6996fb89baee4171ac947efb7cbfe145`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:50.430260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3edffee2-386f-4df5-9f20-7bd8e04f7d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:50.627753 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2721/5479] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:50.628721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e41b2-e142-4d91-9945-0cf1abda90ee admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:50.801510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e41b2-e142-4d91-9945-0cf1abda90ee admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:50.809114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f31dc9-78fb-45b8-bd8d-ba6570f1f742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:50.809957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f31dc9-78fb-45b8-bd8d-ba6570f1f742 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:50.810126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f31dc9-78fb-45b8-bd8d-ba6570f1f742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:50.810266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f31dc9-78fb-45b8-bd8d-ba6570f1f742 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:50.810894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f31dc9-78fb-45b8-bd8d-ba6570f1f742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:50.813176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f31dc9-78fb-45b8-bd8d-ba6570f1f742 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:50.848683 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2759/5480] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:50 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:50.854226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edffee2-386f-4df5-9f20-7bd8e04f7d82 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:50.872861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edffee2-386f-4df5-9f20-7bd8e04f7d82 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:51.018298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5990eb-694b-4dd8-b483-66ef21ff2e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:51.019207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5990eb-694b-4dd8-b483-66ef21ff2e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:51.019646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5990eb-694b-4dd8-b483-66ef21ff2e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:51.020085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5990eb-694b-4dd8-b483-66ef21ff2e98 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:51.021782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5990eb-694b-4dd8-b483-66ef21ff2e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:51.024237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5990eb-694b-4dd8-b483-66ef21ff2e98 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:51.069454 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2722/5481] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:50 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:51.070709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f31dc9-78fb-45b8-bd8d-ba6570f1f742 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:51.085981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f31dc9-78fb-45b8-bd8d-ba6570f1f742 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:51.101057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bc342-b5be-448e-8c47-7391abb6c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:51.101688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bc342-b5be-448e-8c47-7391abb6c674 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:51.101969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bc342-b5be-448e-8c47-7391abb6c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:51.102242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bc342-b5be-448e-8c47-7391abb6c674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:51.102889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bc342-b5be-448e-8c47-7391abb6c674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:51.104936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bc342-b5be-448e-8c47-7391abb6c674 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:51.135991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5990eb-694b-4dd8-b483-66ef21ff2e98 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:51.147366 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2760/5482] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:51.160512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5990eb-694b-4dd8-b483-66ef21ff2e98 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:51.177059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb54a6b-5ac0-40bc-93a0-adf6a3332e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:51.177800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb54a6b-5ac0-40bc-93a0-adf6a3332e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:51.178073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb54a6b-5ac0-40bc-93a0-adf6a3332e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:51.178642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb54a6b-5ac0-40bc-93a0-adf6a3332e63 admin admin] PATH_INFO: `/v3/projects/a124cc7f399844ba9b31c2af995cd0f9/users/bb93001de49740beab1d1635e033c4e4/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:51.198966 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:51.225889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb54a6b-5ac0-40bc-93a0-adf6a3332e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a124cc7f399844ba9b31c2af995cd0f9, user_id=bb93001de49740beab1d1635e033c4e4, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:51.233233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb54a6b-5ac0-40bc-93a0-adf6a3332e63 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:51.260830 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2723/5483] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:51 2022] PUT /identity/v3/projects/a124cc7f399844ba9b31c2af995cd0f9/users/bb93001de49740beab1d1635e033c4e4/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:26:51.264774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bc342-b5be-448e-8c47-7391abb6c674 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:51.290955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bc342-b5be-448e-8c47-7391abb6c674 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:51.417986 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:51.447194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169dbb9-88af-434c-9aec-61ad443e4a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:51.447973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169dbb9-88af-434c-9aec-61ad443e4a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:51.448316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169dbb9-88af-434c-9aec-61ad443e4a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:51.448544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169dbb9-88af-434c-9aec-61ad443e4a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:51.452554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169dbb9-88af-434c-9aec-61ad443e4a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:51.454418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169dbb9-88af-434c-9aec-61ad443e4a3e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:51.478982 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2761/5484] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:51.484851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb54a6b-5ac0-40bc-93a0-adf6a3332e63 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:51.507569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb54a6b-5ac0-40bc-93a0-adf6a3332e63 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:51.522587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c1265-c63d-4a34-b6db-0a37e6f892f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:51.523571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c1265-c63d-4a34-b6db-0a37e6f892f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:51.524015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c1265-c63d-4a34-b6db-0a37e6f892f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:51.524484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c1265-c63d-4a34-b6db-0a37e6f892f9 admin admin] PATH_INFO: `/v3/projects/a124cc7f399844ba9b31c2af995cd0f9/users/bb93001de49740beab1d1635e033c4e4/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:51.528549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c1265-c63d-4a34-b6db-0a37e6f892f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a124cc7f399844ba9b31c2af995cd0f9, user_id=bb93001de49740beab1d1635e033c4e4, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:51.534134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c1265-c63d-4a34-b6db-0a37e6f892f9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:51.572600 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2724/5485] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:51 2022] PUT /identity/v3/projects/a124cc7f399844ba9b31c2af995cd0f9/users/bb93001de49740beab1d1635e033c4e4/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:51.679515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d80f6-4ca5-4c57-8615-3b64b72bcfce None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:51.679860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d80f6-4ca5-4c57-8615-3b64b72bcfce None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:51.680076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d80f6-4ca5-4c57-8615-3b64b72bcfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:51.777004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e41d80f6-4ca5-4c57-8615-3b64b72bcfce None None] MFA Rules not processed for user `bb93001de49740beab1d1635e033c4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:51.782578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e41d80f6-4ca5-4c57-8615-3b64b72bcfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:52.027033 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2762/5486] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:52.168334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c1265-c63d-4a34-b6db-0a37e6f892f9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:52.172069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f66c1265-c63d-4a34-b6db-0a37e6f892f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:52.194421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d80f6-4ca5-4c57-8615-3b64b72bcfce None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:52.203188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e41d80f6-4ca5-4c57-8615-3b64b72bcfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:52.355058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c1265-c63d-4a34-b6db-0a37e6f892f9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:52.359633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620adfbb-0cf0-4385-8e19-034a4efe1f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:52.360524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620adfbb-0cf0-4385-8e19-034a4efe1f12 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:52.360970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620adfbb-0cf0-4385-8e19-034a4efe1f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:52.361403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620adfbb-0cf0-4385-8e19-034a4efe1f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:52.379110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d80f6-4ca5-4c57-8615-3b64b72bcfce None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:52.393810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:52.394655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:52.395271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:52.396927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad admin admin] PATH_INFO: `/v3/projects/9633aa9e525148cb8f73a7f53585719f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:52.400523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=9633aa9e525148cb8f73a7f53585719f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:52.409173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:52.461625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620adfbb-0cf0-4385-8e19-034a4efe1f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:52.463318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620adfbb-0cf0-4385-8e19-034a4efe1f12 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:52.479780 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2725/5487] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:52.480721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620adfbb-0cf0-4385-8e19-034a4efe1f12 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:52.482439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-620adfbb-0cf0-4385-8e19-034a4efe1f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:52.496615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9633aa9e525148cb8f73a7f53585719f', 'request_id': 'req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:52.518511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9633aa9e525148cb8f73a7f53585719f', 'request_id': 'req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:52.542218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9633aa9e525148cb8f73a7f53585719f', 'request_id': 'req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:52.571407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad admin admin] The token cache is being invalidate because project 9633aa9e525148cb8f73a7f53585719f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:52.571701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:52.572718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1fb1634-352e-4c7e-9c73-50a40b80a4ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:52.574378 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2763/5488] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:52 2022] DELETE /identity/v3/projects/9633aa9e525148cb8f73a7f53585719f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:26:52.581680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d895fc-2ea6-44a9-ac36-ff6fc5b71922 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:52.584733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d895fc-2ea6-44a9-ac36-ff6fc5b71922 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:52.585266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d895fc-2ea6-44a9-ac36-ff6fc5b71922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:52.610164 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:52.640181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620adfbb-0cf0-4385-8e19-034a4efe1f12 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:52.645898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a7d895fc-2ea6-44a9-ac36-ff6fc5b71922 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:52.649602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a7d895fc-2ea6-44a9-ac36-ff6fc5b71922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:52.690128 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:52.790200 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2764/5489] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:26:52.799083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74afff-5495-4943-bcb6-cbd5d00bf538 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:52.799565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781872d5-b40f-4b56-8dc1-343ca93acf2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:52.800095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74afff-5495-4943-bcb6-cbd5d00bf538 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:52.800226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781872d5-b40f-4b56-8dc1-343ca93acf2b service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:52.800613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781872d5-b40f-4b56-8dc1-343ca93acf2b service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:52.800749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74afff-5495-4943-bcb6-cbd5d00bf538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:52.800968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781872d5-b40f-4b56-8dc1-343ca93acf2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:52.806040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-781872d5-b40f-4b56-8dc1-343ca93acf2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:52.835969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0d74afff-5495-4943-bcb6-cbd5d00bf538 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:52.836992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781872d5-b40f-4b56-8dc1-343ca93acf2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:52.838828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781872d5-b40f-4b56-8dc1-343ca93acf2b service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:52.839024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0d74afff-5495-4943-bcb6-cbd5d00bf538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:52.855327 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2765/5490] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:52.860033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74afff-5495-4943-bcb6-cbd5d00bf538 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:52.862317 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2726/5491] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:52.882086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74afff-5495-4943-bcb6-cbd5d00bf538 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:52.900386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fd184-2e94-4f75-81bf-3d5711bdc95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:52.901022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fd184-2e94-4f75-81bf-3d5711bdc95a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:52.901300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fd184-2e94-4f75-81bf-3d5711bdc95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:52.901573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fd184-2e94-4f75-81bf-3d5711bdc95a admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:52.904500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fd184-2e94-4f75-81bf-3d5711bdc95a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:26:52.904500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fd184-2e94-4f75-81bf-3d5711bdc95a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:52.904500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fd184-2e94-4f75-81bf-3d5711bdc95a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:52.936705 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2766/5492] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:26:52.941700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781872d5-b40f-4b56-8dc1-343ca93acf2b service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:52.957952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781872d5-b40f-4b56-8dc1-343ca93acf2b service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:52.965820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97172c8a-c2a7-4a50-9393-f6a59038f1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:52.966440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97172c8a-c2a7-4a50-9393-f6a59038f1af admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:52.966708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97172c8a-c2a7-4a50-9393-f6a59038f1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:52.967013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97172c8a-c2a7-4a50-9393-f6a59038f1af admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:52.967650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97172c8a-c2a7-4a50-9393-f6a59038f1af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:52.970344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97172c8a-c2a7-4a50-9393-f6a59038f1af admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:53.037507 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2727/5493] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:52 2022] POST /identity/v3/projects => generated 403 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:53.041939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fd184-2e94-4f75-81bf-3d5711bdc95a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:53.060265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fd184-2e94-4f75-81bf-3d5711bdc95a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:53.176323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9c974-6757-4fef-b93c-2718af5a6ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:53.176808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9c974-6757-4fef-b93c-2718af5a6ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:53.177097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9c974-6757-4fef-b93c-2718af5a6ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:53.177975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9c974-6757-4fef-b93c-2718af5a6ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:53.178722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9c974-6757-4fef-b93c-2718af5a6ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:53.186527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9c974-6757-4fef-b93c-2718af5a6ec7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:53.227971 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2767/5494] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:53 2022] POST /identity/v3/users => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:53.231853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97172c8a-c2a7-4a50-9393-f6a59038f1af admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:53.244503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97172c8a-c2a7-4a50-9393-f6a59038f1af admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:53.256188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762eb1e-7065-488e-bb67-c1ce9f5d3a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:53.256884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762eb1e-7065-488e-bb67-c1ce9f5d3a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:53.257245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762eb1e-7065-488e-bb67-c1ce9f5d3a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:53.257555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762eb1e-7065-488e-bb67-c1ce9f5d3a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:53.258196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762eb1e-7065-488e-bb67-c1ce9f5d3a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:53.261228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762eb1e-7065-488e-bb67-c1ce9f5d3a18 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:53.286469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9c974-6757-4fef-b93c-2718af5a6ec7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:53.295333 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2728/5495] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:53.303278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9c974-6757-4fef-b93c-2718af5a6ec7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:53.314003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6f9a0-661b-4e69-b0d2-8b9cfdc01b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:53.318363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6f9a0-661b-4e69-b0d2-8b9cfdc01b37 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:53.318533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6f9a0-661b-4e69-b0d2-8b9cfdc01b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:53.318798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6f9a0-661b-4e69-b0d2-8b9cfdc01b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:53.319697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6f9a0-661b-4e69-b0d2-8b9cfdc01b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:53.323545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6f9a0-661b-4e69-b0d2-8b9cfdc01b37 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:53.350686 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2768/5496] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:26:53.356839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762eb1e-7065-488e-bb67-c1ce9f5d3a18 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:53.388748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762eb1e-7065-488e-bb67-c1ce9f5d3a18 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:53.403452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6d15c-6162-4956-977a-610bfc443a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:53.406703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6d15c-6162-4956-977a-610bfc443a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:53.407790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6d15c-6162-4956-977a-610bfc443a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:53.409285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6d15c-6162-4956-977a-610bfc443a5b admin admin] PATH_INFO: `/v3/projects/c60bdba9ac3d41f89652021053498823/users/479315cbe66d4d5bbc19a32ea28fa376/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:53.449958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6d15c-6162-4956-977a-610bfc443a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60bdba9ac3d41f89652021053498823, user_id=479315cbe66d4d5bbc19a32ea28fa376, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:53.467509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6d15c-6162-4956-977a-610bfc443a5b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:53.501516 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2729/5497] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:53 2022] PUT /identity/v3/projects/c60bdba9ac3d41f89652021053498823/users/479315cbe66d4d5bbc19a32ea28fa376/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:53.512676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f718e5d-98a2-40ae-b31f-87e723eaf949 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:53.512972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f718e5d-98a2-40ae-b31f-87e723eaf949 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:53.513800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f718e5d-98a2-40ae-b31f-87e723eaf949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:53.635562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0f718e5d-98a2-40ae-b31f-87e723eaf949 None None] MFA Rules not processed for user `479315cbe66d4d5bbc19a32ea28fa376`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:53.636961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0f718e5d-98a2-40ae-b31f-87e723eaf949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:53.723836 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:53.769867 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2769/5498] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:53.775324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6d15c-6162-4956-977a-610bfc443a5b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:53.921967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6d15c-6162-4956-977a-610bfc443a5b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:53.929648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c881f9e-69a0-41aa-b3ed-acfd2bce8511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:53.930229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881f9e-69a0-41aa-b3ed-acfd2bce8511 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:53.931124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881f9e-69a0-41aa-b3ed-acfd2bce8511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:53.931457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881f9e-69a0-41aa-b3ed-acfd2bce8511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:53.932155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c881f9e-69a0-41aa-b3ed-acfd2bce8511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:53.936796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c881f9e-69a0-41aa-b3ed-acfd2bce8511 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:53.990602 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2730/5499] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:26:53 2022] POST /identity/v3/projects => generated 403 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:53.990835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f718e5d-98a2-40ae-b31f-87e723eaf949 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:54.010215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f718e5d-98a2-40ae-b31f-87e723eaf949 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:54.072097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c881f9e-69a0-41aa-b3ed-acfd2bce8511 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:54.075492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9c881f9e-69a0-41aa-b3ed-acfd2bce8511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:54.215583 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:54.219212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71c5ce-cdf2-467c-a85e-bba3e97ca610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:54.220507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71c5ce-cdf2-467c-a85e-bba3e97ca610 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:54.220981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71c5ce-cdf2-467c-a85e-bba3e97ca610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:54.221426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71c5ce-cdf2-467c-a85e-bba3e97ca610 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:54.223090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71c5ce-cdf2-467c-a85e-bba3e97ca610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:54.228108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71c5ce-cdf2-467c-a85e-bba3e97ca610 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:54.272797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c881f9e-69a0-41aa-b3ed-acfd2bce8511 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:54.283379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858a907-ad10-418e-bf5c-56d0dcb65cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:54.284007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858a907-ad10-418e-bf5c-56d0dcb65cfc service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:54.284282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858a907-ad10-418e-bf5c-56d0dcb65cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:54.284553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858a907-ad10-418e-bf5c-56d0dcb65cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:54.285699 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2770/5500] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:26:53 2022] POST /identity/v3/users => generated 308 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:26:54.290630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71c5ce-cdf2-467c-a85e-bba3e97ca610 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:54.296708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e858a907-ad10-418e-bf5c-56d0dcb65cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:54.314879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71c5ce-cdf2-467c-a85e-bba3e97ca610 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:54.321754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06052b0f-1154-4575-a98d-9aa723fd1ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:54.322715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06052b0f-1154-4575-a98d-9aa723fd1ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:54.322854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06052b0f-1154-4575-a98d-9aa723fd1ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:54.335147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06052b0f-1154-4575-a98d-9aa723fd1ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:54.336101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06052b0f-1154-4575-a98d-9aa723fd1ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:54.339059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06052b0f-1154-4575-a98d-9aa723fd1ac4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:54.352313 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2771/5501] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:54.356202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06052b0f-1154-4575-a98d-9aa723fd1ac4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:54.368926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06052b0f-1154-4575-a98d-9aa723fd1ac4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:54.375594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ad781-7bb9-4f06-bd84-2726fdd8cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:54.376610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ad781-7bb9-4f06-bd84-2726fdd8cd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:54.377183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ad781-7bb9-4f06-bd84-2726fdd8cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:54.377562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ad781-7bb9-4f06-bd84-2726fdd8cd3d admin admin] PATH_INFO: `/v3/projects/567c1d5dc69744319b404efb0c1479a4/users/0656302c1a634fe9af12cd6cea2fa6a0/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:54.435571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ad781-7bb9-4f06-bd84-2726fdd8cd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=567c1d5dc69744319b404efb0c1479a4, user_id=0656302c1a634fe9af12cd6cea2fa6a0, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:54.447995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ad781-7bb9-4f06-bd84-2726fdd8cd3d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:54.467816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858a907-ad10-418e-bf5c-56d0dcb65cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:54.470564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858a907-ad10-418e-bf5c-56d0dcb65cfc service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:54.493210 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2772/5502] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:54 2022] PUT /identity/v3/projects/567c1d5dc69744319b404efb0c1479a4/users/0656302c1a634fe9af12cd6cea2fa6a0/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:54.497541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ad781-7bb9-4f06-bd84-2726fdd8cd3d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:54.502507 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2731/5503] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:26:54.763210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ad781-7bb9-4f06-bd84-2726fdd8cd3d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:54.812225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804a9e-5709-4abe-9694-03cb2fe10405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:54.826414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804a9e-5709-4abe-9694-03cb2fe10405 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:54.826414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804a9e-5709-4abe-9694-03cb2fe10405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:54.826702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804a9e-5709-4abe-9694-03cb2fe10405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:54.827142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57804a9e-5709-4abe-9694-03cb2fe10405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:54.828842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57804a9e-5709-4abe-9694-03cb2fe10405 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:54.856657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858a907-ad10-418e-bf5c-56d0dcb65cfc service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:54.860743 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2773/5504] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:26:54.872489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858a907-ad10-418e-bf5c-56d0dcb65cfc service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:54.897770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a497383-6e17-4f2d-9684-53637aaad8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:54.899432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a497383-6e17-4f2d-9684-53637aaad8dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:54.899726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a497383-6e17-4f2d-9684-53637aaad8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:54.899989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a497383-6e17-4f2d-9684-53637aaad8dc admin admin] PATH_INFO: `/v3/projects/567c1d5dc69744319b404efb0c1479a4/users/0656302c1a634fe9af12cd6cea2fa6a0/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:54.905514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a497383-6e17-4f2d-9684-53637aaad8dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=567c1d5dc69744319b404efb0c1479a4, user_id=0656302c1a634fe9af12cd6cea2fa6a0, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:54.908543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a497383-6e17-4f2d-9684-53637aaad8dc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:54.922848 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2732/5505] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:54 2022] PUT /identity/v3/projects/567c1d5dc69744319b404efb0c1479a4/users/0656302c1a634fe9af12cd6cea2fa6a0/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:54.939738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78bb7-571b-4bda-a9f8-6667a85d7fb1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:54.940016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78bb7-571b-4bda-a9f8-6667a85d7fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:54.940343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78bb7-571b-4bda-a9f8-6667a85d7fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:55.018008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2ab78bb7-571b-4bda-a9f8-6667a85d7fb1 None None] MFA Rules not processed for user `0656302c1a634fe9af12cd6cea2fa6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:55.022286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2ab78bb7-571b-4bda-a9f8-6667a85d7fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:55.104577 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:55.189959 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2774/5506] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:54 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:55.196829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a497383-6e17-4f2d-9684-53637aaad8dc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:55.217714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a497383-6e17-4f2d-9684-53637aaad8dc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:55.246178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529db3a-a810-4ea9-8c4f-1bc69fe15f82 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0656302c1a634fe9af12cd6cea2fa6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567c1d5dc69744319b404efb0c1479a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:55.247225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529db3a-a810-4ea9-8c4f-1bc69fe15f82 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:55.247657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529db3a-a810-4ea9-8c4f-1bc69fe15f82 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:55.248031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529db3a-a810-4ea9-8c4f-1bc69fe15f82 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:55.248963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529db3a-a810-4ea9-8c4f-1bc69fe15f82 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:55.253696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529db3a-a810-4ea9-8c4f-1bc69fe15f82 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:55.297973 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2733/5507] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:26:55 2022] POST /identity/v3/roles => generated 239 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:55.303218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab78bb7-571b-4bda-a9f8-6667a85d7fb1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:55.324163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab78bb7-571b-4bda-a9f8-6667a85d7fb1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:55.344681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b44fa-4884-494e-9bcb-a61082f37510 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0656302c1a634fe9af12cd6cea2fa6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567c1d5dc69744319b404efb0c1479a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:55.350395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b44fa-4884-494e-9bcb-a61082f37510 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:55.350732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b44fa-4884-494e-9bcb-a61082f37510 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:55.351054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b44fa-4884-494e-9bcb-a61082f37510 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] PATH_INFO: `/v3/projects/c60bdba9ac3d41f89652021053498823/users/479315cbe66d4d5bbc19a32ea28fa376/roles/7e33bccfe0734f8daf9bb80e6969381a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:55.355109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b44fa-4884-494e-9bcb-a61082f37510 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c60bdba9ac3d41f89652021053498823, user_id=479315cbe66d4d5bbc19a32ea28fa376, role_id=7e33bccfe0734f8daf9bb80e6969381a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:55.357897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b44fa-4884-494e-9bcb-a61082f37510 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:55.390351 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2775/5508] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:26:55 2022] PUT /identity/v3/projects/c60bdba9ac3d41f89652021053498823/users/479315cbe66d4d5bbc19a32ea28fa376/roles/7e33bccfe0734f8daf9bb80e6969381a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:55.391551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529db3a-a810-4ea9-8c4f-1bc69fe15f82 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:55.499316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529db3a-a810-4ea9-8c4f-1bc69fe15f82 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:55.580550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ca5ca-8513-4667-b543-3515c2ff87b4 tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479315cbe66d4d5bbc19a32ea28fa376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c60bdba9ac3d41f89652021053498823', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-755307009'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:55.581311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca5ca-8513-4667-b543-3515c2ff87b4 tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:55.581663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca5ca-8513-4667-b543-3515c2ff87b4 tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:55.582199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca5ca-8513-4667-b543-3515c2ff87b4 tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] PATH_INFO: `/v3/users/479315cbe66d4d5bbc19a32ea28fa376/application_credentials` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:55.582983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ca5ca-8513-4667-b543-3515c2ff87b4 tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] RBAC: Authorizing `identity:create_application_credential(user_id=479315cbe66d4d5bbc19a32ea28fa376)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:55.584577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ca5ca-8513-4667-b543-3515c2ff87b4 tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:55.601428 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:55.680285 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2734/5509] 10.222.0.39 () {60 vars in 1315 bytes} [Sun Oct 16 01:26:55 2022] POST /identity/v3/users/479315cbe66d4d5bbc19a32ea28fa376/application_credentials => generated 659 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:26:55.685224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4af642-0994-4666-9b76-d26167871d4c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:55.685508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4af642-0994-4666-9b76-d26167871d4c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:55.685789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4af642-0994-4666-9b76-d26167871d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:55.710254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bc4af642-0994-4666-9b76-d26167871d4c None None] MFA Rules not processed for user `479315cbe66d4d5bbc19a32ea28fa376`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:55.711552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bc4af642-0994-4666-9b76-d26167871d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:55.881446 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2776/5510] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3396 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 16 01:26:55.886158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ca5ca-8513-4667-b543-3515c2ff87b4 tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:55.901727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ca5ca-8513-4667-b543-3515c2ff87b4 tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:55.908903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd54e68-ea77-4a8d-b7f7-80fab85b547d tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479315cbe66d4d5bbc19a32ea28fa376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c60bdba9ac3d41f89652021053498823', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-755307009'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:55.909828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd54e68-ea77-4a8d-b7f7-80fab85b547d tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:55.910281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd54e68-ea77-4a8d-b7f7-80fab85b547d tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:55.910867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd54e68-ea77-4a8d-b7f7-80fab85b547d tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] PATH_INFO: `/v3/users/479315cbe66d4d5bbc19a32ea28fa376/application_credentials/087529834aa246dfaeaaa61949d033ae` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:55.915454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd54e68-ea77-4a8d-b7f7-80fab85b547d tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] RBAC: Authorizing `identity:delete_application_credential(user_id=479315cbe66d4d5bbc19a32ea28fa376, application_credential_id=087529834aa246dfaeaaa61949d033ae)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:55.919033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd54e68-ea77-4a8d-b7f7-80fab85b547d tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:55.946892 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2735/5511] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Oct 16 01:26:55 2022] DELETE /identity/v3/users/479315cbe66d4d5bbc19a32ea28fa376/application_credentials/087529834aa246dfaeaaa61949d033ae => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:55.951034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4af642-0994-4666-9b76-d26167871d4c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:56.076480 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:56.108380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4af642-0994-4666-9b76-d26167871d4c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:56.121313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faac04f-d559-4b16-bd3d-eec18e33b7a9 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0656302c1a634fe9af12cd6cea2fa6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567c1d5dc69744319b404efb0c1479a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:56.122057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faac04f-d559-4b16-bd3d-eec18e33b7a9 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:56.122468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faac04f-d559-4b16-bd3d-eec18e33b7a9 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:56.122813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faac04f-d559-4b16-bd3d-eec18e33b7a9 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] PATH_INFO: `/v3/roles/7e33bccfe0734f8daf9bb80e6969381a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:56.125348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faac04f-d559-4b16-bd3d-eec18e33b7a9 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7e33bccfe0734f8daf9bb80e6969381a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:56.127510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faac04f-d559-4b16-bd3d-eec18e33b7a9 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:56.189077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5faac04f-d559-4b16-bd3d-eec18e33b7a9 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] Invalidating the token cache because role 7e33bccfe0734f8daf9bb80e6969381a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:56.189563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5faac04f-d559-4b16-bd3d-eec18e33b7a9 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:56.190402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5faac04f-d559-4b16-bd3d-eec18e33b7a9 tempest-ApplicationCredentialsV3AdminTest-1039731958 tempest-ApplicationCredentialsV3AdminTest-1039731958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:56.197586 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2777/5512] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:55 2022] DELETE /identity/v3/roles/7e33bccfe0734f8daf9bb80e6969381a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:56.198887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd54e68-ea77-4a8d-b7f7-80fab85b547d tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:56.200928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0cd54e68-ea77-4a8d-b7f7-80fab85b547d tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:56.370568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd54e68-ea77-4a8d-b7f7-80fab85b547d tempest-ApplicationCredentialsV3AdminTest-1028578383 tempest-ApplicationCredentialsV3AdminTest-1028578383-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:56.477203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:56.478554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:56.478765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:56.479101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] PATH_INFO: `/v3/users/479315cbe66d4d5bbc19a32ea28fa376` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:56.480409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=479315cbe66d4d5bbc19a32ea28fa376)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:56.483564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:56.582340 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:56.622145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '479315cbe66d4d5bbc19a32ea28fa376'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:56.624760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '479315cbe66d4d5bbc19a32ea28fa376'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:56.695602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '479315cbe66d4d5bbc19a32ea28fa376'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:56.723506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '479315cbe66d4d5bbc19a32ea28fa376'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:56.724667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '479315cbe66d4d5bbc19a32ea28fa376'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:56.750620 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2736/5513] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:56 2022] DELETE /identity/v3/users/479315cbe66d4d5bbc19a32ea28fa376 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:56.756930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e00d2-867d-4e82-81f3-000f5cb2e7f0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:56.757504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e00d2-867d-4e82-81f3-000f5cb2e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:56.757600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e00d2-867d-4e82-81f3-000f5cb2e7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:56.802808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c93e00d2-867d-4e82-81f3-000f5cb2e7f0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:26:56.804460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c93e00d2-867d-4e82-81f3-000f5cb2e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:56.940240 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2778/5514] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:26:56.963494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:56.964953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:57.186180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026cd5-997f-479d-ae2d-60541d602d2d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:57.195630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4343a-25cd-4a0b-89c5-7bed1b2dc1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:57.196264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4343a-25cd-4a0b-89c5-7bed1b2dc1ad service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:57.196547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4343a-25cd-4a0b-89c5-7bed1b2dc1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:57.196874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4343a-25cd-4a0b-89c5-7bed1b2dc1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:57.217854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4343a-25cd-4a0b-89c5-7bed1b2dc1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:57.221280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4343a-25cd-4a0b-89c5-7bed1b2dc1ad service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:57.239360 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2737/5515] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:26:58.629203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e00d2-867d-4e82-81f3-000f5cb2e7f0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:58.631300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c93e00d2-867d-4e82-81f3-000f5cb2e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:26:58.656785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e00d2-867d-4e82-81f3-000f5cb2e7f0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:58.660588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:58.662537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:58.663217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:58.664466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] PATH_INFO: `/v3/projects/c60bdba9ac3d41f89652021053498823` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:58.666492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60bdba9ac3d41f89652021053498823)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:58.669553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:58.745018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60bdba9ac3d41f89652021053498823', 'request_id': 'req-ff7f77aa-5075-449b-b2f9-5d81075f100d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:58.753347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60bdba9ac3d41f89652021053498823', 'request_id': 'req-ff7f77aa-5075-449b-b2f9-5d81075f100d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:58.765614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60bdba9ac3d41f89652021053498823', 'request_id': 'req-ff7f77aa-5075-449b-b2f9-5d81075f100d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:58.783006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] The token cache is being invalidate because project c60bdba9ac3d41f89652021053498823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:26:58.783830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:58.787886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:58.794246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4343a-25cd-4a0b-89c5-7bed1b2dc1ad service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:26:58.795464 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2779/5516] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:26:58 2022] DELETE /identity/v3/projects/c60bdba9ac3d41f89652021053498823 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:26:58.813325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4343a-25cd-4a0b-89c5-7bed1b2dc1ad service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:26:58.916289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6f271-7011-4dfc-8b33-cb05c8aa4030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:26:58.917101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6f271-7011-4dfc-8b33-cb05c8aa4030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:26:58.917644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6f271-7011-4dfc-8b33-cb05c8aa4030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:26:58.918172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6f271-7011-4dfc-8b33-cb05c8aa4030 admin admin] PATH_INFO: `/v3/users/0656302c1a634fe9af12cd6cea2fa6a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:26:58.919852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6f271-7011-4dfc-8b33-cb05c8aa4030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0656302c1a634fe9af12cd6cea2fa6a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:26:58.926180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6f271-7011-4dfc-8b33-cb05c8aa4030 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:26:59.014498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-19a6f271-7011-4dfc-8b33-cb05c8aa4030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0656302c1a634fe9af12cd6cea2fa6a0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:59.016090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-19a6f271-7011-4dfc-8b33-cb05c8aa4030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0656302c1a634fe9af12cd6cea2fa6a0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:59.051508 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:59.058427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-19a6f271-7011-4dfc-8b33-cb05c8aa4030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0656302c1a634fe9af12cd6cea2fa6a0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:59.080668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-19a6f271-7011-4dfc-8b33-cb05c8aa4030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0656302c1a634fe9af12cd6cea2fa6a0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:59.081639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-19a6f271-7011-4dfc-8b33-cb05c8aa4030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0656302c1a634fe9af12cd6cea2fa6a0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:26:59.133972 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2738/5517] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:26:58 2022] DELETE /identity/v3/users/0656302c1a634fe9af12cd6cea2fa6a0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:00.220038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:00.222709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:00.262512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f77aa-5075-449b-b2f9-5d81075f100d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:00.328014 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:00.352977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:00.355250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:00.355736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:00.356321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf admin admin] PATH_INFO: `/v3/projects/567c1d5dc69744319b404efb0c1479a4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:00.357734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=567c1d5dc69744319b404efb0c1479a4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:00.360998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:00.434013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567c1d5dc69744319b404efb0c1479a4', 'request_id': 'req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:00.442982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567c1d5dc69744319b404efb0c1479a4', 'request_id': 'req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:00.455582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567c1d5dc69744319b404efb0c1479a4', 'request_id': 'req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:00.473136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf admin admin] The token cache is being invalidate because project 567c1d5dc69744319b404efb0c1479a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:00.473762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:00.475373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5e679e5-8785-4ba0-a209-de2fb2d3d2bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:00.476912 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2780/5518] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:00 2022] DELETE /identity/v3/projects/567c1d5dc69744319b404efb0c1479a4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:00.481887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f0156-f88e-4a90-98cd-8cbbbe69bbad None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:00.483348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f0156-f88e-4a90-98cd-8cbbbe69bbad None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:00.484808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f0156-f88e-4a90-98cd-8cbbbe69bbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:00.509947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-335f0156-f88e-4a90-98cd-8cbbbe69bbad None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:00.511376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-335f0156-f88e-4a90-98cd-8cbbbe69bbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:00.659846 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2739/5519] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:00.747317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951b80-763d-46c6-93d4-d44b482ae802 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:00.751298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951b80-763d-46c6-93d4-d44b482ae802 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:00.753465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951b80-763d-46c6-93d4-d44b482ae802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:00.786301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-83951b80-763d-46c6-93d4-d44b482ae802 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:00.788648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-83951b80-763d-46c6-93d4-d44b482ae802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:00.797765 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2781/5520] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:00.802149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f0156-f88e-4a90-98cd-8cbbbe69bbad None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:00.815442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f0156-f88e-4a90-98cd-8cbbbe69bbad None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:00.821640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62044010-d860-496a-bc62-9cb3a7441a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:00.822264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62044010-d860-496a-bc62-9cb3a7441a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:00.822561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62044010-d860-496a-bc62-9cb3a7441a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:00.822812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62044010-d860-496a-bc62-9cb3a7441a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:00.823630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62044010-d860-496a-bc62-9cb3a7441a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:00.824040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62044010-d860-496a-bc62-9cb3a7441a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:00.825514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62044010-d860-496a-bc62-9cb3a7441a1f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:00.838842 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2740/5521] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:27:00.843776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83951b80-763d-46c6-93d4-d44b482ae802 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:00.854803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83951b80-763d-46c6-93d4-d44b482ae802 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:00.861663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ca997-64c9-4f1b-a63a-9d7b040e18cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:00.862314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ca997-64c9-4f1b-a63a-9d7b040e18cb admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:00.862598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ca997-64c9-4f1b-a63a-9d7b040e18cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:00.863184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ca997-64c9-4f1b-a63a-9d7b040e18cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:00.863832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ca997-64c9-4f1b-a63a-9d7b040e18cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:00.866369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ca997-64c9-4f1b-a63a-9d7b040e18cb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:00.902087 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2782/5522] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:00 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:00.903448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62044010-d860-496a-bc62-9cb3a7441a1f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:00.915201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62044010-d860-496a-bc62-9cb3a7441a1f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:00.999982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ca2c6-8844-4307-ab8a-d4b59d7b3add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:01.000714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ca2c6-8844-4307-ab8a-d4b59d7b3add admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:01.001109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ca2c6-8844-4307-ab8a-d4b59d7b3add admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:01.001686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ca2c6-8844-4307-ab8a-d4b59d7b3add admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:01.003068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ca2c6-8844-4307-ab8a-d4b59d7b3add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:01.005613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ca2c6-8844-4307-ab8a-d4b59d7b3add admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:01.054356 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2741/5523] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:00 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:01.055642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ca997-64c9-4f1b-a63a-9d7b040e18cb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:01.070206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ca997-64c9-4f1b-a63a-9d7b040e18cb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:01.079988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4c8f3-8477-422b-b792-9f00d65889f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:01.081021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4c8f3-8477-422b-b792-9f00d65889f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:01.081638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4c8f3-8477-422b-b792-9f00d65889f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:01.082133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4c8f3-8477-422b-b792-9f00d65889f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:01.083134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4c8f3-8477-422b-b792-9f00d65889f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:01.088185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4c8f3-8477-422b-b792-9f00d65889f1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:01.114277 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2783/5524] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:01.116786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ca2c6-8844-4307-ab8a-d4b59d7b3add admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:01.131950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ca2c6-8844-4307-ab8a-d4b59d7b3add admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:01.144260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3761324-ebb4-4a7e-afa0-7b39ebd843f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:01.144883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3761324-ebb4-4a7e-afa0-7b39ebd843f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:01.191483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3761324-ebb4-4a7e-afa0-7b39ebd843f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:01.191483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3761324-ebb4-4a7e-afa0-7b39ebd843f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:01.191483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3761324-ebb4-4a7e-afa0-7b39ebd843f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:01.191483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3761324-ebb4-4a7e-afa0-7b39ebd843f0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:01.191483 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2742/5525] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:01.196824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4c8f3-8477-422b-b792-9f00d65889f1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:01.196824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4c8f3-8477-422b-b792-9f00d65889f1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:01.207835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296829e-b69b-4709-a5be-0bf6ddbf260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:01.208705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296829e-b69b-4709-a5be-0bf6ddbf260c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:01.209223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296829e-b69b-4709-a5be-0bf6ddbf260c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:01.209691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296829e-b69b-4709-a5be-0bf6ddbf260c admin admin] PATH_INFO: `/v3/projects/1a0a33eafb9d4c35882969d27d74e1a1/users/4b72a48f310c48c7918e78cd3b7bdc77/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:01.244115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296829e-b69b-4709-a5be-0bf6ddbf260c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0a33eafb9d4c35882969d27d74e1a1, user_id=4b72a48f310c48c7918e78cd3b7bdc77, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:01.246968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296829e-b69b-4709-a5be-0bf6ddbf260c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:01.266960 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2784/5526] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:01 2022] PUT /identity/v3/projects/1a0a33eafb9d4c35882969d27d74e1a1/users/4b72a48f310c48c7918e78cd3b7bdc77/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:01.276081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb265932-2d0d-4d02-8a57-8e7c680e9ade None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:01.277097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb265932-2d0d-4d02-8a57-8e7c680e9ade None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:01.277291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb265932-2d0d-4d02-8a57-8e7c680e9ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:01.313632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cb265932-2d0d-4d02-8a57-8e7c680e9ade None None] MFA Rules not processed for user `4b72a48f310c48c7918e78cd3b7bdc77`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:01.315300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cb265932-2d0d-4d02-8a57-8e7c680e9ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:01.361331 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:01.413261 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2743/5527] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:01.417710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296829e-b69b-4709-a5be-0bf6ddbf260c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:01.507281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296829e-b69b-4709-a5be-0bf6ddbf260c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:01.513445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c8dbf-dadd-41f4-b615-d594e600afc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:01.514938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c8dbf-dadd-41f4-b615-d594e600afc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:01.515353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c8dbf-dadd-41f4-b615-d594e600afc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:01.515757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c8dbf-dadd-41f4-b615-d594e600afc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:01.516532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c8dbf-dadd-41f4-b615-d594e600afc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:01.518606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c8dbf-dadd-41f4-b615-d594e600afc0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:01.534234 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:01.572544 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2785/5528] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:01 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:01.576650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb265932-2d0d-4d02-8a57-8e7c680e9ade None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:01.592586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb265932-2d0d-4d02-8a57-8e7c680e9ade None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:01.662321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6ed1c-ce96-4e04-b53f-2ad8b92b6b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:01.663091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6ed1c-ce96-4e04-b53f-2ad8b92b6b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:01.663476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6ed1c-ce96-4e04-b53f-2ad8b92b6b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:01.663845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6ed1c-ce96-4e04-b53f-2ad8b92b6b9a admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:01.664576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6ed1c-ce96-4e04-b53f-2ad8b92b6b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:01.666737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6ed1c-ce96-4e04-b53f-2ad8b92b6b9a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:01.691785 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2744/5529] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:01 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:01.696258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c8dbf-dadd-41f4-b615-d594e600afc0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:01.719157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c8dbf-dadd-41f4-b615-d594e600afc0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:01.729694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea05c1-cb50-4e70-89e9-8d00e12e8ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:01.730646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea05c1-cb50-4e70-89e9-8d00e12e8ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:01.731030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea05c1-cb50-4e70-89e9-8d00e12e8ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:01.731484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea05c1-cb50-4e70-89e9-8d00e12e8ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:01.735846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea05c1-cb50-4e70-89e9-8d00e12e8ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:01.737841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea05c1-cb50-4e70-89e9-8d00e12e8ce6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:01.757226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6ed1c-ce96-4e04-b53f-2ad8b92b6b9a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:01.763749 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2786/5530] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:01.780702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6ed1c-ce96-4e04-b53f-2ad8b92b6b9a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:01.787588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e79d8f-1beb-4fcc-98cc-16ebcc27c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:01.788374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e79d8f-1beb-4fcc-98cc-16ebcc27c532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:01.789628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e79d8f-1beb-4fcc-98cc-16ebcc27c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:01.789949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e79d8f-1beb-4fcc-98cc-16ebcc27c532 admin admin] PATH_INFO: `/v3/projects/fefdb1503cae4c35bc0cc053f6898b10/users/1c872bf19cc64567969c2f82d06dc8be/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:01.809162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e79d8f-1beb-4fcc-98cc-16ebcc27c532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fefdb1503cae4c35bc0cc053f6898b10, user_id=1c872bf19cc64567969c2f82d06dc8be, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:01.812928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e79d8f-1beb-4fcc-98cc-16ebcc27c532 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:01.843625 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2745/5531] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:01 2022] PUT /identity/v3/projects/fefdb1503cae4c35bc0cc053f6898b10/users/1c872bf19cc64567969c2f82d06dc8be/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:01.857300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea05c1-cb50-4e70-89e9-8d00e12e8ce6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:01.875211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea05c1-cb50-4e70-89e9-8d00e12e8ce6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:01.968785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b91755-d5b5-4038-ab94-18604b095d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:01.969558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b91755-d5b5-4038-ab94-18604b095d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:01.970028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b91755-d5b5-4038-ab94-18604b095d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:01.971149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b91755-d5b5-4038-ab94-18604b095d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:01.972558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b91755-d5b5-4038-ab94-18604b095d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:01.978818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b91755-d5b5-4038-ab94-18604b095d33 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:02.002807 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2787/5532] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:02.007065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e79d8f-1beb-4fcc-98cc-16ebcc27c532 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:02.031206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e79d8f-1beb-4fcc-98cc-16ebcc27c532 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:02.038333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b6c1a-ccb5-4ce9-9bcc-dc1498c72895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:02.039997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b6c1a-ccb5-4ce9-9bcc-dc1498c72895 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:02.040394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b6c1a-ccb5-4ce9-9bcc-dc1498c72895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:02.041279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b6c1a-ccb5-4ce9-9bcc-dc1498c72895 admin admin] PATH_INFO: `/v3/projects/fefdb1503cae4c35bc0cc053f6898b10/users/1c872bf19cc64567969c2f82d06dc8be/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:02.045206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b6c1a-ccb5-4ce9-9bcc-dc1498c72895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fefdb1503cae4c35bc0cc053f6898b10, user_id=1c872bf19cc64567969c2f82d06dc8be, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:02.053491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b6c1a-ccb5-4ce9-9bcc-dc1498c72895 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:02.086959 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2746/5533] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:02 2022] PUT /identity/v3/projects/fefdb1503cae4c35bc0cc053f6898b10/users/1c872bf19cc64567969c2f82d06dc8be/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:02.097522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7be924-5437-49ad-82ca-5f0b25ea4b83 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:02.097879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7be924-5437-49ad-82ca-5f0b25ea4b83 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:02.098092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7be924-5437-49ad-82ca-5f0b25ea4b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:02.140365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3d7be924-5437-49ad-82ca-5f0b25ea4b83 None None] MFA Rules not processed for user `1c872bf19cc64567969c2f82d06dc8be`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:02.141783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3d7be924-5437-49ad-82ca-5f0b25ea4b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:02.266086 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2788/5534] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:02.268210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b6c1a-ccb5-4ce9-9bcc-dc1498c72895 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:02.283421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b6c1a-ccb5-4ce9-9bcc-dc1498c72895 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:02.294130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278ea56-461e-47a3-9b61-808ed37e513e tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c872bf19cc64567969c2f82d06dc8be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fefdb1503cae4c35bc0cc053f6898b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:02.294758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278ea56-461e-47a3-9b61-808ed37e513e tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:02.296177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278ea56-461e-47a3-9b61-808ed37e513e tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:02.296296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278ea56-461e-47a3-9b61-808ed37e513e tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:02.297430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278ea56-461e-47a3-9b61-808ed37e513e tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:02.301311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278ea56-461e-47a3-9b61-808ed37e513e tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:02.342652 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2747/5535] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:27:02 2022] POST /identity/v3/domains => generated 246 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:02.347743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7be924-5437-49ad-82ca-5f0b25ea4b83 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:02.359720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7be924-5437-49ad-82ca-5f0b25ea4b83 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:02.468874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb6b70-d2ef-4b83-9d4d-3e72b1d03a8b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c872bf19cc64567969c2f82d06dc8be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fefdb1503cae4c35bc0cc053f6898b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:02.469080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb6b70-d2ef-4b83-9d4d-3e72b1d03a8b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:02.469344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb6b70-d2ef-4b83-9d4d-3e72b1d03a8b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:02.469821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb6b70-d2ef-4b83-9d4d-3e72b1d03a8b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:02.470770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb6b70-d2ef-4b83-9d4d-3e72b1d03a8b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:02.474561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb6b70-d2ef-4b83-9d4d-3e72b1d03a8b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:02.481548 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:02.544674 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2789/5536] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:02 2022] POST /identity/v3/projects => generated 410 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:02.545793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278ea56-461e-47a3-9b61-808ed37e513e tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:02.577041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278ea56-461e-47a3-9b61-808ed37e513e tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:02.654583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ff068-3805-42a2-8ddf-35c33c6d7dcf tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c872bf19cc64567969c2f82d06dc8be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fefdb1503cae4c35bc0cc053f6898b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:02.655730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ff068-3805-42a2-8ddf-35c33c6d7dcf tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:02.657587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ff068-3805-42a2-8ddf-35c33c6d7dcf tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:02.657885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ff068-3805-42a2-8ddf-35c33c6d7dcf tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:02.658682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ff068-3805-42a2-8ddf-35c33c6d7dcf tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:02.661810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ff068-3805-42a2-8ddf-35c33c6d7dcf tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:02.689126 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:02.700480 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2748/5537] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:02 2022] POST /identity/v3/users => generated 347 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:02.705235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb6b70-d2ef-4b83-9d4d-3e72b1d03a8b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:02.725265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb6b70-d2ef-4b83-9d4d-3e72b1d03a8b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:02.734083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a37d2-76d3-481a-8009-5dc4a586f415 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c872bf19cc64567969c2f82d06dc8be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fefdb1503cae4c35bc0cc053f6898b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:02.735004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a37d2-76d3-481a-8009-5dc4a586f415 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:02.735469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a37d2-76d3-481a-8009-5dc4a586f415 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:02.735967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a37d2-76d3-481a-8009-5dc4a586f415 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:02.736839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a37d2-76d3-481a-8009-5dc4a586f415 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:02.739037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a37d2-76d3-481a-8009-5dc4a586f415 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:02.753415 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2790/5538] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:02.758043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ff068-3805-42a2-8ddf-35c33c6d7dcf tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:02.770982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ff068-3805-42a2-8ddf-35c33c6d7dcf tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:02.794151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619b38e-4a05-4759-9e12-07b3069dbe8c tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c872bf19cc64567969c2f82d06dc8be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fefdb1503cae4c35bc0cc053f6898b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:02.794842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619b38e-4a05-4759-9e12-07b3069dbe8c tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:02.795159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619b38e-4a05-4759-9e12-07b3069dbe8c tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:02.795474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619b38e-4a05-4759-9e12-07b3069dbe8c tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] PATH_INFO: `/v3/projects/59356513511640d7bb71a59ad06e42f5/users/00ac89c0f32b4186a8add98d8aa27270/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:02.829134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619b38e-4a05-4759-9e12-07b3069dbe8c tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorizing `identity:create_grant(project_id=59356513511640d7bb71a59ad06e42f5, user_id=00ac89c0f32b4186a8add98d8aa27270, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:02.832193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619b38e-4a05-4759-9e12-07b3069dbe8c tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:02.866973 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2749/5539] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:02 2022] PUT /identity/v3/projects/59356513511640d7bb71a59ad06e42f5/users/00ac89c0f32b4186a8add98d8aa27270/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:02.871539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7984-70c7-478b-b842-3619ceb897dd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:02.871824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7984-70c7-478b-b842-3619ceb897dd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:02.872108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7984-70c7-478b-b842-3619ceb897dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:03.082423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5b5e7984-70c7-478b-b842-3619ceb897dd None None] MFA Rules not processed for user `00ac89c0f32b4186a8add98d8aa27270`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:03.084272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5b5e7984-70c7-478b-b842-3619ceb897dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:03.112807 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2791/5540] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:03.114634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145ce3e-4dd1-4660-a5af-967bf0b3286b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:03.115496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145ce3e-4dd1-4660-a5af-967bf0b3286b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:03.115767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145ce3e-4dd1-4660-a5af-967bf0b3286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:03.141016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c145ce3e-4dd1-4660-a5af-967bf0b3286b None None] MFA Rules not processed for user `00ac89c0f32b4186a8add98d8aa27270`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:03.143028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c145ce3e-4dd1-4660-a5af-967bf0b3286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:03.162363 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2750/5541] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:03.164174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e7984-70c7-478b-b842-3619ceb897dd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:03.175757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e7984-70c7-478b-b842-3619ceb897dd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:03.182492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f8d77-4e09-4df9-905d-d8662a8f77e0 tempest-test_project-1118384465 tempest-user-559219795] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00ac89c0f32b4186a8add98d8aa27270', 'user_domain_id': '781098ca2a7042bfa78567a609a4c4ad', 'system_scope': None, 'project_id': '59356513511640d7bb71a59ad06e42f5', 'project_domain_id': '781098ca2a7042bfa78567a609a4c4ad', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:03.184360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f8d77-4e09-4df9-905d-d8662a8f77e0 tempest-test_project-1118384465 tempest-user-559219795] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:03.184856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f8d77-4e09-4df9-905d-d8662a8f77e0 tempest-test_project-1118384465 tempest-user-559219795] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:03.185328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f8d77-4e09-4df9-905d-d8662a8f77e0 tempest-test_project-1118384465 tempest-user-559219795] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:03.195997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f8d77-4e09-4df9-905d-d8662a8f77e0 tempest-test_project-1118384465 tempest-user-559219795] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:03.198046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f8d77-4e09-4df9-905d-d8662a8f77e0 tempest-test_project-1118384465 tempest-user-559219795] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:03.215440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145ce3e-4dd1-4660-a5af-967bf0b3286b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:03.216121 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2792/5542] 10.222.0.39 () {56 vars in 1284 bytes} [Sun Oct 16 01:27:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:03.318606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145ce3e-4dd1-4660-a5af-967bf0b3286b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:03.324004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c872bf19cc64567969c2f82d06dc8be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fefdb1503cae4c35bc0cc053f6898b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:03.324787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:03.325175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:03.325558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] PATH_INFO: `/v3/users/00ac89c0f32b4186a8add98d8aa27270` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:03.327474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorizing `identity:delete_user(user_id=00ac89c0f32b4186a8add98d8aa27270)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:03.330393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:03.462823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00ac89c0f32b4186a8add98d8aa27270'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:03.463788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00ac89c0f32b4186a8add98d8aa27270'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:03.497544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00ac89c0f32b4186a8add98d8aa27270'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:03.517150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00ac89c0f32b4186a8add98d8aa27270'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:03.517886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00ac89c0f32b4186a8add98d8aa27270'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:03.540523 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2751/5543] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:03 2022] DELETE /identity/v3/users/00ac89c0f32b4186a8add98d8aa27270 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:27:03.544750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f8d77-4e09-4df9-905d-d8662a8f77e0 tempest-test_project-1118384465 tempest-user-559219795] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:03.561740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f8d77-4e09-4df9-905d-d8662a8f77e0 tempest-test_project-1118384465 tempest-user-559219795] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:03.700425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c872bf19cc64567969c2f82d06dc8be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fefdb1503cae4c35bc0cc053f6898b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:03.701076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:03.701359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:03.701635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] PATH_INFO: `/v3/projects/59356513511640d7bb71a59ad06e42f5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:03.702823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorizing `identity:delete_project(project_id=59356513511640d7bb71a59ad06e42f5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:03.704758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:03.759090 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:03.802941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59356513511640d7bb71a59ad06e42f5', 'request_id': 'req-fedce8d6-efb2-41c1-9a28-b60413a50429'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:03.816299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59356513511640d7bb71a59ad06e42f5', 'request_id': 'req-fedce8d6-efb2-41c1-9a28-b60413a50429'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:03.830605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59356513511640d7bb71a59ad06e42f5', 'request_id': 'req-fedce8d6-efb2-41c1-9a28-b60413a50429'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:03.856614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] The token cache is being invalidate because project 59356513511640d7bb71a59ad06e42f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:03.858324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:03.859411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:03.863759 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2793/5544] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:03 2022] DELETE /identity/v3/projects/59356513511640d7bb71a59ad06e42f5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:03.868127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:03.869563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:03.890700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecdd7e-0fc8-46ce-8c04-72d495bd90ab tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:04.014400 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:04.039287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bfdad-3248-4a29-afc6-c132ae14769b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c872bf19cc64567969c2f82d06dc8be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fefdb1503cae4c35bc0cc053f6898b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:04.040956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bfdad-3248-4a29-afc6-c132ae14769b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:04.045041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bfdad-3248-4a29-afc6-c132ae14769b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:04.045592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bfdad-3248-4a29-afc6-c132ae14769b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] PATH_INFO: `/v3/domains/781098ca2a7042bfa78567a609a4c4ad` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:04.049078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bfdad-3248-4a29-afc6-c132ae14769b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=781098ca2a7042bfa78567a609a4c4ad)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:04.053327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bfdad-3248-4a29-afc6-c132ae14769b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:04.166484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-077bfdad-3248-4a29-afc6-c132ae14769b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '781098ca2a7042bfa78567a609a4c4ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.167955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-077bfdad-3248-4a29-afc6-c132ae14769b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '781098ca2a7042bfa78567a609a4c4ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.222781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-077bfdad-3248-4a29-afc6-c132ae14769b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '781098ca2a7042bfa78567a609a4c4ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.224020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-077bfdad-3248-4a29-afc6-c132ae14769b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '781098ca2a7042bfa78567a609a4c4ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.233478 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2752/5545] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:27:03 2022] PATCH /identity/v3/domains/781098ca2a7042bfa78567a609a4c4ad => generated 247 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:27:04.237609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:04.239161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:04.263621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedce8d6-efb2-41c1-9a28-b60413a50429 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:04.400608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c872bf19cc64567969c2f82d06dc8be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fefdb1503cae4c35bc0cc053f6898b10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:04.401516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:04.401946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:04.402363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] PATH_INFO: `/v3/domains/781098ca2a7042bfa78567a609a4c4ad` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:04.418868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=781098ca2a7042bfa78567a609a4c4ad)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:04.420843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:04.466008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '781098ca2a7042bfa78567a609a4c4ad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.487036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '781098ca2a7042bfa78567a609a4c4ad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.571105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781098ca2a7042bfa78567a609a4c4ad', 'request_id': 'req-a1b8d08b-f79f-4851-8f35-de6c8cb85885'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.592082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781098ca2a7042bfa78567a609a4c4ad', 'request_id': 'req-a1b8d08b-f79f-4851-8f35-de6c8cb85885'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.616694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781098ca2a7042bfa78567a609a4c4ad', 'request_id': 'req-a1b8d08b-f79f-4851-8f35-de6c8cb85885'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.668380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] The token cache is being invalidate because project 781098ca2a7042bfa78567a609a4c4ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:04.669744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.671587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.699029 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:04.707240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '781098ca2a7042bfa78567a609a4c4ad', 'request_id': 'req-a1b8d08b-f79f-4851-8f35-de6c8cb85885'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.710065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '781098ca2a7042bfa78567a609a4c4ad', 'request_id': 'req-a1b8d08b-f79f-4851-8f35-de6c8cb85885'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.712228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a1b8d08b-f79f-4851-8f35-de6c8cb85885 tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '781098ca2a7042bfa78567a609a4c4ad', 'request_id': 'req-a1b8d08b-f79f-4851-8f35-de6c8cb85885'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:04.735645 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2794/5546] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:27:04 2022] DELETE /identity/v3/domains/781098ca2a7042bfa78567a609a4c4ad => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:04.741674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bfdad-3248-4a29-afc6-c132ae14769b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:04.743444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-077bfdad-3248-4a29-afc6-c132ae14769b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:04.904807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bfdad-3248-4a29-afc6-c132ae14769b tempest-TestDefaultProjectId-797039796 tempest-TestDefaultProjectId-797039796-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:05.022953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:05.023804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:05.024421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:05.024749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] PATH_INFO: `/v3/users/4b72a48f310c48c7918e78cd3b7bdc77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:05.026472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b72a48f310c48c7918e78cd3b7bdc77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:05.034384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:05.155260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b72a48f310c48c7918e78cd3b7bdc77'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:05.158030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b72a48f310c48c7918e78cd3b7bdc77'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:05.196731 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:05.199121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b72a48f310c48c7918e78cd3b7bdc77'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:05.217140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b72a48f310c48c7918e78cd3b7bdc77'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:05.218783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b72a48f310c48c7918e78cd3b7bdc77'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:05.248784 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2753/5547] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:04 2022] DELETE /identity/v3/users/4b72a48f310c48c7918e78cd3b7bdc77 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:05.253063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48ee94-93b7-42d0-a65b-852c75beecb1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:05.253503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48ee94-93b7-42d0-a65b-852c75beecb1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:05.253907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48ee94-93b7-42d0-a65b-852c75beecb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:05.284546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9c48ee94-93b7-42d0-a65b-852c75beecb1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:05.285957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9c48ee94-93b7-42d0-a65b-852c75beecb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:05.406952 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2795/5548] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:05.431688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:05.433428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:05.581640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533444d-438e-4c6b-8ae1-df498ead1eeb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:05.593033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d50b8-f344-4b29-ad04-0f48e9ccbe8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:05.594498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d50b8-f344-4b29-ad04-0f48e9ccbe8b service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:05.596058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d50b8-f344-4b29-ad04-0f48e9ccbe8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:05.596435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d50b8-f344-4b29-ad04-0f48e9ccbe8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:05.628490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d50b8-f344-4b29-ad04-0f48e9ccbe8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:05.636955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d50b8-f344-4b29-ad04-0f48e9ccbe8b service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:05.678096 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2754/5549] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:06.302254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48ee94-93b7-42d0-a65b-852c75beecb1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:06.307192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9c48ee94-93b7-42d0-a65b-852c75beecb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:06.353348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48ee94-93b7-42d0-a65b-852c75beecb1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:06.360207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:06.361088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:06.361493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:06.361891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] PATH_INFO: `/v3/projects/1a0a33eafb9d4c35882969d27d74e1a1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:06.363703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0a33eafb9d4c35882969d27d74e1a1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:06.367524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:06.532507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0a33eafb9d4c35882969d27d74e1a1', 'request_id': 'req-c8bd82d0-ae3b-4f42-9126-381041daec0b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:06.554469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0a33eafb9d4c35882969d27d74e1a1', 'request_id': 'req-c8bd82d0-ae3b-4f42-9126-381041daec0b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:06.575279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0a33eafb9d4c35882969d27d74e1a1', 'request_id': 'req-c8bd82d0-ae3b-4f42-9126-381041daec0b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:06.591713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] The token cache is being invalidate because project 1a0a33eafb9d4c35882969d27d74e1a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:06.592277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:06.593111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:06.595287 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2796/5550] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:06 2022] DELETE /identity/v3/projects/1a0a33eafb9d4c35882969d27d74e1a1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:06.599583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d50b8-f344-4b29-ad04-0f48e9ccbe8b service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:06.610279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d50b8-f344-4b29-ad04-0f48e9ccbe8b service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:06.730173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f66ed-7bbe-4838-b18e-a32d4b493d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:06.731072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f66ed-7bbe-4838-b18e-a32d4b493d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:06.731456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f66ed-7bbe-4838-b18e-a32d4b493d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:06.732000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f66ed-7bbe-4838-b18e-a32d4b493d2e admin admin] PATH_INFO: `/v3/users/1c872bf19cc64567969c2f82d06dc8be` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:06.733329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f66ed-7bbe-4838-b18e-a32d4b493d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c872bf19cc64567969c2f82d06dc8be)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:06.736909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f66ed-7bbe-4838-b18e-a32d4b493d2e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:06.815630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7d8f66ed-7bbe-4838-b18e-a32d4b493d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c872bf19cc64567969c2f82d06dc8be'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:06.816562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7d8f66ed-7bbe-4838-b18e-a32d4b493d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c872bf19cc64567969c2f82d06dc8be'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:06.832404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7d8f66ed-7bbe-4838-b18e-a32d4b493d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c872bf19cc64567969c2f82d06dc8be'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:06.843199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7d8f66ed-7bbe-4838-b18e-a32d4b493d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c872bf19cc64567969c2f82d06dc8be'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:06.844769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7d8f66ed-7bbe-4838-b18e-a32d4b493d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c872bf19cc64567969c2f82d06dc8be'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:06.863844 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2755/5551] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:06 2022] DELETE /identity/v3/users/1c872bf19cc64567969c2f82d06dc8be => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:08.253456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:08.256229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:08.281428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd82d0-ae3b-4f42-9126-381041daec0b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:08.374331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:08.375792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:08.376272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:08.376738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] PATH_INFO: `/v3/users/88d5c0890ae64fd6aa7e7e547e9bf736` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:08.378117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d5c0890ae64fd6aa7e7e547e9bf736)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:08.381868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:08.419845 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:08.467877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d5c0890ae64fd6aa7e7e547e9bf736'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:08.471361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d5c0890ae64fd6aa7e7e547e9bf736'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:08.487371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d5c0890ae64fd6aa7e7e547e9bf736'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:08.498501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d5c0890ae64fd6aa7e7e547e9bf736'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:08.499755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d5c0890ae64fd6aa7e7e547e9bf736'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:08.521752 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2797/5552] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:08 2022] DELETE /identity/v3/users/88d5c0890ae64fd6aa7e7e547e9bf736 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:08.525793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9d368-11ad-4366-a873-ac16bf3d3d1c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:08.526224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9d368-11ad-4366-a873-ac16bf3d3d1c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:08.528211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9d368-11ad-4366-a873-ac16bf3d3d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:08.539876 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:08.566619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-87d9d368-11ad-4366-a873-ac16bf3d3d1c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:08.569857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-87d9d368-11ad-4366-a873-ac16bf3d3d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:08.722665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:08.725708 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2756/5553] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:08.727462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:08.740849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9d368-11ad-4366-a873-ac16bf3d3d1c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:08.750092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968895d9-fadc-41f1-b6bb-d361f4db8f3a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:08.753885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-87d9d368-11ad-4366-a873-ac16bf3d3d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:08.760993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e3573-ca82-4c74-acbf-cede5efcf13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:08.761673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e3573-ca82-4c74-acbf-cede5efcf13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:08.761991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e3573-ca82-4c74-acbf-cede5efcf13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:08.762275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e3573-ca82-4c74-acbf-cede5efcf13b admin admin] PATH_INFO: `/v3/projects/fefdb1503cae4c35bc0cc053f6898b10` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:08.769123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e3573-ca82-4c74-acbf-cede5efcf13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fefdb1503cae4c35bc0cc053f6898b10)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:08.771136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e3573-ca82-4c74-acbf-cede5efcf13b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:08.846291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9d368-11ad-4366-a873-ac16bf3d3d1c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:08.871905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-968e3573-ca82-4c74-acbf-cede5efcf13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fefdb1503cae4c35bc0cc053f6898b10', 'request_id': 'req-968e3573-ca82-4c74-acbf-cede5efcf13b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:08.894891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-968e3573-ca82-4c74-acbf-cede5efcf13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fefdb1503cae4c35bc0cc053f6898b10', 'request_id': 'req-968e3573-ca82-4c74-acbf-cede5efcf13b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:08.920293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-968e3573-ca82-4c74-acbf-cede5efcf13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fefdb1503cae4c35bc0cc053f6898b10', 'request_id': 'req-968e3573-ca82-4c74-acbf-cede5efcf13b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:08.933427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-968e3573-ca82-4c74-acbf-cede5efcf13b admin admin] The token cache is being invalidate because project fefdb1503cae4c35bc0cc053f6898b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:08.933980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-968e3573-ca82-4c74-acbf-cede5efcf13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:08.934637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-968e3573-ca82-4c74-acbf-cede5efcf13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:08.939503 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2798/5554] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:08 2022] DELETE /identity/v3/projects/fefdb1503cae4c35bc0cc053f6898b10 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:08.941044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d00682-8b13-454f-83cd-90df0bad89ea None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:08.941321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d00682-8b13-454f-83cd-90df0bad89ea None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:08.941700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d00682-8b13-454f-83cd-90df0bad89ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:08.942229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3514d3-1718-4e32-9849-216f910e529c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:08.943236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3514d3-1718-4e32-9849-216f910e529c service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:08.943720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3514d3-1718-4e32-9849-216f910e529c service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:08.944061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3514d3-1718-4e32-9849-216f910e529c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:08.945955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3e3514d3-1718-4e32-9849-216f910e529c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:08.966588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f5d00682-8b13-454f-83cd-90df0bad89ea None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:08.967690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f5d00682-8b13-454f-83cd-90df0bad89ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:09.026349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3514d3-1718-4e32-9849-216f910e529c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:09.028572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3514d3-1718-4e32-9849-216f910e529c service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:09.039678 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2757/5555] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:09.046411 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2799/5556] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:09.055333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0c09d-a039-4ee1-bed1-543b34437248 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:09.056469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0c09d-a039-4ee1-bed1-543b34437248 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:09.056830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0c09d-a039-4ee1-bed1-543b34437248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:09.088079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-34e0c09d-a039-4ee1-bed1-543b34437248 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:09.092180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-34e0c09d-a039-4ee1-bed1-543b34437248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:09.119922 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2758/5557] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:09.122146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d00682-8b13-454f-83cd-90df0bad89ea None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:09.134875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d00682-8b13-454f-83cd-90df0bad89ea None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:09.140539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5314a-3ffe-4a42-a469-5fe91a0a6dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:09.141573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5314a-3ffe-4a42-a469-5fe91a0a6dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:09.142078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5314a-3ffe-4a42-a469-5fe91a0a6dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:09.142576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5314a-3ffe-4a42-a469-5fe91a0a6dc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:09.143712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5314a-3ffe-4a42-a469-5fe91a0a6dc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:09.144415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5314a-3ffe-4a42-a469-5fe91a0a6dc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:09.146519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5314a-3ffe-4a42-a469-5fe91a0a6dc8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:09.166287 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2800/5558] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:09.169623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0c09d-a039-4ee1-bed1-543b34437248 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:09.175011 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:09.192330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0c09d-a039-4ee1-bed1-543b34437248 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:09.201786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0004263-a137-4c86-b9d1-1c25ae7f6754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:09.202987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0004263-a137-4c86-b9d1-1c25ae7f6754 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:09.203570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0004263-a137-4c86-b9d1-1c25ae7f6754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:09.204073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0004263-a137-4c86-b9d1-1c25ae7f6754 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:09.205085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0004263-a137-4c86-b9d1-1c25ae7f6754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:09.209993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0004263-a137-4c86-b9d1-1c25ae7f6754 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:09.270608 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2759/5559] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:09 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:09.272799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5314a-3ffe-4a42-a469-5fe91a0a6dc8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:09.282581 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:09.294001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5314a-3ffe-4a42-a469-5fe91a0a6dc8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:09.441947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162e451-56db-42d7-8daf-856dc15886d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:09.442846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162e451-56db-42d7-8daf-856dc15886d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:09.444060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162e451-56db-42d7-8daf-856dc15886d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:09.445188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162e451-56db-42d7-8daf-856dc15886d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:09.449116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162e451-56db-42d7-8daf-856dc15886d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:09.451619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162e451-56db-42d7-8daf-856dc15886d5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:09.516205 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2801/5560] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:09 2022] POST /identity/v3/users => generated 295 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:09.518183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0004263-a137-4c86-b9d1-1c25ae7f6754 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:09.538015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0004263-a137-4c86-b9d1-1c25ae7f6754 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:09.551484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500b3f2-b6e1-491f-ac4b-7160797abc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:09.552748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b3f2-b6e1-491f-ac4b-7160797abc71 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:09.553717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b3f2-b6e1-491f-ac4b-7160797abc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:09.554053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b3f2-b6e1-491f-ac4b-7160797abc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:09.555009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500b3f2-b6e1-491f-ac4b-7160797abc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:09.561131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500b3f2-b6e1-491f-ac4b-7160797abc71 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:09.591963 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2760/5561] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:09.593316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162e451-56db-42d7-8daf-856dc15886d5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:09.615873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162e451-56db-42d7-8daf-856dc15886d5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:09.631485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08ebeb-2a81-4e39-b4c0-f211ec8755b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:09.633002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ebeb-2a81-4e39-b4c0-f211ec8755b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:09.633305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ebeb-2a81-4e39-b4c0-f211ec8755b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:09.633615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ebeb-2a81-4e39-b4c0-f211ec8755b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:09.636760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08ebeb-2a81-4e39-b4c0-f211ec8755b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:09.639322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08ebeb-2a81-4e39-b4c0-f211ec8755b7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:09.653845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500b3f2-b6e1-491f-ac4b-7160797abc71 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:09.655991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6500b3f2-b6e1-491f-ac4b-7160797abc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:09.663786 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2802/5562] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:09.665604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08ebeb-2a81-4e39-b4c0-f211ec8755b7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:09.678134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500b3f2-b6e1-491f-ac4b-7160797abc71 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:09.685967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:09.686779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:09.687187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:09.687566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] PATH_INFO: `/v3/projects/0d53034488714fc8980132211d0d5c0b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:09.689169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d53034488714fc8980132211d0d5c0b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:09.691227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:09.693553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08ebeb-2a81-4e39-b4c0-f211ec8755b7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:09.701833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f51b3d-9e58-419d-8a27-88e5f7565a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:09.702827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f51b3d-9e58-419d-8a27-88e5f7565a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:09.703267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f51b3d-9e58-419d-8a27-88e5f7565a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:09.703684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f51b3d-9e58-419d-8a27-88e5f7565a21 admin admin] PATH_INFO: `/v3/projects/a5ab9db3284e48379c07365d7699c9c3/users/0d1649e51b3e44e780c6a6ed1d36f2fd/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:09.752968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f51b3d-9e58-419d-8a27-88e5f7565a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ab9db3284e48379c07365d7699c9c3, user_id=0d1649e51b3e44e780c6a6ed1d36f2fd, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:09.758621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f51b3d-9e58-419d-8a27-88e5f7565a21 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:09.780306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d53034488714fc8980132211d0d5c0b', 'request_id': 'req-bdd7f720-ac3c-470a-b3be-ec88144d1543'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:09.789181 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2803/5563] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:09 2022] PUT /identity/v3/projects/a5ab9db3284e48379c07365d7699c9c3/users/0d1649e51b3e44e780c6a6ed1d36f2fd/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:09.795242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d53034488714fc8980132211d0d5c0b', 'request_id': 'req-bdd7f720-ac3c-470a-b3be-ec88144d1543'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:09.805356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f9021-378e-4203-9e4c-58337ddb4725 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:09.805652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f9021-378e-4203-9e4c-58337ddb4725 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:09.805946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f9021-378e-4203-9e4c-58337ddb4725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:09.818889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d53034488714fc8980132211d0d5c0b', 'request_id': 'req-bdd7f720-ac3c-470a-b3be-ec88144d1543'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:09.851141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-692f9021-378e-4203-9e4c-58337ddb4725 None None] MFA Rules not processed for user `0d1649e51b3e44e780c6a6ed1d36f2fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:09.857932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-692f9021-378e-4203-9e4c-58337ddb4725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:09.860455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] The token cache is being invalidate because project 0d53034488714fc8980132211d0d5c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:09.860455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:09.861163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:09.866074 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2761/5564] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:09 2022] DELETE /identity/v3/projects/0d53034488714fc8980132211d0d5c0b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:09.870239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:09.871811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:09.988248 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2804/5565] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:09.993486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f9021-378e-4203-9e4c-58337ddb4725 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:09.996713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-692f9021-378e-4203-9e4c-58337ddb4725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:10.033650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7f720-ac3c-470a-b3be-ec88144d1543 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:10.133519 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:10.154074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f9021-378e-4203-9e4c-58337ddb4725 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:10.160388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6a740-2879-4a27-b67b-327eabb0f088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:10.161253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6a740-2879-4a27-b67b-327eabb0f088 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:10.163328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6a740-2879-4a27-b67b-327eabb0f088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:10.163703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6a740-2879-4a27-b67b-327eabb0f088 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:10.165393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6a740-2879-4a27-b67b-327eabb0f088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:10.167592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6a740-2879-4a27-b67b-327eabb0f088 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:10.198697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:10.199716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:10.200005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:10.200284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] PATH_INFO: `/v3/users/1054183fb3d7417998116c710da08448` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:10.209300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1054183fb3d7417998116c710da08448)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:10.216352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:10.219550 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:10.241147 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2805/5566] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:09 2022] POST /identity/v3/projects => generated 387 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:10.245301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6a740-2879-4a27-b67b-327eabb0f088 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:10.337475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1054183fb3d7417998116c710da08448'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:10.338724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1054183fb3d7417998116c710da08448'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:10.357717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1054183fb3d7417998116c710da08448'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:10.371356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1054183fb3d7417998116c710da08448'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:10.372231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1054183fb3d7417998116c710da08448'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:10.381811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6a740-2879-4a27-b67b-327eabb0f088 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:10.399051 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2762/5567] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:09 2022] DELETE /identity/v3/users/1054183fb3d7417998116c710da08448 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:10.402136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2c9de-850c-4ea7-b5bf-3262c6f6fb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:10.402772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2c9de-850c-4ea7-b5bf-3262c6f6fb2f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:10.403078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2c9de-850c-4ea7-b5bf-3262c6f6fb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:10.403350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2c9de-850c-4ea7-b5bf-3262c6f6fb2f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:10.404320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2c9de-850c-4ea7-b5bf-3262c6f6fb2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:10.405903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2c9de-850c-4ea7-b5bf-3262c6f6fb2f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:10.441621 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2806/5568] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:10 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:27:10.445927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:10.448458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:10.536251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7e871-f46a-4178-8b9a-fec29c064dff admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:10.541878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54005744-0fc3-4565-87ad-ec7f762fbfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:10.553673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54005744-0fc3-4565-87ad-ec7f762fbfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:10.554314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54005744-0fc3-4565-87ad-ec7f762fbfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:10.554788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54005744-0fc3-4565-87ad-ec7f762fbfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:10.555712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54005744-0fc3-4565-87ad-ec7f762fbfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:10.570038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54005744-0fc3-4565-87ad-ec7f762fbfc6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:10.581542 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2763/5569] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:10.585909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2c9de-850c-4ea7-b5bf-3262c6f6fb2f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:10.605826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2c9de-850c-4ea7-b5bf-3262c6f6fb2f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:10.618370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d224-4d5a-4795-8db0-7bb8fde53549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:10.619599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d224-4d5a-4795-8db0-7bb8fde53549 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:10.624434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d224-4d5a-4795-8db0-7bb8fde53549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:10.624973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d224-4d5a-4795-8db0-7bb8fde53549 admin admin] PATH_INFO: `/v3/projects/3150af876ae04de2b7583da7c731bc74/users/dad9e5c7055a43e7bed0c747f3565a0c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:10.655654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950d224-4d5a-4795-8db0-7bb8fde53549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3150af876ae04de2b7583da7c731bc74, user_id=dad9e5c7055a43e7bed0c747f3565a0c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:10.659565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950d224-4d5a-4795-8db0-7bb8fde53549 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:10.683119 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2807/5570] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:10 2022] PUT /identity/v3/projects/3150af876ae04de2b7583da7c731bc74/users/dad9e5c7055a43e7bed0c747f3565a0c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:10.684646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54005744-0fc3-4565-87ad-ec7f762fbfc6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:10.702566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54005744-0fc3-4565-87ad-ec7f762fbfc6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:10.718669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d224-4d5a-4795-8db0-7bb8fde53549 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:10.720838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2950d224-4d5a-4795-8db0-7bb8fde53549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:10.812653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d224-4d5a-4795-8db0-7bb8fde53549 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:10.819976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5589d-8785-4ec8-9d66-6086a8c7ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:10.821147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5589d-8785-4ec8-9d66-6086a8c7ba98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:10.821537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5589d-8785-4ec8-9d66-6086a8c7ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:10.822234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5589d-8785-4ec8-9d66-6086a8c7ba98 admin admin] PATH_INFO: `/v3/users/a206e426d3e74c04a2248e2410a152c6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:10.823513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5589d-8785-4ec8-9d66-6086a8c7ba98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a206e426d3e74c04a2248e2410a152c6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:10.825749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5589d-8785-4ec8-9d66-6086a8c7ba98 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:10.839829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3687b9-6617-4c05-be55-2d8993b57fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:10.840483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3687b9-6617-4c05-be55-2d8993b57fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:10.841110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3687b9-6617-4c05-be55-2d8993b57fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:10.841110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3687b9-6617-4c05-be55-2d8993b57fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:10.841659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3687b9-6617-4c05-be55-2d8993b57fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:10.844744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3687b9-6617-4c05-be55-2d8993b57fe9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:10.864038 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2764/5571] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:10.865149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3687b9-6617-4c05-be55-2d8993b57fe9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:10.878967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3687b9-6617-4c05-be55-2d8993b57fe9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:10.882488 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:10.884717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf3867-ac25-4124-9929-e90e9682d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:10.885812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf3867-ac25-4124-9929-e90e9682d505 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:10.886490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf3867-ac25-4124-9929-e90e9682d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:10.886781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf3867-ac25-4124-9929-e90e9682d505 admin admin] PATH_INFO: `/v3/projects/3150af876ae04de2b7583da7c731bc74/users/dad9e5c7055a43e7bed0c747f3565a0c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:10.889947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf3867-ac25-4124-9929-e90e9682d505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3150af876ae04de2b7583da7c731bc74, user_id=dad9e5c7055a43e7bed0c747f3565a0c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:10.891057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0ef5589d-8785-4ec8-9d66-6086a8c7ba98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a206e426d3e74c04a2248e2410a152c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:10.893749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf3867-ac25-4124-9929-e90e9682d505 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:10.893867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0ef5589d-8785-4ec8-9d66-6086a8c7ba98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a206e426d3e74c04a2248e2410a152c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:10.902179 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:10.912522 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2765/5572] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:10 2022] PUT /identity/v3/projects/3150af876ae04de2b7583da7c731bc74/users/dad9e5c7055a43e7bed0c747f3565a0c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:10.915464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0ef5589d-8785-4ec8-9d66-6086a8c7ba98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a206e426d3e74c04a2248e2410a152c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:10.922442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13cef4-bce3-4f4b-804c-b9d7f585a5fc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:10.922831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13cef4-bce3-4f4b-804c-b9d7f585a5fc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:10.923216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13cef4-bce3-4f4b-804c-b9d7f585a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:10.928963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0ef5589d-8785-4ec8-9d66-6086a8c7ba98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a206e426d3e74c04a2248e2410a152c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:10.930010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0ef5589d-8785-4ec8-9d66-6086a8c7ba98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a206e426d3e74c04a2248e2410a152c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:10.962401 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2808/5573] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:10 2022] DELETE /identity/v3/users/a206e426d3e74c04a2248e2410a152c6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:10.964955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6abb07-ae72-4f3b-91d6-b7c9a256c1d6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:10.965105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6abb07-ae72-4f3b-91d6-b7c9a256c1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:10.965377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6abb07-ae72-4f3b-91d6-b7c9a256c1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:10.978393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-da13cef4-bce3-4f4b-804c-b9d7f585a5fc None None] MFA Rules not processed for user `dad9e5c7055a43e7bed0c747f3565a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:10.979651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-da13cef4-bce3-4f4b-804c-b9d7f585a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:10.994347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ff6abb07-ae72-4f3b-91d6-b7c9a256c1d6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:10.995878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ff6abb07-ae72-4f3b-91d6-b7c9a256c1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:11.112780 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2766/5574] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:11.113304 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2809/5575] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:11.118896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13cef4-bce3-4f4b-804c-b9d7f585a5fc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:11.122568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6abb07-ae72-4f3b-91d6-b7c9a256c1d6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:11.127571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ff6abb07-ae72-4f3b-91d6-b7c9a256c1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:11.147051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13cef4-bce3-4f4b-804c-b9d7f585a5fc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:11.162306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5cc86-3ec4-44ce-a098-1a70d0587210 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:11.163090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5cc86-3ec4-44ce-a098-1a70d0587210 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:11.163526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5cc86-3ec4-44ce-a098-1a70d0587210 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:11.163807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5cc86-3ec4-44ce-a098-1a70d0587210 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:11.164559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5cc86-3ec4-44ce-a098-1a70d0587210 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:11.166636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5cc86-3ec4-44ce-a098-1a70d0587210 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:11.216407 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2767/5576] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:27:11 2022] POST /identity/v3/domains => generated 276 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:27:11.216774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5cc86-3ec4-44ce-a098-1a70d0587210 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:11.281212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6abb07-ae72-4f3b-91d6-b7c9a256c1d6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:11.359742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5cc86-3ec4-44ce-a098-1a70d0587210 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:11.366275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc071a25-8437-45b5-9333-d4ff347383ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:11.366814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b823c7-af50-4bb9-9b33-dbc9c8b397f0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:11.366977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc071a25-8437-45b5-9333-d4ff347383ab service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:11.367202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc071a25-8437-45b5-9333-d4ff347383ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:11.367475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc071a25-8437-45b5-9333-d4ff347383ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:11.368157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b823c7-af50-4bb9-9b33-dbc9c8b397f0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:11.368444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b823c7-af50-4bb9-9b33-dbc9c8b397f0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:11.368724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b823c7-af50-4bb9-9b33-dbc9c8b397f0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/961f09dc21c74689845f56c29c035c0b/config` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:11.369411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b823c7-af50-4bb9-9b33-dbc9c8b397f0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=961f09dc21c74689845f56c29c035c0b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:11.370429 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-99b823c7-af50-4bb9-9b33-dbc9c8b397f0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:11.370429 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:27:11.370429 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:27:11.371464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b823c7-af50-4bb9-9b33-dbc9c8b397f0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:11.423621 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2768/5577] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:27:11 2022] PUT /identity/v3/domains/961f09dc21c74689845f56c29c035c0b/config => generated 138 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:27:11.424934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b823c7-af50-4bb9-9b33-dbc9c8b397f0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:11.427731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-99b823c7-af50-4bb9-9b33-dbc9c8b397f0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:11.429275 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:11.476226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc071a25-8437-45b5-9333-d4ff347383ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:11.477989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc071a25-8437-45b5-9333-d4ff347383ab service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:11.489272 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2810/5578] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:27:11.491163 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:11.491505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc071a25-8437-45b5-9333-d4ff347383ab service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:11.508670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc071a25-8437-45b5-9333-d4ff347383ab service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:11.513852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c779bc-ac83-49f8-bd34-2cc90c4c4db7 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:11.515728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c779bc-ac83-49f8-bd34-2cc90c4c4db7 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:11.516219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c779bc-ac83-49f8-bd34-2cc90c4c4db7 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:11.516611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c779bc-ac83-49f8-bd34-2cc90c4c4db7 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/961f09dc21c74689845f56c29c035c0b/config/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:11.518014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c779bc-ac83-49f8-bd34-2cc90c4c4db7 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=961f09dc21c74689845f56c29c035c0b, group=identity)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:11.519309 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-f7c779bc-ac83-49f8-bd34-2cc90c4c4db7 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:11.519309 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:27:11.519309 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:27:11.521773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b823c7-af50-4bb9-9b33-dbc9c8b397f0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:11.522546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c779bc-ac83-49f8-bd34-2cc90c4c4db7 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:11.529554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd36b6-16da-4f95-a20c-63f7b6c7f884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:11.530629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd36b6-16da-4f95-a20c-63f7b6c7f884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:11.531088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd36b6-16da-4f95-a20c-63f7b6c7f884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:11.531525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd36b6-16da-4f95-a20c-63f7b6c7f884 admin admin] PATH_INFO: `/v3/projects/bde8798c6adc4297805fbb316f563785` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:11.533179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd36b6-16da-4f95-a20c-63f7b6c7f884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bde8798c6adc4297805fbb316f563785)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:11.535850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd36b6-16da-4f95-a20c-63f7b6c7f884 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:11.536259 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2811/5579] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:27:11 2022] GET /identity/v3/domains/961f09dc21c74689845f56c29c035c0b/config/identity => generated 45 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:11.537386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c779bc-ac83-49f8-bd34-2cc90c4c4db7 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:11.564741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c779bc-ac83-49f8-bd34-2cc90c4c4db7 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:11.580072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4d6e8-dc5e-46ca-8404-c3a97ba190be tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:11.580758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d6e8-dc5e-46ca-8404-c3a97ba190be tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:11.581036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d6e8-dc5e-46ca-8404-c3a97ba190be tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:11.581614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d6e8-dc5e-46ca-8404-c3a97ba190be tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/961f09dc21c74689845f56c29c035c0b/config/identity/driver` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:11.584127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4d6e8-dc5e-46ca-8404-c3a97ba190be tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=961f09dc21c74689845f56c29c035c0b, group=identity, option=driver)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:11.588286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4d6e8-dc5e-46ca-8404-c3a97ba190be tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:11.604779 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2812/5580] 10.222.0.39 () {58 vars in 1296 bytes} [Sun Oct 16 01:27:11 2022] GET /identity/v3/domains/961f09dc21c74689845f56c29c035c0b/config/identity/driver => generated 31 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:11.610084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4d6e8-dc5e-46ca-8404-c3a97ba190be tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:11.623754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4d6e8-dc5e-46ca-8404-c3a97ba190be tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:11.648792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e02db-955f-4af9-8d47-e622ebf216dc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:11.651862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e02db-955f-4af9-8d47-e622ebf216dc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:11.651988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e02db-955f-4af9-8d47-e622ebf216dc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:11.653681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e02db-955f-4af9-8d47-e622ebf216dc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/961f09dc21c74689845f56c29c035c0b/config/ldap` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:11.655447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e02db-955f-4af9-8d47-e622ebf216dc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=961f09dc21c74689845f56c29c035c0b, group=ldap)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:11.661628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e02db-955f-4af9-8d47-e622ebf216dc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:11.679375 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2813/5581] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:27:11 2022] GET /identity/v3/domains/961f09dc21c74689845f56c29c035c0b/config/ldap => generated 106 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:11.681315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e02db-955f-4af9-8d47-e622ebf216dc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:11.686135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-47dd36b6-16da-4f95-a20c-63f7b6c7f884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde8798c6adc4297805fbb316f563785', 'request_id': 'req-47dd36b6-16da-4f95-a20c-63f7b6c7f884'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:11.702552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-47dd36b6-16da-4f95-a20c-63f7b6c7f884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde8798c6adc4297805fbb316f563785', 'request_id': 'req-47dd36b6-16da-4f95-a20c-63f7b6c7f884'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:11.706301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e02db-955f-4af9-8d47-e622ebf216dc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:11.713720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-47dd36b6-16da-4f95-a20c-63f7b6c7f884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde8798c6adc4297805fbb316f563785', 'request_id': 'req-47dd36b6-16da-4f95-a20c-63f7b6c7f884'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:11.731629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-47dd36b6-16da-4f95-a20c-63f7b6c7f884 admin admin] The token cache is being invalidate because project bde8798c6adc4297805fbb316f563785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:11.731926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-47dd36b6-16da-4f95-a20c-63f7b6c7f884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:11.732933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-47dd36b6-16da-4f95-a20c-63f7b6c7f884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:11.738431 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2769/5582] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:11 2022] DELETE /identity/v3/projects/bde8798c6adc4297805fbb316f563785 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:11.744333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e307af-c1ef-486d-a2ac-0f26ac28d5c9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:11.744620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e307af-c1ef-486d-a2ac-0f26ac28d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:11.744899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e307af-c1ef-486d-a2ac-0f26ac28d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:11.807339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a9e307af-c1ef-486d-a2ac-0f26ac28d5c9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:11.809645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a9e307af-c1ef-486d-a2ac-0f26ac28d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:11.815286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f97da-85b3-486f-9d81-4cdfe9e0ca96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:11.816060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f97da-85b3-486f-9d81-4cdfe9e0ca96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:11.816414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f97da-85b3-486f-9d81-4cdfe9e0ca96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:11.816767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f97da-85b3-486f-9d81-4cdfe9e0ca96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/961f09dc21c74689845f56c29c035c0b/config/ldap/url` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:11.818610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f97da-85b3-486f-9d81-4cdfe9e0ca96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=961f09dc21c74689845f56c29c035c0b, group=ldap, option=url)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:11.820569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f97da-85b3-486f-9d81-4cdfe9e0ca96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:11.826871 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2814/5583] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:27:11 2022] GET /identity/v3/domains/961f09dc21c74689845f56c29c035c0b/config/ldap/url => generated 46 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:11.830807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f97da-85b3-486f-9d81-4cdfe9e0ca96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:11.835189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a09f97da-85b3-486f-9d81-4cdfe9e0ca96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:11.866209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f97da-85b3-486f-9d81-4cdfe9e0ca96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:11.879037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d30c4-57df-47f8-aab2-3b0a3ece5afb tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:11.879870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d30c4-57df-47f8-aab2-3b0a3ece5afb tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:11.883543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d30c4-57df-47f8-aab2-3b0a3ece5afb tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:11.883981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d30c4-57df-47f8-aab2-3b0a3ece5afb tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/961f09dc21c74689845f56c29c035c0b/config/ldap/user_tree_dn` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:11.887425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d30c4-57df-47f8-aab2-3b0a3ece5afb tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=961f09dc21c74689845f56c29c035c0b, group=ldap, option=user_tree_dn)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:11.889158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d30c4-57df-47f8-aab2-3b0a3ece5afb tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:11.901381 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2770/5584] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:11.911044 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2815/5585] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:27:11 2022] GET /identity/v3/domains/961f09dc21c74689845f56c29c035c0b/config/ldap/user_tree_dn => generated 63 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:11.912089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91130619-eae2-4dac-88e0-db5aa1842ae8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:11.912435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91130619-eae2-4dac-88e0-db5aa1842ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:11.912766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91130619-eae2-4dac-88e0-db5aa1842ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:11.914873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d30c4-57df-47f8-aab2-3b0a3ece5afb tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:11.931662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d30c4-57df-47f8-aab2-3b0a3ece5afb tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:11.938179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-91130619-eae2-4dac-88e0-db5aa1842ae8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:11.939706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-91130619-eae2-4dac-88e0-db5aa1842ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:11.944085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d79696-7a5b-495a-ae7d-e6bd48f4f46d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:11.944855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d79696-7a5b-495a-ae7d-e6bd48f4f46d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:11.945141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d79696-7a5b-495a-ae7d-e6bd48f4f46d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:11.945422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d79696-7a5b-495a-ae7d-e6bd48f4f46d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/961f09dc21c74689845f56c29c035c0b/config` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:11.946156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d79696-7a5b-495a-ae7d-e6bd48f4f46d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=961f09dc21c74689845f56c29c035c0b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:11.948925 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-96d79696-7a5b-495a-ae7d-e6bd48f4f46d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:11.948925 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:27:11.948925 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:27:11.952030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d79696-7a5b-495a-ae7d-e6bd48f4f46d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:11.957177 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2771/5586] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:11.960492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91130619-eae2-4dac-88e0-db5aa1842ae8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:11.975243 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2816/5587] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:27:11 2022] DELETE /identity/v3/domains/961f09dc21c74689845f56c29c035c0b/config => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:27:11.979993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91130619-eae2-4dac-88e0-db5aa1842ae8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:11.981326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d79696-7a5b-495a-ae7d-e6bd48f4f46d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:11.990235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3015cec-dc03-4fa6-aca6-d7dc6c58097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:11.990854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3015cec-dc03-4fa6-aca6-d7dc6c58097a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:11.991294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3015cec-dc03-4fa6-aca6-d7dc6c58097a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:11.991572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3015cec-dc03-4fa6-aca6-d7dc6c58097a admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:11.992617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3015cec-dc03-4fa6-aca6-d7dc6c58097a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:11.992945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3015cec-dc03-4fa6-aca6-d7dc6c58097a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:11.996113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3015cec-dc03-4fa6-aca6-d7dc6c58097a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:12.008802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d79696-7a5b-495a-ae7d-e6bd48f4f46d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:12.016175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c73af-22b6-4430-b039-6a66521ab605 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:12.017084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c73af-22b6-4430-b039-6a66521ab605 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:12.017681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c73af-22b6-4430-b039-6a66521ab605 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:12.017681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c73af-22b6-4430-b039-6a66521ab605 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/961f09dc21c74689845f56c29c035c0b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:12.019247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c73af-22b6-4430-b039-6a66521ab605 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=961f09dc21c74689845f56c29c035c0b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:12.022013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c73af-22b6-4430-b039-6a66521ab605 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:12.028773 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2772/5588] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:12.030510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3015cec-dc03-4fa6-aca6-d7dc6c58097a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:12.055410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3015cec-dc03-4fa6-aca6-d7dc6c58097a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:12.060892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b6c73af-22b6-4430-b039-6a66521ab605 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '961f09dc21c74689845f56c29c035c0b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.061902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0cbb6-d8fa-4e0e-96d0-2e63afe46e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:12.062239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b6c73af-22b6-4430-b039-6a66521ab605 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '961f09dc21c74689845f56c29c035c0b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.062968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0cbb6-d8fa-4e0e-96d0-2e63afe46e1b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:12.063472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0cbb6-d8fa-4e0e-96d0-2e63afe46e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:12.063839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0cbb6-d8fa-4e0e-96d0-2e63afe46e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:12.065968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0cbb6-d8fa-4e0e-96d0-2e63afe46e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:12.068716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0cbb6-d8fa-4e0e-96d0-2e63afe46e1b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:12.134315 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2773/5589] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:12 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:27:12.152257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0cbb6-d8fa-4e0e-96d0-2e63afe46e1b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:12.152735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b6c73af-22b6-4430-b039-6a66521ab605 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '961f09dc21c74689845f56c29c035c0b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.154327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b6c73af-22b6-4430-b039-6a66521ab605 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '961f09dc21c74689845f56c29c035c0b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.167792 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2817/5590] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:27:11 2022] PATCH /identity/v3/domains/961f09dc21c74689845f56c29c035c0b => generated 277 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:12.169088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c73af-22b6-4430-b039-6a66521ab605 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:12.169565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-53c0cbb6-d8fa-4e0e-96d0-2e63afe46e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:12.176742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8b6c73af-22b6-4430-b039-6a66521ab605 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:12.239351 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:12.284975 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:12.305429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0cbb6-d8fa-4e0e-96d0-2e63afe46e1b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:12.311806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687df78-7874-4f15-8aa9-30e1918a337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:12.312364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687df78-7874-4f15-8aa9-30e1918a337f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:12.312642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687df78-7874-4f15-8aa9-30e1918a337f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:12.312971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687df78-7874-4f15-8aa9-30e1918a337f admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:12.314081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687df78-7874-4f15-8aa9-30e1918a337f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:12.316143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687df78-7874-4f15-8aa9-30e1918a337f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:12.351485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c73af-22b6-4430-b039-6a66521ab605 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:12.357173 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2774/5591] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:12 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:12.359750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687df78-7874-4f15-8aa9-30e1918a337f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:12.361848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:12.362932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:12.365767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:12.366296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] PATH_INFO: `/v3/projects/5a378b67fde14fc4867b4b9143abbfcf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:12.367405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0687df78-7874-4f15-8aa9-30e1918a337f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:12.371225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a378b67fde14fc4867b4b9143abbfcf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:12.373422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:12.480681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a378b67fde14fc4867b4b9143abbfcf', 'request_id': 'req-f88343be-eb98-4d3e-bf04-164581d7bf92'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.490817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a378b67fde14fc4867b4b9143abbfcf', 'request_id': 'req-f88343be-eb98-4d3e-bf04-164581d7bf92'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.502576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687df78-7874-4f15-8aa9-30e1918a337f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:12.503457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a378b67fde14fc4867b4b9143abbfcf', 'request_id': 'req-f88343be-eb98-4d3e-bf04-164581d7bf92'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.532034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] The token cache is being invalidate because project 5a378b67fde14fc4867b4b9143abbfcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:12.532402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.533886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.541711 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2818/5592] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:12 2022] DELETE /identity/v3/projects/5a378b67fde14fc4867b4b9143abbfcf => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:12.542942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:12.545449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:12.643161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:12.644057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:12.644840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:12.647620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/961f09dc21c74689845f56c29c035c0b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:12.676830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=961f09dc21c74689845f56c29c035c0b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:12.682428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:12.691940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88343be-eb98-4d3e-bf04-164581d7bf92 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:12.705245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd03b7e-5787-4066-a21f-3045ce85b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:12.706027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd03b7e-5787-4066-a21f-3045ce85b477 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:12.706534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd03b7e-5787-4066-a21f-3045ce85b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:12.706968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd03b7e-5787-4066-a21f-3045ce85b477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:12.707695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd03b7e-5787-4066-a21f-3045ce85b477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:12.714549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd03b7e-5787-4066-a21f-3045ce85b477 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:12.737527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '961f09dc21c74689845f56c29c035c0b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.739476 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2819/5593] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:12.741861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c4687-0965-4882-b2c3-f70daa359df1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:12.741861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c4687-0965-4882-b2c3-f70daa359df1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:12.745235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c4687-0965-4882-b2c3-f70daa359df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:12.757171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '961f09dc21c74689845f56c29c035c0b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.796507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-be3c4687-0965-4882-b2c3-f70daa359df1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:12.798441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-be3c4687-0965-4882-b2c3-f70daa359df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:12.816037 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2820/5594] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:12.826014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c4687-0965-4882-b2c3-f70daa359df1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:12.850092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c4687-0965-4882-b2c3-f70daa359df1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:12.853805 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:12.878373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '961f09dc21c74689845f56c29c035c0b', 'request_id': 'req-ef50cb66-b9b9-4a86-8378-89374974b139'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.902898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '961f09dc21c74689845f56c29c035c0b', 'request_id': 'req-ef50cb66-b9b9-4a86-8378-89374974b139'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.929322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '961f09dc21c74689845f56c29c035c0b', 'request_id': 'req-ef50cb66-b9b9-4a86-8378-89374974b139'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.961709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] The token cache is being invalidate because project 961f09dc21c74689845f56c29c035c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:12.962363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.963283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.981982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '961f09dc21c74689845f56c29c035c0b', 'request_id': 'req-ef50cb66-b9b9-4a86-8378-89374974b139'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.982873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '961f09dc21c74689845f56c29c035c0b', 'request_id': 'req-ef50cb66-b9b9-4a86-8378-89374974b139'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:12.983677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef50cb66-b9b9-4a86-8378-89374974b139 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '961f09dc21c74689845f56c29c035c0b', 'request_id': 'req-ef50cb66-b9b9-4a86-8378-89374974b139'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:13.006741 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2775/5595] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:27:12 2022] DELETE /identity/v3/domains/961f09dc21c74689845f56c29c035c0b => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:13.008560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dac49-ab0b-465e-ae6c-aefe623b0209 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:13.009503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dac49-ab0b-465e-ae6c-aefe623b0209 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:13.010153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dac49-ab0b-465e-ae6c-aefe623b0209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:13.044409 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:13.052117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2b6dac49-ab0b-465e-ae6c-aefe623b0209 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:13.053487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2b6dac49-ab0b-465e-ae6c-aefe623b0209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:13.056668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3701e-9f0b-41de-911c-e52d5f1ebc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:13.058159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3701e-9f0b-41de-911c-e52d5f1ebc7b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:13.058427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3701e-9f0b-41de-911c-e52d5f1ebc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:13.059002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3701e-9f0b-41de-911c-e52d5f1ebc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:13.059753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3701e-9f0b-41de-911c-e52d5f1ebc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:13.067454 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2776/5596] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:13.067454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dac49-ab0b-465e-ae6c-aefe623b0209 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:13.067454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2b6dac49-ab0b-465e-ae6c-aefe623b0209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:13.071595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3701e-9f0b-41de-911c-e52d5f1ebc7b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:13.081393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dac49-ab0b-465e-ae6c-aefe623b0209 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:13.087538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:13.088232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:13.088660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:13.089309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] PATH_INFO: `/v3/users/6996fb89baee4171ac947efb7cbfe145` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:13.089501 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2821/5597] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:13.090513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6996fb89baee4171ac947efb7cbfe145)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:13.090620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3701e-9f0b-41de-911c-e52d5f1ebc7b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:13.092237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-34e3701e-9f0b-41de-911c-e52d5f1ebc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:13.093409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:13.191697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6996fb89baee4171ac947efb7cbfe145'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:13.192885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6996fb89baee4171ac947efb7cbfe145'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:13.245088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3701e-9f0b-41de-911c-e52d5f1ebc7b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:13.251225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6996fb89baee4171ac947efb7cbfe145'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:13.261774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebae6bb-3f76-49dc-a5b3-a7d48e04acc9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:13.265148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebae6bb-3f76-49dc-a5b3-a7d48e04acc9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:13.265496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebae6bb-3f76-49dc-a5b3-a7d48e04acc9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:13.265861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebae6bb-3f76-49dc-a5b3-a7d48e04acc9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:13.268023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebae6bb-3f76-49dc-a5b3-a7d48e04acc9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:13.271281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6996fb89baee4171ac947efb7cbfe145'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:13.272745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6996fb89baee4171ac947efb7cbfe145'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:13.282283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebae6bb-3f76-49dc-a5b3-a7d48e04acc9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:13.331494 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2777/5598] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:13 2022] DELETE /identity/v3/users/6996fb89baee4171ac947efb7cbfe145 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:13.334652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:13.336514 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2822/5599] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:27:13 2022] POST /identity/v3/domains => generated 276 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:13.346862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:13.347626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebae6bb-3f76-49dc-a5b3-a7d48e04acc9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:13.351191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0ebae6bb-3f76-49dc-a5b3-a7d48e04acc9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:13.490770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebae6bb-3f76-49dc-a5b3-a7d48e04acc9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:13.502257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291334aa-1851-4772-9ea0-e7b7289f2a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:13.502955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291334aa-1851-4772-9ea0-e7b7289f2a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:13.503240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291334aa-1851-4772-9ea0-e7b7289f2a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:13.509740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291334aa-1851-4772-9ea0-e7b7289f2a0a admin admin] PATH_INFO: `/v3/projects/24191805b45e4a9b9575e5d989a6c6f9/users/f5f42a99ffbe407bb43f8aee0091f130/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:13.536101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291334aa-1851-4772-9ea0-e7b7289f2a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24191805b45e4a9b9575e5d989a6c6f9, user_id=f5f42a99ffbe407bb43f8aee0091f130, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:13.537575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae27d7e-e1e6-46c6-9a7d-a86938fbfc74 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:13.539444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291334aa-1851-4772-9ea0-e7b7289f2a0a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:13.559862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97455d-239f-491c-aed2-fa7c477dcf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:13.560416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97455d-239f-491c-aed2-fa7c477dcf49 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:13.560742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97455d-239f-491c-aed2-fa7c477dcf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:13.560991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97455d-239f-491c-aed2-fa7c477dcf49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:13.562119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97455d-239f-491c-aed2-fa7c477dcf49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:13.562119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97455d-239f-491c-aed2-fa7c477dcf49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:13.562816 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2823/5600] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:13 2022] PUT /identity/v3/projects/24191805b45e4a9b9575e5d989a6c6f9/users/f5f42a99ffbe407bb43f8aee0091f130/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:13.563592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97455d-239f-491c-aed2-fa7c477dcf49 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:13.564927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fed458-7b9f-4a7d-b083-cb263109ad2b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:13.565315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fed458-7b9f-4a7d-b083-cb263109ad2b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:13.565708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fed458-7b9f-4a7d-b083-cb263109ad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:13.594474 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2778/5601] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:13.595815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1e6f1-ac72-4799-a45d-27c6b64c54d0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:13.596103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1e6f1-ac72-4799-a45d-27c6b64c54d0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:13.596386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1e6f1-ac72-4799-a45d-27c6b64c54d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:13.613358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-01fed458-7b9f-4a7d-b083-cb263109ad2b None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:13.615359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-01fed458-7b9f-4a7d-b083-cb263109ad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:13.618313 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:13.644093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2ae1e6f1-ac72-4799-a45d-27c6b64c54d0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:13.648295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2ae1e6f1-ac72-4799-a45d-27c6b64c54d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:13.740890 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2824/5602] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:27:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:13.742694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fed458-7b9f-4a7d-b083-cb263109ad2b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:13.744340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-01fed458-7b9f-4a7d-b083-cb263109ad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:13.752979 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:13.761849 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2779/5603] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:13.763829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafde82-647d-4342-9fc3-b52e055b59ef None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:13.764188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafde82-647d-4342-9fc3-b52e055b59ef None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:13.764578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafde82-647d-4342-9fc3-b52e055b59ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:13.802202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2bafde82-647d-4342-9fc3-b52e055b59ef None None] MFA Rules not processed for user `f5f42a99ffbe407bb43f8aee0091f130`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:13.803643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2bafde82-647d-4342-9fc3-b52e055b59ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:13.848632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fed458-7b9f-4a7d-b083-cb263109ad2b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:13.858601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e685e-a31c-4360-8b05-4fc236ef4a5d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:13.859560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e685e-a31c-4360-8b05-4fc236ef4a5d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:13.860484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e685e-a31c-4360-8b05-4fc236ef4a5d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:13.860912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e685e-a31c-4360-8b05-4fc236ef4a5d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/367b9b98a547411ea239bd7b855e66ba/config` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:13.862726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e685e-a31c-4360-8b05-4fc236ef4a5d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=367b9b98a547411ea239bd7b855e66ba)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:13.864330 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-596e685e-a31c-4360-8b05-4fc236ef4a5d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:13.864330 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:27:13.864330 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:27:13.867383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e685e-a31c-4360-8b05-4fc236ef4a5d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:13.899101 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2780/5604] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:13.900341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafde82-647d-4342-9fc3-b52e055b59ef None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:13.914727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafde82-647d-4342-9fc3-b52e055b59ef None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:13.919114 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2825/5605] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:27:13 2022] PUT /identity/v3/domains/367b9b98a547411ea239bd7b855e66ba/config => generated 138 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:13.921074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e685e-a31c-4360-8b05-4fc236ef4a5d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:13.924223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-596e685e-a31c-4360-8b05-4fc236ef4a5d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:13.929525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941a6ed-1249-48d2-a0a4-79ad80357492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:13.930170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941a6ed-1249-48d2-a0a4-79ad80357492 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:13.930451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941a6ed-1249-48d2-a0a4-79ad80357492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:13.930723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941a6ed-1249-48d2-a0a4-79ad80357492 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:13.931419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941a6ed-1249-48d2-a0a4-79ad80357492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:13.933449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941a6ed-1249-48d2-a0a4-79ad80357492 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:13.972748 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2781/5606] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:13 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:13.974204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941a6ed-1249-48d2-a0a4-79ad80357492 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:13.978461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6941a6ed-1249-48d2-a0a4-79ad80357492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:14.028731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e685e-a31c-4360-8b05-4fc236ef4a5d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:14.099223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9bd2b-5e93-472b-8953-9242e4f1e6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:14.099828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9bd2b-5e93-472b-8953-9242e4f1e6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:14.100361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9bd2b-5e93-472b-8953-9242e4f1e6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:14.100690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9bd2b-5e93-472b-8953-9242e4f1e6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:14.149052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941a6ed-1249-48d2-a0a4-79ad80357492 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:14.158746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7afdfe-00e2-4f29-8eb1-6edfcca6e8a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:14.159403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7afdfe-00e2-4f29-8eb1-6edfcca6e8a1 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:14.160150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7afdfe-00e2-4f29-8eb1-6edfcca6e8a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:14.160457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7afdfe-00e2-4f29-8eb1-6edfcca6e8a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:14.166909 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:14.177181 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:14.211415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9bd2b-5e93-472b-8953-9242e4f1e6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:14.214296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9bd2b-5e93-472b-8953-9242e4f1e6d6 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:14.229133 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2826/5607] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:14.230375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9bd2b-5e93-472b-8953-9242e4f1e6d6 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:14.249141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9bd2b-5e93-472b-8953-9242e4f1e6d6 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:14.262534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e298b-2894-4d33-8e24-b46c40df22d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:14.263574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e298b-2894-4d33-8e24-b46c40df22d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:14.265274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e298b-2894-4d33-8e24-b46c40df22d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:14.265702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e298b-2894-4d33-8e24-b46c40df22d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:14.269213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e298b-2894-4d33-8e24-b46c40df22d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:14.274519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e298b-2894-4d33-8e24-b46c40df22d0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:14.287920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7afdfe-00e2-4f29-8eb1-6edfcca6e8a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:14.291291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7afdfe-00e2-4f29-8eb1-6edfcca6e8a1 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:14.312283 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2782/5608] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:27:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:27:14.315829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7afdfe-00e2-4f29-8eb1-6edfcca6e8a1 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:14.341616 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2827/5609] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:14 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:14.341616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e298b-2894-4d33-8e24-b46c40df22d0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:14.476527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7afdfe-00e2-4f29-8eb1-6edfcca6e8a1 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:14.529404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e298b-2894-4d33-8e24-b46c40df22d0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:14.537663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040ad96-6b72-4c95-a67c-fef4e953ccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:14.538294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ad96-6b72-4c95-a67c-fef4e953ccbf admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:14.538576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ad96-6b72-4c95-a67c-fef4e953ccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:14.538890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ad96-6b72-4c95-a67c-fef4e953ccbf admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:14.539670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040ad96-6b72-4c95-a67c-fef4e953ccbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:14.541967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040ad96-6b72-4c95-a67c-fef4e953ccbf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:14.586716 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2828/5610] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:14 2022] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:14.590010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040ad96-6b72-4c95-a67c-fef4e953ccbf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:14.633551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040ad96-6b72-4c95-a67c-fef4e953ccbf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:14.634538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f9bc0-5ba3-466c-8f47-f95354469bbd tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:14.635532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f9bc0-5ba3-466c-8f47-f95354469bbd tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:14.635983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f9bc0-5ba3-466c-8f47-f95354469bbd tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:14.636528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f9bc0-5ba3-466c-8f47-f95354469bbd tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/367b9b98a547411ea239bd7b855e66ba/config` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:14.637420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f9bc0-5ba3-466c-8f47-f95354469bbd tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=367b9b98a547411ea239bd7b855e66ba)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:14.639226 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-575f9bc0-5ba3-466c-8f47-f95354469bbd tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:14.639226 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:27:14.639226 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:27:14.640609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f9bc0-5ba3-466c-8f47-f95354469bbd tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:14.666221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bb74a-ec4a-4666-bea4-6f652946e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:14.666640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bb74a-ec4a-4666-bea4-6f652946e811 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:14.668050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bb74a-ec4a-4666-bea4-6f652946e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:14.668260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bb74a-ec4a-4666-bea4-6f652946e811 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:14.668925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bb74a-ec4a-4666-bea4-6f652946e811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:14.671236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bb74a-ec4a-4666-bea4-6f652946e811 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:14.682056 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2783/5611] 10.222.0.39 () {60 vars in 1271 bytes} [Sun Oct 16 01:27:14 2022] PATCH /identity/v3/domains/367b9b98a547411ea239bd7b855e66ba/config => generated 141 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:14.683306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f9bc0-5ba3-466c-8f47-f95354469bbd tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:14.689351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-575f9bc0-5ba3-466c-8f47-f95354469bbd tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:14.715037 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2829/5612] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:14 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:14.716156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bb74a-ec4a-4666-bea4-6f652946e811 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:14.731098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bb74a-ec4a-4666-bea4-6f652946e811 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:14.744719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54545fa-581f-499f-bd88-6e3502cd7275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:14.745722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54545fa-581f-499f-bd88-6e3502cd7275 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:14.746102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54545fa-581f-499f-bd88-6e3502cd7275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:14.747622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54545fa-581f-499f-bd88-6e3502cd7275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:14.748095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54545fa-581f-499f-bd88-6e3502cd7275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:14.749898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54545fa-581f-499f-bd88-6e3502cd7275 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:14.775224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f9bc0-5ba3-466c-8f47-f95354469bbd tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:14.779445 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2830/5613] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:14.780183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54545fa-581f-499f-bd88-6e3502cd7275 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:14.800984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:14.801698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:14.802547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:14.803022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] PATH_INFO: `/v3/projects/2a415e9255ed4465aaa8675197529870` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:14.810738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a415e9255ed4465aaa8675197529870)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:14.812902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:14.851090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54545fa-581f-499f-bd88-6e3502cd7275 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:14.872097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74b156-7aef-4960-9379-c2081c291e35 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:14.872805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74b156-7aef-4960-9379-c2081c291e35 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:14.873025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74b156-7aef-4960-9379-c2081c291e35 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:14.873302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74b156-7aef-4960-9379-c2081c291e35 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/367b9b98a547411ea239bd7b855e66ba/config` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:14.875119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74b156-7aef-4960-9379-c2081c291e35 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=367b9b98a547411ea239bd7b855e66ba)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:14.876756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74b156-7aef-4960-9379-c2081c291e35 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:14.900460 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2831/5614] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:27:14 2022] GET /identity/v3/domains/367b9b98a547411ea239bd7b855e66ba/config => generated 141 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:14.902399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74b156-7aef-4960-9379-c2081c291e35 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:14.931758 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:14.948586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74b156-7aef-4960-9379-c2081c291e35 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:14.973599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56966ed2-0aea-425b-ad76-53b1fa0114d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:14.975290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56966ed2-0aea-425b-ad76-53b1fa0114d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:14.975721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56966ed2-0aea-425b-ad76-53b1fa0114d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:14.976136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56966ed2-0aea-425b-ad76-53b1fa0114d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:14.976926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56966ed2-0aea-425b-ad76-53b1fa0114d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:14.981682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56966ed2-0aea-425b-ad76-53b1fa0114d8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:15.006999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a415e9255ed4465aaa8675197529870', 'request_id': 'req-149bca52-1071-4c05-ab65-b4b63ccf1632'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:15.016792 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2832/5615] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:15.017837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56966ed2-0aea-425b-ad76-53b1fa0114d8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:15.043696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a415e9255ed4465aaa8675197529870', 'request_id': 'req-149bca52-1071-4c05-ab65-b4b63ccf1632'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:15.049180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56966ed2-0aea-425b-ad76-53b1fa0114d8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:15.058377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a415e9255ed4465aaa8675197529870', 'request_id': 'req-149bca52-1071-4c05-ab65-b4b63ccf1632'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:15.095216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] The token cache is being invalidate because project 2a415e9255ed4465aaa8675197529870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:15.095512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:15.097314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:15.101057 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2784/5616] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:14 2022] DELETE /identity/v3/projects/2a415e9255ed4465aaa8675197529870 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:15.102168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:15.105990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:15.207456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bad27-fea2-44a3-aeb6-cd383b046963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:15.208119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bad27-fea2-44a3-aeb6-cd383b046963 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:15.208644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bad27-fea2-44a3-aeb6-cd383b046963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:15.209570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bad27-fea2-44a3-aeb6-cd383b046963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:15.210233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bad27-fea2-44a3-aeb6-cd383b046963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:15.212081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bad27-fea2-44a3-aeb6-cd383b046963 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:15.214760 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:15.231789 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2833/5617] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:15.236179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bad27-fea2-44a3-aeb6-cd383b046963 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:15.238884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5d0bad27-fea2-44a3-aeb6-cd383b046963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:15.260094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bad27-fea2-44a3-aeb6-cd383b046963 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:15.267246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ae1a0-4926-44b2-acd0-efb038081e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:15.268610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ae1a0-4926-44b2-acd0-efb038081e7d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:15.268942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ae1a0-4926-44b2-acd0-efb038081e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:15.269305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ae1a0-4926-44b2-acd0-efb038081e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:15.270457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ae1a0-4926-44b2-acd0-efb038081e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:15.273916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ae1a0-4926-44b2-acd0-efb038081e7d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:15.296297 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2834/5618] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:15.297290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ae1a0-4926-44b2-acd0-efb038081e7d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:15.298363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bca52-1071-4c05-ab65-b4b63ccf1632 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:15.301364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b10ae1a0-4926-44b2-acd0-efb038081e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:15.304853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a29c8f-0699-4872-a085-6bd6496512ea tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:15.305631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29c8f-0699-4872-a085-6bd6496512ea tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:15.306015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29c8f-0699-4872-a085-6bd6496512ea tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:15.306532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29c8f-0699-4872-a085-6bd6496512ea tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/367b9b98a547411ea239bd7b855e66ba/config` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:15.308042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a29c8f-0699-4872-a085-6bd6496512ea tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=367b9b98a547411ea239bd7b855e66ba)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:15.315240 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-64a29c8f-0699-4872-a085-6bd6496512ea tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:15.315240 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:27:15.315240 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:27:15.316479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a29c8f-0699-4872-a085-6bd6496512ea tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:15.324261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ae1a0-4926-44b2-acd0-efb038081e7d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:15.335377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:15.336033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:15.336144 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2785/5619] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:27:15 2022] DELETE /identity/v3/domains/367b9b98a547411ea239bd7b855e66ba/config => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:15.337671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a29c8f-0699-4872-a085-6bd6496512ea tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:15.339932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:15.340219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] PATH_INFO: `/v3/users/bb93001de49740beab1d1635e033c4e4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:15.340728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-64a29c8f-0699-4872-a085-6bd6496512ea tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:15.342035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb93001de49740beab1d1635e033c4e4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:15.344961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:15.377124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a29c8f-0699-4872-a085-6bd6496512ea tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:15.388908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec606d-74a2-42c1-9793-f2384f332f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:15.389063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec606d-74a2-42c1-9793-f2384f332f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:15.389270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec606d-74a2-42c1-9793-f2384f332f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:15.389544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec606d-74a2-42c1-9793-f2384f332f44 admin admin] PATH_INFO: `/v3/projects/12f057e7b6e54f5c87e320fc332f4f5c/users/2a3dc21fd55c4a3ab04e03b7c4a68685/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:15.447889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec606d-74a2-42c1-9793-f2384f332f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f057e7b6e54f5c87e320fc332f4f5c, user_id=2a3dc21fd55c4a3ab04e03b7c4a68685, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:15.451492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec606d-74a2-42c1-9793-f2384f332f44 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:15.464907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb93001de49740beab1d1635e033c4e4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:15.465718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb93001de49740beab1d1635e033c4e4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:15.479309 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2786/5620] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:15 2022] PUT /identity/v3/projects/12f057e7b6e54f5c87e320fc332f4f5c/users/2a3dc21fd55c4a3ab04e03b7c4a68685/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:15.480263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec606d-74a2-42c1-9793-f2384f332f44 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:15.489372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-27ec606d-74a2-42c1-9793-f2384f332f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:15.490343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb93001de49740beab1d1635e033c4e4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:15.505888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb93001de49740beab1d1635e033c4e4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:15.506609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb93001de49740beab1d1635e033c4e4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:15.539509 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2835/5621] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:15 2022] DELETE /identity/v3/users/bb93001de49740beab1d1635e033c4e4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:15.541227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:15.543604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:15.663491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec606d-74a2-42c1-9793-f2384f332f44 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:15.676130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462a65d-688c-493d-be74-8f0fbcff6055 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:15.685035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2957c-eb77-4471-8be9-b2153402a873 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:15.686251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2957c-eb77-4471-8be9-b2153402a873 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:15.686685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2957c-eb77-4471-8be9-b2153402a873 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:15.688495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2957c-eb77-4471-8be9-b2153402a873 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/367b9b98a547411ea239bd7b855e66ba/config` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:15.691249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2957c-eb77-4471-8be9-b2153402a873 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=367b9b98a547411ea239bd7b855e66ba)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:15.695690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2957c-eb77-4471-8be9-b2153402a873 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:15.718017 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-fbb2957c-eb77-4471-8be9-b2153402a873 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Could not find any options in domain configuration for domain 367b9b98a547411ea239bd7b855e66ba.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 367b9b98a547411ea239bd7b855e66ba. Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 16 01:27:15.718752 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 16 01:27:15.720559 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 16 01:27:15.720559 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 16 01:27:15.720559 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:27:15.720559 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:27:15.720559 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 16 01:27:15.720559 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 16 01:27:15.720559 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 367b9b98a547411ea239bd7b855e66ba. Oct 16 01:27:15.720559 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:27:15.739148 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2836/5622] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:27:15 2022] GET /identity/v3/domains/367b9b98a547411ea239bd7b855e66ba/config => generated 151 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:27:15.743379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bab22-2bd0-4cab-a118-c234d193d19f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:15.743694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bab22-2bd0-4cab-a118-c234d193d19f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:15.743977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bab22-2bd0-4cab-a118-c234d193d19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:15.789515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569eb32f-e5a1-4708-b047-8bab67081afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:15.790782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569eb32f-e5a1-4708-b047-8bab67081afd admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:15.791275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569eb32f-e5a1-4708-b047-8bab67081afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:15.791758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569eb32f-e5a1-4708-b047-8bab67081afd admin admin] PATH_INFO: `/v3/projects/812df6cf41cb42cf995c72a41ba3f75e/users/1034bf8e3936453fb6e0e6bde1069558/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:15.804922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-989bab22-2bd0-4cab-a118-c234d193d19f None None] MFA Rules not processed for user `2a3dc21fd55c4a3ab04e03b7c4a68685`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:15.811241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-989bab22-2bd0-4cab-a118-c234d193d19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:15.853546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569eb32f-e5a1-4708-b047-8bab67081afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=812df6cf41cb42cf995c72a41ba3f75e, user_id=1034bf8e3936453fb6e0e6bde1069558, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:15.857589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569eb32f-e5a1-4708-b047-8bab67081afd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:15.909948 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2787/5623] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:15 2022] PUT /identity/v3/projects/812df6cf41cb42cf995c72a41ba3f75e/users/1034bf8e3936453fb6e0e6bde1069558/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:15.911146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569eb32f-e5a1-4708-b047-8bab67081afd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:15.957838 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:16.007405 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2837/5624] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:16.008883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a756b-ae9b-48fe-8555-b4289a992040 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:16.009249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a756b-ae9b-48fe-8555-b4289a992040 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:16.009526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a756b-ae9b-48fe-8555-b4289a992040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:16.044546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5f4a756b-ae9b-48fe-8555-b4289a992040 None None] MFA Rules not processed for user `1034bf8e3936453fb6e0e6bde1069558`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:16.047075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5f4a756b-ae9b-48fe-8555-b4289a992040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:16.058501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569eb32f-e5a1-4708-b047-8bab67081afd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:16.076410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680d071-a823-4c0d-a982-efb43c7b1509 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:16.077525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680d071-a823-4c0d-a982-efb43c7b1509 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:16.077817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680d071-a823-4c0d-a982-efb43c7b1509 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:16.078100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680d071-a823-4c0d-a982-efb43c7b1509 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/367b9b98a547411ea239bd7b855e66ba/config` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:16.078759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680d071-a823-4c0d-a982-efb43c7b1509 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=367b9b98a547411ea239bd7b855e66ba)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:16.091860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680d071-a823-4c0d-a982-efb43c7b1509 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:16.109942 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2788/5625] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:27:15 2022] DELETE /identity/v3/domains/367b9b98a547411ea239bd7b855e66ba/config => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:16.110901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680d071-a823-4c0d-a982-efb43c7b1509 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:16.117690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3680d071-a823-4c0d-a982-efb43c7b1509 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:16.242447 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2838/5626] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:16.242447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a756b-ae9b-48fe-8555-b4289a992040 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:16.257896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5f4a756b-ae9b-48fe-8555-b4289a992040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:16.293561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680d071-a823-4c0d-a982-efb43c7b1509 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:16.299294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e7e60-78f6-4d45-8dbc-76afff562435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:16.300745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e7e60-78f6-4d45-8dbc-76afff562435 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:16.301247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e7e60-78f6-4d45-8dbc-76afff562435 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:16.301711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e7e60-78f6-4d45-8dbc-76afff562435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:16.391409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a756b-ae9b-48fe-8555-b4289a992040 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:16.397667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:16.399082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:16.399564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:16.400924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] PATH_INFO: `/v3/projects/a124cc7f399844ba9b31c2af995cd0f9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:16.403840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e7e60-78f6-4d45-8dbc-76afff562435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:16.405247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e7e60-78f6-4d45-8dbc-76afff562435 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:16.405784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a124cc7f399844ba9b31c2af995cd0f9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:16.409908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:16.426971 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2789/5627] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:16.428123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e7e60-78f6-4d45-8dbc-76afff562435 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:16.443119 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:16.455831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e7e60-78f6-4d45-8dbc-76afff562435 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:16.471144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3931cc-4662-4b9b-aab4-022a019fd91f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:16.471812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3931cc-4662-4b9b-aab4-022a019fd91f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:16.472107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3931cc-4662-4b9b-aab4-022a019fd91f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:16.472467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3931cc-4662-4b9b-aab4-022a019fd91f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/367b9b98a547411ea239bd7b855e66ba` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:16.475344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3931cc-4662-4b9b-aab4-022a019fd91f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=367b9b98a547411ea239bd7b855e66ba)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:16.476980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3931cc-4662-4b9b-aab4-022a019fd91f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:16.481049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a124cc7f399844ba9b31c2af995cd0f9', 'request_id': 'req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:16.489867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a124cc7f399844ba9b31c2af995cd0f9', 'request_id': 'req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:16.515752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a124cc7f399844ba9b31c2af995cd0f9', 'request_id': 'req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:16.529400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aa3931cc-4662-4b9b-aab4-022a019fd91f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '367b9b98a547411ea239bd7b855e66ba'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:16.531321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aa3931cc-4662-4b9b-aab4-022a019fd91f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '367b9b98a547411ea239bd7b855e66ba'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:16.533220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] The token cache is being invalidate because project a124cc7f399844ba9b31c2af995cd0f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:16.533770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:16.535596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:16.539646 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2839/5628] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:16 2022] DELETE /identity/v3/projects/a124cc7f399844ba9b31c2af995cd0f9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:16.541075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:16.548959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:16.569647 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:16.607907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aa3931cc-4662-4b9b-aab4-022a019fd91f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '367b9b98a547411ea239bd7b855e66ba'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:16.611789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aa3931cc-4662-4b9b-aab4-022a019fd91f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '367b9b98a547411ea239bd7b855e66ba'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:16.618784 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2790/5629] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:27:16 2022] PATCH /identity/v3/domains/367b9b98a547411ea239bd7b855e66ba => generated 277 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:16.620303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd59da3-1235-454d-b1fe-af20c8b30cb0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:16.620605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd59da3-1235-454d-b1fe-af20c8b30cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:16.620882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd59da3-1235-454d-b1fe-af20c8b30cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:16.679353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e090f-2ace-4de1-ae98-10ebd6dc1bf4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:16.718842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4fd59da3-1235-454d-b1fe-af20c8b30cb0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:16.720093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4fd59da3-1235-454d-b1fe-af20c8b30cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:16.799257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6181d86-5cd5-4092-a1bc-a7005292e652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:16.800196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6181d86-5cd5-4092-a1bc-a7005292e652 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:16.800572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6181d86-5cd5-4092-a1bc-a7005292e652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:16.800939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6181d86-5cd5-4092-a1bc-a7005292e652 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:16.801675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6181d86-5cd5-4092-a1bc-a7005292e652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:16.805601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6181d86-5cd5-4092-a1bc-a7005292e652 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:16.878282 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2840/5630] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:16 2022] POST /identity/v3/projects => generated 387 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:16.878821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6181d86-5cd5-4092-a1bc-a7005292e652 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:16.882496 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2791/5631] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:16.883184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd59da3-1235-454d-b1fe-af20c8b30cb0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:16.884060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a6181d86-5cd5-4092-a1bc-a7005292e652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:16.884737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4fd59da3-1235-454d-b1fe-af20c8b30cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:16.898055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd59da3-1235-454d-b1fe-af20c8b30cb0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:17.018542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6181d86-5cd5-4092-a1bc-a7005292e652 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:17.026686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:17.028107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:17.028574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:17.029056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/367b9b98a547411ea239bd7b855e66ba` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:17.045831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=367b9b98a547411ea239bd7b855e66ba)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:17.047514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:17.049010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a50622-622e-438d-b989-69e33cb42137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:17.049794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a50622-622e-438d-b989-69e33cb42137 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:17.050175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a50622-622e-438d-b989-69e33cb42137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:17.050548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a50622-622e-438d-b989-69e33cb42137 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:17.051337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a50622-622e-438d-b989-69e33cb42137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:17.053561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a50622-622e-438d-b989-69e33cb42137 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:17.081359 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2792/5632] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:16 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:17.081359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b494c-1731-4a60-9454-ca1854f3b69b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:17.081359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b494c-1731-4a60-9454-ca1854f3b69b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:17.081359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b494c-1731-4a60-9454-ca1854f3b69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:17.100098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '367b9b98a547411ea239bd7b855e66ba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:17.109876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ce7b494c-1731-4a60-9454-ca1854f3b69b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:17.112064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ce7b494c-1731-4a60-9454-ca1854f3b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:17.125959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '367b9b98a547411ea239bd7b855e66ba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:17.128382 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:17.135957 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2793/5633] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:17.136826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b494c-1731-4a60-9454-ca1854f3b69b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:17.160354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b494c-1731-4a60-9454-ca1854f3b69b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:17.170644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd471593-b31c-48d6-878c-426cf4a06979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:17.171399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd471593-b31c-48d6-878c-426cf4a06979 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:17.171884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd471593-b31c-48d6-878c-426cf4a06979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:17.172252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd471593-b31c-48d6-878c-426cf4a06979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:17.175757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd471593-b31c-48d6-878c-426cf4a06979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:17.177938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd471593-b31c-48d6-878c-426cf4a06979 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:17.193749 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2794/5634] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:17.193749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd471593-b31c-48d6-878c-426cf4a06979 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:17.207691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd471593-b31c-48d6-878c-426cf4a06979 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:17.211535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367b9b98a547411ea239bd7b855e66ba', 'request_id': 'req-022dab29-e1cd-4bb0-a74d-2b834b5a709c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:17.229888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367b9b98a547411ea239bd7b855e66ba', 'request_id': 'req-022dab29-e1cd-4bb0-a74d-2b834b5a709c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:17.249081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367b9b98a547411ea239bd7b855e66ba', 'request_id': 'req-022dab29-e1cd-4bb0-a74d-2b834b5a709c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:17.262662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] The token cache is being invalidate because project 367b9b98a547411ea239bd7b855e66ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:17.262858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:17.263706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:17.276045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '367b9b98a547411ea239bd7b855e66ba', 'request_id': 'req-022dab29-e1cd-4bb0-a74d-2b834b5a709c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:17.277212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '367b9b98a547411ea239bd7b855e66ba', 'request_id': 'req-022dab29-e1cd-4bb0-a74d-2b834b5a709c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:17.277945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '367b9b98a547411ea239bd7b855e66ba', 'request_id': 'req-022dab29-e1cd-4bb0-a74d-2b834b5a709c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:17.278372 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:17.296156 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2841/5635] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:27:16 2022] DELETE /identity/v3/domains/367b9b98a547411ea239bd7b855e66ba => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:17.297369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:17.298928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:17.323661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53d210-285a-47f7-a856-0006cd11c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:17.324441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53d210-285a-47f7-a856-0006cd11c0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:17.325026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53d210-285a-47f7-a856-0006cd11c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:17.325313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53d210-285a-47f7-a856-0006cd11c0a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:17.326021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53d210-285a-47f7-a856-0006cd11c0a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:17.326332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53d210-285a-47f7-a856-0006cd11c0a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:17.328682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53d210-285a-47f7-a856-0006cd11c0a2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:17.354273 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2795/5636] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:17.356170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53d210-285a-47f7-a856-0006cd11c0a2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:17.359846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5e53d210-285a-47f7-a856-0006cd11c0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:17.441550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dab29-e1cd-4bb0-a74d-2b834b5a709c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:17.448284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f517cb4-d266-4d39-9102-401d2d2bb882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:17.449106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f517cb4-d266-4d39-9102-401d2d2bb882 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:17.449623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f517cb4-d266-4d39-9102-401d2d2bb882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:17.449973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f517cb4-d266-4d39-9102-401d2d2bb882 admin admin] PATH_INFO: `/v3/projects/40b3d18531c942bb94d4e230980c0afe/users/e5468d57045e4281943bd7ae5d0418f0/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:17.487406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f517cb4-d266-4d39-9102-401d2d2bb882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b3d18531c942bb94d4e230980c0afe, user_id=e5468d57045e4281943bd7ae5d0418f0, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:17.492796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f517cb4-d266-4d39-9102-401d2d2bb882 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:17.500719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53d210-285a-47f7-a856-0006cd11c0a2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:17.510733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9702a5-6bfe-4e63-9371-9051cf5c50ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:17.511656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9702a5-6bfe-4e63-9371-9051cf5c50ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:17.512215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9702a5-6bfe-4e63-9371-9051cf5c50ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:17.512501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9702a5-6bfe-4e63-9371-9051cf5c50ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:17.513748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9702a5-6bfe-4e63-9371-9051cf5c50ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:17.516342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9702a5-6bfe-4e63-9371-9051cf5c50ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:17.529957 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2842/5637] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:17 2022] PUT /identity/v3/projects/40b3d18531c942bb94d4e230980c0afe/users/e5468d57045e4281943bd7ae5d0418f0/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:17.531680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f517cb4-d266-4d39-9102-401d2d2bb882 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:17.533968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5f517cb4-d266-4d39-9102-401d2d2bb882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:17.553152 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2796/5638] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:27:17 2022] POST /identity/v3/domains => generated 277 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:17.554061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9702a5-6bfe-4e63-9371-9051cf5c50ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:17.672276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f517cb4-d266-4d39-9102-401d2d2bb882 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:17.678089 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:17.715634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9702a5-6bfe-4e63-9371-9051cf5c50ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:17.728240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131115c8-fad4-4554-8fa6-42750c19705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:17.728988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131115c8-fad4-4554-8fa6-42750c19705a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:17.729284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131115c8-fad4-4554-8fa6-42750c19705a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:17.729560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131115c8-fad4-4554-8fa6-42750c19705a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:17.730857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131115c8-fad4-4554-8fa6-42750c19705a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:17.732981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131115c8-fad4-4554-8fa6-42750c19705a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:17.749345 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2797/5639] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:17.750538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131115c8-fad4-4554-8fa6-42750c19705a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:17.767034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fa9ab-1e45-4a7a-af94-f1a9a9502ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:17.768076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fa9ab-1e45-4a7a-af94-f1a9a9502ced admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:17.768619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fa9ab-1e45-4a7a-af94-f1a9a9502ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:17.769227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fa9ab-1e45-4a7a-af94-f1a9a9502ced admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:17.770025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fa9ab-1e45-4a7a-af94-f1a9a9502ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:17.772191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fa9ab-1e45-4a7a-af94-f1a9a9502ced admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:17.811644 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2843/5640] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:17 2022] POST /identity/v3/projects => generated 371 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:17.812570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fa9ab-1e45-4a7a-af94-f1a9a9502ced admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:17.839493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131115c8-fad4-4554-8fa6-42750c19705a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:17.849406 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:17.923266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fa9ab-1e45-4a7a-af94-f1a9a9502ced admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:17.928620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5cebc-336e-406d-ac93-e313436902f5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:17.929891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08128-7155-4449-805c-5a9f34c3bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:17.930687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08128-7155-4449-805c-5a9f34c3bfc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:17.931106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08128-7155-4449-805c-5a9f34c3bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:17.931463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08128-7155-4449-805c-5a9f34c3bfc4 admin admin] PATH_INFO: `/v3/projects/40b3d18531c942bb94d4e230980c0afe/users/e5468d57045e4281943bd7ae5d0418f0/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:17.931912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5cebc-336e-406d-ac93-e313436902f5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:17.933724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf08128-7155-4449-805c-5a9f34c3bfc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b3d18531c942bb94d4e230980c0afe, user_id=e5468d57045e4281943bd7ae5d0418f0, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:17.934256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5cebc-336e-406d-ac93-e313436902f5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:17.934690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5cebc-336e-406d-ac93-e313436902f5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:17.935564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5cebc-336e-406d-ac93-e313436902f5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=8a7909cfd4e04718b42c5b454728b6bc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:17.937286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf08128-7155-4449-805c-5a9f34c3bfc4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:17.939837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5cebc-336e-406d-ac93-e313436902f5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:17.965783 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2844/5641] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:17 2022] PUT /identity/v3/projects/40b3d18531c942bb94d4e230980c0afe/users/e5468d57045e4281943bd7ae5d0418f0/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:17.967156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08128-7155-4449-805c-5a9f34c3bfc4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:18.014129 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2798/5642] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:27:17 2022] PUT /identity/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config => generated 138 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:18.014129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64630f-5042-402e-b432-7ce366b19e43 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:18.014129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64630f-5042-402e-b432-7ce366b19e43 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:18.014129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64630f-5042-402e-b432-7ce366b19e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:18.084518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6e64630f-5042-402e-b432-7ce366b19e43 None None] MFA Rules not processed for user `e5468d57045e4281943bd7ae5d0418f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:18.085950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6e64630f-5042-402e-b432-7ce366b19e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:18.135659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08128-7155-4449-805c-5a9f34c3bfc4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:18.150823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2628d-36da-49bd-9b7c-a42fe0156865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:18.151661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2628d-36da-49bd-9b7c-a42fe0156865 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:18.152988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2628d-36da-49bd-9b7c-a42fe0156865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:18.153539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2628d-36da-49bd-9b7c-a42fe0156865 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:18.156584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2628d-36da-49bd-9b7c-a42fe0156865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:18.166642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2628d-36da-49bd-9b7c-a42fe0156865 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:18.217636 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2845/5643] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:17 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:18.218811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2628d-36da-49bd-9b7c-a42fe0156865 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:18.254303 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2799/5644] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:18.254303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64630f-5042-402e-b432-7ce366b19e43 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:18.265535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64630f-5042-402e-b432-7ce366b19e43 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:18.269991 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:18.278620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8838d7-b03d-405f-aec1-ac6fe50d3f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:18.279411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8838d7-b03d-405f-aec1-ac6fe50d3f08 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:18.279843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8838d7-b03d-405f-aec1-ac6fe50d3f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:18.280796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8838d7-b03d-405f-aec1-ac6fe50d3f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:18.284592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8838d7-b03d-405f-aec1-ac6fe50d3f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:18.284592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8838d7-b03d-405f-aec1-ac6fe50d3f08 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:18.297082 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2800/5645] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:18.298274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8838d7-b03d-405f-aec1-ac6fe50d3f08 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:18.300386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1d8838d7-b03d-405f-aec1-ac6fe50d3f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:18.377134 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:18.383836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2628d-36da-49bd-9b7c-a42fe0156865 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:18.390644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53bf43-d5a7-479e-b77b-9936cbb1995f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:18.391435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53bf43-d5a7-479e-b77b-9936cbb1995f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:18.391614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53bf43-d5a7-479e-b77b-9936cbb1995f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:18.391862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53bf43-d5a7-479e-b77b-9936cbb1995f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:18.392867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53bf43-d5a7-479e-b77b-9936cbb1995f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=8a7909cfd4e04718b42c5b454728b6bc, group=identity)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:18.393898 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-5f53bf43-d5a7-479e-b77b-9936cbb1995f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:18.393898 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:27:18.393898 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:27:18.394795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53bf43-d5a7-479e-b77b-9936cbb1995f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:18.416806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8838d7-b03d-405f-aec1-ac6fe50d3f08 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:18.424385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4108fe5-87e4-4959-9409-b10b99ad59fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:18.425017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4108fe5-87e4-4959-9409-b10b99ad59fa service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:18.425299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4108fe5-87e4-4959-9409-b10b99ad59fa service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:18.425577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4108fe5-87e4-4959-9409-b10b99ad59fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:18.428474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a4108fe5-87e4-4959-9409-b10b99ad59fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:18.459313 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2846/5646] 10.222.0.39 () {60 vars in 1297 bytes} [Sun Oct 16 01:27:18 2022] PATCH /identity/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config/identity => generated 176 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:18.462168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53bf43-d5a7-479e-b77b-9936cbb1995f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:18.474882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53bf43-d5a7-479e-b77b-9936cbb1995f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:18.492329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73124600-6334-4433-bc24-54074d1aabe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:18.493505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73124600-6334-4433-bc24-54074d1aabe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:18.494125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73124600-6334-4433-bc24-54074d1aabe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:18.494643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73124600-6334-4433-bc24-54074d1aabe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:18.495456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73124600-6334-4433-bc24-54074d1aabe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:18.497228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73124600-6334-4433-bc24-54074d1aabe7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:18.510421 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2847/5647] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:18.512185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73124600-6334-4433-bc24-54074d1aabe7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:18.513436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4108fe5-87e4-4959-9409-b10b99ad59fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:18.515532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4108fe5-87e4-4959-9409-b10b99ad59fa service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:18.539729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73124600-6334-4433-bc24-54074d1aabe7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:18.565218 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2801/5648] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:18.569782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4108fe5-87e4-4959-9409-b10b99ad59fa service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:18.569926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0592e-0346-4683-be7c-d55000351095 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:18.570494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0592e-0346-4683-be7c-d55000351095 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:18.570792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0592e-0346-4683-be7c-d55000351095 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:18.571123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0592e-0346-4683-be7c-d55000351095 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config/identity/driver` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:18.571805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0592e-0346-4683-be7c-d55000351095 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=8a7909cfd4e04718b42c5b454728b6bc, group=identity, option=driver)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:18.573394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0592e-0346-4683-be7c-d55000351095 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:18.585784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4108fe5-87e4-4959-9409-b10b99ad59fa service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:18.594504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d0c0-e388-4a88-8e91-5df5ff168e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:18.596054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d0c0-e388-4a88-8e91-5df5ff168e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:18.596871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d0c0-e388-4a88-8e91-5df5ff168e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:18.597714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d0c0-e388-4a88-8e91-5df5ff168e75 admin admin] PATH_INFO: `/v3/projects/3945d3eb1f864f2cbb1a1104873c7c1f/users/8dbc3f00f5644e5eacfbab6a1df39556/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:18.612397 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2848/5649] 10.222.0.39 () {60 vars in 1318 bytes} [Sun Oct 16 01:27:18 2022] PATCH /identity/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config/identity/driver => generated 177 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:18.613433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0592e-0346-4683-be7c-d55000351095 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:18.622408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-91b0592e-0346-4683-be7c-d55000351095 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:18.629757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3d0c0-e388-4a88-8e91-5df5ff168e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3945d3eb1f864f2cbb1a1104873c7c1f, user_id=8dbc3f00f5644e5eacfbab6a1df39556, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:18.633877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3d0c0-e388-4a88-8e91-5df5ff168e75 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:18.675304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0592e-0346-4683-be7c-d55000351095 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:18.682980 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2802/5650] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:18 2022] PUT /identity/v3/projects/3945d3eb1f864f2cbb1a1104873c7c1f/users/8dbc3f00f5644e5eacfbab6a1df39556/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:18.682980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d0c0-e388-4a88-8e91-5df5ff168e75 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:18.794344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d0c0-e388-4a88-8e91-5df5ff168e75 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:18.801558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce96b95-9184-4f0c-bbd2-c0c42555a9ee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:18.803034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce96b95-9184-4f0c-bbd2-c0c42555a9ee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:18.803336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce96b95-9184-4f0c-bbd2-c0c42555a9ee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:18.803614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce96b95-9184-4f0c-bbd2-c0c42555a9ee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config/identity/driver` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:18.804413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce96b95-9184-4f0c-bbd2-c0c42555a9ee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8a7909cfd4e04718b42c5b454728b6bc, group=identity, option=driver)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:18.806175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce96b95-9184-4f0c-bbd2-c0c42555a9ee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:18.832128 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2803/5651] 10.222.0.39 () {58 vars in 1299 bytes} [Sun Oct 16 01:27:18 2022] DELETE /identity/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config/identity/driver => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:18.832128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cd119-ebc7-4e64-9c14-aabfb34de4bc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:18.832418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cd119-ebc7-4e64-9c14-aabfb34de4bc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:18.832611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cd119-ebc7-4e64-9c14-aabfb34de4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:18.844637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:18.845287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:18.845569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:18.845840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] PATH_INFO: `/v3/users/fe6f97cacf104ff19ada4bc7e4fe0e01` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:18.847042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe6f97cacf104ff19ada4bc7e4fe0e01)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:18.849514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:18.871913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ed1cd119-ebc7-4e64-9c14-aabfb34de4bc None None] MFA Rules not processed for user `8dbc3f00f5644e5eacfbab6a1df39556`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:18.873686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ed1cd119-ebc7-4e64-9c14-aabfb34de4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:18.939785 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:18.963426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe6f97cacf104ff19ada4bc7e4fe0e01'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:18.964136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe6f97cacf104ff19ada4bc7e4fe0e01'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:18.980785 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:18.983799 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2804/5652] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:18.989150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cd119-ebc7-4e64-9c14-aabfb34de4bc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:19.006980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe6f97cacf104ff19ada4bc7e4fe0e01'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:19.051914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe6f97cacf104ff19ada4bc7e4fe0e01'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:19.053426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe6f97cacf104ff19ada4bc7e4fe0e01'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:19.071703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cd119-ebc7-4e64-9c14-aabfb34de4bc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:19.079297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c5baa-e081-4154-9e03-4d525ac2ba0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:19.080041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c5baa-e081-4154-9e03-4d525ac2ba0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:19.080331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c5baa-e081-4154-9e03-4d525ac2ba0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:19.080749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c5baa-e081-4154-9e03-4d525ac2ba0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config/identity/driver` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:19.082643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c5baa-e081-4154-9e03-4d525ac2ba0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8a7909cfd4e04718b42c5b454728b6bc, group=identity, option=driver)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:19.084440 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-707c5baa-e081-4154-9e03-4d525ac2ba0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:19.084440 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:27:19.084440 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:27:19.085521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c5baa-e081-4154-9e03-4d525ac2ba0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:19.100694 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2849/5653] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:18 2022] DELETE /identity/v3/users/fe6f97cacf104ff19ada4bc7e4fe0e01 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:19.102688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:19.105491 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-707c5baa-e081-4154-9e03-4d525ac2ba0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Could not find option driver in group identity in domain configuration for domain 8a7909cfd4e04718b42c5b454728b6bc.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 8a7909cfd4e04718b42c5b454728b6bc. Oct 16 01:27:19.105491 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:27:19.105491 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:27:19.105491 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:27:19.105491 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:27:19.105491 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:27:19.105491 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:27:19.105491 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:27:19.105491 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:27:19.105491 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:27:19.105491 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:27:19.105491 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:27:19.105491 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 16 01:27:19.106266 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 16 01:27:19.106266 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 16 01:27:19.106266 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 16 01:27:19.106266 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:27:19.106266 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:27:19.106266 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 16 01:27:19.106266 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 16 01:27:19.106266 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 8a7909cfd4e04718b42c5b454728b6bc. Oct 16 01:27:19.106266 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:27:19.107420 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2805/5654] 10.222.0.39 () {58 vars in 1296 bytes} [Sun Oct 16 01:27:18 2022] GET /identity/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config/identity/driver => generated 171 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:27:19.110949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:19.111276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c5baa-e081-4154-9e03-4d525ac2ba0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:19.113472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-707c5baa-e081-4154-9e03-4d525ac2ba0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:19.137079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c5baa-e081-4154-9e03-4d525ac2ba0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:19.306704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df819b96-7b1f-48d9-9f31-dacc7ccd3436 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:19.308276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50c3a1-1f26-4172-b0f1-d9b1e14bd89e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:19.309465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50c3a1-1f26-4172-b0f1-d9b1e14bd89e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:19.310534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50c3a1-1f26-4172-b0f1-d9b1e14bd89e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:19.310792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50c3a1-1f26-4172-b0f1-d9b1e14bd89e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:19.311432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50c3a1-1f26-4172-b0f1-d9b1e14bd89e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8a7909cfd4e04718b42c5b454728b6bc, group=identity)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:19.313902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50c3a1-1f26-4172-b0f1-d9b1e14bd89e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:19.319066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81202fc-ca4b-4dd6-a3d8-861504409a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:19.321238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81202fc-ca4b-4dd6-a3d8-861504409a52 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:19.321602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81202fc-ca4b-4dd6-a3d8-861504409a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:19.321992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81202fc-ca4b-4dd6-a3d8-861504409a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:19.327112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c81202fc-ca4b-4dd6-a3d8-861504409a52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:19.354835 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2806/5655] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Oct 16 01:27:19 2022] DELETE /identity/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config/identity => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:19.358795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50c3a1-1f26-4172-b0f1-d9b1e14bd89e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:19.397172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50c3a1-1f26-4172-b0f1-d9b1e14bd89e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:19.409581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6f47e-bca3-46c1-a117-c903a16d32e5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:19.410251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6f47e-bca3-46c1-a117-c903a16d32e5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:19.410523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6f47e-bca3-46c1-a117-c903a16d32e5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:19.413306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6f47e-bca3-46c1-a117-c903a16d32e5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:19.415661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6f47e-bca3-46c1-a117-c903a16d32e5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8a7909cfd4e04718b42c5b454728b6bc, group=identity)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:19.417685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6f47e-bca3-46c1-a117-c903a16d32e5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:19.438952 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-4ce6f47e-bca3-46c1-a117-c903a16d32e5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Could not find group identity in domain configuration for domain 8a7909cfd4e04718b42c5b454728b6bc.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 8a7909cfd4e04718b42c5b454728b6bc. Oct 16 01:27:19.438952 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:27:19.438952 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:27:19.438952 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:27:19.438952 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:27:19.438952 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:27:19.438952 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:27:19.438952 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:27:19.438952 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:27:19.438952 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:27:19.438952 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:27:19.438952 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:27:19.438952 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 16 01:27:19.439756 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 16 01:27:19.439756 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 16 01:27:19.439756 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 16 01:27:19.439756 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:27:19.439756 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:27:19.439756 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 16 01:27:19.439756 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 16 01:27:19.439756 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 8a7909cfd4e04718b42c5b454728b6bc. Oct 16 01:27:19.439756 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:27:19.440611 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2807/5656] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:27:19 2022] GET /identity/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config/identity => generated 154 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:27:19.451992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6f47e-bca3-46c1-a117-c903a16d32e5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:19.482938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6f47e-bca3-46c1-a117-c903a16d32e5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:19.497881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca25516-7a87-454a-9f65-a08232579090 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:19.498692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25516-7a87-454a-9f65-a08232579090 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:19.499108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25516-7a87-454a-9f65-a08232579090 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:19.500519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25516-7a87-454a-9f65-a08232579090 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:19.501358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca25516-7a87-454a-9f65-a08232579090 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8a7909cfd4e04718b42c5b454728b6bc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:19.504371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca25516-7a87-454a-9f65-a08232579090 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:19.506115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81202fc-ca4b-4dd6-a3d8-861504409a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:19.511363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81202fc-ca4b-4dd6-a3d8-861504409a52 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:19.528106 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2808/5657] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:27:19 2022] DELETE /identity/v3/domains/8a7909cfd4e04718b42c5b454728b6bc/config => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:19.532138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca25516-7a87-454a-9f65-a08232579090 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:19.540805 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2850/5658] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:19.555197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca25516-7a87-454a-9f65-a08232579090 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:19.572106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cac34-9ed0-4c6f-900c-09678ac5fdd3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:19.573292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cac34-9ed0-4c6f-900c-09678ac5fdd3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:19.573729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cac34-9ed0-4c6f-900c-09678ac5fdd3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:19.574140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cac34-9ed0-4c6f-900c-09678ac5fdd3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/8a7909cfd4e04718b42c5b454728b6bc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:19.576000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cac34-9ed0-4c6f-900c-09678ac5fdd3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8a7909cfd4e04718b42c5b454728b6bc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:19.577808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cac34-9ed0-4c6f-900c-09678ac5fdd3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:19.608385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-316cac34-9ed0-4c6f-900c-09678ac5fdd3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8a7909cfd4e04718b42c5b454728b6bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:19.610450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-316cac34-9ed0-4c6f-900c-09678ac5fdd3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8a7909cfd4e04718b42c5b454728b6bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:19.673679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-316cac34-9ed0-4c6f-900c-09678ac5fdd3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8a7909cfd4e04718b42c5b454728b6bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:19.674759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-316cac34-9ed0-4c6f-900c-09678ac5fdd3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8a7909cfd4e04718b42c5b454728b6bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:19.681814 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2809/5659] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:27:19 2022] PATCH /identity/v3/domains/8a7909cfd4e04718b42c5b454728b6bc => generated 278 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:19.683358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81202fc-ca4b-4dd6-a3d8-861504409a52 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:19.702142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81202fc-ca4b-4dd6-a3d8-861504409a52 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:19.854694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:19.855717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:19.856144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:19.856589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/8a7909cfd4e04718b42c5b454728b6bc` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:19.880335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8a7909cfd4e04718b42c5b454728b6bc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:19.882002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:19.929359 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:19.938847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cac34-9ed0-4c6f-900c-09678ac5fdd3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:19.942947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8a7909cfd4e04718b42c5b454728b6bc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:19.943835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-316cac34-9ed0-4c6f-900c-09678ac5fdd3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:19.968209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8a7909cfd4e04718b42c5b454728b6bc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.063947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a7909cfd4e04718b42c5b454728b6bc', 'request_id': 'req-e5712b9f-f4f3-40db-831f-353babe5b10e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.075388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a7909cfd4e04718b42c5b454728b6bc', 'request_id': 'req-e5712b9f-f4f3-40db-831f-353babe5b10e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.095636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a7909cfd4e04718b42c5b454728b6bc', 'request_id': 'req-e5712b9f-f4f3-40db-831f-353babe5b10e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.118966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] The token cache is being invalidate because project 8a7909cfd4e04718b42c5b454728b6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:20.119729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.120718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.136877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8a7909cfd4e04718b42c5b454728b6bc', 'request_id': 'req-e5712b9f-f4f3-40db-831f-353babe5b10e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.143782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8a7909cfd4e04718b42c5b454728b6bc', 'request_id': 'req-e5712b9f-f4f3-40db-831f-353babe5b10e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.144579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8a7909cfd4e04718b42c5b454728b6bc', 'request_id': 'req-e5712b9f-f4f3-40db-831f-353babe5b10e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.164525 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2851/5660] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:27:19 2022] DELETE /identity/v3/domains/8a7909cfd4e04718b42c5b454728b6bc => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:20.165760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:20.170483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:20.205130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cac34-9ed0-4c6f-900c-09678ac5fdd3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:20.222282 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:20.305534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5712b9f-f4f3-40db-831f-353babe5b10e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:20.327675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d0d96-dff5-4541-b970-543bd6ec3aee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:20.335227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d0d96-dff5-4541-b970-543bd6ec3aee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.336601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d0d96-dff5-4541-b970-543bd6ec3aee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.337200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d0d96-dff5-4541-b970-543bd6ec3aee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.339052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d0d96-dff5-4541-b970-543bd6ec3aee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:20.344990 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-5c7d0d96-dff5-4541-b970-543bd6ec3aee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:20.344990 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:27:20.344990 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:27:20.345946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d0d96-dff5-4541-b970-543bd6ec3aee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:20.370159 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2852/5661] 10.222.0.39 () {58 vars in 1173 bytes} [Sun Oct 16 01:27:20 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:20.372157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d0d96-dff5-4541-b970-543bd6ec3aee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:20.408523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d0d96-dff5-4541-b970-543bd6ec3aee tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:20.430297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2c4fb-1fc2-422a-99f3-559228fa1181 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:20.433213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2c4fb-1fc2-422a-99f3-559228fa1181 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.433560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2c4fb-1fc2-422a-99f3-559228fa1181 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.434087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2c4fb-1fc2-422a-99f3-559228fa1181 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.438204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2c4fb-1fc2-422a-99f3-559228fa1181 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:20.444194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2c4fb-1fc2-422a-99f3-559228fa1181 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:20.445861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:20.449334 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2853/5662] 10.222.0.39 () {58 vars in 1200 bytes} [Sun Oct 16 01:27:20 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:20.449490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.449490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.449490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74 admin admin] PATH_INFO: `/v3/projects/e0ad8ba45c374500b4224168c73793b8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.449671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0ad8ba45c374500b4224168c73793b8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:20.451741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:20.452177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2c4fb-1fc2-422a-99f3-559228fa1181 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:20.477998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2c4fb-1fc2-422a-99f3-559228fa1181 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:20.491922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44374dc7-5961-4b17-b90e-aa756c133b26 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:20.492663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44374dc7-5961-4b17-b90e-aa756c133b26 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.493301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44374dc7-5961-4b17-b90e-aa756c133b26 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.493677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44374dc7-5961-4b17-b90e-aa756c133b26 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.494490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44374dc7-5961-4b17-b90e-aa756c133b26 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:20.500267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44374dc7-5961-4b17-b90e-aa756c133b26 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:20.502775 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2854/5663] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:27:20 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:20.509740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44374dc7-5961-4b17-b90e-aa756c133b26 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:20.535729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44374dc7-5961-4b17-b90e-aa756c133b26 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:20.541563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0ad8ba45c374500b4224168c73793b8', 'request_id': 'req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.550650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0ad8ba45c374500b4224168c73793b8', 'request_id': 'req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.585872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0ad8ba45c374500b4224168c73793b8', 'request_id': 'req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.617794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74 admin admin] The token cache is being invalidate because project e0ad8ba45c374500b4224168c73793b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:20.618743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.622440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b8165ba4-df82-42a3-a7bf-8dd8b6a75d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:20.630519 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2810/5664] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:19 2022] DELETE /identity/v3/projects/e0ad8ba45c374500b4224168c73793b8 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:20.634532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1983d-7731-4761-b390-1ead8ea731c1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.647440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1983d-7731-4761-b390-1ead8ea731c1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.648096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1983d-7731-4761-b390-1ead8ea731c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.670445 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:20.685985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79407519-c794-45f3-b80e-aab220abcc22 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:20.687913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79407519-c794-45f3-b80e-aab220abcc22 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.688447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79407519-c794-45f3-b80e-aab220abcc22 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.689761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79407519-c794-45f3-b80e-aab220abcc22 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.690184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a6f1983d-7731-4761-b390-1ead8ea731c1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:20.690678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79407519-c794-45f3-b80e-aab220abcc22 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:20.692741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79407519-c794-45f3-b80e-aab220abcc22 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:20.692884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a6f1983d-7731-4761-b390-1ead8ea731c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:20.695458 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2855/5665] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:20 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 16 01:27:20.706212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79407519-c794-45f3-b80e-aab220abcc22 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:20.709820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79407519-c794-45f3-b80e-aab220abcc22 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:20.729190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79407519-c794-45f3-b80e-aab220abcc22 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:20.737119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae25671-3814-4d95-977a-79b63588ff79 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:20.738299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae25671-3814-4d95-977a-79b63588ff79 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.738733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae25671-3814-4d95-977a-79b63588ff79 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.739189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae25671-3814-4d95-977a-79b63588ff79 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.740531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae25671-3814-4d95-977a-79b63588ff79 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:20.742325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae25671-3814-4d95-977a-79b63588ff79 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:20.756597 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2856/5666] 10.222.0.39 () {58 vars in 1188 bytes} [Sun Oct 16 01:27:20 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:20.757824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae25671-3814-4d95-977a-79b63588ff79 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:20.773835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae25671-3814-4d95-977a-79b63588ff79 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:20.782283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd30070-eb85-491b-a7a5-f536845cb4a8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:20.783222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd30070-eb85-491b-a7a5-f536845cb4a8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.783653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd30070-eb85-491b-a7a5-f536845cb4a8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.784121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd30070-eb85-491b-a7a5-f536845cb4a8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.785411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd30070-eb85-491b-a7a5-f536845cb4a8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:20.788271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd30070-eb85-491b-a7a5-f536845cb4a8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:20.789963 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2857/5667] 10.222.0.39 () {58 vars in 1200 bytes} [Sun Oct 16 01:27:20 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:20.793804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd30070-eb85-491b-a7a5-f536845cb4a8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:20.816110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd30070-eb85-491b-a7a5-f536845cb4a8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:20.823966 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2811/5668] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:20.827496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999f84c-e276-4655-a8de-5995d0fb43b4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:20.832351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5da90-40a2-4c53-9ef8-81b74f69733f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.833663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5da90-40a2-4c53-9ef8-81b74f69733f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.834034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f84c-e276-4655-a8de-5995d0fb43b4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.834461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5da90-40a2-4c53-9ef8-81b74f69733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.835445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f84c-e276-4655-a8de-5995d0fb43b4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.835867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f84c-e276-4655-a8de-5995d0fb43b4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.839206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999f84c-e276-4655-a8de-5995d0fb43b4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:20.841584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999f84c-e276-4655-a8de-5995d0fb43b4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:20.844365 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2858/5669] 10.222.0.39 () {58 vars in 1203 bytes} [Sun Oct 16 01:27:20 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:20.847686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999f84c-e276-4655-a8de-5995d0fb43b4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:20.874097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999f84c-e276-4655-a8de-5995d0fb43b4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:20.883675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-02e5da90-40a2-4c53-9ef8-81b74f69733f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:20.885716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-02e5da90-40a2-4c53-9ef8-81b74f69733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:20.890497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012171c7-0d08-4952-a185-f8c5aa579f6b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:20.891439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012171c7-0d08-4952-a185-f8c5aa579f6b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.891886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012171c7-0d08-4952-a185-f8c5aa579f6b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.892471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012171c7-0d08-4952-a185-f8c5aa579f6b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.893246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012171c7-0d08-4952-a185-f8c5aa579f6b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:20.896737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012171c7-0d08-4952-a185-f8c5aa579f6b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:20.900038 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2859/5670] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Oct 16 01:27:20 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:20.904856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012171c7-0d08-4952-a185-f8c5aa579f6b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:20.916725 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2812/5671] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:20.921097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5da90-40a2-4c53-9ef8-81b74f69733f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:20.930205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012171c7-0d08-4952-a185-f8c5aa579f6b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:20.941202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5da90-40a2-4c53-9ef8-81b74f69733f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:20.947345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234ee89-1d38-47ab-9f81-ca83a170118e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:20.948020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234ee89-1d38-47ab-9f81-ca83a170118e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.948320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234ee89-1d38-47ab-9f81-ca83a170118e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.948600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234ee89-1d38-47ab-9f81-ca83a170118e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.949579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234ee89-1d38-47ab-9f81-ca83a170118e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:20.951256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234ee89-1d38-47ab-9f81-ca83a170118e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:20.953748 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2860/5672] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:20 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:20.955150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0416f3-043f-4b05-840e-984f6f3c7ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:20.955772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0416f3-043f-4b05-840e-984f6f3c7ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.956053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0416f3-043f-4b05-840e-984f6f3c7ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.956327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0416f3-043f-4b05-840e-984f6f3c7ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.957621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234ee89-1d38-47ab-9f81-ca83a170118e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:20.958387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0416f3-043f-4b05-840e-984f6f3c7ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:20.958800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0416f3-043f-4b05-840e-984f6f3c7ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:20.962809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0416f3-043f-4b05-840e-984f6f3c7ea3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:20.979286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234ee89-1d38-47ab-9f81-ca83a170118e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:20.992477 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2813/5673] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:20.993861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b595b5-e3f7-479d-a515-5a00553b3302 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:20.994547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b595b5-e3f7-479d-a515-5a00553b3302 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:20.995058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b595b5-e3f7-479d-a515-5a00553b3302 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:20.995182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b595b5-e3f7-479d-a515-5a00553b3302 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:20.996515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0416f3-043f-4b05-840e-984f6f3c7ea3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:20.997709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b595b5-e3f7-479d-a515-5a00553b3302 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:20.999402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b595b5-e3f7-479d-a515-5a00553b3302 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.000579 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2861/5674] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Oct 16 01:27:20 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:21.006093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b595b5-e3f7-479d-a515-5a00553b3302 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.025681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0416f3-043f-4b05-840e-984f6f3c7ea3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.037809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b595b5-e3f7-479d-a515-5a00553b3302 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.041092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6270d-f3a6-4bdf-b438-339040cd544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.041718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6270d-f3a6-4bdf-b438-339040cd544d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.042003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6270d-f3a6-4bdf-b438-339040cd544d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.042276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6270d-f3a6-4bdf-b438-339040cd544d admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.042925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6270d-f3a6-4bdf-b438-339040cd544d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.044947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6270d-f3a6-4bdf-b438-339040cd544d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.045266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd9ee8-a106-49fa-9bc4-583ff475f3ff tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.046025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd9ee8-a106-49fa-9bc4-583ff475f3ff tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.046408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd9ee8-a106-49fa-9bc4-583ff475f3ff tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.046781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd9ee8-a106-49fa-9bc4-583ff475f3ff tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.047540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd9ee8-a106-49fa-9bc4-583ff475f3ff tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.052925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd9ee8-a106-49fa-9bc4-583ff475f3ff tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.060426 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2862/5675] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:21.061517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd9ee8-a106-49fa-9bc4-583ff475f3ff tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.073526 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:21.074228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd9ee8-a106-49fa-9bc4-583ff475f3ff tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.082224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b78fb-81df-4472-846b-b61968f42685 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.083865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b78fb-81df-4472-846b-b61968f42685 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.084455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b78fb-81df-4472-846b-b61968f42685 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.084838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b78fb-81df-4472-846b-b61968f42685 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.085723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b78fb-81df-4472-846b-b61968f42685 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.087688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b78fb-81df-4472-846b-b61968f42685 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.095885 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2863/5676] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:21.096057 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2814/5677] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:20 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:21.101374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b78fb-81df-4472-846b-b61968f42685 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.109841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6270d-f3a6-4bdf-b438-339040cd544d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.121803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b78fb-81df-4472-846b-b61968f42685 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.275853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeac56-4b9f-46e2-8769-d5b8310b80d3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.276540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeac56-4b9f-46e2-8769-d5b8310b80d3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.276820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeac56-4b9f-46e2-8769-d5b8310b80d3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.277086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeac56-4b9f-46e2-8769-d5b8310b80d3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.277552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6270d-f3a6-4bdf-b438-339040cd544d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.279303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfeac56-4b9f-46e2-8769-d5b8310b80d3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.280960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfeac56-4b9f-46e2-8769-d5b8310b80d3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.285532 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2864/5678] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:21.290253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeac56-4b9f-46e2-8769-d5b8310b80d3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.298197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d269d-676f-47be-8400-6c0ab5ab850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.298851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d269d-676f-47be-8400-6c0ab5ab850a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.299154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d269d-676f-47be-8400-6c0ab5ab850a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.299426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d269d-676f-47be-8400-6c0ab5ab850a admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.300068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d269d-676f-47be-8400-6c0ab5ab850a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.302949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d269d-676f-47be-8400-6c0ab5ab850a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.316179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeac56-4b9f-46e2-8769-d5b8310b80d3 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.330395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80a85d-8d8f-4108-8d63-86d85f9c8d51 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.331896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80a85d-8d8f-4108-8d63-86d85f9c8d51 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.332177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80a85d-8d8f-4108-8d63-86d85f9c8d51 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.332435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80a85d-8d8f-4108-8d63-86d85f9c8d51 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.335210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80a85d-8d8f-4108-8d63-86d85f9c8d51 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.338198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80a85d-8d8f-4108-8d63-86d85f9c8d51 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.342379 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2865/5679] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:21.347993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80a85d-8d8f-4108-8d63-86d85f9c8d51 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.364068 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2815/5680] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:21 2022] POST /identity/v3/users => generated 282 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:21.370823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d269d-676f-47be-8400-6c0ab5ab850a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.386292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80a85d-8d8f-4108-8d63-86d85f9c8d51 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.395256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d269d-676f-47be-8400-6c0ab5ab850a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.402066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eceb9c-0b03-4822-81a4-eb7f826a8e96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.403115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eceb9c-0b03-4822-81a4-eb7f826a8e96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.404884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eceb9c-0b03-4822-81a4-eb7f826a8e96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.406952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eceb9c-0b03-4822-81a4-eb7f826a8e96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.408756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eceb9c-0b03-4822-81a4-eb7f826a8e96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.410155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f2213-3667-4039-b683-4c04514b6a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.410794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f2213-3667-4039-b683-4c04514b6a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.411108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f2213-3667-4039-b683-4c04514b6a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.412211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f2213-3667-4039-b683-4c04514b6a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.412586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f2213-3667-4039-b683-4c04514b6a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.414083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eceb9c-0b03-4822-81a4-eb7f826a8e96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.414202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f2213-3667-4039-b683-4c04514b6a84 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.415298 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2866/5681] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:21.420151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eceb9c-0b03-4822-81a4-eb7f826a8e96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.440789 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2816/5682] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:21.445264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f2213-3667-4039-b683-4c04514b6a84 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.461629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f2213-3667-4039-b683-4c04514b6a84 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.473360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eceb9c-0b03-4822-81a4-eb7f826a8e96 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.478074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cd215-2728-41a6-8936-36bb6e964ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.478900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cd215-2728-41a6-8936-36bb6e964ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.479403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cd215-2728-41a6-8936-36bb6e964ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.479819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cd215-2728-41a6-8936-36bb6e964ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.480598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cd215-2728-41a6-8936-36bb6e964ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.482368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cd215-2728-41a6-8936-36bb6e964ccf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.488511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfc6f4-995f-405c-b836-1844257293d0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.489171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfc6f4-995f-405c-b836-1844257293d0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.489596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfc6f4-995f-405c-b836-1844257293d0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.489876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfc6f4-995f-405c-b836-1844257293d0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.493833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abfc6f4-995f-405c-b836-1844257293d0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.499291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abfc6f4-995f-405c-b836-1844257293d0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.507427 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2867/5683] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:21.508530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfc6f4-995f-405c-b836-1844257293d0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.513075 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2817/5684] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:27:21.518494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cd215-2728-41a6-8936-36bb6e964ccf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.538811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cd215-2728-41a6-8936-36bb6e964ccf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.540815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfc6f4-995f-405c-b836-1844257293d0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.554098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b269f6-f289-467d-9b21-504cace17305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.554782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b269f6-f289-467d-9b21-504cace17305 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.555100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b269f6-f289-467d-9b21-504cace17305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.555377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b269f6-f289-467d-9b21-504cace17305 admin admin] PATH_INFO: `/v3/projects/9b358fd2b53c4cec9453e380044ce7d4/users/507d6a72e4024cfbbafe80a36fb89325/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.586408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aea5e7-d1d4-4972-80c7-d53dafb56640 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.587123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aea5e7-d1d4-4972-80c7-d53dafb56640 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.587409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aea5e7-d1d4-4972-80c7-d53dafb56640 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.587698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aea5e7-d1d4-4972-80c7-d53dafb56640 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.592493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aea5e7-d1d4-4972-80c7-d53dafb56640 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.596689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aea5e7-d1d4-4972-80c7-d53dafb56640 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.602769 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2868/5685] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:21.603736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aea5e7-d1d4-4972-80c7-d53dafb56640 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.619749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b269f6-f289-467d-9b21-504cace17305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b358fd2b53c4cec9453e380044ce7d4, user_id=507d6a72e4024cfbbafe80a36fb89325, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.622441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b269f6-f289-467d-9b21-504cace17305 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.633521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aea5e7-d1d4-4972-80c7-d53dafb56640 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.651230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79e188-316f-4596-8e1f-3902bdc98af4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.651898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79e188-316f-4596-8e1f-3902bdc98af4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.652181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79e188-316f-4596-8e1f-3902bdc98af4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.652458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79e188-316f-4596-8e1f-3902bdc98af4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.653066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79e188-316f-4596-8e1f-3902bdc98af4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.654655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79e188-316f-4596-8e1f-3902bdc98af4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.666370 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2818/5686] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:21 2022] PUT /identity/v3/projects/9b358fd2b53c4cec9453e380044ce7d4/users/507d6a72e4024cfbbafe80a36fb89325/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:27:21.677842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1d1b0-fbef-4d4a-b8e0-eded8807f446 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.678190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1d1b0-fbef-4d4a-b8e0-eded8807f446 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.678377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1d1b0-fbef-4d4a-b8e0-eded8807f446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.679401 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2869/5687] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:21.684179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79e188-316f-4596-8e1f-3902bdc98af4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.714625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79e188-316f-4596-8e1f-3902bdc98af4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.747993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c1d1d1b0-fbef-4d4a-b8e0-eded8807f446 None None] MFA Rules not processed for user `507d6a72e4024cfbbafe80a36fb89325`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:21.749458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c1d1d1b0-fbef-4d4a-b8e0-eded8807f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:21.855777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a401e1f-c3b0-4a86-a448-b4abc0e7c699 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.856689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401e1f-c3b0-4a86-a448-b4abc0e7c699 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.856689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401e1f-c3b0-4a86-a448-b4abc0e7c699 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.857021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401e1f-c3b0-4a86-a448-b4abc0e7c699 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.857504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a401e1f-c3b0-4a86-a448-b4abc0e7c699 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.859158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a401e1f-c3b0-4a86-a448-b4abc0e7c699 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.866954 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2870/5688] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:21.867940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a401e1f-c3b0-4a86-a448-b4abc0e7c699 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.910907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a401e1f-c3b0-4a86-a448-b4abc0e7c699 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.927788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37fd96-bd62-4006-9b0a-1befa533c196 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.928474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37fd96-bd62-4006-9b0a-1befa533c196 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:21.928759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37fd96-bd62-4006-9b0a-1befa533c196 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:21.929040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37fd96-bd62-4006-9b0a-1befa533c196 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:21.929640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37fd96-bd62-4006-9b0a-1befa533c196 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:21.931379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37fd96-bd62-4006-9b0a-1befa533c196 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:21.932916 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2871/5689] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:21.937162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37fd96-bd62-4006-9b0a-1befa533c196 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.940337 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2819/5690] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:27:21.953480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1d1b0-fbef-4d4a-b8e0-eded8807f446 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:21.954497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c1d1d1b0-fbef-4d4a-b8e0-eded8807f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:21.981665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37fd96-bd62-4006-9b0a-1befa533c196 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:21.990018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d755d-aedd-4cb6-a4b7-56cb47273559 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:21.990841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d755d-aedd-4cb6-a4b7-56cb47273559 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.011266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d755d-aedd-4cb6-a4b7-56cb47273559 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.012082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d755d-aedd-4cb6-a4b7-56cb47273559 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.013774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d755d-aedd-4cb6-a4b7-56cb47273559 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.025083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d755d-aedd-4cb6-a4b7-56cb47273559 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.030065 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2872/5691] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:22.034279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d755d-aedd-4cb6-a4b7-56cb47273559 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.040454 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:22.062952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d755d-aedd-4cb6-a4b7-56cb47273559 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.077089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ff7c-6600-4070-b0f0-9cd7562395d9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.079164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ff7c-6600-4070-b0f0-9cd7562395d9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.079694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ff7c-6600-4070-b0f0-9cd7562395d9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.080246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ff7c-6600-4070-b0f0-9cd7562395d9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.081030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8ff7c-6600-4070-b0f0-9cd7562395d9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.084445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8ff7c-6600-4070-b0f0-9cd7562395d9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.089795 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2873/5692] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 16 01:27:22.094233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ff7c-6600-4070-b0f0-9cd7562395d9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.108382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ff7c-6600-4070-b0f0-9cd7562395d9 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.115646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2b57a-00af-492b-8753-df0424bdefa1 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.116510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2b57a-00af-492b-8753-df0424bdefa1 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.116960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2b57a-00af-492b-8753-df0424bdefa1 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.117385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2b57a-00af-492b-8753-df0424bdefa1 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.119782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2b57a-00af-492b-8753-df0424bdefa1 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.122541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2b57a-00af-492b-8753-df0424bdefa1 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.124826 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2874/5693] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:22.130895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2b57a-00af-492b-8753-df0424bdefa1 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.146470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2b57a-00af-492b-8753-df0424bdefa1 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.164272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e877c-2ea7-4942-9d59-61263797ff3f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.164949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e877c-2ea7-4942-9d59-61263797ff3f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.165235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e877c-2ea7-4942-9d59-61263797ff3f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.165518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e877c-2ea7-4942-9d59-61263797ff3f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.166418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e877c-2ea7-4942-9d59-61263797ff3f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.171753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e877c-2ea7-4942-9d59-61263797ff3f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.176397 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2875/5694] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:22.181141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1d1b0-fbef-4d4a-b8e0-eded8807f446 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.181982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e877c-2ea7-4942-9d59-61263797ff3f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.195151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6831b5-0ad2-41d8-b272-73379ad29bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.195786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6831b5-0ad2-41d8-b272-73379ad29bf5 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.196062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6831b5-0ad2-41d8-b272-73379ad29bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.196330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6831b5-0ad2-41d8-b272-73379ad29bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.203494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e877c-2ea7-4942-9d59-61263797ff3f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.217802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6831b5-0ad2-41d8-b272-73379ad29bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.219555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6831b5-0ad2-41d8-b272-73379ad29bf5 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.219980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6aa5a-b5e2-4492-9806-97e18fe37c0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.221233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6aa5a-b5e2-4492-9806-97e18fe37c0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.221538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6aa5a-b5e2-4492-9806-97e18fe37c0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.222000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6aa5a-b5e2-4492-9806-97e18fe37c0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.222812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6aa5a-b5e2-4492-9806-97e18fe37c0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.227040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6aa5a-b5e2-4492-9806-97e18fe37c0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.230937 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2876/5695] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:22.232703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6aa5a-b5e2-4492-9806-97e18fe37c0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.248504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6aa5a-b5e2-4492-9806-97e18fe37c0e tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.249230 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2820/5696] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:22.261728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa274dbb-8239-4568-a5df-b8f71b2bb84d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.263682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa274dbb-8239-4568-a5df-b8f71b2bb84d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.263682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa274dbb-8239-4568-a5df-b8f71b2bb84d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.266476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa274dbb-8239-4568-a5df-b8f71b2bb84d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.267382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa274dbb-8239-4568-a5df-b8f71b2bb84d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.276535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa274dbb-8239-4568-a5df-b8f71b2bb84d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.278996 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2877/5697] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:22.312946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6831b5-0ad2-41d8-b272-73379ad29bf5 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.313833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa274dbb-8239-4568-a5df-b8f71b2bb84d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.333254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa274dbb-8239-4568-a5df-b8f71b2bb84d tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.345425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af47684-8111-4109-b072-d50514b2f48a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.347568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af47684-8111-4109-b072-d50514b2f48a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.350090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af47684-8111-4109-b072-d50514b2f48a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.350879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af47684-8111-4109-b072-d50514b2f48a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.353479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af47684-8111-4109-b072-d50514b2f48a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.355936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af47684-8111-4109-b072-d50514b2f48a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.361382 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2878/5698] 10.222.0.39 () {58 vars in 1290 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:22.367184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af47684-8111-4109-b072-d50514b2f48a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.395657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af47684-8111-4109-b072-d50514b2f48a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.418607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e69335-6356-400a-b2f1-d28be0ce0355 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.419301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e69335-6356-400a-b2f1-d28be0ce0355 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.419586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e69335-6356-400a-b2f1-d28be0ce0355 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.419863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e69335-6356-400a-b2f1-d28be0ce0355 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.420456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e69335-6356-400a-b2f1-d28be0ce0355 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.424934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e69335-6356-400a-b2f1-d28be0ce0355 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.429665 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2879/5699] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:22.435005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e69335-6356-400a-b2f1-d28be0ce0355 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.461092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e69335-6356-400a-b2f1-d28be0ce0355 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.512102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06068dab-be14-4f99-b392-1079e7c28017 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.513226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06068dab-be14-4f99-b392-1079e7c28017 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.513455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06068dab-be14-4f99-b392-1079e7c28017 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.513740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06068dab-be14-4f99-b392-1079e7c28017 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.514604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06068dab-be14-4f99-b392-1079e7c28017 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.517614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06068dab-be14-4f99-b392-1079e7c28017 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.520169 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2880/5700] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:22.525237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06068dab-be14-4f99-b392-1079e7c28017 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.526803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6831b5-0ad2-41d8-b272-73379ad29bf5 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.535153 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:22.541549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5cbc6-8073-4bbe-b7b8-99537d9a1f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.542403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5cbc6-8073-4bbe-b7b8-99537d9a1f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.542818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5cbc6-8073-4bbe-b7b8-99537d9a1f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.543048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06068dab-be14-4f99-b392-1079e7c28017 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.543430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5cbc6-8073-4bbe-b7b8-99537d9a1f6f admin admin] PATH_INFO: `/v3/users/507d6a72e4024cfbbafe80a36fb89325` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.550078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5cbc6-8073-4bbe-b7b8-99537d9a1f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=507d6a72e4024cfbbafe80a36fb89325)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.552611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5cbc6-8073-4bbe-b7b8-99537d9a1f6f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.553447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620845a-731e-4de8-bcab-724cbebf42ba tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.554728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620845a-731e-4de8-bcab-724cbebf42ba tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.556207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620845a-731e-4de8-bcab-724cbebf42ba tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.556683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620845a-731e-4de8-bcab-724cbebf42ba tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.558164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620845a-731e-4de8-bcab-724cbebf42ba tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.561942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620845a-731e-4de8-bcab-724cbebf42ba tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.566741 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2881/5701] 10.222.0.39 () {58 vars in 1308 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:22.570545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620845a-731e-4de8-bcab-724cbebf42ba tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.599789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620845a-731e-4de8-bcab-724cbebf42ba tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.602104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b451a-d83e-425e-baf5-ef7f97d826ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.605700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b451a-d83e-425e-baf5-ef7f97d826ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.605700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b451a-d83e-425e-baf5-ef7f97d826ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.606216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b451a-d83e-425e-baf5-ef7f97d826ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.607132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b451a-d83e-425e-baf5-ef7f97d826ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.609456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b451a-d83e-425e-baf5-ef7f97d826ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.610992 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2882/5702] 10.222.0.39 () {58 vars in 1290 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:22.614817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b451a-d83e-425e-baf5-ef7f97d826ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.632228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b451a-d83e-425e-baf5-ef7f97d826ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.646336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804ae4-de4b-4712-91d3-72d445fc90e4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.647555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804ae4-de4b-4712-91d3-72d445fc90e4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.648219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804ae4-de4b-4712-91d3-72d445fc90e4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.648548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804ae4-de4b-4712-91d3-72d445fc90e4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.649448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98804ae4-de4b-4712-91d3-72d445fc90e4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.678107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98804ae4-de4b-4712-91d3-72d445fc90e4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.683134 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2883/5703] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 16 01:27:22.685323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804ae4-de4b-4712-91d3-72d445fc90e4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.686245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d5b5cbc6-8073-4bbe-b7b8-99537d9a1f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507d6a72e4024cfbbafe80a36fb89325'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:22.687119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d5b5cbc6-8073-4bbe-b7b8-99537d9a1f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507d6a72e4024cfbbafe80a36fb89325'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:22.705712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804ae4-de4b-4712-91d3-72d445fc90e4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.722262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d5b5cbc6-8073-4bbe-b7b8-99537d9a1f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507d6a72e4024cfbbafe80a36fb89325'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:22.724384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4d97c-43e8-4ba4-b296-6a437f8def69 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.725050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4d97c-43e8-4ba4-b296-6a437f8def69 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.725334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4d97c-43e8-4ba4-b296-6a437f8def69 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.725611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4d97c-43e8-4ba4-b296-6a437f8def69 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.726198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4d97c-43e8-4ba4-b296-6a437f8def69 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.730768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4d97c-43e8-4ba4-b296-6a437f8def69 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.732338 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2884/5704] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:22.737278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4d97c-43e8-4ba4-b296-6a437f8def69 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.741963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6ee4d97c-43e8-4ba4-b296-6a437f8def69 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:22.749530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d5b5cbc6-8073-4bbe-b7b8-99537d9a1f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507d6a72e4024cfbbafe80a36fb89325'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:22.751682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d5b5cbc6-8073-4bbe-b7b8-99537d9a1f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507d6a72e4024cfbbafe80a36fb89325'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:22.775425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4d97c-43e8-4ba4-b296-6a437f8def69 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.779434 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2821/5705] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:22 2022] DELETE /identity/v3/users/507d6a72e4024cfbbafe80a36fb89325 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:22.791796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811346f4-f229-4ec3-8eb5-c428dc93fad4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.792466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811346f4-f229-4ec3-8eb5-c428dc93fad4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.792749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811346f4-f229-4ec3-8eb5-c428dc93fad4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.793038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811346f4-f229-4ec3-8eb5-c428dc93fad4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.793624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811346f4-f229-4ec3-8eb5-c428dc93fad4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.795255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811346f4-f229-4ec3-8eb5-c428dc93fad4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.803669 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2885/5706] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:22.804618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811346f4-f229-4ec3-8eb5-c428dc93fad4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:22.806206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6ea33-9d46-4168-a41d-762fafe7db7e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.807076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6ea33-9d46-4168-a41d-762fafe7db7e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.816458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6ea33-9d46-4168-a41d-762fafe7db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.823850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811346f4-f229-4ec3-8eb5-c428dc93fad4 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:22.860501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-93e6ea33-9d46-4168-a41d-762fafe7db7e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:22.868645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-93e6ea33-9d46-4168-a41d-762fafe7db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:22.944967 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:22.977564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5b20-86c7-4700-9e0e-d93f5860a0ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:22.978239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5b20-86c7-4700-9e0e-d93f5860a0ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:22.978520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5b20-86c7-4700-9e0e-d93f5860a0ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:22.978794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5b20-86c7-4700-9e0e-d93f5860a0ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:22.983916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e5b20-86c7-4700-9e0e-d93f5860a0ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:22.985700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e5b20-86c7-4700-9e0e-d93f5860a0ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:22.987151 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2886/5707] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:22.996356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5b20-86c7-4700-9e0e-d93f5860a0ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.016410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5b20-86c7-4700-9e0e-d93f5860a0ef tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.024238 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2822/5708] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:23.039908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6ea33-9d46-4168-a41d-762fafe7db7e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.042825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6c6e4-d6ee-4a6a-bfeb-7ccc69f3cca5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.042825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6c6e4-d6ee-4a6a-bfeb-7ccc69f3cca5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.042825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6c6e4-d6ee-4a6a-bfeb-7ccc69f3cca5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.043184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6c6e4-d6ee-4a6a-bfeb-7ccc69f3cca5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.043184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6c6e4-d6ee-4a6a-bfeb-7ccc69f3cca5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.045605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-93e6ea33-9d46-4168-a41d-762fafe7db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:23.048600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6c6e4-d6ee-4a6a-bfeb-7ccc69f3cca5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.054177 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2887/5709] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:27:22 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.059764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6c6e4-d6ee-4a6a-bfeb-7ccc69f3cca5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.087116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6c6e4-d6ee-4a6a-bfeb-7ccc69f3cca5 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.098643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb07fc1-430b-4b50-b234-8a25ec73deac tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.099899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb07fc1-430b-4b50-b234-8a25ec73deac tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.100217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb07fc1-430b-4b50-b234-8a25ec73deac tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.100568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb07fc1-430b-4b50-b234-8a25ec73deac tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.101851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb07fc1-430b-4b50-b234-8a25ec73deac tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.102768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb07fc1-430b-4b50-b234-8a25ec73deac tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.110243 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2888/5710] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.111580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb07fc1-430b-4b50-b234-8a25ec73deac tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.139105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb07fc1-430b-4b50-b234-8a25ec73deac tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.151684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139d949-ab68-4833-b4c9-a513e4ba3b8b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.152635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139d949-ab68-4833-b4c9-a513e4ba3b8b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.152635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139d949-ab68-4833-b4c9-a513e4ba3b8b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.152928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139d949-ab68-4833-b4c9-a513e4ba3b8b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.153453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139d949-ab68-4833-b4c9-a513e4ba3b8b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.155090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139d949-ab68-4833-b4c9-a513e4ba3b8b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.163518 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2889/5711] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.164476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139d949-ab68-4833-b4c9-a513e4ba3b8b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.186638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139d949-ab68-4833-b4c9-a513e4ba3b8b tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.186871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6ea33-9d46-4168-a41d-762fafe7db7e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.201032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dde161-b45f-4a74-a186-c1bf5981facc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.201905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dde161-b45f-4a74-a186-c1bf5981facc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.202196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dde161-b45f-4a74-a186-c1bf5981facc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.202470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dde161-b45f-4a74-a186-c1bf5981facc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.203108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dde161-b45f-4a74-a186-c1bf5981facc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.203392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a912c9-f0f9-413d-88f3-c8224bef0142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.204017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a912c9-f0f9-413d-88f3-c8224bef0142 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.204422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a912c9-f0f9-413d-88f3-c8224bef0142 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.204697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a912c9-f0f9-413d-88f3-c8224bef0142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.204808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dde161-b45f-4a74-a186-c1bf5981facc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.212552 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2890/5712] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.213459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dde161-b45f-4a74-a186-c1bf5981facc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.226879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a912c9-f0f9-413d-88f3-c8224bef0142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.228353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a912c9-f0f9-413d-88f3-c8224bef0142 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.236809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dde161-b45f-4a74-a186-c1bf5981facc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.253665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a92355-65eb-411f-bbab-9e29db90c1e8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.254477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a92355-65eb-411f-bbab-9e29db90c1e8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.254763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a92355-65eb-411f-bbab-9e29db90c1e8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.255110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a92355-65eb-411f-bbab-9e29db90c1e8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.255822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a92355-65eb-411f-bbab-9e29db90c1e8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.257432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a92355-65eb-411f-bbab-9e29db90c1e8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.261068 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2823/5713] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:23.265186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a912c9-f0f9-413d-88f3-c8224bef0142 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.266449 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2891/5714] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.308111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a912c9-f0f9-413d-88f3-c8224bef0142 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.320270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6b33c-1f1a-41e2-bc1b-65f61a628595 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.320940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b33c-1f1a-41e2-bc1b-65f61a628595 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.321220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b33c-1f1a-41e2-bc1b-65f61a628595 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.321494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b33c-1f1a-41e2-bc1b-65f61a628595 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.322246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6b33c-1f1a-41e2-bc1b-65f61a628595 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.326600 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-7bc6b33c-1f1a-41e2-bc1b-65f61a628595 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:23.326600 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:27:23.326600 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:27:23.327560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6b33c-1f1a-41e2-bc1b-65f61a628595 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.329974 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2824/5715] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.333625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a92355-65eb-411f-bbab-9e29db90c1e8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.353635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a92355-65eb-411f-bbab-9e29db90c1e8 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.360254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fe28e-173e-434f-afbe-b8c90479ebc2 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.360254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fe28e-173e-434f-afbe-b8c90479ebc2 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.360549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fe28e-173e-434f-afbe-b8c90479ebc2 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.360789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fe28e-173e-434f-afbe-b8c90479ebc2 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.361375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fe28e-173e-434f-afbe-b8c90479ebc2 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.370891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fe28e-173e-434f-afbe-b8c90479ebc2 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.372406 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2892/5716] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.377221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6b33c-1f1a-41e2-bc1b-65f61a628595 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.396309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6b33c-1f1a-41e2-bc1b-65f61a628595 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.408530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62069-7d55-471a-a12b-b426490f247a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.412167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62069-7d55-471a-a12b-b426490f247a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.412485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62069-7d55-471a-a12b-b426490f247a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.412861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62069-7d55-471a-a12b-b426490f247a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.413507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd62069-7d55-471a-a12b-b426490f247a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.417607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd62069-7d55-471a-a12b-b426490f247a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.420973 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2825/5717] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.427758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fe28e-173e-434f-afbe-b8c90479ebc2 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.444058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fe28e-173e-434f-afbe-b8c90479ebc2 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.460007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf54c4f-7864-4733-967f-ab301dfaee58 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.460671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf54c4f-7864-4733-967f-ab301dfaee58 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.460951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf54c4f-7864-4733-967f-ab301dfaee58 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.461228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf54c4f-7864-4733-967f-ab301dfaee58 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.461817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf54c4f-7864-4733-967f-ab301dfaee58 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.463443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf54c4f-7864-4733-967f-ab301dfaee58 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.469122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62069-7d55-471a-a12b-b426490f247a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.482127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62069-7d55-471a-a12b-b426490f247a tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.484860 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2893/5718] 10.222.0.39 () {58 vars in 1212 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.500905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a3c4-0935-4a69-bca6-95bded9deb2c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.501970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a3c4-0935-4a69-bca6-95bded9deb2c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.502263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a3c4-0935-4a69-bca6-95bded9deb2c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.503249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a3c4-0935-4a69-bca6-95bded9deb2c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.504048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3a3c4-0935-4a69-bca6-95bded9deb2c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.508166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3a3c4-0935-4a69-bca6-95bded9deb2c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.516371 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2826/5719] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.520269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf54c4f-7864-4733-967f-ab301dfaee58 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.535559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf54c4f-7864-4733-967f-ab301dfaee58 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.575090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9cbe4-25f5-482d-81eb-be704b033f77 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.575750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9cbe4-25f5-482d-81eb-be704b033f77 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.576034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9cbe4-25f5-482d-81eb-be704b033f77 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.576306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9cbe4-25f5-482d-81eb-be704b033f77 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.576895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9cbe4-25f5-482d-81eb-be704b033f77 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.578505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9cbe4-25f5-482d-81eb-be704b033f77 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.583788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a3c4-0935-4a69-bca6-95bded9deb2c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.594239 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2894/5720] 10.222.0.39 () {58 vars in 1215 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.596868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a3c4-0935-4a69-bca6-95bded9deb2c tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.602066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d459df0-cfe4-4da3-aa08-1a9f19bc70fc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.602810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d459df0-cfe4-4da3-aa08-1a9f19bc70fc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.603196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d459df0-cfe4-4da3-aa08-1a9f19bc70fc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.603608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d459df0-cfe4-4da3-aa08-1a9f19bc70fc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.604494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d459df0-cfe4-4da3-aa08-1a9f19bc70fc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.611220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d459df0-cfe4-4da3-aa08-1a9f19bc70fc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.617909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9cbe4-25f5-482d-81eb-be704b033f77 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.625644 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2827/5721] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 16 01:27:23.635835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9cbe4-25f5-482d-81eb-be704b033f77 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.660923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b7c50-dc06-4c55-b195-762203b2e0c6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.661992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b7c50-dc06-4c55-b195-762203b2e0c6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.664864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b7c50-dc06-4c55-b195-762203b2e0c6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.665939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b7c50-dc06-4c55-b195-762203b2e0c6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.667100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b7c50-dc06-4c55-b195-762203b2e0c6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.673674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b7c50-dc06-4c55-b195-762203b2e0c6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.676036 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2895/5722] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.681273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d459df0-cfe4-4da3-aa08-1a9f19bc70fc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.713785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d459df0-cfe4-4da3-aa08-1a9f19bc70fc tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.741940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47795cc3-4561-415a-8140-3759712b7a64 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.742616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47795cc3-4561-415a-8140-3759712b7a64 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.742898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47795cc3-4561-415a-8140-3759712b7a64 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.743202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47795cc3-4561-415a-8140-3759712b7a64 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.743792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47795cc3-4561-415a-8140-3759712b7a64 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.745411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47795cc3-4561-415a-8140-3759712b7a64 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.753804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b7c50-dc06-4c55-b195-762203b2e0c6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.754649 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2828/5723] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.777151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b7c50-dc06-4c55-b195-762203b2e0c6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.799158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334348c-c560-46e8-8c9b-718802bc5245 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.800323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334348c-c560-46e8-8c9b-718802bc5245 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.800323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334348c-c560-46e8-8c9b-718802bc5245 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.806271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334348c-c560-46e8-8c9b-718802bc5245 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.809796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334348c-c560-46e8-8c9b-718802bc5245 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.815334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334348c-c560-46e8-8c9b-718802bc5245 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.817330 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2896/5724] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.821721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47795cc3-4561-415a-8140-3759712b7a64 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.836682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47795cc3-4561-415a-8140-3759712b7a64 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.856397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297f5e7-dc4c-4e0b-b172-f89668986af0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.857268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297f5e7-dc4c-4e0b-b172-f89668986af0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.857689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297f5e7-dc4c-4e0b-b172-f89668986af0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.858381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297f5e7-dc4c-4e0b-b172-f89668986af0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.859144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297f5e7-dc4c-4e0b-b172-f89668986af0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.860920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297f5e7-dc4c-4e0b-b172-f89668986af0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.865572 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2829/5725] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.866372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334348c-c560-46e8-8c9b-718802bc5245 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.877368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334348c-c560-46e8-8c9b-718802bc5245 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.883540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413cf27-d4b7-4606-801b-c462a96c51b6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.884273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413cf27-d4b7-4606-801b-c462a96c51b6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.884622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413cf27-d4b7-4606-801b-c462a96c51b6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.884967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413cf27-d4b7-4606-801b-c462a96c51b6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.885624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413cf27-d4b7-4606-801b-c462a96c51b6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.887326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413cf27-d4b7-4606-801b-c462a96c51b6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.892859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297f5e7-dc4c-4e0b-b172-f89668986af0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.906406 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2897/5726] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 16 01:27:23.910787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297f5e7-dc4c-4e0b-b172-f89668986af0 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.924450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b20862-4869-4d3f-873a-3acc352c5477 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.925444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b20862-4869-4d3f-873a-3acc352c5477 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.925840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b20862-4869-4d3f-873a-3acc352c5477 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.926210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b20862-4869-4d3f-873a-3acc352c5477 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.927083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b20862-4869-4d3f-873a-3acc352c5477 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.936716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b20862-4869-4d3f-873a-3acc352c5477 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:23.956120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413cf27-d4b7-4606-801b-c462a96c51b6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:23.966145 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2830/5727] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:23.978290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413cf27-d4b7-4606-801b-c462a96c51b6 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:23.990247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad345de9-25ac-4e84-a8b9-c69ec1074cfa tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:23.990935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345de9-25ac-4e84-a8b9-c69ec1074cfa tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:23.991454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345de9-25ac-4e84-a8b9-c69ec1074cfa tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:23.991731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345de9-25ac-4e84-a8b9-c69ec1074cfa tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:23.992326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad345de9-25ac-4e84-a8b9-c69ec1074cfa tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:23.994509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad345de9-25ac-4e84-a8b9-c69ec1074cfa tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:24.001528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b20862-4869-4d3f-873a-3acc352c5477 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:24.002368 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2898/5728] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Oct 16 01:27:23 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 16 01:27:24.018102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b20862-4869-4d3f-873a-3acc352c5477 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:24.038673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40fb50-2bab-4c9a-a039-6888d7e644ce tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:24.039196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40fb50-2bab-4c9a-a039-6888d7e644ce tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:24.039584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40fb50-2bab-4c9a-a039-6888d7e644ce tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:24.039936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40fb50-2bab-4c9a-a039-6888d7e644ce tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/8a7909cfd4e04718b42c5b454728b6bc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:24.060576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40fb50-2bab-4c9a-a039-6888d7e644ce tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-ed40fb50-2bab-4c9a-a039-6888d7e644ce tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Could not find domain: 8a7909cfd4e04718b42c5b454728b6bc.: keystone.exception.DomainNotFound: Could not find domain: 8a7909cfd4e04718b42c5b454728b6bc. Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8a7909cfd4e04718b42c5b454728b6bc. Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:27:24.078761 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:27:24.080164 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:27:24.081450 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8a7909cfd4e04718b42c5b454728b6bc. Oct 16 01:27:24.082787 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:27:24.082787 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2831/5729] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:27:24 2022] PATCH /identity/v3/domains/8a7909cfd4e04718b42c5b454728b6bc => generated 112 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:27:24.085046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad345de9-25ac-4e84-a8b9-c69ec1074cfa tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:24.101955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad345de9-25ac-4e84-a8b9-c69ec1074cfa tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:24.124228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7b09e-5c29-42da-bbc9-b5245f9b280f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:24.124883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7b09e-5c29-42da-bbc9-b5245f9b280f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:24.125180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7b09e-5c29-42da-bbc9-b5245f9b280f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:24.125838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7b09e-5c29-42da-bbc9-b5245f9b280f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/367b9b98a547411ea239bd7b855e66ba` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:24.152038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7b09e-5c29-42da-bbc9-b5245f9b280f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-99c7b09e-5c29-42da-bbc9-b5245f9b280f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Could not find domain: 367b9b98a547411ea239bd7b855e66ba.: keystone.exception.DomainNotFound: Could not find domain: 367b9b98a547411ea239bd7b855e66ba. Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 367b9b98a547411ea239bd7b855e66ba. Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:27:24.165210 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:27:24.166039 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:27:24.166820 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 367b9b98a547411ea239bd7b855e66ba. Oct 16 01:27:24.167699 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:27:24.171725 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2899/5730] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:27:24 2022] PATCH /identity/v3/domains/367b9b98a547411ea239bd7b855e66ba => generated 112 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:27:24.173371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40fb50-2bab-4c9a-a039-6888d7e644ce tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:24.191782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40fb50-2bab-4c9a-a039-6888d7e644ce tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:24.215871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b59a6a-2d99-4cb6-8a93-3bbd7c366114 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad9e5c7055a43e7bed0c747f3565a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3150af876ae04de2b7583da7c731bc74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:24.218588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b59a6a-2d99-4cb6-8a93-3bbd7c366114 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:24.218588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b59a6a-2d99-4cb6-8a93-3bbd7c366114 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:24.218588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b59a6a-2d99-4cb6-8a93-3bbd7c366114 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] PATH_INFO: `/v3/domains/961f09dc21c74689845f56c29c035c0b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:24.243653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b59a6a-2d99-4cb6-8a93-3bbd7c366114 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-62b59a6a-2d99-4cb6-8a93-3bbd7c366114 tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Could not find domain: 961f09dc21c74689845f56c29c035c0b.: keystone.exception.DomainNotFound: Could not find domain: 961f09dc21c74689845f56c29c035c0b. Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 961f09dc21c74689845f56c29c035c0b. Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:27:24.264673 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:27:24.265705 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:27:24.266620 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 961f09dc21c74689845f56c29c035c0b. Oct 16 01:27:24.268105 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:27:24.268105 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2832/5731] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:27:24 2022] PATCH /identity/v3/domains/961f09dc21c74689845f56c29c035c0b => generated 112 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 16 01:27:24.271643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7b09e-5c29-42da-bbc9-b5245f9b280f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:24.273782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-99c7b09e-5c29-42da-bbc9-b5245f9b280f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:24.298754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7b09e-5c29-42da-bbc9-b5245f9b280f tempest-DomainConfigurationTestJSON-95703375 tempest-DomainConfigurationTestJSON-95703375-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:24.319340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:24.319881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:24.320169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:24.320446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] PATH_INFO: `/v3/users/0d1649e51b3e44e780c6a6ed1d36f2fd` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:24.323753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d1649e51b3e44e780c6a6ed1d36f2fd)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:24.328572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:24.491437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d1649e51b3e44e780c6a6ed1d36f2fd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:24.494423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d1649e51b3e44e780c6a6ed1d36f2fd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:24.568775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d1649e51b3e44e780c6a6ed1d36f2fd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:24.591060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d1649e51b3e44e780c6a6ed1d36f2fd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:24.591808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d1649e51b3e44e780c6a6ed1d36f2fd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:24.618199 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:24.629708 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2900/5732] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:24 2022] DELETE /identity/v3/users/0d1649e51b3e44e780c6a6ed1d36f2fd => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:24.635509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654265f-c94e-45f5-9e6d-22b98bda4ab3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:24.636144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654265f-c94e-45f5-9e6d-22b98bda4ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:24.636641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654265f-c94e-45f5-9e6d-22b98bda4ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:24.687954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9654265f-c94e-45f5-9e6d-22b98bda4ab3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:24.689533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9654265f-c94e-45f5-9e6d-22b98bda4ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:24.873225 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2833/5733] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:24.927287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:24.928852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:25.079840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82c5d2-64c1-421c-a23e-8b0d5bbd9bde admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:25.090735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbb5e9-aeec-46f4-8a40-61474a7a6a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:25.091881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbb5e9-aeec-46f4-8a40-61474a7a6a28 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:25.093671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbb5e9-aeec-46f4-8a40-61474a7a6a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:25.093963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbb5e9-aeec-46f4-8a40-61474a7a6a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:25.131117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbb5e9-aeec-46f4-8a40-61474a7a6a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:25.135548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbb5e9-aeec-46f4-8a40-61474a7a6a28 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:25.210526 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2901/5734] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:25.222166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654265f-c94e-45f5-9e6d-22b98bda4ab3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:25.224195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9654265f-c94e-45f5-9e6d-22b98bda4ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:25.258059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654265f-c94e-45f5-9e6d-22b98bda4ab3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:25.267653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f050df-2e22-4ca7-9c9a-9572a05cd49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:25.268308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f050df-2e22-4ca7-9c9a-9572a05cd49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:25.268588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f050df-2e22-4ca7-9c9a-9572a05cd49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:25.268861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f050df-2e22-4ca7-9c9a-9572a05cd49c admin admin] PATH_INFO: `/v3/projects/9b358fd2b53c4cec9453e380044ce7d4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:25.271293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f050df-2e22-4ca7-9c9a-9572a05cd49c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b358fd2b53c4cec9453e380044ce7d4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:25.287046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f050df-2e22-4ca7-9c9a-9572a05cd49c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:25.362020 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:25.437216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-23f050df-2e22-4ca7-9c9a-9572a05cd49c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b358fd2b53c4cec9453e380044ce7d4', 'request_id': 'req-23f050df-2e22-4ca7-9c9a-9572a05cd49c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:25.449811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-23f050df-2e22-4ca7-9c9a-9572a05cd49c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b358fd2b53c4cec9453e380044ce7d4', 'request_id': 'req-23f050df-2e22-4ca7-9c9a-9572a05cd49c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:25.461152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-23f050df-2e22-4ca7-9c9a-9572a05cd49c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b358fd2b53c4cec9453e380044ce7d4', 'request_id': 'req-23f050df-2e22-4ca7-9c9a-9572a05cd49c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:25.487123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-23f050df-2e22-4ca7-9c9a-9572a05cd49c admin admin] The token cache is being invalidate because project 9b358fd2b53c4cec9453e380044ce7d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:25.487449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-23f050df-2e22-4ca7-9c9a-9572a05cd49c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:25.488175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-23f050df-2e22-4ca7-9c9a-9572a05cd49c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:25.494274 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2834/5735] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:25 2022] DELETE /identity/v3/projects/9b358fd2b53c4cec9453e380044ce7d4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:25.495464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ad953-938c-4435-9140-55d1245ae669 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:25.495919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ad953-938c-4435-9140-55d1245ae669 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:25.496358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ad953-938c-4435-9140-55d1245ae669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:25.547511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d34ad953-938c-4435-9140-55d1245ae669 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:25.548985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d34ad953-938c-4435-9140-55d1245ae669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:25.702732 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2902/5736] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:25.712340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88f658-48f7-4e0b-90d0-78d77f994bcb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:25.713542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88f658-48f7-4e0b-90d0-78d77f994bcb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:25.713830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88f658-48f7-4e0b-90d0-78d77f994bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:25.773253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3f88f658-48f7-4e0b-90d0-78d77f994bcb None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:25.774845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3f88f658-48f7-4e0b-90d0-78d77f994bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:25.799866 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2835/5737] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:25.800590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ad953-938c-4435-9140-55d1245ae669 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:25.816446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ad953-938c-4435-9140-55d1245ae669 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:25.830215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e369af-bfe0-42f5-af3d-7fbf17f784b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:25.830910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e369af-bfe0-42f5-af3d-7fbf17f784b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:25.831217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e369af-bfe0-42f5-af3d-7fbf17f784b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:25.831495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e369af-bfe0-42f5-af3d-7fbf17f784b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:25.832156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e369af-bfe0-42f5-af3d-7fbf17f784b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:25.832466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e369af-bfe0-42f5-af3d-7fbf17f784b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:25.842420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e369af-bfe0-42f5-af3d-7fbf17f784b6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:25.871366 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2903/5738] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:25.876140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88f658-48f7-4e0b-90d0-78d77f994bcb None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:25.892124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88f658-48f7-4e0b-90d0-78d77f994bcb None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:25.915487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c57fad-116e-427a-8096-fa276cca66ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:25.916199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c57fad-116e-427a-8096-fa276cca66ad admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:25.916551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c57fad-116e-427a-8096-fa276cca66ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:25.916869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c57fad-116e-427a-8096-fa276cca66ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:25.920583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c57fad-116e-427a-8096-fa276cca66ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:25.925500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c57fad-116e-427a-8096-fa276cca66ad admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:26.042193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e369af-bfe0-42f5-af3d-7fbf17f784b6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:26.048334 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2836/5739] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:25 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:26.057285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e369af-bfe0-42f5-af3d-7fbf17f784b6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:26.188506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c850944-3cf1-4c01-884e-0e5f4a49ccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:26.190594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c850944-3cf1-4c01-884e-0e5f4a49ccdf admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:26.191361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c850944-3cf1-4c01-884e-0e5f4a49ccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:26.193943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c850944-3cf1-4c01-884e-0e5f4a49ccdf admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:26.194754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c850944-3cf1-4c01-884e-0e5f4a49ccdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:26.201409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c850944-3cf1-4c01-884e-0e5f4a49ccdf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:26.267093 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2904/5740] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:26 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:26.284991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c57fad-116e-427a-8096-fa276cca66ad admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:26.306713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c57fad-116e-427a-8096-fa276cca66ad admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:26.331717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50820495-35d0-4087-a681-f09dcb2caff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:26.332755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50820495-35d0-4087-a681-f09dcb2caff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:26.333827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50820495-35d0-4087-a681-f09dcb2caff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:26.334476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50820495-35d0-4087-a681-f09dcb2caff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:26.335397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50820495-35d0-4087-a681-f09dcb2caff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:26.337473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50820495-35d0-4087-a681-f09dcb2caff4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:26.378699 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2837/5741] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:26.383644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c850944-3cf1-4c01-884e-0e5f4a49ccdf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:26.399249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c850944-3cf1-4c01-884e-0e5f4a49ccdf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:26.411519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15447b72-39a4-4aae-a9fc-39bf14af2b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:26.412861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15447b72-39a4-4aae-a9fc-39bf14af2b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:26.413880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15447b72-39a4-4aae-a9fc-39bf14af2b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:26.414212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15447b72-39a4-4aae-a9fc-39bf14af2b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:26.416010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15447b72-39a4-4aae-a9fc-39bf14af2b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:26.420340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15447b72-39a4-4aae-a9fc-39bf14af2b86 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:26.452022 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2905/5742] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:26.454865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50820495-35d0-4087-a681-f09dcb2caff4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:26.473247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50820495-35d0-4087-a681-f09dcb2caff4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:26.491824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a3041-a6fd-4d39-ab03-69d099084bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:26.492880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a3041-a6fd-4d39-ab03-69d099084bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:26.493356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a3041-a6fd-4d39-ab03-69d099084bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:26.493843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a3041-a6fd-4d39-ab03-69d099084bcd admin admin] PATH_INFO: `/v3/projects/c252bf00834246ba8d36805a95102d18/users/2aed1959b8ff44d897abd7da41226452/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:26.523722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a3041-a6fd-4d39-ab03-69d099084bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c252bf00834246ba8d36805a95102d18, user_id=2aed1959b8ff44d897abd7da41226452, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:26.527358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a3041-a6fd-4d39-ab03-69d099084bcd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:26.559259 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2838/5743] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:26 2022] PUT /identity/v3/projects/c252bf00834246ba8d36805a95102d18/users/2aed1959b8ff44d897abd7da41226452/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:26.573422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f85c4-44ba-4ceb-b237-0d501bcaa6de None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:26.573744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f85c4-44ba-4ceb-b237-0d501bcaa6de None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:26.574362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f85c4-44ba-4ceb-b237-0d501bcaa6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:26.584099 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:26.675307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-626f85c4-44ba-4ceb-b237-0d501bcaa6de None None] MFA Rules not processed for user `2aed1959b8ff44d897abd7da41226452`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:26.683865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-626f85c4-44ba-4ceb-b237-0d501bcaa6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:26.895119 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2906/5744] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:26.910772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a3041-a6fd-4d39-ab03-69d099084bcd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:26.915528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c86a3041-a6fd-4d39-ab03-69d099084bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:27.205094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a3041-a6fd-4d39-ab03-69d099084bcd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:27.232039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd1c68-b48b-4225-9a0f-2a1272954d47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:27.235514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd1c68-b48b-4225-9a0f-2a1272954d47 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:27.238763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd1c68-b48b-4225-9a0f-2a1272954d47 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:27.241024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd1c68-b48b-4225-9a0f-2a1272954d47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:27.290598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd1c68-b48b-4225-9a0f-2a1272954d47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:27.304536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd1c68-b48b-4225-9a0f-2a1272954d47 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:27.366901 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2839/5745] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:27.533206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f85c4-44ba-4ceb-b237-0d501bcaa6de None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:27.534680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-626f85c4-44ba-4ceb-b237-0d501bcaa6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:27.687435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f85c4-44ba-4ceb-b237-0d501bcaa6de None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:27.693455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:27.694466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:27.695292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:27.695292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] PATH_INFO: `/v3/projects/a5ab9db3284e48379c07365d7699c9c3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:27.696686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ab9db3284e48379c07365d7699c9c3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:27.699858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:27.773897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd1c68-b48b-4225-9a0f-2a1272954d47 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:27.787876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd1c68-b48b-4225-9a0f-2a1272954d47 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:27.803464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ab9db3284e48379c07365d7699c9c3', 'request_id': 'req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:27.815778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ab9db3284e48379c07365d7699c9c3', 'request_id': 'req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:27.833724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ab9db3284e48379c07365d7699c9c3', 'request_id': 'req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:27.861763 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:27.863226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] The token cache is being invalidate because project a5ab9db3284e48379c07365d7699c9c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:27.864968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:27.867079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:27.874671 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2907/5746] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:27 2022] DELETE /identity/v3/projects/a5ab9db3284e48379c07365d7699c9c3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:27.877583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:27.882615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:27.956255 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:27.961873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a86bed-a11e-4eb7-a857-4f52e7371ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:27.962530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a86bed-a11e-4eb7-a857-4f52e7371ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:27.962804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a86bed-a11e-4eb7-a857-4f52e7371ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:27.963102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a86bed-a11e-4eb7-a857-4f52e7371ec7 admin admin] PATH_INFO: `/v3/users/2aed1959b8ff44d897abd7da41226452` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:27.965136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a86bed-a11e-4eb7-a857-4f52e7371ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aed1959b8ff44d897abd7da41226452)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:27.969080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a86bed-a11e-4eb7-a857-4f52e7371ec7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:28.062269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560c9ff-e56f-4ffb-9f0b-a9d687da11aa admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:28.065243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-94a86bed-a11e-4eb7-a857-4f52e7371ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aed1959b8ff44d897abd7da41226452'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:28.066187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-94a86bed-a11e-4eb7-a857-4f52e7371ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aed1959b8ff44d897abd7da41226452'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:28.082496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:28.083231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:28.083644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:28.084390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] PATH_INFO: `/v3/users/dad9e5c7055a43e7bed0c747f3565a0c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:28.085716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad9e5c7055a43e7bed0c747f3565a0c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:28.087862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:28.093994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-94a86bed-a11e-4eb7-a857-4f52e7371ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aed1959b8ff44d897abd7da41226452'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:28.117768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-94a86bed-a11e-4eb7-a857-4f52e7371ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aed1959b8ff44d897abd7da41226452'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:28.121334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-94a86bed-a11e-4eb7-a857-4f52e7371ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aed1959b8ff44d897abd7da41226452'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:28.150576 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2840/5747] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:27 2022] DELETE /identity/v3/users/2aed1959b8ff44d897abd7da41226452 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:27:28.156201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e87c9-d4c0-4078-983e-3ebd79f98b40 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:28.156742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e87c9-d4c0-4078-983e-3ebd79f98b40 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:28.157192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e87c9-d4c0-4078-983e-3ebd79f98b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:28.201965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad9e5c7055a43e7bed0c747f3565a0c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:28.204256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-334e87c9-d4c0-4078-983e-3ebd79f98b40 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:28.204752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad9e5c7055a43e7bed0c747f3565a0c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:28.207480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-334e87c9-d4c0-4078-983e-3ebd79f98b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:28.243745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad9e5c7055a43e7bed0c747f3565a0c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:28.265489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad9e5c7055a43e7bed0c747f3565a0c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:28.266700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad9e5c7055a43e7bed0c747f3565a0c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:28.291817 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2908/5748] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:27 2022] DELETE /identity/v3/users/dad9e5c7055a43e7bed0c747f3565a0c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:28.319155 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2841/5749] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:27:28.363218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:28.365402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:28.520058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868b532-fcfc-49b3-9c64-7f250ef6a516 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:28.527628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cddb0-ab86-4b41-bc81-f78c7f299d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:28.528397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cddb0-ab86-4b41-bc81-f78c7f299d8a service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:28.528730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cddb0-ab86-4b41-bc81-f78c7f299d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:28.529022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cddb0-ab86-4b41-bc81-f78c7f299d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:28.681561 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:28.691383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cddb0-ab86-4b41-bc81-f78c7f299d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:28.696221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cddb0-ab86-4b41-bc81-f78c7f299d8a service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:28.721599 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2909/5750] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:29.294986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e87c9-d4c0-4078-983e-3ebd79f98b40 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:29.297088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-334e87c9-d4c0-4078-983e-3ebd79f98b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:29.316711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e87c9-d4c0-4078-983e-3ebd79f98b40 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:29.324539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374e60d-65a4-47e3-9996-d7f3b03d822a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:29.326373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374e60d-65a4-47e3-9996-d7f3b03d822a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:29.326882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374e60d-65a4-47e3-9996-d7f3b03d822a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:29.327536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374e60d-65a4-47e3-9996-d7f3b03d822a admin admin] PATH_INFO: `/v3/users/04fa49711754440c9e889ad13dc4d7d3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:29.329788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374e60d-65a4-47e3-9996-d7f3b03d822a admin admin] RBAC: Authorizing `identity:delete_user(user_id=04fa49711754440c9e889ad13dc4d7d3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:29.332328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374e60d-65a4-47e3-9996-d7f3b03d822a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:29.467895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2374e60d-65a4-47e3-9996-d7f3b03d822a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04fa49711754440c9e889ad13dc4d7d3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:29.471841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2374e60d-65a4-47e3-9996-d7f3b03d822a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04fa49711754440c9e889ad13dc4d7d3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:29.474090 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:29.518408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cddb0-ab86-4b41-bc81-f78c7f299d8a service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:29.518408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-080cddb0-ab86-4b41-bc81-f78c7f299d8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:29.539713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2374e60d-65a4-47e3-9996-d7f3b03d822a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04fa49711754440c9e889ad13dc4d7d3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:29.553028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cddb0-ab86-4b41-bc81-f78c7f299d8a service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:29.563043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2374e60d-65a4-47e3-9996-d7f3b03d822a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04fa49711754440c9e889ad13dc4d7d3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:29.565262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2374e60d-65a4-47e3-9996-d7f3b03d822a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04fa49711754440c9e889ad13dc4d7d3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:29.576943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:29.581377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:29.582802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:29.583793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] PATH_INFO: `/v3/projects/3150af876ae04de2b7583da7c731bc74` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:29.587437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3150af876ae04de2b7583da7c731bc74)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:29.594436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:29.613263 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2842/5751] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:29 2022] DELETE /identity/v3/users/04fa49711754440c9e889ad13dc4d7d3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:29.691412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3150af876ae04de2b7583da7c731bc74', 'request_id': 'req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:29.710585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3150af876ae04de2b7583da7c731bc74', 'request_id': 'req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:29.730300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3150af876ae04de2b7583da7c731bc74', 'request_id': 'req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:29.758539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] The token cache is being invalidate because project 3150af876ae04de2b7583da7c731bc74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:29.759020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:29.759858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:29.767043 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2910/5752] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:29 2022] DELETE /identity/v3/projects/3150af876ae04de2b7583da7c731bc74 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:29.769904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee65c36-18a2-4f6a-bbc8-6128623059f4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:29.770447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee65c36-18a2-4f6a-bbc8-6128623059f4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:29.770941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee65c36-18a2-4f6a-bbc8-6128623059f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:29.824788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-aee65c36-18a2-4f6a-bbc8-6128623059f4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:29.825565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aee65c36-18a2-4f6a-bbc8-6128623059f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:29.841618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:29.843302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:29.983836 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2843/5753] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:29.999663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab832f-2359-44a2-b527-0b1b5736d038 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:30.000624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab832f-2359-44a2-b527-0b1b5736d038 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:30.002080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab832f-2359-44a2-b527-0b1b5736d038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:30.033789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-88ab832f-2359-44a2-b527-0b1b5736d038 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:30.034284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d8cc5-dae0-48c6-9186-983c3f6de53a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:30.041976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-88ab832f-2359-44a2-b527-0b1b5736d038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:30.043034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d31a96-18d3-4c09-bc37-592214104f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:30.043665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d31a96-18d3-4c09-bc37-592214104f71 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:30.043940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d31a96-18d3-4c09-bc37-592214104f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:30.044209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d31a96-18d3-4c09-bc37-592214104f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:30.050585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-15d31a96-18d3-4c09-bc37-592214104f71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:30.065337 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2844/5754] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:30.071371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab832f-2359-44a2-b527-0b1b5736d038 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:30.088809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab832f-2359-44a2-b527-0b1b5736d038 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:30.109473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7152bc-dcc3-47a2-9776-00d6974ceaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:30.110101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7152bc-dcc3-47a2-9776-00d6974ceaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:30.111653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7152bc-dcc3-47a2-9776-00d6974ceaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:30.111945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7152bc-dcc3-47a2-9776-00d6974ceaa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:30.112610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7152bc-dcc3-47a2-9776-00d6974ceaa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:30.112919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7152bc-dcc3-47a2-9776-00d6974ceaa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:30.118177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7152bc-dcc3-47a2-9776-00d6974ceaa0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:30.151274 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2845/5755] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:30.156559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7152bc-dcc3-47a2-9776-00d6974ceaa0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:30.182719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7152bc-dcc3-47a2-9776-00d6974ceaa0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:30.198880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0547da2-0c8d-410c-9f4b-8147425aa5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:30.200605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0547da2-0c8d-410c-9f4b-8147425aa5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:30.201194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0547da2-0c8d-410c-9f4b-8147425aa5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:30.204812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0547da2-0c8d-410c-9f4b-8147425aa5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:30.206007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d31a96-18d3-4c09-bc37-592214104f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:30.206513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0547da2-0c8d-410c-9f4b-8147425aa5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:30.209870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d31a96-18d3-4c09-bc37-592214104f71 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:30.211970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0547da2-0c8d-410c-9f4b-8147425aa5a9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:30.237569 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2911/5756] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:30.301106 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2846/5757] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:30 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:27:30.307010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d31a96-18d3-4c09-bc37-592214104f71 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:30.341023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d31a96-18d3-4c09-bc37-592214104f71 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:30.406844 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:30.482136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23a62e-d1f1-4dff-bcae-3ef8921cbe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:30.482975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23a62e-d1f1-4dff-bcae-3ef8921cbe64 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:30.483257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23a62e-d1f1-4dff-bcae-3ef8921cbe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:30.483527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23a62e-d1f1-4dff-bcae-3ef8921cbe64 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:30.484303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23a62e-d1f1-4dff-bcae-3ef8921cbe64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:30.486765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23a62e-d1f1-4dff-bcae-3ef8921cbe64 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:30.539348 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2912/5758] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:30 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:30.561048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0547da2-0c8d-410c-9f4b-8147425aa5a9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:30.587268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0547da2-0c8d-410c-9f4b-8147425aa5a9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:30.595883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23a62e-d1f1-4dff-bcae-3ef8921cbe64 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:30.617798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66829a08-6a11-4a8e-85de-0e3541205748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:30.618574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66829a08-6a11-4a8e-85de-0e3541205748 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:30.618984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66829a08-6a11-4a8e-85de-0e3541205748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:30.619373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66829a08-6a11-4a8e-85de-0e3541205748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:30.621822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66829a08-6a11-4a8e-85de-0e3541205748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:30.632419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66829a08-6a11-4a8e-85de-0e3541205748 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:30.648034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5a23a62e-d1f1-4dff-bcae-3ef8921cbe64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:30.686494 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2847/5759] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:30.687901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66829a08-6a11-4a8e-85de-0e3541205748 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:30.703263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23a62e-d1f1-4dff-bcae-3ef8921cbe64 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:30.715115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66829a08-6a11-4a8e-85de-0e3541205748 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:30.723052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ea270-b84a-4856-b856-86843c995a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:30.725429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea270-b84a-4856-b856-86843c995a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:30.727468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea270-b84a-4856-b856-86843c995a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:30.728030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea270-b84a-4856-b856-86843c995a42 admin admin] PATH_INFO: `/v3/projects/3eaf7d9670874e5d92db84283b262d57` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:30.731400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ea270-b84a-4856-b856-86843c995a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eaf7d9670874e5d92db84283b262d57)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:30.734549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ea270-b84a-4856-b856-86843c995a42 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:30.735044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ffc68-8830-4f55-87b1-c6049cf72d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:30.736033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ffc68-8830-4f55-87b1-c6049cf72d2f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:30.736322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ffc68-8830-4f55-87b1-c6049cf72d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:30.736594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ffc68-8830-4f55-87b1-c6049cf72d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:30.738358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ffc68-8830-4f55-87b1-c6049cf72d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:30.741888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ffc68-8830-4f55-87b1-c6049cf72d2f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:30.776354 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2848/5760] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:30.779703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ffc68-8830-4f55-87b1-c6049cf72d2f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:30.807223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ffc68-8830-4f55-87b1-c6049cf72d2f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:30.822006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20b363-87c8-476c-8357-80cd9e48288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:30.825712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20b363-87c8-476c-8357-80cd9e48288b admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:30.826006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20b363-87c8-476c-8357-80cd9e48288b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:30.826289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20b363-87c8-476c-8357-80cd9e48288b admin admin] PATH_INFO: `/v3/projects/51905acc23504f7cb82d7ee6516aa9d2/users/d48ccabd999244799525498df4b84c5f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:30.876783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2d4ea270-b84a-4856-b856-86843c995a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eaf7d9670874e5d92db84283b262d57', 'request_id': 'req-2d4ea270-b84a-4856-b856-86843c995a42'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:30.882292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20b363-87c8-476c-8357-80cd9e48288b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51905acc23504f7cb82d7ee6516aa9d2, user_id=d48ccabd999244799525498df4b84c5f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:30.906674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20b363-87c8-476c-8357-80cd9e48288b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:30.915405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2d4ea270-b84a-4856-b856-86843c995a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eaf7d9670874e5d92db84283b262d57', 'request_id': 'req-2d4ea270-b84a-4856-b856-86843c995a42'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:30.941674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2d4ea270-b84a-4856-b856-86843c995a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eaf7d9670874e5d92db84283b262d57', 'request_id': 'req-2d4ea270-b84a-4856-b856-86843c995a42'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:30.956477 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2849/5761] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:30 2022] PUT /identity/v3/projects/51905acc23504f7cb82d7ee6516aa9d2/users/d48ccabd999244799525498df4b84c5f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:30.956477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20b363-87c8-476c-8357-80cd9e48288b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:30.964365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cd20b363-87c8-476c-8357-80cd9e48288b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:30.971942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2d4ea270-b84a-4856-b856-86843c995a42 admin admin] The token cache is being invalidate because project 3eaf7d9670874e5d92db84283b262d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:30.972245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2d4ea270-b84a-4856-b856-86843c995a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:30.975710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2d4ea270-b84a-4856-b856-86843c995a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:30.980034 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2913/5762] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:30 2022] DELETE /identity/v3/projects/3eaf7d9670874e5d92db84283b262d57 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:30.984609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b37a3-b605-4a43-b9ee-700f0755a01b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:30.984963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b37a3-b605-4a43-b9ee-700f0755a01b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:30.985247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b37a3-b605-4a43-b9ee-700f0755a01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:31.065106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-473b37a3-b605-4a43-b9ee-700f0755a01b None None] MFA Rules not processed for user `d48ccabd999244799525498df4b84c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:31.069251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-473b37a3-b605-4a43-b9ee-700f0755a01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:31.088359 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:31.147769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20b363-87c8-476c-8357-80cd9e48288b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:31.159712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:31.163237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:31.163530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:31.165302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] PATH_INFO: `/v3/projects/c252bf00834246ba8d36805a95102d18` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:31.170077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c252bf00834246ba8d36805a95102d18)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:31.174628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:31.243579 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2914/5763] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:31.245141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765b15e-f05a-4c83-a759-e83df436ee7d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:31.249096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765b15e-f05a-4c83-a759-e83df436ee7d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:31.249612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765b15e-f05a-4c83-a759-e83df436ee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:31.294105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a765b15e-f05a-4c83-a759-e83df436ee7d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:31.295663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a765b15e-f05a-4c83-a759-e83df436ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:31.306497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c252bf00834246ba8d36805a95102d18', 'request_id': 'req-646f9ec5-368c-48b2-a3ec-9a574dcf4989'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:31.317481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c252bf00834246ba8d36805a95102d18', 'request_id': 'req-646f9ec5-368c-48b2-a3ec-9a574dcf4989'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:31.331194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c252bf00834246ba8d36805a95102d18', 'request_id': 'req-646f9ec5-368c-48b2-a3ec-9a574dcf4989'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:31.358425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] The token cache is being invalidate because project c252bf00834246ba8d36805a95102d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:31.358740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:31.363107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:31.365811 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2850/5764] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:30 2022] DELETE /identity/v3/projects/c252bf00834246ba8d36805a95102d18 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:31.366668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:31.368955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:31.369828 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:31.450264 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2915/5765] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:31.451392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5e712-b9ec-4767-8575-a709ad57c5d4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:31.451903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5e712-b9ec-4767-8575-a709ad57c5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:31.452033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5e712-b9ec-4767-8575-a709ad57c5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:31.485157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-06d5e712-b9ec-4767-8575-a709ad57c5d4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:31.486472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-06d5e712-b9ec-4767-8575-a709ad57c5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:31.502010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f9ec5-368c-48b2-a3ec-9a574dcf4989 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:31.503903 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2916/5766] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:31.505266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6419a-907f-4b06-9270-3663b77c459b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:31.505543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6419a-907f-4b06-9270-3663b77c459b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:31.505858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6419a-907f-4b06-9270-3663b77c459b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:31.517219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02904bbb-7cfa-434a-9909-44918f245f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:31.518358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02904bbb-7cfa-434a-9909-44918f245f71 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:31.519163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02904bbb-7cfa-434a-9909-44918f245f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:31.520765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02904bbb-7cfa-434a-9909-44918f245f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:31.521647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02904bbb-7cfa-434a-9909-44918f245f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:31.524032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02904bbb-7cfa-434a-9909-44918f245f71 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:31.541118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6ac6419a-907f-4b06-9270-3663b77c459b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:31.556603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6ac6419a-907f-4b06-9270-3663b77c459b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:31.574821 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2851/5767] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:31 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:31.577038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d3b64-0877-4b7b-96be-3a2922013dc0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:31.577547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d3b64-0877-4b7b-96be-3a2922013dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:31.578351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d3b64-0877-4b7b-96be-3a2922013dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:31.579447 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2917/5768] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:31.580285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6419a-907f-4b06-9270-3663b77c459b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:31.604925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6419a-907f-4b06-9270-3663b77c459b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:31.613878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-519d3b64-0877-4b7b-96be-3a2922013dc0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:31.616005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-519d3b64-0877-4b7b-96be-3a2922013dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:31.700946 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:31.726465 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2852/5769] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:31.727963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d3b64-0877-4b7b-96be-3a2922013dc0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:31.741218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d3b64-0877-4b7b-96be-3a2922013dc0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:31.749007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db194c-8772-47f9-acf8-763740ff605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:31.750179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db194c-8772-47f9-acf8-763740ff605d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:31.750675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db194c-8772-47f9-acf8-763740ff605d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:31.751231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db194c-8772-47f9-acf8-763740ff605d admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:31.752190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db194c-8772-47f9-acf8-763740ff605d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:31.752707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db194c-8772-47f9-acf8-763740ff605d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:31.756360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db194c-8772-47f9-acf8-763740ff605d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:31.757357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58855605-a541-4ff0-a82c-9381ec5c83c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:31.760013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58855605-a541-4ff0-a82c-9381ec5c83c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:31.760869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58855605-a541-4ff0-a82c-9381ec5c83c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:31.762416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58855605-a541-4ff0-a82c-9381ec5c83c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:31.763445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58855605-a541-4ff0-a82c-9381ec5c83c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:31.769520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58855605-a541-4ff0-a82c-9381ec5c83c9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:31.798588 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2853/5770] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:31.801145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db194c-8772-47f9-acf8-763740ff605d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:31.818938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db194c-8772-47f9-acf8-763740ff605d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:31.824497 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2918/5771] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:31 2022] POST /identity/v3/users => generated 295 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:31.825987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58855605-a541-4ff0-a82c-9381ec5c83c9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:31.829060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7caa3-4e4f-4f91-8af2-74ad9098e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:31.830631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7caa3-4e4f-4f91-8af2-74ad9098e4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:31.830631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7caa3-4e4f-4f91-8af2-74ad9098e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:31.830867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7caa3-4e4f-4f91-8af2-74ad9098e4ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:31.831815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7caa3-4e4f-4f91-8af2-74ad9098e4ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:31.832310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7caa3-4e4f-4f91-8af2-74ad9098e4ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:31.835975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7caa3-4e4f-4f91-8af2-74ad9098e4ab admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:31.852887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58855605-a541-4ff0-a82c-9381ec5c83c9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:31.857207 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2854/5772] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:31.858719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7caa3-4e4f-4f91-8af2-74ad9098e4ab admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:31.866334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60def03f-4c6b-427b-829b-36e0fbb5613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:31.867041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60def03f-4c6b-427b-829b-36e0fbb5613c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:31.867365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60def03f-4c6b-427b-829b-36e0fbb5613c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:31.867643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60def03f-4c6b-427b-829b-36e0fbb5613c admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:31.868321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60def03f-4c6b-427b-829b-36e0fbb5613c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:31.874309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60def03f-4c6b-427b-829b-36e0fbb5613c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:31.878504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7caa3-4e4f-4f91-8af2-74ad9098e4ab admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:31.884787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5014fa-4128-4afa-b80e-eec464078bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:31.885681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5014fa-4128-4afa-b80e-eec464078bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:31.886127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5014fa-4128-4afa-b80e-eec464078bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:31.887036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5014fa-4128-4afa-b80e-eec464078bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:31.888299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5014fa-4128-4afa-b80e-eec464078bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:31.890254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5014fa-4128-4afa-b80e-eec464078bf6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:31.907958 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2855/5773] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:31.908916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5014fa-4128-4afa-b80e-eec464078bf6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:31.927785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5014fa-4128-4afa-b80e-eec464078bf6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:31.935177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd41d1e-c3f2-4dbe-8b11-2a78d2c87c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:31.936232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd41d1e-c3f2-4dbe-8b11-2a78d2c87c4e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:31.937292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd41d1e-c3f2-4dbe-8b11-2a78d2c87c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:31.937292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd41d1e-c3f2-4dbe-8b11-2a78d2c87c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:31.938000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd41d1e-c3f2-4dbe-8b11-2a78d2c87c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:31.938713 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2919/5774] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:31 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:31.939612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60def03f-4c6b-427b-829b-36e0fbb5613c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:31.941189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd41d1e-c3f2-4dbe-8b11-2a78d2c87c4e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:31.984308 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2856/5775] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:31 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:31.985310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd41d1e-c3f2-4dbe-8b11-2a78d2c87c4e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:32.085983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60def03f-4c6b-427b-829b-36e0fbb5613c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:32.103023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1f30c-7bab-4a93-a60e-8914ed8584a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:32.103717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1f30c-7bab-4a93-a60e-8914ed8584a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:32.104001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1f30c-7bab-4a93-a60e-8914ed8584a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:32.104274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1f30c-7bab-4a93-a60e-8914ed8584a7 admin admin] PATH_INFO: `/v3/projects/e6cb873ddd3b440c9807e3a25aa3cf9d/users/94bead26b6754da5aa8025058f4d7373/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:32.107719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd41d1e-c3f2-4dbe-8b11-2a78d2c87c4e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:32.115486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131752a-dd16-4ac0-9009-1d5206bcb438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:32.116545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131752a-dd16-4ac0-9009-1d5206bcb438 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:32.116980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131752a-dd16-4ac0-9009-1d5206bcb438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:32.117397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131752a-dd16-4ac0-9009-1d5206bcb438 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:32.118288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131752a-dd16-4ac0-9009-1d5206bcb438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:32.131370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131752a-dd16-4ac0-9009-1d5206bcb438 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:32.152284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1f30c-7bab-4a93-a60e-8914ed8584a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6cb873ddd3b440c9807e3a25aa3cf9d, user_id=94bead26b6754da5aa8025058f4d7373, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:32.155716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1f30c-7bab-4a93-a60e-8914ed8584a7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:32.177490 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2857/5776] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:31 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:32.178617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131752a-dd16-4ac0-9009-1d5206bcb438 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:32.194951 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2920/5777] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:31 2022] PUT /identity/v3/projects/e6cb873ddd3b440c9807e3a25aa3cf9d/users/94bead26b6754da5aa8025058f4d7373/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:32.196426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1f30c-7bab-4a93-a60e-8914ed8584a7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:32.205732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131752a-dd16-4ac0-9009-1d5206bcb438 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:32.224647 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:32.332551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767e40d-9192-4e36-a2c0-3f677880b95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:32.333746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767e40d-9192-4e36-a2c0-3f677880b95d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:32.334194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767e40d-9192-4e36-a2c0-3f677880b95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:32.334649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767e40d-9192-4e36-a2c0-3f677880b95d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:32.335453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767e40d-9192-4e36-a2c0-3f677880b95d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:32.342309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767e40d-9192-4e36-a2c0-3f677880b95d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:32.355528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1f30c-7bab-4a93-a60e-8914ed8584a7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:32.368867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f2c84-9c54-4721-8680-f0aac9b146c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:32.369717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f2c84-9c54-4721-8680-f0aac9b146c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:32.370080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f2c84-9c54-4721-8680-f0aac9b146c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:32.370426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f2c84-9c54-4721-8680-f0aac9b146c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:32.371173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f2c84-9c54-4721-8680-f0aac9b146c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:32.376921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f2c84-9c54-4721-8680-f0aac9b146c9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:32.387188 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2858/5778] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:32 2022] POST /identity/v3/users => generated 284 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:32.388112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767e40d-9192-4e36-a2c0-3f677880b95d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:32.404139 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2921/5779] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:32.405380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f2c84-9c54-4721-8680-f0aac9b146c9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:32.415708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767e40d-9192-4e36-a2c0-3f677880b95d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:32.429979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e8816-82d5-412a-b9b5-f4c6c1d6ba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:32.430614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e8816-82d5-412a-b9b5-f4c6c1d6ba49 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:32.430892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e8816-82d5-412a-b9b5-f4c6c1d6ba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:32.431195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e8816-82d5-412a-b9b5-f4c6c1d6ba49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:32.431311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f2c84-9c54-4721-8680-f0aac9b146c9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:32.431840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e8816-82d5-412a-b9b5-f4c6c1d6ba49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:32.434326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e8816-82d5-412a-b9b5-f4c6c1d6ba49 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:32.448041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb7a10-6635-49d6-81f8-e733022c3a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:32.449082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb7a10-6635-49d6-81f8-e733022c3a73 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:32.449366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb7a10-6635-49d6-81f8-e733022c3a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:32.449625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb7a10-6635-49d6-81f8-e733022c3a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:32.452370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb7a10-6635-49d6-81f8-e733022c3a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:32.454053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb7a10-6635-49d6-81f8-e733022c3a73 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:32.463311 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2859/5780] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:32.464317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e8816-82d5-412a-b9b5-f4c6c1d6ba49 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:32.481527 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:32.488522 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2922/5781] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:32.494401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb7a10-6635-49d6-81f8-e733022c3a73 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:32.501427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e8816-82d5-412a-b9b5-f4c6c1d6ba49 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:32.519402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb7a10-6635-49d6-81f8-e733022c3a73 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:32.526577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd07a2d-be5e-4baf-9251-f76c602b2fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:32.527593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd07a2d-be5e-4baf-9251-f76c602b2fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:32.528091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd07a2d-be5e-4baf-9251-f76c602b2fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:32.528662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd07a2d-be5e-4baf-9251-f76c602b2fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:32.529515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd07a2d-be5e-4baf-9251-f76c602b2fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:32.531780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd07a2d-be5e-4baf-9251-f76c602b2fbf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:32.532701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444ad21-b3f8-45e8-9e57-dfc0a8c7873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:32.534148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444ad21-b3f8-45e8-9e57-dfc0a8c7873e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:32.534436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444ad21-b3f8-45e8-9e57-dfc0a8c7873e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:32.534760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444ad21-b3f8-45e8-9e57-dfc0a8c7873e admin admin] PATH_INFO: `/v3/projects/e6cb873ddd3b440c9807e3a25aa3cf9d/users/94bead26b6754da5aa8025058f4d7373/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:32.540382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444ad21-b3f8-45e8-9e57-dfc0a8c7873e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6cb873ddd3b440c9807e3a25aa3cf9d, user_id=94bead26b6754da5aa8025058f4d7373, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:32.554371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444ad21-b3f8-45e8-9e57-dfc0a8c7873e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:32.581543 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2860/5782] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:32.583878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd07a2d-be5e-4baf-9251-f76c602b2fbf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:32.605882 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2923/5783] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:32 2022] PUT /identity/v3/projects/e6cb873ddd3b440c9807e3a25aa3cf9d/users/94bead26b6754da5aa8025058f4d7373/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:32.606726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444ad21-b3f8-45e8-9e57-dfc0a8c7873e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:32.621790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd07a2d-be5e-4baf-9251-f76c602b2fbf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:32.745464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444ad21-b3f8-45e8-9e57-dfc0a8c7873e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:32.760806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd47c6-7eb3-484f-9bbd-3701f14222ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:32.761500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd47c6-7eb3-484f-9bbd-3701f14222ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:32.761754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd47c6-7eb3-484f-9bbd-3701f14222ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:32.762030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd47c6-7eb3-484f-9bbd-3701f14222ac admin admin] PATH_INFO: `/v3/projects/4ec864865dde4a4fa13a54a5057867f1/users/4d4086e3f9784454a0ccfe87cc54a2b2/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:32.800002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd47c6-7eb3-484f-9bbd-3701f14222ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec864865dde4a4fa13a54a5057867f1, user_id=4d4086e3f9784454a0ccfe87cc54a2b2, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:32.806398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd47c6-7eb3-484f-9bbd-3701f14222ac admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:32.827740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c307e1-5c7d-46ed-b3df-20233253b16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:32.830007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c307e1-5c7d-46ed-b3df-20233253b16c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:32.831610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c307e1-5c7d-46ed-b3df-20233253b16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:32.833275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c307e1-5c7d-46ed-b3df-20233253b16c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:32.835212 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2924/5784] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:32 2022] PUT /identity/v3/projects/4ec864865dde4a4fa13a54a5057867f1/users/4d4086e3f9784454a0ccfe87cc54a2b2/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:32.835385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c307e1-5c7d-46ed-b3df-20233253b16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:32.836259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e43be-13fd-40ac-8abb-1931df7d2a06 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:32.837743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e43be-13fd-40ac-8abb-1931df7d2a06 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:32.838034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e43be-13fd-40ac-8abb-1931df7d2a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:32.844746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c307e1-5c7d-46ed-b3df-20233253b16c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:32.879396 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2861/5785] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:32.881699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931efec-7ad3-4153-9626-31558271c1f5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:32.881995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931efec-7ad3-4153-9626-31558271c1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:32.882281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931efec-7ad3-4153-9626-31558271c1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:32.906671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1a9e43be-13fd-40ac-8abb-1931df7d2a06 None None] MFA Rules not processed for user `94bead26b6754da5aa8025058f4d7373`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:32.908044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1a9e43be-13fd-40ac-8abb-1931df7d2a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:32.941323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e931efec-7ad3-4153-9626-31558271c1f5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:32.943836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e931efec-7ad3-4153-9626-31558271c1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:33.023492 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:33.071836 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2925/5786] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:33.072724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e43be-13fd-40ac-8abb-1931df7d2a06 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:33.107237 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2862/5787] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:33.108035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931efec-7ad3-4153-9626-31558271c1f5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:33.130832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931efec-7ad3-4153-9626-31558271c1f5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:33.147152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e457b-772d-4161-b921-cf3c256c3112 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bead26b6754da5aa8025058f4d7373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cb873ddd3b440c9807e3a25aa3cf9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:33.149267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e457b-772d-4161-b921-cf3c256c3112 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:33.150219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e457b-772d-4161-b921-cf3c256c3112 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:33.151769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e457b-772d-4161-b921-cf3c256c3112 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:33.152508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e457b-772d-4161-b921-cf3c256c3112 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:33.154535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e457b-772d-4161-b921-cf3c256c3112 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:33.201119 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2863/5788] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:33 2022] POST /identity/v3/projects => generated 333 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:33.202535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e457b-772d-4161-b921-cf3c256c3112 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:33.205535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f95e457b-772d-4161-b921-cf3c256c3112 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:33.244818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e43be-13fd-40ac-8abb-1931df7d2a06 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:33.299689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e457b-772d-4161-b921-cf3c256c3112 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:33.304974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c17f88-4cd1-4e00-a7c6-9b796afd9daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:33.305887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c17f88-4cd1-4e00-a7c6-9b796afd9daa service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:33.306490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c17f88-4cd1-4e00-a7c6-9b796afd9daa service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:33.307215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c17f88-4cd1-4e00-a7c6-9b796afd9daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:33.336316 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:33.496226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3029e64-bced-4579-9ac3-9ed9c8fde98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:33.499537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3029e64-bced-4579-9ac3-9ed9c8fde98f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:33.500114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3029e64-bced-4579-9ac3-9ed9c8fde98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:33.502793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3029e64-bced-4579-9ac3-9ed9c8fde98f admin admin] PATH_INFO: `/v3/projects/3527d31339ee4f4e94e66072eb9bc3e9/users/2d1e456049ad4caea8916e09b8d14b37/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:33.506802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c17f88-4cd1-4e00-a7c6-9b796afd9daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:33.510111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c17f88-4cd1-4e00-a7c6-9b796afd9daa service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:33.540205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3029e64-bced-4579-9ac3-9ed9c8fde98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3527d31339ee4f4e94e66072eb9bc3e9, user_id=2d1e456049ad4caea8916e09b8d14b37, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:33.544872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3029e64-bced-4579-9ac3-9ed9c8fde98f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:33.567251 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2864/5789] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:33.569968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c17f88-4cd1-4e00-a7c6-9b796afd9daa service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:33.580389 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2926/5790] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:33 2022] PUT /identity/v3/projects/3527d31339ee4f4e94e66072eb9bc3e9/users/2d1e456049ad4caea8916e09b8d14b37/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:33.595108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd8402-a0b8-4133-b225-66a9b9536101 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:33.595731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd8402-a0b8-4133-b225-66a9b9536101 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:33.596299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd8402-a0b8-4133-b225-66a9b9536101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:33.667945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ebfd8402-a0b8-4133-b225-66a9b9536101 None None] MFA Rules not processed for user `2d1e456049ad4caea8916e09b8d14b37`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:33.671622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ebfd8402-a0b8-4133-b225-66a9b9536101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:33.737684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c17f88-4cd1-4e00-a7c6-9b796afd9daa service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:33.838197 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2927/5791] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:33.842760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd8402-a0b8-4133-b225-66a9b9536101 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:33.867370 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:33.901249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8348a49-5a4e-4433-8f3a-a9397b638ab6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bead26b6754da5aa8025058f4d7373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cb873ddd3b440c9807e3a25aa3cf9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:33.902058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8348a49-5a4e-4433-8f3a-a9397b638ab6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:33.902346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8348a49-5a4e-4433-8f3a-a9397b638ab6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:33.902622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8348a49-5a4e-4433-8f3a-a9397b638ab6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:33.903274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8348a49-5a4e-4433-8f3a-a9397b638ab6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:33.905299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8348a49-5a4e-4433-8f3a-a9397b638ab6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:33.970640 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2865/5792] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:27:33 2022] POST /identity/v3/projects => generated 333 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:33.977493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8348a49-5a4e-4433-8f3a-a9397b638ab6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:34.030978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd8402-a0b8-4133-b225-66a9b9536101 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:34.117169 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:34.156628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8348a49-5a4e-4433-8f3a-a9397b638ab6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:34.168539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238f742-df84-417c-81c1-88da7e79f55e tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bead26b6754da5aa8025058f4d7373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cb873ddd3b440c9807e3a25aa3cf9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:34.169174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238f742-df84-417c-81c1-88da7e79f55e tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:34.169655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238f742-df84-417c-81c1-88da7e79f55e tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:34.169763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238f742-df84-417c-81c1-88da7e79f55e tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:34.171745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238f742-df84-417c-81c1-88da7e79f55e tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:34.179640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238f742-df84-417c-81c1-88da7e79f55e tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:34.182085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319bd07-45b9-41fa-9ea5-d76cf50c8d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:34.186217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319bd07-45b9-41fa-9ea5-d76cf50c8d1a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:34.186752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319bd07-45b9-41fa-9ea5-d76cf50c8d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:34.186857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319bd07-45b9-41fa-9ea5-d76cf50c8d1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:34.187553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319bd07-45b9-41fa-9ea5-d76cf50c8d1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:34.194148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319bd07-45b9-41fa-9ea5-d76cf50c8d1a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:34.254471 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2928/5793] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:33 2022] POST /identity/v3/projects => generated 369 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:34.259168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319bd07-45b9-41fa-9ea5-d76cf50c8d1a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:34.306872 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2866/5794] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:33 2022] POST /identity/v3/projects => generated 358 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:34.310787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238f742-df84-417c-81c1-88da7e79f55e tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:34.450526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319bd07-45b9-41fa-9ea5-d76cf50c8d1a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:34.464976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238f742-df84-417c-81c1-88da7e79f55e tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:34.478182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84495e-6fe8-46f0-a29c-d7a02d820652 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bead26b6754da5aa8025058f4d7373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cb873ddd3b440c9807e3a25aa3cf9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:34.478832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84495e-6fe8-46f0-a29c-d7a02d820652 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:34.479141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84495e-6fe8-46f0-a29c-d7a02d820652 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:34.479429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84495e-6fe8-46f0-a29c-d7a02d820652 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:34.481870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84495e-6fe8-46f0-a29c-d7a02d820652 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:34.486610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84495e-6fe8-46f0-a29c-d7a02d820652 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:34.530393 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2867/5795] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Oct 16 01:27:34 2022] GET /identity/v3/projects => generated 7564 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:34.534472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84495e-6fe8-46f0-a29c-d7a02d820652 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:34.542229 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:34.562850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84495e-6fe8-46f0-a29c-d7a02d820652 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:34.569901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0f9da-7d43-4dc5-a722-277fe9fff487 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bead26b6754da5aa8025058f4d7373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cb873ddd3b440c9807e3a25aa3cf9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:34.570612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0f9da-7d43-4dc5-a722-277fe9fff487 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:34.570906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0f9da-7d43-4dc5-a722-277fe9fff487 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:34.571204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0f9da-7d43-4dc5-a722-277fe9fff487 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:34.571880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0f9da-7d43-4dc5-a722-277fe9fff487 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:34.572229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0f9da-7d43-4dc5-a722-277fe9fff487 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:34.577476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0f9da-7d43-4dc5-a722-277fe9fff487 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:34.592661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471c64c-9ea2-4835-90ea-c82140f2ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:34.593775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471c64c-9ea2-4835-90ea-c82140f2ca2a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:34.595569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471c64c-9ea2-4835-90ea-c82140f2ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:34.596107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471c64c-9ea2-4835-90ea-c82140f2ca2a admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:34.597252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471c64c-9ea2-4835-90ea-c82140f2ca2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:34.599781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471c64c-9ea2-4835-90ea-c82140f2ca2a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:34.623487 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2868/5796] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:27:34 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:34.629737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0f9da-7d43-4dc5-a722-277fe9fff487 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:34.644785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0f9da-7d43-4dc5-a722-277fe9fff487 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:34.665459 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2929/5797] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:34 2022] POST /identity/v3/users => generated 291 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:34.669156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471c64c-9ea2-4835-90ea-c82140f2ca2a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:34.673888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e80f32-e207-4a12-a9f3-8a3e97974e90 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bead26b6754da5aa8025058f4d7373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cb873ddd3b440c9807e3a25aa3cf9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:34.674525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e80f32-e207-4a12-a9f3-8a3e97974e90 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:34.674810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e80f32-e207-4a12-a9f3-8a3e97974e90 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:34.675113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e80f32-e207-4a12-a9f3-8a3e97974e90 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:34.675800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e80f32-e207-4a12-a9f3-8a3e97974e90 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Adding query filter params (parent_id=185d3996ea474edc98c84e5e79189d3c) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:34.676245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e80f32-e207-4a12-a9f3-8a3e97974e90 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:34.678366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e80f32-e207-4a12-a9f3-8a3e97974e90 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:34.695012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471c64c-9ea2-4835-90ea-c82140f2ca2a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:34.710670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874a3d3-c77c-4d06-9319-7265b7ba76fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:34.711356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874a3d3-c77c-4d06-9319-7265b7ba76fe admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:34.711612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874a3d3-c77c-4d06-9319-7265b7ba76fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:34.711882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874a3d3-c77c-4d06-9319-7265b7ba76fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:34.714836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874a3d3-c77c-4d06-9319-7265b7ba76fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:34.715244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874a3d3-c77c-4d06-9319-7265b7ba76fe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:34.731374 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2869/5798] 10.222.0.39 () {58 vars in 1216 bytes} [Sun Oct 16 01:27:34 2022] GET /identity/v3/projects?parent_id=185d3996ea474edc98c84e5e79189d3c => generated 498 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:34.732380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e80f32-e207-4a12-a9f3-8a3e97974e90 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:34.746206 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2930/5799] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:34.749332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874a3d3-c77c-4d06-9319-7265b7ba76fe admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:34.758679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e80f32-e207-4a12-a9f3-8a3e97974e90 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:34.770579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874a3d3-c77c-4d06-9319-7265b7ba76fe admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:34.772101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bead26b6754da5aa8025058f4d7373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cb873ddd3b440c9807e3a25aa3cf9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:34.772825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:34.773110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:34.773386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] PATH_INFO: `/v3/projects/46176a41f5d24950847a383b18836f4b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:34.775223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorizing `identity:delete_project(project_id=46176a41f5d24950847a383b18836f4b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:34.777211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:34.790005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13567016-2d71-4d91-bf82-808da22300df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:34.791475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13567016-2d71-4d91-bf82-808da22300df admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:34.791761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13567016-2d71-4d91-bf82-808da22300df admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:34.792036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13567016-2d71-4d91-bf82-808da22300df admin admin] PATH_INFO: `/v3/projects/03a9fb06784e4b50b724ae9127a5a3d9/users/3ffb96b0c4dc4967aa461ef1446ce7fe/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:34.828122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13567016-2d71-4d91-bf82-808da22300df admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a9fb06784e4b50b724ae9127a5a3d9, user_id=3ffb96b0c4dc4967aa461ef1446ce7fe, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:34.831341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13567016-2d71-4d91-bf82-808da22300df admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:34.863579 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2931/5800] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:34 2022] PUT /identity/v3/projects/03a9fb06784e4b50b724ae9127a5a3d9/users/3ffb96b0c4dc4967aa461ef1446ce7fe/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:34.873258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13567016-2d71-4d91-bf82-808da22300df admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:34.899486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46176a41f5d24950847a383b18836f4b', 'request_id': 'req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:34.914710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46176a41f5d24950847a383b18836f4b', 'request_id': 'req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:34.934488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46176a41f5d24950847a383b18836f4b', 'request_id': 'req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:34.960482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] The token cache is being invalidate because project 46176a41f5d24950847a383b18836f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:34.960731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:34.964637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:34.974241 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2870/5801] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:34 2022] DELETE /identity/v3/projects/46176a41f5d24950847a383b18836f4b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:34.977700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:34.985633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:35.024172 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:35.048535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13567016-2d71-4d91-bf82-808da22300df admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:35.091949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbb3d6-8701-4e2c-9ab5-4fe468593630 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:35.097996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bead26b6754da5aa8025058f4d7373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cb873ddd3b440c9807e3a25aa3cf9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:35.100256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:35.100696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:35.101225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] PATH_INFO: `/v3/projects/185d3996ea474edc98c84e5e79189d3c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:35.102661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorizing `identity:delete_project(project_id=185d3996ea474edc98c84e5e79189d3c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:35.104860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:35.168404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de7d9d-dfc3-4270-856f-00fc416a40df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:35.169164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de7d9d-dfc3-4270-856f-00fc416a40df admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:35.169448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de7d9d-dfc3-4270-856f-00fc416a40df admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:35.169719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de7d9d-dfc3-4270-856f-00fc416a40df admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:35.170991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de7d9d-dfc3-4270-856f-00fc416a40df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:35.172877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de7d9d-dfc3-4270-856f-00fc416a40df admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:35.191666 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2932/5802] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:35.193837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de7d9d-dfc3-4270-856f-00fc416a40df admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:35.202285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-38de7d9d-dfc3-4270-856f-00fc416a40df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:35.224882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de7d9d-dfc3-4270-856f-00fc416a40df admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:35.252763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185d3996ea474edc98c84e5e79189d3c', 'request_id': 'req-30292d46-21a8-474a-b633-7d33085291d6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:35.271872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185d3996ea474edc98c84e5e79189d3c', 'request_id': 'req-30292d46-21a8-474a-b633-7d33085291d6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:35.292665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185d3996ea474edc98c84e5e79189d3c', 'request_id': 'req-30292d46-21a8-474a-b633-7d33085291d6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:35.299976 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:35.324024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbdc5b-8e06-429d-acc3-e6ac15c0a2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:35.326141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] The token cache is being invalidate because project 185d3996ea474edc98c84e5e79189d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:35.326513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:35.327375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbdc5b-8e06-429d-acc3-e6ac15c0a2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:35.327890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbdc5b-8e06-429d-acc3-e6ac15c0a2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:35.327994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:35.328563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbdc5b-8e06-429d-acc3-e6ac15c0a2a0 admin admin] PATH_INFO: `/v3/projects/03a9fb06784e4b50b724ae9127a5a3d9/users/3ffb96b0c4dc4967aa461ef1446ce7fe/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:35.330010 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2871/5803] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:34 2022] DELETE /identity/v3/projects/185d3996ea474edc98c84e5e79189d3c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:35.331410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbdc5b-8e06-429d-acc3-e6ac15c0a2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a9fb06784e4b50b724ae9127a5a3d9, user_id=3ffb96b0c4dc4967aa461ef1446ce7fe, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:35.334908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:35.338006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbdc5b-8e06-429d-acc3-e6ac15c0a2a0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:35.348212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:35.384937 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2933/5804] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:35 2022] PUT /identity/v3/projects/03a9fb06784e4b50b724ae9127a5a3d9/users/3ffb96b0c4dc4967aa461ef1446ce7fe/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:35.389022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f1910-5d79-4bef-9895-639e7e58c860 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:35.389565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f1910-5d79-4bef-9895-639e7e58c860 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:35.390014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f1910-5d79-4bef-9895-639e7e58c860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:35.481172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-486f1910-5d79-4bef-9895-639e7e58c860 None None] MFA Rules not processed for user `3ffb96b0c4dc4967aa461ef1446ce7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:35.488288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-486f1910-5d79-4bef-9895-639e7e58c860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:35.618343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30292d46-21a8-474a-b633-7d33085291d6 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:35.798487 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:35.815572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94bead26b6754da5aa8025058f4d7373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6cb873ddd3b440c9807e3a25aa3cf9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:35.816883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:35.818114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:35.818409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] PATH_INFO: `/v3/projects/98bb5706f1214e8a8147b861ccd3255d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:35.819905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorizing `identity:delete_project(project_id=98bb5706f1214e8a8147b861ccd3255d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:35.822542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:35.830837 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2934/5805] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:35.840104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f1910-5d79-4bef-9895-639e7e58c860 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:35.901233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f1910-5d79-4bef-9895-639e7e58c860 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:35.917794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378ecc1-9aa6-4b9c-b359-3b605af0c861 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:35.918443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378ecc1-9aa6-4b9c-b359-3b605af0c861 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:35.918723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378ecc1-9aa6-4b9c-b359-3b605af0c861 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:35.919015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378ecc1-9aa6-4b9c-b359-3b605af0c861 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:35.920315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378ecc1-9aa6-4b9c-b359-3b605af0c861 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:35.921997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378ecc1-9aa6-4b9c-b359-3b605af0c861 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:35.961200 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2935/5806] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:27:35 2022] POST /identity/v3/domains => generated 276 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:35.980281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378ecc1-9aa6-4b9c-b359-3b605af0c861 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:36.027195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98bb5706f1214e8a8147b861ccd3255d', 'request_id': 'req-861f1825-1387-4806-aca0-c4000a8f6043'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:36.047239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98bb5706f1214e8a8147b861ccd3255d', 'request_id': 'req-861f1825-1387-4806-aca0-c4000a8f6043'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:36.070488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98bb5706f1214e8a8147b861ccd3255d', 'request_id': 'req-861f1825-1387-4806-aca0-c4000a8f6043'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:36.112409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] The token cache is being invalidate because project 98bb5706f1214e8a8147b861ccd3255d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:36.112707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:36.113867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:36.124077 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2872/5807] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:35 2022] DELETE /identity/v3/projects/98bb5706f1214e8a8147b861ccd3255d => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:36.125094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:36.133198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:36.226476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378ecc1-9aa6-4b9c-b359-3b605af0c861 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:36.247105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294be7b-1f09-4ced-9e19-49a222d9bf6d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:36.247844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294be7b-1f09-4ced-9e19-49a222d9bf6d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:36.248257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294be7b-1f09-4ced-9e19-49a222d9bf6d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:36.248697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294be7b-1f09-4ced-9e19-49a222d9bf6d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:36.249421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294be7b-1f09-4ced-9e19-49a222d9bf6d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:36.252725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294be7b-1f09-4ced-9e19-49a222d9bf6d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:36.321118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f1825-1387-4806-aca0-c4000a8f6043 tempest-ListProjectsTestJSON-1333481484 tempest-ListProjectsTestJSON-1333481484-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:36.332174 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2936/5808] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:27:35 2022] POST /identity/v3/groups => generated 280 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:36.335087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294be7b-1f09-4ced-9e19-49a222d9bf6d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:36.338899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3294be7b-1f09-4ced-9e19-49a222d9bf6d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:36.392229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294be7b-1f09-4ced-9e19-49a222d9bf6d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:36.409772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab4774-db5c-4555-aac4-979a256989b3 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:36.410286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab4774-db5c-4555-aac4-979a256989b3 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:36.410696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab4774-db5c-4555-aac4-979a256989b3 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:36.411865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab4774-db5c-4555-aac4-979a256989b3 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/ae166ee45bbc42b397476dc3a32e9e51` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:36.418404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab4774-db5c-4555-aac4-979a256989b3 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:update_group(group_id=ae166ee45bbc42b397476dc3a32e9e51)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:36.419939 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-d1ab4774-db5c-4555-aac4-979a256989b3 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:36.419939 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:27:36.419939 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:27:36.422010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab4774-db5c-4555-aac4-979a256989b3 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:36.475152 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2937/5809] 10.222.0.39 () {60 vars in 1247 bytes} [Sun Oct 16 01:27:36 2022] PATCH /identity/v3/groups/ae166ee45bbc42b397476dc3a32e9e51 => generated 290 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:36.476355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab4774-db5c-4555-aac4-979a256989b3 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:36.506396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a96ef8-010e-4811-91ae-9a29573c6b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:36.507952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a96ef8-010e-4811-91ae-9a29573c6b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:36.512930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a96ef8-010e-4811-91ae-9a29573c6b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:36.513185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a96ef8-010e-4811-91ae-9a29573c6b13 admin admin] PATH_INFO: `/v3/users/d48ccabd999244799525498df4b84c5f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:36.524875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a96ef8-010e-4811-91ae-9a29573c6b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48ccabd999244799525498df4b84c5f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:36.531584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab4774-db5c-4555-aac4-979a256989b3 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:36.555103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a96ef8-010e-4811-91ae-9a29573c6b13 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:36.562016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a712b-d3a8-4033-b8f4-666d764b6d50 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:36.562688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a712b-d3a8-4033-b8f4-666d764b6d50 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:36.562989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a712b-d3a8-4033-b8f4-666d764b6d50 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:36.563273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a712b-d3a8-4033-b8f4-666d764b6d50 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/ae166ee45bbc42b397476dc3a32e9e51` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:36.594248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a712b-d3a8-4033-b8f4-666d764b6d50 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:get_group(group_id=ae166ee45bbc42b397476dc3a32e9e51)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:36.596371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a712b-d3a8-4033-b8f4-666d764b6d50 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:36.598424 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2938/5810] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:36 2022] GET /identity/v3/groups/ae166ee45bbc42b397476dc3a32e9e51 => generated 290 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:36.604218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a712b-d3a8-4033-b8f4-666d764b6d50 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:36.627094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a712b-d3a8-4033-b8f4-666d764b6d50 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:36.645247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3b199-5a0e-4a56-a28f-0fddeb1888fd tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:36.646677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3b199-5a0e-4a56-a28f-0fddeb1888fd tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:36.647080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3b199-5a0e-4a56-a28f-0fddeb1888fd tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:36.647472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3b199-5a0e-4a56-a28f-0fddeb1888fd tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/ae166ee45bbc42b397476dc3a32e9e51` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:36.652841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3b199-5a0e-4a56-a28f-0fddeb1888fd tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:update_group(group_id=ae166ee45bbc42b397476dc3a32e9e51)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:36.659293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3b199-5a0e-4a56-a28f-0fddeb1888fd tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:36.665868 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:36.677689 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:36.694343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68a96ef8-010e-4811-91ae-9a29573c6b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48ccabd999244799525498df4b84c5f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:36.695407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68a96ef8-010e-4811-91ae-9a29573c6b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48ccabd999244799525498df4b84c5f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:36.728934 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2939/5811] 10.222.0.39 () {60 vars in 1246 bytes} [Sun Oct 16 01:27:36 2022] PATCH /identity/v3/groups/ae166ee45bbc42b397476dc3a32e9e51 => generated 305 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:36.734359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3b199-5a0e-4a56-a28f-0fddeb1888fd tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:36.736836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9ff3b199-5a0e-4a56-a28f-0fddeb1888fd tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:36.738524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68a96ef8-010e-4811-91ae-9a29573c6b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48ccabd999244799525498df4b84c5f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:36.757209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68a96ef8-010e-4811-91ae-9a29573c6b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48ccabd999244799525498df4b84c5f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:36.758512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68a96ef8-010e-4811-91ae-9a29573c6b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48ccabd999244799525498df4b84c5f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:36.771896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3b199-5a0e-4a56-a28f-0fddeb1888fd tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:36.782344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e8ec7-b3e8-4be1-a189-e63b0c047d44 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:36.784311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e8ec7-b3e8-4be1-a189-e63b0c047d44 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:36.784607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e8ec7-b3e8-4be1-a189-e63b0c047d44 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:36.784884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e8ec7-b3e8-4be1-a189-e63b0c047d44 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/ae166ee45bbc42b397476dc3a32e9e51` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:36.789296 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2873/5812] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:36 2022] DELETE /identity/v3/users/d48ccabd999244799525498df4b84c5f => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:36.805092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e085e-fc50-43b9-a7e5-a684c0def3b8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:36.805721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e085e-fc50-43b9-a7e5-a684c0def3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:36.805834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e085e-fc50-43b9-a7e5-a684c0def3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:36.807444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e8ec7-b3e8-4be1-a189-e63b0c047d44 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ae166ee45bbc42b397476dc3a32e9e51)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:36.808688 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-998e8ec7-b3e8-4be1-a189-e63b0c047d44 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:36.808688 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:27:36.808688 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:27:36.810567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e8ec7-b3e8-4be1-a189-e63b0c047d44 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:36.835385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-058e085e-fc50-43b9-a7e5-a684c0def3b8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:36.836825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-058e085e-fc50-43b9-a7e5-a684c0def3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:36.976844 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2874/5813] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:27:36.998351 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2940/5814] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:27:36 2022] DELETE /identity/v3/groups/ae166ee45bbc42b397476dc3a32e9e51 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:36.999667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e085e-fc50-43b9-a7e5-a684c0def3b8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:37.017316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e8ec7-b3e8-4be1-a189-e63b0c047d44 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:37.019497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-998e8ec7-b3e8-4be1-a189-e63b0c047d44 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:37.214404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e8ec7-b3e8-4be1-a189-e63b0c047d44 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:37.226625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33766d17-49b4-4d12-b97f-c82716028b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:37.228674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33766d17-49b4-4d12-b97f-c82716028b3a service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:37.234965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33766d17-49b4-4d12-b97f-c82716028b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:37.235879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33766d17-49b4-4d12-b97f-c82716028b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:37.280118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e085e-fc50-43b9-a7e5-a684c0def3b8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:37.514287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33766d17-49b4-4d12-b97f-c82716028b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:37.519356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33766d17-49b4-4d12-b97f-c82716028b3a service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:37.529381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee0cbd-b44e-44bc-a8a4-08745ded709e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:37.530023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee0cbd-b44e-44bc-a8a4-08745ded709e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:37.530254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee0cbd-b44e-44bc-a8a4-08745ded709e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:37.530528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee0cbd-b44e-44bc-a8a4-08745ded709e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:37.531188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee0cbd-b44e-44bc-a8a4-08745ded709e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:37.534908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee0cbd-b44e-44bc-a8a4-08745ded709e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:37.581464 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2941/5815] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:37.582379 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:37.633117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33766d17-49b4-4d12-b97f-c82716028b3a service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:37.638897 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2875/5816] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:27:36 2022] POST /identity/v3/groups => generated 327 bytes in 638 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:37.651335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33766d17-49b4-4d12-b97f-c82716028b3a service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:37.665577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348eaf8b-a94b-4cd1-bc4f-6bcbefb71bc6 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:37.668961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348eaf8b-a94b-4cd1-bc4f-6bcbefb71bc6 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:37.669728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348eaf8b-a94b-4cd1-bc4f-6bcbefb71bc6 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:37.671036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348eaf8b-a94b-4cd1-bc4f-6bcbefb71bc6 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:37.671881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348eaf8b-a94b-4cd1-bc4f-6bcbefb71bc6 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:37.679618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348eaf8b-a94b-4cd1-bc4f-6bcbefb71bc6 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:37.761403 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2942/5817] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:37 2022] POST /identity/v3/users => generated 323 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:37.763513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee0cbd-b44e-44bc-a8a4-08745ded709e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:37.785160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee0cbd-b44e-44bc-a8a4-08745ded709e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:37.825156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1449ab-3133-48e3-bc7c-a9c885433291 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:37.825828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1449ab-3133-48e3-bc7c-a9c885433291 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:37.826114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1449ab-3133-48e3-bc7c-a9c885433291 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:37.826390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1449ab-3133-48e3-bc7c-a9c885433291 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/011a695d4e1f4487bcad5c57327fde8f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:37.925639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1449ab-3133-48e3-bc7c-a9c885433291 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=aed22c5ebd6f47e4b751936c51c318d3, user_id=011a695d4e1f4487bcad5c57327fde8f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:37.948533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1449ab-3133-48e3-bc7c-a9c885433291 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:38.059525 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2876/5818] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Oct 16 01:27:37 2022] PUT /identity/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/011a695d4e1f4487bcad5c57327fde8f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:38.061392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348eaf8b-a94b-4cd1-bc4f-6bcbefb71bc6 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:38.076133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348eaf8b-a94b-4cd1-bc4f-6bcbefb71bc6 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:38.145537 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:38.220069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5aad3-c7f5-4169-8491-a2612ae0f17d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:38.220720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5aad3-c7f5-4169-8491-a2612ae0f17d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:38.221009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5aad3-c7f5-4169-8491-a2612ae0f17d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:38.221293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5aad3-c7f5-4169-8491-a2612ae0f17d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:38.221950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5aad3-c7f5-4169-8491-a2612ae0f17d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:38.224502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5aad3-c7f5-4169-8491-a2612ae0f17d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:38.281185 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2943/5819] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:38 2022] POST /identity/v3/users => generated 321 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:38.282811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1449ab-3133-48e3-bc7c-a9c885433291 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:38.298405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1449ab-3133-48e3-bc7c-a9c885433291 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:38.313527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c12a2-402e-4850-aea4-485bebed3330 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:38.314379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c12a2-402e-4850-aea4-485bebed3330 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:38.314653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c12a2-402e-4850-aea4-485bebed3330 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:38.314959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c12a2-402e-4850-aea4-485bebed3330 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/998859b72aff4c3cadd9755883a848e0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:38.351387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c12a2-402e-4850-aea4-485bebed3330 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=aed22c5ebd6f47e4b751936c51c318d3, user_id=998859b72aff4c3cadd9755883a848e0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:38.353465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c12a2-402e-4850-aea4-485bebed3330 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:38.405866 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2877/5820] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Oct 16 01:27:38 2022] PUT /identity/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/998859b72aff4c3cadd9755883a848e0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:38.406986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5aad3-c7f5-4169-8491-a2612ae0f17d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:38.426091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5aad3-c7f5-4169-8491-a2612ae0f17d tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:38.636750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc4811-83f0-4feb-af42-07769f3af010 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:38.643289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc4811-83f0-4feb-af42-07769f3af010 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:38.644022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc4811-83f0-4feb-af42-07769f3af010 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:38.644318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc4811-83f0-4feb-af42-07769f3af010 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:38.648428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc4811-83f0-4feb-af42-07769f3af010 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:38.656197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc4811-83f0-4feb-af42-07769f3af010 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:38.786832 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2944/5821] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:38 2022] POST /identity/v3/users => generated 323 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:38.788149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c12a2-402e-4850-aea4-485bebed3330 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:38.805881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c12a2-402e-4850-aea4-485bebed3330 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:38.840335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15228401-38a0-4015-b536-9f89c6b0bff1 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:38.842662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15228401-38a0-4015-b536-9f89c6b0bff1 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:38.843787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15228401-38a0-4015-b536-9f89c6b0bff1 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:38.844881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15228401-38a0-4015-b536-9f89c6b0bff1 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/d5ce1f5bcd204764957561a10842b328` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:38.878143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15228401-38a0-4015-b536-9f89c6b0bff1 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=aed22c5ebd6f47e4b751936c51c318d3, user_id=d5ce1f5bcd204764957561a10842b328)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:38.882244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15228401-38a0-4015-b536-9f89c6b0bff1 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:38.918063 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2878/5822] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Oct 16 01:27:38 2022] PUT /identity/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/d5ce1f5bcd204764957561a10842b328 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:38.925276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc4811-83f0-4feb-af42-07769f3af010 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:38.925494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15228401-38a0-4015-b536-9f89c6b0bff1 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:38.930224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-15228401-38a0-4015-b536-9f89c6b0bff1 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:38.956086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc4811-83f0-4feb-af42-07769f3af010 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:39.147212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15228401-38a0-4015-b536-9f89c6b0bff1 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:39.162392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:39.166662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:39.168197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:39.170660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] PATH_INFO: `/v3/projects/51905acc23504f7cb82d7ee6516aa9d2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:39.174107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51905acc23504f7cb82d7ee6516aa9d2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:39.181279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:39.182839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8da1f7-9c6b-4837-bed4-84755ebe0f75 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:39.187453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8da1f7-9c6b-4837-bed4-84755ebe0f75 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:39.190394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8da1f7-9c6b-4837-bed4-84755ebe0f75 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:39.190705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8da1f7-9c6b-4837-bed4-84755ebe0f75 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:39.194824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8da1f7-9c6b-4837-bed4-84755ebe0f75 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=aed22c5ebd6f47e4b751936c51c318d3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:39.204893 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-6b8da1f7-9c6b-4837-bed4-84755ebe0f75 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:39.204893 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:27:39.204893 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:27:39.209748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8da1f7-9c6b-4837-bed4-84755ebe0f75 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:39.276496 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2945/5823] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:27:38 2022] GET /identity/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users => generated 1083 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:39.279222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8da1f7-9c6b-4837-bed4-84755ebe0f75 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:39.301435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51905acc23504f7cb82d7ee6516aa9d2', 'request_id': 'req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:39.307080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8da1f7-9c6b-4837-bed4-84755ebe0f75 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:39.309586 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:39.319938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51905acc23504f7cb82d7ee6516aa9d2', 'request_id': 'req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:39.342536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51905acc23504f7cb82d7ee6516aa9d2', 'request_id': 'req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:39.366275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] The token cache is being invalidate because project 51905acc23504f7cb82d7ee6516aa9d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:39.368546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:39.371567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:39.381299 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2879/5824] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:38 2022] DELETE /identity/v3/projects/51905acc23504f7cb82d7ee6516aa9d2 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:39.385278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:39.385840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:39.445240 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:39.488959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1f968-53d1-4c87-94f0-a6cc84328dc4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:39.490351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f968-53d1-4c87-94f0-a6cc84328dc4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:39.491932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f968-53d1-4c87-94f0-a6cc84328dc4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:39.492222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f968-53d1-4c87-94f0-a6cc84328dc4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/011a695d4e1f4487bcad5c57327fde8f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:39.505392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1f968-53d1-4c87-94f0-a6cc84328dc4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=aed22c5ebd6f47e4b751936c51c318d3, user_id=011a695d4e1f4487bcad5c57327fde8f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:39.506533 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-07b1f968-53d1-4c87-94f0-a6cc84328dc4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:39.506533 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:27:39.506533 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:27:39.514563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1f968-53d1-4c87-94f0-a6cc84328dc4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:39.543096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfe6c1-1c82-453b-9352-9c32248ff3b2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:39.553680 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2946/5825] 10.222.0.39 () {58 vars in 1342 bytes} [Sun Oct 16 01:27:39 2022] HEAD /identity/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/011a695d4e1f4487bcad5c57327fde8f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:39.557774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1f968-53d1-4c87-94f0-a6cc84328dc4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:39.560006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-07b1f968-53d1-4c87-94f0-a6cc84328dc4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:39.560449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:39.561477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:39.562069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:39.564361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] PATH_INFO: `/v3/users/94bead26b6754da5aa8025058f4d7373` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:39.568231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] RBAC: Authorizing `identity:delete_user(user_id=94bead26b6754da5aa8025058f4d7373)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:39.575595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:39.597119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1f968-53d1-4c87-94f0-a6cc84328dc4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:39.615955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9eb6ff-2419-4c6d-883b-7d834388f623 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:39.616780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eb6ff-2419-4c6d-883b-7d834388f623 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:39.617062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eb6ff-2419-4c6d-883b-7d834388f623 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:39.617336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eb6ff-2419-4c6d-883b-7d834388f623 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/011a695d4e1f4487bcad5c57327fde8f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:39.622146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9eb6ff-2419-4c6d-883b-7d834388f623 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=aed22c5ebd6f47e4b751936c51c318d3, user_id=011a695d4e1f4487bcad5c57327fde8f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:39.623257 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-2e9eb6ff-2419-4c6d-883b-7d834388f623 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:39.623257 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:27:39.623257 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:27:39.624465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9eb6ff-2419-4c6d-883b-7d834388f623 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:39.652072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2e9eb6ff-2419-4c6d-883b-7d834388f623 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '011a695d4e1f4487bcad5c57327fde8f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:39.702783 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2947/5826] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Oct 16 01:27:39 2022] DELETE /identity/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/011a695d4e1f4487bcad5c57327fde8f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:39.706337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9eb6ff-2419-4c6d-883b-7d834388f623 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:39.728860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94bead26b6754da5aa8025058f4d7373'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:39.729635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94bead26b6754da5aa8025058f4d7373'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:39.775697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94bead26b6754da5aa8025058f4d7373'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:39.794786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94bead26b6754da5aa8025058f4d7373'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:39.804294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94bead26b6754da5aa8025058f4d7373'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:39.838543 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2880/5827] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:39 2022] DELETE /identity/v3/users/94bead26b6754da5aa8025058f4d7373 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:39.873660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9eb6ff-2419-4c6d-883b-7d834388f623 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:39.994944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd0ae4-1263-4522-a843-a2d36ff3829e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:39.994944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd0ae4-1263-4522-a843-a2d36ff3829e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:39.994944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd0ae4-1263-4522-a843-a2d36ff3829e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:39.995333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd0ae4-1263-4522-a843-a2d36ff3829e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/998859b72aff4c3cadd9755883a848e0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:39.995333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd0ae4-1263-4522-a843-a2d36ff3829e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=aed22c5ebd6f47e4b751936c51c318d3, user_id=998859b72aff4c3cadd9755883a848e0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:40.011179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd0ae4-1263-4522-a843-a2d36ff3829e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:40.043882 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2948/5828] 10.222.0.39 () {58 vars in 1342 bytes} [Sun Oct 16 01:27:39 2022] HEAD /identity/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/998859b72aff4c3cadd9755883a848e0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:40.049302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:40.051003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:40.079327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cbbfd-147d-4486-aef6-2301e179b79d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:40.093172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c780aef-4d22-4f4d-b9d9-99af8a9a6a22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:40.094163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c780aef-4d22-4f4d-b9d9-99af8a9a6a22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:40.094603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c780aef-4d22-4f4d-b9d9-99af8a9a6a22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:40.095079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c780aef-4d22-4f4d-b9d9-99af8a9a6a22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/998859b72aff4c3cadd9755883a848e0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:40.097272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c780aef-4d22-4f4d-b9d9-99af8a9a6a22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=aed22c5ebd6f47e4b751936c51c318d3, user_id=998859b72aff4c3cadd9755883a848e0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:40.101142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c780aef-4d22-4f4d-b9d9-99af8a9a6a22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:40.116529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1c780aef-4d22-4f4d-b9d9-99af8a9a6a22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '998859b72aff4c3cadd9755883a848e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:40.139338 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2881/5829] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Oct 16 01:27:40 2022] DELETE /identity/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/998859b72aff4c3cadd9755883a848e0 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:40.143140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd0ae4-1263-4522-a843-a2d36ff3829e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:40.157543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd0ae4-1263-4522-a843-a2d36ff3829e tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:40.279245 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:40.326794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2fe51-ec2e-4add-a4f2-7e6d339e4c82 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:40.327510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2fe51-ec2e-4add-a4f2-7e6d339e4c82 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:40.327889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2fe51-ec2e-4add-a4f2-7e6d339e4c82 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:40.328072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2fe51-ec2e-4add-a4f2-7e6d339e4c82 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/d5ce1f5bcd204764957561a10842b328` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:40.331384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2fe51-ec2e-4add-a4f2-7e6d339e4c82 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=aed22c5ebd6f47e4b751936c51c318d3, user_id=d5ce1f5bcd204764957561a10842b328)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:40.337492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2fe51-ec2e-4add-a4f2-7e6d339e4c82 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:40.370974 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2949/5830] 10.222.0.39 () {58 vars in 1342 bytes} [Sun Oct 16 01:27:40 2022] HEAD /identity/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/d5ce1f5bcd204764957561a10842b328 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:40.374768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c780aef-4d22-4f4d-b9d9-99af8a9a6a22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:40.393808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c780aef-4d22-4f4d-b9d9-99af8a9a6a22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:40.406289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea9845-c522-4d72-978e-ae61497f5eba tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:40.407347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea9845-c522-4d72-978e-ae61497f5eba tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:40.408082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea9845-c522-4d72-978e-ae61497f5eba tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:40.412154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea9845-c522-4d72-978e-ae61497f5eba tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/d5ce1f5bcd204764957561a10842b328` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:40.417306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea9845-c522-4d72-978e-ae61497f5eba tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=aed22c5ebd6f47e4b751936c51c318d3, user_id=d5ce1f5bcd204764957561a10842b328)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:40.419600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea9845-c522-4d72-978e-ae61497f5eba tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:40.438840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8eea9845-c522-4d72-978e-ae61497f5eba tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd5ce1f5bcd204764957561a10842b328'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:40.496686 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2882/5831] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Oct 16 01:27:40 2022] DELETE /identity/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users/d5ce1f5bcd204764957561a10842b328 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:40.500905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2fe51-ec2e-4add-a4f2-7e6d339e4c82 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:40.525795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2fe51-ec2e-4add-a4f2-7e6d339e4c82 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:40.765536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de50bc-5a6c-44c9-ba68-4067fae41815 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:40.766297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de50bc-5a6c-44c9-ba68-4067fae41815 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:40.766592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de50bc-5a6c-44c9-ba68-4067fae41815 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:40.766859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de50bc-5a6c-44c9-ba68-4067fae41815 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:40.772082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de50bc-5a6c-44c9-ba68-4067fae41815 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=aed22c5ebd6f47e4b751936c51c318d3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:40.778253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de50bc-5a6c-44c9-ba68-4067fae41815 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:40.808755 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2950/5832] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:27:40 2022] GET /identity/v3/groups/aed22c5ebd6f47e4b751936c51c318d3/users => generated 145 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:40.815379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea9845-c522-4d72-978e-ae61497f5eba tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:40.841618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea9845-c522-4d72-978e-ae61497f5eba tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:40.850603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:40.851228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:40.851514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:40.851790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/users/d5ce1f5bcd204764957561a10842b328` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:40.853164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d5ce1f5bcd204764957561a10842b328)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:40.856277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:40.932063 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=79,keystone:INSERT=4,keystone:DELETE=17 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:41.005710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ce1f5bcd204764957561a10842b328'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.006235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ce1f5bcd204764957561a10842b328'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.038851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ce1f5bcd204764957561a10842b328'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.053988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ce1f5bcd204764957561a10842b328'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.054817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ce1f5bcd204764957561a10842b328'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.081990 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2883/5833] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:40 2022] DELETE /identity/v3/users/d5ce1f5bcd204764957561a10842b328 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:41.086668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de50bc-5a6c-44c9-ba68-4067fae41815 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:41.088758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-23de50bc-5a6c-44c9-ba68-4067fae41815 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:41.121663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de50bc-5a6c-44c9-ba68-4067fae41815 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:41.297581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:41.299292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:41.300494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:41.302422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/users/998859b72aff4c3cadd9755883a848e0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:41.306814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:delete_user(user_id=998859b72aff4c3cadd9755883a848e0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:41.308827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:41.379330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:41.381394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:41.404346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998859b72aff4c3cadd9755883a848e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.411448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998859b72aff4c3cadd9755883a848e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.433083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998859b72aff4c3cadd9755883a848e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.460199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998859b72aff4c3cadd9755883a848e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.461970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998859b72aff4c3cadd9755883a848e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.484359 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:41.495303 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2951/5834] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:41 2022] DELETE /identity/v3/users/998859b72aff4c3cadd9755883a848e0 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:41.501174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:41.506667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:41.535864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9ef84-9193-4321-bda0-9664afec4add tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:41.656475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9ffa-2329-4fc4-ab79-4e806bb6e5fe tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:41.668921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863352d-f117-4f82-817f-a89e45a43773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:41.670042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863352d-f117-4f82-817f-a89e45a43773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:41.670541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863352d-f117-4f82-817f-a89e45a43773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:41.671089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863352d-f117-4f82-817f-a89e45a43773 admin admin] PATH_INFO: `/v3/projects/e6cb873ddd3b440c9807e3a25aa3cf9d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:41.672555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863352d-f117-4f82-817f-a89e45a43773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6cb873ddd3b440c9807e3a25aa3cf9d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:41.673591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:41.675171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:41.675474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863352d-f117-4f82-817f-a89e45a43773 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:41.675581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:41.675850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/users/011a695d4e1f4487bcad5c57327fde8f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:41.680444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:delete_user(user_id=011a695d4e1f4487bcad5c57327fde8f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:41.682409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:41.762383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011a695d4e1f4487bcad5c57327fde8f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.764065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011a695d4e1f4487bcad5c57327fde8f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.781548 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:41.806971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1863352d-f117-4f82-817f-a89e45a43773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6cb873ddd3b440c9807e3a25aa3cf9d', 'request_id': 'req-1863352d-f117-4f82-817f-a89e45a43773'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.807608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011a695d4e1f4487bcad5c57327fde8f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.829219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011a695d4e1f4487bcad5c57327fde8f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.830133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011a695d4e1f4487bcad5c57327fde8f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.831142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1863352d-f117-4f82-817f-a89e45a43773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6cb873ddd3b440c9807e3a25aa3cf9d', 'request_id': 'req-1863352d-f117-4f82-817f-a89e45a43773'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.860472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1863352d-f117-4f82-817f-a89e45a43773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6cb873ddd3b440c9807e3a25aa3cf9d', 'request_id': 'req-1863352d-f117-4f82-817f-a89e45a43773'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.862290 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2952/5835] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:41 2022] DELETE /identity/v3/users/011a695d4e1f4487bcad5c57327fde8f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:41.867507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:41.870430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:41.880892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1863352d-f117-4f82-817f-a89e45a43773 admin admin] The token cache is being invalidate because project e6cb873ddd3b440c9807e3a25aa3cf9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:41.882524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1863352d-f117-4f82-817f-a89e45a43773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.883612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1863352d-f117-4f82-817f-a89e45a43773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:41.886157 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2884/5836] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:41 2022] DELETE /identity/v3/projects/e6cb873ddd3b440c9807e3a25aa3cf9d => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:41.892281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768ec3e-796f-4b51-8018-31a6f35293f4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:41.892281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768ec3e-796f-4b51-8018-31a6f35293f4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:41.892281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768ec3e-796f-4b51-8018-31a6f35293f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:41.920607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f768ec3e-796f-4b51-8018-31a6f35293f4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:41.924258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f768ec3e-796f-4b51-8018-31a6f35293f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:42.015654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c273f4-4b48-4361-ad2d-cce8a9e6d16a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:42.020629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4136ec-2507-43b8-b607-21eca5c6316f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:42.021742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4136ec-2507-43b8-b607-21eca5c6316f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:42.021742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4136ec-2507-43b8-b607-21eca5c6316f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:42.021879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4136ec-2507-43b8-b607-21eca5c6316f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/aed22c5ebd6f47e4b751936c51c318d3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:42.023345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4136ec-2507-43b8-b607-21eca5c6316f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:delete_group(group_id=aed22c5ebd6f47e4b751936c51c318d3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:42.025491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4136ec-2507-43b8-b607-21eca5c6316f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:42.091101 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:42.103583 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2885/5837] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:42.111852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6e3bb-bbda-494a-995f-d2b25026855b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:42.112332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6e3bb-bbda-494a-995f-d2b25026855b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:42.112759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6e3bb-bbda-494a-995f-d2b25026855b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:42.169660 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2953/5838] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:27:41 2022] DELETE /identity/v3/groups/aed22c5ebd6f47e4b751936c51c318d3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:42.178149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4136ec-2507-43b8-b607-21eca5c6316f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:42.178649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9dc6e3bb-bbda-494a-995f-d2b25026855b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:42.180089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9dc6e3bb-bbda-494a-995f-d2b25026855b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:42.180850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3b4136ec-2507-43b8-b607-21eca5c6316f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:42.318518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4136ec-2507-43b8-b607-21eca5c6316f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:42.331347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecde474-1790-43dd-8035-eb4599d8c175 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:42.333434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecde474-1790-43dd-8035-eb4599d8c175 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:42.333725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecde474-1790-43dd-8035-eb4599d8c175 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:42.333979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecde474-1790-43dd-8035-eb4599d8c175 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:42.335973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecde474-1790-43dd-8035-eb4599d8c175 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:42.341564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecde474-1790-43dd-8035-eb4599d8c175 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:42.374323 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2954/5839] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:27:42 2022] POST /identity/v3/groups => generated 327 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:42.375540 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2886/5840] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:42.377260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecde474-1790-43dd-8035-eb4599d8c175 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:42.380444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6e3bb-bbda-494a-995f-d2b25026855b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:42.404094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecde474-1790-43dd-8035-eb4599d8c175 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:42.405332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6e3bb-bbda-494a-995f-d2b25026855b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:42.416339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebd313-57e6-4a47-b86e-bec216ac76eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:42.417531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da1eff-63f0-41c4-a10f-d177fd9e350f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:42.418218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebd313-57e6-4a47-b86e-bec216ac76eb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:42.418849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da1eff-63f0-41c4-a10f-d177fd9e350f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:42.419194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebd313-57e6-4a47-b86e-bec216ac76eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:42.419527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da1eff-63f0-41c4-a10f-d177fd9e350f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:42.419879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebd313-57e6-4a47-b86e-bec216ac76eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:42.420218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da1eff-63f0-41c4-a10f-d177fd9e350f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:42.420921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebd313-57e6-4a47-b86e-bec216ac76eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:42.421635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da1eff-63f0-41c4-a10f-d177fd9e350f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:42.422199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebd313-57e6-4a47-b86e-bec216ac76eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:42.424291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da1eff-63f0-41c4-a10f-d177fd9e350f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:42.426303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebd313-57e6-4a47-b86e-bec216ac76eb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:42.461016 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2887/5841] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:42.461212 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2955/5842] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:27:42 2022] POST /identity/v3/groups => generated 327 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:42.461933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebd313-57e6-4a47-b86e-bec216ac76eb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:42.464657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da1eff-63f0-41c4-a10f-d177fd9e350f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:42.482832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebd313-57e6-4a47-b86e-bec216ac76eb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:42.487835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da1eff-63f0-41c4-a10f-d177fd9e350f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:42.496862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b4c48-7b99-46e9-b1f8-ead902d44ca4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:42.497619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae29fc1-75b7-45eb-9715-335b4ccc258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:42.498471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae29fc1-75b7-45eb-9715-335b4ccc258a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:42.499740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b4c48-7b99-46e9-b1f8-ead902d44ca4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:42.500128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae29fc1-75b7-45eb-9715-335b4ccc258a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:42.500815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b4c48-7b99-46e9-b1f8-ead902d44ca4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:42.501145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae29fc1-75b7-45eb-9715-335b4ccc258a admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:42.501491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b4c48-7b99-46e9-b1f8-ead902d44ca4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:42.502278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae29fc1-75b7-45eb-9715-335b4ccc258a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:42.503091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b4c48-7b99-46e9-b1f8-ead902d44ca4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:42.506978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae29fc1-75b7-45eb-9715-335b4ccc258a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:42.508128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b4c48-7b99-46e9-b1f8-ead902d44ca4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:42.554204 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2956/5843] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:27:42 2022] POST /identity/v3/groups => generated 326 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:42.559056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b4c48-7b99-46e9-b1f8-ead902d44ca4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:42.579244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b4c48-7b99-46e9-b1f8-ead902d44ca4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:42.586274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92aa0bd-13ac-4bce-a325-f98d53355bb0 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:42.587815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aa0bd-13ac-4bce-a325-f98d53355bb0 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:42.589306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aa0bd-13ac-4bce-a325-f98d53355bb0 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:42.589582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aa0bd-13ac-4bce-a325-f98d53355bb0 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:42.590230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92aa0bd-13ac-4bce-a325-f98d53355bb0 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:42.591985 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-a92aa0bd-13ac-4bce-a325-f98d53355bb0 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:42.591985 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:27:42.591985 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:27:42.593147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92aa0bd-13ac-4bce-a325-f98d53355bb0 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:42.606066 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2957/5844] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 01:27:42 2022] GET /identity/v3/groups => generated 1490 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:42.607042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92aa0bd-13ac-4bce-a325-f98d53355bb0 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:42.612200 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2888/5845] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:42 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:42.613721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae29fc1-75b7-45eb-9715-335b4ccc258a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:42.626453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92aa0bd-13ac-4bce-a325-f98d53355bb0 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:42.722281 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:42.794566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90274b4-8081-4225-8c28-7e19801f4ab4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:42.795294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90274b4-8081-4225-8c28-7e19801f4ab4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:42.795610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90274b4-8081-4225-8c28-7e19801f4ab4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:42.795839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90274b4-8081-4225-8c28-7e19801f4ab4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/ac312e80cc4b4d1eae855fa402b25446` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:42.800082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae29fc1-75b7-45eb-9715-335b4ccc258a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:42.804268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90274b4-8081-4225-8c28-7e19801f4ab4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ac312e80cc4b4d1eae855fa402b25446)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:42.805632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b6b66-72f3-464e-b3fd-8989782cd27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:42.806386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6b66-72f3-464e-b3fd-8989782cd27e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:42.806591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90274b4-8081-4225-8c28-7e19801f4ab4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:42.806853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6b66-72f3-464e-b3fd-8989782cd27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:42.807259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6b66-72f3-464e-b3fd-8989782cd27e admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:42.808153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b6b66-72f3-464e-b3fd-8989782cd27e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:42.810461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b6b66-72f3-464e-b3fd-8989782cd27e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:42.858645 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2889/5846] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:42 2022] POST /identity/v3/users => generated 284 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:42.863080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b6b66-72f3-464e-b3fd-8989782cd27e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:42.879317 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:42.879561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b6b66-72f3-464e-b3fd-8989782cd27e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:42.885809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7c9c7-896e-4339-a0a0-248157b7b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:42.886773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7c9c7-896e-4339-a0a0-248157b7b2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:42.887207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7c9c7-896e-4339-a0a0-248157b7b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:42.887689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7c9c7-896e-4339-a0a0-248157b7b2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:42.888312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7c9c7-896e-4339-a0a0-248157b7b2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:42.890658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7c9c7-896e-4339-a0a0-248157b7b2a4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:42.909069 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2890/5847] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:27:42.916899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7c9c7-896e-4339-a0a0-248157b7b2a4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:42.922859 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2958/5848] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:27:42 2022] DELETE /identity/v3/groups/ac312e80cc4b4d1eae855fa402b25446 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:42.927659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90274b4-8081-4225-8c28-7e19801f4ab4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:42.945390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7c9c7-896e-4339-a0a0-248157b7b2a4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:43.058899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90274b4-8081-4225-8c28-7e19801f4ab4 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:43.064841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce2ca5-f3d2-40a6-9166-9416b1eb6a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:43.065573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce2ca5-f3d2-40a6-9166-9416b1eb6a89 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:43.065854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce2ca5-f3d2-40a6-9166-9416b1eb6a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:43.066132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce2ca5-f3d2-40a6-9166-9416b1eb6a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:43.066859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c12c0a-d7a0-47b5-94fd-84bd17f2f270 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:43.068507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c12c0a-d7a0-47b5-94fd-84bd17f2f270 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:43.068643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce2ca5-f3d2-40a6-9166-9416b1eb6a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:43.068826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c12c0a-d7a0-47b5-94fd-84bd17f2f270 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:43.069207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c12c0a-d7a0-47b5-94fd-84bd17f2f270 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/ea0946afb37148a48442d9fcbfedb767` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:43.070846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce2ca5-f3d2-40a6-9166-9416b1eb6a89 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:43.075523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c12c0a-d7a0-47b5-94fd-84bd17f2f270 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ea0946afb37148a48442d9fcbfedb767)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:43.078023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c12c0a-d7a0-47b5-94fd-84bd17f2f270 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:43.085287 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2891/5849] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:43.088669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce2ca5-f3d2-40a6-9166-9416b1eb6a89 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:43.115995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce2ca5-f3d2-40a6-9166-9416b1eb6a89 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:43.123742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701cf5a-e35d-4c4a-9ae3-563f67181b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:43.126083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701cf5a-e35d-4c4a-9ae3-563f67181b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:43.126383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701cf5a-e35d-4c4a-9ae3-563f67181b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:43.126640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701cf5a-e35d-4c4a-9ae3-563f67181b2a admin admin] PATH_INFO: `/v3/projects/822c159a5914453eafc4add8de032cdb/users/8fe5898ce4ab413ba3a1556046fe7688/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:43.163118 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2959/5850] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:27:42 2022] DELETE /identity/v3/groups/ea0946afb37148a48442d9fcbfedb767 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:43.164410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c12c0a-d7a0-47b5-94fd-84bd17f2f270 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:43.168777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701cf5a-e35d-4c4a-9ae3-563f67181b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=822c159a5914453eafc4add8de032cdb, user_id=8fe5898ce4ab413ba3a1556046fe7688, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:43.176523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701cf5a-e35d-4c4a-9ae3-563f67181b2a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:43.209520 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2892/5851] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:43 2022] PUT /identity/v3/projects/822c159a5914453eafc4add8de032cdb/users/8fe5898ce4ab413ba3a1556046fe7688/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:43.223998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754f6ba-068f-433b-b313-578c8cd9d5b0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:43.225557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754f6ba-068f-433b-b313-578c8cd9d5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:43.226093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754f6ba-068f-433b-b313-578c8cd9d5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:43.268403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2754f6ba-068f-433b-b313-578c8cd9d5b0 None None] MFA Rules not processed for user `8fe5898ce4ab413ba3a1556046fe7688`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:43.269272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c12c0a-d7a0-47b5-94fd-84bd17f2f270 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:43.270239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2754f6ba-068f-433b-b313-578c8cd9d5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:43.346127 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:43.359637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9460cfd-588b-4c31-98dc-6e111196f400 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:43.360454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9460cfd-588b-4c31-98dc-6e111196f400 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:43.361197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9460cfd-588b-4c31-98dc-6e111196f400 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:43.361631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9460cfd-588b-4c31-98dc-6e111196f400 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/6ddb6508195e4d81b63ec44ee75bb731` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:43.367939 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2893/5852] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:43.371267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9460cfd-588b-4c31-98dc-6e111196f400 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6ddb6508195e4d81b63ec44ee75bb731)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:43.371772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754f6ba-068f-433b-b313-578c8cd9d5b0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:43.373558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9460cfd-588b-4c31-98dc-6e111196f400 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:43.401171 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:43.454171 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2960/5853] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:27:43 2022] DELETE /identity/v3/groups/6ddb6508195e4d81b63ec44ee75bb731 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:27:43.461752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9460cfd-588b-4c31-98dc-6e111196f400 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:43.498869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754f6ba-068f-433b-b313-578c8cd9d5b0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:43.594790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b16ac-7400-4ff8-903c-8e4745df6b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:43.595684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b16ac-7400-4ff8-903c-8e4745df6b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:43.596035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b16ac-7400-4ff8-903c-8e4745df6b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:43.596551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b16ac-7400-4ff8-903c-8e4745df6b78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:43.597264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b16ac-7400-4ff8-903c-8e4745df6b78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:43.599729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b16ac-7400-4ff8-903c-8e4745df6b78 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:43.606408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9460cfd-588b-4c31-98dc-6e111196f400 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:43.613283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f499cf-638b-4087-a7c4-3400884c0ece tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:43.613922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f499cf-638b-4087-a7c4-3400884c0ece tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:43.614254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f499cf-638b-4087-a7c4-3400884c0ece tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:43.614668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f499cf-638b-4087-a7c4-3400884c0ece tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:43.615276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f499cf-638b-4087-a7c4-3400884c0ece tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:43.617199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f499cf-638b-4087-a7c4-3400884c0ece tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:43.656560 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2894/5854] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:43 2022] POST /identity/v3/projects => generated 365 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:27:43.658022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b16ac-7400-4ff8-903c-8e4745df6b78 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:43.680330 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2961/5855] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:43 2022] POST /identity/v3/users => generated 323 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:43.684650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f499cf-638b-4087-a7c4-3400884c0ece tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:43.713217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f499cf-638b-4087-a7c4-3400884c0ece tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:43.774824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b16ac-7400-4ff8-903c-8e4745df6b78 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:43.781999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e2da2-1425-4027-90ab-ef19f2c93351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:43.783205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2da2-1425-4027-90ab-ef19f2c93351 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:43.783629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2da2-1425-4027-90ab-ef19f2c93351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:43.784144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2da2-1425-4027-90ab-ef19f2c93351 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:43.785105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e2da2-1425-4027-90ab-ef19f2c93351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:43.788040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e2da2-1425-4027-90ab-ef19f2c93351 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:43.829886 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2895/5856] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:43 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:27:43.843066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e2da2-1425-4027-90ab-ef19f2c93351 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:43.857625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e2da2-1425-4027-90ab-ef19f2c93351 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:43.862820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcc040-d7c3-4e3e-a2bb-0f544c8dd6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:43.863900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcc040-d7c3-4e3e-a2bb-0f544c8dd6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:43.864323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcc040-d7c3-4e3e-a2bb-0f544c8dd6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:43.865399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcc040-d7c3-4e3e-a2bb-0f544c8dd6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:43.866256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcc040-d7c3-4e3e-a2bb-0f544c8dd6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:43.868290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcc040-d7c3-4e3e-a2bb-0f544c8dd6d4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:43.868820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddb2c9-a15e-4d08-9c36-79a429b3c37f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:43.869449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddb2c9-a15e-4d08-9c36-79a429b3c37f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:43.869734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddb2c9-a15e-4d08-9c36-79a429b3c37f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:43.870015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddb2c9-a15e-4d08-9c36-79a429b3c37f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:43.870662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddb2c9-a15e-4d08-9c36-79a429b3c37f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:43.872792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddb2c9-a15e-4d08-9c36-79a429b3c37f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:43.886846 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2896/5857] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:27:43.888322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcc040-d7c3-4e3e-a2bb-0f544c8dd6d4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:43.911005 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2962/5858] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:27:43 2022] POST /identity/v3/groups => generated 326 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:43.914676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddb2c9-a15e-4d08-9c36-79a429b3c37f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:43.921202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcc040-d7c3-4e3e-a2bb-0f544c8dd6d4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:43.935783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41239e-855c-4428-8408-cbdd55697a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:43.936227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41239e-855c-4428-8408-cbdd55697a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:43.936444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41239e-855c-4428-8408-cbdd55697a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:43.936719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41239e-855c-4428-8408-cbdd55697a1e admin admin] PATH_INFO: `/v3/projects/83dac34a9eaf4dcd8b9053efac54f372/users/2be27a05fa334a40b1fd2f7e640c7d7b/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:43.968535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddb2c9-a15e-4d08-9c36-79a429b3c37f tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:43.975915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41239e-855c-4428-8408-cbdd55697a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dac34a9eaf4dcd8b9053efac54f372, user_id=2be27a05fa334a40b1fd2f7e640c7d7b, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:43.978633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41239e-855c-4428-8408-cbdd55697a1e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:43.983635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4c6b7-37b2-4743-95d7-8a719251c05a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:43.984975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4c6b7-37b2-4743-95d7-8a719251c05a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:43.985342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4c6b7-37b2-4743-95d7-8a719251c05a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:43.985593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4c6b7-37b2-4743-95d7-8a719251c05a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/82f5cbbaf8a74e8fa4ecd20ef70fe49d/users/d7b9816d24f34f1d9c772fbeec248244` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:43.992706 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:44.005601 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2897/5859] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:43 2022] PUT /identity/v3/projects/83dac34a9eaf4dcd8b9053efac54f372/users/2be27a05fa334a40b1fd2f7e640c7d7b/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:44.012124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41239e-855c-4428-8408-cbdd55697a1e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:44.044355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4c6b7-37b2-4743-95d7-8a719251c05a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=82f5cbbaf8a74e8fa4ecd20ef70fe49d, user_id=d7b9816d24f34f1d9c772fbeec248244)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:44.045660 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-63e4c6b7-37b2-4743-95d7-8a719251c05a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:44.045660 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:27:44.045660 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:27:44.047088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4c6b7-37b2-4743-95d7-8a719251c05a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:44.066014 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:44.099628 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2963/5860] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Oct 16 01:27:43 2022] PUT /identity/v3/groups/82f5cbbaf8a74e8fa4ecd20ef70fe49d/users/d7b9816d24f34f1d9c772fbeec248244 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:27:44.106882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4c6b7-37b2-4743-95d7-8a719251c05a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:44.205809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41239e-855c-4428-8408-cbdd55697a1e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:44.307812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4c6b7-37b2-4743-95d7-8a719251c05a tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:44.334729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1f64f-f2b9-4fe6-a049-77484ec86be2 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:44.339671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f64f-f2b9-4fe6-a049-77484ec86be2 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:44.339671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f64f-f2b9-4fe6-a049-77484ec86be2 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:44.339671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f64f-f2b9-4fe6-a049-77484ec86be2 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:44.340304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1f64f-f2b9-4fe6-a049-77484ec86be2 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:44.342618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1f64f-f2b9-4fe6-a049-77484ec86be2 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:44.371968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec56f9-73ac-413d-b8b8-347a9cdadeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:44.371968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec56f9-73ac-413d-b8b8-347a9cdadeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:44.372219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec56f9-73ac-413d-b8b8-347a9cdadeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:44.372441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec56f9-73ac-413d-b8b8-347a9cdadeb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:44.373087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec56f9-73ac-413d-b8b8-347a9cdadeb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:44.374803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec56f9-73ac-413d-b8b8-347a9cdadeb7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:44.382134 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2964/5861] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:27:44 2022] POST /identity/v3/groups => generated 327 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:44.393507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1f64f-f2b9-4fe6-a049-77484ec86be2 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:44.403349 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2898/5862] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:44.414736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec56f9-73ac-413d-b8b8-347a9cdadeb7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:44.462948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1f64f-f2b9-4fe6-a049-77484ec86be2 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:44.465441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec56f9-73ac-413d-b8b8-347a9cdadeb7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:44.476288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1fe7e-743c-4ed0-8ba1-6c8a64652c66 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:44.477670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1fe7e-743c-4ed0-8ba1-6c8a64652c66 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:44.477958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1fe7e-743c-4ed0-8ba1-6c8a64652c66 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:44.478238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1fe7e-743c-4ed0-8ba1-6c8a64652c66 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/4382d3556cc146079477a46a542dfc19/users/d7b9816d24f34f1d9c772fbeec248244` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:44.480641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fbf0b-2384-482a-b7b8-9a189f181511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:44.481370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fbf0b-2384-482a-b7b8-9a189f181511 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:44.482875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fbf0b-2384-482a-b7b8-9a189f181511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:44.483182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fbf0b-2384-482a-b7b8-9a189f181511 admin admin] PATH_INFO: `/v3/projects/83dac34a9eaf4dcd8b9053efac54f372/users/2be27a05fa334a40b1fd2f7e640c7d7b/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:44.490158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fbf0b-2384-482a-b7b8-9a189f181511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dac34a9eaf4dcd8b9053efac54f372, user_id=2be27a05fa334a40b1fd2f7e640c7d7b, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:44.496648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fbf0b-2384-482a-b7b8-9a189f181511 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:44.498262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1fe7e-743c-4ed0-8ba1-6c8a64652c66 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4382d3556cc146079477a46a542dfc19, user_id=d7b9816d24f34f1d9c772fbeec248244)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:44.509714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1fe7e-743c-4ed0-8ba1-6c8a64652c66 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:44.610555 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2899/5863] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:44 2022] PUT /identity/v3/projects/83dac34a9eaf4dcd8b9053efac54f372/users/2be27a05fa334a40b1fd2f7e640c7d7b/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:44.622348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849ba6c-e707-4a52-b6f4-406e91912a1b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:44.623177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849ba6c-e707-4a52-b6f4-406e91912a1b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:44.623690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849ba6c-e707-4a52-b6f4-406e91912a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:44.663248 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2965/5864] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Oct 16 01:27:44 2022] PUT /identity/v3/groups/4382d3556cc146079477a46a542dfc19/users/d7b9816d24f34f1d9c772fbeec248244 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:44.671822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1fe7e-743c-4ed0-8ba1-6c8a64652c66 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:44.709695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9849ba6c-e707-4a52-b6f4-406e91912a1b None None] MFA Rules not processed for user `2be27a05fa334a40b1fd2f7e640c7d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:44.711149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9849ba6c-e707-4a52-b6f4-406e91912a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:44.853490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1fe7e-743c-4ed0-8ba1-6c8a64652c66 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:44.866480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0dc98-8778-4717-85ce-76e02d1b3519 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:44.867289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0dc98-8778-4717-85ce-76e02d1b3519 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:44.871123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0dc98-8778-4717-85ce-76e02d1b3519 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:44.871882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0dc98-8778-4717-85ce-76e02d1b3519 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/users/d7b9816d24f34f1d9c772fbeec248244/groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:44.874941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0dc98-8778-4717-85ce-76e02d1b3519 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=d7b9816d24f34f1d9c772fbeec248244)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:44.881030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0dc98-8778-4717-85ce-76e02d1b3519 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:44.928506 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2966/5865] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:27:44 2022] GET /identity/v3/users/d7b9816d24f34f1d9c772fbeec248244/groups => generated 839 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:44.936759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0dc98-8778-4717-85ce-76e02d1b3519 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:44.949487 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2900/5866] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:44.950627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849ba6c-e707-4a52-b6f4-406e91912a1b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:44.968667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0dc98-8778-4717-85ce-76e02d1b3519 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:44.979811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849ba6c-e707-4a52-b6f4-406e91912a1b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:44.997573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c9d7e-adb9-4891-a1d8-77cd16dc4f19 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:44.997718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dbb5e-d7cd-4174-8f75-af536bea75cb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:44.998237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c9d7e-adb9-4891-a1d8-77cd16dc4f19 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:44.998519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c9d7e-adb9-4891-a1d8-77cd16dc4f19 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:44.998627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dbb5e-d7cd-4174-8f75-af536bea75cb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:44.998792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c9d7e-adb9-4891-a1d8-77cd16dc4f19 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/4382d3556cc146079477a46a542dfc19` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:44.999107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dbb5e-d7cd-4174-8f75-af536bea75cb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:44.999483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dbb5e-d7cd-4174-8f75-af536bea75cb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:45.000085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c9d7e-adb9-4891-a1d8-77cd16dc4f19 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4382d3556cc146079477a46a542dfc19)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:45.000402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dbb5e-d7cd-4174-8f75-af536bea75cb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:45.002850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dbb5e-d7cd-4174-8f75-af536bea75cb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:45.003007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c9d7e-adb9-4891-a1d8-77cd16dc4f19 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:45.048493 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:45.095204 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2901/5867] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:44 2022] POST /identity/v3/projects => generated 358 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:45.101269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dbb5e-d7cd-4174-8f75-af536bea75cb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:45.173857 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2967/5868] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:27:44 2022] DELETE /identity/v3/groups/4382d3556cc146079477a46a542dfc19 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:45.177890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c9d7e-adb9-4891-a1d8-77cd16dc4f19 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:45.193956 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:45.281329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dbb5e-d7cd-4174-8f75-af536bea75cb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:45.351342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c9d7e-adb9-4891-a1d8-77cd16dc4f19 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:45.365390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd39610-52d3-48f7-b7e9-f43302a4ea22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:45.366705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd39610-52d3-48f7-b7e9-f43302a4ea22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:45.367482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd39610-52d3-48f7-b7e9-f43302a4ea22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:45.368855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd39610-52d3-48f7-b7e9-f43302a4ea22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/groups/82f5cbbaf8a74e8fa4ecd20ef70fe49d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:45.371340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd39610-52d3-48f7-b7e9-f43302a4ea22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:delete_group(group_id=82f5cbbaf8a74e8fa4ecd20ef70fe49d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:45.377988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd39610-52d3-48f7-b7e9-f43302a4ea22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:45.389168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7323ab-6184-43ee-9c5f-6752f0569c70 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:45.390339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7323ab-6184-43ee-9c5f-6752f0569c70 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:45.390841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7323ab-6184-43ee-9c5f-6752f0569c70 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:45.391359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7323ab-6184-43ee-9c5f-6752f0569c70 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:45.392219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7323ab-6184-43ee-9c5f-6752f0569c70 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:45.395190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7323ab-6184-43ee-9c5f-6752f0569c70 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:45.445567 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2902/5869] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:45 2022] POST /identity/v3/users => generated 371 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:45.450314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7323ab-6184-43ee-9c5f-6752f0569c70 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:45.465918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7323ab-6184-43ee-9c5f-6752f0569c70 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:45.477007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93964a98-846b-4def-939d-50c56894404c tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:45.478388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964a98-846b-4def-939d-50c56894404c tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:45.478708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964a98-846b-4def-939d-50c56894404c tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:45.479329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964a98-846b-4def-939d-50c56894404c tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/45d15241345a49e0800af8eb5637b043` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:45.515469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93964a98-846b-4def-939d-50c56894404c tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:get_user(user_id=45d15241345a49e0800af8eb5637b043)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:45.516097 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2968/5870] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:27:45 2022] DELETE /identity/v3/groups/82f5cbbaf8a74e8fa4ecd20ef70fe49d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:45.518717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93964a98-846b-4def-939d-50c56894404c tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:45.520147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd39610-52d3-48f7-b7e9-f43302a4ea22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:45.529988 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2903/5871] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:27:45 2022] GET /identity/v3/users/45d15241345a49e0800af8eb5637b043 => generated 371 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:45.533257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93964a98-846b-4def-939d-50c56894404c tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:45.592559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93964a98-846b-4def-939d-50c56894404c tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:45.679719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd39610-52d3-48f7-b7e9-f43302a4ea22 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:45.695263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:45.697362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:45.698177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:45.698465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/users/d7b9816d24f34f1d9c772fbeec248244` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:45.701376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d7b9816d24f34f1d9c772fbeec248244)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:45.707256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:45.760293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:45.760949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:45.761233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:45.761505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/45d15241345a49e0800af8eb5637b043` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:45.765600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:delete_user(user_id=45d15241345a49e0800af8eb5637b043)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:45.769055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:45.817865 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:45.826890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b9816d24f34f1d9c772fbeec248244'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:45.828663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b9816d24f34f1d9c772fbeec248244'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:45.869996 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=12 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:45.883449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b9816d24f34f1d9c772fbeec248244'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:45.902023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b9816d24f34f1d9c772fbeec248244'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:45.903844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b9816d24f34f1d9c772fbeec248244'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:45.920194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d15241345a49e0800af8eb5637b043'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:45.921514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d15241345a49e0800af8eb5637b043'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:45.935321 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2969/5872] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:45 2022] DELETE /identity/v3/users/d7b9816d24f34f1d9c772fbeec248244 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:45.940790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:45.945739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:45.962389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d15241345a49e0800af8eb5637b043'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:45.992336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d15241345a49e0800af8eb5637b043'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:45.995333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d15241345a49e0800af8eb5637b043'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.032127 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2904/5873] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:45 2022] DELETE /identity/v3/users/45d15241345a49e0800af8eb5637b043 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:46.037107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:46.039904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:46.122148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b60a66-c5a1-4cd0-9005-418768d5f853 tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:46.235124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd96a-5ee6-4737-917a-fed37f3fb624 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:46.243313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:46.244666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:46.245130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:46.245581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects/e44e9215832e47db936f092a01c5d33e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:46.247167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e44e9215832e47db936f092a01c5d33e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:46.249374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:46.275349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6c7e8-0c4b-454b-ab34-bc5a79703eaf tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:46.276752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6c7e8-0c4b-454b-ab34-bc5a79703eaf tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:46.277160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6c7e8-0c4b-454b-ab34-bc5a79703eaf tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:46.277670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6c7e8-0c4b-454b-ab34-bc5a79703eaf tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/domains/c17b66ae9d4c4651a7707708de4e6a79` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:46.279636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6c7e8-0c4b-454b-ab34-bc5a79703eaf tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c17b66ae9d4c4651a7707708de4e6a79)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:46.281516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6c7e8-0c4b-454b-ab34-bc5a79703eaf tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:46.345306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-45a6c7e8-0c4b-454b-ab34-bc5a79703eaf tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c17b66ae9d4c4651a7707708de4e6a79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.348618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-45a6c7e8-0c4b-454b-ab34-bc5a79703eaf tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c17b66ae9d4c4651a7707708de4e6a79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.363373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44e9215832e47db936f092a01c5d33e', 'request_id': 'req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.389956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44e9215832e47db936f092a01c5d33e', 'request_id': 'req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.420510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-45a6c7e8-0c4b-454b-ab34-bc5a79703eaf tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c17b66ae9d4c4651a7707708de4e6a79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.421245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-45a6c7e8-0c4b-454b-ab34-bc5a79703eaf tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c17b66ae9d4c4651a7707708de4e6a79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.422526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44e9215832e47db936f092a01c5d33e', 'request_id': 'req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.431748 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2970/5874] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:27:45 2022] PATCH /identity/v3/domains/c17b66ae9d4c4651a7707708de4e6a79 => generated 277 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:46.436149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6c7e8-0c4b-454b-ab34-bc5a79703eaf tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:46.440308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-45a6c7e8-0c4b-454b-ab34-bc5a79703eaf tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:46.442662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] The token cache is being invalidate because project e44e9215832e47db936f092a01c5d33e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:46.443660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.444652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.452225 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2905/5875] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:46 2022] DELETE /identity/v3/projects/e44e9215832e47db936f092a01c5d33e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:27:46.453422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:46.467985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:46.591626 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:46.602723 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:46.651035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6c7e8-0c4b-454b-ab34-bc5a79703eaf tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:46.664734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffb96b0c4dc4967aa461ef1446ce7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03a9fb06784e4b50b724ae9127a5a3d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:46.666498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:46.669546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:46.670004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] PATH_INFO: `/v3/domains/c17b66ae9d4c4651a7707708de4e6a79` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:46.694807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038a453-cad2-43ce-ac8b-e7cb500a0cbb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:46.700692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c17b66ae9d4c4651a7707708de4e6a79)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:46.703301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:46.744428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c17b66ae9d4c4651a7707708de4e6a79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.767622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c17b66ae9d4c4651a7707708de4e6a79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.825784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fabbd-912f-4e37-9e68-14b16d3ca47b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:46.827679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fabbd-912f-4e37-9e68-14b16d3ca47b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:46.827992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fabbd-912f-4e37-9e68-14b16d3ca47b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:46.829687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fabbd-912f-4e37-9e68-14b16d3ca47b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:46.830381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fabbd-912f-4e37-9e68-14b16d3ca47b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:46.836198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fabbd-912f-4e37-9e68-14b16d3ca47b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:46.859477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c17b66ae9d4c4651a7707708de4e6a79', 'request_id': 'req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.875718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c17b66ae9d4c4651a7707708de4e6a79', 'request_id': 'req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.895947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c17b66ae9d4c4651a7707708de4e6a79', 'request_id': 'req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.927848 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2906/5876] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:46 2022] POST /identity/v3/projects => generated 359 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:46.929156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fabbd-912f-4e37-9e68-14b16d3ca47b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:46.934725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] The token cache is being invalidate because project c17b66ae9d4c4651a7707708de4e6a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:46.935186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.941581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.968304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c17b66ae9d4c4651a7707708de4e6a79', 'request_id': 'req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.969098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c17b66ae9d4c4651a7707708de4e6a79', 'request_id': 'req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:46.969768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c17b66ae9d4c4651a7707708de4e6a79', 'request_id': 'req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:47.001283 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2971/5877] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:27:46 2022] DELETE /identity/v3/domains/c17b66ae9d4c4651a7707708de4e6a79 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:47.007245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:47.018537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:47.167870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fabbd-912f-4e37-9e68-14b16d3ca47b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:47.180908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3646e21-56fb-40c3-bf98-3f5d88b94268 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:47.181827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3646e21-56fb-40c3-bf98-3f5d88b94268 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:47.182330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3646e21-56fb-40c3-bf98-3f5d88b94268 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:47.182823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3646e21-56fb-40c3-bf98-3f5d88b94268 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:47.187426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3646e21-56fb-40c3-bf98-3f5d88b94268 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:47.190997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3646e21-56fb-40c3-bf98-3f5d88b94268 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:47.235976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1954b-eb06-4a7f-9d0b-fe0f0cc102df tempest-GroupsV3TestJSON-1069015915 tempest-GroupsV3TestJSON-1069015915-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:47.309251 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2907/5878] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:46 2022] POST /identity/v3/users => generated 417 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:47.318809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bcdcc-ca55-4ca6-a416-ea10ce49bbcf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:47.318809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bcdcc-ca55-4ca6-a416-ea10ce49bbcf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:47.318809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bcdcc-ca55-4ca6-a416-ea10ce49bbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:47.376965 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:47.401888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-120bcdcc-ca55-4ca6-a416-ea10ce49bbcf None None] MFA Rules not processed for user `f5f42a99ffbe407bb43f8aee0091f130`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:47.406840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-120bcdcc-ca55-4ca6-a416-ea10ce49bbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:47.544293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329092e-84f1-46d3-90d5-2b7d4f9f361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:47.544293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329092e-84f1-46d3-90d5-2b7d4f9f361a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:47.544293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329092e-84f1-46d3-90d5-2b7d4f9f361a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:47.544682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329092e-84f1-46d3-90d5-2b7d4f9f361a admin admin] PATH_INFO: `/v3/users/2d1e456049ad4caea8916e09b8d14b37` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:47.548641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329092e-84f1-46d3-90d5-2b7d4f9f361a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d1e456049ad4caea8916e09b8d14b37)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:47.551253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329092e-84f1-46d3-90d5-2b7d4f9f361a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:47.576750 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:47.667240 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2908/5879] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:47.668319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bcdcc-ca55-4ca6-a416-ea10ce49bbcf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:47.671931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-120bcdcc-ca55-4ca6-a416-ea10ce49bbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:47.736886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bcdcc-ca55-4ca6-a416-ea10ce49bbcf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:47.752566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748c6c9-73cb-4bb4-8402-9adb2588c180 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:47.753330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748c6c9-73cb-4bb4-8402-9adb2588c180 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:47.754066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0329092e-84f1-46d3-90d5-2b7d4f9f361a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d1e456049ad4caea8916e09b8d14b37'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:47.754539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748c6c9-73cb-4bb4-8402-9adb2588c180 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:47.755479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748c6c9-73cb-4bb4-8402-9adb2588c180 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:47.756595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0329092e-84f1-46d3-90d5-2b7d4f9f361a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d1e456049ad4caea8916e09b8d14b37'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:47.758212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748c6c9-73cb-4bb4-8402-9adb2588c180 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:47.765228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748c6c9-73cb-4bb4-8402-9adb2588c180 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:47.792867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0329092e-84f1-46d3-90d5-2b7d4f9f361a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d1e456049ad4caea8916e09b8d14b37'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:47.811416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0329092e-84f1-46d3-90d5-2b7d4f9f361a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d1e456049ad4caea8916e09b8d14b37'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:47.822127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0329092e-84f1-46d3-90d5-2b7d4f9f361a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d1e456049ad4caea8916e09b8d14b37'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:47.843199 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2909/5880] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:27:47 2022] POST /identity/v3/roles => generated 239 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:47.844248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748c6c9-73cb-4bb4-8402-9adb2588c180 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:47.849366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4748c6c9-73cb-4bb4-8402-9adb2588c180 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:47.895987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748c6c9-73cb-4bb4-8402-9adb2588c180 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:47.899945 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2972/5881] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:47 2022] DELETE /identity/v3/users/2d1e456049ad4caea8916e09b8d14b37 => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:47.901682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b730d4a-9038-4f1b-b32c-f232fdcfd266 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:47.901972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b730d4a-9038-4f1b-b32c-f232fdcfd266 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:47.902245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b730d4a-9038-4f1b-b32c-f232fdcfd266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:47.961734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2b730d4a-9038-4f1b-b32c-f232fdcfd266 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:47.963616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2b730d4a-9038-4f1b-b32c-f232fdcfd266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:48.111330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9f8d5-7d0a-4dcb-bafe-2631618ca917 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:48.112417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f8d5-7d0a-4dcb-bafe-2631618ca917 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:48.113030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f8d5-7d0a-4dcb-bafe-2631618ca917 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:48.114657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f8d5-7d0a-4dcb-bafe-2631618ca917 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/38dabe33de8445bf9f6cbf5bc43ab724` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:48.144230 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2973/5882] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:48.156454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9f8d5-7d0a-4dcb-bafe-2631618ca917 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:get_user(user_id=38dabe33de8445bf9f6cbf5bc43ab724)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:48.160747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9f8d5-7d0a-4dcb-bafe-2631618ca917 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:48.165483 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2910/5883] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:27:47 2022] GET /identity/v3/users/38dabe33de8445bf9f6cbf5bc43ab724 => generated 417 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:48.171254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b730d4a-9038-4f1b-b32c-f232fdcfd266 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:48.194697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b730d4a-9038-4f1b-b32c-f232fdcfd266 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:48.210057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd4dc9-b17a-491a-ab7a-6964140b5f28 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:48.211159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd4dc9-b17a-491a-ab7a-6964140b5f28 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:48.211444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd4dc9-b17a-491a-ab7a-6964140b5f28 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:48.211720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd4dc9-b17a-491a-ab7a-6964140b5f28 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/roles/325a44947d544487b635fbe6914946c9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:48.214432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd4dc9-b17a-491a-ab7a-6964140b5f28 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:get_role(role_id=325a44947d544487b635fbe6914946c9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:48.216750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd4dc9-b17a-491a-ab7a-6964140b5f28 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:48.219125 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2974/5884] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:27:48 2022] GET /identity/v3/roles/325a44947d544487b635fbe6914946c9 => generated 239 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:48.222403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9f8d5-7d0a-4dcb-bafe-2631618ca917 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:48.266594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9f8d5-7d0a-4dcb-bafe-2631618ca917 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:48.280451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852fdbc-3fd2-4477-a779-31a6d99b9fa7 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:48.283624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852fdbc-3fd2-4477-a779-31a6d99b9fa7 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:48.284928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852fdbc-3fd2-4477-a779-31a6d99b9fa7 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:48.286401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852fdbc-3fd2-4477-a779-31a6d99b9fa7 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:48.289633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852fdbc-3fd2-4477-a779-31a6d99b9fa7 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:48.312154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852fdbc-3fd2-4477-a779-31a6d99b9fa7 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:48.397486 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2911/5885] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:48 2022] POST /identity/v3/projects => generated 359 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:48.400216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd4dc9-b17a-491a-ab7a-6964140b5f28 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:48.429024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd4dc9-b17a-491a-ab7a-6964140b5f28 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:48.472357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852fdbc-3fd2-4477-a779-31a6d99b9fa7 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:48.478265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f852fdbc-3fd2-4477-a779-31a6d99b9fa7 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:48.573590 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:48.621145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e2e7d-95c4-46be-a545-b366c79f8e3e tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:48.624642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2e7d-95c4-46be-a545-b366c79f8e3e tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:48.624939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2e7d-95c4-46be-a545-b366c79f8e3e tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:48.625214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2e7d-95c4-46be-a545-b366c79f8e3e tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects/945ec92980374457b54b839c089e8fda` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:48.630851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e2e7d-95c4-46be-a545-b366c79f8e3e tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:get_project(project_id=945ec92980374457b54b839c089e8fda)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:48.638750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e2e7d-95c4-46be-a545-b366c79f8e3e tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:48.641138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852fdbc-3fd2-4477-a779-31a6d99b9fa7 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:48.651445 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2975/5886] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:27:48 2022] GET /identity/v3/projects/945ec92980374457b54b839c089e8fda => generated 359 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:48.653077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdbee1-b228-46f3-a3bd-ef75fbbf50d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:48.653883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e2e7d-95c4-46be-a545-b366c79f8e3e tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:48.657664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdbee1-b228-46f3-a3bd-ef75fbbf50d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:48.659729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdbee1-b228-46f3-a3bd-ef75fbbf50d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:48.660023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdbee1-b228-46f3-a3bd-ef75fbbf50d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:48.692413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e2e7d-95c4-46be-a545-b366c79f8e3e tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:48.704894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66735cd9-19b7-4b96-b789-61f79d8ef704 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:48.705581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735cd9-19b7-4b96-b789-61f79d8ef704 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:48.705861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735cd9-19b7-4b96-b789-61f79d8ef704 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:48.706136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735cd9-19b7-4b96-b789-61f79d8ef704 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects/945ec92980374457b54b839c089e8fda/users/38dabe33de8445bf9f6cbf5bc43ab724/roles/325a44947d544487b635fbe6914946c9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:48.721676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66735cd9-19b7-4b96-b789-61f79d8ef704 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:create_grant(project_id=945ec92980374457b54b839c089e8fda, user_id=38dabe33de8445bf9f6cbf5bc43ab724, role_id=325a44947d544487b635fbe6914946c9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:48.731839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66735cd9-19b7-4b96-b789-61f79d8ef704 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:48.797081 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2976/5887] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:48 2022] PUT /identity/v3/projects/945ec92980374457b54b839c089e8fda/users/38dabe33de8445bf9f6cbf5bc43ab724/roles/325a44947d544487b635fbe6914946c9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:48.798841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66735cd9-19b7-4b96-b789-61f79d8ef704 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:48.862978 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:48.866421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdbee1-b228-46f3-a3bd-ef75fbbf50d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:48.868779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdbee1-b228-46f3-a3bd-ef75fbbf50d2 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:48.898826 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2912/5888] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:48.954020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66735cd9-19b7-4b96-b789-61f79d8ef704 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:48.970293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7b358-a154-4b3e-a7b5-44bf2f4c9e8b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:48.970980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7b358-a154-4b3e-a7b5-44bf2f4c9e8b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:48.971236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7b358-a154-4b3e-a7b5-44bf2f4c9e8b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:48.971510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7b358-a154-4b3e-a7b5-44bf2f4c9e8b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:48.972142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7b358-a154-4b3e-a7b5-44bf2f4c9e8b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:48.976963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7b358-a154-4b3e-a7b5-44bf2f4c9e8b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:49.058713 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2977/5889] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:48 2022] POST /identity/v3/projects => generated 358 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:27:49.063339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdbee1-b228-46f3-a3bd-ef75fbbf50d2 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:49.083662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdbee1-b228-46f3-a3bd-ef75fbbf50d2 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:49.224266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db155bfb-62a9-4687-bd5c-dd7cbf03f2cc tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:49.225576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db155bfb-62a9-4687-bd5c-dd7cbf03f2cc tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:49.225874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db155bfb-62a9-4687-bd5c-dd7cbf03f2cc tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:49.226152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db155bfb-62a9-4687-bd5c-dd7cbf03f2cc tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects/556739c45a804e10a1e558a049a5f61c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:49.227531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db155bfb-62a9-4687-bd5c-dd7cbf03f2cc tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:get_project(project_id=556739c45a804e10a1e558a049a5f61c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:49.238770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db155bfb-62a9-4687-bd5c-dd7cbf03f2cc tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:49.244560 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2913/5890] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:27:49 2022] GET /identity/v3/projects/556739c45a804e10a1e558a049a5f61c => generated 358 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:49.245872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7b358-a154-4b3e-a7b5-44bf2f4c9e8b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:49.257729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7b358-a154-4b3e-a7b5-44bf2f4c9e8b tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:49.263006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ee406-a0ed-4377-84cd-f3b72eb9aa67 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:49.263689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ee406-a0ed-4377-84cd-f3b72eb9aa67 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:49.263966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ee406-a0ed-4377-84cd-f3b72eb9aa67 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:49.264240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ee406-a0ed-4377-84cd-f3b72eb9aa67 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects/556739c45a804e10a1e558a049a5f61c/users/38dabe33de8445bf9f6cbf5bc43ab724/roles/325a44947d544487b635fbe6914946c9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:49.266438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ee406-a0ed-4377-84cd-f3b72eb9aa67 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:create_grant(project_id=556739c45a804e10a1e558a049a5f61c, user_id=38dabe33de8445bf9f6cbf5bc43ab724, role_id=325a44947d544487b635fbe6914946c9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:49.274685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ee406-a0ed-4377-84cd-f3b72eb9aa67 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:49.298651 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2978/5891] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:49 2022] PUT /identity/v3/projects/556739c45a804e10a1e558a049a5f61c/users/38dabe33de8445bf9f6cbf5bc43ab724/roles/325a44947d544487b635fbe6914946c9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:49.304078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db155bfb-62a9-4687-bd5c-dd7cbf03f2cc tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:49.316613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db155bfb-62a9-4687-bd5c-dd7cbf03f2cc tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:49.460810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc4ad9-7b5a-48b7-a0dc-a2038eb1b03f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:49.461843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc4ad9-7b5a-48b7-a0dc-a2038eb1b03f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:49.462304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc4ad9-7b5a-48b7-a0dc-a2038eb1b03f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:49.462759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc4ad9-7b5a-48b7-a0dc-a2038eb1b03f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/38dabe33de8445bf9f6cbf5bc43ab724/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:49.464448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc4ad9-7b5a-48b7-a0dc-a2038eb1b03f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=38dabe33de8445bf9f6cbf5bc43ab724)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:49.467258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc4ad9-7b5a-48b7-a0dc-a2038eb1b03f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:49.560471 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2914/5892] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:27:49 2022] GET /identity/v3/users/38dabe33de8445bf9f6cbf5bc43ab724/projects => generated 841 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:49.562426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ee406-a0ed-4377-84cd-f3b72eb9aa67 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:49.576667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ee406-a0ed-4377-84cd-f3b72eb9aa67 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:49.584518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:49.585660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:49.585945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:49.586246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects/556739c45a804e10a1e558a049a5f61c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:49.587587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:delete_project(project_id=556739c45a804e10a1e558a049a5f61c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:49.591248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:49.856130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556739c45a804e10a1e558a049a5f61c', 'request_id': 'req-c6f7ec2f-34a9-4b4a-b848-866418b43894'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:49.868762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556739c45a804e10a1e558a049a5f61c', 'request_id': 'req-c6f7ec2f-34a9-4b4a-b848-866418b43894'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:49.886224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556739c45a804e10a1e558a049a5f61c', 'request_id': 'req-c6f7ec2f-34a9-4b4a-b848-866418b43894'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:49.913603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] The token cache is being invalidate because project 556739c45a804e10a1e558a049a5f61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:49.913902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:49.916350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:49.918950 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2979/5893] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:49 2022] DELETE /identity/v3/projects/556739c45a804e10a1e558a049a5f61c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:49.923072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc4ad9-7b5a-48b7-a0dc-a2038eb1b03f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:49.928516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0efc4ad9-7b5a-48b7-a0dc-a2038eb1b03f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:49.987128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc4ad9-7b5a-48b7-a0dc-a2038eb1b03f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:50.142711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:50.145680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:50.146318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:50.146318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects/945ec92980374457b54b839c089e8fda` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:50.149498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:delete_project(project_id=945ec92980374457b54b839c089e8fda)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:50.155858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:50.194075 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:50.299991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945ec92980374457b54b839c089e8fda', 'request_id': 'req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:50.317685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945ec92980374457b54b839c089e8fda', 'request_id': 'req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:50.347332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945ec92980374457b54b839c089e8fda', 'request_id': 'req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:50.372615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] The token cache is being invalidate because project 945ec92980374457b54b839c089e8fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:50.372907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:50.373922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:50.377100 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2915/5894] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:49 2022] DELETE /identity/v3/projects/945ec92980374457b54b839c089e8fda => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:50.383037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:50.414601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7ec2f-34a9-4b4a-b848-866418b43894 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:50.543481 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:50.609517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9618ca-83e4-4b9c-9066-a9ec01f6f0bb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:50.610173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9618ca-83e4-4b9c-9066-a9ec01f6f0bb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:50.610459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9618ca-83e4-4b9c-9066-a9ec01f6f0bb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:50.610795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9618ca-83e4-4b9c-9066-a9ec01f6f0bb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/roles/325a44947d544487b635fbe6914946c9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:50.620172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9618ca-83e4-4b9c-9066-a9ec01f6f0bb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:delete_role(role_id=325a44947d544487b635fbe6914946c9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:50.621938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9618ca-83e4-4b9c-9066-a9ec01f6f0bb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:50.774181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a9618ca-83e4-4b9c-9066-a9ec01f6f0bb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invalidating the token cache because role 325a44947d544487b635fbe6914946c9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:50.776133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a9618ca-83e4-4b9c-9066-a9ec01f6f0bb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:50.776133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a9618ca-83e4-4b9c-9066-a9ec01f6f0bb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:50.778714 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2980/5895] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:50 2022] DELETE /identity/v3/roles/325a44947d544487b635fbe6914946c9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:50.782428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:50.784338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:50.814677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7847c1-6dc7-4e15-83eb-6a6777f26a08 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:50.829897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9618ca-83e4-4b9c-9066-a9ec01f6f0bb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:50.832180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3a9618ca-83e4-4b9c-9066-a9ec01f6f0bb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:51.021109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:51.025093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:51.027122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:51.027420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/38dabe33de8445bf9f6cbf5bc43ab724` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:51.032771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:delete_user(user_id=38dabe33de8445bf9f6cbf5bc43ab724)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:51.036466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:51.045156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9618ca-83e4-4b9c-9066-a9ec01f6f0bb tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:51.075368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:51.076018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:51.076223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:51.076507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] PATH_INFO: `/v3/projects/3527d31339ee4f4e94e66072eb9bc3e9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:51.080146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3527d31339ee4f4e94e66072eb9bc3e9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:51.082162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:51.155617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38dabe33de8445bf9f6cbf5bc43ab724'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.156932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38dabe33de8445bf9f6cbf5bc43ab724'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.175847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38dabe33de8445bf9f6cbf5bc43ab724'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.190106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38dabe33de8445bf9f6cbf5bc43ab724'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.190875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38dabe33de8445bf9f6cbf5bc43ab724'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.250439 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2916/5896] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:50 2022] DELETE /identity/v3/users/38dabe33de8445bf9f6cbf5bc43ab724 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:51.255840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:51.261839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:51.262730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3527d31339ee4f4e94e66072eb9bc3e9', 'request_id': 'req-805ad33f-c439-40c7-935f-52c9bf4dec6a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.285968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3527d31339ee4f4e94e66072eb9bc3e9', 'request_id': 'req-805ad33f-c439-40c7-935f-52c9bf4dec6a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.291161 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:51.313680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3527d31339ee4f4e94e66072eb9bc3e9', 'request_id': 'req-805ad33f-c439-40c7-935f-52c9bf4dec6a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.347700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] The token cache is being invalidate because project 3527d31339ee4f4e94e66072eb9bc3e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:51.348002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.350730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.361766 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2981/5897] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:50 2022] DELETE /identity/v3/projects/3527d31339ee4f4e94e66072eb9bc3e9 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:27:51.366108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:51.371323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:51.381514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595404b6-83f7-476f-9eb9-f995eb1e53f4 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:51.395298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:51.396223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:51.396519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:51.396794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects/03b2180427d54d138d1d4745c1236071` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:51.398003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:delete_project(project_id=03b2180427d54d138d1d4745c1236071)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:51.400175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:51.481676 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:51.512760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b2180427d54d138d1d4745c1236071', 'request_id': 'req-cb772d82-b33a-4730-b40b-338b244e2f68'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.523644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b2180427d54d138d1d4745c1236071', 'request_id': 'req-cb772d82-b33a-4730-b40b-338b244e2f68'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.539694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b2180427d54d138d1d4745c1236071', 'request_id': 'req-cb772d82-b33a-4730-b40b-338b244e2f68'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.550950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ad33f-c439-40c7-935f-52c9bf4dec6a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:51.563785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] The token cache is being invalidate because project 03b2180427d54d138d1d4745c1236071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:51.565430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.566293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.570827 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2917/5898] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:51 2022] DELETE /identity/v3/projects/03b2180427d54d138d1d4745c1236071 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:51.576741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:51.579004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:51.677875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3172a-b79b-4005-9866-6cc959155314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:51.678530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3172a-b79b-4005-9866-6cc959155314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:51.678814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3172a-b79b-4005-9866-6cc959155314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:51.679115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3172a-b79b-4005-9866-6cc959155314 admin admin] PATH_INFO: `/v3/users/3ffb96b0c4dc4967aa461ef1446ce7fe` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:51.697931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3172a-b79b-4005-9866-6cc959155314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ffb96b0c4dc4967aa461ef1446ce7fe)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:51.700061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3172a-b79b-4005-9866-6cc959155314 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:51.751805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb772d82-b33a-4730-b40b-338b244e2f68 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:51.780871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:51.781838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:51.782217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:51.782590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/8fe5898ce4ab413ba3a1556046fe7688` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:51.784375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:update_user(user_id=8fe5898ce4ab413ba3a1556046fe7688)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:51.785521 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:51.785521 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:27:51.785521 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:27:51.790834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:51.794678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03b3172a-b79b-4005-9866-6cc959155314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ffb96b0c4dc4967aa461ef1446ce7fe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.795615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03b3172a-b79b-4005-9866-6cc959155314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ffb96b0c4dc4967aa461ef1446ce7fe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.812892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03b3172a-b79b-4005-9866-6cc959155314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ffb96b0c4dc4967aa461ef1446ce7fe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.823031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03b3172a-b79b-4005-9866-6cc959155314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ffb96b0c4dc4967aa461ef1446ce7fe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.824350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03b3172a-b79b-4005-9866-6cc959155314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ffb96b0c4dc4967aa461ef1446ce7fe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.846992 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2982/5899] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:51 2022] DELETE /identity/v3/users/3ffb96b0c4dc4967aa461ef1446ce7fe => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:51.872271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8fe5898ce4ab413ba3a1556046fe7688'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.887612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invalidating the token cache because user 8fe5898ce4ab413ba3a1556046fe7688 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:51.888075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.888841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:51.891898 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2918/5900] 10.222.0.39 () {60 vars in 1243 bytes} [Sun Oct 16 01:27:51 2022] PATCH /identity/v3/users/8fe5898ce4ab413ba3a1556046fe7688 => generated 297 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:51.896873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67138199-60eb-4092-83d5-9dfe929aacd3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:51.898634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67138199-60eb-4092-83d5-9dfe929aacd3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:51.899038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67138199-60eb-4092-83d5-9dfe929aacd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:51.951392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-67138199-60eb-4092-83d5-9dfe929aacd3 None None] MFA Rules not processed for user `8fe5898ce4ab413ba3a1556046fe7688`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:51.952779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-67138199-60eb-4092-83d5-9dfe929aacd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:51.959340 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2983/5901] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:51 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 01:27:51.963547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:51.967647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:51.999904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954fea8-802f-4181-8f27-fa8569802f8d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:52.198440 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:52.361371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470997e5-26cd-4e80-8458-a0acf7935410 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:52.362053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470997e5-26cd-4e80-8458-a0acf7935410 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:52.362342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470997e5-26cd-4e80-8458-a0acf7935410 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:52.362617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470997e5-26cd-4e80-8458-a0acf7935410 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/8fe5898ce4ab413ba3a1556046fe7688` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:52.366481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470997e5-26cd-4e80-8458-a0acf7935410 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:update_user(user_id=8fe5898ce4ab413ba3a1556046fe7688)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:52.368367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470997e5-26cd-4e80-8458-a0acf7935410 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:52.481354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-470997e5-26cd-4e80-8458-a0acf7935410 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8fe5898ce4ab413ba3a1556046fe7688'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:52.503334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-470997e5-26cd-4e80-8458-a0acf7935410 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invalidating the token cache because user 8fe5898ce4ab413ba3a1556046fe7688 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:52.503691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-470997e5-26cd-4e80-8458-a0acf7935410 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:52.504320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-470997e5-26cd-4e80-8458-a0acf7935410 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:52.509905 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2919/5902] 10.222.0.39 () {60 vars in 1243 bytes} [Sun Oct 16 01:27:51 2022] PATCH /identity/v3/users/8fe5898ce4ab413ba3a1556046fe7688 => generated 297 bytes in 544 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:27:52.511610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67138199-60eb-4092-83d5-9dfe929aacd3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:52.562308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67138199-60eb-4092-83d5-9dfe929aacd3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:52.585531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:52.586544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:52.586836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:52.593260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/8fe5898ce4ab413ba3a1556046fe7688` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:52.624926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:update_user(user_id=8fe5898ce4ab413ba3a1556046fe7688)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:52.626155 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:27:52.626155 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:27:52.626155 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:27:52.627783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:52.711159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8fe5898ce4ab413ba3a1556046fe7688'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:52.715963 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:52.732041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invalidating the token cache because user 8fe5898ce4ab413ba3a1556046fe7688 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:52.732718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:52.733621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:52.739519 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2984/5903] 10.222.0.39 () {60 vars in 1243 bytes} [Sun Oct 16 01:27:52 2022] PATCH /identity/v3/users/8fe5898ce4ab413ba3a1556046fe7688 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:52.741625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8ea7a-ef94-4c46-b272-3a8f3528a41b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:52.741920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8ea7a-ef94-4c46-b272-3a8f3528a41b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:52.742218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8ea7a-ef94-4c46-b272-3a8f3528a41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:52.839184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fdc8ea7a-ef94-4c46-b272-3a8f3528a41b None None] MFA Rules not processed for user `8fe5898ce4ab413ba3a1556046fe7688`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:52.840406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fdc8ea7a-ef94-4c46-b272-3a8f3528a41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:52.844078 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2920/5904] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:52 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 01:27:52.848166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:52.852791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:52.891614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23c3af-5b81-4ada-b3f6-cfffe41b8667 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:52.904371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74239f5f-eaef-42db-912c-4e74f9f4dbff tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:52.904939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74239f5f-eaef-42db-912c-4e74f9f4dbff tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:52.905225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74239f5f-eaef-42db-912c-4e74f9f4dbff tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:52.905503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74239f5f-eaef-42db-912c-4e74f9f4dbff tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/8fe5898ce4ab413ba3a1556046fe7688` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:52.915791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74239f5f-eaef-42db-912c-4e74f9f4dbff tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:update_user(user_id=8fe5898ce4ab413ba3a1556046fe7688)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:52.921100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74239f5f-eaef-42db-912c-4e74f9f4dbff tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:53.004055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-74239f5f-eaef-42db-912c-4e74f9f4dbff tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8fe5898ce4ab413ba3a1556046fe7688'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:53.053774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-74239f5f-eaef-42db-912c-4e74f9f4dbff tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invalidating the token cache because user 8fe5898ce4ab413ba3a1556046fe7688 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:53.055695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-74239f5f-eaef-42db-912c-4e74f9f4dbff tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:53.059275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-74239f5f-eaef-42db-912c-4e74f9f4dbff tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:53.069852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8ea7a-ef94-4c46-b272-3a8f3528a41b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:53.072582 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2985/5905] 10.222.0.39 () {60 vars in 1243 bytes} [Sun Oct 16 01:27:52 2022] PATCH /identity/v3/users/8fe5898ce4ab413ba3a1556046fe7688 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:53.093135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8ea7a-ef94-4c46-b272-3a8f3528a41b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:53.107728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac3571-c861-4fdc-9d87-3d51e9d57ec2 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:53.108117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac3571-c861-4fdc-9d87-3d51e9d57ec2 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:53.108403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac3571-c861-4fdc-9d87-3d51e9d57ec2 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:53.108678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac3571-c861-4fdc-9d87-3d51e9d57ec2 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:53.109319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac3571-c861-4fdc-9d87-3d51e9d57ec2 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:53.111237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac3571-c861-4fdc-9d87-3d51e9d57ec2 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:53.166146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74239f5f-eaef-42db-912c-4e74f9f4dbff tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:53.168332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-74239f5f-eaef-42db-912c-4e74f9f4dbff tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:53.171006 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2921/5906] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:27:53 2022] POST /identity/v3/users => generated 265 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:53.189475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74239f5f-eaef-42db-912c-4e74f9f4dbff tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:53.201306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd7f59-1ed4-4258-ad75-2e6a9fa17042 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:53.201941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd7f59-1ed4-4258-ad75-2e6a9fa17042 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:53.202236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd7f59-1ed4-4258-ad75-2e6a9fa17042 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:53.202511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd7f59-1ed4-4258-ad75-2e6a9fa17042 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/9c2061106b14443cbba21d3f337d6441/password` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:53.332106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-02cd7f59-1ed4-4258-ad75-2e6a9fa17042 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9c2061106b14443cbba21d3f337d6441'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:53.361576 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2986/5907] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:27:53 2022] POST /identity/v3/users/9c2061106b14443cbba21d3f337d6441/password => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:53.648480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac3571-c861-4fdc-9d87-3d51e9d57ec2 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:53.658754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8bac3571-c861-4fdc-9d87-3d51e9d57ec2 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:53.813570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac3571-c861-4fdc-9d87-3d51e9d57ec2 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:53.819945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa8967-b4ab-4767-b010-9dfae68907bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:53.821284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa8967-b4ab-4767-b010-9dfae68907bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:53.821774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa8967-b4ab-4767-b010-9dfae68907bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:53.828705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa8967-b4ab-4767-b010-9dfae68907bd admin admin] PATH_INFO: `/v3/projects/03a9fb06784e4b50b724ae9127a5a3d9` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:53.831345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa8967-b4ab-4767-b010-9dfae68907bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a9fb06784e4b50b724ae9127a5a3d9)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:53.834620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa8967-b4ab-4767-b010-9dfae68907bd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:53.938060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2daa8967-b4ab-4767-b010-9dfae68907bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a9fb06784e4b50b724ae9127a5a3d9', 'request_id': 'req-2daa8967-b4ab-4767-b010-9dfae68907bd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:53.953928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2daa8967-b4ab-4767-b010-9dfae68907bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a9fb06784e4b50b724ae9127a5a3d9', 'request_id': 'req-2daa8967-b4ab-4767-b010-9dfae68907bd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:53.973097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2daa8967-b4ab-4767-b010-9dfae68907bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a9fb06784e4b50b724ae9127a5a3d9', 'request_id': 'req-2daa8967-b4ab-4767-b010-9dfae68907bd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:53.985552 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:53.999098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2daa8967-b4ab-4767-b010-9dfae68907bd admin admin] The token cache is being invalidate because project 03a9fb06784e4b50b724ae9127a5a3d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:53.999877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2daa8967-b4ab-4767-b010-9dfae68907bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:54.006323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2daa8967-b4ab-4767-b010-9dfae68907bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:54.008843 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2922/5908] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:53 2022] DELETE /identity/v3/projects/03a9fb06784e4b50b724ae9127a5a3d9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:54.014213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833473f-7f52-47c1-96f2-4f286f37cee0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:54.015098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833473f-7f52-47c1-96f2-4f286f37cee0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:54.015573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833473f-7f52-47c1-96f2-4f286f37cee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:54.044493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a833473f-7f52-47c1-96f2-4f286f37cee0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:54.046097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a833473f-7f52-47c1-96f2-4f286f37cee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:54.183006 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2987/5909] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:27:54.183889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926200f-37ec-4071-8862-cd3d36052a54 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:54.184175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926200f-37ec-4071-8862-cd3d36052a54 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:54.184694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926200f-37ec-4071-8862-cd3d36052a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:54.269460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a926200f-37ec-4071-8862-cd3d36052a54 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:54.274943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a926200f-37ec-4071-8862-cd3d36052a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:54.297903 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2923/5910] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:54.302656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833473f-7f52-47c1-96f2-4f286f37cee0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:54.314182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833473f-7f52-47c1-96f2-4f286f37cee0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:54.323937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052f1db-5ac0-4df1-8399-ce3be377bce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:54.324571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052f1db-5ac0-4df1-8399-ce3be377bce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:54.324852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052f1db-5ac0-4df1-8399-ce3be377bce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:54.325123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052f1db-5ac0-4df1-8399-ce3be377bce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:54.326160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052f1db-5ac0-4df1-8399-ce3be377bce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:27:54.326477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052f1db-5ac0-4df1-8399-ce3be377bce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:54.329010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052f1db-5ac0-4df1-8399-ce3be377bce8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:54.349843 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2988/5911] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:54.351561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926200f-37ec-4071-8862-cd3d36052a54 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:54.364624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926200f-37ec-4071-8862-cd3d36052a54 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:54.365552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01cbc9-20b7-46af-aa8b-f93ac2175b63 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:54.365844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01cbc9-20b7-46af-aa8b-f93ac2175b63 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:54.366094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01cbc9-20b7-46af-aa8b-f93ac2175b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:54.376810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788dd0a-2eeb-4f0a-9cb2-d2266027d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:54.378880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788dd0a-2eeb-4f0a-9cb2-d2266027d943 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:54.379330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788dd0a-2eeb-4f0a-9cb2-d2266027d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:54.379916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788dd0a-2eeb-4f0a-9cb2-d2266027d943 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:54.381750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788dd0a-2eeb-4f0a-9cb2-d2266027d943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:54.384869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788dd0a-2eeb-4f0a-9cb2-d2266027d943 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:54.401792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6b01cbc9-20b7-46af-aa8b-f93ac2175b63 None None] MFA Rules not processed for user `9c2061106b14443cbba21d3f337d6441`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:54.403318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6b01cbc9-20b7-46af-aa8b-f93ac2175b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:54.419766 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2989/5912] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:54 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:27:54.423553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01cbc9-20b7-46af-aa8b-f93ac2175b63 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:54.427512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6b01cbc9-20b7-46af-aa8b-f93ac2175b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:54.434934 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2924/5913] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:54 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:54.436009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788dd0a-2eeb-4f0a-9cb2-d2266027d943 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:54.553433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788dd0a-2eeb-4f0a-9cb2-d2266027d943 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:54.570768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da91814-ebfb-47af-b554-9cb1259af7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:54.572050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91814-ebfb-47af-b554-9cb1259af7ec admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:54.572964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91814-ebfb-47af-b554-9cb1259af7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:54.572964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91814-ebfb-47af-b554-9cb1259af7ec admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:54.573812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da91814-ebfb-47af-b554-9cb1259af7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:54.577774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da91814-ebfb-47af-b554-9cb1259af7ec admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:54.580186 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=5,keystone:DELETE=4,keystone:SELECT=89,keystone:UPDATE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:54.612125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01cbc9-20b7-46af-aa8b-f93ac2175b63 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:54.622951 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2925/5914] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:54 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:54.623694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa051769-9144-4786-84f2-2a4f55cf54ed tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:54.624336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa051769-9144-4786-84f2-2a4f55cf54ed tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:54.624621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa051769-9144-4786-84f2-2a4f55cf54ed tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:54.624898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa051769-9144-4786-84f2-2a4f55cf54ed tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:54.627042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da91814-ebfb-47af-b554-9cb1259af7ec admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:54.649528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da91814-ebfb-47af-b554-9cb1259af7ec admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:54.650801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa051769-9144-4786-84f2-2a4f55cf54ed tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:54.652941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa051769-9144-4786-84f2-2a4f55cf54ed tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:54.673146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1034e-62e6-477c-bb52-057ed9699add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:54.673779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1034e-62e6-477c-bb52-057ed9699add admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:54.674062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1034e-62e6-477c-bb52-057ed9699add admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:54.674335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1034e-62e6-477c-bb52-057ed9699add admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:54.675527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1034e-62e6-477c-bb52-057ed9699add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:54.677094 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2990/5915] 10.222.0.39 () {56 vars in 1263 bytes} [Sun Oct 16 01:27:54 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 16 01:27:54.681220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa051769-9144-4786-84f2-2a4f55cf54ed tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:54.682083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1034e-62e6-477c-bb52-057ed9699add admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:54.701216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa051769-9144-4786-84f2-2a4f55cf54ed tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:54.717961 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2926/5916] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:54.718479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:54.718778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1034e-62e6-477c-bb52-057ed9699add admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:54.719161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:54.719445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:54.719723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/9c2061106b14443cbba21d3f337d6441` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:54.733367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9c2061106b14443cbba21d3f337d6441)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:54.735505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:54.739892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1034e-62e6-477c-bb52-057ed9699add admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:54.762608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7a76f-f401-43aa-8e8c-0f5d56584d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:54.762608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7a76f-f401-43aa-8e8c-0f5d56584d51 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:54.762885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7a76f-f401-43aa-8e8c-0f5d56584d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:54.763001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7a76f-f401-43aa-8e8c-0f5d56584d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:54.763619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7a76f-f401-43aa-8e8c-0f5d56584d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:54.765534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7a76f-f401-43aa-8e8c-0f5d56584d51 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:54.812658 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2927/5917] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:27:54.818836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7a76f-f401-43aa-8e8c-0f5d56584d51 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:54.840881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7a76f-f401-43aa-8e8c-0f5d56584d51 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:54.848485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e817ab7-97c0-4c15-ab45-c17f1480d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:54.849326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e817ab7-97c0-4c15-ab45-c17f1480d761 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:54.849761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e817ab7-97c0-4c15-ab45-c17f1480d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:54.850164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e817ab7-97c0-4c15-ab45-c17f1480d761 admin admin] PATH_INFO: `/v3/projects/c0b6a5dcc80a43018a88c2d85ee5a3ae/users/184c136ada00481bad9fafc002b51ec1/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:54.862848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2061106b14443cbba21d3f337d6441'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:54.864295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2061106b14443cbba21d3f337d6441'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:54.888651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e817ab7-97c0-4c15-ab45-c17f1480d761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b6a5dcc80a43018a88c2d85ee5a3ae, user_id=184c136ada00481bad9fafc002b51ec1, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:54.894733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2061106b14443cbba21d3f337d6441'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:54.896968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e817ab7-97c0-4c15-ab45-c17f1480d761 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:54.914119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2061106b14443cbba21d3f337d6441'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:54.915857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2061106b14443cbba21d3f337d6441'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:54.930011 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2928/5918] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:27:54 2022] PUT /identity/v3/projects/c0b6a5dcc80a43018a88c2d85ee5a3ae/users/184c136ada00481bad9fafc002b51ec1/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:54.941131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424165d-a477-44dc-923a-5001436c0308 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:54.941752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424165d-a477-44dc-923a-5001436c0308 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:54.941878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424165d-a477-44dc-923a-5001436c0308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:54.954072 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2991/5919] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:54 2022] DELETE /identity/v3/users/9c2061106b14443cbba21d3f337d6441 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:27:54.958483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:54.963510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:55.023786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a424165d-a477-44dc-923a-5001436c0308 None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:55.025080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a424165d-a477-44dc-923a-5001436c0308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:55.129362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b2825-8f9c-411a-b903-4c1be2d7c9d9 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:55.144948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753cde2-055b-4a00-8eca-81085d32333d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:55.146361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753cde2-055b-4a00-8eca-81085d32333d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:55.146797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753cde2-055b-4a00-8eca-81085d32333d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:55.147258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753cde2-055b-4a00-8eca-81085d32333d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:55.160850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753cde2-055b-4a00-8eca-81085d32333d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:55.162374 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:55.166761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753cde2-055b-4a00-8eca-81085d32333d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:55.176071 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2929/5920] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:55.183266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424165d-a477-44dc-923a-5001436c0308 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:55.230956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424165d-a477-44dc-923a-5001436c0308 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:55.232703 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2992/5921] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:27:54 2022] POST /identity/v3/users => generated 361 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:27:55.236609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753cde2-055b-4a00-8eca-81085d32333d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:55.261902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd9ea7-e617-4107-9c53-d6c9d2afe2bd tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '184c136ada00481bad9fafc002b51ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:55.262602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd9ea7-e617-4107-9c53-d6c9d2afe2bd tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:55.262983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd9ea7-e617-4107-9c53-d6c9d2afe2bd tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:55.263343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd9ea7-e617-4107-9c53-d6c9d2afe2bd tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] PATH_INFO: `/v3/users/184c136ada00481bad9fafc002b51ec1/password` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:55.294031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753cde2-055b-4a00-8eca-81085d32333d tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:55.300182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24323b-186b-48e5-8de8-a8301b33a884 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:55.301122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24323b-186b-48e5-8de8-a8301b33a884 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:55.301656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24323b-186b-48e5-8de8-a8301b33a884 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:55.303428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24323b-186b-48e5-8de8-a8301b33a884 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:55.304409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24323b-186b-48e5-8de8-a8301b33a884 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:55.306816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24323b-186b-48e5-8de8-a8301b33a884 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:55.371502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-45fd9ea7-e617-4107-9c53-d6c9d2afe2bd tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:55.372763 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2993/5922] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:27:55 2022] POST /identity/v3/projects => generated 357 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:27:55.378795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24323b-186b-48e5-8de8-a8301b33a884 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:55.396662 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2930/5923] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:27:55 2022] POST /identity/v3/users/184c136ada00481bad9fafc002b51ec1/password => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:55.448582 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:55.519345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24323b-186b-48e5-8de8-a8301b33a884 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:55.528061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca01dc-d874-4f2f-ae1f-6b6d4b89da83 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:55.528734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca01dc-d874-4f2f-ae1f-6b6d4b89da83 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:55.529101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca01dc-d874-4f2f-ae1f-6b6d4b89da83 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:55.529449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca01dc-d874-4f2f-ae1f-6b6d4b89da83 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/c954526b7eb04e89a36f7e45fbe1cfa7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:55.555277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca01dc-d874-4f2f-ae1f-6b6d4b89da83 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:update_user(user_id=c954526b7eb04e89a36f7e45fbe1cfa7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:55.558024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca01dc-d874-4f2f-ae1f-6b6d4b89da83 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:55.628352 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2994/5924] 10.222.0.39 () {60 vars in 1244 bytes} [Sun Oct 16 01:27:55 2022] PATCH /identity/v3/users/c954526b7eb04e89a36f7e45fbe1cfa7 => generated 522 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:55.633528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd9ea7-e617-4107-9c53-d6c9d2afe2bd tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:55.649468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd9ea7-e617-4107-9c53-d6c9d2afe2bd tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:55.657322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3abcb1-53c5-4fe5-99ac-8a552add110f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:55.658291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3abcb1-53c5-4fe5-99ac-8a552add110f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:55.658808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3abcb1-53c5-4fe5-99ac-8a552add110f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:55.659986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3abcb1-53c5-4fe5-99ac-8a552add110f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/c954526b7eb04e89a36f7e45fbe1cfa7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:55.683468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3abcb1-53c5-4fe5-99ac-8a552add110f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:get_user(user_id=c954526b7eb04e89a36f7e45fbe1cfa7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:55.690450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3abcb1-53c5-4fe5-99ac-8a552add110f tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:55.694043 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2931/5925] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:27:55 2022] GET /identity/v3/users/c954526b7eb04e89a36f7e45fbe1cfa7 => generated 389 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:27:55.698508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca01dc-d874-4f2f-ae1f-6b6d4b89da83 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:55.714728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca01dc-d874-4f2f-ae1f-6b6d4b89da83 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:55.728455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:55.730013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:55.732267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:55.732267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/projects/b173b40941db4a1e83b81f730b13bf66` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:55.734216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b173b40941db4a1e83b81f730b13bf66)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:55.737806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:55.755262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c029f-a262-439b-8c85-ad2154737e8f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:55.755633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c029f-a262-439b-8c85-ad2154737e8f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:55.756100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c029f-a262-439b-8c85-ad2154737e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:55.813653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b56c029f-a262-439b-8c85-ad2154737e8f None None] MFA Rules not processed for user `4d4086e3f9784454a0ccfe87cc54a2b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:55.819439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b56c029f-a262-439b-8c85-ad2154737e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:55.874406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b173b40941db4a1e83b81f730b13bf66', 'request_id': 'req-33cf285e-a500-4852-a83a-a536b3d78e33'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:55.891287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b173b40941db4a1e83b81f730b13bf66', 'request_id': 'req-33cf285e-a500-4852-a83a-a536b3d78e33'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:55.909487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b173b40941db4a1e83b81f730b13bf66', 'request_id': 'req-33cf285e-a500-4852-a83a-a536b3d78e33'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:55.940088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] The token cache is being invalidate because project b173b40941db4a1e83b81f730b13bf66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:55.940382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:55.945801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:55.948098 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2995/5926] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:55 2022] DELETE /identity/v3/projects/b173b40941db4a1e83b81f730b13bf66 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:55.951997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:55.953682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:55.974994 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2932/5927] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:55.988622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc61b6-04cf-42da-b469-14db5e7d822b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:55.989751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc61b6-04cf-42da-b469-14db5e7d822b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:55.990028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc61b6-04cf-42da-b469-14db5e7d822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:56.042225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-14cc61b6-04cf-42da-b469-14db5e7d822b None None] MFA Rules not processed for user `4d4086e3f9784454a0ccfe87cc54a2b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:56.043739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-14cc61b6-04cf-42da-b469-14db5e7d822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:56.074763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf285e-a500-4852-a83a-a536b3d78e33 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:56.089136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be27a05fa334a40b1fd2f7e640c7d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dac34a9eaf4dcd8b9053efac54f372', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:56.089928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:56.090395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:56.090774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] PATH_INFO: `/v3/users/c954526b7eb04e89a36f7e45fbe1cfa7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:56.092658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c954526b7eb04e89a36f7e45fbe1cfa7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:56.097391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:56.148183 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:UPDATE=2,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:56.193462 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2933/5928] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:27:56.207481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc61b6-04cf-42da-b469-14db5e7d822b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:56.209972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-14cc61b6-04cf-42da-b469-14db5e7d822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:56.230106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c954526b7eb04e89a36f7e45fbe1cfa7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:56.231829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c954526b7eb04e89a36f7e45fbe1cfa7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:56.274039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c954526b7eb04e89a36f7e45fbe1cfa7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:56.296389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c954526b7eb04e89a36f7e45fbe1cfa7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:56.298979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c954526b7eb04e89a36f7e45fbe1cfa7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:56.344233 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2996/5929] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:55 2022] DELETE /identity/v3/users/c954526b7eb04e89a36f7e45fbe1cfa7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:27:56.349312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:56.352518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:56.370091 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:56.513324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc61b6-04cf-42da-b469-14db5e7d822b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:56.550298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb2737-8506-45bf-a016-8183df41e049 tempest-UsersV3TestJSON-930483927 tempest-UsersV3TestJSON-930483927-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:56.565890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447ab82-29d6-45ff-8159-bac4cf64bd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:56.566625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447ab82-29d6-45ff-8159-bac4cf64bd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:56.566988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447ab82-29d6-45ff-8159-bac4cf64bd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:56.568745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447ab82-29d6-45ff-8159-bac4cf64bd4f admin admin] PATH_INFO: `/v3/users/8fe5898ce4ab413ba3a1556046fe7688` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:56.600345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447ab82-29d6-45ff-8159-bac4cf64bd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe5898ce4ab413ba3a1556046fe7688)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:56.602423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447ab82-29d6-45ff-8159-bac4cf64bd4f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:56.674246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bef2b1-8608-4f6e-bf23-a3443981c3a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:56.700432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bef2b1-8608-4f6e-bf23-a3443981c3a8 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:56.703423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0447ab82-29d6-45ff-8159-bac4cf64bd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe5898ce4ab413ba3a1556046fe7688'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:56.705215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bef2b1-8608-4f6e-bf23-a3443981c3a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:56.705527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bef2b1-8608-4f6e-bf23-a3443981c3a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:56.705849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0447ab82-29d6-45ff-8159-bac4cf64bd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe5898ce4ab413ba3a1556046fe7688'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:56.719993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a8bef2b1-8608-4f6e-bf23-a3443981c3a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:56.733217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0447ab82-29d6-45ff-8159-bac4cf64bd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe5898ce4ab413ba3a1556046fe7688'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:56.757673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0447ab82-29d6-45ff-8159-bac4cf64bd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe5898ce4ab413ba3a1556046fe7688'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:56.758443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0447ab82-29d6-45ff-8159-bac4cf64bd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe5898ce4ab413ba3a1556046fe7688'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:56.788334 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2997/5930] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:56 2022] DELETE /identity/v3/users/8fe5898ce4ab413ba3a1556046fe7688 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:56.790014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8503bcc-32dd-462b-b7b6-323b6c6566c0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:56.798532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8503bcc-32dd-462b-b7b6-323b6c6566c0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:56.799288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8503bcc-32dd-462b-b7b6-323b6c6566c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:56.887139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a8503bcc-32dd-462b-b7b6-323b6c6566c0 None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:56.892105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a8503bcc-32dd-462b-b7b6-323b6c6566c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:56.893714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bef2b1-8608-4f6e-bf23-a3443981c3a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:56.899207 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2998/5931] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:56 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:27:56.899714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bef2b1-8608-4f6e-bf23-a3443981c3a8 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:56.905754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8503bcc-32dd-462b-b7b6-323b6c6566c0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:56.910876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a8503bcc-32dd-462b-b7b6-323b6c6566c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:56.923078 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2934/5932] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:27:56.925902 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:56.927729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaa152-79fb-4631-90a8-7d396500d77c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:56.928024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaa152-79fb-4631-90a8-7d396500d77c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:56.928304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaa152-79fb-4631-90a8-7d396500d77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:56.969476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-48eaa152-79fb-4631-90a8-7d396500d77c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:56.973028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-48eaa152-79fb-4631-90a8-7d396500d77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:57.121897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8503bcc-32dd-462b-b7b6-323b6c6566c0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:57.134177 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2935/5933] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:57.137822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:57.138476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:57.138754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:57.139051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] PATH_INFO: `/v3/users/2a3dc21fd55c4a3ab04e03b7c4a68685` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:57.139362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e248d4-4856-4da6-83ff-2c24422d1bba None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:57.140526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e248d4-4856-4da6-83ff-2c24422d1bba None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:57.140948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e248d4-4856-4da6-83ff-2c24422d1bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:57.141527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3dc21fd55c4a3ab04e03b7c4a68685)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:57.143854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:57.188690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b9e248d4-4856-4da6-83ff-2c24422d1bba None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:57.193843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b9e248d4-4856-4da6-83ff-2c24422d1bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:57.241214 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:57.276377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3dc21fd55c4a3ab04e03b7c4a68685'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:57.277845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3dc21fd55c4a3ab04e03b7c4a68685'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:57.313223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3dc21fd55c4a3ab04e03b7c4a68685'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:57.325672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3dc21fd55c4a3ab04e03b7c4a68685'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:57.327404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3dc21fd55c4a3ab04e03b7c4a68685'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:57.354026 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2999/5934] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:27:56 2022] DELETE /identity/v3/users/2a3dc21fd55c4a3ab04e03b7c4a68685 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:57.355181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:57.365464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:57.371128 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2936/5935] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:57.372361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74dca1-963a-4b45-af8c-7755341b1cc3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:57.372652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74dca1-963a-4b45-af8c-7755341b1cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:57.372925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74dca1-963a-4b45-af8c-7755341b1cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:57.443508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ba74dca1-963a-4b45-af8c-7755341b1cc3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:57.446366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba74dca1-963a-4b45-af8c-7755341b1cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:57.574565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3c5ac-2f1b-4c50-9bc4-d68c4090557e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:57.591653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c776664-6cf2-4ac6-8ae5-7aa4c3410155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:57.592800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c776664-6cf2-4ac6-8ae5-7aa4c3410155 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:57.593246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c776664-6cf2-4ac6-8ae5-7aa4c3410155 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:57.593541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c776664-6cf2-4ac6-8ae5-7aa4c3410155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:57.597949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c776664-6cf2-4ac6-8ae5-7aa4c3410155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:57.690017 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2937/5936] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:57.691054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74dca1-963a-4b45-af8c-7755341b1cc3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:57.697356 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:57.772995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c776664-6cf2-4ac6-8ae5-7aa4c3410155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:57.774709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c776664-6cf2-4ac6-8ae5-7aa4c3410155 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:57.782142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74dca1-963a-4b45-af8c-7755341b1cc3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:57.788070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e34fa-f3ff-40ef-85fc-fa604dbe2b9d tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '184c136ada00481bad9fafc002b51ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:57.788209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e34fa-f3ff-40ef-85fc-fa604dbe2b9d tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:57.788534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e34fa-f3ff-40ef-85fc-fa604dbe2b9d tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:57.788815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e34fa-f3ff-40ef-85fc-fa604dbe2b9d tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] PATH_INFO: `/v3/users/184c136ada00481bad9fafc002b51ec1/password` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:57.806137 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3000/5937] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:57.812973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c776664-6cf2-4ac6-8ae5-7aa4c3410155 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:57.818560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c776664-6cf2-4ac6-8ae5-7aa4c3410155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:57.851096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c776664-6cf2-4ac6-8ae5-7aa4c3410155 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:57.856617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11326c-8d6b-4dc1-b7ff-bc9d83cbfeae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:57.857248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11326c-8d6b-4dc1-b7ff-bc9d83cbfeae service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:57.857531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11326c-8d6b-4dc1-b7ff-bc9d83cbfeae service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:57.857805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11326c-8d6b-4dc1-b7ff-bc9d83cbfeae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:57.865029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5d11326c-8d6b-4dc1-b7ff-bc9d83cbfeae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:57.873654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-a47e34fa-f3ff-40ef-85fc-fa604dbe2b9d tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 16 01:27:57.873654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:27:57.873654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:27:57.873654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:27:57.873654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:27:57.873654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:27:57.873654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:27:57.873654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:27:57.873654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:27:57.873654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:27:57.873654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:27:57.873654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:27:57.873654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 16 01:27:57.874697 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:27:57.880362 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2938/5938] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:27:57 2022] POST /identity/v3/users/184c136ada00481bad9fafc002b51ec1/password => generated 188 bytes in 189 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 16 01:27:57.881546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e34fa-f3ff-40ef-85fc-fa604dbe2b9d tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:57.888622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11326c-8d6b-4dc1-b7ff-bc9d83cbfeae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:57.890409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11326c-8d6b-4dc1-b7ff-bc9d83cbfeae service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:57.912272 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3001/5939] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:57.913131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11326c-8d6b-4dc1-b7ff-bc9d83cbfeae service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:57.922667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e34fa-f3ff-40ef-85fc-fa604dbe2b9d tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:57.941188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60208b8-bec8-4936-b596-04016ba715b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:57.943292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60208b8-bec8-4936-b596-04016ba715b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:57.943590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60208b8-bec8-4936-b596-04016ba715b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:57.943701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11326c-8d6b-4dc1-b7ff-bc9d83cbfeae service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:57.946175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60208b8-bec8-4936-b596-04016ba715b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:57.953550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b2504-bcac-4b8f-9c98-ee86b565baff tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '184c136ada00481bad9fafc002b51ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:57.955849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b2504-bcac-4b8f-9c98-ee86b565baff tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:57.956155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b2504-bcac-4b8f-9c98-ee86b565baff tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:57.956423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b2504-bcac-4b8f-9c98-ee86b565baff tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] PATH_INFO: `/v3/users/184c136ada00481bad9fafc002b51ec1/password` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:57.979329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60208b8-bec8-4936-b596-04016ba715b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:57.981102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60208b8-bec8-4936-b596-04016ba715b7 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:58.008532 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2939/5940] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:27:58.046899 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-259b2504-bcac-4b8f-9c98-ee86b565baff tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 16 01:27:58.046899 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:27:58.046899 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:27:58.046899 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:27:58.046899 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:27:58.046899 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:27:58.046899 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:27:58.046899 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:27:58.046899 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:27:58.046899 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:27:58.046899 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:27:58.046899 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:27:58.046899 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 16 01:27:58.047864 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:27:58.048786 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3002/5941] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:27:57 2022] POST /identity/v3/users/184c136ada00481bad9fafc002b51ec1/password => generated 188 bytes in 136 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 16 01:27:58.053046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60208b8-bec8-4936-b596-04016ba715b7 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:58.066367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60208b8-bec8-4936-b596-04016ba715b7 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:58.077374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903eb1c-c1a3-4a56-9455-4eec58c30075 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '184c136ada00481bad9fafc002b51ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:58.079154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903eb1c-c1a3-4a56-9455-4eec58c30075 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:58.080561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903eb1c-c1a3-4a56-9455-4eec58c30075 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:58.081386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903eb1c-c1a3-4a56-9455-4eec58c30075 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] PATH_INFO: `/v3/users/184c136ada00481bad9fafc002b51ec1/password` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:58.183830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1903eb1c-c1a3-4a56-9455-4eec58c30075 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:58.210375 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2940/5942] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:27:58 2022] POST /identity/v3/users/184c136ada00481bad9fafc002b51ec1/password => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:59.213926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbb1fa-4daf-4cef-a763-309d8d22120f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:59.214458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbb1fa-4daf-4cef-a763-309d8d22120f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:59.214635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbb1fa-4daf-4cef-a763-309d8d22120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:59.265554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cccbb1fa-4daf-4cef-a763-309d8d22120f None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:59.273615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cccbb1fa-4daf-4cef-a763-309d8d22120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:59.293298 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3003/5943] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:59 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:27:59.298613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fa778-1bdc-4321-bca5-4d9092f9aef3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:59.299489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fa778-1bdc-4321-bca5-4d9092f9aef3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:59.303205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fa778-1bdc-4321-bca5-4d9092f9aef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:59.354228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-917fa778-1bdc-4321-bca5-4d9092f9aef3 None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:59.357037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-917fa778-1bdc-4321-bca5-4d9092f9aef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:59.380346 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2941/5944] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:27:59.383397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbb1fa-4daf-4cef-a763-309d8d22120f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:59.400353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbb1fa-4daf-4cef-a763-309d8d22120f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:59.412201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8c93f-bcf9-448d-bd02-f60e47970d4b tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '184c136ada00481bad9fafc002b51ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:59.414043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8c93f-bcf9-448d-bd02-f60e47970d4b tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:59.415163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8c93f-bcf9-448d-bd02-f60e47970d4b tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:59.415887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8c93f-bcf9-448d-bd02-f60e47970d4b tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] PATH_INFO: `/v3/users/184c136ada00481bad9fafc002b51ec1/password` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:59.458653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fa778-1bdc-4321-bca5-4d9092f9aef3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:59.460265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-917fa778-1bdc-4321-bca5-4d9092f9aef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:59.493488 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:59.507587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fa778-1bdc-4321-bca5-4d9092f9aef3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:59.524115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189b629-2c29-4477-ac88-b1382e0efe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:59.524786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189b629-2c29-4477-ac88-b1382e0efe78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:59.525068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189b629-2c29-4477-ac88-b1382e0efe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:59.525340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189b629-2c29-4477-ac88-b1382e0efe78 admin admin] PATH_INFO: `/v3/projects/12f057e7b6e54f5c87e320fc332f4f5c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:59.526595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189b629-2c29-4477-ac88-b1382e0efe78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f057e7b6e54f5c87e320fc332f4f5c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:59.528593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189b629-2c29-4477-ac88-b1382e0efe78 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:27:59.590264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-15c8c93f-bcf9-448d-bd02-f60e47970d4b tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:59.610954 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3004/5945] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:27:59 2022] POST /identity/v3/users/184c136ada00481bad9fafc002b51ec1/password => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:27:59.626865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8c93f-bcf9-448d-bd02-f60e47970d4b tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:27:59.628924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-15c8c93f-bcf9-448d-bd02-f60e47970d4b tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:59.668698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8c93f-bcf9-448d-bd02-f60e47970d4b tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:27:59.682105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3189b629-2c29-4477-ac88-b1382e0efe78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f057e7b6e54f5c87e320fc332f4f5c', 'request_id': 'req-3189b629-2c29-4477-ac88-b1382e0efe78'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:59.693163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3189b629-2c29-4477-ac88-b1382e0efe78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f057e7b6e54f5c87e320fc332f4f5c', 'request_id': 'req-3189b629-2c29-4477-ac88-b1382e0efe78'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:59.712092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3189b629-2c29-4477-ac88-b1382e0efe78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f057e7b6e54f5c87e320fc332f4f5c', 'request_id': 'req-3189b629-2c29-4477-ac88-b1382e0efe78'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:59.734131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3189b629-2c29-4477-ac88-b1382e0efe78 admin admin] The token cache is being invalidate because project 12f057e7b6e54f5c87e320fc332f4f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:27:59.734466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3189b629-2c29-4477-ac88-b1382e0efe78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:59.736158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3189b629-2c29-4477-ac88-b1382e0efe78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:27:59.745293 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2942/5946] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:59 2022] DELETE /identity/v3/projects/12f057e7b6e54f5c87e320fc332f4f5c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:27:59.749019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1baca4-a8e7-4397-9709-8724f4c08a40 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:59.749316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1baca4-a8e7-4397-9709-8724f4c08a40 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:59.749592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1baca4-a8e7-4397-9709-8724f4c08a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:59.808623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fc1baca4-a8e7-4397-9709-8724f4c08a40 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:27:59.810153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fc1baca4-a8e7-4397-9709-8724f4c08a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:27:59.951219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:27:59.951879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:27:59.952144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:27:59.952417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] PATH_INFO: `/v3/projects/822c159a5914453eafc4add8de032cdb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:27:59.953566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=822c159a5914453eafc4add8de032cdb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:27:59.955535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:00.029975 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:00.039603 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2943/5947] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:00.041182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce3bbc-67b1-4f3c-ab65-b9cca97601ce None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:00.047771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce3bbc-67b1-4f3c-ab65-b9cca97601ce None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:00.048127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce3bbc-67b1-4f3c-ab65-b9cca97601ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:00.057988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822c159a5914453eafc4add8de032cdb', 'request_id': 'req-4666096f-623c-4e8c-b45c-8628a56259f1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:00.067580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822c159a5914453eafc4add8de032cdb', 'request_id': 'req-4666096f-623c-4e8c-b45c-8628a56259f1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:00.093464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-83ce3bbc-67b1-4f3c-ab65-b9cca97601ce None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:00.099821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-83ce3bbc-67b1-4f3c-ab65-b9cca97601ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:00.109066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822c159a5914453eafc4add8de032cdb', 'request_id': 'req-4666096f-623c-4e8c-b45c-8628a56259f1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:00.155263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] The token cache is being invalidate because project 822c159a5914453eafc4add8de032cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:28:00.155831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:00.160326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:00.213391 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3005/5948] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:27:59 2022] DELETE /identity/v3/projects/822c159a5914453eafc4add8de032cdb => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:00.217543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:00.227112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:00.363560 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2944/5949] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:00.368318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce3bbc-67b1-4f3c-ab65-b9cca97601ce None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:00.400165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce3bbc-67b1-4f3c-ab65-b9cca97601ce None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:00.425617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffe690-b986-42a0-aa58-81c914e538a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:00.426255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffe690-b986-42a0-aa58-81c914e538a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:00.429584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffe690-b986-42a0-aa58-81c914e538a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:00.429893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffe690-b986-42a0-aa58-81c914e538a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:00.430588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffe690-b986-42a0-aa58-81c914e538a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:28:00.430904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffe690-b986-42a0-aa58-81c914e538a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:00.435749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffe690-b986-42a0-aa58-81c914e538a1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:00.496003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666096f-623c-4e8c-b45c-8628a56259f1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:00.509021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:00.515297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:00.516427 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2945/5950] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:28:00.516918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:00.517355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffe690-b986-42a0-aa58-81c914e538a1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:00.517811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] PATH_INFO: `/v3/users/2be27a05fa334a40b1fd2f7e640c7d7b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:00.521101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be27a05fa334a40b1fd2f7e640c7d7b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:00.530381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:00.562360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffe690-b986-42a0-aa58-81c914e538a1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:00.585807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5ba8-300c-452f-943c-125c32cc3baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:00.588395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5ba8-300c-452f-943c-125c32cc3baf admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:00.588730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5ba8-300c-452f-943c-125c32cc3baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:00.588973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5ba8-300c-452f-943c-125c32cc3baf admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:00.589678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5ba8-300c-452f-943c-125c32cc3baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:00.591725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5ba8-300c-452f-943c-125c32cc3baf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:00.652397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be27a05fa334a40b1fd2f7e640c7d7b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:00.654538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be27a05fa334a40b1fd2f7e640c7d7b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:00.678285 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:00.684106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be27a05fa334a40b1fd2f7e640c7d7b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:00.701145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be27a05fa334a40b1fd2f7e640c7d7b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:00.702415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be27a05fa334a40b1fd2f7e640c7d7b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:00.716990 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2946/5951] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:28:00 2022] POST /identity/v3/projects => generated 363 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:00.718498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986e4c-0ecc-4fc1-916e-b61aa0bc51e3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:00.720157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986e4c-0ecc-4fc1-916e-b61aa0bc51e3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:00.720517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986e4c-0ecc-4fc1-916e-b61aa0bc51e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:00.731991 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3006/5952] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:28:00 2022] DELETE /identity/v3/users/2be27a05fa334a40b1fd2f7e640c7d7b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:00.742259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:00.744334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:00.820343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a0986e4c-0ecc-4fc1-916e-b61aa0bc51e3 None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:00.821557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a0986e4c-0ecc-4fc1-916e-b61aa0bc51e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:00.829434 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2947/5953] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:00 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:28:00.834983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9cc69-b893-4a70-8107-78aa9db11da2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:00.835461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9cc69-b893-4a70-8107-78aa9db11da2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:00.835895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9cc69-b893-4a70-8107-78aa9db11da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:00.878607 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:00.881028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-eea9cc69-b893-4a70-8107-78aa9db11da2 None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:00.882266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eea9cc69-b893-4a70-8107-78aa9db11da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:00.920579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f92cf-28ba-4041-a74a-b1d87e163cfc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:00.936205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30816f2-8127-42bb-8fe1-89f188f32470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:00.937247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30816f2-8127-42bb-8fe1-89f188f32470 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:00.937841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30816f2-8127-42bb-8fe1-89f188f32470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:00.938269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30816f2-8127-42bb-8fe1-89f188f32470 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:00.939152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30816f2-8127-42bb-8fe1-89f188f32470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:00.941393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30816f2-8127-42bb-8fe1-89f188f32470 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:00.990348 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3007/5954] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:28:00 2022] POST /identity/v3/users => generated 282 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:00.994367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30816f2-8127-42bb-8fe1-89f188f32470 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:01.024133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30816f2-8127-42bb-8fe1-89f188f32470 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:01.032297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44426706-6d1e-4eec-86fa-73163f770dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:01.033074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44426706-6d1e-4eec-86fa-73163f770dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:01.033462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44426706-6d1e-4eec-86fa-73163f770dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:01.033802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44426706-6d1e-4eec-86fa-73163f770dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:01.034535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44426706-6d1e-4eec-86fa-73163f770dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:01.036625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44426706-6d1e-4eec-86fa-73163f770dd9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:01.084119 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2948/5955] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:01.087395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9cc69-b893-4a70-8107-78aa9db11da2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:01.088707 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3008/5956] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:28:01.089665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44426706-6d1e-4eec-86fa-73163f770dd9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:01.124459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44426706-6d1e-4eec-86fa-73163f770dd9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:01.125693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9cc69-b893-4a70-8107-78aa9db11da2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:01.144116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e221bfc-deb2-4bff-ae0a-918c1ab635ce tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '184c136ada00481bad9fafc002b51ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:01.144378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e221bfc-deb2-4bff-ae0a-918c1ab635ce tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:01.144581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e221bfc-deb2-4bff-ae0a-918c1ab635ce tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:01.144857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e221bfc-deb2-4bff-ae0a-918c1ab635ce tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] PATH_INFO: `/v3/users/184c136ada00481bad9fafc002b51ec1/password` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:01.160164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad84ca-75a3-44c4-810d-6affd43d779b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:01.161063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad84ca-75a3-44c4-810d-6affd43d779b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:01.161489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad84ca-75a3-44c4-810d-6affd43d779b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:01.161906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad84ca-75a3-44c4-810d-6affd43d779b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:01.162947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad84ca-75a3-44c4-810d-6affd43d779b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:01.167055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad84ca-75a3-44c4-810d-6affd43d779b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:01.195298 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2949/5957] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:01.196392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad84ca-75a3-44c4-810d-6affd43d779b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:01.225457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad84ca-75a3-44c4-810d-6affd43d779b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:01.232560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729a894-c984-4414-ba56-65c010fc5e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:01.233669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729a894-c984-4414-ba56-65c010fc5e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:01.234094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729a894-c984-4414-ba56-65c010fc5e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:01.234514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729a894-c984-4414-ba56-65c010fc5e8c admin admin] PATH_INFO: `/v3/projects/74be159c6dc54e68b77a221ae988345a/users/b434c2c18a8644b4b9940bd43a9f3d10/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:01.283300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1e221bfc-deb2-4bff-ae0a-918c1ab635ce tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:01.289886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729a894-c984-4414-ba56-65c010fc5e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74be159c6dc54e68b77a221ae988345a, user_id=b434c2c18a8644b4b9940bd43a9f3d10, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:01.300245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729a894-c984-4414-ba56-65c010fc5e8c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:01.306655 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3009/5958] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:28:01 2022] POST /identity/v3/users/184c136ada00481bad9fafc002b51ec1/password => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:01.358658 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2950/5959] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:01 2022] PUT /identity/v3/projects/74be159c6dc54e68b77a221ae988345a/users/b434c2c18a8644b4b9940bd43a9f3d10/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:01.371582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50373f8e-07b2-40f0-91a1-7111bf85791f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:01.371879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50373f8e-07b2-40f0-91a1-7111bf85791f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:01.372153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50373f8e-07b2-40f0-91a1-7111bf85791f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:01.446317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-50373f8e-07b2-40f0-91a1-7111bf85791f None None] MFA Rules not processed for user `b434c2c18a8644b4b9940bd43a9f3d10`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:01.447611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-50373f8e-07b2-40f0-91a1-7111bf85791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:01.631903 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3010/5960] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:01.671332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729a894-c984-4414-ba56-65c010fc5e8c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:01.674215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4729a894-c984-4414-ba56-65c010fc5e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:01.838636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729a894-c984-4414-ba56-65c010fc5e8c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:01.846746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85887f54-2053-4daf-96f7-76e814c62006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:01.850645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887f54-2053-4daf-96f7-76e814c62006 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:01.851642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887f54-2053-4daf-96f7-76e814c62006 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:01.854748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887f54-2053-4daf-96f7-76e814c62006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:01.875922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85887f54-2053-4daf-96f7-76e814c62006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:01.877551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85887f54-2053-4daf-96f7-76e814c62006 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:01.889584 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2951/5961] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:02.312270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1763be-65d1-4741-9b6f-e1b3c189f30a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:02.313192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1763be-65d1-4741-9b6f-e1b3c189f30a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:02.313684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1763be-65d1-4741-9b6f-e1b3c189f30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:02.361302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3e1763be-65d1-4741-9b6f-e1b3c189f30a None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:02.362996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3e1763be-65d1-4741-9b6f-e1b3c189f30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:02.368530 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3011/5962] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:02 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:28:02.374086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458fc2b-5a55-40d7-91e1-3db2bda29b67 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:02.374715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458fc2b-5a55-40d7-91e1-3db2bda29b67 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:02.375291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458fc2b-5a55-40d7-91e1-3db2bda29b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:02.407492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4458fc2b-5a55-40d7-91e1-3db2bda29b67 None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:02.409125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4458fc2b-5a55-40d7-91e1-3db2bda29b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:02.561293 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:02.585836 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2952/5963] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:02.590591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1763be-65d1-4741-9b6f-e1b3c189f30a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:02.634870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1763be-65d1-4741-9b6f-e1b3c189f30a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:02.649146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84e4be-018a-40b1-8a20-558f253eeba7 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '184c136ada00481bad9fafc002b51ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:02.649952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84e4be-018a-40b1-8a20-558f253eeba7 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:02.650445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84e4be-018a-40b1-8a20-558f253eeba7 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:02.650755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84e4be-018a-40b1-8a20-558f253eeba7 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] PATH_INFO: `/v3/users/184c136ada00481bad9fafc002b51ec1/password` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:02.743407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0f84e4be-018a-40b1-8a20-558f253eeba7 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:02.769925 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3012/5964] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:28:02 2022] POST /identity/v3/users/184c136ada00481bad9fafc002b51ec1/password => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:02.912015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458fc2b-5a55-40d7-91e1-3db2bda29b67 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:02.913491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4458fc2b-5a55-40d7-91e1-3db2bda29b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:03.063211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458fc2b-5a55-40d7-91e1-3db2bda29b67 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:03.070744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba30b92-851a-400e-bb88-62af8b41928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:03.071449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba30b92-851a-400e-bb88-62af8b41928a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:03.071729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba30b92-851a-400e-bb88-62af8b41928a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:03.072000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba30b92-851a-400e-bb88-62af8b41928a admin admin] PATH_INFO: `/v3/projects/83dac34a9eaf4dcd8b9053efac54f372` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:03.073742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba30b92-851a-400e-bb88-62af8b41928a admin admin] RBAC: Authorizing `identity:delete_project(project_id=83dac34a9eaf4dcd8b9053efac54f372)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:03.075212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba30b92-851a-400e-bb88-62af8b41928a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:03.176324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2ba30b92-851a-400e-bb88-62af8b41928a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83dac34a9eaf4dcd8b9053efac54f372', 'request_id': 'req-2ba30b92-851a-400e-bb88-62af8b41928a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:03.185527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2ba30b92-851a-400e-bb88-62af8b41928a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83dac34a9eaf4dcd8b9053efac54f372', 'request_id': 'req-2ba30b92-851a-400e-bb88-62af8b41928a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:03.196843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2ba30b92-851a-400e-bb88-62af8b41928a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83dac34a9eaf4dcd8b9053efac54f372', 'request_id': 'req-2ba30b92-851a-400e-bb88-62af8b41928a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:03.214721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2ba30b92-851a-400e-bb88-62af8b41928a admin admin] The token cache is being invalidate because project 83dac34a9eaf4dcd8b9053efac54f372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:28:03.215459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2ba30b92-851a-400e-bb88-62af8b41928a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:03.216310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2ba30b92-851a-400e-bb88-62af8b41928a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:03.218271 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2953/5965] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:28:02 2022] DELETE /identity/v3/projects/83dac34a9eaf4dcd8b9053efac54f372 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:03.225151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663eb1c-b3cf-4865-a6bd-39fb64ab9e74 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:03.225499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663eb1c-b3cf-4865-a6bd-39fb64ab9e74 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:03.225959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663eb1c-b3cf-4865-a6bd-39fb64ab9e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:03.301016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6663eb1c-b3cf-4865-a6bd-39fb64ab9e74 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:03.303038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6663eb1c-b3cf-4865-a6bd-39fb64ab9e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:03.315171 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87,keystone:INSERT=7,keystone:UPDATE=2,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:03.420815 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3013/5966] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:03.429571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42374234-2737-4f8b-823f-1e628d23bd96 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:03.430371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42374234-2737-4f8b-823f-1e628d23bd96 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:03.430960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42374234-2737-4f8b-823f-1e628d23bd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:03.479406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-42374234-2737-4f8b-823f-1e628d23bd96 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:03.482144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-42374234-2737-4f8b-823f-1e628d23bd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:03.498163 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2954/5967] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:03.502518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663eb1c-b3cf-4865-a6bd-39fb64ab9e74 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:03.520900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663eb1c-b3cf-4865-a6bd-39fb64ab9e74 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:03.532629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c69d45-e535-450e-8d38-253ff351af5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:03.533679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c69d45-e535-450e-8d38-253ff351af5a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:03.534120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c69d45-e535-450e-8d38-253ff351af5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:03.534530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c69d45-e535-450e-8d38-253ff351af5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:03.535359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c69d45-e535-450e-8d38-253ff351af5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:28:03.537913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c69d45-e535-450e-8d38-253ff351af5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:03.541626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c69d45-e535-450e-8d38-253ff351af5a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:03.577596 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3014/5968] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:28:03.582000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42374234-2737-4f8b-823f-1e628d23bd96 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:03.596585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42374234-2737-4f8b-823f-1e628d23bd96 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:03.605696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729f1cf-2a30-4434-9288-e8403f881e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:03.606590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729f1cf-2a30-4434-9288-e8403f881e17 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:03.607075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729f1cf-2a30-4434-9288-e8403f881e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:03.607493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729f1cf-2a30-4434-9288-e8403f881e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:03.608627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729f1cf-2a30-4434-9288-e8403f881e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:03.612262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729f1cf-2a30-4434-9288-e8403f881e17 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:03.671239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c69d45-e535-450e-8d38-253ff351af5a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:03.672890 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2955/5969] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:28:03 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:03.690058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c69d45-e535-450e-8d38-253ff351af5a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:03.776482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1b485-94d8-45dc-bbec-b61a348f256b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:03.776824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1b485-94d8-45dc-bbec-b61a348f256b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:03.777290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1b485-94d8-45dc-bbec-b61a348f256b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:03.816277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-82c1b485-94d8-45dc-bbec-b61a348f256b None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:03.817559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-82c1b485-94d8-45dc-bbec-b61a348f256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:03.831765 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2956/5970] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:03 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:28:03.860775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9d321-55f7-49ef-8668-aedfd2d3cd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:03.861572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9d321-55f7-49ef-8668-aedfd2d3cd19 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:03.861927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9d321-55f7-49ef-8668-aedfd2d3cd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:03.862483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9d321-55f7-49ef-8668-aedfd2d3cd19 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:03.863860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9d321-55f7-49ef-8668-aedfd2d3cd19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:03.869584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9d321-55f7-49ef-8668-aedfd2d3cd19 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:03.901694 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3015/5971] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:28:03 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:03.905425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1b485-94d8-45dc-bbec-b61a348f256b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:03.935594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1b485-94d8-45dc-bbec-b61a348f256b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:03.940560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5627c-6515-4128-b8e3-865c43e887a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:03.941581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5627c-6515-4128-b8e3-865c43e887a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:03.942089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5627c-6515-4128-b8e3-865c43e887a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:03.942433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5627c-6515-4128-b8e3-865c43e887a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:03.944781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5627c-6515-4128-b8e3-865c43e887a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:03.946601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5627c-6515-4128-b8e3-865c43e887a9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:03.965562 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2957/5972] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:03.970531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9d321-55f7-49ef-8668-aedfd2d3cd19 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:03.980707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9d321-55f7-49ef-8668-aedfd2d3cd19 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:03.986099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65d8ba-709a-466e-8a51-f4d34fe23c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:03.986714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65d8ba-709a-466e-8a51-f4d34fe23c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:03.987035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65d8ba-709a-466e-8a51-f4d34fe23c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:03.987314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65d8ba-709a-466e-8a51-f4d34fe23c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:03.988205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65d8ba-709a-466e-8a51-f4d34fe23c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:03.990361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65d8ba-709a-466e-8a51-f4d34fe23c71 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:04.011478 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3016/5973] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:04.012590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5627c-6515-4128-b8e3-865c43e887a9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:04.027070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5627c-6515-4128-b8e3-865c43e887a9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:04.034449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4711975-6816-43dc-b4e7-712d9dd39ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:04.035608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4711975-6816-43dc-b4e7-712d9dd39ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:04.036612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4711975-6816-43dc-b4e7-712d9dd39ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:04.037697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4711975-6816-43dc-b4e7-712d9dd39ef0 admin admin] PATH_INFO: `/v3/projects/814c1cdec5344a3eadbfe14e0f1945af/users/f4137805a1d346ae89e8443f87b260b1/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:04.060182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4711975-6816-43dc-b4e7-712d9dd39ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814c1cdec5344a3eadbfe14e0f1945af, user_id=f4137805a1d346ae89e8443f87b260b1, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:04.064435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4711975-6816-43dc-b4e7-712d9dd39ef0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:04.089646 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2958/5974] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:04 2022] PUT /identity/v3/projects/814c1cdec5344a3eadbfe14e0f1945af/users/f4137805a1d346ae89e8443f87b260b1/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:28:04.102934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b081302-1e1b-4db5-b941-f22f2df1dd84 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:04.103232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b081302-1e1b-4db5-b941-f22f2df1dd84 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:04.103761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b081302-1e1b-4db5-b941-f22f2df1dd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:04.157920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9b081302-1e1b-4db5-b941-f22f2df1dd84 None None] MFA Rules not processed for user `f4137805a1d346ae89e8443f87b260b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:04.159473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9b081302-1e1b-4db5-b941-f22f2df1dd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:04.293034 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3017/5975] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:04.313929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4711975-6816-43dc-b4e7-712d9dd39ef0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:04.316465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f4711975-6816-43dc-b4e7-712d9dd39ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:04.345002 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:04.478883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4711975-6816-43dc-b4e7-712d9dd39ef0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:04.484616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79825dc-12b5-4102-afc6-4c4b1f1e133f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:04.485428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79825dc-12b5-4102-afc6-4c4b1f1e133f service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:04.485847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79825dc-12b5-4102-afc6-4c4b1f1e133f service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:04.486286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79825dc-12b5-4102-afc6-4c4b1f1e133f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:04.500049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79825dc-12b5-4102-afc6-4c4b1f1e133f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:04.502807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79825dc-12b5-4102-afc6-4c4b1f1e133f service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:04.516362 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2959/5976] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:04.771897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592026c-a006-4552-ad9d-bc431d0ca7e1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:04.772450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592026c-a006-4552-ad9d-bc431d0ca7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:04.772450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592026c-a006-4552-ad9d-bc431d0ca7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:04.805578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5592026c-a006-4552-ad9d-bc431d0ca7e1 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:04.810393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5592026c-a006-4552-ad9d-bc431d0ca7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:04.821535 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:04.837058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0729c-5d1a-45d5-b5bb-bac187b258e5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:04.837351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0729c-5d1a-45d5-b5bb-bac187b258e5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:04.837627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0729c-5d1a-45d5-b5bb-bac187b258e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:04.873568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-89f0729c-5d1a-45d5-b5bb-bac187b258e5 None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:04.876057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-89f0729c-5d1a-45d5-b5bb-bac187b258e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:04.987192 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2960/5977] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:04.993008 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3018/5978] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:04.994893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846469b1-af1a-4bdd-92a2-37e540f0bf3b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:04.995267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846469b1-af1a-4bdd-92a2-37e540f0bf3b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:04.995554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846469b1-af1a-4bdd-92a2-37e540f0bf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:05.007110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592026c-a006-4552-ad9d-bc431d0ca7e1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:05.010181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5592026c-a006-4552-ad9d-bc431d0ca7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:05.020991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-846469b1-af1a-4bdd-92a2-37e540f0bf3b None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:05.021996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-846469b1-af1a-4bdd-92a2-37e540f0bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:05.026653 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2961/5979] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:04 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:28:05.031567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce3a4a-2661-48b6-a36d-83590f0ca97e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:05.032130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce3a4a-2661-48b6-a36d-83590f0ca97e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:05.032662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce3a4a-2661-48b6-a36d-83590f0ca97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:05.115457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592026c-a006-4552-ad9d-bc431d0ca7e1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:05.132239 n-d-master-1 devstack@keystone.service[81805]: WARNING keystone.server.flask.application [None req-2cce3a4a-2661-48b6-a36d-83590f0ca97e None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 16 01:28:05.138092 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2962/5980] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:05 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 108 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 16 01:28:05.141190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e6c09-5508-41bc-87be-9bb394b6c145 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:05.142853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ba8e1-569e-4092-a6cd-602a96df2431 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:05.143389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6c09-5508-41bc-87be-9bb394b6c145 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:05.144075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6c09-5508-41bc-87be-9bb394b6c145 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:05.144357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6c09-5508-41bc-87be-9bb394b6c145 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:05.146179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ba8e1-569e-4092-a6cd-602a96df2431 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:05.146714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ba8e1-569e-4092-a6cd-602a96df2431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:05.183991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e6c09-5508-41bc-87be-9bb394b6c145 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:05.187557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e6c09-5508-41bc-87be-9bb394b6c145 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:05.227659 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3019/5981] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:28:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:28:05.280623 n-d-master-1 devstack@keystone.service[81805]: WARNING keystone.server.flask.application [None req-3e0ba8e1-569e-4092-a6cd-602a96df2431 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 16 01:28:05.284029 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2963/5982] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:05 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 143 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 16 01:28:05.289212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5e4d6-5840-400b-8351-ef8ab22b220e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:05.289521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5e4d6-5840-400b-8351-ef8ab22b220e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:05.289766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5e4d6-5840-400b-8351-ef8ab22b220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:05.363527 n-d-master-1 devstack@keystone.service[81804]: WARNING keystone.server.flask.application [None req-59a5e4d6-5840-400b-8351-ef8ab22b220e None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 16 01:28:05.371011 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3020/5983] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:05 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 82 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 16 01:28:05.950896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bee5d0-93f9-49f9-bc05-a34488b20256 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:05.951484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bee5d0-93f9-49f9-bc05-a34488b20256 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:05.952278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bee5d0-93f9-49f9-bc05-a34488b20256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:05.984061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-18bee5d0-93f9-49f9-bc05-a34488b20256 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:05.986968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-18bee5d0-93f9-49f9-bc05-a34488b20256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:06.000624 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2964/5984] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:28:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:06.016600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5e4d6-5840-400b-8351-ef8ab22b220e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:06.043749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5e4d6-5840-400b-8351-ef8ab22b220e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:06.064958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe6d5e-2add-4f41-acc5-106d7eecd3c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:06.065595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe6d5e-2add-4f41-acc5-106d7eecd3c2 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:06.065870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe6d5e-2add-4f41-acc5-106d7eecd3c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:06.066143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe6d5e-2add-4f41-acc5-106d7eecd3c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:06.082391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe6d5e-2add-4f41-acc5-106d7eecd3c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:06.084317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe6d5e-2add-4f41-acc5-106d7eecd3c2 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:06.107262 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3021/5985] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:28:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:28:06.729726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709e43c-ec0a-45d2-8fb6-ac43b87edf8e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:06.730277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709e43c-ec0a-45d2-8fb6-ac43b87edf8e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:06.730553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709e43c-ec0a-45d2-8fb6-ac43b87edf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:06.761635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5709e43c-ec0a-45d2-8fb6-ac43b87edf8e None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:06.763026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5709e43c-ec0a-45d2-8fb6-ac43b87edf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:06.794812 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2965/5986] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:28:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:06.795409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe6d5e-2add-4f41-acc5-106d7eecd3c2 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:06.826067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe6d5e-2add-4f41-acc5-106d7eecd3c2 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:06.836790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08782e3f-636a-496c-9726-38929c8b3329 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:06.837439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08782e3f-636a-496c-9726-38929c8b3329 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:06.837809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08782e3f-636a-496c-9726-38929c8b3329 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:06.838155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08782e3f-636a-496c-9726-38929c8b3329 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:06.852028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08782e3f-636a-496c-9726-38929c8b3329 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:06.853767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08782e3f-636a-496c-9726-38929c8b3329 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:06.864889 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3022/5987] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:28:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:28:07.113881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d0a5c-550b-49ac-9033-a854e4c06792 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:07.114549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d0a5c-550b-49ac-9033-a854e4c06792 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:07.115102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d0a5c-550b-49ac-9033-a854e4c06792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:07.143580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-df9d0a5c-550b-49ac-9033-a854e4c06792 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:07.146560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-df9d0a5c-550b-49ac-9033-a854e4c06792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:07.162360 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2966/5988] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:07.176733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08782e3f-636a-496c-9726-38929c8b3329 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:07.193585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08782e3f-636a-496c-9726-38929c8b3329 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:07.209547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b23f7-e61d-4c79-ae4c-cec57fc93c54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:07.210189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b23f7-e61d-4c79-ae4c-cec57fc93c54 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:07.210469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b23f7-e61d-4c79-ae4c-cec57fc93c54 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:07.210971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b23f7-e61d-4c79-ae4c-cec57fc93c54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:07.223244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b23f7-e61d-4c79-ae4c-cec57fc93c54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:07.225519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b23f7-e61d-4c79-ae4c-cec57fc93c54 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:07.237608 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3023/5989] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:28:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:28:07.748883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cccf5-1dc6-455f-8dcc-11ec75e758e6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:07.749490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cccf5-1dc6-455f-8dcc-11ec75e758e6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:07.750329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cccf5-1dc6-455f-8dcc-11ec75e758e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:07.776018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f23cccf5-1dc6-455f-8dcc-11ec75e758e6 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:07.777997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f23cccf5-1dc6-455f-8dcc-11ec75e758e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:07.789633 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2967/5990] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:07.804974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b23f7-e61d-4c79-ae4c-cec57fc93c54 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:07.822702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b23f7-e61d-4c79-ae4c-cec57fc93c54 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:07.831895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f66dca-28bb-4b93-aa20-d4964a496b2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:07.832934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f66dca-28bb-4b93-aa20-d4964a496b2a service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:07.833435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f66dca-28bb-4b93-aa20-d4964a496b2a service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:07.833987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f66dca-28bb-4b93-aa20-d4964a496b2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:07.846625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f66dca-28bb-4b93-aa20-d4964a496b2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:07.849650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f66dca-28bb-4b93-aa20-d4964a496b2a service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:07.862402 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3024/5991] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:28:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:28:08.156586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12d5f-127b-4603-9035-48f8da573ad6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:08.157070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12d5f-127b-4603-9035-48f8da573ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:08.157174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12d5f-127b-4603-9035-48f8da573ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:08.186409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f6a12d5f-127b-4603-9035-48f8da573ad6 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:08.187885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f6a12d5f-127b-4603-9035-48f8da573ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:08.216077 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2968/5992] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:08.230521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f66dca-28bb-4b93-aa20-d4964a496b2a service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:08.253737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f66dca-28bb-4b93-aa20-d4964a496b2a service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:08.263645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18357e-8b66-4c16-aed1-08a5a6d654ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:08.264404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18357e-8b66-4c16-aed1-08a5a6d654ef service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:08.264693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18357e-8b66-4c16-aed1-08a5a6d654ef service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:08.264963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18357e-8b66-4c16-aed1-08a5a6d654ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:08.288472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18357e-8b66-4c16-aed1-08a5a6d654ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:08.290274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18357e-8b66-4c16-aed1-08a5a6d654ef service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:08.307239 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3025/5993] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:28:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:28:08.527381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a12d5f-127b-4603-9035-48f8da573ad6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:08.562896 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:08.619374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a12d5f-127b-4603-9035-48f8da573ad6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:08.628694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:08.631337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:08.632077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:08.632601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] PATH_INFO: `/v3/users/f4137805a1d346ae89e8443f87b260b1` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:08.635188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4137805a1d346ae89e8443f87b260b1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:08.637505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:08.711911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4137805a1d346ae89e8443f87b260b1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:08.712576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4137805a1d346ae89e8443f87b260b1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:08.730704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4137805a1d346ae89e8443f87b260b1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:08.740822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4137805a1d346ae89e8443f87b260b1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:08.741596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4137805a1d346ae89e8443f87b260b1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:08.757751 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2969/5994] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:28:08 2022] DELETE /identity/v3/users/f4137805a1d346ae89e8443f87b260b1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:08.761870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9fd74-ea74-4e3e-a16d-2ef5fcacb5a6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:08.762396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9fd74-ea74-4e3e-a16d-2ef5fcacb5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:08.763115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9fd74-ea74-4e3e-a16d-2ef5fcacb5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:08.789536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3ba9fd74-ea74-4e3e-a16d-2ef5fcacb5a6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:08.791364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3ba9fd74-ea74-4e3e-a16d-2ef5fcacb5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:08.822179 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:08.865798 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3026/5995] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:08.902315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:08.903881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:08.988540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96917cc5-e1c1-43ee-8cfd-1bb866b18ba6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:08.992681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f92628-8675-4dfd-b052-5f79eef7135a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:08.993711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f92628-8675-4dfd-b052-5f79eef7135a service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:08.993711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f92628-8675-4dfd-b052-5f79eef7135a service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:08.993926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f92628-8675-4dfd-b052-5f79eef7135a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:09.004153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f92628-8675-4dfd-b052-5f79eef7135a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:09.006455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f92628-8675-4dfd-b052-5f79eef7135a service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:09.018121 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2970/5996] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:10.054334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9fd74-ea74-4e3e-a16d-2ef5fcacb5a6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:10.055809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3ba9fd74-ea74-4e3e-a16d-2ef5fcacb5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:10.072516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9fd74-ea74-4e3e-a16d-2ef5fcacb5a6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:10.084077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259a2df-5a84-4593-9d1a-7386a50a91dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:10.086063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259a2df-5a84-4593-9d1a-7386a50a91dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:10.086411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259a2df-5a84-4593-9d1a-7386a50a91dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:10.099587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259a2df-5a84-4593-9d1a-7386a50a91dd admin admin] PATH_INFO: `/v3/projects/814c1cdec5344a3eadbfe14e0f1945af` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:10.101599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259a2df-5a84-4593-9d1a-7386a50a91dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=814c1cdec5344a3eadbfe14e0f1945af)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:10.103676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259a2df-5a84-4593-9d1a-7386a50a91dd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:10.225862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b259a2df-5a84-4593-9d1a-7386a50a91dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814c1cdec5344a3eadbfe14e0f1945af', 'request_id': 'req-b259a2df-5a84-4593-9d1a-7386a50a91dd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:10.242776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b259a2df-5a84-4593-9d1a-7386a50a91dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814c1cdec5344a3eadbfe14e0f1945af', 'request_id': 'req-b259a2df-5a84-4593-9d1a-7386a50a91dd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:10.255166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b259a2df-5a84-4593-9d1a-7386a50a91dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814c1cdec5344a3eadbfe14e0f1945af', 'request_id': 'req-b259a2df-5a84-4593-9d1a-7386a50a91dd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:10.273726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b259a2df-5a84-4593-9d1a-7386a50a91dd admin admin] The token cache is being invalidate because project 814c1cdec5344a3eadbfe14e0f1945af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:28:10.274587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b259a2df-5a84-4593-9d1a-7386a50a91dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:10.275686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b259a2df-5a84-4593-9d1a-7386a50a91dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:10.283396 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3027/5997] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:28:10 2022] DELETE /identity/v3/projects/814c1cdec5344a3eadbfe14e0f1945af => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:10.285047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec356e1c-e352-4557-874e-d9db1ce7db61 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:10.285478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec356e1c-e352-4557-874e-d9db1ce7db61 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:10.285478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec356e1c-e352-4557-874e-d9db1ce7db61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:10.330362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ec356e1c-e352-4557-874e-d9db1ce7db61 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:10.336660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ec356e1c-e352-4557-874e-d9db1ce7db61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:10.441085 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:10.503862 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2971/5998] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:10.512993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917578a8-f74a-4834-80d9-25e642a49640 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:10.513288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917578a8-f74a-4834-80d9-25e642a49640 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:10.513547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917578a8-f74a-4834-80d9-25e642a49640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:10.571992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-917578a8-f74a-4834-80d9-25e642a49640 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:10.573378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-917578a8-f74a-4834-80d9-25e642a49640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:10.589650 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3028/5999] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:10.591020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec356e1c-e352-4557-874e-d9db1ce7db61 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:10.602257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec356e1c-e352-4557-874e-d9db1ce7db61 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:10.608355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d4323-361e-438d-914c-b6a458487e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:10.609153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d4323-361e-438d-914c-b6a458487e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:10.609585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d4323-361e-438d-914c-b6a458487e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:10.610000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d4323-361e-438d-914c-b6a458487e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:10.610898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d4323-361e-438d-914c-b6a458487e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:28:10.611511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d4323-361e-438d-914c-b6a458487e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:10.615180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d4323-361e-438d-914c-b6a458487e7f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:10.634852 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2972/6000] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:28:10.636329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917578a8-f74a-4834-80d9-25e642a49640 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:10.676667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917578a8-f74a-4834-80d9-25e642a49640 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:10.683416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbff109-02b9-4380-a700-1942a45225e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:10.684035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbff109-02b9-4380-a700-1942a45225e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:10.684311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbff109-02b9-4380-a700-1942a45225e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:10.684583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbff109-02b9-4380-a700-1942a45225e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:10.685617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbff109-02b9-4380-a700-1942a45225e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:10.688869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbff109-02b9-4380-a700-1942a45225e6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:10.759057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6bbbf-defa-4643-bc4e-9a611557bdde None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:10.759484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6bbbf-defa-4643-bc4e-9a611557bdde None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:10.759883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6bbbf-defa-4643-bc4e-9a611557bdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:10.763696 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3029/6001] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:28:10 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:28:10.768200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbff109-02b9-4380-a700-1942a45225e6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:10.814430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e4e6bbbf-defa-4643-bc4e-9a611557bdde None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:10.816005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e4e6bbbf-defa-4643-bc4e-9a611557bdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:10.883567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbff109-02b9-4380-a700-1942a45225e6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:10.894793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a80962-e690-405e-bbf3-12e6c4e06e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:10.896945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80962-e690-405e-bbf3-12e6c4e06e97 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:10.897694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80962-e690-405e-bbf3-12e6c4e06e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:10.898069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80962-e690-405e-bbf3-12e6c4e06e97 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:10.898940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a80962-e690-405e-bbf3-12e6c4e06e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:10.905595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a80962-e690-405e-bbf3-12e6c4e06e97 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:10.964676 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3030/6002] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:28:10 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:10.969531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a80962-e690-405e-bbf3-12e6c4e06e97 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:10.972616 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2973/6003] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:28:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:28:10.984629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6bbbf-defa-4643-bc4e-9a611557bdde None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:10.986982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e4e6bbbf-defa-4643-bc4e-9a611557bdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:10.990077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a80962-e690-405e-bbf3-12e6c4e06e97 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:11.002651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c53aee-b992-4edc-b73e-6bc43637d070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:11.005880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c53aee-b992-4edc-b73e-6bc43637d070 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:11.006551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c53aee-b992-4edc-b73e-6bc43637d070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:11.007174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c53aee-b992-4edc-b73e-6bc43637d070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:11.009231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c53aee-b992-4edc-b73e-6bc43637d070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:11.015533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c53aee-b992-4edc-b73e-6bc43637d070 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:11.029038 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:11.044454 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3031/6004] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:11.045617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c53aee-b992-4edc-b73e-6bc43637d070 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:11.061332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c53aee-b992-4edc-b73e-6bc43637d070 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:11.069698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca1ed-94a7-42b7-8f22-b29543c756ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:11.071090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca1ed-94a7-42b7-8f22-b29543c756ea admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:11.071519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca1ed-94a7-42b7-8f22-b29543c756ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:11.071973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca1ed-94a7-42b7-8f22-b29543c756ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:11.073437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ca1ed-94a7-42b7-8f22-b29543c756ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:11.075631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ca1ed-94a7-42b7-8f22-b29543c756ea admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:11.090125 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3032/6005] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:11.095278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca1ed-94a7-42b7-8f22-b29543c756ea admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:11.110713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca1ed-94a7-42b7-8f22-b29543c756ea admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:11.119892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6f492-df2b-4322-b0ff-a72e610839b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:11.121176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6f492-df2b-4322-b0ff-a72e610839b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:11.121638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6f492-df2b-4322-b0ff-a72e610839b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:11.122057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6f492-df2b-4322-b0ff-a72e610839b5 admin admin] PATH_INFO: `/v3/projects/31bd93e0bfbe4664b08fb09a1a51e29b/users/043dad0417e242cd9f0e60b5e37a8912/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:11.148774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6bbbf-defa-4643-bc4e-9a611557bdde None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:11.155062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6f492-df2b-4322-b0ff-a72e610839b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bd93e0bfbe4664b08fb09a1a51e29b, user_id=043dad0417e242cd9f0e60b5e37a8912, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:11.159181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6f492-df2b-4322-b0ff-a72e610839b5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:11.161643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b3419-f80c-4826-825b-625b56f9837e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:11.162463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b3419-f80c-4826-825b-625b56f9837e service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:11.163009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b3419-f80c-4826-825b-625b56f9837e service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:11.163461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b3419-f80c-4826-825b-625b56f9837e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:11.178624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b3419-f80c-4826-825b-625b56f9837e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:11.181285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b3419-f80c-4826-825b-625b56f9837e service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:11.184383 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3033/6006] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:11 2022] PUT /identity/v3/projects/31bd93e0bfbe4664b08fb09a1a51e29b/users/043dad0417e242cd9f0e60b5e37a8912/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:11.198949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28ff91-890f-4140-948a-7a3bbfa7830f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:11.199435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28ff91-890f-4140-948a-7a3bbfa7830f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:11.199884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28ff91-890f-4140-948a-7a3bbfa7830f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:11.209002 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2974/6007] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:28:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:28:11.240449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3b28ff91-890f-4140-948a-7a3bbfa7830f None None] MFA Rules not processed for user `043dad0417e242cd9f0e60b5e37a8912`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:11.241906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3b28ff91-890f-4140-948a-7a3bbfa7830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:11.331693 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3034/6008] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:11.342020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b3419-f80c-4826-825b-625b56f9837e service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:11.344646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-989b3419-f80c-4826-825b-625b56f9837e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:11.485563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b3419-f80c-4826-825b-625b56f9837e service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:11.539786 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:11.626136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab878e-b676-47b8-aac5-bc7a2b681cf4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:11.626847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab878e-b676-47b8-aac5-bc7a2b681cf4 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:11.627193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab878e-b676-47b8-aac5-bc7a2b681cf4 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:11.627467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab878e-b676-47b8-aac5-bc7a2b681cf4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:11.641494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab878e-b676-47b8-aac5-bc7a2b681cf4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:11.644027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab878e-b676-47b8-aac5-bc7a2b681cf4 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:11.665260 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2975/6009] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:13.515838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28ff91-890f-4140-948a-7a3bbfa7830f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:13.649133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28ff91-890f-4140-948a-7a3bbfa7830f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:13.660332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:13.660892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:13.668692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:13.668692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] PATH_INFO: `/v3/users/043dad0417e242cd9f0e60b5e37a8912` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:13.668692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=043dad0417e242cd9f0e60b5e37a8912)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:13.668692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:13.749666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043dad0417e242cd9f0e60b5e37a8912'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:13.751399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043dad0417e242cd9f0e60b5e37a8912'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:13.761529 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:13.768420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043dad0417e242cd9f0e60b5e37a8912'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:13.784534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043dad0417e242cd9f0e60b5e37a8912'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:13.787387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043dad0417e242cd9f0e60b5e37a8912'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:13.833127 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3035/6010] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:28:13 2022] DELETE /identity/v3/users/043dad0417e242cd9f0e60b5e37a8912 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:13.835788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a5ac2-f140-4020-8849-e2cb3972923a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:13.836272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a5ac2-f140-4020-8849-e2cb3972923a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:13.836361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a5ac2-f140-4020-8849-e2cb3972923a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:13.885447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-925a5ac2-f140-4020-8849-e2cb3972923a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:13.886691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-925a5ac2-f140-4020-8849-e2cb3972923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:14.059031 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2976/6011] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:14.106338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:14.109719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:14.302974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1030871-6ba5-4b19-9a72-daa8e22b3a93 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:14.315056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c246d50-284e-4739-936b-6d2c73d61984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:14.316311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c246d50-284e-4739-936b-6d2c73d61984 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:14.316311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c246d50-284e-4739-936b-6d2c73d61984 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:14.316311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c246d50-284e-4739-936b-6d2c73d61984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:14.354066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c246d50-284e-4739-936b-6d2c73d61984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:14.355566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c246d50-284e-4739-936b-6d2c73d61984 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:14.395970 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3036/6012] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:15.948794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a5ac2-f140-4020-8849-e2cb3972923a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:15.950335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-925a5ac2-f140-4020-8849-e2cb3972923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:15.966528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a5ac2-f140-4020-8849-e2cb3972923a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:15.973543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c771cca-71e8-4bc8-b880-fb2df153d3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:15.974906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c771cca-71e8-4bc8-b880-fb2df153d3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:15.975395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c771cca-71e8-4bc8-b880-fb2df153d3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:15.975908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c771cca-71e8-4bc8-b880-fb2df153d3e1 admin admin] PATH_INFO: `/v3/projects/31bd93e0bfbe4664b08fb09a1a51e29b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:15.977289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c771cca-71e8-4bc8-b880-fb2df153d3e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31bd93e0bfbe4664b08fb09a1a51e29b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:15.981338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c771cca-71e8-4bc8-b880-fb2df153d3e1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:16.052485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c771cca-71e8-4bc8-b880-fb2df153d3e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31bd93e0bfbe4664b08fb09a1a51e29b', 'request_id': 'req-7c771cca-71e8-4bc8-b880-fb2df153d3e1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:16.064514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c771cca-71e8-4bc8-b880-fb2df153d3e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31bd93e0bfbe4664b08fb09a1a51e29b', 'request_id': 'req-7c771cca-71e8-4bc8-b880-fb2df153d3e1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:16.075276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c771cca-71e8-4bc8-b880-fb2df153d3e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31bd93e0bfbe4664b08fb09a1a51e29b', 'request_id': 'req-7c771cca-71e8-4bc8-b880-fb2df153d3e1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:16.091746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c771cca-71e8-4bc8-b880-fb2df153d3e1 admin admin] The token cache is being invalidate because project 31bd93e0bfbe4664b08fb09a1a51e29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:28:16.092377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c771cca-71e8-4bc8-b880-fb2df153d3e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:16.093272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c771cca-71e8-4bc8-b880-fb2df153d3e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:16.096066 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2977/6013] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:28:15 2022] DELETE /identity/v3/projects/31bd93e0bfbe4664b08fb09a1a51e29b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:16.101764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6d21e-3052-4483-a97b-98223a6cb3be None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:16.102619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6d21e-3052-4483-a97b-98223a6cb3be None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:16.103118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6d21e-3052-4483-a97b-98223a6cb3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:16.131301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-73e6d21e-3052-4483-a97b-98223a6cb3be None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:16.132553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-73e6d21e-3052-4483-a97b-98223a6cb3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:16.208223 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3037/6014] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:28:16.214465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660cbbf-e7e7-4c91-8ddf-fb1d37620f5a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:16.215103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660cbbf-e7e7-4c91-8ddf-fb1d37620f5a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:16.215530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660cbbf-e7e7-4c91-8ddf-fb1d37620f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:16.256060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a660cbbf-e7e7-4c91-8ddf-fb1d37620f5a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:16.257297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a660cbbf-e7e7-4c91-8ddf-fb1d37620f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:16.268429 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2978/6015] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:16.273712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6d21e-3052-4483-a97b-98223a6cb3be None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:16.295104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6d21e-3052-4483-a97b-98223a6cb3be None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:16.315525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f06605-cc96-4a32-9221-4303f7783e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:16.318930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f06605-cc96-4a32-9221-4303f7783e06 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:16.320928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f06605-cc96-4a32-9221-4303f7783e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:16.321213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f06605-cc96-4a32-9221-4303f7783e06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:16.324744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f06605-cc96-4a32-9221-4303f7783e06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:28:16.325008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f06605-cc96-4a32-9221-4303f7783e06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:16.335127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f06605-cc96-4a32-9221-4303f7783e06 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:16.382558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61c8a-cd38-4c1f-9210-8018c5451d0b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:16.382845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61c8a-cd38-4c1f-9210-8018c5451d0b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:16.383147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61c8a-cd38-4c1f-9210-8018c5451d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:16.401119 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3038/6016] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:28:16.405690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f06605-cc96-4a32-9221-4303f7783e06 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:16.442494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f06605-cc96-4a32-9221-4303f7783e06 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:16.466780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068a777-ae12-43f4-aa27-2845d556dbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:16.468758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068a777-ae12-43f4-aa27-2845d556dbac admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:16.469123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068a777-ae12-43f4-aa27-2845d556dbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:16.469523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068a777-ae12-43f4-aa27-2845d556dbac admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:16.471313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068a777-ae12-43f4-aa27-2845d556dbac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:16.483685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068a777-ae12-43f4-aa27-2845d556dbac admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:16.525715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fcc61c8a-cd38-4c1f-9210-8018c5451d0b None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:16.530231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fcc61c8a-cd38-4c1f-9210-8018c5451d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:16.545403 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2979/6017] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:16 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:28:16.549529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc61c8a-cd38-4c1f-9210-8018c5451d0b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:16.553593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fcc61c8a-cd38-4c1f-9210-8018c5451d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:16.586009 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3039/6018] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:28:16 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:16.593044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068a777-ae12-43f4-aa27-2845d556dbac admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:16.629386 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:16.706758 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:16.725290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc61c8a-cd38-4c1f-9210-8018c5451d0b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:16.747250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068a777-ae12-43f4-aa27-2845d556dbac admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:16.761463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7d67f-b127-4b05-a296-d2b802c507b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:16.762088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7d67f-b127-4b05-a296-d2b802c507b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:16.762374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7d67f-b127-4b05-a296-d2b802c507b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:16.762639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7d67f-b127-4b05-a296-d2b802c507b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:16.765162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7d67f-b127-4b05-a296-d2b802c507b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:16.770672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7d67f-b127-4b05-a296-d2b802c507b1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:16.826327 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3040/6019] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:28:16 2022] POST /identity/v3/users => generated 284 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:16.830035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7d67f-b127-4b05-a296-d2b802c507b1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:16.844248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7d67f-b127-4b05-a296-d2b802c507b1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:16.850397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f8f1f-f852-4b9f-8e6e-b9880e7b49d8 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '184c136ada00481bad9fafc002b51ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:16.851060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f8f1f-f852-4b9f-8e6e-b9880e7b49d8 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:16.851345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f8f1f-f852-4b9f-8e6e-b9880e7b49d8 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:16.851623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f8f1f-f852-4b9f-8e6e-b9880e7b49d8 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] PATH_INFO: `/v3/users/184c136ada00481bad9fafc002b51ec1/password` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:16.863593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4380f-a7b0-40e7-bc5f-c1ad6ea3dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:16.866289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4380f-a7b0-40e7-bc5f-c1ad6ea3dd7e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:16.867709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4380f-a7b0-40e7-bc5f-c1ad6ea3dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:16.870189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4380f-a7b0-40e7-bc5f-c1ad6ea3dd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:16.871105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4380f-a7b0-40e7-bc5f-c1ad6ea3dd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:16.875130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4380f-a7b0-40e7-bc5f-c1ad6ea3dd7e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:16.902236 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3041/6020] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:28:16.911498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4380f-a7b0-40e7-bc5f-c1ad6ea3dd7e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:16.917029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0a3f8f1f-f852-4b9f-8e6e-b9880e7b49d8 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:16.938530 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2980/6021] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:28:16 2022] POST /identity/v3/users/184c136ada00481bad9fafc002b51ec1/password => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:28:16.940256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4380f-a7b0-40e7-bc5f-c1ad6ea3dd7e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:16.947291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9124a27-406d-4aa0-a1f5-9bb378e8e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:16.948245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9124a27-406d-4aa0-a1f5-9bb378e8e1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:16.948670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9124a27-406d-4aa0-a1f5-9bb378e8e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:16.949154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9124a27-406d-4aa0-a1f5-9bb378e8e1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:16.950374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9124a27-406d-4aa0-a1f5-9bb378e8e1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:16.952823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9124a27-406d-4aa0-a1f5-9bb378e8e1e4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:16.968087 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3042/6022] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:16.972595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f8f1f-f852-4b9f-8e6e-b9880e7b49d8 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:16.988212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f8f1f-f852-4b9f-8e6e-b9880e7b49d8 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:16.999655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4da713-1f69-4e81-9af8-69004efb68f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:16.999655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4da713-1f69-4e81-9af8-69004efb68f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:16.999655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4da713-1f69-4e81-9af8-69004efb68f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:16.999655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4da713-1f69-4e81-9af8-69004efb68f0 admin admin] PATH_INFO: `/v3/projects/ba74a274b7374063a7d3786272fd793c/users/bcabdc9333b140ce99fbb2c8df572cf2/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:17.022266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4da713-1f69-4e81-9af8-69004efb68f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba74a274b7374063a7d3786272fd793c, user_id=bcabdc9333b140ce99fbb2c8df572cf2, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:17.025404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4da713-1f69-4e81-9af8-69004efb68f0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:17.078982 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2981/6023] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:16 2022] PUT /identity/v3/projects/ba74a274b7374063a7d3786272fd793c/users/bcabdc9333b140ce99fbb2c8df572cf2/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:17.086322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d94a5b-cd3a-4b3a-9483-6912ae46b119 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:17.086874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d94a5b-cd3a-4b3a-9483-6912ae46b119 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:17.087359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d94a5b-cd3a-4b3a-9483-6912ae46b119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:17.159898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-17d94a5b-cd3a-4b3a-9483-6912ae46b119 None None] MFA Rules not processed for user `bcabdc9333b140ce99fbb2c8df572cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:17.161454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-17d94a5b-cd3a-4b3a-9483-6912ae46b119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:17.318150 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3043/6024] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:17.335913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4da713-1f69-4e81-9af8-69004efb68f0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:17.338263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7a4da713-1f69-4e81-9af8-69004efb68f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:17.449970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4da713-1f69-4e81-9af8-69004efb68f0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:17.466851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1100f-1719-4ff8-b050-2daf6ef1b283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:17.467901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1100f-1719-4ff8-b050-2daf6ef1b283 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:17.468535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1100f-1719-4ff8-b050-2daf6ef1b283 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:17.469155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1100f-1719-4ff8-b050-2daf6ef1b283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:17.484775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1100f-1719-4ff8-b050-2daf6ef1b283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:17.487089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1100f-1719-4ff8-b050-2daf6ef1b283 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:17.510779 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2982/6025] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:17.942559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f584-033e-4455-9032-cf6fe3911aad None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:17.942886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f584-033e-4455-9032-cf6fe3911aad None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:17.943267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f584-033e-4455-9032-cf6fe3911aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:18.028681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-02e6f584-033e-4455-9032-cf6fe3911aad None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:18.040463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-02e6f584-033e-4455-9032-cf6fe3911aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:18.052852 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3044/6026] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:17 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:28:18.057673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b611b-3999-4d52-86b0-5d6418e998ee None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:18.058216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b611b-3999-4d52-86b0-5d6418e998ee None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:18.059349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b611b-3999-4d52-86b0-5d6418e998ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:18.211917 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c32b611b-3999-4d52-86b0-5d6418e998ee None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 16 01:28:18.397282 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:28:18.398526 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:28:18.399643 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 16 01:28:18.399643 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 16 01:28:18.399643 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:28:18.399643 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:28:18.399643 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 16 01:28:18.399643 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 16 01:28:18.399643 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:28:18.399643 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:28:18.399643 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 16 01:28:18.399643 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 16 01:28:18.399643 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 16 01:28:18.399643 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:28:18.401475 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2983/6027] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:18 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 01:28:18.403647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeab7a-5f6a-4159-8e2c-926d2adc5b92 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:18.404437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeab7a-5f6a-4159-8e2c-926d2adc5b92 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:18.404861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeab7a-5f6a-4159-8e2c-926d2adc5b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:18.516171 n-d-master-1 devstack@keystone.service[81804]: WARNING keystone.server.flask.application [None req-4dfeab7a-5f6a-4159-8e2c-926d2adc5b92 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 16 01:28:18.522743 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3045/6028] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:18 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 121 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 16 01:28:18.524407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4662-5091-4067-b68a-e4ead7792170 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:18.524694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4662-5091-4067-b68a-e4ead7792170 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:18.525011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4662-5091-4067-b68a-e4ead7792170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:18.641617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9e4b4662-5091-4067-b68a-e4ead7792170 None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:18.650411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9e4b4662-5091-4067-b68a-e4ead7792170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:18.671682 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2984/6029] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:18.675746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfeab7a-5f6a-4159-8e2c-926d2adc5b92 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:18.698358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfeab7a-5f6a-4159-8e2c-926d2adc5b92 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:18.713718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cab3fb-4b11-4320-817d-fc13edade011 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '184c136ada00481bad9fafc002b51ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:18.714285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cab3fb-4b11-4320-817d-fc13edade011 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:18.714570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cab3fb-4b11-4320-817d-fc13edade011 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:18.714846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cab3fb-4b11-4320-817d-fc13edade011 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] PATH_INFO: `/v3/users/184c136ada00481bad9fafc002b51ec1/password` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:18.848171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-66cab3fb-4b11-4320-817d-fc13edade011 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:18.860538 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3046/6030] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:28:18 2022] POST /identity/v3/users/184c136ada00481bad9fafc002b51ec1/password => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:19.866946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654e5a-950d-43a3-967a-19ab3103a3b7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:19.867629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654e5a-950d-43a3-967a-19ab3103a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:19.867629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654e5a-950d-43a3-967a-19ab3103a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:19.908413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ce654e5a-950d-43a3-967a-19ab3103a3b7 None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:19.910498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ce654e5a-950d-43a3-967a-19ab3103a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:19.927258 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2985/6031] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:19 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:28:19.932178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d0ae7-08b4-45f5-9971-29bd9cd871f1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:19.933060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d0ae7-08b4-45f5-9971-29bd9cd871f1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:19.933492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d0ae7-08b4-45f5-9971-29bd9cd871f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:19.994445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9c4d0ae7-08b4-45f5-9971-29bd9cd871f1 None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:20.000156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9c4d0ae7-08b4-45f5-9971-29bd9cd871f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:20.020909 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3047/6032] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:20.025204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce654e5a-950d-43a3-967a-19ab3103a3b7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:20.042310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce654e5a-950d-43a3-967a-19ab3103a3b7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:20.055275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f331e-ed24-4fd9-8d0d-d86c1a437196 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '184c136ada00481bad9fafc002b51ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:20.055945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f331e-ed24-4fd9-8d0d-d86c1a437196 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:20.056228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f331e-ed24-4fd9-8d0d-d86c1a437196 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:20.056507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f331e-ed24-4fd9-8d0d-d86c1a437196 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] PATH_INFO: `/v3/users/184c136ada00481bad9fafc002b51ec1/password` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:20.168400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e9f331e-ed24-4fd9-8d0d-d86c1a437196 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:20.185268 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2986/6033] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:28:20 2022] POST /identity/v3/users/184c136ada00481bad9fafc002b51ec1/password => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:21.190350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58e00-0cac-4978-86ea-500ba70008fb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:21.190995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58e00-0cac-4978-86ea-500ba70008fb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:21.190995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58e00-0cac-4978-86ea-500ba70008fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:21.214391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dac58e00-0cac-4978-86ea-500ba70008fb None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:21.221915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dac58e00-0cac-4978-86ea-500ba70008fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:21.227805 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3048/6034] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:21 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:28:21.232999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8edddf-25c1-4cdb-80eb-4086ccd5f829 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:21.233572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8edddf-25c1-4cdb-80eb-4086ccd5f829 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:21.233572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8edddf-25c1-4cdb-80eb-4086ccd5f829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:21.278300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0e8edddf-25c1-4cdb-80eb-4086ccd5f829 None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:21.320663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0e8edddf-25c1-4cdb-80eb-4086ccd5f829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:21.348021 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2987/6035] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:21.352635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac58e00-0cac-4978-86ea-500ba70008fb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:21.372845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac58e00-0cac-4978-86ea-500ba70008fb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:21.382082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e67a1c-cd96-47d6-9953-9a29fd928ef4 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '184c136ada00481bad9fafc002b51ec1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:21.383222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e67a1c-cd96-47d6-9953-9a29fd928ef4 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:21.383745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e67a1c-cd96-47d6-9953-9a29fd928ef4 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:21.384280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e67a1c-cd96-47d6-9953-9a29fd928ef4 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] PATH_INFO: `/v3/users/184c136ada00481bad9fafc002b51ec1/password` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:21.482147 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:UPDATE=3,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:21.508344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-21e67a1c-cd96-47d6-9953-9a29fd928ef4 tempest-IdentityV3UsersTest-1385588874 tempest-IdentityV3UsersTest-1385588874-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:21.527326 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3049/6036] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Oct 16 01:28:21 2022] POST /identity/v3/users/184c136ada00481bad9fafc002b51ec1/password => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:22.532749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae856b-3fa1-4663-a73d-cf44245d27c4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:22.534499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae856b-3fa1-4663-a73d-cf44245d27c4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:22.534959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae856b-3fa1-4663-a73d-cf44245d27c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:22.605060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c8ae856b-3fa1-4663-a73d-cf44245d27c4 None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:22.609680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c8ae856b-3fa1-4663-a73d-cf44245d27c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:22.628749 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2988/6037] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:22 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:28:23.633760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96269d-0409-4e10-beb0-ffe2da616dec None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:23.634843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96269d-0409-4e10-beb0-ffe2da616dec None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:23.636366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96269d-0409-4e10-beb0-ffe2da616dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:23.669473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ae96269d-0409-4e10-beb0-ffe2da616dec None None] MFA Rules not processed for user `184c136ada00481bad9fafc002b51ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:23.672323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ae96269d-0409-4e10-beb0-ffe2da616dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:23.688579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae856b-3fa1-4663-a73d-cf44245d27c4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:23.690604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c8ae856b-3fa1-4663-a73d-cf44245d27c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:23.693444 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3050/6038] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:23.840522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae856b-3fa1-4663-a73d-cf44245d27c4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:23.853870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:23.854539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:23.854837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:23.857129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] PATH_INFO: `/v3/users/184c136ada00481bad9fafc002b51ec1` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:23.860105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=184c136ada00481bad9fafc002b51ec1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:23.864467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:23.980336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:23.981539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:24.004774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:24.014322 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=84,keystone:UPDATE=2,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:24.027317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:24.029625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '184c136ada00481bad9fafc002b51ec1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:24.075480 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2989/6039] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:28:23 2022] DELETE /identity/v3/users/184c136ada00481bad9fafc002b51ec1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:28:24.079934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad5d6e-5284-47d4-9539-06e5c918e2d6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:24.080469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad5d6e-5284-47d4-9539-06e5c918e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:24.080790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad5d6e-5284-47d4-9539-06e5c918e2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:24.125622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-62ad5d6e-5284-47d4-9539-06e5c918e2d6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:24.127568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-62ad5d6e-5284-47d4-9539-06e5c918e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:24.257374 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3051/6040] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:24.302749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:24.306472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:24.436992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643771a-15e5-4b72-a7ae-933c39d26688 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:24.441194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ba6fd-2bc9-44b4-a27c-2ec69057e700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:24.441935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ba6fd-2bc9-44b4-a27c-2ec69057e700 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:24.442282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ba6fd-2bc9-44b4-a27c-2ec69057e700 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:24.442552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ba6fd-2bc9-44b4-a27c-2ec69057e700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:24.453103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ba6fd-2bc9-44b4-a27c-2ec69057e700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:24.455078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ba6fd-2bc9-44b4-a27c-2ec69057e700 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:24.468185 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2990/6041] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:24.610149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad5d6e-5284-47d4-9539-06e5c918e2d6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:24.612307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-62ad5d6e-5284-47d4-9539-06e5c918e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:24.808014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad5d6e-5284-47d4-9539-06e5c918e2d6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:24.832329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76f967-46cd-4227-9034-c931aa4fae44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:24.832329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76f967-46cd-4227-9034-c931aa4fae44 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:24.832329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76f967-46cd-4227-9034-c931aa4fae44 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:24.832329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76f967-46cd-4227-9034-c931aa4fae44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:24.834882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2d76f967-46cd-4227-9034-c931aa4fae44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:24.859318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76f967-46cd-4227-9034-c931aa4fae44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:24.862397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76f967-46cd-4227-9034-c931aa4fae44 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:24.880250 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3052/6042] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:26.179632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ba6fd-2bc9-44b4-a27c-2ec69057e700 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:26.182293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-603ba6fd-2bc9-44b4-a27c-2ec69057e700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:26.242019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ba6fd-2bc9-44b4-a27c-2ec69057e700 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:26.253464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:26.267715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:26.268181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:26.268554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab admin admin] PATH_INFO: `/v3/projects/c0b6a5dcc80a43018a88c2d85ee5a3ae` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:26.272910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b6a5dcc80a43018a88c2d85ee5a3ae)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:26.275830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:26.385633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'request_id': 'req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:26.394052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'request_id': 'req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:26.420533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b6a5dcc80a43018a88c2d85ee5a3ae', 'request_id': 'req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:26.476743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab admin admin] The token cache is being invalidate because project c0b6a5dcc80a43018a88c2d85ee5a3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:28:26.476743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:26.480286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6736b6f0-ea97-4f3e-bebf-f2730bba1bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:26.488215 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2991/6043] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:28:26 2022] DELETE /identity/v3/projects/c0b6a5dcc80a43018a88c2d85ee5a3ae => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:26.494108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79859-dbc4-42a8-9c80-8e6c5b5b2e8b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:26.495000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79859-dbc4-42a8-9c80-8e6c5b5b2e8b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:26.495442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79859-dbc4-42a8-9c80-8e6c5b5b2e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:26.566299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-35d79859-dbc4-42a8-9c80-8e6c5b5b2e8b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:26.571626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-35d79859-dbc4-42a8-9c80-8e6c5b5b2e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:26.737021 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3053/6044] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:26.745582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef808b81-be81-4be1-8149-dbcd842a5b80 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:26.745954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef808b81-be81-4be1-8149-dbcd842a5b80 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:26.746315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef808b81-be81-4be1-8149-dbcd842a5b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:26.813784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ef808b81-be81-4be1-8149-dbcd842a5b80 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:26.836162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef808b81-be81-4be1-8149-dbcd842a5b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:26.850179 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2992/6045] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:26.859883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d79859-dbc4-42a8-9c80-8e6c5b5b2e8b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:26.865350 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:26.872914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d79859-dbc4-42a8-9c80-8e6c5b5b2e8b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:26.886320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451252a-ba64-4dbf-a5cd-96ed029f08f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:26.887358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451252a-ba64-4dbf-a5cd-96ed029f08f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:26.887871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451252a-ba64-4dbf-a5cd-96ed029f08f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:26.888344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451252a-ba64-4dbf-a5cd-96ed029f08f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:26.889219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451252a-ba64-4dbf-a5cd-96ed029f08f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:28:26.889726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451252a-ba64-4dbf-a5cd-96ed029f08f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:26.891636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451252a-ba64-4dbf-a5cd-96ed029f08f4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:26.905883 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3054/6046] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:28:26.910030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef808b81-be81-4be1-8149-dbcd842a5b80 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:26.921969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef808b81-be81-4be1-8149-dbcd842a5b80 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:26.947971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45445c13-4c0c-4e94-ac32-bf4ed7e9735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:26.949024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45445c13-4c0c-4e94-ac32-bf4ed7e9735c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:26.949835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45445c13-4c0c-4e94-ac32-bf4ed7e9735c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:26.950345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45445c13-4c0c-4e94-ac32-bf4ed7e9735c admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:26.951252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45445c13-4c0c-4e94-ac32-bf4ed7e9735c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:26.954355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45445c13-4c0c-4e94-ac32-bf4ed7e9735c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:27.045259 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2993/6047] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:28:26 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:27.049017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451252a-ba64-4dbf-a5cd-96ed029f08f4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:27.070245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451252a-ba64-4dbf-a5cd-96ed029f08f4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:27.242787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fce1ff-44f2-4970-a8c3-7893f3d5135a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:27.244632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fce1ff-44f2-4970-a8c3-7893f3d5135a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:27.244920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fce1ff-44f2-4970-a8c3-7893f3d5135a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:27.245199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fce1ff-44f2-4970-a8c3-7893f3d5135a admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:27.245859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fce1ff-44f2-4970-a8c3-7893f3d5135a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:27.251379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fce1ff-44f2-4970-a8c3-7893f3d5135a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:27.305002 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3055/6048] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:28:27 2022] POST /identity/v3/users => generated 303 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:28:27.306297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45445c13-4c0c-4e94-ac32-bf4ed7e9735c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:27.322934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45445c13-4c0c-4e94-ac32-bf4ed7e9735c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:27.341846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95978e55-80ef-4522-a393-29f27e65396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:27.344796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978e55-80ef-4522-a393-29f27e65396f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:27.347643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978e55-80ef-4522-a393-29f27e65396f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:27.351676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978e55-80ef-4522-a393-29f27e65396f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:27.352737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95978e55-80ef-4522-a393-29f27e65396f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:27.356985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95978e55-80ef-4522-a393-29f27e65396f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:27.400900 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2994/6049] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:27.402498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fce1ff-44f2-4970-a8c3-7893f3d5135a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:27.421285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fce1ff-44f2-4970-a8c3-7893f3d5135a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:27.448181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef077c6-65ea-47e4-87f8-9a33cba6de50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:27.449782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef077c6-65ea-47e4-87f8-9a33cba6de50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:27.451845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef077c6-65ea-47e4-87f8-9a33cba6de50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:27.458056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef077c6-65ea-47e4-87f8-9a33cba6de50 admin admin] PATH_INFO: `/v3/projects/0a1a788e786c4667a47e4054e91bc126/users/4009213a96c3469c8e1c0cea40a3af3c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:27.561092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef077c6-65ea-47e4-87f8-9a33cba6de50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1a788e786c4667a47e4054e91bc126, user_id=4009213a96c3469c8e1c0cea40a3af3c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:27.563825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef077c6-65ea-47e4-87f8-9a33cba6de50 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:27.606578 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3056/6050] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:27 2022] PUT /identity/v3/projects/0a1a788e786c4667a47e4054e91bc126/users/4009213a96c3469c8e1c0cea40a3af3c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:27.608145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95978e55-80ef-4522-a393-29f27e65396f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:27.625817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95978e55-80ef-4522-a393-29f27e65396f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:27.700035 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:27.779840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496d0a2-7c4c-4048-9bb9-6830686599e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:27.780525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496d0a2-7c4c-4048-9bb9-6830686599e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:27.780948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496d0a2-7c4c-4048-9bb9-6830686599e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:27.781290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496d0a2-7c4c-4048-9bb9-6830686599e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:27.781987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496d0a2-7c4c-4048-9bb9-6830686599e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:27.783949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496d0a2-7c4c-4048-9bb9-6830686599e9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:27.828391 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2995/6051] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:27.829927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef077c6-65ea-47e4-87f8-9a33cba6de50 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:27.846847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef077c6-65ea-47e4-87f8-9a33cba6de50 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:27.862598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba58e0-3fce-422a-aa58-b3830a2533a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:27.864068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba58e0-3fce-422a-aa58-b3830a2533a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:27.864607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba58e0-3fce-422a-aa58-b3830a2533a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:27.865143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba58e0-3fce-422a-aa58-b3830a2533a8 admin admin] PATH_INFO: `/v3/projects/0a1a788e786c4667a47e4054e91bc126/users/4009213a96c3469c8e1c0cea40a3af3c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:27.872174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba58e0-3fce-422a-aa58-b3830a2533a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1a788e786c4667a47e4054e91bc126, user_id=4009213a96c3469c8e1c0cea40a3af3c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:27.893593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba58e0-3fce-422a-aa58-b3830a2533a8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:27.920444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496d0a2-7c4c-4048-9bb9-6830686599e9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:27.921827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2496d0a2-7c4c-4048-9bb9-6830686599e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:27.947931 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3057/6052] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:27 2022] PUT /identity/v3/projects/0a1a788e786c4667a47e4054e91bc126/users/4009213a96c3469c8e1c0cea40a3af3c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:27.949563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9372491-ad6e-443c-b722-2d5e5da7a441 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:27.949855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9372491-ad6e-443c-b722-2d5e5da7a441 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:27.950129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9372491-ad6e-443c-b722-2d5e5da7a441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:28.070897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b9372491-ad6e-443c-b722-2d5e5da7a441 None None] MFA Rules not processed for user `4009213a96c3469c8e1c0cea40a3af3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:28.073901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b9372491-ad6e-443c-b722-2d5e5da7a441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:28.108513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496d0a2-7c4c-4048-9bb9-6830686599e9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:28.283298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4511c6-ca76-4fe8-9ab8-bb05deef9ebe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:28.285192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4511c6-ca76-4fe8-9ab8-bb05deef9ebe service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:28.285997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4511c6-ca76-4fe8-9ab8-bb05deef9ebe service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:28.286279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4511c6-ca76-4fe8-9ab8-bb05deef9ebe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:28.294204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3f4511c6-ca76-4fe8-9ab8-bb05deef9ebe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:28.294624 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3058/6053] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:28.300891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9372491-ad6e-443c-b722-2d5e5da7a441 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:28.322674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4511c6-ca76-4fe8-9ab8-bb05deef9ebe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:28.324575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4511c6-ca76-4fe8-9ab8-bb05deef9ebe service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:28.341839 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2996/6054] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:28.375062 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:28.447998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9372491-ad6e-443c-b722-2d5e5da7a441 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:28.453927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afc91d-b412-4873-978b-b828783b0ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:28.454555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afc91d-b412-4873-978b-b828783b0ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:28.454830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afc91d-b412-4873-978b-b828783b0ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:28.455217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afc91d-b412-4873-978b-b828783b0ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:28.455750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afc91d-b412-4873-978b-b828783b0ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:28.457914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afc91d-b412-4873-978b-b828783b0ee0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:28.522567 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3059/6055] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:28:28 2022] POST /identity/v3/projects => generated 391 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:28.526402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4511c6-ca76-4fe8-9ab8-bb05deef9ebe service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:28.541199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4511c6-ca76-4fe8-9ab8-bb05deef9ebe service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:28.687341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627cdf9-b6f9-400d-b20f-58a0ed1ea9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:28.688248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627cdf9-b6f9-400d-b20f-58a0ed1ea9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:28.688717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627cdf9-b6f9-400d-b20f-58a0ed1ea9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:28.689827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627cdf9-b6f9-400d-b20f-58a0ed1ea9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:28.690625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627cdf9-b6f9-400d-b20f-58a0ed1ea9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:28.696295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627cdf9-b6f9-400d-b20f-58a0ed1ea9e8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:28.707922 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:28.744902 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2997/6056] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:28:28 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:28.747774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afc91d-b412-4873-978b-b828783b0ee0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:28.764626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afc91d-b412-4873-978b-b828783b0ee0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:28.782318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c91a4-a0ec-4d56-b3da-ce9a120e5932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:28.783029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c91a4-a0ec-4d56-b3da-ce9a120e5932 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:28.783256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c91a4-a0ec-4d56-b3da-ce9a120e5932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:28.783725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c91a4-a0ec-4d56-b3da-ce9a120e5932 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:28.784588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c91a4-a0ec-4d56-b3da-ce9a120e5932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:28.788073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c91a4-a0ec-4d56-b3da-ce9a120e5932 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:28.820416 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3060/6057] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:28.821913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627cdf9-b6f9-400d-b20f-58a0ed1ea9e8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:28.837952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627cdf9-b6f9-400d-b20f-58a0ed1ea9e8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:28.852969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932787d-82e4-4ced-96cd-bec8d184d6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:28.853768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932787d-82e4-4ced-96cd-bec8d184d6ed admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:28.854047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932787d-82e4-4ced-96cd-bec8d184d6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:28.854318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932787d-82e4-4ced-96cd-bec8d184d6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:28.855002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932787d-82e4-4ced-96cd-bec8d184d6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:28.857349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932787d-82e4-4ced-96cd-bec8d184d6ed admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:28.886605 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2998/6058] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:28.887733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c91a4-a0ec-4d56-b3da-ce9a120e5932 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:28.908045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c91a4-a0ec-4d56-b3da-ce9a120e5932 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:28.920494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393c42e-b6a3-4e88-b75e-1ec5a9b22cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:28.921285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c42e-b6a3-4e88-b75e-1ec5a9b22cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:28.921570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c42e-b6a3-4e88-b75e-1ec5a9b22cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:28.921844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c42e-b6a3-4e88-b75e-1ec5a9b22cc4 admin admin] PATH_INFO: `/v3/projects/669130c5d0f2477d953135a974eaaaa4/users/b86833b59ce74ac59d6d22689e9f2c97/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:28.949065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393c42e-b6a3-4e88-b75e-1ec5a9b22cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=669130c5d0f2477d953135a974eaaaa4, user_id=b86833b59ce74ac59d6d22689e9f2c97, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:28.953258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393c42e-b6a3-4e88-b75e-1ec5a9b22cc4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:28.978950 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3061/6059] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:28 2022] PUT /identity/v3/projects/669130c5d0f2477d953135a974eaaaa4/users/b86833b59ce74ac59d6d22689e9f2c97/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:28.993097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20a520-8382-470a-8142-5b092b83bf36 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:28.993431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20a520-8382-470a-8142-5b092b83bf36 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:28.993700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20a520-8382-470a-8142-5b092b83bf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:29.029932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cc20a520-8382-470a-8142-5b092b83bf36 None None] MFA Rules not processed for user `b86833b59ce74ac59d6d22689e9f2c97`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:29.031309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cc20a520-8382-470a-8142-5b092b83bf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:29.154007 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2999/6060] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:29.167131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393c42e-b6a3-4e88-b75e-1ec5a9b22cc4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:29.169482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d393c42e-b6a3-4e88-b75e-1ec5a9b22cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:29.359591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393c42e-b6a3-4e88-b75e-1ec5a9b22cc4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:29.381537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b27141-fa7f-4c83-9339-ad43644ce8d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:29.382176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b27141-fa7f-4c83-9339-ad43644ce8d0 service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:29.382639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b27141-fa7f-4c83-9339-ad43644ce8d0 service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:29.383101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b27141-fa7f-4c83-9339-ad43644ce8d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:29.514892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b27141-fa7f-4c83-9339-ad43644ce8d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:29.516913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b27141-fa7f-4c83-9339-ad43644ce8d0 service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:29.533456 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3062/6061] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:29 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:31.133474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20a520-8382-470a-8142-5b092b83bf36 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:31.272763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20a520-8382-470a-8142-5b092b83bf36 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:31.278680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:31.281426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:31.281716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:31.282006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] PATH_INFO: `/v3/users/4009213a96c3469c8e1c0cea40a3af3c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:31.283915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4009213a96c3469c8e1c0cea40a3af3c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:31.286130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:31.370854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4009213a96c3469c8e1c0cea40a3af3c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:31.371606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4009213a96c3469c8e1c0cea40a3af3c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:31.387155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4009213a96c3469c8e1c0cea40a3af3c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:31.391768 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:31.402665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4009213a96c3469c8e1c0cea40a3af3c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:31.405556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4009213a96c3469c8e1c0cea40a3af3c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:31.432964 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3000/6062] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:28:31 2022] DELETE /identity/v3/users/4009213a96c3469c8e1c0cea40a3af3c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:31.438019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea313b67-a86a-4eb7-9468-82d8c2ba820f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:31.438461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea313b67-a86a-4eb7-9468-82d8c2ba820f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:31.438757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea313b67-a86a-4eb7-9468-82d8c2ba820f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:31.468690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ea313b67-a86a-4eb7-9468-82d8c2ba820f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:31.470359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ea313b67-a86a-4eb7-9468-82d8c2ba820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:31.502901 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:31.592354 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3063/6063] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:31.610523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:31.612146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:31.741330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff218287-d4c9-48af-9ac8-333f4274b895 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:31.749789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd9f6e-f91d-40be-b7a9-2aafbfda1cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:31.750622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd9f6e-f91d-40be-b7a9-2aafbfda1cbc service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:31.750990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd9f6e-f91d-40be-b7a9-2aafbfda1cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:31.751471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd9f6e-f91d-40be-b7a9-2aafbfda1cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:31.773395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd9f6e-f91d-40be-b7a9-2aafbfda1cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:31.776207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd9f6e-f91d-40be-b7a9-2aafbfda1cbc service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:31.804064 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3001/6064] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:32.565858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea313b67-a86a-4eb7-9468-82d8c2ba820f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:32.567968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ea313b67-a86a-4eb7-9468-82d8c2ba820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:32.592552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea313b67-a86a-4eb7-9468-82d8c2ba820f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:32.609371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:32.610028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:32.610312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:32.610584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] PATH_INFO: `/v3/projects/0a1a788e786c4667a47e4054e91bc126` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:32.614207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1a788e786c4667a47e4054e91bc126)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:32.616199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:32.787024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1a788e786c4667a47e4054e91bc126', 'request_id': 'req-18870f55-98ff-4181-ad6d-52ef51b79fa6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:32.813173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1a788e786c4667a47e4054e91bc126', 'request_id': 'req-18870f55-98ff-4181-ad6d-52ef51b79fa6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:32.827625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1a788e786c4667a47e4054e91bc126', 'request_id': 'req-18870f55-98ff-4181-ad6d-52ef51b79fa6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:32.868435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] The token cache is being invalidate because project 0a1a788e786c4667a47e4054e91bc126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:28:32.868964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:32.870125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:32.872323 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3064/6065] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:28:32 2022] DELETE /identity/v3/projects/0a1a788e786c4667a47e4054e91bc126 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:32.876574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd9f6e-f91d-40be-b7a9-2aafbfda1cbc service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:32.890312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd9f6e-f91d-40be-b7a9-2aafbfda1cbc service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:33.028624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb53f3-4785-4c33-95e4-a37da9650740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:33.029373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb53f3-4785-4c33-95e4-a37da9650740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:33.031222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb53f3-4785-4c33-95e4-a37da9650740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:33.033335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb53f3-4785-4c33-95e4-a37da9650740 admin admin] PATH_INFO: `/v3/users/b86833b59ce74ac59d6d22689e9f2c97` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:33.038659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb53f3-4785-4c33-95e4-a37da9650740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86833b59ce74ac59d6d22689e9f2c97)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:33.044577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb53f3-4785-4c33-95e4-a37da9650740 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:33.171933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b5eb53f3-4785-4c33-95e4-a37da9650740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86833b59ce74ac59d6d22689e9f2c97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:33.172906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b5eb53f3-4785-4c33-95e4-a37da9650740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86833b59ce74ac59d6d22689e9f2c97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:33.204606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b5eb53f3-4785-4c33-95e4-a37da9650740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86833b59ce74ac59d6d22689e9f2c97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:33.227984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b5eb53f3-4785-4c33-95e4-a37da9650740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86833b59ce74ac59d6d22689e9f2c97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:33.229806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b5eb53f3-4785-4c33-95e4-a37da9650740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86833b59ce74ac59d6d22689e9f2c97'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:33.257823 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3002/6066] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:28:32 2022] DELETE /identity/v3/users/b86833b59ce74ac59d6d22689e9f2c97 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:34.859102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:34.860682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:34.887226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18870f55-98ff-4181-ad6d-52ef51b79fa6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:35.023724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ec256-b44e-499a-8e14-5bc42aa7f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:35.024149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ec256-b44e-499a-8e14-5bc42aa7f5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:35.024741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ec256-b44e-499a-8e14-5bc42aa7f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:35.025022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ec256-b44e-499a-8e14-5bc42aa7f5bf admin admin] PATH_INFO: `/v3/projects/669130c5d0f2477d953135a974eaaaa4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:35.026592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ec256-b44e-499a-8e14-5bc42aa7f5bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=669130c5d0f2477d953135a974eaaaa4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:35.032025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ec256-b44e-499a-8e14-5bc42aa7f5bf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:35.137924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-650ec256-b44e-499a-8e14-5bc42aa7f5bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669130c5d0f2477d953135a974eaaaa4', 'request_id': 'req-650ec256-b44e-499a-8e14-5bc42aa7f5bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:35.141585 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:35.150381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-650ec256-b44e-499a-8e14-5bc42aa7f5bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669130c5d0f2477d953135a974eaaaa4', 'request_id': 'req-650ec256-b44e-499a-8e14-5bc42aa7f5bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:35.168462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-650ec256-b44e-499a-8e14-5bc42aa7f5bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669130c5d0f2477d953135a974eaaaa4', 'request_id': 'req-650ec256-b44e-499a-8e14-5bc42aa7f5bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:35.201324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-650ec256-b44e-499a-8e14-5bc42aa7f5bf admin admin] The token cache is being invalidate because project 669130c5d0f2477d953135a974eaaaa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:28:35.202097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-650ec256-b44e-499a-8e14-5bc42aa7f5bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:35.205217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-650ec256-b44e-499a-8e14-5bc42aa7f5bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:35.212053 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3065/6067] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:28:34 2022] DELETE /identity/v3/projects/669130c5d0f2477d953135a974eaaaa4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:35.213605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db7d2-8de2-4652-b9b3-de3d86a62b80 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:35.214114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db7d2-8de2-4652-b9b3-de3d86a62b80 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:35.214205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db7d2-8de2-4652-b9b3-de3d86a62b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:35.237857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ad6db7d2-8de2-4652-b9b3-de3d86a62b80 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:35.240235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ad6db7d2-8de2-4652-b9b3-de3d86a62b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:35.248257 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:35.347266 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3003/6068] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:35.355424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a58402-26b1-4a9b-a1f5-a01b2ced6631 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:35.355787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a58402-26b1-4a9b-a1f5-a01b2ced6631 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:35.356166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a58402-26b1-4a9b-a1f5-a01b2ced6631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:35.379635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-05a58402-26b1-4a9b-a1f5-a01b2ced6631 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:35.381160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05a58402-26b1-4a9b-a1f5-a01b2ced6631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:35.393212 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3066/6069] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:35.397849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db7d2-8de2-4652-b9b3-de3d86a62b80 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:35.408711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db7d2-8de2-4652-b9b3-de3d86a62b80 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:35.415152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ce889-ff2f-4180-ada6-44aad0cf8643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:35.415904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ce889-ff2f-4180-ada6-44aad0cf8643 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:35.416286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ce889-ff2f-4180-ada6-44aad0cf8643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:35.416666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ce889-ff2f-4180-ada6-44aad0cf8643 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:35.417425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ce889-ff2f-4180-ada6-44aad0cf8643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:28:35.417859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ce889-ff2f-4180-ada6-44aad0cf8643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:35.419615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ce889-ff2f-4180-ada6-44aad0cf8643 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:35.436389 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3004/6070] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:28:35.437877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a58402-26b1-4a9b-a1f5-a01b2ced6631 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:35.450907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a58402-26b1-4a9b-a1f5-a01b2ced6631 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:35.458314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb51f5-914f-4a1a-b2a5-2d9814b473e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:35.459937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb51f5-914f-4a1a-b2a5-2d9814b473e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:35.460425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb51f5-914f-4a1a-b2a5-2d9814b473e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:35.460920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb51f5-914f-4a1a-b2a5-2d9814b473e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:35.461835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb51f5-914f-4a1a-b2a5-2d9814b473e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:35.464158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb51f5-914f-4a1a-b2a5-2d9814b473e3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:35.522028 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3067/6071] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:28:35 2022] POST /identity/v3/projects => generated 399 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:35.523042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ce889-ff2f-4180-ada6-44aad0cf8643 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:35.538229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ce889-ff2f-4180-ada6-44aad0cf8643 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:35.652324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22144f22-967e-4e51-8f5b-a0f01636af5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:35.653264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144f22-967e-4e51-8f5b-a0f01636af5f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:35.653694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144f22-967e-4e51-8f5b-a0f01636af5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:35.654111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144f22-967e-4e51-8f5b-a0f01636af5f admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:35.654893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22144f22-967e-4e51-8f5b-a0f01636af5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:35.657111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22144f22-967e-4e51-8f5b-a0f01636af5f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:35.691003 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3005/6072] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:28:35 2022] POST /identity/v3/users => generated 306 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:35.692868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb51f5-914f-4a1a-b2a5-2d9814b473e3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:35.706216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb51f5-914f-4a1a-b2a5-2d9814b473e3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:35.720839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c15aec-93fa-4a3c-90c1-032367ae0854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:35.721457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c15aec-93fa-4a3c-90c1-032367ae0854 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:35.721911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c15aec-93fa-4a3c-90c1-032367ae0854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:35.722357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c15aec-93fa-4a3c-90c1-032367ae0854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:35.724043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c15aec-93fa-4a3c-90c1-032367ae0854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:35.725842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c15aec-93fa-4a3c-90c1-032367ae0854 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:35.743502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22144f22-967e-4e51-8f5b-a0f01636af5f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:35.755641 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3068/6073] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:35.756945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22144f22-967e-4e51-8f5b-a0f01636af5f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:35.762736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f97da-b055-4f0f-a660-fd2c26e74b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:35.763481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f97da-b055-4f0f-a660-fd2c26e74b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:35.763761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f97da-b055-4f0f-a660-fd2c26e74b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:35.764037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f97da-b055-4f0f-a660-fd2c26e74b07 admin admin] PATH_INFO: `/v3/projects/508fab5b72a145ba959413be3ef4facf/users/74c347d6c6234c12a31cf430956803c5/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:35.783754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f97da-b055-4f0f-a660-fd2c26e74b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508fab5b72a145ba959413be3ef4facf, user_id=74c347d6c6234c12a31cf430956803c5, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:35.787411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f97da-b055-4f0f-a660-fd2c26e74b07 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:35.817742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c15aec-93fa-4a3c-90c1-032367ae0854 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:35.818179 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3006/6074] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:35 2022] PUT /identity/v3/projects/508fab5b72a145ba959413be3ef4facf/users/74c347d6c6234c12a31cf430956803c5/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:35.828278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c15aec-93fa-4a3c-90c1-032367ae0854 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:35.906080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682aa5b-789d-4f77-9d0b-5d034b05dfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:35.906834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682aa5b-789d-4f77-9d0b-5d034b05dfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:35.907291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682aa5b-789d-4f77-9d0b-5d034b05dfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:35.907574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682aa5b-789d-4f77-9d0b-5d034b05dfa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:35.908499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682aa5b-789d-4f77-9d0b-5d034b05dfa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:35.912370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682aa5b-789d-4f77-9d0b-5d034b05dfa1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:35.930441 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3069/6075] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:35.932078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f97da-b055-4f0f-a660-fd2c26e74b07 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:35.950312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f97da-b055-4f0f-a660-fd2c26e74b07 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:35.960856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8f3f7-af08-4d65-90c9-de627837c6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:35.962626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8f3f7-af08-4d65-90c9-de627837c6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:35.963151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8f3f7-af08-4d65-90c9-de627837c6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:35.963719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8f3f7-af08-4d65-90c9-de627837c6cb admin admin] PATH_INFO: `/v3/projects/508fab5b72a145ba959413be3ef4facf/users/74c347d6c6234c12a31cf430956803c5/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:35.966800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8f3f7-af08-4d65-90c9-de627837c6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=508fab5b72a145ba959413be3ef4facf, user_id=74c347d6c6234c12a31cf430956803c5, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:35.969958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8f3f7-af08-4d65-90c9-de627837c6cb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:35.990728 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3007/6076] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:35 2022] PUT /identity/v3/projects/508fab5b72a145ba959413be3ef4facf/users/74c347d6c6234c12a31cf430956803c5/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:36.090005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c46c17-8ebe-4ec7-8b57-be8e79c63615 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:36.090316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c46c17-8ebe-4ec7-8b57-be8e79c63615 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:36.090612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c46c17-8ebe-4ec7-8b57-be8e79c63615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:36.128167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-82c46c17-8ebe-4ec7-8b57-be8e79c63615 None None] MFA Rules not processed for user `74c347d6c6234c12a31cf430956803c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:36.130778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-82c46c17-8ebe-4ec7-8b57-be8e79c63615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:36.233587 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3070/6077] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:36 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:36.237749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8f3f7-af08-4d65-90c9-de627837c6cb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:36.366133 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:36.382328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8f3f7-af08-4d65-90c9-de627837c6cb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:36.388648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b94fe6-f797-4925-8f3d-722fdde4081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:36.389633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b94fe6-f797-4925-8f3d-722fdde4081e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:36.390067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b94fe6-f797-4925-8f3d-722fdde4081e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:36.391095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b94fe6-f797-4925-8f3d-722fdde4081e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:36.392308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b94fe6-f797-4925-8f3d-722fdde4081e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:36.395405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b94fe6-f797-4925-8f3d-722fdde4081e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:36.482075 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3008/6078] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:28:36 2022] POST /identity/v3/projects => generated 397 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:36.482827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c46c17-8ebe-4ec7-8b57-be8e79c63615 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:36.498386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c46c17-8ebe-4ec7-8b57-be8e79c63615 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:36.547244 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:36.692484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0495b-5a65-463c-9726-075f50221963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:36.694015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0495b-5a65-463c-9726-075f50221963 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:36.694760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0495b-5a65-463c-9726-075f50221963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:36.695886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0495b-5a65-463c-9726-075f50221963 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:36.697685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0495b-5a65-463c-9726-075f50221963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:36.700253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0495b-5a65-463c-9726-075f50221963 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:36.753839 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3071/6079] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:28:36 2022] POST /identity/v3/users => generated 299 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:36.757261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b94fe6-f797-4925-8f3d-722fdde4081e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:36.777876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b94fe6-f797-4925-8f3d-722fdde4081e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:36.788781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc49c-b571-4cd7-b9b2-3067940d99f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:36.789786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc49c-b571-4cd7-b9b2-3067940d99f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:36.790273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc49c-b571-4cd7-b9b2-3067940d99f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:36.791099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc49c-b571-4cd7-b9b2-3067940d99f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:36.791970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfc49c-b571-4cd7-b9b2-3067940d99f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:36.794585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfc49c-b571-4cd7-b9b2-3067940d99f4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:36.817281 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3009/6080] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:36.818044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0495b-5a65-463c-9726-075f50221963 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:36.841335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0495b-5a65-463c-9726-075f50221963 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:36.853433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684a6a4-2795-4223-a40c-883d56ccb1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:36.853650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a6a4-2795-4223-a40c-883d56ccb1aa admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:36.853874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a6a4-2795-4223-a40c-883d56ccb1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:36.854705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a6a4-2795-4223-a40c-883d56ccb1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:36.858779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684a6a4-2795-4223-a40c-883d56ccb1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:36.860450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684a6a4-2795-4223-a40c-883d56ccb1aa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:36.884095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc49c-b571-4cd7-b9b2-3067940d99f4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:36.901792 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3072/6081] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:36.903545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc49c-b571-4cd7-b9b2-3067940d99f4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:36.909779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd79d60-90e9-4fa1-b24d-59b5a6e0a861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:36.911885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd79d60-90e9-4fa1-b24d-59b5a6e0a861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:36.912340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd79d60-90e9-4fa1-b24d-59b5a6e0a861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:36.912807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd79d60-90e9-4fa1-b24d-59b5a6e0a861 admin admin] PATH_INFO: `/v3/projects/754e6c3311424124b3b7a364aeba4c32/users/b84e49f98fe44e7ca504bb7a6b1d64c7/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:36.933751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd79d60-90e9-4fa1-b24d-59b5a6e0a861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=754e6c3311424124b3b7a364aeba4c32, user_id=b84e49f98fe44e7ca504bb7a6b1d64c7, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:36.937291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd79d60-90e9-4fa1-b24d-59b5a6e0a861 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:36.971521 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3010/6082] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:36 2022] PUT /identity/v3/projects/754e6c3311424124b3b7a364aeba4c32/users/b84e49f98fe44e7ca504bb7a6b1d64c7/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:36.978470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec21f2-6b53-4a4b-9afc-e41cc4d47665 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:36.978990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec21f2-6b53-4a4b-9afc-e41cc4d47665 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:36.978990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec21f2-6b53-4a4b-9afc-e41cc4d47665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:37.029346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8aec21f2-6b53-4a4b-9afc-e41cc4d47665 None None] MFA Rules not processed for user `b84e49f98fe44e7ca504bb7a6b1d64c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:37.030701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8aec21f2-6b53-4a4b-9afc-e41cc4d47665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:37.148384 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3073/6083] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:37.165416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd79d60-90e9-4fa1-b24d-59b5a6e0a861 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:37.167286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7dd79d60-90e9-4fa1-b24d-59b5a6e0a861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:37.274310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd79d60-90e9-4fa1-b24d-59b5a6e0a861 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:37.286483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6b087-11a9-48a7-90fe-048c152d18c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:37.287997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6b087-11a9-48a7-90fe-048c152d18c9 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:37.288339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6b087-11a9-48a7-90fe-048c152d18c9 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:37.288627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6b087-11a9-48a7-90fe-048c152d18c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:37.419921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6b087-11a9-48a7-90fe-048c152d18c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:37.423004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6b087-11a9-48a7-90fe-048c152d18c9 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:37.452206 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3011/6084] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:38.035884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec21f2-6b53-4a4b-9afc-e41cc4d47665 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:38.129828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec21f2-6b53-4a4b-9afc-e41cc4d47665 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:38.135147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:38.135814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:38.136096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:38.136371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] PATH_INFO: `/v3/users/74c347d6c6234c12a31cf430956803c5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:38.137742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c347d6c6234c12a31cf430956803c5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:38.139952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:38.224418 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:38.241759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c347d6c6234c12a31cf430956803c5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:38.242895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c347d6c6234c12a31cf430956803c5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:38.267324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c347d6c6234c12a31cf430956803c5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:38.282980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c347d6c6234c12a31cf430956803c5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:38.283693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c347d6c6234c12a31cf430956803c5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:38.306665 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3074/6085] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:28:38 2022] DELETE /identity/v3/users/74c347d6c6234c12a31cf430956803c5 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:38.312158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068dbb2-b979-4ead-82c7-ebfbd678e701 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:38.313348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068dbb2-b979-4ead-82c7-ebfbd678e701 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:38.313815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068dbb2-b979-4ead-82c7-ebfbd678e701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:38.338078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a068dbb2-b979-4ead-82c7-ebfbd678e701 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:38.339859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a068dbb2-b979-4ead-82c7-ebfbd678e701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:38.413074 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:38.467293 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3012/6086] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:38.510264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:38.511896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:38.594758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ab7aa-42f3-47eb-8927-8dfb7678a662 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:38.595082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ab7aa-42f3-47eb-8927-8dfb7678a662 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:38.595364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ab7aa-42f3-47eb-8927-8dfb7678a662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:38.660706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7f2ab7aa-42f3-47eb-8927-8dfb7678a662 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:38.661794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7f2ab7aa-42f3-47eb-8927-8dfb7678a662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:38.673824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4664f-6111-42be-bb0b-04099a12d59c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:38.681849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83707-83f4-42c8-8ac9-fe0856fe797f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:38.682855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83707-83f4-42c8-8ac9-fe0856fe797f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:38.683377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83707-83f4-42c8-8ac9-fe0856fe797f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:38.683855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83707-83f4-42c8-8ac9-fe0856fe797f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:38.699963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b83707-83f4-42c8-8ac9-fe0856fe797f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:38.702674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b83707-83f4-42c8-8ac9-fe0856fe797f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:38.732259 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3075/6087] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:38.806374 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3013/6088] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:28:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:28:38.829081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83707-83f4-42c8-8ac9-fe0856fe797f service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:38.831016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-91b83707-83f4-42c8-8ac9-fe0856fe797f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:38.939016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83707-83f4-42c8-8ac9-fe0856fe797f service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:38.945271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10606f-139f-4def-b843-426965883100 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:38.946164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10606f-139f-4def-b843-426965883100 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:38.946681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10606f-139f-4def-b843-426965883100 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:38.947379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10606f-139f-4def-b843-426965883100 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:38.959533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10606f-139f-4def-b843-426965883100 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:38.961764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10606f-139f-4def-b843-426965883100 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:38.978581 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3076/6089] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:28:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:28:39.899219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ab7aa-42f3-47eb-8927-8dfb7678a662 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:39.901507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7f2ab7aa-42f3-47eb-8927-8dfb7678a662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:39.931675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ab7aa-42f3-47eb-8927-8dfb7678a662 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:39.951611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:39.952297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:39.952578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:39.952851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] PATH_INFO: `/v3/projects/508fab5b72a145ba959413be3ef4facf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:39.963282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=508fab5b72a145ba959413be3ef4facf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:39.965335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:40.038124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508fab5b72a145ba959413be3ef4facf', 'request_id': 'req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:40.046143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508fab5b72a145ba959413be3ef4facf', 'request_id': 'req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:40.058275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508fab5b72a145ba959413be3ef4facf', 'request_id': 'req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:40.074728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] The token cache is being invalidate because project 508fab5b72a145ba959413be3ef4facf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:28:40.075298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:40.076321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:40.083457 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3014/6090] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:28:39 2022] DELETE /identity/v3/projects/508fab5b72a145ba959413be3ef4facf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:40.084151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10606f-139f-4def-b843-426965883100 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:40.101822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10606f-139f-4def-b843-426965883100 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:40.163867 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:40.193814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb72ef-e2d1-46dd-b65b-ef3ea08908ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:40.194428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb72ef-e2d1-46dd-b65b-ef3ea08908ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:40.194830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb72ef-e2d1-46dd-b65b-ef3ea08908ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:40.195247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb72ef-e2d1-46dd-b65b-ef3ea08908ba admin admin] PATH_INFO: `/v3/users/b84e49f98fe44e7ca504bb7a6b1d64c7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:40.197349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb72ef-e2d1-46dd-b65b-ef3ea08908ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84e49f98fe44e7ca504bb7a6b1d64c7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:40.201011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb72ef-e2d1-46dd-b65b-ef3ea08908ba admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:40.349104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6eb72ef-e2d1-46dd-b65b-ef3ea08908ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84e49f98fe44e7ca504bb7a6b1d64c7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:40.353399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6eb72ef-e2d1-46dd-b65b-ef3ea08908ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84e49f98fe44e7ca504bb7a6b1d64c7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:40.476133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6eb72ef-e2d1-46dd-b65b-ef3ea08908ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84e49f98fe44e7ca504bb7a6b1d64c7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:40.506811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6eb72ef-e2d1-46dd-b65b-ef3ea08908ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84e49f98fe44e7ca504bb7a6b1d64c7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:40.507452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b6eb72ef-e2d1-46dd-b65b-ef3ea08908ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84e49f98fe44e7ca504bb7a6b1d64c7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:40.545757 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3077/6091] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:28:40 2022] DELETE /identity/v3/users/b84e49f98fe44e7ca504bb7a6b1d64c7 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:42.135705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:42.137182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:42.217017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915ab7-c0c0-474d-99bd-f6a7c0df8ef4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:42.329300 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:42.351695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:42.352879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:42.353708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:42.354199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0 admin admin] PATH_INFO: `/v3/projects/754e6c3311424124b3b7a364aeba4c32` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:42.355857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=754e6c3311424124b3b7a364aeba4c32)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:42.357845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:42.434440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754e6c3311424124b3b7a364aeba4c32', 'request_id': 'req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:42.450722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754e6c3311424124b3b7a364aeba4c32', 'request_id': 'req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:42.464568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754e6c3311424124b3b7a364aeba4c32', 'request_id': 'req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:42.488140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0 admin admin] The token cache is being invalidate because project 754e6c3311424124b3b7a364aeba4c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:28:42.488568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:42.489641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ee20a0ba-541f-4a3a-9c13-312f23b8f8f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:42.496035 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3015/6092] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:28:42 2022] DELETE /identity/v3/projects/754e6c3311424124b3b7a364aeba4c32 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:42.499235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e830f-6913-4035-b8f2-1fa54948853c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:42.499235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e830f-6913-4035-b8f2-1fa54948853c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:42.499235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e830f-6913-4035-b8f2-1fa54948853c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:42.574624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-362e830f-6913-4035-b8f2-1fa54948853c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:42.577014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-362e830f-6913-4035-b8f2-1fa54948853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:42.674590 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3078/6093] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:42.682558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd9632-cbd7-4475-83b1-51d0c81e2c62 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:42.682846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd9632-cbd7-4475-83b1-51d0c81e2c62 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:42.683155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd9632-cbd7-4475-83b1-51d0c81e2c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:42.727671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2fbd9632-cbd7-4475-83b1-51d0c81e2c62 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:42.733880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2fbd9632-cbd7-4475-83b1-51d0c81e2c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:42.745570 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3016/6094] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:42.751270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e830f-6913-4035-b8f2-1fa54948853c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:42.769436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e830f-6913-4035-b8f2-1fa54948853c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:42.784870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86903ea-bd04-47ed-ae72-425fbd537cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:42.786044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86903ea-bd04-47ed-ae72-425fbd537cec admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:42.786757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86903ea-bd04-47ed-ae72-425fbd537cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:42.787194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86903ea-bd04-47ed-ae72-425fbd537cec admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:42.788157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86903ea-bd04-47ed-ae72-425fbd537cec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:28:42.789096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86903ea-bd04-47ed-ae72-425fbd537cec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:42.793987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86903ea-bd04-47ed-ae72-425fbd537cec admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:42.827781 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3079/6095] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:28:42.831804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd9632-cbd7-4475-83b1-51d0c81e2c62 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:42.844748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd9632-cbd7-4475-83b1-51d0c81e2c62 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:42.859705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5748663-a201-4f9b-81ea-9042b43a2569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:42.860590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5748663-a201-4f9b-81ea-9042b43a2569 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:42.860871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5748663-a201-4f9b-81ea-9042b43a2569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:42.861138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5748663-a201-4f9b-81ea-9042b43a2569 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:42.862779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5748663-a201-4f9b-81ea-9042b43a2569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:42.865226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5748663-a201-4f9b-81ea-9042b43a2569 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:42.921763 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3017/6096] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:28:42 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:42.923258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86903ea-bd04-47ed-ae72-425fbd537cec admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:42.937029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86903ea-bd04-47ed-ae72-425fbd537cec admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:43.009519 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:43.042498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b9774-9623-4210-804f-b588ffc15e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:43.043563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b9774-9623-4210-804f-b588ffc15e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:43.044028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b9774-9623-4210-804f-b588ffc15e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:43.044383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b9774-9623-4210-804f-b588ffc15e41 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:43.045185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b9774-9623-4210-804f-b588ffc15e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:43.047802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b9774-9623-4210-804f-b588ffc15e41 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:43.101679 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3080/6097] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:28:42 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:43.103785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5748663-a201-4f9b-81ea-9042b43a2569 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:43.120993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5748663-a201-4f9b-81ea-9042b43a2569 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:43.135133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc272a99-797a-4d58-b895-d7f675cf27ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:43.135914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc272a99-797a-4d58-b895-d7f675cf27ed admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:43.136463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc272a99-797a-4d58-b895-d7f675cf27ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:43.140759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc272a99-797a-4d58-b895-d7f675cf27ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:43.142418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc272a99-797a-4d58-b895-d7f675cf27ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:43.144772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc272a99-797a-4d58-b895-d7f675cf27ed admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:43.164425 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3018/6098] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:43.167088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b9774-9623-4210-804f-b588ffc15e41 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:43.180440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b9774-9623-4210-804f-b588ffc15e41 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:43.196529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087537a-9477-432b-88ce-18d9b27ee8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:43.197341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087537a-9477-432b-88ce-18d9b27ee8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:43.197584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087537a-9477-432b-88ce-18d9b27ee8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:43.197928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087537a-9477-432b-88ce-18d9b27ee8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:43.198657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087537a-9477-432b-88ce-18d9b27ee8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:43.200534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087537a-9477-432b-88ce-18d9b27ee8c0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:43.228623 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3081/6099] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:43.233560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc272a99-797a-4d58-b895-d7f675cf27ed admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:43.262995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc272a99-797a-4d58-b895-d7f675cf27ed admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:43.281220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450fe98-714d-44d9-8a29-4c4f2ebffd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:43.282193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450fe98-714d-44d9-8a29-4c4f2ebffd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:43.282685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450fe98-714d-44d9-8a29-4c4f2ebffd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:43.283297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450fe98-714d-44d9-8a29-4c4f2ebffd07 admin admin] PATH_INFO: `/v3/projects/954ef4c8d093498284159db9a8cc156e/users/38ad245e04994b1b9864d32693386123/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:43.336640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450fe98-714d-44d9-8a29-4c4f2ebffd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954ef4c8d093498284159db9a8cc156e, user_id=38ad245e04994b1b9864d32693386123, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:43.342137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450fe98-714d-44d9-8a29-4c4f2ebffd07 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:43.362672 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3019/6100] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:43 2022] PUT /identity/v3/projects/954ef4c8d093498284159db9a8cc156e/users/38ad245e04994b1b9864d32693386123/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:43.377002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3ddff-6dee-49d0-840a-48c3d65ce407 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:43.377548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3ddff-6dee-49d0-840a-48c3d65ce407 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:43.377852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3ddff-6dee-49d0-840a-48c3d65ce407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:43.458412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3db3ddff-6dee-49d0-840a-48c3d65ce407 None None] MFA Rules not processed for user `38ad245e04994b1b9864d32693386123`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:43.460329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3db3ddff-6dee-49d0-840a-48c3d65ce407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:43.568034 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3082/6101] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:43.574081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450fe98-714d-44d9-8a29-4c4f2ebffd07 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:43.694444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450fe98-714d-44d9-8a29-4c4f2ebffd07 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:43.701006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68291fae-39a0-45d9-afe4-8dc162a24461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:43.701732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68291fae-39a0-45d9-afe4-8dc162a24461 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:43.702363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68291fae-39a0-45d9-afe4-8dc162a24461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:43.702757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68291fae-39a0-45d9-afe4-8dc162a24461 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:43.704072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68291fae-39a0-45d9-afe4-8dc162a24461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:43.706118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68291fae-39a0-45d9-afe4-8dc162a24461 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:43.741746 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:43.763323 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3020/6102] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:28:43 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:28:43.765347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3ddff-6dee-49d0-840a-48c3d65ce407 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:43.781969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3ddff-6dee-49d0-840a-48c3d65ce407 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:43.930441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf1567-c691-49c6-9e91-975ccb5dfa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:43.931117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf1567-c691-49c6-9e91-975ccb5dfa58 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:43.931403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf1567-c691-49c6-9e91-975ccb5dfa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:43.931681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf1567-c691-49c6-9e91-975ccb5dfa58 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:43.932344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf1567-c691-49c6-9e91-975ccb5dfa58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:43.937154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf1567-c691-49c6-9e91-975ccb5dfa58 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:43.989598 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3083/6103] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:28:43 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:43.993424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68291fae-39a0-45d9-afe4-8dc162a24461 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:44.008671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68291fae-39a0-45d9-afe4-8dc162a24461 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:44.019118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9932db-de8b-4d40-961f-314f9db91b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:44.019999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9932db-de8b-4d40-961f-314f9db91b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:44.020116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9932db-de8b-4d40-961f-314f9db91b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:44.020328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9932db-de8b-4d40-961f-314f9db91b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:44.020979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9932db-de8b-4d40-961f-314f9db91b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:44.022598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9932db-de8b-4d40-961f-314f9db91b00 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:44.038114 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3021/6104] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:44.039716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf1567-c691-49c6-9e91-975ccb5dfa58 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:44.050630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf1567-c691-49c6-9e91-975ccb5dfa58 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:44.056081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a7364-8997-4dcd-b961-a6b7b771b7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:44.056704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a7364-8997-4dcd-b961-a6b7b771b7bb admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:44.056989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a7364-8997-4dcd-b961-a6b7b771b7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:44.057266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a7364-8997-4dcd-b961-a6b7b771b7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:44.058152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a7364-8997-4dcd-b961-a6b7b771b7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:44.059928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a7364-8997-4dcd-b961-a6b7b771b7bb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:44.074984 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3084/6105] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:44.078608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9932db-de8b-4d40-961f-314f9db91b00 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:44.090709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9932db-de8b-4d40-961f-314f9db91b00 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:44.095912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aeaf3-5131-4582-b61f-a765a5b77ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:44.096828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aeaf3-5131-4582-b61f-a765a5b77ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:44.097258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aeaf3-5131-4582-b61f-a765a5b77ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:44.097718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aeaf3-5131-4582-b61f-a765a5b77ab6 admin admin] PATH_INFO: `/v3/projects/63c4e6576fec4069bd50d4c7df60bb20/users/a2dd979a415e4137a97cea1573d4927f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:44.118658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58aeaf3-5131-4582-b61f-a765a5b77ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c4e6576fec4069bd50d4c7df60bb20, user_id=a2dd979a415e4137a97cea1573d4927f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:44.122902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58aeaf3-5131-4582-b61f-a765a5b77ab6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:44.148604 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3022/6106] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:44 2022] PUT /identity/v3/projects/63c4e6576fec4069bd50d4c7df60bb20/users/a2dd979a415e4137a97cea1573d4927f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:28:44.159007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225a14a-97e1-428e-9c1c-49af4bca6e5d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:44.159319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225a14a-97e1-428e-9c1c-49af4bca6e5d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:44.159577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225a14a-97e1-428e-9c1c-49af4bca6e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:44.200294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e225a14a-97e1-428e-9c1c-49af4bca6e5d None None] MFA Rules not processed for user `a2dd979a415e4137a97cea1573d4927f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:44.201583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e225a14a-97e1-428e-9c1c-49af4bca6e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:44.226732 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:44.360186 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3085/6107] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:44.382974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aeaf3-5131-4582-b61f-a765a5b77ab6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:44.385364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e58aeaf3-5131-4582-b61f-a765a5b77ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:44.549330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aeaf3-5131-4582-b61f-a765a5b77ab6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:44.553591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362757a-a910-411a-a63e-c1765425824f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:44.554214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362757a-a910-411a-a63e-c1765425824f service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:44.554491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362757a-a910-411a-a63e-c1765425824f service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:44.554760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362757a-a910-411a-a63e-c1765425824f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:44.662094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362757a-a910-411a-a63e-c1765425824f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:44.665052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362757a-a910-411a-a63e-c1765425824f service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:44.703292 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3023/6108] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:44.937865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5d430-5765-4b79-a344-29063b863445 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:44.937865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5d430-5765-4b79-a344-29063b863445 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:44.938500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5d430-5765-4b79-a344-29063b863445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:44.998327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ded5d430-5765-4b79-a344-29063b863445 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:44.999580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ded5d430-5765-4b79-a344-29063b863445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:45.221893 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3086/6109] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:28:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:45.261222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362757a-a910-411a-a63e-c1765425824f service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:45.263946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6362757a-a910-411a-a63e-c1765425824f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:45.432679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362757a-a910-411a-a63e-c1765425824f service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:45.446226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f02e8-570e-4bef-8110-a179706527be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:45.447009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f02e8-570e-4bef-8110-a179706527be service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:45.447501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f02e8-570e-4bef-8110-a179706527be service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:45.447881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f02e8-570e-4bef-8110-a179706527be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:45.458695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f02e8-570e-4bef-8110-a179706527be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:45.462117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f02e8-570e-4bef-8110-a179706527be service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:45.493057 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3024/6110] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:28:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:28:45.777674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5d430-5765-4b79-a344-29063b863445 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:45.780224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ded5d430-5765-4b79-a344-29063b863445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:45.796684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5d430-5765-4b79-a344-29063b863445 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:45.808270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f58975-88bf-4fae-b2ad-deb6c389e83e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:45.809180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f58975-88bf-4fae-b2ad-deb6c389e83e service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:45.809900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f58975-88bf-4fae-b2ad-deb6c389e83e service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:45.811145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f58975-88bf-4fae-b2ad-deb6c389e83e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:45.823582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f58975-88bf-4fae-b2ad-deb6c389e83e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:45.825292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f58975-88bf-4fae-b2ad-deb6c389e83e service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:45.838437 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3087/6111] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:45.946416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48eaef1-3823-48d4-b6b5-d6d602f01b7e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:45.946707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48eaef1-3823-48d4-b6b5-d6d602f01b7e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:45.947019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48eaef1-3823-48d4-b6b5-d6d602f01b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:45.980119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f48eaef1-3823-48d4-b6b5-d6d602f01b7e None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:45.981917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f48eaef1-3823-48d4-b6b5-d6d602f01b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:45.990751 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3025/6112] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:28:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:46.006235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f58975-88bf-4fae-b2ad-deb6c389e83e service glance] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:46.027653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f58975-88bf-4fae-b2ad-deb6c389e83e service glance] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:46.033585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aeb07-a861-4caa-bd90-129dc42c0fde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:46.034198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aeb07-a861-4caa-bd90-129dc42c0fde service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:46.034471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aeb07-a861-4caa-bd90-129dc42c0fde service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:46.034822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aeb07-a861-4caa-bd90-129dc42c0fde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:46.047171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315aeb07-a861-4caa-bd90-129dc42c0fde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:46.049502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315aeb07-a861-4caa-bd90-129dc42c0fde service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:46.063568 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3088/6113] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:28:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:28:46.224568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48eaef1-3823-48d4-b6b5-d6d602f01b7e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:46.230723 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:46.318324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48eaef1-3823-48d4-b6b5-d6d602f01b7e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:46.327924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:46.328974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:46.329910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:46.330400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] PATH_INFO: `/v3/users/38ad245e04994b1b9864d32693386123` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:46.332710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ad245e04994b1b9864d32693386123)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:46.335529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:46.448661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ad245e04994b1b9864d32693386123'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:46.451633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ad245e04994b1b9864d32693386123'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:46.483325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ad245e04994b1b9864d32693386123'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:46.503764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ad245e04994b1b9864d32693386123'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:46.505593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ad245e04994b1b9864d32693386123'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:46.566241 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3026/6114] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:28:46 2022] DELETE /identity/v3/users/38ad245e04994b1b9864d32693386123 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:46.572291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b82cd6-5d30-41f7-a3cf-ad89250509e4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:46.572418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b82cd6-5d30-41f7-a3cf-ad89250509e4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:46.572899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b82cd6-5d30-41f7-a3cf-ad89250509e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:46.601985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b6b82cd6-5d30-41f7-a3cf-ad89250509e4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:46.604039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b6b82cd6-5d30-41f7-a3cf-ad89250509e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:46.715087 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3089/6115] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:46.754829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:46.756338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:46.881448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1dfd3-16e7-48de-a8a3-c3a82cd9eca6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:46.887427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409ee76-90d3-4b4d-9cb5-df1b506c240e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:46.889673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409ee76-90d3-4b4d-9cb5-df1b506c240e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:46.890065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409ee76-90d3-4b4d-9cb5-df1b506c240e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:46.890432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409ee76-90d3-4b4d-9cb5-df1b506c240e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:46.904026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409ee76-90d3-4b4d-9cb5-df1b506c240e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:46.906176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409ee76-90d3-4b4d-9cb5-df1b506c240e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:46.921588 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3027/6116] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:28:48.339249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b82cd6-5d30-41f7-a3cf-ad89250509e4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:48.342494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b6b82cd6-5d30-41f7-a3cf-ad89250509e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:48.408481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b82cd6-5d30-41f7-a3cf-ad89250509e4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:48.429378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:48.430133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:48.430639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:48.431179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] PATH_INFO: `/v3/projects/954ef4c8d093498284159db9a8cc156e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:48.434635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=954ef4c8d093498284159db9a8cc156e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:48.442788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:48.541701 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:48.558205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954ef4c8d093498284159db9a8cc156e', 'request_id': 'req-ae243240-eb7a-44ea-b236-c0ef8f675775'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:48.583537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954ef4c8d093498284159db9a8cc156e', 'request_id': 'req-ae243240-eb7a-44ea-b236-c0ef8f675775'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:48.614388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954ef4c8d093498284159db9a8cc156e', 'request_id': 'req-ae243240-eb7a-44ea-b236-c0ef8f675775'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:48.660686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] The token cache is being invalidate because project 954ef4c8d093498284159db9a8cc156e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:28:48.661056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:48.662057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:48.675592 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3090/6117] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:28:48 2022] DELETE /identity/v3/projects/954ef4c8d093498284159db9a8cc156e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:28:48.680342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409ee76-90d3-4b4d-9cb5-df1b506c240e service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:48.699165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409ee76-90d3-4b4d-9cb5-df1b506c240e service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:48.722316 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:48.869331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c1e91-5010-45cd-9a59-46629c6f7e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:48.870631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c1e91-5010-45cd-9a59-46629c6f7e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:48.870908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c1e91-5010-45cd-9a59-46629c6f7e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:48.872014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c1e91-5010-45cd-9a59-46629c6f7e15 admin admin] PATH_INFO: `/v3/users/a2dd979a415e4137a97cea1573d4927f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:48.875255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c1e91-5010-45cd-9a59-46629c6f7e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2dd979a415e4137a97cea1573d4927f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:48.883643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c1e91-5010-45cd-9a59-46629c6f7e15 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:48.991930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-956c1e91-5010-45cd-9a59-46629c6f7e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2dd979a415e4137a97cea1573d4927f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:48.992629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-956c1e91-5010-45cd-9a59-46629c6f7e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2dd979a415e4137a97cea1573d4927f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:49.025718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-956c1e91-5010-45cd-9a59-46629c6f7e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2dd979a415e4137a97cea1573d4927f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:49.041308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-956c1e91-5010-45cd-9a59-46629c6f7e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2dd979a415e4137a97cea1573d4927f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:49.043599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-956c1e91-5010-45cd-9a59-46629c6f7e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2dd979a415e4137a97cea1573d4927f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:49.066680 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3028/6118] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:28:48 2022] DELETE /identity/v3/users/a2dd979a415e4137a97cea1573d4927f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:49.850276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:49.853198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:49.867795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae243240-eb7a-44ea-b236-c0ef8f675775 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:50.012691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf41fe-07fd-457b-af6e-28377d4f8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:50.013654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf41fe-07fd-457b-af6e-28377d4f8b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:50.014307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf41fe-07fd-457b-af6e-28377d4f8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:50.014666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf41fe-07fd-457b-af6e-28377d4f8b13 admin admin] PATH_INFO: `/v3/projects/63c4e6576fec4069bd50d4c7df60bb20` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:50.016172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf41fe-07fd-457b-af6e-28377d4f8b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63c4e6576fec4069bd50d4c7df60bb20)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:50.018418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf41fe-07fd-457b-af6e-28377d4f8b13 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:50.140294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4ecf41fe-07fd-457b-af6e-28377d4f8b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c4e6576fec4069bd50d4c7df60bb20', 'request_id': 'req-4ecf41fe-07fd-457b-af6e-28377d4f8b13'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:50.149648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4ecf41fe-07fd-457b-af6e-28377d4f8b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c4e6576fec4069bd50d4c7df60bb20', 'request_id': 'req-4ecf41fe-07fd-457b-af6e-28377d4f8b13'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:50.169499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4ecf41fe-07fd-457b-af6e-28377d4f8b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c4e6576fec4069bd50d4c7df60bb20', 'request_id': 'req-4ecf41fe-07fd-457b-af6e-28377d4f8b13'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:50.190462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4ecf41fe-07fd-457b-af6e-28377d4f8b13 admin admin] The token cache is being invalidate because project 63c4e6576fec4069bd50d4c7df60bb20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:28:50.191363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4ecf41fe-07fd-457b-af6e-28377d4f8b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:50.193399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4ecf41fe-07fd-457b-af6e-28377d4f8b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:28:50.202410 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3091/6119] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:28:49 2022] DELETE /identity/v3/projects/63c4e6576fec4069bd50d4c7df60bb20 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:50.209128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eb1b2-1178-4f4f-85f5-e843aa5d9856 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:50.209679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eb1b2-1178-4f4f-85f5-e843aa5d9856 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:50.209969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eb1b2-1178-4f4f-85f5-e843aa5d9856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:50.308627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-718eb1b2-1178-4f4f-85f5-e843aa5d9856 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:50.309867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-718eb1b2-1178-4f4f-85f5-e843aa5d9856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:50.442772 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3029/6120] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:50.455223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a161f-b14b-4271-a36b-bb1c720cab14 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:50.455933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a161f-b14b-4271-a36b-bb1c720cab14 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:50.456464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a161f-b14b-4271-a36b-bb1c720cab14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:50.532210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1a7a161f-b14b-4271-a36b-bb1c720cab14 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:50.539240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1a7a161f-b14b-4271-a36b-bb1c720cab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:50.567250 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3092/6121] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:50.571142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eb1b2-1178-4f4f-85f5-e843aa5d9856 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:50.574368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939acb02-afea-41f6-8d81-9b5963380169 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:50.574837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939acb02-afea-41f6-8d81-9b5963380169 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:50.575283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939acb02-afea-41f6-8d81-9b5963380169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:50.591379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eb1b2-1178-4f4f-85f5-e843aa5d9856 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:50.610544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56097a0a-8cba-460d-9dc6-b6ee8a19bdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:50.611211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56097a0a-8cba-460d-9dc6-b6ee8a19bdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:50.611491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56097a0a-8cba-460d-9dc6-b6ee8a19bdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:50.611759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56097a0a-8cba-460d-9dc6-b6ee8a19bdf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:50.612410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56097a0a-8cba-460d-9dc6-b6ee8a19bdf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:28:50.612708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56097a0a-8cba-460d-9dc6-b6ee8a19bdf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:50.614664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56097a0a-8cba-460d-9dc6-b6ee8a19bdf4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:50.620206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-939acb02-afea-41f6-8d81-9b5963380169 None None] MFA Rules not processed for user `4d4086e3f9784454a0ccfe87cc54a2b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:50.627101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-939acb02-afea-41f6-8d81-9b5963380169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:50.637277 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3030/6122] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:28:50.641409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56097a0a-8cba-460d-9dc6-b6ee8a19bdf4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:50.652779 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:50.658490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56097a0a-8cba-460d-9dc6-b6ee8a19bdf4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:50.672173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143009d2-a813-416e-94c0-990345aa9689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:50.672982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143009d2-a813-416e-94c0-990345aa9689 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:50.673372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143009d2-a813-416e-94c0-990345aa9689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:50.673937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143009d2-a813-416e-94c0-990345aa9689 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:50.677296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143009d2-a813-416e-94c0-990345aa9689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:50.682900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143009d2-a813-416e-94c0-990345aa9689 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:50.722623 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:50.775368 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3031/6123] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:28:50 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:50.775568 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3093/6124] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:28:50.776890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143009d2-a813-416e-94c0-990345aa9689 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:50.925500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143009d2-a813-416e-94c0-990345aa9689 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:50.932301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a4458-4329-4d97-a33b-6446808f4602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:50.932935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a4458-4329-4d97-a33b-6446808f4602 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:50.933211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a4458-4329-4d97-a33b-6446808f4602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:50.933482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a4458-4329-4d97-a33b-6446808f4602 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:50.934123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a4458-4329-4d97-a33b-6446808f4602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:50.936565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a4458-4329-4d97-a33b-6446808f4602 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:50.970138 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3032/6125] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:28:50 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:50.971314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939acb02-afea-41f6-8d81-9b5963380169 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:51.009028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939acb02-afea-41f6-8d81-9b5963380169 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:51.015553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b9c5d-a739-418a-8ad3-db5e86ceb7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:51.016459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b9c5d-a739-418a-8ad3-db5e86ceb7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:51.016742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b9c5d-a739-418a-8ad3-db5e86ceb7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:51.017288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b9c5d-a739-418a-8ad3-db5e86ceb7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:51.018424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b9c5d-a739-418a-8ad3-db5e86ceb7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:51.021978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b9c5d-a739-418a-8ad3-db5e86ceb7e9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:51.035285 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3094/6126] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:51.040435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a4458-4329-4d97-a33b-6446808f4602 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:51.061114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a4458-4329-4d97-a33b-6446808f4602 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:51.076578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc062ffb-9ff8-4474-bbb1-3754f38a5ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:51.076578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc062ffb-9ff8-4474-bbb1-3754f38a5ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:51.076997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc062ffb-9ff8-4474-bbb1-3754f38a5ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:51.077372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc062ffb-9ff8-4474-bbb1-3754f38a5ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:51.078117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc062ffb-9ff8-4474-bbb1-3754f38a5ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:51.079913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc062ffb-9ff8-4474-bbb1-3754f38a5ba9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:51.107041 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3033/6127] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:51.107971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b9c5d-a739-418a-8ad3-db5e86ceb7e9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:51.124222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b9c5d-a739-418a-8ad3-db5e86ceb7e9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:51.136579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91197db8-668e-4a72-86ed-abd71cf6d9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:51.137272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91197db8-668e-4a72-86ed-abd71cf6d9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:51.137948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91197db8-668e-4a72-86ed-abd71cf6d9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:51.137948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91197db8-668e-4a72-86ed-abd71cf6d9bf admin admin] PATH_INFO: `/v3/projects/4bdfcb33749347a3990528dd4492e09a/users/b85826df25ac472db9cdf974db36b8b2/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:51.180933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91197db8-668e-4a72-86ed-abd71cf6d9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bdfcb33749347a3990528dd4492e09a, user_id=b85826df25ac472db9cdf974db36b8b2, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:51.184863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91197db8-668e-4a72-86ed-abd71cf6d9bf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:51.210060 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3095/6128] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:51 2022] PUT /identity/v3/projects/4bdfcb33749347a3990528dd4492e09a/users/b85826df25ac472db9cdf974db36b8b2/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:51.221661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202ad5d-2bcf-4c33-b9c6-5c03e7e7411a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:51.222176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202ad5d-2bcf-4c33-b9c6-5c03e7e7411a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:51.222176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202ad5d-2bcf-4c33-b9c6-5c03e7e7411a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:51.264355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a202ad5d-2bcf-4c33-b9c6-5c03e7e7411a None None] MFA Rules not processed for user `b85826df25ac472db9cdf974db36b8b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:51.265858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a202ad5d-2bcf-4c33-b9c6-5c03e7e7411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:51.389703 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3034/6129] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:51.394223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91197db8-668e-4a72-86ed-abd71cf6d9bf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:51.514382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91197db8-668e-4a72-86ed-abd71cf6d9bf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:51.524314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212dc26-60ac-49af-820f-6ff536687086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:51.525142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212dc26-60ac-49af-820f-6ff536687086 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:51.525591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212dc26-60ac-49af-820f-6ff536687086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:51.526008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212dc26-60ac-49af-820f-6ff536687086 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:51.527742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212dc26-60ac-49af-820f-6ff536687086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:51.530373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212dc26-60ac-49af-820f-6ff536687086 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:51.594080 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3096/6130] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:28:51 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:51.596539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202ad5d-2bcf-4c33-b9c6-5c03e7e7411a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:51.612642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202ad5d-2bcf-4c33-b9c6-5c03e7e7411a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:51.706287 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:51.720914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3ad37-ae44-481a-a535-2b1e6e635f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:51.722091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ad37-ae44-481a-a535-2b1e6e635f63 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:51.722465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ad37-ae44-481a-a535-2b1e6e635f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:51.724072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ad37-ae44-481a-a535-2b1e6e635f63 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:51.724216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3ad37-ae44-481a-a535-2b1e6e635f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:51.727045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3ad37-ae44-481a-a535-2b1e6e635f63 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:51.767037 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3035/6131] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:28:51 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:28:51.768279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212dc26-60ac-49af-820f-6ff536687086 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:51.786569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212dc26-60ac-49af-820f-6ff536687086 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:51.794683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f2979-c756-4375-9440-2970142dfd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:51.795609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f2979-c756-4375-9440-2970142dfd92 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:51.795991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f2979-c756-4375-9440-2970142dfd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:51.796373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f2979-c756-4375-9440-2970142dfd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:51.797186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f2979-c756-4375-9440-2970142dfd92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:51.799449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f2979-c756-4375-9440-2970142dfd92 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:51.817186 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3097/6132] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:51.818674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3ad37-ae44-481a-a535-2b1e6e635f63 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:51.829911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3ad37-ae44-481a-a535-2b1e6e635f63 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:51.837471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04febc-818a-47bf-8d53-0407275849e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:51.838294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04febc-818a-47bf-8d53-0407275849e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:51.838681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04febc-818a-47bf-8d53-0407275849e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:51.839108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04febc-818a-47bf-8d53-0407275849e0 admin admin] PATH_INFO: `/v3/projects/361a3071af1b46d8896af8cc722d443e/users/be2c9ee26f874ec3862b7843381cefb6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:51.900748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04febc-818a-47bf-8d53-0407275849e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=361a3071af1b46d8896af8cc722d443e, user_id=be2c9ee26f874ec3862b7843381cefb6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:51.906855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04febc-818a-47bf-8d53-0407275849e0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:51.937250 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3036/6133] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:51 2022] PUT /identity/v3/projects/361a3071af1b46d8896af8cc722d443e/users/be2c9ee26f874ec3862b7843381cefb6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:51.941479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f2979-c756-4375-9440-2970142dfd92 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:51.957151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f2979-c756-4375-9440-2970142dfd92 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:52.097607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e297148-a83d-4673-bc5a-2dd248428472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:52.099389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e297148-a83d-4673-bc5a-2dd248428472 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:52.099389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e297148-a83d-4673-bc5a-2dd248428472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:52.099641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e297148-a83d-4673-bc5a-2dd248428472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:52.100780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e297148-a83d-4673-bc5a-2dd248428472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:52.103416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e297148-a83d-4673-bc5a-2dd248428472 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:52.133980 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3098/6134] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:28:52.138950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04febc-818a-47bf-8d53-0407275849e0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:52.156222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04febc-818a-47bf-8d53-0407275849e0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:52.168493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f5b8a-35cf-4838-aab5-ac0979ce5457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:52.169335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f5b8a-35cf-4838-aab5-ac0979ce5457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:52.169676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f5b8a-35cf-4838-aab5-ac0979ce5457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:52.170343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f5b8a-35cf-4838-aab5-ac0979ce5457 admin admin] PATH_INFO: `/v3/projects/361a3071af1b46d8896af8cc722d443e/users/be2c9ee26f874ec3862b7843381cefb6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:52.173831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f5b8a-35cf-4838-aab5-ac0979ce5457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=361a3071af1b46d8896af8cc722d443e, user_id=be2c9ee26f874ec3862b7843381cefb6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:52.176895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f5b8a-35cf-4838-aab5-ac0979ce5457 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:52.196804 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3037/6135] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:28:52 2022] PUT /identity/v3/projects/361a3071af1b46d8896af8cc722d443e/users/be2c9ee26f874ec3862b7843381cefb6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:28:52.208621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291557b0-9b4f-42e3-89d1-d455120e6963 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:52.209053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291557b0-9b4f-42e3-89d1-d455120e6963 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:52.209430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291557b0-9b4f-42e3-89d1-d455120e6963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:52.249522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-291557b0-9b4f-42e3-89d1-d455120e6963 None None] MFA Rules not processed for user `be2c9ee26f874ec3862b7843381cefb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:28:52.251749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-291557b0-9b4f-42e3-89d1-d455120e6963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:52.276495 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:52.378229 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3099/6136] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:28:52.384811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f5b8a-35cf-4838-aab5-ac0979ce5457 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:52.405542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f5b8a-35cf-4838-aab5-ac0979ce5457 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:52.418819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae39195-f406-4417-a136-5dadc4921efe tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2c9ee26f874ec3862b7843381cefb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '361a3071af1b46d8896af8cc722d443e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:52.419940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae39195-f406-4417-a136-5dadc4921efe tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:52.421353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae39195-f406-4417-a136-5dadc4921efe tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:52.444898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae39195-f406-4417-a136-5dadc4921efe tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:52.445957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae39195-f406-4417-a136-5dadc4921efe tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:28:52.450551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae39195-f406-4417-a136-5dadc4921efe tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:52.454245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae39195-f406-4417-a136-5dadc4921efe tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:52.494370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291557b0-9b4f-42e3-89d1-d455120e6963 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:52.497116 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3038/6137] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:28:52.510517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291557b0-9b4f-42e3-89d1-d455120e6963 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:52.520967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d273a4f-101d-4158-a31d-653892331d96 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2c9ee26f874ec3862b7843381cefb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '361a3071af1b46d8896af8cc722d443e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:52.521694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d273a4f-101d-4158-a31d-653892331d96 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:52.521983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d273a4f-101d-4158-a31d-653892331d96 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:52.522260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d273a4f-101d-4158-a31d-653892331d96 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:52.522931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d273a4f-101d-4158-a31d-653892331d96 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:52.525005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d273a4f-101d-4158-a31d-653892331d96 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:52.623122 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3100/6138] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:28:52 2022] POST /identity/v3/projects => generated 349 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:28:52.624510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae39195-f406-4417-a136-5dadc4921efe tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:52.644613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae39195-f406-4417-a136-5dadc4921efe tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:52.811833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cae95f-94c9-4dfc-9f96-2f6ca73dfd78 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2c9ee26f874ec3862b7843381cefb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '361a3071af1b46d8896af8cc722d443e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:52.812599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cae95f-94c9-4dfc-9f96-2f6ca73dfd78 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:52.812888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cae95f-94c9-4dfc-9f96-2f6ca73dfd78 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:52.813168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cae95f-94c9-4dfc-9f96-2f6ca73dfd78 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:52.813895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cae95f-94c9-4dfc-9f96-2f6ca73dfd78 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:28:52.814206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cae95f-94c9-4dfc-9f96-2f6ca73dfd78 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:52.816213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cae95f-94c9-4dfc-9f96-2f6ca73dfd78 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:52.839239 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3039/6139] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:28:52.899365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d273a4f-101d-4158-a31d-653892331d96 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:28:52.901558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4d273a4f-101d-4158-a31d-653892331d96 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:28:53.034550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d273a4f-101d-4158-a31d-653892331d96 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:28:53.039897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d16176-0702-4314-8e33-f10bef239732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:28:53.041873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d16176-0702-4314-8e33-f10bef239732 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:28:53.042165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d16176-0702-4314-8e33-f10bef239732 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:28:53.042443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d16176-0702-4314-8e33-f10bef239732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:28:53.061798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d16176-0702-4314-8e33-f10bef239732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:28:53.068979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d16176-0702-4314-8e33-f10bef239732 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:28:53.083355 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3101/6140] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:28:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:29:00.993476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cae95f-94c9-4dfc-9f96-2f6ca73dfd78 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:01.013178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cae95f-94c9-4dfc-9f96-2f6ca73dfd78 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:01.025612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b0d9f-244d-477c-9102-ef590155a165 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be2c9ee26f874ec3862b7843381cefb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '361a3071af1b46d8896af8cc722d443e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:01.027510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b0d9f-244d-477c-9102-ef590155a165 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:01.027948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b0d9f-244d-477c-9102-ef590155a165 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:01.028372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b0d9f-244d-477c-9102-ef590155a165 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] PATH_INFO: `/v3/projects/1dcdcb266ca54e028ef166139986b254` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:01.029697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b0d9f-244d-477c-9102-ef590155a165 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1dcdcb266ca54e028ef166139986b254)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:01.032210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b0d9f-244d-477c-9102-ef590155a165 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:01.166149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c61b0d9f-244d-477c-9102-ef590155a165 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dcdcb266ca54e028ef166139986b254', 'request_id': 'req-c61b0d9f-244d-477c-9102-ef590155a165'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:01.197574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c61b0d9f-244d-477c-9102-ef590155a165 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dcdcb266ca54e028ef166139986b254', 'request_id': 'req-c61b0d9f-244d-477c-9102-ef590155a165'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:01.206684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c61b0d9f-244d-477c-9102-ef590155a165 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dcdcb266ca54e028ef166139986b254', 'request_id': 'req-c61b0d9f-244d-477c-9102-ef590155a165'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:01.220698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c61b0d9f-244d-477c-9102-ef590155a165 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] The token cache is being invalidate because project 1dcdcb266ca54e028ef166139986b254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:29:01.221119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c61b0d9f-244d-477c-9102-ef590155a165 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:01.221930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c61b0d9f-244d-477c-9102-ef590155a165 tempest-QuotasNegativeTest-440681605 tempest-QuotasNegativeTest-440681605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:01.224101 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3040/6141] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:29:00 2022] DELETE /identity/v3/projects/1dcdcb266ca54e028ef166139986b254 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:01.228985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d16176-0702-4314-8e33-f10bef239732 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:01.338518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d16176-0702-4314-8e33-f10bef239732 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:01.409891 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:01.454096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:01.455299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:01.455553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:01.455821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] PATH_INFO: `/v3/users/b85826df25ac472db9cdf974db36b8b2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:01.457136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b85826df25ac472db9cdf974db36b8b2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:01.459804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:01.538873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b85826df25ac472db9cdf974db36b8b2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:01.540317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b85826df25ac472db9cdf974db36b8b2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:01.560823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b85826df25ac472db9cdf974db36b8b2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:01.573202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b85826df25ac472db9cdf974db36b8b2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:01.575154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b85826df25ac472db9cdf974db36b8b2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:01.608317 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3102/6142] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:29:01 2022] DELETE /identity/v3/users/b85826df25ac472db9cdf974db36b8b2 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:01.610164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc8e7-724d-4702-92d5-8b8fda3e5055 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:01.610457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc8e7-724d-4702-92d5-8b8fda3e5055 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:01.610737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc8e7-724d-4702-92d5-8b8fda3e5055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:01.629561 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:01.641050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-151bc8e7-724d-4702-92d5-8b8fda3e5055 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:01.645905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-151bc8e7-724d-4702-92d5-8b8fda3e5055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:01.738855 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3041/6143] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:01.791371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:01.796247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:01.969231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a1ed3-1fa4-4719-85b2-83235b316e08 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:01.979797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f9a6-32cf-465b-8726-5729995f3dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:01.980441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f9a6-32cf-465b-8726-5729995f3dba service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:01.981029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f9a6-32cf-465b-8726-5729995f3dba service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:01.981308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f9a6-32cf-465b-8726-5729995f3dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:02.006846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3f9a6-32cf-465b-8726-5729995f3dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:02.008344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3f9a6-32cf-465b-8726-5729995f3dba service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:02.031543 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3103/6144] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:29:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:29:03.960329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bc8e7-724d-4702-92d5-8b8fda3e5055 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:03.965770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-151bc8e7-724d-4702-92d5-8b8fda3e5055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:03.979392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bc8e7-724d-4702-92d5-8b8fda3e5055 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:03.984487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176b28d-a690-42cf-abd6-a4126574c625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:03.985365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176b28d-a690-42cf-abd6-a4126574c625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:03.985784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176b28d-a690-42cf-abd6-a4126574c625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:03.986063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176b28d-a690-42cf-abd6-a4126574c625 admin admin] PATH_INFO: `/v3/projects/4bdfcb33749347a3990528dd4492e09a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:03.992062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176b28d-a690-42cf-abd6-a4126574c625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bdfcb33749347a3990528dd4492e09a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:03.994393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176b28d-a690-42cf-abd6-a4126574c625 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:04.100888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d176b28d-a690-42cf-abd6-a4126574c625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bdfcb33749347a3990528dd4492e09a', 'request_id': 'req-d176b28d-a690-42cf-abd6-a4126574c625'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:04.119767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d176b28d-a690-42cf-abd6-a4126574c625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bdfcb33749347a3990528dd4492e09a', 'request_id': 'req-d176b28d-a690-42cf-abd6-a4126574c625'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:04.143545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d176b28d-a690-42cf-abd6-a4126574c625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bdfcb33749347a3990528dd4492e09a', 'request_id': 'req-d176b28d-a690-42cf-abd6-a4126574c625'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:04.158518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d176b28d-a690-42cf-abd6-a4126574c625 admin admin] The token cache is being invalidate because project 4bdfcb33749347a3990528dd4492e09a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:29:04.158818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d176b28d-a690-42cf-abd6-a4126574c625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:04.159510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d176b28d-a690-42cf-abd6-a4126574c625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:04.165389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f9a6-32cf-465b-8726-5729995f3dba service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:04.172070 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3042/6145] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:29:03 2022] DELETE /identity/v3/projects/4bdfcb33749347a3990528dd4492e09a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:04.179860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f9a6-32cf-465b-8726-5729995f3dba service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:04.275512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:04.276287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:04.276513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:04.276732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] PATH_INFO: `/v3/users/be2c9ee26f874ec3862b7843381cefb6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:04.280308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2c9ee26f874ec3862b7843381cefb6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:04.283311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:04.286169 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:04.384617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2c9ee26f874ec3862b7843381cefb6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:04.385318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2c9ee26f874ec3862b7843381cefb6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:04.419509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2c9ee26f874ec3862b7843381cefb6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:04.457959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2c9ee26f874ec3862b7843381cefb6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:04.459020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2c9ee26f874ec3862b7843381cefb6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:04.480174 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3104/6146] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:29:04 2022] DELETE /identity/v3/users/be2c9ee26f874ec3862b7843381cefb6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:04.654981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d27f9e-df52-4350-9ccb-04336aee0999 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:04.655304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d27f9e-df52-4350-9ccb-04336aee0999 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:04.655591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d27f9e-df52-4350-9ccb-04336aee0999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:04.704065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-41d27f9e-df52-4350-9ccb-04336aee0999 None None] MFA Rules not processed for user `f5f42a99ffbe407bb43f8aee0091f130`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:04.705579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-41d27f9e-df52-4350-9ccb-04336aee0999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:04.861493 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3043/6147] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:06.030280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:06.031786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:06.195629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72c1c1-c5a2-46db-8d17-3792e93b360c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:06.204650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b4a68-75da-4a81-b738-ed825663fdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:06.205226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4a68-75da-4a81-b738-ed825663fdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:06.205503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4a68-75da-4a81-b738-ed825663fdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:06.205773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4a68-75da-4a81-b738-ed825663fdbc admin admin] PATH_INFO: `/v3/projects/361a3071af1b46d8896af8cc722d443e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:06.214166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b4a68-75da-4a81-b738-ed825663fdbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=361a3071af1b46d8896af8cc722d443e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:06.216167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b4a68-75da-4a81-b738-ed825663fdbc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:06.375368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a5b4a68-75da-4a81-b738-ed825663fdbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361a3071af1b46d8896af8cc722d443e', 'request_id': 'req-3a5b4a68-75da-4a81-b738-ed825663fdbc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:06.399586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a5b4a68-75da-4a81-b738-ed825663fdbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361a3071af1b46d8896af8cc722d443e', 'request_id': 'req-3a5b4a68-75da-4a81-b738-ed825663fdbc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:06.419569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a5b4a68-75da-4a81-b738-ed825663fdbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361a3071af1b46d8896af8cc722d443e', 'request_id': 'req-3a5b4a68-75da-4a81-b738-ed825663fdbc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:06.440317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a5b4a68-75da-4a81-b738-ed825663fdbc admin admin] The token cache is being invalidate because project 361a3071af1b46d8896af8cc722d443e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:29:06.440616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a5b4a68-75da-4a81-b738-ed825663fdbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:06.442646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a5b4a68-75da-4a81-b738-ed825663fdbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:06.448861 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3105/6148] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:29:06 2022] DELETE /identity/v3/projects/361a3071af1b46d8896af8cc722d443e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:06.450579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8380185-c207-47d6-a626-3f76bc146e64 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:06.451067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8380185-c207-47d6-a626-3f76bc146e64 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:06.451144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8380185-c207-47d6-a626-3f76bc146e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:06.508162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e8380185-c207-47d6-a626-3f76bc146e64 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:06.509372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e8380185-c207-47d6-a626-3f76bc146e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:06.596139 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:06.676476 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3044/6149] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:06.688515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c9263-e881-4a2f-9fdf-095279dcd2c1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:06.689196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c9263-e881-4a2f-9fdf-095279dcd2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:06.689676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c9263-e881-4a2f-9fdf-095279dcd2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:06.755172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bb0c9263-e881-4a2f-9fdf-095279dcd2c1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:06.759900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bb0c9263-e881-4a2f-9fdf-095279dcd2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:06.786381 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3106/6150] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:06.791162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8380185-c207-47d6-a626-3f76bc146e64 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:06.806220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8380185-c207-47d6-a626-3f76bc146e64 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:06.827018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e78e05-fd9f-46ac-90ad-2077c301e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:06.827643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e78e05-fd9f-46ac-90ad-2077c301e897 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:06.827924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e78e05-fd9f-46ac-90ad-2077c301e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:06.828195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e78e05-fd9f-46ac-90ad-2077c301e897 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:06.828850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e78e05-fd9f-46ac-90ad-2077c301e897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:29:06.829147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e78e05-fd9f-46ac-90ad-2077c301e897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:06.830958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e78e05-fd9f-46ac-90ad-2077c301e897 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:06.914455 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3045/6151] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:29:06.918258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c9263-e881-4a2f-9fdf-095279dcd2c1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:06.923367 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:06.931928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c9263-e881-4a2f-9fdf-095279dcd2c1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:06.952277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635f680-5be8-4244-b7d2-65168d19ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:06.953061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635f680-5be8-4244-b7d2-65168d19ca4d admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:06.953448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635f680-5be8-4244-b7d2-65168d19ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:06.953818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635f680-5be8-4244-b7d2-65168d19ca4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:06.954582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635f680-5be8-4244-b7d2-65168d19ca4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:06.964128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635f680-5be8-4244-b7d2-65168d19ca4d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:07.077253 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3107/6152] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:29:06 2022] POST /identity/v3/projects => generated 407 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:29:07.081394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e78e05-fd9f-46ac-90ad-2077c301e897 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:07.106431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e78e05-fd9f-46ac-90ad-2077c301e897 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:07.301958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef60b3e-1fe3-4db2-8a22-3455329c3c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:07.302619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef60b3e-1fe3-4db2-8a22-3455329c3c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:07.302906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef60b3e-1fe3-4db2-8a22-3455329c3c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:07.303231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef60b3e-1fe3-4db2-8a22-3455329c3c81 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:07.303856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef60b3e-1fe3-4db2-8a22-3455329c3c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:07.305912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef60b3e-1fe3-4db2-8a22-3455329c3c81 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:07.366231 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3046/6153] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:29:07 2022] POST /identity/v3/users => generated 304 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:29:07.370415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635f680-5be8-4244-b7d2-65168d19ca4d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:07.388257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635f680-5be8-4244-b7d2-65168d19ca4d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:07.402779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc0136-fe07-4c6e-8372-b50fd45494b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:07.403777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0136-fe07-4c6e-8372-b50fd45494b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:07.411510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0136-fe07-4c6e-8372-b50fd45494b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:07.412244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0136-fe07-4c6e-8372-b50fd45494b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:07.413456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc0136-fe07-4c6e-8372-b50fd45494b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:07.415872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc0136-fe07-4c6e-8372-b50fd45494b8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:07.442966 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3108/6154] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:29:07.447164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef60b3e-1fe3-4db2-8a22-3455329c3c81 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:07.463828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef60b3e-1fe3-4db2-8a22-3455329c3c81 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:07.489260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3a5ea-8934-41da-8118-e9c344665054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:07.490273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3a5ea-8934-41da-8118-e9c344665054 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:07.490273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3a5ea-8934-41da-8118-e9c344665054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:07.490273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3a5ea-8934-41da-8118-e9c344665054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:07.492356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3a5ea-8934-41da-8118-e9c344665054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:07.510469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3a5ea-8934-41da-8118-e9c344665054 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:07.543673 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3047/6155] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:29:07.547713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc0136-fe07-4c6e-8372-b50fd45494b8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:07.560476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc0136-fe07-4c6e-8372-b50fd45494b8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:07.590858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecf5d2-35bb-4dad-b21e-53e7bf07bdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:07.591595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecf5d2-35bb-4dad-b21e-53e7bf07bdd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:07.591876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecf5d2-35bb-4dad-b21e-53e7bf07bdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:07.592152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecf5d2-35bb-4dad-b21e-53e7bf07bdd6 admin admin] PATH_INFO: `/v3/projects/54c1ebae256e4f1e89cb00fb9b81d714/users/202b5ecfaa314a708558179479ffe137/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:07.630171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecf5d2-35bb-4dad-b21e-53e7bf07bdd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c1ebae256e4f1e89cb00fb9b81d714, user_id=202b5ecfaa314a708558179479ffe137, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:07.633065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecf5d2-35bb-4dad-b21e-53e7bf07bdd6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:07.664383 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3109/6156] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:29:07 2022] PUT /identity/v3/projects/54c1ebae256e4f1e89cb00fb9b81d714/users/202b5ecfaa314a708558179479ffe137/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:07.677554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae373f-e89d-43f2-8c6b-b35386185185 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:07.678143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae373f-e89d-43f2-8c6b-b35386185185 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:07.678712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae373f-e89d-43f2-8c6b-b35386185185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:07.753552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8cae373f-e89d-43f2-8c6b-b35386185185 None None] MFA Rules not processed for user `202b5ecfaa314a708558179479ffe137`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:07.755593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8cae373f-e89d-43f2-8c6b-b35386185185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:07.916162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecf5d2-35bb-4dad-b21e-53e7bf07bdd6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:07.933151 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3048/6157] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:07 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:08.144918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecf5d2-35bb-4dad-b21e-53e7bf07bdd6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:08.156217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5d35-81ca-47bc-95e9-0aae2727dcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:08.158057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5d35-81ca-47bc-95e9-0aae2727dcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:08.158474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5d35-81ca-47bc-95e9-0aae2727dcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:08.160095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5d35-81ca-47bc-95e9-0aae2727dcd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:08.160095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a5d35-81ca-47bc-95e9-0aae2727dcd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:08.162763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a5d35-81ca-47bc-95e9-0aae2727dcd6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:08.237784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae373f-e89d-43f2-8c6b-b35386185185 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:08.245501 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3110/6158] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:29:07 2022] POST /identity/v3/projects => generated 405 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:29:08.257930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae373f-e89d-43f2-8c6b-b35386185185 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:08.346402 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:08.413726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19010181-5704-45ae-842b-daed6bc6e89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:08.415683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010181-5704-45ae-842b-daed6bc6e89a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:08.416405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010181-5704-45ae-842b-daed6bc6e89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:08.417078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010181-5704-45ae-842b-daed6bc6e89a admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:08.417924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19010181-5704-45ae-842b-daed6bc6e89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:08.420424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19010181-5704-45ae-842b-daed6bc6e89a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:08.481222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5d35-81ca-47bc-95e9-0aae2727dcd6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:08.491246 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3049/6159] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:29:08 2022] POST /identity/v3/users => generated 309 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:29:08.506306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5d35-81ca-47bc-95e9-0aae2727dcd6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:08.512289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41338dfe-03f2-4d76-a02e-e5435d58f487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:08.513209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41338dfe-03f2-4d76-a02e-e5435d58f487 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:08.513725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41338dfe-03f2-4d76-a02e-e5435d58f487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:08.514216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41338dfe-03f2-4d76-a02e-e5435d58f487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:08.515455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41338dfe-03f2-4d76-a02e-e5435d58f487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:08.517390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41338dfe-03f2-4d76-a02e-e5435d58f487 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:08.545558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19010181-5704-45ae-842b-daed6bc6e89a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:08.546639 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3111/6160] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:29:08.560124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19010181-5704-45ae-842b-daed6bc6e89a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:08.581285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1f3de-4800-450c-9c0b-a78e2442ce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:08.581910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1f3de-4800-450c-9c0b-a78e2442ce2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:08.582295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1f3de-4800-450c-9c0b-a78e2442ce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:08.582684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1f3de-4800-450c-9c0b-a78e2442ce2c admin admin] PATH_INFO: `/v3/projects/31b01fe741dc400093de0de4960a0b1b/users/5861d5cacdd24bd3a83eb1efe5ba9d10/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:08.619893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1f3de-4800-450c-9c0b-a78e2442ce2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b01fe741dc400093de0de4960a0b1b, user_id=5861d5cacdd24bd3a83eb1efe5ba9d10, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:08.622832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1f3de-4800-450c-9c0b-a78e2442ce2c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:08.654137 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3050/6161] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:29:08 2022] PUT /identity/v3/projects/31b01fe741dc400093de0de4960a0b1b/users/5861d5cacdd24bd3a83eb1efe5ba9d10/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:08.658386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41338dfe-03f2-4d76-a02e-e5435d58f487 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:08.672528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41338dfe-03f2-4d76-a02e-e5435d58f487 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:08.787014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73dff0-5e9f-40b5-9cbe-c6264e5d6e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:08.787785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73dff0-5e9f-40b5-9cbe-c6264e5d6e78 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:08.788197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73dff0-5e9f-40b5-9cbe-c6264e5d6e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:08.788598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73dff0-5e9f-40b5-9cbe-c6264e5d6e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:08.789594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73dff0-5e9f-40b5-9cbe-c6264e5d6e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:08.793117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73dff0-5e9f-40b5-9cbe-c6264e5d6e78 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:08.821924 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3112/6162] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:29:08.826744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1f3de-4800-450c-9c0b-a78e2442ce2c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:08.841730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1f3de-4800-450c-9c0b-a78e2442ce2c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:08.857020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2b449-4d88-4154-aaa2-cd7248f7afe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:08.858074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2b449-4d88-4154-aaa2-cd7248f7afe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:08.858598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2b449-4d88-4154-aaa2-cd7248f7afe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:08.859136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2b449-4d88-4154-aaa2-cd7248f7afe8 admin admin] PATH_INFO: `/v3/projects/31b01fe741dc400093de0de4960a0b1b/users/5861d5cacdd24bd3a83eb1efe5ba9d10/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:08.864699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2b449-4d88-4154-aaa2-cd7248f7afe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b01fe741dc400093de0de4960a0b1b, user_id=5861d5cacdd24bd3a83eb1efe5ba9d10, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:08.873645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2b449-4d88-4154-aaa2-cd7248f7afe8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:08.903434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052670b1-5d30-4712-8208-630ca42d0f99 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:08.903434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052670b1-5d30-4712-8208-630ca42d0f99 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:08.903718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052670b1-5d30-4712-8208-630ca42d0f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:08.904104 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3051/6163] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:29:08 2022] PUT /identity/v3/projects/31b01fe741dc400093de0de4960a0b1b/users/5861d5cacdd24bd3a83eb1efe5ba9d10/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:09.014670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-052670b1-5d30-4712-8208-630ca42d0f99 None None] MFA Rules not processed for user `5861d5cacdd24bd3a83eb1efe5ba9d10`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:09.017030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-052670b1-5d30-4712-8208-630ca42d0f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:09.023521 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:09.215225 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3113/6164] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:08 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:09.319728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2b449-4d88-4154-aaa2-cd7248f7afe8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:09.322274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-99a2b449-4d88-4154-aaa2-cd7248f7afe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:09.406116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2b449-4d88-4154-aaa2-cd7248f7afe8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:09.410358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dd156-d01f-4a7c-bea9-ade12d0adf7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:09.418152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dd156-d01f-4a7c-bea9-ade12d0adf7c service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:09.418562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dd156-d01f-4a7c-bea9-ade12d0adf7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:09.418955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dd156-d01f-4a7c-bea9-ade12d0adf7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:09.528294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dd156-d01f-4a7c-bea9-ade12d0adf7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:09.529763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dd156-d01f-4a7c-bea9-ade12d0adf7c service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:09.542007 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3052/6165] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:29:09 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:29:11.160854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052670b1-5d30-4712-8208-630ca42d0f99 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:11.162252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-052670b1-5d30-4712-8208-630ca42d0f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:11.349942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052670b1-5d30-4712-8208-630ca42d0f99 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:11.366655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934dd59-c60b-485e-b6ff-eb427fb4bba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:11.367739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934dd59-c60b-485e-b6ff-eb427fb4bba0 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:11.368308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934dd59-c60b-485e-b6ff-eb427fb4bba0 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:11.368791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934dd59-c60b-485e-b6ff-eb427fb4bba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:11.381315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934dd59-c60b-485e-b6ff-eb427fb4bba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:11.385591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934dd59-c60b-485e-b6ff-eb427fb4bba0 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:11.402512 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3114/6166] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:29:11 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:29:19.537140 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=78,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:21.396675 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=69 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:29.963223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dd156-d01f-4a7c-bea9-ade12d0adf7c service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:29.965827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-310dd156-d01f-4a7c-bea9-ade12d0adf7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:30.104408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dd156-d01f-4a7c-bea9-ade12d0adf7c service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:30.118956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c71624-0e96-49cd-b03a-6c09e4c8c42a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:30.120972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c71624-0e96-49cd-b03a-6c09e4c8c42a service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:30.121335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c71624-0e96-49cd-b03a-6c09e4c8c42a service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:30.123859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c71624-0e96-49cd-b03a-6c09e4c8c42a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:30.132062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-78c71624-0e96-49cd-b03a-6c09e4c8c42a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:30.152193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c71624-0e96-49cd-b03a-6c09e4c8c42a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:30.156920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c71624-0e96-49cd-b03a-6c09e4c8c42a service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:30.184323 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3053/6167] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:29:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:29:31.457707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934dd59-c60b-485e-b6ff-eb427fb4bba0 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:31.460308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3934dd59-c60b-485e-b6ff-eb427fb4bba0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:31.506824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934dd59-c60b-485e-b6ff-eb427fb4bba0 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:31.513125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc95b0-274b-46b0-982b-763e9756a0cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:31.514008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc95b0-274b-46b0-982b-763e9756a0cf service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:31.514570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc95b0-274b-46b0-982b-763e9756a0cf service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:31.515082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc95b0-274b-46b0-982b-763e9756a0cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:31.517172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cbcc95b0-274b-46b0-982b-763e9756a0cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:31.532730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc95b0-274b-46b0-982b-763e9756a0cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:31.534691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc95b0-274b-46b0-982b-763e9756a0cf service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:31.565270 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3115/6168] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:29:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:29:31.594539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c71624-0e96-49cd-b03a-6c09e4c8c42a service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:31.674361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c71624-0e96-49cd-b03a-6c09e4c8c42a service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:31.679654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:31.680452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:31.680834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:31.681243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] PATH_INFO: `/v3/users/202b5ecfaa314a708558179479ffe137` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:31.682585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=202b5ecfaa314a708558179479ffe137)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:31.684754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:31.769889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '202b5ecfaa314a708558179479ffe137'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:31.770736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '202b5ecfaa314a708558179479ffe137'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:31.799688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '202b5ecfaa314a708558179479ffe137'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:31.825388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '202b5ecfaa314a708558179479ffe137'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:31.826102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '202b5ecfaa314a708558179479ffe137'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:31.850295 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3054/6169] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:29:31 2022] DELETE /identity/v3/users/202b5ecfaa314a708558179479ffe137 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:31.854300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804c1c5-e396-4bb0-b8e4-10660f741a4a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:31.854817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804c1c5-e396-4bb0-b8e4-10660f741a4a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:31.855486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804c1c5-e396-4bb0-b8e4-10660f741a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:31.921504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0804c1c5-e396-4bb0-b8e4-10660f741a4a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:31.923733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0804c1c5-e396-4bb0-b8e4-10660f741a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:32.107294 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3116/6170] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:32.163997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:32.167724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:32.194285 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:32.362071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7ea0b-dd50-4919-9a17-8cc4d7c804b7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:32.376719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfb64c-9fa6-418d-9e61-99340c2e0f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:32.377420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfb64c-9fa6-418d-9e61-99340c2e0f2f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:32.377636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfb64c-9fa6-418d-9e61-99340c2e0f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:32.377906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfb64c-9fa6-418d-9e61-99340c2e0f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:32.400008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfb64c-9fa6-418d-9e61-99340c2e0f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:32.402513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfb64c-9fa6-418d-9e61-99340c2e0f2f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:32.417615 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3055/6171] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:29:32.761124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804c1c5-e396-4bb0-b8e4-10660f741a4a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:32.762595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0804c1c5-e396-4bb0-b8e4-10660f741a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:32.786524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804c1c5-e396-4bb0-b8e4-10660f741a4a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:32.803718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:32.804419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:32.804723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:32.805063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] PATH_INFO: `/v3/projects/54c1ebae256e4f1e89cb00fb9b81d714` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:32.806241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c1ebae256e4f1e89cb00fb9b81d714)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:32.808216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:32.891422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c1ebae256e4f1e89cb00fb9b81d714', 'request_id': 'req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:32.905029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c1ebae256e4f1e89cb00fb9b81d714', 'request_id': 'req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:32.926562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c1ebae256e4f1e89cb00fb9b81d714', 'request_id': 'req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:32.961279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] The token cache is being invalidate because project 54c1ebae256e4f1e89cb00fb9b81d714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:29:32.962284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:32.963929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:32.970736 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3117/6172] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:29:32 2022] DELETE /identity/v3/projects/54c1ebae256e4f1e89cb00fb9b81d714 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:32.975927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfb64c-9fa6-418d-9e61-99340c2e0f2f service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:32.990591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfb64c-9fa6-418d-9e61-99340c2e0f2f service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:33.107667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3e9f2-5279-4172-b1f4-157b8261eb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:33.111247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3e9f2-5279-4172-b1f4-157b8261eb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:33.111559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3e9f2-5279-4172-b1f4-157b8261eb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:33.111943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3e9f2-5279-4172-b1f4-157b8261eb69 admin admin] PATH_INFO: `/v3/users/5861d5cacdd24bd3a83eb1efe5ba9d10` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:33.113469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3e9f2-5279-4172-b1f4-157b8261eb69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5861d5cacdd24bd3a83eb1efe5ba9d10)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:33.115776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3e9f2-5279-4172-b1f4-157b8261eb69 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:33.207501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-55e3e9f2-5279-4172-b1f4-157b8261eb69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5861d5cacdd24bd3a83eb1efe5ba9d10'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:33.208694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-55e3e9f2-5279-4172-b1f4-157b8261eb69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5861d5cacdd24bd3a83eb1efe5ba9d10'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:33.231059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-55e3e9f2-5279-4172-b1f4-157b8261eb69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5861d5cacdd24bd3a83eb1efe5ba9d10'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:33.256036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-55e3e9f2-5279-4172-b1f4-157b8261eb69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5861d5cacdd24bd3a83eb1efe5ba9d10'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:33.257341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-55e3e9f2-5279-4172-b1f4-157b8261eb69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5861d5cacdd24bd3a83eb1efe5ba9d10'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:33.291635 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3056/6173] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:29:32 2022] DELETE /identity/v3/users/5861d5cacdd24bd3a83eb1efe5ba9d10 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:34.271401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:34.273334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:34.292406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa6cce-1678-4fb1-8af7-5a5d3f9a41e8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:34.383980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bbda4-3693-4000-8857-5d1e844c522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:34.384901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bbda4-3693-4000-8857-5d1e844c522b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:34.385197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bbda4-3693-4000-8857-5d1e844c522b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:34.385467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bbda4-3693-4000-8857-5d1e844c522b admin admin] PATH_INFO: `/v3/projects/31b01fe741dc400093de0de4960a0b1b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:34.386679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bbda4-3693-4000-8857-5d1e844c522b admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b01fe741dc400093de0de4960a0b1b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:34.390716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bbda4-3693-4000-8857-5d1e844c522b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:34.408645 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:34.472059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-476bbda4-3693-4000-8857-5d1e844c522b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b01fe741dc400093de0de4960a0b1b', 'request_id': 'req-476bbda4-3693-4000-8857-5d1e844c522b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:34.481459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-476bbda4-3693-4000-8857-5d1e844c522b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b01fe741dc400093de0de4960a0b1b', 'request_id': 'req-476bbda4-3693-4000-8857-5d1e844c522b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:34.495859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-476bbda4-3693-4000-8857-5d1e844c522b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b01fe741dc400093de0de4960a0b1b', 'request_id': 'req-476bbda4-3693-4000-8857-5d1e844c522b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:34.524689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-476bbda4-3693-4000-8857-5d1e844c522b admin admin] The token cache is being invalidate because project 31b01fe741dc400093de0de4960a0b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:29:34.525556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-476bbda4-3693-4000-8857-5d1e844c522b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:34.526572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-476bbda4-3693-4000-8857-5d1e844c522b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:34.529313 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3118/6174] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:29:34 2022] DELETE /identity/v3/projects/31b01fe741dc400093de0de4960a0b1b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:29:34.534168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113f5f9-3c17-4712-b1c2-e47e1b9b283e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:34.535411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113f5f9-3c17-4712-b1c2-e47e1b9b283e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:34.535904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113f5f9-3c17-4712-b1c2-e47e1b9b283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:34.577902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b113f5f9-3c17-4712-b1c2-e47e1b9b283e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:34.579534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b113f5f9-3c17-4712-b1c2-e47e1b9b283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:34.619507 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:34.695527 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3057/6175] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:34.703624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4ead-7765-41a0-818c-0f47f11703c5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:34.704029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4ead-7765-41a0-818c-0f47f11703c5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:34.704406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4ead-7765-41a0-818c-0f47f11703c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:34.737586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-937b4ead-7765-41a0-818c-0f47f11703c5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:34.741721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-937b4ead-7765-41a0-818c-0f47f11703c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:34.760690 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3119/6176] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:34.761631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113f5f9-3c17-4712-b1c2-e47e1b9b283e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:34.773437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113f5f9-3c17-4712-b1c2-e47e1b9b283e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:34.780321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943479e3-4800-4b0a-adc1-b6d2d19d5ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:34.780949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943479e3-4800-4b0a-adc1-b6d2d19d5ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:34.781274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943479e3-4800-4b0a-adc1-b6d2d19d5ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:34.781551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943479e3-4800-4b0a-adc1-b6d2d19d5ff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:34.784598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943479e3-4800-4b0a-adc1-b6d2d19d5ff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:29:34.785036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943479e3-4800-4b0a-adc1-b6d2d19d5ff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:34.787495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943479e3-4800-4b0a-adc1-b6d2d19d5ff3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:34.806817 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3058/6177] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:29:34.811459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b4ead-7765-41a0-818c-0f47f11703c5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:34.827640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b4ead-7765-41a0-818c-0f47f11703c5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:34.841803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df153d-be6d-4be8-877e-de9a72821941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:34.849189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df153d-be6d-4be8-877e-de9a72821941 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:34.849189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df153d-be6d-4be8-877e-de9a72821941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:34.849189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df153d-be6d-4be8-877e-de9a72821941 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:34.849189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df153d-be6d-4be8-877e-de9a72821941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:34.849189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df153d-be6d-4be8-877e-de9a72821941 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:34.897928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943479e3-4800-4b0a-adc1-b6d2d19d5ff3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:34.898139 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3120/6178] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:29:34 2022] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:29:34.914548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943479e3-4800-4b0a-adc1-b6d2d19d5ff3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:35.018747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356c34d-39e1-4f73-b47c-80881260a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:35.022338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356c34d-39e1-4f73-b47c-80881260a5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:35.022779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356c34d-39e1-4f73-b47c-80881260a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:35.023095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356c34d-39e1-4f73-b47c-80881260a5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:35.028581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356c34d-39e1-4f73-b47c-80881260a5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:35.031172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356c34d-39e1-4f73-b47c-80881260a5e8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:35.083307 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3059/6179] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:29:34 2022] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:29:35.087901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df153d-be6d-4be8-877e-de9a72821941 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:35.105502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df153d-be6d-4be8-877e-de9a72821941 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:35.113112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f6d33-4584-4e7b-b411-254e6172a69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:35.113747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f6d33-4584-4e7b-b411-254e6172a69f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:35.114031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f6d33-4584-4e7b-b411-254e6172a69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:35.114307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f6d33-4584-4e7b-b411-254e6172a69f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:35.115058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f6d33-4584-4e7b-b411-254e6172a69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:35.117726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f6d33-4584-4e7b-b411-254e6172a69f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:35.137060 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3121/6180] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:29:35.137510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356c34d-39e1-4f73-b47c-80881260a5e8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:35.153606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356c34d-39e1-4f73-b47c-80881260a5e8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:35.162089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce0610-46c4-4b4c-a090-7a4bb5cfb821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:35.163124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0610-46c4-4b4c-a090-7a4bb5cfb821 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:35.163488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0610-46c4-4b4c-a090-7a4bb5cfb821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:35.164351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0610-46c4-4b4c-a090-7a4bb5cfb821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:35.165543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce0610-46c4-4b4c-a090-7a4bb5cfb821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:35.167976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce0610-46c4-4b4c-a090-7a4bb5cfb821 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:35.186036 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3060/6181] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:29:35.191506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f6d33-4584-4e7b-b411-254e6172a69f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:35.206225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f6d33-4584-4e7b-b411-254e6172a69f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:35.212240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197d672-1230-40f8-b282-59b1821029f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:35.213891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197d672-1230-40f8-b282-59b1821029f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:35.216593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197d672-1230-40f8-b282-59b1821029f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:35.216895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197d672-1230-40f8-b282-59b1821029f8 admin admin] PATH_INFO: `/v3/projects/a0bb8d08d2b749e685e4cfa83af8ed83/users/27bf7c73c844466f91294a6ef7749fb9/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:35.268327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197d672-1230-40f8-b282-59b1821029f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bb8d08d2b749e685e4cfa83af8ed83, user_id=27bf7c73c844466f91294a6ef7749fb9, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:35.280765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197d672-1230-40f8-b282-59b1821029f8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:35.313000 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3122/6182] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:29:35 2022] PUT /identity/v3/projects/a0bb8d08d2b749e685e4cfa83af8ed83/users/27bf7c73c844466f91294a6ef7749fb9/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:35.324453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba45ac9-8d9a-4f18-9be4-a72f8b26e107 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:35.324740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba45ac9-8d9a-4f18-9be4-a72f8b26e107 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:35.325016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba45ac9-8d9a-4f18-9be4-a72f8b26e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:35.371921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1ba45ac9-8d9a-4f18-9be4-a72f8b26e107 None None] MFA Rules not processed for user `27bf7c73c844466f91294a6ef7749fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:35.373504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1ba45ac9-8d9a-4f18-9be4-a72f8b26e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:35.514428 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3061/6183] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:35.574107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197d672-1230-40f8-b282-59b1821029f8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:35.579712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7197d672-1230-40f8-b282-59b1821029f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:35.688954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197d672-1230-40f8-b282-59b1821029f8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:35.695575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bf7f7-861f-4dea-b792-dc00a69e3ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:35.697845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf7f7-861f-4dea-b792-dc00a69e3ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:35.698522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf7f7-861f-4dea-b792-dc00a69e3ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:35.698823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf7f7-861f-4dea-b792-dc00a69e3ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:35.716360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bf7f7-861f-4dea-b792-dc00a69e3ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:35.719234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bf7f7-861f-4dea-b792-dc00a69e3ec3 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:35.733040 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3123/6184] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:29:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:29:35.833463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba45ac9-8d9a-4f18-9be4-a72f8b26e107 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:35.955491 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:36.040263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba45ac9-8d9a-4f18-9be4-a72f8b26e107 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:36.046200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:36.046894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:36.047219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:36.047493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] PATH_INFO: `/v3/users/27bf7c73c844466f91294a6ef7749fb9` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:36.048681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] RBAC: Authorizing `identity:delete_user(user_id=27bf7c73c844466f91294a6ef7749fb9)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:36.053385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:36.168838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27bf7c73c844466f91294a6ef7749fb9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:36.171758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27bf7c73c844466f91294a6ef7749fb9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:36.189451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27bf7c73c844466f91294a6ef7749fb9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:36.202794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27bf7c73c844466f91294a6ef7749fb9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:36.204920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27bf7c73c844466f91294a6ef7749fb9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:36.224555 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3062/6185] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:29:35 2022] DELETE /identity/v3/users/27bf7c73c844466f91294a6ef7749fb9 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:36.226381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26361d-e14d-4262-8c20-839e17f93369 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:36.227329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26361d-e14d-4262-8c20-839e17f93369 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:36.227849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26361d-e14d-4262-8c20-839e17f93369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:36.260921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3b26361d-e14d-4262-8c20-839e17f93369 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:36.263547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3b26361d-e14d-4262-8c20-839e17f93369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:36.340915 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:36.392154 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3124/6186] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:36.411849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:36.413480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:36.532058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1d187-581d-45fb-9797-754177c8166b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:36.538335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d4ba8-f89e-4d6e-ad59-d606138c9230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:36.539641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d4ba8-f89e-4d6e-ad59-d606138c9230 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:36.540175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d4ba8-f89e-4d6e-ad59-d606138c9230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:36.540701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d4ba8-f89e-4d6e-ad59-d606138c9230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:36.552700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d4ba8-f89e-4d6e-ad59-d606138c9230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:36.554623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d4ba8-f89e-4d6e-ad59-d606138c9230 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:36.570364 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3063/6187] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:29:38.462886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26361d-e14d-4262-8c20-839e17f93369 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:38.464507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3b26361d-e14d-4262-8c20-839e17f93369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:38.487954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26361d-e14d-4262-8c20-839e17f93369 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:38.489873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae7d0c-dcd7-4a9f-ae6d-266cf91bbc4f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:38.490334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae7d0c-dcd7-4a9f-ae6d-266cf91bbc4f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:38.490534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae7d0c-dcd7-4a9f-ae6d-266cf91bbc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:38.499677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a215e-aae2-424e-9e51-1cccde458e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:38.500683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a215e-aae2-424e-9e51-1cccde458e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:38.500960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a215e-aae2-424e-9e51-1cccde458e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:38.501512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a215e-aae2-424e-9e51-1cccde458e9e admin admin] PATH_INFO: `/v3/projects/a0bb8d08d2b749e685e4cfa83af8ed83` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:38.504834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a215e-aae2-424e-9e51-1cccde458e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0bb8d08d2b749e685e4cfa83af8ed83)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:38.507137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a215e-aae2-424e-9e51-1cccde458e9e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:38.519151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f8ae7d0c-dcd7-4a9f-ae6d-266cf91bbc4f None None] MFA Rules not processed for user `1fbc6af4172d4f3d95ae57485bf6d7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:38.528624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f8ae7d0c-dcd7-4a9f-ae6d-266cf91bbc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:38.633863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-178a215e-aae2-424e-9e51-1cccde458e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0bb8d08d2b749e685e4cfa83af8ed83', 'request_id': 'req-178a215e-aae2-424e-9e51-1cccde458e9e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:38.634406 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:38.646971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-178a215e-aae2-424e-9e51-1cccde458e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0bb8d08d2b749e685e4cfa83af8ed83', 'request_id': 'req-178a215e-aae2-424e-9e51-1cccde458e9e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:38.659732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-178a215e-aae2-424e-9e51-1cccde458e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0bb8d08d2b749e685e4cfa83af8ed83', 'request_id': 'req-178a215e-aae2-424e-9e51-1cccde458e9e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:38.684611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-178a215e-aae2-424e-9e51-1cccde458e9e admin admin] The token cache is being invalidate because project a0bb8d08d2b749e685e4cfa83af8ed83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:29:38.688891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-178a215e-aae2-424e-9e51-1cccde458e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:38.689828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-178a215e-aae2-424e-9e51-1cccde458e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:29:38.701367 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3064/6188] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:29:38.701564 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3125/6189] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:29:38 2022] DELETE /identity/v3/projects/a0bb8d08d2b749e685e4cfa83af8ed83 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:29:38.702491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dea8a4-6cf6-48ed-a58e-cd53b46d9e75 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:38.702784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dea8a4-6cf6-48ed-a58e-cd53b46d9e75 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:38.703087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dea8a4-6cf6-48ed-a58e-cd53b46d9e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:38.755566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-55dea8a4-6cf6-48ed-a58e-cd53b46d9e75 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:38.756944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-55dea8a4-6cf6-48ed-a58e-cd53b46d9e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:38.855900 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3065/6190] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:38.866333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e153456-7f96-4ab0-8722-d6ae77e03cf0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:38.866728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e153456-7f96-4ab0-8722-d6ae77e03cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:38.867034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e153456-7f96-4ab0-8722-d6ae77e03cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:38.907034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3e153456-7f96-4ab0-8722-d6ae77e03cf0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:38.908584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3e153456-7f96-4ab0-8722-d6ae77e03cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:38.919867 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3126/6191] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:38.926132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dea8a4-6cf6-48ed-a58e-cd53b46d9e75 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:38.951415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dea8a4-6cf6-48ed-a58e-cd53b46d9e75 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:38.958008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eeb2d-8002-49b1-86f1-ac86595c454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:38.958977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eeb2d-8002-49b1-86f1-ac86595c454e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:38.959444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eeb2d-8002-49b1-86f1-ac86595c454e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:38.959894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eeb2d-8002-49b1-86f1-ac86595c454e admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:38.960753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eeb2d-8002-49b1-86f1-ac86595c454e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:29:38.961844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eeb2d-8002-49b1-86f1-ac86595c454e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:38.963856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eeb2d-8002-49b1-86f1-ac86595c454e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:38.979479 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3066/6192] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:29:38.983426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e153456-7f96-4ab0-8722-d6ae77e03cf0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:38.994828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e153456-7f96-4ab0-8722-d6ae77e03cf0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:39.000418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e691a-2bc3-4d4d-9ccf-0e9373943c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:39.001637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e691a-2bc3-4d4d-9ccf-0e9373943c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:39.002100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e691a-2bc3-4d4d-9ccf-0e9373943c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:39.002796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e691a-2bc3-4d4d-9ccf-0e9373943c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:39.004061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e691a-2bc3-4d4d-9ccf-0e9373943c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:39.006724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e691a-2bc3-4d4d-9ccf-0e9373943c06 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:39.057474 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3127/6193] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:29:38 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:29:39.061622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eeb2d-8002-49b1-86f1-ac86595c454e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:39.076055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eeb2d-8002-49b1-86f1-ac86595c454e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:39.180081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d062f-e365-4475-b4a0-4768430faacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:39.180849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d062f-e365-4475-b4a0-4768430faacc admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:39.181230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d062f-e365-4475-b4a0-4768430faacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:39.181757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d062f-e365-4475-b4a0-4768430faacc admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:39.182594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d062f-e365-4475-b4a0-4768430faacc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:39.185129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d062f-e365-4475-b4a0-4768430faacc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:39.244886 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3067/6194] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:29:39 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:29:39.250601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e691a-2bc3-4d4d-9ccf-0e9373943c06 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:39.281298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e691a-2bc3-4d4d-9ccf-0e9373943c06 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:39.290893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e416b-766c-4f1c-b6fe-7efda6748f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:39.291696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e416b-766c-4f1c-b6fe-7efda6748f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:39.292614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e416b-766c-4f1c-b6fe-7efda6748f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:39.293071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e416b-766c-4f1c-b6fe-7efda6748f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:39.294113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e416b-766c-4f1c-b6fe-7efda6748f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:39.296002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e416b-766c-4f1c-b6fe-7efda6748f88 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:39.322366 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3128/6195] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:29:39.336866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d062f-e365-4475-b4a0-4768430faacc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:39.355776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d062f-e365-4475-b4a0-4768430faacc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:39.371105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978225f3-7ecf-415a-9365-9e10994dd8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:39.371987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978225f3-7ecf-415a-9365-9e10994dd8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:39.372421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978225f3-7ecf-415a-9365-9e10994dd8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:39.374170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978225f3-7ecf-415a-9365-9e10994dd8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:39.375880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978225f3-7ecf-415a-9365-9e10994dd8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:39.382827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978225f3-7ecf-415a-9365-9e10994dd8e6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:39.421705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e416b-766c-4f1c-b6fe-7efda6748f88 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:39.423161 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3068/6196] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:29:39.430778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e416b-766c-4f1c-b6fe-7efda6748f88 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:39.451803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb192a-4237-4856-80d2-0efdce00b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:39.452505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb192a-4237-4856-80d2-0efdce00b776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:39.452790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb192a-4237-4856-80d2-0efdce00b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:39.453068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb192a-4237-4856-80d2-0efdce00b776 admin admin] PATH_INFO: `/v3/projects/96b75903dbc94bb4a13646b677bdebf7/users/29558de38c454aec80b21692aba3d038/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:39.489988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb192a-4237-4856-80d2-0efdce00b776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b75903dbc94bb4a13646b677bdebf7, user_id=29558de38c454aec80b21692aba3d038, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:39.494622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb192a-4237-4856-80d2-0efdce00b776 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:39.542995 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3129/6197] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:29:39 2022] PUT /identity/v3/projects/96b75903dbc94bb4a13646b677bdebf7/users/29558de38c454aec80b21692aba3d038/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:29:39.546094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff564f-cb9c-4788-b277-168f44504489 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:39.546538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff564f-cb9c-4788-b277-168f44504489 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:39.546680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff564f-cb9c-4788-b277-168f44504489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:39.615053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f4ff564f-cb9c-4788-b277-168f44504489 None None] MFA Rules not processed for user `29558de38c454aec80b21692aba3d038`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:29:39.617247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f4ff564f-cb9c-4788-b277-168f44504489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:39.730047 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:39.783747 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3069/6198] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:29:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:29:39.800677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb192a-4237-4856-80d2-0efdce00b776 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:29:39.803085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ddfb192a-4237-4856-80d2-0efdce00b776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:29:39.984937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb192a-4237-4856-80d2-0efdce00b776 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:29:39.990353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d10f9-fb93-4937-94f5-0bc2e35b8d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:29:39.991500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d10f9-fb93-4937-94f5-0bc2e35b8d7c service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:29:39.991965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d10f9-fb93-4937-94f5-0bc2e35b8d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:29:39.992448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d10f9-fb93-4937-94f5-0bc2e35b8d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:29:40.007991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d10f9-fb93-4937-94f5-0bc2e35b8d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:29:40.009826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d10f9-fb93-4937-94f5-0bc2e35b8d7c service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:29:40.029956 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3130/6199] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:29:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:29:49.779801 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:50.015917 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:13.063670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff564f-cb9c-4788-b277-168f44504489 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:13.065148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f4ff564f-cb9c-4788-b277-168f44504489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:13.236561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff564f-cb9c-4788-b277-168f44504489 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:13.242222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:13.243240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:13.243735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:13.244221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] PATH_INFO: `/v3/users/f5f42a99ffbe407bb43f8aee0091f130` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:13.246137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f42a99ffbe407bb43f8aee0091f130)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:13.248852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:13.382738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f42a99ffbe407bb43f8aee0091f130'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:13.387343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f42a99ffbe407bb43f8aee0091f130'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:13.414345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f42a99ffbe407bb43f8aee0091f130'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:13.428700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f42a99ffbe407bb43f8aee0091f130'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:13.430239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f42a99ffbe407bb43f8aee0091f130'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:13.457045 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3070/6200] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:30:13 2022] DELETE /identity/v3/users/f5f42a99ffbe407bb43f8aee0091f130 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:13.457346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8e791-738f-45b5-a8a1-be163c7c9851 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:13.457828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8e791-738f-45b5-a8a1-be163c7c9851 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:13.457926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8e791-738f-45b5-a8a1-be163c7c9851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:13.514235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2db8e791-738f-45b5-a8a1-be163c7c9851 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:30:13.515627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2db8e791-738f-45b5-a8a1-be163c7c9851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:13.637072 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3131/6201] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:30:13.658778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:13.664152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:13.819721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008d8ec-1f93-4599-b15d-d238a4b161fe admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:13.831594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bbb99-55c6-423e-9f7f-1ec67075b0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:13.832976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bbb99-55c6-423e-9f7f-1ec67075b0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:13.833481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bbb99-55c6-423e-9f7f-1ec67075b0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:13.833850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bbb99-55c6-423e-9f7f-1ec67075b0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:13.849691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75bbb99-55c6-423e-9f7f-1ec67075b0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:13.851362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75bbb99-55c6-423e-9f7f-1ec67075b0e6 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:13.873432 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3071/6202] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:30:14.396372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8e791-738f-45b5-a8a1-be163c7c9851 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:14.400173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2db8e791-738f-45b5-a8a1-be163c7c9851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:14.419007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8e791-738f-45b5-a8a1-be163c7c9851 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:14.428412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:14.430003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:14.430350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:14.431253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] PATH_INFO: `/v3/projects/24191805b45e4a9b9575e5d989a6c6f9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:14.433447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=24191805b45e4a9b9575e5d989a6c6f9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:14.445240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:14.550445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24191805b45e4a9b9575e5d989a6c6f9', 'request_id': 'req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:14.573508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24191805b45e4a9b9575e5d989a6c6f9', 'request_id': 'req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:14.590204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24191805b45e4a9b9575e5d989a6c6f9', 'request_id': 'req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:14.618583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] The token cache is being invalidate because project 24191805b45e4a9b9575e5d989a6c6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:30:14.619838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:14.620973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:14.625229 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3132/6203] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:30:14 2022] DELETE /identity/v3/projects/24191805b45e4a9b9575e5d989a6c6f9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:14.629650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bbb99-55c6-423e-9f7f-1ec67075b0e6 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:14.646107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bbb99-55c6-423e-9f7f-1ec67075b0e6 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:14.700700 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:14.783668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:14.785638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:14.787160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:14.787160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] PATH_INFO: `/v3/users/1034bf8e3936453fb6e0e6bde1069558` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:14.789718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1034bf8e3936453fb6e0e6bde1069558)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:14.792971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:14.896269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1034bf8e3936453fb6e0e6bde1069558'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:14.899008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1034bf8e3936453fb6e0e6bde1069558'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:14.917074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1034bf8e3936453fb6e0e6bde1069558'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:14.927016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1034bf8e3936453fb6e0e6bde1069558'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:14.927748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1034bf8e3936453fb6e0e6bde1069558'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:14.965434 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3072/6204] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:30:14 2022] DELETE /identity/v3/users/1034bf8e3936453fb6e0e6bde1069558 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:30:17.981173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:17.983227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:18.019228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff0c2f-8b36-42cd-aedf-5d8fd62298ad admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:18.211070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:18.211745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:18.212035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:18.212679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] PATH_INFO: `/v3/projects/812df6cf41cb42cf995c72a41ba3f75e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:18.217118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=812df6cf41cb42cf995c72a41ba3f75e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:18.229627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:18.298863 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:18.340939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812df6cf41cb42cf995c72a41ba3f75e', 'request_id': 'req-d65b1652-faf4-4ae9-9338-1e20a04725ef'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:18.354825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812df6cf41cb42cf995c72a41ba3f75e', 'request_id': 'req-d65b1652-faf4-4ae9-9338-1e20a04725ef'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:18.372766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812df6cf41cb42cf995c72a41ba3f75e', 'request_id': 'req-d65b1652-faf4-4ae9-9338-1e20a04725ef'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:18.400019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] The token cache is being invalidate because project 812df6cf41cb42cf995c72a41ba3f75e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:30:18.400430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:18.401286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:18.404326 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3133/6205] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:30:17 2022] DELETE /identity/v3/projects/812df6cf41cb42cf995c72a41ba3f75e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:18.408043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:18.410403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:18.438772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922dbed-290c-46f3-b053-55283ddb946d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:18.593725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:18.596369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:18.597518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:18.597898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] PATH_INFO: `/v3/users/e5468d57045e4281943bd7ae5d0418f0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:18.603350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5468d57045e4281943bd7ae5d0418f0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:18.608500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:18.708764 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:18.724538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5468d57045e4281943bd7ae5d0418f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:18.727008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5468d57045e4281943bd7ae5d0418f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:18.759054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5468d57045e4281943bd7ae5d0418f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:18.774370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5468d57045e4281943bd7ae5d0418f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:18.775959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5468d57045e4281943bd7ae5d0418f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:18.802800 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3073/6206] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:30:18 2022] DELETE /identity/v3/users/e5468d57045e4281943bd7ae5d0418f0 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:19.998876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:20.002352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:20.053207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b1652-faf4-4ae9-9338-1e20a04725ef admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:20.230293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:20.231804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:20.231995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:20.232393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] PATH_INFO: `/v3/projects/40b3d18531c942bb94d4e230980c0afe` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:20.236055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b3d18531c942bb94d4e230980c0afe)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:20.238768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:20.353505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b3d18531c942bb94d4e230980c0afe', 'request_id': 'req-1793cd22-5088-4958-b648-f365b6311ca8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:20.369735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b3d18531c942bb94d4e230980c0afe', 'request_id': 'req-1793cd22-5088-4958-b648-f365b6311ca8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:20.391977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b3d18531c942bb94d4e230980c0afe', 'request_id': 'req-1793cd22-5088-4958-b648-f365b6311ca8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:20.414245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] The token cache is being invalidate because project 40b3d18531c942bb94d4e230980c0afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:30:20.415655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:20.420058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:20.423684 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3134/6207] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:30:19 2022] DELETE /identity/v3/projects/40b3d18531c942bb94d4e230980c0afe => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:23.355943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:23.357579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:23.371896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d181-a20c-4b1b-a221-350a2bf8e953 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:23.448842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8618fd9-2290-4208-be4e-6f9916cdc76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:23.450412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8618fd9-2290-4208-be4e-6f9916cdc76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:23.450700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8618fd9-2290-4208-be4e-6f9916cdc76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:23.451894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8618fd9-2290-4208-be4e-6f9916cdc76d admin admin] PATH_INFO: `/v3/users/4d4086e3f9784454a0ccfe87cc54a2b2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:23.454111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8618fd9-2290-4208-be4e-6f9916cdc76d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4086e3f9784454a0ccfe87cc54a2b2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:23.457522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8618fd9-2290-4208-be4e-6f9916cdc76d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:23.523473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8618fd9-2290-4208-be4e-6f9916cdc76d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4086e3f9784454a0ccfe87cc54a2b2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:23.524252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8618fd9-2290-4208-be4e-6f9916cdc76d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4086e3f9784454a0ccfe87cc54a2b2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:23.542264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8618fd9-2290-4208-be4e-6f9916cdc76d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4086e3f9784454a0ccfe87cc54a2b2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:23.560495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8618fd9-2290-4208-be4e-6f9916cdc76d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4086e3f9784454a0ccfe87cc54a2b2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:23.561613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8618fd9-2290-4208-be4e-6f9916cdc76d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4086e3f9784454a0ccfe87cc54a2b2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:23.582505 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3074/6208] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:30:23 2022] DELETE /identity/v3/users/4d4086e3f9784454a0ccfe87cc54a2b2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:23.891412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:23.894165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:23.922299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793cd22-5088-4958-b648-f365b6311ca8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:23.999860 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:24.050780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:24.051351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:24.051630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:24.051953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718 admin admin] PATH_INFO: `/v3/projects/4ec864865dde4a4fa13a54a5057867f1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:24.053893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec864865dde4a4fa13a54a5057867f1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:24.058140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:24.127448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec864865dde4a4fa13a54a5057867f1', 'request_id': 'req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:24.139199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec864865dde4a4fa13a54a5057867f1', 'request_id': 'req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:24.154322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec864865dde4a4fa13a54a5057867f1', 'request_id': 'req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:24.170733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718 admin admin] The token cache is being invalidate because project 4ec864865dde4a4fa13a54a5057867f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:30:24.171149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:24.171912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5e1470b-8ca2-474a-b1f6-0e0aae90e718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:24.180393 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3135/6209] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:30:23 2022] DELETE /identity/v3/projects/4ec864865dde4a4fa13a54a5057867f1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:24.183648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db731ac6-8480-4903-9215-c37de071724e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:24.184248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db731ac6-8480-4903-9215-c37de071724e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:24.184980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db731ac6-8480-4903-9215-c37de071724e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:24.233841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-db731ac6-8480-4903-9215-c37de071724e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:30:24.247715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-db731ac6-8480-4903-9215-c37de071724e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:24.400615 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:24.507188 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3075/6210] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:30:24.523375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb230da-05a0-4c30-9f33-14f544ce653b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:24.523710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb230da-05a0-4c30-9f33-14f544ce653b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:24.523984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb230da-05a0-4c30-9f33-14f544ce653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:24.559866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3bb230da-05a0-4c30-9f33-14f544ce653b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:30:24.559866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3bb230da-05a0-4c30-9f33-14f544ce653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:24.607758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db731ac6-8480-4903-9215-c37de071724e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:24.619007 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3136/6211] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:30:24.625914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db731ac6-8480-4903-9215-c37de071724e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:24.647304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75da49-d2e4-426f-81de-a21938365f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:24.648259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75da49-d2e4-426f-81de-a21938365f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:24.648536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75da49-d2e4-426f-81de-a21938365f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:24.648801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75da49-d2e4-426f-81de-a21938365f58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:24.650682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75da49-d2e4-426f-81de-a21938365f58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:30:24.651132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75da49-d2e4-426f-81de-a21938365f58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:24.654370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75da49-d2e4-426f-81de-a21938365f58 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:24.684674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb230da-05a0-4c30-9f33-14f544ce653b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:24.689466 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3076/6212] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:30:24.701114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb230da-05a0-4c30-9f33-14f544ce653b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:24.725831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5dec4-154d-4e84-8bd5-7cb701914d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:24.726568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5dec4-154d-4e84-8bd5-7cb701914d47 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:24.726959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5dec4-154d-4e84-8bd5-7cb701914d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:24.727350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5dec4-154d-4e84-8bd5-7cb701914d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:24.728089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5dec4-154d-4e84-8bd5-7cb701914d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:24.734797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5dec4-154d-4e84-8bd5-7cb701914d47 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:24.858036 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3137/6213] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:30:24 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:30:24.860161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75da49-d2e4-426f-81de-a21938365f58 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:24.881217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75da49-d2e4-426f-81de-a21938365f58 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:25.054069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becfc78-85c3-4340-81c8-86154ef5089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:25.054740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becfc78-85c3-4340-81c8-86154ef5089b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:25.055045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becfc78-85c3-4340-81c8-86154ef5089b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:25.055316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becfc78-85c3-4340-81c8-86154ef5089b admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:25.055955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becfc78-85c3-4340-81c8-86154ef5089b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:25.057891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becfc78-85c3-4340-81c8-86154ef5089b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:25.124135 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3077/6214] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:30:24 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:30:25.129120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5dec4-154d-4e84-8bd5-7cb701914d47 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:25.146265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5dec4-154d-4e84-8bd5-7cb701914d47 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:25.158876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75009748-2b6a-4a73-b256-05dc68272b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:25.163208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75009748-2b6a-4a73-b256-05dc68272b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:25.163527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75009748-2b6a-4a73-b256-05dc68272b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:25.163809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75009748-2b6a-4a73-b256-05dc68272b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:25.164493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75009748-2b6a-4a73-b256-05dc68272b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:25.172357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75009748-2b6a-4a73-b256-05dc68272b66 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:25.198596 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3138/6215] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:30:25.203932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becfc78-85c3-4340-81c8-86154ef5089b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:25.250429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becfc78-85c3-4340-81c8-86154ef5089b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:25.271130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890fac5-247e-4094-9e9b-a3a1e096558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:25.273636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890fac5-247e-4094-9e9b-a3a1e096558c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:25.274969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890fac5-247e-4094-9e9b-a3a1e096558c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:25.274969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890fac5-247e-4094-9e9b-a3a1e096558c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:25.275174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890fac5-247e-4094-9e9b-a3a1e096558c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:25.277540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890fac5-247e-4094-9e9b-a3a1e096558c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:25.292937 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3078/6216] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:30:25.297132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75009748-2b6a-4a73-b256-05dc68272b66 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:25.310819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75009748-2b6a-4a73-b256-05dc68272b66 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:25.324306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e4317-e76b-4009-9236-98cd1873fa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:25.325408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e4317-e76b-4009-9236-98cd1873fa0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:25.325946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e4317-e76b-4009-9236-98cd1873fa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:25.326605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e4317-e76b-4009-9236-98cd1873fa0e admin admin] PATH_INFO: `/v3/projects/a1ca1a983a354c86a943358b08cc7b4a/users/c7809ba59fea42acae2d413125e1e5c0/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:25.348271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e4317-e76b-4009-9236-98cd1873fa0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ca1a983a354c86a943358b08cc7b4a, user_id=c7809ba59fea42acae2d413125e1e5c0, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:25.352182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e4317-e76b-4009-9236-98cd1873fa0e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:25.398454 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3139/6217] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:30:25 2022] PUT /identity/v3/projects/a1ca1a983a354c86a943358b08cc7b4a/users/c7809ba59fea42acae2d413125e1e5c0/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:25.401485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b08c7d-78ba-458b-be7c-5e2b6ef6a324 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:25.401485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b08c7d-78ba-458b-be7c-5e2b6ef6a324 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:25.402095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b08c7d-78ba-458b-be7c-5e2b6ef6a324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:25.460852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-49b08c7d-78ba-458b-be7c-5e2b6ef6a324 None None] MFA Rules not processed for user `c7809ba59fea42acae2d413125e1e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:30:25.463373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-49b08c7d-78ba-458b-be7c-5e2b6ef6a324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:25.621523 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3079/6218] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:30:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:30:25.634990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffaab6-e585-46c4-93e6-ba73b171c044 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:25.635452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffaab6-e585-46c4-93e6-ba73b171c044 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:25.635805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffaab6-e585-46c4-93e6-ba73b171c044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:25.663262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c3ffaab6-e585-46c4-93e6-ba73b171c044 None None] MFA Rules not processed for user `c7809ba59fea42acae2d413125e1e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:30:25.665143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c3ffaab6-e585-46c4-93e6-ba73b171c044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:25.675444 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3140/6219] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:30:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:30:25.695780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b08c7d-78ba-458b-be7c-5e2b6ef6a324 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:25.697835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-49b08c7d-78ba-458b-be7c-5e2b6ef6a324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:25.757697 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:25.838737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b08c7d-78ba-458b-be7c-5e2b6ef6a324 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:25.857330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eb987-c75c-45cf-8b2a-10debd4c55a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:25.857969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eb987-c75c-45cf-8b2a-10debd4c55a2 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:25.859190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eb987-c75c-45cf-8b2a-10debd4c55a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:25.860725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eb987-c75c-45cf-8b2a-10debd4c55a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:25.880357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eb987-c75c-45cf-8b2a-10debd4c55a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:25.881995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eb987-c75c-45cf-8b2a-10debd4c55a2 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:25.919629 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3080/6220] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:30:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:30:26.606687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffaab6-e585-46c4-93e6-ba73b171c044 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:26.608724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c3ffaab6-e585-46c4-93e6-ba73b171c044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:26.743522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffaab6-e585-46c4-93e6-ba73b171c044 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:26.753567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc408e1-7cbc-4fa8-90e6-59a36503b4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:26.754577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc408e1-7cbc-4fa8-90e6-59a36503b4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:26.755075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc408e1-7cbc-4fa8-90e6-59a36503b4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:26.755531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc408e1-7cbc-4fa8-90e6-59a36503b4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:26.770057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9bc408e1-7cbc-4fa8-90e6-59a36503b4c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:26.825417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc408e1-7cbc-4fa8-90e6-59a36503b4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:26.827625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc408e1-7cbc-4fa8-90e6-59a36503b4c3 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:26.845386 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:26.858341 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3141/6221] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:30:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:30:29.510144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eb987-c75c-45cf-8b2a-10debd4c55a2 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:29.512671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a68eb987-c75c-45cf-8b2a-10debd4c55a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:29.548064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eb987-c75c-45cf-8b2a-10debd4c55a2 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:29.572355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cb013-fde3-4b5f-8d69-0c2651a8524d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:29.574944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cb013-fde3-4b5f-8d69-0c2651a8524d service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:29.575191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cb013-fde3-4b5f-8d69-0c2651a8524d service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:29.575474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cb013-fde3-4b5f-8d69-0c2651a8524d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:29.584727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a20cb013-fde3-4b5f-8d69-0c2651a8524d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:29.621931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cb013-fde3-4b5f-8d69-0c2651a8524d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:29.623731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cb013-fde3-4b5f-8d69-0c2651a8524d service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:29.645055 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3081/6222] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:30:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:30:36.865654 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:36.966392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc408e1-7cbc-4fa8-90e6-59a36503b4c3 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:36.969949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9bc408e1-7cbc-4fa8-90e6-59a36503b4c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:37.166622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc408e1-7cbc-4fa8-90e6-59a36503b4c3 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:37.180629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:37.181246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:37.181529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:37.182038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] PATH_INFO: `/v3/users/b434c2c18a8644b4b9940bd43a9f3d10` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:37.183726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b434c2c18a8644b4b9940bd43a9f3d10)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:37.185723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:37.329254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b434c2c18a8644b4b9940bd43a9f3d10'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:37.330282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b434c2c18a8644b4b9940bd43a9f3d10'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:37.357079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b434c2c18a8644b4b9940bd43a9f3d10'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:37.380318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b434c2c18a8644b4b9940bd43a9f3d10'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:37.383134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b434c2c18a8644b4b9940bd43a9f3d10'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:37.416697 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3142/6223] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:30:36 2022] DELETE /identity/v3/users/b434c2c18a8644b4b9940bd43a9f3d10 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:37.419254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44084759-aa3f-4151-b9b2-828c8707aa99 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:37.419745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44084759-aa3f-4151-b9b2-828c8707aa99 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:37.419858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44084759-aa3f-4151-b9b2-828c8707aa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:37.516605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-44084759-aa3f-4151-b9b2-828c8707aa99 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:30:37.517831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-44084759-aa3f-4151-b9b2-828c8707aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:37.729607 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3082/6224] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:30:37.751595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:37.753190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:37.879884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f02d8-ab7d-4a47-9217-acbfab58a778 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:37.895217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22e305-5f26-46c8-8be2-b996f6eb250f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:37.895865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e305-5f26-46c8-8be2-b996f6eb250f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:37.898701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e305-5f26-46c8-8be2-b996f6eb250f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:37.899130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e305-5f26-46c8-8be2-b996f6eb250f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:37.917104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22e305-5f26-46c8-8be2-b996f6eb250f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:37.926347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22e305-5f26-46c8-8be2-b996f6eb250f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:37.961282 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3143/6225] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:30:38.317191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44084759-aa3f-4151-b9b2-828c8707aa99 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:38.318873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-44084759-aa3f-4151-b9b2-828c8707aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:38.337375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44084759-aa3f-4151-b9b2-828c8707aa99 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:38.355435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac773a20-d387-4835-ae55-e6da23b616b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:38.356430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac773a20-d387-4835-ae55-e6da23b616b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:38.356923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac773a20-d387-4835-ae55-e6da23b616b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:38.357563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac773a20-d387-4835-ae55-e6da23b616b7 admin admin] PATH_INFO: `/v3/projects/74be159c6dc54e68b77a221ae988345a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:38.360696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac773a20-d387-4835-ae55-e6da23b616b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74be159c6dc54e68b77a221ae988345a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:38.364368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac773a20-d387-4835-ae55-e6da23b616b7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:38.446454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac773a20-d387-4835-ae55-e6da23b616b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74be159c6dc54e68b77a221ae988345a', 'request_id': 'req-ac773a20-d387-4835-ae55-e6da23b616b7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:38.458127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac773a20-d387-4835-ae55-e6da23b616b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74be159c6dc54e68b77a221ae988345a', 'request_id': 'req-ac773a20-d387-4835-ae55-e6da23b616b7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:38.470226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac773a20-d387-4835-ae55-e6da23b616b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74be159c6dc54e68b77a221ae988345a', 'request_id': 'req-ac773a20-d387-4835-ae55-e6da23b616b7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:38.489602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac773a20-d387-4835-ae55-e6da23b616b7 admin admin] The token cache is being invalidate because project 74be159c6dc54e68b77a221ae988345a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:30:38.490142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac773a20-d387-4835-ae55-e6da23b616b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:38.491116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac773a20-d387-4835-ae55-e6da23b616b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:38.493481 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3083/6226] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:30:38 2022] DELETE /identity/v3/projects/74be159c6dc54e68b77a221ae988345a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:38.499192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaedd7-6e33-47cd-afc3-8ed18fa28f03 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:38.500032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaedd7-6e33-47cd-afc3-8ed18fa28f03 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:38.500485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaedd7-6e33-47cd-afc3-8ed18fa28f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:38.530343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b8eaedd7-6e33-47cd-afc3-8ed18fa28f03 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:30:38.538420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b8eaedd7-6e33-47cd-afc3-8ed18fa28f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:38.576817 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:38.673496 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3144/6227] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:30:38.682701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab262-8978-4cb5-8b31-3ffdacf28e2b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:38.683368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab262-8978-4cb5-8b31-3ffdacf28e2b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:38.683808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab262-8978-4cb5-8b31-3ffdacf28e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:38.719565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-de7ab262-8978-4cb5-8b31-3ffdacf28e2b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:30:38.722811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-de7ab262-8978-4cb5-8b31-3ffdacf28e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:38.742356 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3084/6228] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:30:38.743120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaedd7-6e33-47cd-afc3-8ed18fa28f03 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:38.767010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaedd7-6e33-47cd-afc3-8ed18fa28f03 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:38.793666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213f0dd-9652-48d5-8492-75a6f2e5c07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:38.795470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213f0dd-9652-48d5-8492-75a6f2e5c07b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:38.796643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213f0dd-9652-48d5-8492-75a6f2e5c07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:38.798095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213f0dd-9652-48d5-8492-75a6f2e5c07b admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:38.800275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213f0dd-9652-48d5-8492-75a6f2e5c07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:30:38.802033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213f0dd-9652-48d5-8492-75a6f2e5c07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:38.805702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213f0dd-9652-48d5-8492-75a6f2e5c07b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:38.832976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab262-8978-4cb5-8b31-3ffdacf28e2b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:38.835276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-de7ab262-8978-4cb5-8b31-3ffdacf28e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:38.843681 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3145/6229] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:30:38.848450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213f0dd-9652-48d5-8492-75a6f2e5c07b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:38.876342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213f0dd-9652-48d5-8492-75a6f2e5c07b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:38.895867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672fde4-4219-4e57-8dff-7cba4125995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:38.896954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672fde4-4219-4e57-8dff-7cba4125995f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:38.896954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672fde4-4219-4e57-8dff-7cba4125995f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:38.897293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672fde4-4219-4e57-8dff-7cba4125995f admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:38.898028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672fde4-4219-4e57-8dff-7cba4125995f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:38.900179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672fde4-4219-4e57-8dff-7cba4125995f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:38.912658 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:38.981485 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3146/6230] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:30:38 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:30:38.982666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672fde4-4219-4e57-8dff-7cba4125995f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:39.000198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab262-8978-4cb5-8b31-3ffdacf28e2b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:39.092057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30252f1b-18bf-42cc-a4d0-604dd889946e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:39.092736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30252f1b-18bf-42cc-a4d0-604dd889946e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:39.093020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30252f1b-18bf-42cc-a4d0-604dd889946e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:39.093477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30252f1b-18bf-42cc-a4d0-604dd889946e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:39.100494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-30252f1b-18bf-42cc-a4d0-604dd889946e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:39.143091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672fde4-4219-4e57-8dff-7cba4125995f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:39.150970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6f3c0-7371-4865-a9a9-6a7dd4d127f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:39.152031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6f3c0-7371-4865-a9a9-6a7dd4d127f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:39.152326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6f3c0-7371-4865-a9a9-6a7dd4d127f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:39.152705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6f3c0-7371-4865-a9a9-6a7dd4d127f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:39.153369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6f3c0-7371-4865-a9a9-6a7dd4d127f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:39.159528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6f3c0-7371-4865-a9a9-6a7dd4d127f5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:39.229415 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3147/6231] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:30:38 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:30:39.236377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30252f1b-18bf-42cc-a4d0-604dd889946e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:39.237633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30252f1b-18bf-42cc-a4d0-604dd889946e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:39.239955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6f3c0-7371-4865-a9a9-6a7dd4d127f5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:39.261526 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3085/6232] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:30:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:30:39.289184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6f3c0-7371-4865-a9a9-6a7dd4d127f5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:39.318953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e98d4f-e84c-4df6-a8a9-aeca4d37fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:39.319599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98d4f-e84c-4df6-a8a9-aeca4d37fb21 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:39.319880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98d4f-e84c-4df6-a8a9-aeca4d37fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:39.320154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98d4f-e84c-4df6-a8a9-aeca4d37fb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:39.320805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e98d4f-e84c-4df6-a8a9-aeca4d37fb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:39.322427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e98d4f-e84c-4df6-a8a9-aeca4d37fb21 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:39.358713 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3148/6233] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:30:39.362791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30252f1b-18bf-42cc-a4d0-604dd889946e service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:39.390198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30252f1b-18bf-42cc-a4d0-604dd889946e service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:39.400070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356b5d3-56c5-4fba-abd1-233b0e993e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:39.411373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356b5d3-56c5-4fba-abd1-233b0e993e81 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:39.412122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356b5d3-56c5-4fba-abd1-233b0e993e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:39.413142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356b5d3-56c5-4fba-abd1-233b0e993e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:39.413945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356b5d3-56c5-4fba-abd1-233b0e993e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:39.422057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356b5d3-56c5-4fba-abd1-233b0e993e81 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:39.462717 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3086/6234] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:30:39.465510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e98d4f-e84c-4df6-a8a9-aeca4d37fb21 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:39.482137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e98d4f-e84c-4df6-a8a9-aeca4d37fb21 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:39.489711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1dc47-19e6-4201-a097-bfc8918007f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:39.490426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1dc47-19e6-4201-a097-bfc8918007f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:39.493644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1dc47-19e6-4201-a097-bfc8918007f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:39.494420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1dc47-19e6-4201-a097-bfc8918007f8 admin admin] PATH_INFO: `/v3/projects/ca17f09fe055442ca39d811e0a4daf65/users/11b1e9f796734320b9492c6c1d19c75d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:39.525813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1dc47-19e6-4201-a097-bfc8918007f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca17f09fe055442ca39d811e0a4daf65, user_id=11b1e9f796734320b9492c6c1d19c75d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:39.528917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1dc47-19e6-4201-a097-bfc8918007f8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:39.571996 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3149/6235] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:30:39 2022] PUT /identity/v3/projects/ca17f09fe055442ca39d811e0a4daf65/users/11b1e9f796734320b9492c6c1d19c75d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:39.573770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95996d4d-13f8-4c86-bec9-e91e0d01bd4e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:39.574063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95996d4d-13f8-4c86-bec9-e91e0d01bd4e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:39.574331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95996d4d-13f8-4c86-bec9-e91e0d01bd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:39.616825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-95996d4d-13f8-4c86-bec9-e91e0d01bd4e None None] MFA Rules not processed for user `11b1e9f796734320b9492c6c1d19c75d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:30:39.618533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-95996d4d-13f8-4c86-bec9-e91e0d01bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:39.772318 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:39.782971 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3087/6236] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:30:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:30:39.834509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1dc47-19e6-4201-a097-bfc8918007f8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:39.969267 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:40.005172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1dc47-19e6-4201-a097-bfc8918007f8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:40.012193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb3b86-e37d-4e2d-8681-4cb256706953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:40.012950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb3b86-e37d-4e2d-8681-4cb256706953 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:40.013234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb3b86-e37d-4e2d-8681-4cb256706953 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:40.013507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb3b86-e37d-4e2d-8681-4cb256706953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:40.033869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb3b86-e37d-4e2d-8681-4cb256706953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:40.035530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb3b86-e37d-4e2d-8681-4cb256706953 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:40.055090 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3150/6237] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:30:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:30:40.115965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95996d4d-13f8-4c86-bec9-e91e0d01bd4e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:40.376112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95996d4d-13f8-4c86-bec9-e91e0d01bd4e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:40.405333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:40.412499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:40.412987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:40.413338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] PATH_INFO: `/v3/users/11b1e9f796734320b9492c6c1d19c75d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:40.414801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b1e9f796734320b9492c6c1d19c75d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:40.422641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:40.586423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b1e9f796734320b9492c6c1d19c75d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:40.589800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b1e9f796734320b9492c6c1d19c75d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:40.655014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b1e9f796734320b9492c6c1d19c75d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:40.683683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b1e9f796734320b9492c6c1d19c75d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:40.684804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b1e9f796734320b9492c6c1d19c75d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:40.720161 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3088/6238] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:30:40 2022] DELETE /identity/v3/users/11b1e9f796734320b9492c6c1d19c75d => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:40.725084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d09c3-d75f-487a-a9c2-aae993c42f1e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:40.728309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d09c3-d75f-487a-a9c2-aae993c42f1e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:40.728618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d09c3-d75f-487a-a9c2-aae993c42f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:40.758381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e30d09c3-d75f-487a-a9c2-aae993c42f1e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:30:40.773122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e30d09c3-d75f-487a-a9c2-aae993c42f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:40.910954 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3151/6239] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:30:40.930029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:40.932297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:41.169845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a2b02-a05b-4752-996d-ea4c08511206 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:41.175027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f24f0-b683-4786-9d5a-8bf223d03630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:41.175939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f24f0-b683-4786-9d5a-8bf223d03630 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:41.176377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f24f0-b683-4786-9d5a-8bf223d03630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:41.176791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f24f0-b683-4786-9d5a-8bf223d03630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:41.201789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f24f0-b683-4786-9d5a-8bf223d03630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:41.203561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f24f0-b683-4786-9d5a-8bf223d03630 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:41.230538 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3089/6240] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:30:42.115996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d09c3-d75f-487a-a9c2-aae993c42f1e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:42.118217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e30d09c3-d75f-487a-a9c2-aae993c42f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:42.140141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d09c3-d75f-487a-a9c2-aae993c42f1e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:42.160143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e76609-f9aa-4102-81cd-a7838aab3239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:42.161623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e76609-f9aa-4102-81cd-a7838aab3239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:42.162280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e76609-f9aa-4102-81cd-a7838aab3239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:42.162869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e76609-f9aa-4102-81cd-a7838aab3239 admin admin] PATH_INFO: `/v3/projects/ca17f09fe055442ca39d811e0a4daf65` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:42.166011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e76609-f9aa-4102-81cd-a7838aab3239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca17f09fe055442ca39d811e0a4daf65)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:42.178850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e76609-f9aa-4102-81cd-a7838aab3239 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:42.307013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e4e76609-f9aa-4102-81cd-a7838aab3239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca17f09fe055442ca39d811e0a4daf65', 'request_id': 'req-e4e76609-f9aa-4102-81cd-a7838aab3239'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:42.321259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e4e76609-f9aa-4102-81cd-a7838aab3239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca17f09fe055442ca39d811e0a4daf65', 'request_id': 'req-e4e76609-f9aa-4102-81cd-a7838aab3239'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:42.379826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e4e76609-f9aa-4102-81cd-a7838aab3239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca17f09fe055442ca39d811e0a4daf65', 'request_id': 'req-e4e76609-f9aa-4102-81cd-a7838aab3239'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:42.398588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e4e76609-f9aa-4102-81cd-a7838aab3239 admin admin] The token cache is being invalidate because project ca17f09fe055442ca39d811e0a4daf65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:30:42.398952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e4e76609-f9aa-4102-81cd-a7838aab3239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:42.399778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e4e76609-f9aa-4102-81cd-a7838aab3239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:30:42.429553 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3152/6241] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:30:42 2022] DELETE /identity/v3/projects/ca17f09fe055442ca39d811e0a4daf65 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:42.430009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7966043-1159-4408-b32b-dab39c64c7e2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:42.430009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7966043-1159-4408-b32b-dab39c64c7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:42.430009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7966043-1159-4408-b32b-dab39c64c7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:42.451415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a7966043-1159-4408-b32b-dab39c64c7e2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:30:42.452744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a7966043-1159-4408-b32b-dab39c64c7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:42.483837 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:42.635472 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3090/6242] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:30:42.645336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c43e9-d557-4fbc-bf72-51f495bf5f58 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:42.645855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c43e9-d557-4fbc-bf72-51f495bf5f58 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:42.646145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c43e9-d557-4fbc-bf72-51f495bf5f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:42.679526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b16c43e9-d557-4fbc-bf72-51f495bf5f58 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:30:42.680851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b16c43e9-d557-4fbc-bf72-51f495bf5f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:42.702806 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3153/6243] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:30:42.704066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7966043-1159-4408-b32b-dab39c64c7e2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:42.717008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7966043-1159-4408-b32b-dab39c64c7e2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:42.726101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e86df-be9d-4eb0-aad2-ccc9c1a66a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:42.727678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e86df-be9d-4eb0-aad2-ccc9c1a66a5f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:42.728244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e86df-be9d-4eb0-aad2-ccc9c1a66a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:42.728708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e86df-be9d-4eb0-aad2-ccc9c1a66a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:42.729758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e86df-be9d-4eb0-aad2-ccc9c1a66a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:30:42.731841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e86df-be9d-4eb0-aad2-ccc9c1a66a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:42.733888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e86df-be9d-4eb0-aad2-ccc9c1a66a5f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:42.751467 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3091/6244] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:30:42.752283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c43e9-d557-4fbc-bf72-51f495bf5f58 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:42.762625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c43e9-d557-4fbc-bf72-51f495bf5f58 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:42.776558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3afde-8399-4ec5-a83b-1962997b8e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:42.776826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3afde-8399-4ec5-a83b-1962997b8e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:42.776915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3afde-8399-4ec5-a83b-1962997b8e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:42.777220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3afde-8399-4ec5-a83b-1962997b8e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:42.778551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3afde-8399-4ec5-a83b-1962997b8e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:42.788076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3afde-8399-4ec5-a83b-1962997b8e49 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:42.848925 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3154/6245] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:30:42 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:30:42.853236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e86df-be9d-4eb0-aad2-ccc9c1a66a5f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:42.876461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e86df-be9d-4eb0-aad2-ccc9c1a66a5f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:43.025702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397fc5e-b949-4ed4-b315-c84297e10784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:43.026412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397fc5e-b949-4ed4-b315-c84297e10784 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:43.026688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397fc5e-b949-4ed4-b315-c84297e10784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:43.027508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397fc5e-b949-4ed4-b315-c84297e10784 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:43.028161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397fc5e-b949-4ed4-b315-c84297e10784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:43.030813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397fc5e-b949-4ed4-b315-c84297e10784 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:43.113477 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3092/6246] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:30:42 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:30:43.120337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3afde-8399-4ec5-a83b-1962997b8e49 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:43.167313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3afde-8399-4ec5-a83b-1962997b8e49 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:43.178524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efd589-510a-413d-ad32-eb8f39786dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:43.179614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efd589-510a-413d-ad32-eb8f39786dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:43.180109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efd589-510a-413d-ad32-eb8f39786dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:43.180592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efd589-510a-413d-ad32-eb8f39786dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:43.181662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efd589-510a-413d-ad32-eb8f39786dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:43.187859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efd589-510a-413d-ad32-eb8f39786dbe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:43.208032 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3155/6247] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:30:43.213393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397fc5e-b949-4ed4-b315-c84297e10784 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:43.246906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397fc5e-b949-4ed4-b315-c84297e10784 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:43.265315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18ac23-6361-4cee-9cbd-2e04fe57b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:43.268578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18ac23-6361-4cee-9cbd-2e04fe57b3bf admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:43.269575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18ac23-6361-4cee-9cbd-2e04fe57b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:43.269995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18ac23-6361-4cee-9cbd-2e04fe57b3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:43.271496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18ac23-6361-4cee-9cbd-2e04fe57b3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:43.273345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18ac23-6361-4cee-9cbd-2e04fe57b3bf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:43.298480 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3093/6248] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:30:43.300261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efd589-510a-413d-ad32-eb8f39786dbe admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:43.313181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efd589-510a-413d-ad32-eb8f39786dbe admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:43.322171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a51fb-8b19-4456-b742-44fb49e52e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:43.323060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a51fb-8b19-4456-b742-44fb49e52e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:43.324226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a51fb-8b19-4456-b742-44fb49e52e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:43.324603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a51fb-8b19-4456-b742-44fb49e52e3c admin admin] PATH_INFO: `/v3/projects/fa93612eb81c4c47bb8833b9fe4904e7/users/1019b560417543fa9fc31514951dbeb1/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:43.385524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a51fb-8b19-4456-b742-44fb49e52e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa93612eb81c4c47bb8833b9fe4904e7, user_id=1019b560417543fa9fc31514951dbeb1, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:43.389010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a51fb-8b19-4456-b742-44fb49e52e3c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:43.446421 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3156/6249] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:30:43 2022] PUT /identity/v3/projects/fa93612eb81c4c47bb8833b9fe4904e7/users/1019b560417543fa9fc31514951dbeb1/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:30:43.460162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f0e00-c882-43df-af93-0c90449e3893 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:43.460737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f0e00-c882-43df-af93-0c90449e3893 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:43.460853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f0e00-c882-43df-af93-0c90449e3893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:43.522542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d58f0e00-c882-43df-af93-0c90449e3893 None None] MFA Rules not processed for user `1019b560417543fa9fc31514951dbeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:30:43.523807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d58f0e00-c882-43df-af93-0c90449e3893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:43.772215 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3094/6250] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:30:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:30:43.882519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a51fb-8b19-4456-b742-44fb49e52e3c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:43.884330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3b3a51fb-8b19-4456-b742-44fb49e52e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:43.891840 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:44.008622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a51fb-8b19-4456-b742-44fb49e52e3c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:44.012985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33d1cc-9e41-497b-b1b3-5fcc5fcf5dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:44.013892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33d1cc-9e41-497b-b1b3-5fcc5fcf5dbd service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:44.014197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33d1cc-9e41-497b-b1b3-5fcc5fcf5dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:44.014957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33d1cc-9e41-497b-b1b3-5fcc5fcf5dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:44.028728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33d1cc-9e41-497b-b1b3-5fcc5fcf5dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:44.031072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33d1cc-9e41-497b-b1b3-5fcc5fcf5dbd service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:44.059725 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3157/6251] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:30:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:30:53.725542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f0e00-c882-43df-af93-0c90449e3893 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:30:53.727106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d58f0e00-c882-43df-af93-0c90449e3893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:53.750546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f0e00-c882-43df-af93-0c90449e3893 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:30:53.760217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ce7e6-961f-4902-b83c-4bc5d3a84184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:30:53.761687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce7e6-961f-4902-b83c-4bc5d3a84184 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:30:53.762038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce7e6-961f-4902-b83c-4bc5d3a84184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:30:53.762384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce7e6-961f-4902-b83c-4bc5d3a84184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:30:53.764619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b55ce7e6-961f-4902-b83c-4bc5d3a84184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:30:53.806159 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:53.906396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ce7e6-961f-4902-b83c-4bc5d3a84184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:30:53.908595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ce7e6-961f-4902-b83c-4bc5d3a84184 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:30:53.927335 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3095/6252] 10.222.0.39 () {60 vars in 1396 bytes} [Sun Oct 16 01:30:53 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:30:54.047904 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=24 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:01.209896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0e7d4-2410-48ff-b596-5f8516dc840e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:01.210942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0e7d4-2410-48ff-b596-5f8516dc840e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:01.211270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0e7d4-2410-48ff-b596-5f8516dc840e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:01.235213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-86e0e7d4-2410-48ff-b596-5f8516dc840e None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:01.237811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-86e0e7d4-2410-48ff-b596-5f8516dc840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:01.392818 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3158/6253] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:31:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:01.460152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ce7e6-961f-4902-b83c-4bc5d3a84184 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:01.462444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b55ce7e6-961f-4902-b83c-4bc5d3a84184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:01.594487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ce7e6-961f-4902-b83c-4bc5d3a84184 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:01.601932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024c0a8-ac73-409f-8a86-9b23f38504b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:01.602659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024c0a8-ac73-409f-8a86-9b23f38504b8 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:01.602958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024c0a8-ac73-409f-8a86-9b23f38504b8 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:01.603238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024c0a8-ac73-409f-8a86-9b23f38504b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:01.613819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024c0a8-ac73-409f-8a86-9b23f38504b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:01.615984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024c0a8-ac73-409f-8a86-9b23f38504b8 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:01.635294 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3096/6254] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:31:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:31:07.356511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0e7d4-2410-48ff-b596-5f8516dc840e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:07.360975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-86e0e7d4-2410-48ff-b596-5f8516dc840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:07.509382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0e7d4-2410-48ff-b596-5f8516dc840e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:07.514151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:07.514946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:07.515228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:07.515556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] PATH_INFO: `/v3/users/c7809ba59fea42acae2d413125e1e5c0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:07.516898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7809ba59fea42acae2d413125e1e5c0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:07.520022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:07.683511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7809ba59fea42acae2d413125e1e5c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:07.684480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7809ba59fea42acae2d413125e1e5c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:07.710769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7809ba59fea42acae2d413125e1e5c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:07.730900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7809ba59fea42acae2d413125e1e5c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:07.731986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7809ba59fea42acae2d413125e1e5c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:07.760834 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3159/6255] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:31:07 2022] DELETE /identity/v3/users/c7809ba59fea42acae2d413125e1e5c0 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:07.765323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64d728-e543-4386-a9dc-6e6ea3a93dee None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:07.766219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64d728-e543-4386-a9dc-6e6ea3a93dee None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:07.766648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64d728-e543-4386-a9dc-6e6ea3a93dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:07.795651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ed64d728-e543-4386-a9dc-6e6ea3a93dee None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:07.797243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ed64d728-e543-4386-a9dc-6e6ea3a93dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:07.902725 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3097/6256] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:31:07.958659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:07.962220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:07.993769 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:08.039243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a49b29-0ed2-42bd-8778-a3ee293df9a7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:08.044145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1385583-c6e5-429e-b118-4942a2738d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:08.044953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1385583-c6e5-429e-b118-4942a2738d6d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:08.045465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1385583-c6e5-429e-b118-4942a2738d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:08.045841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1385583-c6e5-429e-b118-4942a2738d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:08.062250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1385583-c6e5-429e-b118-4942a2738d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:08.065665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1385583-c6e5-429e-b118-4942a2738d6d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:08.081095 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3160/6257] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:09.889011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64d728-e543-4386-a9dc-6e6ea3a93dee None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:09.890812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ed64d728-e543-4386-a9dc-6e6ea3a93dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:09.910449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64d728-e543-4386-a9dc-6e6ea3a93dee None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:09.916809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0a69d-9165-4237-8100-62a50317a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:09.919564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0a69d-9165-4237-8100-62a50317a833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:09.926087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0a69d-9165-4237-8100-62a50317a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:09.926720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0a69d-9165-4237-8100-62a50317a833 admin admin] PATH_INFO: `/v3/projects/a1ca1a983a354c86a943358b08cc7b4a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:09.929612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0a69d-9165-4237-8100-62a50317a833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ca1a983a354c86a943358b08cc7b4a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:09.949189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0a69d-9165-4237-8100-62a50317a833 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:10.125910 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:10.140628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c8d0a69d-9165-4237-8100-62a50317a833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ca1a983a354c86a943358b08cc7b4a', 'request_id': 'req-c8d0a69d-9165-4237-8100-62a50317a833'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:10.152366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c8d0a69d-9165-4237-8100-62a50317a833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ca1a983a354c86a943358b08cc7b4a', 'request_id': 'req-c8d0a69d-9165-4237-8100-62a50317a833'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:10.174087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c8d0a69d-9165-4237-8100-62a50317a833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ca1a983a354c86a943358b08cc7b4a', 'request_id': 'req-c8d0a69d-9165-4237-8100-62a50317a833'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:10.189774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c8d0a69d-9165-4237-8100-62a50317a833 admin admin] The token cache is being invalidate because project a1ca1a983a354c86a943358b08cc7b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:31:10.191055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c8d0a69d-9165-4237-8100-62a50317a833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:10.191909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c8d0a69d-9165-4237-8100-62a50317a833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:10.194408 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3098/6258] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:31:09 2022] DELETE /identity/v3/projects/a1ca1a983a354c86a943358b08cc7b4a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:10.199429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad4141-541e-4e02-b233-0b71401d341f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:10.199942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad4141-541e-4e02-b233-0b71401d341f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:10.200063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad4141-541e-4e02-b233-0b71401d341f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:10.253014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d6ad4141-541e-4e02-b233-0b71401d341f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:10.255027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d6ad4141-541e-4e02-b233-0b71401d341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:10.380554 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3161/6259] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:10.387949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2d2ae-9101-4829-a2c6-bf3df130d640 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:10.388236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2d2ae-9101-4829-a2c6-bf3df130d640 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:10.388513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2d2ae-9101-4829-a2c6-bf3df130d640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:10.419005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b8b2d2ae-9101-4829-a2c6-bf3df130d640 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:10.420509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b8b2d2ae-9101-4829-a2c6-bf3df130d640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:10.435826 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3099/6260] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:10.436766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad4141-541e-4e02-b233-0b71401d341f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:10.451231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad4141-541e-4e02-b233-0b71401d341f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:10.460584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5daa32-914d-48f2-8678-5828657efe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:10.461830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5daa32-914d-48f2-8678-5828657efe1d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:10.462231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5daa32-914d-48f2-8678-5828657efe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:10.462615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5daa32-914d-48f2-8678-5828657efe1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:10.464362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5daa32-914d-48f2-8678-5828657efe1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:31:10.464362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5daa32-914d-48f2-8678-5828657efe1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:10.467394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5daa32-914d-48f2-8678-5828657efe1d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:10.497421 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3162/6261] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:31:10.504225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2d2ae-9101-4829-a2c6-bf3df130d640 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:10.515480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2d2ae-9101-4829-a2c6-bf3df130d640 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:10.530174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d04c81-990a-43a3-a62d-ef9af56bda4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:10.530723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04c81-990a-43a3-a62d-ef9af56bda4e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:10.531040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04c81-990a-43a3-a62d-ef9af56bda4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:10.531484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04c81-990a-43a3-a62d-ef9af56bda4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:10.532453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d04c81-990a-43a3-a62d-ef9af56bda4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:10.535347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d04c81-990a-43a3-a62d-ef9af56bda4e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:10.581411 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3100/6262] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:10 2022] POST /identity/v3/projects => generated 405 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:10.582387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5daa32-914d-48f2-8678-5828657efe1d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:10.602351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5daa32-914d-48f2-8678-5828657efe1d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:10.746461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7a3fe-7130-4621-a5e0-5a232ec313a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:10.747224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7a3fe-7130-4621-a5e0-5a232ec313a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:10.747570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7a3fe-7130-4621-a5e0-5a232ec313a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:10.748046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7a3fe-7130-4621-a5e0-5a232ec313a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:10.748761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7a3fe-7130-4621-a5e0-5a232ec313a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:10.758671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7a3fe-7130-4621-a5e0-5a232ec313a7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:10.809440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d04c81-990a-43a3-a62d-ef9af56bda4e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:10.817833 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3163/6263] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:10 2022] POST /identity/v3/users => generated 303 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:10.829260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d04c81-990a-43a3-a62d-ef9af56bda4e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:10.835308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09b1a-0f63-4fa9-87d8-e0ac80989cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:10.836012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09b1a-0f63-4fa9-87d8-e0ac80989cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:10.836360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09b1a-0f63-4fa9-87d8-e0ac80989cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:10.836700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09b1a-0f63-4fa9-87d8-e0ac80989cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:10.837410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c09b1a-0f63-4fa9-87d8-e0ac80989cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:10.839331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c09b1a-0f63-4fa9-87d8-e0ac80989cd8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:10.855417 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3101/6264] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:31:10.859761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7a3fe-7130-4621-a5e0-5a232ec313a7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:10.872003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7a3fe-7130-4621-a5e0-5a232ec313a7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:10.879198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4758ea-e314-45a0-8ce3-e55f7ffeb833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:10.879940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4758ea-e314-45a0-8ce3-e55f7ffeb833 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:10.880316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4758ea-e314-45a0-8ce3-e55f7ffeb833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:10.880676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4758ea-e314-45a0-8ce3-e55f7ffeb833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:10.881517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4758ea-e314-45a0-8ce3-e55f7ffeb833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:10.883415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4758ea-e314-45a0-8ce3-e55f7ffeb833 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:10.899881 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3164/6265] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:10.904952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09b1a-0f63-4fa9-87d8-e0ac80989cd8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:10.929741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09b1a-0f63-4fa9-87d8-e0ac80989cd8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:10.935663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba803d-dc4e-4ec0-ac6a-bcaa4eac9f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:10.936421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba803d-dc4e-4ec0-ac6a-bcaa4eac9f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:10.936775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba803d-dc4e-4ec0-ac6a-bcaa4eac9f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:10.937119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba803d-dc4e-4ec0-ac6a-bcaa4eac9f36 admin admin] PATH_INFO: `/v3/projects/d136775e094041b4bc669a95c11dd1e4/users/1d6d6b9af8af4d399c78e0b22b0da004/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:10.976685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba803d-dc4e-4ec0-ac6a-bcaa4eac9f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d136775e094041b4bc669a95c11dd1e4, user_id=1d6d6b9af8af4d399c78e0b22b0da004, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:10.979588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba803d-dc4e-4ec0-ac6a-bcaa4eac9f36 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:11.014637 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3102/6266] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:10 2022] PUT /identity/v3/projects/d136775e094041b4bc669a95c11dd1e4/users/1d6d6b9af8af4d399c78e0b22b0da004/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:31:11.016564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31686ba-8a59-41b7-b14c-2f265dc2004a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:11.017089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31686ba-8a59-41b7-b14c-2f265dc2004a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:11.017628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31686ba-8a59-41b7-b14c-2f265dc2004a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:11.059556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e31686ba-8a59-41b7-b14c-2f265dc2004a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:11.061216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e31686ba-8a59-41b7-b14c-2f265dc2004a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:11.221617 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:11.299258 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3165/6267] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:11.349541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba803d-dc4e-4ec0-ac6a-bcaa4eac9f36 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:11.351996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-67ba803d-dc4e-4ec0-ac6a-bcaa4eac9f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:11.428427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31686ba-8a59-41b7-b14c-2f265dc2004a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:11.430267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e31686ba-8a59-41b7-b14c-2f265dc2004a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:11.460439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31686ba-8a59-41b7-b14c-2f265dc2004a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:11.478799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:11.479741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:11.481440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:11.481872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] PATH_INFO: `/v3/users/8dbc3f00f5644e5eacfbab6a1df39556` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:11.483860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbc3f00f5644e5eacfbab6a1df39556)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:11.487296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:11.531141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba803d-dc4e-4ec0-ac6a-bcaa4eac9f36 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:11.544806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891fd0a-86dc-4e58-888e-332be5233a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:11.545941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891fd0a-86dc-4e58-888e-332be5233a2c service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:11.546503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891fd0a-86dc-4e58-888e-332be5233a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:11.547174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891fd0a-86dc-4e58-888e-332be5233a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:11.585587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891fd0a-86dc-4e58-888e-332be5233a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:11.590025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891fd0a-86dc-4e58-888e-332be5233a2c service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:11.602747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbc3f00f5644e5eacfbab6a1df39556'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:11.605140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbc3f00f5644e5eacfbab6a1df39556'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:11.620220 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3103/6268] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:11.635360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbc3f00f5644e5eacfbab6a1df39556'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:11.666445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbc3f00f5644e5eacfbab6a1df39556'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:11.667147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbc3f00f5644e5eacfbab6a1df39556'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:11.696852 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3166/6269] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:31:11 2022] DELETE /identity/v3/users/8dbc3f00f5644e5eacfbab6a1df39556 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:11.701605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ad760-9d98-4194-b275-a5346f453755 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:11.702092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ad760-9d98-4194-b275-a5346f453755 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:11.702451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ad760-9d98-4194-b275-a5346f453755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:11.746640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-930ad760-9d98-4194-b275-a5346f453755 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:11.749108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-930ad760-9d98-4194-b275-a5346f453755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:11.849169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:11.850907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:11.889479 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3104/6270] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:11.927112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ad760-9d98-4194-b275-a5346f453755 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:11.928600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-930ad760-9d98-4194-b275-a5346f453755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:11.947192 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:12.052566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97dd70-772d-419c-851a-f83691270125 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:12.069595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:12.072821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:12.073246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:12.073635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] PATH_INFO: `/v3/users/bcabdc9333b140ce99fbb2c8df572cf2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:12.078104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcabdc9333b140ce99fbb2c8df572cf2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:12.084537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:12.140159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ad760-9d98-4194-b275-a5346f453755 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:12.155940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46aba27-f3f9-45f2-a653-a94606655f9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:12.160276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aba27-f3f9-45f2-a653-a94606655f9a service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:12.160600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aba27-f3f9-45f2-a653-a94606655f9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:12.160885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aba27-f3f9-45f2-a653-a94606655f9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:12.207023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46aba27-f3f9-45f2-a653-a94606655f9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:12.227976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46aba27-f3f9-45f2-a653-a94606655f9a service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:12.245582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcabdc9333b140ce99fbb2c8df572cf2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:12.247300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcabdc9333b140ce99fbb2c8df572cf2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:12.249580 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:12.290201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcabdc9333b140ce99fbb2c8df572cf2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:12.292535 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3105/6271] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:12.308041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcabdc9333b140ce99fbb2c8df572cf2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:12.308735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcabdc9333b140ce99fbb2c8df572cf2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:12.334881 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3167/6272] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:31:11 2022] DELETE /identity/v3/users/bcabdc9333b140ce99fbb2c8df572cf2 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:31:12.339351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b4955-2f7c-4dec-bb3f-bd2f98604dd0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:12.339639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b4955-2f7c-4dec-bb3f-bd2f98604dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:12.339914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b4955-2f7c-4dec-bb3f-bd2f98604dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:12.376092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-909b4955-2f7c-4dec-bb3f-bd2f98604dd0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:12.378790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-909b4955-2f7c-4dec-bb3f-bd2f98604dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:12.519352 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3106/6273] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:31:12.543856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:12.548142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:12.680382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955009db-d2b0-4803-80a4-071f66a15fbe admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:12.692562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04889cc-f27b-454f-bdb0-ea4d3a6a8738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:12.693924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04889cc-f27b-454f-bdb0-ea4d3a6a8738 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:12.694362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04889cc-f27b-454f-bdb0-ea4d3a6a8738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:12.695091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04889cc-f27b-454f-bdb0-ea4d3a6a8738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:12.710407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04889cc-f27b-454f-bdb0-ea4d3a6a8738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:12.712683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04889cc-f27b-454f-bdb0-ea4d3a6a8738 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:12.727889 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3168/6274] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:13.050896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b4955-2f7c-4dec-bb3f-bd2f98604dd0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:13.053093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-909b4955-2f7c-4dec-bb3f-bd2f98604dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:13.072227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b4955-2f7c-4dec-bb3f-bd2f98604dd0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:13.078248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:13.079332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:13.079846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:13.080905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] PATH_INFO: `/v3/projects/3945d3eb1f864f2cbb1a1104873c7c1f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:13.082354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3945d3eb1f864f2cbb1a1104873c7c1f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:13.086663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:13.186209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3945d3eb1f864f2cbb1a1104873c7c1f', 'request_id': 'req-e0eefc68-1625-46ba-b057-8426ea4b97b5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:13.200498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3945d3eb1f864f2cbb1a1104873c7c1f', 'request_id': 'req-e0eefc68-1625-46ba-b057-8426ea4b97b5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:13.216154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3945d3eb1f864f2cbb1a1104873c7c1f', 'request_id': 'req-e0eefc68-1625-46ba-b057-8426ea4b97b5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:13.244407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] The token cache is being invalidate because project 3945d3eb1f864f2cbb1a1104873c7c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:31:13.244778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:13.246351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:13.252560 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3107/6275] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:31:13 2022] DELETE /identity/v3/projects/3945d3eb1f864f2cbb1a1104873c7c1f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:13.257531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608aa4c-14c2-45f6-9f94-01904db61c39 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:13.257994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608aa4c-14c2-45f6-9f94-01904db61c39 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:13.258089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608aa4c-14c2-45f6-9f94-01904db61c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:13.266973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:13.275697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:13.329383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c608aa4c-14c2-45f6-9f94-01904db61c39 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:13.342300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c608aa4c-14c2-45f6-9f94-01904db61c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:13.371750 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:13.419083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eefc68-1625-46ba-b057-8426ea4b97b5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:13.427636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b540cf-008b-4696-a801-25c1708994cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:13.427800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b540cf-008b-4696-a801-25c1708994cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:13.428079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b540cf-008b-4696-a801-25c1708994cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:13.428350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b540cf-008b-4696-a801-25c1708994cb admin admin] PATH_INFO: `/v3/projects/ba74a274b7374063a7d3786272fd793c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:13.429969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b540cf-008b-4696-a801-25c1708994cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba74a274b7374063a7d3786272fd793c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:13.431987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b540cf-008b-4696-a801-25c1708994cb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:13.500876 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3169/6276] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:13.512340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051792-9628-4a0e-af40-02b945ff6298 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:13.512628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051792-9628-4a0e-af40-02b945ff6298 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:13.512905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051792-9628-4a0e-af40-02b945ff6298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:13.515310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e1b540cf-008b-4696-a801-25c1708994cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba74a274b7374063a7d3786272fd793c', 'request_id': 'req-e1b540cf-008b-4696-a801-25c1708994cb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:13.538371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e1b540cf-008b-4696-a801-25c1708994cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba74a274b7374063a7d3786272fd793c', 'request_id': 'req-e1b540cf-008b-4696-a801-25c1708994cb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:13.570424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e1b540cf-008b-4696-a801-25c1708994cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba74a274b7374063a7d3786272fd793c', 'request_id': 'req-e1b540cf-008b-4696-a801-25c1708994cb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:13.573369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e2051792-9628-4a0e-af40-02b945ff6298 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:13.575377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e2051792-9628-4a0e-af40-02b945ff6298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:13.591419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e1b540cf-008b-4696-a801-25c1708994cb admin admin] The token cache is being invalidate because project ba74a274b7374063a7d3786272fd793c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:31:13.591768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e1b540cf-008b-4696-a801-25c1708994cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:13.594218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e1b540cf-008b-4696-a801-25c1708994cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:13.599597 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3108/6277] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:31:13 2022] DELETE /identity/v3/projects/ba74a274b7374063a7d3786272fd793c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:13.604307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a327f-ad51-4cc0-9a64-70789a1089c0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:13.605806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a327f-ad51-4cc0-9a64-70789a1089c0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:13.606626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a327f-ad51-4cc0-9a64-70789a1089c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:13.636424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-db0a327f-ad51-4cc0-9a64-70789a1089c0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:13.646043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-db0a327f-ad51-4cc0-9a64-70789a1089c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:13.753238 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3109/6278] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:31:13.774306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf3027-0bb9-43f7-876f-9bc46e0a0f71 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:13.774595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf3027-0bb9-43f7-876f-9bc46e0a0f71 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:13.774867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf3027-0bb9-43f7-876f-9bc46e0a0f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:13.807134 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3170/6279] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:13.808458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2051792-9628-4a0e-af40-02b945ff6298 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:13.837841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2051792-9628-4a0e-af40-02b945ff6298 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:13.860870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9670369-3f37-46a1-b01a-a2f00541fd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:13.862835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9670369-3f37-46a1-b01a-a2f00541fd08 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:13.863150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9670369-3f37-46a1-b01a-a2f00541fd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:13.867209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9670369-3f37-46a1-b01a-a2f00541fd08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:13.868028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9670369-3f37-46a1-b01a-a2f00541fd08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:31:13.868557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9670369-3f37-46a1-b01a-a2f00541fd08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:13.870512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9670369-3f37-46a1-b01a-a2f00541fd08 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:13.882334 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:13.894864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6bdf3027-0bb9-43f7-876f-9bc46e0a0f71 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:13.898927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6bdf3027-0bb9-43f7-876f-9bc46e0a0f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:13.920529 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3171/6280] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:31:13.923317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9670369-3f37-46a1-b01a-a2f00541fd08 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:13.930859 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3110/6281] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:13.935370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf3027-0bb9-43f7-876f-9bc46e0a0f71 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:13.958443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9670369-3f37-46a1-b01a-a2f00541fd08 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:13.965697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf3027-0bb9-43f7-876f-9bc46e0a0f71 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:13.970607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c2be2-0586-4666-abee-fdd062c89529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:13.972033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c2be2-0586-4666-abee-fdd062c89529 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:13.972836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c2be2-0586-4666-abee-fdd062c89529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:13.973121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c2be2-0586-4666-abee-fdd062c89529 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:13.973802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c2be2-0586-4666-abee-fdd062c89529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:13.978281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c2be2-0586-4666-abee-fdd062c89529 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:13.980386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb5f04-1dbc-4fe1-b0af-a3b14cd6d2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:13.981408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb5f04-1dbc-4fe1-b0af-a3b14cd6d2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:13.981408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb5f04-1dbc-4fe1-b0af-a3b14cd6d2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:13.981614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb5f04-1dbc-4fe1-b0af-a3b14cd6d2d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:13.982188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb5f04-1dbc-4fe1-b0af-a3b14cd6d2d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:31:13.982489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb5f04-1dbc-4fe1-b0af-a3b14cd6d2d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:13.986561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb5f04-1dbc-4fe1-b0af-a3b14cd6d2d2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:14.012812 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3111/6282] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:31:14.013746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb5f04-1dbc-4fe1-b0af-a3b14cd6d2d2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:14.047254 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3172/6283] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:13 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:14.052716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb5f04-1dbc-4fe1-b0af-a3b14cd6d2d2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:14.056866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c2be2-0586-4666-abee-fdd062c89529 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:14.193265 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:14.218836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c2be2-0586-4666-abee-fdd062c89529 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:14.230061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc6ee0-7f30-428b-9d46-bc2cf43c3814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:14.230313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739b27e-7ec6-41c0-ba43-25260ab18d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:14.230743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc6ee0-7f30-428b-9d46-bc2cf43c3814 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:14.230875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b27e-7ec6-41c0-ba43-25260ab18d02 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:14.231060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc6ee0-7f30-428b-9d46-bc2cf43c3814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:14.231176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b27e-7ec6-41c0-ba43-25260ab18d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:14.231347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc6ee0-7f30-428b-9d46-bc2cf43c3814 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:14.231446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b27e-7ec6-41c0-ba43-25260ab18d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:14.231989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc6ee0-7f30-428b-9d46-bc2cf43c3814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:14.232120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739b27e-7ec6-41c0-ba43-25260ab18d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:14.233906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739b27e-7ec6-41c0-ba43-25260ab18d02 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:14.234025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc6ee0-7f30-428b-9d46-bc2cf43c3814 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:14.275870 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3173/6284] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:14 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:14.279858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc6ee0-7f30-428b-9d46-bc2cf43c3814 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:14.296094 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3112/6285] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:14 2022] POST /identity/v3/projects => generated 377 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:14.298421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc6ee0-7f30-428b-9d46-bc2cf43c3814 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:14.300796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739b27e-7ec6-41c0-ba43-25260ab18d02 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:14.433162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739b27e-7ec6-41c0-ba43-25260ab18d02 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:14.447757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dc846-de25-461f-a5b4-d5ea086f4901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:14.448240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd0b5d-baaa-48c1-a0a4-e912e974b506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:14.449316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd0b5d-baaa-48c1-a0a4-e912e974b506 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:14.450422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd0b5d-baaa-48c1-a0a4-e912e974b506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:14.450422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd0b5d-baaa-48c1-a0a4-e912e974b506 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:14.450985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dc846-de25-461f-a5b4-d5ea086f4901 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:14.451506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dc846-de25-461f-a5b4-d5ea086f4901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:14.451990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dc846-de25-461f-a5b4-d5ea086f4901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:14.452385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd0b5d-baaa-48c1-a0a4-e912e974b506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:14.453292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dc846-de25-461f-a5b4-d5ea086f4901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:14.456228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd0b5d-baaa-48c1-a0a4-e912e974b506 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:14.458137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dc846-de25-461f-a5b4-d5ea086f4901 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:14.489474 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3174/6286] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:31:14.490737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dc846-de25-461f-a5b4-d5ea086f4901 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:14.505623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dc846-de25-461f-a5b4-d5ea086f4901 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:14.511189 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3113/6287] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:14 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:14.511929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd0b5d-baaa-48c1-a0a4-e912e974b506 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:14.516920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19008761-9442-4fb3-a672-a27de492bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:14.518418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19008761-9442-4fb3-a672-a27de492bdcb admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:14.518899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19008761-9442-4fb3-a672-a27de492bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:14.519337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19008761-9442-4fb3-a672-a27de492bdcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:14.520272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19008761-9442-4fb3-a672-a27de492bdcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:14.522249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19008761-9442-4fb3-a672-a27de492bdcb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:14.554613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd0b5d-baaa-48c1-a0a4-e912e974b506 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:14.565955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b19912-9769-45ca-a146-9a44280d27de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:14.566579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b19912-9769-45ca-a146-9a44280d27de admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:14.566854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b19912-9769-45ca-a146-9a44280d27de admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:14.567146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b19912-9769-45ca-a146-9a44280d27de admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:14.567786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b19912-9769-45ca-a146-9a44280d27de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:14.569579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b19912-9769-45ca-a146-9a44280d27de admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:14.589978 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3114/6288] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:14.590309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b19912-9769-45ca-a146-9a44280d27de admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:14.596489 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3175/6289] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:14.600055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19008761-9442-4fb3-a672-a27de492bdcb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:14.613526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b19912-9769-45ca-a146-9a44280d27de admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:14.621921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce202ab-1ad7-4bec-b625-eadcbeb220d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:14.623426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce202ab-1ad7-4bec-b625-eadcbeb220d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:14.623899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce202ab-1ad7-4bec-b625-eadcbeb220d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:14.624182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce202ab-1ad7-4bec-b625-eadcbeb220d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:14.624833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce202ab-1ad7-4bec-b625-eadcbeb220d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:14.627295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce202ab-1ad7-4bec-b625-eadcbeb220d4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:14.628513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19008761-9442-4fb3-a672-a27de492bdcb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:14.646123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbcf37-19eb-4b62-9384-0b58191b7582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:14.647158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbcf37-19eb-4b62-9384-0b58191b7582 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:14.647816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbcf37-19eb-4b62-9384-0b58191b7582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:14.649170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbcf37-19eb-4b62-9384-0b58191b7582 admin admin] PATH_INFO: `/v3/projects/c6aa6cb2a5464a228a7a744d894f9f9c/users/0c935bd39e2647d88a14090686508d71/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:14.653607 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3115/6290] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:14.660185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce202ab-1ad7-4bec-b625-eadcbeb220d4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:14.680215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce202ab-1ad7-4bec-b625-eadcbeb220d4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:14.685350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbcf37-19eb-4b62-9384-0b58191b7582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6aa6cb2a5464a228a7a744d894f9f9c, user_id=0c935bd39e2647d88a14090686508d71, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:14.688416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15430b7-6955-4e8d-94ca-e0ab6be7559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:14.689218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15430b7-6955-4e8d-94ca-e0ab6be7559d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:14.689663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15430b7-6955-4e8d-94ca-e0ab6be7559d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:14.690541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15430b7-6955-4e8d-94ca-e0ab6be7559d admin admin] PATH_INFO: `/v3/projects/72bc6a022d874497a0dad660ee849586/users/a740a8b8014244f288df844dcba56f18/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:14.690868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbcf37-19eb-4b62-9384-0b58191b7582 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:14.755574 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3176/6291] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:14 2022] PUT /identity/v3/projects/c6aa6cb2a5464a228a7a744d894f9f9c/users/0c935bd39e2647d88a14090686508d71/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:14.761074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0eecd-1b8c-4f43-9022-965a18d802cc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:14.761376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0eecd-1b8c-4f43-9022-965a18d802cc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:14.761644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0eecd-1b8c-4f43-9022-965a18d802cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:14.773991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15430b7-6955-4e8d-94ca-e0ab6be7559d admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bc6a022d874497a0dad660ee849586, user_id=a740a8b8014244f288df844dcba56f18, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:14.777558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15430b7-6955-4e8d-94ca-e0ab6be7559d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:14.813690 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3116/6292] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:14 2022] PUT /identity/v3/projects/72bc6a022d874497a0dad660ee849586/users/a740a8b8014244f288df844dcba56f18/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:31:14.833136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f47d9d-19c2-43c4-9241-8de8504555f4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:14.833473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f47d9d-19c2-43c4-9241-8de8504555f4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:14.833714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f47d9d-19c2-43c4-9241-8de8504555f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:14.837750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a7a0eecd-1b8c-4f43-9022-965a18d802cc None None] MFA Rules not processed for user `0c935bd39e2647d88a14090686508d71`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:14.839290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a7a0eecd-1b8c-4f43-9022-965a18d802cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:14.859116 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:14.922764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-60f47d9d-19c2-43c4-9241-8de8504555f4 None None] MFA Rules not processed for user `a740a8b8014244f288df844dcba56f18`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:14.925491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-60f47d9d-19c2-43c4-9241-8de8504555f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:14.981675 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3177/6293] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:14.992436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0eecd-1b8c-4f43-9022-965a18d802cc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:14.998300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a7a0eecd-1b8c-4f43-9022-965a18d802cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:15.084224 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3117/6294] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:15.134205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f47d9d-19c2-43c4-9241-8de8504555f4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:15.135713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-60f47d9d-19c2-43c4-9241-8de8504555f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:15.144147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0eecd-1b8c-4f43-9022-965a18d802cc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:15.152068 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:15.156244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f47d9d-19c2-43c4-9241-8de8504555f4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:15.162246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43c575-9613-49d9-987e-a224f0713dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:15.162965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43c575-9613-49d9-987e-a224f0713dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:15.163634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43c575-9613-49d9-987e-a224f0713dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:15.163990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43c575-9613-49d9-987e-a224f0713dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:15.170268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04714e5d-23d8-42d0-9606-0c4de101727e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:15.170906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714e5d-23d8-42d0-9606-0c4de101727e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:15.178737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714e5d-23d8-42d0-9606-0c4de101727e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:15.179145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714e5d-23d8-42d0-9606-0c4de101727e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:15.193002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43c575-9613-49d9-987e-a224f0713dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:15.195041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43c575-9613-49d9-987e-a224f0713dcf service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:15.199731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04714e5d-23d8-42d0-9606-0c4de101727e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:15.201239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04714e5d-23d8-42d0-9606-0c4de101727e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:15.212046 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3178/6295] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:31:15.229042 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3118/6296] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:31:17.285141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43c575-9613-49d9-987e-a224f0713dcf service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:17.468606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43c575-9613-49d9-987e-a224f0713dcf service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:17.482065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:17.484106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:17.485001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:17.487261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] PATH_INFO: `/v3/users/0c935bd39e2647d88a14090686508d71` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:17.490537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c935bd39e2647d88a14090686508d71)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:17.498141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:17.653796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c935bd39e2647d88a14090686508d71'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:17.654893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c935bd39e2647d88a14090686508d71'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:17.701677 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:17.710113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c935bd39e2647d88a14090686508d71'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:17.726686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c935bd39e2647d88a14090686508d71'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:17.727745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c935bd39e2647d88a14090686508d71'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:17.746992 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3179/6297] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:31:17 2022] DELETE /identity/v3/users/0c935bd39e2647d88a14090686508d71 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:17.751019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4f98-4b77-46ea-a8fd-d22d46ccb3df None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:17.751543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4f98-4b77-46ea-a8fd-d22d46ccb3df None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:17.751543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4f98-4b77-46ea-a8fd-d22d46ccb3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:17.804137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bbdb4f98-4b77-46ea-a8fd-d22d46ccb3df None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:17.808669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bbdb4f98-4b77-46ea-a8fd-d22d46ccb3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:17.981765 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3119/6298] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:18.155547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:18.157154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:18.312317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df77b08-0779-42d0-a62f-a3173c5566e6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:18.325928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538d7fc-44d8-45a2-9989-2e4d34ad829f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:18.326564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538d7fc-44d8-45a2-9989-2e4d34ad829f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:18.327052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538d7fc-44d8-45a2-9989-2e4d34ad829f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:18.327485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538d7fc-44d8-45a2-9989-2e4d34ad829f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:18.356099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538d7fc-44d8-45a2-9989-2e4d34ad829f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:18.358151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538d7fc-44d8-45a2-9989-2e4d34ad829f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:18.387999 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3180/6299] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:20.114434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb4f98-4b77-46ea-a8fd-d22d46ccb3df None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:20.115922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bbdb4f98-4b77-46ea-a8fd-d22d46ccb3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:20.142230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb4f98-4b77-46ea-a8fd-d22d46ccb3df None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:20.168376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24b338-4564-4fba-9b93-820255edeb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:20.168990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24b338-4564-4fba-9b93-820255edeb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:20.169271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24b338-4564-4fba-9b93-820255edeb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:20.169548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24b338-4564-4fba-9b93-820255edeb9a admin admin] PATH_INFO: `/v3/projects/c6aa6cb2a5464a228a7a744d894f9f9c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:20.178330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24b338-4564-4fba-9b93-820255edeb9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6aa6cb2a5464a228a7a744d894f9f9c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:20.181486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24b338-4564-4fba-9b93-820255edeb9a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:20.325385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eb24b338-4564-4fba-9b93-820255edeb9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6aa6cb2a5464a228a7a744d894f9f9c', 'request_id': 'req-eb24b338-4564-4fba-9b93-820255edeb9a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:20.338716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eb24b338-4564-4fba-9b93-820255edeb9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6aa6cb2a5464a228a7a744d894f9f9c', 'request_id': 'req-eb24b338-4564-4fba-9b93-820255edeb9a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:20.365987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eb24b338-4564-4fba-9b93-820255edeb9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6aa6cb2a5464a228a7a744d894f9f9c', 'request_id': 'req-eb24b338-4564-4fba-9b93-820255edeb9a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:20.385227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eb24b338-4564-4fba-9b93-820255edeb9a admin admin] The token cache is being invalidate because project c6aa6cb2a5464a228a7a744d894f9f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:31:20.387063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eb24b338-4564-4fba-9b93-820255edeb9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:20.389608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eb24b338-4564-4fba-9b93-820255edeb9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:20.395142 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3120/6300] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:31:20 2022] DELETE /identity/v3/projects/c6aa6cb2a5464a228a7a744d894f9f9c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:20.400371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7ccf0-2874-4b4e-ae57-0bdd6a07c983 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:20.401180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7ccf0-2874-4b4e-ae57-0bdd6a07c983 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:20.401639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7ccf0-2874-4b4e-ae57-0bdd6a07c983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:20.495275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-eee7ccf0-2874-4b4e-ae57-0bdd6a07c983 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:20.498726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eee7ccf0-2874-4b4e-ae57-0bdd6a07c983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:20.698055 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3181/6301] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:31:20.699116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cac02-f33c-4a2c-ad78-1e76fe2472b3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:20.699410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cac02-f33c-4a2c-ad78-1e76fe2472b3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:20.699869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cac02-f33c-4a2c-ad78-1e76fe2472b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:20.752754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-af1cac02-f33c-4a2c-ad78-1e76fe2472b3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:20.761862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-af1cac02-f33c-4a2c-ad78-1e76fe2472b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:20.806512 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3121/6302] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:31:20.811294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7ccf0-2874-4b4e-ae57-0bdd6a07c983 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:20.833277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7ccf0-2874-4b4e-ae57-0bdd6a07c983 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:20.845475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4326e0-02e7-4e2d-832c-6ac275e2a933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:20.846608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4326e0-02e7-4e2d-832c-6ac275e2a933 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:20.847068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4326e0-02e7-4e2d-832c-6ac275e2a933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:20.847494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4326e0-02e7-4e2d-832c-6ac275e2a933 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:20.848301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4326e0-02e7-4e2d-832c-6ac275e2a933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:31:20.848762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4326e0-02e7-4e2d-832c-6ac275e2a933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:20.860161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4326e0-02e7-4e2d-832c-6ac275e2a933 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:20.894637 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3182/6303] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:31:20.899071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cac02-f33c-4a2c-ad78-1e76fe2472b3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:20.910230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cac02-f33c-4a2c-ad78-1e76fe2472b3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:20.939297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44a98-e116-45c2-87e1-e32723eb73ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:20.940324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44a98-e116-45c2-87e1-e32723eb73ba admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:20.943264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44a98-e116-45c2-87e1-e32723eb73ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:20.943864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44a98-e116-45c2-87e1-e32723eb73ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:20.944960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44a98-e116-45c2-87e1-e32723eb73ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:20.952231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44a98-e116-45c2-87e1-e32723eb73ba admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:21.053615 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3122/6304] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:20 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:21.055137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4326e0-02e7-4e2d-832c-6ac275e2a933 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:21.068637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4326e0-02e7-4e2d-832c-6ac275e2a933 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:21.271824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a684b1-e30e-4b13-984e-b09fdb78d473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:21.272763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a684b1-e30e-4b13-984e-b09fdb78d473 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:21.274160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a684b1-e30e-4b13-984e-b09fdb78d473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:21.274707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a684b1-e30e-4b13-984e-b09fdb78d473 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:21.276001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a684b1-e30e-4b13-984e-b09fdb78d473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:21.282649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a684b1-e30e-4b13-984e-b09fdb78d473 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:21.317739 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:21.343773 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3183/6305] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:21 2022] POST /identity/v3/users => generated 295 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:21.348460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44a98-e116-45c2-87e1-e32723eb73ba admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:21.369689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44a98-e116-45c2-87e1-e32723eb73ba admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:21.387667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc2b97-e4e6-494a-8004-c018ac0b6907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:21.388309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc2b97-e4e6-494a-8004-c018ac0b6907 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:21.388590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc2b97-e4e6-494a-8004-c018ac0b6907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:21.389025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc2b97-e4e6-494a-8004-c018ac0b6907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:21.389736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc2b97-e4e6-494a-8004-c018ac0b6907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:21.391648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc2b97-e4e6-494a-8004-c018ac0b6907 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:21.430388 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3123/6306] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:21.432032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a684b1-e30e-4b13-984e-b09fdb78d473 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:21.452999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a684b1-e30e-4b13-984e-b09fdb78d473 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:21.467781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa23844-4d77-4112-902d-54c2e714d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:21.469834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa23844-4d77-4112-902d-54c2e714d305 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:21.470133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa23844-4d77-4112-902d-54c2e714d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:21.471929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa23844-4d77-4112-902d-54c2e714d305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:21.475140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa23844-4d77-4112-902d-54c2e714d305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:21.480412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa23844-4d77-4112-902d-54c2e714d305 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:21.520982 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3184/6307] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:21.523370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc2b97-e4e6-494a-8004-c018ac0b6907 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:21.538289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc2b97-e4e6-494a-8004-c018ac0b6907 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:21.556025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c7b0a-6cde-40bd-aae9-df308c5ba8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:21.557133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c7b0a-6cde-40bd-aae9-df308c5ba8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:21.557552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c7b0a-6cde-40bd-aae9-df308c5ba8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:21.557981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c7b0a-6cde-40bd-aae9-df308c5ba8f4 admin admin] PATH_INFO: `/v3/projects/56aeccd6e0d846d19c838f5b449f9d89/users/bd21192484464796bf46517d76777d33/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:21.595580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c7b0a-6cde-40bd-aae9-df308c5ba8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56aeccd6e0d846d19c838f5b449f9d89, user_id=bd21192484464796bf46517d76777d33, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:21.600935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c7b0a-6cde-40bd-aae9-df308c5ba8f4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:21.636351 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3124/6308] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:21 2022] PUT /identity/v3/projects/56aeccd6e0d846d19c838f5b449f9d89/users/bd21192484464796bf46517d76777d33/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:21.650077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8257523-e517-4554-b3bb-93eed7ff6f4c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:21.650611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8257523-e517-4554-b3bb-93eed7ff6f4c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:21.651068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8257523-e517-4554-b3bb-93eed7ff6f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:21.731175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e8257523-e517-4554-b3bb-93eed7ff6f4c None None] MFA Rules not processed for user `bd21192484464796bf46517d76777d33`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:21.732735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e8257523-e517-4554-b3bb-93eed7ff6f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:21.992395 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3185/6309] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:22.007380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c7b0a-6cde-40bd-aae9-df308c5ba8f4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:22.020032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b0c7b0a-6cde-40bd-aae9-df308c5ba8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:22.073693 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:22.224932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c7b0a-6cde-40bd-aae9-df308c5ba8f4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:22.229940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d427169-ec7d-4086-94d7-36350a1be85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:22.230538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d427169-ec7d-4086-94d7-36350a1be85a service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:22.230822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d427169-ec7d-4086-94d7-36350a1be85a service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:22.231218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d427169-ec7d-4086-94d7-36350a1be85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:22.255185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d427169-ec7d-4086-94d7-36350a1be85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:22.257416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d427169-ec7d-4086-94d7-36350a1be85a service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:22.279716 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3125/6310] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:24.308950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8257523-e517-4554-b3bb-93eed7ff6f4c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:24.310653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e8257523-e517-4554-b3bb-93eed7ff6f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:24.471533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8257523-e517-4554-b3bb-93eed7ff6f4c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:24.482193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532511d9-2684-4270-a56c-306deff4e976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:24.483169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532511d9-2684-4270-a56c-306deff4e976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:24.483608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532511d9-2684-4270-a56c-306deff4e976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:24.484042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532511d9-2684-4270-a56c-306deff4e976 admin admin] PATH_INFO: `/v3/users/1019b560417543fa9fc31514951dbeb1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:24.485351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532511d9-2684-4270-a56c-306deff4e976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1019b560417543fa9fc31514951dbeb1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:24.487722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532511d9-2684-4270-a56c-306deff4e976 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:24.593898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-532511d9-2684-4270-a56c-306deff4e976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1019b560417543fa9fc31514951dbeb1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:24.594855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-532511d9-2684-4270-a56c-306deff4e976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1019b560417543fa9fc31514951dbeb1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:24.626634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-532511d9-2684-4270-a56c-306deff4e976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1019b560417543fa9fc31514951dbeb1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:24.638526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-532511d9-2684-4270-a56c-306deff4e976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1019b560417543fa9fc31514951dbeb1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:24.639406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-532511d9-2684-4270-a56c-306deff4e976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1019b560417543fa9fc31514951dbeb1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:24.645556 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:24.669021 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3186/6311] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:31:24 2022] DELETE /identity/v3/users/1019b560417543fa9fc31514951dbeb1 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:24.673095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c9928-8b5f-47f6-aa7a-62db7975198c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:24.673584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c9928-8b5f-47f6-aa7a-62db7975198c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:24.673706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c9928-8b5f-47f6-aa7a-62db7975198c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:24.683984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6b933-f136-46a3-956b-3c76736d81d7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:24.684278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6b933-f136-46a3-956b-3c76736d81d7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:24.684555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6b933-f136-46a3-956b-3c76736d81d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:24.708245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3e5c9928-8b5f-47f6-aa7a-62db7975198c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:24.709878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3e5c9928-8b5f-47f6-aa7a-62db7975198c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:24.750328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e4f6b933-f136-46a3-956b-3c76736d81d7 None None] MFA Rules not processed for user `1d6d6b9af8af4d399c78e0b22b0da004`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:24.751734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e4f6b933-f136-46a3-956b-3c76736d81d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:24.807061 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3126/6312] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:24.808620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c9928-8b5f-47f6-aa7a-62db7975198c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:24.811412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3e5c9928-8b5f-47f6-aa7a-62db7975198c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:24.879939 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3187/6313] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:24.881070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6b933-f136-46a3-956b-3c76736d81d7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:24.883924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c9928-8b5f-47f6-aa7a-62db7975198c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:24.890615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d079ea3-054a-4411-ba94-93f08a4ae2e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:24.892046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d079ea3-054a-4411-ba94-93f08a4ae2e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:24.892324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d079ea3-054a-4411-ba94-93f08a4ae2e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:24.892594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d079ea3-054a-4411-ba94-93f08a4ae2e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:24.894522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5d079ea3-054a-4411-ba94-93f08a4ae2e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:24.896432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6b933-f136-46a3-956b-3c76736d81d7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:24.901503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8451396-f256-4f7b-ae06-edaf8bb20415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:24.902830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8451396-f256-4f7b-ae06-edaf8bb20415 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:24.903322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8451396-f256-4f7b-ae06-edaf8bb20415 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:24.904241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8451396-f256-4f7b-ae06-edaf8bb20415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:24.907975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d079ea3-054a-4411-ba94-93f08a4ae2e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:24.909960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d079ea3-054a-4411-ba94-93f08a4ae2e2 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:24.920417 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3127/6314] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:24.921587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d079ea3-054a-4411-ba94-93f08a4ae2e2 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:24.922952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5d079ea3-054a-4411-ba94-93f08a4ae2e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:24.925447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8451396-f256-4f7b-ae06-edaf8bb20415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:24.927679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8451396-f256-4f7b-ae06-edaf8bb20415 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:24.940705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d079ea3-054a-4411-ba94-93f08a4ae2e2 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:24.943889 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3188/6315] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:24.946465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffe5d6-1ebb-4ccc-a474-beaf64dcd3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:24.947198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffe5d6-1ebb-4ccc-a474-beaf64dcd3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:24.947477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffe5d6-1ebb-4ccc-a474-beaf64dcd3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:24.947743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffe5d6-1ebb-4ccc-a474-beaf64dcd3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:24.948370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffe5d6-1ebb-4ccc-a474-beaf64dcd3f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:24.950264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffe5d6-1ebb-4ccc-a474-beaf64dcd3f0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:25.006782 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3128/6316] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:24 2022] POST /identity/v3/projects => generated 405 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:25.010843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8451396-f256-4f7b-ae06-edaf8bb20415 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:25.034183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8451396-f256-4f7b-ae06-edaf8bb20415 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:25.132549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79518364-6141-4d32-8084-5bdec569f3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:25.133173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79518364-6141-4d32-8084-5bdec569f3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:25.133693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79518364-6141-4d32-8084-5bdec569f3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:25.134116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79518364-6141-4d32-8084-5bdec569f3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:25.134855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79518364-6141-4d32-8084-5bdec569f3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:25.137389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79518364-6141-4d32-8084-5bdec569f3b0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:25.192361 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3189/6317] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:25 2022] POST /identity/v3/users => generated 303 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:31:25.196194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffe5d6-1ebb-4ccc-a474-beaf64dcd3f0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:25.213209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffe5d6-1ebb-4ccc-a474-beaf64dcd3f0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:25.224472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c72da1-b4e9-490e-be9d-f00cd455b923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:25.226259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c72da1-b4e9-490e-be9d-f00cd455b923 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:25.226548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c72da1-b4e9-490e-be9d-f00cd455b923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:25.227229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c72da1-b4e9-490e-be9d-f00cd455b923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:25.228219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c72da1-b4e9-490e-be9d-f00cd455b923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:25.230482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c72da1-b4e9-490e-be9d-f00cd455b923 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:25.249895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79518364-6141-4d32-8084-5bdec569f3b0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:25.265226 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3129/6318] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:25.270431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79518364-6141-4d32-8084-5bdec569f3b0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:25.278727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8796912-61b1-4b1c-b8ed-8fac465b07a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:25.279645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8796912-61b1-4b1c-b8ed-8fac465b07a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:25.279832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8796912-61b1-4b1c-b8ed-8fac465b07a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:25.280167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8796912-61b1-4b1c-b8ed-8fac465b07a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:25.280994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8796912-61b1-4b1c-b8ed-8fac465b07a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:25.282756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8796912-61b1-4b1c-b8ed-8fac465b07a9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:25.307467 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3190/6319] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:25.311596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c72da1-b4e9-490e-be9d-f00cd455b923 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:25.328914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c72da1-b4e9-490e-be9d-f00cd455b923 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:25.342336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ee23a-5439-44bb-b44f-6876ba002bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:25.342985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ee23a-5439-44bb-b44f-6876ba002bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:25.343316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ee23a-5439-44bb-b44f-6876ba002bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:25.343900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ee23a-5439-44bb-b44f-6876ba002bb4 admin admin] PATH_INFO: `/v3/projects/e4d0965b1cdc4667b3436cf8d16397fd/users/bd696a109e84412ea51e920b1b2cb01c/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:25.417937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ee23a-5439-44bb-b44f-6876ba002bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d0965b1cdc4667b3436cf8d16397fd, user_id=bd696a109e84412ea51e920b1b2cb01c, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:25.430364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ee23a-5439-44bb-b44f-6876ba002bb4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:25.459654 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:25.474653 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3130/6320] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:25 2022] PUT /identity/v3/projects/e4d0965b1cdc4667b3436cf8d16397fd/users/bd696a109e84412ea51e920b1b2cb01c/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:25.784862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8796912-61b1-4b1c-b8ed-8fac465b07a9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:25.787410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e8796912-61b1-4b1c-b8ed-8fac465b07a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:25.818427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8796912-61b1-4b1c-b8ed-8fac465b07a9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:25.946508 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:25.977769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863f1fc-2fde-47b4-9495-26feb7746405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:25.978726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863f1fc-2fde-47b4-9495-26feb7746405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:25.979040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863f1fc-2fde-47b4-9495-26feb7746405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:25.979318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863f1fc-2fde-47b4-9495-26feb7746405 admin admin] PATH_INFO: `/v3/projects/fa93612eb81c4c47bb8833b9fe4904e7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:25.983461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863f1fc-2fde-47b4-9495-26feb7746405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa93612eb81c4c47bb8833b9fe4904e7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:25.991397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863f1fc-2fde-47b4-9495-26feb7746405 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:26.161052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9863f1fc-2fde-47b4-9495-26feb7746405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa93612eb81c4c47bb8833b9fe4904e7', 'request_id': 'req-9863f1fc-2fde-47b4-9495-26feb7746405'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:26.180574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9863f1fc-2fde-47b4-9495-26feb7746405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa93612eb81c4c47bb8833b9fe4904e7', 'request_id': 'req-9863f1fc-2fde-47b4-9495-26feb7746405'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:26.200673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9863f1fc-2fde-47b4-9495-26feb7746405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa93612eb81c4c47bb8833b9fe4904e7', 'request_id': 'req-9863f1fc-2fde-47b4-9495-26feb7746405'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:26.226619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9863f1fc-2fde-47b4-9495-26feb7746405 admin admin] The token cache is being invalidate because project fa93612eb81c4c47bb8833b9fe4904e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:31:26.227169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9863f1fc-2fde-47b4-9495-26feb7746405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:26.229522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9863f1fc-2fde-47b4-9495-26feb7746405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:26.234356 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3191/6321] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:31:25 2022] DELETE /identity/v3/projects/fa93612eb81c4c47bb8833b9fe4904e7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:26.239114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bec857-d5bf-4138-aae0-fe67fc7d6c09 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:26.239642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bec857-d5bf-4138-aae0-fe67fc7d6c09 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:26.240024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bec857-d5bf-4138-aae0-fe67fc7d6c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:26.273021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-90bec857-d5bf-4138-aae0-fe67fc7d6c09 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:26.274436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-90bec857-d5bf-4138-aae0-fe67fc7d6c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:26.528231 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3131/6322] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:26.529894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37136026-3aef-4eca-be9d-bdd60e522f48 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:26.530688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37136026-3aef-4eca-be9d-bdd60e522f48 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:26.530688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37136026-3aef-4eca-be9d-bdd60e522f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:26.583149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-37136026-3aef-4eca-be9d-bdd60e522f48 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:26.590233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-37136026-3aef-4eca-be9d-bdd60e522f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:26.625302 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3192/6323] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:26.629315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bec857-d5bf-4138-aae0-fe67fc7d6c09 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:26.649081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bec857-d5bf-4138-aae0-fe67fc7d6c09 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:26.654735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485ab03-f931-40d0-89ba-96353ee20ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:26.655427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485ab03-f931-40d0-89ba-96353ee20ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:26.655662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485ab03-f931-40d0-89ba-96353ee20ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:26.655981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485ab03-f931-40d0-89ba-96353ee20ba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:26.656631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485ab03-f931-40d0-89ba-96353ee20ba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:31:26.656928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485ab03-f931-40d0-89ba-96353ee20ba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:26.660101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485ab03-f931-40d0-89ba-96353ee20ba5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:26.682318 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3132/6324] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:31:26.686978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37136026-3aef-4eca-be9d-bdd60e522f48 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:26.700801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37136026-3aef-4eca-be9d-bdd60e522f48 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:26.715017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee75be-2d5a-4e91-967e-595ca658df08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:26.715365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee75be-2d5a-4e91-967e-595ca658df08 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:26.715487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee75be-2d5a-4e91-967e-595ca658df08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:26.715760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee75be-2d5a-4e91-967e-595ca658df08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:26.716409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee75be-2d5a-4e91-967e-595ca658df08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:26.718323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee75be-2d5a-4e91-967e-595ca658df08 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:26.793169 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3193/6325] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:26 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:26.807492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485ab03-f931-40d0-89ba-96353ee20ba5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:26.826533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485ab03-f931-40d0-89ba-96353ee20ba5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:27.142532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196604f-2227-4c15-ac61-51a2160eea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:27.150291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196604f-2227-4c15-ac61-51a2160eea93 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:27.150603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196604f-2227-4c15-ac61-51a2160eea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:27.150890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196604f-2227-4c15-ac61-51a2160eea93 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:27.151598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196604f-2227-4c15-ac61-51a2160eea93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:27.158823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196604f-2227-4c15-ac61-51a2160eea93 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:27.197170 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3133/6326] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:26 2022] POST /identity/v3/users => generated 303 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:27.198816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee75be-2d5a-4e91-967e-595ca658df08 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:27.225523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee75be-2d5a-4e91-967e-595ca658df08 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:27.246774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916e3dd-06cf-4d89-87bb-139f363621e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:27.247515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916e3dd-06cf-4d89-87bb-139f363621e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:27.247867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916e3dd-06cf-4d89-87bb-139f363621e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:27.248228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916e3dd-06cf-4d89-87bb-139f363621e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:27.248951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916e3dd-06cf-4d89-87bb-139f363621e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:27.250730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916e3dd-06cf-4d89-87bb-139f363621e8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:27.275335 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3194/6327] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:27.275560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196604f-2227-4c15-ac61-51a2160eea93 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:27.290822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196604f-2227-4c15-ac61-51a2160eea93 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:27.308107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8af01-dbb5-4224-87fe-e15516dd8580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:27.308741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8af01-dbb5-4224-87fe-e15516dd8580 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:27.309020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8af01-dbb5-4224-87fe-e15516dd8580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:27.309312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8af01-dbb5-4224-87fe-e15516dd8580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:27.309939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8af01-dbb5-4224-87fe-e15516dd8580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:27.311761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8af01-dbb5-4224-87fe-e15516dd8580 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:27.335123 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3134/6328] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:27.336287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916e3dd-06cf-4d89-87bb-139f363621e8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:27.355045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916e3dd-06cf-4d89-87bb-139f363621e8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:27.369106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463af84-e1e6-4d4f-8158-580ff3975cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:27.369801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463af84-e1e6-4d4f-8158-580ff3975cde admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:27.370046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463af84-e1e6-4d4f-8158-580ff3975cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:27.370320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463af84-e1e6-4d4f-8158-580ff3975cde admin admin] PATH_INFO: `/v3/projects/ec8ba167c6c5404b99a94e0b01a1596a/users/10866d6ca9634c42b08187f6a6dfecf6/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:27.421718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463af84-e1e6-4d4f-8158-580ff3975cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8ba167c6c5404b99a94e0b01a1596a, user_id=10866d6ca9634c42b08187f6a6dfecf6, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:27.429541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463af84-e1e6-4d4f-8158-580ff3975cde admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:27.457534 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3195/6329] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:27 2022] PUT /identity/v3/projects/ec8ba167c6c5404b99a94e0b01a1596a/users/10866d6ca9634c42b08187f6a6dfecf6/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:27.459419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37167cfc-0859-4fc2-bc1d-4a67e6d2c949 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:27.459885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37167cfc-0859-4fc2-bc1d-4a67e6d2c949 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:27.460231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37167cfc-0859-4fc2-bc1d-4a67e6d2c949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:27.496747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-37167cfc-0859-4fc2-bc1d-4a67e6d2c949 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:27.499843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-37167cfc-0859-4fc2-bc1d-4a67e6d2c949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:27.678374 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3135/6330] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:27.723321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463af84-e1e6-4d4f-8158-580ff3975cde admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:27.726073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7463af84-e1e6-4d4f-8158-580ff3975cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:27.863383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463af84-e1e6-4d4f-8158-580ff3975cde admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:27.873981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aae571-4c4e-4329-bb83-b09b136045eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:27.874740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aae571-4c4e-4329-bb83-b09b136045eb service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:27.875159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aae571-4c4e-4329-bb83-b09b136045eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:27.875538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aae571-4c4e-4329-bb83-b09b136045eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:27.898501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aae571-4c4e-4329-bb83-b09b136045eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:27.902594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aae571-4c4e-4329-bb83-b09b136045eb service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:27.942691 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3196/6331] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:29.034746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37167cfc-0859-4fc2-bc1d-4a67e6d2c949 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:29.036438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-37167cfc-0859-4fc2-bc1d-4a67e6d2c949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:29.053038 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:29.251890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37167cfc-0859-4fc2-bc1d-4a67e6d2c949 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:29.272725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ebb68-7f52-4f3e-b578-e910cd1eb083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:29.273652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ebb68-7f52-4f3e-b578-e910cd1eb083 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:29.274106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ebb68-7f52-4f3e-b578-e910cd1eb083 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:29.274542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ebb68-7f52-4f3e-b578-e910cd1eb083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:29.276598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-739ebb68-7f52-4f3e-b578-e910cd1eb083 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:29.310146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ebb68-7f52-4f3e-b578-e910cd1eb083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:29.312088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ebb68-7f52-4f3e-b578-e910cd1eb083 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:29.338677 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3136/6332] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:31.144857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73bdb4-3b86-47a4-89f7-acfef5950361 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:31.145452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73bdb4-3b86-47a4-89f7-acfef5950361 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:31.145633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73bdb4-3b86-47a4-89f7-acfef5950361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:31.182424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ba73bdb4-3b86-47a4-89f7-acfef5950361 None None] MFA Rules not processed for user `10866d6ca9634c42b08187f6a6dfecf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:31.184499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ba73bdb4-3b86-47a4-89f7-acfef5950361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:31.205895 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:31.340227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ebb68-7f52-4f3e-b578-e910cd1eb083 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:31.341808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-739ebb68-7f52-4f3e-b578-e910cd1eb083 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:31.400673 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3197/6333] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:31 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:31.402908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73bdb4-3b86-47a4-89f7-acfef5950361 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:31.440658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73bdb4-3b86-47a4-89f7-acfef5950361 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:31.456324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905702c-d8ec-409a-8b8c-5d6d57ef7512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:31.457447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905702c-d8ec-409a-8b8c-5d6d57ef7512 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:31.457737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905702c-d8ec-409a-8b8c-5d6d57ef7512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:31.458017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905702c-d8ec-409a-8b8c-5d6d57ef7512 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:31.458673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905702c-d8ec-409a-8b8c-5d6d57ef7512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:31.460820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905702c-d8ec-409a-8b8c-5d6d57ef7512 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:31.473839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ebb68-7f52-4f3e-b578-e910cd1eb083 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:31.483843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793233d-8193-482e-8d53-05adc9793396 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:31.485007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793233d-8193-482e-8d53-05adc9793396 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:31.485615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793233d-8193-482e-8d53-05adc9793396 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:31.486037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793233d-8193-482e-8d53-05adc9793396 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:31.492777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e793233d-8193-482e-8d53-05adc9793396 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:31.526505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793233d-8193-482e-8d53-05adc9793396 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:31.530976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793233d-8193-482e-8d53-05adc9793396 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:31.570478 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3198/6334] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:31 2022] POST /identity/v3/projects => generated 403 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:31.572944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905702c-d8ec-409a-8b8c-5d6d57ef7512 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:31.579457 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3137/6335] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:31:31.663637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793233d-8193-482e-8d53-05adc9793396 service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:31.665639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e793233d-8193-482e-8d53-05adc9793396 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:31.689388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793233d-8193-482e-8d53-05adc9793396 service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:31.741072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905702c-d8ec-409a-8b8c-5d6d57ef7512 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:31.748947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7b241-51b6-4502-a47c-84fce6ccf707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:31.749891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7b241-51b6-4502-a47c-84fce6ccf707 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:31.750283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7b241-51b6-4502-a47c-84fce6ccf707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:31.780461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7b241-51b6-4502-a47c-84fce6ccf707 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:31.781205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7b241-51b6-4502-a47c-84fce6ccf707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:31.783236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7b241-51b6-4502-a47c-84fce6ccf707 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:31.871781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ae27e-0013-47d0-9702-0737bd0e9fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:31.873705 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3199/6336] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:31 2022] POST /identity/v3/users => generated 308 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:31.873938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ae27e-0013-47d0-9702-0737bd0e9fee service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:31.874225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ae27e-0013-47d0-9702-0737bd0e9fee service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:31.874501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ae27e-0013-47d0-9702-0737bd0e9fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:31.879713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7b241-51b6-4502-a47c-84fce6ccf707 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:31.884039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-808ae27e-0013-47d0-9702-0737bd0e9fee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:31.909864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ae27e-0013-47d0-9702-0737bd0e9fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:31.912241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ae27e-0013-47d0-9702-0737bd0e9fee service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:31.918604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7b241-51b6-4502-a47c-84fce6ccf707 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:31.940488 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3138/6337] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:31.941695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c494ff-3b90-407b-8f87-88336f21bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:31.944101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c494ff-3b90-407b-8f87-88336f21bbcb admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:31.944382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c494ff-3b90-407b-8f87-88336f21bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:31.951182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c494ff-3b90-407b-8f87-88336f21bbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:31.951982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c494ff-3b90-407b-8f87-88336f21bbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:31.953641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c494ff-3b90-407b-8f87-88336f21bbcb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:31.974798 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3200/6338] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:31.978844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ae27e-0013-47d0-9702-0737bd0e9fee service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:31.997109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ae27e-0013-47d0-9702-0737bd0e9fee service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:32.017018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c5c9b-47ea-4730-974d-3c2ebaec5ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:32.018123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c5c9b-47ea-4730-974d-3c2ebaec5ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:32.018548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c5c9b-47ea-4730-974d-3c2ebaec5ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:32.018840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c5c9b-47ea-4730-974d-3c2ebaec5ce3 admin admin] PATH_INFO: `/v3/projects/93e4ab13615843f5be02b0d7832f8c72/users/8ed377c2537e487a9cb06d33f66afa4d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:32.043269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c5c9b-47ea-4730-974d-3c2ebaec5ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e4ab13615843f5be02b0d7832f8c72, user_id=8ed377c2537e487a9cb06d33f66afa4d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:32.046134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c5c9b-47ea-4730-974d-3c2ebaec5ce3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:32.075515 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3139/6339] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:31 2022] PUT /identity/v3/projects/93e4ab13615843f5be02b0d7832f8c72/users/8ed377c2537e487a9cb06d33f66afa4d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:32.079378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c494ff-3b90-407b-8f87-88336f21bbcb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:32.098948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c494ff-3b90-407b-8f87-88336f21bbcb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:32.293941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e8d33-2fc0-43b1-81e6-46c12ff8885b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:32.298610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e8d33-2fc0-43b1-81e6-46c12ff8885b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:32.299881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e8d33-2fc0-43b1-81e6-46c12ff8885b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:32.301056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e8d33-2fc0-43b1-81e6-46c12ff8885b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:32.303820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e8d33-2fc0-43b1-81e6-46c12ff8885b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:32.307115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e8d33-2fc0-43b1-81e6-46c12ff8885b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:32.308225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c5c9b-47ea-4730-974d-3c2ebaec5ce3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:32.319916 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:32.329376 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3201/6340] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:32.338593 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:32.341642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e8d33-2fc0-43b1-81e6-46c12ff8885b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:32.374954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e8d33-2fc0-43b1-81e6-46c12ff8885b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:32.386138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6545d-d27c-487a-87c4-f9679f9c4d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:32.387509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6545d-d27c-487a-87c4-f9679f9c4d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:32.388190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6545d-d27c-487a-87c4-f9679f9c4d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:32.388681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6545d-d27c-487a-87c4-f9679f9c4d93 admin admin] PATH_INFO: `/v3/projects/93e4ab13615843f5be02b0d7832f8c72/users/8ed377c2537e487a9cb06d33f66afa4d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:32.394596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6545d-d27c-487a-87c4-f9679f9c4d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e4ab13615843f5be02b0d7832f8c72, user_id=8ed377c2537e487a9cb06d33f66afa4d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:32.399231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6545d-d27c-487a-87c4-f9679f9c4d93 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:32.419245 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3202/6341] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:32 2022] PUT /identity/v3/projects/93e4ab13615843f5be02b0d7832f8c72/users/8ed377c2537e487a9cb06d33f66afa4d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:32.451465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c5c9b-47ea-4730-974d-3c2ebaec5ce3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:32.538410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5ab17-c3d3-49ff-9189-3d6e7bbfed13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:32.539429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5ab17-c3d3-49ff-9189-3d6e7bbfed13 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:32.539862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5ab17-c3d3-49ff-9189-3d6e7bbfed13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:32.540309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5ab17-c3d3-49ff-9189-3d6e7bbfed13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:32.543336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-86a5ab17-c3d3-49ff-9189-3d6e7bbfed13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:32.651994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5ab17-c3d3-49ff-9189-3d6e7bbfed13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:32.653611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5ab17-c3d3-49ff-9189-3d6e7bbfed13 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:32.672456 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3140/6342] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:33.959780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6545d-d27c-487a-87c4-f9679f9c4d93 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:33.962501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dac6545d-d27c-487a-87c4-f9679f9c4d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:34.095275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6545d-d27c-487a-87c4-f9679f9c4d93 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:34.115541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:34.118129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:34.118409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:34.118683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] PATH_INFO: `/v3/users/a740a8b8014244f288df844dcba56f18` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:34.120590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a740a8b8014244f288df844dcba56f18)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:34.123903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:34.223229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a740a8b8014244f288df844dcba56f18'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:34.224326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a740a8b8014244f288df844dcba56f18'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:34.240645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a740a8b8014244f288df844dcba56f18'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:34.251239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a740a8b8014244f288df844dcba56f18'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:34.253474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a740a8b8014244f288df844dcba56f18'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:34.272818 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3203/6343] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:31:33 2022] DELETE /identity/v3/users/a740a8b8014244f288df844dcba56f18 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:34.274654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3580cdf-4d38-48cd-8800-d5c9ed2ec2d3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:34.276178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3580cdf-4d38-48cd-8800-d5c9ed2ec2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:34.276676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3580cdf-4d38-48cd-8800-d5c9ed2ec2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:34.307494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e3580cdf-4d38-48cd-8800-d5c9ed2ec2d3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:34.309772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e3580cdf-4d38-48cd-8800-d5c9ed2ec2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:34.416517 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3141/6344] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:31:34.456084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:34.457339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:34.612827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2270f2d-428a-4d88-9de8-5a60a61bf7b1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:34.618028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b69c1d-dd72-4d2b-9171-da1989e84155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:34.619309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b69c1d-dd72-4d2b-9171-da1989e84155 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:34.619309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b69c1d-dd72-4d2b-9171-da1989e84155 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:34.619691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b69c1d-dd72-4d2b-9171-da1989e84155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:34.634708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b69c1d-dd72-4d2b-9171-da1989e84155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:34.636609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b69c1d-dd72-4d2b-9171-da1989e84155 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:34.651377 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3204/6345] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:35.035679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c09b61-f805-4c48-a0f9-0c679dd7de17 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:35.035974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c09b61-f805-4c48-a0f9-0c679dd7de17 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:35.039047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c09b61-f805-4c48-a0f9-0c679dd7de17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:35.065671 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:35.080785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-98c09b61-f805-4c48-a0f9-0c679dd7de17 None None] MFA Rules not processed for user `8ed377c2537e487a9cb06d33f66afa4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:35.082460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-98c09b61-f805-4c48-a0f9-0c679dd7de17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:35.202142 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3142/6346] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:35.811000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b69c1d-dd72-4d2b-9171-da1989e84155 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:35.815031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-73b69c1d-dd72-4d2b-9171-da1989e84155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:35.837731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b69c1d-dd72-4d2b-9171-da1989e84155 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:35.864733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01461b-4177-4e0c-8ef9-21475b35ee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:35.865718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01461b-4177-4e0c-8ef9-21475b35ee8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:35.867371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01461b-4177-4e0c-8ef9-21475b35ee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:35.868315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01461b-4177-4e0c-8ef9-21475b35ee8f admin admin] PATH_INFO: `/v3/projects/72bc6a022d874497a0dad660ee849586` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:35.871231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01461b-4177-4e0c-8ef9-21475b35ee8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bc6a022d874497a0dad660ee849586)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:35.880129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01461b-4177-4e0c-8ef9-21475b35ee8f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:35.887683 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:36.035271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9e01461b-4177-4e0c-8ef9-21475b35ee8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bc6a022d874497a0dad660ee849586', 'request_id': 'req-9e01461b-4177-4e0c-8ef9-21475b35ee8f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:36.043069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9e01461b-4177-4e0c-8ef9-21475b35ee8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bc6a022d874497a0dad660ee849586', 'request_id': 'req-9e01461b-4177-4e0c-8ef9-21475b35ee8f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:36.053127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9e01461b-4177-4e0c-8ef9-21475b35ee8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bc6a022d874497a0dad660ee849586', 'request_id': 'req-9e01461b-4177-4e0c-8ef9-21475b35ee8f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:36.067574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9e01461b-4177-4e0c-8ef9-21475b35ee8f admin admin] The token cache is being invalidate because project 72bc6a022d874497a0dad660ee849586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:31:36.068097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9e01461b-4177-4e0c-8ef9-21475b35ee8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:36.068952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9e01461b-4177-4e0c-8ef9-21475b35ee8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:36.071292 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3205/6347] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:31:35 2022] DELETE /identity/v3/projects/72bc6a022d874497a0dad660ee849586 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:36.076115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8b89b-1895-41c9-a476-2760b06f8c85 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:36.077114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8b89b-1895-41c9-a476-2760b06f8c85 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:36.077496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8b89b-1895-41c9-a476-2760b06f8c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:36.105202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-19f8b89b-1895-41c9-a476-2760b06f8c85 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:36.106724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-19f8b89b-1895-41c9-a476-2760b06f8c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:36.205573 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3143/6348] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:31:36.215277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fbbd7-3657-4fb9-9fde-a4869e834ae2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:36.215646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fbbd7-3657-4fb9-9fde-a4869e834ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:36.215883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fbbd7-3657-4fb9-9fde-a4869e834ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:36.253350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-944fbbd7-3657-4fb9-9fde-a4869e834ae2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:36.258709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-944fbbd7-3657-4fb9-9fde-a4869e834ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:36.281716 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3206/6349] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:36.286782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8b89b-1895-41c9-a476-2760b06f8c85 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:36.305198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8b89b-1895-41c9-a476-2760b06f8c85 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:36.322108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bba15e-fb0d-4f35-a48d-b05787e15ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:36.322738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bba15e-fb0d-4f35-a48d-b05787e15ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:36.323043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bba15e-fb0d-4f35-a48d-b05787e15ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:36.323317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bba15e-fb0d-4f35-a48d-b05787e15ca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:36.323971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bba15e-fb0d-4f35-a48d-b05787e15ca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:31:36.324271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bba15e-fb0d-4f35-a48d-b05787e15ca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:36.325872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bba15e-fb0d-4f35-a48d-b05787e15ca7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:36.344320 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3144/6350] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:31:36.345191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fbbd7-3657-4fb9-9fde-a4869e834ae2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:36.358396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fbbd7-3657-4fb9-9fde-a4869e834ae2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:36.364156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986829b-9409-40aa-a19d-9c1f33756e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:36.364829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986829b-9409-40aa-a19d-9c1f33756e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:36.365114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986829b-9409-40aa-a19d-9c1f33756e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:36.365392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986829b-9409-40aa-a19d-9c1f33756e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:36.366035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986829b-9409-40aa-a19d-9c1f33756e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:36.368479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986829b-9409-40aa-a19d-9c1f33756e50 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:36.408244 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3207/6351] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:36 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:36.410492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bba15e-fb0d-4f35-a48d-b05787e15ca7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:36.423482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bba15e-fb0d-4f35-a48d-b05787e15ca7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:36.508249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8b2c3-0d82-4372-952a-21ef4a90431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:36.509147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8b2c3-0d82-4372-952a-21ef4a90431c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:36.509609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8b2c3-0d82-4372-952a-21ef4a90431c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:36.510119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8b2c3-0d82-4372-952a-21ef4a90431c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:36.510942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8b2c3-0d82-4372-952a-21ef4a90431c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:36.513716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8b2c3-0d82-4372-952a-21ef4a90431c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:36.564137 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3145/6352] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:36 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:36.567919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986829b-9409-40aa-a19d-9c1f33756e50 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:36.579517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986829b-9409-40aa-a19d-9c1f33756e50 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:36.586706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf74a0-27f1-4875-9523-0e366ca13504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:36.587370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf74a0-27f1-4875-9523-0e366ca13504 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:36.587658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf74a0-27f1-4875-9523-0e366ca13504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:36.587929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf74a0-27f1-4875-9523-0e366ca13504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:36.588580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf74a0-27f1-4875-9523-0e366ca13504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:36.590314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf74a0-27f1-4875-9523-0e366ca13504 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:36.604450 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3208/6353] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:36.607586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8b2c3-0d82-4372-952a-21ef4a90431c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:36.623790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8b2c3-0d82-4372-952a-21ef4a90431c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:36.636584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480c3d0-310e-48fc-bc36-2d16cee37de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:36.638455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480c3d0-310e-48fc-bc36-2d16cee37de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:36.639516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480c3d0-310e-48fc-bc36-2d16cee37de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:36.640007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480c3d0-310e-48fc-bc36-2d16cee37de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:36.640881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480c3d0-310e-48fc-bc36-2d16cee37de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:36.643335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480c3d0-310e-48fc-bc36-2d16cee37de3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:36.662028 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3146/6354] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:36.666152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf74a0-27f1-4875-9523-0e366ca13504 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:36.683310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf74a0-27f1-4875-9523-0e366ca13504 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:36.694018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f2f4d-83ac-4ea6-84e3-5941d95055c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:36.695603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f2f4d-83ac-4ea6-84e3-5941d95055c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:36.696831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f2f4d-83ac-4ea6-84e3-5941d95055c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:36.696831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f2f4d-83ac-4ea6-84e3-5941d95055c7 admin admin] PATH_INFO: `/v3/projects/200bce5500534c62b7ca45cb1002853f/users/773cb3b19f3d48ae81c23645eb2ce455/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:36.738240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f2f4d-83ac-4ea6-84e3-5941d95055c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200bce5500534c62b7ca45cb1002853f, user_id=773cb3b19f3d48ae81c23645eb2ce455, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:36.744190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f2f4d-83ac-4ea6-84e3-5941d95055c7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:36.766547 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3209/6355] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:36 2022] PUT /identity/v3/projects/200bce5500534c62b7ca45cb1002853f/users/773cb3b19f3d48ae81c23645eb2ce455/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:36.777294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc843feb-c1d2-499d-88f7-0c872fdc4aae None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:36.777577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc843feb-c1d2-499d-88f7-0c872fdc4aae None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:36.777854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc843feb-c1d2-499d-88f7-0c872fdc4aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:36.786856 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:36.816799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bc843feb-c1d2-499d-88f7-0c872fdc4aae None None] MFA Rules not processed for user `773cb3b19f3d48ae81c23645eb2ce455`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:36.817807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bc843feb-c1d2-499d-88f7-0c872fdc4aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:36.913223 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3147/6356] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:36.917514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f2f4d-83ac-4ea6-84e3-5941d95055c7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:37.090020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f2f4d-83ac-4ea6-84e3-5941d95055c7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:37.095494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be7812-5ae4-4e8f-a519-8fc46a491da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:37.097262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be7812-5ae4-4e8f-a519-8fc46a491da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:37.098268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be7812-5ae4-4e8f-a519-8fc46a491da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:37.098586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be7812-5ae4-4e8f-a519-8fc46a491da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:37.099385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be7812-5ae4-4e8f-a519-8fc46a491da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:37.103183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be7812-5ae4-4e8f-a519-8fc46a491da4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:37.156548 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3210/6357] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:36 2022] POST /identity/v3/projects => generated 373 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:37.162820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc843feb-c1d2-499d-88f7-0c872fdc4aae None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:37.195881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc843feb-c1d2-499d-88f7-0c872fdc4aae None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:37.280415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc9cda-22cd-4429-8add-60c2184f902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:37.281575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc9cda-22cd-4429-8add-60c2184f902e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:37.281951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc9cda-22cd-4429-8add-60c2184f902e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:37.282315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc9cda-22cd-4429-8add-60c2184f902e admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:37.283201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc9cda-22cd-4429-8add-60c2184f902e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:37.287557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc9cda-22cd-4429-8add-60c2184f902e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:37.354531 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3148/6358] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:37 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:37.358817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be7812-5ae4-4e8f-a519-8fc46a491da4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:37.373574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be7812-5ae4-4e8f-a519-8fc46a491da4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:37.387345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cca8db-76cd-4dc6-9695-2d0377f88c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:37.388409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cca8db-76cd-4dc6-9695-2d0377f88c8b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:37.388954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cca8db-76cd-4dc6-9695-2d0377f88c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:37.389496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cca8db-76cd-4dc6-9695-2d0377f88c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:37.390405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cca8db-76cd-4dc6-9695-2d0377f88c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:37.393567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cca8db-76cd-4dc6-9695-2d0377f88c8b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:37.414537 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3211/6359] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:37.418507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc9cda-22cd-4429-8add-60c2184f902e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:37.436117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc9cda-22cd-4429-8add-60c2184f902e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:37.445575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780422ff-de98-4b4a-b7d0-8b83614cea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:37.446416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780422ff-de98-4b4a-b7d0-8b83614cea31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:37.446895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780422ff-de98-4b4a-b7d0-8b83614cea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:37.447397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780422ff-de98-4b4a-b7d0-8b83614cea31 admin admin] PATH_INFO: `/v3/projects/8ad5f5fab5dd42fd94be46e2600bd442/users/af9a45e136e34cf7ac7abb3ded503fd7/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:37.472261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780422ff-de98-4b4a-b7d0-8b83614cea31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad5f5fab5dd42fd94be46e2600bd442, user_id=af9a45e136e34cf7ac7abb3ded503fd7, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:37.475697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780422ff-de98-4b4a-b7d0-8b83614cea31 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:37.502959 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3149/6360] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:37 2022] PUT /identity/v3/projects/8ad5f5fab5dd42fd94be46e2600bd442/users/af9a45e136e34cf7ac7abb3ded503fd7/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:37.506648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cca8db-76cd-4dc6-9695-2d0377f88c8b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:37.514711 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:37.548768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cca8db-76cd-4dc6-9695-2d0377f88c8b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:37.637431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcce1f6-53fa-402e-9c46-53a87d6bedba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:37.638382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcce1f6-53fa-402e-9c46-53a87d6bedba admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:37.638729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcce1f6-53fa-402e-9c46-53a87d6bedba admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:37.639168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcce1f6-53fa-402e-9c46-53a87d6bedba admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:37.639955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcce1f6-53fa-402e-9c46-53a87d6bedba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:37.641974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcce1f6-53fa-402e-9c46-53a87d6bedba admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:37.659119 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3212/6361] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:37.659710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780422ff-de98-4b4a-b7d0-8b83614cea31 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:37.675125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780422ff-de98-4b4a-b7d0-8b83614cea31 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:37.684354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56f145-780c-4902-ab04-d481fe90494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:37.685033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f145-780c-4902-ab04-d481fe90494f admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:37.685310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f145-780c-4902-ab04-d481fe90494f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:37.685599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f145-780c-4902-ab04-d481fe90494f admin admin] PATH_INFO: `/v3/projects/8ad5f5fab5dd42fd94be46e2600bd442/users/af9a45e136e34cf7ac7abb3ded503fd7/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:37.688916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56f145-780c-4902-ab04-d481fe90494f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad5f5fab5dd42fd94be46e2600bd442, user_id=af9a45e136e34cf7ac7abb3ded503fd7, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:37.692584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56f145-780c-4902-ab04-d481fe90494f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:37.722988 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3150/6362] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:37 2022] PUT /identity/v3/projects/8ad5f5fab5dd42fd94be46e2600bd442/users/af9a45e136e34cf7ac7abb3ded503fd7/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:31:37.728401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0797bd-7fe9-4b15-927a-ca02fe7d83db None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:37.728757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0797bd-7fe9-4b15-927a-ca02fe7d83db None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:37.729101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0797bd-7fe9-4b15-927a-ca02fe7d83db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:37.772673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fa0797bd-7fe9-4b15-927a-ca02fe7d83db None None] MFA Rules not processed for user `af9a45e136e34cf7ac7abb3ded503fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:37.778075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fa0797bd-7fe9-4b15-927a-ca02fe7d83db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:37.833650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56f145-780c-4902-ab04-d481fe90494f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:37.836006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7c56f145-780c-4902-ab04-d481fe90494f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:37.922622 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3213/6363] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:37.934134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0797bd-7fe9-4b15-927a-ca02fe7d83db None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:37.935901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fa0797bd-7fe9-4b15-927a-ca02fe7d83db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:37.972480 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:38.026663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56f145-780c-4902-ab04-d481fe90494f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:38.035690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35e67-9737-47e8-a697-6b276973041e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:38.036402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35e67-9737-47e8-a697-6b276973041e service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:38.037681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35e67-9737-47e8-a697-6b276973041e service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:38.038066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35e67-9737-47e8-a697-6b276973041e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:38.040583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d9c35e67-9737-47e8-a697-6b276973041e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:38.058621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c35e67-9737-47e8-a697-6b276973041e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:38.062038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c35e67-9737-47e8-a697-6b276973041e service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:38.087575 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3151/6364] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:31:38.089734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0797bd-7fe9-4b15-927a-ca02fe7d83db None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:38.099861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d4395-0986-4d4f-a537-2af9583050eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:38.100987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d4395-0986-4d4f-a537-2af9583050eb service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:38.101597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d4395-0986-4d4f-a537-2af9583050eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:38.102090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d4395-0986-4d4f-a537-2af9583050eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:38.126054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d4395-0986-4d4f-a537-2af9583050eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:38.131511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d4395-0986-4d4f-a537-2af9583050eb service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:38.156766 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3214/6365] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:38.279283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35e67-9737-47e8-a697-6b276973041e service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:38.296083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35e67-9737-47e8-a697-6b276973041e service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:38.306031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3722a-f24f-41c7-8fa1-a2266a126ca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:38.306901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3722a-f24f-41c7-8fa1-a2266a126ca3 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:38.309312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3722a-f24f-41c7-8fa1-a2266a126ca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:38.309780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3722a-f24f-41c7-8fa1-a2266a126ca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:38.396811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3722a-f24f-41c7-8fa1-a2266a126ca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:38.399264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3722a-f24f-41c7-8fa1-a2266a126ca3 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:38.418132 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3152/6366] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:39.479427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d4395-0986-4d4f-a537-2af9583050eb service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:39.482024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2c4d4395-0986-4d4f-a537-2af9583050eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:39.504921 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:39.659915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d4395-0986-4d4f-a537-2af9583050eb service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:39.672786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:39.673487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:39.673829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:39.674756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] PATH_INFO: `/v3/users/10866d6ca9634c42b08187f6a6dfecf6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:39.676022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=10866d6ca9634c42b08187f6a6dfecf6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:39.677961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:39.775878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10866d6ca9634c42b08187f6a6dfecf6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:39.776719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10866d6ca9634c42b08187f6a6dfecf6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:39.805440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10866d6ca9634c42b08187f6a6dfecf6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:39.827754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10866d6ca9634c42b08187f6a6dfecf6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:39.829216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10866d6ca9634c42b08187f6a6dfecf6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:39.840202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63654fa-109d-42e0-81ba-18c6c486c52f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:39.842467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63654fa-109d-42e0-81ba-18c6c486c52f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:39.842900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63654fa-109d-42e0-81ba-18c6c486c52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:39.871438 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3215/6367] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:31:39 2022] DELETE /identity/v3/users/10866d6ca9634c42b08187f6a6dfecf6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:39.884563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a63654fa-109d-42e0-81ba-18c6c486c52f None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:39.885799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a63654fa-109d-42e0-81ba-18c6c486c52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:40.032664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:40.034992 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3153/6368] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:31:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:31:40.035306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:40.166056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1ffa4-5cc8-4a1a-81b1-14922106bf1d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:40.174298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df6f9e-038b-405c-96e9-460dcf05430c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:40.175905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df6f9e-038b-405c-96e9-460dcf05430c service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:40.176252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df6f9e-038b-405c-96e9-460dcf05430c service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:40.176621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df6f9e-038b-405c-96e9-460dcf05430c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:40.191805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df6f9e-038b-405c-96e9-460dcf05430c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:40.194154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df6f9e-038b-405c-96e9-460dcf05430c service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:40.214762 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3216/6369] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:31:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:31:40.916154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63654fa-109d-42e0-81ba-18c6c486c52f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:40.917750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a63654fa-109d-42e0-81ba-18c6c486c52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:41.160828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63654fa-109d-42e0-81ba-18c6c486c52f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:41.172514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b6051-9cde-4aee-aa75-21ee2a6dc8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:41.173179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b6051-9cde-4aee-aa75-21ee2a6dc8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:41.173462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b6051-9cde-4aee-aa75-21ee2a6dc8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:41.174356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b6051-9cde-4aee-aa75-21ee2a6dc8af admin admin] PATH_INFO: `/v3/projects/ec8ba167c6c5404b99a94e0b01a1596a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:41.180529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b6051-9cde-4aee-aa75-21ee2a6dc8af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec8ba167c6c5404b99a94e0b01a1596a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:41.182760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b6051-9cde-4aee-aa75-21ee2a6dc8af admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:41.222694 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:41.289679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-124b6051-9cde-4aee-aa75-21ee2a6dc8af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8ba167c6c5404b99a94e0b01a1596a', 'request_id': 'req-124b6051-9cde-4aee-aa75-21ee2a6dc8af'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:41.306043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-124b6051-9cde-4aee-aa75-21ee2a6dc8af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8ba167c6c5404b99a94e0b01a1596a', 'request_id': 'req-124b6051-9cde-4aee-aa75-21ee2a6dc8af'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:41.320235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-124b6051-9cde-4aee-aa75-21ee2a6dc8af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8ba167c6c5404b99a94e0b01a1596a', 'request_id': 'req-124b6051-9cde-4aee-aa75-21ee2a6dc8af'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:41.341298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-124b6051-9cde-4aee-aa75-21ee2a6dc8af admin admin] The token cache is being invalidate because project ec8ba167c6c5404b99a94e0b01a1596a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:31:41.341603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-124b6051-9cde-4aee-aa75-21ee2a6dc8af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:41.344313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-124b6051-9cde-4aee-aa75-21ee2a6dc8af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:41.351745 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3154/6370] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:31:40 2022] DELETE /identity/v3/projects/ec8ba167c6c5404b99a94e0b01a1596a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:41.355911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df6f9e-038b-405c-96e9-460dcf05430c service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:41.375688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df6f9e-038b-405c-96e9-460dcf05430c service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:41.413237 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:41.511965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dde0ca-bcdb-470a-b42e-f7c9aeb616cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:41.512665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dde0ca-bcdb-470a-b42e-f7c9aeb616cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:41.512949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dde0ca-bcdb-470a-b42e-f7c9aeb616cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:41.513491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dde0ca-bcdb-470a-b42e-f7c9aeb616cc admin admin] PATH_INFO: `/v3/users/8ed377c2537e487a9cb06d33f66afa4d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:41.514688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dde0ca-bcdb-470a-b42e-f7c9aeb616cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed377c2537e487a9cb06d33f66afa4d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:41.516952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dde0ca-bcdb-470a-b42e-f7c9aeb616cc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:41.663745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55dde0ca-bcdb-470a-b42e-f7c9aeb616cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed377c2537e487a9cb06d33f66afa4d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:41.666786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55dde0ca-bcdb-470a-b42e-f7c9aeb616cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed377c2537e487a9cb06d33f66afa4d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:41.685201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55dde0ca-bcdb-470a-b42e-f7c9aeb616cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed377c2537e487a9cb06d33f66afa4d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:41.703479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55dde0ca-bcdb-470a-b42e-f7c9aeb616cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed377c2537e487a9cb06d33f66afa4d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:41.705758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55dde0ca-bcdb-470a-b42e-f7c9aeb616cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed377c2537e487a9cb06d33f66afa4d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:41.745816 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3217/6371] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:31:41 2022] DELETE /identity/v3/users/8ed377c2537e487a9cb06d33f66afa4d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:41.907349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60535fa-4f46-4857-9571-163658fbd02b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:41.907823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60535fa-4f46-4857-9571-163658fbd02b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:41.908655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60535fa-4f46-4857-9571-163658fbd02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:41.981850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c60535fa-4f46-4857-9571-163658fbd02b None None] MFA Rules not processed for user `bd696a109e84412ea51e920b1b2cb01c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:41.984526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c60535fa-4f46-4857-9571-163658fbd02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:42.153116 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3155/6372] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:42.168931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9dd43-c703-4fb7-a486-ee160fd8db10 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:42.169721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9dd43-c703-4fb7-a486-ee160fd8db10 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:42.170961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9dd43-c703-4fb7-a486-ee160fd8db10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:42.266700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-66f9dd43-c703-4fb7-a486-ee160fd8db10 None None] MFA Rules not processed for user `1d6d6b9af8af4d399c78e0b22b0da004`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:42.272178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-66f9dd43-c703-4fb7-a486-ee160fd8db10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:42.463180 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3218/6373] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:42 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:42.474998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60535fa-4f46-4857-9571-163658fbd02b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:42.476745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c60535fa-4f46-4857-9571-163658fbd02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:42.483427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9dd43-c703-4fb7-a486-ee160fd8db10 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:42.485164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-66f9dd43-c703-4fb7-a486-ee160fd8db10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:42.585116 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:42.654870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9dd43-c703-4fb7-a486-ee160fd8db10 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:42.669327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b862b5-ad5b-4fce-bd6d-039f979ff74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:42.670142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b862b5-ad5b-4fce-bd6d-039f979ff74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:42.670563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b862b5-ad5b-4fce-bd6d-039f979ff74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:42.670894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b862b5-ad5b-4fce-bd6d-039f979ff74f admin admin] PATH_INFO: `/v3/projects/93e4ab13615843f5be02b0d7832f8c72` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:42.675223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b862b5-ad5b-4fce-bd6d-039f979ff74f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e4ab13615843f5be02b0d7832f8c72)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:42.677291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b862b5-ad5b-4fce-bd6d-039f979ff74f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:42.788024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60535fa-4f46-4857-9571-163658fbd02b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:42.807592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-09b862b5-ad5b-4fce-bd6d-039f979ff74f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e4ab13615843f5be02b0d7832f8c72', 'request_id': 'req-09b862b5-ad5b-4fce-bd6d-039f979ff74f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:42.824948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-09b862b5-ad5b-4fce-bd6d-039f979ff74f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e4ab13615843f5be02b0d7832f8c72', 'request_id': 'req-09b862b5-ad5b-4fce-bd6d-039f979ff74f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:42.845318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-09b862b5-ad5b-4fce-bd6d-039f979ff74f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e4ab13615843f5be02b0d7832f8c72', 'request_id': 'req-09b862b5-ad5b-4fce-bd6d-039f979ff74f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:42.870318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-09b862b5-ad5b-4fce-bd6d-039f979ff74f admin admin] The token cache is being invalidate because project 93e4ab13615843f5be02b0d7832f8c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:31:42.870540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-09b862b5-ad5b-4fce-bd6d-039f979ff74f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:42.875364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-09b862b5-ad5b-4fce-bd6d-039f979ff74f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:42.881477 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3219/6374] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:31:42 2022] DELETE /identity/v3/projects/93e4ab13615843f5be02b0d7832f8c72 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:31:42.882557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7aaeb-dd55-457b-8004-c2544455fa32 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:42.882845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7aaeb-dd55-457b-8004-c2544455fa32 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:42.883185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7aaeb-dd55-457b-8004-c2544455fa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:42.910742 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:42.927839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-86f7aaeb-dd55-457b-8004-c2544455fa32 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:42.929450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-86f7aaeb-dd55-457b-8004-c2544455fa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:42.996083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017901d1-b339-4949-b2e9-797fae5c30b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:42.996787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017901d1-b339-4949-b2e9-797fae5c30b9 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:42.997453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017901d1-b339-4949-b2e9-797fae5c30b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:42.998014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017901d1-b339-4949-b2e9-797fae5c30b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:43.001703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-017901d1-b339-4949-b2e9-797fae5c30b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:43.078769 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3220/6375] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:43.089069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e853f7c-5cfb-4dc9-88e4-25ab3065530f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:43.089421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e853f7c-5cfb-4dc9-88e4-25ab3065530f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:43.089623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e853f7c-5cfb-4dc9-88e4-25ab3065530f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:43.148042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5e853f7c-5cfb-4dc9-88e4-25ab3065530f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:43.149275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5e853f7c-5cfb-4dc9-88e4-25ab3065530f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:43.170141 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3221/6376] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:43.175533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e853f7c-5cfb-4dc9-88e4-25ab3065530f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:43.183629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017901d1-b339-4949-b2e9-797fae5c30b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:43.192131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017901d1-b339-4949-b2e9-797fae5c30b9 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:43.201333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e853f7c-5cfb-4dc9-88e4-25ab3065530f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:43.214936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b622ba-b535-4f70-b504-de9af320aad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:43.215463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b622ba-b535-4f70-b504-de9af320aad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:43.215887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b622ba-b535-4f70-b504-de9af320aad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:43.216174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b622ba-b535-4f70-b504-de9af320aad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:43.216892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b622ba-b535-4f70-b504-de9af320aad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:31:43.217166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b622ba-b535-4f70-b504-de9af320aad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:43.217668 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3156/6377] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:42 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:43.218759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b622ba-b535-4f70-b504-de9af320aad7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:43.249307 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3222/6378] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:31:43.254950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017901d1-b339-4949-b2e9-797fae5c30b9 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:43.277202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017901d1-b339-4949-b2e9-797fae5c30b9 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:43.307166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f4ecc-2247-43d5-9a55-770b06abe6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:43.308648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f4ecc-2247-43d5-9a55-770b06abe6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:43.308938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f4ecc-2247-43d5-9a55-770b06abe6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:43.310237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f4ecc-2247-43d5-9a55-770b06abe6a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:43.310932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f4ecc-2247-43d5-9a55-770b06abe6a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:43.331069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f4ecc-2247-43d5-9a55-770b06abe6a4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:43.452332 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3157/6379] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:43 2022] POST /identity/v3/projects => generated 363 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:43.452708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b622ba-b535-4f70-b504-de9af320aad7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:43.473781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b622ba-b535-4f70-b504-de9af320aad7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:43.630042 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:43.672725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab99a3-5b8d-4e77-897b-e14e3a4dcfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:43.674345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab99a3-5b8d-4e77-897b-e14e3a4dcfe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:43.676585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab99a3-5b8d-4e77-897b-e14e3a4dcfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:43.676975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab99a3-5b8d-4e77-897b-e14e3a4dcfe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:43.679194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab99a3-5b8d-4e77-897b-e14e3a4dcfe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:43.687575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab99a3-5b8d-4e77-897b-e14e3a4dcfe6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:43.739470 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3223/6380] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:43 2022] POST /identity/v3/users => generated 282 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:43.742868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f4ecc-2247-43d5-9a55-770b06abe6a4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:43.758772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f4ecc-2247-43d5-9a55-770b06abe6a4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:43.773079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5471c8a-de25-48d8-99e7-26284956e6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:43.773827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5471c8a-de25-48d8-99e7-26284956e6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:43.774324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5471c8a-de25-48d8-99e7-26284956e6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:43.774743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5471c8a-de25-48d8-99e7-26284956e6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:43.775510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5471c8a-de25-48d8-99e7-26284956e6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:43.779719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5471c8a-de25-48d8-99e7-26284956e6a9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:43.806717 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3158/6381] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:43.810216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab99a3-5b8d-4e77-897b-e14e3a4dcfe6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:43.826662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab99a3-5b8d-4e77-897b-e14e3a4dcfe6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:43.842557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155daea-e300-4733-946a-31dc192a3afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:43.843358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155daea-e300-4733-946a-31dc192a3afc admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:43.843766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155daea-e300-4733-946a-31dc192a3afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:43.844198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155daea-e300-4733-946a-31dc192a3afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:43.844820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155daea-e300-4733-946a-31dc192a3afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:43.851514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155daea-e300-4733-946a-31dc192a3afc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:43.897372 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3224/6382] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:43.901720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5471c8a-de25-48d8-99e7-26284956e6a9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:43.915761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5471c8a-de25-48d8-99e7-26284956e6a9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:43.931167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7ebbe-cc05-42b0-b43b-f595d59fe457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:43.933310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7ebbe-cc05-42b0-b43b-f595d59fe457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:43.933731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7ebbe-cc05-42b0-b43b-f595d59fe457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:43.934763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7ebbe-cc05-42b0-b43b-f595d59fe457 admin admin] PATH_INFO: `/v3/projects/1a1d39fbaa814343aa4d5b04bc4500c6/users/9d83d1da36fd4d0f8ba7b1600198897b/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:43.972276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7ebbe-cc05-42b0-b43b-f595d59fe457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1d39fbaa814343aa4d5b04bc4500c6, user_id=9d83d1da36fd4d0f8ba7b1600198897b, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:43.979975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7ebbe-cc05-42b0-b43b-f595d59fe457 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:44.018949 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3159/6383] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:43 2022] PUT /identity/v3/projects/1a1d39fbaa814343aa4d5b04bc4500c6/users/9d83d1da36fd4d0f8ba7b1600198897b/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:44.025806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0813d-d72e-480f-b5d4-85659f996735 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:44.026095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0813d-d72e-480f-b5d4-85659f996735 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:44.026556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0813d-d72e-480f-b5d4-85659f996735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:44.096275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7bf0813d-d72e-480f-b5d4-85659f996735 None None] MFA Rules not processed for user `9d83d1da36fd4d0f8ba7b1600198897b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:44.099985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7bf0813d-d72e-480f-b5d4-85659f996735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:44.294242 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3225/6384] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:44.298461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7ebbe-cc05-42b0-b43b-f595d59fe457 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:44.446990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7ebbe-cc05-42b0-b43b-f595d59fe457 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:44.462149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3b4e2-f442-495d-8ca0-d41f653031e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:44.462760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b4e2-f442-495d-8ca0-d41f653031e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:44.463075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b4e2-f442-495d-8ca0-d41f653031e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:44.463350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b4e2-f442-495d-8ca0-d41f653031e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:44.463999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3b4e2-f442-495d-8ca0-d41f653031e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:44.469245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3b4e2-f442-495d-8ca0-d41f653031e7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:44.517004 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:44.542894 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3160/6385] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:44 2022] POST /identity/v3/projects => generated 363 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:44.547032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0813d-d72e-480f-b5d4-85659f996735 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:44.582634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0813d-d72e-480f-b5d4-85659f996735 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:44.764663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e29cc2-9f96-44ac-a537-b801d4381af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:44.765920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e29cc2-9f96-44ac-a537-b801d4381af0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:44.766205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e29cc2-9f96-44ac-a537-b801d4381af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:44.767221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e29cc2-9f96-44ac-a537-b801d4381af0 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:44.769022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e29cc2-9f96-44ac-a537-b801d4381af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:44.778193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e29cc2-9f96-44ac-a537-b801d4381af0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:44.858903 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3226/6386] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:44 2022] POST /identity/v3/users => generated 288 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:44.862763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3b4e2-f442-495d-8ca0-d41f653031e7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:44.876366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3b4e2-f442-495d-8ca0-d41f653031e7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:44.903648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e116f-d947-40b2-9d31-e7385da4193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:44.906046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e116f-d947-40b2-9d31-e7385da4193f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:44.906334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e116f-d947-40b2-9d31-e7385da4193f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:44.906617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e116f-d947-40b2-9d31-e7385da4193f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:44.907342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e116f-d947-40b2-9d31-e7385da4193f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:44.913680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e116f-d947-40b2-9d31-e7385da4193f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:44.968556 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3161/6387] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:44.970002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e29cc2-9f96-44ac-a537-b801d4381af0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:44.995480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e29cc2-9f96-44ac-a537-b801d4381af0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:45.010569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71413f0c-64f1-4a43-a574-ad34f74e7e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:45.013743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413f0c-64f1-4a43-a574-ad34f74e7e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:45.014033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413f0c-64f1-4a43-a574-ad34f74e7e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:45.014318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413f0c-64f1-4a43-a574-ad34f74e7e19 admin admin] PATH_INFO: `/v3/projects/526b136423dc4058ba0bf6efb3e0b61f/users/f1f3e645a3a24424a1e98466b57de618/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:45.075702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71413f0c-64f1-4a43-a574-ad34f74e7e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526b136423dc4058ba0bf6efb3e0b61f, user_id=f1f3e645a3a24424a1e98466b57de618, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:45.078764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71413f0c-64f1-4a43-a574-ad34f74e7e19 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:45.104810 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3227/6388] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:44 2022] PUT /identity/v3/projects/526b136423dc4058ba0bf6efb3e0b61f/users/f1f3e645a3a24424a1e98466b57de618/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:45.108915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e116f-d947-40b2-9d31-e7385da4193f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:45.143884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e116f-d947-40b2-9d31-e7385da4193f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:45.305530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84a9a4-04f6-440f-81c3-099a95ca4deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:45.306161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84a9a4-04f6-440f-81c3-099a95ca4deb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:45.306441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84a9a4-04f6-440f-81c3-099a95ca4deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:45.306779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84a9a4-04f6-440f-81c3-099a95ca4deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:45.307520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84a9a4-04f6-440f-81c3-099a95ca4deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:45.309294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84a9a4-04f6-440f-81c3-099a95ca4deb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:45.326894 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3162/6389] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:45.331838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71413f0c-64f1-4a43-a574-ad34f74e7e19 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:45.352769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71413f0c-64f1-4a43-a574-ad34f74e7e19 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:45.370979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfae46f-166f-4a35-82f2-3a837a98adeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:45.371817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfae46f-166f-4a35-82f2-3a837a98adeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:45.372104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfae46f-166f-4a35-82f2-3a837a98adeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:45.372455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfae46f-166f-4a35-82f2-3a837a98adeb admin admin] PATH_INFO: `/v3/projects/526b136423dc4058ba0bf6efb3e0b61f/users/f1f3e645a3a24424a1e98466b57de618/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:45.378358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfae46f-166f-4a35-82f2-3a837a98adeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=526b136423dc4058ba0bf6efb3e0b61f, user_id=f1f3e645a3a24424a1e98466b57de618, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:45.385436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfae46f-166f-4a35-82f2-3a837a98adeb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:45.411086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84a9a4-04f6-440f-81c3-099a95ca4deb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:45.413947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2e84a9a4-04f6-440f-81c3-099a95ca4deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:45.439098 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3228/6390] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:45 2022] PUT /identity/v3/projects/526b136423dc4058ba0bf6efb3e0b61f/users/f1f3e645a3a24424a1e98466b57de618/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:31:45.450874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e30ad7-833e-484d-bb4f-3f2096016136 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:45.451398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e30ad7-833e-484d-bb4f-3f2096016136 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:45.452128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e30ad7-833e-484d-bb4f-3f2096016136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:45.506561 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:45.555388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b8e30ad7-833e-484d-bb4f-3f2096016136 None None] MFA Rules not processed for user `f1f3e645a3a24424a1e98466b57de618`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:45.557166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b8e30ad7-833e-484d-bb4f-3f2096016136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:45.640736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84a9a4-04f6-440f-81c3-099a95ca4deb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:45.766234 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3229/6391] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:31:45.778409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e30ad7-833e-484d-bb4f-3f2096016136 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:45.780135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b8e30ad7-833e-484d-bb4f-3f2096016136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:45.843183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfb03d-98d8-440b-9463-2d9410de8389 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:45.847539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfb03d-98d8-440b-9463-2d9410de8389 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:45.847907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfb03d-98d8-440b-9463-2d9410de8389 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:45.848279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfb03d-98d8-440b-9463-2d9410de8389 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:45.850289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-43bfb03d-98d8-440b-9463-2d9410de8389 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:45.889339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfb03d-98d8-440b-9463-2d9410de8389 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:45.892006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfb03d-98d8-440b-9463-2d9410de8389 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:45.929884 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3163/6392] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:45.995403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e30ad7-833e-484d-bb4f-3f2096016136 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:46.008564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043234f4-76fc-4183-ae0c-3f59fd7c80f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:46.009199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043234f4-76fc-4183-ae0c-3f59fd7c80f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:46.009485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043234f4-76fc-4183-ae0c-3f59fd7c80f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:46.009763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043234f4-76fc-4183-ae0c-3f59fd7c80f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:46.065927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043234f4-76fc-4183-ae0c-3f59fd7c80f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:46.068344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043234f4-76fc-4183-ae0c-3f59fd7c80f5 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:46.091459 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3230/6393] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:31:47.074025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfb03d-98d8-440b-9463-2d9410de8389 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:47.103564 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:47.259419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfb03d-98d8-440b-9463-2d9410de8389 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:47.288114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:47.290129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:47.290676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:47.291264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] PATH_INFO: `/v3/users/9d83d1da36fd4d0f8ba7b1600198897b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:47.292744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d83d1da36fd4d0f8ba7b1600198897b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:47.295341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:47.427908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d83d1da36fd4d0f8ba7b1600198897b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:47.430382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d83d1da36fd4d0f8ba7b1600198897b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:47.491883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d83d1da36fd4d0f8ba7b1600198897b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:47.515159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d83d1da36fd4d0f8ba7b1600198897b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:47.516081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d83d1da36fd4d0f8ba7b1600198897b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:47.555274 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3164/6394] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:31:47 2022] DELETE /identity/v3/users/9d83d1da36fd4d0f8ba7b1600198897b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:47.567197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c9e57-1993-4cfc-b981-bf2662bbefef None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:47.567768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c9e57-1993-4cfc-b981-bf2662bbefef None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:47.568373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c9e57-1993-4cfc-b981-bf2662bbefef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:47.615036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ae9c9e57-1993-4cfc-b981-bf2662bbefef None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:47.616410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ae9c9e57-1993-4cfc-b981-bf2662bbefef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:47.820375 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3231/6395] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:47.829039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:47.830766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:48.050431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35a572-a8ee-4ac8-80d2-df63948d0af0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:48.074021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f254a-9258-4ece-9ef4-59005b3e8db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:48.074789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f254a-9258-4ece-9ef4-59005b3e8db6 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:48.075260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f254a-9258-4ece-9ef4-59005b3e8db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:48.075636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f254a-9258-4ece-9ef4-59005b3e8db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:48.100072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f254a-9258-4ece-9ef4-59005b3e8db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:48.101660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f254a-9258-4ece-9ef4-59005b3e8db6 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:48.125178 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3165/6396] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:49.700891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c9e57-1993-4cfc-b981-bf2662bbefef None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:49.707177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ae9c9e57-1993-4cfc-b981-bf2662bbefef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:49.724479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c9e57-1993-4cfc-b981-bf2662bbefef None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:49.750478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:49.751076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:49.751358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:49.751630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] PATH_INFO: `/v3/projects/1a1d39fbaa814343aa4d5b04bc4500c6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:49.758708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1d39fbaa814343aa4d5b04bc4500c6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:49.760894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:49.888304 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:49.914286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1d39fbaa814343aa4d5b04bc4500c6', 'request_id': 'req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:49.936095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1d39fbaa814343aa4d5b04bc4500c6', 'request_id': 'req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:49.956893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1d39fbaa814343aa4d5b04bc4500c6', 'request_id': 'req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:49.987089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] The token cache is being invalidate because project 1a1d39fbaa814343aa4d5b04bc4500c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:31:49.987827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:49.995396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:50.004703 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3232/6397] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:31:49 2022] DELETE /identity/v3/projects/1a1d39fbaa814343aa4d5b04bc4500c6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:50.008620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f254a-9258-4ece-9ef4-59005b3e8db6 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:50.033849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f254a-9258-4ece-9ef4-59005b3e8db6 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:50.123919 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:50.184968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6566b-b0d0-4e65-b591-39642c8d33d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:50.185913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6566b-b0d0-4e65-b591-39642c8d33d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:50.186342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6566b-b0d0-4e65-b591-39642c8d33d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:50.186763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6566b-b0d0-4e65-b591-39642c8d33d3 admin admin] PATH_INFO: `/v3/users/f1f3e645a3a24424a1e98466b57de618` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:50.188198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6566b-b0d0-4e65-b591-39642c8d33d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f3e645a3a24424a1e98466b57de618)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:50.190634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6566b-b0d0-4e65-b591-39642c8d33d3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:50.311397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76b6566b-b0d0-4e65-b591-39642c8d33d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f3e645a3a24424a1e98466b57de618'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:50.313849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76b6566b-b0d0-4e65-b591-39642c8d33d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f3e645a3a24424a1e98466b57de618'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:50.352229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76b6566b-b0d0-4e65-b591-39642c8d33d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f3e645a3a24424a1e98466b57de618'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:50.369561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76b6566b-b0d0-4e65-b591-39642c8d33d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f3e645a3a24424a1e98466b57de618'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:50.370806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76b6566b-b0d0-4e65-b591-39642c8d33d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f3e645a3a24424a1e98466b57de618'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:50.418800 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3166/6398] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:31:50 2022] DELETE /identity/v3/users/f1f3e645a3a24424a1e98466b57de618 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:51.835972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:51.838079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:51.889166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbcdcb-c4cb-482b-ae9f-ff43e4896c3e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:52.098232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7143dc6-186d-4cb9-9833-0d257f984a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:52.098886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7143dc6-186d-4cb9-9833-0d257f984a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:52.099193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7143dc6-186d-4cb9-9833-0d257f984a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:52.099469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7143dc6-186d-4cb9-9833-0d257f984a9d admin admin] PATH_INFO: `/v3/projects/526b136423dc4058ba0bf6efb3e0b61f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:52.100632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7143dc6-186d-4cb9-9833-0d257f984a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=526b136423dc4058ba0bf6efb3e0b61f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:52.102581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7143dc6-186d-4cb9-9833-0d257f984a9d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:52.316526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e7143dc6-186d-4cb9-9833-0d257f984a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526b136423dc4058ba0bf6efb3e0b61f', 'request_id': 'req-e7143dc6-186d-4cb9-9833-0d257f984a9d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:52.323627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e7143dc6-186d-4cb9-9833-0d257f984a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526b136423dc4058ba0bf6efb3e0b61f', 'request_id': 'req-e7143dc6-186d-4cb9-9833-0d257f984a9d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:52.341743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e7143dc6-186d-4cb9-9833-0d257f984a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526b136423dc4058ba0bf6efb3e0b61f', 'request_id': 'req-e7143dc6-186d-4cb9-9833-0d257f984a9d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:52.365325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e7143dc6-186d-4cb9-9833-0d257f984a9d admin admin] The token cache is being invalidate because project 526b136423dc4058ba0bf6efb3e0b61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:31:52.365616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e7143dc6-186d-4cb9-9833-0d257f984a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:52.367447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e7143dc6-186d-4cb9-9833-0d257f984a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:52.369296 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3233/6399] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:31:51 2022] DELETE /identity/v3/projects/526b136423dc4058ba0bf6efb3e0b61f => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:52.374128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcca3c9-e25f-4a21-9bbe-083556f0d63b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:52.374811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcca3c9-e25f-4a21-9bbe-083556f0d63b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:52.374811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcca3c9-e25f-4a21-9bbe-083556f0d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:52.420102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ffcca3c9-e25f-4a21-9bbe-083556f0d63b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:52.427004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ffcca3c9-e25f-4a21-9bbe-083556f0d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:52.626053 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3167/6400] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:52.634018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204439b-5789-45d1-a300-8cd3c94f5d17 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:52.634404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204439b-5789-45d1-a300-8cd3c94f5d17 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:52.634553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204439b-5789-45d1-a300-8cd3c94f5d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:52.674465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7204439b-5789-45d1-a300-8cd3c94f5d17 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:52.675868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7204439b-5789-45d1-a300-8cd3c94f5d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:52.704664 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3234/6401] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:52.710196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcca3c9-e25f-4a21-9bbe-083556f0d63b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:52.726616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcca3c9-e25f-4a21-9bbe-083556f0d63b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:52.749973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a196006-81f7-43d4-8d5e-bc9c4e1d6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:52.751106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196006-81f7-43d4-8d5e-bc9c4e1d6051 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:52.751588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196006-81f7-43d4-8d5e-bc9c4e1d6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:52.753041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196006-81f7-43d4-8d5e-bc9c4e1d6051 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:52.754870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a196006-81f7-43d4-8d5e-bc9c4e1d6051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:31:52.756743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a196006-81f7-43d4-8d5e-bc9c4e1d6051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:52.761248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a196006-81f7-43d4-8d5e-bc9c4e1d6051 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:52.846622 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3168/6402] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:31:52.847803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204439b-5789-45d1-a300-8cd3c94f5d17 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:52.858305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204439b-5789-45d1-a300-8cd3c94f5d17 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:52.875688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140f24d-6339-4fa2-b39e-b31002f35063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:52.883386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140f24d-6339-4fa2-b39e-b31002f35063 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:52.884536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140f24d-6339-4fa2-b39e-b31002f35063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:52.885625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140f24d-6339-4fa2-b39e-b31002f35063 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:52.887216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140f24d-6339-4fa2-b39e-b31002f35063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:52.890302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140f24d-6339-4fa2-b39e-b31002f35063 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:52.985359 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3235/6403] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:52 2022] POST /identity/v3/projects => generated 355 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:52.990741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a196006-81f7-43d4-8d5e-bc9c4e1d6051 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:53.024350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a196006-81f7-43d4-8d5e-bc9c4e1d6051 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:53.181376 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:53.233394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29462d0-7755-4454-b86b-722438922d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:53.234307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29462d0-7755-4454-b86b-722438922d88 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:53.234765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29462d0-7755-4454-b86b-722438922d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:53.235071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29462d0-7755-4454-b86b-722438922d88 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:53.235729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29462d0-7755-4454-b86b-722438922d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:53.239402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29462d0-7755-4454-b86b-722438922d88 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:53.323979 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3169/6404] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:52 2022] POST /identity/v3/users => generated 278 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:53.327702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140f24d-6339-4fa2-b39e-b31002f35063 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:53.374628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140f24d-6339-4fa2-b39e-b31002f35063 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:53.401514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678dd96-9f0f-4660-8b47-ff9a23723241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:53.403621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678dd96-9f0f-4660-8b47-ff9a23723241 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:53.412218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678dd96-9f0f-4660-8b47-ff9a23723241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:53.412743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678dd96-9f0f-4660-8b47-ff9a23723241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:53.415487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678dd96-9f0f-4660-8b47-ff9a23723241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:53.417338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678dd96-9f0f-4660-8b47-ff9a23723241 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:53.481085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29462d0-7755-4454-b86b-722438922d88 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:53.494542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29462d0-7755-4454-b86b-722438922d88 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:53.499235 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3236/6405] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:53.512741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc4fb6-a13e-4677-a9ef-decccddd87c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:53.513843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc4fb6-a13e-4677-a9ef-decccddd87c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:53.514121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc4fb6-a13e-4677-a9ef-decccddd87c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:53.514391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc4fb6-a13e-4677-a9ef-decccddd87c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:53.515067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc4fb6-a13e-4677-a9ef-decccddd87c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:53.516651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc4fb6-a13e-4677-a9ef-decccddd87c1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:53.555836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678dd96-9f0f-4660-8b47-ff9a23723241 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:53.566316 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3170/6406] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:53.573530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678dd96-9f0f-4660-8b47-ff9a23723241 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:53.591433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356743a-f27c-478e-b65b-6ae75859e5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:53.592364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356743a-f27c-478e-b65b-6ae75859e5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:53.592852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356743a-f27c-478e-b65b-6ae75859e5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:53.593296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356743a-f27c-478e-b65b-6ae75859e5c3 admin admin] PATH_INFO: `/v3/projects/3c173df85e2942769d3361a511a628c7/users/cf762132a6a94be29246c528174b2fb8/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:53.629173 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:53.656707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356743a-f27c-478e-b65b-6ae75859e5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c173df85e2942769d3361a511a628c7, user_id=cf762132a6a94be29246c528174b2fb8, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:53.660950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356743a-f27c-478e-b65b-6ae75859e5c3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:53.723800 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3237/6407] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:53 2022] PUT /identity/v3/projects/3c173df85e2942769d3361a511a628c7/users/cf762132a6a94be29246c528174b2fb8/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:53.736214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf0e44-da17-4942-b2fc-0316ee43d9c5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:53.736757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf0e44-da17-4942-b2fc-0316ee43d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:53.737277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf0e44-da17-4942-b2fc-0316ee43d9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:53.816368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c6bf0e44-da17-4942-b2fc-0316ee43d9c5 None None] MFA Rules not processed for user `cf762132a6a94be29246c528174b2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:53.819347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c6bf0e44-da17-4942-b2fc-0316ee43d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:54.088610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356743a-f27c-478e-b65b-6ae75859e5c3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:54.094510 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3171/6408] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:54.221188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356743a-f27c-478e-b65b-6ae75859e5c3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:54.227862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac67e0-79a5-4e1f-8df7-eba3013d3f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:54.228835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac67e0-79a5-4e1f-8df7-eba3013d3f75 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:54.229420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac67e0-79a5-4e1f-8df7-eba3013d3f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:54.229941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac67e0-79a5-4e1f-8df7-eba3013d3f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:54.230817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac67e0-79a5-4e1f-8df7-eba3013d3f75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:54.234224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac67e0-79a5-4e1f-8df7-eba3013d3f75 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:54.294967 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3238/6409] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:54 2022] POST /identity/v3/projects => generated 355 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:54.298882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf0e44-da17-4942-b2fc-0316ee43d9c5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:54.317916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf0e44-da17-4942-b2fc-0316ee43d9c5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:54.413107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a198a-9ebd-4820-9c44-5ade76fe404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:54.413787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a198a-9ebd-4820-9c44-5ade76fe404a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:54.414307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a198a-9ebd-4820-9c44-5ade76fe404a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:54.414661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a198a-9ebd-4820-9c44-5ade76fe404a admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:54.415524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a198a-9ebd-4820-9c44-5ade76fe404a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:54.418054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a198a-9ebd-4820-9c44-5ade76fe404a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:54.452167 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3172/6410] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:54 2022] POST /identity/v3/users => generated 284 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:54.453985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac67e0-79a5-4e1f-8df7-eba3013d3f75 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:54.472053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac67e0-79a5-4e1f-8df7-eba3013d3f75 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:54.497910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456be717-6210-447c-965e-4bf79431743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:54.501525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456be717-6210-447c-965e-4bf79431743f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:54.501525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456be717-6210-447c-965e-4bf79431743f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:54.501525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456be717-6210-447c-965e-4bf79431743f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:54.505095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456be717-6210-447c-965e-4bf79431743f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:54.512224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456be717-6210-447c-965e-4bf79431743f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:54.536091 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3239/6411] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:54.540550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a198a-9ebd-4820-9c44-5ade76fe404a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:54.571240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a198a-9ebd-4820-9c44-5ade76fe404a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:54.596260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfd68a-290f-4c30-ba2d-0da5e1b2cae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:54.596958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfd68a-290f-4c30-ba2d-0da5e1b2cae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:54.597292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfd68a-290f-4c30-ba2d-0da5e1b2cae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:54.597596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfd68a-290f-4c30-ba2d-0da5e1b2cae6 admin admin] PATH_INFO: `/v3/projects/97eeec610e1a420c9d9ff77dcd1ef8d3/users/3723a7ae9a9e4ce69a1375804b250c72/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:54.658579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfd68a-290f-4c30-ba2d-0da5e1b2cae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97eeec610e1a420c9d9ff77dcd1ef8d3, user_id=3723a7ae9a9e4ce69a1375804b250c72, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:54.668581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfd68a-290f-4c30-ba2d-0da5e1b2cae6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:54.732554 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3173/6412] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:54 2022] PUT /identity/v3/projects/97eeec610e1a420c9d9ff77dcd1ef8d3/users/3723a7ae9a9e4ce69a1375804b250c72/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:54.733959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456be717-6210-447c-965e-4bf79431743f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:54.750240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456be717-6210-447c-965e-4bf79431743f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:54.902222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998f7ae-7688-4e0e-aec2-c09e66004385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:54.903271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998f7ae-7688-4e0e-aec2-c09e66004385 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:54.903801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998f7ae-7688-4e0e-aec2-c09e66004385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:54.904268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998f7ae-7688-4e0e-aec2-c09e66004385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:54.905165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998f7ae-7688-4e0e-aec2-c09e66004385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:54.907549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998f7ae-7688-4e0e-aec2-c09e66004385 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:54.936486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfd68a-290f-4c30-ba2d-0da5e1b2cae6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:54.943312 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3240/6413] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:54.953961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfd68a-290f-4c30-ba2d-0da5e1b2cae6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:54.984963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bdfbd-d30a-42a4-bb88-39b0251ca3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:54.985932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bdfbd-d30a-42a4-bb88-39b0251ca3a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:54.987016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bdfbd-d30a-42a4-bb88-39b0251ca3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:54.987300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bdfbd-d30a-42a4-bb88-39b0251ca3a0 admin admin] PATH_INFO: `/v3/projects/97eeec610e1a420c9d9ff77dcd1ef8d3/users/3723a7ae9a9e4ce69a1375804b250c72/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:54.990300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bdfbd-d30a-42a4-bb88-39b0251ca3a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97eeec610e1a420c9d9ff77dcd1ef8d3, user_id=3723a7ae9a9e4ce69a1375804b250c72, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:54.995719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bdfbd-d30a-42a4-bb88-39b0251ca3a0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:55.022295 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3174/6414] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:54 2022] PUT /identity/v3/projects/97eeec610e1a420c9d9ff77dcd1ef8d3/users/3723a7ae9a9e4ce69a1375804b250c72/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:55.034347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a346b-bcb7-43fa-9e8e-a6b3c1cad323 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:55.034622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a346b-bcb7-43fa-9e8e-a6b3c1cad323 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:55.034899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a346b-bcb7-43fa-9e8e-a6b3c1cad323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:55.094536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-152a346b-bcb7-43fa-9e8e-a6b3c1cad323 None None] MFA Rules not processed for user `3723a7ae9a9e4ce69a1375804b250c72`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:55.096430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-152a346b-bcb7-43fa-9e8e-a6b3c1cad323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:55.203700 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:55.275097 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3241/6415] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:55.287659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bdfbd-d30a-42a4-bb88-39b0251ca3a0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:55.289707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-377bdfbd-d30a-42a4-bb88-39b0251ca3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:55.296003 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:55.415976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bdfbd-d30a-42a4-bb88-39b0251ca3a0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:55.425355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c73b2-c02b-4b89-b125-664912d44c15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:55.428625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c73b2-c02b-4b89-b125-664912d44c15 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:55.429028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c73b2-c02b-4b89-b125-664912d44c15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:55.429418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c73b2-c02b-4b89-b125-664912d44c15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:55.459302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c73b2-c02b-4b89-b125-664912d44c15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:55.460987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c73b2-c02b-4b89-b125-664912d44c15 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:55.495429 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3175/6416] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:55.586090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a346b-bcb7-43fa-9e8e-a6b3c1cad323 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:55.603234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a346b-bcb7-43fa-9e8e-a6b3c1cad323 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:55.607340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f2e24-886d-43e7-b4ef-281c2ed5c12e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:55.608040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f2e24-886d-43e7-b4ef-281c2ed5c12e service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:55.608387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f2e24-886d-43e7-b4ef-281c2ed5c12e service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:55.608721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f2e24-886d-43e7-b4ef-281c2ed5c12e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:55.684775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f2e24-886d-43e7-b4ef-281c2ed5c12e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:55.686998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f2e24-886d-43e7-b4ef-281c2ed5c12e service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:55.704114 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3242/6417] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:56.019530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c73b2-c02b-4b89-b125-664912d44c15 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:56.021041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-846c73b2-c02b-4b89-b125-664912d44c15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:56.174890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c73b2-c02b-4b89-b125-664912d44c15 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:56.185777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:56.187255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:56.187742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:56.188226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] PATH_INFO: `/v3/users/bd21192484464796bf46517d76777d33` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:56.190072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd21192484464796bf46517d76777d33)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:56.192808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:56.306898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd21192484464796bf46517d76777d33'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:56.308117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd21192484464796bf46517d76777d33'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:56.337875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd21192484464796bf46517d76777d33'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:56.348643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd21192484464796bf46517d76777d33'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:56.349649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd21192484464796bf46517d76777d33'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:56.388453 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3176/6418] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:31:56 2022] DELETE /identity/v3/users/bd21192484464796bf46517d76777d33 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:56.391174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2cca3-26de-4efe-8017-f3bf4e73b9bc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:56.392160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2cca3-26de-4efe-8017-f3bf4e73b9bc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:56.392915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2cca3-26de-4efe-8017-f3bf4e73b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:56.422361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-22d2cca3-26de-4efe-8017-f3bf4e73b9bc None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:56.424921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22d2cca3-26de-4efe-8017-f3bf4e73b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:56.533668 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3243/6419] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:56.579397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:56.582228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:56.633247 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:56.718330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a3694-1908-489e-9a7f-ca97f9c13ed3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:56.728985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e86f9-8643-4d67-8e78-d9357429001f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:56.729882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e86f9-8643-4d67-8e78-d9357429001f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:56.730163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e86f9-8643-4d67-8e78-d9357429001f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:56.731028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e86f9-8643-4d67-8e78-d9357429001f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:56.754484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e86f9-8643-4d67-8e78-d9357429001f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:56.755836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e86f9-8643-4d67-8e78-d9357429001f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:56.766695 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3177/6420] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:31:57.050227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2cca3-26de-4efe-8017-f3bf4e73b9bc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:57.052158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22d2cca3-26de-4efe-8017-f3bf4e73b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:57.087304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2cca3-26de-4efe-8017-f3bf4e73b9bc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:57.096192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb6549-d907-4a01-9fd0-7047b5f959c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:57.096846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6549-d907-4a01-9fd0-7047b5f959c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:57.097129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6549-d907-4a01-9fd0-7047b5f959c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:57.097406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6549-d907-4a01-9fd0-7047b5f959c9 admin admin] PATH_INFO: `/v3/projects/56aeccd6e0d846d19c838f5b449f9d89` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:57.099137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb6549-d907-4a01-9fd0-7047b5f959c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56aeccd6e0d846d19c838f5b449f9d89)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:57.101106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb6549-d907-4a01-9fd0-7047b5f959c9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:57.209403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37fb6549-d907-4a01-9fd0-7047b5f959c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56aeccd6e0d846d19c838f5b449f9d89', 'request_id': 'req-37fb6549-d907-4a01-9fd0-7047b5f959c9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:57.219974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37fb6549-d907-4a01-9fd0-7047b5f959c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56aeccd6e0d846d19c838f5b449f9d89', 'request_id': 'req-37fb6549-d907-4a01-9fd0-7047b5f959c9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:57.238520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37fb6549-d907-4a01-9fd0-7047b5f959c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56aeccd6e0d846d19c838f5b449f9d89', 'request_id': 'req-37fb6549-d907-4a01-9fd0-7047b5f959c9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:57.261020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37fb6549-d907-4a01-9fd0-7047b5f959c9 admin admin] The token cache is being invalidate because project 56aeccd6e0d846d19c838f5b449f9d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:31:57.261324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37fb6549-d907-4a01-9fd0-7047b5f959c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:57.262601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37fb6549-d907-4a01-9fd0-7047b5f959c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:31:57.264127 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3244/6421] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:31:57 2022] DELETE /identity/v3/projects/56aeccd6e0d846d19c838f5b449f9d89 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:31:57.270130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c65b3d-239d-4a13-8eb7-ab4aa388f63c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:57.270571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c65b3d-239d-4a13-8eb7-ab4aa388f63c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:57.270699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c65b3d-239d-4a13-8eb7-ab4aa388f63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:57.307018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b6c65b3d-239d-4a13-8eb7-ab4aa388f63c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:57.308650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b6c65b3d-239d-4a13-8eb7-ab4aa388f63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:57.398092 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3178/6422] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:57.399620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76134fb4-8b75-4efb-a2d4-edde0dbeb2d8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:57.400186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76134fb4-8b75-4efb-a2d4-edde0dbeb2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:57.400186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76134fb4-8b75-4efb-a2d4-edde0dbeb2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:57.417139 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:57.428112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-76134fb4-8b75-4efb-a2d4-edde0dbeb2d8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:57.431322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-76134fb4-8b75-4efb-a2d4-edde0dbeb2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:57.452887 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3245/6423] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:31:57.456947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c65b3d-239d-4a13-8eb7-ab4aa388f63c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:57.468006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c65b3d-239d-4a13-8eb7-ab4aa388f63c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:57.475790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fffe5-decb-4a7b-a352-880dfc85e060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:57.476026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fffe5-decb-4a7b-a352-880dfc85e060 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:57.476329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fffe5-decb-4a7b-a352-880dfc85e060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:57.476842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fffe5-decb-4a7b-a352-880dfc85e060 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:57.477261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fffe5-decb-4a7b-a352-880dfc85e060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:31:57.477920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fffe5-decb-4a7b-a352-880dfc85e060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:57.479462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fffe5-decb-4a7b-a352-880dfc85e060 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:57.512444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76134fb4-8b75-4efb-a2d4-edde0dbeb2d8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:57.517226 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3179/6424] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:31:57.524401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76134fb4-8b75-4efb-a2d4-edde0dbeb2d8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:57.530330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c9468-303c-4cfb-899e-a922b6b2edd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:57.531434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c9468-303c-4cfb-899e-a922b6b2edd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:57.531830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c9468-303c-4cfb-899e-a922b6b2edd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:57.532229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c9468-303c-4cfb-899e-a922b6b2edd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:57.533134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c9468-303c-4cfb-899e-a922b6b2edd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:57.535159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c9468-303c-4cfb-899e-a922b6b2edd7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:57.610482 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3246/6425] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:31:57 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:57.612964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fffe5-decb-4a7b-a352-880dfc85e060 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:57.624539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fffe5-decb-4a7b-a352-880dfc85e060 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:57.728377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2f4f9-e397-4157-ab39-ac55aaab8a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:57.729579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2f4f9-e397-4157-ab39-ac55aaab8a44 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:57.729761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2f4f9-e397-4157-ab39-ac55aaab8a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:57.730318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2f4f9-e397-4157-ab39-ac55aaab8a44 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:57.731848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2f4f9-e397-4157-ab39-ac55aaab8a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:57.738465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2f4f9-e397-4157-ab39-ac55aaab8a44 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:57.787122 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3180/6426] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:31:57 2022] POST /identity/v3/users => generated 279 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:31:57.791324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c9468-303c-4cfb-899e-a922b6b2edd7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:57.819339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c9468-303c-4cfb-899e-a922b6b2edd7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:57.830496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa22381-b35a-46cc-bf68-afe8e0aba73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:57.831509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa22381-b35a-46cc-bf68-afe8e0aba73a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:57.831858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa22381-b35a-46cc-bf68-afe8e0aba73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:57.832753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa22381-b35a-46cc-bf68-afe8e0aba73a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:57.833365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa22381-b35a-46cc-bf68-afe8e0aba73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:57.835301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa22381-b35a-46cc-bf68-afe8e0aba73a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:57.857098 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3247/6427] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:31:57.862333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2f4f9-e397-4157-ab39-ac55aaab8a44 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:57.874802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2f4f9-e397-4157-ab39-ac55aaab8a44 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:57.880474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e54e2a-336b-4b73-b50b-92f017ac7e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:57.881064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e54e2a-336b-4b73-b50b-92f017ac7e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:57.881450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e54e2a-336b-4b73-b50b-92f017ac7e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:57.881845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e54e2a-336b-4b73-b50b-92f017ac7e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:57.882760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e54e2a-336b-4b73-b50b-92f017ac7e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:57.884365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e54e2a-336b-4b73-b50b-92f017ac7e02 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:57.896941 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3181/6428] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:31:57.901404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa22381-b35a-46cc-bf68-afe8e0aba73a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:57.914008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa22381-b35a-46cc-bf68-afe8e0aba73a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:57.920052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e589a-e5be-428a-91c6-a91e0b4a5715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:57.920863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e589a-e5be-428a-91c6-a91e0b4a5715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:57.921240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e589a-e5be-428a-91c6-a91e0b4a5715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:57.921625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e589a-e5be-428a-91c6-a91e0b4a5715 admin admin] PATH_INFO: `/v3/projects/33c8022a0a254f19a841913fb535b691/users/4b9481603fe84267a7801771647d1fa8/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:57.941707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e589a-e5be-428a-91c6-a91e0b4a5715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c8022a0a254f19a841913fb535b691, user_id=4b9481603fe84267a7801771647d1fa8, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:57.944973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e589a-e5be-428a-91c6-a91e0b4a5715 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:57.962504 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3248/6429] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:31:57 2022] PUT /identity/v3/projects/33c8022a0a254f19a841913fb535b691/users/4b9481603fe84267a7801771647d1fa8/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:31:57.974481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2974b2f-e448-454a-9e1a-ae9b416cf6bf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:57.974798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2974b2f-e448-454a-9e1a-ae9b416cf6bf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:57.975601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2974b2f-e448-454a-9e1a-ae9b416cf6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:58.034013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e2974b2f-e448-454a-9e1a-ae9b416cf6bf None None] MFA Rules not processed for user `4b9481603fe84267a7801771647d1fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:31:58.035194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e2974b2f-e448-454a-9e1a-ae9b416cf6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:58.076173 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:58.150959 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3182/6430] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:31:58.158827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e589a-e5be-428a-91c6-a91e0b4a5715 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:31:58.160799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f37e589a-e5be-428a-91c6-a91e0b4a5715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:31:58.231269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e589a-e5be-428a-91c6-a91e0b4a5715 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:31:58.236347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9260f-39c0-4989-a57e-02536b67c671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:31:58.237040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9260f-39c0-4989-a57e-02536b67c671 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:31:58.237321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9260f-39c0-4989-a57e-02536b67c671 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:31:58.237717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9260f-39c0-4989-a57e-02536b67c671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:31:58.247521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9260f-39c0-4989-a57e-02536b67c671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:31:58.249080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9260f-39c0-4989-a57e-02536b67c671 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:31:58.261618 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3249/6431] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:31:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:02.411013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4d18b-5f05-43cf-ac27-c8dc33dcf3d9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:02.411927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4d18b-5f05-43cf-ac27-c8dc33dcf3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:02.412353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4d18b-5f05-43cf-ac27-c8dc33dcf3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:02.450675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4ea4d18b-5f05-43cf-ac27-c8dc33dcf3d9 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:02.452317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4ea4d18b-5f05-43cf-ac27-c8dc33dcf3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:02.530245 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3183/6432] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:32:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:02.584643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9260f-39c0-4989-a57e-02536b67c671 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:02.586121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ffe9260f-39c0-4989-a57e-02536b67c671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:02.796297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9260f-39c0-4989-a57e-02536b67c671 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:02.805604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcceff3-0224-4fec-9105-b8d62a6803a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:02.806595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcceff3-0224-4fec-9105-b8d62a6803a4 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:02.807675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcceff3-0224-4fec-9105-b8d62a6803a4 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:02.808175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcceff3-0224-4fec-9105-b8d62a6803a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:02.825471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcceff3-0224-4fec-9105-b8d62a6803a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:02.827866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcceff3-0224-4fec-9105-b8d62a6803a4 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:02.856377 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3250/6433] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:32:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:32:04.065532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4d18b-5f05-43cf-ac27-c8dc33dcf3d9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:04.068101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4ea4d18b-5f05-43cf-ac27-c8dc33dcf3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:04.157818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4d18b-5f05-43cf-ac27-c8dc33dcf3d9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:04.164869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:04.165540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:04.165823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:04.166103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] PATH_INFO: `/v3/users/29558de38c454aec80b21692aba3d038` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:04.167449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29558de38c454aec80b21692aba3d038)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:04.170382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:04.248080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29558de38c454aec80b21692aba3d038'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:04.249140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29558de38c454aec80b21692aba3d038'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:04.279308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29558de38c454aec80b21692aba3d038'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:04.285814 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:04.294896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29558de38c454aec80b21692aba3d038'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:04.297567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29558de38c454aec80b21692aba3d038'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:04.321038 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3184/6434] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:04 2022] DELETE /identity/v3/users/29558de38c454aec80b21692aba3d038 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:04.327049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bcdf1-2383-4e9c-b222-9195f67b7903 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:04.328053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bcdf1-2383-4e9c-b222-9195f67b7903 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:04.328488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bcdf1-2383-4e9c-b222-9195f67b7903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:04.359699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1d7bcdf1-2383-4e9c-b222-9195f67b7903 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:04.362749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1d7bcdf1-2383-4e9c-b222-9195f67b7903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:04.409044 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:04.457075 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3251/6435] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:04.471679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:04.473975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:04.588088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c041ed-2ed5-40fe-9de3-204ab3888438 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:04.597098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb5098-3113-406e-be23-8f277349b1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:04.597770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb5098-3113-406e-be23-8f277349b1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:04.598056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb5098-3113-406e-be23-8f277349b1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:04.598305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb5098-3113-406e-be23-8f277349b1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:04.652189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb5098-3113-406e-be23-8f277349b1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:04.652437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb5098-3113-406e-be23-8f277349b1e1 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:04.671613 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3185/6436] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:05.086146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bcdf1-2383-4e9c-b222-9195f67b7903 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:05.087835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1d7bcdf1-2383-4e9c-b222-9195f67b7903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:05.113793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bcdf1-2383-4e9c-b222-9195f67b7903 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:05.132738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ca266-b589-483e-9906-3eefd9f773e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:05.133941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ca266-b589-483e-9906-3eefd9f773e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:05.133941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ca266-b589-483e-9906-3eefd9f773e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:05.134139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ca266-b589-483e-9906-3eefd9f773e3 admin admin] PATH_INFO: `/v3/projects/96b75903dbc94bb4a13646b677bdebf7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:05.135351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ca266-b589-483e-9906-3eefd9f773e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b75903dbc94bb4a13646b677bdebf7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:05.137387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ca266-b589-483e-9906-3eefd9f773e3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:05.270886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d8ca266-b589-483e-9906-3eefd9f773e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b75903dbc94bb4a13646b677bdebf7', 'request_id': 'req-9d8ca266-b589-483e-9906-3eefd9f773e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:05.279855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d8ca266-b589-483e-9906-3eefd9f773e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b75903dbc94bb4a13646b677bdebf7', 'request_id': 'req-9d8ca266-b589-483e-9906-3eefd9f773e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:05.291444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d8ca266-b589-483e-9906-3eefd9f773e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b75903dbc94bb4a13646b677bdebf7', 'request_id': 'req-9d8ca266-b589-483e-9906-3eefd9f773e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:05.306461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d8ca266-b589-483e-9906-3eefd9f773e3 admin admin] The token cache is being invalidate because project 96b75903dbc94bb4a13646b677bdebf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:05.306868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d8ca266-b589-483e-9906-3eefd9f773e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:05.307775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d8ca266-b589-483e-9906-3eefd9f773e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:05.315173 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3252/6437] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:05 2022] DELETE /identity/v3/projects/96b75903dbc94bb4a13646b677bdebf7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:05.316902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd8992-9902-4e83-a292-6e6d8daa2a7c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:05.317428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd8992-9902-4e83-a292-6e6d8daa2a7c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:05.317913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd8992-9902-4e83-a292-6e6d8daa2a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:05.341537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d1cd8992-9902-4e83-a292-6e6d8daa2a7c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:05.343442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d1cd8992-9902-4e83-a292-6e6d8daa2a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:05.486654 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3186/6438] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:05.495296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226f3a8-8e97-4706-9564-f8c258d2c877 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:05.496386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226f3a8-8e97-4706-9564-f8c258d2c877 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:05.496885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226f3a8-8e97-4706-9564-f8c258d2c877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:05.535917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2226f3a8-8e97-4706-9564-f8c258d2c877 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:05.538795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2226f3a8-8e97-4706-9564-f8c258d2c877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:05.571314 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3253/6439] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:05.583200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd8992-9902-4e83-a292-6e6d8daa2a7c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:05.591190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226f3a8-8e97-4706-9564-f8c258d2c877 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:05.595593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2226f3a8-8e97-4706-9564-f8c258d2c877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:05.601076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd8992-9902-4e83-a292-6e6d8daa2a7c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:05.615475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c268d2-418a-4228-b842-773c161b19f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:05.617768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c268d2-418a-4228-b842-773c161b19f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:05.618163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c268d2-418a-4228-b842-773c161b19f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:05.618513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c268d2-418a-4228-b842-773c161b19f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:05.619290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c268d2-418a-4228-b842-773c161b19f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:32:05.619658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c268d2-418a-4228-b842-773c161b19f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:05.623167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c268d2-418a-4228-b842-773c161b19f2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:05.646662 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3187/6440] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:32:05.648106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c268d2-418a-4228-b842-773c161b19f2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:05.661606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c268d2-418a-4228-b842-773c161b19f2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:05.668300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001db905-69a3-4b80-a164-692334463e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:05.668992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001db905-69a3-4b80-a164-692334463e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:05.669703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001db905-69a3-4b80-a164-692334463e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:05.669703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001db905-69a3-4b80-a164-692334463e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:05.670473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001db905-69a3-4b80-a164-692334463e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:05.672658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001db905-69a3-4b80-a164-692334463e77 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:05.719935 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3188/6441] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:05 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:05.721953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001db905-69a3-4b80-a164-692334463e77 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:05.769950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226f3a8-8e97-4706-9564-f8c258d2c877 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:05.826046 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:05.835267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001db905-69a3-4b80-a164-692334463e77 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:05.854268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d15063-e02d-4a82-9807-bc8c894bb69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:05.855277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d15063-e02d-4a82-9807-bc8c894bb69e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:05.855838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d15063-e02d-4a82-9807-bc8c894bb69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:05.856505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d15063-e02d-4a82-9807-bc8c894bb69e admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:05.857974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d15063-e02d-4a82-9807-bc8c894bb69e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:05.863117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d15063-e02d-4a82-9807-bc8c894bb69e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:05.909155 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3189/6442] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:05 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:05.913523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d15063-e02d-4a82-9807-bc8c894bb69e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:05.928534 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:05.934466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d15063-e02d-4a82-9807-bc8c894bb69e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:05.956677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6076684-379a-4f2c-81d4-9c4a3489f3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:05.957594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6076684-379a-4f2c-81d4-9c4a3489f3cd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:05.957985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6076684-379a-4f2c-81d4-9c4a3489f3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:05.958661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6076684-379a-4f2c-81d4-9c4a3489f3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:05.959465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6076684-379a-4f2c-81d4-9c4a3489f3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:05.961213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6076684-379a-4f2c-81d4-9c4a3489f3cd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:05.972600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a967c-a167-4b9d-ac33-cf480dc7c92d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:05.973233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a967c-a167-4b9d-ac33-cf480dc7c92d service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:05.973516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a967c-a167-4b9d-ac33-cf480dc7c92d service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:05.973793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a967c-a167-4b9d-ac33-cf480dc7c92d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:05.981006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d47a967c-a167-4b9d-ac33-cf480dc7c92d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:05.989976 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3190/6443] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:05.994406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6076684-379a-4f2c-81d4-9c4a3489f3cd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:06.018787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6076684-379a-4f2c-81d4-9c4a3489f3cd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:06.030869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea7525-bc80-4128-a987-138dd5c0265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:06.031430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea7525-bc80-4128-a987-138dd5c0265e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:06.031984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea7525-bc80-4128-a987-138dd5c0265e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:06.032358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea7525-bc80-4128-a987-138dd5c0265e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:06.033649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea7525-bc80-4128-a987-138dd5c0265e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:06.037368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea7525-bc80-4128-a987-138dd5c0265e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:06.076915 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3191/6444] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:06.078183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea7525-bc80-4128-a987-138dd5c0265e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:06.092610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a967c-a167-4b9d-ac33-cf480dc7c92d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:06.101776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea7525-bc80-4128-a987-138dd5c0265e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:06.101989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a967c-a167-4b9d-ac33-cf480dc7c92d service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:06.111560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314b87f-fd7f-4ffd-9a65-9ad933c5d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:06.112334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b87f-fd7f-4ffd-9a65-9ad933c5d3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:06.112771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b87f-fd7f-4ffd-9a65-9ad933c5d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:06.113140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b87f-fd7f-4ffd-9a65-9ad933c5d3fb admin admin] PATH_INFO: `/v3/projects/128065c9046f49b0a4c3f8bbdfdaaba2/users/21d3fc8f95c74b2e8c06da9593d54b3f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:06.124283 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3254/6445] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:05 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:06.134318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314b87f-fd7f-4ffd-9a65-9ad933c5d3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=128065c9046f49b0a4c3f8bbdfdaaba2, user_id=21d3fc8f95c74b2e8c06da9593d54b3f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:06.137141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314b87f-fd7f-4ffd-9a65-9ad933c5d3fb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:06.180450 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3192/6446] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:06 2022] PUT /identity/v3/projects/128065c9046f49b0a4c3f8bbdfdaaba2/users/21d3fc8f95c74b2e8c06da9593d54b3f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:06.192560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f4d34-e752-45bc-aebd-aef7fd3862d9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:06.192863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f4d34-e752-45bc-aebd-aef7fd3862d9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:06.193143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f4d34-e752-45bc-aebd-aef7fd3862d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:06.289011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bc9f4d34-e752-45bc-aebd-aef7fd3862d9 None None] MFA Rules not processed for user `21d3fc8f95c74b2e8c06da9593d54b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:06.290532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bc9f4d34-e752-45bc-aebd-aef7fd3862d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:06.403286 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3255/6447] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:06.411018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314b87f-fd7f-4ffd-9a65-9ad933c5d3fb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:06.413856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d314b87f-fd7f-4ffd-9a65-9ad933c5d3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:06.495807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314b87f-fd7f-4ffd-9a65-9ad933c5d3fb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:06.500824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f133268-8221-4cae-998d-4bca0d5d975e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:06.501770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f133268-8221-4cae-998d-4bca0d5d975e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:06.502274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f133268-8221-4cae-998d-4bca0d5d975e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:06.502772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f133268-8221-4cae-998d-4bca0d5d975e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:06.514542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f133268-8221-4cae-998d-4bca0d5d975e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:06.516854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f133268-8221-4cae-998d-4bca0d5d975e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:06.533714 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3193/6448] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:32:14.681067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f4d34-e752-45bc-aebd-aef7fd3862d9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:14.683037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bc9f4d34-e752-45bc-aebd-aef7fd3862d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:14.823778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f4d34-e752-45bc-aebd-aef7fd3862d9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:14.829031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:14.829802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:14.830771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:14.831115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] PATH_INFO: `/v3/users/4b9481603fe84267a7801771647d1fa8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:14.832377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b9481603fe84267a7801771647d1fa8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:14.835398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:14.866108 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:14.913528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b9481603fe84267a7801771647d1fa8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:14.914569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b9481603fe84267a7801771647d1fa8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:14.940341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b9481603fe84267a7801771647d1fa8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:14.954572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b9481603fe84267a7801771647d1fa8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:14.956367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b9481603fe84267a7801771647d1fa8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:14.996617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc711f1-4064-48ec-abe9-b9c847948483 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:14.997116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc711f1-4064-48ec-abe9-b9c847948483 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:14.997228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc711f1-4064-48ec-abe9-b9c847948483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:15.027094 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3256/6449] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:14 2022] DELETE /identity/v3/users/4b9481603fe84267a7801771647d1fa8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:15.056621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4cc711f1-4064-48ec-abe9-b9c847948483 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:15.060163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4cc711f1-4064-48ec-abe9-b9c847948483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:15.234484 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3194/6450] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:15.245162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:15.246857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:15.400052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88159ac-e312-4c02-97df-8efd1a50dd08 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:15.421337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a62dc-8b39-47b8-9fde-938a7736a76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:15.422214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a62dc-8b39-47b8-9fde-938a7736a76c service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:15.422525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a62dc-8b39-47b8-9fde-938a7736a76c service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:15.423982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a62dc-8b39-47b8-9fde-938a7736a76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:15.456859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a62dc-8b39-47b8-9fde-938a7736a76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:15.458496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a62dc-8b39-47b8-9fde-938a7736a76c service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:15.486423 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3257/6451] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:16.060526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc711f1-4064-48ec-abe9-b9c847948483 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:16.063750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4cc711f1-4064-48ec-abe9-b9c847948483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:16.084877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc711f1-4064-48ec-abe9-b9c847948483 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:16.100541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:16.101773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:16.102205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:16.102792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd admin admin] PATH_INFO: `/v3/projects/33c8022a0a254f19a841913fb535b691` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:16.107299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=33c8022a0a254f19a841913fb535b691)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:16.109843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:16.200514 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:16.224500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c8022a0a254f19a841913fb535b691', 'request_id': 'req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:16.233949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c8022a0a254f19a841913fb535b691', 'request_id': 'req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:16.253067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c8022a0a254f19a841913fb535b691', 'request_id': 'req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:16.269459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd admin admin] The token cache is being invalidate because project 33c8022a0a254f19a841913fb535b691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:16.271183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:16.272809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8c865a0d-ef7d-40b7-944c-3bd7ea8f8ebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:16.278584 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3195/6452] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:16 2022] DELETE /identity/v3/projects/33c8022a0a254f19a841913fb535b691 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:16.283604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562ec48-d389-41a8-9525-bef2fa665d94 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:16.284098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562ec48-d389-41a8-9525-bef2fa665d94 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:16.284355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562ec48-d389-41a8-9525-bef2fa665d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:16.328005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b562ec48-d389-41a8-9525-bef2fa665d94 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:16.328277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b562ec48-d389-41a8-9525-bef2fa665d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:16.503455 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3258/6453] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:16.511575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15271c-261d-470a-9c57-c59cfa58736a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:16.511861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15271c-261d-470a-9c57-c59cfa58736a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:16.512141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15271c-261d-470a-9c57-c59cfa58736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:16.566701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8e15271c-261d-470a-9c57-c59cfa58736a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:16.567986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8e15271c-261d-470a-9c57-c59cfa58736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:16.590552 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3196/6454] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:16.594766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562ec48-d389-41a8-9525-bef2fa665d94 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:16.613409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562ec48-d389-41a8-9525-bef2fa665d94 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:16.628679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4a98b-2135-4f45-a3db-c2804342078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:16.629442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4a98b-2135-4f45-a3db-c2804342078b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:16.629814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4a98b-2135-4f45-a3db-c2804342078b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:16.630183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4a98b-2135-4f45-a3db-c2804342078b admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:16.631090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4a98b-2135-4f45-a3db-c2804342078b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:32:16.634568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4a98b-2135-4f45-a3db-c2804342078b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:16.640155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4a98b-2135-4f45-a3db-c2804342078b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:16.669610 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3259/6455] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:32:16.670366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15271c-261d-470a-9c57-c59cfa58736a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:16.684367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15271c-261d-470a-9c57-c59cfa58736a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:16.697977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471e61c-72cd-4039-b1e0-aae72cc6b18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:16.701083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471e61c-72cd-4039-b1e0-aae72cc6b18b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:16.701399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471e61c-72cd-4039-b1e0-aae72cc6b18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:16.702434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471e61c-72cd-4039-b1e0-aae72cc6b18b admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:16.704112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471e61c-72cd-4039-b1e0-aae72cc6b18b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:16.711921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471e61c-72cd-4039-b1e0-aae72cc6b18b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:16.826009 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3197/6456] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:16 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:16.830717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4a98b-2135-4f45-a3db-c2804342078b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:16.857051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4a98b-2135-4f45-a3db-c2804342078b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:16.930489 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:17.020950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e94388-92fc-4f57-97ce-318ce6ad3e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:17.022854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e94388-92fc-4f57-97ce-318ce6ad3e8c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:17.022854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e94388-92fc-4f57-97ce-318ce6ad3e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:17.022854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e94388-92fc-4f57-97ce-318ce6ad3e8c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:17.027325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e94388-92fc-4f57-97ce-318ce6ad3e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:17.029740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e94388-92fc-4f57-97ce-318ce6ad3e8c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:17.068867 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3260/6457] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:16 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:17.073659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471e61c-72cd-4039-b1e0-aae72cc6b18b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:17.093454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471e61c-72cd-4039-b1e0-aae72cc6b18b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:17.113343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b274e-6b7e-4303-a488-0efc7aebf826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:17.115106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b274e-6b7e-4303-a488-0efc7aebf826 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:17.115593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b274e-6b7e-4303-a488-0efc7aebf826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:17.116627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b274e-6b7e-4303-a488-0efc7aebf826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:17.121857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b274e-6b7e-4303-a488-0efc7aebf826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:17.128696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b274e-6b7e-4303-a488-0efc7aebf826 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:17.153174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e94388-92fc-4f57-97ce-318ce6ad3e8c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:17.163835 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3198/6458] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:32:17.179738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e94388-92fc-4f57-97ce-318ce6ad3e8c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:17.190258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02563e7c-72b5-4ddc-92ed-1f2c9b8e91a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:17.191317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02563e7c-72b5-4ddc-92ed-1f2c9b8e91a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:17.191993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02563e7c-72b5-4ddc-92ed-1f2c9b8e91a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:17.192380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02563e7c-72b5-4ddc-92ed-1f2c9b8e91a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:17.193457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02563e7c-72b5-4ddc-92ed-1f2c9b8e91a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:17.197980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02563e7c-72b5-4ddc-92ed-1f2c9b8e91a2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:17.235462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b274e-6b7e-4303-a488-0efc7aebf826 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:17.242744 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3261/6459] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:17.253279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b274e-6b7e-4303-a488-0efc7aebf826 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:17.261611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c846e91-ab7d-4d85-a4dc-b8a16c458cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:17.263313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c846e91-ab7d-4d85-a4dc-b8a16c458cca admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:17.263824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c846e91-ab7d-4d85-a4dc-b8a16c458cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:17.264325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c846e91-ab7d-4d85-a4dc-b8a16c458cca admin admin] PATH_INFO: `/v3/projects/705dd2b2fd54465abf6e870633543ce5/users/062f96bc7eee4827ad1bf98370788ddc/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:17.289942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c846e91-ab7d-4d85-a4dc-b8a16c458cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=705dd2b2fd54465abf6e870633543ce5, user_id=062f96bc7eee4827ad1bf98370788ddc, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:17.293716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c846e91-ab7d-4d85-a4dc-b8a16c458cca admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:17.315493 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3199/6460] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:17 2022] PUT /identity/v3/projects/705dd2b2fd54465abf6e870633543ce5/users/062f96bc7eee4827ad1bf98370788ddc/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:17.327756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6329d-7aa6-45b0-a4fb-406455590b1a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:17.328583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6329d-7aa6-45b0-a4fb-406455590b1a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:17.329022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6329d-7aa6-45b0-a4fb-406455590b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:17.475505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4fa6329d-7aa6-45b0-a4fb-406455590b1a None None] MFA Rules not processed for user `062f96bc7eee4827ad1bf98370788ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:17.476953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4fa6329d-7aa6-45b0-a4fb-406455590b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:17.651106 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3262/6461] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:17.661855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c846e91-ab7d-4d85-a4dc-b8a16c458cca admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:17.663752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5c846e91-ab7d-4d85-a4dc-b8a16c458cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:17.738643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c846e91-ab7d-4d85-a4dc-b8a16c458cca admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:17.743156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617e059-3aae-40e5-88be-9ab758c969ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:17.743777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617e059-3aae-40e5-88be-9ab758c969ea service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:17.744055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617e059-3aae-40e5-88be-9ab758c969ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:17.744324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617e059-3aae-40e5-88be-9ab758c969ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:17.757617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617e059-3aae-40e5-88be-9ab758c969ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:17.759495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617e059-3aae-40e5-88be-9ab758c969ea service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:17.769625 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3200/6462] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:18.261137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6329d-7aa6-45b0-a4fb-406455590b1a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:18.362121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6329d-7aa6-45b0-a4fb-406455590b1a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:18.369606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:18.370575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:18.371126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:18.371610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] PATH_INFO: `/v3/users/062f96bc7eee4827ad1bf98370788ddc` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:18.374352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062f96bc7eee4827ad1bf98370788ddc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:18.379008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:18.487193 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:18.514477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062f96bc7eee4827ad1bf98370788ddc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:18.515210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062f96bc7eee4827ad1bf98370788ddc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:18.541351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062f96bc7eee4827ad1bf98370788ddc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:18.559565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062f96bc7eee4827ad1bf98370788ddc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:18.560785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062f96bc7eee4827ad1bf98370788ddc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:18.594891 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3263/6463] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:18 2022] DELETE /identity/v3/users/062f96bc7eee4827ad1bf98370788ddc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:18.597243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc672bf3-88ef-47da-aa97-5874520accb7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:18.597734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc672bf3-88ef-47da-aa97-5874520accb7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:18.597827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc672bf3-88ef-47da-aa97-5874520accb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:18.633925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dc672bf3-88ef-47da-aa97-5874520accb7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:18.639629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dc672bf3-88ef-47da-aa97-5874520accb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:18.794498 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3201/6464] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:32:18.807473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:18.809852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:18.906998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef648d-62da-4250-a314-3c39f9df6154 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:18.912210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d6e3b-3cfd-479b-b092-d34913599fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:18.912835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d6e3b-3cfd-479b-b092-d34913599fed service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:18.913162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d6e3b-3cfd-479b-b092-d34913599fed service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:18.913362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d6e3b-3cfd-479b-b092-d34913599fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:18.925256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d6e3b-3cfd-479b-b092-d34913599fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:18.926230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d6e3b-3cfd-479b-b092-d34913599fed service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:18.942941 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3264/6465] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:20.081412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc672bf3-88ef-47da-aa97-5874520accb7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:20.087055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dc672bf3-88ef-47da-aa97-5874520accb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:20.101407 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:20.106279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc672bf3-88ef-47da-aa97-5874520accb7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:20.129939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:20.130831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:20.131274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:20.131720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34 admin admin] PATH_INFO: `/v3/projects/705dd2b2fd54465abf6e870633543ce5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:20.134058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=705dd2b2fd54465abf6e870633543ce5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:20.136166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:20.256858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '705dd2b2fd54465abf6e870633543ce5', 'request_id': 'req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:20.266505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '705dd2b2fd54465abf6e870633543ce5', 'request_id': 'req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:20.290537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '705dd2b2fd54465abf6e870633543ce5', 'request_id': 'req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:20.309367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34 admin admin] The token cache is being invalidate because project 705dd2b2fd54465abf6e870633543ce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:20.309768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:20.310541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-eba47ea4-073c-4742-bacb-1fa0e2c1ea34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:20.312238 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3202/6466] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:20 2022] DELETE /identity/v3/projects/705dd2b2fd54465abf6e870633543ce5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:20.318289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c0ac9-b5a2-4218-a29f-c6e71b23d360 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:20.319395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c0ac9-b5a2-4218-a29f-c6e71b23d360 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:20.319826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c0ac9-b5a2-4218-a29f-c6e71b23d360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:20.359278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-464c0ac9-b5a2-4218-a29f-c6e71b23d360 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:20.362040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-464c0ac9-b5a2-4218-a29f-c6e71b23d360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:20.512458 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3265/6467] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:20.514118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b9aa9-0b15-4e36-98ae-89449ea3810f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:20.514410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b9aa9-0b15-4e36-98ae-89449ea3810f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:20.514713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b9aa9-0b15-4e36-98ae-89449ea3810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:20.580439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0c6b9aa9-0b15-4e36-98ae-89449ea3810f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:20.581658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0c6b9aa9-0b15-4e36-98ae-89449ea3810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:20.601078 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3203/6468] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:32:20.605526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c0ac9-b5a2-4218-a29f-c6e71b23d360 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:20.617493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c0ac9-b5a2-4218-a29f-c6e71b23d360 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:20.630569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b20e8-8480-4266-94f3-f92950fa6a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:20.631608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b20e8-8480-4266-94f3-f92950fa6a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:20.631608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b20e8-8480-4266-94f3-f92950fa6a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:20.631834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b20e8-8480-4266-94f3-f92950fa6a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:20.632414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b20e8-8480-4266-94f3-f92950fa6a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:32:20.632722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b20e8-8480-4266-94f3-f92950fa6a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:20.634366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b20e8-8480-4266-94f3-f92950fa6a00 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:20.652556 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3266/6469] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:32:20.653620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b9aa9-0b15-4e36-98ae-89449ea3810f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:20.665780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b9aa9-0b15-4e36-98ae-89449ea3810f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:20.671405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f51e0-bac7-4e9d-bc6f-f6acf8997f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:20.672343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f51e0-bac7-4e9d-bc6f-f6acf8997f67 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:20.672838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f51e0-bac7-4e9d-bc6f-f6acf8997f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:20.673960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f51e0-bac7-4e9d-bc6f-f6acf8997f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:20.674839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f51e0-bac7-4e9d-bc6f-f6acf8997f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:20.677352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f51e0-bac7-4e9d-bc6f-f6acf8997f67 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:20.759748 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3204/6470] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:20 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:32:20.763649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b20e8-8480-4266-94f3-f92950fa6a00 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:20.794870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b20e8-8480-4266-94f3-f92950fa6a00 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:20.901447 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:20.937237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704fb8e-4223-4e28-a8c5-4ae6b41271a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:20.937890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704fb8e-4223-4e28-a8c5-4ae6b41271a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:20.938165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704fb8e-4223-4e28-a8c5-4ae6b41271a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:20.941910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704fb8e-4223-4e28-a8c5-4ae6b41271a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:20.942687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704fb8e-4223-4e28-a8c5-4ae6b41271a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:20.958147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704fb8e-4223-4e28-a8c5-4ae6b41271a1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:20.996024 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3267/6471] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:20 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:20.999548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f51e0-bac7-4e9d-bc6f-f6acf8997f67 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:21.015698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f51e0-bac7-4e9d-bc6f-f6acf8997f67 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:21.044347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691d062-ec60-41af-9b70-d4a729332417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:21.045180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691d062-ec60-41af-9b70-d4a729332417 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:21.045616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691d062-ec60-41af-9b70-d4a729332417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:21.046038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691d062-ec60-41af-9b70-d4a729332417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:21.046829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691d062-ec60-41af-9b70-d4a729332417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:21.049827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691d062-ec60-41af-9b70-d4a729332417 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:21.067698 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3205/6472] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:32:21.071856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704fb8e-4223-4e28-a8c5-4ae6b41271a1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:21.123906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704fb8e-4223-4e28-a8c5-4ae6b41271a1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:21.135024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b9b91-c728-4332-8ae0-52da462f2824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:21.135937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b9b91-c728-4332-8ae0-52da462f2824 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:21.136215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b9b91-c728-4332-8ae0-52da462f2824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:21.136481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b9b91-c728-4332-8ae0-52da462f2824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:21.137112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b9b91-c728-4332-8ae0-52da462f2824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:21.138982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b9b91-c728-4332-8ae0-52da462f2824 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:21.158968 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3268/6473] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:21.161976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691d062-ec60-41af-9b70-d4a729332417 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:21.176307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691d062-ec60-41af-9b70-d4a729332417 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:21.182091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7328245-f127-405a-940e-afccecfcc1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:21.183224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7328245-f127-405a-940e-afccecfcc1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:21.183759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7328245-f127-405a-940e-afccecfcc1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:21.184332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7328245-f127-405a-940e-afccecfcc1b6 admin admin] PATH_INFO: `/v3/projects/238e541c9fd947899e98bf5c94c9c6fc/users/0b363b5432fb46778c1ef0034cbd75b1/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:21.210478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7328245-f127-405a-940e-afccecfcc1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=238e541c9fd947899e98bf5c94c9c6fc, user_id=0b363b5432fb46778c1ef0034cbd75b1, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:21.214146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7328245-f127-405a-940e-afccecfcc1b6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:21.251318 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3206/6474] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:21 2022] PUT /identity/v3/projects/238e541c9fd947899e98bf5c94c9c6fc/users/0b363b5432fb46778c1ef0034cbd75b1/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:21.253373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6c210-0ab4-44fe-bcf1-82ddf04b97da None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:21.254134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6c210-0ab4-44fe-bcf1-82ddf04b97da None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:21.254622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6c210-0ab4-44fe-bcf1-82ddf04b97da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:21.298635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7fa6c210-0ab4-44fe-bcf1-82ddf04b97da None None] MFA Rules not processed for user `0b363b5432fb46778c1ef0034cbd75b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:21.300530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7fa6c210-0ab4-44fe-bcf1-82ddf04b97da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:21.415342 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3269/6475] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:21.447006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7328245-f127-405a-940e-afccecfcc1b6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:21.449020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e7328245-f127-405a-940e-afccecfcc1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:21.623835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7328245-f127-405a-940e-afccecfcc1b6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:21.633315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6921c-dd77-4f96-8a33-8045784adc7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:21.634247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6921c-dd77-4f96-8a33-8045784adc7f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:21.634738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6921c-dd77-4f96-8a33-8045784adc7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:21.635188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6921c-dd77-4f96-8a33-8045784adc7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:21.663333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6921c-dd77-4f96-8a33-8045784adc7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:21.665718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6921c-dd77-4f96-8a33-8045784adc7f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:21.679330 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3207/6476] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:21.694580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6c210-0ab4-44fe-bcf1-82ddf04b97da None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:21.849532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6c210-0ab4-44fe-bcf1-82ddf04b97da None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:21.860252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:21.861496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:21.861884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:21.862085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] PATH_INFO: `/v3/users/0b363b5432fb46778c1ef0034cbd75b1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:21.865067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b363b5432fb46778c1ef0034cbd75b1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:21.867068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:21.965384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b363b5432fb46778c1ef0034cbd75b1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:21.966558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b363b5432fb46778c1ef0034cbd75b1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:21.981935 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:22.002444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b363b5432fb46778c1ef0034cbd75b1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:22.012837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b363b5432fb46778c1ef0034cbd75b1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:22.014573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b363b5432fb46778c1ef0034cbd75b1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:22.047870 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3270/6477] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:21 2022] DELETE /identity/v3/users/0b363b5432fb46778c1ef0034cbd75b1 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:22.049707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d296eef-78ce-4e79-b992-287990d17b0c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:22.050003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d296eef-78ce-4e79-b992-287990d17b0c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:22.050303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d296eef-78ce-4e79-b992-287990d17b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:22.104449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5d296eef-78ce-4e79-b992-287990d17b0c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:22.107967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5d296eef-78ce-4e79-b992-287990d17b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:22.160426 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:22.250455 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3208/6478] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:22.278850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:22.280762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:22.448935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd754247-42a1-40b4-80af-564ebb0e9bdc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:22.453047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb3128-0032-4a3d-b8e1-2cc54a157e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:22.453761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb3128-0032-4a3d-b8e1-2cc54a157e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:22.455780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb3128-0032-4a3d-b8e1-2cc54a157e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:22.456394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb3128-0032-4a3d-b8e1-2cc54a157e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:22.478025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb3128-0032-4a3d-b8e1-2cc54a157e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:22.479654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb3128-0032-4a3d-b8e1-2cc54a157e12 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:22.511561 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3271/6479] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:23.369609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d296eef-78ce-4e79-b992-287990d17b0c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:23.371356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5d296eef-78ce-4e79-b992-287990d17b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:23.411436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d296eef-78ce-4e79-b992-287990d17b0c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:23.437221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d2fb9-55c2-4ae8-ae50-950ddab3f335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:23.439063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d2fb9-55c2-4ae8-ae50-950ddab3f335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:23.445347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d2fb9-55c2-4ae8-ae50-950ddab3f335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:23.445782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d2fb9-55c2-4ae8-ae50-950ddab3f335 admin admin] PATH_INFO: `/v3/projects/238e541c9fd947899e98bf5c94c9c6fc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:23.458622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d2fb9-55c2-4ae8-ae50-950ddab3f335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=238e541c9fd947899e98bf5c94c9c6fc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:23.461968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d2fb9-55c2-4ae8-ae50-950ddab3f335 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:23.639111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-463d2fb9-55c2-4ae8-ae50-950ddab3f335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '238e541c9fd947899e98bf5c94c9c6fc', 'request_id': 'req-463d2fb9-55c2-4ae8-ae50-950ddab3f335'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:23.656787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-463d2fb9-55c2-4ae8-ae50-950ddab3f335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '238e541c9fd947899e98bf5c94c9c6fc', 'request_id': 'req-463d2fb9-55c2-4ae8-ae50-950ddab3f335'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:23.672382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-463d2fb9-55c2-4ae8-ae50-950ddab3f335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '238e541c9fd947899e98bf5c94c9c6fc', 'request_id': 'req-463d2fb9-55c2-4ae8-ae50-950ddab3f335'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:23.696620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-463d2fb9-55c2-4ae8-ae50-950ddab3f335 admin admin] The token cache is being invalidate because project 238e541c9fd947899e98bf5c94c9c6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:23.697204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-463d2fb9-55c2-4ae8-ae50-950ddab3f335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:23.699431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-463d2fb9-55c2-4ae8-ae50-950ddab3f335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:23.705583 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3209/6480] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:23 2022] DELETE /identity/v3/projects/238e541c9fd947899e98bf5c94c9c6fc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:23.711421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d609-7fa8-456b-a087-fd8ba99ca176 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:23.715696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d609-7fa8-456b-a087-fd8ba99ca176 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:23.717153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d609-7fa8-456b-a087-fd8ba99ca176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:23.768468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0159d609-7fa8-456b-a087-fd8ba99ca176 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:23.772322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0159d609-7fa8-456b-a087-fd8ba99ca176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:23.900348 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3272/6481] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:23.909362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b0cfd-06d4-48d5-958a-fa78e16ddc62 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:23.909671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b0cfd-06d4-48d5-958a-fa78e16ddc62 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:23.909922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b0cfd-06d4-48d5-958a-fa78e16ddc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:23.941433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6c4b0cfd-06d4-48d5-958a-fa78e16ddc62 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:23.941433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6c4b0cfd-06d4-48d5-958a-fa78e16ddc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:23.972204 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3210/6482] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:23.976802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159d609-7fa8-456b-a087-fd8ba99ca176 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:23.990663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159d609-7fa8-456b-a087-fd8ba99ca176 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:24.013341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e440fce-89e3-425d-b1aa-a423f057ddcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:24.014407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e440fce-89e3-425d-b1aa-a423f057ddcd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:24.015025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e440fce-89e3-425d-b1aa-a423f057ddcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:24.015543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e440fce-89e3-425d-b1aa-a423f057ddcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:24.018642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e440fce-89e3-425d-b1aa-a423f057ddcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:32:24.019645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e440fce-89e3-425d-b1aa-a423f057ddcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:24.036537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e440fce-89e3-425d-b1aa-a423f057ddcd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:24.065171 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3273/6483] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:32:24.069254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b0cfd-06d4-48d5-958a-fa78e16ddc62 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:24.086560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b0cfd-06d4-48d5-958a-fa78e16ddc62 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:24.100717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78927602-2234-4eb6-91b6-abf9cf83fa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:24.101530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78927602-2234-4eb6-91b6-abf9cf83fa3a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:24.101841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78927602-2234-4eb6-91b6-abf9cf83fa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:24.102208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78927602-2234-4eb6-91b6-abf9cf83fa3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:24.102941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78927602-2234-4eb6-91b6-abf9cf83fa3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:24.105206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78927602-2234-4eb6-91b6-abf9cf83fa3a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:24.186743 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3211/6484] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:24 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:24.191542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e440fce-89e3-425d-b1aa-a423f057ddcd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:24.209709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e440fce-89e3-425d-b1aa-a423f057ddcd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:24.383524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848e237-4f77-49e2-a343-8ea2dd04d18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:24.385179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848e237-4f77-49e2-a343-8ea2dd04d18f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:24.385472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848e237-4f77-49e2-a343-8ea2dd04d18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:24.385755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848e237-4f77-49e2-a343-8ea2dd04d18f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:24.386762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848e237-4f77-49e2-a343-8ea2dd04d18f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:24.390945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848e237-4f77-49e2-a343-8ea2dd04d18f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:24.426073 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:24.462302 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3274/6485] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:24 2022] POST /identity/v3/users => generated 290 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:24.466647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78927602-2234-4eb6-91b6-abf9cf83fa3a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:24.480752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78927602-2234-4eb6-91b6-abf9cf83fa3a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:24.495904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac1327-7f77-4588-9167-c87e0e6eafa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:24.496696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac1327-7f77-4588-9167-c87e0e6eafa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:24.496945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac1327-7f77-4588-9167-c87e0e6eafa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:24.497221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac1327-7f77-4588-9167-c87e0e6eafa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:24.497873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac1327-7f77-4588-9167-c87e0e6eafa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:24.502463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac1327-7f77-4588-9167-c87e0e6eafa0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:24.528079 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3212/6486] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:24.533463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848e237-4f77-49e2-a343-8ea2dd04d18f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:24.556111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848e237-4f77-49e2-a343-8ea2dd04d18f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:24.564454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c08ba-e0ed-4c4a-a236-943bf356bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:24.565120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c08ba-e0ed-4c4a-a236-943bf356bd2f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:24.565419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c08ba-e0ed-4c4a-a236-943bf356bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:24.566016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c08ba-e0ed-4c4a-a236-943bf356bd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:24.566724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c08ba-e0ed-4c4a-a236-943bf356bd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:24.568396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c08ba-e0ed-4c4a-a236-943bf356bd2f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:24.595216 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3275/6487] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:24.599837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac1327-7f77-4588-9167-c87e0e6eafa0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:24.619845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac1327-7f77-4588-9167-c87e0e6eafa0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:24.638448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765acb8-12bd-49d7-9525-fc069cbf664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:24.639227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765acb8-12bd-49d7-9525-fc069cbf664a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:24.639535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765acb8-12bd-49d7-9525-fc069cbf664a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:24.639840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765acb8-12bd-49d7-9525-fc069cbf664a admin admin] PATH_INFO: `/v3/projects/6e211f906a1242e0b98da9cc400ed090/users/67255c92958e473aa6679014a34f3914/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:24.660876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765acb8-12bd-49d7-9525-fc069cbf664a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e211f906a1242e0b98da9cc400ed090, user_id=67255c92958e473aa6679014a34f3914, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:24.663838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765acb8-12bd-49d7-9525-fc069cbf664a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:24.710112 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3213/6488] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:24 2022] PUT /identity/v3/projects/6e211f906a1242e0b98da9cc400ed090/users/67255c92958e473aa6679014a34f3914/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:24.721934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5041d4a-4a46-45a4-bd43-22dbefc45e26 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:24.722486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5041d4a-4a46-45a4-bd43-22dbefc45e26 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:24.722598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5041d4a-4a46-45a4-bd43-22dbefc45e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:24.775755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c5041d4a-4a46-45a4-bd43-22dbefc45e26 None None] MFA Rules not processed for user `67255c92958e473aa6679014a34f3914`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:24.777076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c5041d4a-4a46-45a4-bd43-22dbefc45e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:24.943488 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3276/6489] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:24.944614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765acb8-12bd-49d7-9525-fc069cbf664a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:25.045037 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:25.086512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765acb8-12bd-49d7-9525-fc069cbf664a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:25.093071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ad5d2-0505-456c-adf9-0ca58653459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:25.104544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ad5d2-0505-456c-adf9-0ca58653459a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:25.105211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ad5d2-0505-456c-adf9-0ca58653459a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:25.105720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ad5d2-0505-456c-adf9-0ca58653459a admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:25.106743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ad5d2-0505-456c-adf9-0ca58653459a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:25.109563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ad5d2-0505-456c-adf9-0ca58653459a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:25.195008 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3214/6490] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:24 2022] POST /identity/v3/projects => generated 381 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:25.195571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5041d4a-4a46-45a4-bd43-22dbefc45e26 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:25.230196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5041d4a-4a46-45a4-bd43-22dbefc45e26 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:25.406128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eddad-9dc1-4d0f-9642-2793f795ed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:25.411048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eddad-9dc1-4d0f-9642-2793f795ed4c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:25.411576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eddad-9dc1-4d0f-9642-2793f795ed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:25.412031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eddad-9dc1-4d0f-9642-2793f795ed4c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:25.412870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9eddad-9dc1-4d0f-9642-2793f795ed4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:25.415092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9eddad-9dc1-4d0f-9642-2793f795ed4c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:25.491147 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3277/6491] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:25 2022] POST /identity/v3/users => generated 297 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:32:25.495000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ad5d2-0505-456c-adf9-0ca58653459a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:25.506737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ad5d2-0505-456c-adf9-0ca58653459a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:25.512790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cd8c1-577b-463f-bf22-9dc8e0025d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:25.514130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd8c1-577b-463f-bf22-9dc8e0025d51 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:25.514621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd8c1-577b-463f-bf22-9dc8e0025d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:25.515143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd8c1-577b-463f-bf22-9dc8e0025d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:25.516106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cd8c1-577b-463f-bf22-9dc8e0025d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:25.518784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cd8c1-577b-463f-bf22-9dc8e0025d51 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:25.532077 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3215/6492] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:25.537171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eddad-9dc1-4d0f-9642-2793f795ed4c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:25.565748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eddad-9dc1-4d0f-9642-2793f795ed4c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:25.595420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848d5f5-c581-4b05-93ed-78199e30d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:25.596286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848d5f5-c581-4b05-93ed-78199e30d026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:25.597776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848d5f5-c581-4b05-93ed-78199e30d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:25.598297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848d5f5-c581-4b05-93ed-78199e30d026 admin admin] PATH_INFO: `/v3/projects/ee6316884ac540f99ef304a5f78888f7/users/7242be99fa834096ac03649d6c0a48aa/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:25.655183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848d5f5-c581-4b05-93ed-78199e30d026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6316884ac540f99ef304a5f78888f7, user_id=7242be99fa834096ac03649d6c0a48aa, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:25.680669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848d5f5-c581-4b05-93ed-78199e30d026 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:25.717823 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3278/6493] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:25 2022] PUT /identity/v3/projects/ee6316884ac540f99ef304a5f78888f7/users/7242be99fa834096ac03649d6c0a48aa/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:25.725744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cd8c1-577b-463f-bf22-9dc8e0025d51 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:25.736549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cd8c1-577b-463f-bf22-9dc8e0025d51 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:25.940331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a03b99-2514-49a9-9e01-d3c9879c27ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:25.941493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a03b99-2514-49a9-9e01-d3c9879c27ea admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:25.942014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a03b99-2514-49a9-9e01-d3c9879c27ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:25.942500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a03b99-2514-49a9-9e01-d3c9879c27ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:25.944044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a03b99-2514-49a9-9e01-d3c9879c27ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:25.948356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a03b99-2514-49a9-9e01-d3c9879c27ea admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:25.983609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848d5f5-c581-4b05-93ed-78199e30d026 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:25.991347 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3216/6494] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:26.003891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848d5f5-c581-4b05-93ed-78199e30d026 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:26.029941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54cfe8-7ca4-45f3-b261-4aa4f1c4e7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:26.030669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54cfe8-7ca4-45f3-b261-4aa4f1c4e7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:26.031021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54cfe8-7ca4-45f3-b261-4aa4f1c4e7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:26.031363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54cfe8-7ca4-45f3-b261-4aa4f1c4e7ee admin admin] PATH_INFO: `/v3/projects/ee6316884ac540f99ef304a5f78888f7/users/7242be99fa834096ac03649d6c0a48aa/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:26.037445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54cfe8-7ca4-45f3-b261-4aa4f1c4e7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6316884ac540f99ef304a5f78888f7, user_id=7242be99fa834096ac03649d6c0a48aa, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:26.040186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54cfe8-7ca4-45f3-b261-4aa4f1c4e7ee admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:26.088450 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3279/6495] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:25 2022] PUT /identity/v3/projects/ee6316884ac540f99ef304a5f78888f7/users/7242be99fa834096ac03649d6c0a48aa/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:32:26.105318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aa4b5-7ced-412e-b773-33a5bec38c24 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:26.105603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aa4b5-7ced-412e-b773-33a5bec38c24 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:26.105876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aa4b5-7ced-412e-b773-33a5bec38c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:26.194019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-533aa4b5-7ced-412e-b773-33a5bec38c24 None None] MFA Rules not processed for user `7242be99fa834096ac03649d6c0a48aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:26.195126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-533aa4b5-7ced-412e-b773-33a5bec38c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:26.287598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54cfe8-7ca4-45f3-b261-4aa4f1c4e7ee admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:26.289647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bd54cfe8-7ca4-45f3-b261-4aa4f1c4e7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:26.367442 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:26.440193 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3217/6496] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:26.469494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aa4b5-7ced-412e-b773-33a5bec38c24 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:26.471014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-533aa4b5-7ced-412e-b773-33a5bec38c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:26.522467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54cfe8-7ca4-45f3-b261-4aa4f1c4e7ee admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:26.542759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbee1d1-84da-477c-b9ad-41e35df80548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:26.543909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee1d1-84da-477c-b9ad-41e35df80548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:26.544186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee1d1-84da-477c-b9ad-41e35df80548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:26.544460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee1d1-84da-477c-b9ad-41e35df80548 admin admin] PATH_INFO: `/v3/users/cf762132a6a94be29246c528174b2fb8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:26.553873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbee1d1-84da-477c-b9ad-41e35df80548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf762132a6a94be29246c528174b2fb8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:26.555902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbee1d1-84da-477c-b9ad-41e35df80548 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:26.585623 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:26.617344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aa4b5-7ced-412e-b773-33a5bec38c24 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:26.631093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647be98-5468-4e7d-97c7-5feb836b36b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:26.632758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647be98-5468-4e7d-97c7-5feb836b36b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:26.633712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647be98-5468-4e7d-97c7-5feb836b36b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:26.634237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647be98-5468-4e7d-97c7-5feb836b36b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:26.652498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abbee1d1-84da-477c-b9ad-41e35df80548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf762132a6a94be29246c528174b2fb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:26.653052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abbee1d1-84da-477c-b9ad-41e35df80548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf762132a6a94be29246c528174b2fb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:26.658832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647be98-5468-4e7d-97c7-5feb836b36b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:26.661937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647be98-5468-4e7d-97c7-5feb836b36b8 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:26.683538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abbee1d1-84da-477c-b9ad-41e35df80548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf762132a6a94be29246c528174b2fb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:26.698358 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3218/6497] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:32:26.700713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647be98-5468-4e7d-97c7-5feb836b36b8 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:26.709559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e647be98-5468-4e7d-97c7-5feb836b36b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:26.714144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abbee1d1-84da-477c-b9ad-41e35df80548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf762132a6a94be29246c528174b2fb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:26.715273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abbee1d1-84da-477c-b9ad-41e35df80548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf762132a6a94be29246c528174b2fb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:26.751854 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3280/6498] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:26 2022] DELETE /identity/v3/users/cf762132a6a94be29246c528174b2fb8 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:26.757907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647be98-5468-4e7d-97c7-5feb836b36b8 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:26.766769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3c848-6209-4c43-8f24-54ae280b3770 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:26.767709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3c848-6209-4c43-8f24-54ae280b3770 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:26.767987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3c848-6209-4c43-8f24-54ae280b3770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:26.834725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a5e3c848-6209-4c43-8f24-54ae280b3770 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:26.837634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a5e3c848-6209-4c43-8f24-54ae280b3770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:26.974407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:26.976023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:26.976273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:26.978409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] PATH_INFO: `/v3/users/1d6d6b9af8af4d399c78e0b22b0da004` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:26.983507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6d6b9af8af4d399c78e0b22b0da004)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:26.991030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:27.013647 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3281/6499] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:27.020246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3c848-6209-4c43-8f24-54ae280b3770 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:27.025735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a5e3c848-6209-4c43-8f24-54ae280b3770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:27.102541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6d6b9af8af4d399c78e0b22b0da004'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:27.103859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6d6b9af8af4d399c78e0b22b0da004'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:27.130466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6d6b9af8af4d399c78e0b22b0da004'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:27.141354 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:27.146286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6d6b9af8af4d399c78e0b22b0da004'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:27.147695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6d6b9af8af4d399c78e0b22b0da004'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:27.163583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3c848-6209-4c43-8f24-54ae280b3770 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:27.173111 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3219/6500] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:26 2022] DELETE /identity/v3/users/1d6d6b9af8af4d399c78e0b22b0da004 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:27.174253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:27.174381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958aa05-aa53-4203-a8ed-efa4b3499a8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:27.175118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958aa05-aa53-4203-a8ed-efa4b3499a8e service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:27.175469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958aa05-aa53-4203-a8ed-efa4b3499a8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:27.175810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958aa05-aa53-4203-a8ed-efa4b3499a8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:27.180382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:27.181489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5958aa05-aa53-4203-a8ed-efa4b3499a8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:27.305560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7f3f6-cb9f-4ff2-85a1-27746219e130 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:27.310418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a86af-3db7-42a1-b053-32fd4e001c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:27.311198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a86af-3db7-42a1-b053-32fd4e001c1b service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:27.311472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a86af-3db7-42a1-b053-32fd4e001c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:27.311738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a86af-3db7-42a1-b053-32fd4e001c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:27.314885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a52a86af-3db7-42a1-b053-32fd4e001c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:27.336663 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:27.348538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958aa05-aa53-4203-a8ed-efa4b3499a8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:27.350183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958aa05-aa53-4203-a8ed-efa4b3499a8e service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:27.407152 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3282/6501] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:27.484438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a86af-3db7-42a1-b053-32fd4e001c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:27.486451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a86af-3db7-42a1-b053-32fd4e001c1b service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:27.523190 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3220/6502] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:27.583598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958aa05-aa53-4203-a8ed-efa4b3499a8e service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:27.585835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5958aa05-aa53-4203-a8ed-efa4b3499a8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:27.627678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958aa05-aa53-4203-a8ed-efa4b3499a8e service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:27.654044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:27.658363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:27.659119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:27.659665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] PATH_INFO: `/v3/projects/d136775e094041b4bc669a95c11dd1e4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:27.663431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d136775e094041b4bc669a95c11dd1e4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:27.670465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:27.803607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd136775e094041b4bc669a95c11dd1e4', 'request_id': 'req-e60deab9-94eb-49ef-bfe0-1313926fd76f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:27.816746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd136775e094041b4bc669a95c11dd1e4', 'request_id': 'req-e60deab9-94eb-49ef-bfe0-1313926fd76f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:27.829053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd136775e094041b4bc669a95c11dd1e4', 'request_id': 'req-e60deab9-94eb-49ef-bfe0-1313926fd76f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:27.865201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] The token cache is being invalidate because project d136775e094041b4bc669a95c11dd1e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:27.865504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:27.866212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:27.868113 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3283/6503] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:27 2022] DELETE /identity/v3/projects/d136775e094041b4bc669a95c11dd1e4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:27.872018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a86af-3db7-42a1-b053-32fd4e001c1b service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:27.883603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a86af-3db7-42a1-b053-32fd4e001c1b service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:27.957369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:27.958140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:27.958486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:27.959153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] PATH_INFO: `/v3/users/bd696a109e84412ea51e920b1b2cb01c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:27.962035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd696a109e84412ea51e920b1b2cb01c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:27.962201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:28.026995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd696a109e84412ea51e920b1b2cb01c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.027340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd696a109e84412ea51e920b1b2cb01c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.046023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd696a109e84412ea51e920b1b2cb01c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.058635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd696a109e84412ea51e920b1b2cb01c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.060707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd696a109e84412ea51e920b1b2cb01c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.082267 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3221/6504] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:27 2022] DELETE /identity/v3/users/bd696a109e84412ea51e920b1b2cb01c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:32:28.116019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:28.117780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:28.152303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60deab9-94eb-49ef-bfe0-1313926fd76f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:28.239251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:28.240103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:28.240542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:28.241173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] PATH_INFO: `/v3/projects/3c173df85e2942769d3361a511a628c7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:28.242732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c173df85e2942769d3361a511a628c7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:28.245475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:28.280617 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:28.332052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c173df85e2942769d3361a511a628c7', 'request_id': 'req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.340564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c173df85e2942769d3361a511a628c7', 'request_id': 'req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.351184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c173df85e2942769d3361a511a628c7', 'request_id': 'req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.366066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] The token cache is being invalidate because project 3c173df85e2942769d3361a511a628c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:28.366360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.367097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.372024 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3284/6505] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:28 2022] DELETE /identity/v3/projects/3c173df85e2942769d3361a511a628c7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:28.373259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:28.374856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:28.391037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514ad56-a103-486e-8b53-42fdcddc5493 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:28.435633 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:28.492781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccb6a6-6623-4f3f-8101-2d7f2cd4f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:28.494288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccb6a6-6623-4f3f-8101-2d7f2cd4f0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:28.494574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccb6a6-6623-4f3f-8101-2d7f2cd4f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:28.495002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccb6a6-6623-4f3f-8101-2d7f2cd4f0c1 admin admin] PATH_INFO: `/v3/users/3723a7ae9a9e4ce69a1375804b250c72` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:28.496420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccb6a6-6623-4f3f-8101-2d7f2cd4f0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3723a7ae9a9e4ce69a1375804b250c72)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:28.498595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccb6a6-6623-4f3f-8101-2d7f2cd4f0c1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:28.539608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:28.541964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:28.573394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba5b4c-d220-4a7e-9a60-1f8354db7cf2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:28.582706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aaccb6a6-6623-4f3f-8101-2d7f2cd4f0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3723a7ae9a9e4ce69a1375804b250c72'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.596750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05384e35-4a87-439a-822a-526dc7f45e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:28.596905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aaccb6a6-6623-4f3f-8101-2d7f2cd4f0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3723a7ae9a9e4ce69a1375804b250c72'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.597416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05384e35-4a87-439a-822a-526dc7f45e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:28.597752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05384e35-4a87-439a-822a-526dc7f45e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:28.598042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05384e35-4a87-439a-822a-526dc7f45e1c admin admin] PATH_INFO: `/v3/projects/e4d0965b1cdc4667b3436cf8d16397fd` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:28.599885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05384e35-4a87-439a-822a-526dc7f45e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d0965b1cdc4667b3436cf8d16397fd)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:28.603094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05384e35-4a87-439a-822a-526dc7f45e1c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:28.629810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aaccb6a6-6623-4f3f-8101-2d7f2cd4f0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3723a7ae9a9e4ce69a1375804b250c72'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.652291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aaccb6a6-6623-4f3f-8101-2d7f2cd4f0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3723a7ae9a9e4ce69a1375804b250c72'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.653322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aaccb6a6-6623-4f3f-8101-2d7f2cd4f0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3723a7ae9a9e4ce69a1375804b250c72'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.673843 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3222/6506] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:28 2022] DELETE /identity/v3/users/3723a7ae9a9e4ce69a1375804b250c72 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:28.697837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-05384e35-4a87-439a-822a-526dc7f45e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d0965b1cdc4667b3436cf8d16397fd', 'request_id': 'req-05384e35-4a87-439a-822a-526dc7f45e1c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.708766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-05384e35-4a87-439a-822a-526dc7f45e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d0965b1cdc4667b3436cf8d16397fd', 'request_id': 'req-05384e35-4a87-439a-822a-526dc7f45e1c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.731695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-05384e35-4a87-439a-822a-526dc7f45e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d0965b1cdc4667b3436cf8d16397fd', 'request_id': 'req-05384e35-4a87-439a-822a-526dc7f45e1c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.771031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-05384e35-4a87-439a-822a-526dc7f45e1c admin admin] The token cache is being invalidate because project e4d0965b1cdc4667b3436cf8d16397fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:28.771349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-05384e35-4a87-439a-822a-526dc7f45e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.772033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-05384e35-4a87-439a-822a-526dc7f45e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:28.773606 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3285/6507] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:28 2022] DELETE /identity/v3/projects/e4d0965b1cdc4667b3436cf8d16397fd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:28.778679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1731cc-8fb3-45ce-ad28-87ca66f7a787 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:28.778997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1731cc-8fb3-45ce-ad28-87ca66f7a787 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:28.779282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1731cc-8fb3-45ce-ad28-87ca66f7a787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:28.819802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5a1731cc-8fb3-45ce-ad28-87ca66f7a787 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:28.821251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5a1731cc-8fb3-45ce-ad28-87ca66f7a787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:28.936287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78c9be-a4c1-4869-aaab-5b899a34c523 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:28.936503 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3223/6508] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:28.936973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78c9be-a4c1-4869-aaab-5b899a34c523 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:28.936973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78c9be-a4c1-4869-aaab-5b899a34c523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:28.979490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4f78c9be-a4c1-4869-aaab-5b899a34c523 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:28.980739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4f78c9be-a4c1-4869-aaab-5b899a34c523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:29.008708 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3286/6509] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:32:29.011396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1731cc-8fb3-45ce-ad28-87ca66f7a787 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:29.032836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1731cc-8fb3-45ce-ad28-87ca66f7a787 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:29.050271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38072c4b-b635-4e17-9049-d3e3bd42242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:29.051962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38072c4b-b635-4e17-9049-d3e3bd42242b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:29.052494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38072c4b-b635-4e17-9049-d3e3bd42242b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:29.053394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38072c4b-b635-4e17-9049-d3e3bd42242b admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:29.056109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38072c4b-b635-4e17-9049-d3e3bd42242b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:32:29.056663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38072c4b-b635-4e17-9049-d3e3bd42242b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:29.060656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38072c4b-b635-4e17-9049-d3e3bd42242b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:29.098675 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3224/6510] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:32:29.101173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78c9be-a4c1-4869-aaab-5b899a34c523 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:29.119044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78c9be-a4c1-4869-aaab-5b899a34c523 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:29.136396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c7681-514a-4cbc-8d65-b7b0503acba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:29.144634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c7681-514a-4cbc-8d65-b7b0503acba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:29.145269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c7681-514a-4cbc-8d65-b7b0503acba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:29.151100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c7681-514a-4cbc-8d65-b7b0503acba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:29.152105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c7681-514a-4cbc-8d65-b7b0503acba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:29.156805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c7681-514a-4cbc-8d65-b7b0503acba4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:29.230059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38072c4b-b635-4e17-9049-d3e3bd42242b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:29.244541 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3287/6511] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:29 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:29.246295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38072c4b-b635-4e17-9049-d3e3bd42242b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:29.348768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c7681-514a-4cbc-8d65-b7b0503acba4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:29.350868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-041c7681-514a-4cbc-8d65-b7b0503acba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:29.367406 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:29.431924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c07c1-6f4f-4aec-a344-f63954446435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:29.432567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c07c1-6f4f-4aec-a344-f63954446435 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:29.432839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c07c1-6f4f-4aec-a344-f63954446435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:29.433110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c07c1-6f4f-4aec-a344-f63954446435 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:29.433934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c07c1-6f4f-4aec-a344-f63954446435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:29.438266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c07c1-6f4f-4aec-a344-f63954446435 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:29.503049 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3225/6512] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:29 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:29.506566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c07c1-6f4f-4aec-a344-f63954446435 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:29.537206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c07c1-6f4f-4aec-a344-f63954446435 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:29.568815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d62f7c-a4a8-4a1d-ac04-3b091d39060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:29.569761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d62f7c-a4a8-4a1d-ac04-3b091d39060e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:29.570193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d62f7c-a4a8-4a1d-ac04-3b091d39060e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:29.570680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d62f7c-a4a8-4a1d-ac04-3b091d39060e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:29.571907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d62f7c-a4a8-4a1d-ac04-3b091d39060e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:29.573677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d62f7c-a4a8-4a1d-ac04-3b091d39060e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:29.576305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c7681-514a-4cbc-8d65-b7b0503acba4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:29.590267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780347d-a9b2-4214-9f69-9f221ea0c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:29.591014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780347d-a9b2-4214-9f69-9f221ea0c936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:29.591360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780347d-a9b2-4214-9f69-9f221ea0c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:29.591699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780347d-a9b2-4214-9f69-9f221ea0c936 admin admin] PATH_INFO: `/v3/projects/97eeec610e1a420c9d9ff77dcd1ef8d3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:29.593376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780347d-a9b2-4214-9f69-9f221ea0c936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97eeec610e1a420c9d9ff77dcd1ef8d3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:29.602680 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3226/6513] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:29.603863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780347d-a9b2-4214-9f69-9f221ea0c936 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:29.607549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d62f7c-a4a8-4a1d-ac04-3b091d39060e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:29.623217 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:29.639524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d62f7c-a4a8-4a1d-ac04-3b091d39060e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:29.654186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4645b0c-fa56-4f16-a114-59ce166e853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:29.655560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645b0c-fa56-4f16-a114-59ce166e853a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:29.656003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645b0c-fa56-4f16-a114-59ce166e853a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:29.657264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645b0c-fa56-4f16-a114-59ce166e853a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:29.659320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4645b0c-fa56-4f16-a114-59ce166e853a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:29.661571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4645b0c-fa56-4f16-a114-59ce166e853a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:29.674399 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3227/6514] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:29.681452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4645b0c-fa56-4f16-a114-59ce166e853a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:29.706764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4645b0c-fa56-4f16-a114-59ce166e853a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:29.716430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085e7ed-406a-4bc6-aa27-cf13c6db9bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:29.717672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085e7ed-406a-4bc6-aa27-cf13c6db9bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:29.718428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085e7ed-406a-4bc6-aa27-cf13c6db9bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:29.718946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085e7ed-406a-4bc6-aa27-cf13c6db9bd8 admin admin] PATH_INFO: `/v3/projects/50724ab6c2bc4523accb6589ce286343/users/65390e8b0db94ef4be6497f8adc40ba1/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:29.759660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085e7ed-406a-4bc6-aa27-cf13c6db9bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50724ab6c2bc4523accb6589ce286343, user_id=65390e8b0db94ef4be6497f8adc40ba1, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:29.767327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085e7ed-406a-4bc6-aa27-cf13c6db9bd8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:29.781825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1780347d-a9b2-4214-9f69-9f221ea0c936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97eeec610e1a420c9d9ff77dcd1ef8d3', 'request_id': 'req-1780347d-a9b2-4214-9f69-9f221ea0c936'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:29.798763 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3228/6515] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:29 2022] PUT /identity/v3/projects/50724ab6c2bc4523accb6589ce286343/users/65390e8b0db94ef4be6497f8adc40ba1/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:29.801061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1780347d-a9b2-4214-9f69-9f221ea0c936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97eeec610e1a420c9d9ff77dcd1ef8d3', 'request_id': 'req-1780347d-a9b2-4214-9f69-9f221ea0c936'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:29.804291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb6c18-7704-4cc7-abf9-721104b99c69 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:29.804646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb6c18-7704-4cc7-abf9-721104b99c69 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:29.804996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb6c18-7704-4cc7-abf9-721104b99c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:29.819326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1780347d-a9b2-4214-9f69-9f221ea0c936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97eeec610e1a420c9d9ff77dcd1ef8d3', 'request_id': 'req-1780347d-a9b2-4214-9f69-9f221ea0c936'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:29.843235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1780347d-a9b2-4214-9f69-9f221ea0c936 admin admin] The token cache is being invalidate because project 97eeec610e1a420c9d9ff77dcd1ef8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:29.845956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1780347d-a9b2-4214-9f69-9f221ea0c936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:29.847120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1780347d-a9b2-4214-9f69-9f221ea0c936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:29.848434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f2bb6c18-7704-4cc7-abf9-721104b99c69 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:29.849805 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3288/6516] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:29 2022] DELETE /identity/v3/projects/97eeec610e1a420c9d9ff77dcd1ef8d3 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:29.851070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f2bb6c18-7704-4cc7-abf9-721104b99c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:29.854497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa905f-e447-416f-8316-4f8fe5085254 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:29.854840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa905f-e447-416f-8316-4f8fe5085254 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:29.855202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa905f-e447-416f-8316-4f8fe5085254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:29.911100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1caa905f-e447-416f-8316-4f8fe5085254 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:29.914896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1caa905f-e447-416f-8316-4f8fe5085254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:29.969914 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3229/6517] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:29.983291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb6c18-7704-4cc7-abf9-721104b99c69 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:29.984805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f2bb6c18-7704-4cc7-abf9-721104b99c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:30.017158 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3289/6518] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:30.093910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb6c18-7704-4cc7-abf9-721104b99c69 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:30.106151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8fd6d-a581-46ea-aca2-9e9e8625badf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:30.106816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8fd6d-a581-46ea-aca2-9e9e8625badf service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:30.110827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8fd6d-a581-46ea-aca2-9e9e8625badf service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:30.112818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8fd6d-a581-46ea-aca2-9e9e8625badf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:30.136777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8fd6d-a581-46ea-aca2-9e9e8625badf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:30.137026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1379f9-9ea4-406f-b88d-5a1e7f6b5997 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:30.137476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1379f9-9ea4-406f-b88d-5a1e7f6b5997 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:30.137476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1379f9-9ea4-406f-b88d-5a1e7f6b5997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:30.138246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8fd6d-a581-46ea-aca2-9e9e8625badf service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:30.170452 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3230/6519] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:30.172715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8e1379f9-9ea4-406f-b88d-5a1e7f6b5997 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:30.174566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8e1379f9-9ea4-406f-b88d-5a1e7f6b5997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:30.192146 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3290/6520] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:32:30.196519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8fd6d-a581-46ea-aca2-9e9e8625badf service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:30.214005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8fd6d-a581-46ea-aca2-9e9e8625badf service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:30.227387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc37fc5-7c5c-4cfe-985e-7b9be4fcca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:30.228168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc37fc5-7c5c-4cfe-985e-7b9be4fcca15 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:30.228451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc37fc5-7c5c-4cfe-985e-7b9be4fcca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:30.229826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc37fc5-7c5c-4cfe-985e-7b9be4fcca15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:30.229969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc37fc5-7c5c-4cfe-985e-7b9be4fcca15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:32:30.230278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc37fc5-7c5c-4cfe-985e-7b9be4fcca15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:30.235347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc37fc5-7c5c-4cfe-985e-7b9be4fcca15 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:30.271882 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3231/6521] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:32:30.276995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1379f9-9ea4-406f-b88d-5a1e7f6b5997 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:30.288020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1379f9-9ea4-406f-b88d-5a1e7f6b5997 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:30.304507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e9e8a-bb1d-420d-9036-1def8ff09223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:30.305143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e9e8a-bb1d-420d-9036-1def8ff09223 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:30.305418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e9e8a-bb1d-420d-9036-1def8ff09223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:30.305869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e9e8a-bb1d-420d-9036-1def8ff09223 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:30.306694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e9e8a-bb1d-420d-9036-1def8ff09223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:30.309853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e9e8a-bb1d-420d-9036-1def8ff09223 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:30.352750 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3291/6522] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:30 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:30.353378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc37fc5-7c5c-4cfe-985e-7b9be4fcca15 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:30.366037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc37fc5-7c5c-4cfe-985e-7b9be4fcca15 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:30.388817 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:30.502040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0590b6-240b-40d5-9b23-4ae305e477ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:30.502040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0590b6-240b-40d5-9b23-4ae305e477ae admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:30.502660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0590b6-240b-40d5-9b23-4ae305e477ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:30.503747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0590b6-240b-40d5-9b23-4ae305e477ae admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:30.504924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0590b6-240b-40d5-9b23-4ae305e477ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:30.507312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0590b6-240b-40d5-9b23-4ae305e477ae admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:30.559817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e9e8a-bb1d-420d-9036-1def8ff09223 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:30.580557 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3232/6523] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:30 2022] POST /identity/v3/users => generated 296 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:32:30.591041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e9e8a-bb1d-420d-9036-1def8ff09223 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:30.601706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f6a8d-b0f9-4bbb-93c6-eab822f6b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:30.602343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f6a8d-b0f9-4bbb-93c6-eab822f6b79b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:30.602682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f6a8d-b0f9-4bbb-93c6-eab822f6b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:30.603002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f6a8d-b0f9-4bbb-93c6-eab822f6b79b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:30.611397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f6a8d-b0f9-4bbb-93c6-eab822f6b79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:30.624414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f6a8d-b0f9-4bbb-93c6-eab822f6b79b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:30.675791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0590b6-240b-40d5-9b23-4ae305e477ae admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:30.681321 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3292/6524] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:30.703760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0590b6-240b-40d5-9b23-4ae305e477ae admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:30.720553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b21f9-4b77-4fab-8130-e5afb581d059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:30.721756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b21f9-4b77-4fab-8130-e5afb581d059 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:30.722075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b21f9-4b77-4fab-8130-e5afb581d059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:30.722489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b21f9-4b77-4fab-8130-e5afb581d059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:30.723475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b21f9-4b77-4fab-8130-e5afb581d059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:30.725582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b21f9-4b77-4fab-8130-e5afb581d059 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:30.756746 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3233/6525] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:32:30.757900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f6a8d-b0f9-4bbb-93c6-eab822f6b79b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:30.798750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f6a8d-b0f9-4bbb-93c6-eab822f6b79b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:30.819077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62972cfe-79c8-4bcb-9b1e-7b5c4c95932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:30.819762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62972cfe-79c8-4bcb-9b1e-7b5c4c95932c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:30.820039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62972cfe-79c8-4bcb-9b1e-7b5c4c95932c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:30.820312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62972cfe-79c8-4bcb-9b1e-7b5c4c95932c admin admin] PATH_INFO: `/v3/projects/08fda1e882454f83a7a743be835fec8d/users/afa67795ea30451799691721b1ce269b/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:30.860651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62972cfe-79c8-4bcb-9b1e-7b5c4c95932c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08fda1e882454f83a7a743be835fec8d, user_id=afa67795ea30451799691721b1ce269b, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:30.864339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62972cfe-79c8-4bcb-9b1e-7b5c4c95932c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:30.889247 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3293/6526] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:30 2022] PUT /identity/v3/projects/08fda1e882454f83a7a743be835fec8d/users/afa67795ea30451799691721b1ce269b/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:30.909250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efadae-ec7d-4ae2-a21c-7c663a87fdd1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:30.909534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efadae-ec7d-4ae2-a21c-7c663a87fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:30.909805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efadae-ec7d-4ae2-a21c-7c663a87fdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:30.964528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-49efadae-ec7d-4ae2-a21c-7c663a87fdd1 None None] MFA Rules not processed for user `afa67795ea30451799691721b1ce269b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:30.966716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-49efadae-ec7d-4ae2-a21c-7c663a87fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:31.139222 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3234/6527] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:32:31.144435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62972cfe-79c8-4bcb-9b1e-7b5c4c95932c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:31.194878 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:31.248851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62972cfe-79c8-4bcb-9b1e-7b5c4c95932c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:31.258829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358b281-2e99-4e4c-9de3-deb732fe370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:31.259596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b281-2e99-4e4c-9de3-deb732fe370c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:31.259882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b281-2e99-4e4c-9de3-deb732fe370c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:31.260157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b281-2e99-4e4c-9de3-deb732fe370c admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:31.260814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358b281-2e99-4e4c-9de3-deb732fe370c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:31.262735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358b281-2e99-4e4c-9de3-deb732fe370c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:31.309465 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3294/6528] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:31 2022] POST /identity/v3/projects => generated 393 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:31.310759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efadae-ec7d-4ae2-a21c-7c663a87fdd1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:31.322682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efadae-ec7d-4ae2-a21c-7c663a87fdd1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:31.393339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df5e9a-bdb7-43fe-9384-f15de308af53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:31.394307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df5e9a-bdb7-43fe-9384-f15de308af53 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:31.394654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df5e9a-bdb7-43fe-9384-f15de308af53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:31.395023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df5e9a-bdb7-43fe-9384-f15de308af53 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:31.395871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df5e9a-bdb7-43fe-9384-f15de308af53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:31.397971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df5e9a-bdb7-43fe-9384-f15de308af53 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:31.428652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac20af0-db77-4d33-bd1e-adcb60b34e12 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:31.430133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac20af0-db77-4d33-bd1e-adcb60b34e12 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:31.430577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac20af0-db77-4d33-bd1e-adcb60b34e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:31.465214 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3235/6529] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:31 2022] POST /identity/v3/users => generated 303 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:31.466609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df5e9a-bdb7-43fe-9384-f15de308af53 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:31.500079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df5e9a-bdb7-43fe-9384-f15de308af53 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:31.512413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe4983-e5a7-41f1-9083-c21c034bc67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:31.512663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1ac20af0-db77-4d33-bd1e-adcb60b34e12 None None] MFA Rules not processed for user `65390e8b0db94ef4be6497f8adc40ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:31.515311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe4983-e5a7-41f1-9083-c21c034bc67a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:31.515576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe4983-e5a7-41f1-9083-c21c034bc67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:31.516898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe4983-e5a7-41f1-9083-c21c034bc67a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:31.518377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe4983-e5a7-41f1-9083-c21c034bc67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:31.518977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1ac20af0-db77-4d33-bd1e-adcb60b34e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:31.523365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe4983-e5a7-41f1-9083-c21c034bc67a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:31.538375 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:31.550729 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3236/6530] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:31.560063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe4983-e5a7-41f1-9083-c21c034bc67a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:31.596119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe4983-e5a7-41f1-9083-c21c034bc67a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:31.608957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d38644-1235-44e5-bd52-5450438d184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:31.610647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d38644-1235-44e5-bd52-5450438d184a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:31.611967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d38644-1235-44e5-bd52-5450438d184a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:31.612436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d38644-1235-44e5-bd52-5450438d184a admin admin] PATH_INFO: `/v3/projects/2b74493656c9430a91d024d836bf60fc/users/9696de64e3044029b30a2f765824f857/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:31.649737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d38644-1235-44e5-bd52-5450438d184a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b74493656c9430a91d024d836bf60fc, user_id=9696de64e3044029b30a2f765824f857, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:31.654173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d38644-1235-44e5-bd52-5450438d184a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:31.677439 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3237/6531] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:31 2022] PUT /identity/v3/projects/2b74493656c9430a91d024d836bf60fc/users/9696de64e3044029b30a2f765824f857/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:31.679506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d38644-1235-44e5-bd52-5450438d184a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:31.692399 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3295/6532] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:31.694597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a9a58-e249-42d0-936e-21cb8d97373f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:31.695147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a9a58-e249-42d0-936e-21cb8d97373f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:31.695666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a9a58-e249-42d0-936e-21cb8d97373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:31.719429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-505a9a58-e249-42d0-936e-21cb8d97373f None None] MFA Rules not processed for user `65390e8b0db94ef4be6497f8adc40ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:31.721145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-505a9a58-e249-42d0-936e-21cb8d97373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:31.821530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d38644-1235-44e5-bd52-5450438d184a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:31.841708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8ebef-ce5a-4909-8a1e-387e58ebd0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:31.843976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8ebef-ce5a-4909-8a1e-387e58ebd0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:31.845199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8ebef-ce5a-4909-8a1e-387e58ebd0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:31.845477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8ebef-ce5a-4909-8a1e-387e58ebd0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:31.851902 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3296/6533] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:31.852129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8ebef-ce5a-4909-8a1e-387e58ebd0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:31.857443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8ebef-ce5a-4909-8a1e-387e58ebd0e6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:31.864849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a9a58-e249-42d0-936e-21cb8d97373f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:31.872412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-505a9a58-e249-42d0-936e-21cb8d97373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:31.884741 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3238/6534] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:31.885735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8ebef-ce5a-4909-8a1e-387e58ebd0e6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:31.897003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8ebef-ce5a-4909-8a1e-387e58ebd0e6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:31.926703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc50f43-60df-464e-a68a-b244f97c3b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:31.927434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc50f43-60df-464e-a68a-b244f97c3b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:31.927711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc50f43-60df-464e-a68a-b244f97c3b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:31.927978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc50f43-60df-464e-a68a-b244f97c3b29 admin admin] PATH_INFO: `/v3/projects/2b74493656c9430a91d024d836bf60fc/users/9696de64e3044029b30a2f765824f857/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:31.932585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc50f43-60df-464e-a68a-b244f97c3b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b74493656c9430a91d024d836bf60fc, user_id=9696de64e3044029b30a2f765824f857, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:31.936447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc50f43-60df-464e-a68a-b244f97c3b29 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:31.964946 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3239/6535] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:31 2022] PUT /identity/v3/projects/2b74493656c9430a91d024d836bf60fc/users/9696de64e3044029b30a2f765824f857/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:31.976599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bf3c3-0d42-481c-b003-0701af6a0279 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:31.976947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bf3c3-0d42-481c-b003-0701af6a0279 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:31.977157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bf3c3-0d42-481c-b003-0701af6a0279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:32.015588 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:32.055636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f92bf3c3-0d42-481c-b003-0701af6a0279 None None] MFA Rules not processed for user `9696de64e3044029b30a2f765824f857`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:32.057201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f92bf3c3-0d42-481c-b003-0701af6a0279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:32.118735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a9a58-e249-42d0-936e-21cb8d97373f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:32.266162 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3240/6536] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:31 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:32.271678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bf3c3-0d42-481c-b003-0701af6a0279 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:32.273585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f92bf3c3-0d42-481c-b003-0701af6a0279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:32.319457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86396ff3-a4b6-42bb-badb-67cb2d70ba93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:32.320458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86396ff3-a4b6-42bb-badb-67cb2d70ba93 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:32.320772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86396ff3-a4b6-42bb-badb-67cb2d70ba93 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:32.321053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86396ff3-a4b6-42bb-badb-67cb2d70ba93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:32.392068 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:32.413675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bf3c3-0d42-481c-b003-0701af6a0279 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:32.418284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe87bde-3257-4900-8925-7f900a7cc11e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:32.419325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe87bde-3257-4900-8925-7f900a7cc11e service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:32.419661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe87bde-3257-4900-8925-7f900a7cc11e service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:32.419951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe87bde-3257-4900-8925-7f900a7cc11e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:32.451556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe87bde-3257-4900-8925-7f900a7cc11e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:32.452016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86396ff3-a4b6-42bb-badb-67cb2d70ba93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:32.454854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86396ff3-a4b6-42bb-badb-67cb2d70ba93 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:32.455121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe87bde-3257-4900-8925-7f900a7cc11e service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:32.468098 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3297/6537] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:32:32.494570 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3241/6538] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:32 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:32:32.616221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86396ff3-a4b6-42bb-badb-67cb2d70ba93 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:32.617938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-86396ff3-a4b6-42bb-badb-67cb2d70ba93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:32.638019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86396ff3-a4b6-42bb-badb-67cb2d70ba93 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:32.652214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c244373-1f49-46f2-8dd3-edb6b67c27fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:32.653127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c244373-1f49-46f2-8dd3-edb6b67c27fd service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:32.653752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c244373-1f49-46f2-8dd3-edb6b67c27fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:32.654195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c244373-1f49-46f2-8dd3-edb6b67c27fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:32.795488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c244373-1f49-46f2-8dd3-edb6b67c27fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:32.797263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c244373-1f49-46f2-8dd3-edb6b67c27fd service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:32.819879 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3298/6539] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:32:33.723771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe87bde-3257-4900-8925-7f900a7cc11e service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:33.726038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dfe87bde-3257-4900-8925-7f900a7cc11e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:33.868749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe87bde-3257-4900-8925-7f900a7cc11e service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:33.887536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63878eb8-49c8-4bf3-9dae-18bf3f49246b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:33.888028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63878eb8-49c8-4bf3-9dae-18bf3f49246b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:33.888322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63878eb8-49c8-4bf3-9dae-18bf3f49246b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:33.888602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63878eb8-49c8-4bf3-9dae-18bf3f49246b admin admin] PATH_INFO: `/v3/users/65390e8b0db94ef4be6497f8adc40ba1` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:33.891695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63878eb8-49c8-4bf3-9dae-18bf3f49246b admin admin] RBAC: Authorizing `identity:delete_user(user_id=65390e8b0db94ef4be6497f8adc40ba1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:33.894492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63878eb8-49c8-4bf3-9dae-18bf3f49246b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:33.963867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-63878eb8-49c8-4bf3-9dae-18bf3f49246b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65390e8b0db94ef4be6497f8adc40ba1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:33.964556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-63878eb8-49c8-4bf3-9dae-18bf3f49246b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65390e8b0db94ef4be6497f8adc40ba1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:33.985002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-63878eb8-49c8-4bf3-9dae-18bf3f49246b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65390e8b0db94ef4be6497f8adc40ba1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:33.995927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-63878eb8-49c8-4bf3-9dae-18bf3f49246b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65390e8b0db94ef4be6497f8adc40ba1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:33.996482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-63878eb8-49c8-4bf3-9dae-18bf3f49246b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65390e8b0db94ef4be6497f8adc40ba1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:34.029337 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3242/6540] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:33 2022] DELETE /identity/v3/users/65390e8b0db94ef4be6497f8adc40ba1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:34.444651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c244373-1f49-46f2-8dd3-edb6b67c27fd service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:34.491176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c244373-1f49-46f2-8dd3-edb6b67c27fd service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:34.566565 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:34.720850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b410b-9a57-4038-8e5e-0bd2c269fc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:34.721675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b410b-9a57-4038-8e5e-0bd2c269fc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:34.722038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b410b-9a57-4038-8e5e-0bd2c269fc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:34.722371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b410b-9a57-4038-8e5e-0bd2c269fc88 admin admin] PATH_INFO: `/v3/projects/50724ab6c2bc4523accb6589ce286343` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:34.723825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b410b-9a57-4038-8e5e-0bd2c269fc88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50724ab6c2bc4523accb6589ce286343)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:34.725991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b410b-9a57-4038-8e5e-0bd2c269fc88 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:34.882262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-690b410b-9a57-4038-8e5e-0bd2c269fc88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50724ab6c2bc4523accb6589ce286343', 'request_id': 'req-690b410b-9a57-4038-8e5e-0bd2c269fc88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:34.895866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-690b410b-9a57-4038-8e5e-0bd2c269fc88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50724ab6c2bc4523accb6589ce286343', 'request_id': 'req-690b410b-9a57-4038-8e5e-0bd2c269fc88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:34.905165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-690b410b-9a57-4038-8e5e-0bd2c269fc88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50724ab6c2bc4523accb6589ce286343', 'request_id': 'req-690b410b-9a57-4038-8e5e-0bd2c269fc88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:34.934620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-690b410b-9a57-4038-8e5e-0bd2c269fc88 admin admin] The token cache is being invalidate because project 50724ab6c2bc4523accb6589ce286343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:34.934943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-690b410b-9a57-4038-8e5e-0bd2c269fc88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:34.941750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-690b410b-9a57-4038-8e5e-0bd2c269fc88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:34.947060 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3299/6541] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:34 2022] DELETE /identity/v3/projects/50724ab6c2bc4523accb6589ce286343 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:34.948730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df6f1-fe5e-4452-8897-ec00ab6264f6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:34.949198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df6f1-fe5e-4452-8897-ec00ab6264f6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:34.949286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df6f1-fe5e-4452-8897-ec00ab6264f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:34.984058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-903df6f1-fe5e-4452-8897-ec00ab6264f6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:34.988445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-903df6f1-fe5e-4452-8897-ec00ab6264f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:35.177039 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3243/6542] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:35.190881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1303-e427-4fb1-8885-2d248e2c8e4f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:35.192305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1303-e427-4fb1-8885-2d248e2c8e4f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:35.192775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1303-e427-4fb1-8885-2d248e2c8e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:35.265165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b4ff1303-e427-4fb1-8885-2d248e2c8e4f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:35.266490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b4ff1303-e427-4fb1-8885-2d248e2c8e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:35.294281 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3300/6543] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:35.296889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df6f1-fe5e-4452-8897-ec00ab6264f6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:35.309614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df6f1-fe5e-4452-8897-ec00ab6264f6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:35.316347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d9b47-a710-44dc-a38d-3de4d6f506af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:35.317232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d9b47-a710-44dc-a38d-3de4d6f506af admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:35.317929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d9b47-a710-44dc-a38d-3de4d6f506af admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:35.318453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d9b47-a710-44dc-a38d-3de4d6f506af admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:35.319350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d9b47-a710-44dc-a38d-3de4d6f506af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:32:35.319969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d9b47-a710-44dc-a38d-3de4d6f506af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:35.321783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d9b47-a710-44dc-a38d-3de4d6f506af admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:35.330749 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:35.356313 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3244/6544] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:32:35.361719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1303-e427-4fb1-8885-2d248e2c8e4f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:35.389112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1303-e427-4fb1-8885-2d248e2c8e4f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:35.405032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e2eb0-634d-4144-bef8-528cfaf4a428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:35.407330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e2eb0-634d-4144-bef8-528cfaf4a428 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:35.409258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e2eb0-634d-4144-bef8-528cfaf4a428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:35.410969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e2eb0-634d-4144-bef8-528cfaf4a428 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:35.416273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e2eb0-634d-4144-bef8-528cfaf4a428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:35.421498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e2eb0-634d-4144-bef8-528cfaf4a428 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:35.510511 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3301/6545] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:35 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:35.520072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d9b47-a710-44dc-a38d-3de4d6f506af admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:35.578484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d9b47-a710-44dc-a38d-3de4d6f506af admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:35.744489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931deb0-997e-40a2-97b9-3b77ef167796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:35.745511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931deb0-997e-40a2-97b9-3b77ef167796 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:35.745988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931deb0-997e-40a2-97b9-3b77ef167796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:35.746974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931deb0-997e-40a2-97b9-3b77ef167796 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:35.747935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931deb0-997e-40a2-97b9-3b77ef167796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:35.750186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931deb0-997e-40a2-97b9-3b77ef167796 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:35.786065 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3245/6546] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:35 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:35.786676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e2eb0-634d-4144-bef8-528cfaf4a428 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:35.804181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e2eb0-634d-4144-bef8-528cfaf4a428 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:35.813398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771f874-6f8a-4c1f-8039-f149ffa42a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:35.814554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771f874-6f8a-4c1f-8039-f149ffa42a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:35.814852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771f874-6f8a-4c1f-8039-f149ffa42a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:35.815154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771f874-6f8a-4c1f-8039-f149ffa42a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:35.816276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771f874-6f8a-4c1f-8039-f149ffa42a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:35.817387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771f874-6f8a-4c1f-8039-f149ffa42a42 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:35.846215 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3302/6547] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:32:35.848258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931deb0-997e-40a2-97b9-3b77ef167796 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:35.873513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931deb0-997e-40a2-97b9-3b77ef167796 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:35.879289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcaeed7-16a9-436a-b898-dc0db9865af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:35.880024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaeed7-16a9-436a-b898-dc0db9865af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:35.880366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaeed7-16a9-436a-b898-dc0db9865af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:35.880709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaeed7-16a9-436a-b898-dc0db9865af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:35.881423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcaeed7-16a9-436a-b898-dc0db9865af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:35.883139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcaeed7-16a9-436a-b898-dc0db9865af1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:35.943980 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3246/6548] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:35.948238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771f874-6f8a-4c1f-8039-f149ffa42a42 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:35.969335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771f874-6f8a-4c1f-8039-f149ffa42a42 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:35.988422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441ac34-e9f4-47b3-bc90-07ad47e564c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:35.989239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441ac34-e9f4-47b3-bc90-07ad47e564c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:35.989700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441ac34-e9f4-47b3-bc90-07ad47e564c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:35.989860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441ac34-e9f4-47b3-bc90-07ad47e564c7 admin admin] PATH_INFO: `/v3/projects/3bf371ee661342e193e6d9d4aacda40d/users/6a10008a2a4e41c5be09552821db8fad/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:36.026540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441ac34-e9f4-47b3-bc90-07ad47e564c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf371ee661342e193e6d9d4aacda40d, user_id=6a10008a2a4e41c5be09552821db8fad, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:36.036547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441ac34-e9f4-47b3-bc90-07ad47e564c7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:36.071058 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3303/6549] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:35 2022] PUT /identity/v3/projects/3bf371ee661342e193e6d9d4aacda40d/users/6a10008a2a4e41c5be09552821db8fad/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:36.074853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaa9fd-33e2-4d48-aeca-56e5a5613685 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:36.075427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaa9fd-33e2-4d48-aeca-56e5a5613685 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:36.075427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaa9fd-33e2-4d48-aeca-56e5a5613685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:36.120683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-96aaa9fd-33e2-4d48-aeca-56e5a5613685 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:36.123298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-96aaa9fd-33e2-4d48-aeca-56e5a5613685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:36.284563 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3247/6550] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:36.299570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441ac34-e9f4-47b3-bc90-07ad47e564c7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:36.301346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4441ac34-e9f4-47b3-bc90-07ad47e564c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:36.397472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441ac34-e9f4-47b3-bc90-07ad47e564c7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:36.402244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aabbca-7b46-41e4-a656-f2d90341e510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:36.402955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aabbca-7b46-41e4-a656-f2d90341e510 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:36.403312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aabbca-7b46-41e4-a656-f2d90341e510 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:36.403788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aabbca-7b46-41e4-a656-f2d90341e510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:36.412951 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:36.417327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aabbca-7b46-41e4-a656-f2d90341e510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:36.419015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aabbca-7b46-41e4-a656-f2d90341e510 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:36.435935 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3304/6551] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:42.656819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaa9fd-33e2-4d48-aeca-56e5a5613685 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:42.658513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-96aaa9fd-33e2-4d48-aeca-56e5a5613685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:42.693465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaa9fd-33e2-4d48-aeca-56e5a5613685 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:42.712610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:42.720088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:42.721885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:42.722163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] PATH_INFO: `/v3/users/afa67795ea30451799691721b1ce269b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:42.736356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa67795ea30451799691721b1ce269b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:42.749735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:42.920872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa67795ea30451799691721b1ce269b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:42.922477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa67795ea30451799691721b1ce269b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:42.961829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa67795ea30451799691721b1ce269b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:42.969705 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:42.984927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa67795ea30451799691721b1ce269b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:42.986463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa67795ea30451799691721b1ce269b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:43.021257 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3248/6552] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:42 2022] DELETE /identity/v3/users/afa67795ea30451799691721b1ce269b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:43.022674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e93112-b33c-4e54-9bae-99597a16e723 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:43.023113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e93112-b33c-4e54-9bae-99597a16e723 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:43.023631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e93112-b33c-4e54-9bae-99597a16e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:43.080315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-01e93112-b33c-4e54-9bae-99597a16e723 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:43.081501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-01e93112-b33c-4e54-9bae-99597a16e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:43.283821 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3305/6553] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:32:43.314323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:43.317140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:43.464220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78f87d-5fb1-4b5a-b05c-ca209d79b894 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:43.470402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96935caf-aec3-499d-a47d-bbc3251238ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:43.473984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96935caf-aec3-499d-a47d-bbc3251238ee service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:43.475028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96935caf-aec3-499d-a47d-bbc3251238ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:43.478659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96935caf-aec3-499d-a47d-bbc3251238ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:43.516412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96935caf-aec3-499d-a47d-bbc3251238ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:43.518739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96935caf-aec3-499d-a47d-bbc3251238ee service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:43.538836 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3249/6554] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:44.785892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e93112-b33c-4e54-9bae-99597a16e723 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:44.788408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-01e93112-b33c-4e54-9bae-99597a16e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:44.813886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e93112-b33c-4e54-9bae-99597a16e723 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:44.829078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:44.831620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:44.833744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:44.834469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] PATH_INFO: `/v3/projects/08fda1e882454f83a7a743be835fec8d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:44.837472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08fda1e882454f83a7a743be835fec8d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:44.843922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:44.934036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08fda1e882454f83a7a743be835fec8d', 'request_id': 'req-9a2c77e0-1a86-405b-89dd-53a16864d8c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:44.943165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08fda1e882454f83a7a743be835fec8d', 'request_id': 'req-9a2c77e0-1a86-405b-89dd-53a16864d8c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:44.954070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08fda1e882454f83a7a743be835fec8d', 'request_id': 'req-9a2c77e0-1a86-405b-89dd-53a16864d8c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:44.971372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] The token cache is being invalidate because project 08fda1e882454f83a7a743be835fec8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:44.972134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:44.973523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:44.978817 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3306/6555] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:44 2022] DELETE /identity/v3/projects/08fda1e882454f83a7a743be835fec8d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:44.979824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96935caf-aec3-499d-a47d-bbc3251238ee service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:44.995605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96935caf-aec3-499d-a47d-bbc3251238ee service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:45.166569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:45.170001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:45.170284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:45.170713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] PATH_INFO: `/v3/users/9696de64e3044029b30a2f765824f857` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:45.176468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9696de64e3044029b30a2f765824f857)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:45.190592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:45.289650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9696de64e3044029b30a2f765824f857'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:45.290474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9696de64e3044029b30a2f765824f857'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:45.326625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9696de64e3044029b30a2f765824f857'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:45.364067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9696de64e3044029b30a2f765824f857'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:45.364923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9696de64e3044029b30a2f765824f857'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:45.428781 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3250/6556] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:44 2022] DELETE /identity/v3/users/9696de64e3044029b30a2f765824f857 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:47.744857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:47.746386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:47.776823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c77e0-1a86-405b-89dd-53a16864d8c6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:47.909770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:47.911888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:47.934538 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:48.041258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d86703-66be-4263-a0a5-52759a252b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:48.041522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d86703-66be-4263-a0a5-52759a252b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:48.041793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d86703-66be-4263-a0a5-52759a252b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:48.042064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d86703-66be-4263-a0a5-52759a252b46 admin admin] PATH_INFO: `/v3/users/67255c92958e473aa6679014a34f3914` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:48.044194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d86703-66be-4263-a0a5-52759a252b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67255c92958e473aa6679014a34f3914)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:48.046146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d86703-66be-4263-a0a5-52759a252b46 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:48.105604 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:48.161218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588e4b5-7695-4841-92e4-525c0434f000 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:48.174779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-96d86703-66be-4263-a0a5-52759a252b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67255c92958e473aa6679014a34f3914'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:48.175498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-96d86703-66be-4263-a0a5-52759a252b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67255c92958e473aa6679014a34f3914'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:48.177239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b98a7c-e445-4477-9c63-d999a665fbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:48.177893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b98a7c-e445-4477-9c63-d999a665fbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:48.178169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b98a7c-e445-4477-9c63-d999a665fbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:48.178436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b98a7c-e445-4477-9c63-d999a665fbe6 admin admin] PATH_INFO: `/v3/projects/2b74493656c9430a91d024d836bf60fc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:48.180351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b98a7c-e445-4477-9c63-d999a665fbe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b74493656c9430a91d024d836bf60fc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:48.182265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b98a7c-e445-4477-9c63-d999a665fbe6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:48.206141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-96d86703-66be-4263-a0a5-52759a252b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67255c92958e473aa6679014a34f3914'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:48.229080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-96d86703-66be-4263-a0a5-52759a252b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67255c92958e473aa6679014a34f3914'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:48.229636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-96d86703-66be-4263-a0a5-52759a252b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67255c92958e473aa6679014a34f3914'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:48.255759 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3307/6557] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:47 2022] DELETE /identity/v3/users/67255c92958e473aa6679014a34f3914 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:48.263369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5232-5db4-4c6b-a42e-66bf4ace02fc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:48.263997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5232-5db4-4c6b-a42e-66bf4ace02fc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:48.265365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5232-5db4-4c6b-a42e-66bf4ace02fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:48.291354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83b98a7c-e445-4477-9c63-d999a665fbe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b74493656c9430a91d024d836bf60fc', 'request_id': 'req-83b98a7c-e445-4477-9c63-d999a665fbe6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:48.304895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83b98a7c-e445-4477-9c63-d999a665fbe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b74493656c9430a91d024d836bf60fc', 'request_id': 'req-83b98a7c-e445-4477-9c63-d999a665fbe6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:48.318747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83b98a7c-e445-4477-9c63-d999a665fbe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b74493656c9430a91d024d836bf60fc', 'request_id': 'req-83b98a7c-e445-4477-9c63-d999a665fbe6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:48.345923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dfed5232-5db4-4c6b-a42e-66bf4ace02fc None None] MFA Rules not processed for user `6a10008a2a4e41c5be09552821db8fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:48.348368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dfed5232-5db4-4c6b-a42e-66bf4ace02fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:48.348844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83b98a7c-e445-4477-9c63-d999a665fbe6 admin admin] The token cache is being invalidate because project 2b74493656c9430a91d024d836bf60fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:48.349491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83b98a7c-e445-4477-9c63-d999a665fbe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:48.350788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83b98a7c-e445-4477-9c63-d999a665fbe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:48.353283 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3251/6558] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:47 2022] DELETE /identity/v3/projects/2b74493656c9430a91d024d836bf60fc => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:48.354751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27568de6-78ee-40bd-9ee4-6d739dc483e0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:48.355305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27568de6-78ee-40bd-9ee4-6d739dc483e0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:48.355797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27568de6-78ee-40bd-9ee4-6d739dc483e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:48.380389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-27568de6-78ee-40bd-9ee4-6d739dc483e0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:48.383759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-27568de6-78ee-40bd-9ee4-6d739dc483e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:48.491879 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3308/6559] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:48.493444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f976d6-c6db-425d-89e3-6df5c80d7204 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:48.493727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f976d6-c6db-425d-89e3-6df5c80d7204 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:48.494005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f976d6-c6db-425d-89e3-6df5c80d7204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:48.529500 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3252/6560] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:48.532880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27568de6-78ee-40bd-9ee4-6d739dc483e0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:48.539329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-27568de6-78ee-40bd-9ee4-6d739dc483e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:48.546991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-39f976d6-c6db-425d-89e3-6df5c80d7204 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:48.546991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-39f976d6-c6db-425d-89e3-6df5c80d7204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:48.561037 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3309/6561] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:48.569571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f976d6-c6db-425d-89e3-6df5c80d7204 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:48.571066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-39f976d6-c6db-425d-89e3-6df5c80d7204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:48.645817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f976d6-c6db-425d-89e3-6df5c80d7204 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:48.649864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ff7da-e5ff-4bca-8ff9-1aaba9432d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:48.650482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ff7da-e5ff-4bca-8ff9-1aaba9432d50 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:48.650757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ff7da-e5ff-4bca-8ff9-1aaba9432d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:48.651072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ff7da-e5ff-4bca-8ff9-1aaba9432d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:48.662619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ff7da-e5ff-4bca-8ff9-1aaba9432d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:48.664251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ff7da-e5ff-4bca-8ff9-1aaba9432d50 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:48.688531 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3310/6562] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:48.691869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14119c0d-a58d-4360-811e-7bcf3fcefdc8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:48.693958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14119c0d-a58d-4360-811e-7bcf3fcefdc8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:48.694250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14119c0d-a58d-4360-811e-7bcf3fcefdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:48.700065 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:48.758478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-14119c0d-a58d-4360-811e-7bcf3fcefdc8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:48.764534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-14119c0d-a58d-4360-811e-7bcf3fcefdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:48.787175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27568de6-78ee-40bd-9ee4-6d739dc483e0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:48.793087 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3311/6563] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:48.798698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14119c0d-a58d-4360-811e-7bcf3fcefdc8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:48.804108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bd1be-8eb2-428c-8fc0-418095d2c280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:48.804908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bd1be-8eb2-428c-8fc0-418095d2c280 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:48.805308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bd1be-8eb2-428c-8fc0-418095d2c280 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:48.807284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bd1be-8eb2-428c-8fc0-418095d2c280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:48.844412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14119c0d-a58d-4360-811e-7bcf3fcefdc8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:48.851973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bd1be-8eb2-428c-8fc0-418095d2c280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:48.854609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bd1be-8eb2-428c-8fc0-418095d2c280 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:48.866527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc42134-51cc-44e7-888c-db54c9a5f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:48.868852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc42134-51cc-44e7-888c-db54c9a5f98f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:48.869133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc42134-51cc-44e7-888c-db54c9a5f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:48.870725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc42134-51cc-44e7-888c-db54c9a5f98f admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:48.872971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc42134-51cc-44e7-888c-db54c9a5f98f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:32:48.873298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc42134-51cc-44e7-888c-db54c9a5f98f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:48.878975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc42134-51cc-44e7-888c-db54c9a5f98f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:48.900397 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3253/6564] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:48.914737 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3312/6565] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:32:48.919690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bd1be-8eb2-428c-8fc0-418095d2c280 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:48.961325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bd1be-8eb2-428c-8fc0-418095d2c280 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:48.979499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f78f24-1b35-43b7-a871-c89cb333fa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:48.983004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f78f24-1b35-43b7-a871-c89cb333fa4a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:48.983471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f78f24-1b35-43b7-a871-c89cb333fa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:48.983771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f78f24-1b35-43b7-a871-c89cb333fa4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:48.985338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f78f24-1b35-43b7-a871-c89cb333fa4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:48.988005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f78f24-1b35-43b7-a871-c89cb333fa4a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:49.070427 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3254/6566] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:48 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:49.072414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc42134-51cc-44e7-888c-db54c9a5f98f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:49.080580 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:49.095839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc42134-51cc-44e7-888c-db54c9a5f98f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:49.365357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56a0ce-96f7-414b-a3b2-c60bc995bacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:49.366492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56a0ce-96f7-414b-a3b2-c60bc995bacb admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:49.367172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56a0ce-96f7-414b-a3b2-c60bc995bacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:49.367953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56a0ce-96f7-414b-a3b2-c60bc995bacb admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:49.369098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56a0ce-96f7-414b-a3b2-c60bc995bacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:49.375309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56a0ce-96f7-414b-a3b2-c60bc995bacb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:49.447551 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3313/6567] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:49 2022] POST /identity/v3/users => generated 293 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:32:49.451466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f78f24-1b35-43b7-a871-c89cb333fa4a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:49.468183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f78f24-1b35-43b7-a871-c89cb333fa4a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:49.485127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcb6f1-cf1d-450c-840d-a213b76fe2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:49.485647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcb6f1-cf1d-450c-840d-a213b76fe2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:49.486114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcb6f1-cf1d-450c-840d-a213b76fe2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:49.486265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcb6f1-cf1d-450c-840d-a213b76fe2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:49.486993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcb6f1-cf1d-450c-840d-a213b76fe2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:49.490032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcb6f1-cf1d-450c-840d-a213b76fe2a6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:49.516092 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3255/6568] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:49.519002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56a0ce-96f7-414b-a3b2-c60bc995bacb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:49.536531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56a0ce-96f7-414b-a3b2-c60bc995bacb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:49.557301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef81d72-2cfc-4fab-9a11-d3e58d3cb364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:49.557941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef81d72-2cfc-4fab-9a11-d3e58d3cb364 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:49.558224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef81d72-2cfc-4fab-9a11-d3e58d3cb364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:49.558497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef81d72-2cfc-4fab-9a11-d3e58d3cb364 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:49.559170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef81d72-2cfc-4fab-9a11-d3e58d3cb364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:49.560785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef81d72-2cfc-4fab-9a11-d3e58d3cb364 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:49.590173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcb6f1-cf1d-450c-840d-a213b76fe2a6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:49.595430 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3314/6569] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:49.610858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcb6f1-cf1d-450c-840d-a213b76fe2a6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:49.618473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01f9de-3cb8-441f-94a7-f77b217d2383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:49.619274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01f9de-3cb8-441f-94a7-f77b217d2383 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:49.619630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01f9de-3cb8-441f-94a7-f77b217d2383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:49.619975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01f9de-3cb8-441f-94a7-f77b217d2383 admin admin] PATH_INFO: `/v3/projects/6f99b9f5219f41beb140c9643c1d9527/users/4588d7ac8fe24ff6801f28303dc891a3/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:49.663502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01f9de-3cb8-441f-94a7-f77b217d2383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f99b9f5219f41beb140c9643c1d9527, user_id=4588d7ac8fe24ff6801f28303dc891a3, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:49.666388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01f9de-3cb8-441f-94a7-f77b217d2383 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:49.707371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990865b-9da0-4d53-bc80-6c87f4c0a158 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:49.707796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990865b-9da0-4d53-bc80-6c87f4c0a158 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:49.708189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990865b-9da0-4d53-bc80-6c87f4c0a158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:49.711272 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3256/6570] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:49 2022] PUT /identity/v3/projects/6f99b9f5219f41beb140c9643c1d9527/users/4588d7ac8fe24ff6801f28303dc891a3/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:49.766455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1990865b-9da0-4d53-bc80-6c87f4c0a158 None None] MFA Rules not processed for user `4588d7ac8fe24ff6801f28303dc891a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:49.768332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1990865b-9da0-4d53-bc80-6c87f4c0a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:49.915119 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3315/6571] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:49.923855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01f9de-3cb8-441f-94a7-f77b217d2383 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:49.926447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b01f9de-3cb8-441f-94a7-f77b217d2383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:49.939996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990865b-9da0-4d53-bc80-6c87f4c0a158 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:49.942751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1990865b-9da0-4d53-bc80-6c87f4c0a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:50.026480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01f9de-3cb8-441f-94a7-f77b217d2383 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:50.034065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51905f-9096-4b87-bf9c-f3ea2369be86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:50.036274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51905f-9096-4b87-bf9c-f3ea2369be86 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:50.037383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51905f-9096-4b87-bf9c-f3ea2369be86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:50.038704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51905f-9096-4b87-bf9c-f3ea2369be86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:50.053515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51905f-9096-4b87-bf9c-f3ea2369be86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:50.055614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51905f-9096-4b87-bf9c-f3ea2369be86 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:50.070778 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3257/6572] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:50.096354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51905f-9096-4b87-bf9c-f3ea2369be86 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:50.109328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51905f-9096-4b87-bf9c-f3ea2369be86 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:50.116174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c077ca-ebb7-45d8-ac43-3e6c43765c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:50.117251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c077ca-ebb7-45d8-ac43-3e6c43765c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:50.117664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990865b-9da0-4d53-bc80-6c87f4c0a158 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:50.117995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c077ca-ebb7-45d8-ac43-3e6c43765c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:50.118674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c077ca-ebb7-45d8-ac43-3e6c43765c85 admin admin] PATH_INFO: `/v3/users/4588d7ac8fe24ff6801f28303dc891a3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:50.120208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c077ca-ebb7-45d8-ac43-3e6c43765c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4588d7ac8fe24ff6801f28303dc891a3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:50.123056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c077ca-ebb7-45d8-ac43-3e6c43765c85 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:50.134120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:50.135207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:50.135329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:50.135636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] PATH_INFO: `/v3/projects/6e211f906a1242e0b98da9cc400ed090` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:50.139068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e211f906a1242e0b98da9cc400ed090)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:50.141193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:50.184998 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:50.255412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-28c077ca-ebb7-45d8-ac43-3e6c43765c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4588d7ac8fe24ff6801f28303dc891a3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.256338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-28c077ca-ebb7-45d8-ac43-3e6c43765c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4588d7ac8fe24ff6801f28303dc891a3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.259518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e211f906a1242e0b98da9cc400ed090', 'request_id': 'req-d0bc4510-a760-4415-9eae-0598343419e6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.271319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e211f906a1242e0b98da9cc400ed090', 'request_id': 'req-d0bc4510-a760-4415-9eae-0598343419e6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.285115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e211f906a1242e0b98da9cc400ed090', 'request_id': 'req-d0bc4510-a760-4415-9eae-0598343419e6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.289105 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:50.291421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-28c077ca-ebb7-45d8-ac43-3e6c43765c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4588d7ac8fe24ff6801f28303dc891a3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.314398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] The token cache is being invalidate because project 6e211f906a1242e0b98da9cc400ed090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:50.315292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.316478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.319015 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3316/6573] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:49 2022] DELETE /identity/v3/projects/6e211f906a1242e0b98da9cc400ed090 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:50.320813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-28c077ca-ebb7-45d8-ac43-3e6c43765c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4588d7ac8fe24ff6801f28303dc891a3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.322672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-28c077ca-ebb7-45d8-ac43-3e6c43765c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4588d7ac8fe24ff6801f28303dc891a3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.323022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:50.327094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:50.367943 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3258/6574] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:50 2022] DELETE /identity/v3/users/4588d7ac8fe24ff6801f28303dc891a3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:50.372816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5e0d4-845f-4507-a11a-7450c8c6d0aa None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:50.373439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5e0d4-845f-4507-a11a-7450c8c6d0aa None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:50.373817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5e0d4-845f-4507-a11a-7450c8c6d0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:50.434937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d6e5e0d4-845f-4507-a11a-7450c8c6d0aa None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:50.436513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d6e5e0d4-845f-4507-a11a-7450c8c6d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:50.586542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc4510-a760-4415-9eae-0598343419e6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:50.594245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:50.595855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:50.596217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:50.596400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] PATH_INFO: `/v3/users/7242be99fa834096ac03649d6c0a48aa` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:50.600131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7242be99fa834096ac03649d6c0a48aa)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:50.602236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:50.616795 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3259/6575] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:50.653611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5e0d4-845f-4507-a11a-7450c8c6d0aa None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:50.656086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d6e5e0d4-845f-4507-a11a-7450c8c6d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:50.773566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7242be99fa834096ac03649d6c0a48aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.774763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7242be99fa834096ac03649d6c0a48aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.841058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7242be99fa834096ac03649d6c0a48aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.862209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7242be99fa834096ac03649d6c0a48aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.863640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7242be99fa834096ac03649d6c0a48aa'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:50.868242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5e0d4-845f-4507-a11a-7450c8c6d0aa None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:50.885461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e5ed8-30c3-4d72-8745-b9120206fa5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:50.886156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e5ed8-30c3-4d72-8745-b9120206fa5a service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:50.886435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e5ed8-30c3-4d72-8745-b9120206fa5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:50.886783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e5ed8-30c3-4d72-8745-b9120206fa5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:50.889517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a57e5ed8-30c3-4d72-8745-b9120206fa5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:50.893306 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3317/6576] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:50 2022] DELETE /identity/v3/users/7242be99fa834096ac03649d6c0a48aa => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:50.940484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e5ed8-30c3-4d72-8745-b9120206fa5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:50.941917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e5ed8-30c3-4d72-8745-b9120206fa5a service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:50.970356 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3260/6577] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:52.485285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:52.490851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:52.519801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e5ed8-30c3-4d72-8745-b9120206fa5a service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:52.522606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a57e5ed8-30c3-4d72-8745-b9120206fa5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:52.578378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e5ed8-30c3-4d72-8745-b9120206fa5a service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:52.606654 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:52.805927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aa60b-5823-4c34-82d3-16db3df84d5f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:52.817417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b935299-651e-4ea7-b732-cdd931294d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:52.818339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b935299-651e-4ea7-b732-cdd931294d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:52.819934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b935299-651e-4ea7-b732-cdd931294d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:52.820398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b935299-651e-4ea7-b732-cdd931294d21 admin admin] PATH_INFO: `/v3/projects/6f99b9f5219f41beb140c9643c1d9527` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:52.826575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b935299-651e-4ea7-b732-cdd931294d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f99b9f5219f41beb140c9643c1d9527)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:52.828943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b935299-651e-4ea7-b732-cdd931294d21 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:52.887225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:52.887988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:52.888278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:52.888587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497 admin admin] PATH_INFO: `/v3/projects/ee6316884ac540f99ef304a5f78888f7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:52.895941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6316884ac540f99ef304a5f78888f7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:52.906596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:52.974470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5b935299-651e-4ea7-b732-cdd931294d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f99b9f5219f41beb140c9643c1d9527', 'request_id': 'req-5b935299-651e-4ea7-b732-cdd931294d21'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:52.995687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5b935299-651e-4ea7-b732-cdd931294d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f99b9f5219f41beb140c9643c1d9527', 'request_id': 'req-5b935299-651e-4ea7-b732-cdd931294d21'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:53.019584 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:53.027007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5b935299-651e-4ea7-b732-cdd931294d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f99b9f5219f41beb140c9643c1d9527', 'request_id': 'req-5b935299-651e-4ea7-b732-cdd931294d21'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:53.059777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6316884ac540f99ef304a5f78888f7', 'request_id': 'req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:53.070099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6316884ac540f99ef304a5f78888f7', 'request_id': 'req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:53.097835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6316884ac540f99ef304a5f78888f7', 'request_id': 'req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:53.100456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5b935299-651e-4ea7-b732-cdd931294d21 admin admin] The token cache is being invalidate because project 6f99b9f5219f41beb140c9643c1d9527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:53.100887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5b935299-651e-4ea7-b732-cdd931294d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:53.109210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5b935299-651e-4ea7-b732-cdd931294d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:53.114550 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3318/6578] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:52 2022] DELETE /identity/v3/projects/6f99b9f5219f41beb140c9643c1d9527 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:53.119719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f00288-3760-4223-8df8-4d524f70f432 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:53.120046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f00288-3760-4223-8df8-4d524f70f432 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:53.120259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f00288-3760-4223-8df8-4d524f70f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:53.168799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497 admin admin] The token cache is being invalidate because project ee6316884ac540f99ef304a5f78888f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:53.169808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:53.171591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c9ef2a55-f2e0-47fc-bafc-61dba91f8497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:53.179939 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3261/6579] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:52 2022] DELETE /identity/v3/projects/ee6316884ac540f99ef304a5f78888f7 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:53.180502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-44f00288-3760-4223-8df8-4d524f70f432 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:53.181829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-44f00288-3760-4223-8df8-4d524f70f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:53.185489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf8b2c-2401-4f20-a167-56edd4169173 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:53.187589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf8b2c-2401-4f20-a167-56edd4169173 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:53.191905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf8b2c-2401-4f20-a167-56edd4169173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:53.257137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e6bf8b2c-2401-4f20-a167-56edd4169173 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:53.258681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e6bf8b2c-2401-4f20-a167-56edd4169173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:53.436752 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3319/6580] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:53.438462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106bcd-1bfd-49dc-9512-0805cf9b5b5a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:53.439987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106bcd-1bfd-49dc-9512-0805cf9b5b5a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:53.440267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106bcd-1bfd-49dc-9512-0805cf9b5b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:53.506231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-32106bcd-1bfd-49dc-9512-0805cf9b5b5a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:53.507018 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3262/6581] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:53.507129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-32106bcd-1bfd-49dc-9512-0805cf9b5b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:53.507943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0053a6-b419-4275-81cf-6de7e603b669 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:53.508229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0053a6-b419-4275-81cf-6de7e603b669 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:53.508501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0053a6-b419-4275-81cf-6de7e603b669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:53.524668 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3320/6582] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:53.526212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32106bcd-1bfd-49dc-9512-0805cf9b5b5a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:53.549383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32106bcd-1bfd-49dc-9512-0805cf9b5b5a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:53.560588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e73a1-6a77-48e3-9364-1b69e3f80d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:53.561392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e73a1-6a77-48e3-9364-1b69e3f80d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:53.561829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e73a1-6a77-48e3-9364-1b69e3f80d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:53.562236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e73a1-6a77-48e3-9364-1b69e3f80d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:53.563063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e73a1-6a77-48e3-9364-1b69e3f80d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:32:53.568413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e73a1-6a77-48e3-9364-1b69e3f80d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:53.570072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e73a1-6a77-48e3-9364-1b69e3f80d00 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:53.593033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1c0053a6-b419-4275-81cf-6de7e603b669 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:53.594248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1c0053a6-b419-4275-81cf-6de7e603b669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:53.609032 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3321/6583] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:32:53.612261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e73a1-6a77-48e3-9364-1b69e3f80d00 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:53.627552 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3263/6584] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:32:53.628779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0053a6-b419-4275-81cf-6de7e603b669 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:53.645136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e73a1-6a77-48e3-9364-1b69e3f80d00 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:53.654478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5acf8-c5d7-4938-ab99-f3f4ceb4f091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:53.655553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5acf8-c5d7-4938-ab99-f3f4ceb4f091 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:53.656063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5acf8-c5d7-4938-ab99-f3f4ceb4f091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:53.656560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5acf8-c5d7-4938-ab99-f3f4ceb4f091 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:53.658100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0053a6-b419-4275-81cf-6de7e603b669 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:53.658371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5acf8-c5d7-4938-ab99-f3f4ceb4f091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:53.661709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5acf8-c5d7-4938-ab99-f3f4ceb4f091 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:53.668674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28e8da-e976-4b6a-8069-3778f5242f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:53.670472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28e8da-e976-4b6a-8069-3778f5242f9c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:53.671172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28e8da-e976-4b6a-8069-3778f5242f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:53.671834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28e8da-e976-4b6a-8069-3778f5242f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:53.672724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28e8da-e976-4b6a-8069-3778f5242f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:32:53.674111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28e8da-e976-4b6a-8069-3778f5242f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:53.677251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28e8da-e976-4b6a-8069-3778f5242f9c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:53.728610 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3264/6585] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:32:53.730731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28e8da-e976-4b6a-8069-3778f5242f9c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:53.753344 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3322/6586] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:53 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:53.761162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5acf8-c5d7-4938-ab99-f3f4ceb4f091 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:53.766317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28e8da-e976-4b6a-8069-3778f5242f9c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:53.791114 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:53.928546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e300d0-436f-42b2-ab88-b750a1842cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:53.929172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e300d0-436f-42b2-ab88-b750a1842cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:53.929451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e300d0-436f-42b2-ab88-b750a1842cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:53.929730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e300d0-436f-42b2-ab88-b750a1842cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:53.930354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e300d0-436f-42b2-ab88-b750a1842cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:53.943645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e300d0-436f-42b2-ab88-b750a1842cf5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:54.002809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5acf8-c5d7-4938-ab99-f3f4ceb4f091 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:54.037878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542b4ff-9308-406e-ba3b-70163089c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:54.038667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542b4ff-9308-406e-ba3b-70163089c65c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:54.039317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542b4ff-9308-406e-ba3b-70163089c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:54.041019 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3265/6587] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:53 2022] POST /identity/v3/projects => generated 389 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:54.044428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542b4ff-9308-406e-ba3b-70163089c65c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:54.047340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542b4ff-9308-406e-ba3b-70163089c65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:54.051989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e300d0-436f-42b2-ab88-b750a1842cf5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:54.054148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542b4ff-9308-406e-ba3b-70163089c65c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:54.113349 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:54.135556 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3323/6588] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:53 2022] POST /identity/v3/users => generated 286 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:54.136676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542b4ff-9308-406e-ba3b-70163089c65c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:54.167734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542b4ff-9308-406e-ba3b-70163089c65c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:54.313323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e300d0-436f-42b2-ab88-b750a1842cf5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:54.333513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036d2a5-f98b-49a8-a642-a12a4130178e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:54.335199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036d2a5-f98b-49a8-a642-a12a4130178e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:54.335199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036d2a5-f98b-49a8-a642-a12a4130178e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:54.335199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036d2a5-f98b-49a8-a642-a12a4130178e admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:54.335486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036d2a5-f98b-49a8-a642-a12a4130178e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:54.337444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036d2a5-f98b-49a8-a642-a12a4130178e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:54.381742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecd64d-0bf2-4600-a4a5-1ea68876f1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:54.382452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecd64d-0bf2-4600-a4a5-1ea68876f1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:54.382734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecd64d-0bf2-4600-a4a5-1ea68876f1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:54.383043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecd64d-0bf2-4600-a4a5-1ea68876f1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:54.383930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecd64d-0bf2-4600-a4a5-1ea68876f1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:54.386421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecd64d-0bf2-4600-a4a5-1ea68876f1a9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:54.389047 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3266/6589] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:54 2022] POST /identity/v3/users => generated 295 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:54.393813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036d2a5-f98b-49a8-a642-a12a4130178e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:54.421605 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3324/6590] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:54.423314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecd64d-0bf2-4600-a4a5-1ea68876f1a9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:54.438883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036d2a5-f98b-49a8-a642-a12a4130178e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:54.454760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240b1fe-8eac-4bfe-ae7a-72f2c49bc5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:54.455428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b1fe-8eac-4bfe-ae7a-72f2c49bc5ac admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:54.455706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b1fe-8eac-4bfe-ae7a-72f2c49bc5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:54.455968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b1fe-8eac-4bfe-ae7a-72f2c49bc5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:54.456606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240b1fe-8eac-4bfe-ae7a-72f2c49bc5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:54.458224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240b1fe-8eac-4bfe-ae7a-72f2c49bc5ac admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:54.460504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecd64d-0bf2-4600-a4a5-1ea68876f1a9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:54.469428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c136a-c93e-4eac-9acd-c3c39da86de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:54.470499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c136a-c93e-4eac-9acd-c3c39da86de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:54.470990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c136a-c93e-4eac-9acd-c3c39da86de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:54.472024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c136a-c93e-4eac-9acd-c3c39da86de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:54.472834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c136a-c93e-4eac-9acd-c3c39da86de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:54.476559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c136a-c93e-4eac-9acd-c3c39da86de3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:54.492914 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3325/6591] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:54.494535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ae14b-20dd-4158-b7d1-781610a33746 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:54.494989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ae14b-20dd-4158-b7d1-781610a33746 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:54.495440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ae14b-20dd-4158-b7d1-781610a33746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:54.497632 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3267/6592] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:54.500348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240b1fe-8eac-4bfe-ae7a-72f2c49bc5ac admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:54.518680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-172ae14b-20dd-4158-b7d1-781610a33746 None None] MFA Rules not processed for user `6a10008a2a4e41c5be09552821db8fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:54.521154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-172ae14b-20dd-4158-b7d1-781610a33746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:54.529066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240b1fe-8eac-4bfe-ae7a-72f2c49bc5ac admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:54.555076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367e00-98be-4a49-af5b-554cd9325c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:54.555716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367e00-98be-4a49-af5b-554cd9325c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:54.556002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367e00-98be-4a49-af5b-554cd9325c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:54.564468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367e00-98be-4a49-af5b-554cd9325c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:54.565878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6367e00-98be-4a49-af5b-554cd9325c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:54.580412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6367e00-98be-4a49-af5b-554cd9325c9d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:54.607622 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3268/6593] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:54.609742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367e00-98be-4a49-af5b-554cd9325c9d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:54.630163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367e00-98be-4a49-af5b-554cd9325c9d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:54.646294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252391dd-cf38-47fa-98dc-4501f24af09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:54.647187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252391dd-cf38-47fa-98dc-4501f24af09f admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:54.647930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252391dd-cf38-47fa-98dc-4501f24af09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:54.649293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252391dd-cf38-47fa-98dc-4501f24af09f admin admin] PATH_INFO: `/v3/projects/bc25d2fa7e254c3ba428663aa44b5868/users/9adb32a355c041f688c32d983086d939/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:54.650817 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3326/6594] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:54.652670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ae14b-20dd-4158-b7d1-781610a33746 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:54.700700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ae14b-20dd-4158-b7d1-781610a33746 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:54.706147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252391dd-cf38-47fa-98dc-4501f24af09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc25d2fa7e254c3ba428663aa44b5868, user_id=9adb32a355c041f688c32d983086d939, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:54.722182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252391dd-cf38-47fa-98dc-4501f24af09f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:54.723476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c265b9-f879-4536-b756-ed949cb1dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:54.724296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c265b9-f879-4536-b756-ed949cb1dd49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:54.727216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c265b9-f879-4536-b756-ed949cb1dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:54.727752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c265b9-f879-4536-b756-ed949cb1dd49 admin admin] PATH_INFO: `/v3/projects/d6c09bc9c59749e79d671c64450a5275/users/67f081e16d8e40c1bc5be6627ec7b50e/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:54.768603 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3269/6595] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:54 2022] PUT /identity/v3/projects/bc25d2fa7e254c3ba428663aa44b5868/users/9adb32a355c041f688c32d983086d939/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:54.779328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb56a17-f9e8-4944-b5f9-69286ed55f23 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:54.779959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb56a17-f9e8-4944-b5f9-69286ed55f23 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:54.780454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb56a17-f9e8-4944-b5f9-69286ed55f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:54.792786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c265b9-f879-4536-b756-ed949cb1dd49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c09bc9c59749e79d671c64450a5275, user_id=67f081e16d8e40c1bc5be6627ec7b50e, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:54.808283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c265b9-f879-4536-b756-ed949cb1dd49 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:54.836402 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3327/6596] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:54 2022] PUT /identity/v3/projects/d6c09bc9c59749e79d671c64450a5275/users/67f081e16d8e40c1bc5be6627ec7b50e/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:54.853170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fe43c-60d5-4e15-b3c6-1a0114736a01 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:54.853654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fe43c-60d5-4e15-b3c6-1a0114736a01 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:54.855253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fe43c-60d5-4e15-b3c6-1a0114736a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:54.873929 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:54.887983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8bb56a17-f9e8-4944-b5f9-69286ed55f23 None None] MFA Rules not processed for user `9adb32a355c041f688c32d983086d939`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:54.889229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8bb56a17-f9e8-4944-b5f9-69286ed55f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:54.947997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6c4fe43c-60d5-4e15-b3c6-1a0114736a01 None None] MFA Rules not processed for user `67f081e16d8e40c1bc5be6627ec7b50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:54.949142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c4fe43c-60d5-4e15-b3c6-1a0114736a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:55.086256 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3270/6597] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:32:55.098182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb56a17-f9e8-4944-b5f9-69286ed55f23 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:55.101745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8bb56a17-f9e8-4944-b5f9-69286ed55f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:55.116138 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3328/6598] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:55.119991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fe43c-60d5-4e15-b3c6-1a0114736a01 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:55.269162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb56a17-f9e8-4944-b5f9-69286ed55f23 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:55.276011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c070629-59f4-436b-b785-83ab85545734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:55.276635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c070629-59f4-436b-b785-83ab85545734 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:55.276908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c070629-59f4-436b-b785-83ab85545734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:55.277181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c070629-59f4-436b-b785-83ab85545734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:55.291168 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:55.294830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c070629-59f4-436b-b785-83ab85545734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:55.302508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c070629-59f4-436b-b785-83ab85545734 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:55.318336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fe43c-60d5-4e15-b3c6-1a0114736a01 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:55.331275 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3271/6599] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:55.333281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fabab9-716e-4917-bd9e-44ce46f173be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:55.334995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fabab9-716e-4917-bd9e-44ce46f173be admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:55.336538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fabab9-716e-4917-bd9e-44ce46f173be admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:55.337237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fabab9-716e-4917-bd9e-44ce46f173be admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:55.339456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fabab9-716e-4917-bd9e-44ce46f173be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:55.347093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fabab9-716e-4917-bd9e-44ce46f173be admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:55.349150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c070629-59f4-436b-b785-83ab85545734 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:55.370401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c070629-59f4-436b-b785-83ab85545734 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:55.405661 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3329/6600] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:55 2022] POST /identity/v3/projects => generated 385 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:55.411986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fabab9-716e-4917-bd9e-44ce46f173be admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:55.414261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:55.414424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:55.414604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:55.414872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] PATH_INFO: `/v3/users/9adb32a355c041f688c32d983086d939` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:55.416227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9adb32a355c041f688c32d983086d939)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:55.418163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:55.560801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fabab9-716e-4917-bd9e-44ce46f173be admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:55.561448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9adb32a355c041f688c32d983086d939'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:55.562331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9adb32a355c041f688c32d983086d939'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:55.575330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391f724-9a74-4dff-a5e1-7c7bbf3e4a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:55.576421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391f724-9a74-4dff-a5e1-7c7bbf3e4a81 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:55.576745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391f724-9a74-4dff-a5e1-7c7bbf3e4a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:55.577417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391f724-9a74-4dff-a5e1-7c7bbf3e4a81 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:55.578512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391f724-9a74-4dff-a5e1-7c7bbf3e4a81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:55.589114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391f724-9a74-4dff-a5e1-7c7bbf3e4a81 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:55.601623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9adb32a355c041f688c32d983086d939'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:55.615045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9adb32a355c041f688c32d983086d939'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:55.615801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9adb32a355c041f688c32d983086d939'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:55.641282 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3272/6602] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:55 2022] DELETE /identity/v3/users/9adb32a355c041f688c32d983086d939 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:55.642274 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3330/6601] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:55 2022] POST /identity/v3/users => generated 299 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:55.642832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:55.645353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaae24a-90cd-45ba-b311-ed7f1b641692 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:55.646202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaae24a-90cd-45ba-b311-ed7f1b641692 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:55.646426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:55.648748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaae24a-90cd-45ba-b311-ed7f1b641692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:55.698635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-eaaae24a-90cd-45ba-b311-ed7f1b641692 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:55.700371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eaaae24a-90cd-45ba-b311-ed7f1b641692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:55.713999 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:55.811052 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3331/6603] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:55.812585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e00fe7-1bb9-4340-bc45-3f74baa9e416 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:55.835369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af1c84-310f-4ad5-b65b-c25d047b1dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:55.836010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af1c84-310f-4ad5-b65b-c25d047b1dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:55.836289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af1c84-310f-4ad5-b65b-c25d047b1dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:55.836560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af1c84-310f-4ad5-b65b-c25d047b1dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:55.837213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af1c84-310f-4ad5-b65b-c25d047b1dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:55.838844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af1c84-310f-4ad5-b65b-c25d047b1dd3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:55.844003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaae24a-90cd-45ba-b311-ed7f1b641692 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:55.846906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eaaae24a-90cd-45ba-b311-ed7f1b641692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:55.881981 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3273/6604] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:55.890180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af1c84-310f-4ad5-b65b-c25d047b1dd3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:55.916150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af1c84-310f-4ad5-b65b-c25d047b1dd3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:55.938794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8e818-115e-4885-bc1f-9530a9f9f962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:55.939928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8e818-115e-4885-bc1f-9530a9f9f962 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:55.940222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8e818-115e-4885-bc1f-9530a9f9f962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:55.940495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8e818-115e-4885-bc1f-9530a9f9f962 admin admin] PATH_INFO: `/v3/projects/1821261fcd434e00a55f77a67466df94/users/55bc040f98924179a35c52d567864e3f/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:55.975497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8e818-115e-4885-bc1f-9530a9f9f962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1821261fcd434e00a55f77a67466df94, user_id=55bc040f98924179a35c52d567864e3f, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:55.978428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8e818-115e-4885-bc1f-9530a9f9f962 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:55.983305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaae24a-90cd-45ba-b311-ed7f1b641692 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:55.990855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d051b49-85b6-4f3c-beba-e7315d87335c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:55.992075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d051b49-85b6-4f3c-beba-e7315d87335c service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:55.992826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d051b49-85b6-4f3c-beba-e7315d87335c service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:55.993371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d051b49-85b6-4f3c-beba-e7315d87335c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:56.009571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d051b49-85b6-4f3c-beba-e7315d87335c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:56.011299 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3274/6605] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:55 2022] PUT /identity/v3/projects/1821261fcd434e00a55f77a67466df94/users/55bc040f98924179a35c52d567864e3f/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:56.013917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d051b49-85b6-4f3c-beba-e7315d87335c service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:56.015586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8e818-115e-4885-bc1f-9530a9f9f962 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:56.046262 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3332/6606] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:56.246098 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:56.293495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8e818-115e-4885-bc1f-9530a9f9f962 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:56.307852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd1f1c-f37b-4e2c-a053-941af92bdb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:56.309189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd1f1c-f37b-4e2c-a053-941af92bdb33 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:56.309982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd1f1c-f37b-4e2c-a053-941af92bdb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:56.311358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd1f1c-f37b-4e2c-a053-941af92bdb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:56.312249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd1f1c-f37b-4e2c-a053-941af92bdb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:56.315516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd1f1c-f37b-4e2c-a053-941af92bdb33 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:56.342539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d051b49-85b6-4f3c-beba-e7315d87335c service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:56.349574 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3275/6607] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:56.354799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d051b49-85b6-4f3c-beba-e7315d87335c service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:56.359875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce56bac-6890-4321-a7e3-f39985a7d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:56.360823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56bac-6890-4321-a7e3-f39985a7d811 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:56.362046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56bac-6890-4321-a7e3-f39985a7d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:56.362531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56bac-6890-4321-a7e3-f39985a7d811 admin admin] PATH_INFO: `/v3/projects/1821261fcd434e00a55f77a67466df94/users/55bc040f98924179a35c52d567864e3f/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:56.365017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce56bac-6890-4321-a7e3-f39985a7d811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1821261fcd434e00a55f77a67466df94, user_id=55bc040f98924179a35c52d567864e3f, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:56.367911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce56bac-6890-4321-a7e3-f39985a7d811 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:56.399392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8c49-cf0e-4ab7-83db-73eefdce3144 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:56.399888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8c49-cf0e-4ab7-83db-73eefdce3144 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:56.400276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8c49-cf0e-4ab7-83db-73eefdce3144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:56.403517 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3333/6608] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:56 2022] PUT /identity/v3/projects/1821261fcd434e00a55f77a67466df94/users/55bc040f98924179a35c52d567864e3f/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:56.450492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fdfa8c49-cf0e-4ab7-83db-73eefdce3144 None None] MFA Rules not processed for user `55bc040f98924179a35c52d567864e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:56.458523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fdfa8c49-cf0e-4ab7-83db-73eefdce3144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:56.667957 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3276/6609] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:56.680542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce56bac-6890-4321-a7e3-f39985a7d811 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:56.682333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0ce56bac-6890-4321-a7e3-f39985a7d811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:56.875527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce56bac-6890-4321-a7e3-f39985a7d811 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:56.887123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725f77c-35cb-4068-94a2-fdfb8be6b717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:56.887802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725f77c-35cb-4068-94a2-fdfb8be6b717 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:56.888033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725f77c-35cb-4068-94a2-fdfb8be6b717 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:56.897326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725f77c-35cb-4068-94a2-fdfb8be6b717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:56.924648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8c49-cf0e-4ab7-83db-73eefdce3144 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:56.926093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fdfa8c49-cf0e-4ab7-83db-73eefdce3144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:56.949256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725f77c-35cb-4068-94a2-fdfb8be6b717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:56.961262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725f77c-35cb-4068-94a2-fdfb8be6b717 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:57.001817 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3334/6610] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:57.090972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8c49-cf0e-4ab7-83db-73eefdce3144 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:57.103667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:57.104234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:57.108527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:57.109042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] PATH_INFO: `/v3/projects/bc25d2fa7e254c3ba428663aa44b5868` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:57.110576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc25d2fa7e254c3ba428663aa44b5868)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:57.115480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:57.219204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc25d2fa7e254c3ba428663aa44b5868', 'request_id': 'req-f6220ef7-2684-4251-a609-8bb8f984111e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:57.230960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc25d2fa7e254c3ba428663aa44b5868', 'request_id': 'req-f6220ef7-2684-4251-a609-8bb8f984111e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:57.244926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc25d2fa7e254c3ba428663aa44b5868', 'request_id': 'req-f6220ef7-2684-4251-a609-8bb8f984111e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:57.251827 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:57.289256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] The token cache is being invalidate because project bc25d2fa7e254c3ba428663aa44b5868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:57.289427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:57.299006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:57.308513 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3277/6611] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:56 2022] DELETE /identity/v3/projects/bc25d2fa7e254c3ba428663aa44b5868 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:57.310201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a0561-85fc-4e61-93ba-4b2b99712f1d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:57.310515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a0561-85fc-4e61-93ba-4b2b99712f1d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:57.310775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a0561-85fc-4e61-93ba-4b2b99712f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:57.359926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2d2a0561-85fc-4e61-93ba-4b2b99712f1d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:57.363886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2d2a0561-85fc-4e61-93ba-4b2b99712f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:57.402102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:57.405227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:57.488897 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:57.567622 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3335/6612] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:32:57.573957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb80de0-9928-4ad3-a2f8-8a71164e58b1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:57.574485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb80de0-9928-4ad3-a2f8-8a71164e58b1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:57.575026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb80de0-9928-4ad3-a2f8-8a71164e58b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:57.598488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6220ef7-2684-4251-a609-8bb8f984111e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:57.600707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2cb80de0-9928-4ad3-a2f8-8a71164e58b1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:57.602007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2cb80de0-9928-4ad3-a2f8-8a71164e58b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:57.615161 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3336/6613] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:57.616709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb80de0-9928-4ad3-a2f8-8a71164e58b1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:57.617926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:57.619861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:57.624724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:57.625067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] PATH_INFO: `/v3/users/67f081e16d8e40c1bc5be6627ec7b50e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:57.628000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f081e16d8e40c1bc5be6627ec7b50e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:57.629750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb80de0-9928-4ad3-a2f8-8a71164e58b1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:57.653334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:57.660782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51613fa2-97d2-4264-9898-717a2d521a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:57.661887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613fa2-97d2-4264-9898-717a2d521a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:57.668408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613fa2-97d2-4264-9898-717a2d521a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:57.671613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613fa2-97d2-4264-9898-717a2d521a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:57.676457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51613fa2-97d2-4264-9898-717a2d521a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:32:57.676857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51613fa2-97d2-4264-9898-717a2d521a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:57.686724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51613fa2-97d2-4264-9898-717a2d521a9a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:57.757265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f081e16d8e40c1bc5be6627ec7b50e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:57.760062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f081e16d8e40c1bc5be6627ec7b50e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:57.784990 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3337/6614] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:32:57.786006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51613fa2-97d2-4264-9898-717a2d521a9a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:57.788320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-51613fa2-97d2-4264-9898-717a2d521a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:57.803647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f081e16d8e40c1bc5be6627ec7b50e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:57.824467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f081e16d8e40c1bc5be6627ec7b50e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:57.825354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f081e16d8e40c1bc5be6627ec7b50e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:57.852335 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3278/6615] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:57 2022] DELETE /identity/v3/users/67f081e16d8e40c1bc5be6627ec7b50e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:32:57.853424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:57.861317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:57.875610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51613fa2-97d2-4264-9898-717a2d521a9a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:58.000590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140aa8a5-7d2e-4f19-b4d0-d23861c48353 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:58.012406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228d7fb-e266-4cd5-9a6d-3dfb5dea26a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:58.013040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228d7fb-e266-4cd5-9a6d-3dfb5dea26a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:58.013322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228d7fb-e266-4cd5-9a6d-3dfb5dea26a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:58.013592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228d7fb-e266-4cd5-9a6d-3dfb5dea26a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:58.014424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228d7fb-e266-4cd5-9a6d-3dfb5dea26a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:58.016524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228d7fb-e266-4cd5-9a6d-3dfb5dea26a4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:58.041266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84010d47-2708-4256-9610-4f868135e267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:58.041807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84010d47-2708-4256-9610-4f868135e267 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:58.042092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84010d47-2708-4256-9610-4f868135e267 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:58.042349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84010d47-2708-4256-9610-4f868135e267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:58.044272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-84010d47-2708-4256-9610-4f868135e267 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:58.056485 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:58.069789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84010d47-2708-4256-9610-4f868135e267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:58.079901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84010d47-2708-4256-9610-4f868135e267 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:58.084831 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3279/6616] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:32:57 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:58.086525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15aa96c-3d10-4ccc-8574-32c561018d7a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:58.087347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15aa96c-3d10-4ccc-8574-32c561018d7a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:58.087954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15aa96c-3d10-4ccc-8574-32c561018d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:58.112052 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3338/6617] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:58.118188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84010d47-2708-4256-9610-4f868135e267 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:58.132776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d15aa96c-3d10-4ccc-8574-32c561018d7a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:58.134244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d15aa96c-3d10-4ccc-8574-32c561018d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:58.152839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84010d47-2708-4256-9610-4f868135e267 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:58.265695 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3280/6618] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:58.351898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d505bb-0298-47ee-963c-cb866076d420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:58.352525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d505bb-0298-47ee-963c-cb866076d420 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:58.352802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d505bb-0298-47ee-963c-cb866076d420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:58.353074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d505bb-0298-47ee-963c-cb866076d420 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:58.353708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d505bb-0298-47ee-963c-cb866076d420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:58.355665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d505bb-0298-47ee-963c-cb866076d420 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:58.380202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15aa96c-3d10-4ccc-8574-32c561018d7a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:58.381955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d15aa96c-3d10-4ccc-8574-32c561018d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:58.428037 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3339/6619] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:32:58 2022] POST /identity/v3/users => generated 287 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:32:58.432062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d505bb-0298-47ee-963c-cb866076d420 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:58.463431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d505bb-0298-47ee-963c-cb866076d420 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:58.499998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043b1af-4b1f-4858-8460-61d855afa1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:58.501476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043b1af-4b1f-4858-8460-61d855afa1ab admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:58.509483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043b1af-4b1f-4858-8460-61d855afa1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:58.510017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043b1af-4b1f-4858-8460-61d855afa1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:58.511006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043b1af-4b1f-4858-8460-61d855afa1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:58.514346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043b1af-4b1f-4858-8460-61d855afa1ab admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:58.542037 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:58.565430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15aa96c-3d10-4ccc-8574-32c561018d7a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:58.566337 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3340/6620] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:58.567466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043b1af-4b1f-4858-8460-61d855afa1ab admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:58.580874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cc231-9c95-4e26-8426-a4d1685a8423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:58.581511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cc231-9c95-4e26-8426-a4d1685a8423 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:58.581795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cc231-9c95-4e26-8426-a4d1685a8423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:58.582067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cc231-9c95-4e26-8426-a4d1685a8423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:58.596342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043b1af-4b1f-4858-8460-61d855afa1ab admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:58.598841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20cc231-9c95-4e26-8426-a4d1685a8423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:58.600817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20cc231-9c95-4e26-8426-a4d1685a8423 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:58.607457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fec29-17f6-4d02-9d58-ad68f4ef9801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:58.608078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fec29-17f6-4d02-9d58-ad68f4ef9801 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:58.608360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fec29-17f6-4d02-9d58-ad68f4ef9801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:58.608646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fec29-17f6-4d02-9d58-ad68f4ef9801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:58.609274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fec29-17f6-4d02-9d58-ad68f4ef9801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:58.611040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fec29-17f6-4d02-9d58-ad68f4ef9801 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:58.617195 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3281/6621] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:58.636912 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3341/6622] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:32:58.641543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cc231-9c95-4e26-8426-a4d1685a8423 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:58.671697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cc231-9c95-4e26-8426-a4d1685a8423 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:58.685019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b651a30-0b78-4ab2-9082-d93632761ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:58.687876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b651a30-0b78-4ab2-9082-d93632761ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:58.688202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b651a30-0b78-4ab2-9082-d93632761ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:58.689471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b651a30-0b78-4ab2-9082-d93632761ffe admin admin] PATH_INFO: `/v3/projects/297a0eb860444023b67aa53333a88a9a/users/6dfd2de312f74480b4026fb1eff0a4b3/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:58.750150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b651a30-0b78-4ab2-9082-d93632761ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=297a0eb860444023b67aa53333a88a9a, user_id=6dfd2de312f74480b4026fb1eff0a4b3, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:58.753889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b651a30-0b78-4ab2-9082-d93632761ffe admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:58.778978 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3282/6623] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:32:58 2022] PUT /identity/v3/projects/297a0eb860444023b67aa53333a88a9a/users/6dfd2de312f74480b4026fb1eff0a4b3/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:58.781743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87352c-afb7-4c5c-b1b5-4cce9cba1cfc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:58.782223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87352c-afb7-4c5c-b1b5-4cce9cba1cfc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:58.782387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87352c-afb7-4c5c-b1b5-4cce9cba1cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:58.816532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9a87352c-afb7-4c5c-b1b5-4cce9cba1cfc None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:32:58.818007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9a87352c-afb7-4c5c-b1b5-4cce9cba1cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:58.947816 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3342/6624] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:32:58.962637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b651a30-0b78-4ab2-9082-d93632761ffe admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:59.118985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b651a30-0b78-4ab2-9082-d93632761ffe admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:59.133950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cf690-623a-4bce-8385-d66bbd5bf351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:59.134663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cf690-623a-4bce-8385-d66bbd5bf351 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:59.134951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cf690-623a-4bce-8385-d66bbd5bf351 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:59.135369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cf690-623a-4bce-8385-d66bbd5bf351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:59.155278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cf690-623a-4bce-8385-d66bbd5bf351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:59.156884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cf690-623a-4bce-8385-d66bbd5bf351 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:59.179265 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3283/6625] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:32:59.412688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87352c-afb7-4c5c-b1b5-4cce9cba1cfc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:59.414475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9a87352c-afb7-4c5c-b1b5-4cce9cba1cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:32:59.434505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87352c-afb7-4c5c-b1b5-4cce9cba1cfc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:59.467812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:59.469565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:59.470310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:59.471560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] PATH_INFO: `/v3/projects/d6c09bc9c59749e79d671c64450a5275` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:59.473895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c09bc9c59749e79d671c64450a5275)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:59.477067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:32:59.632652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c09bc9c59749e79d671c64450a5275', 'request_id': 'req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:59.655707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c09bc9c59749e79d671c64450a5275', 'request_id': 'req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:59.678445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c09bc9c59749e79d671c64450a5275', 'request_id': 'req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:59.737467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] The token cache is being invalidate because project d6c09bc9c59749e79d671c64450a5275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:32:59.737982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:59.740435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:32:59.745613 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3343/6626] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:32:59 2022] DELETE /identity/v3/projects/d6c09bc9c59749e79d671c64450a5275 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:32:59.751048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cf690-623a-4bce-8385-d66bbd5bf351 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:32:59.770751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cf690-623a-4bce-8385-d66bbd5bf351 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:32:59.813106 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:59.948440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc4437-cfd5-48de-aa7d-8ca9edf9de5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:32:59.949097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4437-cfd5-48de-aa7d-8ca9edf9de5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:32:59.949374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4437-cfd5-48de-aa7d-8ca9edf9de5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:32:59.949644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4437-cfd5-48de-aa7d-8ca9edf9de5f admin admin] PATH_INFO: `/v3/users/55bc040f98924179a35c52d567864e3f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:32:59.952545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc4437-cfd5-48de-aa7d-8ca9edf9de5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=55bc040f98924179a35c52d567864e3f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:32:59.958240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc4437-cfd5-48de-aa7d-8ca9edf9de5f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:00.060934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-13fc4437-cfd5-48de-aa7d-8ca9edf9de5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55bc040f98924179a35c52d567864e3f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:00.061637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-13fc4437-cfd5-48de-aa7d-8ca9edf9de5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55bc040f98924179a35c52d567864e3f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:00.086845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-13fc4437-cfd5-48de-aa7d-8ca9edf9de5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55bc040f98924179a35c52d567864e3f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:00.104419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-13fc4437-cfd5-48de-aa7d-8ca9edf9de5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55bc040f98924179a35c52d567864e3f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:00.105226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-13fc4437-cfd5-48de-aa7d-8ca9edf9de5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55bc040f98924179a35c52d567864e3f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:00.140701 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3284/6627] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:32:59 2022] DELETE /identity/v3/users/55bc040f98924179a35c52d567864e3f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:01.410057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:01.414624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:01.435600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8e2d4-2fd8-4ff9-9222-0a31f04e1183 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:01.548865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f7e3e-c825-4a89-9836-135eb2df765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:01.549823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f7e3e-c825-4a89-9836-135eb2df765f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:01.550204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f7e3e-c825-4a89-9836-135eb2df765f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:01.551245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f7e3e-c825-4a89-9836-135eb2df765f admin admin] PATH_INFO: `/v3/projects/1821261fcd434e00a55f77a67466df94` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:01.557622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f7e3e-c825-4a89-9836-135eb2df765f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1821261fcd434e00a55f77a67466df94)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:01.561068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f7e3e-c825-4a89-9836-135eb2df765f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:01.622167 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:01.665381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb2f7e3e-c825-4a89-9836-135eb2df765f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1821261fcd434e00a55f77a67466df94', 'request_id': 'req-bb2f7e3e-c825-4a89-9836-135eb2df765f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:01.675764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb2f7e3e-c825-4a89-9836-135eb2df765f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1821261fcd434e00a55f77a67466df94', 'request_id': 'req-bb2f7e3e-c825-4a89-9836-135eb2df765f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:01.708181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb2f7e3e-c825-4a89-9836-135eb2df765f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1821261fcd434e00a55f77a67466df94', 'request_id': 'req-bb2f7e3e-c825-4a89-9836-135eb2df765f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:01.711273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74e76-95b4-4f1b-a9fe-7edacc49ac28 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:01.711734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74e76-95b4-4f1b-a9fe-7edacc49ac28 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:01.712015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74e76-95b4-4f1b-a9fe-7edacc49ac28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:01.729763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb2f7e3e-c825-4a89-9836-135eb2df765f admin admin] The token cache is being invalidate because project 1821261fcd434e00a55f77a67466df94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:01.730072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb2f7e3e-c825-4a89-9836-135eb2df765f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:01.734961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bb2f7e3e-c825-4a89-9836-135eb2df765f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:01.744169 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3344/6628] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:01 2022] DELETE /identity/v3/projects/1821261fcd434e00a55f77a67466df94 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:01.746088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c551b3-02a9-4452-9d74-88ad88c0f213 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:01.746943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c551b3-02a9-4452-9d74-88ad88c0f213 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:01.747228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c551b3-02a9-4452-9d74-88ad88c0f213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:01.778278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cfd74e76-95b4-4f1b-a9fe-7edacc49ac28 None None] MFA Rules not processed for user `6dfd2de312f74480b4026fb1eff0a4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:01.783919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cfd74e76-95b4-4f1b-a9fe-7edacc49ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:01.828437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c2c551b3-02a9-4452-9d74-88ad88c0f213 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:01.830696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c2c551b3-02a9-4452-9d74-88ad88c0f213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:02.010366 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3345/6629] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:02.017149 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3285/6630] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:02.021488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736cf25-bc0d-4cfa-ad9b-6b6930a03ce7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:02.021954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736cf25-bc0d-4cfa-ad9b-6b6930a03ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:02.024220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736cf25-bc0d-4cfa-ad9b-6b6930a03ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:02.027464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd74e76-95b4-4f1b-a9fe-7edacc49ac28 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:02.029372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cfd74e76-95b4-4f1b-a9fe-7edacc49ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:02.061213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b736cf25-bc0d-4cfa-ad9b-6b6930a03ce7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:02.062654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b736cf25-bc0d-4cfa-ad9b-6b6930a03ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:02.096328 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3346/6631] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:02.097291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736cf25-bc0d-4cfa-ad9b-6b6930a03ce7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:02.105141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b736cf25-bc0d-4cfa-ad9b-6b6930a03ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:02.107470 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:02.137260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736cf25-bc0d-4cfa-ad9b-6b6930a03ce7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:02.148651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d998d-a5ad-4ba9-bde5-070e2b876db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:02.149302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d998d-a5ad-4ba9-bde5-070e2b876db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:02.151069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d998d-a5ad-4ba9-bde5-070e2b876db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:02.151351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d998d-a5ad-4ba9-bde5-070e2b876db2 admin admin] PATH_INFO: `/v3/users/21d3fc8f95c74b2e8c06da9593d54b3f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:02.153660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d998d-a5ad-4ba9-bde5-070e2b876db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d3fc8f95c74b2e8c06da9593d54b3f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:02.156443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d998d-a5ad-4ba9-bde5-070e2b876db2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:02.176608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd74e76-95b4-4f1b-a9fe-7edacc49ac28 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:02.185600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a38636-02b4-486d-9ab5-0cb28b4fb8b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:02.188002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38636-02b4-486d-9ab5-0cb28b4fb8b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:02.188306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38636-02b4-486d-9ab5-0cb28b4fb8b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:02.188762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38636-02b4-486d-9ab5-0cb28b4fb8b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:02.202601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a38636-02b4-486d-9ab5-0cb28b4fb8b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:02.204560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a38636-02b4-486d-9ab5-0cb28b4fb8b0 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:02.215683 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3286/6632] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:33:02.216554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a38636-02b4-486d-9ab5-0cb28b4fb8b0 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:02.229558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a38636-02b4-486d-9ab5-0cb28b4fb8b0 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:02.234488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55775cd-a729-42e2-b6b3-831b8388c232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:02.235137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55775cd-a729-42e2-b6b3-831b8388c232 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:02.240067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55775cd-a729-42e2-b6b3-831b8388c232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:02.240343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55775cd-a729-42e2-b6b3-831b8388c232 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:02.241019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55775cd-a729-42e2-b6b3-831b8388c232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:02.241343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55775cd-a729-42e2-b6b3-831b8388c232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:02.242993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55775cd-a729-42e2-b6b3-831b8388c232 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:02.270433 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3287/6633] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:02.271179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55775cd-a729-42e2-b6b3-831b8388c232 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:02.290852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55775cd-a729-42e2-b6b3-831b8388c232 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:02.298891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9212090-1ddd-4d39-a1f5-d318dace8f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:02.299579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9212090-1ddd-4d39-a1f5-d318dace8f46 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:02.299775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9212090-1ddd-4d39-a1f5-d318dace8f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:02.300011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9212090-1ddd-4d39-a1f5-d318dace8f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:02.300932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9212090-1ddd-4d39-a1f5-d318dace8f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:02.305152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-db6d998d-a5ad-4ba9-bde5-070e2b876db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d3fc8f95c74b2e8c06da9593d54b3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:02.305868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-db6d998d-a5ad-4ba9-bde5-070e2b876db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d3fc8f95c74b2e8c06da9593d54b3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:02.306807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9212090-1ddd-4d39-a1f5-d318dace8f46 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:02.335655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-db6d998d-a5ad-4ba9-bde5-070e2b876db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d3fc8f95c74b2e8c06da9593d54b3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:02.350593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-db6d998d-a5ad-4ba9-bde5-070e2b876db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d3fc8f95c74b2e8c06da9593d54b3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:02.351774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-db6d998d-a5ad-4ba9-bde5-070e2b876db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d3fc8f95c74b2e8c06da9593d54b3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:02.379986 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3347/6634] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:02 2022] DELETE /identity/v3/users/21d3fc8f95c74b2e8c06da9593d54b3f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:02.381459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d027c0-9b40-480f-828d-9a9144704e1e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:02.381760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d027c0-9b40-480f-828d-9a9144704e1e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:02.382030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d027c0-9b40-480f-828d-9a9144704e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:02.400981 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3288/6635] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:02 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:02.406388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9212090-1ddd-4d39-a1f5-d318dace8f46 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:02.413173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d9212090-1ddd-4d39-a1f5-d318dace8f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:02.441673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b9d027c0-9b40-480f-828d-9a9144704e1e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:02.445466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b9d027c0-9b40-480f-828d-9a9144704e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:02.457223 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:02.605174 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3348/6636] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:02.612983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9212090-1ddd-4d39-a1f5-d318dace8f46 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:02.618106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d027c0-9b40-480f-828d-9a9144704e1e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:02.619485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b9d027c0-9b40-480f-828d-9a9144704e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:02.637593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452e78c-b330-497d-a2db-149d03461515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:02.642080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452e78c-b330-497d-a2db-149d03461515 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:02.644507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452e78c-b330-497d-a2db-149d03461515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:02.645101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452e78c-b330-497d-a2db-149d03461515 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:02.649263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452e78c-b330-497d-a2db-149d03461515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:02.651389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452e78c-b330-497d-a2db-149d03461515 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:02.727575 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3289/6637] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:02 2022] POST /identity/v3/users => generated 283 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:02.731742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452e78c-b330-497d-a2db-149d03461515 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:02.746302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d027c0-9b40-480f-828d-9a9144704e1e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:02.752732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb395572-1c21-4aba-9bcf-103e0fdcf8b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:02.753585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb395572-1c21-4aba-9bcf-103e0fdcf8b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:02.753968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb395572-1c21-4aba-9bcf-103e0fdcf8b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:02.754362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb395572-1c21-4aba-9bcf-103e0fdcf8b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:02.754699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452e78c-b330-497d-a2db-149d03461515 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:02.768360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb395572-1c21-4aba-9bcf-103e0fdcf8b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:02.770158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb395572-1c21-4aba-9bcf-103e0fdcf8b6 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:02.772623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dc2e2-0b16-411e-81e1-47474a692ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:02.773241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dc2e2-0b16-411e-81e1-47474a692ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:02.773527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dc2e2-0b16-411e-81e1-47474a692ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:02.773801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dc2e2-0b16-411e-81e1-47474a692ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:02.774448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dc2e2-0b16-411e-81e1-47474a692ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:02.776113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dc2e2-0b16-411e-81e1-47474a692ec0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:02.784493 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3349/6638] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:02.804155 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3290/6639] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:02.804961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb395572-1c21-4aba-9bcf-103e0fdcf8b6 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:02.818259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb395572-1c21-4aba-9bcf-103e0fdcf8b6 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:02.822993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79c7d8-e59f-4cd6-a2df-732ddf861b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:02.823718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79c7d8-e59f-4cd6-a2df-732ddf861b6d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:02.824100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79c7d8-e59f-4cd6-a2df-732ddf861b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:02.824779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79c7d8-e59f-4cd6-a2df-732ddf861b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:02.825652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79c7d8-e59f-4cd6-a2df-732ddf861b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:02.827531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79c7d8-e59f-4cd6-a2df-732ddf861b6d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:02.842993 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3350/6640] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:02.843726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dc2e2-0b16-411e-81e1-47474a692ec0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:02.857889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dc2e2-0b16-411e-81e1-47474a692ec0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:02.864150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be6ca4-826d-4b42-9d69-e590a58ff4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:02.865276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be6ca4-826d-4b42-9d69-e590a58ff4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:02.865725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be6ca4-826d-4b42-9d69-e590a58ff4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:02.866165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be6ca4-826d-4b42-9d69-e590a58ff4ec admin admin] PATH_INFO: `/v3/projects/945428a8639944d6aa42707e4b9c28ef/users/05019954ceec42be9e4f5822b25e18ad/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:02.890728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be6ca4-826d-4b42-9d69-e590a58ff4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=945428a8639944d6aa42707e4b9c28ef, user_id=05019954ceec42be9e4f5822b25e18ad, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:02.904714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be6ca4-826d-4b42-9d69-e590a58ff4ec admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:02.941703 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3291/6641] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:02 2022] PUT /identity/v3/projects/945428a8639944d6aa42707e4b9c28ef/users/05019954ceec42be9e4f5822b25e18ad/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:02.941849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aa2ef-846f-43ef-8c76-21f0926a45c8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:02.942127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aa2ef-846f-43ef-8c76-21f0926a45c8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:02.942400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aa2ef-846f-43ef-8c76-21f0926a45c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:03.017670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8b2aa2ef-846f-43ef-8c76-21f0926a45c8 None None] MFA Rules not processed for user `05019954ceec42be9e4f5822b25e18ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:03.023654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8b2aa2ef-846f-43ef-8c76-21f0926a45c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:03.219871 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3351/6642] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:03.222849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be6ca4-826d-4b42-9d69-e590a58ff4ec admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:03.385295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aa2ef-846f-43ef-8c76-21f0926a45c8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:03.387152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8b2aa2ef-846f-43ef-8c76-21f0926a45c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:03.474536 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:03.529941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aa2ef-846f-43ef-8c76-21f0926a45c8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:03.545502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:03.546206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:03.546490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:03.546759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f admin admin] PATH_INFO: `/v3/projects/128065c9046f49b0a4c3f8bbdfdaaba2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:03.550050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f admin admin] RBAC: Authorizing `identity:delete_project(project_id=128065c9046f49b0a4c3f8bbdfdaaba2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:03.557036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:03.602545 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:03.622083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be6ca4-826d-4b42-9d69-e590a58ff4ec admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:03.629978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560e36f-95e5-4d41-8e80-1c78bead1869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:03.631920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560e36f-95e5-4d41-8e80-1c78bead1869 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:03.633100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560e36f-95e5-4d41-8e80-1c78bead1869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:03.633385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560e36f-95e5-4d41-8e80-1c78bead1869 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:03.634075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560e36f-95e5-4d41-8e80-1c78bead1869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:03.638001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560e36f-95e5-4d41-8e80-1c78bead1869 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:03.667320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128065c9046f49b0a4c3f8bbdfdaaba2', 'request_id': 'req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:03.687337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128065c9046f49b0a4c3f8bbdfdaaba2', 'request_id': 'req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:03.693490 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3292/6643] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:03 2022] POST /identity/v3/projects => generated 365 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:03.698822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560e36f-95e5-4d41-8e80-1c78bead1869 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:03.707860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128065c9046f49b0a4c3f8bbdfdaaba2', 'request_id': 'req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:03.737029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f admin admin] The token cache is being invalidate because project 128065c9046f49b0a4c3f8bbdfdaaba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:03.741399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:03.743408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36a7986b-3045-4d06-b8ba-0d9ea2fa397f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:03.748427 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3352/6644] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:03 2022] DELETE /identity/v3/projects/128065c9046f49b0a4c3f8bbdfdaaba2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:03.755230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3329e8-4a97-46cf-a8e0-e07d12420ea3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:03.757063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3329e8-4a97-46cf-a8e0-e07d12420ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:03.758810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3329e8-4a97-46cf-a8e0-e07d12420ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:03.789017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5a3329e8-4a97-46cf-a8e0-e07d12420ea3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:03.791102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5a3329e8-4a97-46cf-a8e0-e07d12420ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:03.855851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560e36f-95e5-4d41-8e80-1c78bead1869 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:03.863200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eabe9b-b713-49e4-98bd-9d3cfddb1483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:03.863827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eabe9b-b713-49e4-98bd-9d3cfddb1483 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:03.864103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eabe9b-b713-49e4-98bd-9d3cfddb1483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:03.864371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eabe9b-b713-49e4-98bd-9d3cfddb1483 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:03.865372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eabe9b-b713-49e4-98bd-9d3cfddb1483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:03.871341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eabe9b-b713-49e4-98bd-9d3cfddb1483 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:03.928184 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3293/6645] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:03 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:03.931982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eabe9b-b713-49e4-98bd-9d3cfddb1483 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:03.939245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c4eabe9b-b713-49e4-98bd-9d3cfddb1483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:03.967908 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3353/6646] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:03.970473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eabe9b-b713-49e4-98bd-9d3cfddb1483 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:03.976653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ade05-289c-47d9-aaf3-0864a567d6d6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:03.977121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ade05-289c-47d9-aaf3-0864a567d6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:03.977491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ade05-289c-47d9-aaf3-0864a567d6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:03.986301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5fdab-23c7-42e3-a0d7-4bca5caa84c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:03.987257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5fdab-23c7-42e3-a0d7-4bca5caa84c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:03.987697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5fdab-23c7-42e3-a0d7-4bca5caa84c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:03.988059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5fdab-23c7-42e3-a0d7-4bca5caa84c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:03.988977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5fdab-23c7-42e3-a0d7-4bca5caa84c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:03.991056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5fdab-23c7-42e3-a0d7-4bca5caa84c7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:04.004539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7a7ade05-289c-47d9-aaf3-0864a567d6d6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:04.010302 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3294/6647] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:04.010904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7a7ade05-289c-47d9-aaf3-0864a567d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:04.011506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5fdab-23c7-42e3-a0d7-4bca5caa84c7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:04.024846 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3354/6648] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:04.029142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ade05-289c-47d9-aaf3-0864a567d6d6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:04.032829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5fdab-23c7-42e3-a0d7-4bca5caa84c7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:04.038376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198d39-923b-4f00-b34d-88ecfa2d0cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:04.039295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198d39-923b-4f00-b34d-88ecfa2d0cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:04.039671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198d39-923b-4f00-b34d-88ecfa2d0cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:04.040036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198d39-923b-4f00-b34d-88ecfa2d0cd8 admin admin] PATH_INFO: `/v3/projects/85137a5e354e4a4283e73e573bd03211/users/b906bbcbacaa4eb8b121adb2bff8628c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:04.052881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ade05-289c-47d9-aaf3-0864a567d6d6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:04.062334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ad9d1-f14d-4a2d-985b-f9c0f66a0d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:04.063682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad9d1-f14d-4a2d-985b-f9c0f66a0d7e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:04.064750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad9d1-f14d-4a2d-985b-f9c0f66a0d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:04.065622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad9d1-f14d-4a2d-985b-f9c0f66a0d7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:04.066476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ad9d1-f14d-4a2d-985b-f9c0f66a0d7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:04.067151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ad9d1-f14d-4a2d-985b-f9c0f66a0d7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:04.070949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f198d39-923b-4f00-b34d-88ecfa2d0cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85137a5e354e4a4283e73e573bd03211, user_id=b906bbcbacaa4eb8b121adb2bff8628c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:04.073273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f198d39-923b-4f00-b34d-88ecfa2d0cd8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:04.073519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ad9d1-f14d-4a2d-985b-f9c0f66a0d7e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:04.090963 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3355/6649] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:04.094267 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3295/6650] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:04 2022] PUT /identity/v3/projects/85137a5e354e4a4283e73e573bd03211/users/b906bbcbacaa4eb8b121adb2bff8628c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:04.096208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ad9d1-f14d-4a2d-985b-f9c0f66a0d7e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:04.097265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198d39-923b-4f00-b34d-88ecfa2d0cd8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:04.111628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ad9d1-f14d-4a2d-985b-f9c0f66a0d7e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:04.194798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198d39-923b-4f00-b34d-88ecfa2d0cd8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:04.203017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821403a7-d045-4846-943a-817b9f0ade00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:04.205106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821403a7-d045-4846-943a-817b9f0ade00 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:04.205266 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:04.205750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821403a7-d045-4846-943a-817b9f0ade00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:04.206115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821403a7-d045-4846-943a-817b9f0ade00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:04.207731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821403a7-d045-4846-943a-817b9f0ade00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:04.210298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821403a7-d045-4846-943a-817b9f0ade00 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:04.232589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef35f00-9b38-4769-beb9-799333a4dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:04.233221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef35f00-9b38-4769-beb9-799333a4dff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:04.233498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef35f00-9b38-4769-beb9-799333a4dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:04.233832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef35f00-9b38-4769-beb9-799333a4dff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:04.234489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef35f00-9b38-4769-beb9-799333a4dff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:04.236602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef35f00-9b38-4769-beb9-799333a4dff1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:04.254690 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3296/6651] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:04.258319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821403a7-d045-4846-943a-817b9f0ade00 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:04.285352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821403a7-d045-4846-943a-817b9f0ade00 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:04.291274 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3356/6652] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:04 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:04.295306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef35f00-9b38-4769-beb9-799333a4dff1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:04.301997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7f205-6ad0-4cd1-8a4e-d56927f3ddb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:04.303064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7f205-6ad0-4cd1-8a4e-d56927f3ddb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:04.303561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7f205-6ad0-4cd1-8a4e-d56927f3ddb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:04.303897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7f205-6ad0-4cd1-8a4e-d56927f3ddb3 admin admin] PATH_INFO: `/v3/projects/85137a5e354e4a4283e73e573bd03211/users/b906bbcbacaa4eb8b121adb2bff8628c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:04.307538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7f205-6ad0-4cd1-8a4e-d56927f3ddb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85137a5e354e4a4283e73e573bd03211, user_id=b906bbcbacaa4eb8b121adb2bff8628c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:04.314193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7f205-6ad0-4cd1-8a4e-d56927f3ddb3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:04.349158 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3297/6653] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:04 2022] PUT /identity/v3/projects/85137a5e354e4a4283e73e573bd03211/users/b906bbcbacaa4eb8b121adb2bff8628c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:04.361792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f3188-38ea-4744-b074-54049434bcab None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:04.361995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f3188-38ea-4744-b074-54049434bcab None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:04.362240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f3188-38ea-4744-b074-54049434bcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:04.427143 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:04.457144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5e6f3188-38ea-4744-b074-54049434bcab None None] MFA Rules not processed for user `b906bbcbacaa4eb8b121adb2bff8628c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:04.458515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef35f00-9b38-4769-beb9-799333a4dff1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:04.463217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5e6f3188-38ea-4744-b074-54049434bcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:04.651045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab63c3-94b8-4551-9da6-43174fdb92f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:04.651045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab63c3-94b8-4551-9da6-43174fdb92f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:04.651045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab63c3-94b8-4551-9da6-43174fdb92f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:04.651045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab63c3-94b8-4551-9da6-43174fdb92f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:04.651877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab63c3-94b8-4551-9da6-43174fdb92f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:04.651877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab63c3-94b8-4551-9da6-43174fdb92f1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:04.680533 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3298/6654] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:04.693776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f3188-38ea-4744-b074-54049434bcab None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:04.695540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5e6f3188-38ea-4744-b074-54049434bcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:04.724126 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3357/6655] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:04 2022] POST /identity/v3/users => generated 292 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:04.728925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab63c3-94b8-4551-9da6-43174fdb92f1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:04.754075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab63c3-94b8-4551-9da6-43174fdb92f1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:04.767916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a87e0f-1c70-4a1b-88ac-4fd4d0a0c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:04.768641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a87e0f-1c70-4a1b-88ac-4fd4d0a0c924 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:04.769778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a87e0f-1c70-4a1b-88ac-4fd4d0a0c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:04.769778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a87e0f-1c70-4a1b-88ac-4fd4d0a0c924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:04.771578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a87e0f-1c70-4a1b-88ac-4fd4d0a0c924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:04.777725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a87e0f-1c70-4a1b-88ac-4fd4d0a0c924 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:04.816225 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3358/6656] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:04.817202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a87e0f-1c70-4a1b-88ac-4fd4d0a0c924 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:04.840229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a87e0f-1c70-4a1b-88ac-4fd4d0a0c924 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:04.846228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f3188-38ea-4744-b074-54049434bcab None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:04.852111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b0644-9b04-450e-9d16-f224a67dba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:04.852738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b0644-9b04-450e-9d16-f224a67dba63 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:04.853018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b0644-9b04-450e-9d16-f224a67dba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:04.853291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b0644-9b04-450e-9d16-f224a67dba63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:04.853934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b0644-9b04-450e-9d16-f224a67dba63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:04.855619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a86e9-6b5b-45b0-845c-54dcf69b3eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:04.856310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a86e9-6b5b-45b0-845c-54dcf69b3eaf service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:04.857251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a86e9-6b5b-45b0-845c-54dcf69b3eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:04.857908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a86e9-6b5b-45b0-845c-54dcf69b3eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:04.862581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b0644-9b04-450e-9d16-f224a67dba63 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:04.875419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a86e9-6b5b-45b0-845c-54dcf69b3eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:04.877709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a86e9-6b5b-45b0-845c-54dcf69b3eaf service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:04.895958 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3359/6657] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:04.900920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b0644-9b04-450e-9d16-f224a67dba63 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:04.903297 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3299/6658] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:04.926285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b0644-9b04-450e-9d16-f224a67dba63 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:04.952491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10993cb4-36b9-4b3e-96a5-926eec7d385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:04.953580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993cb4-36b9-4b3e-96a5-926eec7d385a admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:04.954784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993cb4-36b9-4b3e-96a5-926eec7d385a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:04.955442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993cb4-36b9-4b3e-96a5-926eec7d385a admin admin] PATH_INFO: `/v3/projects/be6fcb7172de490a8c807e0603172a5c/users/93a49f128e134ac49523678a18ed2205/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:04.993659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10993cb4-36b9-4b3e-96a5-926eec7d385a admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6fcb7172de490a8c807e0603172a5c, user_id=93a49f128e134ac49523678a18ed2205, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:04.997651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10993cb4-36b9-4b3e-96a5-926eec7d385a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:05.026638 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3360/6659] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:04 2022] PUT /identity/v3/projects/be6fcb7172de490a8c807e0603172a5c/users/93a49f128e134ac49523678a18ed2205/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:05.037076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68da6bd-9ae4-4284-a619-08cf0839118f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:05.037553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68da6bd-9ae4-4284-a619-08cf0839118f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:05.037779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68da6bd-9ae4-4284-a619-08cf0839118f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:05.062113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e694-a53a-43b0-aadb-a7a2a16c4ebe None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:05.062390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e694-a53a-43b0-aadb-a7a2a16c4ebe None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:05.062703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e694-a53a-43b0-aadb-a7a2a16c4ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:05.077585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a68da6bd-9ae4-4284-a619-08cf0839118f None None] MFA Rules not processed for user `93a49f128e134ac49523678a18ed2205`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:05.084451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a68da6bd-9ae4-4284-a619-08cf0839118f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:05.090079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9a35e694-a53a-43b0-aadb-a7a2a16c4ebe None None] MFA Rules not processed for user `6dfd2de312f74480b4026fb1eff0a4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:05.091329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9a35e694-a53a-43b0-aadb-a7a2a16c4ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:05.111736 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:05.184138 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3300/6660] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:05.185661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68da6bd-9ae4-4284-a619-08cf0839118f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:05.187057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a68da6bd-9ae4-4284-a619-08cf0839118f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:05.204981 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3361/6661] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:05.212788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35e694-a53a-43b0-aadb-a7a2a16c4ebe None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:05.221188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9a35e694-a53a-43b0-aadb-a7a2a16c4ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:05.225809 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:05.258278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68da6bd-9ae4-4284-a619-08cf0839118f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:05.265666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a4951-237d-4fdf-b54e-4a71cda9a954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:05.266463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a4951-237d-4fdf-b54e-4a71cda9a954 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:05.266813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a4951-237d-4fdf-b54e-4a71cda9a954 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:05.267511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a4951-237d-4fdf-b54e-4a71cda9a954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:05.269772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4d3a4951-237d-4fdf-b54e-4a71cda9a954 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:05.365768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35e694-a53a-43b0-aadb-a7a2a16c4ebe None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:05.374525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e1c9a-9328-4ff9-82e8-3126a0c90c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:05.378404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e1c9a-9328-4ff9-82e8-3126a0c90c56 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:05.378686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e1c9a-9328-4ff9-82e8-3126a0c90c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:05.378995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e1c9a-9328-4ff9-82e8-3126a0c90c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:05.398844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e1c9a-9328-4ff9-82e8-3126a0c90c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:05.400996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e1c9a-9328-4ff9-82e8-3126a0c90c56 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:05.418689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a4951-237d-4fdf-b54e-4a71cda9a954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:05.420194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a4951-237d-4fdf-b54e-4a71cda9a954 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:05.424879 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3362/6662] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:05.433930 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3301/6663] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:06.008851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e1c9a-9328-4ff9-82e8-3126a0c90c56 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:06.023430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e1c9a-9328-4ff9-82e8-3126a0c90c56 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:06.029392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57067810-ed5c-48bd-bf26-a6a3498684d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:06.030548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067810-ed5c-48bd-bf26-a6a3498684d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:06.030845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067810-ed5c-48bd-bf26-a6a3498684d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:06.038629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067810-ed5c-48bd-bf26-a6a3498684d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:06.044340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-57067810-ed5c-48bd-bf26-a6a3498684d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:06.071860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57067810-ed5c-48bd-bf26-a6a3498684d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:06.073769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57067810-ed5c-48bd-bf26-a6a3498684d2 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:06.099659 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3363/6664] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:08.528814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a4951-237d-4fdf-b54e-4a71cda9a954 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:08.530295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4d3a4951-237d-4fdf-b54e-4a71cda9a954 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:08.714458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a4951-237d-4fdf-b54e-4a71cda9a954 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:08.740700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c0042-4236-4dda-8605-bec07a69ab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:08.743531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0042-4236-4dda-8605-bec07a69ab58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:08.744964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0042-4236-4dda-8605-bec07a69ab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:08.745239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0042-4236-4dda-8605-bec07a69ab58 admin admin] PATH_INFO: `/v3/users/1fbc6af4172d4f3d95ae57485bf6d7a2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:08.753692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c0042-4236-4dda-8605-bec07a69ab58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbc6af4172d4f3d95ae57485bf6d7a2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:08.756389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c0042-4236-4dda-8605-bec07a69ab58 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:08.897852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f62c0042-4236-4dda-8605-bec07a69ab58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbc6af4172d4f3d95ae57485bf6d7a2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:08.910089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f62c0042-4236-4dda-8605-bec07a69ab58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbc6af4172d4f3d95ae57485bf6d7a2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:08.943749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f62c0042-4236-4dda-8605-bec07a69ab58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbc6af4172d4f3d95ae57485bf6d7a2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:08.964448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f62c0042-4236-4dda-8605-bec07a69ab58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbc6af4172d4f3d95ae57485bf6d7a2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:08.965124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f62c0042-4236-4dda-8605-bec07a69ab58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbc6af4172d4f3d95ae57485bf6d7a2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:08.999659 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3302/6665] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:08 2022] DELETE /identity/v3/users/1fbc6af4172d4f3d95ae57485bf6d7a2 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:09.452955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57067810-ed5c-48bd-bf26-a6a3498684d2 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:09.474271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57067810-ed5c-48bd-bf26-a6a3498684d2 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:09.611583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612badd9-7b60-4312-8cc3-8dc1e3032c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:09.612352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612badd9-7b60-4312-8cc3-8dc1e3032c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:09.612705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612badd9-7b60-4312-8cc3-8dc1e3032c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:09.613408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612badd9-7b60-4312-8cc3-8dc1e3032c21 admin admin] PATH_INFO: `/v3/projects/cff8886e6a5f4728806b806cb3459ac5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:09.615756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612badd9-7b60-4312-8cc3-8dc1e3032c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff8886e6a5f4728806b806cb3459ac5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:09.636261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612badd9-7b60-4312-8cc3-8dc1e3032c21 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:09.778710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-612badd9-7b60-4312-8cc3-8dc1e3032c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff8886e6a5f4728806b806cb3459ac5', 'request_id': 'req-612badd9-7b60-4312-8cc3-8dc1e3032c21'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:09.793774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-612badd9-7b60-4312-8cc3-8dc1e3032c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff8886e6a5f4728806b806cb3459ac5', 'request_id': 'req-612badd9-7b60-4312-8cc3-8dc1e3032c21'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:09.796176 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:09.826853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-612badd9-7b60-4312-8cc3-8dc1e3032c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff8886e6a5f4728806b806cb3459ac5', 'request_id': 'req-612badd9-7b60-4312-8cc3-8dc1e3032c21'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:09.862909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-612badd9-7b60-4312-8cc3-8dc1e3032c21 admin admin] The token cache is being invalidate because project cff8886e6a5f4728806b806cb3459ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:09.864754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-612badd9-7b60-4312-8cc3-8dc1e3032c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:09.866638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-612badd9-7b60-4312-8cc3-8dc1e3032c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:09.884391 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3364/6666] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:09 2022] DELETE /identity/v3/projects/cff8886e6a5f4728806b806cb3459ac5 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:09.890796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb4cee-6289-4a67-826a-d17a81762e5d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:09.892391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb4cee-6289-4a67-826a-d17a81762e5d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:09.892859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb4cee-6289-4a67-826a-d17a81762e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:09.905590 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:09.949430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bddb4cee-6289-4a67-826a-d17a81762e5d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:09.950664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bddb4cee-6289-4a67-826a-d17a81762e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:10.156996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d7c2e-6747-49c7-be82-6dee7209ad11 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:10.157822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d7c2e-6747-49c7-be82-6dee7209ad11 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:10.158106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d7c2e-6747-49c7-be82-6dee7209ad11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:10.161088 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3303/6667] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:10.223454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1b2d7c2e-6747-49c7-be82-6dee7209ad11 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:10.224708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1b2d7c2e-6747-49c7-be82-6dee7209ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:10.265895 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3365/6668] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:10.270944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb4cee-6289-4a67-826a-d17a81762e5d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:10.288357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb4cee-6289-4a67-826a-d17a81762e5d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:10.307148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0a65e-a15c-4a63-9c2d-b016cb6d58b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:10.309150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0a65e-a15c-4a63-9c2d-b016cb6d58b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:10.309645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0a65e-a15c-4a63-9c2d-b016cb6d58b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:10.310184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0a65e-a15c-4a63-9c2d-b016cb6d58b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:10.314011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0a65e-a15c-4a63-9c2d-b016cb6d58b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:10.315552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0a65e-a15c-4a63-9c2d-b016cb6d58b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:10.325338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0a65e-a15c-4a63-9c2d-b016cb6d58b1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:10.327914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d7c2e-6747-49c7-be82-6dee7209ad11 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:10.330058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1b2d7c2e-6747-49c7-be82-6dee7209ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:10.350160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d7c2e-6747-49c7-be82-6dee7209ad11 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:10.364215 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3304/6669] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:10.367331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0a65e-a15c-4a63-9c2d-b016cb6d58b1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:10.369275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791da093-78bc-40db-bf99-a7eae8d61a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:10.369990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da093-78bc-40db-bf99-a7eae8d61a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:10.370273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da093-78bc-40db-bf99-a7eae8d61a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:10.370551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da093-78bc-40db-bf99-a7eae8d61a34 admin admin] PATH_INFO: `/v3/users/773cb3b19f3d48ae81c23645eb2ce455` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:10.373415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791da093-78bc-40db-bf99-a7eae8d61a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=773cb3b19f3d48ae81c23645eb2ce455)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:10.375472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791da093-78bc-40db-bf99-a7eae8d61a34 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:10.384840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0a65e-a15c-4a63-9c2d-b016cb6d58b1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:10.409964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d55bdb-509b-4b0b-9ea8-e145a5cfb8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:10.414478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d55bdb-509b-4b0b-9ea8-e145a5cfb8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:10.415292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d55bdb-509b-4b0b-9ea8-e145a5cfb8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:10.415810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d55bdb-509b-4b0b-9ea8-e145a5cfb8e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:10.416887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d55bdb-509b-4b0b-9ea8-e145a5cfb8e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:10.421795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d55bdb-509b-4b0b-9ea8-e145a5cfb8e5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:10.503035 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3305/6670] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:10 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:10.507100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d55bdb-509b-4b0b-9ea8-e145a5cfb8e5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:10.513111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-791da093-78bc-40db-bf99-a7eae8d61a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773cb3b19f3d48ae81c23645eb2ce455'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:10.514954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-791da093-78bc-40db-bf99-a7eae8d61a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773cb3b19f3d48ae81c23645eb2ce455'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:10.530564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-791da093-78bc-40db-bf99-a7eae8d61a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773cb3b19f3d48ae81c23645eb2ce455'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:10.564440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-791da093-78bc-40db-bf99-a7eae8d61a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773cb3b19f3d48ae81c23645eb2ce455'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:10.568310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-791da093-78bc-40db-bf99-a7eae8d61a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773cb3b19f3d48ae81c23645eb2ce455'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:10.605300 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3366/6671] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:10 2022] DELETE /identity/v3/users/773cb3b19f3d48ae81c23645eb2ce455 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:10.613090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfddf6b-8dfc-419c-9198-affacef10a69 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:10.613417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfddf6b-8dfc-419c-9198-affacef10a69 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:10.613793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfddf6b-8dfc-419c-9198-affacef10a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:10.691556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1bfddf6b-8dfc-419c-9198-affacef10a69 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:10.693042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1bfddf6b-8dfc-419c-9198-affacef10a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:10.744536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d55bdb-509b-4b0b-9ea8-e145a5cfb8e5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:10.891281 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3367/6672] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:10.898398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfddf6b-8dfc-419c-9198-affacef10a69 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:10.901384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1bfddf6b-8dfc-419c-9198-affacef10a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:10.933558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d930653-8db7-4861-b9c1-9fec37a4220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:10.937002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d930653-8db7-4861-b9c1-9fec37a4220c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:10.937542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d930653-8db7-4861-b9c1-9fec37a4220c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:10.937889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d930653-8db7-4861-b9c1-9fec37a4220c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:10.939436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d930653-8db7-4861-b9c1-9fec37a4220c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:10.943409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d930653-8db7-4861-b9c1-9fec37a4220c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:11.020643 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3306/6673] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:10 2022] POST /identity/v3/users => generated 288 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:11.021643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d930653-8db7-4861-b9c1-9fec37a4220c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:11.028471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4d930653-8db7-4861-b9c1-9fec37a4220c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:11.035700 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:11.049769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfddf6b-8dfc-419c-9198-affacef10a69 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:11.052062 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:11.062382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d930653-8db7-4861-b9c1-9fec37a4220c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:11.069011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc6534-8fa4-4b86-bd64-d81fcb29ca1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:11.069654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc6534-8fa4-4b86-bd64-d81fcb29ca1e service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:11.069931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc6534-8fa4-4b86-bd64-d81fcb29ca1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:11.070256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc6534-8fa4-4b86-bd64-d81fcb29ca1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:11.078880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b8679-aaf1-423a-a39d-a9a723a84a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:11.083551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b8679-aaf1-423a-a39d-a9a723a84a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:11.083731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b8679-aaf1-423a-a39d-a9a723a84a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:11.085028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b8679-aaf1-423a-a39d-a9a723a84a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:11.085730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b8679-aaf1-423a-a39d-a9a723a84a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:11.087943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b8679-aaf1-423a-a39d-a9a723a84a24 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:11.091768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc6534-8fa4-4b86-bd64-d81fcb29ca1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:11.093346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc6534-8fa4-4b86-bd64-d81fcb29ca1e service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:11.119697 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3307/6674] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:11.120638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b8679-aaf1-423a-a39d-a9a723a84a24 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:11.123496 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3368/6675] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:11.135958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b8679-aaf1-423a-a39d-a9a723a84a24 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:11.143824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37febf-bab8-4d8a-a355-6597548bf1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:11.145345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37febf-bab8-4d8a-a355-6597548bf1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:11.145345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37febf-bab8-4d8a-a355-6597548bf1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:11.145345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37febf-bab8-4d8a-a355-6597548bf1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:11.146039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37febf-bab8-4d8a-a355-6597548bf1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:11.148088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37febf-bab8-4d8a-a355-6597548bf1eb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:11.168065 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3308/6676] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:11.172814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc6534-8fa4-4b86-bd64-d81fcb29ca1e service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:11.186470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc6534-8fa4-4b86-bd64-d81fcb29ca1e service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:11.193668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331eb0b-a7cc-4ad7-ae46-4e1dbfd5978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:11.194829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331eb0b-a7cc-4ad7-ae46-4e1dbfd5978f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:11.195254 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331eb0b-a7cc-4ad7-ae46-4e1dbfd5978f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:11.196418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331eb0b-a7cc-4ad7-ae46-4e1dbfd5978f admin admin] PATH_INFO: `/v3/projects/f1d5d88088924dbb94091fef30985c56/users/49acfb54470e49a5a9d9c0bb7f635223/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:11.238154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331eb0b-a7cc-4ad7-ae46-4e1dbfd5978f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d5d88088924dbb94091fef30985c56, user_id=49acfb54470e49a5a9d9c0bb7f635223, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:11.242700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331eb0b-a7cc-4ad7-ae46-4e1dbfd5978f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:11.274243 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3369/6677] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:11 2022] PUT /identity/v3/projects/f1d5d88088924dbb94091fef30985c56/users/49acfb54470e49a5a9d9c0bb7f635223/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:11.286739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9487e4-ee12-4807-831e-f397faf853b9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:11.287237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9487e4-ee12-4807-831e-f397faf853b9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:11.287605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9487e4-ee12-4807-831e-f397faf853b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:11.328675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ea9487e4-ee12-4807-831e-f397faf853b9 None None] MFA Rules not processed for user `49acfb54470e49a5a9d9c0bb7f635223`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:11.335356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ea9487e4-ee12-4807-831e-f397faf853b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:11.518246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331eb0b-a7cc-4ad7-ae46-4e1dbfd5978f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:11.524230 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3309/6678] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:11.661202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331eb0b-a7cc-4ad7-ae46-4e1dbfd5978f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:11.675977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dc19a-c755-43cb-879a-cb378e4153d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:11.676607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dc19a-c755-43cb-879a-cb378e4153d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:11.676880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dc19a-c755-43cb-879a-cb378e4153d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:11.677146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dc19a-c755-43cb-879a-cb378e4153d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:11.677935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dc19a-c755-43cb-879a-cb378e4153d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:11.679934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dc19a-c755-43cb-879a-cb378e4153d0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:11.826253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9487e4-ee12-4807-831e-f397faf853b9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:11.833656 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3370/6679] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:11 2022] POST /identity/v3/projects => generated 375 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:11.842292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9487e4-ee12-4807-831e-f397faf853b9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:12.033063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05f218-1c57-4493-b355-bdefcd417e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:12.034760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05f218-1c57-4493-b355-bdefcd417e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:12.035310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05f218-1c57-4493-b355-bdefcd417e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:12.036044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05f218-1c57-4493-b355-bdefcd417e33 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:12.036937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05f218-1c57-4493-b355-bdefcd417e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:12.039563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05f218-1c57-4493-b355-bdefcd417e33 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:12.104285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dc19a-c755-43cb-879a-cb378e4153d0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:12.108469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eb6dc19a-c755-43cb-879a-cb378e4153d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:12.126315 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3310/6680] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:11 2022] POST /identity/v3/users => generated 294 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:12.127470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05f218-1c57-4493-b355-bdefcd417e33 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:12.159722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dc19a-c755-43cb-879a-cb378e4153d0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:12.169017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:12.169271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05f218-1c57-4493-b355-bdefcd417e33 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:12.170264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:12.170555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:12.170831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] PATH_INFO: `/v3/projects/200bce5500534c62b7ca45cb1002853f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:12.172183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=200bce5500534c62b7ca45cb1002853f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:12.174713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:12.183352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e67275-810b-4bb3-b577-b60b1ad0312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:12.185655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e67275-810b-4bb3-b577-b60b1ad0312e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:12.185951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e67275-810b-4bb3-b577-b60b1ad0312e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:12.186228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e67275-810b-4bb3-b577-b60b1ad0312e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:12.186890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e67275-810b-4bb3-b577-b60b1ad0312e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:12.195347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e67275-810b-4bb3-b577-b60b1ad0312e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:12.223793 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3311/6681] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:12.228449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e67275-810b-4bb3-b577-b60b1ad0312e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:12.252519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e67275-810b-4bb3-b577-b60b1ad0312e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:12.268402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87a30d-cd7f-4dc7-879a-7396e9d5726a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:12.269235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87a30d-cd7f-4dc7-879a-7396e9d5726a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:12.269613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87a30d-cd7f-4dc7-879a-7396e9d5726a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:12.269984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87a30d-cd7f-4dc7-879a-7396e9d5726a admin admin] PATH_INFO: `/v3/projects/84e222913db04f86822ffedffe9fe2cf/users/fffbc84f68574562a09dba624bd884f9/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:12.276205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200bce5500534c62b7ca45cb1002853f', 'request_id': 'req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:12.306281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87a30d-cd7f-4dc7-879a-7396e9d5726a admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e222913db04f86822ffedffe9fe2cf, user_id=fffbc84f68574562a09dba624bd884f9, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:12.311985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87a30d-cd7f-4dc7-879a-7396e9d5726a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:12.315901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200bce5500534c62b7ca45cb1002853f', 'request_id': 'req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:12.340823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200bce5500534c62b7ca45cb1002853f', 'request_id': 'req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:12.353347 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3312/6682] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:12 2022] PUT /identity/v3/projects/84e222913db04f86822ffedffe9fe2cf/users/fffbc84f68574562a09dba624bd884f9/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:12.363035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] The token cache is being invalidate because project 200bce5500534c62b7ca45cb1002853f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:12.363035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:12.363356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:12.363451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87a30d-cd7f-4dc7-879a-7396e9d5726a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:12.368742 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3371/6683] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:12 2022] DELETE /identity/v3/projects/200bce5500534c62b7ca45cb1002853f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:12.370087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:12.370539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b87a30d-cd7f-4dc7-879a-7396e9d5726a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:12.371298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:12.424693 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:12.459914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dbbc5-3641-40b1-8c8f-e8043cd2bd29 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:12.472381 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:12.524089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87a30d-cd7f-4dc7-879a-7396e9d5726a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:12.529862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3534a7-c503-4235-b602-fb173d0be39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:12.531004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3534a7-c503-4235-b602-fb173d0be39b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:12.531355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3534a7-c503-4235-b602-fb173d0be39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:12.531704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3534a7-c503-4235-b602-fb173d0be39b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:12.533230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3534a7-c503-4235-b602-fb173d0be39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:12.534903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3534a7-c503-4235-b602-fb173d0be39b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:12.568569 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3313/6684] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:33:12.569652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3534a7-c503-4235-b602-fb173d0be39b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:12.583254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3534a7-c503-4235-b602-fb173d0be39b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:12.586773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc59b2-b9a2-4cc9-82b2-c0f3bcd5594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:12.587473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc59b2-b9a2-4cc9-82b2-c0f3bcd5594f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:12.587812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc59b2-b9a2-4cc9-82b2-c0f3bcd5594f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:12.588023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc59b2-b9a2-4cc9-82b2-c0f3bcd5594f admin admin] PATH_INFO: `/v3/users/af9a45e136e34cf7ac7abb3ded503fd7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:12.588381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26174103-fd84-4130-aeda-ce1c42d05e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:12.589054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26174103-fd84-4130-aeda-ce1c42d05e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:12.589335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26174103-fd84-4130-aeda-ce1c42d05e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:12.589609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26174103-fd84-4130-aeda-ce1c42d05e6e admin admin] PATH_INFO: `/v3/projects/84e222913db04f86822ffedffe9fe2cf/users/fffbc84f68574562a09dba624bd884f9/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:12.590246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc59b2-b9a2-4cc9-82b2-c0f3bcd5594f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9a45e136e34cf7ac7abb3ded503fd7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:12.591700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26174103-fd84-4130-aeda-ce1c42d05e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e222913db04f86822ffedffe9fe2cf, user_id=fffbc84f68574562a09dba624bd884f9, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:12.595352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26174103-fd84-4130-aeda-ce1c42d05e6e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:12.596953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc59b2-b9a2-4cc9-82b2-c0f3bcd5594f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:12.609853 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3314/6685] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:12 2022] PUT /identity/v3/projects/84e222913db04f86822ffedffe9fe2cf/users/fffbc84f68574562a09dba624bd884f9/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:12.622887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef9a0-138a-484e-a37f-a7ffd1d83566 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:12.623135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef9a0-138a-484e-a37f-a7ffd1d83566 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:12.623378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef9a0-138a-484e-a37f-a7ffd1d83566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:12.658625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-482ef9a0-138a-484e-a37f-a7ffd1d83566 None None] MFA Rules not processed for user `fffbc84f68574562a09dba624bd884f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:12.661093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-482ef9a0-138a-484e-a37f-a7ffd1d83566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:12.715237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3edc59b2-b9a2-4cc9-82b2-c0f3bcd5594f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9a45e136e34cf7ac7abb3ded503fd7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:12.716221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3edc59b2-b9a2-4cc9-82b2-c0f3bcd5594f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9a45e136e34cf7ac7abb3ded503fd7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:12.747966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3edc59b2-b9a2-4cc9-82b2-c0f3bcd5594f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9a45e136e34cf7ac7abb3ded503fd7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:12.767150 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3315/6686] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:12.768739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3edc59b2-b9a2-4cc9-82b2-c0f3bcd5594f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9a45e136e34cf7ac7abb3ded503fd7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:12.769390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3edc59b2-b9a2-4cc9-82b2-c0f3bcd5594f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9a45e136e34cf7ac7abb3ded503fd7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:12.773442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ef9a0-138a-484e-a37f-a7ffd1d83566 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:12.787518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ef9a0-138a-484e-a37f-a7ffd1d83566 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:12.794036 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3372/6687] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:12 2022] DELETE /identity/v3/users/af9a45e136e34cf7ac7abb3ded503fd7 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:12.796929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be130b4-5ac5-4e04-ba1e-aa4cdadc554e tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:12.797961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be130b4-5ac5-4e04-ba1e-aa4cdadc554e tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:12.798459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be130b4-5ac5-4e04-ba1e-aa4cdadc554e tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:12.798905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be130b4-5ac5-4e04-ba1e-aa4cdadc554e tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:12.799848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be130b4-5ac5-4e04-ba1e-aa4cdadc554e tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:12.801896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be130b4-5ac5-4e04-ba1e-aa4cdadc554e tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:12.854307 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3316/6688] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:12 2022] POST /identity/v3/projects => generated 351 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:12.858744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc59b2-b9a2-4cc9-82b2-c0f3bcd5594f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:12.981808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc59b2-b9a2-4cc9-82b2-c0f3bcd5594f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:12.993488 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:13.135259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce390c4f-1cad-4a3d-acbb-4aacde1b05ee tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:13.135899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce390c4f-1cad-4a3d-acbb-4aacde1b05ee tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:13.136281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce390c4f-1cad-4a3d-acbb-4aacde1b05ee tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:13.136551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce390c4f-1cad-4a3d-acbb-4aacde1b05ee tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:13.137088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce390c4f-1cad-4a3d-acbb-4aacde1b05ee tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:13.139082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce390c4f-1cad-4a3d-acbb-4aacde1b05ee tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:13.245151 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3373/6689] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:33:12 2022] POST /identity/v3/projects => generated 349 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:13.249256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be130b4-5ac5-4e04-ba1e-aa4cdadc554e tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:13.278035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be130b4-5ac5-4e04-ba1e-aa4cdadc554e tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:13.412678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce390c4f-1cad-4a3d-acbb-4aacde1b05ee tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:13.415274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ce390c4f-1cad-4a3d-acbb-4aacde1b05ee tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:13.543799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9a89c-7f2c-4b9a-93ff-7519ad3d5821 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:13.544694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9a89c-7f2c-4b9a-93ff-7519ad3d5821 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:13.546320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9a89c-7f2c-4b9a-93ff-7519ad3d5821 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:13.546769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9a89c-7f2c-4b9a-93ff-7519ad3d5821 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/users/49acfb54470e49a5a9d9c0bb7f635223` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:13.552763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9a89c-7f2c-4b9a-93ff-7519ad3d5821 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:get_user(user_id=49acfb54470e49a5a9d9c0bb7f635223)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:13.555410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9a89c-7f2c-4b9a-93ff-7519ad3d5821 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:13.563013 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3317/6690] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:33:13 2022] GET /identity/v3/users/49acfb54470e49a5a9d9c0bb7f635223 => generated 288 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:13.567756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9a89c-7f2c-4b9a-93ff-7519ad3d5821 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:13.594196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9a89c-7f2c-4b9a-93ff-7519ad3d5821 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:13.603805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a3b28-70bf-4fc2-badf-4966cba6414a tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:13.604429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a3b28-70bf-4fc2-badf-4966cba6414a tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:13.604706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a3b28-70bf-4fc2-badf-4966cba6414a tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:13.604981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a3b28-70bf-4fc2-badf-4966cba6414a tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:13.605627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a3b28-70bf-4fc2-badf-4966cba6414a tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:13.608711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a3b28-70bf-4fc2-badf-4966cba6414a tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:13.664026 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3318/6691] 10.222.0.39 () {60 vars in 1162 bytes} [Sun Oct 16 01:33:13 2022] POST /identity/v3/credentials => generated 429 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:13.668220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce390c4f-1cad-4a3d-acbb-4aacde1b05ee tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:13.669285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a3b28-70bf-4fc2-badf-4966cba6414a tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:13.679010 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:13.682358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91716a70-8fc5-413d-b306-9e21ee7b95b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:13.683374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716a70-8fc5-413d-b306-9e21ee7b95b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:13.683825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716a70-8fc5-413d-b306-9e21ee7b95b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:13.684795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716a70-8fc5-413d-b306-9e21ee7b95b8 admin admin] PATH_INFO: `/v3/projects/8ad5f5fab5dd42fd94be46e2600bd442` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:13.686374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91716a70-8fc5-413d-b306-9e21ee7b95b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad5f5fab5dd42fd94be46e2600bd442)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:13.691091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91716a70-8fc5-413d-b306-9e21ee7b95b8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:13.696972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a3b28-70bf-4fc2-badf-4966cba6414a tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:13.712538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa06eab-08ca-46af-b0f5-418bbb23c2f8 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:13.713298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa06eab-08ca-46af-b0f5-418bbb23c2f8 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:13.715244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa06eab-08ca-46af-b0f5-418bbb23c2f8 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:13.715619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa06eab-08ca-46af-b0f5-418bbb23c2f8 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/credentials/4db2219341e21b5937844467ac883df51757cd7fe56da900b0f8461edb21822a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:13.720780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa06eab-08ca-46af-b0f5-418bbb23c2f8 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=4db2219341e21b5937844467ac883df51757cd7fe56da900b0f8461edb21822a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:13.739874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa06eab-08ca-46af-b0f5-418bbb23c2f8 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:13.753814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa06eab-08ca-46af-b0f5-418bbb23c2f8 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=4db2219341e21b5937844467ac883df51757cd7fe56da900b0f8461edb21822a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:13.756762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa06eab-08ca-46af-b0f5-418bbb23c2f8 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:13.825312 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3319/6692] 10.222.0.39 () {60 vars in 1358 bytes} [Sun Oct 16 01:33:13 2022] PATCH /identity/v3/credentials/4db2219341e21b5937844467ac883df51757cd7fe56da900b0f8461edb21822a => generated 436 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:13.833638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa06eab-08ca-46af-b0f5-418bbb23c2f8 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:13.852204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-91716a70-8fc5-413d-b306-9e21ee7b95b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad5f5fab5dd42fd94be46e2600bd442', 'request_id': 'req-91716a70-8fc5-413d-b306-9e21ee7b95b8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:13.872969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa06eab-08ca-46af-b0f5-418bbb23c2f8 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:13.877514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-91716a70-8fc5-413d-b306-9e21ee7b95b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad5f5fab5dd42fd94be46e2600bd442', 'request_id': 'req-91716a70-8fc5-413d-b306-9e21ee7b95b8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:13.918941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-91716a70-8fc5-413d-b306-9e21ee7b95b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad5f5fab5dd42fd94be46e2600bd442', 'request_id': 'req-91716a70-8fc5-413d-b306-9e21ee7b95b8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:13.940501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-91716a70-8fc5-413d-b306-9e21ee7b95b8 admin admin] The token cache is being invalidate because project 8ad5f5fab5dd42fd94be46e2600bd442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:13.940824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-91716a70-8fc5-413d-b306-9e21ee7b95b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:13.948153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-91716a70-8fc5-413d-b306-9e21ee7b95b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:13.957971 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3374/6693] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:13 2022] DELETE /identity/v3/projects/8ad5f5fab5dd42fd94be46e2600bd442 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:13.960050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c726d1-0e85-4038-b534-86b1a991c0ba None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:13.960521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c726d1-0e85-4038-b534-86b1a991c0ba None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:13.960806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c726d1-0e85-4038-b534-86b1a991c0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.014626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-07c726d1-0e85-4038-b534-86b1a991c0ba None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:14.016048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-07c726d1-0e85-4038-b534-86b1a991c0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:14.037896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fa8c6-b843-4854-b468-0ab63ce0ce37 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.038604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fa8c6-b843-4854-b468-0ab63ce0ce37 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.038893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fa8c6-b843-4854-b468-0ab63ce0ce37 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.039404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fa8c6-b843-4854-b468-0ab63ce0ce37 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/credentials/4db2219341e21b5937844467ac883df51757cd7fe56da900b0f8461edb21822a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.043443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fa8c6-b843-4854-b468-0ab63ce0ce37 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=4db2219341e21b5937844467ac883df51757cd7fe56da900b0f8461edb21822a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.047890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fa8c6-b843-4854-b468-0ab63ce0ce37 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.061616 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3320/6694] 10.222.0.39 () {58 vars in 1335 bytes} [Sun Oct 16 01:33:13 2022] GET /identity/v3/credentials/4db2219341e21b5937844467ac883df51757cd7fe56da900b0f8461edb21822a => generated 436 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:14.064529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fa8c6-b843-4854-b468-0ab63ce0ce37 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:14.066820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-705fa8c6-b843-4854-b468-0ab63ce0ce37 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:14.073158 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:14.100982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fa8c6-b843-4854-b468-0ab63ce0ce37 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:14.113510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85e509-5d2d-4cec-ab36-0ef0bf906706 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.114631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85e509-5d2d-4cec-ab36-0ef0bf906706 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.115115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85e509-5d2d-4cec-ab36-0ef0bf906706 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.115544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85e509-5d2d-4cec-ab36-0ef0bf906706 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/credentials/4db2219341e21b5937844467ac883df51757cd7fe56da900b0f8461edb21822a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.119334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85e509-5d2d-4cec-ab36-0ef0bf906706 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=4db2219341e21b5937844467ac883df51757cd7fe56da900b0f8461edb21822a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.125447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85e509-5d2d-4cec-ab36-0ef0bf906706 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.162746 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3321/6695] 10.222.0.39 () {58 vars in 1338 bytes} [Sun Oct 16 01:33:14 2022] DELETE /identity/v3/credentials/4db2219341e21b5937844467ac883df51757cd7fe56da900b0f8461edb21822a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:14.162981 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3375/6696] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:14.168007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c726d1-0e85-4038-b534-86b1a991c0ba None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:14.168902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99cdc-93f1-4fd2-b129-c53e394cc903 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.169204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99cdc-93f1-4fd2-b129-c53e394cc903 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.170014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99cdc-93f1-4fd2-b129-c53e394cc903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.180519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c726d1-0e85-4038-b534-86b1a991c0ba None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:14.186127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a454b-4a7c-463b-8dba-e35cf82e19be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.187671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a454b-4a7c-463b-8dba-e35cf82e19be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.188947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a454b-4a7c-463b-8dba-e35cf82e19be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.189702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a454b-4a7c-463b-8dba-e35cf82e19be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.190555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a454b-4a7c-463b-8dba-e35cf82e19be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.193219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a454b-4a7c-463b-8dba-e35cf82e19be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.208693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7db99cdc-93f1-4fd2-b129-c53e394cc903 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:14.210802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7db99cdc-93f1-4fd2-b129-c53e394cc903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:14.218856 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3322/6697] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:14.223804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99cdc-93f1-4fd2-b129-c53e394cc903 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:14.227439 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3376/6698] 10.222.0.39 () {60 vars in 1162 bytes} [Sun Oct 16 01:33:14 2022] POST /identity/v3/credentials => generated 430 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:14.235349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99cdc-93f1-4fd2-b129-c53e394cc903 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:14.236516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a454b-4a7c-463b-8dba-e35cf82e19be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:14.249252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097178d-7a61-426e-9bdd-12b309a4bfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.250403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097178d-7a61-426e-9bdd-12b309a4bfcf admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.251614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097178d-7a61-426e-9bdd-12b309a4bfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.252048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097178d-7a61-426e-9bdd-12b309a4bfcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.253633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097178d-7a61-426e-9bdd-12b309a4bfcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:14.253633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097178d-7a61-426e-9bdd-12b309a4bfcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.257510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097178d-7a61-426e-9bdd-12b309a4bfcf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.261979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a454b-4a7c-463b-8dba-e35cf82e19be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:14.273678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146c98-b7f2-4340-882f-dea6c6ec3ff3 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.274304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146c98-b7f2-4340-882f-dea6c6ec3ff3 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.274585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146c98-b7f2-4340-882f-dea6c6ec3ff3 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.274862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146c98-b7f2-4340-882f-dea6c6ec3ff3 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.276101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d146c98-b7f2-4340-882f-dea6c6ec3ff3 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.277869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d146c98-b7f2-4340-882f-dea6c6ec3ff3 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.286680 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3323/6699] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:33:14.291479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097178d-7a61-426e-9bdd-12b309a4bfcf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:14.326430 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3377/6700] 10.222.0.39 () {60 vars in 1162 bytes} [Sun Oct 16 01:33:14 2022] POST /identity/v3/credentials => generated 431 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:14.331112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146c98-b7f2-4340-882f-dea6c6ec3ff3 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:14.333819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097178d-7a61-426e-9bdd-12b309a4bfcf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:14.352901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0faef2-6e31-4a8f-b0b0-6d6b42ebfdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.353531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0faef2-6e31-4a8f-b0b0-6d6b42ebfdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.353874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0faef2-6e31-4a8f-b0b0-6d6b42ebfdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.354075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0faef2-6e31-4a8f-b0b0-6d6b42ebfdc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.354709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0faef2-6e31-4a8f-b0b0-6d6b42ebfdc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.357915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0faef2-6e31-4a8f-b0b0-6d6b42ebfdc3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.365337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146c98-b7f2-4340-882f-dea6c6ec3ff3 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:14.398983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6e8f2-38fa-4325-8a64-178400e401be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.399538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6e8f2-38fa-4325-8a64-178400e401be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.399803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6e8f2-38fa-4325-8a64-178400e401be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.400169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6e8f2-38fa-4325-8a64-178400e401be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.400684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6e8f2-38fa-4325-8a64-178400e401be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.402293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6e8f2-38fa-4325-8a64-178400e401be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.422178 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3324/6701] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:14 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:14.427401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0faef2-6e31-4a8f-b0b0-6d6b42ebfdc3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:14.437375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6e8f2-38fa-4325-8a64-178400e401be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.440789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6e8f2-38fa-4325-8a64-178400e401be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.453722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6e8f2-38fa-4325-8a64-178400e401be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.456373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6e8f2-38fa-4325-8a64-178400e401be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.472977 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3378/6702] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Oct 16 01:33:14 2022] GET /identity/v3/credentials => generated 946 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:14.473878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6e8f2-38fa-4325-8a64-178400e401be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:14.484871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6e8f2-38fa-4325-8a64-178400e401be tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:14.577930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0faef2-6e31-4a8f-b0b0-6d6b42ebfdc3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:14.585793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801abb06-c273-4aee-be5a-9d1a89b1c586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.586676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801abb06-c273-4aee-be5a-9d1a89b1c586 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.587174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801abb06-c273-4aee-be5a-9d1a89b1c586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.587595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801abb06-c273-4aee-be5a-9d1a89b1c586 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.588383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801abb06-c273-4aee-be5a-9d1a89b1c586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.591729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801abb06-c273-4aee-be5a-9d1a89b1c586 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.651714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706f11a-26aa-49a9-9212-45da40aafff9 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.652447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706f11a-26aa-49a9-9212-45da40aafff9 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.652732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706f11a-26aa-49a9-9212-45da40aafff9 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.653009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706f11a-26aa-49a9-9212-45da40aafff9 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/credentials/a56469f4ab4b7345ec0d260e2902cd4d79a45412f19f989954faa9c08e1a0dc9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.660991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706f11a-26aa-49a9-9212-45da40aafff9 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=a56469f4ab4b7345ec0d260e2902cd4d79a45412f19f989954faa9c08e1a0dc9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.662777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706f11a-26aa-49a9-9212-45da40aafff9 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.667369 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3325/6703] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:14 2022] POST /identity/v3/users => generated 283 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:14.669263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801abb06-c273-4aee-be5a-9d1a89b1c586 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:14.701025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801abb06-c273-4aee-be5a-9d1a89b1c586 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:14.713452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36999b3b-ff41-4bfe-8dc0-e61340a92521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.714094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36999b3b-ff41-4bfe-8dc0-e61340a92521 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.722084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36999b3b-ff41-4bfe-8dc0-e61340a92521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.722369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36999b3b-ff41-4bfe-8dc0-e61340a92521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.723068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36999b3b-ff41-4bfe-8dc0-e61340a92521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.728009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36999b3b-ff41-4bfe-8dc0-e61340a92521 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.728954 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3379/6704] 10.222.0.39 () {58 vars in 1338 bytes} [Sun Oct 16 01:33:14 2022] DELETE /identity/v3/credentials/a56469f4ab4b7345ec0d260e2902cd4d79a45412f19f989954faa9c08e1a0dc9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:14.730871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706f11a-26aa-49a9-9212-45da40aafff9 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:14.746118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706f11a-26aa-49a9-9212-45da40aafff9 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:14.753069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b3e03-fde5-46ce-96dd-ff769ae86886 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.754243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b3e03-fde5-46ce-96dd-ff769ae86886 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.754684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b3e03-fde5-46ce-96dd-ff769ae86886 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.755177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b3e03-fde5-46ce-96dd-ff769ae86886 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/credentials/917e622ae9b7f86a1e43720b347eed00b3c61cc882e5d19fed0e7e7996b09cc9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.757584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b3e03-fde5-46ce-96dd-ff769ae86886 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=917e622ae9b7f86a1e43720b347eed00b3c61cc882e5d19fed0e7e7996b09cc9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.758633 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3326/6705] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:14.762797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36999b3b-ff41-4bfe-8dc0-e61340a92521 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:14.764332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b3e03-fde5-46ce-96dd-ff769ae86886 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.796466 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3380/6706] 10.222.0.39 () {58 vars in 1338 bytes} [Sun Oct 16 01:33:14 2022] DELETE /identity/v3/credentials/917e622ae9b7f86a1e43720b347eed00b3c61cc882e5d19fed0e7e7996b09cc9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:14.797861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b3e03-fde5-46ce-96dd-ff769ae86886 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:14.810096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36999b3b-ff41-4bfe-8dc0-e61340a92521 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:14.824544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e916667-7700-4c8c-81b1-c320d4d83305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.825843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e916667-7700-4c8c-81b1-c320d4d83305 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.825843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e916667-7700-4c8c-81b1-c320d4d83305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.825843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e916667-7700-4c8c-81b1-c320d4d83305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.826658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e916667-7700-4c8c-81b1-c320d4d83305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.827581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b3e03-fde5-46ce-96dd-ff769ae86886 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:14.830574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e916667-7700-4c8c-81b1-c320d4d83305 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.839454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.843913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.844593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.848185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/projects/e11ea22f184c4ffcb445379cb6b38760` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.855472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e11ea22f184c4ffcb445379cb6b38760)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.863553 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3327/6707] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:14.865241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e916667-7700-4c8c-81b1-c320d4d83305 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:14.867430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:14.878863 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:14.889629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e916667-7700-4c8c-81b1-c320d4d83305 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:14.901797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb2e85-594e-435f-b704-19853d797acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:14.903447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb2e85-594e-435f-b704-19853d797acd admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:14.905648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb2e85-594e-435f-b704-19853d797acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:14.906040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb2e85-594e-435f-b704-19853d797acd admin admin] PATH_INFO: `/v3/projects/5b963b2bcb1a4c2ea85de0e04c1998dc/users/8c3b323c78b442b9a188b4b6ac9965c6/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:14.964104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb2e85-594e-435f-b704-19853d797acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b963b2bcb1a4c2ea85de0e04c1998dc, user_id=8c3b323c78b442b9a188b4b6ac9965c6, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:14.968182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb2e85-594e-435f-b704-19853d797acd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:15.003053 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3328/6708] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:14 2022] PUT /identity/v3/projects/5b963b2bcb1a4c2ea85de0e04c1998dc/users/8c3b323c78b442b9a188b4b6ac9965c6/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:15.014755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64912df4-13ac-48e0-8334-9ef4aedd34d4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:15.015226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64912df4-13ac-48e0-8334-9ef4aedd34d4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:15.015604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64912df4-13ac-48e0-8334-9ef4aedd34d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:15.029815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11ea22f184c4ffcb445379cb6b38760', 'request_id': 'req-fc309d50-b945-4aa3-8c79-801001dd69a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.042307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11ea22f184c4ffcb445379cb6b38760', 'request_id': 'req-fc309d50-b945-4aa3-8c79-801001dd69a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.056804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11ea22f184c4ffcb445379cb6b38760', 'request_id': 'req-fc309d50-b945-4aa3-8c79-801001dd69a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.058396 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:15.084349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-64912df4-13ac-48e0-8334-9ef4aedd34d4 None None] MFA Rules not processed for user `8c3b323c78b442b9a188b4b6ac9965c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:15.087640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-64912df4-13ac-48e0-8334-9ef4aedd34d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:15.100184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] The token cache is being invalidate because project e11ea22f184c4ffcb445379cb6b38760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:15.100496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.101185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.103023 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3381/6709] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:14 2022] DELETE /identity/v3/projects/e11ea22f184c4ffcb445379cb6b38760 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:15.107184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:15.110904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:15.233854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc309d50-b945-4aa3-8c79-801001dd69a1 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:15.239544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fffbc84f68574562a09dba624bd884f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84e222913db04f86822ffedffe9fe2cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:15.240532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:15.240823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:15.241148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] PATH_INFO: `/v3/projects/18813e89239649ea9a7a8fce20fb4075` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:15.242463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorizing `identity:delete_project(project_id=18813e89239649ea9a7a8fce20fb4075)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:15.244416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:15.285921 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3329/6710] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:15.287520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64912df4-13ac-48e0-8334-9ef4aedd34d4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:15.294280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-64912df4-13ac-48e0-8334-9ef4aedd34d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:15.361044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18813e89239649ea9a7a8fce20fb4075', 'request_id': 'req-cb0ba765-759c-4b6b-859b-f83a5a223469'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.375627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18813e89239649ea9a7a8fce20fb4075', 'request_id': 'req-cb0ba765-759c-4b6b-859b-f83a5a223469'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.397567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18813e89239649ea9a7a8fce20fb4075', 'request_id': 'req-cb0ba765-759c-4b6b-859b-f83a5a223469'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.413691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] The token cache is being invalidate because project 18813e89239649ea9a7a8fce20fb4075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:15.414724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.416484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.421108 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3382/6711] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:15 2022] DELETE /identity/v3/projects/18813e89239649ea9a7a8fce20fb4075 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:15.425547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:15.435399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:15.462621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64912df4-13ac-48e0-8334-9ef4aedd34d4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:15.635024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba765-759c-4b6b-859b-f83a5a223469 tempest-CredentialsTestJSON-1046247665 tempest-CredentialsTestJSON-1046247665-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:15.653579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a661093-c665-4721-9c0b-dec79155c51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:15.656615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a661093-c665-4721-9c0b-dec79155c51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:15.658338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a661093-c665-4721-9c0b-dec79155c51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:15.658728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a661093-c665-4721-9c0b-dec79155c51a admin admin] PATH_INFO: `/v3/users/49acfb54470e49a5a9d9c0bb7f635223` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:15.660316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5517c18-6431-42f5-ac86-3c58b5f48c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:15.661604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a661093-c665-4721-9c0b-dec79155c51a admin admin] RBAC: Authorizing `identity:delete_user(user_id=49acfb54470e49a5a9d9c0bb7f635223)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:15.663276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5517c18-6431-42f5-ac86-3c58b5f48c14 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:15.665431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a661093-c665-4721-9c0b-dec79155c51a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:15.666072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5517c18-6431-42f5-ac86-3c58b5f48c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:15.666800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5517c18-6431-42f5-ac86-3c58b5f48c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:15.667700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5517c18-6431-42f5-ac86-3c58b5f48c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:15.672120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5517c18-6431-42f5-ac86-3c58b5f48c14 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:15.732272 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:15.740600 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3330/6712] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:15 2022] POST /identity/v3/projects => generated 365 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:15.745279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5517c18-6431-42f5-ac86-3c58b5f48c14 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:15.750155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d5517c18-6431-42f5-ac86-3c58b5f48c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:15.773107 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:15.788479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a661093-c665-4721-9c0b-dec79155c51a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49acfb54470e49a5a9d9c0bb7f635223'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.789700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a661093-c665-4721-9c0b-dec79155c51a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49acfb54470e49a5a9d9c0bb7f635223'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.825898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a661093-c665-4721-9c0b-dec79155c51a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49acfb54470e49a5a9d9c0bb7f635223'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.850842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a661093-c665-4721-9c0b-dec79155c51a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49acfb54470e49a5a9d9c0bb7f635223'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.851699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a661093-c665-4721-9c0b-dec79155c51a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49acfb54470e49a5a9d9c0bb7f635223'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:15.897882 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3383/6713] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:15 2022] DELETE /identity/v3/users/49acfb54470e49a5a9d9c0bb7f635223 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:15.906411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f1b4a-08b1-478e-85d2-49f6961344a3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:15.911314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f1b4a-08b1-478e-85d2-49f6961344a3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:15.911790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f1b4a-08b1-478e-85d2-49f6961344a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:15.966980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-526f1b4a-08b1-478e-85d2-49f6961344a3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:15.969299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-526f1b4a-08b1-478e-85d2-49f6961344a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:15.983905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5517c18-6431-42f5-ac86-3c58b5f48c14 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:16.123169 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3384/6714] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:16.148354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae52037-a0af-4295-a546-9bbd26694dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:16.149174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae52037-a0af-4295-a546-9bbd26694dbc admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:16.149701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae52037-a0af-4295-a546-9bbd26694dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:16.149963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae52037-a0af-4295-a546-9bbd26694dbc admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:16.152563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae52037-a0af-4295-a546-9bbd26694dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:16.156054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae52037-a0af-4295-a546-9bbd26694dbc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:16.173341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f1b4a-08b1-478e-85d2-49f6961344a3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:16.176634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-526f1b4a-08b1-478e-85d2-49f6961344a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:16.207806 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3331/6715] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:15 2022] POST /identity/v3/users => generated 289 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:16.211937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae52037-a0af-4295-a546-9bbd26694dbc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:16.214610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aae52037-a0af-4295-a546-9bbd26694dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:16.245650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae52037-a0af-4295-a546-9bbd26694dbc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:16.259757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8235a93-99f1-4a36-8f12-8d99cb4724fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:16.260553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235a93-99f1-4a36-8f12-8d99cb4724fc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:16.261018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235a93-99f1-4a36-8f12-8d99cb4724fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:16.262615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235a93-99f1-4a36-8f12-8d99cb4724fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:16.263889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8235a93-99f1-4a36-8f12-8d99cb4724fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:16.271168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8235a93-99f1-4a36-8f12-8d99cb4724fc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:16.304526 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3332/6716] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:16.305717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8235a93-99f1-4a36-8f12-8d99cb4724fc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:16.326969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f1b4a-08b1-478e-85d2-49f6961344a3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:16.335336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8235a93-99f1-4a36-8f12-8d99cb4724fc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:16.336401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9603c-4498-4949-92ec-6221689b072e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:16.337263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9603c-4498-4949-92ec-6221689b072e service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:16.338433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9603c-4498-4949-92ec-6221689b072e service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:16.340543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9603c-4498-4949-92ec-6221689b072e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:16.357214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754a2a1-916c-49b6-b059-f956fc444f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:16.358132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754a2a1-916c-49b6-b059-f956fc444f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:16.358581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754a2a1-916c-49b6-b059-f956fc444f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:16.359055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754a2a1-916c-49b6-b059-f956fc444f3c admin admin] PATH_INFO: `/v3/projects/d460289569c54a7bb8420dc14503f91b/users/6d2286a605fd4940a2c511dca8cc0e86/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:16.372126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9603c-4498-4949-92ec-6221689b072e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:16.373609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9603c-4498-4949-92ec-6221689b072e service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:16.404360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754a2a1-916c-49b6-b059-f956fc444f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d460289569c54a7bb8420dc14503f91b, user_id=6d2286a605fd4940a2c511dca8cc0e86, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:16.408024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754a2a1-916c-49b6-b059-f956fc444f3c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:16.427518 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3385/6717] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:33:16.455746 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3333/6718] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:16 2022] PUT /identity/v3/projects/d460289569c54a7bb8420dc14503f91b/users/6d2286a605fd4940a2c511dca8cc0e86/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:16.456613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9603c-4498-4949-92ec-6221689b072e service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:16.467536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9603c-4498-4949-92ec-6221689b072e service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:16.567754 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:16.677004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599430b-30b6-4c33-95ea-5d22a2df076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:16.677646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599430b-30b6-4c33-95ea-5d22a2df076f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:16.677926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599430b-30b6-4c33-95ea-5d22a2df076f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:16.678198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599430b-30b6-4c33-95ea-5d22a2df076f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:16.681856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599430b-30b6-4c33-95ea-5d22a2df076f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:16.686369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599430b-30b6-4c33-95ea-5d22a2df076f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:16.727790 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3386/6719] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:16.728304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754a2a1-916c-49b6-b059-f956fc444f3c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:16.771763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754a2a1-916c-49b6-b059-f956fc444f3c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:16.788086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f216-e0f1-42ba-ad83-77d63deea062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:16.789378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f216-e0f1-42ba-ad83-77d63deea062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:16.790160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f216-e0f1-42ba-ad83-77d63deea062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:16.790759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f216-e0f1-42ba-ad83-77d63deea062 admin admin] PATH_INFO: `/v3/projects/d460289569c54a7bb8420dc14503f91b/users/6d2286a605fd4940a2c511dca8cc0e86/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:16.796222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4f216-e0f1-42ba-ad83-77d63deea062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d460289569c54a7bb8420dc14503f91b, user_id=6d2286a605fd4940a2c511dca8cc0e86, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:16.802197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4f216-e0f1-42ba-ad83-77d63deea062 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:16.824990 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3334/6720] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:16 2022] PUT /identity/v3/projects/d460289569c54a7bb8420dc14503f91b/users/6d2286a605fd4940a2c511dca8cc0e86/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:16.838699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948652c-728b-4166-9937-191a28cc6948 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:16.838699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948652c-728b-4166-9937-191a28cc6948 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:16.839406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948652c-728b-4166-9937-191a28cc6948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:16.939765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7948652c-728b-4166-9937-191a28cc6948 None None] MFA Rules not processed for user `6d2286a605fd4940a2c511dca8cc0e86`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:16.950834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7948652c-728b-4166-9937-191a28cc6948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:17.018572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f216-e0f1-42ba-ad83-77d63deea062 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:17.020358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-18e4f216-e0f1-42ba-ad83-77d63deea062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:17.200328 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3387/6721] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:17.206634 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:17.217800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948652c-728b-4166-9937-191a28cc6948 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:17.220645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7948652c-728b-4166-9937-191a28cc6948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:17.241249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f216-e0f1-42ba-ad83-77d63deea062 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:17.252083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:17.252747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:17.256117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:17.256117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] PATH_INFO: `/v3/users/05019954ceec42be9e4f5822b25e18ad` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:17.256117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05019954ceec42be9e4f5822b25e18ad)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:17.257546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:17.370581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05019954ceec42be9e4f5822b25e18ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:17.371384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05019954ceec42be9e4f5822b25e18ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:17.381484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948652c-728b-4166-9937-191a28cc6948 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:17.390970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b8852-9c25-4bb3-89c1-b741af977f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:17.392240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8852-9c25-4bb3-89c1-b741af977f41 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:17.392524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8852-9c25-4bb3-89c1-b741af977f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:17.394893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8852-9c25-4bb3-89c1-b741af977f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:17.410937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05019954ceec42be9e4f5822b25e18ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:17.412021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f99b8852-9c25-4bb3-89c1-b741af977f41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:17.424421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05019954ceec42be9e4f5822b25e18ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:17.425116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05019954ceec42be9e4f5822b25e18ad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:17.445059 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3335/6722] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:17 2022] DELETE /identity/v3/users/05019954ceec42be9e4f5822b25e18ad => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:17.446171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:17.447841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:17.448698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b8852-9c25-4bb3-89c1-b741af977f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:17.450309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b8852-9c25-4bb3-89c1-b741af977f41 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:17.469465 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3388/6723] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:17.471936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7af13-a69f-40db-b923-477b1da5c660 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:17.473861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7af13-a69f-40db-b923-477b1da5c660 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:17.474383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7af13-a69f-40db-b923-477b1da5c660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:17.521573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e0a7af13-a69f-40db-b923-477b1da5c660 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:17.523449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e0a7af13-a69f-40db-b923-477b1da5c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:17.655805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d786e30-2a50-449a-b18d-864be787ffd3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:17.667884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:17.669058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:17.669558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:17.670035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] PATH_INFO: `/v3/projects/f1d5d88088924dbb94091fef30985c56` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:17.672252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d5d88088924dbb94091fef30985c56)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:17.678280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:17.706706 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3389/6724] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:17.709027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7af13-a69f-40db-b923-477b1da5c660 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:17.714049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e0a7af13-a69f-40db-b923-477b1da5c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:17.737095 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:17.820116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d5d88088924dbb94091fef30985c56', 'request_id': 'req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:17.853111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d5d88088924dbb94091fef30985c56', 'request_id': 'req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:17.878770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d5d88088924dbb94091fef30985c56', 'request_id': 'req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:17.901681 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:17.908336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] The token cache is being invalidate because project f1d5d88088924dbb94091fef30985c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:17.915575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:17.917456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:17.923814 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3336/6725] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:17 2022] DELETE /identity/v3/projects/f1d5d88088924dbb94091fef30985c56 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:17.926747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:17.927976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:17.931455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7af13-a69f-40db-b923-477b1da5c660 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:18.049974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de842e2-e473-4f38-bf1b-36b0aecf3b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:18.051007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de842e2-e473-4f38-bf1b-36b0aecf3b06 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:18.051560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de842e2-e473-4f38-bf1b-36b0aecf3b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:18.052659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de842e2-e473-4f38-bf1b-36b0aecf3b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:18.055485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0de842e2-e473-4f38-bf1b-36b0aecf3b06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:18.105781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad775a94-4e8d-4f47-b41d-c35b1fe7aae3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:18.119491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda0ae6-e7e1-471a-ad9a-3d4c53950d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:18.120458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda0ae6-e7e1-471a-ad9a-3d4c53950d51 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:18.120753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda0ae6-e7e1-471a-ad9a-3d4c53950d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:18.121034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda0ae6-e7e1-471a-ad9a-3d4c53950d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:18.125661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4eda0ae6-e7e1-471a-ad9a-3d4c53950d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:18.143572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de842e2-e473-4f38-bf1b-36b0aecf3b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:18.145599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de842e2-e473-4f38-bf1b-36b0aecf3b06 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:18.157854 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3390/6726] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:18.159193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de842e2-e473-4f38-bf1b-36b0aecf3b06 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:18.161249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0de842e2-e473-4f38-bf1b-36b0aecf3b06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:18.277720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda0ae6-e7e1-471a-ad9a-3d4c53950d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:18.280813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda0ae6-e7e1-471a-ad9a-3d4c53950d51 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:18.303738 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3337/6727] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:18.323887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de842e2-e473-4f38-bf1b-36b0aecf3b06 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:18.333124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:18.336597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:18.337984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:18.339057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] PATH_INFO: `/v3/users/fffbc84f68574562a09dba624bd884f9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:18.341608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fffbc84f68574562a09dba624bd884f9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:18.360728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:18.462907 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:18.508421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fffbc84f68574562a09dba624bd884f9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:18.509380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fffbc84f68574562a09dba624bd884f9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:18.530327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fffbc84f68574562a09dba624bd884f9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:18.546957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fffbc84f68574562a09dba624bd884f9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:18.546957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fffbc84f68574562a09dba624bd884f9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:18.566956 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3391/6728] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:18 2022] DELETE /identity/v3/users/fffbc84f68574562a09dba624bd884f9 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:19.026125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda0ae6-e7e1-471a-ad9a-3d4c53950d51 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:19.028340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4eda0ae6-e7e1-471a-ad9a-3d4c53950d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:19.047380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda0ae6-e7e1-471a-ad9a-3d4c53950d51 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:19.106994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:19.108509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:19.162891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:19.163625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:19.164057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:19.164331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] PATH_INFO: `/v3/projects/945428a8639944d6aa42707e4b9c28ef` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:19.165499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945428a8639944d6aa42707e4b9c28ef)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:19.168088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:19.195303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddde9d-eb78-4c18-8384-f6a9fa4dff26 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:19.201937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63f8a2-90f6-495a-8c10-500cc5eb4242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:19.202644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63f8a2-90f6-495a-8c10-500cc5eb4242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:19.202945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63f8a2-90f6-495a-8c10-500cc5eb4242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:19.203219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63f8a2-90f6-495a-8c10-500cc5eb4242 admin admin] PATH_INFO: `/v3/projects/84e222913db04f86822ffedffe9fe2cf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:19.205626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63f8a2-90f6-495a-8c10-500cc5eb4242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e222913db04f86822ffedffe9fe2cf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:19.207612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63f8a2-90f6-495a-8c10-500cc5eb4242 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:19.229246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945428a8639944d6aa42707e4b9c28ef', 'request_id': 'req-62820754-58aa-4d0b-ad13-69ac5a983ce7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.233046 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:19.240212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945428a8639944d6aa42707e4b9c28ef', 'request_id': 'req-62820754-58aa-4d0b-ad13-69ac5a983ce7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.249848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945428a8639944d6aa42707e4b9c28ef', 'request_id': 'req-62820754-58aa-4d0b-ad13-69ac5a983ce7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.262524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1a63f8a2-90f6-495a-8c10-500cc5eb4242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e222913db04f86822ffedffe9fe2cf', 'request_id': 'req-1a63f8a2-90f6-495a-8c10-500cc5eb4242'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.268981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] The token cache is being invalidate because project 945428a8639944d6aa42707e4b9c28ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:19.269509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.270402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.270711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1a63f8a2-90f6-495a-8c10-500cc5eb4242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e222913db04f86822ffedffe9fe2cf', 'request_id': 'req-1a63f8a2-90f6-495a-8c10-500cc5eb4242'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.275090 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3338/6729] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:19 2022] DELETE /identity/v3/projects/945428a8639944d6aa42707e4b9c28ef => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:19.276036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:19.277387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:19.284590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1a63f8a2-90f6-495a-8c10-500cc5eb4242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e222913db04f86822ffedffe9fe2cf', 'request_id': 'req-1a63f8a2-90f6-495a-8c10-500cc5eb4242'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.297328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1a63f8a2-90f6-495a-8c10-500cc5eb4242 admin admin] The token cache is being invalidate because project 84e222913db04f86822ffedffe9fe2cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:19.297731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1a63f8a2-90f6-495a-8c10-500cc5eb4242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.298331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1a63f8a2-90f6-495a-8c10-500cc5eb4242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.300697 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3392/6730] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:19 2022] DELETE /identity/v3/projects/84e222913db04f86822ffedffe9fe2cf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:19.305835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093deeb4-5388-42c9-b4f8-e3799ab4ae89 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:19.306127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093deeb4-5388-42c9-b4f8-e3799ab4ae89 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:19.306409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093deeb4-5388-42c9-b4f8-e3799ab4ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:19.328423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-093deeb4-5388-42c9-b4f8-e3799ab4ae89 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:19.330198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-093deeb4-5388-42c9-b4f8-e3799ab4ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:19.356932 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:19.372541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62820754-58aa-4d0b-ad13-69ac5a983ce7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:19.407898 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3393/6731] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:19.415638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6146fd-8fc4-44f7-9661-c5a3f557b6ad None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:19.416085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6146fd-8fc4-44f7-9661-c5a3f557b6ad None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:19.416414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6146fd-8fc4-44f7-9661-c5a3f557b6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:19.441549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7d6146fd-8fc4-44f7-9661-c5a3f557b6ad None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:19.443314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7d6146fd-8fc4-44f7-9661-c5a3f557b6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:19.444187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:19.444979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:19.445348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:19.445638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] PATH_INFO: `/v3/users/b906bbcbacaa4eb8b121adb2bff8628c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:19.447011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b906bbcbacaa4eb8b121adb2bff8628c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:19.449267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:19.452181 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3394/6732] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:19.457716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6146fd-8fc4-44f7-9661-c5a3f557b6ad None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:19.471777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6146fd-8fc4-44f7-9661-c5a3f557b6ad None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:19.477316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e437993-3d62-4345-8515-308ff23e33d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:19.477812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e437993-3d62-4345-8515-308ff23e33d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:19.478088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e437993-3d62-4345-8515-308ff23e33d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:19.478353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e437993-3d62-4345-8515-308ff23e33d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:19.479020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e437993-3d62-4345-8515-308ff23e33d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:19.479446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e437993-3d62-4345-8515-308ff23e33d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:19.481245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e437993-3d62-4345-8515-308ff23e33d8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:19.502745 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3395/6733] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:19.503913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e437993-3d62-4345-8515-308ff23e33d8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:19.506661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b906bbcbacaa4eb8b121adb2bff8628c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.511504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b906bbcbacaa4eb8b121adb2bff8628c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.518395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e437993-3d62-4345-8515-308ff23e33d8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:19.524784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5458b8-4106-4bad-8641-d8130fbdc2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:19.525393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5458b8-4106-4bad-8641-d8130fbdc2ed admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:19.525670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5458b8-4106-4bad-8641-d8130fbdc2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:19.525947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5458b8-4106-4bad-8641-d8130fbdc2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:19.526715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5458b8-4106-4bad-8641-d8130fbdc2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:19.528525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5458b8-4106-4bad-8641-d8130fbdc2ed admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:19.530199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b906bbcbacaa4eb8b121adb2bff8628c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.542666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b906bbcbacaa4eb8b121adb2bff8628c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.549568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b906bbcbacaa4eb8b121adb2bff8628c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:19.567958 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3339/6734] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:19 2022] DELETE /identity/v3/users/b906bbcbacaa4eb8b121adb2bff8628c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:19.599186 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3396/6735] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:19 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:19.604042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:19.606461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:19.618728 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:19.711668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703f67d-7883-46d3-92a6-b0f05e2e9edc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:19.794346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb44b9-657b-46d4-aaaa-19a6b4d9a08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:19.795344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb44b9-657b-46d4-aaaa-19a6b4d9a08f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:19.795615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb44b9-657b-46d4-aaaa-19a6b4d9a08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:19.799688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb44b9-657b-46d4-aaaa-19a6b4d9a08f admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:19.800240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb44b9-657b-46d4-aaaa-19a6b4d9a08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:19.802347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb44b9-657b-46d4-aaaa-19a6b4d9a08f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:19.839035 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3340/6736] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:19 2022] POST /identity/v3/users => generated 284 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:19.843235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5458b8-4106-4bad-8641-d8130fbdc2ed admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:19.871115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5458b8-4106-4bad-8641-d8130fbdc2ed admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:19.878067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e99951-8d8c-43f1-b64c-005d5188d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:19.878862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e99951-8d8c-43f1-b64c-005d5188d03c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:19.879963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e99951-8d8c-43f1-b64c-005d5188d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:19.880510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e99951-8d8c-43f1-b64c-005d5188d03c admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:19.881093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e99951-8d8c-43f1-b64c-005d5188d03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:19.883833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e99951-8d8c-43f1-b64c-005d5188d03c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:19.902969 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3397/6737] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:33:19.907004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb44b9-657b-46d4-aaaa-19a6b4d9a08f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:19.944862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb44b9-657b-46d4-aaaa-19a6b4d9a08f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:19.967844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582ea1f-ba31-43f1-a569-9fce567ff1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:19.968431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582ea1f-ba31-43f1-a569-9fce567ff1aa admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:19.968672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582ea1f-ba31-43f1-a569-9fce567ff1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:19.969113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582ea1f-ba31-43f1-a569-9fce567ff1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:19.970148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582ea1f-ba31-43f1-a569-9fce567ff1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:19.971782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582ea1f-ba31-43f1-a569-9fce567ff1aa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:20.002497 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3341/6738] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:20.003798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e99951-8d8c-43f1-b64c-005d5188d03c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:20.026417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e99951-8d8c-43f1-b64c-005d5188d03c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:20.046754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb40eeb-545f-4c80-ac2e-13832767ace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:20.049052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb40eeb-545f-4c80-ac2e-13832767ace5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:20.049316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb40eeb-545f-4c80-ac2e-13832767ace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:20.050347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb40eeb-545f-4c80-ac2e-13832767ace5 admin admin] PATH_INFO: `/v3/projects/17660cfc13244ad0aab678c363d073ef/users/b14f79e2fa8840959b37b28df6a6722d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:20.099826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb40eeb-545f-4c80-ac2e-13832767ace5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17660cfc13244ad0aab678c363d073ef, user_id=b14f79e2fa8840959b37b28df6a6722d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:20.107502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb40eeb-545f-4c80-ac2e-13832767ace5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:20.134979 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3398/6739] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:20 2022] PUT /identity/v3/projects/17660cfc13244ad0aab678c363d073ef/users/b14f79e2fa8840959b37b28df6a6722d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:20.145952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eb3f5-eb59-4e31-b494-ee1571f3637e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:20.146429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eb3f5-eb59-4e31-b494-ee1571f3637e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:20.146621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eb3f5-eb59-4e31-b494-ee1571f3637e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:20.213124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a45eb3f5-eb59-4e31-b494-ee1571f3637e None None] MFA Rules not processed for user `b14f79e2fa8840959b37b28df6a6722d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:20.214636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a45eb3f5-eb59-4e31-b494-ee1571f3637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:20.331583 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3342/6740] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:20.335005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb40eeb-545f-4c80-ac2e-13832767ace5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:20.449127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb40eeb-545f-4c80-ac2e-13832767ace5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:20.453931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55e918-4b36-45ac-b710-3c855c864600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:20.455285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55e918-4b36-45ac-b710-3c855c864600 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:20.455567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55e918-4b36-45ac-b710-3c855c864600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:20.455844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55e918-4b36-45ac-b710-3c855c864600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:20.456475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55e918-4b36-45ac-b710-3c855c864600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:20.459620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55e918-4b36-45ac-b710-3c855c864600 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:20.505922 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3399/6741] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:20 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:20.510129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45eb3f5-eb59-4e31-b494-ee1571f3637e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:20.526803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45eb3f5-eb59-4e31-b494-ee1571f3637e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:20.586161 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:20.609857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55e918-4b36-45ac-b710-3c855c864600 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:20.611907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8e55e918-4b36-45ac-b710-3c855c864600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:20.655572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26dca8-56c1-4512-a83c-a4ed8467290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:20.658508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26dca8-56c1-4512-a83c-a4ed8467290f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:20.659027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26dca8-56c1-4512-a83c-a4ed8467290f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:20.659164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26dca8-56c1-4512-a83c-a4ed8467290f admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:20.659723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26dca8-56c1-4512-a83c-a4ed8467290f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:20.665758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26dca8-56c1-4512-a83c-a4ed8467290f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:20.724027 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:20.725503 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3343/6742] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:20 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:20.728916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26dca8-56c1-4512-a83c-a4ed8467290f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:20.748625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26dca8-56c1-4512-a83c-a4ed8467290f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:20.756875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889cbaf-2946-4d39-b5c3-b02b1bdba88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:20.757872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889cbaf-2946-4d39-b5c3-b02b1bdba88e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:20.758643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889cbaf-2946-4d39-b5c3-b02b1bdba88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:20.759195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889cbaf-2946-4d39-b5c3-b02b1bdba88e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:20.760082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889cbaf-2946-4d39-b5c3-b02b1bdba88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:20.762241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889cbaf-2946-4d39-b5c3-b02b1bdba88e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:20.779023 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3344/6743] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:20.784023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889cbaf-2946-4d39-b5c3-b02b1bdba88e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:20.785054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55e918-4b36-45ac-b710-3c855c864600 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:20.808616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e25c4-c622-42c9-8d6d-508ab552ff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:20.809243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e25c4-c622-42c9-8d6d-508ab552ff99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:20.809523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e25c4-c622-42c9-8d6d-508ab552ff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:20.809799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e25c4-c622-42c9-8d6d-508ab552ff99 admin admin] PATH_INFO: `/v3/projects/85137a5e354e4a4283e73e573bd03211` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:20.812335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e25c4-c622-42c9-8d6d-508ab552ff99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85137a5e354e4a4283e73e573bd03211)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:20.812873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889cbaf-2946-4d39-b5c3-b02b1bdba88e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:20.814387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e25c4-c622-42c9-8d6d-508ab552ff99 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:20.824024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd9473-f738-45a5-8dbb-0591cd44dce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:20.826204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd9473-f738-45a5-8dbb-0591cd44dce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:20.826715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd9473-f738-45a5-8dbb-0591cd44dce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:20.827277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd9473-f738-45a5-8dbb-0591cd44dce6 admin admin] PATH_INFO: `/v3/projects/e0e09220949a4928bd64fe5690ba6aa9/users/fddd3a729b8f4c1b9465a951f4c7c082/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:20.858066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd9473-f738-45a5-8dbb-0591cd44dce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e09220949a4928bd64fe5690ba6aa9, user_id=fddd3a729b8f4c1b9465a951f4c7c082, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:20.862654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd9473-f738-45a5-8dbb-0591cd44dce6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:20.886470 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3345/6744] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:20 2022] PUT /identity/v3/projects/e0e09220949a4928bd64fe5690ba6aa9/users/fddd3a729b8f4c1b9465a951f4c7c082/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:20.893631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd9473-f738-45a5-8dbb-0591cd44dce6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:20.945170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a19e25c4-c622-42c9-8d6d-508ab552ff99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85137a5e354e4a4283e73e573bd03211', 'request_id': 'req-a19e25c4-c622-42c9-8d6d-508ab552ff99'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:20.960282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a19e25c4-c622-42c9-8d6d-508ab552ff99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85137a5e354e4a4283e73e573bd03211', 'request_id': 'req-a19e25c4-c622-42c9-8d6d-508ab552ff99'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:20.979167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a19e25c4-c622-42c9-8d6d-508ab552ff99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85137a5e354e4a4283e73e573bd03211', 'request_id': 'req-a19e25c4-c622-42c9-8d6d-508ab552ff99'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:21.001808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a19e25c4-c622-42c9-8d6d-508ab552ff99 admin admin] The token cache is being invalidate because project 85137a5e354e4a4283e73e573bd03211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:21.002344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a19e25c4-c622-42c9-8d6d-508ab552ff99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:21.006826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a19e25c4-c622-42c9-8d6d-508ab552ff99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:21.011336 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3400/6745] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:20 2022] DELETE /identity/v3/projects/85137a5e354e4a4283e73e573bd03211 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:21.015954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d27b5b-3683-4108-b9dc-2b9f307a5c5c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:21.016243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d27b5b-3683-4108-b9dc-2b9f307a5c5c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:21.019322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d27b5b-3683-4108-b9dc-2b9f307a5c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:21.027897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd9473-f738-45a5-8dbb-0591cd44dce6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:21.086600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-81d27b5b-3683-4108-b9dc-2b9f307a5c5c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:21.087811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-81d27b5b-3683-4108-b9dc-2b9f307a5c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:21.107104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb66af-9f7b-4ed1-9415-3f37e6e4d0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:21.109190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb66af-9f7b-4ed1-9415-3f37e6e4d0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:21.110646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb66af-9f7b-4ed1-9415-3f37e6e4d0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:21.111544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb66af-9f7b-4ed1-9415-3f37e6e4d0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:21.112791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb66af-9f7b-4ed1-9415-3f37e6e4d0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:21.116484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb66af-9f7b-4ed1-9415-3f37e6e4d0a2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:21.134707 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3346/6746] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:21.139499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb66af-9f7b-4ed1-9415-3f37e6e4d0a2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:21.143821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0deb66af-9f7b-4ed1-9415-3f37e6e4d0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:21.161718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb66af-9f7b-4ed1-9415-3f37e6e4d0a2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:21.176535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a142c-c0b8-4c23-bf2a-a5da82d258a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:21.178486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a142c-c0b8-4c23-bf2a-a5da82d258a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:21.178993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a142c-c0b8-4c23-bf2a-a5da82d258a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:21.179454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a142c-c0b8-4c23-bf2a-a5da82d258a8 admin admin] PATH_INFO: `/v3/projects/e0e09220949a4928bd64fe5690ba6aa9/users/fddd3a729b8f4c1b9465a951f4c7c082/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:21.182329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a142c-c0b8-4c23-bf2a-a5da82d258a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e09220949a4928bd64fe5690ba6aa9, user_id=fddd3a729b8f4c1b9465a951f4c7c082, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:21.186135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a142c-c0b8-4c23-bf2a-a5da82d258a8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:21.186754 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3401/6747] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:21.199821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b642d3-64fc-4ff5-9fc3-086b011d8f8b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:21.200967 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3347/6748] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:21 2022] PUT /identity/v3/projects/e0e09220949a4928bd64fe5690ba6aa9/users/fddd3a729b8f4c1b9465a951f4c7c082/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:21.201217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b642d3-64fc-4ff5-9fc3-086b011d8f8b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:21.202256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b642d3-64fc-4ff5-9fc3-086b011d8f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:21.212921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31c190-4ca3-4cb3-b164-963a2a8dbd34 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:21.213209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31c190-4ca3-4cb3-b164-963a2a8dbd34 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:21.213488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31c190-4ca3-4cb3-b164-963a2a8dbd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:21.231666 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:21.252633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4b31c190-4ca3-4cb3-b164-963a2a8dbd34 None None] MFA Rules not processed for user `fddd3a729b8f4c1b9465a951f4c7c082`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:21.253869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4b31c190-4ca3-4cb3-b164-963a2a8dbd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:21.254054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e9b642d3-64fc-4ff5-9fc3-086b011d8f8b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:21.256047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e9b642d3-64fc-4ff5-9fc3-086b011d8f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:21.383825 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3348/6749] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:21.392118 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3402/6750] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:21.396536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31c190-4ca3-4cb3-b164-963a2a8dbd34 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:21.396726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b642d3-64fc-4ff5-9fc3-086b011d8f8b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:21.408298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31c190-4ca3-4cb3-b164-963a2a8dbd34 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:21.410491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b642d3-64fc-4ff5-9fc3-086b011d8f8b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:21.414086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f936c1-0570-4e13-983e-e978e5b35357 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:21.415155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f936c1-0570-4e13-983e-e978e5b35357 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:21.415670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f936c1-0570-4e13-983e-e978e5b35357 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:21.415862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942613b-bff9-492d-83f2-bdf852f6e89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:21.416384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f936c1-0570-4e13-983e-e978e5b35357 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:21.416616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942613b-bff9-492d-83f2-bdf852f6e89a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:21.416902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942613b-bff9-492d-83f2-bdf852f6e89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:21.417231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942613b-bff9-492d-83f2-bdf852f6e89a admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:21.418084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942613b-bff9-492d-83f2-bdf852f6e89a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:21.418381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f936c1-0570-4e13-983e-e978e5b35357 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:21.418496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942613b-bff9-492d-83f2-bdf852f6e89a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:21.420406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f936c1-0570-4e13-983e-e978e5b35357 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:21.420618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942613b-bff9-492d-83f2-bdf852f6e89a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:21.423297 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:21.445603 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3403/6751] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:21.452062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942613b-bff9-492d-83f2-bdf852f6e89a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:21.457914 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3349/6752] 10.222.0.39 () {60 vars in 1150 bytes} [Sun Oct 16 01:33:21 2022] POST /identity/v3/domains => generated 276 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:21.459396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f936c1-0570-4e13-983e-e978e5b35357 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:21.466114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942613b-bff9-492d-83f2-bdf852f6e89a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:21.570108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f936c1-0570-4e13-983e-e978e5b35357 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:21.575461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967981b-3d06-4b34-a2b0-576b99f977fc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:21.576605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967981b-3d06-4b34-a2b0-576b99f977fc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:21.576891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967981b-3d06-4b34-a2b0-576b99f977fc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:21.578009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967981b-3d06-4b34-a2b0-576b99f977fc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:21.578714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967981b-3d06-4b34-a2b0-576b99f977fc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:21.582390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967981b-3d06-4b34-a2b0-576b99f977fc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:21.593829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e88221-c922-4561-bf44-b2dc1dcbbfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:21.595204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e88221-c922-4561-bf44-b2dc1dcbbfc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:21.595417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e88221-c922-4561-bf44-b2dc1dcbbfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:21.596813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e88221-c922-4561-bf44-b2dc1dcbbfc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:21.596813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e88221-c922-4561-bf44-b2dc1dcbbfc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:21.598661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e88221-c922-4561-bf44-b2dc1dcbbfc2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:21.609858 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3350/6753] 10.222.0.39 () {60 vars in 1150 bytes} [Sun Oct 16 01:33:21 2022] POST /identity/v3/domains => generated 276 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:21.624197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967981b-3d06-4b34-a2b0-576b99f977fc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:21.649121 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3404/6754] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:21 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:21.650170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e88221-c922-4561-bf44-b2dc1dcbbfc2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:21.740234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967981b-3d06-4b34-a2b0-576b99f977fc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:21.769069 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:21.780323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e88221-c922-4561-bf44-b2dc1dcbbfc2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:21.793006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58392d74-deaa-4b8d-94a3-ab4dbf04e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:21.794591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58392d74-deaa-4b8d-94a3-ab4dbf04e073 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:21.794876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58392d74-deaa-4b8d-94a3-ab4dbf04e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:21.796628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58392d74-deaa-4b8d-94a3-ab4dbf04e073 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:21.797292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58392d74-deaa-4b8d-94a3-ab4dbf04e073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:21.801692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58392d74-deaa-4b8d-94a3-ab4dbf04e073 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:21.849232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb399d4c-6809-4c13-a871-036a4f8f6280 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:21.850073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb399d4c-6809-4c13-a871-036a4f8f6280 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:21.850453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb399d4c-6809-4c13-a871-036a4f8f6280 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:21.850998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb399d4c-6809-4c13-a871-036a4f8f6280 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:21.851807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb399d4c-6809-4c13-a871-036a4f8f6280 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:21.854623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb399d4c-6809-4c13-a871-036a4f8f6280 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:21.862643 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3405/6755] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:21 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:21.866375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58392d74-deaa-4b8d-94a3-ab4dbf04e073 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:21.887439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58392d74-deaa-4b8d-94a3-ab4dbf04e073 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:21.896822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91fb29-0263-423c-a1a1-ce64ea1c67d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:21.897706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91fb29-0263-423c-a1a1-ce64ea1c67d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:21.898091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91fb29-0263-423c-a1a1-ce64ea1c67d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:21.898609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91fb29-0263-423c-a1a1-ce64ea1c67d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:21.899723 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3351/6756] 10.222.0.39 () {60 vars in 1150 bytes} [Sun Oct 16 01:33:21 2022] POST /identity/v3/domains => generated 275 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:21.903430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91fb29-0263-423c-a1a1-ce64ea1c67d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:21.906657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb399d4c-6809-4c13-a871-036a4f8f6280 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:21.909800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91fb29-0263-423c-a1a1-ce64ea1c67d5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:21.930416 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3406/6757] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:33:21.931696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91fb29-0263-423c-a1a1-ce64ea1c67d5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:21.935278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4c91fb29-0263-423c-a1a1-ce64ea1c67d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:22.011212 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:22.012716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb399d4c-6809-4c13-a871-036a4f8f6280 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:22.024897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55841e-487c-40fb-960b-da02fb816504 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:22.025538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55841e-487c-40fb-960b-da02fb816504 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:22.025815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55841e-487c-40fb-960b-da02fb816504 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:22.026352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55841e-487c-40fb-960b-da02fb816504 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:22.027275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55841e-487c-40fb-960b-da02fb816504 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:22.030847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55841e-487c-40fb-960b-da02fb816504 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:22.062985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91fb29-0263-423c-a1a1-ce64ea1c67d5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:22.067655 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3352/6758] 10.222.0.39 () {60 vars in 1150 bytes} [Sun Oct 16 01:33:21 2022] POST /identity/v3/domains => generated 280 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:22.068527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55841e-487c-40fb-960b-da02fb816504 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:22.189754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8971e4e-dc6c-4e97-af8f-c4e71adb0532 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:22.190953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8971e4e-dc6c-4e97-af8f-c4e71adb0532 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:22.191309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8971e4e-dc6c-4e97-af8f-c4e71adb0532 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:22.191643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8971e4e-dc6c-4e97-af8f-c4e71adb0532 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:22.193943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f8971e4e-dc6c-4e97-af8f-c4e71adb0532 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:22.207941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55841e-487c-40fb-960b-da02fb816504 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:22.211396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8971e4e-dc6c-4e97-af8f-c4e71adb0532 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:22.212804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5be70f-eb4c-4d52-8188-6b04b2834704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:22.213427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be70f-eb4c-4d52-8188-6b04b2834704 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:22.213709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be70f-eb4c-4d52-8188-6b04b2834704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:22.213985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be70f-eb4c-4d52-8188-6b04b2834704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:22.214636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5be70f-eb4c-4d52-8188-6b04b2834704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:22.214906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8971e4e-dc6c-4e97-af8f-c4e71adb0532 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:22.216276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5be70f-eb4c-4d52-8188-6b04b2834704 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:22.233637 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3353/6759] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:22.234507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5be70f-eb4c-4d52-8188-6b04b2834704 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:22.239481 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3407/6760] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:22.240511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8971e4e-dc6c-4e97-af8f-c4e71adb0532 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:22.254428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8971e4e-dc6c-4e97-af8f-c4e71adb0532 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:22.260883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bbe86-cbf9-4514-a979-9ffe966ee223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:22.261655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bbe86-cbf9-4514-a979-9ffe966ee223 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:22.262001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bbe86-cbf9-4514-a979-9ffe966ee223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:22.262562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bbe86-cbf9-4514-a979-9ffe966ee223 admin admin] PATH_INFO: `/v3/projects/aa44de13a18f4057a7aa203e99104468/users/3824035c58fc4119bd1e3a84f186d5cb/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:22.302461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bbe86-cbf9-4514-a979-9ffe966ee223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa44de13a18f4057a7aa203e99104468, user_id=3824035c58fc4119bd1e3a84f186d5cb, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:22.306429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bbe86-cbf9-4514-a979-9ffe966ee223 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:22.340064 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:22.340200 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3408/6761] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:22 2022] PUT /identity/v3/projects/aa44de13a18f4057a7aa203e99104468/users/3824035c58fc4119bd1e3a84f186d5cb/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:22.350658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697decc-a826-4758-b72d-b30d518a1ad2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:22.351247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697decc-a826-4758-b72d-b30d518a1ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:22.351527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697decc-a826-4758-b72d-b30d518a1ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:22.384701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5be70f-eb4c-4d52-8188-6b04b2834704 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:22.385608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c697decc-a826-4758-b72d-b30d518a1ad2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:22.387040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c697decc-a826-4758-b72d-b30d518a1ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:22.505764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:22.506429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:22.506778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:22.507443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/6735808702a246148f8188bde9fea0b0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:22.537486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6735808702a246148f8188bde9fea0b0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:22.543465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:22.554194 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3409/6762] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:22.584540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697decc-a826-4758-b72d-b30d518a1ad2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:22.588995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c697decc-a826-4758-b72d-b30d518a1ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:22.607325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6735808702a246148f8188bde9fea0b0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:22.639954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6735808702a246148f8188bde9fea0b0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:22.743622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697decc-a826-4758-b72d-b30d518a1ad2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:22.757349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6735808702a246148f8188bde9fea0b0', 'request_id': 'req-6468103a-3a5b-4193-9486-d45e7f50ef1a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:22.771487 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:22.787893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6735808702a246148f8188bde9fea0b0', 'request_id': 'req-6468103a-3a5b-4193-9486-d45e7f50ef1a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:22.808667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6735808702a246148f8188bde9fea0b0', 'request_id': 'req-6468103a-3a5b-4193-9486-d45e7f50ef1a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:22.838468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] The token cache is being invalidate because project 6735808702a246148f8188bde9fea0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:22.839481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:22.842662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:22.854690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6735808702a246148f8188bde9fea0b0', 'request_id': 'req-6468103a-3a5b-4193-9486-d45e7f50ef1a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:22.855418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6735808702a246148f8188bde9fea0b0', 'request_id': 'req-6468103a-3a5b-4193-9486-d45e7f50ef1a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:22.856025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6735808702a246148f8188bde9fea0b0', 'request_id': 'req-6468103a-3a5b-4193-9486-d45e7f50ef1a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:22.868180 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3354/6763] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:33:22 2022] DELETE /identity/v3/domains/6735808702a246148f8188bde9fea0b0 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:22.872669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761c960-1088-430a-ac78-11f5a09f08c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:22.873396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761c960-1088-430a-ac78-11f5a09f08c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:22.873675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761c960-1088-430a-ac78-11f5a09f08c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:22.873998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761c960-1088-430a-ac78-11f5a09f08c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:22.877151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0761c960-1088-430a-ac78-11f5a09f08c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:22.879672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:22.893560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:22.967282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761c960-1088-430a-ac78-11f5a09f08c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:22.968741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761c960-1088-430a-ac78-11f5a09f08c8 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:22.980651 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3410/6764] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:23.012963 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:23.074125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468103a-3a5b-4193-9486-d45e7f50ef1a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:23.083162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6bd86-37a0-487f-980d-9243a07b95d3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:23.083944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6bd86-37a0-487f-980d-9243a07b95d3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:23.084851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6bd86-37a0-487f-980d-9243a07b95d3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:23.085253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6bd86-37a0-487f-980d-9243a07b95d3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:23.086109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6bd86-37a0-487f-980d-9243a07b95d3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:23.087927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6bd86-37a0-487f-980d-9243a07b95d3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:23.118458 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3355/6765] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:33:22 2022] POST /identity/v3/domains => generated 249 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:23.119748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761c960-1088-430a-ac78-11f5a09f08c8 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:23.137862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761c960-1088-430a-ac78-11f5a09f08c8 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:23.300437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378756f-621d-4090-ac25-877f45f21f2c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:23.301325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378756f-621d-4090-ac25-877f45f21f2c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:23.301844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378756f-621d-4090-ac25-877f45f21f2c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:23.302214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378756f-621d-4090-ac25-877f45f21f2c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/5fbf669106b9462f9f9da48b824cd964` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:23.331125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378756f-621d-4090-ac25-877f45f21f2c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5fbf669106b9462f9f9da48b824cd964)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:23.339912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378756f-621d-4090-ac25-877f45f21f2c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:23.410354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e378756f-621d-4090-ac25-877f45f21f2c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5fbf669106b9462f9f9da48b824cd964'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.412060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e378756f-621d-4090-ac25-877f45f21f2c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5fbf669106b9462f9f9da48b824cd964'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.461508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e378756f-621d-4090-ac25-877f45f21f2c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5fbf669106b9462f9f9da48b824cd964'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.462137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e378756f-621d-4090-ac25-877f45f21f2c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5fbf669106b9462f9f9da48b824cd964'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.466108 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3411/6766] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:23 2022] PATCH /identity/v3/domains/5fbf669106b9462f9f9da48b824cd964 => generated 250 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:23.471545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6bd86-37a0-487f-980d-9243a07b95d3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:23.474530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8af6bd86-37a0-487f-980d-9243a07b95d3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:23.496946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6bd86-37a0-487f-980d-9243a07b95d3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:23.587253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:23.589331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:23.589968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:23.590504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/5fbf669106b9462f9f9da48b824cd964` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:23.607306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5fbf669106b9462f9f9da48b824cd964)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:23.611387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:23.649999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5fbf669106b9462f9f9da48b824cd964'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.663036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5fbf669106b9462f9f9da48b824cd964'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.770836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbf669106b9462f9f9da48b824cd964', 'request_id': 'req-1d698eb3-c6aa-43b2-91b7-169fe6900dba'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.791455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbf669106b9462f9f9da48b824cd964', 'request_id': 'req-1d698eb3-c6aa-43b2-91b7-169fe6900dba'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.816717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbf669106b9462f9f9da48b824cd964', 'request_id': 'req-1d698eb3-c6aa-43b2-91b7-169fe6900dba'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.843598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] The token cache is being invalidate because project 5fbf669106b9462f9f9da48b824cd964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:23.844050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.844718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.868789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5fbf669106b9462f9f9da48b824cd964', 'request_id': 'req-1d698eb3-c6aa-43b2-91b7-169fe6900dba'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.871365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5fbf669106b9462f9f9da48b824cd964', 'request_id': 'req-1d698eb3-c6aa-43b2-91b7-169fe6900dba'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.872269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5fbf669106b9462f9f9da48b824cd964', 'request_id': 'req-1d698eb3-c6aa-43b2-91b7-169fe6900dba'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:23.888470 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:23.894750 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3356/6767] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:33:23 2022] DELETE /identity/v3/domains/5fbf669106b9462f9f9da48b824cd964 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:23.899996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378756f-621d-4090-ac25-877f45f21f2c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:23.933876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378756f-621d-4090-ac25-877f45f21f2c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:23.983258 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:24.073806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cac3b0-ab1f-4f0f-8fbc-414465410800 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:24.074435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cac3b0-ab1f-4f0f-8fbc-414465410800 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:24.075059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cac3b0-ab1f-4f0f-8fbc-414465410800 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:24.075257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cac3b0-ab1f-4f0f-8fbc-414465410800 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:24.075960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cac3b0-ab1f-4f0f-8fbc-414465410800 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:24.077554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cac3b0-ab1f-4f0f-8fbc-414465410800 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:24.124249 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3412/6768] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:33:23 2022] POST /identity/v3/domains => generated 278 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:24.128464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:24.130447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:24.150777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d698eb3-c6aa-43b2-91b7-169fe6900dba tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:24.334189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670abbeb-cfab-4b8e-9c57-a0836cf2399e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:24.335357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670abbeb-cfab-4b8e-9c57-a0836cf2399e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:24.338515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670abbeb-cfab-4b8e-9c57-a0836cf2399e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:24.339804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670abbeb-cfab-4b8e-9c57-a0836cf2399e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/a18bda88fbb944e88246f8349710b500` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:24.354690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7b105-7db9-451a-818a-1f99150cd458 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:24.355232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7b105-7db9-451a-818a-1f99150cd458 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:24.355460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7b105-7db9-451a-818a-1f99150cd458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:24.426428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670abbeb-cfab-4b8e-9c57-a0836cf2399e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a18bda88fbb944e88246f8349710b500)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:24.431307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670abbeb-cfab-4b8e-9c57-a0836cf2399e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:24.452394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dcb7b105-7db9-451a-818a-1f99150cd458 None None] MFA Rules not processed for user `3824035c58fc4119bd1e3a84f186d5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:24.455986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dcb7b105-7db9-451a-818a-1f99150cd458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:24.479862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-670abbeb-cfab-4b8e-9c57-a0836cf2399e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a18bda88fbb944e88246f8349710b500'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:24.480734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-670abbeb-cfab-4b8e-9c57-a0836cf2399e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a18bda88fbb944e88246f8349710b500'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:24.535785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-670abbeb-cfab-4b8e-9c57-a0836cf2399e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a18bda88fbb944e88246f8349710b500'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:24.537356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-670abbeb-cfab-4b8e-9c57-a0836cf2399e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a18bda88fbb944e88246f8349710b500'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:24.545305 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3357/6769] 10.222.0.39 () {60 vars in 1250 bytes} [Sun Oct 16 01:33:24 2022] PATCH /identity/v3/domains/a18bda88fbb944e88246f8349710b500 => generated 279 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:24.546367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670abbeb-cfab-4b8e-9c57-a0836cf2399e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:24.556238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-670abbeb-cfab-4b8e-9c57-a0836cf2399e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:24.623479 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3413/6770] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:24.629264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7b105-7db9-451a-818a-1f99150cd458 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:24.632410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dcb7b105-7db9-451a-818a-1f99150cd458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:24.685870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670abbeb-cfab-4b8e-9c57-a0836cf2399e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:24.693933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bafc1-fa17-420d-a7a2-a9c685f12b5e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:24.696083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bafc1-fa17-420d-a7a2-a9c685f12b5e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:24.696731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bafc1-fa17-420d-a7a2-a9c685f12b5e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:24.697249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bafc1-fa17-420d-a7a2-a9c685f12b5e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/a18bda88fbb944e88246f8349710b500` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:24.713117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bafc1-fa17-420d-a7a2-a9c685f12b5e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=a18bda88fbb944e88246f8349710b500)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:24.715553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bafc1-fa17-420d-a7a2-a9c685f12b5e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:24.721441 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3358/6771] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:33:24 2022] GET /identity/v3/domains/a18bda88fbb944e88246f8349710b500 => generated 279 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:24.722538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bafc1-fa17-420d-a7a2-a9c685f12b5e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:24.741869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bafc1-fa17-420d-a7a2-a9c685f12b5e tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:24.757207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:24.757949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:24.758229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:24.758496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/a18bda88fbb944e88246f8349710b500` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:24.759736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a18bda88fbb944e88246f8349710b500)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:24.761460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:24.789674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7b105-7db9-451a-818a-1f99150cd458 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:24.808213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a18bda88fbb944e88246f8349710b500'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:24.837218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a18bda88fbb944e88246f8349710b500'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:24.893017 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:24.903806 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:24.930997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df91bd-c3dd-494c-915d-fb38ab4f2626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:24.931615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df91bd-c3dd-494c-915d-fb38ab4f2626 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:24.931903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df91bd-c3dd-494c-915d-fb38ab4f2626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:24.932160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df91bd-c3dd-494c-915d-fb38ab4f2626 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:24.932796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df91bd-c3dd-494c-915d-fb38ab4f2626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:24.934709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df91bd-c3dd-494c-915d-fb38ab4f2626 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:24.959714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18bda88fbb944e88246f8349710b500', 'request_id': 'req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:24.982942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18bda88fbb944e88246f8349710b500', 'request_id': 'req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:24.987285 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3414/6772] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:24 2022] POST /identity/v3/projects => generated 371 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:24.990972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df91bd-c3dd-494c-915d-fb38ab4f2626 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:25.005234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18bda88fbb944e88246f8349710b500', 'request_id': 'req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:25.025785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] The token cache is being invalidate because project a18bda88fbb944e88246f8349710b500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:25.026076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:25.029449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:25.048143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a18bda88fbb944e88246f8349710b500', 'request_id': 'req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:25.050523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a18bda88fbb944e88246f8349710b500', 'request_id': 'req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:25.051282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a18bda88fbb944e88246f8349710b500', 'request_id': 'req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:25.069243 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3359/6773] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:33:24 2022] DELETE /identity/v3/domains/a18bda88fbb944e88246f8349710b500 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:25.073174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:25.075673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:25.126072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df91bd-c3dd-494c-915d-fb38ab4f2626 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:25.139527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07196a-7ced-4682-bf7b-b892e18a1a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:25.140157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07196a-7ced-4682-bf7b-b892e18a1a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:25.140437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07196a-7ced-4682-bf7b-b892e18a1a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:25.140711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07196a-7ced-4682-bf7b-b892e18a1a31 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:25.141935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07196a-7ced-4682-bf7b-b892e18a1a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:25.144069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07196a-7ced-4682-bf7b-b892e18a1a31 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:25.190099 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3415/6774] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:24 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:25.194061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07196a-7ced-4682-bf7b-b892e18a1a31 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:25.195873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aa07196a-7ced-4682-bf7b-b892e18a1a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:25.225519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07196a-7ced-4682-bf7b-b892e18a1a31 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:25.231619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db8d6f-8dce-4728-96ff-cb5b1533f2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:25.232235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db8d6f-8dce-4728-96ff-cb5b1533f2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:25.232518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db8d6f-8dce-4728-96ff-cb5b1533f2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:25.232790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db8d6f-8dce-4728-96ff-cb5b1533f2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:25.233435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db8d6f-8dce-4728-96ff-cb5b1533f2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:25.235592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db8d6f-8dce-4728-96ff-cb5b1533f2b3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:25.241218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dca9d5-72a0-40db-b6c6-0dc6188bd64c tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:25.268173 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3416/6775] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:25.271955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db8d6f-8dce-4728-96ff-cb5b1533f2b3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:25.300524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db8d6f-8dce-4728-96ff-cb5b1533f2b3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:25.306603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984752d-ecdf-48f9-b7c8-85027c6d89ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:25.307330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984752d-ecdf-48f9-b7c8-85027c6d89ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:25.307655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984752d-ecdf-48f9-b7c8-85027c6d89ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:25.307888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984752d-ecdf-48f9-b7c8-85027c6d89ba admin admin] PATH_INFO: `/v3/projects/91574de8cd934816bc20a7584d3b1025/users/9847f4d5f3e241aa91e02323460683bb/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:25.341161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984752d-ecdf-48f9-b7c8-85027c6d89ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=91574de8cd934816bc20a7584d3b1025, user_id=9847f4d5f3e241aa91e02323460683bb, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:25.344777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984752d-ecdf-48f9-b7c8-85027c6d89ba admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:25.368890 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3417/6776] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:25 2022] PUT /identity/v3/projects/91574de8cd934816bc20a7584d3b1025/users/9847f4d5f3e241aa91e02323460683bb/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:25.373031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984752d-ecdf-48f9-b7c8-85027c6d89ba admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:25.404002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4ba64-533b-41ad-b9c9-aacf6afc3f43 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:25.406092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4ba64-533b-41ad-b9c9-aacf6afc3f43 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:25.407837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4ba64-533b-41ad-b9c9-aacf6afc3f43 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:25.408601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4ba64-533b-41ad-b9c9-aacf6afc3f43 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:25.409472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4ba64-533b-41ad-b9c9-aacf6afc3f43 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:25.413510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4ba64-533b-41ad-b9c9-aacf6afc3f43 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:25.451626 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3360/6777] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Oct 16 01:33:25 2022] GET /identity/v3/domains => generated 1345 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:25.456781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4ba64-533b-41ad-b9c9-aacf6afc3f43 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:25.515725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4ba64-533b-41ad-b9c9-aacf6afc3f43 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:25.596584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984752d-ecdf-48f9-b7c8-85027c6d89ba admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:25.613354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319ab69-4ad8-4f9b-a3b7-778ed0ced54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:25.614124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319ab69-4ad8-4f9b-a3b7-778ed0ced54d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:25.614506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319ab69-4ad8-4f9b-a3b7-778ed0ced54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:25.614880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319ab69-4ad8-4f9b-a3b7-778ed0ced54d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:25.615681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319ab69-4ad8-4f9b-a3b7-778ed0ced54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:25.630622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319ab69-4ad8-4f9b-a3b7-778ed0ced54d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:25.652662 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:25.670910 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3418/6778] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:33:25.676141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319ab69-4ad8-4f9b-a3b7-778ed0ced54d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:25.692564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319ab69-4ad8-4f9b-a3b7-778ed0ced54d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:25.720783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dd69f-1c77-492f-9620-1ae5f558d0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:25.721605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd69f-1c77-492f-9620-1ae5f558d0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:25.722979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd69f-1c77-492f-9620-1ae5f558d0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:25.723275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd69f-1c77-492f-9620-1ae5f558d0a2 admin admin] PATH_INFO: `/v3/projects/91574de8cd934816bc20a7584d3b1025/users/9847f4d5f3e241aa91e02323460683bb/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:25.725931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e69e08-bc03-4a21-864c-078fe60e3f64 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:25.726597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e69e08-bc03-4a21-864c-078fe60e3f64 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:25.726881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e69e08-bc03-4a21-864c-078fe60e3f64 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:25.729111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e69e08-bc03-4a21-864c-078fe60e3f64 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/a18bda88fbb944e88246f8349710b500` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:25.731817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1dd69f-1c77-492f-9620-1ae5f558d0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91574de8cd934816bc20a7584d3b1025, user_id=9847f4d5f3e241aa91e02323460683bb, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:25.734514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1dd69f-1c77-492f-9620-1ae5f558d0a2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:25.749385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e69e08-bc03-4a21-864c-078fe60e3f64 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-10e69e08-bc03-4a21-864c-078fe60e3f64 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Could not find domain: a18bda88fbb944e88246f8349710b500.: keystone.exception.DomainNotFound: Could not find domain: a18bda88fbb944e88246f8349710b500. Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a18bda88fbb944e88246f8349710b500. Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:25.759196 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:25.760463 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a18bda88fbb944e88246f8349710b500. Oct 16 01:33:25.761522 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:25.762686 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3361/6779] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:25 2022] PATCH /identity/v3/domains/a18bda88fbb944e88246f8349710b500 => generated 112 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:33:25.768829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e69e08-bc03-4a21-864c-078fe60e3f64 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:25.771667 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3419/6780] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:25 2022] PUT /identity/v3/projects/91574de8cd934816bc20a7584d3b1025/users/9847f4d5f3e241aa91e02323460683bb/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:25.811535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e69e08-bc03-4a21-864c-078fe60e3f64 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:25.953533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb97fd-0056-4b29-af78-55590ae1b792 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:25.954648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb97fd-0056-4b29-af78-55590ae1b792 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:25.955007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb97fd-0056-4b29-af78-55590ae1b792 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:25.955477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb97fd-0056-4b29-af78-55590ae1b792 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:25.957024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb97fd-0056-4b29-af78-55590ae1b792 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:25.959766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb97fd-0056-4b29-af78-55590ae1b792 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:25.996130 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3362/6781] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:33:25 2022] POST /identity/v3/domains => generated 276 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:26.000575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dd69f-1c77-492f-9620-1ae5f558d0a2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:26.017856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dd69f-1c77-492f-9620-1ae5f558d0a2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:26.049234 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:26.170805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7f443-370a-4520-8d88-5e034a1c5ac0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:26.171460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7f443-370a-4520-8d88-5e034a1c5ac0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:26.171743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7f443-370a-4520-8d88-5e034a1c5ac0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:26.172017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7f443-370a-4520-8d88-5e034a1c5ac0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:26.175142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7f443-370a-4520-8d88-5e034a1c5ac0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:26.179300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7f443-370a-4520-8d88-5e034a1c5ac0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:26.256650 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3420/6782] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:25 2022] POST /identity/v3/users => generated 348 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:26.260928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb97fd-0056-4b29-af78-55590ae1b792 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:26.281193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb97fd-0056-4b29-af78-55590ae1b792 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:26.295438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20ccf0-fb98-4b28-a268-8d6b4d080d8d tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:26.296965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20ccf0-fb98-4b28-a268-8d6b4d080d8d tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:26.297256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20ccf0-fb98-4b28-a268-8d6b4d080d8d tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:26.297595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20ccf0-fb98-4b28-a268-8d6b4d080d8d tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/groups` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:26.300355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20ccf0-fb98-4b28-a268-8d6b4d080d8d tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:26.305536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20ccf0-fb98-4b28-a268-8d6b4d080d8d tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:26.334761 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3363/6783] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:33:26 2022] POST /identity/v3/groups => generated 323 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:26.336324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7f443-370a-4520-8d88-5e034a1c5ac0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:26.356781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7f443-370a-4520-8d88-5e034a1c5ac0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:26.371190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6970918-0492-4fb8-b27a-7a7e4be2e906 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:26.371913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6970918-0492-4fb8-b27a-7a7e4be2e906 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:26.372693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6970918-0492-4fb8-b27a-7a7e4be2e906 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:26.372995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6970918-0492-4fb8-b27a-7a7e4be2e906 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/1f185244333542138c01d4e4e093e91b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:26.374850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6970918-0492-4fb8-b27a-7a7e4be2e906 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1f185244333542138c01d4e4e093e91b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:26.377857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6970918-0492-4fb8-b27a-7a7e4be2e906 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:26.431686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6970918-0492-4fb8-b27a-7a7e4be2e906 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1f185244333542138c01d4e4e093e91b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:26.433163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6970918-0492-4fb8-b27a-7a7e4be2e906 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1f185244333542138c01d4e4e093e91b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:26.496896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6970918-0492-4fb8-b27a-7a7e4be2e906 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1f185244333542138c01d4e4e093e91b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:26.499616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6970918-0492-4fb8-b27a-7a7e4be2e906 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1f185244333542138c01d4e4e093e91b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:26.505337 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3421/6784] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:26 2022] PATCH /identity/v3/domains/1f185244333542138c01d4e4e093e91b => generated 277 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:33:26.509066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20ccf0-fb98-4b28-a268-8d6b4d080d8d tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:26.511252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba20ccf0-fb98-4b28-a268-8d6b4d080d8d tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:26.540082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20ccf0-fb98-4b28-a268-8d6b4d080d8d tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:26.730009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:26.730761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:26.731811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:26.732383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/1f185244333542138c01d4e4e093e91b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:26.773381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1f185244333542138c01d4e4e093e91b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:26.775055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:26.848975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1f185244333542138c01d4e4e093e91b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:26.901428 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:27.134249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a0530bf7804d0e9e5ae86ff48c6d5c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.135006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a0530bf7804d0e9e5ae86ff48c6d5c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.166716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a0530bf7804d0e9e5ae86ff48c6d5c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.192339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a0530bf7804d0e9e5ae86ff48c6d5c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.193282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a0530bf7804d0e9e5ae86ff48c6d5c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.219613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1f185244333542138c01d4e4e093e91b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.322064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f185244333542138c01d4e4e093e91b', 'request_id': 'req-200f0b2f-34a8-4fbf-a851-988e10f448d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.333072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f185244333542138c01d4e4e093e91b', 'request_id': 'req-200f0b2f-34a8-4fbf-a851-988e10f448d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.346897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f185244333542138c01d4e4e093e91b', 'request_id': 'req-200f0b2f-34a8-4fbf-a851-988e10f448d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.365475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] The token cache is being invalidate because project 1f185244333542138c01d4e4e093e91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:27.366054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.366884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.380715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1f185244333542138c01d4e4e093e91b', 'request_id': 'req-200f0b2f-34a8-4fbf-a851-988e10f448d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.381654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1f185244333542138c01d4e4e093e91b', 'request_id': 'req-200f0b2f-34a8-4fbf-a851-988e10f448d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.383100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-200f0b2f-34a8-4fbf-a851-988e10f448d4 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1f185244333542138c01d4e4e093e91b', 'request_id': 'req-200f0b2f-34a8-4fbf-a851-988e10f448d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:27.394704 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3364/6785] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:33:26 2022] DELETE /identity/v3/domains/1f185244333542138c01d4e4e093e91b => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:27.399781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6970918-0492-4fb8-b27a-7a7e4be2e906 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:27.413379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6970918-0492-4fb8-b27a-7a7e4be2e906 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:27.466398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a1423-13f9-4bde-b945-034372b70ff0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:27.466731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a1423-13f9-4bde-b945-034372b70ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:27.467125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a1423-13f9-4bde-b945-034372b70ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:27.491020 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=25,keystone:SELECT=73,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:27.541896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9a8a1423-13f9-4bde-b945-034372b70ff0 None None] MFA Rules not processed for user `9847f4d5f3e241aa91e02323460683bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:27.543087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9a8a1423-13f9-4bde-b945-034372b70ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:27.616133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dffe9-5ba6-4c27-8d63-0916da176c12 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:27.616619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dffe9-5ba6-4c27-8d63-0916da176c12 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:27.616905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dffe9-5ba6-4c27-8d63-0916da176c12 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:27.617176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dffe9-5ba6-4c27-8d63-0916da176c12 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/1f185244333542138c01d4e4e093e91b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:27.647720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5dffe9-5ba6-4c27-8d63-0916da176c12 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=1f185244333542138c01d4e4e093e91b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:27.649602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5dffe9-5ba6-4c27-8d63-0916da176c12 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-ea5dffe9-5ba6-4c27-8d63-0916da176c12 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Could not find domain: 1f185244333542138c01d4e4e093e91b.: keystone.exception.DomainNotFound: Could not find domain: 1f185244333542138c01d4e4e093e91b. Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1f185244333542138c01d4e4e093e91b. Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:27.687456 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:33:27.688685 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1f185244333542138c01d4e4e093e91b. Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:33:27.689766 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3422/6786] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:33:27 2022] GET /identity/v3/domains/1f185244333542138c01d4e4e093e91b => generated 112 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:33:27.695997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dffe9-5ba6-4c27-8d63-0916da176c12 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:27.703642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ea5dffe9-5ba6-4c27-8d63-0916da176c12 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:27.747043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dffe9-5ba6-4c27-8d63-0916da176c12 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:27.755815 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3365/6787] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:27.767393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c3503-39b6-41b8-80b5-ae212c0c67a2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:27.767869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c3503-39b6-41b8-80b5-ae212c0c67a2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:27.768377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c3503-39b6-41b8-80b5-ae212c0c67a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:27.770213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeb0b8-f512-4e98-9232-86c1e3cd19cf tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:27.771101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeb0b8-f512-4e98-9232-86c1e3cd19cf tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:27.771410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeb0b8-f512-4e98-9232-86c1e3cd19cf tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:27.771672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeb0b8-f512-4e98-9232-86c1e3cd19cf tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/users/58a0530bf7804d0e9e5ae86ff48c6d5c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:27.784462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeb0b8-f512-4e98-9232-86c1e3cd19cf tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:get_user(user_id=58a0530bf7804d0e9e5ae86ff48c6d5c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:27.787260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeb0b8-f512-4e98-9232-86c1e3cd19cf tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-74eeb0b8-f512-4e98-9232-86c1e3cd19cf tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Could not find user: 58a0530bf7804d0e9e5ae86ff48c6d5c.: keystone.exception.UserNotFound: Could not find user: 58a0530bf7804d0e9e5ae86ff48c6d5c. Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 01:33:27.802437 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:33:27.803629 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:33:27.804716 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:33:27.804716 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:33:27.804716 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:33:27.804716 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:33:27.804716 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 01:33:27.804716 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 01:33:27.804716 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 01:33:27.804716 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 01:33:27.804716 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 01:33:27.804716 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 01:33:27.804716 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 58a0530bf7804d0e9e5ae86ff48c6d5c. Oct 16 01:33:27.804716 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:33:27.808124 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3423/6788] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:33:27 2022] GET /identity/v3/users/58a0530bf7804d0e9e5ae86ff48c6d5c => generated 110 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:33:27.821307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeb0b8-f512-4e98-9232-86c1e3cd19cf tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:27.840279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f85c3503-39b6-41b8-80b5-ae212c0c67a2 None None] MFA Rules not processed for user `3824035c58fc4119bd1e3a84f186d5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:27.843088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f85c3503-39b6-41b8-80b5-ae212c0c67a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:27.844981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeb0b8-f512-4e98-9232-86c1e3cd19cf tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:27.865974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c467057-98d1-4214-b09e-80dce6d13287 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:27.866794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c467057-98d1-4214-b09e-80dce6d13287 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:27.867209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c467057-98d1-4214-b09e-80dce6d13287 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:27.867498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c467057-98d1-4214-b09e-80dce6d13287 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/groups/11c5b076865c419f8c5e671a1a56fdc5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:27.882403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c467057-98d1-4214-b09e-80dce6d13287 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:get_group(group_id=11c5b076865c419f8c5e671a1a56fdc5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:27.901916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c467057-98d1-4214-b09e-80dce6d13287 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3c467057-98d1-4214-b09e-80dce6d13287 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Could not find group: 11c5b076865c419f8c5e671a1a56fdc5.: keystone.exception.GroupNotFound: Could not find group: 11c5b076865c419f8c5e671a1a56fdc5. Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 16 01:33:27.956060 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:33:27.957093 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:33:27.958155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:33:27.958155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:33:27.958155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:33:27.958155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:33:27.958155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 16 01:33:27.958155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 16 01:33:27.958155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 16 01:33:27.958155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 16 01:33:27.958155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 16 01:33:27.958155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 16 01:33:27.958155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 11c5b076865c419f8c5e671a1a56fdc5. Oct 16 01:33:27.958155 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:33:27.958155 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3424/6789] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:27 2022] GET /identity/v3/groups/11c5b076865c419f8c5e671a1a56fdc5 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:33:27.963880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c467057-98d1-4214-b09e-80dce6d13287 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:27.997069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c467057-98d1-4214-b09e-80dce6d13287 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:28.029964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17896a4-d634-4ffd-be70-b130c6469d08 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:28.031384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17896a4-d634-4ffd-be70-b130c6469d08 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:28.032084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17896a4-d634-4ffd-be70-b130c6469d08 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:28.032521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17896a4-d634-4ffd-be70-b130c6469d08 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/groups/11c5b076865c419f8c5e671a1a56fdc5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:28.039565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17896a4-d634-4ffd-be70-b130c6469d08 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-a17896a4-d634-4ffd-be70-b130c6469d08 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Could not find group: 11c5b076865c419f8c5e671a1a56fdc5.: keystone.exception.GroupNotFound: Could not find group: 11c5b076865c419f8c5e671a1a56fdc5. Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 16 01:33:28.045306 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 01:33:28.046246 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 11c5b076865c419f8c5e671a1a56fdc5. Oct 16 01:33:28.047388 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:33:28.050083 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3425/6790] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:33:27 2022] DELETE /identity/v3/groups/11c5b076865c419f8c5e671a1a56fdc5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:33:28.059212 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3366/6791] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:28.062759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17896a4-d634-4ffd-be70-b130c6469d08 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:28.076540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a17896a4-d634-4ffd-be70-b130c6469d08 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:28.080382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c3503-39b6-41b8-80b5-ae212c0c67a2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:28.099878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c3503-39b6-41b8-80b5-ae212c0c67a2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:28.103753 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:28.116006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8a94a-0498-4ee8-961b-26bd513c1201 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:28.116683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8a94a-0498-4ee8-961b-26bd513c1201 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:28.116985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8a94a-0498-4ee8-961b-26bd513c1201 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:28.117283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8a94a-0498-4ee8-961b-26bd513c1201 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/users/58a0530bf7804d0e9e5ae86ff48c6d5c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:28.133897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8a94a-0498-4ee8-961b-26bd513c1201 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:delete_user(user_id=58a0530bf7804d0e9e5ae86ff48c6d5c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:28.135910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8a94a-0498-4ee8-961b-26bd513c1201 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-93b8a94a-0498-4ee8-961b-26bd513c1201 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Could not find user: 58a0530bf7804d0e9e5ae86ff48c6d5c.: keystone.exception.UserNotFound: Could not find user: 58a0530bf7804d0e9e5ae86ff48c6d5c. Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 16 01:33:28.160864 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:33:28.161843 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 58a0530bf7804d0e9e5ae86ff48c6d5c. Oct 16 01:33:28.162967 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:28.167730 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3367/6792] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:28 2022] DELETE /identity/v3/users/58a0530bf7804d0e9e5ae86ff48c6d5c => generated 110 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:33:28.168723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8a94a-0498-4ee8-961b-26bd513c1201 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:28.189746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8a94a-0498-4ee8-961b-26bd513c1201 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:28.199446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a248a38-12cb-4a82-8bf1-1e7e8903e768 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:28.200125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a248a38-12cb-4a82-8bf1-1e7e8903e768 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:28.200427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a248a38-12cb-4a82-8bf1-1e7e8903e768 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:28.200648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a248a38-12cb-4a82-8bf1-1e7e8903e768 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/1f185244333542138c01d4e4e093e91b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:28.222040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a248a38-12cb-4a82-8bf1-1e7e8903e768 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:33:28.242584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17896a4-d634-4ffd-be70-b130c6469d08 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-7a248a38-12cb-4a82-8bf1-1e7e8903e768 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Could not find domain: 1f185244333542138c01d4e4e093e91b.: keystone.exception.DomainNotFound: Could not find domain: 1f185244333542138c01d4e4e093e91b. Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1f185244333542138c01d4e4e093e91b. Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:28.246907 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:28.248152 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1f185244333542138c01d4e4e093e91b. Oct 16 01:33:28.249333 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:28.257144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afa9dd-281f-49bc-8127-46ad8dba56b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:28.257671 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3368/6793] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:28 2022] PATCH /identity/v3/domains/1f185244333542138c01d4e4e093e91b => generated 112 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:33:28.257838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afa9dd-281f-49bc-8127-46ad8dba56b3 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:28.258125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afa9dd-281f-49bc-8127-46ad8dba56b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:28.258397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afa9dd-281f-49bc-8127-46ad8dba56b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:28.259268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a248a38-12cb-4a82-8bf1-1e7e8903e768 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:28.264268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e0afa9dd-281f-49bc-8127-46ad8dba56b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:28.286126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a248a38-12cb-4a82-8bf1-1e7e8903e768 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:28.289875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afa9dd-281f-49bc-8127-46ad8dba56b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:28.291527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afa9dd-281f-49bc-8127-46ad8dba56b3 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:28.301489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2d7ac-4027-4679-90d7-e2c657ae34bc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:28.301768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2d7ac-4027-4679-90d7-e2c657ae34bc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:28.301967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2d7ac-4027-4679-90d7-e2c657ae34bc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:28.303576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2d7ac-4027-4679-90d7-e2c657ae34bc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:28.304241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2d7ac-4027-4679-90d7-e2c657ae34bc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:28.306939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2d7ac-4027-4679-90d7-e2c657ae34bc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:28.335474 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3426/6794] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:28.355500 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3369/6795] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Oct 16 01:33:28 2022] GET /identity/v3/domains => generated 1345 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:28.356161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afa9dd-281f-49bc-8127-46ad8dba56b3 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:28.369532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afa9dd-281f-49bc-8127-46ad8dba56b3 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:28.374717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561d11a-7136-449c-9d35-7517d2f824a2 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:28.376514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561d11a-7136-449c-9d35-7517d2f824a2 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:28.376995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561d11a-7136-449c-9d35-7517d2f824a2 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:28.377936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561d11a-7136-449c-9d35-7517d2f824a2 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:28.378787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561d11a-7136-449c-9d35-7517d2f824a2 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:28.379278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561d11a-7136-449c-9d35-7517d2f824a2 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:28.381057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561d11a-7136-449c-9d35-7517d2f824a2 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:28.468142 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3427/6796] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:33:28 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:28.473631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2d7ac-4027-4679-90d7-e2c657ae34bc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:28.495510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2d7ac-4027-4679-90d7-e2c657ae34bc tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:28.517169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24341-c01b-4995-91eb-a53806ae8f78 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:28.517676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24341-c01b-4995-91eb-a53806ae8f78 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:28.517963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24341-c01b-4995-91eb-a53806ae8f78 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:28.518238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24341-c01b-4995-91eb-a53806ae8f78 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:28.518892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24341-c01b-4995-91eb-a53806ae8f78 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1296405123) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:28.519221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24341-c01b-4995-91eb-a53806ae8f78 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:28.520990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24341-c01b-4995-91eb-a53806ae8f78 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:28.556446 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3370/6797] 10.222.0.39 () {58 vars in 1199 bytes} [Sun Oct 16 01:33:28 2022] GET /identity/v3/domains?name=tempest-test_domain-1296405123 => generated 408 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:28.557165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561d11a-7136-449c-9d35-7517d2f824a2 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:28.591123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561d11a-7136-449c-9d35-7517d2f824a2 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:28.636368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151d720-0344-4ddb-94ae-5963aa8f1a61 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:28.637026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151d720-0344-4ddb-94ae-5963aa8f1a61 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:28.637311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151d720-0344-4ddb-94ae-5963aa8f1a61 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:28.637585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151d720-0344-4ddb-94ae-5963aa8f1a61 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/1f185244333542138c01d4e4e093e91b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:28.674810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151d720-0344-4ddb-94ae-5963aa8f1a61 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-1151d720-0344-4ddb-94ae-5963aa8f1a61 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Could not find domain: 1f185244333542138c01d4e4e093e91b.: keystone.exception.DomainNotFound: Could not find domain: 1f185244333542138c01d4e4e093e91b. Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1f185244333542138c01d4e4e093e91b. Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:28.690941 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:28.692067 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1f185244333542138c01d4e4e093e91b. Oct 16 01:33:28.693123 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:33:28.706542 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3428/6798] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:28 2022] PATCH /identity/v3/domains/1f185244333542138c01d4e4e093e91b => generated 112 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 16 01:33:28.711561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24341-c01b-4995-91eb-a53806ae8f78 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:28.729071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24341-c01b-4995-91eb-a53806ae8f78 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:28.742405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e4aff-3563-4fa3-a3df-6fdef8526d89 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:28.744467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e4aff-3563-4fa3-a3df-6fdef8526d89 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:28.746798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e4aff-3563-4fa3-a3df-6fdef8526d89 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:28.747211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e4aff-3563-4fa3-a3df-6fdef8526d89 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/43419ce1d58347f392ad1d8934fde7c4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:28.781578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e4aff-3563-4fa3-a3df-6fdef8526d89 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=43419ce1d58347f392ad1d8934fde7c4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:28.784733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e4aff-3563-4fa3-a3df-6fdef8526d89 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:28.849771 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:28.865230 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3371/6799] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:28 2022] PATCH /identity/v3/domains/43419ce1d58347f392ad1d8934fde7c4 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:28.868982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151d720-0344-4ddb-94ae-5963aa8f1a61 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:28.886187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151d720-0344-4ddb-94ae-5963aa8f1a61 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:28.896592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:28.897658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:28.897951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:28.898232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/43419ce1d58347f392ad1d8934fde7c4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:28.923783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=43419ce1d58347f392ad1d8934fde7c4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:28.925429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:28.983540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '43419ce1d58347f392ad1d8934fde7c4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:28.999655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '43419ce1d58347f392ad1d8934fde7c4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.093382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43419ce1d58347f392ad1d8934fde7c4', 'request_id': 'req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.104523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43419ce1d58347f392ad1d8934fde7c4', 'request_id': 'req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.135908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43419ce1d58347f392ad1d8934fde7c4', 'request_id': 'req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.148590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] The token cache is being invalidate because project 43419ce1d58347f392ad1d8934fde7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:29.148964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.149572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.165501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '43419ce1d58347f392ad1d8934fde7c4', 'request_id': 'req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.166264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '43419ce1d58347f392ad1d8934fde7c4', 'request_id': 'req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.166906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '43419ce1d58347f392ad1d8934fde7c4', 'request_id': 'req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.191250 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3429/6800] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:33:28 2022] DELETE /identity/v3/domains/43419ce1d58347f392ad1d8934fde7c4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:29.194864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e4aff-3563-4fa3-a3df-6fdef8526d89 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:29.197824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a92e4aff-3563-4fa3-a3df-6fdef8526d89 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:29.245712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e4aff-3563-4fa3-a3df-6fdef8526d89 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:29.346101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499e45a-2b54-420b-b440-0b7d98b976f3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:29.347149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499e45a-2b54-420b-b440-0b7d98b976f3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:29.347551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499e45a-2b54-420b-b440-0b7d98b976f3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:29.347937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499e45a-2b54-420b-b440-0b7d98b976f3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/1c864ce8e0754a2486f4120588ce5fa9` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:29.369574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499e45a-2b54-420b-b440-0b7d98b976f3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1c864ce8e0754a2486f4120588ce5fa9)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:29.371534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499e45a-2b54-420b-b440-0b7d98b976f3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:29.405119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7499e45a-2b54-420b-b440-0b7d98b976f3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1c864ce8e0754a2486f4120588ce5fa9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.406313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7499e45a-2b54-420b-b440-0b7d98b976f3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1c864ce8e0754a2486f4120588ce5fa9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.454656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7499e45a-2b54-420b-b440-0b7d98b976f3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1c864ce8e0754a2486f4120588ce5fa9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.455935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7499e45a-2b54-420b-b440-0b7d98b976f3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1c864ce8e0754a2486f4120588ce5fa9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.459093 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3372/6801] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:29 2022] PATCH /identity/v3/domains/1c864ce8e0754a2486f4120588ce5fa9 => generated 277 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:29.463940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:29.472368 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:29.478237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce1acd-9c89-409b-9bb1-af8ae524f6f0 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:29.597227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:29.598639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:29.599034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:29.599387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/1c864ce8e0754a2486f4120588ce5fa9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:29.614960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1c864ce8e0754a2486f4120588ce5fa9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:29.616872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:29.647633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1c864ce8e0754a2486f4120588ce5fa9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.660903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1c864ce8e0754a2486f4120588ce5fa9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.724367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c864ce8e0754a2486f4120588ce5fa9', 'request_id': 'req-14db8034-bd30-4c41-80c0-bf5bbf6de106'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.739081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c864ce8e0754a2486f4120588ce5fa9', 'request_id': 'req-14db8034-bd30-4c41-80c0-bf5bbf6de106'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.750583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c864ce8e0754a2486f4120588ce5fa9', 'request_id': 'req-14db8034-bd30-4c41-80c0-bf5bbf6de106'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.766759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] The token cache is being invalidate because project 1c864ce8e0754a2486f4120588ce5fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:29.767341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.767904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.779784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1c864ce8e0754a2486f4120588ce5fa9', 'request_id': 'req-14db8034-bd30-4c41-80c0-bf5bbf6de106'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.780775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1c864ce8e0754a2486f4120588ce5fa9', 'request_id': 'req-14db8034-bd30-4c41-80c0-bf5bbf6de106'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.781617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1c864ce8e0754a2486f4120588ce5fa9', 'request_id': 'req-14db8034-bd30-4c41-80c0-bf5bbf6de106'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:29.811649 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3430/6802] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:33:29 2022] DELETE /identity/v3/domains/1c864ce8e0754a2486f4120588ce5fa9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:29.816199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499e45a-2b54-420b-b440-0b7d98b976f3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:29.817721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7499e45a-2b54-420b-b440-0b7d98b976f3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:29.838181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499e45a-2b54-420b-b440-0b7d98b976f3 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:29.977161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eee82f-43fc-4396-b86d-5ddd125038a9 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:29.977839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eee82f-43fc-4396-b86d-5ddd125038a9 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:29.978122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eee82f-43fc-4396-b86d-5ddd125038a9 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:29.978395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eee82f-43fc-4396-b86d-5ddd125038a9 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/bdce8a5195874779b94ed2d6f5f4ac60` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:30.002904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eee82f-43fc-4396-b86d-5ddd125038a9 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bdce8a5195874779b94ed2d6f5f4ac60)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:30.004827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eee82f-43fc-4396-b86d-5ddd125038a9 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:30.071823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d5eee82f-43fc-4396-b86d-5ddd125038a9 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bdce8a5195874779b94ed2d6f5f4ac60'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.076377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d5eee82f-43fc-4396-b86d-5ddd125038a9 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bdce8a5195874779b94ed2d6f5f4ac60'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.128762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d5eee82f-43fc-4396-b86d-5ddd125038a9 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bdce8a5195874779b94ed2d6f5f4ac60'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.129607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d5eee82f-43fc-4396-b86d-5ddd125038a9 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bdce8a5195874779b94ed2d6f5f4ac60'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.133373 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3373/6803] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:29 2022] PATCH /identity/v3/domains/bdce8a5195874779b94ed2d6f5f4ac60 => generated 277 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:30.137206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:30.138898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:30.159585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db8034-bd30-4c41-80c0-bf5bbf6de106 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:30.258080 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:30.307392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddd3a729b8f4c1b9465a951f4c7c082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0e09220949a4928bd64fe5690ba6aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:30.308121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:30.308409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:30.311344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] PATH_INFO: `/v3/domains/bdce8a5195874779b94ed2d6f5f4ac60` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:30.326510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bdce8a5195874779b94ed2d6f5f4ac60)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:30.329476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:30.359272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bdce8a5195874779b94ed2d6f5f4ac60'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.374000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bdce8a5195874779b94ed2d6f5f4ac60'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.468617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdce8a5195874779b94ed2d6f5f4ac60', 'request_id': 'req-8e08bebd-9047-43f6-b681-0c39c0934d3a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.479817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdce8a5195874779b94ed2d6f5f4ac60', 'request_id': 'req-8e08bebd-9047-43f6-b681-0c39c0934d3a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.492628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdce8a5195874779b94ed2d6f5f4ac60', 'request_id': 'req-8e08bebd-9047-43f6-b681-0c39c0934d3a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.517285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] The token cache is being invalidate because project bdce8a5195874779b94ed2d6f5f4ac60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:30.517737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.523370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.544951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bdce8a5195874779b94ed2d6f5f4ac60', 'request_id': 'req-8e08bebd-9047-43f6-b681-0c39c0934d3a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.547470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bdce8a5195874779b94ed2d6f5f4ac60', 'request_id': 'req-8e08bebd-9047-43f6-b681-0c39c0934d3a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.549616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bdce8a5195874779b94ed2d6f5f4ac60', 'request_id': 'req-8e08bebd-9047-43f6-b681-0c39c0934d3a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.568820 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3431/6804] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:33:30 2022] DELETE /identity/v3/domains/bdce8a5195874779b94ed2d6f5f4ac60 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:30.573254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eee82f-43fc-4396-b86d-5ddd125038a9 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:30.574959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d5eee82f-43fc-4396-b86d-5ddd125038a9 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:30.630329 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:30.711649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eee82f-43fc-4396-b86d-5ddd125038a9 tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:30.824954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d590dac-8b60-4434-8644-36b9bda59d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:30.826213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d590dac-8b60-4434-8644-36b9bda59d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:30.826615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d590dac-8b60-4434-8644-36b9bda59d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:30.826891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d590dac-8b60-4434-8644-36b9bda59d68 admin admin] PATH_INFO: `/v3/users/b14f79e2fa8840959b37b28df6a6722d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:30.830969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d590dac-8b60-4434-8644-36b9bda59d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14f79e2fa8840959b37b28df6a6722d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:30.833430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d590dac-8b60-4434-8644-36b9bda59d68 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:30.885864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:30.888322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:30.964474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6d590dac-8b60-4434-8644-36b9bda59d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14f79e2fa8840959b37b28df6a6722d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.965955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6d590dac-8b60-4434-8644-36b9bda59d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14f79e2fa8840959b37b28df6a6722d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.985184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6d590dac-8b60-4434-8644-36b9bda59d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14f79e2fa8840959b37b28df6a6722d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.995726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6d590dac-8b60-4434-8644-36b9bda59d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14f79e2fa8840959b37b28df6a6722d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:30.996488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6d590dac-8b60-4434-8644-36b9bda59d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14f79e2fa8840959b37b28df6a6722d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:31.010145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08bebd-9047-43f6-b681-0c39c0934d3a tempest-DomainsTestJSON-1369986240 tempest-DomainsTestJSON-1369986240-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:31.019778 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3374/6805] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:30 2022] DELETE /identity/v3/users/b14f79e2fa8840959b37b28df6a6722d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:31.020208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce448db8-16d6-47b2-83a3-4d8233f841f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:31.020853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448db8-16d6-47b2-83a3-4d8233f841f3 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:31.021542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada958-8919-4cd1-bc89-2b57492077e2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:31.021659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada958-8919-4cd1-bc89-2b57492077e2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:31.021741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448db8-16d6-47b2-83a3-4d8233f841f3 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:31.022139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada958-8919-4cd1-bc89-2b57492077e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:31.022249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448db8-16d6-47b2-83a3-4d8233f841f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:31.024230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ce448db8-16d6-47b2-83a3-4d8233f841f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:31.039928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce448db8-16d6-47b2-83a3-4d8233f841f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:31.042204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce448db8-16d6-47b2-83a3-4d8233f841f3 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:31.044437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6eada958-8919-4cd1-bc89-2b57492077e2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:31.046148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6eada958-8919-4cd1-bc89-2b57492077e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:31.064738 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3432/6806] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:31.124275 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:31.228619 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3375/6807] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:31.242640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce448db8-16d6-47b2-83a3-4d8233f841f3 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:31.244296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ce448db8-16d6-47b2-83a3-4d8233f841f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:31.260467 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:31.374148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce448db8-16d6-47b2-83a3-4d8233f841f3 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:31.511434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458100b-a682-4cc1-aaf6-b01f0545cdb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:31.512954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458100b-a682-4cc1-aaf6-b01f0545cdb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:31.513566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458100b-a682-4cc1-aaf6-b01f0545cdb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:31.514051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458100b-a682-4cc1-aaf6-b01f0545cdb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:31.528927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458100b-a682-4cc1-aaf6-b01f0545cdb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:31.530659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458100b-a682-4cc1-aaf6-b01f0545cdb9 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:31.542318 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3433/6808] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:32.577139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eada958-8919-4cd1-bc89-2b57492077e2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:32.583741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6eada958-8919-4cd1-bc89-2b57492077e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:32.635938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eada958-8919-4cd1-bc89-2b57492077e2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:32.661500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:32.662229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:32.662573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:32.662922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] PATH_INFO: `/v3/projects/17660cfc13244ad0aab678c363d073ef` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:32.669144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17660cfc13244ad0aab678c363d073ef)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:32.670633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:32.787420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17660cfc13244ad0aab678c363d073ef', 'request_id': 'req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:32.806337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17660cfc13244ad0aab678c363d073ef', 'request_id': 'req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:32.830626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17660cfc13244ad0aab678c363d073ef', 'request_id': 'req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:32.851964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] The token cache is being invalidate because project 17660cfc13244ad0aab678c363d073ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:32.852387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:32.853136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:32.855192 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3376/6809] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:32 2022] DELETE /identity/v3/projects/17660cfc13244ad0aab678c363d073ef => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:32.859270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458100b-a682-4cc1-aaf6-b01f0545cdb9 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:32.877858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458100b-a682-4cc1-aaf6-b01f0545cdb9 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:33.054539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cafb9-8d6e-4713-be1b-8cbfcc7c9ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:33.055223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cafb9-8d6e-4713-be1b-8cbfcc7c9ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:33.055499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cafb9-8d6e-4713-be1b-8cbfcc7c9ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:33.055860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cafb9-8d6e-4713-be1b-8cbfcc7c9ee7 admin admin] PATH_INFO: `/v3/users/fddd3a729b8f4c1b9465a951f4c7c082` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:33.063044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cafb9-8d6e-4713-be1b-8cbfcc7c9ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddd3a729b8f4c1b9465a951f4c7c082)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:33.066067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cafb9-8d6e-4713-be1b-8cbfcc7c9ee7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:33.200946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7f8cafb9-8d6e-4713-be1b-8cbfcc7c9ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddd3a729b8f4c1b9465a951f4c7c082'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:33.201537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7f8cafb9-8d6e-4713-be1b-8cbfcc7c9ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddd3a729b8f4c1b9465a951f4c7c082'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:33.265015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7f8cafb9-8d6e-4713-be1b-8cbfcc7c9ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddd3a729b8f4c1b9465a951f4c7c082'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:33.279685 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:33.293742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7f8cafb9-8d6e-4713-be1b-8cbfcc7c9ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddd3a729b8f4c1b9465a951f4c7c082'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:33.298042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7f8cafb9-8d6e-4713-be1b-8cbfcc7c9ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddd3a729b8f4c1b9465a951f4c7c082'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:33.374176 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3434/6810] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:32 2022] DELETE /identity/v3/users/fddd3a729b8f4c1b9465a951f4c7c082 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:34.218392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:34.224051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:34.256491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41746bb9-4b1c-4ef4-8cce-0fd36a6a8e54 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:34.397107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:34.397923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:34.398063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:34.398317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d admin admin] PATH_INFO: `/v3/projects/e0e09220949a4928bd64fe5690ba6aa9` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:34.403517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e09220949a4928bd64fe5690ba6aa9)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:34.409459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:34.510305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e09220949a4928bd64fe5690ba6aa9', 'request_id': 'req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:34.524160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e09220949a4928bd64fe5690ba6aa9', 'request_id': 'req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:34.538938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e09220949a4928bd64fe5690ba6aa9', 'request_id': 'req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:34.548766 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:34.577605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bf6c7-4855-4864-a4b0-ec32fe0b3408 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:34.579503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bf6c7-4855-4864-a4b0-ec32fe0b3408 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:34.579967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bf6c7-4855-4864-a4b0-ec32fe0b3408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:34.593322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d admin admin] The token cache is being invalidate because project e0e09220949a4928bd64fe5690ba6aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:34.593632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:34.594511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-33aa6f52-b2ed-48e6-951c-a77b94ebbe7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:34.598962 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3377/6811] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:34 2022] DELETE /identity/v3/projects/e0e09220949a4928bd64fe5690ba6aa9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:34.603296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45714a9e-2e09-4f37-8e3a-ebdef32a1c97 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:34.603584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45714a9e-2e09-4f37-8e3a-ebdef32a1c97 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:34.604395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45714a9e-2e09-4f37-8e3a-ebdef32a1c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:34.619918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-448bf6c7-4855-4864-a4b0-ec32fe0b3408 None None] MFA Rules not processed for user `6dfd2de312f74480b4026fb1eff0a4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:34.623673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-448bf6c7-4855-4864-a4b0-ec32fe0b3408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:34.676718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-45714a9e-2e09-4f37-8e3a-ebdef32a1c97 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:34.682824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-45714a9e-2e09-4f37-8e3a-ebdef32a1c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:34.780537 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3435/6812] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:34.833262 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3378/6813] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:34.844244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64844f83-b06c-4258-a89c-0e792cad48f7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:34.844942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64844f83-b06c-4258-a89c-0e792cad48f7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:34.845363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64844f83-b06c-4258-a89c-0e792cad48f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:34.882214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-64844f83-b06c-4258-a89c-0e792cad48f7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:34.884061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-64844f83-b06c-4258-a89c-0e792cad48f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:34.906331 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3436/6814] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:34.911664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45714a9e-2e09-4f37-8e3a-ebdef32a1c97 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:34.927563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45714a9e-2e09-4f37-8e3a-ebdef32a1c97 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:34.936253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204daa10-06ec-4751-b205-a9fb2b3c16e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:34.937751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204daa10-06ec-4751-b205-a9fb2b3c16e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:34.938695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204daa10-06ec-4751-b205-a9fb2b3c16e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:34.939234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204daa10-06ec-4751-b205-a9fb2b3c16e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:34.942417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204daa10-06ec-4751-b205-a9fb2b3c16e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:34.942847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204daa10-06ec-4751-b205-a9fb2b3c16e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:34.944581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204daa10-06ec-4751-b205-a9fb2b3c16e1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:34.979326 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3379/6815] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:34.996230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64844f83-b06c-4258-a89c-0e792cad48f7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:35.015165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64844f83-b06c-4258-a89c-0e792cad48f7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:35.022020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a10419-a0a4-4a08-a40e-b2d84291e870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:35.022772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10419-a0a4-4a08-a40e-b2d84291e870 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:35.023199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10419-a0a4-4a08-a40e-b2d84291e870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:35.023576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10419-a0a4-4a08-a40e-b2d84291e870 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:35.024326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a10419-a0a4-4a08-a40e-b2d84291e870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:35.029585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a10419-a0a4-4a08-a40e-b2d84291e870 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:35.083701 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3437/6816] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:34 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:35.087666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204daa10-06ec-4751-b205-a9fb2b3c16e1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:35.101418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204daa10-06ec-4751-b205-a9fb2b3c16e1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:35.232136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cee398-1145-462c-8721-308d5b6e7dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:35.233904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cee398-1145-462c-8721-308d5b6e7dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:35.234848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cee398-1145-462c-8721-308d5b6e7dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:35.235635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cee398-1145-462c-8721-308d5b6e7dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:35.237059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cee398-1145-462c-8721-308d5b6e7dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:35.240062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cee398-1145-462c-8721-308d5b6e7dc3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:35.272152 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3380/6817] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:35 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:35.276381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a10419-a0a4-4a08-a40e-b2d84291e870 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:35.302247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a10419-a0a4-4a08-a40e-b2d84291e870 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:35.312118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d2209-24a4-4d6a-91c8-eaea3cf5b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:35.312936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2209-24a4-4d6a-91c8-eaea3cf5b171 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:35.315251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2209-24a4-4d6a-91c8-eaea3cf5b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:35.315797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2209-24a4-4d6a-91c8-eaea3cf5b171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:35.321925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d2209-24a4-4d6a-91c8-eaea3cf5b171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:35.325534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d2209-24a4-4d6a-91c8-eaea3cf5b171 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:35.350269 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3438/6818] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:35.354974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cee398-1145-462c-8721-308d5b6e7dc3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:35.370059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cee398-1145-462c-8721-308d5b6e7dc3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:35.385234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d25088-97f9-45ab-96ff-26b1a94fe21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:35.386455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d25088-97f9-45ab-96ff-26b1a94fe21e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:35.387002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d25088-97f9-45ab-96ff-26b1a94fe21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:35.388097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d25088-97f9-45ab-96ff-26b1a94fe21e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:35.389096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d25088-97f9-45ab-96ff-26b1a94fe21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:35.390995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d25088-97f9-45ab-96ff-26b1a94fe21e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:35.410132 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3381/6819] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:35.410335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d2209-24a4-4d6a-91c8-eaea3cf5b171 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:35.427433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d2209-24a4-4d6a-91c8-eaea3cf5b171 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:35.435013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de536c-1fbd-460a-92ee-f96ec62c0941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:35.436123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de536c-1fbd-460a-92ee-f96ec62c0941 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:35.436630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de536c-1fbd-460a-92ee-f96ec62c0941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:35.437138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de536c-1fbd-460a-92ee-f96ec62c0941 admin admin] PATH_INFO: `/v3/projects/f5ae4cb4193045cfba630cd5f27f34fb/users/9718002323e64c3eacfaeeb690c9bbab/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:35.464638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de536c-1fbd-460a-92ee-f96ec62c0941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ae4cb4193045cfba630cd5f27f34fb, user_id=9718002323e64c3eacfaeeb690c9bbab, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:35.468154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de536c-1fbd-460a-92ee-f96ec62c0941 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:35.510554 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3439/6820] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:35 2022] PUT /identity/v3/projects/f5ae4cb4193045cfba630cd5f27f34fb/users/9718002323e64c3eacfaeeb690c9bbab/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:35.514729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e65b11-ed78-4cd9-abd0-74bdae9d2451 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:35.515242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e65b11-ed78-4cd9-abd0-74bdae9d2451 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:35.515692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e65b11-ed78-4cd9-abd0-74bdae9d2451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:35.600329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e5e65b11-ed78-4cd9-abd0-74bdae9d2451 None None] MFA Rules not processed for user `9718002323e64c3eacfaeeb690c9bbab`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:35.601629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e5e65b11-ed78-4cd9-abd0-74bdae9d2451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:35.692054 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:35.757413 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3382/6821] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:35.759313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de536c-1fbd-460a-92ee-f96ec62c0941 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:35.949242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de536c-1fbd-460a-92ee-f96ec62c0941 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:35.970759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5788b-9c5f-44e8-8425-3c54fac94b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:35.971559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5788b-9c5f-44e8-8425-3c54fac94b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:35.971943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5788b-9c5f-44e8-8425-3c54fac94b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:35.972317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5788b-9c5f-44e8-8425-3c54fac94b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:35.973062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5788b-9c5f-44e8-8425-3c54fac94b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:35.975135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5788b-9c5f-44e8-8425-3c54fac94b2a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:36.053179 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3440/6822] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:35 2022] POST /identity/v3/projects => generated 377 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:36.055593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e65b11-ed78-4cd9-abd0-74bdae9d2451 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:36.073615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e65b11-ed78-4cd9-abd0-74bdae9d2451 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:36.282300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcf25a-ea23-4d9f-b56c-48bacff32725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:36.283997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf25a-ea23-4d9f-b56c-48bacff32725 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:36.284286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf25a-ea23-4d9f-b56c-48bacff32725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:36.284549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf25a-ea23-4d9f-b56c-48bacff32725 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:36.292359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcf25a-ea23-4d9f-b56c-48bacff32725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:36.302759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcf25a-ea23-4d9f-b56c-48bacff32725 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:36.356575 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3383/6823] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:36 2022] POST /identity/v3/users => generated 295 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:36.357858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5788b-9c5f-44e8-8425-3c54fac94b2a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:36.388712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5788b-9c5f-44e8-8425-3c54fac94b2a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:36.403266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42ac63-da34-4858-be51-0d20e4cbfe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:36.403891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42ac63-da34-4858-be51-0d20e4cbfe14 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:36.404176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42ac63-da34-4858-be51-0d20e4cbfe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:36.404436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42ac63-da34-4858-be51-0d20e4cbfe14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:36.405076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42ac63-da34-4858-be51-0d20e4cbfe14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:36.409186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42ac63-da34-4858-be51-0d20e4cbfe14 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:36.450533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcf25a-ea23-4d9f-b56c-48bacff32725 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:36.461865 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3441/6824] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:36.466513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcf25a-ea23-4d9f-b56c-48bacff32725 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:36.479553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ae3ad-5416-4066-92ed-5bbf8a6fab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:36.491487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae3ad-5416-4066-92ed-5bbf8a6fab7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:36.491773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae3ad-5416-4066-92ed-5bbf8a6fab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:36.492050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae3ad-5416-4066-92ed-5bbf8a6fab7a admin admin] PATH_INFO: `/v3/projects/4bfc3a4ac5a84f2bb39d26d62121a9ab/users/4a3161d0301b46eeaeaf92cd958813a6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:36.600861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ae3ad-5416-4066-92ed-5bbf8a6fab7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfc3a4ac5a84f2bb39d26d62121a9ab, user_id=4a3161d0301b46eeaeaf92cd958813a6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:36.611415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ae3ad-5416-4066-92ed-5bbf8a6fab7a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:36.650110 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3384/6825] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:36 2022] PUT /identity/v3/projects/4bfc3a4ac5a84f2bb39d26d62121a9ab/users/4a3161d0301b46eeaeaf92cd958813a6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:36.654893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42ac63-da34-4858-be51-0d20e4cbfe14 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:36.660512 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:36.669207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42ac63-da34-4858-be51-0d20e4cbfe14 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:36.837803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f2115-034b-401e-a224-10e44015b812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:36.838538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2115-034b-401e-a224-10e44015b812 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:36.839012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2115-034b-401e-a224-10e44015b812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:36.842716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2115-034b-401e-a224-10e44015b812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:36.843783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f2115-034b-401e-a224-10e44015b812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:36.846824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f2115-034b-401e-a224-10e44015b812 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:36.878364 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3442/6826] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:36.883069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ae3ad-5416-4066-92ed-5bbf8a6fab7a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:36.897439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ae3ad-5416-4066-92ed-5bbf8a6fab7a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:36.902955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff72b5f-eb4a-4bc4-a090-11a1339f7cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:36.903715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff72b5f-eb4a-4bc4-a090-11a1339f7cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:36.904043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff72b5f-eb4a-4bc4-a090-11a1339f7cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:36.904450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff72b5f-eb4a-4bc4-a090-11a1339f7cfd admin admin] PATH_INFO: `/v3/projects/4bfc3a4ac5a84f2bb39d26d62121a9ab/users/4a3161d0301b46eeaeaf92cd958813a6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:36.907821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff72b5f-eb4a-4bc4-a090-11a1339f7cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfc3a4ac5a84f2bb39d26d62121a9ab, user_id=4a3161d0301b46eeaeaf92cd958813a6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:36.911689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff72b5f-eb4a-4bc4-a090-11a1339f7cfd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:36.923753 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3385/6827] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:36 2022] PUT /identity/v3/projects/4bfc3a4ac5a84f2bb39d26d62121a9ab/users/4a3161d0301b46eeaeaf92cd958813a6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:36.936827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcf455-03b4-4c9d-9948-4ef4e2c2a48a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:36.937551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcf455-03b4-4c9d-9948-4ef4e2c2a48a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:36.938365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcf455-03b4-4c9d-9948-4ef4e2c2a48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:36.977943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-09bcf455-03b4-4c9d-9948-4ef4e2c2a48a None None] MFA Rules not processed for user `4a3161d0301b46eeaeaf92cd958813a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:36.981372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-09bcf455-03b4-4c9d-9948-4ef4e2c2a48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:37.158663 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3443/6828] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:37.160049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff72b5f-eb4a-4bc4-a090-11a1339f7cfd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:37.176553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff72b5f-eb4a-4bc4-a090-11a1339f7cfd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:37.201654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fdca8-d9fd-46d5-8714-8b326377596a tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:37.203336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fdca8-d9fd-46d5-8714-8b326377596a tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:37.205617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fdca8-d9fd-46d5-8714-8b326377596a tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:37.206872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fdca8-d9fd-46d5-8714-8b326377596a tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:37.209412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fdca8-d9fd-46d5-8714-8b326377596a tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:37.211444 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-bc4fdca8-d9fd-46d5-8714-8b326377596a tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:33:37.211444 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:33:37.211444 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:33:37.213092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fdca8-d9fd-46d5-8714-8b326377596a tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:37.254198 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3386/6829] 10.222.0.39 () {60 vars in 1185 bytes} [Sun Oct 16 01:33:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 263 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:37.259256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcf455-03b4-4c9d-9948-4ef4e2c2a48a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:37.272235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcf455-03b4-4c9d-9948-4ef4e2c2a48a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:37.289530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff56b-4d80-40ad-89b6-566966e6ccf1 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:37.290186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff56b-4d80-40ad-89b6-566966e6ccf1 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:37.290469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff56b-4d80-40ad-89b6-566966e6ccf1 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:37.290761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff56b-4d80-40ad-89b6-566966e6ccf1 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/726bea686a0f4ad0ad2cac06adfa1930` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:37.291357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eff56b-4d80-40ad-89b6-566966e6ccf1 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=726bea686a0f4ad0ad2cac06adfa1930)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:37.292367 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-d1eff56b-4d80-40ad-89b6-566966e6ccf1 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:33:37.292367 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:33:37.292367 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:33:37.293248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eff56b-4d80-40ad-89b6-566966e6ccf1 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:37.312687 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3444/6830] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:33:37 2022] GET /identity/v3/OS-OAUTH1/consumers/726bea686a0f4ad0ad2cac06adfa1930 => generated 217 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:37.314163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fdca8-d9fd-46d5-8714-8b326377596a tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:37.334041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fdca8-d9fd-46d5-8714-8b326377596a tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:37.357636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:37.358574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:37.359043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:37.359500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/726bea686a0f4ad0ad2cac06adfa1930` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:37.360802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=726bea686a0f4ad0ad2cac06adfa1930)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:37.362748 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:33:37.362748 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:33:37.362748 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:33:37.363833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:37.364289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invalidating token cache because consumer 726bea686a0f4ad0ad2cac06adfa1930 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:37.364741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:37.365740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:37.419963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '726bea686a0f4ad0ad2cac06adfa1930', 'request_id': 'req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:37.481274 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3387/6831] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:33:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/726bea686a0f4ad0ad2cac06adfa1930 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:37.482802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff56b-4d80-40ad-89b6-566966e6ccf1 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:37.484855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d1eff56b-4d80-40ad-89b6-566966e6ccf1 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:37.524871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff56b-4d80-40ad-89b6-566966e6ccf1 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:37.539232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27001d5a-6332-4f97-ad0a-4990333e9a39 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:37.540317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27001d5a-6332-4f97-ad0a-4990333e9a39 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:37.540636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27001d5a-6332-4f97-ad0a-4990333e9a39 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:37.541167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27001d5a-6332-4f97-ad0a-4990333e9a39 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:37.541837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27001d5a-6332-4f97-ad0a-4990333e9a39 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:37.547539 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-27001d5a-6332-4f97-ad0a-4990333e9a39 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:33:37.547539 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:33:37.547539 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:33:37.548556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27001d5a-6332-4f97-ad0a-4990333e9a39 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:37.579496 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3445/6832] 10.222.0.39 () {60 vars in 1185 bytes} [Sun Oct 16 01:33:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:37.581505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:37.595959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa4aa1-b9e5-4cd8-a407-546328eac6e3 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:37.601941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918535f9-bcad-4d0f-945d-56e500461396 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:37.602813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918535f9-bcad-4d0f-945d-56e500461396 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:37.603838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918535f9-bcad-4d0f-945d-56e500461396 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:37.604341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918535f9-bcad-4d0f-945d-56e500461396 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/22be3bf1d5ba4219bdde9ae69d59feb8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:37.605141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918535f9-bcad-4d0f-945d-56e500461396 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=22be3bf1d5ba4219bdde9ae69d59feb8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:37.606859 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-918535f9-bcad-4d0f-945d-56e500461396 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:33:37.606859 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:33:37.606859 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:33:37.608299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918535f9-bcad-4d0f-945d-56e500461396 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:37.613839 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3388/6833] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:33:37 2022] GET /identity/v3/OS-OAUTH1/consumers/22be3bf1d5ba4219bdde9ae69d59feb8 => generated 221 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:37.618050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27001d5a-6332-4f97-ad0a-4990333e9a39 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:37.635467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27001d5a-6332-4f97-ad0a-4990333e9a39 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:37.646971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:37.646971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:37.647661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:37.647855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/22be3bf1d5ba4219bdde9ae69d59feb8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:37.648459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=22be3bf1d5ba4219bdde9ae69d59feb8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:37.649487 n-d-master-1 devstack@keystone.service[81804]: WARNING py.warnings [None req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:33:37.649487 n-d-master-1 devstack@keystone.service[81804]: warnings.warn(msg) Oct 16 01:33:37.649487 n-d-master-1 devstack@keystone.service[81804]: Oct 16 01:33:37.650946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:37.651247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invalidating token cache because consumer 22be3bf1d5ba4219bdde9ae69d59feb8 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:37.651531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:37.652267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:37.699396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '22be3bf1d5ba4219bdde9ae69d59feb8', 'request_id': 'req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:37.729977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918535f9-bcad-4d0f-945d-56e500461396 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:37.731028 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3446/6834] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:33:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/22be3bf1d5ba4219bdde9ae69d59feb8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:37.732282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-918535f9-bcad-4d0f-945d-56e500461396 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:37.747079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918535f9-bcad-4d0f-945d-56e500461396 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:37.761386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b8242-9dc4-4aaf-a534-132b7bdd5386 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:37.762090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b8242-9dc4-4aaf-a534-132b7bdd5386 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:37.762374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b8242-9dc4-4aaf-a534-132b7bdd5386 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:37.762665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b8242-9dc4-4aaf-a534-132b7bdd5386 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/22be3bf1d5ba4219bdde9ae69d59feb8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:37.763283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b8242-9dc4-4aaf-a534-132b7bdd5386 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=22be3bf1d5ba4219bdde9ae69d59feb8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:37.764900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b8242-9dc4-4aaf-a534-132b7bdd5386 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-945b8242-9dc4-4aaf-a534-132b7bdd5386 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 16 01:33:37.796398 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 16 01:33:37.798267 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 16 01:33:37.798267 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 16 01:33:37.798267 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 16 01:33:37.798267 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 16 01:33:37.798267 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 16 01:33:37.798267 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 16 01:33:37.798267 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 16 01:33:37.798267 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 16 01:33:37.798267 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:37.800142 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3389/6835] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:33:37 2022] GET /identity/v3/OS-OAUTH1/consumers/22be3bf1d5ba4219bdde9ae69d59feb8 => generated 74 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 01:33:37.819364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:37.835718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6412c-9f7a-4d15-98ef-073854e8d4b2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:37.858744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4b0fc-3bdc-4ade-b25f-893e620f2081 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:37.864391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4b0fc-3bdc-4ade-b25f-893e620f2081 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:37.865646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4b0fc-3bdc-4ade-b25f-893e620f2081 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:37.867615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4b0fc-3bdc-4ade-b25f-893e620f2081 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/22be3bf1d5ba4219bdde9ae69d59feb8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:37.868948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4b0fc-3bdc-4ade-b25f-893e620f2081 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=22be3bf1d5ba4219bdde9ae69d59feb8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:37.873646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4b0fc-3bdc-4ade-b25f-893e620f2081 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:37.874161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcc4b0fc-3bdc-4ade-b25f-893e620f2081 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invalidating token cache because consumer 22be3bf1d5ba4219bdde9ae69d59feb8 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:37.874665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcc4b0fc-3bdc-4ade-b25f-893e620f2081 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:37.879048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcc4b0fc-3bdc-4ade-b25f-893e620f2081 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-dcc4b0fc-3bdc-4ade-b25f-893e620f2081 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 16 01:33:37.915342 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:37.916468 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:37.916468 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 16 01:33:37.916468 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 16 01:33:37.916468 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 16 01:33:37.916468 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 16 01:33:37.916468 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 16 01:33:37.916468 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 16 01:33:37.916468 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 16 01:33:37.916468 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 16 01:33:37.916468 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 16 01:33:37.916468 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:33:37.919178 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3447/6836] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:33:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/22be3bf1d5ba4219bdde9ae69d59feb8 => generated 74 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 01:33:37.924932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b8242-9dc4-4aaf-a534-132b7bdd5386 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:37.927325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-945b8242-9dc4-4aaf-a534-132b7bdd5386 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:37.944937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b8242-9dc4-4aaf-a534-132b7bdd5386 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:37.950794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8423f7-b60a-400f-a244-e252f1e9dcd0 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:37.951693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8423f7-b60a-400f-a244-e252f1e9dcd0 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:37.952188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8423f7-b60a-400f-a244-e252f1e9dcd0 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:37.952675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8423f7-b60a-400f-a244-e252f1e9dcd0 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:37.953594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8423f7-b60a-400f-a244-e252f1e9dcd0 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:37.956039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8423f7-b60a-400f-a244-e252f1e9dcd0 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:37.977441 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3390/6837] 10.222.0.39 () {60 vars in 1185 bytes} [Sun Oct 16 01:33:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:37.981169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4b0fc-3bdc-4ade-b25f-893e620f2081 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:37.995480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4b0fc-3bdc-4ade-b25f-893e620f2081 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:38.002760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829700a-74e5-42cd-aeeb-85a71c8a3be5 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:38.003399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829700a-74e5-42cd-aeeb-85a71c8a3be5 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:38.003675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829700a-74e5-42cd-aeeb-85a71c8a3be5 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:38.003953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829700a-74e5-42cd-aeeb-85a71c8a3be5 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:38.004590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829700a-74e5-42cd-aeeb-85a71c8a3be5 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:38.006308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829700a-74e5-42cd-aeeb-85a71c8a3be5 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:38.030135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8423f7-b60a-400f-a244-e252f1e9dcd0 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:38.052316 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3448/6838] 10.222.0.39 () {60 vars in 1185 bytes} [Sun Oct 16 01:33:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:38.054971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8423f7-b60a-400f-a244-e252f1e9dcd0 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:38.069142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73d71d-a285-4274-bbb4-8bef8769b7c4 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:38.079633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73d71d-a285-4274-bbb4-8bef8769b7c4 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:38.080998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73d71d-a285-4274-bbb4-8bef8769b7c4 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:38.082898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73d71d-a285-4274-bbb4-8bef8769b7c4 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:38.084955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73d71d-a285-4274-bbb4-8bef8769b7c4 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:38.088063 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-6f73d71d-a285-4274-bbb4-8bef8769b7c4 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:33:38.088063 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:33:38.088063 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:33:38.090122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73d71d-a285-4274-bbb4-8bef8769b7c4 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:38.108353 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3391/6839] 10.222.0.39 () {58 vars in 1164 bytes} [Sun Oct 16 01:33:38 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:38.114249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829700a-74e5-42cd-aeeb-85a71c8a3be5 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:38.149501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829700a-74e5-42cd-aeeb-85a71c8a3be5 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:38.176600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2a697-e7ee-4805-bf4f-09e9bc1486b9 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:38.178907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2a697-e7ee-4805-bf4f-09e9bc1486b9 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:38.179459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2a697-e7ee-4805-bf4f-09e9bc1486b9 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:38.180260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2a697-e7ee-4805-bf4f-09e9bc1486b9 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/217209695d484307962db652be2a2852` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:38.180929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2a697-e7ee-4805-bf4f-09e9bc1486b9 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=217209695d484307962db652be2a2852)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:38.184300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2a697-e7ee-4805-bf4f-09e9bc1486b9 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:38.184753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b3b2a697-e7ee-4805-bf4f-09e9bc1486b9 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invalidating token cache because consumer 217209695d484307962db652be2a2852 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:38.185230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b3b2a697-e7ee-4805-bf4f-09e9bc1486b9 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.186248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b3b2a697-e7ee-4805-bf4f-09e9bc1486b9 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.196519 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:38.217744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b3b2a697-e7ee-4805-bf4f-09e9bc1486b9 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '217209695d484307962db652be2a2852', 'request_id': 'req-b3b2a697-e7ee-4805-bf4f-09e9bc1486b9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.245728 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3449/6840] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:33:38 2022] DELETE /identity/v3/OS-OAUTH1/consumers/217209695d484307962db652be2a2852 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:38.249867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73d71d-a285-4274-bbb4-8bef8769b7c4 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:38.253394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6f73d71d-a285-4274-bbb4-8bef8769b7c4 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:38.270845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73d71d-a285-4274-bbb4-8bef8769b7c4 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:38.276039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81149-c6cc-411e-8224-9af86e309db2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:38.276694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81149-c6cc-411e-8224-9af86e309db2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:38.276985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81149-c6cc-411e-8224-9af86e309db2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:38.277611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81149-c6cc-411e-8224-9af86e309db2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/cc14e53131ec48b8a20d9f75668235a5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:38.278211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d81149-c6cc-411e-8224-9af86e309db2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=cc14e53131ec48b8a20d9f75668235a5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:38.280098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d81149-c6cc-411e-8224-9af86e309db2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:38.280309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74d81149-c6cc-411e-8224-9af86e309db2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invalidating token cache because consumer cc14e53131ec48b8a20d9f75668235a5 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:38.280595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74d81149-c6cc-411e-8224-9af86e309db2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.282335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74d81149-c6cc-411e-8224-9af86e309db2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.296620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-74d81149-c6cc-411e-8224-9af86e309db2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'cc14e53131ec48b8a20d9f75668235a5', 'request_id': 'req-74d81149-c6cc-411e-8224-9af86e309db2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.302695 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:INSERT=9,keystone:DELETE=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:38.323867 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3392/6841] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:33:38 2022] DELETE /identity/v3/OS-OAUTH1/consumers/cc14e53131ec48b8a20d9f75668235a5 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:38.329151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2a697-e7ee-4805-bf4f-09e9bc1486b9 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:38.343780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2a697-e7ee-4805-bf4f-09e9bc1486b9 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:38.349951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783aa6f-f567-4d80-9011-cc6a0f6d965c tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:38.350719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783aa6f-f567-4d80-9011-cc6a0f6d965c tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:38.351098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783aa6f-f567-4d80-9011-cc6a0f6d965c tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:38.351449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783aa6f-f567-4d80-9011-cc6a0f6d965c tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:38.352176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783aa6f-f567-4d80-9011-cc6a0f6d965c tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:38.353911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783aa6f-f567-4d80-9011-cc6a0f6d965c tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:38.380045 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3450/6842] 10.222.0.39 () {60 vars in 1185 bytes} [Sun Oct 16 01:33:38 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:38.380999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81149-c6cc-411e-8224-9af86e309db2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:38.384494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-74d81149-c6cc-411e-8224-9af86e309db2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:38.403709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81149-c6cc-411e-8224-9af86e309db2 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:38.429428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3aa1e-6824-4617-80fb-b6f457235f56 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:38.430356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3aa1e-6824-4617-80fb-b6f457235f56 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:38.430835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3aa1e-6824-4617-80fb-b6f457235f56 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:38.431293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3aa1e-6824-4617-80fb-b6f457235f56 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/aa31401cfe994d4b8218edba0fe412e7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:38.436727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3aa1e-6824-4617-80fb-b6f457235f56 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=aa31401cfe994d4b8218edba0fe412e7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:38.438004 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-0fc3aa1e-6824-4617-80fb-b6f457235f56 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:33:38.438004 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:33:38.438004 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:33:38.440087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3aa1e-6824-4617-80fb-b6f457235f56 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:38.501902 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3393/6843] 10.222.0.39 () {60 vars in 1285 bytes} [Sun Oct 16 01:33:38 2022] PATCH /identity/v3/OS-OAUTH1/consumers/aa31401cfe994d4b8218edba0fe412e7 => generated 220 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:38.506145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783aa6f-f567-4d80-9011-cc6a0f6d965c tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:38.526677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783aa6f-f567-4d80-9011-cc6a0f6d965c tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:38.531577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6f9fb-f4b9-4e2b-846a-30eba0528927 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:38.532261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6f9fb-f4b9-4e2b-846a-30eba0528927 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:38.532824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6f9fb-f4b9-4e2b-846a-30eba0528927 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:38.532824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6f9fb-f4b9-4e2b-846a-30eba0528927 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/aa31401cfe994d4b8218edba0fe412e7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:38.533378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6f9fb-f4b9-4e2b-846a-30eba0528927 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=aa31401cfe994d4b8218edba0fe412e7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:38.535107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6f9fb-f4b9-4e2b-846a-30eba0528927 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:38.542963 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3451/6844] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:33:38 2022] GET /identity/v3/OS-OAUTH1/consumers/aa31401cfe994d4b8218edba0fe412e7 => generated 220 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:38.544729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3aa1e-6824-4617-80fb-b6f457235f56 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:38.560816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3aa1e-6824-4617-80fb-b6f457235f56 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:38.567208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e792d6-2a11-4d70-be48-528ba43b643d tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a3161d0301b46eeaeaf92cd958813a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:38.567960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e792d6-2a11-4d70-be48-528ba43b643d tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:38.568465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e792d6-2a11-4d70-be48-528ba43b643d tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:38.568847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e792d6-2a11-4d70-be48-528ba43b643d tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/aa31401cfe994d4b8218edba0fe412e7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:38.569500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e792d6-2a11-4d70-be48-528ba43b643d tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=aa31401cfe994d4b8218edba0fe412e7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:38.571297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e792d6-2a11-4d70-be48-528ba43b643d tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:38.571873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d3e792d6-2a11-4d70-be48-528ba43b643d tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invalidating token cache because consumer aa31401cfe994d4b8218edba0fe412e7 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:38.572235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d3e792d6-2a11-4d70-be48-528ba43b643d tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.572948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d3e792d6-2a11-4d70-be48-528ba43b643d tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.586514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d3e792d6-2a11-4d70-be48-528ba43b643d tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'aa31401cfe994d4b8218edba0fe412e7', 'request_id': 'req-d3e792d6-2a11-4d70-be48-528ba43b643d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.611714 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3394/6845] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:33:38 2022] DELETE /identity/v3/OS-OAUTH1/consumers/aa31401cfe994d4b8218edba0fe412e7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:38.617073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6f9fb-f4b9-4e2b-846a-30eba0528927 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:38.619639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-25e6f9fb-f4b9-4e2b-846a-30eba0528927 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:38.703150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6f9fb-f4b9-4e2b-846a-30eba0528927 tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:38.709951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb66f0-1038-47f7-af5a-40ccbb3b7096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:38.711104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb66f0-1038-47f7-af5a-40ccbb3b7096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:38.711104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb66f0-1038-47f7-af5a-40ccbb3b7096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:38.711385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb66f0-1038-47f7-af5a-40ccbb3b7096 admin admin] PATH_INFO: `/v3/users/9718002323e64c3eacfaeeb690c9bbab` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:38.714492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb66f0-1038-47f7-af5a-40ccbb3b7096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9718002323e64c3eacfaeeb690c9bbab)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:38.716875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb66f0-1038-47f7-af5a-40ccbb3b7096 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:38.766703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e792d6-2a11-4d70-be48-528ba43b643d tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:38.769913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d3e792d6-2a11-4d70-be48-528ba43b643d tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:38.783021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2fb66f0-1038-47f7-af5a-40ccbb3b7096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9718002323e64c3eacfaeeb690c9bbab'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.784151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2fb66f0-1038-47f7-af5a-40ccbb3b7096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9718002323e64c3eacfaeeb690c9bbab'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.799356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2fb66f0-1038-47f7-af5a-40ccbb3b7096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9718002323e64c3eacfaeeb690c9bbab'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.811851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2fb66f0-1038-47f7-af5a-40ccbb3b7096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9718002323e64c3eacfaeeb690c9bbab'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.812557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2fb66f0-1038-47f7-af5a-40ccbb3b7096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9718002323e64c3eacfaeeb690c9bbab'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:38.832626 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3452/6846] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:38 2022] DELETE /identity/v3/users/9718002323e64c3eacfaeeb690c9bbab => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:38.838295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5dded-0661-4410-9beb-3c3682cf16f8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:38.838633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5dded-0661-4410-9beb-3c3682cf16f8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:38.838835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5dded-0661-4410-9beb-3c3682cf16f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:38.868094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d7d5dded-0661-4410-9beb-3c3682cf16f8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:38.871943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d7d5dded-0661-4410-9beb-3c3682cf16f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:38.885935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e792d6-2a11-4d70-be48-528ba43b643d tempest-OAUTHConsumersV3Test-1768055921 tempest-OAUTHConsumersV3Test-1768055921-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:38.945108 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:39.035954 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3453/6847] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:39.041126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e56920-a79d-4ff9-8fdb-6bd246f17791 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:39.041955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e56920-a79d-4ff9-8fdb-6bd246f17791 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:39.042342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e56920-a79d-4ff9-8fdb-6bd246f17791 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:39.042717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e56920-a79d-4ff9-8fdb-6bd246f17791 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:39.044969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-10e56920-a79d-4ff9-8fdb-6bd246f17791 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:39.049910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5dded-0661-4410-9beb-3c3682cf16f8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:39.051758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d7d5dded-0661-4410-9beb-3c3682cf16f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:39.097111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e56920-a79d-4ff9-8fdb-6bd246f17791 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:39.100215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e56920-a79d-4ff9-8fdb-6bd246f17791 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:39.124232 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3395/6848] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:33:39.212992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5dded-0661-4410-9beb-3c3682cf16f8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:39.225097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17240a86-1fe2-49d4-8f87-366ffbb7ad84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:39.226459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17240a86-1fe2-49d4-8f87-366ffbb7ad84 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:39.226985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17240a86-1fe2-49d4-8f87-366ffbb7ad84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:39.227443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17240a86-1fe2-49d4-8f87-366ffbb7ad84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:39.241410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17240a86-1fe2-49d4-8f87-366ffbb7ad84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:39.243375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17240a86-1fe2-49d4-8f87-366ffbb7ad84 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:39.256981 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3454/6849] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:40.118581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e56920-a79d-4ff9-8fdb-6bd246f17791 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:40.120497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-10e56920-a79d-4ff9-8fdb-6bd246f17791 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:40.159917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e56920-a79d-4ff9-8fdb-6bd246f17791 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:40.172333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:40.174480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:40.174786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:40.175090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] PATH_INFO: `/v3/projects/f5ae4cb4193045cfba630cd5f27f34fb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:40.176310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ae4cb4193045cfba630cd5f27f34fb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:40.178179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:40.231135 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:40.254160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ae4cb4193045cfba630cd5f27f34fb', 'request_id': 'req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:40.265614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ae4cb4193045cfba630cd5f27f34fb', 'request_id': 'req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:40.275062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ae4cb4193045cfba630cd5f27f34fb', 'request_id': 'req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:40.288943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] The token cache is being invalidate because project f5ae4cb4193045cfba630cd5f27f34fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:40.289148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:40.289777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:40.291328 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3396/6850] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:40 2022] DELETE /identity/v3/projects/f5ae4cb4193045cfba630cd5f27f34fb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:40.295235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17240a86-1fe2-49d4-8f87-366ffbb7ad84 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:40.308881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17240a86-1fe2-49d4-8f87-366ffbb7ad84 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:40.390485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:40.391953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:40.392353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:40.392718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] PATH_INFO: `/v3/users/4a3161d0301b46eeaeaf92cd958813a6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:40.394343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a3161d0301b46eeaeaf92cd958813a6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:40.396570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:40.459295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a3161d0301b46eeaeaf92cd958813a6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:40.460307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a3161d0301b46eeaeaf92cd958813a6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:40.476460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a3161d0301b46eeaeaf92cd958813a6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:40.487260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a3161d0301b46eeaeaf92cd958813a6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:40.487969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a3161d0301b46eeaeaf92cd958813a6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:40.506856 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3455/6851] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:40 2022] DELETE /identity/v3/users/4a3161d0301b46eeaeaf92cd958813a6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:40.934949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:40.936482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:40.961126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c5cf7-17a6-4d5d-b665-3b9ecc8ac65e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:41.075018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:41.076850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:41.088547 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:41.106097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba4642-0305-4028-b016-b954d6c5532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:41.106760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba4642-0305-4028-b016-b954d6c5532e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:41.107081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba4642-0305-4028-b016-b954d6c5532e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:41.107356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba4642-0305-4028-b016-b954d6c5532e admin admin] PATH_INFO: `/v3/projects/4bfc3a4ac5a84f2bb39d26d62121a9ab` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:41.108709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba4642-0305-4028-b016-b954d6c5532e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bfc3a4ac5a84f2bb39d26d62121a9ab)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:41.115047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba4642-0305-4028-b016-b954d6c5532e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:41.169865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-17ba4642-0305-4028-b016-b954d6c5532e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'request_id': 'req-17ba4642-0305-4028-b016-b954d6c5532e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:41.178904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-17ba4642-0305-4028-b016-b954d6c5532e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'request_id': 'req-17ba4642-0305-4028-b016-b954d6c5532e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:41.190410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-17ba4642-0305-4028-b016-b954d6c5532e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bfc3a4ac5a84f2bb39d26d62121a9ab', 'request_id': 'req-17ba4642-0305-4028-b016-b954d6c5532e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:41.206630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02edcc7-c94a-4d77-87f8-c165d9ae1132 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:41.221036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-17ba4642-0305-4028-b016-b954d6c5532e admin admin] The token cache is being invalidate because project 4bfc3a4ac5a84f2bb39d26d62121a9ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:41.221335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-17ba4642-0305-4028-b016-b954d6c5532e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:41.222014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-17ba4642-0305-4028-b016-b954d6c5532e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:41.223910 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3397/6852] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:40 2022] DELETE /identity/v3/projects/4bfc3a4ac5a84f2bb39d26d62121a9ab => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:41.228581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db25a6a-94f9-473d-90b9-d726cc530ee0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:41.228911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db25a6a-94f9-473d-90b9-d726cc530ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:41.229195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db25a6a-94f9-473d-90b9-d726cc530ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:41.268048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4db25a6a-94f9-473d-90b9-d726cc530ee0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:41.269527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4db25a6a-94f9-473d-90b9-d726cc530ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:41.309623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b81fc-1c9f-4c6b-afb7-9a1f0517d5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:41.310279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b81fc-1c9f-4c6b-afb7-9a1f0517d5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:41.310559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b81fc-1c9f-4c6b-afb7-9a1f0517d5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:41.310833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b81fc-1c9f-4c6b-afb7-9a1f0517d5db admin admin] PATH_INFO: `/v3/users/93a49f128e134ac49523678a18ed2205` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:41.312746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b81fc-1c9f-4c6b-afb7-9a1f0517d5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a49f128e134ac49523678a18ed2205)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:41.317166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b81fc-1c9f-4c6b-afb7-9a1f0517d5db admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:41.363035 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:41.384507 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3398/6853] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:41.386508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245ec43-6be2-48c1-a421-09f62997fd19 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:41.387020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245ec43-6be2-48c1-a421-09f62997fd19 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:41.387411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245ec43-6be2-48c1-a421-09f62997fd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:41.410074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-731b81fc-1c9f-4c6b-afb7-9a1f0517d5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a49f128e134ac49523678a18ed2205'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:41.411163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-731b81fc-1c9f-4c6b-afb7-9a1f0517d5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a49f128e134ac49523678a18ed2205'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:41.416362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0245ec43-6be2-48c1-a421-09f62997fd19 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:41.418197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0245ec43-6be2-48c1-a421-09f62997fd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:41.427585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-731b81fc-1c9f-4c6b-afb7-9a1f0517d5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a49f128e134ac49523678a18ed2205'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:41.432500 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3399/6854] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:41.433587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245ec43-6be2-48c1-a421-09f62997fd19 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:41.439807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-731b81fc-1c9f-4c6b-afb7-9a1f0517d5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a49f128e134ac49523678a18ed2205'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:41.441147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-731b81fc-1c9f-4c6b-afb7-9a1f0517d5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a49f128e134ac49523678a18ed2205'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:41.446496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245ec43-6be2-48c1-a421-09f62997fd19 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:41.452173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617328be-66e7-4adb-ae51-4385943ddb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:41.452790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617328be-66e7-4adb-ae51-4385943ddb62 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:41.453068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617328be-66e7-4adb-ae51-4385943ddb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:41.453339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617328be-66e7-4adb-ae51-4385943ddb62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:41.454311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617328be-66e7-4adb-ae51-4385943ddb62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:41.454773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617328be-66e7-4adb-ae51-4385943ddb62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:41.456639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617328be-66e7-4adb-ae51-4385943ddb62 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:41.469054 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3456/6855] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:41 2022] DELETE /identity/v3/users/93a49f128e134ac49523678a18ed2205 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:41.471052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadbd04-e751-4a63-b862-fc773a5f1d39 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:41.471524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadbd04-e751-4a63-b862-fc773a5f1d39 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:41.472009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadbd04-e751-4a63-b862-fc773a5f1d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:41.480140 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3400/6856] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:41.482523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617328be-66e7-4adb-ae51-4385943ddb62 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:41.503643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-edadbd04-e751-4a63-b862-fc773a5f1d39 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:41.507663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617328be-66e7-4adb-ae51-4385943ddb62 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:41.524199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-edadbd04-e751-4a63-b862-fc773a5f1d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:41.646074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c016cce-4e91-42bf-969b-68d25d29fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:41.646680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c016cce-4e91-42bf-969b-68d25d29fbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:41.647126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c016cce-4e91-42bf-969b-68d25d29fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:41.647416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c016cce-4e91-42bf-969b-68d25d29fbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:41.648343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c016cce-4e91-42bf-969b-68d25d29fbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:41.650315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c016cce-4e91-42bf-969b-68d25d29fbc5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:41.675500 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:41.706239 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3401/6857] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:41 2022] POST /identity/v3/projects => generated 369 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:41.707711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c016cce-4e91-42bf-969b-68d25d29fbc5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:41.804441 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3457/6858] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:41.835852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadbd04-e751-4a63-b862-fc773a5f1d39 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:41.837345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-edadbd04-e751-4a63-b862-fc773a5f1d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:41.868837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c016cce-4e91-42bf-969b-68d25d29fbc5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:41.889576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c6581-ea2f-4cfb-9e9c-0bd8912325b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:41.897584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c6581-ea2f-4cfb-9e9c-0bd8912325b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:41.898067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c6581-ea2f-4cfb-9e9c-0bd8912325b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:41.898509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c6581-ea2f-4cfb-9e9c-0bd8912325b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:41.899681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c6581-ea2f-4cfb-9e9c-0bd8912325b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:41.903843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c6581-ea2f-4cfb-9e9c-0bd8912325b5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:41.948661 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3402/6859] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:41 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:41.953898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c6581-ea2f-4cfb-9e9c-0bd8912325b5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:41.968923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c6581-ea2f-4cfb-9e9c-0bd8912325b5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:41.977972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b7d30-7814-4401-a158-b9a9ac159b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:41.978778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b7d30-7814-4401-a158-b9a9ac159b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:41.980444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b7d30-7814-4401-a158-b9a9ac159b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:41.981286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b7d30-7814-4401-a158-b9a9ac159b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:41.981804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b7d30-7814-4401-a158-b9a9ac159b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:41.984218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b7d30-7814-4401-a158-b9a9ac159b0b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:41.998729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadbd04-e751-4a63-b862-fc773a5f1d39 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:42.001233 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3403/6860] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:33:42.005685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b7d30-7814-4401-a158-b9a9ac159b0b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:42.029474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b7d30-7814-4401-a158-b9a9ac159b0b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:42.038285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd93dd2-db21-41cf-8b60-0559d16166d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:42.038934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd93dd2-db21-41cf-8b60-0559d16166d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:42.039328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd93dd2-db21-41cf-8b60-0559d16166d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:42.039607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd93dd2-db21-41cf-8b60-0559d16166d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:42.040254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd93dd2-db21-41cf-8b60-0559d16166d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:42.042023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd93dd2-db21-41cf-8b60-0559d16166d2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:42.063169 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3404/6861] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:33:42.064908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd93dd2-db21-41cf-8b60-0559d16166d2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:42.076339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efde2d-4a2e-4ffc-aac3-9ce4f5d2b7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:42.076854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd93dd2-db21-41cf-8b60-0559d16166d2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:42.077540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efde2d-4a2e-4ffc-aac3-9ce4f5d2b7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:42.078132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efde2d-4a2e-4ffc-aac3-9ce4f5d2b7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:42.078779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efde2d-4a2e-4ffc-aac3-9ce4f5d2b7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:42.084441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5fc7f-0ead-4a1a-aa1d-4377a476a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:42.085738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5fc7f-0ead-4a1a-aa1d-4377a476a13e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:42.086016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5fc7f-0ead-4a1a-aa1d-4377a476a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:42.086290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5fc7f-0ead-4a1a-aa1d-4377a476a13e admin admin] PATH_INFO: `/v3/projects/f84db7c967b0425a89098305ae023db6/users/d24cac289f3d462ca3146b63efa516e5/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:42.093126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efde2d-4a2e-4ffc-aac3-9ce4f5d2b7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:42.096055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efde2d-4a2e-4ffc-aac3-9ce4f5d2b7d6 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:42.105647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5fc7f-0ead-4a1a-aa1d-4377a476a13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f84db7c967b0425a89098305ae023db6, user_id=d24cac289f3d462ca3146b63efa516e5, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:42.108537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5fc7f-0ead-4a1a-aa1d-4377a476a13e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:42.115575 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3458/6862] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:42.132028 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3405/6863] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:42 2022] PUT /identity/v3/projects/f84db7c967b0425a89098305ae023db6/users/d24cac289f3d462ca3146b63efa516e5/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:42.144485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d831999-d65c-43e4-bfa2-508e37f6964b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:42.145038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d831999-d65c-43e4-bfa2-508e37f6964b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:42.145433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d831999-d65c-43e4-bfa2-508e37f6964b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:42.184322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5d831999-d65c-43e4-bfa2-508e37f6964b None None] MFA Rules not processed for user `d24cac289f3d462ca3146b63efa516e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:42.185716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5d831999-d65c-43e4-bfa2-508e37f6964b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:42.284621 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3459/6864] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:42.289450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5fc7f-0ead-4a1a-aa1d-4377a476a13e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:42.305061 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:42.434651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5fc7f-0ead-4a1a-aa1d-4377a476a13e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:42.450893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43edd78-cc97-4847-be2b-eee84c1f96ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:42.452975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43edd78-cc97-4847-be2b-eee84c1f96ff admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:42.453427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43edd78-cc97-4847-be2b-eee84c1f96ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:42.454286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43edd78-cc97-4847-be2b-eee84c1f96ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:42.455216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43edd78-cc97-4847-be2b-eee84c1f96ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:42.459999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43edd78-cc97-4847-be2b-eee84c1f96ff admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:42.520489 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3406/6865] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:42 2022] POST /identity/v3/projects => generated 369 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:42.524406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d831999-d65c-43e4-bfa2-508e37f6964b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:42.568088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43edd78-cc97-4847-be2b-eee84c1f96ff admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:42.574148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f43edd78-cc97-4847-be2b-eee84c1f96ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:42.582283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d831999-d65c-43e4-bfa2-508e37f6964b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:42.609049 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:42.678691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa0780-0140-4dcf-bbf2-e2df56591803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:42.679342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0780-0140-4dcf-bbf2-e2df56591803 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:42.679794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0780-0140-4dcf-bbf2-e2df56591803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:42.680075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0780-0140-4dcf-bbf2-e2df56591803 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:42.680708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa0780-0140-4dcf-bbf2-e2df56591803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:42.683421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa0780-0140-4dcf-bbf2-e2df56591803 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:42.686419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43edd78-cc97-4847-be2b-eee84c1f96ff admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:42.692428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3b545-ecec-477e-9748-0291e1f66404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:42.694598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3b545-ecec-477e-9748-0291e1f66404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:42.695487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3b545-ecec-477e-9748-0291e1f66404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:42.695928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3b545-ecec-477e-9748-0291e1f66404 admin admin] PATH_INFO: `/v3/projects/be6fcb7172de490a8c807e0603172a5c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:42.697902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3b545-ecec-477e-9748-0291e1f66404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6fcb7172de490a8c807e0603172a5c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:42.700461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3b545-ecec-477e-9748-0291e1f66404 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:42.710137 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3460/6866] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:42 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:42.713765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa0780-0140-4dcf-bbf2-e2df56591803 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:42.729341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa0780-0140-4dcf-bbf2-e2df56591803 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:42.738449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe3f46-6457-43b4-bfc1-e16c42a17d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:42.739436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe3f46-6457-43b4-bfc1-e16c42a17d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:42.740089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe3f46-6457-43b4-bfc1-e16c42a17d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:42.740566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe3f46-6457-43b4-bfc1-e16c42a17d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:42.741656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe3f46-6457-43b4-bfc1-e16c42a17d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:42.743803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe3f46-6457-43b4-bfc1-e16c42a17d19 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:42.759115 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3461/6867] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:42.765397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe3f46-6457-43b4-bfc1-e16c42a17d19 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:42.776138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe3f46-6457-43b4-bfc1-e16c42a17d19 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:42.776374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3d3b545-ecec-477e-9748-0291e1f66404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6fcb7172de490a8c807e0603172a5c', 'request_id': 'req-e3d3b545-ecec-477e-9748-0291e1f66404'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:42.783517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3d3b545-ecec-477e-9748-0291e1f66404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6fcb7172de490a8c807e0603172a5c', 'request_id': 'req-e3d3b545-ecec-477e-9748-0291e1f66404'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:42.793343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3d3b545-ecec-477e-9748-0291e1f66404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6fcb7172de490a8c807e0603172a5c', 'request_id': 'req-e3d3b545-ecec-477e-9748-0291e1f66404'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:42.805837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3d3b545-ecec-477e-9748-0291e1f66404 admin admin] The token cache is being invalidate because project be6fcb7172de490a8c807e0603172a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:42.806208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3d3b545-ecec-477e-9748-0291e1f66404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:42.807060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3d3b545-ecec-477e-9748-0291e1f66404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:42.808728 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3407/6868] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:42 2022] DELETE /identity/v3/projects/be6fcb7172de490a8c807e0603172a5c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:42.815013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e69236-9427-4c37-b424-66db9f8bee81 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:42.815013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e69236-9427-4c37-b424-66db9f8bee81 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:42.815013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e69236-9427-4c37-b424-66db9f8bee81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:42.835909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a7e69236-9427-4c37-b424-66db9f8bee81 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:42.837445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a7e69236-9427-4c37-b424-66db9f8bee81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:42.856782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fefea-0094-4264-9bea-47044cf4387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:42.857634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fefea-0094-4264-9bea-47044cf4387f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:42.857924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fefea-0094-4264-9bea-47044cf4387f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:42.858202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fefea-0094-4264-9bea-47044cf4387f admin admin] PATH_INFO: `/v3/projects/fa2a907ced2b405bae2c3b718f17d035/users/172a93a0955444d9a0926c7282a505e9/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:42.881526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fefea-0094-4264-9bea-47044cf4387f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2a907ced2b405bae2c3b718f17d035, user_id=172a93a0955444d9a0926c7282a505e9, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:42.884228 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:42.887491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fefea-0094-4264-9bea-47044cf4387f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:42.910092 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3462/6869] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:42 2022] PUT /identity/v3/projects/fa2a907ced2b405bae2c3b718f17d035/users/172a93a0955444d9a0926c7282a505e9/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:42.916159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fefea-0094-4264-9bea-47044cf4387f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:42.917963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a76fefea-0094-4264-9bea-47044cf4387f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:42.952288 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3408/6870] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:42.962113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5264189-ca18-45e3-bf0a-a150f368411d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:42.962402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5264189-ca18-45e3-bf0a-a150f368411d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:42.962676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5264189-ca18-45e3-bf0a-a150f368411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:42.987902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f5264189-ca18-45e3-bf0a-a150f368411d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:42.989321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f5264189-ca18-45e3-bf0a-a150f368411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:43.008302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fefea-0094-4264-9bea-47044cf4387f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.014088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3555c4d-fb2e-4585-9251-1da7e38fed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.015036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3555c4d-fb2e-4585-9251-1da7e38fed17 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.015319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3555c4d-fb2e-4585-9251-1da7e38fed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.015594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3555c4d-fb2e-4585-9251-1da7e38fed17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.017177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3555c4d-fb2e-4585-9251-1da7e38fed17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.018833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3555c4d-fb2e-4585-9251-1da7e38fed17 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.033521 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3463/6871] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:43.037226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3555c4d-fb2e-4585-9251-1da7e38fed17 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.051837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3555c4d-fb2e-4585-9251-1da7e38fed17 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.058427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e441499-aac2-407a-9c6c-7453c84aea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.059242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e441499-aac2-407a-9c6c-7453c84aea1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.059470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e441499-aac2-407a-9c6c-7453c84aea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.060028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e441499-aac2-407a-9c6c-7453c84aea1b admin admin] PATH_INFO: `/v3/projects/fa2a907ced2b405bae2c3b718f17d035/users/172a93a0955444d9a0926c7282a505e9/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.062397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e441499-aac2-407a-9c6c-7453c84aea1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2a907ced2b405bae2c3b718f17d035, user_id=172a93a0955444d9a0926c7282a505e9, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.066749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e441499-aac2-407a-9c6c-7453c84aea1b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.070952 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3409/6872] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:43.073353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5264189-ca18-45e3-bf0a-a150f368411d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.082429 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3464/6873] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:43 2022] PUT /identity/v3/projects/fa2a907ced2b405bae2c3b718f17d035/users/172a93a0955444d9a0926c7282a505e9/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:43.089552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5264189-ca18-45e3-bf0a-a150f368411d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.092833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc460e11-3004-4ff8-9db9-d45460f3c134 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.094287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc460e11-3004-4ff8-9db9-d45460f3c134 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.094287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc460e11-3004-4ff8-9db9-d45460f3c134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.105948 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:43.154905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cc460e11-3004-4ff8-9db9-d45460f3c134 None None] MFA Rules not processed for user `172a93a0955444d9a0926c7282a505e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:43.156410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc460e11-3004-4ff8-9db9-d45460f3c134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:43.196810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3d4f0-33f7-4a07-84b1-92ece24dc3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.197906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3d4f0-33f7-4a07-84b1-92ece24dc3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.198370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3d4f0-33f7-4a07-84b1-92ece24dc3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.199437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3d4f0-33f7-4a07-84b1-92ece24dc3b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.200281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3d4f0-33f7-4a07-84b1-92ece24dc3b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:43.202579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3d4f0-33f7-4a07-84b1-92ece24dc3b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.204616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3d4f0-33f7-4a07-84b1-92ece24dc3b7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.235909 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3410/6874] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:43.240578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3d4f0-33f7-4a07-84b1-92ece24dc3b7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.260822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3d4f0-33f7-4a07-84b1-92ece24dc3b7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.278095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f61cf0-8ea9-46cf-84a5-99177f1d2083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.278727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f61cf0-8ea9-46cf-84a5-99177f1d2083 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.279036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f61cf0-8ea9-46cf-84a5-99177f1d2083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.279308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f61cf0-8ea9-46cf-84a5-99177f1d2083 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.279946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f61cf0-8ea9-46cf-84a5-99177f1d2083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.280513 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3465/6875] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:43.285153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc460e11-3004-4ff8-9db9-d45460f3c134 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.286684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f61cf0-8ea9-46cf-84a5-99177f1d2083 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.317044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc460e11-3004-4ff8-9db9-d45460f3c134 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.327775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fed427-cdd3-4fc2-8b87-5e81f2bb3093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.328443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fed427-cdd3-4fc2-8b87-5e81f2bb3093 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.329365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fed427-cdd3-4fc2-8b87-5e81f2bb3093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.329649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fed427-cdd3-4fc2-8b87-5e81f2bb3093 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.330355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fed427-cdd3-4fc2-8b87-5e81f2bb3093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.332421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fed427-cdd3-4fc2-8b87-5e81f2bb3093 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.367135 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3466/6876] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:43 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:43.373416 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3411/6877] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:43 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:43.376833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fed427-cdd3-4fc2-8b87-5e81f2bb3093 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.378096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f61cf0-8ea9-46cf-84a5-99177f1d2083 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.454587 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:43.469980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fed427-cdd3-4fc2-8b87-5e81f2bb3093 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.478698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5b5ed-463a-4a46-802f-0e5ca826972f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.479814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5b5ed-463a-4a46-802f-0e5ca826972f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.480092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5b5ed-463a-4a46-802f-0e5ca826972f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.480363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5b5ed-463a-4a46-802f-0e5ca826972f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.481046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f61cf0-8ea9-46cf-84a5-99177f1d2083 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.481950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5b5ed-463a-4a46-802f-0e5ca826972f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.485301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5b5ed-463a-4a46-802f-0e5ca826972f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.486527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42b452-d3c8-4a98-b27c-d6a5f33b7e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.487358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42b452-d3c8-4a98-b27c-d6a5f33b7e16 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.487738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42b452-d3c8-4a98-b27c-d6a5f33b7e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.488159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42b452-d3c8-4a98-b27c-d6a5f33b7e16 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.488963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42b452-d3c8-4a98-b27c-d6a5f33b7e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.491154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42b452-d3c8-4a98-b27c-d6a5f33b7e16 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.520205 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3412/6878] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:43 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:43.524644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42b452-d3c8-4a98-b27c-d6a5f33b7e16 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.537624 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3467/6879] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:43 2022] POST /identity/v3/users => generated 284 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:43.541391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5b5ed-463a-4a46-802f-0e5ca826972f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.543236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42b452-d3c8-4a98-b27c-d6a5f33b7e16 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.559354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39968e20-b69c-4e09-8d14-c852b187f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.559832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39968e20-b69c-4e09-8d14-c852b187f678 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.560115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39968e20-b69c-4e09-8d14-c852b187f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.560387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39968e20-b69c-4e09-8d14-c852b187f678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.561029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39968e20-b69c-4e09-8d14-c852b187f678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.566578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39968e20-b69c-4e09-8d14-c852b187f678 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.570743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5b5ed-463a-4a46-802f-0e5ca826972f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.581347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47334510-e936-4668-b052-82709d0686eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.581968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47334510-e936-4668-b052-82709d0686eb admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.582246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47334510-e936-4668-b052-82709d0686eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.582655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47334510-e936-4668-b052-82709d0686eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.583196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47334510-e936-4668-b052-82709d0686eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.585076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47334510-e936-4668-b052-82709d0686eb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.588862 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3413/6880] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:33:43.589788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39968e20-b69c-4e09-8d14-c852b187f678 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.601318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39968e20-b69c-4e09-8d14-c852b187f678 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.607384 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3468/6881] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:43.611606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47334510-e936-4668-b052-82709d0686eb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.622807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badd437-8224-4797-85fa-918280752a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.623662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badd437-8224-4797-85fa-918280752a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.623949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badd437-8224-4797-85fa-918280752a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.624229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badd437-8224-4797-85fa-918280752a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.624872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badd437-8224-4797-85fa-918280752a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.627849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47334510-e936-4668-b052-82709d0686eb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.628111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badd437-8224-4797-85fa-918280752a7e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.632013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd999fa-5660-4b55-87f7-e9ac1298bd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.633500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd999fa-5660-4b55-87f7-e9ac1298bd98 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.633784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd999fa-5660-4b55-87f7-e9ac1298bd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.634771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd999fa-5660-4b55-87f7-e9ac1298bd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.635548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd999fa-5660-4b55-87f7-e9ac1298bd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.637161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd999fa-5660-4b55-87f7-e9ac1298bd98 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.643438 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3414/6882] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:33:43.644630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badd437-8224-4797-85fa-918280752a7e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.656739 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3469/6883] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:43.660696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd999fa-5660-4b55-87f7-e9ac1298bd98 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.662374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badd437-8224-4797-85fa-918280752a7e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.671680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd999fa-5660-4b55-87f7-e9ac1298bd98 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.672183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560ff4d-c4c4-4d93-8589-bc9a5cb45fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.673177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560ff4d-c4c4-4d93-8589-bc9a5cb45fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.673750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560ff4d-c4c4-4d93-8589-bc9a5cb45fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.674150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560ff4d-c4c4-4d93-8589-bc9a5cb45fa6 admin admin] PATH_INFO: `/v3/projects/55fe14fa76094089808b0856bf93d104/users/e646dcc2399948268e69419eb6bce21d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.678020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4993d9-ce18-4f9f-91e6-373d24469982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.678982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4993d9-ce18-4f9f-91e6-373d24469982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.679443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4993d9-ce18-4f9f-91e6-373d24469982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.679915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4993d9-ce18-4f9f-91e6-373d24469982 admin admin] PATH_INFO: `/v3/projects/9a9d337291ec4f35a1cffa914a7df300/users/a1131c39f6cb47eea8e243fc28eb17d4/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.698103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560ff4d-c4c4-4d93-8589-bc9a5cb45fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fe14fa76094089808b0856bf93d104, user_id=e646dcc2399948268e69419eb6bce21d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.701218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560ff4d-c4c4-4d93-8589-bc9a5cb45fa6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.703266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4993d9-ce18-4f9f-91e6-373d24469982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9d337291ec4f35a1cffa914a7df300, user_id=a1131c39f6cb47eea8e243fc28eb17d4, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.707428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4993d9-ce18-4f9f-91e6-373d24469982 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.721733 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3415/6884] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:43 2022] PUT /identity/v3/projects/55fe14fa76094089808b0856bf93d104/users/e646dcc2399948268e69419eb6bce21d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:43.733054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d80326-0430-410f-94cb-651d1bef280b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.735859 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3470/6885] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:43 2022] PUT /identity/v3/projects/9a9d337291ec4f35a1cffa914a7df300/users/a1131c39f6cb47eea8e243fc28eb17d4/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:43.743539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d80326-0430-410f-94cb-651d1bef280b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.743980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d80326-0430-410f-94cb-651d1bef280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.744841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83904e4-e0c4-4f65-8ad2-5d4c5356dbde None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.745231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83904e4-e0c4-4f65-8ad2-5d4c5356dbde None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.745511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83904e4-e0c4-4f65-8ad2-5d4c5356dbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.776462 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:43.789939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f6d80326-0430-410f-94cb-651d1bef280b None None] MFA Rules not processed for user `e646dcc2399948268e69419eb6bce21d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:43.791252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f6d80326-0430-410f-94cb-651d1bef280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:43.792734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a83904e4-e0c4-4f65-8ad2-5d4c5356dbde None None] MFA Rules not processed for user `a1131c39f6cb47eea8e243fc28eb17d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:43.794944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a83904e4-e0c4-4f65-8ad2-5d4c5356dbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:43.884043 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3416/6886] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:43.893928 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3471/6887] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:43.894840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d80326-0430-410f-94cb-651d1bef280b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.896331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f6d80326-0430-410f-94cb-651d1bef280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:43.898409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83904e4-e0c4-4f65-8ad2-5d4c5356dbde None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:43.967424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d80326-0430-410f-94cb-651d1bef280b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.967809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83904e4-e0c4-4f65-8ad2-5d4c5356dbde None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:43.971421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306269b3-c5a9-4331-91d2-1f98e51602dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.972161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306269b3-c5a9-4331-91d2-1f98e51602dd service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.972451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306269b3-c5a9-4331-91d2-1f98e51602dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.972791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306269b3-c5a9-4331-91d2-1f98e51602dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.972921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ff008-0b37-410d-8eb9-45f2dd7db338 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:43.973562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ff008-0b37-410d-8eb9-45f2dd7db338 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:43.974026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ff008-0b37-410d-8eb9-45f2dd7db338 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:43.974368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ff008-0b37-410d-8eb9-45f2dd7db338 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:43.975268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ff008-0b37-410d-8eb9-45f2dd7db338 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.976923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ff008-0b37-410d-8eb9-45f2dd7db338 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.982363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306269b3-c5a9-4331-91d2-1f98e51602dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:43.983950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306269b3-c5a9-4331-91d2-1f98e51602dd service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:43.995492 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3417/6888] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:43.996601 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3472/6889] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:33:43 2022] POST /identity/v3/domains => generated 276 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:44.000286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306269b3-c5a9-4331-91d2-1f98e51602dd service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:44.009800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ff008-0b37-410d-8eb9-45f2dd7db338 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:44.017715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306269b3-c5a9-4331-91d2-1f98e51602dd service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:44.028247 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:44.079846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ff008-0b37-410d-8eb9-45f2dd7db338 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:44.091184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e2507-4854-450b-8c78-14cc6593d4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:44.091184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e2507-4854-450b-8c78-14cc6593d4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:44.091184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e2507-4854-450b-8c78-14cc6593d4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:44.091184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e2507-4854-450b-8c78-14cc6593d4ca admin admin] PATH_INFO: `/v3/users/e646dcc2399948268e69419eb6bce21d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:44.092994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e2507-4854-450b-8c78-14cc6593d4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=e646dcc2399948268e69419eb6bce21d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:44.095713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e2507-4854-450b-8c78-14cc6593d4ca admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:44.095858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c1bd9-7b04-43b4-a2a5-382c12227504 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:44.096344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c1bd9-7b04-43b4-a2a5-382c12227504 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:44.096750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c1bd9-7b04-43b4-a2a5-382c12227504 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:44.097176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c1bd9-7b04-43b4-a2a5-382c12227504 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:44.097846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c1bd9-7b04-43b4-a2a5-382c12227504 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:44.099548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c1bd9-7b04-43b4-a2a5-382c12227504 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:44.119598 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3418/6890] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:33:43 2022] POST /identity/v3/roles => generated 240 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:44.120692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c1bd9-7b04-43b4-a2a5-382c12227504 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:44.132858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c1bd9-7b04-43b4-a2a5-382c12227504 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:44.138508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c716ca-88d6-4e8b-880e-20f0b7f5c40a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:44.139335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c716ca-88d6-4e8b-880e-20f0b7f5c40a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:44.139708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c716ca-88d6-4e8b-880e-20f0b7f5c40a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:44.140083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c716ca-88d6-4e8b-880e-20f0b7f5c40a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/d3cd089dddc24e86a75a36eb93ffd5b8/users/a1131c39f6cb47eea8e243fc28eb17d4/roles/e4abe9b262ea4f569d603448c5128d97` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:44.142457 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:44.156123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c716ca-88d6-4e8b-880e-20f0b7f5c40a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d3cd089dddc24e86a75a36eb93ffd5b8, user_id=a1131c39f6cb47eea8e243fc28eb17d4, role_id=e4abe9b262ea4f569d603448c5128d97)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:44.156322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f16e2507-4854-450b-8c78-14cc6593d4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e646dcc2399948268e69419eb6bce21d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:44.157016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f16e2507-4854-450b-8c78-14cc6593d4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e646dcc2399948268e69419eb6bce21d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:44.159193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c716ca-88d6-4e8b-880e-20f0b7f5c40a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:44.172132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f16e2507-4854-450b-8c78-14cc6593d4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e646dcc2399948268e69419eb6bce21d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:44.175363 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3419/6891] 10.222.0.39 () {60 vars in 1480 bytes} [Sun Oct 16 01:33:44 2022] PUT /identity/v3/domains/d3cd089dddc24e86a75a36eb93ffd5b8/users/a1131c39f6cb47eea8e243fc28eb17d4/roles/e4abe9b262ea4f569d603448c5128d97 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:44.179422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c716ca-88d6-4e8b-880e-20f0b7f5c40a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:44.180338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f16e2507-4854-450b-8c78-14cc6593d4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e646dcc2399948268e69419eb6bce21d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:44.181211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f16e2507-4854-450b-8c78-14cc6593d4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e646dcc2399948268e69419eb6bce21d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:44.181436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f5c716ca-88d6-4e8b-880e-20f0b7f5c40a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:44.195836 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3473/6892] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:44 2022] DELETE /identity/v3/users/e646dcc2399948268e69419eb6bce21d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:44.200029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a0d7f-e0d5-442c-8e38-ce6c49383157 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:44.200380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a0d7f-e0d5-442c-8e38-ce6c49383157 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:44.200659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a0d7f-e0d5-442c-8e38-ce6c49383157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:44.221284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-840a0d7f-e0d5-442c-8e38-ce6c49383157 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:44.222481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-840a0d7f-e0d5-442c-8e38-ce6c49383157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:44.254116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c716ca-88d6-4e8b-880e-20f0b7f5c40a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:44.289333 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3474/6893] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:44.305935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a0d7f-e0d5-442c-8e38-ce6c49383157 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:44.307601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-840a0d7f-e0d5-442c-8e38-ce6c49383157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:44.321323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ac525-6749-483c-bad1-ced1d4e9f64d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:44.321941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ac525-6749-483c-bad1-ced1d4e9f64d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:44.322226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ac525-6749-483c-bad1-ced1d4e9f64d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:44.322501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ac525-6749-483c-bad1-ced1d4e9f64d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:44.323198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ac525-6749-483c-bad1-ced1d4e9f64d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:44.324804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ac525-6749-483c-bad1-ced1d4e9f64d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:44.346260 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3420/6894] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:33:44 2022] POST /identity/v3/domains => generated 276 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:44.347719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ac525-6749-483c-bad1-ced1d4e9f64d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:44.379431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a0d7f-e0d5-442c-8e38-ce6c49383157 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:44.382829 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:44.419184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ac525-6749-483c-bad1-ced1d4e9f64d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:44.424323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e06e3-5c49-45f5-b679-49decc99c355 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:44.424943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e06e3-5c49-45f5-b679-49decc99c355 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:44.425227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e06e3-5c49-45f5-b679-49decc99c355 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:44.425502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e06e3-5c49-45f5-b679-49decc99c355 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:44.426193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e06e3-5c49-45f5-b679-49decc99c355 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:44.427907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e06e3-5c49-45f5-b679-49decc99c355 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:44.439369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd8b74-53b8-423e-83c8-64090e771ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:44.439984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd8b74-53b8-423e-83c8-64090e771ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:44.440319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd8b74-53b8-423e-83c8-64090e771ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:44.440536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd8b74-53b8-423e-83c8-64090e771ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:44.447073 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3421/6895] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:33:44 2022] POST /identity/v3/roles => generated 240 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:44.450784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e06e3-5c49-45f5-b679-49decc99c355 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:44.461963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e06e3-5c49-45f5-b679-49decc99c355 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:44.468443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d56a20-9325-48a1-9266-237e3db2a83c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:44.468929 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:44.469184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d56a20-9325-48a1-9266-237e3db2a83c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:44.469728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d56a20-9325-48a1-9266-237e3db2a83c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:44.470099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d56a20-9325-48a1-9266-237e3db2a83c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/groups` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:44.470783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d56a20-9325-48a1-9266-237e3db2a83c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:44.472897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d56a20-9325-48a1-9266-237e3db2a83c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:44.508273 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3422/6896] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:33:44 2022] POST /identity/v3/groups => generated 325 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:44.510426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d56a20-9325-48a1-9266-237e3db2a83c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:44.522857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd8b74-53b8-423e-83c8-64090e771ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:44.524737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd8b74-53b8-423e-83c8-64090e771ae9 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:44.525255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d56a20-9325-48a1-9266-237e3db2a83c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:44.530630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34e3db-c9c9-49f2-8368-28358defefb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:44.531613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34e3db-c9c9-49f2-8368-28358defefb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:44.532285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34e3db-c9c9-49f2-8368-28358defefb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:44.532640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34e3db-c9c9-49f2-8368-28358defefb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/groups/ca92d628a49a4aa8a8344c4557b73c23/users/a1131c39f6cb47eea8e243fc28eb17d4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:44.539142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34e3db-c9c9-49f2-8368-28358defefb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ca92d628a49a4aa8a8344c4557b73c23, user_id=a1131c39f6cb47eea8e243fc28eb17d4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:44.541173 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3475/6897] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:33:44.541703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34e3db-c9c9-49f2-8368-28358defefb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:44.576889 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3423/6898] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Oct 16 01:33:44 2022] PUT /identity/v3/groups/ca92d628a49a4aa8a8344c4557b73c23/users/a1131c39f6cb47eea8e243fc28eb17d4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:44.580416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd8b74-53b8-423e-83c8-64090e771ae9 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:44.600870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd8b74-53b8-423e-83c8-64090e771ae9 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:44.711222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662213d-960a-43dd-9b79-3441772c7b1a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:44.712216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662213d-960a-43dd-9b79-3441772c7b1a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:44.712680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662213d-960a-43dd-9b79-3441772c7b1a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:44.712938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662213d-960a-43dd-9b79-3441772c7b1a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/5b692b566df94330ac0eb8bc6574117c/groups/ca92d628a49a4aa8a8344c4557b73c23/roles/02b0470741174c87a17aa79e17a7cdec` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:44.715712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662213d-960a-43dd-9b79-3441772c7b1a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=5b692b566df94330ac0eb8bc6574117c, group_id=ca92d628a49a4aa8a8344c4557b73c23, role_id=02b0470741174c87a17aa79e17a7cdec)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:44.718907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662213d-960a-43dd-9b79-3441772c7b1a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:44.743190 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3476/6899] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:44 2022] PUT /identity/v3/domains/5b692b566df94330ac0eb8bc6574117c/groups/ca92d628a49a4aa8a8344c4557b73c23/roles/02b0470741174c87a17aa79e17a7cdec => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:44.745078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34e3db-c9c9-49f2-8368-28358defefb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:44.766820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34e3db-c9c9-49f2-8368-28358defefb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:44.867131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665a82b-b069-4054-a496-ac1ce9c59a77 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:44.868306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665a82b-b069-4054-a496-ac1ce9c59a77 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:44.868412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665a82b-b069-4054-a496-ac1ce9c59a77 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:44.868649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665a82b-b069-4054-a496-ac1ce9c59a77 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:44.869320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665a82b-b069-4054-a496-ac1ce9c59a77 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:44.871652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665a82b-b069-4054-a496-ac1ce9c59a77 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:44.897107 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3424/6900] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:33:44 2022] POST /identity/v3/domains => generated 277 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:44.901067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662213d-960a-43dd-9b79-3441772c7b1a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:44.916883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662213d-960a-43dd-9b79-3441772c7b1a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:45.002096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d19ef1-1933-431a-b5d5-5b114e5e9592 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:45.002855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d19ef1-1933-431a-b5d5-5b114e5e9592 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:45.003232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d19ef1-1933-431a-b5d5-5b114e5e9592 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:45.003580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d19ef1-1933-431a-b5d5-5b114e5e9592 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:45.004836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d19ef1-1933-431a-b5d5-5b114e5e9592 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:45.007723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d19ef1-1933-431a-b5d5-5b114e5e9592 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:45.035482 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3477/6901] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:33:44 2022] POST /identity/v3/roles => generated 239 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:45.039448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665a82b-b069-4054-a496-ac1ce9c59a77 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:45.052001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665a82b-b069-4054-a496-ac1ce9c59a77 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:45.069234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d869f-fefa-4179-bd34-660d42db55de tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:45.070179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d869f-fefa-4179-bd34-660d42db55de tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:45.070627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d869f-fefa-4179-bd34-660d42db55de tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:45.071134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d869f-fefa-4179-bd34-660d42db55de tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/4eff1f3edade4caca1101e6fef516839/users/a1131c39f6cb47eea8e243fc28eb17d4/roles/728e43a96023445a824ded091cd7498f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:45.087112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d869f-fefa-4179-bd34-660d42db55de tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=4eff1f3edade4caca1101e6fef516839, user_id=a1131c39f6cb47eea8e243fc28eb17d4, role_id=728e43a96023445a824ded091cd7498f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:45.089782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d869f-fefa-4179-bd34-660d42db55de tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:45.106367 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3425/6902] 10.222.0.39 () {60 vars in 1480 bytes} [Sun Oct 16 01:33:45 2022] PUT /identity/v3/domains/4eff1f3edade4caca1101e6fef516839/users/a1131c39f6cb47eea8e243fc28eb17d4/roles/728e43a96023445a824ded091cd7498f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:45.110220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d19ef1-1933-431a-b5d5-5b114e5e9592 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:45.129202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d19ef1-1933-431a-b5d5-5b114e5e9592 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:45.179186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d869f-fefa-4179-bd34-660d42db55de tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:45.181918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba0d869f-fefa-4179-bd34-660d42db55de tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:45.218817 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:45.236118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7dd9c5-63c6-4ac5-a2d1-f80bc93d5205 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:45.236883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dd9c5-63c6-4ac5-a2d1-f80bc93d5205 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:45.237133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dd9c5-63c6-4ac5-a2d1-f80bc93d5205 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:45.237375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dd9c5-63c6-4ac5-a2d1-f80bc93d5205 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:45.238056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7dd9c5-63c6-4ac5-a2d1-f80bc93d5205 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:45.239988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7dd9c5-63c6-4ac5-a2d1-f80bc93d5205 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:45.264507 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3478/6903] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Oct 16 01:33:45 2022] POST /identity/v3/domains => generated 275 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:45.265424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7dd9c5-63c6-4ac5-a2d1-f80bc93d5205 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:45.305898 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:45.351795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d869f-fefa-4179-bd34-660d42db55de tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:45.384499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7dd9c5-63c6-4ac5-a2d1-f80bc93d5205 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:45.389612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9264f0e-ba8c-434c-8065-d39348bbbfcb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:45.390532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9264f0e-ba8c-434c-8065-d39348bbbfcb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:45.390820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9264f0e-ba8c-434c-8065-d39348bbbfcb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:45.392626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9264f0e-ba8c-434c-8065-d39348bbbfcb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:45.392626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9264f0e-ba8c-434c-8065-d39348bbbfcb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:45.394325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9264f0e-ba8c-434c-8065-d39348bbbfcb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:45.418525 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3479/6904] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:33:45 2022] POST /identity/v3/roles => generated 239 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:45.419509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9264f0e-ba8c-434c-8065-d39348bbbfcb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:45.431351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9264f0e-ba8c-434c-8065-d39348bbbfcb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:45.437763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084462b-9c76-4fa4-b4cc-c8bd29ecd553 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:45.439131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084462b-9c76-4fa4-b4cc-c8bd29ecd553 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:45.439622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084462b-9c76-4fa4-b4cc-c8bd29ecd553 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:45.440077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084462b-9c76-4fa4-b4cc-c8bd29ecd553 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:45.441514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084462b-9c76-4fa4-b4cc-c8bd29ecd553 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:45.444197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084462b-9c76-4fa4-b4cc-c8bd29ecd553 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:45.451561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e59d6d-e086-45c0-b49e-ac20969f6d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:45.452322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e59d6d-e086-45c0-b49e-ac20969f6d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:45.452697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e59d6d-e086-45c0-b49e-ac20969f6d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:45.453062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e59d6d-e086-45c0-b49e-ac20969f6d0b admin admin] PATH_INFO: `/v3/projects/55fe14fa76094089808b0856bf93d104` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:45.456175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e59d6d-e086-45c0-b49e-ac20969f6d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=55fe14fa76094089808b0856bf93d104)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:45.458950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e59d6d-e086-45c0-b49e-ac20969f6d0b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:45.482795 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3480/6905] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:33:45 2022] POST /identity/v3/groups => generated 326 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:45.486948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084462b-9c76-4fa4-b4cc-c8bd29ecd553 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:45.498024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084462b-9c76-4fa4-b4cc-c8bd29ecd553 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:45.506374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2050ab8-161d-4295-9d16-3ad399e2d768 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:45.506692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2050ab8-161d-4295-9d16-3ad399e2d768 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:45.507060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2050ab8-161d-4295-9d16-3ad399e2d768 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:45.507342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2050ab8-161d-4295-9d16-3ad399e2d768 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/groups/2136d7c1a05b4d0ba7b1b8249bb68473/users/a1131c39f6cb47eea8e243fc28eb17d4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:45.514671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2050ab8-161d-4295-9d16-3ad399e2d768 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2136d7c1a05b4d0ba7b1b8249bb68473, user_id=a1131c39f6cb47eea8e243fc28eb17d4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:45.517510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2050ab8-161d-4295-9d16-3ad399e2d768 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:45.526383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22e59d6d-e086-45c0-b49e-ac20969f6d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55fe14fa76094089808b0856bf93d104', 'request_id': 'req-22e59d6d-e086-45c0-b49e-ac20969f6d0b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:45.537235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22e59d6d-e086-45c0-b49e-ac20969f6d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55fe14fa76094089808b0856bf93d104', 'request_id': 'req-22e59d6d-e086-45c0-b49e-ac20969f6d0b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:45.554880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22e59d6d-e086-45c0-b49e-ac20969f6d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55fe14fa76094089808b0856bf93d104', 'request_id': 'req-22e59d6d-e086-45c0-b49e-ac20969f6d0b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:45.567607 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3481/6906] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Oct 16 01:33:45 2022] PUT /identity/v3/groups/2136d7c1a05b4d0ba7b1b8249bb68473/users/a1131c39f6cb47eea8e243fc28eb17d4 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:45.568610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22e59d6d-e086-45c0-b49e-ac20969f6d0b admin admin] The token cache is being invalidate because project 55fe14fa76094089808b0856bf93d104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:45.568971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22e59d6d-e086-45c0-b49e-ac20969f6d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:45.569702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22e59d6d-e086-45c0-b49e-ac20969f6d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:45.571478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2050ab8-161d-4295-9d16-3ad399e2d768 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:45.572006 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3426/6907] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:45 2022] DELETE /identity/v3/projects/55fe14fa76094089808b0856bf93d104 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:45.576408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d2050ab8-161d-4295-9d16-3ad399e2d768 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:45.576580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0d373-8be7-4cfd-a4a7-f630c1e5faa4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:45.576699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0d373-8be7-4cfd-a4a7-f630c1e5faa4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:45.576959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0d373-8be7-4cfd-a4a7-f630c1e5faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:45.598559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b7c0d373-8be7-4cfd-a4a7-f630c1e5faa4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:45.599778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b7c0d373-8be7-4cfd-a4a7-f630c1e5faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:45.653824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2050ab8-161d-4295-9d16-3ad399e2d768 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:45.658726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428ee9f-b981-4839-9e05-0f902bc79e79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:45.659503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428ee9f-b981-4839-9e05-0f902bc79e79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:45.659890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428ee9f-b981-4839-9e05-0f902bc79e79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:45.660232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428ee9f-b981-4839-9e05-0f902bc79e79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/2538688a404948ca88a9a7253a1d922e/groups/2136d7c1a05b4d0ba7b1b8249bb68473/roles/10316e04223346918f3bf3a33c5aede4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:45.662290 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3427/6908] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:45.662541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428ee9f-b981-4839-9e05-0f902bc79e79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2538688a404948ca88a9a7253a1d922e, group_id=2136d7c1a05b4d0ba7b1b8249bb68473, role_id=10316e04223346918f3bf3a33c5aede4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:45.665313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428ee9f-b981-4839-9e05-0f902bc79e79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:45.669459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790c03-f2c5-4942-8e3d-fc4249a5949c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:45.669869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790c03-f2c5-4942-8e3d-fc4249a5949c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:45.670149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790c03-f2c5-4942-8e3d-fc4249a5949c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:45.680589 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3482/6909] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:45 2022] PUT /identity/v3/domains/2538688a404948ca88a9a7253a1d922e/groups/2136d7c1a05b4d0ba7b1b8249bb68473/roles/10316e04223346918f3bf3a33c5aede4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:45.684792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428ee9f-b981-4839-9e05-0f902bc79e79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:45.686851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0428ee9f-b981-4839-9e05-0f902bc79e79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:45.693158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8c790c03-f2c5-4942-8e3d-fc4249a5949c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:45.694909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8c790c03-f2c5-4942-8e3d-fc4249a5949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:45.714194 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:45.726901 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:45.796314 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3428/6910] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:45.798591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c790c03-f2c5-4942-8e3d-fc4249a5949c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:45.809366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c790c03-f2c5-4942-8e3d-fc4249a5949c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:45.814672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a2643-f841-423b-8638-b39d581a0a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:45.816116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a2643-f841-423b-8638-b39d581a0a48 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:45.816116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a2643-f841-423b-8638-b39d581a0a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:45.816365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a2643-f841-423b-8638-b39d581a0a48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:45.816849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a2643-f841-423b-8638-b39d581a0a48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:45.817152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a2643-f841-423b-8638-b39d581a0a48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:45.819268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a2643-f841-423b-8638-b39d581a0a48 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:45.838342 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3429/6911] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:45.839458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a2643-f841-423b-8638-b39d581a0a48 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:45.852114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a2643-f841-423b-8638-b39d581a0a48 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:45.863251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f21559-9b5e-4495-a7bd-07e59ae39c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:45.864147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f21559-9b5e-4495-a7bd-07e59ae39c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:45.865314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f21559-9b5e-4495-a7bd-07e59ae39c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:45.865663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f21559-9b5e-4495-a7bd-07e59ae39c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:45.867843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f21559-9b5e-4495-a7bd-07e59ae39c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:45.870227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f21559-9b5e-4495-a7bd-07e59ae39c3b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:45.876765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428ee9f-b981-4839-9e05-0f902bc79e79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:45.883270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd08116-0440-448e-ae2f-74e504d1a649 tempest-TokensV3TestJSON-489712013 tempest-TokensV3TestJSON-489712013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1131c39f6cb47eea8e243fc28eb17d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a9d337291ec4f35a1cffa914a7df300', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:45.884181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd08116-0440-448e-ae2f-74e504d1a649 tempest-TokensV3TestJSON-489712013 tempest-TokensV3TestJSON-489712013-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:45.884663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd08116-0440-448e-ae2f-74e504d1a649 tempest-TokensV3TestJSON-489712013 tempest-TokensV3TestJSON-489712013-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:45.885158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd08116-0440-448e-ae2f-74e504d1a649 tempest-TokensV3TestJSON-489712013 tempest-TokensV3TestJSON-489712013-project] PATH_INFO: `/v3/auth/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:45.885943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd08116-0440-448e-ae2f-74e504d1a649 tempest-TokensV3TestJSON-489712013 tempest-TokensV3TestJSON-489712013-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:45.887306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd08116-0440-448e-ae2f-74e504d1a649 tempest-TokensV3TestJSON-489712013 tempest-TokensV3TestJSON-489712013-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:45.916846 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3430/6912] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:45 2022] POST /identity/v3/projects => generated 399 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:45.921485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f21559-9b5e-4495-a7bd-07e59ae39c3b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:46.003135 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3483/6913] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:33:45 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:46.004176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd08116-0440-448e-ae2f-74e504d1a649 tempest-TokensV3TestJSON-489712013 tempest-TokensV3TestJSON-489712013-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:46.034904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f21559-9b5e-4495-a7bd-07e59ae39c3b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:46.047542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35184a9-98f6-4007-8f3f-e58e9feea919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:46.048653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35184a9-98f6-4007-8f3f-e58e9feea919 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:46.048653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35184a9-98f6-4007-8f3f-e58e9feea919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:46.049103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35184a9-98f6-4007-8f3f-e58e9feea919 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:46.049834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35184a9-98f6-4007-8f3f-e58e9feea919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:46.052438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35184a9-98f6-4007-8f3f-e58e9feea919 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:46.087384 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3431/6914] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:45 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:46.090098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35184a9-98f6-4007-8f3f-e58e9feea919 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:46.119116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35184a9-98f6-4007-8f3f-e58e9feea919 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:46.137679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6a1cc-d2c5-4f04-a820-a204b59bcbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:46.138787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6a1cc-d2c5-4f04-a820-a204b59bcbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:46.139722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6a1cc-d2c5-4f04-a820-a204b59bcbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:46.140100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6a1cc-d2c5-4f04-a820-a204b59bcbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:46.141177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6a1cc-d2c5-4f04-a820-a204b59bcbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:46.143836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6a1cc-d2c5-4f04-a820-a204b59bcbe1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:46.151103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd08116-0440-448e-ae2f-74e504d1a649 tempest-TokensV3TestJSON-489712013 tempest-TokensV3TestJSON-489712013-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:46.163988 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3432/6915] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:46 2022] GET /identity/v3/roles => generated 2342 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:46.166464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6a1cc-d2c5-4f04-a820-a204b59bcbe1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:46.180310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6a1cc-d2c5-4f04-a820-a204b59bcbe1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:46.185550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813be7e-f3b8-49c4-bd48-a52b0dc185c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:46.186342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813be7e-f3b8-49c4-bd48-a52b0dc185c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:46.186721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813be7e-f3b8-49c4-bd48-a52b0dc185c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:46.187241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813be7e-f3b8-49c4-bd48-a52b0dc185c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:46.188783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813be7e-f3b8-49c4-bd48-a52b0dc185c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:46.191394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813be7e-f3b8-49c4-bd48-a52b0dc185c5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:46.235377 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3433/6916] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:46 2022] GET /identity/v3/roles => generated 2342 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:46.238532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813be7e-f3b8-49c4-bd48-a52b0dc185c5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:46.266406 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:46.268692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813be7e-f3b8-49c4-bd48-a52b0dc185c5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:46.280610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64906180-c176-4597-b9d5-9849efbedade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:46.282656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64906180-c176-4597-b9d5-9849efbedade admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:46.283087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64906180-c176-4597-b9d5-9849efbedade admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:46.283533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64906180-c176-4597-b9d5-9849efbedade admin admin] PATH_INFO: `/v3/projects/56b60a0d776343e1a4ecfb6bf889f0ce/users/1502daf0493049b0a4f85afb7a125998/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:46.312333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42282c9f-2781-4091-bc89-79f453f54cf2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:46.313103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42282c9f-2781-4091-bc89-79f453f54cf2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:46.313431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42282c9f-2781-4091-bc89-79f453f54cf2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:46.313714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42282c9f-2781-4091-bc89-79f453f54cf2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/2538688a404948ca88a9a7253a1d922e/groups/2136d7c1a05b4d0ba7b1b8249bb68473/roles/10316e04223346918f3bf3a33c5aede4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:46.315523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64906180-c176-4597-b9d5-9849efbedade admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b60a0d776343e1a4ecfb6bf889f0ce, user_id=1502daf0493049b0a4f85afb7a125998, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:46.316638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42282c9f-2781-4091-bc89-79f453f54cf2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2538688a404948ca88a9a7253a1d922e, group_id=2136d7c1a05b4d0ba7b1b8249bb68473, role_id=10316e04223346918f3bf3a33c5aede4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:46.319102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64906180-c176-4597-b9d5-9849efbedade admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:46.320237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42282c9f-2781-4091-bc89-79f453f54cf2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:46.328504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-42282c9f-2781-4091-bc89-79f453f54cf2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invalidating the token cache because role 10316e04223346918f3bf3a33c5aede4 was removed from group 2136d7c1a05b4d0ba7b1b8249bb68473 on domain 2538688a404948ca88a9a7253a1d922e. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:46.329436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-42282c9f-2781-4091-bc89-79f453f54cf2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:46.330686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-42282c9f-2781-4091-bc89-79f453f54cf2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:46.342286 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3434/6917] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:46 2022] PUT /identity/v3/projects/56b60a0d776343e1a4ecfb6bf889f0ce/users/1502daf0493049b0a4f85afb7a125998/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:46.354941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd3424-5982-4a7e-8c9f-7cad6c0daecd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:46.356366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd3424-5982-4a7e-8c9f-7cad6c0daecd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:46.356985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd3424-5982-4a7e-8c9f-7cad6c0daecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:46.365592 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3484/6918] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Oct 16 01:33:46 2022] DELETE /identity/v3/domains/2538688a404948ca88a9a7253a1d922e/groups/2136d7c1a05b4d0ba7b1b8249bb68473/roles/10316e04223346918f3bf3a33c5aede4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:46.366739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42282c9f-2781-4091-bc89-79f453f54cf2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:46.376988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-42282c9f-2781-4091-bc89-79f453f54cf2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:46.419454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-60cd3424-5982-4a7e-8c9f-7cad6c0daecd None None] MFA Rules not processed for user `1502daf0493049b0a4f85afb7a125998`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:46.421358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-60cd3424-5982-4a7e-8c9f-7cad6c0daecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:46.448601 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:46.505684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42282c9f-2781-4091-bc89-79f453f54cf2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:46.515777 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3435/6919] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:46.520741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd3424-5982-4a7e-8c9f-7cad6c0daecd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:46.522273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb06dd-096e-4f40-b2cd-b0bee9501bc2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:46.522442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-60cd3424-5982-4a7e-8c9f-7cad6c0daecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:46.524745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb06dd-096e-4f40-b2cd-b0bee9501bc2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:46.529276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb06dd-096e-4f40-b2cd-b0bee9501bc2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:46.529753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb06dd-096e-4f40-b2cd-b0bee9501bc2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/groups/2136d7c1a05b4d0ba7b1b8249bb68473/users/a1131c39f6cb47eea8e243fc28eb17d4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:46.531956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb06dd-096e-4f40-b2cd-b0bee9501bc2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2136d7c1a05b4d0ba7b1b8249bb68473, user_id=a1131c39f6cb47eea8e243fc28eb17d4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:46.535767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb06dd-096e-4f40-b2cd-b0bee9501bc2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:46.547963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ffeb06dd-096e-4f40-b2cd-b0bee9501bc2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a1131c39f6cb47eea8e243fc28eb17d4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:46.595644 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3485/6920] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Oct 16 01:33:46 2022] DELETE /identity/v3/groups/2136d7c1a05b4d0ba7b1b8249bb68473/users/a1131c39f6cb47eea8e243fc28eb17d4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:46.599867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb06dd-096e-4f40-b2cd-b0bee9501bc2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:46.622503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd3424-5982-4a7e-8c9f-7cad6c0daecd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:46.686652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb06dd-096e-4f40-b2cd-b0bee9501bc2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:46.694186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4d652-0ae9-493d-8720-a8bde331c07d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:46.694833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d652-0ae9-493d-8720-a8bde331c07d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:46.695157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d652-0ae9-493d-8720-a8bde331c07d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:46.695432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d652-0ae9-493d-8720-a8bde331c07d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/groups/2136d7c1a05b4d0ba7b1b8249bb68473` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:46.696668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4d652-0ae9-493d-8720-a8bde331c07d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2136d7c1a05b4d0ba7b1b8249bb68473)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:46.698816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4d652-0ae9-493d-8720-a8bde331c07d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:46.701563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfa4ec-ccd5-45ac-a0ec-d62fde6e8599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:46.702253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfa4ec-ccd5-45ac-a0ec-d62fde6e8599 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:46.702596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfa4ec-ccd5-45ac-a0ec-d62fde6e8599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:46.702978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfa4ec-ccd5-45ac-a0ec-d62fde6e8599 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:46.704551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfa4ec-ccd5-45ac-a0ec-d62fde6e8599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:46.707487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfa4ec-ccd5-45ac-a0ec-d62fde6e8599 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:46.746011 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3436/6921] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:46 2022] POST /identity/v3/projects => generated 399 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:46.750028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfa4ec-ccd5-45ac-a0ec-d62fde6e8599 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:46.757479 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3486/6922] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:33:46 2022] DELETE /identity/v3/groups/2136d7c1a05b4d0ba7b1b8249bb68473 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:46.758443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4d652-0ae9-493d-8720-a8bde331c07d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:46.782143 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:46.821666 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:46.837378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfa4ec-ccd5-45ac-a0ec-d62fde6e8599 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:46.845847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4d652-0ae9-493d-8720-a8bde331c07d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:46.851099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456658f-d71d-4fe5-a129-92b260d20679 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:46.851824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456658f-d71d-4fe5-a129-92b260d20679 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:46.852105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456658f-d71d-4fe5-a129-92b260d20679 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:46.852378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456658f-d71d-4fe5-a129-92b260d20679 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/roles/10316e04223346918f3bf3a33c5aede4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:46.854403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456658f-d71d-4fe5-a129-92b260d20679 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_role(role_id=10316e04223346918f3bf3a33c5aede4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:46.856155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456658f-d71d-4fe5-a129-92b260d20679 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:46.904869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6456658f-d71d-4fe5-a129-92b260d20679 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invalidating the token cache because role 10316e04223346918f3bf3a33c5aede4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:46.905281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6456658f-d71d-4fe5-a129-92b260d20679 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:46.905969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6456658f-d71d-4fe5-a129-92b260d20679 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:46.908098 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3487/6923] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:46 2022] DELETE /identity/v3/roles/10316e04223346918f3bf3a33c5aede4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:46.911042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9e161-396f-4fae-94d9-1e1ff7e319af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:46.911775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9e161-396f-4fae-94d9-1e1ff7e319af admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:46.912502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9e161-396f-4fae-94d9-1e1ff7e319af admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:46.912631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456658f-d71d-4fe5-a129-92b260d20679 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:46.912961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9e161-396f-4fae-94d9-1e1ff7e319af admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:46.914140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9e161-396f-4fae-94d9-1e1ff7e319af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:46.914513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6456658f-d71d-4fe5-a129-92b260d20679 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:46.916317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9e161-396f-4fae-94d9-1e1ff7e319af admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:46.945086 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3437/6924] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:46 2022] POST /identity/v3/users => generated 306 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:46.946109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9e161-396f-4fae-94d9-1e1ff7e319af admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:46.948180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dbb9e161-396f-4fae-94d9-1e1ff7e319af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:46.965087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9e161-396f-4fae-94d9-1e1ff7e319af admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:47.012805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456658f-d71d-4fe5-a129-92b260d20679 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:47.020312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5117-f995-412f-870d-d6a38c9562d2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:47.021686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5117-f995-412f-870d-d6a38c9562d2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:47.022170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5117-f995-412f-870d-d6a38c9562d2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:47.023683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5117-f995-412f-870d-d6a38c9562d2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/2538688a404948ca88a9a7253a1d922e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:47.026112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d5117-f995-412f-870d-d6a38c9562d2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2538688a404948ca88a9a7253a1d922e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:47.028101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d5117-f995-412f-870d-d6a38c9562d2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:47.053902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e1a8b-0791-48d7-9667-35e761ed565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:47.054654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e1a8b-0791-48d7-9667-35e761ed565d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:47.055037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e1a8b-0791-48d7-9667-35e761ed565d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:47.055381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e1a8b-0791-48d7-9667-35e761ed565d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:47.057232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e1a8b-0791-48d7-9667-35e761ed565d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:47.060488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-310d5117-f995-412f-870d-d6a38c9562d2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2538688a404948ca88a9a7253a1d922e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.060628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e1a8b-0791-48d7-9667-35e761ed565d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:47.061651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-310d5117-f995-412f-870d-d6a38c9562d2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2538688a404948ca88a9a7253a1d922e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.075355 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3438/6925] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:46 2022] GET /identity/v3/roles => generated 2112 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:47.080500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e1a8b-0791-48d7-9667-35e761ed565d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:47.082590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba5e1a8b-0791-48d7-9667-35e761ed565d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:47.097461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-310d5117-f995-412f-870d-d6a38c9562d2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2538688a404948ca88a9a7253a1d922e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.098387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-310d5117-f995-412f-870d-d6a38c9562d2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2538688a404948ca88a9a7253a1d922e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.100029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e1a8b-0791-48d7-9667-35e761ed565d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:47.101725 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3488/6926] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:46 2022] PATCH /identity/v3/domains/2538688a404948ca88a9a7253a1d922e => generated 276 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:47.106881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5117-f995-412f-870d-d6a38c9562d2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:47.108542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-310d5117-f995-412f-870d-d6a38c9562d2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:47.163518 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:47.174224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f20ee3-6fbd-400d-807b-b60279a99e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:47.175561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f20ee3-6fbd-400d-807b-b60279a99e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:47.176387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f20ee3-6fbd-400d-807b-b60279a99e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:47.176387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f20ee3-6fbd-400d-807b-b60279a99e5a admin admin] PATH_INFO: `/v3/projects/8f5edef17b4e4734bb479836b7fb14da/users/6ae44a7898c94e9dbfb9961f8ea78f15/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:47.189930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5117-f995-412f-870d-d6a38c9562d2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:47.196646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:47.197863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:47.198430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:47.198993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/2538688a404948ca88a9a7253a1d922e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:47.199813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f20ee3-6fbd-400d-807b-b60279a99e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5edef17b4e4734bb479836b7fb14da, user_id=6ae44a7898c94e9dbfb9961f8ea78f15, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:47.202795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f20ee3-6fbd-400d-807b-b60279a99e5a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:47.215170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2538688a404948ca88a9a7253a1d922e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:47.217046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:47.221841 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3439/6927] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:47 2022] PUT /identity/v3/projects/8f5edef17b4e4734bb479836b7fb14da/users/6ae44a7898c94e9dbfb9961f8ea78f15/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:47.225731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f20ee3-6fbd-400d-807b-b60279a99e5a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:47.233490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e1f20ee3-6fbd-400d-807b-b60279a99e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:47.257603 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:47.304072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2538688a404948ca88a9a7253a1d922e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.320616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2538688a404948ca88a9a7253a1d922e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.401972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f20ee3-6fbd-400d-807b-b60279a99e5a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:47.412305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2538688a404948ca88a9a7253a1d922e', 'request_id': 'req-066abf1d-0ab7-429d-96e7-39c52ed56c79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.420909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2538688a404948ca88a9a7253a1d922e', 'request_id': 'req-066abf1d-0ab7-429d-96e7-39c52ed56c79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.437713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2538688a404948ca88a9a7253a1d922e', 'request_id': 'req-066abf1d-0ab7-429d-96e7-39c52ed56c79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.462329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] The token cache is being invalidate because project 2538688a404948ca88a9a7253a1d922e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:47.462755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.464116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.478381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2538688a404948ca88a9a7253a1d922e', 'request_id': 'req-066abf1d-0ab7-429d-96e7-39c52ed56c79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.479350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2538688a404948ca88a9a7253a1d922e', 'request_id': 'req-066abf1d-0ab7-429d-96e7-39c52ed56c79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.480672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2538688a404948ca88a9a7253a1d922e', 'request_id': 'req-066abf1d-0ab7-429d-96e7-39c52ed56c79'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.492741 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3489/6928] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:33:47 2022] DELETE /identity/v3/domains/2538688a404948ca88a9a7253a1d922e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:47.497087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:47.499204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:47.587906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da1f76-3b62-4df3-8c6b-368b3c3763be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:47.595852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da1f76-3b62-4df3-8c6b-368b3c3763be admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:47.599718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da1f76-3b62-4df3-8c6b-368b3c3763be admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:47.600184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da1f76-3b62-4df3-8c6b-368b3c3763be admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:47.608227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da1f76-3b62-4df3-8c6b-368b3c3763be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:47.610732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da1f76-3b62-4df3-8c6b-368b3c3763be admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:47.646274 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3440/6929] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:47 2022] GET /identity/v3/roles => generated 2112 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:47.648212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da1f76-3b62-4df3-8c6b-368b3c3763be admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:47.650154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b5da1f76-3b62-4df3-8c6b-368b3c3763be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:47.673341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da1f76-3b62-4df3-8c6b-368b3c3763be admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:47.686530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1f239-1d26-4142-9683-550c71411be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:47.693117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1f239-1d26-4142-9683-550c71411be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:47.693507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1f239-1d26-4142-9683-550c71411be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:47.693907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1f239-1d26-4142-9683-550c71411be4 admin admin] PATH_INFO: `/v3/projects/8f5edef17b4e4734bb479836b7fb14da/users/6ae44a7898c94e9dbfb9961f8ea78f15/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:47.697414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1f239-1d26-4142-9683-550c71411be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5edef17b4e4734bb479836b7fb14da, user_id=6ae44a7898c94e9dbfb9961f8ea78f15, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:47.700251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1f239-1d26-4142-9683-550c71411be4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:47.737198 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3441/6930] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:47 2022] PUT /identity/v3/projects/8f5edef17b4e4734bb479836b7fb14da/users/6ae44a7898c94e9dbfb9961f8ea78f15/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:47.762906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066abf1d-0ab7-429d-96e7-39c52ed56c79 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:47.764447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545d8be-3ee5-4f26-b8a4-e8a99d6dd829 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:47.765837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545d8be-3ee5-4f26-b8a4-e8a99d6dd829 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:47.766838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545d8be-3ee5-4f26-b8a4-e8a99d6dd829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:47.865953 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:47.912061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4545d8be-3ee5-4f26-b8a4-e8a99d6dd829 None None] MFA Rules not processed for user `6ae44a7898c94e9dbfb9961f8ea78f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:47.912377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8670e-9d7d-4b08-83c1-0fbc43daab03 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:47.914806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8670e-9d7d-4b08-83c1-0fbc43daab03 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:47.915490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8670e-9d7d-4b08-83c1-0fbc43daab03 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:47.915964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8670e-9d7d-4b08-83c1-0fbc43daab03 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/4eff1f3edade4caca1101e6fef516839/users/a1131c39f6cb47eea8e243fc28eb17d4/roles/728e43a96023445a824ded091cd7498f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:47.916389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4545d8be-3ee5-4f26-b8a4-e8a99d6dd829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:47.919486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8670e-9d7d-4b08-83c1-0fbc43daab03 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=4eff1f3edade4caca1101e6fef516839, user_id=a1131c39f6cb47eea8e243fc28eb17d4, role_id=728e43a96023445a824ded091cd7498f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:47.924609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8670e-9d7d-4b08-83c1-0fbc43daab03 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:47.936331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-74a8670e-9d7d-4b08-83c1-0fbc43daab03 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invalidating the token cache because role 728e43a96023445a824ded091cd7498f was removed from user a1131c39f6cb47eea8e243fc28eb17d4 on domain 4eff1f3edade4caca1101e6fef516839. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:47.937196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-74a8670e-9d7d-4b08-83c1-0fbc43daab03 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.938530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-74a8670e-9d7d-4b08-83c1-0fbc43daab03 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:47.965632 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3490/6931] 10.222.0.39 () {58 vars in 1464 bytes} [Sun Oct 16 01:33:47 2022] DELETE /identity/v3/domains/4eff1f3edade4caca1101e6fef516839/users/a1131c39f6cb47eea8e243fc28eb17d4/roles/728e43a96023445a824ded091cd7498f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:47.970384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8670e-9d7d-4b08-83c1-0fbc43daab03 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:47.971959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-74a8670e-9d7d-4b08-83c1-0fbc43daab03 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:48.046686 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3442/6932] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:48.059783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545d8be-3ee5-4f26-b8a4-e8a99d6dd829 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:48.061803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4545d8be-3ee5-4f26-b8a4-e8a99d6dd829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:48.095699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8670e-9d7d-4b08-83c1-0fbc43daab03 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:48.099355 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:48.108986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cd3d9-66b2-40d0-958d-452a8c42018b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:48.108986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cd3d9-66b2-40d0-958d-452a8c42018b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:48.108986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cd3d9-66b2-40d0-958d-452a8c42018b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:48.109430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cd3d9-66b2-40d0-958d-452a8c42018b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/roles/728e43a96023445a824ded091cd7498f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:48.111297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cd3d9-66b2-40d0-958d-452a8c42018b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_role(role_id=728e43a96023445a824ded091cd7498f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:48.112942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cd3d9-66b2-40d0-958d-452a8c42018b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:48.144703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545d8be-3ee5-4f26-b8a4-e8a99d6dd829 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:48.162790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-319cd3d9-66b2-40d0-958d-452a8c42018b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invalidating the token cache because role 728e43a96023445a824ded091cd7498f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:48.163252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-319cd3d9-66b2-40d0-958d-452a8c42018b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.164027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-319cd3d9-66b2-40d0-958d-452a8c42018b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.166948 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3491/6933] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:47 2022] DELETE /identity/v3/roles/728e43a96023445a824ded091cd7498f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:48.171044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cd3d9-66b2-40d0-958d-452a8c42018b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:48.173114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-319cd3d9-66b2-40d0-958d-452a8c42018b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:48.203434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc8032-8bb5-4e9d-a4b1-8b98dfc985da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:48.204295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc8032-8bb5-4e9d-a4b1-8b98dfc985da service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:48.204736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc8032-8bb5-4e9d-a4b1-8b98dfc985da service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:48.205020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc8032-8bb5-4e9d-a4b1-8b98dfc985da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:48.206836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d3cc8032-8bb5-4e9d-a4b1-8b98dfc985da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:48.272914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cd3d9-66b2-40d0-958d-452a8c42018b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:48.278238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3c1d4-4b9f-4460-bbb4-bec06eabeee8 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:48.278888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c1d4-4b9f-4460-bbb4-bec06eabeee8 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:48.279313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c1d4-4b9f-4460-bbb4-bec06eabeee8 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:48.280208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c1d4-4b9f-4460-bbb4-bec06eabeee8 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/4eff1f3edade4caca1101e6fef516839` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:48.281722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3c1d4-4b9f-4460-bbb4-bec06eabeee8 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4eff1f3edade4caca1101e6fef516839)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:48.283362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3c1d4-4b9f-4460-bbb4-bec06eabeee8 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:48.293972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc8032-8bb5-4e9d-a4b1-8b98dfc985da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:48.296275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc8032-8bb5-4e9d-a4b1-8b98dfc985da service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:48.306849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6ee3c1d4-4b9f-4460-bbb4-bec06eabeee8 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4eff1f3edade4caca1101e6fef516839'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.307591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6ee3c1d4-4b9f-4460-bbb4-bec06eabeee8 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4eff1f3edade4caca1101e6fef516839'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.311100 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3443/6934] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:33:48.312418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc8032-8bb5-4e9d-a4b1-8b98dfc985da service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:48.314264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d3cc8032-8bb5-4e9d-a4b1-8b98dfc985da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:48.320305 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:48.332620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc8032-8bb5-4e9d-a4b1-8b98dfc985da service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:48.349063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6ee3c1d4-4b9f-4460-bbb4-bec06eabeee8 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4eff1f3edade4caca1101e6fef516839'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.349872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6ee3c1d4-4b9f-4460-bbb4-bec06eabeee8 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4eff1f3edade4caca1101e6fef516839'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.354756 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3492/6935] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:48 2022] PATCH /identity/v3/domains/4eff1f3edade4caca1101e6fef516839 => generated 278 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:48.365519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3c1d4-4b9f-4460-bbb4-bec06eabeee8 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:48.367439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6ee3c1d4-4b9f-4460-bbb4-bec06eabeee8 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:48.419557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333598b3-cf16-4109-8332-8e1c7fc7dc66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:48.420393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333598b3-cf16-4109-8332-8e1c7fc7dc66 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:48.420811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333598b3-cf16-4109-8332-8e1c7fc7dc66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:48.421104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333598b3-cf16-4109-8332-8e1c7fc7dc66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:48.423564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-333598b3-cf16-4109-8332-8e1c7fc7dc66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:48.465832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3c1d4-4b9f-4460-bbb4-bec06eabeee8 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:48.472454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:48.473110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:48.473395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:48.473806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/4eff1f3edade4caca1101e6fef516839` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:48.476467 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:48.488249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4eff1f3edade4caca1101e6fef516839)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:48.489857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:48.497484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333598b3-cf16-4109-8332-8e1c7fc7dc66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:48.498932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333598b3-cf16-4109-8332-8e1c7fc7dc66 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:48.510502 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3444/6936] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:48.511188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333598b3-cf16-4109-8332-8e1c7fc7dc66 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:48.512707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-333598b3-cf16-4109-8332-8e1c7fc7dc66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:48.519804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4eff1f3edade4caca1101e6fef516839'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.528034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333598b3-cf16-4109-8332-8e1c7fc7dc66 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:48.533629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650806a9-d7ff-4536-8cbb-277452e30920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:48.534247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650806a9-d7ff-4536-8cbb-277452e30920 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:48.534587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650806a9-d7ff-4536-8cbb-277452e30920 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:48.534951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650806a9-d7ff-4536-8cbb-277452e30920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:48.535815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4eff1f3edade4caca1101e6fef516839'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.537105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-650806a9-d7ff-4536-8cbb-277452e30920 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:48.590510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eff1f3edade4caca1101e6fef516839', 'request_id': 'req-3794f517-b50a-4636-b792-49635a8eb318'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.598754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eff1f3edade4caca1101e6fef516839', 'request_id': 'req-3794f517-b50a-4636-b792-49635a8eb318'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.607287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eff1f3edade4caca1101e6fef516839', 'request_id': 'req-3794f517-b50a-4636-b792-49635a8eb318'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.620873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] The token cache is being invalidate because project 4eff1f3edade4caca1101e6fef516839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:48.621174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.621536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650806a9-d7ff-4536-8cbb-277452e30920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:48.622996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650806a9-d7ff-4536-8cbb-277452e30920 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:48.623525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.636562 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3445/6937] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:48.639014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4eff1f3edade4caca1101e6fef516839', 'request_id': 'req-3794f517-b50a-4636-b792-49635a8eb318'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.640101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4eff1f3edade4caca1101e6fef516839', 'request_id': 'req-3794f517-b50a-4636-b792-49635a8eb318'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.641990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4eff1f3edade4caca1101e6fef516839', 'request_id': 'req-3794f517-b50a-4636-b792-49635a8eb318'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.659378 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3493/6938] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:33:48 2022] DELETE /identity/v3/domains/4eff1f3edade4caca1101e6fef516839 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:48.660297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650806a9-d7ff-4536-8cbb-277452e30920 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:48.672450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650806a9-d7ff-4536-8cbb-277452e30920 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:48.765053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25eaca-9520-4597-8143-be55798d9391 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:48.765053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25eaca-9520-4597-8143-be55798d9391 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:48.766150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25eaca-9520-4597-8143-be55798d9391 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:48.768194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25eaca-9520-4597-8143-be55798d9391 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/5b692b566df94330ac0eb8bc6574117c/groups/ca92d628a49a4aa8a8344c4557b73c23/roles/02b0470741174c87a17aa79e17a7cdec` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:48.773805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25eaca-9520-4597-8143-be55798d9391 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=5b692b566df94330ac0eb8bc6574117c, group_id=ca92d628a49a4aa8a8344c4557b73c23, role_id=02b0470741174c87a17aa79e17a7cdec)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:48.778458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25eaca-9520-4597-8143-be55798d9391 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:48.784990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac25eaca-9520-4597-8143-be55798d9391 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invalidating the token cache because role 02b0470741174c87a17aa79e17a7cdec was removed from group ca92d628a49a4aa8a8344c4557b73c23 on domain 5b692b566df94330ac0eb8bc6574117c. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:48.785239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac25eaca-9520-4597-8143-be55798d9391 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.786157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac25eaca-9520-4597-8143-be55798d9391 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:48.808070 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3446/6939] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Oct 16 01:33:48 2022] DELETE /identity/v3/domains/5b692b566df94330ac0eb8bc6574117c/groups/ca92d628a49a4aa8a8344c4557b73c23/roles/02b0470741174c87a17aa79e17a7cdec => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:48.809521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:48.814182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:48.833563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794f517-b50a-4636-b792-49635a8eb318 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:48.876205 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:48.971315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ae82a-c93b-433d-8f0e-4686f75bc698 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:48.972049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ae82a-c93b-433d-8f0e-4686f75bc698 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:48.972336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ae82a-c93b-433d-8f0e-4686f75bc698 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:48.972658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ae82a-c93b-433d-8f0e-4686f75bc698 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/groups/ca92d628a49a4aa8a8344c4557b73c23/users/a1131c39f6cb47eea8e243fc28eb17d4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:48.974889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ae82a-c93b-433d-8f0e-4686f75bc698 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=ca92d628a49a4aa8a8344c4557b73c23, user_id=a1131c39f6cb47eea8e243fc28eb17d4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:48.977607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ae82a-c93b-433d-8f0e-4686f75bc698 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:49.007194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7d3ae82a-c93b-433d-8f0e-4686f75bc698 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a1131c39f6cb47eea8e243fc28eb17d4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.039052 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3494/6940] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Oct 16 01:33:48 2022] DELETE /identity/v3/groups/ca92d628a49a4aa8a8344c4557b73c23/users/a1131c39f6cb47eea8e243fc28eb17d4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:49.043181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25eaca-9520-4597-8143-be55798d9391 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:49.048044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ac25eaca-9520-4597-8143-be55798d9391 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:49.088232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25eaca-9520-4597-8143-be55798d9391 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:49.169551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ae82a-c93b-433d-8f0e-4686f75bc698 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:49.171477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7d3ae82a-c93b-433d-8f0e-4686f75bc698 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:49.249629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56547003-33ea-4a16-831d-8bb128edcd81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:49.251326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56547003-33ea-4a16-831d-8bb128edcd81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:49.251887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56547003-33ea-4a16-831d-8bb128edcd81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:49.252343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56547003-33ea-4a16-831d-8bb128edcd81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/groups/ca92d628a49a4aa8a8344c4557b73c23` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:49.253957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56547003-33ea-4a16-831d-8bb128edcd81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ca92d628a49a4aa8a8344c4557b73c23)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:49.256642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56547003-33ea-4a16-831d-8bb128edcd81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:49.267190 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:49.309368 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3447/6941] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Oct 16 01:33:49 2022] DELETE /identity/v3/groups/ca92d628a49a4aa8a8344c4557b73c23 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:49.313786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ae82a-c93b-433d-8f0e-4686f75bc698 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:49.319010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56547003-33ea-4a16-831d-8bb128edcd81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:49.405572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56547003-33ea-4a16-831d-8bb128edcd81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:49.412369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecc96b-d9eb-46ce-bdbd-f9789fbc820f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:49.413065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecc96b-d9eb-46ce-bdbd-f9789fbc820f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:49.413348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecc96b-d9eb-46ce-bdbd-f9789fbc820f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:49.413638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecc96b-d9eb-46ce-bdbd-f9789fbc820f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/roles/02b0470741174c87a17aa79e17a7cdec` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:49.415100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecc96b-d9eb-46ce-bdbd-f9789fbc820f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_role(role_id=02b0470741174c87a17aa79e17a7cdec)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:49.416719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecc96b-d9eb-46ce-bdbd-f9789fbc820f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:49.425656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2956211-abd7-4998-82ec-bfb9ffb9d452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:49.426840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2956211-abd7-4998-82ec-bfb9ffb9d452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:49.427372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2956211-abd7-4998-82ec-bfb9ffb9d452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:49.428426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2956211-abd7-4998-82ec-bfb9ffb9d452 admin admin] PATH_INFO: `/v3/users/8c3b323c78b442b9a188b4b6ac9965c6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:49.430870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2956211-abd7-4998-82ec-bfb9ffb9d452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3b323c78b442b9a188b4b6ac9965c6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:49.434379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2956211-abd7-4998-82ec-bfb9ffb9d452 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:49.471292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-05ecc96b-d9eb-46ce-bdbd-f9789fbc820f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invalidating the token cache because role 02b0470741174c87a17aa79e17a7cdec has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:49.471719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-05ecc96b-d9eb-46ce-bdbd-f9789fbc820f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.472893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-05ecc96b-d9eb-46ce-bdbd-f9789fbc820f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.475781 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3448/6942] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:49 2022] DELETE /identity/v3/roles/02b0470741174c87a17aa79e17a7cdec => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:49.480315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecc96b-d9eb-46ce-bdbd-f9789fbc820f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:49.481948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-05ecc96b-d9eb-46ce-bdbd-f9789fbc820f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:49.530966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2956211-abd7-4998-82ec-bfb9ffb9d452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3b323c78b442b9a188b4b6ac9965c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.532532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2956211-abd7-4998-82ec-bfb9ffb9d452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3b323c78b442b9a188b4b6ac9965c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.573737 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:49.577005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2956211-abd7-4998-82ec-bfb9ffb9d452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3b323c78b442b9a188b4b6ac9965c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.587393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecc96b-d9eb-46ce-bdbd-f9789fbc820f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:49.591088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2956211-abd7-4998-82ec-bfb9ffb9d452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3b323c78b442b9a188b4b6ac9965c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.592670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2956211-abd7-4998-82ec-bfb9ffb9d452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3b323c78b442b9a188b4b6ac9965c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.593591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6b12b-3a0c-4390-a3ac-752ce2c4262b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:49.594992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b12b-3a0c-4390-a3ac-752ce2c4262b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:49.595279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b12b-3a0c-4390-a3ac-752ce2c4262b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:49.595736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b12b-3a0c-4390-a3ac-752ce2c4262b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/5b692b566df94330ac0eb8bc6574117c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:49.597615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6b12b-3a0c-4390-a3ac-752ce2c4262b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5b692b566df94330ac0eb8bc6574117c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:49.599783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6b12b-3a0c-4390-a3ac-752ce2c4262b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:49.612174 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3495/6943] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:49 2022] DELETE /identity/v3/users/8c3b323c78b442b9a188b4b6ac9965c6 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:49.617115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb7c2b-d739-4df9-ba0a-2a1a48b384da None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:49.617524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb7c2b-d739-4df9-ba0a-2a1a48b384da None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:49.624263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb7c2b-d739-4df9-ba0a-2a1a48b384da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:49.626659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ddb6b12b-3a0c-4390-a3ac-752ce2c4262b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5b692b566df94330ac0eb8bc6574117c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.627641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ddb6b12b-3a0c-4390-a3ac-752ce2c4262b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5b692b566df94330ac0eb8bc6574117c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.650308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bafb7c2b-d739-4df9-ba0a-2a1a48b384da None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:49.651692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bafb7c2b-d739-4df9-ba0a-2a1a48b384da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:49.655731 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:49.663068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ddb6b12b-3a0c-4390-a3ac-752ce2c4262b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5b692b566df94330ac0eb8bc6574117c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.664323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ddb6b12b-3a0c-4390-a3ac-752ce2c4262b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5b692b566df94330ac0eb8bc6574117c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.676551 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3449/6944] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:49 2022] PATCH /identity/v3/domains/5b692b566df94330ac0eb8bc6574117c => generated 277 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:33:49.678501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6b12b-3a0c-4390-a3ac-752ce2c4262b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:49.680167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ddb6b12b-3a0c-4390-a3ac-752ce2c4262b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:49.738696 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3496/6945] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:49.750987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb7c2b-d739-4df9-ba0a-2a1a48b384da None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:49.752835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bafb7c2b-d739-4df9-ba0a-2a1a48b384da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:49.793298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6b12b-3a0c-4390-a3ac-752ce2c4262b tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:49.799599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:49.800811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:49.801100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:49.801539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/5b692b566df94330ac0eb8bc6574117c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:49.820148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5b692b566df94330ac0eb8bc6574117c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:49.822060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:49.841283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb7c2b-d739-4df9-ba0a-2a1a48b384da None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:49.851716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5b692b566df94330ac0eb8bc6574117c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.855360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9728f3-9be8-40cc-b14b-b723df327136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:49.856843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9728f3-9be8-40cc-b14b-b723df327136 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:49.857319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9728f3-9be8-40cc-b14b-b723df327136 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:49.857896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9728f3-9be8-40cc-b14b-b723df327136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:49.864396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5b692b566df94330ac0eb8bc6574117c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.877224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9728f3-9be8-40cc-b14b-b723df327136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:49.884820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9728f3-9be8-40cc-b14b-b723df327136 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:49.898233 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3497/6946] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:49.913514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b692b566df94330ac0eb8bc6574117c', 'request_id': 'req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.920346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b692b566df94330ac0eb8bc6574117c', 'request_id': 'req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.932727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b692b566df94330ac0eb8bc6574117c', 'request_id': 'req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.949687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] The token cache is being invalidate because project 5b692b566df94330ac0eb8bc6574117c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:49.950037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.950885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.959889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5b692b566df94330ac0eb8bc6574117c', 'request_id': 'req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.960614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5b692b566df94330ac0eb8bc6574117c', 'request_id': 'req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.961240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5b692b566df94330ac0eb8bc6574117c', 'request_id': 'req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:49.971844 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3450/6947] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:33:49 2022] DELETE /identity/v3/domains/5b692b566df94330ac0eb8bc6574117c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:49.976361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9728f3-9be8-40cc-b14b-b723df327136 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:49.995377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9728f3-9be8-40cc-b14b-b723df327136 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:50.073332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbc764-2ea0-4705-8d92-d2ce5bfb45a1 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:50.074378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbc764-2ea0-4705-8d92-d2ce5bfb45a1 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:50.074821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbc764-2ea0-4705-8d92-d2ce5bfb45a1 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:50.075595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbc764-2ea0-4705-8d92-d2ce5bfb45a1 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/d3cd089dddc24e86a75a36eb93ffd5b8/users/a1131c39f6cb47eea8e243fc28eb17d4/roles/e4abe9b262ea4f569d603448c5128d97` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:50.079583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbc764-2ea0-4705-8d92-d2ce5bfb45a1 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d3cd089dddc24e86a75a36eb93ffd5b8, user_id=a1131c39f6cb47eea8e243fc28eb17d4, role_id=e4abe9b262ea4f569d603448c5128d97)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:50.083126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbc764-2ea0-4705-8d92-d2ce5bfb45a1 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:50.090896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-becbc764-2ea0-4705-8d92-d2ce5bfb45a1 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invalidating the token cache because role e4abe9b262ea4f569d603448c5128d97 was removed from user a1131c39f6cb47eea8e243fc28eb17d4 on domain d3cd089dddc24e86a75a36eb93ffd5b8. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:50.091507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-becbc764-2ea0-4705-8d92-d2ce5bfb45a1 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.092926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-becbc764-2ea0-4705-8d92-d2ce5bfb45a1 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.118395 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3498/6948] 10.222.0.39 () {58 vars in 1464 bytes} [Sun Oct 16 01:33:49 2022] DELETE /identity/v3/domains/d3cd089dddc24e86a75a36eb93ffd5b8/users/a1131c39f6cb47eea8e243fc28eb17d4/roles/e4abe9b262ea4f569d603448c5128d97 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:50.123057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:50.127170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:50.158866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11609d-f3e8-4de7-8194-7407cdf1b5c4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:50.207269 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:50.248844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d6488-39b0-4715-aae2-7bd1e115514d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:50.249080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d6488-39b0-4715-aae2-7bd1e115514d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:50.249352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d6488-39b0-4715-aae2-7bd1e115514d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:50.249632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d6488-39b0-4715-aae2-7bd1e115514d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/roles/e4abe9b262ea4f569d603448c5128d97` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:50.252893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d6488-39b0-4715-aae2-7bd1e115514d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e4abe9b262ea4f569d603448c5128d97)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:50.255596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d6488-39b0-4715-aae2-7bd1e115514d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:50.318360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbc764-2ea0-4705-8d92-d2ce5bfb45a1 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:50.320660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-becbc764-2ea0-4705-8d92-d2ce5bfb45a1 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:50.331042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae9d6488-39b0-4715-aae2-7bd1e115514d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invalidating the token cache because role e4abe9b262ea4f569d603448c5128d97 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:50.331363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae9d6488-39b0-4715-aae2-7bd1e115514d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.332033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae9d6488-39b0-4715-aae2-7bd1e115514d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.338332 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3451/6949] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:50 2022] DELETE /identity/v3/roles/e4abe9b262ea4f569d603448c5128d97 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:50.339327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d6488-39b0-4715-aae2-7bd1e115514d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:50.341648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ae9d6488-39b0-4715-aae2-7bd1e115514d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:50.348135 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:50.424414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d6488-39b0-4715-aae2-7bd1e115514d tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:50.425636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbc764-2ea0-4705-8d92-d2ce5bfb45a1 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:50.432329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86689ae9-ab05-424a-a3cd-e975c07e97b7 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:50.432972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86689ae9-ab05-424a-a3cd-e975c07e97b7 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:50.433249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86689ae9-ab05-424a-a3cd-e975c07e97b7 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:50.433517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86689ae9-ab05-424a-a3cd-e975c07e97b7 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/d3cd089dddc24e86a75a36eb93ffd5b8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:50.434761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86689ae9-ab05-424a-a3cd-e975c07e97b7 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d3cd089dddc24e86a75a36eb93ffd5b8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:50.436401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86689ae9-ab05-424a-a3cd-e975c07e97b7 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:50.463014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86689ae9-ab05-424a-a3cd-e975c07e97b7 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd3cd089dddc24e86a75a36eb93ffd5b8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.463905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86689ae9-ab05-424a-a3cd-e975c07e97b7 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd3cd089dddc24e86a75a36eb93ffd5b8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.492584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:50.493718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:50.493829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:50.494051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] PATH_INFO: `/v3/projects/5b963b2bcb1a4c2ea85de0e04c1998dc` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:50.495242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b963b2bcb1a4c2ea85de0e04c1998dc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:50.495344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86689ae9-ab05-424a-a3cd-e975c07e97b7 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd3cd089dddc24e86a75a36eb93ffd5b8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.496020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-86689ae9-ab05-424a-a3cd-e975c07e97b7 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd3cd089dddc24e86a75a36eb93ffd5b8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.497796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:50.502885 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3452/6950] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:50 2022] PATCH /identity/v3/domains/d3cd089dddc24e86a75a36eb93ffd5b8 => generated 277 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:50.503925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86689ae9-ab05-424a-a3cd-e975c07e97b7 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:50.505480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-86689ae9-ab05-424a-a3cd-e975c07e97b7 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:50.580346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86689ae9-ab05-424a-a3cd-e975c07e97b7 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:50.584204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b963b2bcb1a4c2ea85de0e04c1998dc', 'request_id': 'req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.591646 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:50.593861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b963b2bcb1a4c2ea85de0e04c1998dc', 'request_id': 'req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.604080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b963b2bcb1a4c2ea85de0e04c1998dc', 'request_id': 'req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.617887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] The token cache is being invalidate because project 5b963b2bcb1a4c2ea85de0e04c1998dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:50.619453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.620202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.621887 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3499/6951] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:50 2022] DELETE /identity/v3/projects/5b963b2bcb1a4c2ea85de0e04c1998dc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:50.626727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:50.628354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:50.659785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:50.660525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:50.660870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:50.661204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/d3cd089dddc24e86a75a36eb93ffd5b8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:50.673121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d3cd089dddc24e86a75a36eb93ffd5b8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:50.675005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:50.699052 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:50.702167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd3cd089dddc24e86a75a36eb93ffd5b8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.715319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd3cd089dddc24e86a75a36eb93ffd5b8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.720266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a7e7e-afd3-4c45-80d3-8edda35ce38a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:50.729399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:50.730546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:50.730832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:50.731242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] PATH_INFO: `/v3/users/6d2286a605fd4940a2c511dca8cc0e86` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:50.732400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2286a605fd4940a2c511dca8cc0e86)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:50.734334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:50.761981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3cd089dddc24e86a75a36eb93ffd5b8', 'request_id': 'req-adeb7b90-1e43-4ab1-807a-144ff62eed53'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.769978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3cd089dddc24e86a75a36eb93ffd5b8', 'request_id': 'req-adeb7b90-1e43-4ab1-807a-144ff62eed53'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.779795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3cd089dddc24e86a75a36eb93ffd5b8', 'request_id': 'req-adeb7b90-1e43-4ab1-807a-144ff62eed53'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.792628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] The token cache is being invalidate because project d3cd089dddc24e86a75a36eb93ffd5b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:50.792915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.793651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2286a605fd4940a2c511dca8cc0e86'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.793829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.794729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2286a605fd4940a2c511dca8cc0e86'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.806029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd3cd089dddc24e86a75a36eb93ffd5b8', 'request_id': 'req-adeb7b90-1e43-4ab1-807a-144ff62eed53'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.806833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd3cd089dddc24e86a75a36eb93ffd5b8', 'request_id': 'req-adeb7b90-1e43-4ab1-807a-144ff62eed53'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.807668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd3cd089dddc24e86a75a36eb93ffd5b8', 'request_id': 'req-adeb7b90-1e43-4ab1-807a-144ff62eed53'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.810268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2286a605fd4940a2c511dca8cc0e86'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.818443 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3453/6952] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:33:50 2022] DELETE /identity/v3/domains/d3cd089dddc24e86a75a36eb93ffd5b8 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:50.824389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2286a605fd4940a2c511dca8cc0e86'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.824920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2286a605fd4940a2c511dca8cc0e86'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:50.828960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:50.831011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:50.839101 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3500/6953] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:50 2022] DELETE /identity/v3/users/6d2286a605fd4940a2c511dca8cc0e86 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:50.898961 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:50.915346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7b90-1e43-4ab1-807a-144ff62eed53 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:50.984269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1b1ff-b46d-4798-805a-42af134af1fe tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:50.985414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1b1ff-b46d-4798-805a-42af134af1fe tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:50.985917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1b1ff-b46d-4798-805a-42af134af1fe tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:50.986395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1b1ff-b46d-4798-805a-42af134af1fe tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:50.987735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1b1ff-b46d-4798-805a-42af134af1fe tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:50.990306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1b1ff-b46d-4798-805a-42af134af1fe tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:51.009964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:51.011517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:51.015103 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3454/6954] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:51.028915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c94ac2-35d9-44d2-92d9-c68b94a2b0c4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:51.038117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276ee43-e620-4f1e-93b2-382976b0ede0 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:51.040373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276ee43-e620-4f1e-93b2-382976b0ede0 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:51.040728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276ee43-e620-4f1e-93b2-382976b0ede0 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:51.040905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276ee43-e620-4f1e-93b2-382976b0ede0 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/projects/f84db7c967b0425a89098305ae023db6/users/172a93a0955444d9a0926c7282a505e9/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:51.044202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276ee43-e620-4f1e-93b2-382976b0ede0 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f84db7c967b0425a89098305ae023db6, user_id=172a93a0955444d9a0926c7282a505e9, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:51.048242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276ee43-e620-4f1e-93b2-382976b0ede0 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:51.069948 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3501/6955] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:51 2022] PUT /identity/v3/projects/f84db7c967b0425a89098305ae023db6/users/172a93a0955444d9a0926c7282a505e9/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:51.071593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1b1ff-b46d-4798-805a-42af134af1fe tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:51.084232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1b1ff-b46d-4798-805a-42af134af1fe tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:51.153363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb42607-7c91-44b2-aff3-ed79e0bc55b2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:51.154058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb42607-7c91-44b2-aff3-ed79e0bc55b2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:51.154404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb42607-7c91-44b2-aff3-ed79e0bc55b2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:51.154745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb42607-7c91-44b2-aff3-ed79e0bc55b2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:51.155753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb42607-7c91-44b2-aff3-ed79e0bc55b2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:51.156990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb42607-7c91-44b2-aff3-ed79e0bc55b2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:51.217486 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3455/6956] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:33:51 2022] GET /identity/v3/auth/projects => generated 828 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:51.218718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276ee43-e620-4f1e-93b2-382976b0ede0 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:51.230128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276ee43-e620-4f1e-93b2-382976b0ede0 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:51.252985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da92a6-5152-4e08-8e50-99bda4cb1145 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:51.253808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da92a6-5152-4e08-8e50-99bda4cb1145 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:51.254086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da92a6-5152-4e08-8e50-99bda4cb1145 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:51.254361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da92a6-5152-4e08-8e50-99bda4cb1145 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/projects/f84db7c967b0425a89098305ae023db6/users/172a93a0955444d9a0926c7282a505e9/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:51.256456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da92a6-5152-4e08-8e50-99bda4cb1145 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f84db7c967b0425a89098305ae023db6, user_id=172a93a0955444d9a0926c7282a505e9, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:51.259222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da92a6-5152-4e08-8e50-99bda4cb1145 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:51.271383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75da92a6-5152-4e08-8e50-99bda4cb1145 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invalidating the token cache because role 3b2c8c93a1c54611871c4299008b2abf was removed from user 172a93a0955444d9a0926c7282a505e9 on project f84db7c967b0425a89098305ae023db6. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:51.271724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75da92a6-5152-4e08-8e50-99bda4cb1145 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:51.272603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-75da92a6-5152-4e08-8e50-99bda4cb1145 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:51.293832 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3502/6957] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Oct 16 01:33:51 2022] DELETE /identity/v3/projects/f84db7c967b0425a89098305ae023db6/users/172a93a0955444d9a0926c7282a505e9/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:51.304832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb42607-7c91-44b2-aff3-ed79e0bc55b2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:51.309038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-efb42607-7c91-44b2-aff3-ed79e0bc55b2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:51.310192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da92a6-5152-4e08-8e50-99bda4cb1145 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:51.312097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-75da92a6-5152-4e08-8e50-99bda4cb1145 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:51.351565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb42607-7c91-44b2-aff3-ed79e0bc55b2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:51.401870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da92a6-5152-4e08-8e50-99bda4cb1145 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:51.409208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed881af-1edd-4789-bcbd-6e50d21a28ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:51.410078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed881af-1edd-4789-bcbd-6e50d21a28ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:51.410359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed881af-1edd-4789-bcbd-6e50d21a28ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:51.410635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed881af-1edd-4789-bcbd-6e50d21a28ed admin admin] PATH_INFO: `/v3/projects/d460289569c54a7bb8420dc14503f91b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:51.411924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed881af-1edd-4789-bcbd-6e50d21a28ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d460289569c54a7bb8420dc14503f91b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:51.413881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed881af-1edd-4789-bcbd-6e50d21a28ed admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:51.454362 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:51.462961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8fad9-6531-4244-8f2e-9ea6ef25256f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:51.463588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8fad9-6531-4244-8f2e-9ea6ef25256f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:51.463874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8fad9-6531-4244-8f2e-9ea6ef25256f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:51.464150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8fad9-6531-4244-8f2e-9ea6ef25256f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:51.464842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8fad9-6531-4244-8f2e-9ea6ef25256f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:51.467289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8fad9-6531-4244-8f2e-9ea6ef25256f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:51.470048 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:51.480957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1ed881af-1edd-4789-bcbd-6e50d21a28ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd460289569c54a7bb8420dc14503f91b', 'request_id': 'req-1ed881af-1edd-4789-bcbd-6e50d21a28ed'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:51.490048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1ed881af-1edd-4789-bcbd-6e50d21a28ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd460289569c54a7bb8420dc14503f91b', 'request_id': 'req-1ed881af-1edd-4789-bcbd-6e50d21a28ed'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:51.499159 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3456/6958] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:51 2022] POST /identity/v3/users => generated 321 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:51.502778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8fad9-6531-4244-8f2e-9ea6ef25256f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:51.505598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1ed881af-1edd-4789-bcbd-6e50d21a28ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd460289569c54a7bb8420dc14503f91b', 'request_id': 'req-1ed881af-1edd-4789-bcbd-6e50d21a28ed'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:51.521409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8fad9-6531-4244-8f2e-9ea6ef25256f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:51.527507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1ed881af-1edd-4789-bcbd-6e50d21a28ed admin admin] The token cache is being invalidate because project d460289569c54a7bb8420dc14503f91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:51.527904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1ed881af-1edd-4789-bcbd-6e50d21a28ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:51.529117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1ed881af-1edd-4789-bcbd-6e50d21a28ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:51.531401 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3503/6959] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:51 2022] DELETE /identity/v3/projects/d460289569c54a7bb8420dc14503f91b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:51.538064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f258f0-ab8a-4280-9298-88539966ae15 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:51.538351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f258f0-ab8a-4280-9298-88539966ae15 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:51.538683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f258f0-ab8a-4280-9298-88539966ae15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:51.582206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-97f258f0-ab8a-4280-9298-88539966ae15 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:51.585571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-97f258f0-ab8a-4280-9298-88539966ae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:51.616255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06728ef-99cc-48f1-ab39-ab8a2d5a8f9c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:51.617355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06728ef-99cc-48f1-ab39-ab8a2d5a8f9c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:51.619585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06728ef-99cc-48f1-ab39-ab8a2d5a8f9c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:51.619585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06728ef-99cc-48f1-ab39-ab8a2d5a8f9c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:51.619585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06728ef-99cc-48f1-ab39-ab8a2d5a8f9c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:51.622202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06728ef-99cc-48f1-ab39-ab8a2d5a8f9c tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:51.690030 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3504/6960] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:51.723224 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3457/6961] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:51 2022] POST /identity/v3/projects => generated 363 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:51.727746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f258f0-ab8a-4280-9298-88539966ae15 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:51.729848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-97f258f0-ab8a-4280-9298-88539966ae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:51.754279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f258f0-ab8a-4280-9298-88539966ae15 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:51.798265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3625de-91ff-4e78-bcbe-d7323c7b8774 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:51.798605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3625de-91ff-4e78-bcbe-d7323c7b8774 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:51.799047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3625de-91ff-4e78-bcbe-d7323c7b8774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:51.828995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-da3625de-91ff-4e78-bcbe-d7323c7b8774 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:51.830381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-da3625de-91ff-4e78-bcbe-d7323c7b8774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:51.869150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db322aa0-f60f-4062-a6d3-8ad463cd0e54 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:51.871395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db322aa0-f60f-4062-a6d3-8ad463cd0e54 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:51.871828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db322aa0-f60f-4062-a6d3-8ad463cd0e54 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:51.872787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db322aa0-f60f-4062-a6d3-8ad463cd0e54 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:51.873500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db322aa0-f60f-4062-a6d3-8ad463cd0e54 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:51.876653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db322aa0-f60f-4062-a6d3-8ad463cd0e54 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:51.915280 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3505/6962] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:51 2022] POST /identity/v3/projects => generated 363 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:51.919536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db322aa0-f60f-4062-a6d3-8ad463cd0e54 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:51.928659 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3458/6963] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:51.933063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3625de-91ff-4e78-bcbe-d7323c7b8774 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:51.951696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3625de-91ff-4e78-bcbe-d7323c7b8774 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:52.055863 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:52.056417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c55dc1-d5b4-496d-80ea-6b2cad33a1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:52.056954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55dc1-d5b4-496d-80ea-6b2cad33a1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.057244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55dc1-d5b4-496d-80ea-6b2cad33a1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.057520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55dc1-d5b4-496d-80ea-6b2cad33a1c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.058173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55dc1-d5b4-496d-80ea-6b2cad33a1c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:52.058554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55dc1-d5b4-496d-80ea-6b2cad33a1c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:52.068616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db322aa0-f60f-4062-a6d3-8ad463cd0e54 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:52.072864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55dc1-d5b4-496d-80ea-6b2cad33a1c7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:52.079250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeb2c6-1e37-45d4-8144-4fc369f9bed4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:52.080366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeb2c6-1e37-45d4-8144-4fc369f9bed4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.080815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeb2c6-1e37-45d4-8144-4fc369f9bed4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.081217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeb2c6-1e37-45d4-8144-4fc369f9bed4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.082026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feeb2c6-1e37-45d4-8144-4fc369f9bed4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:52.084065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feeb2c6-1e37-45d4-8144-4fc369f9bed4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:52.093150 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3459/6964] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:52.098853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c55dc1-d5b4-496d-80ea-6b2cad33a1c7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:52.113623 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:52.114080 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3506/6965] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:33:51 2022] POST /identity/v3/roles => generated 239 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:52.116002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeb2c6-1e37-45d4-8144-4fc369f9bed4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:52.137556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeb2c6-1e37-45d4-8144-4fc369f9bed4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:52.138287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c55dc1-d5b4-496d-80ea-6b2cad33a1c7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:52.141681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0230e-af58-4b23-a195-6643f28ddd30 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:52.142831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0230e-af58-4b23-a195-6643f28ddd30 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.143220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0230e-af58-4b23-a195-6643f28ddd30 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.143497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0230e-af58-4b23-a195-6643f28ddd30 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/projects/7cd8bd50c4734b63ad1975649107327b/users/e6355516264343409c57fd69bb358600/roles/7fb97297e129422fb38602424df5b216` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.145823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f53e67-e425-4080-82b7-440825d9ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:52.146761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f53e67-e425-4080-82b7-440825d9ee97 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.147256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f53e67-e425-4080-82b7-440825d9ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.147743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f53e67-e425-4080-82b7-440825d9ee97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.149543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f53e67-e425-4080-82b7-440825d9ee97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:52.151760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f53e67-e425-4080-82b7-440825d9ee97 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:52.163847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0230e-af58-4b23-a195-6643f28ddd30 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7cd8bd50c4734b63ad1975649107327b, user_id=e6355516264343409c57fd69bb358600, role_id=7fb97297e129422fb38602424df5b216)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:52.167057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0230e-af58-4b23-a195-6643f28ddd30 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:52.183225 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3507/6966] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:52 2022] PUT /identity/v3/projects/7cd8bd50c4734b63ad1975649107327b/users/e6355516264343409c57fd69bb358600/roles/7fb97297e129422fb38602424df5b216 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:52.187080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0230e-af58-4b23-a195-6643f28ddd30 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:52.190990 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3460/6967] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:52 2022] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:33:52.194433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f53e67-e425-4080-82b7-440825d9ee97 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:52.268599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f53e67-e425-4080-82b7-440825d9ee97 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:52.273526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad25566-d2c5-4997-a5bc-57ea005f27e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:52.274175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad25566-d2c5-4997-a5bc-57ea005f27e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.274456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad25566-d2c5-4997-a5bc-57ea005f27e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.274836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad25566-d2c5-4997-a5bc-57ea005f27e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.275504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad25566-d2c5-4997-a5bc-57ea005f27e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:52.278097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad25566-d2c5-4997-a5bc-57ea005f27e7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:52.280491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0230e-af58-4b23-a195-6643f28ddd30 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:52.307582 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3461/6968] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:52 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:52.309829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad25566-d2c5-4997-a5bc-57ea005f27e7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:52.322211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad25566-d2c5-4997-a5bc-57ea005f27e7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:52.328432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e6afd-db85-4955-981d-88e8ba65ce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:52.330312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e6afd-db85-4955-981d-88e8ba65ce97 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.330589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e6afd-db85-4955-981d-88e8ba65ce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.330856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e6afd-db85-4955-981d-88e8ba65ce97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.332670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e6afd-db85-4955-981d-88e8ba65ce97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:52.333146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e6afd-db85-4955-981d-88e8ba65ce97 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:52.347691 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3462/6969] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:52 2022] GET /identity/v3/roles => generated 1650 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:52.351348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e6afd-db85-4955-981d-88e8ba65ce97 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:52.361125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce7c22-3244-4b14-a385-b459d40487bb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:52.364616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e6afd-db85-4955-981d-88e8ba65ce97 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:52.371456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb1c3d-5b71-43f5-8403-c005431ab3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:52.372170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb1c3d-5b71-43f5-8403-c005431ab3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.372559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb1c3d-5b71-43f5-8403-c005431ab3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.373110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb1c3d-5b71-43f5-8403-c005431ab3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.373917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb1c3d-5b71-43f5-8403-c005431ab3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:52.375323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce7c22-3244-4b14-a385-b459d40487bb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.376703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce7c22-3244-4b14-a385-b459d40487bb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.377493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb1c3d-5b71-43f5-8403-c005431ab3b4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:52.378483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce7c22-3244-4b14-a385-b459d40487bb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/projects/95a94c864f6f476f84b0780a68a68810/users/e6355516264343409c57fd69bb358600/roles/7fb97297e129422fb38602424df5b216` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.383301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce7c22-3244-4b14-a385-b459d40487bb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:create_grant(project_id=95a94c864f6f476f84b0780a68a68810, user_id=e6355516264343409c57fd69bb358600, role_id=7fb97297e129422fb38602424df5b216)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:52.386087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce7c22-3244-4b14-a385-b459d40487bb tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:52.398205 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3463/6970] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:52 2022] GET /identity/v3/roles => generated 1650 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:52.402232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb1c3d-5b71-43f5-8403-c005431ab3b4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:52.409622 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3508/6971] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:52 2022] PUT /identity/v3/projects/95a94c864f6f476f84b0780a68a68810/users/e6355516264343409c57fd69bb358600/roles/7fb97297e129422fb38602424df5b216 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:52.411053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1205a-30d6-49e1-940a-9c90194bf583 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.411342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1205a-30d6-49e1-940a-9c90194bf583 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.412951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1205a-30d6-49e1-940a-9c90194bf583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.415159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb1c3d-5b71-43f5-8403-c005431ab3b4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:52.444131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2ae1205a-30d6-49e1-940a-9c90194bf583 None None] MFA Rules not processed for user `e6355516264343409c57fd69bb358600`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:52.445691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2ae1205a-30d6-49e1-940a-9c90194bf583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:52.453913 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3509/6972] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:52 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:33:52.467210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf639-cbe5-449b-9945-9a176b875344 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.467210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf639-cbe5-449b-9945-9a176b875344 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.467210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf639-cbe5-449b-9945-9a176b875344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.478295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f3baf639-cbe5-449b-9945-9a176b875344 None None] MFA Rules not processed for user `e6355516264343409c57fd69bb358600`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:52.479589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f3baf639-cbe5-449b-9945-9a176b875344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:52.508651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c5111-b783-4b54-bbb2-7edcd868436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:52.510003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c5111-b783-4b54-bbb2-7edcd868436a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.510003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c5111-b783-4b54-bbb2-7edcd868436a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.510222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c5111-b783-4b54-bbb2-7edcd868436a admin admin] PATH_INFO: `/v3/projects/7ac40a8f05824b1fb5dd00a145aed17b/users/4d1830e053fd4fe1b7faf929552529f0/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.526788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c5111-b783-4b54-bbb2-7edcd868436a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac40a8f05824b1fb5dd00a145aed17b, user_id=4d1830e053fd4fe1b7faf929552529f0, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:52.535004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c5111-b783-4b54-bbb2-7edcd868436a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:52.540056 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:52.565997 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3464/6973] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:52 2022] PUT /identity/v3/projects/7ac40a8f05824b1fb5dd00a145aed17b/users/4d1830e053fd4fe1b7faf929552529f0/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:52.567786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626c1d-a792-412a-81a9-47880b48d150 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.568079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626c1d-a792-412a-81a9-47880b48d150 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.568511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626c1d-a792-412a-81a9-47880b48d150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.571353 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3510/6974] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 16 01:33:52.576495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf639-cbe5-449b-9945-9a176b875344 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:52.621239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ac626c1d-a792-412a-81a9-47880b48d150 None None] MFA Rules not processed for user `4d1830e053fd4fe1b7faf929552529f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:52.623228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ac626c1d-a792-412a-81a9-47880b48d150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:52.664357 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:52.685841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf639-cbe5-449b-9945-9a176b875344 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:52.761459 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3465/6975] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:52.765825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626c1d-a792-412a-81a9-47880b48d150 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:52.799231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2c12a-a778-47ba-8228-a87cd620eeb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:52.800336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2c12a-a778-47ba-8228-a87cd620eeb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.801243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2c12a-a778-47ba-8228-a87cd620eeb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.801728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2c12a-a778-47ba-8228-a87cd620eeb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.882986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626c1d-a792-412a-81a9-47880b48d150 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:52.888390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b26427-5214-475f-9224-0bd6593f1f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:52.889109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b26427-5214-475f-9224-0bd6593f1f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.889387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b26427-5214-475f-9224-0bd6593f1f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.889658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b26427-5214-475f-9224-0bd6593f1f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.890291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b26427-5214-475f-9224-0bd6593f1f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:52.893312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b26427-5214-475f-9224-0bd6593f1f59 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:52.905630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2c12a-a778-47ba-8228-a87cd620eeb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:52.908416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2c12a-a778-47ba-8228-a87cd620eeb2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:52.932430 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3466/6977] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:52 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:52.933230 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3511/6977] 10.222.0.39 () {56 vars in 1308 bytes} [Sun Oct 16 01:33:52 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:52.935996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b26427-5214-475f-9224-0bd6593f1f59 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:52.936840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c9c32-6c6c-4d32-a7b2-06082454a60e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:52.937252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c9c32-6c6c-4d32-a7b2-06082454a60e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:52.937608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c9c32-6c6c-4d32-a7b2-06082454a60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:52.951273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-730c9c32-6c6c-4d32-a7b2-06082454a60e None None] MFA Rules not processed for user `e6355516264343409c57fd69bb358600`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:52.953167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-730c9c32-6c6c-4d32-a7b2-06082454a60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:53.014123 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:53.040634 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3512/6978] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3223 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 16 01:33:53.044028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c9c32-6c6c-4d32-a7b2-06082454a60e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:53.075719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b26427-5214-475f-9224-0bd6593f1f59 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:53.088284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429346d-e0fa-4505-a082-295423601ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:53.089027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429346d-e0fa-4505-a082-295423601ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:53.089305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429346d-e0fa-4505-a082-295423601ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:53.089581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429346d-e0fa-4505-a082-295423601ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:53.090219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429346d-e0fa-4505-a082-295423601ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:53.092282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429346d-e0fa-4505-a082-295423601ad6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:53.140523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c9c32-6c6c-4d32-a7b2-06082454a60e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:53.143215 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3467/6979] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:52 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:53.146907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429346d-e0fa-4505-a082-295423601ad6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:53.152358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092182a9-33d5-4084-8501-da3582b2d7a4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:53.153618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092182a9-33d5-4084-8501-da3582b2d7a4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:53.154906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092182a9-33d5-4084-8501-da3582b2d7a4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:53.155394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092182a9-33d5-4084-8501-da3582b2d7a4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/roles/7fb97297e129422fb38602424df5b216` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:53.158245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092182a9-33d5-4084-8501-da3582b2d7a4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7fb97297e129422fb38602424df5b216)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:53.158825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429346d-e0fa-4505-a082-295423601ad6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:53.161436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092182a9-33d5-4084-8501-da3582b2d7a4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:53.164410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a839e50-9d36-4767-b3b9-7d3151e8c5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:53.165371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a839e50-9d36-4767-b3b9-7d3151e8c5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:53.165509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a839e50-9d36-4767-b3b9-7d3151e8c5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:53.165917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a839e50-9d36-4767-b3b9-7d3151e8c5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:53.168046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a839e50-9d36-4767-b3b9-7d3151e8c5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:53.169762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a839e50-9d36-4767-b3b9-7d3151e8c5a1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:53.182732 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3468/6980] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:53 2022] GET /identity/v3/roles => generated 1650 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:53.186902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a839e50-9d36-4767-b3b9-7d3151e8c5a1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:53.211909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a839e50-9d36-4767-b3b9-7d3151e8c5a1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:53.218481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-092182a9-33d5-4084-8501-da3582b2d7a4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invalidating the token cache because role 7fb97297e129422fb38602424df5b216 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:53.218862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-092182a9-33d5-4084-8501-da3582b2d7a4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:53.220724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-092182a9-33d5-4084-8501-da3582b2d7a4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:53.225704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c943152-714b-4945-9ce3-fa7dbfb4e5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:53.231184 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3513/6981] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:53 2022] DELETE /identity/v3/roles/7fb97297e129422fb38602424df5b216 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:53.232103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092182a9-33d5-4084-8501-da3582b2d7a4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:53.232631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c943152-714b-4945-9ce3-fa7dbfb4e5c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:53.232966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c943152-714b-4945-9ce3-fa7dbfb4e5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:53.233169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c943152-714b-4945-9ce3-fa7dbfb4e5c9 admin admin] PATH_INFO: `/v3/projects/a4cff3e3819a462ab4a8cd029e8d189f/users/b4be138e990e49e58efdfd49d5e1a7eb/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:53.235972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-092182a9-33d5-4084-8501-da3582b2d7a4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:53.284093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c943152-714b-4945-9ce3-fa7dbfb4e5c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4cff3e3819a462ab4a8cd029e8d189f, user_id=b4be138e990e49e58efdfd49d5e1a7eb, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:53.289904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c943152-714b-4945-9ce3-fa7dbfb4e5c9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:53.324731 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3469/6982] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:53 2022] PUT /identity/v3/projects/a4cff3e3819a462ab4a8cd029e8d189f/users/b4be138e990e49e58efdfd49d5e1a7eb/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:53.332006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c943152-714b-4945-9ce3-fa7dbfb4e5c9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:53.334535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4c943152-714b-4945-9ce3-fa7dbfb4e5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:53.350654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092182a9-33d5-4084-8501-da3582b2d7a4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:53.352420 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:53.461439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:53.462370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:53.462747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:53.463151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/projects/95a94c864f6f476f84b0780a68a68810` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:53.464426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_project(project_id=95a94c864f6f476f84b0780a68a68810)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:53.467606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:53.470944 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:53.500958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c943152-714b-4945-9ce3-fa7dbfb4e5c9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:53.506348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0893da-c4ed-437c-92dc-d1efc2d233a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:53.507942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0893da-c4ed-437c-92dc-d1efc2d233a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:53.508224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0893da-c4ed-437c-92dc-d1efc2d233a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:53.508492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0893da-c4ed-437c-92dc-d1efc2d233a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:53.509507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0893da-c4ed-437c-92dc-d1efc2d233a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:53.511784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0893da-c4ed-437c-92dc-d1efc2d233a0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:53.527750 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3470/6983] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:33:53.533554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0893da-c4ed-437c-92dc-d1efc2d233a0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:53.550535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a94c864f6f476f84b0780a68a68810', 'request_id': 'req-2b29652e-0fed-4ff1-bf99-61efc9762e81'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:53.564049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0893da-c4ed-437c-92dc-d1efc2d233a0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:53.588636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a94c864f6f476f84b0780a68a68810', 'request_id': 'req-2b29652e-0fed-4ff1-bf99-61efc9762e81'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:53.612162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a94c864f6f476f84b0780a68a68810', 'request_id': 'req-2b29652e-0fed-4ff1-bf99-61efc9762e81'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:53.629520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] The token cache is being invalidate because project 95a94c864f6f476f84b0780a68a68810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:53.629912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:53.631658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:53.636305 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3514/6984] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:53 2022] DELETE /identity/v3/projects/95a94c864f6f476f84b0780a68a68810 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:53.641582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:53.652967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:53.679336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c27c86-dfa1-40fe-ac52-72a1ee63ccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:53.681875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c27c86-dfa1-40fe-ac52-72a1ee63ccb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:53.682258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c27c86-dfa1-40fe-ac52-72a1ee63ccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:53.682653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c27c86-dfa1-40fe-ac52-72a1ee63ccb3 admin admin] PATH_INFO: `/v3/projects/a4cff3e3819a462ab4a8cd029e8d189f/users/b4be138e990e49e58efdfd49d5e1a7eb/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:53.687525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c27c86-dfa1-40fe-ac52-72a1ee63ccb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4cff3e3819a462ab4a8cd029e8d189f, user_id=b4be138e990e49e58efdfd49d5e1a7eb, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:53.692184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c27c86-dfa1-40fe-ac52-72a1ee63ccb3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:53.717832 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3471/6985] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:33:53 2022] PUT /identity/v3/projects/a4cff3e3819a462ab4a8cd029e8d189f/users/b4be138e990e49e58efdfd49d5e1a7eb/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:53.732508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b7378-d7ab-468e-8db3-69628c207839 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:53.732937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b7378-d7ab-468e-8db3-69628c207839 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:53.733318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b7378-d7ab-468e-8db3-69628c207839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:53.776040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29652e-0fed-4ff1-bf99-61efc9762e81 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:53.793295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-430b7378-d7ab-468e-8db3-69628c207839 None None] MFA Rules not processed for user `b4be138e990e49e58efdfd49d5e1a7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:53.794488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-430b7378-d7ab-468e-8db3-69628c207839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:53.888950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf92a3c-e1fa-464c-946a-adffa790321f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:53.889837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf92a3c-e1fa-464c-946a-adffa790321f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:53.890114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf92a3c-e1fa-464c-946a-adffa790321f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:53.890393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf92a3c-e1fa-464c-946a-adffa790321f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/projects/95a94c864f6f476f84b0780a68a68810` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:53.900836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf92a3c-e1fa-464c-946a-adffa790321f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_project(project_id=95a94c864f6f476f84b0780a68a68810)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:53.903907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf92a3c-e1fa-464c-946a-adffa790321f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-ecf92a3c-e1fa-464c-946a-adffa790321f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Could not find project: 95a94c864f6f476f84b0780a68a68810.: keystone.exception.ProjectNotFound: Could not find project: 95a94c864f6f476f84b0780a68a68810. Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 16 01:33:53.921131 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 16 01:33:53.922976 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:53.922976 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:53.922976 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 16 01:33:53.922976 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 16 01:33:53.922976 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:33:53.922976 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:33:53.922976 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:33:53.922976 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:33:53.922976 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 95a94c864f6f476f84b0780a68a68810. Oct 16 01:33:53.922976 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:33:53.927497 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3515/6986] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:53 2022] DELETE /identity/v3/projects/95a94c864f6f476f84b0780a68a68810 => generated 113 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:33:53.931479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf92a3c-e1fa-464c-946a-adffa790321f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:53.931680 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3472/6987] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:53.950588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf92a3c-e1fa-464c-946a-adffa790321f tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:53.952620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b7378-d7ab-468e-8db3-69628c207839 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:53.959036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:53.960086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:53.960772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:53.961273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/projects/7cd8bd50c4734b63ad1975649107327b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:53.962862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7cd8bd50c4734b63ad1975649107327b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:53.965486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:53.965694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-430b7378-d7ab-468e-8db3-69628c207839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:54.002624 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:54.041245 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:54.072786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd8bd50c4734b63ad1975649107327b', 'request_id': 'req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:54.085112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd8bd50c4734b63ad1975649107327b', 'request_id': 'req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:54.096600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd8bd50c4734b63ad1975649107327b', 'request_id': 'req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:54.108175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b7378-d7ab-468e-8db3-69628c207839 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:54.114514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] The token cache is being invalidate because project 7cd8bd50c4734b63ad1975649107327b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:54.115085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:54.117251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:54.138038 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3516/6988] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:53 2022] DELETE /identity/v3/projects/7cd8bd50c4734b63ad1975649107327b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:54.138285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:54.140603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:54.198703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d73632-d61e-4eeb-b945-312f8ce9f628 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:54.199400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d73632-d61e-4eeb-b945-312f8ce9f628 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:54.199680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d73632-d61e-4eeb-b945-312f8ce9f628 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:54.199955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d73632-d61e-4eeb-b945-312f8ce9f628 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:54.201810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-26d73632-d61e-4eeb-b945-312f8ce9f628 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:54.260307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6e41c-b9a1-43c3-8f8a-70e3cb5b1c82 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:54.268663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:54.269675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:54.270061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:54.270444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/users/e6355516264343409c57fd69bb358600` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:54.272499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e6355516264343409c57fd69bb358600)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:54.277486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:54.399241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6355516264343409c57fd69bb358600'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:54.401008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6355516264343409c57fd69bb358600'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:54.434783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6355516264343409c57fd69bb358600'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:54.436930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d73632-d61e-4eeb-b945-312f8ce9f628 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:54.446075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6355516264343409c57fd69bb358600'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:54.447011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6355516264343409c57fd69bb358600'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:54.450042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d73632-d61e-4eeb-b945-312f8ce9f628 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:54.468055 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3473/6989] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:54.485165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d73632-d61e-4eeb-b945-312f8ce9f628 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:54.486017 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3517/6990] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:54 2022] DELETE /identity/v3/users/e6355516264343409c57fd69bb358600 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:54.498868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d73632-d61e-4eeb-b945-312f8ce9f628 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:54.584458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:54.586580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:54.608659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59baaf7-3a14-477c-b387-c3ada603aab4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:54.609611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59baaf7-3a14-477c-b387-c3ada603aab4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:54.610165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59baaf7-3a14-477c-b387-c3ada603aab4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:54.610656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59baaf7-3a14-477c-b387-c3ada603aab4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/2538688a404948ca88a9a7253a1d922e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:54.619174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59baaf7-3a14-477c-b387-c3ada603aab4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e59baaf7-3a14-477c-b387-c3ada603aab4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Could not find domain: 2538688a404948ca88a9a7253a1d922e.: keystone.exception.DomainNotFound: Could not find domain: 2538688a404948ca88a9a7253a1d922e. Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2538688a404948ca88a9a7253a1d922e. Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:54.624256 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:54.627139 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2538688a404948ca88a9a7253a1d922e. Oct 16 01:33:54.628260 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:54.629557 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3474/6991] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:54 2022] PATCH /identity/v3/domains/2538688a404948ca88a9a7253a1d922e => generated 112 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:33:54.632123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59baaf7-3a14-477c-b387-c3ada603aab4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:54.636159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e59baaf7-3a14-477c-b387-c3ada603aab4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:54.654550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59baaf7-3a14-477c-b387-c3ada603aab4 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:54.659248 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:54.662309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88245fa-dd9f-49fe-b91b-05b9e96800fa tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:54.663002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88245fa-dd9f-49fe-b91b-05b9e96800fa tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:54.663283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88245fa-dd9f-49fe-b91b-05b9e96800fa tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:54.663558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88245fa-dd9f-49fe-b91b-05b9e96800fa tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/4eff1f3edade4caca1101e6fef516839` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:54.672404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88245fa-dd9f-49fe-b91b-05b9e96800fa tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-d88245fa-dd9f-49fe-b91b-05b9e96800fa tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Could not find domain: 4eff1f3edade4caca1101e6fef516839.: keystone.exception.DomainNotFound: Could not find domain: 4eff1f3edade4caca1101e6fef516839. Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4eff1f3edade4caca1101e6fef516839. Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:54.680168 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:54.681503 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4eff1f3edade4caca1101e6fef516839. Oct 16 01:33:54.682654 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:54.683815 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3475/6992] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:54 2022] PATCH /identity/v3/domains/4eff1f3edade4caca1101e6fef516839 => generated 112 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:33:54.688327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88245fa-dd9f-49fe-b91b-05b9e96800fa tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:54.712436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88245fa-dd9f-49fe-b91b-05b9e96800fa tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:54.715183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e16ea-e095-430f-ae86-126c065e106a tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:54.718344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ae007-dee5-4fd9-9789-d554ec808aa2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:54.719124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ae007-dee5-4fd9-9789-d554ec808aa2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:54.719423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ae007-dee5-4fd9-9789-d554ec808aa2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:54.720576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ae007-dee5-4fd9-9789-d554ec808aa2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/5b692b566df94330ac0eb8bc6574117c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:54.723740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268c816-2ced-4f71-a7e3-fdad5f426600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:54.724761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268c816-2ced-4f71-a7e3-fdad5f426600 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:54.725304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268c816-2ced-4f71-a7e3-fdad5f426600 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:54.726216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268c816-2ced-4f71-a7e3-fdad5f426600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:54.728730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8268c816-2ced-4f71-a7e3-fdad5f426600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:54.729304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ae007-dee5-4fd9-9789-d554ec808aa2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-ab3ae007-dee5-4fd9-9789-d554ec808aa2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Could not find domain: 5b692b566df94330ac0eb8bc6574117c.: keystone.exception.DomainNotFound: Could not find domain: 5b692b566df94330ac0eb8bc6574117c. Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5b692b566df94330ac0eb8bc6574117c. Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:54.736758 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:54.738136 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5b692b566df94330ac0eb8bc6574117c. Oct 16 01:33:54.739227 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:54.740417 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3476/6993] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:54 2022] PATCH /identity/v3/domains/5b692b566df94330ac0eb8bc6574117c => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:33:54.741757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ae007-dee5-4fd9-9789-d554ec808aa2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:54.749819 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:54.756494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ae007-dee5-4fd9-9789-d554ec808aa2 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:54.761816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257076b-00c3-49db-bb54-622dc7932d40 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172a93a0955444d9a0926c7282a505e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa2a907ced2b405bae2c3b718f17d035', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:54.762456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257076b-00c3-49db-bb54-622dc7932d40 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:54.762734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257076b-00c3-49db-bb54-622dc7932d40 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:54.763085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257076b-00c3-49db-bb54-622dc7932d40 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] PATH_INFO: `/v3/domains/d3cd089dddc24e86a75a36eb93ffd5b8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:54.774180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257076b-00c3-49db-bb54-622dc7932d40 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-0257076b-00c3-49db-bb54-622dc7932d40 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Could not find domain: d3cd089dddc24e86a75a36eb93ffd5b8.: keystone.exception.DomainNotFound: Could not find domain: d3cd089dddc24e86a75a36eb93ffd5b8. Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d3cd089dddc24e86a75a36eb93ffd5b8. Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:33:54.779931 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:33:54.781377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d3cd089dddc24e86a75a36eb93ffd5b8. Oct 16 01:33:54.783377 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:33:54.784540 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3477/6994] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:33:54 2022] PATCH /identity/v3/domains/d3cd089dddc24e86a75a36eb93ffd5b8 => generated 112 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 16 01:33:54.787613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257076b-00c3-49db-bb54-622dc7932d40 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:54.793478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0257076b-00c3-49db-bb54-622dc7932d40 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:54.829345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268c816-2ced-4f71-a7e3-fdad5f426600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:54.831304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268c816-2ced-4f71-a7e3-fdad5f426600 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:54.842959 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3518/6995] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:54.895191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257076b-00c3-49db-bb54-622dc7932d40 tempest-TokensV3TestJSON-1459588881 tempest-TokensV3TestJSON-1459588881-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:54.901679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:54.902995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:54.903147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:54.903497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] PATH_INFO: `/v3/users/d24cac289f3d462ca3146b63efa516e5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:54.904761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d24cac289f3d462ca3146b63efa516e5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:54.908423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:54.975204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd24cac289f3d462ca3146b63efa516e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:54.977308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd24cac289f3d462ca3146b63efa516e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:54.992719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd24cac289f3d462ca3146b63efa516e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:55.002771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd24cac289f3d462ca3146b63efa516e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:55.003626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd24cac289f3d462ca3146b63efa516e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:55.045212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755f26b-8db0-4a1f-aced-c03ab2fa1e08 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:55.045385 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3478/6996] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:54 2022] DELETE /identity/v3/users/d24cac289f3d462ca3146b63efa516e5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:55.046484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755f26b-8db0-4a1f-aced-c03ab2fa1e08 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:55.047264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755f26b-8db0-4a1f-aced-c03ab2fa1e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:55.097420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2755f26b-8db0-4a1f-aced-c03ab2fa1e08 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:55.098671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2755f26b-8db0-4a1f-aced-c03ab2fa1e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:55.239722 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3519/6997] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:55.252356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:55.253838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:55.370075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc4f6e-89e3-48f2-a6f7-81123e1ba3ae admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:55.374403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47400d85-89bc-4232-9749-0207f90b5846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:55.375263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47400d85-89bc-4232-9749-0207f90b5846 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:55.376176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47400d85-89bc-4232-9749-0207f90b5846 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:55.376510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47400d85-89bc-4232-9749-0207f90b5846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:55.388735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47400d85-89bc-4232-9749-0207f90b5846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:55.390362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47400d85-89bc-4232-9749-0207f90b5846 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:55.415165 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3479/6998] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:55.747915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755f26b-8db0-4a1f-aced-c03ab2fa1e08 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:55.749555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2755f26b-8db0-4a1f-aced-c03ab2fa1e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:55.769885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755f26b-8db0-4a1f-aced-c03ab2fa1e08 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:55.781281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:55.782899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:55.793731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:55.794084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] PATH_INFO: `/v3/projects/f84db7c967b0425a89098305ae023db6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:55.798279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f84db7c967b0425a89098305ae023db6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:55.801855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:55.882072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f84db7c967b0425a89098305ae023db6', 'request_id': 'req-d4ec038e-1114-4c1f-806a-a6f702f040dc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:55.890023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f84db7c967b0425a89098305ae023db6', 'request_id': 'req-d4ec038e-1114-4c1f-806a-a6f702f040dc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:55.902336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f84db7c967b0425a89098305ae023db6', 'request_id': 'req-d4ec038e-1114-4c1f-806a-a6f702f040dc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:55.919199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] The token cache is being invalidate because project f84db7c967b0425a89098305ae023db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:55.919689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:55.922040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:55.931589 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3520/6999] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:55 2022] DELETE /identity/v3/projects/f84db7c967b0425a89098305ae023db6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:55.935541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47400d85-89bc-4232-9749-0207f90b5846 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:55.948962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47400d85-89bc-4232-9749-0207f90b5846 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:55.968788 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:56.047005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:56.051080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:56.051433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:56.051778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] PATH_INFO: `/v3/users/172a93a0955444d9a0926c7282a505e9` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:56.054742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=172a93a0955444d9a0926c7282a505e9)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:56.057570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:56.164589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '172a93a0955444d9a0926c7282a505e9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:56.165556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '172a93a0955444d9a0926c7282a505e9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:56.195982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '172a93a0955444d9a0926c7282a505e9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:56.208932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '172a93a0955444d9a0926c7282a505e9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:56.209630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '172a93a0955444d9a0926c7282a505e9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:56.231935 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3480/7000] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:55 2022] DELETE /identity/v3/users/172a93a0955444d9a0926c7282a505e9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:56.919284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:56.920942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:56.935738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:56.937302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:56.948516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec038e-1114-4c1f-806a-a6f702f040dc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:56.983783 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:57.028697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c09905-dcba-4030-83a5-5ca1c8a08f16 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:57.035575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:57.036303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:57.036641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:57.036925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] PATH_INFO: `/v3/projects/fa2a907ced2b405bae2c3b718f17d035` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:57.038328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2a907ced2b405bae2c3b718f17d035)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:57.040366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:57.086241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3fc4e-2963-4ca0-b859-01e0a9ec30c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:57.086894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3fc4e-2963-4ca0-b859-01e0a9ec30c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:57.087214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3fc4e-2963-4ca0-b859-01e0a9ec30c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:57.087490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3fc4e-2963-4ca0-b859-01e0a9ec30c2 admin admin] PATH_INFO: `/v3/users/1502daf0493049b0a4f85afb7a125998` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:57.088706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3fc4e-2963-4ca0-b859-01e0a9ec30c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1502daf0493049b0a4f85afb7a125998)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:57.090703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3fc4e-2963-4ca0-b859-01e0a9ec30c2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:57.113116 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:57.139242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2a907ced2b405bae2c3b718f17d035', 'request_id': 'req-1caf5a4f-a763-4093-9bed-cfc790dfc581'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.155392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2a907ced2b405bae2c3b718f17d035', 'request_id': 'req-1caf5a4f-a763-4093-9bed-cfc790dfc581'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.174771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2a907ced2b405bae2c3b718f17d035', 'request_id': 'req-1caf5a4f-a763-4093-9bed-cfc790dfc581'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.216594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-28d3fc4e-2963-4ca0-b859-01e0a9ec30c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1502daf0493049b0a4f85afb7a125998'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.218687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-28d3fc4e-2963-4ca0-b859-01e0a9ec30c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1502daf0493049b0a4f85afb7a125998'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.235677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] The token cache is being invalidate because project fa2a907ced2b405bae2c3b718f17d035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:57.238309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.240082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.248878 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3481/7001] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:56 2022] DELETE /identity/v3/projects/fa2a907ced2b405bae2c3b718f17d035 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:33:57.250409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:57.256288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:57.267621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-28d3fc4e-2963-4ca0-b859-01e0a9ec30c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1502daf0493049b0a4f85afb7a125998'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.288183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-28d3fc4e-2963-4ca0-b859-01e0a9ec30c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1502daf0493049b0a4f85afb7a125998'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.290139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-28d3fc4e-2963-4ca0-b859-01e0a9ec30c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1502daf0493049b0a4f85afb7a125998'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.326975 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3521/7002] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:56 2022] DELETE /identity/v3/users/1502daf0493049b0a4f85afb7a125998 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:57.331897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47918a70-02f7-4a4e-8b34-40ea4577925e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:57.332308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47918a70-02f7-4a4e-8b34-40ea4577925e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:57.332717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47918a70-02f7-4a4e-8b34-40ea4577925e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:57.375107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-47918a70-02f7-4a4e-8b34-40ea4577925e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:57.378839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47918a70-02f7-4a4e-8b34-40ea4577925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:57.399201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf5a4f-a763-4093-9bed-cfc790dfc581 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:57.512164 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3522/7003] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:57.521679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47918a70-02f7-4a4e-8b34-40ea4577925e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:57.523840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47918a70-02f7-4a4e-8b34-40ea4577925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:57.547101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3833e58-7f6b-4d3b-a421-daf1225244cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:57.547101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833e58-7f6b-4d3b-a421-daf1225244cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:57.547101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833e58-7f6b-4d3b-a421-daf1225244cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:57.547101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833e58-7f6b-4d3b-a421-daf1225244cf admin admin] PATH_INFO: `/v3/users/a1131c39f6cb47eea8e243fc28eb17d4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:57.551626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3833e58-7f6b-4d3b-a421-daf1225244cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1131c39f6cb47eea8e243fc28eb17d4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:57.551626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3833e58-7f6b-4d3b-a421-daf1225244cf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:57.628342 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:57.649968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a3833e58-7f6b-4d3b-a421-daf1225244cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1131c39f6cb47eea8e243fc28eb17d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.651094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a3833e58-7f6b-4d3b-a421-daf1225244cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1131c39f6cb47eea8e243fc28eb17d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.666552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a3833e58-7f6b-4d3b-a421-daf1225244cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1131c39f6cb47eea8e243fc28eb17d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.677817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a3833e58-7f6b-4d3b-a421-daf1225244cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1131c39f6cb47eea8e243fc28eb17d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.680076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a3833e58-7f6b-4d3b-a421-daf1225244cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1131c39f6cb47eea8e243fc28eb17d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:57.690031 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:57.699968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47918a70-02f7-4a4e-8b34-40ea4577925e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:57.714709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae68a9-ea82-4941-a5e0-7f4c8ed3e5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:57.715453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae68a9-ea82-4941-a5e0-7f4c8ed3e5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:57.716137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae68a9-ea82-4941-a5e0-7f4c8ed3e5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:57.717160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae68a9-ea82-4941-a5e0-7f4c8ed3e5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:57.724262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3aae68a9-ea82-4941-a5e0-7f4c8ed3e5c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:57.727472 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3482/7004] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:57 2022] DELETE /identity/v3/users/a1131c39f6cb47eea8e243fc28eb17d4 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:57.756448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae68a9-ea82-4941-a5e0-7f4c8ed3e5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:57.758732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae68a9-ea82-4941-a5e0-7f4c8ed3e5c9 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:57.767528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aee01-de30-41b8-94d4-2f04cb9b8834 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:57.768010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aee01-de30-41b8-94d4-2f04cb9b8834 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:57.768495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aee01-de30-41b8-94d4-2f04cb9b8834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:57.774051 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3523/7005] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:33:57.814246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-759aee01-de30-41b8-94d4-2f04cb9b8834 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:57.820620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-759aee01-de30-41b8-94d4-2f04cb9b8834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:57.959216 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3483/7006] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:33:58.040882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae68a9-ea82-4941-a5e0-7f4c8ed3e5c9 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:58.044583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3aae68a9-ea82-4941-a5e0-7f4c8ed3e5c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:58.239766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae68a9-ea82-4941-a5e0-7f4c8ed3e5c9 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:58.368690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01f8af-dc40-45f8-89a5-f4573a1e8a23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:58.369755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01f8af-dc40-45f8-89a5-f4573a1e8a23 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:58.370111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01f8af-dc40-45f8-89a5-f4573a1e8a23 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:58.370554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01f8af-dc40-45f8-89a5-f4573a1e8a23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:58.383550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01f8af-dc40-45f8-89a5-f4573a1e8a23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:58.387836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01f8af-dc40-45f8-89a5-f4573a1e8a23 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:58.415658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759aee01-de30-41b8-94d4-2f04cb9b8834 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:58.417455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-759aee01-de30-41b8-94d4-2f04cb9b8834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:58.427975 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3524/7007] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:33:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:33:58.429204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01f8af-dc40-45f8-89a5-f4573a1e8a23 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:58.436154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6a01f8af-dc40-45f8-89a5-f4573a1e8a23 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:58.655240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01f8af-dc40-45f8-89a5-f4573a1e8a23 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:58.662089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:58.663886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:58.664503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:58.665133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] PATH_INFO: `/v3/projects/9a9d337291ec4f35a1cffa914a7df300` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:58.667142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9d337291ec4f35a1cffa914a7df300)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:58.669904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:58.689885 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:58.710330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759aee01-de30-41b8-94d4-2f04cb9b8834 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:58.731134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4322e-a9c9-4254-947f-c0390abc421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:58.731894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4322e-a9c9-4254-947f-c0390abc421d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:58.732280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4322e-a9c9-4254-947f-c0390abc421d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:58.732410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4322e-a9c9-4254-947f-c0390abc421d admin admin] PATH_INFO: `/v3/users/4d1830e053fd4fe1b7faf929552529f0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:58.739159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4322e-a9c9-4254-947f-c0390abc421d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1830e053fd4fe1b7faf929552529f0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:58.741122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4322e-a9c9-4254-947f-c0390abc421d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:58.783478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9d337291ec4f35a1cffa914a7df300', 'request_id': 'req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:58.800079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9d337291ec4f35a1cffa914a7df300', 'request_id': 'req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:58.821085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9d337291ec4f35a1cffa914a7df300', 'request_id': 'req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:58.834854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] The token cache is being invalidate because project 9a9d337291ec4f35a1cffa914a7df300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:58.838095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:58.839194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:58.843279 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3525/7008] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:58 2022] DELETE /identity/v3/projects/9a9d337291ec4f35a1cffa914a7df300 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:58.844517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:58.850304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:58.903417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-63d4322e-a9c9-4254-947f-c0390abc421d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1830e053fd4fe1b7faf929552529f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:58.905748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-63d4322e-a9c9-4254-947f-c0390abc421d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1830e053fd4fe1b7faf929552529f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:58.950436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-63d4322e-a9c9-4254-947f-c0390abc421d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1830e053fd4fe1b7faf929552529f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:58.991844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-63d4322e-a9c9-4254-947f-c0390abc421d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1830e053fd4fe1b7faf929552529f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:58.994202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-63d4322e-a9c9-4254-947f-c0390abc421d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1830e053fd4fe1b7faf929552529f0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:59.099232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55d4ea-dceb-4677-9b9f-329a1dc4af6e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:59.100107 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3484/7009] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:58 2022] DELETE /identity/v3/users/4d1830e053fd4fe1b7faf929552529f0 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:59.105224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e1a3-11b5-456c-b002-63e809bca656 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:59.108046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e1a3-11b5-456c-b002-63e809bca656 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:59.114061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e1a3-11b5-456c-b002-63e809bca656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:59.153093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6be8e1a3-11b5-456c-b002-63e809bca656 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:59.154446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6be8e1a3-11b5-456c-b002-63e809bca656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:59.202606 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:59.258265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:59.259332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:59.259857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:59.260505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] PATH_INFO: `/v3/projects/56b60a0d776343e1a4ecfb6bf889f0ce` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:59.262713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b60a0d776343e1a4ecfb6bf889f0ce)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:59.269920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:59.270354 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3485/7010] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:59.277427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d52a3-ee20-4599-83b8-dacbc82ddd5b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:59.277427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d52a3-ee20-4599-83b8-dacbc82ddd5b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:59.277427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d52a3-ee20-4599-83b8-dacbc82ddd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:59.314661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e93d52a3-ee20-4599-83b8-dacbc82ddd5b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:59.317206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e93d52a3-ee20-4599-83b8-dacbc82ddd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:59.325772 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3486/7011] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:59.327284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37041-51f8-47ee-b922-2afe1e26d0b1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:59.327671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37041-51f8-47ee-b922-2afe1e26d0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:59.328257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37041-51f8-47ee-b922-2afe1e26d0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:59.395317 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:59.398039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-32f37041-51f8-47ee-b922-2afe1e26d0b1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:33:59.399433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-32f37041-51f8-47ee-b922-2afe1e26d0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:59.399909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b60a0d776343e1a4ecfb6bf889f0ce', 'request_id': 'req-46722671-dba5-448e-b170-acd669dc6827'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:59.413837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b60a0d776343e1a4ecfb6bf889f0ce', 'request_id': 'req-46722671-dba5-448e-b170-acd669dc6827'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:59.424144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b60a0d776343e1a4ecfb6bf889f0ce', 'request_id': 'req-46722671-dba5-448e-b170-acd669dc6827'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:59.444016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] The token cache is being invalidate because project 56b60a0d776343e1a4ecfb6bf889f0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:33:59.444313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:59.445027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:59.449998 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3526/7012] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:33:58 2022] DELETE /identity/v3/projects/56b60a0d776343e1a4ecfb6bf889f0ce => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:59.450957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:59.452382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:59.534682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46722671-dba5-448e-b170-acd669dc6827 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:59.542429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da90bd8-f176-48d7-9948-431f96d9ee30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:59.543228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da90bd8-f176-48d7-9948-431f96d9ee30 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:59.543797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da90bd8-f176-48d7-9948-431f96d9ee30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:59.544081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da90bd8-f176-48d7-9948-431f96d9ee30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:59.550374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4da90bd8-f176-48d7-9948-431f96d9ee30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:59.561680 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3487/7013] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:33:59.562622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f37041-51f8-47ee-b922-2afe1e26d0b1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:59.575353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da90bd8-f176-48d7-9948-431f96d9ee30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:59.575922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-32f37041-51f8-47ee-b922-2afe1e26d0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:33:59.583575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da90bd8-f176-48d7-9948-431f96d9ee30 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:59.597720 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3527/7014] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:33:59.598993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da90bd8-f176-48d7-9948-431f96d9ee30 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:59.620481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da90bd8-f176-48d7-9948-431f96d9ee30 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:59.620721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f37041-51f8-47ee-b922-2afe1e26d0b1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:59.633336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0ff9d-9f41-4485-a3a1-c5020d22d618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:59.633954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ff9d-9f41-4485-a3a1-c5020d22d618 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:59.635564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ff9d-9f41-4485-a3a1-c5020d22d618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:59.636766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ff9d-9f41-4485-a3a1-c5020d22d618 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:59.637724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0ff9d-9f41-4485-a3a1-c5020d22d618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:33:59.637724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0ff9d-9f41-4485-a3a1-c5020d22d618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:59.640264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:59.642303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0ff9d-9f41-4485-a3a1-c5020d22d618 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:59.643078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:59.647139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:59.648231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] PATH_INFO: `/v3/users/6ae44a7898c94e9dbfb9961f8ea78f15` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:59.659942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae44a7898c94e9dbfb9961f8ea78f15)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:59.662269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:59.678073 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3528/7015] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:33:59.679181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0ff9d-9f41-4485-a3a1-c5020d22d618 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:59.692778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0ff9d-9f41-4485-a3a1-c5020d22d618 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:33:59.697651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16401ec-d54c-4391-b823-61e9fa739c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:33:59.698713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16401ec-d54c-4391-b823-61e9fa739c69 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:33:59.699083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16401ec-d54c-4391-b823-61e9fa739c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:33:59.699363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16401ec-d54c-4391-b823-61e9fa739c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:33:59.700129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16401ec-d54c-4391-b823-61e9fa739c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:33:59.702706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16401ec-d54c-4391-b823-61e9fa739c69 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:33:59.745946 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3529/7016] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:33:59 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:33:59.753814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16401ec-d54c-4391-b823-61e9fa739c69 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:33:59.780775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae44a7898c94e9dbfb9961f8ea78f15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:59.781759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae44a7898c94e9dbfb9961f8ea78f15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:59.811092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae44a7898c94e9dbfb9961f8ea78f15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:59.835416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae44a7898c94e9dbfb9961f8ea78f15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:59.835416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae44a7898c94e9dbfb9961f8ea78f15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:33:59.877038 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3488/7017] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:33:59 2022] DELETE /identity/v3/users/6ae44a7898c94e9dbfb9961f8ea78f15 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:33:59.957344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16401ec-d54c-4391-b823-61e9fa739c69 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:00.134797 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:00.154570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bfaec-1de4-459e-9e8e-215c3c3e3998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:00.155356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bfaec-1de4-459e-9e8e-215c3c3e3998 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:00.155748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bfaec-1de4-459e-9e8e-215c3c3e3998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:00.156147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bfaec-1de4-459e-9e8e-215c3c3e3998 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:00.157465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bfaec-1de4-459e-9e8e-215c3c3e3998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:00.159553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bfaec-1de4-459e-9e8e-215c3c3e3998 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:00.208262 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3530/7018] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:33:59 2022] POST /identity/v3/users => generated 285 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:00.212318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:00.214780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:00.254964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c3778-3319-4403-bf47-4bd99744a8a6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:00.276934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea16e1a-fedb-446f-9bb0-80dc9942fdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:00.277723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea16e1a-fedb-446f-9bb0-80dc9942fdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:00.278130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea16e1a-fedb-446f-9bb0-80dc9942fdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:00.278506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea16e1a-fedb-446f-9bb0-80dc9942fdf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:00.280755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea16e1a-fedb-446f-9bb0-80dc9942fdf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:00.285679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea16e1a-fedb-446f-9bb0-80dc9942fdf6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:00.313848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bfaec-1de4-459e-9e8e-215c3c3e3998 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:00.314397 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3489/7019] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:00.331950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bfaec-1de4-459e-9e8e-215c3c3e3998 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:00.346172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6f32e-e15e-458c-a277-5ae3760b0786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:00.346946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6f32e-e15e-458c-a277-5ae3760b0786 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:00.347366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6f32e-e15e-458c-a277-5ae3760b0786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:00.347745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6f32e-e15e-458c-a277-5ae3760b0786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:00.348499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6f32e-e15e-458c-a277-5ae3760b0786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:00.351710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6f32e-e15e-458c-a277-5ae3760b0786 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:00.373135 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3531/7020] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:34:00.378932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea16e1a-fedb-446f-9bb0-80dc9942fdf6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:00.390365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea16e1a-fedb-446f-9bb0-80dc9942fdf6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:00.401742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44bbaf-1261-48db-aa46-a71a555b29c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:00.402550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44bbaf-1261-48db-aa46-a71a555b29c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:00.403213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44bbaf-1261-48db-aa46-a71a555b29c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:00.403491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44bbaf-1261-48db-aa46-a71a555b29c1 admin admin] PATH_INFO: `/v3/projects/0608c49af850453da7632aa14a1addc2/users/f37630bff21f4c359b75cd5e5c027d24/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:00.424733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6f32e-e15e-458c-a277-5ae3760b0786 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:00.426834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e7d6f32e-e15e-458c-a277-5ae3760b0786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:00.454868 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:00.457505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6f32e-e15e-458c-a277-5ae3760b0786 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:00.466479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44bbaf-1261-48db-aa46-a71a555b29c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0608c49af850453da7632aa14a1addc2, user_id=f37630bff21f4c359b75cd5e5c027d24, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:00.471347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44bbaf-1261-48db-aa46-a71a555b29c1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:00.472123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:00.472889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:00.475086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:00.475483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] PATH_INFO: `/v3/projects/7ac40a8f05824b1fb5dd00a145aed17b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:00.476991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac40a8f05824b1fb5dd00a145aed17b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:00.485386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:00.510889 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3490/7021] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:00 2022] PUT /identity/v3/projects/0608c49af850453da7632aa14a1addc2/users/f37630bff21f4c359b75cd5e5c027d24/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:00.522784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a46bac-e1f3-4d35-a614-617d8e3937ba None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:00.523848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a46bac-e1f3-4d35-a614-617d8e3937ba None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:00.524241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a46bac-e1f3-4d35-a614-617d8e3937ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:00.608869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-02a46bac-e1f3-4d35-a614-617d8e3937ba None None] MFA Rules not processed for user `f37630bff21f4c359b75cd5e5c027d24`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:00.614863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-02a46bac-e1f3-4d35-a614-617d8e3937ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:00.657646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac40a8f05824b1fb5dd00a145aed17b', 'request_id': 'req-2f721063-7b53-4aa5-a6c1-426d81ca1b71'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:00.676281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac40a8f05824b1fb5dd00a145aed17b', 'request_id': 'req-2f721063-7b53-4aa5-a6c1-426d81ca1b71'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:00.690665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac40a8f05824b1fb5dd00a145aed17b', 'request_id': 'req-2f721063-7b53-4aa5-a6c1-426d81ca1b71'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:00.710488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] The token cache is being invalidate because project 7ac40a8f05824b1fb5dd00a145aed17b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:00.711152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:00.712931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:00.718687 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3532/7022] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:00 2022] DELETE /identity/v3/projects/7ac40a8f05824b1fb5dd00a145aed17b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:34:00.720130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:00.722710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:00.823530 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3491/7023] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:34:00.825026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a46bac-e1f3-4d35-a614-617d8e3937ba None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:00.826957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-02a46bac-e1f3-4d35-a614-617d8e3937ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:00.872751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f721063-7b53-4aa5-a6c1-426d81ca1b71 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:00.892242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:00.892975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:00.893370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:00.893758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] PATH_INFO: `/v3/projects/8f5edef17b4e4734bb479836b7fb14da` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:00.895179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5edef17b4e4734bb479836b7fb14da)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:00.897238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:00.962176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a46bac-e1f3-4d35-a614-617d8e3937ba None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:00.971472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6628ba-cf83-4ba0-8af4-eb84fb780df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:00.972762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6628ba-cf83-4ba0-8af4-eb84fb780df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:00.973362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6628ba-cf83-4ba0-8af4-eb84fb780df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:00.974078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6628ba-cf83-4ba0-8af4-eb84fb780df7 admin admin] PATH_INFO: `/v3/users/b4be138e990e49e58efdfd49d5e1a7eb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:00.975943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6628ba-cf83-4ba0-8af4-eb84fb780df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4be138e990e49e58efdfd49d5e1a7eb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:00.978513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6628ba-cf83-4ba0-8af4-eb84fb780df7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:01.021301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5edef17b4e4734bb479836b7fb14da', 'request_id': 'req-baa65377-7dc9-4b67-a508-e1ca0fbcf622'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:01.039785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5edef17b4e4734bb479836b7fb14da', 'request_id': 'req-baa65377-7dc9-4b67-a508-e1ca0fbcf622'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:01.042622 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:01.053547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5edef17b4e4734bb479836b7fb14da', 'request_id': 'req-baa65377-7dc9-4b67-a508-e1ca0fbcf622'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:01.081086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] The token cache is being invalidate because project 8f5edef17b4e4734bb479836b7fb14da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:01.081450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:01.082168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b6628ba-cf83-4ba0-8af4-eb84fb780df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4be138e990e49e58efdfd49d5e1a7eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:01.082834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:01.083462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b6628ba-cf83-4ba0-8af4-eb84fb780df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4be138e990e49e58efdfd49d5e1a7eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:01.088645 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3533/7024] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:00 2022] DELETE /identity/v3/projects/8f5edef17b4e4734bb479836b7fb14da => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:01.091106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:01.094850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:01.115895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b6628ba-cf83-4ba0-8af4-eb84fb780df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4be138e990e49e58efdfd49d5e1a7eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:01.136310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b6628ba-cf83-4ba0-8af4-eb84fb780df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4be138e990e49e58efdfd49d5e1a7eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:01.137462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b6628ba-cf83-4ba0-8af4-eb84fb780df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4be138e990e49e58efdfd49d5e1a7eb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:01.168932 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:01.180446 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3492/7025] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:00 2022] DELETE /identity/v3/users/b4be138e990e49e58efdfd49d5e1a7eb => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:01.184572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e81a2-75c4-499f-ac2a-2d74b6744207 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:01.184864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e81a2-75c4-499f-ac2a-2d74b6744207 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:01.185158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e81a2-75c4-499f-ac2a-2d74b6744207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:01.232089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a05e81a2-75c4-499f-ac2a-2d74b6744207 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:01.233365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a05e81a2-75c4-499f-ac2a-2d74b6744207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:01.285166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa65377-7dc9-4b67-a508-e1ca0fbcf622 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:01.337922 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3493/7026] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:01.345880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c6562-2571-47dc-8357-9b5323cf71b2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:01.346479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c6562-2571-47dc-8357-9b5323cf71b2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:01.347037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c6562-2571-47dc-8357-9b5323cf71b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:01.403401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ab1c6562-2571-47dc-8357-9b5323cf71b2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:01.408454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ab1c6562-2571-47dc-8357-9b5323cf71b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:01.433111 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3494/7027] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:34:01.436943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c6562-2571-47dc-8357-9b5323cf71b2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:01.460259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c6562-2571-47dc-8357-9b5323cf71b2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:01.466009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a899c-5a19-46e5-8f56-832a2328e44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:01.466807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a899c-5a19-46e5-8f56-832a2328e44c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:01.467395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a899c-5a19-46e5-8f56-832a2328e44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:01.467595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a899c-5a19-46e5-8f56-832a2328e44c admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:01.468342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a899c-5a19-46e5-8f56-832a2328e44c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:01.470423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c539bca-1878-4391-9200-10c7728ece3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:01.472172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c539bca-1878-4391-9200-10c7728ece3f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:01.472480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c539bca-1878-4391-9200-10c7728ece3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:01.472780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c539bca-1878-4391-9200-10c7728ece3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:01.473429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c539bca-1878-4391-9200-10c7728ece3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:01.473738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c539bca-1878-4391-9200-10c7728ece3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:01.476507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a899c-5a19-46e5-8f56-832a2328e44c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:01.478254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c539bca-1878-4391-9200-10c7728ece3f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:01.513433 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3495/7028] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:01.514292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c539bca-1878-4391-9200-10c7728ece3f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:01.531075 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3534/7029] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:01 2022] POST /identity/v3/projects => generated 367 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:01.536807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a899c-5a19-46e5-8f56-832a2328e44c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:01.539991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c539bca-1878-4391-9200-10c7728ece3f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:01.716926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d39579-40af-47ee-aa68-08f75be56600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:01.717630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d39579-40af-47ee-aa68-08f75be56600 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:01.719663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d39579-40af-47ee-aa68-08f75be56600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:01.721541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d39579-40af-47ee-aa68-08f75be56600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:01.723495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d39579-40af-47ee-aa68-08f75be56600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:01.723991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a899c-5a19-46e5-8f56-832a2328e44c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:01.731552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d39579-40af-47ee-aa68-08f75be56600 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:01.742234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df95bf-bda3-4da8-bd87-679b36eca808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:01.742864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df95bf-bda3-4da8-bd87-679b36eca808 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:01.743179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df95bf-bda3-4da8-bd87-679b36eca808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:01.743477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df95bf-bda3-4da8-bd87-679b36eca808 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:01.744281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df95bf-bda3-4da8-bd87-679b36eca808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:01.747518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df95bf-bda3-4da8-bd87-679b36eca808 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:01.822006 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3535/7030] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:01 2022] POST /identity/v3/users => generated 290 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:34:01.823137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df95bf-bda3-4da8-bd87-679b36eca808 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:01.825499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e6df95bf-bda3-4da8-bd87-679b36eca808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:01.825636 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3496/7031] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:01 2022] POST /identity/v3/projects => generated 377 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:01.826491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d39579-40af-47ee-aa68-08f75be56600 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:01.853697 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:01.860237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df95bf-bda3-4da8-bd87-679b36eca808 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:01.942714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d39579-40af-47ee-aa68-08f75be56600 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:01.950726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cc751-05d0-4094-89b2-48b7f43a60b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:01.951978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cc751-05d0-4094-89b2-48b7f43a60b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:01.952621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cc751-05d0-4094-89b2-48b7f43a60b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:01.953119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cc751-05d0-4094-89b2-48b7f43a60b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:01.955896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cc751-05d0-4094-89b2-48b7f43a60b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:01.958853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cc751-05d0-4094-89b2-48b7f43a60b0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:01.968335 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:01.983689 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3497/7032] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:01.986297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cc751-05d0-4094-89b2-48b7f43a60b0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:02.004057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:02.007355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.008048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.008573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] PATH_INFO: `/v3/projects/a4cff3e3819a462ab4a8cd029e8d189f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.010425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4cff3e3819a462ab4a8cd029e8d189f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:02.011402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cc751-05d0-4094-89b2-48b7f43a60b0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:02.015130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:02.025819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fe33a-8b01-47f2-8adc-7745493c52cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:02.026833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fe33a-8b01-47f2-8adc-7745493c52cc admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.027493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fe33a-8b01-47f2-8adc-7745493c52cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.027988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fe33a-8b01-47f2-8adc-7745493c52cc admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.029988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fe33a-8b01-47f2-8adc-7745493c52cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:02.037032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fe33a-8b01-47f2-8adc-7745493c52cc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:02.085034 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3498/7033] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:01 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:02.086465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fe33a-8b01-47f2-8adc-7745493c52cc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:02.103100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fe33a-8b01-47f2-8adc-7745493c52cc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:02.111010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b943db-9ef1-4468-b409-9a0a1417ff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:02.111695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b943db-9ef1-4468-b409-9a0a1417ff50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.111974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b943db-9ef1-4468-b409-9a0a1417ff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.112246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b943db-9ef1-4468-b409-9a0a1417ff50 admin admin] PATH_INFO: `/v3/projects/1330ed37916845a0ad3442a93345bf7b/users/ced8bb91f3f94876a9295c0101fea4b0/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.128480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4cff3e3819a462ab4a8cd029e8d189f', 'request_id': 'req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:02.131246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b943db-9ef1-4468-b409-9a0a1417ff50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1330ed37916845a0ad3442a93345bf7b, user_id=ced8bb91f3f94876a9295c0101fea4b0, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:02.133916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b943db-9ef1-4468-b409-9a0a1417ff50 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:02.138160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4cff3e3819a462ab4a8cd029e8d189f', 'request_id': 'req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:02.149825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4cff3e3819a462ab4a8cd029e8d189f', 'request_id': 'req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:02.156534 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3499/7034] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:02 2022] PUT /identity/v3/projects/1330ed37916845a0ad3442a93345bf7b/users/ced8bb91f3f94876a9295c0101fea4b0/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:02.158101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b943db-9ef1-4468-b409-9a0a1417ff50 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:02.165834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] The token cache is being invalidate because project a4cff3e3819a462ab4a8cd029e8d189f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:02.166619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:02.167553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:02.170176 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3536/7035] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:01 2022] DELETE /identity/v3/projects/a4cff3e3819a462ab4a8cd029e8d189f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:02.171589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:02.174184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:02.268815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b943db-9ef1-4468-b409-9a0a1417ff50 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:02.286764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc097bd-ec34-4746-ab85-4fe681c848eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:02.287399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc097bd-ec34-4746-ab85-4fe681c848eb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.287677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc097bd-ec34-4746-ab85-4fe681c848eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.287947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc097bd-ec34-4746-ab85-4fe681c848eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.288589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc097bd-ec34-4746-ab85-4fe681c848eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:02.290186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc097bd-ec34-4746-ab85-4fe681c848eb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:02.314324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dfae0-2d6f-43ff-8213-b53e33a1b613 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:02.315720 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3500/7036] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:02.319995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75542c-0545-4f23-94b3-22f9ddbd7c29 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.320282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75542c-0545-4f23-94b3-22f9ddbd7c29 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.320556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75542c-0545-4f23-94b3-22f9ddbd7c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.323548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c70746-7bd0-4c58-bf43-be4d78a9b0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:02.324786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c70746-7bd0-4c58-bf43-be4d78a9b0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.325167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c70746-7bd0-4c58-bf43-be4d78a9b0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.325562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c70746-7bd0-4c58-bf43-be4d78a9b0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.326802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c70746-7bd0-4c58-bf43-be4d78a9b0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:02.329210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c70746-7bd0-4c58-bf43-be4d78a9b0d7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:02.341072 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3537/7037] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:02.345252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c70746-7bd0-4c58-bf43-be4d78a9b0d7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:02.347133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-23c70746-7bd0-4c58-bf43-be4d78a9b0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:02.349202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ef75542c-0545-4f23-94b3-22f9ddbd7c29 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:02.350369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef75542c-0545-4f23-94b3-22f9ddbd7c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:02.359365 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3501/7038] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:02.360092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75542c-0545-4f23-94b3-22f9ddbd7c29 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:02.362371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c70746-7bd0-4c58-bf43-be4d78a9b0d7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:02.368620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ddae1-9cfd-4cc7-983f-cc82ed71b351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:02.369710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ddae1-9cfd-4cc7-983f-cc82ed71b351 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.370087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ddae1-9cfd-4cc7-983f-cc82ed71b351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.370502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ddae1-9cfd-4cc7-983f-cc82ed71b351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.371285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ddae1-9cfd-4cc7-983f-cc82ed71b351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:02.373056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ddae1-9cfd-4cc7-983f-cc82ed71b351 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:02.373569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75542c-0545-4f23-94b3-22f9ddbd7c29 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:02.382950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69d04b-030e-4328-86a9-8138b1d96624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:02.383933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69d04b-030e-4328-86a9-8138b1d96624 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.384213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69d04b-030e-4328-86a9-8138b1d96624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.384486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69d04b-030e-4328-86a9-8138b1d96624 admin admin] PATH_INFO: `/v3/projects/1330ed37916845a0ad3442a93345bf7b/users/ced8bb91f3f94876a9295c0101fea4b0/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.387690 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3538/7039] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:02.390633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be525c2a-6914-4ae6-9da4-6d0d099a30e2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.390633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be525c2a-6914-4ae6-9da4-6d0d099a30e2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.390633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be525c2a-6914-4ae6-9da4-6d0d099a30e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.391249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69d04b-030e-4328-86a9-8138b1d96624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1330ed37916845a0ad3442a93345bf7b, user_id=ced8bb91f3f94876a9295c0101fea4b0, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:02.409065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69d04b-030e-4328-86a9-8138b1d96624 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:02.413870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-be525c2a-6914-4ae6-9da4-6d0d099a30e2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:02.415792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-be525c2a-6914-4ae6-9da4-6d0d099a30e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:02.446147 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3539/7040] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:02.446147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be525c2a-6914-4ae6-9da4-6d0d099a30e2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:02.456251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be525c2a-6914-4ae6-9da4-6d0d099a30e2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:02.458385 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3502/7041] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:02 2022] PUT /identity/v3/projects/1330ed37916845a0ad3442a93345bf7b/users/ced8bb91f3f94876a9295c0101fea4b0/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:02.458561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69d04b-030e-4328-86a9-8138b1d96624 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:02.477995 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:02.546802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5e345-a4fd-45f8-8294-5ed8b74e7d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:02.548996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5e345-a4fd-45f8-8294-5ed8b74e7d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.549390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5e345-a4fd-45f8-8294-5ed8b74e7d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.550054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5e345-a4fd-45f8-8294-5ed8b74e7d59 admin admin] PATH_INFO: `/v3/projects/a3a01506391040a99c3d98b79eb75d5a/users/46d942640d6a4712a9af5db1be6e4ea3/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.580213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5e345-a4fd-45f8-8294-5ed8b74e7d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a01506391040a99c3d98b79eb75d5a, user_id=46d942640d6a4712a9af5db1be6e4ea3, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:02.581851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69d04b-030e-4328-86a9-8138b1d96624 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:02.583297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5e345-a4fd-45f8-8294-5ed8b74e7d59 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:02.593233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68d0a7-b4db-4562-8e13-d2ee2538b62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:02.596295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68d0a7-b4db-4562-8e13-d2ee2538b62e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.596592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68d0a7-b4db-4562-8e13-d2ee2538b62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.597052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68d0a7-b4db-4562-8e13-d2ee2538b62e admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.597624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68d0a7-b4db-4562-8e13-d2ee2538b62e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:02.597928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68d0a7-b4db-4562-8e13-d2ee2538b62e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:02.601970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68d0a7-b4db-4562-8e13-d2ee2538b62e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:02.604022 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3540/7042] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:02 2022] PUT /identity/v3/projects/a3a01506391040a99c3d98b79eb75d5a/users/46d942640d6a4712a9af5db1be6e4ea3/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:02.606909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a272cd-785a-4d6b-97c5-2bf6defa84cc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.607329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a272cd-785a-4d6b-97c5-2bf6defa84cc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.607704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a272cd-785a-4d6b-97c5-2bf6defa84cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.649734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-11a272cd-785a-4d6b-97c5-2bf6defa84cc None None] MFA Rules not processed for user `ced8bb91f3f94876a9295c0101fea4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:02.651363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-11a272cd-785a-4d6b-97c5-2bf6defa84cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:02.730105 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3503/7043] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:02.738498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68d0a7-b4db-4562-8e13-d2ee2538b62e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:02.756433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68d0a7-b4db-4562-8e13-d2ee2538b62e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:02.761465 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3541/7044] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:02.763286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81aae-cb6f-4b96-8ba1-8541f3228a21 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.763654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81aae-cb6f-4b96-8ba1-8541f3228a21 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.764000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81aae-cb6f-4b96-8ba1-8541f3228a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.803096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-eec81aae-cb6f-4b96-8ba1-8541f3228a21 None None] MFA Rules not processed for user `46d942640d6a4712a9af5db1be6e4ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:02.804288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eec81aae-cb6f-4b96-8ba1-8541f3228a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:02.820847 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:02.910563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce273336-9d50-45d8-8802-551f1bf6b752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:02.911397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce273336-9d50-45d8-8802-551f1bf6b752 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.911678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce273336-9d50-45d8-8802-551f1bf6b752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.911951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce273336-9d50-45d8-8802-551f1bf6b752 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.912743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce273336-9d50-45d8-8802-551f1bf6b752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:02.914859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce273336-9d50-45d8-8802-551f1bf6b752 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:02.959223 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3542/7045] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:02.960688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81aae-cb6f-4b96-8ba1-8541f3228a21 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:02.978407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81aae-cb6f-4b96-8ba1-8541f3228a21 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:02.985532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fde18-ec20-481e-a038-6f6c4733dab2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:02.986388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fde18-ec20-481e-a038-6f6c4733dab2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:02.986777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fde18-ec20-481e-a038-6f6c4733dab2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:02.987384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fde18-ec20-481e-a038-6f6c4733dab2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:02.998747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fde18-ec20-481e-a038-6f6c4733dab2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:03.005324 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3504/7046] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:02 2022] POST /identity/v3/projects => generated 367 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:03.005324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce273336-9d50-45d8-8802-551f1bf6b752 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:03.006700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fde18-ec20-481e-a038-6f6c4733dab2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:03.021671 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:03.063224 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3543/7047] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:34:02 2022] POST /identity/v3/projects => generated 328 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:03.066796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fde18-ec20-481e-a038-6f6c4733dab2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:03.181504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce273336-9d50-45d8-8802-551f1bf6b752 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:03.229367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fde18-ec20-481e-a038-6f6c4733dab2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:03.257366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152e7c2-2b87-4189-854b-81ff50c97858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:03.258045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e7c2-2b87-4189-854b-81ff50c97858 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:03.258338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e7c2-2b87-4189-854b-81ff50c97858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:03.258591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e7c2-2b87-4189-854b-81ff50c97858 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:03.259658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152e7c2-2b87-4189-854b-81ff50c97858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:03.261636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152e7c2-2b87-4189-854b-81ff50c97858 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:03.302252 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3544/7048] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:03 2022] POST /identity/v3/users => generated 284 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:03.303314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152e7c2-2b87-4189-854b-81ff50c97858 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:03.371484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51d923-34c1-432f-98b5-797b0c087ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:03.372815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d923-34c1-432f-98b5-797b0c087ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:03.373316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d923-34c1-432f-98b5-797b0c087ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:03.373769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d923-34c1-432f-98b5-797b0c087ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:03.374849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d923-34c1-432f-98b5-797b0c087ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:03.377789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d923-34c1-432f-98b5-797b0c087ccb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:03.415535 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3505/7049] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:03 2022] POST /identity/v3/projects => generated 379 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:03.417029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51d923-34c1-432f-98b5-797b0c087ccb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:03.419682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152e7c2-2b87-4189-854b-81ff50c97858 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:03.537927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810ba3c-c0fb-4f98-94ba-08079ec55970 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:03.538903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810ba3c-c0fb-4f98-94ba-08079ec55970 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:03.539319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810ba3c-c0fb-4f98-94ba-08079ec55970 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:03.539702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810ba3c-c0fb-4f98-94ba-08079ec55970 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:03.540582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810ba3c-c0fb-4f98-94ba-08079ec55970 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:03.543029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810ba3c-c0fb-4f98-94ba-08079ec55970 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:03.569150 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:03.595418 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3545/7050] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:03 2022] POST /identity/v3/users => generated 413 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:03.597958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810ba3c-c0fb-4f98-94ba-08079ec55970 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:03.603526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51d923-34c1-432f-98b5-797b0c087ccb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:03.615720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edb4fc-57f4-4969-91bd-1c1767c0954f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:03.616358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edb4fc-57f4-4969-91bd-1c1767c0954f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:03.616636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edb4fc-57f4-4969-91bd-1c1767c0954f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:03.616907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edb4fc-57f4-4969-91bd-1c1767c0954f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:03.619648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edb4fc-57f4-4969-91bd-1c1767c0954f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:03.622409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edb4fc-57f4-4969-91bd-1c1767c0954f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:03.623946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810ba3c-c0fb-4f98-94ba-08079ec55970 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:03.637309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f844f-fafb-4b37-8fe3-286e5f6682d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:03.638312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f844f-fafb-4b37-8fe3-286e5f6682d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:03.638843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f844f-fafb-4b37-8fe3-286e5f6682d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:03.639393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f844f-fafb-4b37-8fe3-286e5f6682d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:03.640270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f844f-fafb-4b37-8fe3-286e5f6682d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:03.643011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f844f-fafb-4b37-8fe3-286e5f6682d3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:03.648149 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3506/7051] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:03.648867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edb4fc-57f4-4969-91bd-1c1767c0954f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:03.674568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edb4fc-57f4-4969-91bd-1c1767c0954f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:03.684563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508090c8-2e1a-4819-8b0c-bda9e1e123db tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:03.686316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508090c8-2e1a-4819-8b0c-bda9e1e123db tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:03.687055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508090c8-2e1a-4819-8b0c-bda9e1e123db tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:03.688397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508090c8-2e1a-4819-8b0c-bda9e1e123db tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:03.692661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508090c8-2e1a-4819-8b0c-bda9e1e123db tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:03.695878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508090c8-2e1a-4819-8b0c-bda9e1e123db tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:03.702296 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:03.720356 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3546/7052] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:03 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:03.728747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f844f-fafb-4b37-8fe3-286e5f6682d3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:03.732846 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3507/7053] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:34:03 2022] POST /identity/v3/roles => generated 243 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:03.733802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508090c8-2e1a-4819-8b0c-bda9e1e123db tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:03.740437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f844f-fafb-4b37-8fe3-286e5f6682d3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:03.757750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508090c8-2e1a-4819-8b0c-bda9e1e123db tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:03.758619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba16196-e3c3-4eb5-b9e7-b28e84b4d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:03.763501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba16196-e3c3-4eb5-b9e7-b28e84b4d38d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:03.764895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba16196-e3c3-4eb5-b9e7-b28e84b4d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:03.765649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba16196-e3c3-4eb5-b9e7-b28e84b4d38d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:03.767683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba16196-e3c3-4eb5-b9e7-b28e84b4d38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:03.769779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba16196-e3c3-4eb5-b9e7-b28e84b4d38d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:03.772074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d29cf-4f92-4542-80cc-bd14705ca0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:03.772704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d29cf-4f92-4542-80cc-bd14705ca0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:03.772982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d29cf-4f92-4542-80cc-bd14705ca0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:03.773319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d29cf-4f92-4542-80cc-bd14705ca0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:03.774106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d29cf-4f92-4542-80cc-bd14705ca0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:03.776230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d29cf-4f92-4542-80cc-bd14705ca0d7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:03.795366 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3547/7054] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:03 2022] GET /identity/v3/roles => generated 1654 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:03.796518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba16196-e3c3-4eb5-b9e7-b28e84b4d38d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:03.806426 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3508/7055] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:03 2022] GET /identity/v3/roles => generated 1654 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:03.806426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d29cf-4f92-4542-80cc-bd14705ca0d7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:03.811705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba16196-e3c3-4eb5-b9e7-b28e84b4d38d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:03.819033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb1c14-ee4a-47e8-9bc6-e934250a1bb8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:03.819768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb1c14-ee4a-47e8-9bc6-e934250a1bb8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:03.820262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb1c14-ee4a-47e8-9bc6-e934250a1bb8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:03.820785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb1c14-ee4a-47e8-9bc6-e934250a1bb8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:03.822077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb1c14-ee4a-47e8-9bc6-e934250a1bb8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:03.823869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb1c14-ee4a-47e8-9bc6-e934250a1bb8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:03.834197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d29cf-4f92-4542-80cc-bd14705ca0d7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:03.846201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86554e-9fe2-49a2-ac5c-3386565bb248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:03.848042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86554e-9fe2-49a2-ac5c-3386565bb248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:03.848337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86554e-9fe2-49a2-ac5c-3386565bb248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:03.848622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86554e-9fe2-49a2-ac5c-3386565bb248 admin admin] PATH_INFO: `/v3/projects/43300708939f44e695c999230d4baf0c/users/6f2e70ecf1a8455e8a083ebe6ff77514/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:03.853588 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3548/7056] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:34:03 2022] POST /identity/v3/roles => generated 246 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:03.855219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb1c14-ee4a-47e8-9bc6-e934250a1bb8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:03.890298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb1c14-ee4a-47e8-9bc6-e934250a1bb8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:03.895773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86554e-9fe2-49a2-ac5c-3386565bb248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43300708939f44e695c999230d4baf0c, user_id=6f2e70ecf1a8455e8a083ebe6ff77514, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:03.899390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86554e-9fe2-49a2-ac5c-3386565bb248 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:03.901357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1f0e8-a02f-476d-a82b-716706356d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:03.902193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f0e8-a02f-476d-a82b-716706356d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:03.902584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f0e8-a02f-476d-a82b-716706356d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:03.903038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f0e8-a02f-476d-a82b-716706356d19 admin admin] PATH_INFO: `/v3/projects/4e3cf0f78d8d421d87963e2962728308/users/1076cb6062ce497fbcc485248bfea66d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:03.924291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1f0e8-a02f-476d-a82b-716706356d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3cf0f78d8d421d87963e2962728308, user_id=1076cb6062ce497fbcc485248bfea66d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:03.928259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1f0e8-a02f-476d-a82b-716706356d19 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:03.937220 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3509/7057] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:03 2022] PUT /identity/v3/projects/43300708939f44e695c999230d4baf0c/users/6f2e70ecf1a8455e8a083ebe6ff77514/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:03.937220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86554e-9fe2-49a2-ac5c-3386565bb248 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:03.967426 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3549/7058] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:03 2022] PUT /identity/v3/projects/4e3cf0f78d8d421d87963e2962728308/users/1076cb6062ce497fbcc485248bfea66d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:03.969572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd700ba9-84d6-4915-a4e4-fe333e971712 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:03.972555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd700ba9-84d6-4915-a4e4-fe333e971712 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:03.972855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd700ba9-84d6-4915-a4e4-fe333e971712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:04.056297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86554e-9fe2-49a2-ac5c-3386565bb248 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:04.079513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dd700ba9-84d6-4915-a4e4-fe333e971712 None None] MFA Rules not processed for user `6f2e70ecf1a8455e8a083ebe6ff77514`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:04.081139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dd700ba9-84d6-4915-a4e4-fe333e971712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:04.212251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f53457-b22f-46e0-9041-5fa65e5f830a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:04.213031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f53457-b22f-46e0-9041-5fa65e5f830a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:04.213314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f53457-b22f-46e0-9041-5fa65e5f830a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:04.213589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f53457-b22f-46e0-9041-5fa65e5f830a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/556cbd0b1a7542c793f0a59a21328491/users/52845f1d62b44a3290421409819a1f3f/roles/49128baafda84fa782bd7c4dd24478bb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:04.224155 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3550/7059] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:04.226350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd700ba9-84d6-4915-a4e4-fe333e971712 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:04.264532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f53457-b22f-46e0-9041-5fa65e5f830a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_grant(project_id=556cbd0b1a7542c793f0a59a21328491, user_id=52845f1d62b44a3290421409819a1f3f, role_id=49128baafda84fa782bd7c4dd24478bb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:04.268636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f53457-b22f-46e0-9041-5fa65e5f830a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:04.305856 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3510/7060] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:03 2022] PUT /identity/v3/projects/556cbd0b1a7542c793f0a59a21328491/users/52845f1d62b44a3290421409819a1f3f/roles/49128baafda84fa782bd7c4dd24478bb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:04.306685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f53457-b22f-46e0-9041-5fa65e5f830a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:04.378946 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:04.381122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd700ba9-84d6-4915-a4e4-fe333e971712 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:04.440189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f53457-b22f-46e0-9041-5fa65e5f830a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:04.448325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ff0ec-e2bc-444d-ad03-95523e7aa2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:04.450899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff0ec-e2bc-444d-ad03-95523e7aa2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:04.451970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff0ec-e2bc-444d-ad03-95523e7aa2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:04.452662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff0ec-e2bc-444d-ad03-95523e7aa2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:04.456338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ff0ec-e2bc-444d-ad03-95523e7aa2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:04.460865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ff0ec-e2bc-444d-ad03-95523e7aa2f0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:04.481479 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:04.513507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418c334-813a-4cab-841e-287444fd89b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:04.514557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c334-813a-4cab-841e-287444fd89b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:04.515125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c334-813a-4cab-841e-287444fd89b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:04.515762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c334-813a-4cab-841e-287444fd89b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:04.516877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418c334-813a-4cab-841e-287444fd89b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:04.519028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418c334-813a-4cab-841e-287444fd89b5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:04.540626 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3511/7061] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:04 2022] POST /identity/v3/projects => generated 369 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:04.540626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ff0ec-e2bc-444d-ad03-95523e7aa2f0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:04.544631 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3551/7062] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:04 2022] GET /identity/v3/roles => generated 1891 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:04.554167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418c334-813a-4cab-841e-287444fd89b5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:04.578867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418c334-813a-4cab-841e-287444fd89b5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:04.665858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604346a-080e-4bdb-bad6-c865b5efac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:04.666725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604346a-080e-4bdb-bad6-c865b5efac8c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:04.667107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604346a-080e-4bdb-bad6-c865b5efac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:04.667696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604346a-080e-4bdb-bad6-c865b5efac8c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:04.668587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604346a-080e-4bdb-bad6-c865b5efac8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:04.673602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604346a-080e-4bdb-bad6-c865b5efac8c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:04.713595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ff0ec-e2bc-444d-ad03-95523e7aa2f0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:04.716614 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3552/7063] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:04 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:04.721216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604346a-080e-4bdb-bad6-c865b5efac8c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:04.733240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a8397-b2db-4e8c-9e3d-429b397308dd tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:04.734094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a8397-b2db-4e8c-9e3d-429b397308dd tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:04.734408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a8397-b2db-4e8c-9e3d-429b397308dd tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:04.735275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a8397-b2db-4e8c-9e3d-429b397308dd tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/556cbd0b1a7542c793f0a59a21328491/users/52845f1d62b44a3290421409819a1f3f/roles/42837bd7bec94551b40283b2d93345de` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:04.736956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604346a-080e-4bdb-bad6-c865b5efac8c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:04.742548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36662691-845c-4f5a-a278-b3ad234f3fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:04.746489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662691-845c-4f5a-a278-b3ad234f3fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:04.746489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662691-845c-4f5a-a278-b3ad234f3fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:04.746489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662691-845c-4f5a-a278-b3ad234f3fdf admin admin] PATH_INFO: `/v3/projects/4e3cf0f78d8d421d87963e2962728308/users/1076cb6062ce497fbcc485248bfea66d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:04.746489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36662691-845c-4f5a-a278-b3ad234f3fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3cf0f78d8d421d87963e2962728308, user_id=1076cb6062ce497fbcc485248bfea66d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:04.749639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36662691-845c-4f5a-a278-b3ad234f3fdf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:04.760357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a8397-b2db-4e8c-9e3d-429b397308dd tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_grant(project_id=556cbd0b1a7542c793f0a59a21328491, user_id=52845f1d62b44a3290421409819a1f3f, role_id=42837bd7bec94551b40283b2d93345de)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:04.771922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a8397-b2db-4e8c-9e3d-429b397308dd tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:04.774852 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3553/7064] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:04 2022] PUT /identity/v3/projects/4e3cf0f78d8d421d87963e2962728308/users/1076cb6062ce497fbcc485248bfea66d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:04.785406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36662691-845c-4f5a-a278-b3ad234f3fdf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:04.817419 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3512/7065] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:04 2022] PUT /identity/v3/projects/556cbd0b1a7542c793f0a59a21328491/users/52845f1d62b44a3290421409819a1f3f/roles/42837bd7bec94551b40283b2d93345de => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:04.819582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e2c51-3520-4007-a025-85ef4af8ac86 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:04.819972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e2c51-3520-4007-a025-85ef4af8ac86 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:04.820348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e2c51-3520-4007-a025-85ef4af8ac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:04.877069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-266e2c51-3520-4007-a025-85ef4af8ac86 None None] MFA Rules not processed for user `1076cb6062ce497fbcc485248bfea66d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:04.881337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-266e2c51-3520-4007-a025-85ef4af8ac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:04.912525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36662691-845c-4f5a-a278-b3ad234f3fdf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:05.010024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dcc43-f525-49ac-862b-dc8cc9c145df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:05.010788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcc43-f525-49ac-862b-dc8cc9c145df admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:05.011486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcc43-f525-49ac-862b-dc8cc9c145df admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:05.011838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcc43-f525-49ac-862b-dc8cc9c145df admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:05.012669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dcc43-f525-49ac-862b-dc8cc9c145df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:05.014365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dcc43-f525-49ac-862b-dc8cc9c145df admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:05.038203 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3513/7066] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:05.038867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e2c51-3520-4007-a025-85ef4af8ac86 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:05.040305 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3554/7067] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:04 2022] GET /identity/v3/roles => generated 1891 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:05.041987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dcc43-f525-49ac-862b-dc8cc9c145df admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:05.044846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7e8dcc43-f525-49ac-862b-dc8cc9c145df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:05.055244 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:05.089191 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:05.163345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dcc43-f525-49ac-862b-dc8cc9c145df admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:05.167767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f5712-a7e2-4eea-aaec-4a47bf9981d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:05.168438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f5712-a7e2-4eea-aaec-4a47bf9981d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:05.168725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f5712-a7e2-4eea-aaec-4a47bf9981d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:05.169130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f5712-a7e2-4eea-aaec-4a47bf9981d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:05.171394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e2c51-3520-4007-a025-85ef4af8ac86 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:05.180970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f5712-a7e2-4eea-aaec-4a47bf9981d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:05.182557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f5712-a7e2-4eea-aaec-4a47bf9981d3 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:05.182970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4070544-8be3-48dc-8698-f7a483f51ab6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:05.183605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4070544-8be3-48dc-8698-f7a483f51ab6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:05.183884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4070544-8be3-48dc-8698-f7a483f51ab6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:05.184155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4070544-8be3-48dc-8698-f7a483f51ab6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:05.184817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4070544-8be3-48dc-8698-f7a483f51ab6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:05.186892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4070544-8be3-48dc-8698-f7a483f51ab6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:05.197493 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3555/7068] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:05.199077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f5712-a7e2-4eea-aaec-4a47bf9981d3 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:05.215937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f5712-a7e2-4eea-aaec-4a47bf9981d3 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:05.227914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27994e-56e8-43a0-a55b-edbc736b3be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:05.228848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27994e-56e8-43a0-a55b-edbc736b3be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:05.229234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27994e-56e8-43a0-a55b-edbc736b3be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:05.229611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27994e-56e8-43a0-a55b-edbc736b3be1 admin admin] PATH_INFO: `/v3/projects/4907202f97c34031b0aca5ce3b508bc7/users/040dae0e68cc4b5abb8456d68254d80f/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:05.253907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27994e-56e8-43a0-a55b-edbc736b3be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4907202f97c34031b0aca5ce3b508bc7, user_id=040dae0e68cc4b5abb8456d68254d80f, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:05.256970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27994e-56e8-43a0-a55b-edbc736b3be1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:05.275545 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3556/7069] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:05 2022] PUT /identity/v3/projects/4907202f97c34031b0aca5ce3b508bc7/users/040dae0e68cc4b5abb8456d68254d80f/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:05.279036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27994e-56e8-43a0-a55b-edbc736b3be1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:05.319832 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3514/7070] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:05 2022] GET /identity/v3/users => generated 8320 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:05.324904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb44408-3867-4fe1-bfd1-67fa97abd523 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:05.325401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb44408-3867-4fe1-bfd1-67fa97abd523 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:05.326415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb44408-3867-4fe1-bfd1-67fa97abd523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:05.391424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27994e-56e8-43a0-a55b-edbc736b3be1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:05.397333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad110f-3bbe-4fa2-a7f2-23745c155b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:05.398090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad110f-3bbe-4fa2-a7f2-23745c155b96 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:05.398362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad110f-3bbe-4fa2-a7f2-23745c155b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:05.398757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad110f-3bbe-4fa2-a7f2-23745c155b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:05.399611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad110f-3bbe-4fa2-a7f2-23745c155b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:05.402097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad110f-3bbe-4fa2-a7f2-23745c155b96 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:05.416451 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3557/7071] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:05 2022] GET /identity/v3/roles => generated 1891 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:05.421462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad110f-3bbe-4fa2-a7f2-23745c155b96 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:05.421778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0cb44408-3867-4fe1-bfd1-67fa97abd523 None None] MFA Rules not processed for user `52845f1d62b44a3290421409819a1f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:05.424411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0cb44408-3867-4fe1-bfd1-67fa97abd523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:05.435671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad110f-3bbe-4fa2-a7f2-23745c155b96 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:05.464264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b35097-09c8-43cd-847e-69e647217f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:05.465244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b35097-09c8-43cd-847e-69e647217f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:05.465534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b35097-09c8-43cd-847e-69e647217f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:05.467028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b35097-09c8-43cd-847e-69e647217f37 admin admin] PATH_INFO: `/v3/projects/4907202f97c34031b0aca5ce3b508bc7/users/040dae0e68cc4b5abb8456d68254d80f/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:05.470683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b35097-09c8-43cd-847e-69e647217f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4907202f97c34031b0aca5ce3b508bc7, user_id=040dae0e68cc4b5abb8456d68254d80f, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:05.474674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b35097-09c8-43cd-847e-69e647217f37 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:05.491783 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3558/7072] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:05 2022] PUT /identity/v3/projects/4907202f97c34031b0aca5ce3b508bc7/users/040dae0e68cc4b5abb8456d68254d80f/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:34:05.505154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc4ad-cfb1-4534-8aef-aa476e754fef None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:05.505445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc4ad-cfb1-4534-8aef-aa476e754fef None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:05.505765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc4ad-cfb1-4534-8aef-aa476e754fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:05.599890 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3515/7073] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:05 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:05.624133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b02cc4ad-cfb1-4534-8aef-aa476e754fef None None] MFA Rules not processed for user `040dae0e68cc4b5abb8456d68254d80f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:05.626613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b02cc4ad-cfb1-4534-8aef-aa476e754fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:05.712183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9654cfd-39fd-4132-8bcd-fdf865be2a4b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:05.712440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9654cfd-39fd-4132-8bcd-fdf865be2a4b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:05.712680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9654cfd-39fd-4132-8bcd-fdf865be2a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:05.765162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b9654cfd-39fd-4132-8bcd-fdf865be2a4b None None] MFA Rules not processed for user `52845f1d62b44a3290421409819a1f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:05.767567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b9654cfd-39fd-4132-8bcd-fdf865be2a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:05.769304 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:05.825976 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3559/7074] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:05.904550 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3516/7075] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:05 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:34:05.910215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc4ad-cfb1-4534-8aef-aa476e754fef None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:05.939930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc4ad-cfb1-4534-8aef-aa476e754fef None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:05.947934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9654cfd-39fd-4132-8bcd-fdf865be2a4b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:05.950370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8300fa4-542b-486f-9fc7-e76f3462d925 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52845f1d62b44a3290421409819a1f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '556cbd0b1a7542c793f0a59a21328491', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-868158230', 'tempest-DelegatedRole-667129980'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:05.951278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8300fa4-542b-486f-9fc7-e76f3462d925 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:05.951660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8300fa4-542b-486f-9fc7-e76f3462d925 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:05.952525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8300fa4-542b-486f-9fc7-e76f3462d925 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:05.954022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8300fa4-542b-486f-9fc7-e76f3462d925 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] RBAC: Authorizing `identity:create_trust()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:05.955846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8300fa4-542b-486f-9fc7-e76f3462d925 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:06.070010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9654cfd-39fd-4132-8bcd-fdf865be2a4b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:06.074715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978a17d-363b-44ce-9bc0-d2e9604f3b6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:06.076569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978a17d-363b-44ce-9bc0-d2e9604f3b6d service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:06.077094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978a17d-363b-44ce-9bc0-d2e9604f3b6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:06.077586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978a17d-363b-44ce-9bc0-d2e9604f3b6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:06.088789 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:06.091998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978a17d-363b-44ce-9bc0-d2e9604f3b6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:06.094269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978a17d-363b-44ce-9bc0-d2e9604f3b6d service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:06.126811 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3517/7076] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:06.162731 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3560/7077] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Oct 16 01:34:05 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:06.166873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978a17d-363b-44ce-9bc0-d2e9604f3b6d service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:06.323564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978a17d-363b-44ce-9bc0-d2e9604f3b6d service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:06.331817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9116e-2f54-4729-843e-e01bc57e579e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:06.333125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9116e-2f54-4729-843e-e01bc57e579e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:06.333416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9116e-2f54-4729-843e-e01bc57e579e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:06.333690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9116e-2f54-4729-843e-e01bc57e579e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:06.335453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9116e-2f54-4729-843e-e01bc57e579e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:06.336789 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-74e9116e-2f54-4729-843e-e01bc57e579e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:34:06.336789 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:34:06.336789 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:34:06.338403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9116e-2f54-4729-843e-e01bc57e579e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:06.353189 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3518/7078] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:34:06 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:06.357235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8300fa4-542b-486f-9fc7-e76f3462d925 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:06.392203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8300fa4-542b-486f-9fc7-e76f3462d925 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:06.397885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52845f1d62b44a3290421409819a1f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '556cbd0b1a7542c793f0a59a21328491', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-868158230', 'tempest-DelegatedRole-667129980'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:06.398536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:06.398820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:06.399127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] PATH_INFO: `/v3/OS-TRUST/trusts/a3630eaf68e947dca71c75fc59c2c718` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:06.413182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] RBAC: Authorizing `identity:delete_trust(trust_id=a3630eaf68e947dca71c75fc59c2c718)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:06.414697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:06.460887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a3630eaf68e947dca71c75fc59c2c718', 'request_id': 'req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:06.461876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a3630eaf68e947dca71c75fc59c2c718', 'request_id': 'req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:06.462631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'a3630eaf68e947dca71c75fc59c2c718', 'request_id': 'req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:06.487539 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3561/7079] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Oct 16 01:34:06 2022] DELETE /identity/v3/OS-TRUST/trusts/a3630eaf68e947dca71c75fc59c2c718 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:06.491870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9116e-2f54-4729-843e-e01bc57e579e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:06.495168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-74e9116e-2f54-4729-843e-e01bc57e579e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:06.522663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9116e-2f54-4729-843e-e01bc57e579e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:06.536359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4040a-7265-4b0f-b4cd-889f2830699b tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52845f1d62b44a3290421409819a1f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '556cbd0b1a7542c793f0a59a21328491', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-868158230', 'tempest-DelegatedRole-667129980'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:06.539014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4040a-7265-4b0f-b4cd-889f2830699b tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:06.539492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4040a-7265-4b0f-b4cd-889f2830699b tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:06.539939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4040a-7265-4b0f-b4cd-889f2830699b tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] PATH_INFO: `/v3/OS-TRUST/trusts/a3630eaf68e947dca71c75fc59c2c718` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-03a4040a-7265-4b0f-b4cd-889f2830699b tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] Could not find trust: a3630eaf68e947dca71c75fc59c2c718.: keystone.exception.TrustNotFound: Could not find trust: a3630eaf68e947dca71c75fc59c2c718. Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 16 01:34:06.586271 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 16 01:34:06.587711 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 16 01:34:06.587711 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 16 01:34:06.587711 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 16 01:34:06.587711 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 16 01:34:06.587711 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 16 01:34:06.587711 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:06.587711 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:06.587711 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 16 01:34:06.587711 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 16 01:34:06.587711 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 16 01:34:06.587711 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 16 01:34:06.587711 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: a3630eaf68e947dca71c75fc59c2c718. Oct 16 01:34:06.587711 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:34:06.597804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:06.599837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:06.601961 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3519/7080] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:34:06 2022] GET /identity/v3/OS-TRUST/trusts/a3630eaf68e947dca71c75fc59c2c718 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:34:06.628847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f1bfc-3707-4edc-a9d1-ecc8a261e5c0 tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:06.634239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0ca70-bdf5-455c-92b1-7494e060bf80 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:06.635128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0ca70-bdf5-455c-92b1-7494e060bf80 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:06.635590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0ca70-bdf5-455c-92b1-7494e060bf80 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:06.636033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0ca70-bdf5-455c-92b1-7494e060bf80 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles/42837bd7bec94551b40283b2d93345de` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:06.637982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0ca70-bdf5-455c-92b1-7494e060bf80 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_role(role_id=42837bd7bec94551b40283b2d93345de)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:06.639996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0ca70-bdf5-455c-92b1-7494e060bf80 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:06.725916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-29c0ca70-bdf5-455c-92b1-7494e060bf80 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invalidating the token cache because role 42837bd7bec94551b40283b2d93345de has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:06.726234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-29c0ca70-bdf5-455c-92b1-7494e060bf80 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:06.727139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-29c0ca70-bdf5-455c-92b1-7494e060bf80 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:06.732217 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3562/7081] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:06 2022] DELETE /identity/v3/roles/42837bd7bec94551b40283b2d93345de => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:06.734288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4040a-7265-4b0f-b4cd-889f2830699b tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:06.736832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-03a4040a-7265-4b0f-b4cd-889f2830699b tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:06.765547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4040a-7265-4b0f-b4cd-889f2830699b tempest-TrustsV3TestJSON-468238961 tempest-user-958722529] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:06.900404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9ea1f-ce8f-4f9a-8f94-7d7e0f29c91b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:06.901193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9ea1f-ce8f-4f9a-8f94-7d7e0f29c91b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:06.901582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9ea1f-ce8f-4f9a-8f94-7d7e0f29c91b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:06.901984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9ea1f-ce8f-4f9a-8f94-7d7e0f29c91b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles/49128baafda84fa782bd7c4dd24478bb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:06.904306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9ea1f-ce8f-4f9a-8f94-7d7e0f29c91b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_role(role_id=49128baafda84fa782bd7c4dd24478bb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:06.906256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9ea1f-ce8f-4f9a-8f94-7d7e0f29c91b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:06.985355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e6a9ea1f-ce8f-4f9a-8f94-7d7e0f29c91b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invalidating the token cache because role 49128baafda84fa782bd7c4dd24478bb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:06.985841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e6a9ea1f-ce8f-4f9a-8f94-7d7e0f29c91b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:06.987844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e6a9ea1f-ce8f-4f9a-8f94-7d7e0f29c91b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:06.992577 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3520/7082] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:06 2022] DELETE /identity/v3/roles/49128baafda84fa782bd7c4dd24478bb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:06.996870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0ca70-bdf5-455c-92b1-7494e060bf80 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:07.024319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0ca70-bdf5-455c-92b1-7494e060bf80 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:07.168504 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:07.190229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:07.191326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:07.191716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:07.192096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users/52845f1d62b44a3290421409819a1f3f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:07.197878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_user(user_id=52845f1d62b44a3290421409819a1f3f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:07.199994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:07.367459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52845f1d62b44a3290421409819a1f3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:07.368209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52845f1d62b44a3290421409819a1f3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:07.412656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52845f1d62b44a3290421409819a1f3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:07.432068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52845f1d62b44a3290421409819a1f3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:07.433717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52845f1d62b44a3290421409819a1f3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:07.465324 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3563/7083] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:06 2022] DELETE /identity/v3/users/52845f1d62b44a3290421409819a1f3f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:07.469573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9ea1f-ce8f-4f9a-8f94-7d7e0f29c91b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:07.471392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e6a9ea1f-ce8f-4f9a-8f94-7d7e0f29c91b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:07.497636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9ea1f-ce8f-4f9a-8f94-7d7e0f29c91b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:07.633467 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:07.652723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:07.654364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:07.654756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:07.655733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/556cbd0b1a7542c793f0a59a21328491` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:07.659905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_project(project_id=556cbd0b1a7542c793f0a59a21328491)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:07.661988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:07.669451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:07.671153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:07.833394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556cbd0b1a7542c793f0a59a21328491', 'request_id': 'req-9436cdbe-b364-44ef-bb8b-aa2ad5928415'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:07.851616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556cbd0b1a7542c793f0a59a21328491', 'request_id': 'req-9436cdbe-b364-44ef-bb8b-aa2ad5928415'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:07.859245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331337-13e6-4bdf-a4dd-4bb9760a0842 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:07.862101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556cbd0b1a7542c793f0a59a21328491', 'request_id': 'req-9436cdbe-b364-44ef-bb8b-aa2ad5928415'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:07.890596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] The token cache is being invalidate because project 556cbd0b1a7542c793f0a59a21328491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:07.891267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:07.892383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:07.894434 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3521/7084] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:07 2022] DELETE /identity/v3/projects/556cbd0b1a7542c793f0a59a21328491 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:07.903738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:07.906634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:08.012529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:08.013648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:08.014042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:08.016991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] PATH_INFO: `/v3/users/46d942640d6a4712a9af5db1be6e4ea3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:08.020750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d942640d6a4712a9af5db1be6e4ea3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:08.025116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:08.092352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436cdbe-b364-44ef-bb8b-aa2ad5928415 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:08.103525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ca075-07e9-403f-ac95-908539878550 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:08.113056 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:08.121478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ca075-07e9-403f-ac95-908539878550 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:08.122079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ca075-07e9-403f-ac95-908539878550 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:08.122419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ca075-07e9-403f-ac95-908539878550 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:08.127179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ca075-07e9-403f-ac95-908539878550 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:08.130721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ca075-07e9-403f-ac95-908539878550 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:08.148968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d942640d6a4712a9af5db1be6e4ea3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:08.150167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d942640d6a4712a9af5db1be6e4ea3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:08.170782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d942640d6a4712a9af5db1be6e4ea3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:08.183822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d942640d6a4712a9af5db1be6e4ea3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:08.184845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d942640d6a4712a9af5db1be6e4ea3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:08.213882 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3564/7085] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:07 2022] DELETE /identity/v3/users/46d942640d6a4712a9af5db1be6e4ea3 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:08.218350 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3522/7086] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:34:07 2022] POST /identity/v3/projects => generated 329 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:08.227903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:08.230080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:08.232018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465e54e-eeed-4093-9d5d-0563c1bbe54f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:08.232359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465e54e-eeed-4093-9d5d-0563c1bbe54f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:08.232588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465e54e-eeed-4093-9d5d-0563c1bbe54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:08.293230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1465e54e-eeed-4093-9d5d-0563c1bbe54f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:08.294337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1465e54e-eeed-4093-9d5d-0563c1bbe54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:08.415161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1760c-a4bd-4506-aaa4-e2487b6f2c94 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:08.496485 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3523/7087] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:08.507829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465e54e-eeed-4093-9d5d-0563c1bbe54f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:08.509471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1465e54e-eeed-4093-9d5d-0563c1bbe54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:08.517527 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:08.554802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29730be1-96e9-4f2b-ada4-58498bbf7644 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:08.558556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29730be1-96e9-4f2b-ada4-58498bbf7644 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:08.558556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29730be1-96e9-4f2b-ada4-58498bbf7644 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:08.558556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29730be1-96e9-4f2b-ada4-58498bbf7644 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:08.558556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29730be1-96e9-4f2b-ada4-58498bbf7644 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:08.565476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29730be1-96e9-4f2b-ada4-58498bbf7644 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:08.620282 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3565/7088] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:08 2022] POST /identity/v3/users => generated 413 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:08.621617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29730be1-96e9-4f2b-ada4-58498bbf7644 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:08.627336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465e54e-eeed-4093-9d5d-0563c1bbe54f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:08.636775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a3486-fcc1-4a73-a3b9-38477f82fcfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:08.637402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a3486-fcc1-4a73-a3b9-38477f82fcfb service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:08.637682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a3486-fcc1-4a73-a3b9-38477f82fcfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:08.637956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a3486-fcc1-4a73-a3b9-38477f82fcfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:08.642593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29730be1-96e9-4f2b-ada4-58498bbf7644 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:08.657948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a3486-fcc1-4a73-a3b9-38477f82fcfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:08.659474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a3486-fcc1-4a73-a3b9-38477f82fcfb service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:08.662672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e4390-1bdb-453a-bb22-8157af619a07 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:08.663341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e4390-1bdb-453a-bb22-8157af619a07 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:08.663624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e4390-1bdb-453a-bb22-8157af619a07 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:08.663909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e4390-1bdb-453a-bb22-8157af619a07 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:08.664622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e4390-1bdb-453a-bb22-8157af619a07 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:08.666221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e4390-1bdb-453a-bb22-8157af619a07 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:08.683410 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3524/7089] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:08.705483 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3566/7090] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:34:08 2022] POST /identity/v3/roles => generated 244 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:34:08.709073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a3486-fcc1-4a73-a3b9-38477f82fcfb service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:08.744207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a3486-fcc1-4a73-a3b9-38477f82fcfb service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:08.762786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1658a-2eda-4b66-9286-ba3c843430fe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:08.763834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1658a-2eda-4b66-9286-ba3c843430fe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:08.765630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1658a-2eda-4b66-9286-ba3c843430fe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:08.766726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1658a-2eda-4b66-9286-ba3c843430fe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:08.772172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1658a-2eda-4b66-9286-ba3c843430fe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:08.774123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1658a-2eda-4b66-9286-ba3c843430fe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:08.824434 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3525/7091] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:34:08 2022] POST /identity/v3/roles => generated 246 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:08.829638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e4390-1bdb-453a-bb22-8157af619a07 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:08.843509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e4390-1bdb-453a-bb22-8157af619a07 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:08.874260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00b16f-d782-4e75-91e9-545a4135dbdb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:08.875808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00b16f-d782-4e75-91e9-545a4135dbdb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:08.878294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00b16f-d782-4e75-91e9-545a4135dbdb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:08.878586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00b16f-d782-4e75-91e9-545a4135dbdb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/32922c01352f4c879cd2bd59c5e443d2/users/c20e9a883c4e48b0bb3b7bedb2b3f531/roles/fc9f11d172564c86a068f69394f73f0f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:08.915377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00b16f-d782-4e75-91e9-545a4135dbdb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_grant(project_id=32922c01352f4c879cd2bd59c5e443d2, user_id=c20e9a883c4e48b0bb3b7bedb2b3f531, role_id=fc9f11d172564c86a068f69394f73f0f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:08.923369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00b16f-d782-4e75-91e9-545a4135dbdb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:08.956108 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3567/7092] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:08 2022] PUT /identity/v3/projects/32922c01352f4c879cd2bd59c5e443d2/users/c20e9a883c4e48b0bb3b7bedb2b3f531/roles/fc9f11d172564c86a068f69394f73f0f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:08.959990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1658a-2eda-4b66-9286-ba3c843430fe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:08.971709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1658a-2eda-4b66-9286-ba3c843430fe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:09.145131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d567d4-3378-49a1-a9e5-c1f5f1144404 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:09.145930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d567d4-3378-49a1-a9e5-c1f5f1144404 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:09.146273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d567d4-3378-49a1-a9e5-c1f5f1144404 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:09.146627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d567d4-3378-49a1-a9e5-c1f5f1144404 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/32922c01352f4c879cd2bd59c5e443d2/users/c20e9a883c4e48b0bb3b7bedb2b3f531/roles/2db58517e8fd4b649fce9d8997116cab` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:09.149453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d567d4-3378-49a1-a9e5-c1f5f1144404 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_grant(project_id=32922c01352f4c879cd2bd59c5e443d2, user_id=c20e9a883c4e48b0bb3b7bedb2b3f531, role_id=2db58517e8fd4b649fce9d8997116cab)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:09.152532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d567d4-3378-49a1-a9e5-c1f5f1144404 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:09.183171 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3526/7093] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:08 2022] PUT /identity/v3/projects/32922c01352f4c879cd2bd59c5e443d2/users/c20e9a883c4e48b0bb3b7bedb2b3f531/roles/2db58517e8fd4b649fce9d8997116cab => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:09.184208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00b16f-d782-4e75-91e9-545a4135dbdb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:09.190720 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:09.215420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00b16f-d782-4e75-91e9-545a4135dbdb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:09.363075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accdc19-0a89-423c-ad0f-e1099bb123cb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:09.364242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accdc19-0a89-423c-ad0f-e1099bb123cb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:09.365420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accdc19-0a89-423c-ad0f-e1099bb123cb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:09.366654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accdc19-0a89-423c-ad0f-e1099bb123cb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:09.367862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accdc19-0a89-423c-ad0f-e1099bb123cb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:09.374790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accdc19-0a89-423c-ad0f-e1099bb123cb tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:09.445144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d567d4-3378-49a1-a9e5-c1f5f1144404 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:09.447626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-42d567d4-3378-49a1-a9e5-c1f5f1144404 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:09.453569 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3568/7094] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:09 2022] GET /identity/v3/users => generated 8040 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:09.463175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a85aa-de2f-422d-8596-e34dce5bfc9e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:09.464537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a85aa-de2f-422d-8596-e34dce5bfc9e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:09.465202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a85aa-de2f-422d-8596-e34dce5bfc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:09.560627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d83a85aa-de2f-422d-8596-e34dce5bfc9e None None] MFA Rules not processed for user `c20e9a883c4e48b0bb3b7bedb2b3f531`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:09.562043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d83a85aa-de2f-422d-8596-e34dce5bfc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:09.636991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d567d4-3378-49a1-a9e5-c1f5f1144404 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:09.649839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:09.649839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:09.649839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:09.649839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] PATH_INFO: `/v3/projects/a3a01506391040a99c3d98b79eb75d5a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:09.650822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a01506391040a99c3d98b79eb75d5a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:09.652952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:09.693459 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3569/7095] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:09 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:09.695045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cc4d3-306b-4298-b80a-0879e3ea15f4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:09.697809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cc4d3-306b-4298-b80a-0879e3ea15f4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:09.698232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cc4d3-306b-4298-b80a-0879e3ea15f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:09.733919 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:09.771017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a71cc4d3-306b-4298-b80a-0879e3ea15f4 None None] MFA Rules not processed for user `c20e9a883c4e48b0bb3b7bedb2b3f531`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:09.777217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a71cc4d3-306b-4298-b80a-0879e3ea15f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:09.780617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a01506391040a99c3d98b79eb75d5a', 'request_id': 'req-357a5881-4997-4f6a-9458-7f4ac83a2cd4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:09.800342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a01506391040a99c3d98b79eb75d5a', 'request_id': 'req-357a5881-4997-4f6a-9458-7f4ac83a2cd4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:09.817557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a01506391040a99c3d98b79eb75d5a', 'request_id': 'req-357a5881-4997-4f6a-9458-7f4ac83a2cd4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:09.841213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] The token cache is being invalidate because project a3a01506391040a99c3d98b79eb75d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:09.841851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:09.843079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:09.849661 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3527/7096] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:09 2022] DELETE /identity/v3/projects/a3a01506391040a99c3d98b79eb75d5a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:09.854307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:09.855896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:09.930722 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3570/7097] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:09 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:09.935024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cc4d3-306b-4298-b80a-0879e3ea15f4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:09.946111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cc4d3-306b-4298-b80a-0879e3ea15f4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:09.951914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947d432-851a-4244-b1f7-9c46024029dd tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20e9a883c4e48b0bb3b7bedb2b3f531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32922c01352f4c879cd2bd59c5e443d2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1487547524', 'tempest-NotDelegatedRole-740262319'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:09.952695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947d432-851a-4244-b1f7-9c46024029dd tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:09.953071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947d432-851a-4244-b1f7-9c46024029dd tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:09.954147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947d432-851a-4244-b1f7-9c46024029dd tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:09.955494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947d432-851a-4244-b1f7-9c46024029dd tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] RBAC: Authorizing `identity:create_trust()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:09.956860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947d432-851a-4244-b1f7-9c46024029dd tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:10.033931 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:10.059095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a5881-4997-4f6a-9458-7f4ac83a2cd4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:10.072502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:10.075158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:10.075516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:10.075884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] PATH_INFO: `/v3/users/1076cb6062ce497fbcc485248bfea66d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:10.086561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1076cb6062ce497fbcc485248bfea66d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:10.093150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:10.145210 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3571/7098] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Oct 16 01:34:09 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:10.148419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947d432-851a-4244-b1f7-9c46024029dd tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:10.206942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947d432-851a-4244-b1f7-9c46024029dd tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:10.218575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e38fe-364b-47c6-bcb6-2ac9fe7340fb tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20e9a883c4e48b0bb3b7bedb2b3f531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32922c01352f4c879cd2bd59c5e443d2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1487547524', 'tempest-NotDelegatedRole-740262319'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:10.219428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e38fe-364b-47c6-bcb6-2ac9fe7340fb tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:10.220342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e38fe-364b-47c6-bcb6-2ac9fe7340fb tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:10.220342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e38fe-364b-47c6-bcb6-2ac9fe7340fb tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:10.220559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e38fe-364b-47c6-bcb6-2ac9fe7340fb tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:10.221881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e38fe-364b-47c6-bcb6-2ac9fe7340fb tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:10.237704 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3572/7099] 10.222.0.39 () {58 vars in 1252 bytes} [Sun Oct 16 01:34:10 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=c20e9a883c4e48b0bb3b7bedb2b3f531 => generated 611 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:10.244260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e38fe-364b-47c6-bcb6-2ac9fe7340fb tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:10.262437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1076cb6062ce497fbcc485248bfea66d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:10.265778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1076cb6062ce497fbcc485248bfea66d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:10.281004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e38fe-364b-47c6-bcb6-2ac9fe7340fb tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:10.294630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c7583-2b44-4776-9686-0f89d2be07a5 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20e9a883c4e48b0bb3b7bedb2b3f531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32922c01352f4c879cd2bd59c5e443d2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1487547524', 'tempest-NotDelegatedRole-740262319'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:10.295304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c7583-2b44-4776-9686-0f89d2be07a5 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:10.299675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c7583-2b44-4776-9686-0f89d2be07a5 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:10.300041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c7583-2b44-4776-9686-0f89d2be07a5 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] PATH_INFO: `/v3/OS-TRUST/trusts/d92219bcd9f0486aa2779bd61fc1398d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:10.314398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c7583-2b44-4776-9686-0f89d2be07a5 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] RBAC: Authorizing `identity:delete_trust(trust_id=d92219bcd9f0486aa2779bd61fc1398d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:10.315892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c7583-2b44-4776-9686-0f89d2be07a5 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:10.348527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1076cb6062ce497fbcc485248bfea66d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:10.363602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1076cb6062ce497fbcc485248bfea66d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:10.374200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e32c7583-2b44-4776-9686-0f89d2be07a5 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd92219bcd9f0486aa2779bd61fc1398d', 'request_id': 'req-e32c7583-2b44-4776-9686-0f89d2be07a5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:10.377372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e32c7583-2b44-4776-9686-0f89d2be07a5 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd92219bcd9f0486aa2779bd61fc1398d', 'request_id': 'req-e32c7583-2b44-4776-9686-0f89d2be07a5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:10.379123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e32c7583-2b44-4776-9686-0f89d2be07a5 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'd92219bcd9f0486aa2779bd61fc1398d', 'request_id': 'req-e32c7583-2b44-4776-9686-0f89d2be07a5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:10.383381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1076cb6062ce497fbcc485248bfea66d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:10.416832 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3573/7100] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Oct 16 01:34:10 2022] DELETE /identity/v3/OS-TRUST/trusts/d92219bcd9f0486aa2779bd61fc1398d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:10.419375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c7583-2b44-4776-9686-0f89d2be07a5 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:10.423609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e32c7583-2b44-4776-9686-0f89d2be07a5 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:10.427107 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3528/7101] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:09 2022] DELETE /identity/v3/users/1076cb6062ce497fbcc485248bfea66d => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:10.428914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:10.431888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:10.447897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c7583-2b44-4776-9686-0f89d2be07a5 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:10.534354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a617fb-3f4a-4962-95d2-842d5884d322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:10.535206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a617fb-3f4a-4962-95d2-842d5884d322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:10.535497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a617fb-3f4a-4962-95d2-842d5884d322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:10.536555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a617fb-3f4a-4962-95d2-842d5884d322 admin admin] PATH_INFO: `/v3/users/6f2e70ecf1a8455e8a083ebe6ff77514` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:10.537907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a617fb-3f4a-4962-95d2-842d5884d322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2e70ecf1a8455e8a083ebe6ff77514)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:10.540839 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:10.541952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a617fb-3f4a-4962-95d2-842d5884d322 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:10.590411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a789d-56a2-48e4-b50c-46247aca9986 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:10.602885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a737c4e-0d5a-47aa-b521-f8ee719650e3 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20e9a883c4e48b0bb3b7bedb2b3f531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32922c01352f4c879cd2bd59c5e443d2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1487547524', 'tempest-NotDelegatedRole-740262319'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:10.604788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a737c4e-0d5a-47aa-b521-f8ee719650e3 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:10.605521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a737c4e-0d5a-47aa-b521-f8ee719650e3 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:10.606102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a737c4e-0d5a-47aa-b521-f8ee719650e3 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] PATH_INFO: `/v3/OS-TRUST/trusts/d92219bcd9f0486aa2779bd61fc1398d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-4a737c4e-0d5a-47aa-b521-f8ee719650e3 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Could not find trust: d92219bcd9f0486aa2779bd61fc1398d.: keystone.exception.TrustNotFound: Could not find trust: d92219bcd9f0486aa2779bd61fc1398d. Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 16 01:34:10.637123 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 16 01:34:10.638790 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 16 01:34:10.638790 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 16 01:34:10.638790 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 16 01:34:10.638790 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 16 01:34:10.638790 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 16 01:34:10.638790 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:10.638790 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:10.638790 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 16 01:34:10.638790 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 16 01:34:10.638790 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 16 01:34:10.638790 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 16 01:34:10.638790 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: d92219bcd9f0486aa2779bd61fc1398d. Oct 16 01:34:10.638790 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:34:10.640271 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3529/7102] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:34:10 2022] GET /identity/v3/OS-TRUST/trusts/d92219bcd9f0486aa2779bd61fc1398d => generated 111 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:34:10.644807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a737c4e-0d5a-47aa-b521-f8ee719650e3 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:10.647308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4a737c4e-0d5a-47aa-b521-f8ee719650e3 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:10.655378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-15a617fb-3f4a-4962-95d2-842d5884d322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2e70ecf1a8455e8a083ebe6ff77514'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:10.657034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-15a617fb-3f4a-4962-95d2-842d5884d322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2e70ecf1a8455e8a083ebe6ff77514'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:10.694295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-15a617fb-3f4a-4962-95d2-842d5884d322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2e70ecf1a8455e8a083ebe6ff77514'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:10.703228 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:10.713306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-15a617fb-3f4a-4962-95d2-842d5884d322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2e70ecf1a8455e8a083ebe6ff77514'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:10.714463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-15a617fb-3f4a-4962-95d2-842d5884d322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2e70ecf1a8455e8a083ebe6ff77514'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:10.754062 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3574/7103] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:10 2022] DELETE /identity/v3/users/6f2e70ecf1a8455e8a083ebe6ff77514 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:10.761792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792ff5f-e665-4873-a291-3d01a7250339 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:10.761792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792ff5f-e665-4873-a291-3d01a7250339 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:10.762030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792ff5f-e665-4873-a291-3d01a7250339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:10.815553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4792ff5f-e665-4873-a291-3d01a7250339 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:10.817578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4792ff5f-e665-4873-a291-3d01a7250339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:10.873932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a737c4e-0d5a-47aa-b521-f8ee719650e3 tempest-TrustsV3TestJSON-1192768035 tempest-user-517055441] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:10.987104 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3575/7104] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:10.999764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792ff5f-e665-4873-a291-3d01a7250339 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:11.002534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4792ff5f-e665-4873-a291-3d01a7250339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:11.064191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843479-9f77-4d68-8548-3f7808a2b896 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:11.065247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843479-9f77-4d68-8548-3f7808a2b896 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:11.065247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843479-9f77-4d68-8548-3f7808a2b896 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:11.065484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843479-9f77-4d68-8548-3f7808a2b896 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles/2db58517e8fd4b649fce9d8997116cab` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:11.069310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a843479-9f77-4d68-8548-3f7808a2b896 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2db58517e8fd4b649fce9d8997116cab)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:11.070958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a843479-9f77-4d68-8548-3f7808a2b896 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:11.173498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3a843479-9f77-4d68-8548-3f7808a2b896 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invalidating the token cache because role 2db58517e8fd4b649fce9d8997116cab has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:11.173881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3a843479-9f77-4d68-8548-3f7808a2b896 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:11.174715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792ff5f-e665-4873-a291-3d01a7250339 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:11.176148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3a843479-9f77-4d68-8548-3f7808a2b896 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:11.183160 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3530/7105] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:10 2022] DELETE /identity/v3/roles/2db58517e8fd4b649fce9d8997116cab => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:11.186469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843479-9f77-4d68-8548-3f7808a2b896 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:11.187365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b78e6c-214e-41da-9169-621889579f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:11.188564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b78e6c-214e-41da-9169-621889579f71 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:11.188841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b78e6c-214e-41da-9169-621889579f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:11.189838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a843479-9f77-4d68-8548-3f7808a2b896 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:11.190558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b78e6c-214e-41da-9169-621889579f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:11.199210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-80b78e6c-214e-41da-9169-621889579f71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:11.236010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b78e6c-214e-41da-9169-621889579f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:11.239015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b78e6c-214e-41da-9169-621889579f71 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:11.270251 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3576/7106] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:11.284449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b78e6c-214e-41da-9169-621889579f71 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:11.293339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-80b78e6c-214e-41da-9169-621889579f71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:11.336220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b78e6c-214e-41da-9169-621889579f71 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:11.389602 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:11.444586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843479-9f77-4d68-8548-3f7808a2b896 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:11.467552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a26e1d-9867-4f19-b1f1-c98e27b64b1b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:11.471559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26e1d-9867-4f19-b1f1-c98e27b64b1b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:11.472123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26e1d-9867-4f19-b1f1-c98e27b64b1b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:11.472640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26e1d-9867-4f19-b1f1-c98e27b64b1b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles/fc9f11d172564c86a068f69394f73f0f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:11.480498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a26e1d-9867-4f19-b1f1-c98e27b64b1b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fc9f11d172564c86a068f69394f73f0f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:11.486698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a26e1d-9867-4f19-b1f1-c98e27b64b1b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:11.554457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1dda9-391c-44f1-97a1-8750394d5442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:11.559564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1dda9-391c-44f1-97a1-8750394d5442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:11.559899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1dda9-391c-44f1-97a1-8750394d5442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:11.560311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1dda9-391c-44f1-97a1-8750394d5442 admin admin] PATH_INFO: `/v3/projects/4e3cf0f78d8d421d87963e2962728308` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:11.564312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1dda9-391c-44f1-97a1-8750394d5442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3cf0f78d8d421d87963e2962728308)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:11.567932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1dda9-391c-44f1-97a1-8750394d5442 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:11.605877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b6a26e1d-9867-4f19-b1f1-c98e27b64b1b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invalidating the token cache because role fc9f11d172564c86a068f69394f73f0f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:11.606614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b6a26e1d-9867-4f19-b1f1-c98e27b64b1b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:11.610344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b6a26e1d-9867-4f19-b1f1-c98e27b64b1b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:11.616557 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3531/7107] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:11 2022] DELETE /identity/v3/roles/fc9f11d172564c86a068f69394f73f0f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:11.620373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a26e1d-9867-4f19-b1f1-c98e27b64b1b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:11.623122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b6a26e1d-9867-4f19-b1f1-c98e27b64b1b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:11.704223 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:11.775515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f5f1dda9-391c-44f1-97a1-8750394d5442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3cf0f78d8d421d87963e2962728308', 'request_id': 'req-f5f1dda9-391c-44f1-97a1-8750394d5442'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:11.790567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f5f1dda9-391c-44f1-97a1-8750394d5442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3cf0f78d8d421d87963e2962728308', 'request_id': 'req-f5f1dda9-391c-44f1-97a1-8750394d5442'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:11.793640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a26e1d-9867-4f19-b1f1-c98e27b64b1b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:11.808657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f5f1dda9-391c-44f1-97a1-8750394d5442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3cf0f78d8d421d87963e2962728308', 'request_id': 'req-f5f1dda9-391c-44f1-97a1-8750394d5442'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:11.828685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f5f1dda9-391c-44f1-97a1-8750394d5442 admin admin] The token cache is being invalidate because project 4e3cf0f78d8d421d87963e2962728308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:11.831210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f5f1dda9-391c-44f1-97a1-8750394d5442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:11.832747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f5f1dda9-391c-44f1-97a1-8750394d5442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:11.837766 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3577/7108] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:11 2022] DELETE /identity/v3/projects/4e3cf0f78d8d421d87963e2962728308 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:11.842321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fd81b-2043-43d4-ad0d-754eb24d4fff None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:11.842595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fd81b-2043-43d4-ad0d-754eb24d4fff None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:11.842931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fd81b-2043-43d4-ad0d-754eb24d4fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:11.911532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7e0fd81b-2043-43d4-ad0d-754eb24d4fff None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:11.918156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7e0fd81b-2043-43d4-ad0d-754eb24d4fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:11.919206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:11.921273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:11.922260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:11.922993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users/c20e9a883c4e48b0bb3b7bedb2b3f531` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:11.924891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c20e9a883c4e48b0bb3b7bedb2b3f531)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:11.930735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:11.993656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c20e9a883c4e48b0bb3b7bedb2b3f531'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:11.995036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c20e9a883c4e48b0bb3b7bedb2b3f531'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.029229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c20e9a883c4e48b0bb3b7bedb2b3f531'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.043225 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:12.057612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c20e9a883c4e48b0bb3b7bedb2b3f531'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.061920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c20e9a883c4e48b0bb3b7bedb2b3f531'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.108107 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3532/7109] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:11 2022] DELETE /identity/v3/users/c20e9a883c4e48b0bb3b7bedb2b3f531 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:12.109337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:12.111822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:12.145792 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3578/7110] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:34:12.146820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fd81b-2043-43d4-ad0d-754eb24d4fff None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:12.148498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7e0fd81b-2043-43d4-ad0d-754eb24d4fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:12.168134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fd81b-2043-43d4-ad0d-754eb24d4fff None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:12.289463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a4e9f-974f-46ff-b87f-dd7821a2ca32 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:12.292239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666073b-5358-4cfa-9abc-e6815279001b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:12.292905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666073b-5358-4cfa-9abc-e6815279001b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:12.299408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:12.300422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:12.300979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666073b-5358-4cfa-9abc-e6815279001b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:12.301301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:12.301484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666073b-5358-4cfa-9abc-e6815279001b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/32922c01352f4c879cd2bd59c5e443d2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:12.302170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] PATH_INFO: `/v3/projects/43300708939f44e695c999230d4baf0c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:12.303704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43300708939f44e695c999230d4baf0c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:12.306239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:12.307708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666073b-5358-4cfa-9abc-e6815279001b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_project(project_id=32922c01352f4c879cd2bd59c5e443d2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:12.311904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666073b-5358-4cfa-9abc-e6815279001b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:12.416133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43300708939f44e695c999230d4baf0c', 'request_id': 'req-d701145e-3343-4b8d-a3bb-ea33a9efac76'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.435640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6666073b-5358-4cfa-9abc-e6815279001b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32922c01352f4c879cd2bd59c5e443d2', 'request_id': 'req-6666073b-5358-4cfa-9abc-e6815279001b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.479546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43300708939f44e695c999230d4baf0c', 'request_id': 'req-d701145e-3343-4b8d-a3bb-ea33a9efac76'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.480360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6666073b-5358-4cfa-9abc-e6815279001b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32922c01352f4c879cd2bd59c5e443d2', 'request_id': 'req-6666073b-5358-4cfa-9abc-e6815279001b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.486491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6666073b-5358-4cfa-9abc-e6815279001b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32922c01352f4c879cd2bd59c5e443d2', 'request_id': 'req-6666073b-5358-4cfa-9abc-e6815279001b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.488018 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:12.498513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43300708939f44e695c999230d4baf0c', 'request_id': 'req-d701145e-3343-4b8d-a3bb-ea33a9efac76'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.518502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6666073b-5358-4cfa-9abc-e6815279001b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] The token cache is being invalidate because project 32922c01352f4c879cd2bd59c5e443d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:12.518805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6666073b-5358-4cfa-9abc-e6815279001b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.519983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6666073b-5358-4cfa-9abc-e6815279001b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.529134 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3579/7111] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:12 2022] DELETE /identity/v3/projects/32922c01352f4c879cd2bd59c5e443d2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:12.529134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3050fa7-1f03-442e-977d-9381cd40ff39 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:12.529134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3050fa7-1f03-442e-977d-9381cd40ff39 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:12.529134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3050fa7-1f03-442e-977d-9381cd40ff39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:12.556543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] The token cache is being invalidate because project 43300708939f44e695c999230d4baf0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:12.558004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.594285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.606036 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3533/7112] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:12 2022] DELETE /identity/v3/projects/43300708939f44e695c999230d4baf0c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:12.607156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:12.611839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:12.623198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e3050fa7-1f03-442e-977d-9381cd40ff39 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:12.624466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e3050fa7-1f03-442e-977d-9381cd40ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:12.743329 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3580/7113] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:12.744485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3050fa7-1f03-442e-977d-9381cd40ff39 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:12.747964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e3050fa7-1f03-442e-977d-9381cd40ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:12.769279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3050fa7-1f03-442e-977d-9381cd40ff39 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:12.775049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:12.776109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:12.776485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:12.777161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] PATH_INFO: `/v3/users/040dae0e68cc4b5abb8456d68254d80f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:12.778885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=040dae0e68cc4b5abb8456d68254d80f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:12.783292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:12.797106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701145e-3343-4b8d-a3bb-ea33a9efac76 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:12.848346 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:12.902167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040dae0e68cc4b5abb8456d68254d80f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.903928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040dae0e68cc4b5abb8456d68254d80f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.931962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040dae0e68cc4b5abb8456d68254d80f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.954094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec9f2-8f6b-441e-b643-674640a2b17e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:12.954778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec9f2-8f6b-441e-b643-674640a2b17e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:12.955256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec9f2-8f6b-441e-b643-674640a2b17e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:12.955519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec9f2-8f6b-441e-b643-674640a2b17e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:12.956112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ec9f2-8f6b-441e-b643-674640a2b17e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:12.957731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040dae0e68cc4b5abb8456d68254d80f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.960892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040dae0e68cc4b5abb8456d68254d80f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:12.963889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ec9f2-8f6b-441e-b643-674640a2b17e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:12.986442 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3581/7114] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:12 2022] DELETE /identity/v3/users/040dae0e68cc4b5abb8456d68254d80f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:12.989752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:12.991845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:13.030830 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3534/7115] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:34:12 2022] POST /identity/v3/projects => generated 328 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:13.035067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec9f2-8f6b-441e-b643-674640a2b17e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:13.039405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a34ec9f2-8f6b-441e-b643-674640a2b17e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:13.174978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec519586-2b2d-4a8f-90be-4a961dddf63b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:13.219278 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:13.231697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec9f2-8f6b-441e-b643-674640a2b17e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:13.279951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddefee-e6ee-4d6b-811b-ff52fd228ad1 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:13.281253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddefee-e6ee-4d6b-811b-ff52fd228ad1 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:13.281682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddefee-e6ee-4d6b-811b-ff52fd228ad1 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:13.282300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddefee-e6ee-4d6b-811b-ff52fd228ad1 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:13.283148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddefee-e6ee-4d6b-811b-ff52fd228ad1 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:13.285221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddefee-e6ee-4d6b-811b-ff52fd228ad1 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:13.345512 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3535/7116] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:13 2022] POST /identity/v3/users => generated 416 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:13.347372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddefee-e6ee-4d6b-811b-ff52fd228ad1 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:13.376433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddefee-e6ee-4d6b-811b-ff52fd228ad1 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:13.378448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459e86f-2d4a-4180-bfc9-7755482217c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:13.379559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459e86f-2d4a-4180-bfc9-7755482217c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:13.379848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459e86f-2d4a-4180-bfc9-7755482217c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:13.380127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459e86f-2d4a-4180-bfc9-7755482217c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:13.380791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459e86f-2d4a-4180-bfc9-7755482217c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:13.381102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459e86f-2d4a-4180-bfc9-7755482217c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:13.384253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459e86f-2d4a-4180-bfc9-7755482217c5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:13.394131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df652a-5af8-49e2-8ec3-f9c47a3ee5b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:13.394762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df652a-5af8-49e2-8ec3-f9c47a3ee5b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:13.396355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df652a-5af8-49e2-8ec3-f9c47a3ee5b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:13.396705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df652a-5af8-49e2-8ec3-f9c47a3ee5b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:13.397385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df652a-5af8-49e2-8ec3-f9c47a3ee5b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:13.402806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df652a-5af8-49e2-8ec3-f9c47a3ee5b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:13.415451 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3582/7117] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:13.420227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459e86f-2d4a-4180-bfc9-7755482217c5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:13.440829 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3536/7118] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:34:13 2022] POST /identity/v3/roles => generated 244 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:13.442356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df652a-5af8-49e2-8ec3-f9c47a3ee5b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:13.443614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459e86f-2d4a-4180-bfc9-7755482217c5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:13.453907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27cc8-a15e-4e92-86a2-4417dd3b7323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:13.455276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27cc8-a15e-4e92-86a2-4417dd3b7323 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:13.455722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27cc8-a15e-4e92-86a2-4417dd3b7323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:13.456386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27cc8-a15e-4e92-86a2-4417dd3b7323 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:13.458773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb27cc8-a15e-4e92-86a2-4417dd3b7323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:13.461526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb27cc8-a15e-4e92-86a2-4417dd3b7323 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:13.465425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df652a-5af8-49e2-8ec3-f9c47a3ee5b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:13.475605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185434f7-95cd-405a-bde9-15f99c5d51b6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:13.476266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185434f7-95cd-405a-bde9-15f99c5d51b6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:13.476552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185434f7-95cd-405a-bde9-15f99c5d51b6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:13.476874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185434f7-95cd-405a-bde9-15f99c5d51b6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:13.477546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185434f7-95cd-405a-bde9-15f99c5d51b6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:13.481492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185434f7-95cd-405a-bde9-15f99c5d51b6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:13.517998 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3583/7119] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:13 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:13.519207 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3537/7120] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:34:13 2022] POST /identity/v3/roles => generated 246 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:13.520232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185434f7-95cd-405a-bde9-15f99c5d51b6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:13.522193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27cc8-a15e-4e92-86a2-4417dd3b7323 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:13.524870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-efb27cc8-a15e-4e92-86a2-4417dd3b7323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:13.542796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185434f7-95cd-405a-bde9-15f99c5d51b6 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:13.665027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74336dbf-e617-4f29-8594-549bcbae79c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:13.666109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74336dbf-e617-4f29-8594-549bcbae79c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:13.666396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74336dbf-e617-4f29-8594-549bcbae79c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:13.666671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74336dbf-e617-4f29-8594-549bcbae79c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:13.667340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74336dbf-e617-4f29-8594-549bcbae79c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:13.670768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27cc8-a15e-4e92-86a2-4417dd3b7323 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:13.674673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74336dbf-e617-4f29-8594-549bcbae79c2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:13.677289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:13.678127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:13.678718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:13.679232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] PATH_INFO: `/v3/projects/4907202f97c34031b0aca5ce3b508bc7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:13.681286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4907202f97c34031b0aca5ce3b508bc7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:13.683496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:13.724374 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:13.737884 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3538/7121] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:13 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:13.740919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74336dbf-e617-4f29-8594-549bcbae79c2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:13.789456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4907202f97c34031b0aca5ce3b508bc7', 'request_id': 'req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:13.802345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4907202f97c34031b0aca5ce3b508bc7', 'request_id': 'req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:13.814465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4907202f97c34031b0aca5ce3b508bc7', 'request_id': 'req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:13.832551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] The token cache is being invalidate because project 4907202f97c34031b0aca5ce3b508bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:13.833038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:13.835479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:13.842636 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3584/7122] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:13 2022] DELETE /identity/v3/projects/4907202f97c34031b0aca5ce3b508bc7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:13.844450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:13.848398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:13.880256 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:13.887468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74336dbf-e617-4f29-8594-549bcbae79c2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:13.980587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac2b2a-4685-44b5-bd1c-996053a0cd24 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:13.988600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f6691-6400-41e2-ad13-ad95ab499f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:13.989696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f6691-6400-41e2-ad13-ad95ab499f0d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:13.990710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f6691-6400-41e2-ad13-ad95ab499f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:13.991238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283c51b-4213-4391-8af7-7204635d6570 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:13.991431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f6691-6400-41e2-ad13-ad95ab499f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:13.991908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283c51b-4213-4391-8af7-7204635d6570 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:13.992194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283c51b-4213-4391-8af7-7204635d6570 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:13.992323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f6691-6400-41e2-ad13-ad95ab499f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:13.992446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283c51b-4213-4391-8af7-7204635d6570 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/a70c0675bc7148e59c2691f652e99fc4/users/ce80bae03a844593adbbac1773fb71ae/roles/85baef5df35b4eda8f8c9933e2138baa` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:13.994054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f6691-6400-41e2-ad13-ad95ab499f0d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:14.010485 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3585/7123] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:13 2022] GET /identity/v3/roles => generated 1892 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:14.012205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456bef2-9896-4c03-9d9a-751fd0b4059a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:14.012900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456bef2-9896-4c03-9d9a-751fd0b4059a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:14.013264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456bef2-9896-4c03-9d9a-751fd0b4059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:14.018672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283c51b-4213-4391-8af7-7204635d6570 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a70c0675bc7148e59c2691f652e99fc4, user_id=ce80bae03a844593adbbac1773fb71ae, role_id=85baef5df35b4eda8f8c9933e2138baa)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:14.022950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283c51b-4213-4391-8af7-7204635d6570 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:14.042963 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3539/7124] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:13 2022] PUT /identity/v3/projects/a70c0675bc7148e59c2691f652e99fc4/users/ce80bae03a844593adbbac1773fb71ae/roles/85baef5df35b4eda8f8c9933e2138baa => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:14.043209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f456bef2-9896-4c03-9d9a-751fd0b4059a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:14.043331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283c51b-4213-4391-8af7-7204635d6570 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:14.043420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f456bef2-9896-4c03-9d9a-751fd0b4059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:14.182884 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3586/7125] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:14.183874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456bef2-9896-4c03-9d9a-751fd0b4059a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:14.185259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f456bef2-9896-4c03-9d9a-751fd0b4059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:14.202888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283c51b-4213-4391-8af7-7204635d6570 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:14.211620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a2f4c-be31-4073-a4f3-a57663c2cd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:14.212458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a2f4c-be31-4073-a4f3-a57663c2cd3c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:14.212693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a2f4c-be31-4073-a4f3-a57663c2cd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:14.213002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a2f4c-be31-4073-a4f3-a57663c2cd3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:14.213611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a2f4c-be31-4073-a4f3-a57663c2cd3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:14.215222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a2f4c-be31-4073-a4f3-a57663c2cd3c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:14.233921 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3540/7126] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:14 2022] GET /identity/v3/roles => generated 1892 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:14.236339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fb2a8-fbcd-417e-bfef-0da4f90252c6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:14.236636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fb2a8-fbcd-417e-bfef-0da4f90252c6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:14.236949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fb2a8-fbcd-417e-bfef-0da4f90252c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:14.265523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ce1fb2a8-fbcd-417e-bfef-0da4f90252c6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:14.267566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ce1fb2a8-fbcd-417e-bfef-0da4f90252c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:14.279852 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3541/7127] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:14.284946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fb2a8-fbcd-417e-bfef-0da4f90252c6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:14.300638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fb2a8-fbcd-417e-bfef-0da4f90252c6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:14.308088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515f2c7-283a-4be2-8ae9-76dc1a1f20ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:14.308769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515f2c7-283a-4be2-8ae9-76dc1a1f20ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:14.309096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515f2c7-283a-4be2-8ae9-76dc1a1f20ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:14.309595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456bef2-9896-4c03-9d9a-751fd0b4059a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:14.309725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515f2c7-283a-4be2-8ae9-76dc1a1f20ce admin admin] PATH_INFO: `/v3/projects/0bccbbd3ba9645e69a5af8628de47a02/users/7c9f88d7a9b442b49796b714b52905e8/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:14.316377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06022850-00c7-4e44-b15a-f1f0d9f63ce8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:14.317228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06022850-00c7-4e44-b15a-f1f0d9f63ce8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:14.317518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06022850-00c7-4e44-b15a-f1f0d9f63ce8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:14.317798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06022850-00c7-4e44-b15a-f1f0d9f63ce8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/a70c0675bc7148e59c2691f652e99fc4/users/ce80bae03a844593adbbac1773fb71ae/roles/d661df8e858543f49960219cce59a23a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:14.325864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06022850-00c7-4e44-b15a-f1f0d9f63ce8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a70c0675bc7148e59c2691f652e99fc4, user_id=ce80bae03a844593adbbac1773fb71ae, role_id=d661df8e858543f49960219cce59a23a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:14.329345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06022850-00c7-4e44-b15a-f1f0d9f63ce8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:14.335092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515f2c7-283a-4be2-8ae9-76dc1a1f20ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bccbbd3ba9645e69a5af8628de47a02, user_id=7c9f88d7a9b442b49796b714b52905e8, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:14.338724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515f2c7-283a-4be2-8ae9-76dc1a1f20ce admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:14.342803 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:14.352665 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3587/7128] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:14 2022] PUT /identity/v3/projects/a70c0675bc7148e59c2691f652e99fc4/users/ce80bae03a844593adbbac1773fb71ae/roles/d661df8e858543f49960219cce59a23a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:14.353618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06022850-00c7-4e44-b15a-f1f0d9f63ce8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:14.357913 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3542/7129] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:14 2022] PUT /identity/v3/projects/0bccbbd3ba9645e69a5af8628de47a02/users/7c9f88d7a9b442b49796b714b52905e8/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:14.361297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515f2c7-283a-4be2-8ae9-76dc1a1f20ce admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:14.448657 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:14.486395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06022850-00c7-4e44-b15a-f1f0d9f63ce8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:14.518379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515f2c7-283a-4be2-8ae9-76dc1a1f20ce admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:14.531691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338d664-08b7-46e5-89bc-2a52bfaf1735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:14.532892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338d664-08b7-46e5-89bc-2a52bfaf1735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:14.533538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338d664-08b7-46e5-89bc-2a52bfaf1735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:14.534045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338d664-08b7-46e5-89bc-2a52bfaf1735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:14.534988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338d664-08b7-46e5-89bc-2a52bfaf1735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:14.537312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338d664-08b7-46e5-89bc-2a52bfaf1735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:14.578322 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3543/7130] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:14 2022] GET /identity/v3/users => generated 7482 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:14.580360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee82c5d-7fff-4f44-b36c-34c692ddf16d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:14.580863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee82c5d-7fff-4f44-b36c-34c692ddf16d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:14.581846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee82c5d-7fff-4f44-b36c-34c692ddf16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:14.622835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc980ea1-11a9-422a-94ae-4db266c01690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:14.624369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc980ea1-11a9-422a-94ae-4db266c01690 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:14.624843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc980ea1-11a9-422a-94ae-4db266c01690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:14.625935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc980ea1-11a9-422a-94ae-4db266c01690 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:14.627374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc980ea1-11a9-422a-94ae-4db266c01690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:14.627902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc980ea1-11a9-422a-94ae-4db266c01690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:14.629708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc980ea1-11a9-422a-94ae-4db266c01690 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:14.631752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4ee82c5d-7fff-4f44-b36c-34c692ddf16d None None] MFA Rules not processed for user `7c9f88d7a9b442b49796b714b52905e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:14.633601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4ee82c5d-7fff-4f44-b36c-34c692ddf16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:14.644762 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3588/7131] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:14.646402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afee82-e096-444b-98f7-c8b662e13747 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:14.646904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afee82-e096-444b-98f7-c8b662e13747 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:14.648076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afee82-e096-444b-98f7-c8b662e13747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:14.724440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c6afee82-e096-444b-98f7-c8b662e13747 None None] MFA Rules not processed for user `ce80bae03a844593adbbac1773fb71ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:14.728902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c6afee82-e096-444b-98f7-c8b662e13747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:14.777402 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3544/7132] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:14.778525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee82c5d-7fff-4f44-b36c-34c692ddf16d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:14.807507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee82c5d-7fff-4f44-b36c-34c692ddf16d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:14.821241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0431344-cfb7-4b1f-8cd2-561e1c7b3ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:14.822196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0431344-cfb7-4b1f-8cd2-561e1c7b3ade admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:14.822898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0431344-cfb7-4b1f-8cd2-561e1c7b3ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:14.823359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0431344-cfb7-4b1f-8cd2-561e1c7b3ade admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:14.824202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0431344-cfb7-4b1f-8cd2-561e1c7b3ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:14.827200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0431344-cfb7-4b1f-8cd2-561e1c7b3ade admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:14.878848 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3545/7133] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:14 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:14.879701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0431344-cfb7-4b1f-8cd2-561e1c7b3ade admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:14.891839 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3589/7134] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:14 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:14.892806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afee82-e096-444b-98f7-c8b662e13747 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:14.941000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afee82-e096-444b-98f7-c8b662e13747 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:15.102550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36123acc-4e0d-4948-bfda-45dfbe6bd939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:15.105317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123acc-4e0d-4948-bfda-45dfbe6bd939 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:15.106444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123acc-4e0d-4948-bfda-45dfbe6bd939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:15.109182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123acc-4e0d-4948-bfda-45dfbe6bd939 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:15.111247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36123acc-4e0d-4948-bfda-45dfbe6bd939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:15.114473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0431344-cfb7-4b1f-8cd2-561e1c7b3ade admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:15.120191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36123acc-4e0d-4948-bfda-45dfbe6bd939 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:15.129749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d5f34-c9d4-4d6c-bb2d-a2e05283fa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:15.130800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d5f34-c9d4-4d6c-bb2d-a2e05283fa65 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:15.131368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d5f34-c9d4-4d6c-bb2d-a2e05283fa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:15.131747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d5f34-c9d4-4d6c-bb2d-a2e05283fa65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:15.132633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d5f34-c9d4-4d6c-bb2d-a2e05283fa65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:15.134653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d5f34-c9d4-4d6c-bb2d-a2e05283fa65 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:15.148097 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:15.156118 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:15.174592 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3590/7135] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:14 2022] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:15.176448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95aed-1e8b-479e-b6fe-0824a07e1471 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:15.176448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95aed-1e8b-479e-b6fe-0824a07e1471 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:15.176448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95aed-1e8b-479e-b6fe-0824a07e1471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:15.192411 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3546/7136] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:14 2022] POST /identity/v3/projects => generated 383 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:15.193636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d5f34-c9d4-4d6c-bb2d-a2e05283fa65 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:15.231547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-23e95aed-1e8b-479e-b6fe-0824a07e1471 None None] MFA Rules not processed for user `ce80bae03a844593adbbac1773fb71ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:15.232692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-23e95aed-1e8b-479e-b6fe-0824a07e1471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:15.329578 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3591/7137] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:15.329578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e95aed-1e8b-479e-b6fe-0824a07e1471 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:15.337701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d5f34-c9d4-4d6c-bb2d-a2e05283fa65 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:15.348140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e95aed-1e8b-479e-b6fe-0824a07e1471 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:15.354528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f87b70-7800-40bb-8f7e-9082da1cc82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:15.355367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f87b70-7800-40bb-8f7e-9082da1cc82f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:15.355802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f87b70-7800-40bb-8f7e-9082da1cc82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:15.356216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f87b70-7800-40bb-8f7e-9082da1cc82f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:15.357289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f87b70-7800-40bb-8f7e-9082da1cc82f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:15.357439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7247ba2-ebc9-43d1-b9eb-9a5a234dba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:15.357991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247ba2-ebc9-43d1-b9eb-9a5a234dba35 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:15.358276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247ba2-ebc9-43d1-b9eb-9a5a234dba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:15.358555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247ba2-ebc9-43d1-b9eb-9a5a234dba35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:15.359234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7247ba2-ebc9-43d1-b9eb-9a5a234dba35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:15.360537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f87b70-7800-40bb-8f7e-9082da1cc82f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:15.366225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7247ba2-ebc9-43d1-b9eb-9a5a234dba35 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:15.383589 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3547/7138] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:15 2022] GET /identity/v3/roles => generated 1892 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:15.384453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7247ba2-ebc9-43d1-b9eb-9a5a234dba35 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:15.398679 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3592/7139] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:15 2022] POST /identity/v3/users => generated 298 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:15.399598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f87b70-7800-40bb-8f7e-9082da1cc82f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:15.421107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7247ba2-ebc9-43d1-b9eb-9a5a234dba35 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:15.425705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f87b70-7800-40bb-8f7e-9082da1cc82f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:15.426670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1501284-240b-4562-b45c-bb0cef384973 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce80bae03a844593adbbac1773fb71ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a70c0675bc7148e59c2691f652e99fc4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-563934325', 'tempest-DelegatedRole-1799149447'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:15.427801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1501284-240b-4562-b45c-bb0cef384973 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:15.428074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1501284-240b-4562-b45c-bb0cef384973 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:15.428352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1501284-240b-4562-b45c-bb0cef384973 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:15.429030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1501284-240b-4562-b45c-bb0cef384973 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorizing `identity:create_trust()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:15.430193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1501284-240b-4562-b45c-bb0cef384973 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:15.432264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2d19a-88ec-47b0-863a-c8fa53b6617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:15.433305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2d19a-88ec-47b0-863a-c8fa53b6617b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:15.433925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2d19a-88ec-47b0-863a-c8fa53b6617b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:15.434652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2d19a-88ec-47b0-863a-c8fa53b6617b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:15.435678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2d19a-88ec-47b0-863a-c8fa53b6617b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:15.439088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2d19a-88ec-47b0-863a-c8fa53b6617b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:15.456777 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3593/7140] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:15 2022] GET /identity/v3/roles => generated 1892 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:15.457792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2d19a-88ec-47b0-863a-c8fa53b6617b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:15.471777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2d19a-88ec-47b0-863a-c8fa53b6617b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:15.497916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006e8c7-db1a-4d43-b796-fc0e9f096464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:15.503876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006e8c7-db1a-4d43-b796-fc0e9f096464 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:15.504190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006e8c7-db1a-4d43-b796-fc0e9f096464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:15.504410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006e8c7-db1a-4d43-b796-fc0e9f096464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:15.505100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006e8c7-db1a-4d43-b796-fc0e9f096464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:15.509388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006e8c7-db1a-4d43-b796-fc0e9f096464 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:15.628649 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3594/7141] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:15 2022] GET /identity/v3/roles => generated 1892 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:15.629575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006e8c7-db1a-4d43-b796-fc0e9f096464 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:15.643996 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3548/7142] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Oct 16 01:34:15 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:15.648218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1501284-240b-4562-b45c-bb0cef384973 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:15.654101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006e8c7-db1a-4d43-b796-fc0e9f096464 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:15.664983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3672ba-a362-4bd6-b447-9c6a94c9de8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:15.665671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3672ba-a362-4bd6-b447-9c6a94c9de8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:15.665950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3672ba-a362-4bd6-b447-9c6a94c9de8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:15.666234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3672ba-a362-4bd6-b447-9c6a94c9de8c admin admin] PATH_INFO: `/v3/projects/19305e6e924f4159b32dfe55be05d735/users/cd9e49f226da473694ebe8a2bc29226f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:15.681514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1501284-240b-4562-b45c-bb0cef384973 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:15.697266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c8600-20cd-40d7-ade4-c6891b2aa527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:15.698572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c8600-20cd-40d7-ade4-c6891b2aa527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:15.699860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c8600-20cd-40d7-ade4-c6891b2aa527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:15.700383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c8600-20cd-40d7-ade4-c6891b2aa527 admin admin] PATH_INFO: `/v3/projects/4affb38cd687480497c542e01577abec/users/9d746660a25846e3a357e0f831475320/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:15.700650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3672ba-a362-4bd6-b447-9c6a94c9de8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19305e6e924f4159b32dfe55be05d735, user_id=cd9e49f226da473694ebe8a2bc29226f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:15.707927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3672ba-a362-4bd6-b447-9c6a94c9de8c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:15.737632 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3595/7143] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:15 2022] PUT /identity/v3/projects/19305e6e924f4159b32dfe55be05d735/users/cd9e49f226da473694ebe8a2bc29226f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:15.745118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c8600-20cd-40d7-ade4-c6891b2aa527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4affb38cd687480497c542e01577abec, user_id=9d746660a25846e3a357e0f831475320, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:15.748274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c8600-20cd-40d7-ade4-c6891b2aa527 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:15.754692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3672ba-a362-4bd6-b447-9c6a94c9de8c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:15.789828 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3549/7144] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:15 2022] PUT /identity/v3/projects/4affb38cd687480497c542e01577abec/users/9d746660a25846e3a357e0f831475320/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:15.791539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1f093-54af-4589-be8a-e98e69d6d478 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:15.794729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1f093-54af-4589-be8a-e98e69d6d478 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:15.795342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1f093-54af-4589-be8a-e98e69d6d478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:15.867706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e4b1f093-54af-4589-be8a-e98e69d6d478 None None] MFA Rules not processed for user `cd9e49f226da473694ebe8a2bc29226f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:15.869030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e4b1f093-54af-4589-be8a-e98e69d6d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:15.888022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3672ba-a362-4bd6-b447-9c6a94c9de8c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:15.932970 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:15.991986 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:16.010441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb954c1-d51c-4a7d-84e8-90e30be9ea42 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce80bae03a844593adbbac1773fb71ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a70c0675bc7148e59c2691f652e99fc4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-563934325', 'tempest-DelegatedRole-1799149447'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:16.011815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb954c1-d51c-4a7d-84e8-90e30be9ea42 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:16.013759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb954c1-d51c-4a7d-84e8-90e30be9ea42 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:16.023473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb954c1-d51c-4a7d-84e8-90e30be9ea42 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] PATH_INFO: `/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:16.042878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb954c1-d51c-4a7d-84e8-90e30be9ea42 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorizing `identity:get_trust(trust_id=03ab6f50a0824f7d98c9ed70517a0ef7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:16.045822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb954c1-d51c-4a7d-84e8-90e30be9ea42 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:16.058872 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3550/7145] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:16.062014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1f093-54af-4589-be8a-e98e69d6d478 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:16.064737 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3596/7146] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:34:15 2022] GET /identity/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7 => generated 859 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:16.065909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb954c1-d51c-4a7d-84e8-90e30be9ea42 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:16.211400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1f093-54af-4589-be8a-e98e69d6d478 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:16.222153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb954c1-d51c-4a7d-84e8-90e30be9ea42 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:16.226387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23f9d-5be5-46b7-a2e4-94cae3b96308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:16.227331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23f9d-5be5-46b7-a2e4-94cae3b96308 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:16.227802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23f9d-5be5-46b7-a2e4-94cae3b96308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:16.227938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23f9d-5be5-46b7-a2e4-94cae3b96308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:16.232863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee23f9d-5be5-46b7-a2e4-94cae3b96308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:16.235178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee23f9d-5be5-46b7-a2e4-94cae3b96308 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:16.236093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbd865-83ee-4e22-bcba-79f12e7baf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:16.236921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbd865-83ee-4e22-bcba-79f12e7baf55 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:16.237266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbd865-83ee-4e22-bcba-79f12e7baf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:16.237458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbd865-83ee-4e22-bcba-79f12e7baf55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:16.238055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbd865-83ee-4e22-bcba-79f12e7baf55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:16.243149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbd865-83ee-4e22-bcba-79f12e7baf55 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:16.260763 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3551/7147] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:16 2022] GET /identity/v3/roles => generated 1892 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:16.262817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23f9d-5be5-46b7-a2e4-94cae3b96308 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:16.286953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23f9d-5be5-46b7-a2e4-94cae3b96308 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:16.293682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872b871-3046-41bc-a445-cc3745a46560 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce80bae03a844593adbbac1773fb71ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a70c0675bc7148e59c2691f652e99fc4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-563934325', 'tempest-DelegatedRole-1799149447'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:16.294994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872b871-3046-41bc-a445-cc3745a46560 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:16.295386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872b871-3046-41bc-a445-cc3745a46560 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:16.295749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872b871-3046-41bc-a445-cc3745a46560 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] PATH_INFO: `/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:16.308448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872b871-3046-41bc-a445-cc3745a46560 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=03ab6f50a0824f7d98c9ed70517a0ef7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:16.309906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872b871-3046-41bc-a445-cc3745a46560 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:16.320933 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3552/7148] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:34:16 2022] GET /identity/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7/roles => generated 371 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:16.321874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872b871-3046-41bc-a445-cc3745a46560 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:16.341688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872b871-3046-41bc-a445-cc3745a46560 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:16.350953 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3597/7149] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:16 2022] POST /identity/v3/projects => generated 383 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:16.353249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbd865-83ee-4e22-bcba-79f12e7baf55 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:16.353481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5c0e2-b1a4-4da2-bada-0a0ba06f8b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:16.355191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5c0e2-b1a4-4da2-bada-0a0ba06f8b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:16.356552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5c0e2-b1a4-4da2-bada-0a0ba06f8b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:16.357265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5c0e2-b1a4-4da2-bada-0a0ba06f8b6e admin admin] PATH_INFO: `/v3/projects/4affb38cd687480497c542e01577abec/users/9d746660a25846e3a357e0f831475320/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:16.361227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5c0e2-b1a4-4da2-bada-0a0ba06f8b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4affb38cd687480497c542e01577abec, user_id=9d746660a25846e3a357e0f831475320, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:16.364827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5c0e2-b1a4-4da2-bada-0a0ba06f8b6e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:16.426193 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3553/7150] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:16 2022] PUT /identity/v3/projects/4affb38cd687480497c542e01577abec/users/9d746660a25846e3a357e0f831475320/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:16.426193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5c0e2-b1a4-4da2-bada-0a0ba06f8b6e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:16.519032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbd865-83ee-4e22-bcba-79f12e7baf55 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:16.618208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5c0e2-b1a4-4da2-bada-0a0ba06f8b6e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:16.638189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b4993-681e-45cb-adea-498fd5fd2877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:16.640859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b4993-681e-45cb-adea-498fd5fd2877 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:16.641101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b4993-681e-45cb-adea-498fd5fd2877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:16.641628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b4993-681e-45cb-adea-498fd5fd2877 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:16.644336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b4993-681e-45cb-adea-498fd5fd2877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:16.645159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54874366-4d54-4227-9388-353b8eacec89 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce80bae03a844593adbbac1773fb71ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a70c0675bc7148e59c2691f652e99fc4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-563934325', 'tempest-DelegatedRole-1799149447'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:16.645898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54874366-4d54-4227-9388-353b8eacec89 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:16.646248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54874366-4d54-4227-9388-353b8eacec89 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:16.646586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54874366-4d54-4227-9388-353b8eacec89 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] PATH_INFO: `/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7/roles/85baef5df35b4eda8f8c9933e2138baa` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:16.653042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b4993-681e-45cb-adea-498fd5fd2877 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:16.660506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54874366-4d54-4227-9388-353b8eacec89 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorizing `identity:get_role_for_trust(trust_id=03ab6f50a0824f7d98c9ed70517a0ef7, role_id=85baef5df35b4eda8f8c9933e2138baa)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:16.662576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54874366-4d54-4227-9388-353b8eacec89 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:16.676142 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3598/7151] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Oct 16 01:34:16 2022] GET /identity/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7/roles/85baef5df35b4eda8f8c9933e2138baa => generated 244 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:16.677645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e420dce-7b41-4e16-94f4-b1d22938867d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:16.677999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e420dce-7b41-4e16-94f4-b1d22938867d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:16.678346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e420dce-7b41-4e16-94f4-b1d22938867d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:16.713529 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3554/7152] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:16 2022] POST /identity/v3/users => generated 298 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:16.714370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b4993-681e-45cb-adea-498fd5fd2877 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:16.728875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b4993-681e-45cb-adea-498fd5fd2877 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:16.734173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8031313-f07e-407b-8673-e38786b7df01 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce80bae03a844593adbbac1773fb71ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a70c0675bc7148e59c2691f652e99fc4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-563934325', 'tempest-DelegatedRole-1799149447'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:16.734870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8031313-f07e-407b-8673-e38786b7df01 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] REQUEST_METHOD: `HEAD` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:16.735203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8031313-f07e-407b-8673-e38786b7df01 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:16.735534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8031313-f07e-407b-8673-e38786b7df01 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] PATH_INFO: `/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7/roles/85baef5df35b4eda8f8c9933e2138baa` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:16.751230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8031313-f07e-407b-8673-e38786b7df01 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorizing `identity:get_role_for_trust(trust_id=03ab6f50a0824f7d98c9ed70517a0ef7, role_id=85baef5df35b4eda8f8c9933e2138baa)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:16.757526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8031313-f07e-407b-8673-e38786b7df01 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:16.767792 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:16.780687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8e420dce-7b41-4e16-94f4-b1d22938867d None None] MFA Rules not processed for user `9d746660a25846e3a357e0f831475320`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:16.782172 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3555/7153] 10.222.0.39 () {58 vars in 1369 bytes} [Sun Oct 16 01:34:16 2022] HEAD /identity/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7/roles/85baef5df35b4eda8f8c9933e2138baa => generated 0 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 16 01:34:16.784067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8e420dce-7b41-4e16-94f4-b1d22938867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:16.785638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8031313-f07e-407b-8673-e38786b7df01 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:16.817293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8031313-f07e-407b-8673-e38786b7df01 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:16.822939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def54ad-8491-4ae0-8974-387a937f927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:16.823853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def54ad-8491-4ae0-8974-387a937f927f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:16.824142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def54ad-8491-4ae0-8974-387a937f927f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:16.824418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def54ad-8491-4ae0-8974-387a937f927f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:16.825064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def54ad-8491-4ae0-8974-387a937f927f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:16.827202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def54ad-8491-4ae0-8974-387a937f927f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:16.841393 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3556/7154] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:16 2022] GET /identity/v3/roles => generated 1892 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:16.842370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def54ad-8491-4ae0-8974-387a937f927f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:16.854141 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:16.874110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def54ad-8491-4ae0-8974-387a937f927f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:16.880394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a8ac4-4390-468c-8d26-16ef79ef1a35 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce80bae03a844593adbbac1773fb71ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a70c0675bc7148e59c2691f652e99fc4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-563934325', 'tempest-DelegatedRole-1799149447'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:16.881116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a8ac4-4390-468c-8d26-16ef79ef1a35 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:16.881434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a8ac4-4390-468c-8d26-16ef79ef1a35 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:16.881718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a8ac4-4390-468c-8d26-16ef79ef1a35 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] PATH_INFO: `/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7/roles/d661df8e858543f49960219cce59a23a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:16.890157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a8ac4-4390-468c-8d26-16ef79ef1a35 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorizing `identity:get_role_for_trust(trust_id=03ab6f50a0824f7d98c9ed70517a0ef7, role_id=d661df8e858543f49960219cce59a23a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:16.892522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a8ac4-4390-468c-8d26-16ef79ef1a35 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-3c5a8ac4-4390-468c-8d26-16ef79ef1a35 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Could not find role: d661df8e858543f49960219cce59a23a.: keystone.exception.RoleNotFound: Could not find role: d661df8e858543f49960219cce59a23a. Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 01:34:16.921208 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: d661df8e858543f49960219cce59a23a. Oct 16 01:34:16.923156 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:34:16.923156 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3557/7155] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Oct 16 01:34:16 2022] GET /identity/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7/roles/d661df8e858543f49960219cce59a23a => generated 110 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:34:16.923156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a8ac4-4390-468c-8d26-16ef79ef1a35 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:16.947937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a8ac4-4390-468c-8d26-16ef79ef1a35 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:16.953989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148efa86-3b66-4fdf-bc1f-7a4b1414a30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:16.954897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148efa86-3b66-4fdf-bc1f-7a4b1414a30c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:16.955491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148efa86-3b66-4fdf-bc1f-7a4b1414a30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:16.955772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148efa86-3b66-4fdf-bc1f-7a4b1414a30c admin admin] PATH_INFO: `/v3/projects/95e6f12a69b74230816313661a27c0ff/users/8f2d8d5a8a7948a19a82ff69512c1863/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:16.980454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148efa86-3b66-4fdf-bc1f-7a4b1414a30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e6f12a69b74230816313661a27c0ff, user_id=8f2d8d5a8a7948a19a82ff69512c1863, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:16.983499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148efa86-3b66-4fdf-bc1f-7a4b1414a30c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:17.011547 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3558/7156] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:16 2022] PUT /identity/v3/projects/95e6f12a69b74230816313661a27c0ff/users/8f2d8d5a8a7948a19a82ff69512c1863/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:17.012415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148efa86-3b66-4fdf-bc1f-7a4b1414a30c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:17.019073 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3599/7157] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:17.024170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e420dce-7b41-4e16-94f4-b1d22938867d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:17.059724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e420dce-7b41-4e16-94f4-b1d22938867d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:17.139863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148efa86-3b66-4fdf-bc1f-7a4b1414a30c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:17.145311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c0ea2-f2c4-421c-b18e-f41211cf5ec7 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce80bae03a844593adbbac1773fb71ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a70c0675bc7148e59c2691f652e99fc4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-563934325', 'tempest-DelegatedRole-1799149447'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:17.146077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c0ea2-f2c4-421c-b18e-f41211cf5ec7 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] REQUEST_METHOD: `HEAD` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:17.146258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c0ea2-f2c4-421c-b18e-f41211cf5ec7 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:17.146535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c0ea2-f2c4-421c-b18e-f41211cf5ec7 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] PATH_INFO: `/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7/roles/d661df8e858543f49960219cce59a23a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:17.153514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c0ea2-f2c4-421c-b18e-f41211cf5ec7 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorizing `identity:get_role_for_trust(trust_id=03ab6f50a0824f7d98c9ed70517a0ef7, role_id=d661df8e858543f49960219cce59a23a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:17.155351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c0ea2-f2c4-421c-b18e-f41211cf5ec7 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-3b6c0ea2-f2c4-421c-b18e-f41211cf5ec7 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Could not find role: d661df8e858543f49960219cce59a23a.: keystone.exception.RoleNotFound: Could not find role: d661df8e858543f49960219cce59a23a. Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 01:34:17.169114 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: d661df8e858543f49960219cce59a23a. Oct 16 01:34:17.170550 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:34:17.170758 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3559/7158] 10.222.0.39 () {58 vars in 1369 bytes} [Sun Oct 16 01:34:17 2022] HEAD /identity/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7/roles/d661df8e858543f49960219cce59a23a => generated 0 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 16 01:34:17.172134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c0ea2-f2c4-421c-b18e-f41211cf5ec7 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:17.175060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b6c0ea2-f2c4-421c-b18e-f41211cf5ec7 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:17.202267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c3a3d-13af-47c2-9aa3-4749e23d37fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:17.205342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c3a3d-13af-47c2-9aa3-4749e23d37fb admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:17.205731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c3a3d-13af-47c2-9aa3-4749e23d37fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:17.206712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c3a3d-13af-47c2-9aa3-4749e23d37fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:17.209266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c3a3d-13af-47c2-9aa3-4749e23d37fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:17.211032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c3a3d-13af-47c2-9aa3-4749e23d37fb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:17.234282 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3600/7159] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:17 2022] GET /identity/v3/roles => generated 1892 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:17.235520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c3a3d-13af-47c2-9aa3-4749e23d37fb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:17.251064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c3a3d-13af-47c2-9aa3-4749e23d37fb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:17.256961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312b881-56fc-48db-aea9-835d148414a1 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce80bae03a844593adbbac1773fb71ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a70c0675bc7148e59c2691f652e99fc4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-563934325', 'tempest-DelegatedRole-1799149447'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:17.257731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312b881-56fc-48db-aea9-835d148414a1 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:17.258102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312b881-56fc-48db-aea9-835d148414a1 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:17.258478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312b881-56fc-48db-aea9-835d148414a1 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] PATH_INFO: `/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:17.273647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312b881-56fc-48db-aea9-835d148414a1 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorizing `identity:delete_trust(trust_id=03ab6f50a0824f7d98c9ed70517a0ef7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:17.276457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312b881-56fc-48db-aea9-835d148414a1 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:17.295173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c0ea2-f2c4-421c-b18e-f41211cf5ec7 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:17.299536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f312b881-56fc-48db-aea9-835d148414a1 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '03ab6f50a0824f7d98c9ed70517a0ef7', 'request_id': 'req-f312b881-56fc-48db-aea9-835d148414a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:17.302115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f312b881-56fc-48db-aea9-835d148414a1 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '03ab6f50a0824f7d98c9ed70517a0ef7', 'request_id': 'req-f312b881-56fc-48db-aea9-835d148414a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:17.304439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f312b881-56fc-48db-aea9-835d148414a1 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '03ab6f50a0824f7d98c9ed70517a0ef7', 'request_id': 'req-f312b881-56fc-48db-aea9-835d148414a1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:17.307693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a6c07-fd6e-4ad4-8e48-b8d1cf765b1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:17.308630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6c07-fd6e-4ad4-8e48-b8d1cf765b1f service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:17.309480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6c07-fd6e-4ad4-8e48-b8d1cf765b1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:17.310673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6c07-fd6e-4ad4-8e48-b8d1cf765b1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:17.315396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4c3a6c07-fd6e-4ad4-8e48-b8d1cf765b1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:17.336601 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3601/7160] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Oct 16 01:34:17 2022] DELETE /identity/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:17.337826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312b881-56fc-48db-aea9-835d148414a1 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:17.343555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f312b881-56fc-48db-aea9-835d148414a1 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:17.372708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312b881-56fc-48db-aea9-835d148414a1 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:17.388557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3cbb2-8321-4942-9f9a-c0577ed4ec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:17.389370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3cbb2-8321-4942-9f9a-c0577ed4ec94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:17.389851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3cbb2-8321-4942-9f9a-c0577ed4ec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:17.390236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3cbb2-8321-4942-9f9a-c0577ed4ec94 admin admin] PATH_INFO: `/v3/projects/95e6f12a69b74230816313661a27c0ff/users/8f2d8d5a8a7948a19a82ff69512c1863/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:17.393381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3cbb2-8321-4942-9f9a-c0577ed4ec94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e6f12a69b74230816313661a27c0ff, user_id=8f2d8d5a8a7948a19a82ff69512c1863, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:17.396417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3cbb2-8321-4942-9f9a-c0577ed4ec94 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:17.434951 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3602/7161] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:17 2022] PUT /identity/v3/projects/95e6f12a69b74230816313661a27c0ff/users/8f2d8d5a8a7948a19a82ff69512c1863/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:17.436221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3cbb2-8321-4942-9f9a-c0577ed4ec94 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:17.439086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1ee3cbb2-8321-4942-9f9a-c0577ed4ec94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:17.492179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a6c07-fd6e-4ad4-8e48-b8d1cf765b1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:17.495089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a6c07-fd6e-4ad4-8e48-b8d1cf765b1f service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:17.524009 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:17.533279 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3560/7162] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:17.536584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74712e8e-869e-4d6d-bcd4-2f0ce5c67bf3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:17.538101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74712e8e-869e-4d6d-bcd4-2f0ce5c67bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:17.538634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74712e8e-869e-4d6d-bcd4-2f0ce5c67bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:17.568075 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:17.596228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3cbb2-8321-4942-9f9a-c0577ed4ec94 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:17.604781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab4537-6aac-4d0a-80e3-6d9fc0ab2938 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce80bae03a844593adbbac1773fb71ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a70c0675bc7148e59c2691f652e99fc4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-563934325', 'tempest-DelegatedRole-1799149447'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:17.605718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab4537-6aac-4d0a-80e3-6d9fc0ab2938 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:17.606002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab4537-6aac-4d0a-80e3-6d9fc0ab2938 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:17.606285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab4537-6aac-4d0a-80e3-6d9fc0ab2938 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] PATH_INFO: `/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:17.613665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-74712e8e-869e-4d6d-bcd4-2f0ce5c67bf3 None None] MFA Rules not processed for user `8f2d8d5a8a7948a19a82ff69512c1863`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:17.615569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-74712e8e-869e-4d6d-bcd4-2f0ce5c67bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-39ab4537-6aac-4d0a-80e3-6d9fc0ab2938 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Could not find trust: 03ab6f50a0824f7d98c9ed70517a0ef7.: keystone.exception.TrustNotFound: Could not find trust: 03ab6f50a0824f7d98c9ed70517a0ef7. Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 16 01:34:17.634466 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 16 01:34:17.636022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 16 01:34:17.636022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 16 01:34:17.636022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 16 01:34:17.636022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 16 01:34:17.636022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 16 01:34:17.636022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:17.636022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:17.636022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 16 01:34:17.636022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 16 01:34:17.636022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 16 01:34:17.636022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 16 01:34:17.636022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 03ab6f50a0824f7d98c9ed70517a0ef7. Oct 16 01:34:17.636022 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:17.641414 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3603/7163] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:34:17 2022] GET /identity/v3/OS-TRUST/trusts/03ab6f50a0824f7d98c9ed70517a0ef7 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:34:17.643640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab4537-6aac-4d0a-80e3-6d9fc0ab2938 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:17.657642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-39ab4537-6aac-4d0a-80e3-6d9fc0ab2938 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:17.761853 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3561/7164] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:17.762750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74712e8e-869e-4d6d-bcd4-2f0ce5c67bf3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:17.768285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-74712e8e-869e-4d6d-bcd4-2f0ce5c67bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:17.824441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab4537-6aac-4d0a-80e3-6d9fc0ab2938 tempest-TrustsV3TestJSON-295596334 tempest-user-1473410687] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:17.836314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7aafc6-3d97-4df6-81cd-5adb54c8e5cc tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:17.839888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7aafc6-3d97-4df6-81cd-5adb54c8e5cc tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:17.840409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7aafc6-3d97-4df6-81cd-5adb54c8e5cc tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:17.840997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7aafc6-3d97-4df6-81cd-5adb54c8e5cc tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles/d661df8e858543f49960219cce59a23a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:17.843468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7aafc6-3d97-4df6-81cd-5adb54c8e5cc tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d661df8e858543f49960219cce59a23a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:17.846293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7aafc6-3d97-4df6-81cd-5adb54c8e5cc tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:17.916809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74712e8e-869e-4d6d-bcd4-2f0ce5c67bf3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:17.923393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9363f-016e-4b96-acaa-74636ebe209a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:17.924030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9363f-016e-4b96-acaa-74636ebe209a service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:17.924312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9363f-016e-4b96-acaa-74636ebe209a service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:17.924595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9363f-016e-4b96-acaa-74636ebe209a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:17.931226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aec9363f-016e-4b96-acaa-74636ebe209a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:17.946031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d7aafc6-3d97-4df6-81cd-5adb54c8e5cc tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invalidating the token cache because role d661df8e858543f49960219cce59a23a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:17.947278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d7aafc6-3d97-4df6-81cd-5adb54c8e5cc tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:17.949379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d7aafc6-3d97-4df6-81cd-5adb54c8e5cc tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:17.961295 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3604/7165] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:17 2022] DELETE /identity/v3/roles/d661df8e858543f49960219cce59a23a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:17.963485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7aafc6-3d97-4df6-81cd-5adb54c8e5cc tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:17.967348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d7aafc6-3d97-4df6-81cd-5adb54c8e5cc tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:18.058705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9363f-016e-4b96-acaa-74636ebe209a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:18.066647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9363f-016e-4b96-acaa-74636ebe209a service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:18.081118 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3562/7166] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:18.081993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9363f-016e-4b96-acaa-74636ebe209a service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:18.116004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9363f-016e-4b96-acaa-74636ebe209a service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:18.155997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7aafc6-3d97-4df6-81cd-5adb54c8e5cc tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:18.170175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fbd17-6672-4262-8c38-4136c3f985ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:18.170810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fbd17-6672-4262-8c38-4136c3f985ae service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:18.171110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fbd17-6672-4262-8c38-4136c3f985ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:18.178814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fbd17-6672-4262-8c38-4136c3f985ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:18.181420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-934fbd17-6672-4262-8c38-4136c3f985ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:18.248596 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:18.300151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e54c17-f41d-45ad-b95b-06f376826ebe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:18.301636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e54c17-f41d-45ad-b95b-06f376826ebe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:18.302175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e54c17-f41d-45ad-b95b-06f376826ebe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:18.302676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e54c17-f41d-45ad-b95b-06f376826ebe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles/85baef5df35b4eda8f8c9933e2138baa` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:18.304846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e54c17-f41d-45ad-b95b-06f376826ebe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_role(role_id=85baef5df35b4eda8f8c9933e2138baa)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:18.306598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e54c17-f41d-45ad-b95b-06f376826ebe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:18.381392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fbd17-6672-4262-8c38-4136c3f985ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:18.383846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fbd17-6672-4262-8c38-4136c3f985ae service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:18.420233 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3605/7167] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:18.429448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-58e54c17-f41d-45ad-b95b-06f376826ebe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invalidating the token cache because role 85baef5df35b4eda8f8c9933e2138baa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:18.430783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-58e54c17-f41d-45ad-b95b-06f376826ebe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:18.431797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-58e54c17-f41d-45ad-b95b-06f376826ebe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:18.437512 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3563/7168] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:18 2022] DELETE /identity/v3/roles/85baef5df35b4eda8f8c9933e2138baa => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:18.443137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fbd17-6672-4262-8c38-4136c3f985ae service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:18.444658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-934fbd17-6672-4262-8c38-4136c3f985ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:18.467625 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:18.482689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fbd17-6672-4262-8c38-4136c3f985ae service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:18.624539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:18.625975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:18.632819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:18.633352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users/ce80bae03a844593adbbac1773fb71ae` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:18.635560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ce80bae03a844593adbbac1773fb71ae)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:18.638178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:18.721596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e54c17-f41d-45ad-b95b-06f376826ebe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:18.723664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-58e54c17-f41d-45ad-b95b-06f376826ebe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:18.766704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce80bae03a844593adbbac1773fb71ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:18.768650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce80bae03a844593adbbac1773fb71ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:18.790527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce80bae03a844593adbbac1773fb71ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:18.802142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce80bae03a844593adbbac1773fb71ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:18.803859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce80bae03a844593adbbac1773fb71ae'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:18.827142 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3606/7169] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:18 2022] DELETE /identity/v3/users/ce80bae03a844593adbbac1773fb71ae => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:18.831427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:18.833520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:18.906745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e54c17-f41d-45ad-b95b-06f376826ebe tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:18.969777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3a1f4-3258-407b-ade4-6f4db0d25867 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:18.981133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b0003-f5d5-440f-86a0-e3f611091638 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:18.981927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b0003-f5d5-440f-86a0-e3f611091638 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:18.982253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b0003-f5d5-440f-86a0-e3f611091638 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:18.982531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b0003-f5d5-440f-86a0-e3f611091638 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/a70c0675bc7148e59c2691f652e99fc4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:18.988056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b0003-f5d5-440f-86a0-e3f611091638 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a70c0675bc7148e59c2691f652e99fc4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:18.989999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b0003-f5d5-440f-86a0-e3f611091638 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:19.022749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:19.022749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:19.022749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:19.022749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] PATH_INFO: `/v3/users/7c9f88d7a9b442b49796b714b52905e8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:19.023625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9f88d7a9b442b49796b714b52905e8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:19.023625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:19.155482 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:19.184093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9f88d7a9b442b49796b714b52905e8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:19.184949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9f88d7a9b442b49796b714b52905e8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:19.219465 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:19.219614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6a7b0003-f5d5-440f-86a0-e3f611091638 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70c0675bc7148e59c2691f652e99fc4', 'request_id': 'req-6a7b0003-f5d5-440f-86a0-e3f611091638'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:19.219744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9f88d7a9b442b49796b714b52905e8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:19.219840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6a7b0003-f5d5-440f-86a0-e3f611091638 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70c0675bc7148e59c2691f652e99fc4', 'request_id': 'req-6a7b0003-f5d5-440f-86a0-e3f611091638'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:19.226669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6a7b0003-f5d5-440f-86a0-e3f611091638 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70c0675bc7148e59c2691f652e99fc4', 'request_id': 'req-6a7b0003-f5d5-440f-86a0-e3f611091638'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:19.233813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9f88d7a9b442b49796b714b52905e8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:19.234306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9f88d7a9b442b49796b714b52905e8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:19.261309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6a7b0003-f5d5-440f-86a0-e3f611091638 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] The token cache is being invalidate because project a70c0675bc7148e59c2691f652e99fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:19.261764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6a7b0003-f5d5-440f-86a0-e3f611091638 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:19.266785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6a7b0003-f5d5-440f-86a0-e3f611091638 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:19.278587 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3607/7170] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:18 2022] DELETE /identity/v3/projects/a70c0675bc7148e59c2691f652e99fc4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:19.279944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1be6f-90bb-4ec1-9578-5d8d88074f28 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:19.280233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1be6f-90bb-4ec1-9578-5d8d88074f28 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:19.280508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1be6f-90bb-4ec1-9578-5d8d88074f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:19.283194 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3564/7171] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:18 2022] DELETE /identity/v3/users/7c9f88d7a9b442b49796b714b52905e8 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:34:19.284657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:19.286327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:19.337299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f3a1be6f-90bb-4ec1-9578-5d8d88074f28 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:19.339346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f3a1be6f-90bb-4ec1-9578-5d8d88074f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:19.446739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d9068-efb4-4954-a3b8-8ae75a7af843 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:19.466611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204db86f-6469-4607-9d07-e5937d079821 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:19.471923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204db86f-6469-4607-9d07-e5937d079821 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:19.472814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204db86f-6469-4607-9d07-e5937d079821 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:19.473614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204db86f-6469-4607-9d07-e5937d079821 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:19.474301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204db86f-6469-4607-9d07-e5937d079821 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:19.478014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204db86f-6469-4607-9d07-e5937d079821 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:19.536117 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3608/7172] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:19.547251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1be6f-90bb-4ec1-9578-5d8d88074f28 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:19.550697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f3a1be6f-90bb-4ec1-9578-5d8d88074f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:19.577246 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3565/7173] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:34:19 2022] POST /identity/v3/projects => generated 328 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:19.578131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204db86f-6469-4607-9d07-e5937d079821 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:19.583556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-204db86f-6469-4607-9d07-e5937d079821 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:19.677712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1be6f-90bb-4ec1-9578-5d8d88074f28 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:19.720242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204db86f-6469-4607-9d07-e5937d079821 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:19.734213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439e458-5500-4962-94b7-921a46f99eec tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:19.735481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439e458-5500-4962-94b7-921a46f99eec tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:19.735765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439e458-5500-4962-94b7-921a46f99eec tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:19.736165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439e458-5500-4962-94b7-921a46f99eec tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:19.736762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439e458-5500-4962-94b7-921a46f99eec tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:19.738841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439e458-5500-4962-94b7-921a46f99eec tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:19.802390 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3566/7174] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:19 2022] POST /identity/v3/users => generated 413 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:19.805871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7d974-d7b7-42fe-98b1-30d4dda0248a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:19.806629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7d974-d7b7-42fe-98b1-30d4dda0248a service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:19.807243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7d974-d7b7-42fe-98b1-30d4dda0248a service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:19.807633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7d974-d7b7-42fe-98b1-30d4dda0248a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:19.808133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439e458-5500-4962-94b7-921a46f99eec tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:19.826431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439e458-5500-4962-94b7-921a46f99eec tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:19.839267 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:19.840500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3134676-1633-4eda-83be-40d934bd25de tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:19.841263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134676-1633-4eda-83be-40d934bd25de tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:19.841704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134676-1633-4eda-83be-40d934bd25de tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:19.842090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134676-1633-4eda-83be-40d934bd25de tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:19.843672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3134676-1633-4eda-83be-40d934bd25de tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:19.849983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3134676-1633-4eda-83be-40d934bd25de tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:19.877796 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3567/7175] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:34:19 2022] POST /identity/v3/roles => generated 243 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:19.885361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3134676-1633-4eda-83be-40d934bd25de tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:19.904691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3134676-1633-4eda-83be-40d934bd25de tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:19.915652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1f634-b870-48d0-a47f-01d669323ba8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:19.916416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1f634-b870-48d0-a47f-01d669323ba8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:19.916993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1f634-b870-48d0-a47f-01d669323ba8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:19.918018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1f634-b870-48d0-a47f-01d669323ba8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:19.919322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1f634-b870-48d0-a47f-01d669323ba8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:19.922080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1f634-b870-48d0-a47f-01d669323ba8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:19.936114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7d974-d7b7-42fe-98b1-30d4dda0248a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:19.938229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7d974-d7b7-42fe-98b1-30d4dda0248a service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:19.959010 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3568/7176] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:34:19 2022] POST /identity/v3/roles => generated 247 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:19.960077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1f634-b870-48d0-a47f-01d669323ba8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:19.970666 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3609/7177] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:19.978267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1f634-b870-48d0-a47f-01d669323ba8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:19.983645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1a108-8874-42e1-82d2-ad97e8bb6edf tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:19.984496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1a108-8874-42e1-82d2-ad97e8bb6edf tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:19.985062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1a108-8874-42e1-82d2-ad97e8bb6edf tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:19.985470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1a108-8874-42e1-82d2-ad97e8bb6edf tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/a815a7a321f54158b04acf3c56cb2a20/users/26fe405d3e5142248c29cdd2894d4b3e/roles/0c5a5ca833d84a6a9ab9310958b9bffd` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:20.003249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1a108-8874-42e1-82d2-ad97e8bb6edf tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a815a7a321f54158b04acf3c56cb2a20, user_id=26fe405d3e5142248c29cdd2894d4b3e, role_id=0c5a5ca833d84a6a9ab9310958b9bffd)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:20.006711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1a108-8874-42e1-82d2-ad97e8bb6edf tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:20.029427 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=2,keystone:INSERT=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:20.047512 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3569/7178] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:19 2022] PUT /identity/v3/projects/a815a7a321f54158b04acf3c56cb2a20/users/26fe405d3e5142248c29cdd2894d4b3e/roles/0c5a5ca833d84a6a9ab9310958b9bffd => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:20.052437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7d974-d7b7-42fe-98b1-30d4dda0248a service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:20.067910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7d974-d7b7-42fe-98b1-30d4dda0248a service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:20.191910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91aa15-4d5a-4b36-b0d4-699a37096e4b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:20.193335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91aa15-4d5a-4b36-b0d4-699a37096e4b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:20.193849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91aa15-4d5a-4b36-b0d4-699a37096e4b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:20.194286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91aa15-4d5a-4b36-b0d4-699a37096e4b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/a815a7a321f54158b04acf3c56cb2a20/users/26fe405d3e5142248c29cdd2894d4b3e/roles/2db0d55002b14ae8886ad25ef0b52422` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:20.197348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91aa15-4d5a-4b36-b0d4-699a37096e4b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a815a7a321f54158b04acf3c56cb2a20, user_id=26fe405d3e5142248c29cdd2894d4b3e, role_id=2db0d55002b14ae8886ad25ef0b52422)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:20.200738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91aa15-4d5a-4b36-b0d4-699a37096e4b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:20.232350 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3610/7179] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:20 2022] PUT /identity/v3/projects/a815a7a321f54158b04acf3c56cb2a20/users/26fe405d3e5142248c29cdd2894d4b3e/roles/2db0d55002b14ae8886ad25ef0b52422 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:20.245207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1a108-8874-42e1-82d2-ad97e8bb6edf tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:20.265127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1a108-8874-42e1-82d2-ad97e8bb6edf tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:20.421804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125400e-24cf-45f3-ab26-63d606f36ce2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:20.423056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125400e-24cf-45f3-ab26-63d606f36ce2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:20.423345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125400e-24cf-45f3-ab26-63d606f36ce2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:20.423623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125400e-24cf-45f3-ab26-63d606f36ce2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:20.424478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125400e-24cf-45f3-ab26-63d606f36ce2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:20.426402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125400e-24cf-45f3-ab26-63d606f36ce2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:20.505252 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3570/7180] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:20 2022] GET /identity/v3/users => generated 8057 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:20.505932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d7fa4-a097-4dd4-8d01-10633bf2fced None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:20.506227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d7fa4-a097-4dd4-8d01-10633bf2fced None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:20.506511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d7fa4-a097-4dd4-8d01-10633bf2fced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:20.589938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125400e-24cf-45f3-ab26-63d606f36ce2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:20.592381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f125400e-24cf-45f3-ab26-63d606f36ce2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:20.595830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0e3d7fa4-a097-4dd4-8d01-10633bf2fced None None] MFA Rules not processed for user `26fe405d3e5142248c29cdd2894d4b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:20.597689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0e3d7fa4-a097-4dd4-8d01-10633bf2fced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:20.716672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125400e-24cf-45f3-ab26-63d606f36ce2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:20.727970 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3611/7181] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:20.729253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:20.730524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:20.732193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:20.732193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] PATH_INFO: `/v3/projects/0bccbbd3ba9645e69a5af8628de47a02` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:20.732382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bccbbd3ba9645e69a5af8628de47a02)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:20.734628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:20.741842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1991a-b214-42c6-aa8d-04d61a3f9899 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:20.747960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1991a-b214-42c6-aa8d-04d61a3f9899 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:20.748303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1991a-b214-42c6-aa8d-04d61a3f9899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:20.795083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-64d1991a-b214-42c6-aa8d-04d61a3f9899 None None] MFA Rules not processed for user `26fe405d3e5142248c29cdd2894d4b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:20.796378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-64d1991a-b214-42c6-aa8d-04d61a3f9899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:20.823963 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3612/7182] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:34:20.825019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1991a-b214-42c6-aa8d-04d61a3f9899 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:20.840798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1991a-b214-42c6-aa8d-04d61a3f9899 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:20.846582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9256d7-0ba4-4600-9414-fe0b6c982751 tempest-TrustsV3TestJSON-997521663 tempest-user-626115866] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26fe405d3e5142248c29cdd2894d4b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a815a7a321f54158b04acf3c56cb2a20', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1745311446', 'tempest-DelegatedRole-330829585'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:20.847636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9256d7-0ba4-4600-9414-fe0b6c982751 tempest-TrustsV3TestJSON-997521663 tempest-user-626115866] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:20.847636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9256d7-0ba4-4600-9414-fe0b6c982751 tempest-TrustsV3TestJSON-997521663 tempest-user-626115866] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:20.847878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9256d7-0ba4-4600-9414-fe0b6c982751 tempest-TrustsV3TestJSON-997521663 tempest-user-626115866] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:20.848417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9256d7-0ba4-4600-9414-fe0b6c982751 tempest-TrustsV3TestJSON-997521663 tempest-user-626115866] RBAC: Authorizing `identity:create_trust()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:20.850200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9256d7-0ba4-4600-9414-fe0b6c982751 tempest-TrustsV3TestJSON-997521663 tempest-user-626115866] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:20.885290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bccbbd3ba9645e69a5af8628de47a02', 'request_id': 'req-29cf79cd-44f6-4a3c-b67e-36c85976bac6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:20.886682 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:20.903288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bccbbd3ba9645e69a5af8628de47a02', 'request_id': 'req-29cf79cd-44f6-4a3c-b67e-36c85976bac6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:20.927832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bccbbd3ba9645e69a5af8628de47a02', 'request_id': 'req-29cf79cd-44f6-4a3c-b67e-36c85976bac6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:20.957259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] The token cache is being invalidate because project 0bccbbd3ba9645e69a5af8628de47a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:20.957554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:20.958860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:20.968253 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3571/7183] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:20 2022] DELETE /identity/v3/projects/0bccbbd3ba9645e69a5af8628de47a02 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:20.969380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:20.977347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-7a9256d7-0ba4-4600-9414-fe0b6c982751 tempest-TrustsV3TestJSON-997521663 tempest-user-626115866] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 16 01:34:20.979150 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 16 01:34:20.980418 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 16 01:34:20.981863 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 16 01:34:20.981863 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 16 01:34:20.981863 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 16 01:34:20.981863 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 16 01:34:20.981863 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 16 01:34:20.981863 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:20.986429 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3613/7184] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Oct 16 01:34:20 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 162 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 16 01:34:20.990807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9256d7-0ba4-4600-9414-fe0b6c982751 tempest-TrustsV3TestJSON-997521663 tempest-user-626115866] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:20.994162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7a9256d7-0ba4-4600-9414-fe0b6c982751 tempest-TrustsV3TestJSON-997521663 tempest-user-626115866] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:21.036428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9256d7-0ba4-4600-9414-fe0b6c982751 tempest-TrustsV3TestJSON-997521663 tempest-user-626115866] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:21.042820 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:21.126043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf79cd-44f6-4a3c-b67e-36c85976bac6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:21.139399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:21.142072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:21.142072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:21.145494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] PATH_INFO: `/v3/users/9d746660a25846e3a357e0f831475320` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:21.148680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d746660a25846e3a357e0f831475320)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:21.151920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:21.181161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793a684-2d7c-4c8e-9e75-41d7c7e58984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:21.182260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793a684-2d7c-4c8e-9e75-41d7c7e58984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:21.185105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793a684-2d7c-4c8e-9e75-41d7c7e58984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:21.185526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793a684-2d7c-4c8e-9e75-41d7c7e58984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles/2db0d55002b14ae8886ad25ef0b52422` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:21.190378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793a684-2d7c-4c8e-9e75-41d7c7e58984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2db0d55002b14ae8886ad25ef0b52422)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:21.199062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793a684-2d7c-4c8e-9e75-41d7c7e58984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:21.295360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d746660a25846e3a357e0f831475320'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:21.299342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d746660a25846e3a357e0f831475320'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:21.310092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e793a684-2d7c-4c8e-9e75-41d7c7e58984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invalidating the token cache because role 2db0d55002b14ae8886ad25ef0b52422 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:21.311633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e793a684-2d7c-4c8e-9e75-41d7c7e58984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:21.313409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e793a684-2d7c-4c8e-9e75-41d7c7e58984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:21.319737 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3614/7185] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:20 2022] DELETE /identity/v3/roles/2db0d55002b14ae8886ad25ef0b52422 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:21.324614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793a684-2d7c-4c8e-9e75-41d7c7e58984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:21.328161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e793a684-2d7c-4c8e-9e75-41d7c7e58984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:21.347231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d746660a25846e3a357e0f831475320'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:21.363721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d746660a25846e3a357e0f831475320'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:21.364632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d746660a25846e3a357e0f831475320'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:21.401476 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3572/7186] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:20 2022] DELETE /identity/v3/users/9d746660a25846e3a357e0f831475320 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:21.470220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793a684-2d7c-4c8e-9e75-41d7c7e58984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:21.607673 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:21.635781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b829e-d158-4ca3-a407-4f829378537f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:21.636623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b829e-d158-4ca3-a407-4f829378537f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:21.637006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b829e-d158-4ca3-a407-4f829378537f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:21.637783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b829e-d158-4ca3-a407-4f829378537f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles/0c5a5ca833d84a6a9ab9310958b9bffd` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:21.640475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b829e-d158-4ca3-a407-4f829378537f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0c5a5ca833d84a6a9ab9310958b9bffd)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:21.643318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b829e-d158-4ca3-a407-4f829378537f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:21.761132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f4b829e-d158-4ca3-a407-4f829378537f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invalidating the token cache because role 0c5a5ca833d84a6a9ab9310958b9bffd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:21.761941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f4b829e-d158-4ca3-a407-4f829378537f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:21.764829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f4b829e-d158-4ca3-a407-4f829378537f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:21.788485 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3615/7187] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:21 2022] DELETE /identity/v3/roles/0c5a5ca833d84a6a9ab9310958b9bffd => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:21.793495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:21.795239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:21.838032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815f0c5-39d4-4740-aeeb-650abb6d51de admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:21.953250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b829e-d158-4ca3-a407-4f829378537f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:21.954826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8f4b829e-d158-4ca3-a407-4f829378537f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:22.052114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:22.053754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:22.054380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:22.054821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users/26fe405d3e5142248c29cdd2894d4b3e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:22.058305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_user(user_id=26fe405d3e5142248c29cdd2894d4b3e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:22.060908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:22.311053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b829e-d158-4ca3-a407-4f829378537f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:22.320935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6ee15-1b19-442a-bc77-119b4008365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:22.322322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6ee15-1b19-442a-bc77-119b4008365a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:22.322943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6ee15-1b19-442a-bc77-119b4008365a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:22.323586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6ee15-1b19-442a-bc77-119b4008365a admin admin] PATH_INFO: `/v3/projects/4affb38cd687480497c542e01577abec` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:22.326777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6ee15-1b19-442a-bc77-119b4008365a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4affb38cd687480497c542e01577abec)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:22.331808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6ee15-1b19-442a-bc77-119b4008365a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:22.406047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26fe405d3e5142248c29cdd2894d4b3e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.407694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26fe405d3e5142248c29cdd2894d4b3e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.409515 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:22.467878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26fe405d3e5142248c29cdd2894d4b3e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.471874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-71a6ee15-1b19-442a-bc77-119b4008365a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4affb38cd687480497c542e01577abec', 'request_id': 'req-71a6ee15-1b19-442a-bc77-119b4008365a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.493762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-71a6ee15-1b19-442a-bc77-119b4008365a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4affb38cd687480497c542e01577abec', 'request_id': 'req-71a6ee15-1b19-442a-bc77-119b4008365a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.496743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26fe405d3e5142248c29cdd2894d4b3e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.497415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26fe405d3e5142248c29cdd2894d4b3e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.512648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-71a6ee15-1b19-442a-bc77-119b4008365a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4affb38cd687480497c542e01577abec', 'request_id': 'req-71a6ee15-1b19-442a-bc77-119b4008365a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.522583 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3573/7188] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:21 2022] DELETE /identity/v3/users/26fe405d3e5142248c29cdd2894d4b3e => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:34:22.522583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:22.532363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:22.545480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-71a6ee15-1b19-442a-bc77-119b4008365a admin admin] The token cache is being invalidate because project 4affb38cd687480497c542e01577abec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:22.546415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-71a6ee15-1b19-442a-bc77-119b4008365a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.548460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-71a6ee15-1b19-442a-bc77-119b4008365a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.550252 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3616/7189] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:21 2022] DELETE /identity/v3/projects/4affb38cd687480497c542e01577abec => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:22.558265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c023e-cec0-4643-a91c-0586fae5a864 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:22.558901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c023e-cec0-4643-a91c-0586fae5a864 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:22.559487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c023e-cec0-4643-a91c-0586fae5a864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:22.620186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bd5c023e-cec0-4643-a91c-0586fae5a864 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:22.632786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bd5c023e-cec0-4643-a91c-0586fae5a864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:22.672637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6972020-a224-4eda-ab91-bff852a9805f tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:22.685789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:22.686450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:22.686725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:22.687022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/a815a7a321f54158b04acf3c56cb2a20` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:22.688957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a815a7a321f54158b04acf3c56cb2a20)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:22.690879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:22.716760 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:22.759497 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3617/7190] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:22.768285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b3117-2cb6-4f0b-8840-9ed3699c66c2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:22.769451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b3117-2cb6-4f0b-8840-9ed3699c66c2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:22.770433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b3117-2cb6-4f0b-8840-9ed3699c66c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:22.803021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a815a7a321f54158b04acf3c56cb2a20', 'request_id': 'req-71dbb27a-99d3-4c2f-9461-f4b689017843'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.810277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a815a7a321f54158b04acf3c56cb2a20', 'request_id': 'req-71dbb27a-99d3-4c2f-9461-f4b689017843'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.823617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6c1b3117-2cb6-4f0b-8840-9ed3699c66c2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:22.828542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c1b3117-2cb6-4f0b-8840-9ed3699c66c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:22.836815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a815a7a321f54158b04acf3c56cb2a20', 'request_id': 'req-71dbb27a-99d3-4c2f-9461-f4b689017843'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.854657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] The token cache is being invalidate because project a815a7a321f54158b04acf3c56cb2a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:22.854971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.855671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:22.857407 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3574/7191] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:22 2022] DELETE /identity/v3/projects/a815a7a321f54158b04acf3c56cb2a20 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:22.866715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:22.872324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:22.979400 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3618/7192] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:22.983586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b3117-2cb6-4f0b-8840-9ed3699c66c2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:23.011865 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:23.030743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbb27a-99d3-4c2f-9461-f4b689017843 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:23.046389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b3117-2cb6-4f0b-8840-9ed3699c66c2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:23.051611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babf634-0df3-47c0-8a59-3c335820f512 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:23.052305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babf634-0df3-47c0-8a59-3c335820f512 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:23.052614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babf634-0df3-47c0-8a59-3c335820f512 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:23.052864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babf634-0df3-47c0-8a59-3c335820f512 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:23.056764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babf634-0df3-47c0-8a59-3c335820f512 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:23.058892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0d968-de8a-4264-903a-716c36891275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:23.059677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d968-de8a-4264-903a-716c36891275 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:23.060981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babf634-0df3-47c0-8a59-3c335820f512 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:23.061325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d968-de8a-4264-903a-716c36891275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:23.061710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d968-de8a-4264-903a-716c36891275 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:23.063483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0d968-de8a-4264-903a-716c36891275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:23.065590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0d968-de8a-4264-903a-716c36891275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:23.067659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0d968-de8a-4264-903a-716c36891275 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:23.108326 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3619/7193] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:34:23.112949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0d968-de8a-4264-903a-716c36891275 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:23.132732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0d968-de8a-4264-903a-716c36891275 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:23.146403 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3575/7194] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:34:22 2022] POST /identity/v3/projects => generated 329 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:34:23.151184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babf634-0df3-47c0-8a59-3c335820f512 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:23.152688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1bfcf-ffc2-46de-859f-9b33b7927638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:23.153759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1bfcf-ffc2-46de-859f-9b33b7927638 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:23.154375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1bfcf-ffc2-46de-859f-9b33b7927638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:23.155385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1bfcf-ffc2-46de-859f-9b33b7927638 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:23.158070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1bfcf-ffc2-46de-859f-9b33b7927638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:23.160498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1bfcf-ffc2-46de-859f-9b33b7927638 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:23.226563 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3620/7195] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:23 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:34:23.230711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1bfcf-ffc2-46de-859f-9b33b7927638 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:23.315658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babf634-0df3-47c0-8a59-3c335820f512 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:23.421294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1bfcf-ffc2-46de-859f-9b33b7927638 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:23.431590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5facd6-c80e-4529-90e4-1310d75789b8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:23.432930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5facd6-c80e-4529-90e4-1310d75789b8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:23.433423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5facd6-c80e-4529-90e4-1310d75789b8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:23.433964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5facd6-c80e-4529-90e4-1310d75789b8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:23.435633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5facd6-c80e-4529-90e4-1310d75789b8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:23.443634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5facd6-c80e-4529-90e4-1310d75789b8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:23.446130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e01c3c-c419-4ed0-b0ba-31b692238627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:23.446759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e01c3c-c419-4ed0-b0ba-31b692238627 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:23.447079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e01c3c-c419-4ed0-b0ba-31b692238627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:23.447330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e01c3c-c419-4ed0-b0ba-31b692238627 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:23.447993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e01c3c-c419-4ed0-b0ba-31b692238627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:23.449943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e01c3c-c419-4ed0-b0ba-31b692238627 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:23.494840 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3576/7196] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:23 2022] POST /identity/v3/users => generated 413 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:23.499374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5facd6-c80e-4529-90e4-1310d75789b8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:23.524800 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3621/7197] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:23 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:23.530436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5facd6-c80e-4529-90e4-1310d75789b8 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:23.530721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e01c3c-c419-4ed0-b0ba-31b692238627 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:23.542472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa8ec-f13e-447a-9e58-55a7bd89ae74 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:23.543652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa8ec-f13e-447a-9e58-55a7bd89ae74 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:23.546100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa8ec-f13e-447a-9e58-55a7bd89ae74 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:23.546631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa8ec-f13e-447a-9e58-55a7bd89ae74 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:23.550549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fa8ec-f13e-447a-9e58-55a7bd89ae74 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:23.553023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fa8ec-f13e-447a-9e58-55a7bd89ae74 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:23.554729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e01c3c-c419-4ed0-b0ba-31b692238627 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:23.565770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af28bd-3510-4014-ab3e-717020aa34fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:23.566653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af28bd-3510-4014-ab3e-717020aa34fe admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:23.566943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af28bd-3510-4014-ab3e-717020aa34fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:23.567306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af28bd-3510-4014-ab3e-717020aa34fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:23.567957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af28bd-3510-4014-ab3e-717020aa34fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:23.569567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af28bd-3510-4014-ab3e-717020aa34fe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:23.594868 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3577/7198] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:34:23 2022] POST /identity/v3/roles => generated 244 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:23.598354 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3622/7199] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:34:23.598354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af28bd-3510-4014-ab3e-717020aa34fe admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:23.601977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa8ec-f13e-447a-9e58-55a7bd89ae74 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:23.628439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af28bd-3510-4014-ab3e-717020aa34fe admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:23.633186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa8ec-f13e-447a-9e58-55a7bd89ae74 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:23.635271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad757416-e909-439a-86f2-232d81835b15 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:23.635895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad757416-e909-439a-86f2-232d81835b15 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:23.636177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad757416-e909-439a-86f2-232d81835b15 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:23.636620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad757416-e909-439a-86f2-232d81835b15 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:23.637298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad757416-e909-439a-86f2-232d81835b15 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:23.641457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad757416-e909-439a-86f2-232d81835b15 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:23.646072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f965d-26fe-419a-b946-109c3b57c697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:23.647672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f965d-26fe-419a-b946-109c3b57c697 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:23.648834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f965d-26fe-419a-b946-109c3b57c697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:23.650163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f965d-26fe-419a-b946-109c3b57c697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:23.652677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f965d-26fe-419a-b946-109c3b57c697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:23.657759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f965d-26fe-419a-b946-109c3b57c697 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:23.671318 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3623/7200] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:34:23 2022] POST /identity/v3/roles => generated 247 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:23.675895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad757416-e909-439a-86f2-232d81835b15 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:23.696329 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3578/7201] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:23 2022] GET /identity/v3/roles => generated 1893 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:23.697314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f965d-26fe-419a-b946-109c3b57c697 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:23.699801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad757416-e909-439a-86f2-232d81835b15 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:23.710593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f965d-26fe-419a-b946-109c3b57c697 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:23.715501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d65eee-1e66-4f97-879c-1ce7c204ae2b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:23.716183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d65eee-1e66-4f97-879c-1ce7c204ae2b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:23.716466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d65eee-1e66-4f97-879c-1ce7c204ae2b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:23.716743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d65eee-1e66-4f97-879c-1ce7c204ae2b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/74c6572d32fc49f5ad04d3cbaaa47180/users/8c6fb1ca25fd4ee0a382658019ff0347/roles/dc5892a2684544aeb1fa44881fd8deea` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:23.717794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f41fa-3fdb-43d3-9952-795dc75a91a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:23.718693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f41fa-3fdb-43d3-9952-795dc75a91a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:23.719326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f41fa-3fdb-43d3-9952-795dc75a91a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:23.719822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f41fa-3fdb-43d3-9952-795dc75a91a6 admin admin] PATH_INFO: `/v3/projects/717d512ff96843dc9481302b63c26463/users/b04d6c2b915946cab57cd9c7ceac9f4f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:23.731758 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:23.755383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d65eee-1e66-4f97-879c-1ce7c204ae2b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_grant(project_id=74c6572d32fc49f5ad04d3cbaaa47180, user_id=8c6fb1ca25fd4ee0a382658019ff0347, role_id=dc5892a2684544aeb1fa44881fd8deea)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:23.758428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d65eee-1e66-4f97-879c-1ce7c204ae2b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:23.761908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f41fa-3fdb-43d3-9952-795dc75a91a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717d512ff96843dc9481302b63c26463, user_id=b04d6c2b915946cab57cd9c7ceac9f4f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:23.766936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f41fa-3fdb-43d3-9952-795dc75a91a6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:23.786860 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3624/7202] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:23 2022] PUT /identity/v3/projects/74c6572d32fc49f5ad04d3cbaaa47180/users/8c6fb1ca25fd4ee0a382658019ff0347/roles/dc5892a2684544aeb1fa44881fd8deea => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:23.790900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d65eee-1e66-4f97-879c-1ce7c204ae2b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:23.800735 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3579/7203] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:23 2022] PUT /identity/v3/projects/717d512ff96843dc9481302b63c26463/users/b04d6c2b915946cab57cd9c7ceac9f4f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:23.811286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7386f45-a737-49a1-a240-6d1fae0e66bb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:23.811972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7386f45-a737-49a1-a240-6d1fae0e66bb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:23.811972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7386f45-a737-49a1-a240-6d1fae0e66bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:23.884437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f7386f45-a737-49a1-a240-6d1fae0e66bb None None] MFA Rules not processed for user `b04d6c2b915946cab57cd9c7ceac9f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:23.887035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f7386f45-a737-49a1-a240-6d1fae0e66bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:23.920459 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:23.921803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d65eee-1e66-4f97-879c-1ce7c204ae2b tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:24.041388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cf341-aee6-41a6-99a4-2baf2373b412 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:24.042134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cf341-aee6-41a6-99a4-2baf2373b412 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:24.042790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cf341-aee6-41a6-99a4-2baf2373b412 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:24.043256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cf341-aee6-41a6-99a4-2baf2373b412 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/74c6572d32fc49f5ad04d3cbaaa47180/users/8c6fb1ca25fd4ee0a382658019ff0347/roles/725935477d2e4ba684f13348a127d0e9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:24.046392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cf341-aee6-41a6-99a4-2baf2373b412 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_grant(project_id=74c6572d32fc49f5ad04d3cbaaa47180, user_id=8c6fb1ca25fd4ee0a382658019ff0347, role_id=725935477d2e4ba684f13348a127d0e9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:24.050192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cf341-aee6-41a6-99a4-2baf2373b412 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:24.057174 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3580/7204] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:24.061125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7386f45-a737-49a1-a240-6d1fae0e66bb None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:24.108506 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3625/7205] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:23 2022] PUT /identity/v3/projects/74c6572d32fc49f5ad04d3cbaaa47180/users/8c6fb1ca25fd4ee0a382658019ff0347/roles/725935477d2e4ba684f13348a127d0e9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:24.117296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cf341-aee6-41a6-99a4-2baf2373b412 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:24.203113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cf341-aee6-41a6-99a4-2baf2373b412 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:24.224948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25856bc-6438-4c8d-92bb-f0bff0c84402 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:24.225741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25856bc-6438-4c8d-92bb-f0bff0c84402 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:24.226120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25856bc-6438-4c8d-92bb-f0bff0c84402 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:24.226543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25856bc-6438-4c8d-92bb-f0bff0c84402 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:24.227347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25856bc-6438-4c8d-92bb-f0bff0c84402 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:24.230093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25856bc-6438-4c8d-92bb-f0bff0c84402 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:24.280743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7386f45-a737-49a1-a240-6d1fae0e66bb None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:24.396488 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3626/7206] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:24 2022] GET /identity/v3/users => generated 8051 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:34:24.402006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117b84c-4eee-4b75-b884-4296aafc75b1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:24.402305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117b84c-4eee-4b75-b884-4296aafc75b1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:24.402591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117b84c-4eee-4b75-b884-4296aafc75b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:24.477980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd808e54-94bf-4540-93cd-17b30d17807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:24.478867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd808e54-94bf-4540-93cd-17b30d17807e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:24.479174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd808e54-94bf-4540-93cd-17b30d17807e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:24.479447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd808e54-94bf-4540-93cd-17b30d17807e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:24.483126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd808e54-94bf-4540-93cd-17b30d17807e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:24.490233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd808e54-94bf-4540-93cd-17b30d17807e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:24.540362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c117b84c-4eee-4b75-b884-4296aafc75b1 None None] MFA Rules not processed for user `8c6fb1ca25fd4ee0a382658019ff0347`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:24.551747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c117b84c-4eee-4b75-b884-4296aafc75b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:24.573492 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:24.594783 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3581/7207] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:24 2022] POST /identity/v3/projects => generated 383 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:24.596638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd808e54-94bf-4540-93cd-17b30d17807e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:24.699234 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3627/7208] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:24 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:24.711039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2347df-a92a-4b44-b43c-4575997ef2dd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:24.711468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2347df-a92a-4b44-b43c-4575997ef2dd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:24.711957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2347df-a92a-4b44-b43c-4575997ef2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:24.714145 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:24.739333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd808e54-94bf-4540-93cd-17b30d17807e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:24.744931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ee2347df-a92a-4b44-b43c-4575997ef2dd None None] MFA Rules not processed for user `8c6fb1ca25fd4ee0a382658019ff0347`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:24.746389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ee2347df-a92a-4b44-b43c-4575997ef2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:24.756599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1fe30-d1c6-497b-8e93-357cb07e972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:24.758741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1fe30-d1c6-497b-8e93-357cb07e972c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:24.759225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1fe30-d1c6-497b-8e93-357cb07e972c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:24.760574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1fe30-d1c6-497b-8e93-357cb07e972c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:24.762807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1fe30-d1c6-497b-8e93-357cb07e972c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:24.765362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1fe30-d1c6-497b-8e93-357cb07e972c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:24.802585 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3582/7209] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:24 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:24.803774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1fe30-d1c6-497b-8e93-357cb07e972c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:24.833642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1fe30-d1c6-497b-8e93-357cb07e972c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:24.846355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fffc3-9142-4238-8549-0c8b183f0877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:24.847248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fffc3-9142-4238-8549-0c8b183f0877 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:24.847703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fffc3-9142-4238-8549-0c8b183f0877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:24.848284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fffc3-9142-4238-8549-0c8b183f0877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:24.849096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fffc3-9142-4238-8549-0c8b183f0877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:24.851816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fffc3-9142-4238-8549-0c8b183f0877 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:24.889382 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3583/7210] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:24 2022] GET /identity/v3/roles => generated 1893 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:24.891273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fffc3-9142-4238-8549-0c8b183f0877 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:24.910212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fffc3-9142-4238-8549-0c8b183f0877 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:24.916426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf78c15-2ca2-49d7-adc5-9d39329590d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:24.916690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf78c15-2ca2-49d7-adc5-9d39329590d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:24.917026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf78c15-2ca2-49d7-adc5-9d39329590d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:24.917262 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3628/7211] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:24 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:34:24.917399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf78c15-2ca2-49d7-adc5-9d39329590d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:24.918257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2347df-a92a-4b44-b43c-4575997ef2dd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:24.919034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf78c15-2ca2-49d7-adc5-9d39329590d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:24.920645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf78c15-2ca2-49d7-adc5-9d39329590d3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:24.958519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2347df-a92a-4b44-b43c-4575997ef2dd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:24.962288 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3584/7212] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:24 2022] GET /identity/v3/roles => generated 1893 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:24.964748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf78c15-2ca2-49d7-adc5-9d39329590d3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:24.989369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9530e-cc2f-4de8-96cd-b95086f212dc tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c6fb1ca25fd4ee0a382658019ff0347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c6572d32fc49f5ad04d3cbaaa47180', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1024878626', 'tempest-DelegatedRole-1077235928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:24.990002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9530e-cc2f-4de8-96cd-b95086f212dc tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:24.990276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9530e-cc2f-4de8-96cd-b95086f212dc tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:24.990544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9530e-cc2f-4de8-96cd-b95086f212dc tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:24.991239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9530e-cc2f-4de8-96cd-b95086f212dc tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorizing `identity:create_trust()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:24.992383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9530e-cc2f-4de8-96cd-b95086f212dc tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:24.993495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf78c15-2ca2-49d7-adc5-9d39329590d3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:25.010189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009388bd-4b70-42ee-a147-d9f82bc59ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:25.011082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009388bd-4b70-42ee-a147-d9f82bc59ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:25.011464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009388bd-4b70-42ee-a147-d9f82bc59ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:25.011902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009388bd-4b70-42ee-a147-d9f82bc59ad5 admin admin] PATH_INFO: `/v3/projects/0901e2e12cda4feda7568f48c611f6e4/users/0afe58a5cc4343df982b7b99f25827e7/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:25.063862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009388bd-4b70-42ee-a147-d9f82bc59ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0901e2e12cda4feda7568f48c611f6e4, user_id=0afe58a5cc4343df982b7b99f25827e7, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:25.068985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009388bd-4b70-42ee-a147-d9f82bc59ad5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:25.099531 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3585/7213] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:24 2022] PUT /identity/v3/projects/0901e2e12cda4feda7568f48c611f6e4/users/0afe58a5cc4343df982b7b99f25827e7/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:25.100639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009388bd-4b70-42ee-a147-d9f82bc59ad5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:25.106629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-009388bd-4b70-42ee-a147-d9f82bc59ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:25.202035 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3629/7214] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Oct 16 01:34:24 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:25.210494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc412fc1-e76f-47bd-963c-6dcc97814c1e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:25.210810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc412fc1-e76f-47bd-963c-6dcc97814c1e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:25.211084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc412fc1-e76f-47bd-963c-6dcc97814c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:25.264996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009388bd-4b70-42ee-a147-d9f82bc59ad5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:25.271496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dc412fc1-e76f-47bd-963c-6dcc97814c1e None None] MFA Rules not processed for user `0afe58a5cc4343df982b7b99f25827e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:25.272770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dc412fc1-e76f-47bd-963c-6dcc97814c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:25.276973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692a91-4e35-448b-8bb0-d82fbc5f4d1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:25.277794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692a91-4e35-448b-8bb0-d82fbc5f4d1f service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:25.279481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692a91-4e35-448b-8bb0-d82fbc5f4d1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:25.280014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692a91-4e35-448b-8bb0-d82fbc5f4d1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:25.286208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a2692a91-4e35-448b-8bb0-d82fbc5f4d1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:25.346501 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:25.439278 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3630/7215] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:25.439278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc412fc1-e76f-47bd-963c-6dcc97814c1e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:25.494546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2692a91-4e35-448b-8bb0-d82fbc5f4d1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:25.496562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2692a91-4e35-448b-8bb0-d82fbc5f4d1f service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:25.513373 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3586/7216] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:25.514944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692a91-4e35-448b-8bb0-d82fbc5f4d1f service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:25.598722 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:25.619463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc412fc1-e76f-47bd-963c-6dcc97814c1e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:25.626028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686b6b2-c393-4f54-adf7-51c8650ac09d tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c6fb1ca25fd4ee0a382658019ff0347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c6572d32fc49f5ad04d3cbaaa47180', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1024878626', 'tempest-DelegatedRole-1077235928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:25.626987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686b6b2-c393-4f54-adf7-51c8650ac09d tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:25.627275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686b6b2-c393-4f54-adf7-51c8650ac09d tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:25.627553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686b6b2-c393-4f54-adf7-51c8650ac09d tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] PATH_INFO: `/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:25.642279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686b6b2-c393-4f54-adf7-51c8650ac09d tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorizing `identity:get_trust(trust_id=0ff2fe81e36d45bb8e1a0418fba82fcb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:25.645566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686b6b2-c393-4f54-adf7-51c8650ac09d tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:25.659231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692a91-4e35-448b-8bb0-d82fbc5f4d1f service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:25.665253 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3631/7217] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:34:25 2022] GET /identity/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb => generated 834 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:25.668802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7805cf7-bdef-4e70-bb58-2fc7a61a971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:25.670892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686b6b2-c393-4f54-adf7-51c8650ac09d tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:25.673793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7805cf7-bdef-4e70-bb58-2fc7a61a971e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:25.674141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7805cf7-bdef-4e70-bb58-2fc7a61a971e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:25.674415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7805cf7-bdef-4e70-bb58-2fc7a61a971e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:25.675097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7805cf7-bdef-4e70-bb58-2fc7a61a971e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:25.681770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7805cf7-bdef-4e70-bb58-2fc7a61a971e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:25.691005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686b6b2-c393-4f54-adf7-51c8650ac09d tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:25.701513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ffdd1-bf06-4913-be24-c4da4fac71b1 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c6fb1ca25fd4ee0a382658019ff0347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c6572d32fc49f5ad04d3cbaaa47180', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1024878626', 'tempest-DelegatedRole-1077235928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:25.702276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ffdd1-bf06-4913-be24-c4da4fac71b1 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:25.702559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ffdd1-bf06-4913-be24-c4da4fac71b1 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:25.704606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ffdd1-bf06-4913-be24-c4da4fac71b1 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] PATH_INFO: `/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:25.717137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ffdd1-bf06-4913-be24-c4da4fac71b1 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=0ff2fe81e36d45bb8e1a0418fba82fcb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:25.719463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ffdd1-bf06-4913-be24-c4da4fac71b1 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:25.743886 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3587/7218] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:25 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:25.744140 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3632/7219] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:34:25 2022] GET /identity/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb/roles => generated 371 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:25.745199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7805cf7-bdef-4e70-bb58-2fc7a61a971e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:25.746211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ffdd1-bf06-4913-be24-c4da4fac71b1 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:25.769533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ffdd1-bf06-4913-be24-c4da4fac71b1 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:25.899131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5c257-d4c8-469c-82aa-b6f1c8d6a284 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c6fb1ca25fd4ee0a382658019ff0347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c6572d32fc49f5ad04d3cbaaa47180', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1024878626', 'tempest-DelegatedRole-1077235928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:25.899700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5c257-d4c8-469c-82aa-b6f1c8d6a284 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:25.900532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5c257-d4c8-469c-82aa-b6f1c8d6a284 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:25.901472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5c257-d4c8-469c-82aa-b6f1c8d6a284 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] PATH_INFO: `/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb/roles/dc5892a2684544aeb1fa44881fd8deea` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:25.909052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5c257-d4c8-469c-82aa-b6f1c8d6a284 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0ff2fe81e36d45bb8e1a0418fba82fcb, role_id=dc5892a2684544aeb1fa44881fd8deea)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:25.910727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5c257-d4c8-469c-82aa-b6f1c8d6a284 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:25.924186 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3633/7220] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Oct 16 01:34:25 2022] GET /identity/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb/roles/dc5892a2684544aeb1fa44881fd8deea => generated 244 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:25.926221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5c257-d4c8-469c-82aa-b6f1c8d6a284 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:25.946498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7805cf7-bdef-4e70-bb58-2fc7a61a971e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:25.958082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5c257-d4c8-469c-82aa-b6f1c8d6a284 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:25.959376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59556-348e-4758-941e-a1682b2c7720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:25.960005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59556-348e-4758-941e-a1682b2c7720 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:25.960279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59556-348e-4758-941e-a1682b2c7720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:25.960551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59556-348e-4758-941e-a1682b2c7720 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:25.961713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee59556-348e-4758-941e-a1682b2c7720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:25.965139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee59556-348e-4758-941e-a1682b2c7720 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:25.969980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c4843-745a-4bb7-98a2-bdcce83e0265 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c6fb1ca25fd4ee0a382658019ff0347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c6572d32fc49f5ad04d3cbaaa47180', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1024878626', 'tempest-DelegatedRole-1077235928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:25.971095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c4843-745a-4bb7-98a2-bdcce83e0265 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] REQUEST_METHOD: `HEAD` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:25.971385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c4843-745a-4bb7-98a2-bdcce83e0265 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:25.971673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c4843-745a-4bb7-98a2-bdcce83e0265 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] PATH_INFO: `/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb/roles/dc5892a2684544aeb1fa44881fd8deea` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:25.988905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c4843-745a-4bb7-98a2-bdcce83e0265 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0ff2fe81e36d45bb8e1a0418fba82fcb, role_id=dc5892a2684544aeb1fa44881fd8deea)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:25.990377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c4843-745a-4bb7-98a2-bdcce83e0265 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:26.024326 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3634/7221] 10.222.0.39 () {58 vars in 1369 bytes} [Sun Oct 16 01:34:25 2022] HEAD /identity/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb/roles/dc5892a2684544aeb1fa44881fd8deea => generated 0 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 16 01:34:26.025480 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3588/7222] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:25 2022] POST /identity/v3/users => generated 299 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:26.030420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c4843-745a-4bb7-98a2-bdcce83e0265 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:26.039204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59556-348e-4758-941e-a1682b2c7720 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:26.066053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c4843-745a-4bb7-98a2-bdcce83e0265 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:26.096627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59556-348e-4758-941e-a1682b2c7720 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:26.100563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee699bb-a4a6-4008-af34-00116a7ea97b tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c6fb1ca25fd4ee0a382658019ff0347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c6572d32fc49f5ad04d3cbaaa47180', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1024878626', 'tempest-DelegatedRole-1077235928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:26.101246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee699bb-a4a6-4008-af34-00116a7ea97b tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:26.101525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee699bb-a4a6-4008-af34-00116a7ea97b tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:26.101793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee699bb-a4a6-4008-af34-00116a7ea97b tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] PATH_INFO: `/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb/roles/725935477d2e4ba684f13348a127d0e9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:26.107516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003b18e-3696-47d4-82c1-8e3e81ec6c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:26.109472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003b18e-3696-47d4-82c1-8e3e81ec6c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:26.110050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003b18e-3696-47d4-82c1-8e3e81ec6c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:26.110620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003b18e-3696-47d4-82c1-8e3e81ec6c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:26.111674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003b18e-3696-47d4-82c1-8e3e81ec6c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:26.113045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee699bb-a4a6-4008-af34-00116a7ea97b tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0ff2fe81e36d45bb8e1a0418fba82fcb, role_id=725935477d2e4ba684f13348a127d0e9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:26.114395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003b18e-3696-47d4-82c1-8e3e81ec6c6e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:26.114710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee699bb-a4a6-4008-af34-00116a7ea97b tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-dee699bb-a4a6-4008-af34-00116a7ea97b tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Could not find role: 725935477d2e4ba684f13348a127d0e9.: keystone.exception.RoleNotFound: Could not find role: 725935477d2e4ba684f13348a127d0e9. Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 01:34:26.134982 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 725935477d2e4ba684f13348a127d0e9. Oct 16 01:34:26.136265 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:26.136265 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3635/7223] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Oct 16 01:34:26 2022] GET /identity/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb/roles/725935477d2e4ba684f13348a127d0e9 => generated 110 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:34:26.141622 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3589/7224] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:26 2022] GET /identity/v3/roles => generated 1893 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:26.144493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee699bb-a4a6-4008-af34-00116a7ea97b tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:26.148499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003b18e-3696-47d4-82c1-8e3e81ec6c6e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:26.161671 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:26.165118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003b18e-3696-47d4-82c1-8e3e81ec6c6e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:26.169754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee699bb-a4a6-4008-af34-00116a7ea97b tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:26.174707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89db3ae-29a2-4822-baef-83095a289994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:26.176755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89db3ae-29a2-4822-baef-83095a289994 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:26.177626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89db3ae-29a2-4822-baef-83095a289994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:26.178340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f587a23-1c76-4c37-a6b6-6b2dd2f37a99 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c6fb1ca25fd4ee0a382658019ff0347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c6572d32fc49f5ad04d3cbaaa47180', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1024878626', 'tempest-DelegatedRole-1077235928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:26.179069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89db3ae-29a2-4822-baef-83095a289994 admin admin] PATH_INFO: `/v3/projects/5ca80bb39bd34c08bc3a1d40d8ede3cd/users/bb4b3c86e3e0407f9f4a5924c9ff8610/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:26.179939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f587a23-1c76-4c37-a6b6-6b2dd2f37a99 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] REQUEST_METHOD: `HEAD` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:26.181742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f587a23-1c76-4c37-a6b6-6b2dd2f37a99 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:26.182439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f587a23-1c76-4c37-a6b6-6b2dd2f37a99 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] PATH_INFO: `/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb/roles/725935477d2e4ba684f13348a127d0e9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:26.207944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89db3ae-29a2-4822-baef-83095a289994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca80bb39bd34c08bc3a1d40d8ede3cd, user_id=bb4b3c86e3e0407f9f4a5924c9ff8610, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:26.211566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89db3ae-29a2-4822-baef-83095a289994 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:26.221110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f587a23-1c76-4c37-a6b6-6b2dd2f37a99 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0ff2fe81e36d45bb8e1a0418fba82fcb, role_id=725935477d2e4ba684f13348a127d0e9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:26.222689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f587a23-1c76-4c37-a6b6-6b2dd2f37a99 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:26.244756 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3590/7225] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:26 2022] PUT /identity/v3/projects/5ca80bb39bd34c08bc3a1d40d8ede3cd/users/bb4b3c86e3e0407f9f4a5924c9ff8610/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:26.249218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89db3ae-29a2-4822-baef-83095a289994 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-4f587a23-1c76-4c37-a6b6-6b2dd2f37a99 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Could not find role: 725935477d2e4ba684f13348a127d0e9.: keystone.exception.RoleNotFound: Could not find role: 725935477d2e4ba684f13348a127d0e9. Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 01:34:26.254975 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 725935477d2e4ba684f13348a127d0e9. Oct 16 01:34:26.256172 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:26.260673 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3636/7226] 10.222.0.39 () {58 vars in 1369 bytes} [Sun Oct 16 01:34:26 2022] HEAD /identity/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb/roles/725935477d2e4ba684f13348a127d0e9 => generated 0 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:34:26.263951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f587a23-1c76-4c37-a6b6-6b2dd2f37a99 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:26.281148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f587a23-1c76-4c37-a6b6-6b2dd2f37a99 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:26.365918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5834f67-c778-42e9-b992-df53d8deeb58 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c6fb1ca25fd4ee0a382658019ff0347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c6572d32fc49f5ad04d3cbaaa47180', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1024878626', 'tempest-DelegatedRole-1077235928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:26.366690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834f67-c778-42e9-b992-df53d8deeb58 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:26.367043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834f67-c778-42e9-b992-df53d8deeb58 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:26.367455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834f67-c778-42e9-b992-df53d8deeb58 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] PATH_INFO: `/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:26.374112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5834f67-c778-42e9-b992-df53d8deeb58 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorizing `identity:delete_trust(trust_id=0ff2fe81e36d45bb8e1a0418fba82fcb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:26.378339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5834f67-c778-42e9-b992-df53d8deeb58 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:26.461538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5834f67-c778-42e9-b992-df53d8deeb58 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '0ff2fe81e36d45bb8e1a0418fba82fcb', 'request_id': 'req-b5834f67-c778-42e9-b992-df53d8deeb58'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:26.462371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5834f67-c778-42e9-b992-df53d8deeb58 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '0ff2fe81e36d45bb8e1a0418fba82fcb', 'request_id': 'req-b5834f67-c778-42e9-b992-df53d8deeb58'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:26.464884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5834f67-c778-42e9-b992-df53d8deeb58 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '0ff2fe81e36d45bb8e1a0418fba82fcb', 'request_id': 'req-b5834f67-c778-42e9-b992-df53d8deeb58'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:26.499421 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3637/7227] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Oct 16 01:34:26 2022] DELETE /identity/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:26.504036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89db3ae-29a2-4822-baef-83095a289994 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:26.504244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5834f67-c778-42e9-b992-df53d8deeb58 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:26.505815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b5834f67-c778-42e9-b992-df53d8deeb58 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:26.517262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a591e5-3590-4260-83f4-cdc3aa4cdadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:26.517886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a591e5-3590-4260-83f4-cdc3aa4cdadf admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:26.518156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a591e5-3590-4260-83f4-cdc3aa4cdadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:26.518428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a591e5-3590-4260-83f4-cdc3aa4cdadf admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:26.519171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a591e5-3590-4260-83f4-cdc3aa4cdadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:26.520787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a591e5-3590-4260-83f4-cdc3aa4cdadf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:26.524932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5834f67-c778-42e9-b992-df53d8deeb58 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:26.531727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3df03-2628-4e5f-a17d-54fe7477f248 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c6fb1ca25fd4ee0a382658019ff0347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c6572d32fc49f5ad04d3cbaaa47180', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1024878626', 'tempest-DelegatedRole-1077235928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:26.533749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3df03-2628-4e5f-a17d-54fe7477f248 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:26.534190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3df03-2628-4e5f-a17d-54fe7477f248 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:26.534582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3df03-2628-4e5f-a17d-54fe7477f248 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] PATH_INFO: `/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:26.556003 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3591/7228] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:26 2022] GET /identity/v3/roles => generated 1893 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:26.557238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a591e5-3590-4260-83f4-cdc3aa4cdadf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:26.565896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b9a591e5-3590-4260-83f4-cdc3aa4cdadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-81c3df03-2628-4e5f-a17d-54fe7477f248 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Could not find trust: 0ff2fe81e36d45bb8e1a0418fba82fcb.: keystone.exception.TrustNotFound: Could not find trust: 0ff2fe81e36d45bb8e1a0418fba82fcb. Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 16 01:34:26.586083 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 16 01:34:26.587308 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 16 01:34:26.587308 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 16 01:34:26.587308 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 16 01:34:26.587308 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 16 01:34:26.587308 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 16 01:34:26.587308 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:26.587308 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:26.587308 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 16 01:34:26.587308 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 16 01:34:26.587308 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 16 01:34:26.587308 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 16 01:34:26.587308 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 0ff2fe81e36d45bb8e1a0418fba82fcb. Oct 16 01:34:26.587308 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:26.598524 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3638/7229] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:34:26 2022] GET /identity/v3/OS-TRUST/trusts/0ff2fe81e36d45bb8e1a0418fba82fcb => generated 111 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 16 01:34:26.603206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a591e5-3590-4260-83f4-cdc3aa4cdadf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:26.604489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3df03-2628-4e5f-a17d-54fe7477f248 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:26.611816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-81c3df03-2628-4e5f-a17d-54fe7477f248 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:26.615611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd45bc-717b-4148-b5a5-2d3d6427ca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:26.616544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd45bc-717b-4148-b5a5-2d3d6427ca0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:26.616544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd45bc-717b-4148-b5a5-2d3d6427ca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:26.616808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd45bc-717b-4148-b5a5-2d3d6427ca0a admin admin] PATH_INFO: `/v3/projects/5ca80bb39bd34c08bc3a1d40d8ede3cd/users/bb4b3c86e3e0407f9f4a5924c9ff8610/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:26.644781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd45bc-717b-4148-b5a5-2d3d6427ca0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca80bb39bd34c08bc3a1d40d8ede3cd, user_id=bb4b3c86e3e0407f9f4a5924c9ff8610, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:26.658327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd45bc-717b-4148-b5a5-2d3d6427ca0a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:26.710713 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3592/7230] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:26 2022] PUT /identity/v3/projects/5ca80bb39bd34c08bc3a1d40d8ede3cd/users/bb4b3c86e3e0407f9f4a5924c9ff8610/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:26.721624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9510e84-a4f9-4a6b-977e-a53036b3f64a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:26.721923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9510e84-a4f9-4a6b-977e-a53036b3f64a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:26.722294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9510e84-a4f9-4a6b-977e-a53036b3f64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:26.739192 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:26.767658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d9510e84-a4f9-4a6b-977e-a53036b3f64a None None] MFA Rules not processed for user `bb4b3c86e3e0407f9f4a5924c9ff8610`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:26.769236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d9510e84-a4f9-4a6b-977e-a53036b3f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:26.797238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3df03-2628-4e5f-a17d-54fe7477f248 tempest-TrustsV3TestJSON-1141205801 tempest-user-497912105] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:26.869868 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:26.886560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede6d50-d171-481f-b56f-ff39b281498a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:26.889039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede6d50-d171-481f-b56f-ff39b281498a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:26.889323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede6d50-d171-481f-b56f-ff39b281498a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:26.889746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede6d50-d171-481f-b56f-ff39b281498a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles/725935477d2e4ba684f13348a127d0e9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:26.894764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede6d50-d171-481f-b56f-ff39b281498a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_role(role_id=725935477d2e4ba684f13348a127d0e9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:26.896401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede6d50-d171-481f-b56f-ff39b281498a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:26.967157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6ede6d50-d171-481f-b56f-ff39b281498a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invalidating the token cache because role 725935477d2e4ba684f13348a127d0e9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:26.967496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6ede6d50-d171-481f-b56f-ff39b281498a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:26.968134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6ede6d50-d171-481f-b56f-ff39b281498a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:26.975576 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3639/7231] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:26 2022] DELETE /identity/v3/roles/725935477d2e4ba684f13348a127d0e9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:26.976994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede6d50-d171-481f-b56f-ff39b281498a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:26.979243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6ede6d50-d171-481f-b56f-ff39b281498a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:26.989306 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3593/7232] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:34:27.007756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9510e84-a4f9-4a6b-977e-a53036b3f64a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:27.010090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d9510e84-a4f9-4a6b-977e-a53036b3f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:27.094457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9510e84-a4f9-4a6b-977e-a53036b3f64a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:27.165106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede6d50-d171-481f-b56f-ff39b281498a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:27.174579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad003a5b-5d50-43f8-ad42-efa3c6ea75b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:27.175684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad003a5b-5d50-43f8-ad42-efa3c6ea75b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:27.176121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad003a5b-5d50-43f8-ad42-efa3c6ea75b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:27.176398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605d54-426a-47bf-bd6b-3c92490576bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:27.177199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605d54-426a-47bf-bd6b-3c92490576bf service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:27.177544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad003a5b-5d50-43f8-ad42-efa3c6ea75b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles/dc5892a2684544aeb1fa44881fd8deea` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:27.177689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605d54-426a-47bf-bd6b-3c92490576bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:27.178047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605d54-426a-47bf-bd6b-3c92490576bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:27.179472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad003a5b-5d50-43f8-ad42-efa3c6ea75b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dc5892a2684544aeb1fa44881fd8deea)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:27.180136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b6605d54-426a-47bf-bd6b-3c92490576bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:27.183951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad003a5b-5d50-43f8-ad42-efa3c6ea75b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:27.261111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ad003a5b-5d50-43f8-ad42-efa3c6ea75b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invalidating the token cache because role dc5892a2684544aeb1fa44881fd8deea has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:27.261493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ad003a5b-5d50-43f8-ad42-efa3c6ea75b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:27.262373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ad003a5b-5d50-43f8-ad42-efa3c6ea75b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:27.271161 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3640/7233] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:26 2022] DELETE /identity/v3/roles/dc5892a2684544aeb1fa44881fd8deea => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:27.272815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad003a5b-5d50-43f8-ad42-efa3c6ea75b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:27.277078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ad003a5b-5d50-43f8-ad42-efa3c6ea75b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:27.333230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6605d54-426a-47bf-bd6b-3c92490576bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:27.335906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6605d54-426a-47bf-bd6b-3c92490576bf service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:27.379392 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3594/7234] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:27.484304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad003a5b-5d50-43f8-ad42-efa3c6ea75b5 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:27.499619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:27.501821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:27.503306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:27.503812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users/8c6fb1ca25fd4ee0a382658019ff0347` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:27.506203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8c6fb1ca25fd4ee0a382658019ff0347)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:27.511079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:27.635224 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:27.675848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6fb1ca25fd4ee0a382658019ff0347'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:27.677993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6fb1ca25fd4ee0a382658019ff0347'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:27.718350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6fb1ca25fd4ee0a382658019ff0347'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:27.749403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6fb1ca25fd4ee0a382658019ff0347'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:27.753062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6fb1ca25fd4ee0a382658019ff0347'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:27.806379 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3641/7235] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:27 2022] DELETE /identity/v3/users/8c6fb1ca25fd4ee0a382658019ff0347 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:27.807176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605d54-426a-47bf-bd6b-3c92490576bf service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:27.811210 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:27.840714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605d54-426a-47bf-bd6b-3c92490576bf service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:28.059913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:28.060634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:28.060863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:28.061134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/74c6572d32fc49f5ad04d3cbaaa47180` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:28.062773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_project(project_id=74c6572d32fc49f5ad04d3cbaaa47180)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:28.064788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:28.197610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c6572d32fc49f5ad04d3cbaaa47180', 'request_id': 'req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:28.208802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c6572d32fc49f5ad04d3cbaaa47180', 'request_id': 'req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:28.226377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c6572d32fc49f5ad04d3cbaaa47180', 'request_id': 'req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:28.252954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] The token cache is being invalidate because project 74c6572d32fc49f5ad04d3cbaaa47180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:28.255209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:28.257485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:28.269590 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3595/7236] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:27 2022] DELETE /identity/v3/projects/74c6572d32fc49f5ad04d3cbaaa47180 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:28.270699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:28.276493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:28.308953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0663701-d9eb-479c-a219-6656574ee275 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:28.477420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8d354-f84c-463e-b5de-a06fc2c13f1e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:28.478048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d354-f84c-463e-b5de-a06fc2c13f1e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:28.478337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d354-f84c-463e-b5de-a06fc2c13f1e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:28.478615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d354-f84c-463e-b5de-a06fc2c13f1e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:28.479279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8d354-f84c-463e-b5de-a06fc2c13f1e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:28.482004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8d354-f84c-463e-b5de-a06fc2c13f1e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:28.569813 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3642/7237] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:34:28 2022] POST /identity/v3/projects => generated 328 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:28.574787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:28.577065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:28.597672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef1d3d-091f-4ec9-922d-3b6aa119529a tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:28.729113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf4a80-66e4-483f-84d5-8c7bc4c012d2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:28.733254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf4a80-66e4-483f-84d5-8c7bc4c012d2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:28.736920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf4a80-66e4-483f-84d5-8c7bc4c012d2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:28.737518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf4a80-66e4-483f-84d5-8c7bc4c012d2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:28.739303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf4a80-66e4-483f-84d5-8c7bc4c012d2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:28.742682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf4a80-66e4-483f-84d5-8c7bc4c012d2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:28.793640 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3596/7238] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:28 2022] POST /identity/v3/users => generated 410 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:28.795094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8d354-f84c-463e-b5de-a06fc2c13f1e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:28.810035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8d354-f84c-463e-b5de-a06fc2c13f1e tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:28.821796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9c627-1ad0-4fdc-881a-71fe58baf984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:28.822869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9c627-1ad0-4fdc-881a-71fe58baf984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:28.823456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9c627-1ad0-4fdc-881a-71fe58baf984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:28.823983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9c627-1ad0-4fdc-881a-71fe58baf984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:28.824902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9c627-1ad0-4fdc-881a-71fe58baf984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:28.827056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9c627-1ad0-4fdc-881a-71fe58baf984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:28.861723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf4a80-66e4-483f-84d5-8c7bc4c012d2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:28.869317 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3643/7239] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:34:28 2022] POST /identity/v3/roles => generated 244 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:28.874414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf4a80-66e4-483f-84d5-8c7bc4c012d2 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:28.881762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a1c00-146a-4bf5-be62-43489164d7ae tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:28.882716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a1c00-146a-4bf5-be62-43489164d7ae tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:28.883315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a1c00-146a-4bf5-be62-43489164d7ae tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:28.883963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a1c00-146a-4bf5-be62-43489164d7ae tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:28.885926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a1c00-146a-4bf5-be62-43489164d7ae tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:28.887858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a1c00-146a-4bf5-be62-43489164d7ae tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:28.946557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9c627-1ad0-4fdc-881a-71fe58baf984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:28.952508 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3597/7240] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Oct 16 01:34:28 2022] POST /identity/v3/roles => generated 246 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:28.961955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9c627-1ad0-4fdc-881a-71fe58baf984 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:28.982212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729c83a-010b-4b66-b72f-1623992c16f7 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:28.984046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729c83a-010b-4b66-b72f-1623992c16f7 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:28.987360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729c83a-010b-4b66-b72f-1623992c16f7 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:28.991176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729c83a-010b-4b66-b72f-1623992c16f7 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/fef47e050e544fe7bb5486eea0accae7/users/acc5a3928a644a3490f6f3e2db90190d/roles/6a47ce3cb86a47208100e786d950099d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:29.088123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729c83a-010b-4b66-b72f-1623992c16f7 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fef47e050e544fe7bb5486eea0accae7, user_id=acc5a3928a644a3490f6f3e2db90190d, role_id=6a47ce3cb86a47208100e786d950099d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:29.110435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729c83a-010b-4b66-b72f-1623992c16f7 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:29.156865 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3644/7241] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:28 2022] PUT /identity/v3/projects/fef47e050e544fe7bb5486eea0accae7/users/acc5a3928a644a3490f6f3e2db90190d/roles/6a47ce3cb86a47208100e786d950099d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:29.158169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a1c00-146a-4bf5-be62-43489164d7ae tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:29.177869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a1c00-146a-4bf5-be62-43489164d7ae tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:29.197399 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:29.408316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee18a5e-db3f-4042-b280-d8eaf9f70063 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:29.409218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18a5e-db3f-4042-b280-d8eaf9f70063 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:29.409709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18a5e-db3f-4042-b280-d8eaf9f70063 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:29.409964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18a5e-db3f-4042-b280-d8eaf9f70063 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/fef47e050e544fe7bb5486eea0accae7/users/acc5a3928a644a3490f6f3e2db90190d/roles/5981f43a75a54a739f325a80baf11577` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:29.427906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee18a5e-db3f-4042-b280-d8eaf9f70063 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fef47e050e544fe7bb5486eea0accae7, user_id=acc5a3928a644a3490f6f3e2db90190d, role_id=5981f43a75a54a739f325a80baf11577)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:29.431108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee18a5e-db3f-4042-b280-d8eaf9f70063 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:29.472951 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3598/7242] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:29 2022] PUT /identity/v3/projects/fef47e050e544fe7bb5486eea0accae7/users/acc5a3928a644a3490f6f3e2db90190d/roles/5981f43a75a54a739f325a80baf11577 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:29.474274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729c83a-010b-4b66-b72f-1623992c16f7 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:29.494373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729c83a-010b-4b66-b72f-1623992c16f7 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:29.653143 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:29.671045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078c21a-7d29-4680-b57d-1c3a6a45cdf3 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:29.671638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c21a-7d29-4680-b57d-1c3a6a45cdf3 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:29.672478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c21a-7d29-4680-b57d-1c3a6a45cdf3 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:29.672756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c21a-7d29-4680-b57d-1c3a6a45cdf3 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:29.673426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078c21a-7d29-4680-b57d-1c3a6a45cdf3 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:29.675795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078c21a-7d29-4680-b57d-1c3a6a45cdf3 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:29.749189 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3645/7243] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:29 2022] GET /identity/v3/users => generated 8621 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:29.755481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db13f5-2bc4-44db-af64-4b07fba0a127 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:29.755481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db13f5-2bc4-44db-af64-4b07fba0a127 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:29.755481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db13f5-2bc4-44db-af64-4b07fba0a127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:29.830436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f4db13f5-2bc4-44db-af64-4b07fba0a127 None None] MFA Rules not processed for user `acc5a3928a644a3490f6f3e2db90190d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:29.831715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f4db13f5-2bc4-44db-af64-4b07fba0a127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:29.916769 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3599/7244] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:29 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:29.929253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813746-a618-4653-aa3f-b4a052f12ebb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:29.929808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813746-a618-4653-aa3f-b4a052f12ebb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:29.929808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813746-a618-4653-aa3f-b4a052f12ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:29.955270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-86813746-a618-4653-aa3f-b4a052f12ebb None None] MFA Rules not processed for user `acc5a3928a644a3490f6f3e2db90190d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:29.956494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-86813746-a618-4653-aa3f-b4a052f12ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:29.970655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db13f5-2bc4-44db-af64-4b07fba0a127 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:29.981085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db13f5-2bc4-44db-af64-4b07fba0a127 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:29.982031 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3646/7245] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:29 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:29.988639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5589ee-80fc-4638-be31-e1296b120240 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc5a3928a644a3490f6f3e2db90190d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fef47e050e544fe7bb5486eea0accae7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1850204303', 'tempest-NotDelegatedRole-588544370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:29.989269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5589ee-80fc-4638-be31-e1296b120240 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:29.989549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5589ee-80fc-4638-be31-e1296b120240 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:29.990593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5589ee-80fc-4638-be31-e1296b120240 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:29.991301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5589ee-80fc-4638-be31-e1296b120240 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorizing `identity:create_trust()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:29.993332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5589ee-80fc-4638-be31-e1296b120240 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:30.101601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813746-a618-4653-aa3f-b4a052f12ebb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:30.108132 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3600/7246] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Oct 16 01:34:29 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:30.115936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813746-a618-4653-aa3f-b4a052f12ebb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:30.123683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eb9e4-e67e-4339-9018-19733536fd6e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc5a3928a644a3490f6f3e2db90190d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fef47e050e544fe7bb5486eea0accae7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1850204303', 'tempest-NotDelegatedRole-588544370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:30.129442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eb9e4-e67e-4339-9018-19733536fd6e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:30.129442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eb9e4-e67e-4339-9018-19733536fd6e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:30.129442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eb9e4-e67e-4339-9018-19733536fd6e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] PATH_INFO: `/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:30.138774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6eb9e4-e67e-4339-9018-19733536fd6e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorizing `identity:get_trust(trust_id=813356e3c0f249a4bacb779c852a6dab)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:30.140448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6eb9e4-e67e-4339-9018-19733536fd6e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:30.168487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5589ee-80fc-4638-be31-e1296b120240 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:30.219512 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3647/7247] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:34:30 2022] GET /identity/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab => generated 835 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:34:30.241602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5589ee-80fc-4638-be31-e1296b120240 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:30.248968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200336f6-04e9-4461-a41c-edbf52a79bab tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc5a3928a644a3490f6f3e2db90190d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fef47e050e544fe7bb5486eea0accae7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1850204303', 'tempest-NotDelegatedRole-588544370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:30.252565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200336f6-04e9-4461-a41c-edbf52a79bab tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:30.252945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200336f6-04e9-4461-a41c-edbf52a79bab tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:30.253327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200336f6-04e9-4461-a41c-edbf52a79bab tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] PATH_INFO: `/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:30.285199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200336f6-04e9-4461-a41c-edbf52a79bab tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=813356e3c0f249a4bacb779c852a6dab)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:30.286795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200336f6-04e9-4461-a41c-edbf52a79bab tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:30.291945 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:30.306976 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3601/7248] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:34:30 2022] GET /identity/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab/roles => generated 371 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:30.310059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eb9e4-e67e-4339-9018-19733536fd6e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:30.325092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eb9e4-e67e-4339-9018-19733536fd6e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:30.330947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a58ba-3ba7-4606-9dbd-90a805edb34d tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc5a3928a644a3490f6f3e2db90190d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fef47e050e544fe7bb5486eea0accae7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1850204303', 'tempest-NotDelegatedRole-588544370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:30.332013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a58ba-3ba7-4606-9dbd-90a805edb34d tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:30.332528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a58ba-3ba7-4606-9dbd-90a805edb34d tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:30.333170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a58ba-3ba7-4606-9dbd-90a805edb34d tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] PATH_INFO: `/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab/roles/6a47ce3cb86a47208100e786d950099d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:30.341298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a58ba-3ba7-4606-9dbd-90a805edb34d tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorizing `identity:get_role_for_trust(trust_id=813356e3c0f249a4bacb779c852a6dab, role_id=6a47ce3cb86a47208100e786d950099d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:30.344026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a58ba-3ba7-4606-9dbd-90a805edb34d tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:30.354278 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3648/7249] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Oct 16 01:34:30 2022] GET /identity/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab/roles/6a47ce3cb86a47208100e786d950099d => generated 244 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:34:30.358544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200336f6-04e9-4461-a41c-edbf52a79bab tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:30.375515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200336f6-04e9-4461-a41c-edbf52a79bab tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:30.389202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f702062-1ebe-4185-8747-9843a279fe89 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc5a3928a644a3490f6f3e2db90190d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fef47e050e544fe7bb5486eea0accae7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1850204303', 'tempest-NotDelegatedRole-588544370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:30.392545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702062-1ebe-4185-8747-9843a279fe89 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] REQUEST_METHOD: `HEAD` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:30.392827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702062-1ebe-4185-8747-9843a279fe89 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:30.393109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702062-1ebe-4185-8747-9843a279fe89 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] PATH_INFO: `/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab/roles/6a47ce3cb86a47208100e786d950099d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:30.415802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f702062-1ebe-4185-8747-9843a279fe89 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorizing `identity:get_role_for_trust(trust_id=813356e3c0f249a4bacb779c852a6dab, role_id=6a47ce3cb86a47208100e786d950099d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:30.417281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f702062-1ebe-4185-8747-9843a279fe89 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:30.429419 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3602/7250] 10.222.0.39 () {58 vars in 1369 bytes} [Sun Oct 16 01:34:30 2022] HEAD /identity/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab/roles/6a47ce3cb86a47208100e786d950099d => generated 0 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 16 01:34:30.430838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a58ba-3ba7-4606-9dbd-90a805edb34d tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:30.452788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a58ba-3ba7-4606-9dbd-90a805edb34d tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:30.460102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a29917-a18b-4736-8f4a-821cc6f95a4e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc5a3928a644a3490f6f3e2db90190d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fef47e050e544fe7bb5486eea0accae7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1850204303', 'tempest-NotDelegatedRole-588544370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:30.461056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a29917-a18b-4736-8f4a-821cc6f95a4e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:30.461689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a29917-a18b-4736-8f4a-821cc6f95a4e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:30.462406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a29917-a18b-4736-8f4a-821cc6f95a4e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] PATH_INFO: `/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab/roles/5981f43a75a54a739f325a80baf11577` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:30.470397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a29917-a18b-4736-8f4a-821cc6f95a4e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorizing `identity:get_role_for_trust(trust_id=813356e3c0f249a4bacb779c852a6dab, role_id=5981f43a75a54a739f325a80baf11577)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:30.486506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a29917-a18b-4736-8f4a-821cc6f95a4e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-57a29917-a18b-4736-8f4a-821cc6f95a4e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Could not find role: 5981f43a75a54a739f325a80baf11577.: keystone.exception.RoleNotFound: Could not find role: 5981f43a75a54a739f325a80baf11577. Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 01:34:30.527978 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 5981f43a75a54a739f325a80baf11577. Oct 16 01:34:30.529177 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:30.534208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f702062-1ebe-4185-8747-9843a279fe89 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:30.541069 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3649/7251] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Oct 16 01:34:30 2022] GET /identity/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab/roles/5981f43a75a54a739f325a80baf11577 => generated 110 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:34:30.547251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f702062-1ebe-4185-8747-9843a279fe89 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:30.560470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8230b8-3eca-4a29-8073-72018c1106ae tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc5a3928a644a3490f6f3e2db90190d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fef47e050e544fe7bb5486eea0accae7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1850204303', 'tempest-NotDelegatedRole-588544370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:30.561233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8230b8-3eca-4a29-8073-72018c1106ae tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] REQUEST_METHOD: `HEAD` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:30.561587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8230b8-3eca-4a29-8073-72018c1106ae tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:30.561932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8230b8-3eca-4a29-8073-72018c1106ae tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] PATH_INFO: `/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab/roles/5981f43a75a54a739f325a80baf11577` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:30.580085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8230b8-3eca-4a29-8073-72018c1106ae tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorizing `identity:get_role_for_trust(trust_id=813356e3c0f249a4bacb779c852a6dab, role_id=5981f43a75a54a739f325a80baf11577)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:30.581631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8230b8-3eca-4a29-8073-72018c1106ae tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-bd8230b8-3eca-4a29-8073-72018c1106ae tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Could not find role: 5981f43a75a54a739f325a80baf11577.: keystone.exception.RoleNotFound: Could not find role: 5981f43a75a54a739f325a80baf11577. Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 01:34:30.603570 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 5981f43a75a54a739f325a80baf11577. Oct 16 01:34:30.604899 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:34:30.610658 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3603/7252] 10.222.0.39 () {58 vars in 1369 bytes} [Sun Oct 16 01:34:30 2022] HEAD /identity/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab/roles/5981f43a75a54a739f325a80baf11577 => generated 0 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 16 01:34:30.615603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a29917-a18b-4736-8f4a-821cc6f95a4e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:30.664989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a29917-a18b-4736-8f4a-821cc6f95a4e tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:30.696652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc5a3928a644a3490f6f3e2db90190d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fef47e050e544fe7bb5486eea0accae7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1850204303', 'tempest-NotDelegatedRole-588544370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:30.697323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:30.697587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:30.697865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] PATH_INFO: `/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:30.706402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorizing `identity:delete_trust(trust_id=813356e3c0f249a4bacb779c852a6dab)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:30.707896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:30.774679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '813356e3c0f249a4bacb779c852a6dab', 'request_id': 'req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:30.774679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '813356e3c0f249a4bacb779c852a6dab', 'request_id': 'req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:30.774679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '813356e3c0f249a4bacb779c852a6dab', 'request_id': 'req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:30.813184 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3650/7253] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Oct 16 01:34:30 2022] DELETE /identity/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:30.818754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8230b8-3eca-4a29-8073-72018c1106ae tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:30.820868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bd8230b8-3eca-4a29-8073-72018c1106ae tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:30.835920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8230b8-3eca-4a29-8073-72018c1106ae tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:30.840751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6428753-cad2-409e-8132-c5c341a451f7 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc5a3928a644a3490f6f3e2db90190d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fef47e050e544fe7bb5486eea0accae7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1850204303', 'tempest-NotDelegatedRole-588544370'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:30.841374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6428753-cad2-409e-8132-c5c341a451f7 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:30.841652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6428753-cad2-409e-8132-c5c341a451f7 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:30.841927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6428753-cad2-409e-8132-c5c341a451f7 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] PATH_INFO: `/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-a6428753-cad2-409e-8132-c5c341a451f7 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Could not find trust: 813356e3c0f249a4bacb779c852a6dab.: keystone.exception.TrustNotFound: Could not find trust: 813356e3c0f249a4bacb779c852a6dab. Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 16 01:34:30.853083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 813356e3c0f249a4bacb779c852a6dab. Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:34:30.854626 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3604/7254] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:34:30 2022] GET /identity/v3/OS-TRUST/trusts/813356e3c0f249a4bacb779c852a6dab => generated 111 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:34:30.860528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:30.865491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:30.886498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561e962-3c4f-4f77-b88e-cfdc1b2d1990 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:30.898675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49fd97-3935-41d3-9fdb-5cbd03b1a1d9 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:30.899285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49fd97-3935-41d3-9fdb-5cbd03b1a1d9 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:30.899568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49fd97-3935-41d3-9fdb-5cbd03b1a1d9 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:30.899976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49fd97-3935-41d3-9fdb-5cbd03b1a1d9 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles/5981f43a75a54a739f325a80baf11577` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:30.902979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49fd97-3935-41d3-9fdb-5cbd03b1a1d9 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5981f43a75a54a739f325a80baf11577)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:30.904589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49fd97-3935-41d3-9fdb-5cbd03b1a1d9 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:30.923843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6428753-cad2-409e-8132-c5c341a451f7 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:30.925581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a6428753-cad2-409e-8132-c5c341a451f7 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:31.027262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc49fd97-3935-41d3-9fdb-5cbd03b1a1d9 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invalidating the token cache because role 5981f43a75a54a739f325a80baf11577 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:31.028543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc49fd97-3935-41d3-9fdb-5cbd03b1a1d9 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.029471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-cc49fd97-3935-41d3-9fdb-5cbd03b1a1d9 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.032426 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3651/7255] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:30 2022] DELETE /identity/v3/roles/5981f43a75a54a739f325a80baf11577 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:31.036301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49fd97-3935-41d3-9fdb-5cbd03b1a1d9 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:31.038062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc49fd97-3935-41d3-9fdb-5cbd03b1a1d9 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:31.061160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6428753-cad2-409e-8132-c5c341a451f7 tempest-TrustsV3TestJSON-657448016 tempest-user-73231147] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:31.150327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729403e-fe73-479a-8556-f51ca8bc5ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:31.153596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729403e-fe73-479a-8556-f51ca8bc5ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:31.153891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729403e-fe73-479a-8556-f51ca8bc5ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:31.154117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729403e-fe73-479a-8556-f51ca8bc5ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:31.162143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1729403e-fe73-479a-8556-f51ca8bc5ad0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:31.178687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49fd97-3935-41d3-9fdb-5cbd03b1a1d9 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:31.202819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9b292-e801-4bbb-b209-9cbd6ad9da69 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:31.204611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9b292-e801-4bbb-b209-9cbd6ad9da69 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:31.205269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9b292-e801-4bbb-b209-9cbd6ad9da69 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:31.205872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9b292-e801-4bbb-b209-9cbd6ad9da69 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/roles/6a47ce3cb86a47208100e786d950099d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:31.207890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9b292-e801-4bbb-b209-9cbd6ad9da69 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6a47ce3cb86a47208100e786d950099d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:31.209890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9b292-e801-4bbb-b209-9cbd6ad9da69 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:31.237012 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:31.277755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3cb9b292-e801-4bbb-b209-9cbd6ad9da69 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invalidating the token cache because role 6a47ce3cb86a47208100e786d950099d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:31.278326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3cb9b292-e801-4bbb-b209-9cbd6ad9da69 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.280148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3cb9b292-e801-4bbb-b209-9cbd6ad9da69 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.290526 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3652/7256] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:31 2022] DELETE /identity/v3/roles/6a47ce3cb86a47208100e786d950099d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:31.294388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9b292-e801-4bbb-b209-9cbd6ad9da69 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:31.296646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3cb9b292-e801-4bbb-b209-9cbd6ad9da69 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:31.350277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729403e-fe73-479a-8556-f51ca8bc5ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:31.351767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729403e-fe73-479a-8556-f51ca8bc5ad0 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:31.386207 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3605/7257] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:31.398958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9b292-e801-4bbb-b209-9cbd6ad9da69 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:31.408448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:31.409936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:31.410506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:31.411368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/users/acc5a3928a644a3490f6f3e2db90190d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:31.412777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_user(user_id=acc5a3928a644a3490f6f3e2db90190d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:31.415096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:31.521462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc5a3928a644a3490f6f3e2db90190d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.525102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc5a3928a644a3490f6f3e2db90190d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.552312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc5a3928a644a3490f6f3e2db90190d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.567406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc5a3928a644a3490f6f3e2db90190d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.569274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc5a3928a644a3490f6f3e2db90190d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.600386 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3653/7258] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:31 2022] DELETE /identity/v3/users/acc5a3928a644a3490f6f3e2db90190d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:31.605181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729403e-fe73-479a-8556-f51ca8bc5ad0 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:31.637301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729403e-fe73-479a-8556-f51ca8bc5ad0 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:31.687005 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:31.783820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced8bb91f3f94876a9295c0101fea4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1330ed37916845a0ad3442a93345bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:31.784675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:31.785003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:31.785276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] PATH_INFO: `/v3/projects/fef47e050e544fe7bb5486eea0accae7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:31.786909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fef47e050e544fe7bb5486eea0accae7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:31.789728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:31.907872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef47e050e544fe7bb5486eea0accae7', 'request_id': 'req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.920937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef47e050e544fe7bb5486eea0accae7', 'request_id': 'req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.940900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef47e050e544fe7bb5486eea0accae7', 'request_id': 'req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.963560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] The token cache is being invalidate because project fef47e050e544fe7bb5486eea0accae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:31.965000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.966591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:31.974668 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3606/7259] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:31 2022] DELETE /identity/v3/projects/fef47e050e544fe7bb5486eea0accae7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:34:31.978963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:31.981613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:32.155372 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:32.173302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf67a02-f484-4b74-b177-7ec32eefdf82 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:32.305677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6799f6-bc1e-42f7-b0a5-c4ffcea9f247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:32.306844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6799f6-bc1e-42f7-b0a5-c4ffcea9f247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:32.307454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6799f6-bc1e-42f7-b0a5-c4ffcea9f247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:32.308467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6799f6-bc1e-42f7-b0a5-c4ffcea9f247 admin admin] PATH_INFO: `/v3/users/f37630bff21f4c359b75cd5e5c027d24` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:32.311098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6799f6-bc1e-42f7-b0a5-c4ffcea9f247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37630bff21f4c359b75cd5e5c027d24)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:32.319623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6799f6-bc1e-42f7-b0a5-c4ffcea9f247 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:32.530888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a6799f6-bc1e-42f7-b0a5-c4ffcea9f247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37630bff21f4c359b75cd5e5c027d24'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:32.532657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a6799f6-bc1e-42f7-b0a5-c4ffcea9f247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37630bff21f4c359b75cd5e5c027d24'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:32.599877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a6799f6-bc1e-42f7-b0a5-c4ffcea9f247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37630bff21f4c359b75cd5e5c027d24'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:32.613468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a6799f6-bc1e-42f7-b0a5-c4ffcea9f247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37630bff21f4c359b75cd5e5c027d24'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:32.625012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3a6799f6-bc1e-42f7-b0a5-c4ffcea9f247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37630bff21f4c359b75cd5e5c027d24'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:32.639509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:32.642450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:32.659946 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3654/7260] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:31 2022] DELETE /identity/v3/users/f37630bff21f4c359b75cd5e5c027d24 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:32.665612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5039372-ddec-4daf-8de0-52889f89e7bb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:32.665918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5039372-ddec-4daf-8de0-52889f89e7bb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:32.666171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5039372-ddec-4daf-8de0-52889f89e7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:32.710596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a5039372-ddec-4daf-8de0-52889f89e7bb None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:32.711851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a5039372-ddec-4daf-8de0-52889f89e7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:32.725090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137241-f990-4cfd-a0ff-fd6cfa1b0735 tempest-TrustsV3TestJSON-991436510 tempest-TrustsV3TestJSON-991436510-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:32.824076 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3655/7261] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:32.835061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5039372-ddec-4daf-8de0-52889f89e7bb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:32.837500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a5039372-ddec-4daf-8de0-52889f89e7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:32.860937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f408a-31db-4d1c-a5bd-34b221fcb3e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:32.862679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f408a-31db-4d1c-a5bd-34b221fcb3e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:32.863195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f408a-31db-4d1c-a5bd-34b221fcb3e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:32.863892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f408a-31db-4d1c-a5bd-34b221fcb3e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:32.868971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-614f408a-31db-4d1c-a5bd-34b221fcb3e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:32.896238 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:32.903246 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:32.962378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5039372-ddec-4daf-8de0-52889f89e7bb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:32.971436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490a3ba-a03b-4cfe-af64-a2523d2c2ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:32.973611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490a3ba-a03b-4cfe-af64-a2523d2c2ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:32.975736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490a3ba-a03b-4cfe-af64-a2523d2c2ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:32.976166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490a3ba-a03b-4cfe-af64-a2523d2c2ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:32.992541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490a3ba-a03b-4cfe-af64-a2523d2c2ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:32.994179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490a3ba-a03b-4cfe-af64-a2523d2c2ba1 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:33.007579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f408a-31db-4d1c-a5bd-34b221fcb3e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:33.009059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f408a-31db-4d1c-a5bd-34b221fcb3e2 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:33.012977 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3656/7262] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:34:33.048789 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3607/7263] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:34:33.681666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490a3ba-a03b-4cfe-af64-a2523d2c2ba1 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:33.683264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c490a3ba-a03b-4cfe-af64-a2523d2c2ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:33.714974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490a3ba-a03b-4cfe-af64-a2523d2c2ba1 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:33.739658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:33.740308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:33.740579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:33.740846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] PATH_INFO: `/v3/projects/0608c49af850453da7632aa14a1addc2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:33.743713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0608c49af850453da7632aa14a1addc2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:33.751713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:33.939681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0608c49af850453da7632aa14a1addc2', 'request_id': 'req-95ed401d-ae07-492a-9ae0-ba1d0b186acb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:33.960102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0608c49af850453da7632aa14a1addc2', 'request_id': 'req-95ed401d-ae07-492a-9ae0-ba1d0b186acb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:33.983299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0608c49af850453da7632aa14a1addc2', 'request_id': 'req-95ed401d-ae07-492a-9ae0-ba1d0b186acb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:34.022670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] The token cache is being invalidate because project 0608c49af850453da7632aa14a1addc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:34.023313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:34.031784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:34.036106 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3657/7264] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:33 2022] DELETE /identity/v3/projects/0608c49af850453da7632aa14a1addc2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:34.039986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f408a-31db-4d1c-a5bd-34b221fcb3e2 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:34.061230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f408a-31db-4d1c-a5bd-34b221fcb3e2 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:34.237240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ee5eb-1a72-4c6b-b633-cc320a313732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:34.238169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ee5eb-1a72-4c6b-b633-cc320a313732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:34.238626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ee5eb-1a72-4c6b-b633-cc320a313732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:34.239093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ee5eb-1a72-4c6b-b633-cc320a313732 admin admin] PATH_INFO: `/v3/users/ced8bb91f3f94876a9295c0101fea4b0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:34.240394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ee5eb-1a72-4c6b-b633-cc320a313732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced8bb91f3f94876a9295c0101fea4b0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:34.242487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ee5eb-1a72-4c6b-b633-cc320a313732 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:34.365642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b84ee5eb-1a72-4c6b-b633-cc320a313732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced8bb91f3f94876a9295c0101fea4b0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:34.366239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b84ee5eb-1a72-4c6b-b633-cc320a313732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced8bb91f3f94876a9295c0101fea4b0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:34.391351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b84ee5eb-1a72-4c6b-b633-cc320a313732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced8bb91f3f94876a9295c0101fea4b0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:34.408239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b84ee5eb-1a72-4c6b-b633-cc320a313732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced8bb91f3f94876a9295c0101fea4b0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:34.408866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b84ee5eb-1a72-4c6b-b633-cc320a313732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced8bb91f3f94876a9295c0101fea4b0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:34.435113 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3608/7265] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:34 2022] DELETE /identity/v3/users/ced8bb91f3f94876a9295c0101fea4b0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:35.222553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:35.224134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:35.254267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed401d-ae07-492a-9ae0-ba1d0b186acb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:35.376658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e14288-0fa4-407b-b594-cb25c676d7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:35.377570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e14288-0fa4-407b-b594-cb25c676d7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:35.378007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e14288-0fa4-407b-b594-cb25c676d7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:35.378382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e14288-0fa4-407b-b594-cb25c676d7fe admin admin] PATH_INFO: `/v3/projects/1330ed37916845a0ad3442a93345bf7b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:35.380500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e14288-0fa4-407b-b594-cb25c676d7fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1330ed37916845a0ad3442a93345bf7b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:35.383027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e14288-0fa4-407b-b594-cb25c676d7fe admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:35.451852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20e14288-0fa4-407b-b594-cb25c676d7fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1330ed37916845a0ad3442a93345bf7b', 'request_id': 'req-20e14288-0fa4-407b-b594-cb25c676d7fe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:35.454248 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:35.462083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20e14288-0fa4-407b-b594-cb25c676d7fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1330ed37916845a0ad3442a93345bf7b', 'request_id': 'req-20e14288-0fa4-407b-b594-cb25c676d7fe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:35.478162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20e14288-0fa4-407b-b594-cb25c676d7fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1330ed37916845a0ad3442a93345bf7b', 'request_id': 'req-20e14288-0fa4-407b-b594-cb25c676d7fe'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:35.496201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20e14288-0fa4-407b-b594-cb25c676d7fe admin admin] The token cache is being invalidate because project 1330ed37916845a0ad3442a93345bf7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:35.496598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20e14288-0fa4-407b-b594-cb25c676d7fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:35.497154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20e14288-0fa4-407b-b594-cb25c676d7fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:35.502494 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3658/7266] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:35 2022] DELETE /identity/v3/projects/1330ed37916845a0ad3442a93345bf7b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:35.504279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d61a40-161e-4d8a-a612-e595ba8852e9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:35.505166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d61a40-161e-4d8a-a612-e595ba8852e9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:35.505694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d61a40-161e-4d8a-a612-e595ba8852e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:35.538784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-51d61a40-161e-4d8a-a612-e595ba8852e9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:35.540134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-51d61a40-161e-4d8a-a612-e595ba8852e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:35.625160 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:35.664236 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3609/7267] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:35.672340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75980d10-7145-4ddf-854f-cc3b24bd9ef3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:35.672721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75980d10-7145-4ddf-854f-cc3b24bd9ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:35.673063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75980d10-7145-4ddf-854f-cc3b24bd9ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:35.694361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-75980d10-7145-4ddf-854f-cc3b24bd9ef3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:35.695631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-75980d10-7145-4ddf-854f-cc3b24bd9ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:35.704924 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3659/7268] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:34:35.709126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d61a40-161e-4d8a-a612-e595ba8852e9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:35.721894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d61a40-161e-4d8a-a612-e595ba8852e9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:35.739743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5c247-f405-4229-8d62-c77be8e1499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:35.740560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5c247-f405-4229-8d62-c77be8e1499c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:35.740956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5c247-f405-4229-8d62-c77be8e1499c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:35.741506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5c247-f405-4229-8d62-c77be8e1499c admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:35.742304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5c247-f405-4229-8d62-c77be8e1499c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:35.742861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5c247-f405-4229-8d62-c77be8e1499c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:35.746074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5c247-f405-4229-8d62-c77be8e1499c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:35.768924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75980d10-7145-4ddf-854f-cc3b24bd9ef3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:35.771464 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3610/7269] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:35.781846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75980d10-7145-4ddf-854f-cc3b24bd9ef3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:35.795376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9b78a-7154-495b-937b-a350dd888b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:35.795713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9b78a-7154-495b-937b-a350dd888b8d admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:35.795996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9b78a-7154-495b-937b-a350dd888b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:35.796270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9b78a-7154-495b-937b-a350dd888b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:35.797530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9b78a-7154-495b-937b-a350dd888b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:35.799558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9b78a-7154-495b-937b-a350dd888b8d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:35.857532 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3660/7270] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:35 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:35.858672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5c247-f405-4229-8d62-c77be8e1499c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:35.871603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5c247-f405-4229-8d62-c77be8e1499c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:35.987247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94547974-8a59-46c4-af79-55133f57b2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:35.987876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94547974-8a59-46c4-af79-55133f57b2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:35.988157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94547974-8a59-46c4-af79-55133f57b2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:35.988430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94547974-8a59-46c4-af79-55133f57b2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:35.989077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94547974-8a59-46c4-af79-55133f57b2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:35.994314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94547974-8a59-46c4-af79-55133f57b2c2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:36.053234 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3611/7271] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:35 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:36.057805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9b78a-7154-495b-937b-a350dd888b8d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:36.077425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9b78a-7154-495b-937b-a350dd888b8d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:36.088871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f0317-1258-4b3e-bd4b-e0051806a769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:36.089655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f0317-1258-4b3e-bd4b-e0051806a769 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:36.090051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f0317-1258-4b3e-bd4b-e0051806a769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:36.090433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f0317-1258-4b3e-bd4b-e0051806a769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:36.091240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f0317-1258-4b3e-bd4b-e0051806a769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:36.092964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f0317-1258-4b3e-bd4b-e0051806a769 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:36.106054 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3661/7272] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:34:36.110257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94547974-8a59-46c4-af79-55133f57b2c2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:36.121597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94547974-8a59-46c4-af79-55133f57b2c2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:36.135804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ea096-efa2-4b53-8a97-57179af73d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:36.136438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea096-efa2-4b53-8a97-57179af73d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:36.136722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea096-efa2-4b53-8a97-57179af73d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:36.136999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea096-efa2-4b53-8a97-57179af73d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:36.137644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ea096-efa2-4b53-8a97-57179af73d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:36.139288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ea096-efa2-4b53-8a97-57179af73d93 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:36.175143 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3612/7273] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:36.176662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f0317-1258-4b3e-bd4b-e0051806a769 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:36.203115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f0317-1258-4b3e-bd4b-e0051806a769 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:36.215717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe69c79-fc7e-43cf-8f63-1067154ffc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:36.216380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe69c79-fc7e-43cf-8f63-1067154ffc20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:36.216669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe69c79-fc7e-43cf-8f63-1067154ffc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:36.216929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe69c79-fc7e-43cf-8f63-1067154ffc20 admin admin] PATH_INFO: `/v3/projects/c0905a21414e42858c096508dee600e0/users/f5a7a43b3abb4268869e7107f7d0a49f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:36.241441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe69c79-fc7e-43cf-8f63-1067154ffc20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0905a21414e42858c096508dee600e0, user_id=f5a7a43b3abb4268869e7107f7d0a49f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:36.244975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe69c79-fc7e-43cf-8f63-1067154ffc20 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:36.269188 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3662/7274] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:36 2022] PUT /identity/v3/projects/c0905a21414e42858c096508dee600e0/users/f5a7a43b3abb4268869e7107f7d0a49f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:36.279500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b6747-5327-4c3c-a801-5c1962ebc4fa None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:36.279787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b6747-5327-4c3c-a801-5c1962ebc4fa None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:36.279978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b6747-5327-4c3c-a801-5c1962ebc4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:36.337140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-041b6747-5327-4c3c-a801-5c1962ebc4fa None None] MFA Rules not processed for user `f5a7a43b3abb4268869e7107f7d0a49f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:36.338350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-041b6747-5327-4c3c-a801-5c1962ebc4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:36.471387 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3613/7275] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:36.475549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe69c79-fc7e-43cf-8f63-1067154ffc20 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:36.790907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe69c79-fc7e-43cf-8f63-1067154ffc20 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:36.799259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e9ae9-ae66-46f8-b15a-a3eab8355c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:36.799967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e9ae9-ae66-46f8-b15a-a3eab8355c88 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:36.800312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e9ae9-ae66-46f8-b15a-a3eab8355c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:36.800704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e9ae9-ae66-46f8-b15a-a3eab8355c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:36.801402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e9ae9-ae66-46f8-b15a-a3eab8355c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:36.803921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e9ae9-ae66-46f8-b15a-a3eab8355c88 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:36.851399 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3663/7276] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:36 2022] POST /identity/v3/projects => generated 369 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:36.856619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b6747-5327-4c3c-a801-5c1962ebc4fa None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:36.871553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b6747-5327-4c3c-a801-5c1962ebc4fa None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:36.903523 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:36.936583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707ead9-ee9c-47ca-9501-5dd110871f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:36.937671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707ead9-ee9c-47ca-9501-5dd110871f9d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:36.937958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707ead9-ee9c-47ca-9501-5dd110871f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:36.938233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707ead9-ee9c-47ca-9501-5dd110871f9d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:36.939484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707ead9-ee9c-47ca-9501-5dd110871f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:36.941904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707ead9-ee9c-47ca-9501-5dd110871f9d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:36.971626 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3614/7277] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:36 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:36.972689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e9ae9-ae66-46f8-b15a-a3eab8355c88 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:36.986650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e9ae9-ae66-46f8-b15a-a3eab8355c88 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:36.992597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1c7ab-2351-4ec3-a3f6-d926d6aa59ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:36.993313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1c7ab-2351-4ec3-a3f6-d926d6aa59ed admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:36.993697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1c7ab-2351-4ec3-a3f6-d926d6aa59ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:36.994045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1c7ab-2351-4ec3-a3f6-d926d6aa59ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:36.994782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1c7ab-2351-4ec3-a3f6-d926d6aa59ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:36.996544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1c7ab-2351-4ec3-a3f6-d926d6aa59ed admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:37.010350 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3664/7278] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:37.014455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707ead9-ee9c-47ca-9501-5dd110871f9d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:37.025744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707ead9-ee9c-47ca-9501-5dd110871f9d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:37.032939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b840d-7c62-4c01-b3ff-5cff6248a20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:37.033750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b840d-7c62-4c01-b3ff-5cff6248a20f admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:37.034110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b840d-7c62-4c01-b3ff-5cff6248a20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:37.034511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b840d-7c62-4c01-b3ff-5cff6248a20f admin admin] PATH_INFO: `/v3/projects/d8a8f2cc1c7c417cb217e2cc6f907673/users/098e60f4cada4c50b1852567324a8de4/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:37.067276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b840d-7c62-4c01-b3ff-5cff6248a20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a8f2cc1c7c417cb217e2cc6f907673, user_id=098e60f4cada4c50b1852567324a8de4, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:37.070273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b840d-7c62-4c01-b3ff-5cff6248a20f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:37.094152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1c7ab-2351-4ec3-a3f6-d926d6aa59ed admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:37.095413 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3615/7279] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:37 2022] PUT /identity/v3/projects/d8a8f2cc1c7c417cb217e2cc6f907673/users/098e60f4cada4c50b1852567324a8de4/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:37.107208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1c7ab-2351-4ec3-a3f6-d926d6aa59ed admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:37.186947 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:37.210774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77960dd-07f0-4523-8409-56b0457ac4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:37.211424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77960dd-07f0-4523-8409-56b0457ac4bd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:37.211698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77960dd-07f0-4523-8409-56b0457ac4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:37.211965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77960dd-07f0-4523-8409-56b0457ac4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:37.213236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77960dd-07f0-4523-8409-56b0457ac4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:37.214818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77960dd-07f0-4523-8409-56b0457ac4bd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:37.226750 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3665/7280] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:37.231179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b840d-7c62-4c01-b3ff-5cff6248a20f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:37.236483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5f9c8-d322-4e0f-91cb-e4d47ee0ac09 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:37.236844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5f9c8-d322-4e0f-91cb-e4d47ee0ac09 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:37.237126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5f9c8-d322-4e0f-91cb-e4d47ee0ac09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:37.246945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b840d-7c62-4c01-b3ff-5cff6248a20f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:37.261158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b875c27-bc0a-440e-8caf-dcbc8e97c60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:37.261995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b875c27-bc0a-440e-8caf-dcbc8e97c60d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:37.262393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b875c27-bc0a-440e-8caf-dcbc8e97c60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:37.262828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b875c27-bc0a-440e-8caf-dcbc8e97c60d admin admin] PATH_INFO: `/v3/projects/d8a8f2cc1c7c417cb217e2cc6f907673/users/098e60f4cada4c50b1852567324a8de4/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:37.267179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b875c27-bc0a-440e-8caf-dcbc8e97c60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a8f2cc1c7c417cb217e2cc6f907673, user_id=098e60f4cada4c50b1852567324a8de4, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:37.269982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b875c27-bc0a-440e-8caf-dcbc8e97c60d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:37.295568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f4b5f9c8-d322-4e0f-91cb-e4d47ee0ac09 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:37.298060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f4b5f9c8-d322-4e0f-91cb-e4d47ee0ac09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:37.307361 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3616/7281] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:37 2022] PUT /identity/v3/projects/d8a8f2cc1c7c417cb217e2cc6f907673/users/098e60f4cada4c50b1852567324a8de4/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:37.309183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3118991-0669-4549-94d6-f2917250712d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:37.309476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3118991-0669-4549-94d6-f2917250712d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:37.309756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3118991-0669-4549-94d6-f2917250712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:37.387564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e3118991-0669-4549-94d6-f2917250712d None None] MFA Rules not processed for user `098e60f4cada4c50b1852567324a8de4`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:37.388781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e3118991-0669-4549-94d6-f2917250712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:37.400522 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3666/7282] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:34:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:37.416632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5f9c8-d322-4e0f-91cb-e4d47ee0ac09 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:37.418637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f4b5f9c8-d322-4e0f-91cb-e4d47ee0ac09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:37.582488 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3617/7283] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:37.583652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3118991-0669-4549-94d6-f2917250712d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:37.604265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3118991-0669-4549-94d6-f2917250712d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:37.608231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5f9c8-d322-4e0f-91cb-e4d47ee0ac09 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:37.614425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c991a6-9f70-45c8-a311-e7565e80a0de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:37.615631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c991a6-9f70-45c8-a311-e7565e80a0de service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:37.615779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b39481-ba77-48ce-b3c6-21cb3f42ad23 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '098e60f4cada4c50b1852567324a8de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8a8f2cc1c7c417cb217e2cc6f907673', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:37.616273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c991a6-9f70-45c8-a311-e7565e80a0de service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:37.616555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b39481-ba77-48ce-b3c6-21cb3f42ad23 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:37.616912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b39481-ba77-48ce-b3c6-21cb3f42ad23 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:37.617184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c991a6-9f70-45c8-a311-e7565e80a0de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:37.617301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b39481-ba77-48ce-b3c6-21cb3f42ad23 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:37.617960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b39481-ba77-48ce-b3c6-21cb3f42ad23 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:37.629055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c991a6-9f70-45c8-a311-e7565e80a0de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:37.629651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b39481-ba77-48ce-b3c6-21cb3f42ad23 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:37.630638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c991a6-9f70-45c8-a311-e7565e80a0de service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:37.641235 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3667/7284] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:34:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:34:37.699418 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3618/7285] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:37 2022] POST /identity/v3/projects => generated 358 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:37.703230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c991a6-9f70-45c8-a311-e7565e80a0de service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:37.714742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c991a6-9f70-45c8-a311-e7565e80a0de service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:37.916768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b39481-ba77-48ce-b3c6-21cb3f42ad23 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:37.919762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e8b39481-ba77-48ce-b3c6-21cb3f42ad23 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:37.921621 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:37.978245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff2de-76ca-4b17-ac94-6ba3d5cba23b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '098e60f4cada4c50b1852567324a8de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8a8f2cc1c7c417cb217e2cc6f907673', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:37.979905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff2de-76ca-4b17-ac94-6ba3d5cba23b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:37.980967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff2de-76ca-4b17-ac94-6ba3d5cba23b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:37.981922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff2de-76ca-4b17-ac94-6ba3d5cba23b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:37.983285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ff2de-76ca-4b17-ac94-6ba3d5cba23b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:37.990737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ff2de-76ca-4b17-ac94-6ba3d5cba23b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:38.059400 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3668/7286] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:37 2022] POST /identity/v3/users => generated 373 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:34:38.060594 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:38.060785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff2de-76ca-4b17-ac94-6ba3d5cba23b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:38.085976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff2de-76ca-4b17-ac94-6ba3d5cba23b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:38.100121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee089f8-e027-4b88-8a21-85e21934e463 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '098e60f4cada4c50b1852567324a8de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8a8f2cc1c7c417cb217e2cc6f907673', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:38.102156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee089f8-e027-4b88-8a21-85e21934e463 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:38.102156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee089f8-e027-4b88-8a21-85e21934e463 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:38.102860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee089f8-e027-4b88-8a21-85e21934e463 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:38.105674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee089f8-e027-4b88-8a21-85e21934e463 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:38.105674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee089f8-e027-4b88-8a21-85e21934e463 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:38.111148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee089f8-e027-4b88-8a21-85e21934e463 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:38.119170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b39481-ba77-48ce-b3c6-21cb3f42ad23 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:38.154255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d037e4a-0758-43f5-9029-c4460764a284 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:38.161266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d037e4a-0758-43f5-9029-c4460764a284 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:38.161736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d037e4a-0758-43f5-9029-c4460764a284 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:38.162186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d037e4a-0758-43f5-9029-c4460764a284 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:38.168616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3d037e4a-0758-43f5-9029-c4460764a284 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:38.206141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d037e4a-0758-43f5-9029-c4460764a284 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:38.211572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d037e4a-0758-43f5-9029-c4460764a284 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:38.225986 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3669/7287] 10.222.0.39 () {58 vars in 1157 bytes} [Sun Oct 16 01:34:38 2022] GET /identity/v3/users?domain_id=default => generated 8301 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:38.230746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee089f8-e027-4b88-8a21-85e21934e463 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:38.241273 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3619/7288] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:34:38.262686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee089f8-e027-4b88-8a21-85e21934e463 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:38.278832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd2d3e-12ce-438d-844c-7ec413831405 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '098e60f4cada4c50b1852567324a8de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8a8f2cc1c7c417cb217e2cc6f907673', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:38.280403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd2d3e-12ce-438d-844c-7ec413831405 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:38.280692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd2d3e-12ce-438d-844c-7ec413831405 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:38.280972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd2d3e-12ce-438d-844c-7ec413831405 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] PATH_INFO: `/v3/users/4058c0b7220d419d9097f41e24b22c12` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:38.302086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd2d3e-12ce-438d-844c-7ec413831405 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorizing `identity:update_user(user_id=4058c0b7220d419d9097f41e24b22c12)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:38.309012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd2d3e-12ce-438d-844c-7ec413831405 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:38.381102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a7cd2d3e-12ce-438d-844c-7ec413831405 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4058c0b7220d419d9097f41e24b22c12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:38.400846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a7cd2d3e-12ce-438d-844c-7ec413831405 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invalidating the token cache because user 4058c0b7220d419d9097f41e24b22c12 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:38.401147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a7cd2d3e-12ce-438d-844c-7ec413831405 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:38.402348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a7cd2d3e-12ce-438d-844c-7ec413831405 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:38.409011 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3670/7289] 10.222.0.39 () {60 vars in 1244 bytes} [Sun Oct 16 01:34:38 2022] PATCH /identity/v3/users/4058c0b7220d419d9097f41e24b22c12 => generated 488 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:38.411390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b7b08-0e59-470c-8e76-d4bd15245386 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:38.411705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b7b08-0e59-470c-8e76-d4bd15245386 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:38.413102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b7b08-0e59-470c-8e76-d4bd15245386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:38.464966 n-d-master-1 devstack@keystone.service[81805]: WARNING keystone.auth.plugins.core [None req-855b7b08-0e59-470c-8e76-d4bd15245386 None None] User is disabled: 4058c0b7220d419d9097f41e24b22c12: AssertionError: User is disabled: 4058c0b7220d419d9097f41e24b22c12 Oct 16 01:34:38.479386 n-d-master-1 devstack@keystone.service[81805]: WARNING keystone.server.flask.application [None req-855b7b08-0e59-470c-8e76-d4bd15245386 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 16 01:34:38.480949 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3620/7290] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:38 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 71 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 16 01:34:38.486028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd2d3e-12ce-438d-844c-7ec413831405 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:38.487696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a7cd2d3e-12ce-438d-844c-7ec413831405 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:38.546233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd2d3e-12ce-438d-844c-7ec413831405 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:38.569883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904c13e-f50d-43f1-97e7-570ef505b8eb tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '098e60f4cada4c50b1852567324a8de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8a8f2cc1c7c417cb217e2cc6f907673', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:38.570552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904c13e-f50d-43f1-97e7-570ef505b8eb tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:38.570829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904c13e-f50d-43f1-97e7-570ef505b8eb tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:38.571136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904c13e-f50d-43f1-97e7-570ef505b8eb tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] PATH_INFO: `/v3/users/4058c0b7220d419d9097f41e24b22c12` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:38.608956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904c13e-f50d-43f1-97e7-570ef505b8eb tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4058c0b7220d419d9097f41e24b22c12)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:38.620716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904c13e-f50d-43f1-97e7-570ef505b8eb tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:38.696966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7904c13e-f50d-43f1-97e7-570ef505b8eb tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4058c0b7220d419d9097f41e24b22c12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:38.697811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7904c13e-f50d-43f1-97e7-570ef505b8eb tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4058c0b7220d419d9097f41e24b22c12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:38.713914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7904c13e-f50d-43f1-97e7-570ef505b8eb tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4058c0b7220d419d9097f41e24b22c12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:38.726506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7904c13e-f50d-43f1-97e7-570ef505b8eb tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4058c0b7220d419d9097f41e24b22c12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:38.727459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7904c13e-f50d-43f1-97e7-570ef505b8eb tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4058c0b7220d419d9097f41e24b22c12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:38.755581 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3671/7291] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:38 2022] DELETE /identity/v3/users/4058c0b7220d419d9097f41e24b22c12 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:38.760043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b7b08-0e59-470c-8e76-d4bd15245386 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:38.762967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-855b7b08-0e59-470c-8e76-d4bd15245386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:38.920321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b7b08-0e59-470c-8e76-d4bd15245386 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:38.926861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '098e60f4cada4c50b1852567324a8de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8a8f2cc1c7c417cb217e2cc6f907673', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:38.927874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:38.928385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:38.928924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] PATH_INFO: `/v3/projects/c64aa8a54c6244f3aa4176a19033c619` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:38.930478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c64aa8a54c6244f3aa4176a19033c619)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:38.932736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:39.033260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c64aa8a54c6244f3aa4176a19033c619', 'request_id': 'req-0b7b3b07-68ce-4a2e-90a0-85aa50288625'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:39.062404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c64aa8a54c6244f3aa4176a19033c619', 'request_id': 'req-0b7b3b07-68ce-4a2e-90a0-85aa50288625'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:39.081886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c64aa8a54c6244f3aa4176a19033c619', 'request_id': 'req-0b7b3b07-68ce-4a2e-90a0-85aa50288625'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:39.126238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] The token cache is being invalidate because project c64aa8a54c6244f3aa4176a19033c619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:39.126546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:39.129244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:39.131932 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3621/7292] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:38 2022] DELETE /identity/v3/projects/c64aa8a54c6244f3aa4176a19033c619 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:39.140358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904c13e-f50d-43f1-97e7-570ef505b8eb tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:39.158301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904c13e-f50d-43f1-97e7-570ef505b8eb tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:39.282265 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:39.326376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f5f51-e700-4ee1-9468-56d5407eec5b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '098e60f4cada4c50b1852567324a8de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8a8f2cc1c7c417cb217e2cc6f907673', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:39.327145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f5f51-e700-4ee1-9468-56d5407eec5b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:39.327296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f5f51-e700-4ee1-9468-56d5407eec5b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:39.329712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f5f51-e700-4ee1-9468-56d5407eec5b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:39.331111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f5f51-e700-4ee1-9468-56d5407eec5b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:39.333950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f5f51-e700-4ee1-9468-56d5407eec5b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-861f5f51-e700-4ee1-9468-56d5407eec5b tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Could not find domain: 3f1343a6ca4148b7943b6189e5471502.: keystone.exception.DomainNotFound: Could not find domain: 3f1343a6ca4148b7943b6189e5471502. Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3f1343a6ca4148b7943b6189e5471502. Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:39.370803 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 16 01:34:39.372207 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:34:39.373400 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 16 01:34:39.377929 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 01:34:39.377929 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3f1343a6ca4148b7943b6189e5471502. Oct 16 01:34:39.377929 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:39.377929 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3672/7293] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:39 2022] POST /identity/v3/users => generated 112 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:34:39.378508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:39.379813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:39.572141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b3b07-68ce-4a2e-90a0-85aa50288625 tempest-UsersNegativeTest-657304152 tempest-UsersNegativeTest-657304152-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:39.580218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:39.581053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:39.581344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:39.582277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] PATH_INFO: `/v3/users/f5a7a43b3abb4268869e7107f7d0a49f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:39.583236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a7a43b3abb4268869e7107f7d0a49f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:39.585532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:39.613757 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:39.719523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a7a43b3abb4268869e7107f7d0a49f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:39.723563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a7a43b3abb4268869e7107f7d0a49f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:39.753805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a7a43b3abb4268869e7107f7d0a49f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:39.767774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a7a43b3abb4268869e7107f7d0a49f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:39.769000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a7a43b3abb4268869e7107f7d0a49f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:39.792548 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3622/7294] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:39 2022] DELETE /identity/v3/users/f5a7a43b3abb4268869e7107f7d0a49f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:39.794331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23105595-242b-49b4-9657-1366983a0014 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:39.794614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23105595-242b-49b4-9657-1366983a0014 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:39.794903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23105595-242b-49b4-9657-1366983a0014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:39.823881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-23105595-242b-49b4-9657-1366983a0014 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:39.825169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-23105595-242b-49b4-9657-1366983a0014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:39.905987 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3673/7295] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:39.919222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:39.940799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:40.134559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bb70e-f662-473b-bd1b-40153cc2418a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:40.143324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fc537-e247-4807-af3f-305779d7ccab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:40.144255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fc537-e247-4807-af3f-305779d7ccab service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:40.144696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fc537-e247-4807-af3f-305779d7ccab service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:40.145145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fc537-e247-4807-af3f-305779d7ccab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:40.167141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fc537-e247-4807-af3f-305779d7ccab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:40.169055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fc537-e247-4807-af3f-305779d7ccab service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:40.181632 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3623/7296] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:40.365055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23105595-242b-49b4-9657-1366983a0014 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:40.367784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-23105595-242b-49b4-9657-1366983a0014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:40.408723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23105595-242b-49b4-9657-1366983a0014 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:40.415558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:40.416289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:40.416707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:40.417022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] PATH_INFO: `/v3/users/3824035c58fc4119bd1e3a84f186d5cb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:40.418384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3824035c58fc4119bd1e3a84f186d5cb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:40.422767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:40.495724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3824035c58fc4119bd1e3a84f186d5cb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:40.496440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3824035c58fc4119bd1e3a84f186d5cb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:40.519961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3824035c58fc4119bd1e3a84f186d5cb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:40.543142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3824035c58fc4119bd1e3a84f186d5cb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:40.543142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3824035c58fc4119bd1e3a84f186d5cb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:40.581622 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3674/7297] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:40 2022] DELETE /identity/v3/users/3824035c58fc4119bd1e3a84f186d5cb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:40.631575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fc537-e247-4807-af3f-305779d7ccab service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:40.633403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-906fc537-e247-4807-af3f-305779d7ccab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:40.659964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fc537-e247-4807-af3f-305779d7ccab service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:40.825277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:40.825923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:40.826200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:40.826470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] PATH_INFO: `/v3/projects/c0905a21414e42858c096508dee600e0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:40.827618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0905a21414e42858c096508dee600e0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:40.829764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:40.886327 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:40.917485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0905a21414e42858c096508dee600e0', 'request_id': 'req-12874625-3c02-486e-a293-2ed4eabb3b89'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:40.927651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0905a21414e42858c096508dee600e0', 'request_id': 'req-12874625-3c02-486e-a293-2ed4eabb3b89'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:40.938719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0905a21414e42858c096508dee600e0', 'request_id': 'req-12874625-3c02-486e-a293-2ed4eabb3b89'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:40.956261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:40.957356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] The token cache is being invalidate because project c0905a21414e42858c096508dee600e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:40.957825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:40.957932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:40.958395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:40.960674 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3624/7298] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:40 2022] DELETE /identity/v3/projects/c0905a21414e42858c096508dee600e0 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:40.965318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:40.973648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:40.989109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf39380-a640-4a63-9d8f-2c75ea32d07f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:41.066362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12874625-3c02-486e-a293-2ed4eabb3b89 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:41.080829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:41.081600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:41.082051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:41.082471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] PATH_INFO: `/v3/users/098e60f4cada4c50b1852567324a8de4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:41.084435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=098e60f4cada4c50b1852567324a8de4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:41.086582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:41.088567 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:41.102062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:41.102952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:41.103801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:41.104398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] PATH_INFO: `/v3/projects/aa44de13a18f4057a7aa203e99104468` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:41.106329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa44de13a18f4057a7aa203e99104468)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:41.111072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:41.186712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098e60f4cada4c50b1852567324a8de4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.188433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098e60f4cada4c50b1852567324a8de4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.206508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098e60f4cada4c50b1852567324a8de4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.226477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098e60f4cada4c50b1852567324a8de4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.226477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098e60f4cada4c50b1852567324a8de4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.246633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa44de13a18f4057a7aa203e99104468', 'request_id': 'req-c4863b88-9438-4a03-bccb-73b36d48c4d7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.254508 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3625/7299] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:40 2022] DELETE /identity/v3/users/098e60f4cada4c50b1852567324a8de4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:41.255072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa44de13a18f4057a7aa203e99104468', 'request_id': 'req-c4863b88-9438-4a03-bccb-73b36d48c4d7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.268998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa44de13a18f4057a7aa203e99104468', 'request_id': 'req-c4863b88-9438-4a03-bccb-73b36d48c4d7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.285251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] The token cache is being invalidate because project aa44de13a18f4057a7aa203e99104468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:41.285806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.287451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.289505 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3675/7300] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:40 2022] DELETE /identity/v3/projects/aa44de13a18f4057a7aa203e99104468 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:41.293643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:41.295262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:41.345155 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:41.393802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899a7a-c396-4886-b188-0faf10724a4d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:41.400876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:41.401355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:41.402093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:41.402590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] PATH_INFO: `/v3/users/9847f4d5f3e241aa91e02323460683bb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:41.404107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9847f4d5f3e241aa91e02323460683bb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:41.407144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:41.574016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9847f4d5f3e241aa91e02323460683bb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.575387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9847f4d5f3e241aa91e02323460683bb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.611019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9847f4d5f3e241aa91e02323460683bb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.641574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9847f4d5f3e241aa91e02323460683bb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.642467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9847f4d5f3e241aa91e02323460683bb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:41.674814 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3626/7301] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:41 2022] DELETE /identity/v3/users/9847f4d5f3e241aa91e02323460683bb => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:34:41.776895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:41.785532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:41.912676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4863b88-9438-4a03-bccb-73b36d48c4d7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:42.003668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:42.005431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:42.015666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f92228-e9ea-438e-aff1-613f925c7cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:42.016439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92228-e9ea-438e-aff1-613f925c7cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:42.016857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92228-e9ea-438e-aff1-613f925c7cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:42.017235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92228-e9ea-438e-aff1-613f925c7cdb admin admin] PATH_INFO: `/v3/projects/d8a8f2cc1c7c417cb217e2cc6f907673` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:42.018963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f92228-e9ea-438e-aff1-613f925c7cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a8f2cc1c7c417cb217e2cc6f907673)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:42.025671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f92228-e9ea-438e-aff1-613f925c7cdb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:42.091528 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:42.113181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36f92228-e9ea-438e-aff1-613f925c7cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a8f2cc1c7c417cb217e2cc6f907673', 'request_id': 'req-36f92228-e9ea-438e-aff1-613f925c7cdb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:42.122470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36f92228-e9ea-438e-aff1-613f925c7cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a8f2cc1c7c417cb217e2cc6f907673', 'request_id': 'req-36f92228-e9ea-438e-aff1-613f925c7cdb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:42.142553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36f92228-e9ea-438e-aff1-613f925c7cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a8f2cc1c7c417cb217e2cc6f907673', 'request_id': 'req-36f92228-e9ea-438e-aff1-613f925c7cdb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:42.149125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34af9-5eb2-4f7f-8852-5bfaa5cb88fc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:42.159297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36f92228-e9ea-438e-aff1-613f925c7cdb admin admin] The token cache is being invalidate because project d8a8f2cc1c7c417cb217e2cc6f907673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:42.159587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36f92228-e9ea-438e-aff1-613f925c7cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:42.160959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-36f92228-e9ea-438e-aff1-613f925c7cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:42.169138 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3676/7302] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:41 2022] DELETE /identity/v3/projects/d8a8f2cc1c7c417cb217e2cc6f907673 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:42.170742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caf1f2-1375-4cff-a749-a8d12b70d9e6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:42.171052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caf1f2-1375-4cff-a749-a8d12b70d9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:42.171329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caf1f2-1375-4cff-a749-a8d12b70d9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:42.194168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e4caf1f2-1375-4cff-a749-a8d12b70d9e6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:42.195334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e4caf1f2-1375-4cff-a749-a8d12b70d9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:42.260154 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:42.271029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b3a47-4fea-403f-9cb7-014c02f11985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:42.274566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3a47-4fea-403f-9cb7-014c02f11985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:42.275874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3a47-4fea-403f-9cb7-014c02f11985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:42.277631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3a47-4fea-403f-9cb7-014c02f11985 admin admin] PATH_INFO: `/v3/projects/91574de8cd934816bc20a7584d3b1025` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:42.279535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b3a47-4fea-403f-9cb7-014c02f11985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91574de8cd934816bc20a7584d3b1025)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:42.283019 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3677/7303] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:42.287890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b3a47-4fea-403f-9cb7-014c02f11985 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:42.292003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3fdac-6258-48fe-a0a2-1a8a62a6837c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:42.292967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3fdac-6258-48fe-a0a2-1a8a62a6837c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:42.293453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3fdac-6258-48fe-a0a2-1a8a62a6837c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:42.337088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-62f3fdac-6258-48fe-a0a2-1a8a62a6837c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:42.338561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-62f3fdac-6258-48fe-a0a2-1a8a62a6837c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:42.355475 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3678/7304] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:42.361039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3fdac-6258-48fe-a0a2-1a8a62a6837c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:42.372582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3fdac-6258-48fe-a0a2-1a8a62a6837c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:42.395336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c1b3a47-4fea-403f-9cb7-014c02f11985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91574de8cd934816bc20a7584d3b1025', 'request_id': 'req-2c1b3a47-4fea-403f-9cb7-014c02f11985'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:42.408892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c1b3a47-4fea-403f-9cb7-014c02f11985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91574de8cd934816bc20a7584d3b1025', 'request_id': 'req-2c1b3a47-4fea-403f-9cb7-014c02f11985'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:42.426225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c1b3a47-4fea-403f-9cb7-014c02f11985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91574de8cd934816bc20a7584d3b1025', 'request_id': 'req-2c1b3a47-4fea-403f-9cb7-014c02f11985'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:42.463623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c1b3a47-4fea-403f-9cb7-014c02f11985 admin admin] The token cache is being invalidate because project 91574de8cd934816bc20a7584d3b1025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:42.464021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c1b3a47-4fea-403f-9cb7-014c02f11985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:42.464855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2c1b3a47-4fea-403f-9cb7-014c02f11985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:42.469603 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3627/7305] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:42 2022] DELETE /identity/v3/projects/91574de8cd934816bc20a7584d3b1025 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:42.472333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db865e3-6ed6-4467-9a3f-7eac612ecf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:42.472498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc4db-b947-4abc-86fc-525fe61a33e0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:42.472722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc4db-b947-4abc-86fc-525fe61a33e0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:42.472936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc4db-b947-4abc-86fc-525fe61a33e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:42.473069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db865e3-6ed6-4467-9a3f-7eac612ecf75 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:42.473245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db865e3-6ed6-4467-9a3f-7eac612ecf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:42.473534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db865e3-6ed6-4467-9a3f-7eac612ecf75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:42.474175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db865e3-6ed6-4467-9a3f-7eac612ecf75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:42.474481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db865e3-6ed6-4467-9a3f-7eac612ecf75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:42.476146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db865e3-6ed6-4467-9a3f-7eac612ecf75 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:42.492456 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3679/7306] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:42.494689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b72fc4db-b947-4abc-86fc-525fe61a33e0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:42.495950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b72fc4db-b947-4abc-86fc-525fe61a33e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:42.497001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db865e3-6ed6-4467-9a3f-7eac612ecf75 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:42.499528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0db865e3-6ed6-4467-9a3f-7eac612ecf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:42.505369 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3628/7307] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:42.513168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b00d8-29eb-4282-92e4-c0ec6bb4e8f1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:42.513428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b00d8-29eb-4282-92e4-c0ec6bb4e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:42.513629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b00d8-29eb-4282-92e4-c0ec6bb4e8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:42.517093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db865e3-6ed6-4467-9a3f-7eac612ecf75 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:42.527937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440fa25-1532-4c4d-b6c1-73f9580cd4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:42.528622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440fa25-1532-4c4d-b6c1-73f9580cd4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:42.529141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440fa25-1532-4c4d-b6c1-73f9580cd4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:42.529471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440fa25-1532-4c4d-b6c1-73f9580cd4c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:42.530208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440fa25-1532-4c4d-b6c1-73f9580cd4c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:42.532428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440fa25-1532-4c4d-b6c1-73f9580cd4c1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:42.539419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8d3b00d8-29eb-4282-92e4-c0ec6bb4e8f1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:42.540639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8d3b00d8-29eb-4282-92e4-c0ec6bb4e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:42.571974 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3629/7308] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:42.575978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b00d8-29eb-4282-92e4-c0ec6bb4e8f1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:42.581739 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3680/7309] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:42 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:34:42.586385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440fa25-1532-4c4d-b6c1-73f9580cd4c1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:42.587097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b00d8-29eb-4282-92e4-c0ec6bb4e8f1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:42.637845 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:42.693175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440fa25-1532-4c4d-b6c1-73f9580cd4c1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:42.694033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270734a8-1d0e-4caa-af86-8eb6260c9ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:42.694880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270734a8-1d0e-4caa-af86-8eb6260c9ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:42.695223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270734a8-1d0e-4caa-af86-8eb6260c9ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:42.695503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270734a8-1d0e-4caa-af86-8eb6260c9ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:42.696325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270734a8-1d0e-4caa-af86-8eb6260c9ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:42.696690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270734a8-1d0e-4caa-af86-8eb6260c9ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:42.698387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270734a8-1d0e-4caa-af86-8eb6260c9ac1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:42.698688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae5c25-974b-4bcf-844e-c835cab77625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:42.699324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae5c25-974b-4bcf-844e-c835cab77625 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:42.699600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae5c25-974b-4bcf-844e-c835cab77625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:42.700432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae5c25-974b-4bcf-844e-c835cab77625 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:42.701993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae5c25-974b-4bcf-844e-c835cab77625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:42.704131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae5c25-974b-4bcf-844e-c835cab77625 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:42.712769 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3630/7310] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:34:42.717461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270734a8-1d0e-4caa-af86-8eb6260c9ac1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:42.731016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270734a8-1d0e-4caa-af86-8eb6260c9ac1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:42.738376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6737a-bf52-4b0f-b320-b7b5adfcfd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:42.739035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6737a-bf52-4b0f-b320-b7b5adfcfd2c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:42.739360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6737a-bf52-4b0f-b320-b7b5adfcfd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:42.740035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6737a-bf52-4b0f-b320-b7b5adfcfd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:42.740872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6737a-bf52-4b0f-b320-b7b5adfcfd2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:42.743330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6737a-bf52-4b0f-b320-b7b5adfcfd2c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:42.744279 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3681/7311] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:42 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:42.748504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae5c25-974b-4bcf-844e-c835cab77625 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:42.777036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae5c25-974b-4bcf-844e-c835cab77625 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:42.791639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f928b8-f375-42d9-b155-7b6c30c8f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:42.792193 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3631/7312] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:42 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:42.798329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6737a-bf52-4b0f-b320-b7b5adfcfd2c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:42.798962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f928b8-f375-42d9-b155-7b6c30c8f46b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:42.799278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f928b8-f375-42d9-b155-7b6c30c8f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:42.799553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f928b8-f375-42d9-b155-7b6c30c8f46b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:42.801814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f928b8-f375-42d9-b155-7b6c30c8f46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:42.803496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f928b8-f375-42d9-b155-7b6c30c8f46b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:42.806082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-98c6737a-bf52-4b0f-b320-b7b5adfcfd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:42.837370 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3682/7313] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:42.838543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f928b8-f375-42d9-b155-7b6c30c8f46b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:42.862754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f928b8-f375-42d9-b155-7b6c30c8f46b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:42.920999 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:42.974740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6737a-bf52-4b0f-b320-b7b5adfcfd2c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:42.990654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340d712-3b0d-47a9-9e72-8e6f56a1f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:42.991325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340d712-3b0d-47a9-9e72-8e6f56a1f3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:42.991747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340d712-3b0d-47a9-9e72-8e6f56a1f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:42.992025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340d712-3b0d-47a9-9e72-8e6f56a1f3e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:42.992660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340d712-3b0d-47a9-9e72-8e6f56a1f3e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:42.994893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340d712-3b0d-47a9-9e72-8e6f56a1f3e4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:43.003618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3822ac2-8e98-441e-9dd9-44b973b8bc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:43.004555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3822ac2-8e98-441e-9dd9-44b973b8bc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:43.005122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3822ac2-8e98-441e-9dd9-44b973b8bc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:43.007039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3822ac2-8e98-441e-9dd9-44b973b8bc3a admin admin] PATH_INFO: `/v3/users/cd9e49f226da473694ebe8a2bc29226f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:43.010648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3822ac2-8e98-441e-9dd9-44b973b8bc3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9e49f226da473694ebe8a2bc29226f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:43.015097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3822ac2-8e98-441e-9dd9-44b973b8bc3a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:43.052827 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3683/7314] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:42 2022] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:43.055166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340d712-3b0d-47a9-9e72-8e6f56a1f3e4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:43.087207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340d712-3b0d-47a9-9e72-8e6f56a1f3e4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:43.101623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c9ae4-d8c1-4510-acf2-bdac85fcba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:43.102251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c9ae4-d8c1-4510-acf2-bdac85fcba35 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:43.102532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c9ae4-d8c1-4510-acf2-bdac85fcba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:43.102811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c9ae4-d8c1-4510-acf2-bdac85fcba35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:43.103559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c9ae4-d8c1-4510-acf2-bdac85fcba35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:43.105223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c9ae4-d8c1-4510-acf2-bdac85fcba35 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:43.130043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3822ac2-8e98-441e-9dd9-44b973b8bc3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9e49f226da473694ebe8a2bc29226f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:43.133597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3822ac2-8e98-441e-9dd9-44b973b8bc3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9e49f226da473694ebe8a2bc29226f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:43.133906 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3684/7315] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:43.135002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c9ae4-d8c1-4510-acf2-bdac85fcba35 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:43.137616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3a3c9ae4-d8c1-4510-acf2-bdac85fcba35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:43.164791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c9ae4-d8c1-4510-acf2-bdac85fcba35 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:43.167503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3822ac2-8e98-441e-9dd9-44b973b8bc3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9e49f226da473694ebe8a2bc29226f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:43.176974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843c592-5760-4893-a90a-3308cfaf0119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:43.177610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843c592-5760-4893-a90a-3308cfaf0119 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:43.177933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843c592-5760-4893-a90a-3308cfaf0119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:43.178143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843c592-5760-4893-a90a-3308cfaf0119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:43.178792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843c592-5760-4893-a90a-3308cfaf0119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:43.180560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843c592-5760-4893-a90a-3308cfaf0119 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:43.204692 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3685/7316] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:43.205695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843c592-5760-4893-a90a-3308cfaf0119 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:43.211746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5843c592-5760-4893-a90a-3308cfaf0119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:43.224365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3822ac2-8e98-441e-9dd9-44b973b8bc3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9e49f226da473694ebe8a2bc29226f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:43.225647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e3822ac2-8e98-441e-9dd9-44b973b8bc3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9e49f226da473694ebe8a2bc29226f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:43.240496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843c592-5760-4893-a90a-3308cfaf0119 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:43.248316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee1c29-c2a0-4ae2-a1b3-edfdc44b0857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:43.253698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee1c29-c2a0-4ae2-a1b3-edfdc44b0857 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:43.253998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee1c29-c2a0-4ae2-a1b3-edfdc44b0857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:43.256439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee1c29-c2a0-4ae2-a1b3-edfdc44b0857 admin admin] PATH_INFO: `/v3/projects/264d375b991b41e39c7f903376c346e7/users/b8dd998a4b9f4da5bf42866a86cc66e0/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:43.257247 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3632/7317] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:42 2022] DELETE /identity/v3/users/cd9e49f226da473694ebe8a2bc29226f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:43.259625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3822ac2-8e98-441e-9dd9-44b973b8bc3a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:43.290730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee1c29-c2a0-4ae2-a1b3-edfdc44b0857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=264d375b991b41e39c7f903376c346e7, user_id=b8dd998a4b9f4da5bf42866a86cc66e0, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:43.293831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee1c29-c2a0-4ae2-a1b3-edfdc44b0857 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:43.319512 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3686/7318] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:43 2022] PUT /identity/v3/projects/264d375b991b41e39c7f903376c346e7/users/b8dd998a4b9f4da5bf42866a86cc66e0/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:43.324017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214003fe-304e-4bda-93a2-be7d13474fd6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:43.325396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214003fe-304e-4bda-93a2-be7d13474fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:43.326077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214003fe-304e-4bda-93a2-be7d13474fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:43.383250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-214003fe-304e-4bda-93a2-be7d13474fd6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:43.384903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-214003fe-304e-4bda-93a2-be7d13474fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:43.476292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3822ac2-8e98-441e-9dd9-44b973b8bc3a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:43.477599 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:43.517074 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3687/7319] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:43.525636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9b303-24ad-4df3-87a6-b333d56cdd56 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:43.525949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9b303-24ad-4df3-87a6-b333d56cdd56 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:43.526204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9b303-24ad-4df3-87a6-b333d56cdd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:43.605902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d4e9b303-24ad-4df3-87a6-b333d56cdd56 None None] MFA Rules not processed for user `b8dd998a4b9f4da5bf42866a86cc66e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:43.607146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d4e9b303-24ad-4df3-87a6-b333d56cdd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:43.612891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26351c-d989-42b5-aabc-04814dfa7c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:43.613520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26351c-d989-42b5-aabc-04814dfa7c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:43.613798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26351c-d989-42b5-aabc-04814dfa7c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:43.614060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26351c-d989-42b5-aabc-04814dfa7c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:43.614863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26351c-d989-42b5-aabc-04814dfa7c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:43.616639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26351c-d989-42b5-aabc-04814dfa7c33 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:43.635377 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3633/7320] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:43.635377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26351c-d989-42b5-aabc-04814dfa7c33 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:43.639320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-de26351c-d989-42b5-aabc-04814dfa7c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:43.655763 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:43.749070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26351c-d989-42b5-aabc-04814dfa7c33 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:43.755649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950de656-7203-4c38-8266-327cfc163298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:43.756664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950de656-7203-4c38-8266-327cfc163298 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:43.757192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950de656-7203-4c38-8266-327cfc163298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:43.757685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950de656-7203-4c38-8266-327cfc163298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:43.771486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950de656-7203-4c38-8266-327cfc163298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:43.772206 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3688/7321] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:43.773252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9b303-24ad-4df3-87a6-b333d56cdd56 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:43.776124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950de656-7203-4c38-8266-327cfc163298 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:43.786896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9b303-24ad-4df3-87a6-b333d56cdd56 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:43.793513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17553ad8-a3dd-4565-956d-c58cc0175d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:43.794302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17553ad8-a3dd-4565-956d-c58cc0175d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:43.794644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17553ad8-a3dd-4565-956d-c58cc0175d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:43.795029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17553ad8-a3dd-4565-956d-c58cc0175d40 admin admin] PATH_INFO: `/v3/projects/22b55a98a2384d51bad21d5c7915e862/users/546c615defb6447ebea66cf0b2c8f067/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:43.803699 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3634/7322] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:43.805785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950de656-7203-4c38-8266-327cfc163298 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:43.814795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17553ad8-a3dd-4565-956d-c58cc0175d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b55a98a2384d51bad21d5c7915e862, user_id=546c615defb6447ebea66cf0b2c8f067, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:43.817835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17553ad8-a3dd-4565-956d-c58cc0175d40 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:43.836723 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3689/7323] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:43 2022] PUT /identity/v3/projects/22b55a98a2384d51bad21d5c7915e862/users/546c615defb6447ebea66cf0b2c8f067/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:43.837111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950de656-7203-4c38-8266-327cfc163298 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:43.960795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f6cab-286f-455f-99fb-26723ae95f11 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:43.961021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f6cab-286f-455f-99fb-26723ae95f11 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:43.961289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f6cab-286f-455f-99fb-26723ae95f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:44.014690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9d8f6cab-286f-455f-99fb-26723ae95f11 None None] MFA Rules not processed for user `546c615defb6447ebea66cf0b2c8f067`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:44.016883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d8f6cab-286f-455f-99fb-26723ae95f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:44.033310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b89254-e780-43ec-8f46-a82bd951f9af tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd998a4b9f4da5bf42866a86cc66e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264d375b991b41e39c7f903376c346e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:44.034222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89254-e780-43ec-8f46-a82bd951f9af tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:44.034613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89254-e780-43ec-8f46-a82bd951f9af tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:44.035093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89254-e780-43ec-8f46-a82bd951f9af tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:44.036149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b89254-e780-43ec-8f46-a82bd951f9af tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=b8dd998a4b9f4da5bf42866a86cc66e0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:44.039698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b89254-e780-43ec-8f46-a82bd951f9af tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:44.079989 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3635/7324] 10.222.0.39 () {60 vars in 1299 bytes} [Sun Oct 16 01:34:43 2022] POST /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2 => generated 367 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:44.085425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b89254-e780-43ec-8f46-a82bd951f9af tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:44.106777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b89254-e780-43ec-8f46-a82bd951f9af tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:44.121132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683e003-ae9c-43a2-a322-3e4285ba8d16 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd998a4b9f4da5bf42866a86cc66e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264d375b991b41e39c7f903376c346e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:44.121929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e003-ae9c-43a2-a322-3e4285ba8d16 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:44.122503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e003-ae9c-43a2-a322-3e4285ba8d16 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:44.122679 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3690/7325] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:44.122831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e003-ae9c-43a2-a322-3e4285ba8d16 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/777fe6629ab9402689ffaf080147ce4c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:44.123575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f6cab-286f-455f-99fb-26723ae95f11 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:44.128032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683e003-ae9c-43a2-a322-3e4285ba8d16 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=b8dd998a4b9f4da5bf42866a86cc66e0, credential_id=777fe6629ab9402689ffaf080147ce4c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:44.132064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683e003-ae9c-43a2-a322-3e4285ba8d16 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:44.166421 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3636/7326] 10.222.0.39 () {58 vars in 1380 bytes} [Sun Oct 16 01:34:44 2022] DELETE /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/777fe6629ab9402689ffaf080147ce4c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:44.172616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683e003-ae9c-43a2-a322-3e4285ba8d16 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:44.190805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683e003-ae9c-43a2-a322-3e4285ba8d16 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:44.193350 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:44.207133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c7ff0-99cb-4fac-8fad-f69b5baa7a35 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd998a4b9f4da5bf42866a86cc66e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264d375b991b41e39c7f903376c346e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:44.209592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c7ff0-99cb-4fac-8fad-f69b5baa7a35 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:44.209990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c7ff0-99cb-4fac-8fad-f69b5baa7a35 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:44.211577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f6cab-286f-455f-99fb-26723ae95f11 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:44.213269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c7ff0-99cb-4fac-8fad-f69b5baa7a35 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:44.214127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c7ff0-99cb-4fac-8fad-f69b5baa7a35 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=b8dd998a4b9f4da5bf42866a86cc66e0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:44.217265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c209a-30f1-4545-8271-421a3b0841b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:44.218051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c7ff0-99cb-4fac-8fad-f69b5baa7a35 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:44.218203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c209a-30f1-4545-8271-421a3b0841b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:44.218531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c209a-30f1-4545-8271-421a3b0841b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:44.219272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c209a-30f1-4545-8271-421a3b0841b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:44.220562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c209a-30f1-4545-8271-421a3b0841b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:44.223012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c209a-30f1-4545-8271-421a3b0841b7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:44.255423 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3637/7327] 10.222.0.39 () {60 vars in 1299 bytes} [Sun Oct 16 01:34:44 2022] POST /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2 => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:34:44.259581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c7ff0-99cb-4fac-8fad-f69b5baa7a35 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:44.272948 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3691/7328] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:44 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:44.277153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c209a-30f1-4545-8271-421a3b0841b7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:44.280741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c7ff0-99cb-4fac-8fad-f69b5baa7a35 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:44.397817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d412e7-86a2-460b-bbd0-20f7dd1eb678 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd998a4b9f4da5bf42866a86cc66e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264d375b991b41e39c7f903376c346e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:44.398491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d412e7-86a2-460b-bbd0-20f7dd1eb678 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:44.398773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d412e7-86a2-460b-bbd0-20f7dd1eb678 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:44.400902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d412e7-86a2-460b-bbd0-20f7dd1eb678 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/a040c1add5e54dc3a51155680d83404d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:44.402164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c209a-30f1-4545-8271-421a3b0841b7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:44.404751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d412e7-86a2-460b-bbd0-20f7dd1eb678 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=b8dd998a4b9f4da5bf42866a86cc66e0, credential_id=a040c1add5e54dc3a51155680d83404d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:44.407109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d412e7-86a2-460b-bbd0-20f7dd1eb678 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:44.420238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be712022-7b4f-4414-8d91-bddf2e594701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:44.420873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be712022-7b4f-4414-8d91-bddf2e594701 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:44.421169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be712022-7b4f-4414-8d91-bddf2e594701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:44.421434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be712022-7b4f-4414-8d91-bddf2e594701 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:44.422654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be712022-7b4f-4414-8d91-bddf2e594701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:44.424612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be712022-7b4f-4414-8d91-bddf2e594701 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:44.445733 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3638/7329] 10.222.0.39 () {58 vars in 1380 bytes} [Sun Oct 16 01:34:44 2022] DELETE /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/a040c1add5e54dc3a51155680d83404d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:44.445733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d412e7-86a2-460b-bbd0-20f7dd1eb678 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:44.470083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d9d412e7-86a2-460b-bbd0-20f7dd1eb678 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:44.498259 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3692/7330] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:44 2022] POST /identity/v3/users => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:44.499266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be712022-7b4f-4414-8d91-bddf2e594701 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:44.510422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d412e7-86a2-460b-bbd0-20f7dd1eb678 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:44.519333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be712022-7b4f-4414-8d91-bddf2e594701 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:44.524237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:44.525165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:44.525589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:44.525839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] PATH_INFO: `/v3/projects/19305e6e924f4159b32dfe55be05d735` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:44.534420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19305e6e924f4159b32dfe55be05d735)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:44.536698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:44.538028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0b3ea-3a2d-4985-b63f-10143d828a00 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd998a4b9f4da5bf42866a86cc66e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264d375b991b41e39c7f903376c346e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:44.539724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b3ea-3a2d-4985-b63f-10143d828a00 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:44.540414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b3ea-3a2d-4985-b63f-10143d828a00 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:44.540909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b3ea-3a2d-4985-b63f-10143d828a00 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/a040c1add5e54dc3a51155680d83404d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:44.565720 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-0af0b3ea-3a2d-4985-b63f-10143d828a00 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Could not find credential: 6948184a9ed77fd1a0d3169c8252459e1fbd8b4c03157078332d4d62a1abeeeb.: keystone.exception.CredentialNotFound: Could not find credential: 6948184a9ed77fd1a0d3169c8252459e1fbd8b4c03157078332d4d62a1abeeeb. Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 16 01:34:44.583552 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 01:34:44.584710 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 6948184a9ed77fd1a0d3169c8252459e1fbd8b4c03157078332d4d62a1abeeeb. Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:44.585963 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3693/7331] 10.222.0.39 () {58 vars in 1377 bytes} [Sun Oct 16 01:34:44 2022] GET /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/a040c1add5e54dc3a51155680d83404d => generated 148 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:34:44.587694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0b3ea-3a2d-4985-b63f-10143d828a00 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:44.622513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0b3ea-3a2d-4985-b63f-10143d828a00 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:44.650422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19305e6e924f4159b32dfe55be05d735', 'request_id': 'req-32569560-7419-49dc-a75f-10f063bd6934'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:44.675328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19305e6e924f4159b32dfe55be05d735', 'request_id': 'req-32569560-7419-49dc-a75f-10f063bd6934'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:44.695272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19305e6e924f4159b32dfe55be05d735', 'request_id': 'req-32569560-7419-49dc-a75f-10f063bd6934'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:44.717983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] The token cache is being invalidate because project 19305e6e924f4159b32dfe55be05d735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:44.719707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:44.725026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:44.727078 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3639/7332] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:44 2022] DELETE /identity/v3/projects/19305e6e924f4159b32dfe55be05d735 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:44.728186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:44.729882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:44.784764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aaba6-9fd8-4bb2-aefb-4ba080578a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:44.785616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aaba6-9fd8-4bb2-aefb-4ba080578a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:44.785997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aaba6-9fd8-4bb2-aefb-4ba080578a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:44.786507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aaba6-9fd8-4bb2-aefb-4ba080578a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:44.787741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43aaba6-9fd8-4bb2-aefb-4ba080578a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:44.789187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43aaba6-9fd8-4bb2-aefb-4ba080578a76 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:44.823942 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3694/7333] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:44.825070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aaba6-9fd8-4bb2-aefb-4ba080578a76 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:44.827918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b43aaba6-9fd8-4bb2-aefb-4ba080578a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:44.860468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aaba6-9fd8-4bb2-aefb-4ba080578a76 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:44.887322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32569560-7419-49dc-a75f-10f063bd6934 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:44.887528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:44.888068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:44.888501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:44.888816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] PATH_INFO: `/v3/users/6dfd2de312f74480b4026fb1eff0a4b3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:44.890078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dfd2de312f74480b4026fb1eff0a4b3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:44.892928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:44.893696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54547f55-d948-4e62-badb-c52109ce98a7 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd998a4b9f4da5bf42866a86cc66e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264d375b991b41e39c7f903376c346e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:44.894361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54547f55-d948-4e62-badb-c52109ce98a7 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:44.895296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54547f55-d948-4e62-badb-c52109ce98a7 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:44.895588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54547f55-d948-4e62-badb-c52109ce98a7 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:44.896224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54547f55-d948-4e62-badb-c52109ce98a7 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=b8dd998a4b9f4da5bf42866a86cc66e0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:44.897931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54547f55-d948-4e62-badb-c52109ce98a7 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:44.920037 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3640/7334] 10.222.0.39 () {60 vars in 1299 bytes} [Sun Oct 16 01:34:44 2022] POST /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2 => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:44.920952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54547f55-d948-4e62-badb-c52109ce98a7 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:44.927781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-54547f55-d948-4e62-badb-c52109ce98a7 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:44.949172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54547f55-d948-4e62-badb-c52109ce98a7 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:44.954622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:44.955292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:44.955581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:44.955874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] PATH_INFO: `/v3/users/8f2d8d5a8a7948a19a82ff69512c1863` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:44.956970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2d8d5a8a7948a19a82ff69512c1863)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:44.958897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:44.961768 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:44.966299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dfd2de312f74480b4026fb1eff0a4b3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:44.967728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dfd2de312f74480b4026fb1eff0a4b3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:44.983123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dfd2de312f74480b4026fb1eff0a4b3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:44.995764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dfd2de312f74480b4026fb1eff0a4b3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:44.997866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dfd2de312f74480b4026fb1eff0a4b3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.026790 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3695/7335] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:44 2022] DELETE /identity/v3/users/6dfd2de312f74480b4026fb1eff0a4b3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:45.028192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:45.030479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2d8d5a8a7948a19a82ff69512c1863'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.031140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2d8d5a8a7948a19a82ff69512c1863'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.041699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:45.053625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2d8d5a8a7948a19a82ff69512c1863'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.076649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2d8d5a8a7948a19a82ff69512c1863'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.078797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2d8d5a8a7948a19a82ff69512c1863'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.100691 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3641/7336] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:44 2022] DELETE /identity/v3/users/8f2d8d5a8a7948a19a82ff69512c1863 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:45.101763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:45.104482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:45.121974 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:45.178945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89136e8e-657a-48e2-8022-884840d4e125 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:45.207588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc8558-48c1-412f-ae8b-b2156e1eeb5a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:45.214809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320993f-8896-4646-a4ce-f85755fe069e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd998a4b9f4da5bf42866a86cc66e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264d375b991b41e39c7f903376c346e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:45.215558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320993f-8896-4646-a4ce-f85755fe069e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:45.215845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320993f-8896-4646-a4ce-f85755fe069e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:45.216120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320993f-8896-4646-a4ce-f85755fe069e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:45.216746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320993f-8896-4646-a4ce-f85755fe069e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=b8dd998a4b9f4da5bf42866a86cc66e0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:45.218999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320993f-8896-4646-a4ce-f85755fe069e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:45.245963 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3642/7337] 10.222.0.39 () {60 vars in 1299 bytes} [Sun Oct 16 01:34:45 2022] POST /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2 => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:45.251007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320993f-8896-4646-a4ce-f85755fe069e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:45.263889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320993f-8896-4646-a4ce-f85755fe069e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:45.270366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3c236-4a9f-41b5-a1cd-7a277a8f2cc5 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd998a4b9f4da5bf42866a86cc66e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264d375b991b41e39c7f903376c346e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:45.271234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3c236-4a9f-41b5-a1cd-7a277a8f2cc5 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:45.271579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3c236-4a9f-41b5-a1cd-7a277a8f2cc5 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:45.271859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3c236-4a9f-41b5-a1cd-7a277a8f2cc5 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:45.273159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3c236-4a9f-41b5-a1cd-7a277a8f2cc5 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=b8dd998a4b9f4da5bf42866a86cc66e0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:45.275456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3c236-4a9f-41b5-a1cd-7a277a8f2cc5 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:45.284017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b231c-0016-43af-8548-685ecbb5859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:45.284783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b231c-0016-43af-8548-685ecbb5859a admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:45.286435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b231c-0016-43af-8548-685ecbb5859a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:45.286963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b231c-0016-43af-8548-685ecbb5859a admin admin] PATH_INFO: `/v3/projects/47ede506015540f2a9e53e6f2dc680d0/users/99e2655dedfa49c1a1622bdf76d00f04/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:45.295291 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3643/7338] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Oct 16 01:34:45 2022] GET /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2 => generated 865 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:45.298058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3c236-4a9f-41b5-a1cd-7a277a8f2cc5 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:45.308238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b231c-0016-43af-8548-685ecbb5859a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ede506015540f2a9e53e6f2dc680d0, user_id=99e2655dedfa49c1a1622bdf76d00f04, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:45.311259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b231c-0016-43af-8548-685ecbb5859a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:45.311707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3c236-4a9f-41b5-a1cd-7a277a8f2cc5 tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:45.319365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ede89-cb6a-4b8a-8c39-7509684a7e9f tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd998a4b9f4da5bf42866a86cc66e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264d375b991b41e39c7f903376c346e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:45.320260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ede89-cb6a-4b8a-8c39-7509684a7e9f tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:45.320563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ede89-cb6a-4b8a-8c39-7509684a7e9f tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:45.320912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ede89-cb6a-4b8a-8c39-7509684a7e9f tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/30c48c8000524d6abe3d1ecf2a770565` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:45.323799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ede89-cb6a-4b8a-8c39-7509684a7e9f tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=b8dd998a4b9f4da5bf42866a86cc66e0, credential_id=30c48c8000524d6abe3d1ecf2a770565)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:45.325286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ede89-cb6a-4b8a-8c39-7509684a7e9f tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:45.332938 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3696/7339] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:45 2022] PUT /identity/v3/projects/47ede506015540f2a9e53e6f2dc680d0/users/99e2655dedfa49c1a1622bdf76d00f04/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:45.338024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b231c-0016-43af-8548-685ecbb5859a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:45.341093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6d3b231c-0016-43af-8548-685ecbb5859a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:45.356468 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3644/7340] 10.222.0.39 () {58 vars in 1380 bytes} [Sun Oct 16 01:34:45 2022] DELETE /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/30c48c8000524d6abe3d1ecf2a770565 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:45.361032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ede89-cb6a-4b8a-8c39-7509684a7e9f tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:45.371155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ede89-cb6a-4b8a-8c39-7509684a7e9f tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:45.434122 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:45.451434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b231c-0016-43af-8548-685ecbb5859a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:45.459384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49216577-9d5f-4675-b66b-06b801a11e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:45.460012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49216577-9d5f-4675-b66b-06b801a11e8f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:45.460287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49216577-9d5f-4675-b66b-06b801a11e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:45.460602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49216577-9d5f-4675-b66b-06b801a11e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:45.461465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49216577-9d5f-4675-b66b-06b801a11e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:45.463314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49216577-9d5f-4675-b66b-06b801a11e8f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:45.476990 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3697/7341] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:45.478145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49216577-9d5f-4675-b66b-06b801a11e8f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:45.480754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-49216577-9d5f-4675-b66b-06b801a11e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:45.504547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49216577-9d5f-4675-b66b-06b801a11e8f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:45.509625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:45.510273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:45.510857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:45.511193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] PATH_INFO: `/v3/projects/297a0eb860444023b67aa53333a88a9a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:45.513488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] RBAC: Authorizing `identity:delete_project(project_id=297a0eb860444023b67aa53333a88a9a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:45.514512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4343f-ffe5-466b-96a1-3a7cbe8ec64e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd998a4b9f4da5bf42866a86cc66e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264d375b991b41e39c7f903376c346e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:45.515751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:45.515904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4343f-ffe5-466b-96a1-3a7cbe8ec64e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:45.517382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4343f-ffe5-466b-96a1-3a7cbe8ec64e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:45.517759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4343f-ffe5-466b-96a1-3a7cbe8ec64e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/a9391882b0b8407c91605a7138fe9b3e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:45.521306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4343f-ffe5-466b-96a1-3a7cbe8ec64e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=b8dd998a4b9f4da5bf42866a86cc66e0, credential_id=a9391882b0b8407c91605a7138fe9b3e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:45.523082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4343f-ffe5-466b-96a1-3a7cbe8ec64e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:45.570941 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3645/7342] 10.222.0.39 () {58 vars in 1380 bytes} [Sun Oct 16 01:34:45 2022] DELETE /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/a9391882b0b8407c91605a7138fe9b3e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:34:45.574862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4343f-ffe5-466b-96a1-3a7cbe8ec64e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:45.600358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4343f-ffe5-466b-96a1-3a7cbe8ec64e tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:45.627642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297a0eb860444023b67aa53333a88a9a', 'request_id': 'req-2b6eb493-6f23-4468-b37c-cd8f989c260e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.639182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297a0eb860444023b67aa53333a88a9a', 'request_id': 'req-2b6eb493-6f23-4468-b37c-cd8f989c260e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.651593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297a0eb860444023b67aa53333a88a9a', 'request_id': 'req-2b6eb493-6f23-4468-b37c-cd8f989c260e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.680528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] The token cache is being invalidate because project 297a0eb860444023b67aa53333a88a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:45.680929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.681593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.683454 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3698/7343] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:45 2022] DELETE /identity/v3/projects/297a0eb860444023b67aa53333a88a9a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:45.684196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:45.685652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:45.730173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a54717-c264-44a8-8bcc-d14904a78c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:45.731069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a54717-c264-44a8-8bcc-d14904a78c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:45.731781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a54717-c264-44a8-8bcc-d14904a78c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:45.732248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a54717-c264-44a8-8bcc-d14904a78c81 admin admin] PATH_INFO: `/v3/projects/47ede506015540f2a9e53e6f2dc680d0/users/99e2655dedfa49c1a1622bdf76d00f04/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:45.735920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a54717-c264-44a8-8bcc-d14904a78c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ede506015540f2a9e53e6f2dc680d0, user_id=99e2655dedfa49c1a1622bdf76d00f04, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:45.739205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a54717-c264-44a8-8bcc-d14904a78c81 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:45.753278 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3646/7344] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:45 2022] PUT /identity/v3/projects/47ede506015540f2a9e53e6f2dc680d0/users/99e2655dedfa49c1a1622bdf76d00f04/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:45.754038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a54717-c264-44a8-8bcc-d14904a78c81 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:45.756045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-69a54717-c264-44a8-8bcc-d14904a78c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:45.780170 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:45.793285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6eb493-6f23-4468-b37c-cd8f989c260e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:45.836104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a54717-c264-44a8-8bcc-d14904a78c81 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:45.841787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedf1d0-8a42-44cd-a982-8c74d08046a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:45.842442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf1d0-8a42-44cd-a982-8c74d08046a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:45.842738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf1d0-8a42-44cd-a982-8c74d08046a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:45.843027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf1d0-8a42-44cd-a982-8c74d08046a0 admin admin] PATH_INFO: `/v3/users/b04d6c2b915946cab57cd9c7ceac9f4f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:45.844872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedf1d0-8a42-44cd-a982-8c74d08046a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04d6c2b915946cab57cd9c7ceac9f4f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:45.846803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedf1d0-8a42-44cd-a982-8c74d08046a0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:45.852248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443f7d3-c4ac-4d6e-8b6e-8236cab57e2a tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd998a4b9f4da5bf42866a86cc66e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264d375b991b41e39c7f903376c346e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:45.852901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443f7d3-c4ac-4d6e-8b6e-8236cab57e2a tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:45.853181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443f7d3-c4ac-4d6e-8b6e-8236cab57e2a tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:45.853459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443f7d3-c4ac-4d6e-8b6e-8236cab57e2a tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:45.854075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443f7d3-c4ac-4d6e-8b6e-8236cab57e2a tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=b8dd998a4b9f4da5bf42866a86cc66e0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:45.855620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443f7d3-c4ac-4d6e-8b6e-8236cab57e2a tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:45.874552 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3699/7345] 10.222.0.39 () {60 vars in 1299 bytes} [Sun Oct 16 01:34:45 2022] POST /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2 => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:45.880561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1682a-7747-464c-9d15-fa345a67c90c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:45.881102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1682a-7747-464c-9d15-fa345a67c90c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:45.881473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1682a-7747-464c-9d15-fa345a67c90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:45.907885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e8a1682a-7747-464c-9d15-fa345a67c90c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:45.909839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e8a1682a-7747-464c-9d15-fa345a67c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:45.911969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0fedf1d0-8a42-44cd-a982-8c74d08046a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04d6c2b915946cab57cd9c7ceac9f4f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.912915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0fedf1d0-8a42-44cd-a982-8c74d08046a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04d6c2b915946cab57cd9c7ceac9f4f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.920890 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3700/7346] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:45.923274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1682a-7747-464c-9d15-fa345a67c90c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:45.924928 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e8a1682a-7747-464c-9d15-fa345a67c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:45.933864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0fedf1d0-8a42-44cd-a982-8c74d08046a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04d6c2b915946cab57cd9c7ceac9f4f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.942837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1682a-7747-464c-9d15-fa345a67c90c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:45.945299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0fedf1d0-8a42-44cd-a982-8c74d08046a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04d6c2b915946cab57cd9c7ceac9f4f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.946171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0fedf1d0-8a42-44cd-a982-8c74d08046a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04d6c2b915946cab57cd9c7ceac9f4f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:45.951458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:45.952375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:45.952839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:45.953921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] PATH_INFO: `/v3/projects/95e6f12a69b74230816313661a27c0ff` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:45.955616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e6f12a69b74230816313661a27c0ff)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:45.957672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:45.967407 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:45.978688 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3647/7347] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:45 2022] DELETE /identity/v3/users/b04d6c2b915946cab57cd9c7ceac9f4f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:45.980715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101acab1-f18e-4635-a685-ac5e98920ed7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:45.981202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101acab1-f18e-4635-a685-ac5e98920ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:45.982152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101acab1-f18e-4635-a685-ac5e98920ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.022699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-101acab1-f18e-4635-a685-ac5e98920ed7 None None] MFA Rules not processed for user `99e2655dedfa49c1a1622bdf76d00f04`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:46.024238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-101acab1-f18e-4635-a685-ac5e98920ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.041181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e6f12a69b74230816313661a27c0ff', 'request_id': 'req-0737aae3-b4b0-4cc7-91c0-3a212e90965c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:46.050167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e6f12a69b74230816313661a27c0ff', 'request_id': 'req-0737aae3-b4b0-4cc7-91c0-3a212e90965c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:46.063514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e6f12a69b74230816313661a27c0ff', 'request_id': 'req-0737aae3-b4b0-4cc7-91c0-3a212e90965c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:46.085923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] The token cache is being invalidate because project 95e6f12a69b74230816313661a27c0ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:46.087027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:46.088840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:46.090772 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3701/7348] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:45 2022] DELETE /identity/v3/projects/95e6f12a69b74230816313661a27c0ff => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:46.091732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:46.093069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.114990 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3648/7349] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:46.116357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a6340-d7f6-43da-80e9-e34dba466baa None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.116710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a6340-d7f6-43da-80e9-e34dba466baa None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.117056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a6340-d7f6-43da-80e9-e34dba466baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.137514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e89a6340-d7f6-43da-80e9-e34dba466baa None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:46.138838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e89a6340-d7f6-43da-80e9-e34dba466baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.152399 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:46.176780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737aae3-b4b0-4cc7-91c0-3a212e90965c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:46.181880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e34ec2-cdd1-47fe-b273-b6f95005411a tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd998a4b9f4da5bf42866a86cc66e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264d375b991b41e39c7f903376c346e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:46.182683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e34ec2-cdd1-47fe-b273-b6f95005411a tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.183061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e34ec2-cdd1-47fe-b273-b6f95005411a tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.183415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e34ec2-cdd1-47fe-b273-b6f95005411a tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/a4fd19a6029b4c2daa25f9baff2c66a7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.185760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e34ec2-cdd1-47fe-b273-b6f95005411a tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=b8dd998a4b9f4da5bf42866a86cc66e0, credential_id=a4fd19a6029b4c2daa25f9baff2c66a7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:46.188224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e34ec2-cdd1-47fe-b273-b6f95005411a tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:46.195143 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3702/7350] 10.222.0.39 () {58 vars in 1377 bytes} [Sun Oct 16 01:34:46 2022] GET /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/a4fd19a6029b4c2daa25f9baff2c66a7 => generated 367 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:46.195143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b1a9d-b367-47d3-aacc-9ede5cb10452 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.195143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b1a9d-b367-47d3-aacc-9ede5cb10452 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.195143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b1a9d-b367-47d3-aacc-9ede5cb10452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.213193 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3649/7351] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:46.215026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8e5d7-0fe2-4154-a4a2-2d048992765b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.215450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ae6b1a9d-b367-47d3-aacc-9ede5cb10452 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:46.215729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8e5d7-0fe2-4154-a4a2-2d048992765b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.216551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8e5d7-0fe2-4154-a4a2-2d048992765b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.217133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ae6b1a9d-b367-47d3-aacc-9ede5cb10452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.228706 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3703/7352] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:46.228706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b1a9d-b367-47d3-aacc-9ede5cb10452 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:46.233796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ae6b1a9d-b367-47d3-aacc-9ede5cb10452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.240555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5fa8e5d7-0fe2-4154-a4a2-2d048992765b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:46.241815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5fa8e5d7-0fe2-4154-a4a2-2d048992765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.251643 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3650/7353] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:46.252498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8e5d7-0fe2-4154-a4a2-2d048992765b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:46.263056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8e5d7-0fe2-4154-a4a2-2d048992765b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:46.275213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e154f6-4752-4e81-8442-6cd045b99fba tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd998a4b9f4da5bf42866a86cc66e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '264d375b991b41e39c7f903376c346e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:46.275890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e154f6-4752-4e81-8442-6cd045b99fba tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.276171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e154f6-4752-4e81-8442-6cd045b99fba tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.276442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e154f6-4752-4e81-8442-6cd045b99fba tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/a4fd19a6029b4c2daa25f9baff2c66a7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.278652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e154f6-4752-4e81-8442-6cd045b99fba tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=b8dd998a4b9f4da5bf42866a86cc66e0, credential_id=a4fd19a6029b4c2daa25f9baff2c66a7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:46.280675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e154f6-4752-4e81-8442-6cd045b99fba tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:46.298660 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3651/7354] 10.222.0.39 () {58 vars in 1380 bytes} [Sun Oct 16 01:34:46 2022] DELETE /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0/credentials/OS-EC2/a4fd19a6029b4c2daa25f9baff2c66a7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:46.299880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e154f6-4752-4e81-8442-6cd045b99fba tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:46.310268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b1a9d-b367-47d3-aacc-9ede5cb10452 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:46.311338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e154f6-4752-4e81-8442-6cd045b99fba tempest-EC2CredentialsTest-948157471 tempest-EC2CredentialsTest-948157471-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:46.314839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412db78c-5ebb-44c0-9c42-8a7c6c549170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:46.315477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412db78c-5ebb-44c0-9c42-8a7c6c549170 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.315757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412db78c-5ebb-44c0-9c42-8a7c6c549170 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.316031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412db78c-5ebb-44c0-9c42-8a7c6c549170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.317403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b7631-f5c8-497c-ab27-d55cb2c555c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:46.317986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7631-f5c8-497c-ab27-d55cb2c555c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.318108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-412db78c-5ebb-44c0-9c42-8a7c6c549170 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.318263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7631-f5c8-497c-ab27-d55cb2c555c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.318532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7631-f5c8-497c-ab27-d55cb2c555c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.319202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b7631-f5c8-497c-ab27-d55cb2c555c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:46.319497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b7631-f5c8-497c-ab27-d55cb2c555c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:46.321127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b7631-f5c8-497c-ab27-d55cb2c555c0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:46.333320 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3652/7355] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:46.334135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b7631-f5c8-497c-ab27-d55cb2c555c0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:46.335762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d01b7631-f5c8-497c-ab27-d55cb2c555c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.372749 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:46.385692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412db78c-5ebb-44c0-9c42-8a7c6c549170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:46.387476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412db78c-5ebb-44c0-9c42-8a7c6c549170 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:46.397410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b7631-f5c8-497c-ab27-d55cb2c555c0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:46.397602 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3704/7356] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:46.398841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a29b3-cdd2-4c51-875a-1f68080dc6f0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.399155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a29b3-cdd2-4c51-875a-1f68080dc6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.399463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a29b3-cdd2-4c51-875a-1f68080dc6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.401994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb49acb-8c6a-4f08-9493-0dd7ff4748f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:46.402806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb49acb-8c6a-4f08-9493-0dd7ff4748f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.403208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb49acb-8c6a-4f08-9493-0dd7ff4748f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.403653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb49acb-8c6a-4f08-9493-0dd7ff4748f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.415356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb49acb-8c6a-4f08-9493-0dd7ff4748f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:46.417133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb49acb-8c6a-4f08-9493-0dd7ff4748f1 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:46.420430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2e3a29b3-cdd2-4c51-875a-1f68080dc6f0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:46.422428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2e3a29b3-cdd2-4c51-875a-1f68080dc6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.428823 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3653/7357] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:46.429545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb49acb-8c6a-4f08-9493-0dd7ff4748f1 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:46.430843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1eb49acb-8c6a-4f08-9493-0dd7ff4748f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.431538 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3705/7358] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:46.432328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a29b3-cdd2-4c51-875a-1f68080dc6f0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:46.442669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a29b3-cdd2-4c51-875a-1f68080dc6f0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:46.446334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb49acb-8c6a-4f08-9493-0dd7ff4748f1 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:46.448152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a9cc-d8d6-47af-a4f5-b714bce95e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:46.448759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a9cc-d8d6-47af-a4f5-b714bce95e28 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.449037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a9cc-d8d6-47af-a4f5-b714bce95e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.449308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a9cc-d8d6-47af-a4f5-b714bce95e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.450003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19a9cc-d8d6-47af-a4f5-b714bce95e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:46.452182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19a9cc-d8d6-47af-a4f5-b714bce95e28 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:46.452806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154251e3-e402-491e-8436-8862479d094e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:46.453881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154251e3-e402-491e-8436-8862479d094e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.454197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154251e3-e402-491e-8436-8862479d094e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.454550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154251e3-e402-491e-8436-8862479d094e admin admin] PATH_INFO: `/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.456019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154251e3-e402-491e-8436-8862479d094e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8dd998a4b9f4da5bf42866a86cc66e0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:46.458957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154251e3-e402-491e-8436-8862479d094e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:46.495092 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3706/7359] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:46 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:46.496190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a9cc-d8d6-47af-a4f5-b714bce95e28 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:46.551441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-154251e3-e402-491e-8436-8862479d094e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8dd998a4b9f4da5bf42866a86cc66e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:46.552262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-154251e3-e402-491e-8436-8862479d094e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8dd998a4b9f4da5bf42866a86cc66e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:46.581817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-154251e3-e402-491e-8436-8862479d094e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8dd998a4b9f4da5bf42866a86cc66e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:46.596326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-154251e3-e402-491e-8436-8862479d094e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8dd998a4b9f4da5bf42866a86cc66e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:46.597186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-154251e3-e402-491e-8436-8862479d094e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8dd998a4b9f4da5bf42866a86cc66e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:46.603479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a9cc-d8d6-47af-a4f5-b714bce95e28 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:46.617153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d00d0-c268-4612-84b4-e493967ae840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:46.617789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d00d0-c268-4612-84b4-e493967ae840 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.618073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d00d0-c268-4612-84b4-e493967ae840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.618346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d00d0-c268-4612-84b4-e493967ae840 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.619037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d00d0-c268-4612-84b4-e493967ae840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:46.619346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d00d0-c268-4612-84b4-e493967ae840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:46.620973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d00d0-c268-4612-84b4-e493967ae840 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:46.634696 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:46.638175 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3707/7360] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:46.643816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d00d0-c268-4612-84b4-e493967ae840 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:46.645318 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3654/7361] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:46 2022] DELETE /identity/v3/users/b8dd998a4b9f4da5bf42866a86cc66e0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:46.646325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154251e3-e402-491e-8436-8862479d094e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:46.649256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-499d00d0-c268-4612-84b4-e493967ae840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.649743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-154251e3-e402-491e-8436-8862479d094e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.668508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d00d0-c268-4612-84b4-e493967ae840 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:46.773264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6ca08-41df-42d1-9d78-18e11ad9b709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:46.773975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6ca08-41df-42d1-9d78-18e11ad9b709 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.774604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6ca08-41df-42d1-9d78-18e11ad9b709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.775117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6ca08-41df-42d1-9d78-18e11ad9b709 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.776286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6ca08-41df-42d1-9d78-18e11ad9b709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:46.780782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6ca08-41df-42d1-9d78-18e11ad9b709 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:46.801734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154251e3-e402-491e-8436-8862479d094e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:46.807687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a9143-89de-4cec-961b-ca7e03bbb23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:46.808507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a9143-89de-4cec-961b-ca7e03bbb23d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.809071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a9143-89de-4cec-961b-ca7e03bbb23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.809340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a9143-89de-4cec-961b-ca7e03bbb23d admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.810008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a9143-89de-4cec-961b-ca7e03bbb23d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:46.812739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a9143-89de-4cec-961b-ca7e03bbb23d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:46.816142 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3708/7362] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:46 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:46.819538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ac3fd-8bc8-47e8-a2b7-89731e70a6a2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.819986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ac3fd-8bc8-47e8-a2b7-89731e70a6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.821512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ac3fd-8bc8-47e8-a2b7-89731e70a6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.857252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7c9ac3fd-8bc8-47e8-a2b7-89731e70a6a2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:46.858716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7c9ac3fd-8bc8-47e8-a2b7-89731e70a6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.870397 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3655/7364] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:46 2022] POST /identity/v3/projects => generated 367 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:46.871828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a9143-89de-4cec-961b-ca7e03bbb23d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:46.874349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b04a9143-89de-4cec-961b-ca7e03bbb23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:46.875327 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3709/7364] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:46.876621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ac3fd-8bc8-47e8-a2b7-89731e70a6a2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:46.889858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ac3fd-8bc8-47e8-a2b7-89731e70a6a2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:46.931620 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:46.950982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a9143-89de-4cec-961b-ca7e03bbb23d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:46.955129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426a27e-5677-4a2a-bb3e-57d9f527eb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:46.955805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426a27e-5677-4a2a-bb3e-57d9f527eb6b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.956111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426a27e-5677-4a2a-bb3e-57d9f527eb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.956389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426a27e-5677-4a2a-bb3e-57d9f527eb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.956919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:46.957114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426a27e-5677-4a2a-bb3e-57d9f527eb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:46.957781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.958124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.958502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] PATH_INFO: `/v3/projects/717d512ff96843dc9481302b63c26463` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.958817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426a27e-5677-4a2a-bb3e-57d9f527eb6b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:46.960259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=717d512ff96843dc9481302b63c26463)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:46.962782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:46.973711 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3710/7365] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:46.973711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426a27e-5677-4a2a-bb3e-57d9f527eb6b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:46.982612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426a27e-5677-4a2a-bb3e-57d9f527eb6b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:46.988381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ba490-5fce-408e-b6c6-fa78b378907b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:46.988961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ba490-5fce-408e-b6c6-fa78b378907b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:46.989213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ba490-5fce-408e-b6c6-fa78b378907b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:46.989489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ba490-5fce-408e-b6c6-fa78b378907b admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:46.990200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ba490-5fce-408e-b6c6-fa78b378907b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:46.992028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ba490-5fce-408e-b6c6-fa78b378907b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:47.018726 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3711/7366] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:46 2022] POST /identity/v3/users => generated 284 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:47.019612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ba490-5fce-408e-b6c6-fa78b378907b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:47.022597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a67ba490-5fce-408e-b6c6-fa78b378907b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:47.026525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717d512ff96843dc9481302b63c26463', 'request_id': 'req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:47.036315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717d512ff96843dc9481302b63c26463', 'request_id': 'req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:47.047575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717d512ff96843dc9481302b63c26463', 'request_id': 'req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:47.062663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] The token cache is being invalidate because project 717d512ff96843dc9481302b63c26463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:47.062983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:47.064530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:47.069798 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3656/7367] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:46 2022] DELETE /identity/v3/projects/717d512ff96843dc9481302b63c26463 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:47.070689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:47.072636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:47.090676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ba490-5fce-408e-b6c6-fa78b378907b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:47.095497 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:47.147069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb6e80-73b1-4cd9-85d4-e3373a3ab593 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:47.148496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf54dcc-5a16-4260-8545-96de756bc0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:47.149114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf54dcc-5a16-4260-8545-96de756bc0aa service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:47.149396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf54dcc-5a16-4260-8545-96de756bc0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:47.149727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf54dcc-5a16-4260-8545-96de756bc0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:47.151536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3cf54dcc-5a16-4260-8545-96de756bc0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:47.152342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dcdf0-0d44-45aa-b4b6-75cf1fe3c22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:47.153056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dcdf0-0d44-45aa-b4b6-75cf1fe3c22d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:47.153412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dcdf0-0d44-45aa-b4b6-75cf1fe3c22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:47.153762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dcdf0-0d44-45aa-b4b6-75cf1fe3c22d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:47.154474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dcdf0-0d44-45aa-b4b6-75cf1fe3c22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:47.156704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dcdf0-0d44-45aa-b4b6-75cf1fe3c22d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:47.166032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf54dcc-5a16-4260-8545-96de756bc0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:47.169684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf54dcc-5a16-4260-8545-96de756bc0aa service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:47.170209 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3657/7368] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:47.171103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dcdf0-0d44-45aa-b4b6-75cf1fe3c22d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:47.173558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-697dcdf0-0d44-45aa-b4b6-75cf1fe3c22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:47.184894 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3712/7369] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:47.185308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf54dcc-5a16-4260-8545-96de756bc0aa service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:47.186652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3cf54dcc-5a16-4260-8545-96de756bc0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:47.189348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dcdf0-0d44-45aa-b4b6-75cf1fe3c22d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:47.194514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7602e6-d8af-445e-9bce-365c20b6628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:47.195237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7602e6-d8af-445e-9bce-365c20b6628a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:47.195520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7602e6-d8af-445e-9bce-365c20b6628a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:47.195894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7602e6-d8af-445e-9bce-365c20b6628a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:47.196606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7602e6-d8af-445e-9bce-365c20b6628a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:47.198952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7602e6-d8af-445e-9bce-365c20b6628a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:47.200334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf54dcc-5a16-4260-8545-96de756bc0aa service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:47.205723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75285a7-e5d9-481c-b7fc-c200e9c0f243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:47.206694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75285a7-e5d9-481c-b7fc-c200e9c0f243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:47.207181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75285a7-e5d9-481c-b7fc-c200e9c0f243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:47.207636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75285a7-e5d9-481c-b7fc-c200e9c0f243 admin admin] PATH_INFO: `/v3/users/0afe58a5cc4343df982b7b99f25827e7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:47.209007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75285a7-e5d9-481c-b7fc-c200e9c0f243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0afe58a5cc4343df982b7b99f25827e7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:47.210573 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3658/7370] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:47.211501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7602e6-d8af-445e-9bce-365c20b6628a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:47.212357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75285a7-e5d9-481c-b7fc-c200e9c0f243 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:47.224434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7602e6-d8af-445e-9bce-365c20b6628a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:47.229643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7410-70fd-4522-a43e-d0e58179c234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:47.230382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7410-70fd-4522-a43e-d0e58179c234 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:47.230741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7410-70fd-4522-a43e-d0e58179c234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:47.231126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7410-70fd-4522-a43e-d0e58179c234 admin admin] PATH_INFO: `/v3/projects/18778c9e91d14fed9e49afc254aa81fd/users/4bdb352285134f4b93ab4879db31c8c1/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:47.249401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d7410-70fd-4522-a43e-d0e58179c234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18778c9e91d14fed9e49afc254aa81fd, user_id=4bdb352285134f4b93ab4879db31c8c1, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:47.253450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d7410-70fd-4522-a43e-d0e58179c234 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:47.271051 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3659/7371] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:47 2022] PUT /identity/v3/projects/18778c9e91d14fed9e49afc254aa81fd/users/4bdb352285134f4b93ab4879db31c8c1/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:47.275155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7410-70fd-4522-a43e-d0e58179c234 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:47.283617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d75285a7-e5d9-481c-b7fc-c200e9c0f243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0afe58a5cc4343df982b7b99f25827e7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:47.285291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d75285a7-e5d9-481c-b7fc-c200e9c0f243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0afe58a5cc4343df982b7b99f25827e7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:47.303975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d75285a7-e5d9-481c-b7fc-c200e9c0f243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0afe58a5cc4343df982b7b99f25827e7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:47.315840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d75285a7-e5d9-481c-b7fc-c200e9c0f243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0afe58a5cc4343df982b7b99f25827e7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:47.317023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d75285a7-e5d9-481c-b7fc-c200e9c0f243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0afe58a5cc4343df982b7b99f25827e7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:47.318999 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:47.342584 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3713/7372] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:47 2022] DELETE /identity/v3/users/0afe58a5cc4343df982b7b99f25827e7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:47.342584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e663303-97ed-4a8e-9d83-c8bee660f4f6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:47.342584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e663303-97ed-4a8e-9d83-c8bee660f4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:47.342584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e663303-97ed-4a8e-9d83-c8bee660f4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:47.360637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7410-70fd-4522-a43e-d0e58179c234 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:47.366760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4e663303-97ed-4a8e-9d83-c8bee660f4f6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:47.368169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4e663303-97ed-4a8e-9d83-c8bee660f4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:47.431862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da5615-472d-45e6-9692-9aea341d5986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:47.433144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da5615-472d-45e6-9692-9aea341d5986 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:47.434063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da5615-472d-45e6-9692-9aea341d5986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:47.434873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da5615-472d-45e6-9692-9aea341d5986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:47.435764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da5615-472d-45e6-9692-9aea341d5986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:47.437852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da5615-472d-45e6-9692-9aea341d5986 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:47.450759 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3714/7373] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:47.464830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e663303-97ed-4a8e-9d83-c8bee660f4f6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:47.466431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4e663303-97ed-4a8e-9d83-c8bee660f4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:47.477555 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3660/7374] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:47.480923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da5615-472d-45e6-9692-9aea341d5986 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:47.485951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-17da5615-472d-45e6-9692-9aea341d5986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:47.510690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da5615-472d-45e6-9692-9aea341d5986 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:47.517400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893817f-e763-4ea8-bcb0-baf085b26000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:47.518364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893817f-e763-4ea8-bcb0-baf085b26000 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:47.518774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893817f-e763-4ea8-bcb0-baf085b26000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:47.519184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893817f-e763-4ea8-bcb0-baf085b26000 admin admin] PATH_INFO: `/v3/projects/3676910f27a54f2e928aa73c78a75602/users/dd498f921baf4e4890c5f29233ac7e7b/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:47.542575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893817f-e763-4ea8-bcb0-baf085b26000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3676910f27a54f2e928aa73c78a75602, user_id=dd498f921baf4e4890c5f29233ac7e7b, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:47.547818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893817f-e763-4ea8-bcb0-baf085b26000 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:47.553916 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:47.575353 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3661/7375] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:47 2022] PUT /identity/v3/projects/3676910f27a54f2e928aa73c78a75602/users/dd498f921baf4e4890c5f29233ac7e7b/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:47.581868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e663303-97ed-4a8e-9d83-c8bee660f4f6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:47.586520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659f93f-04dd-4a48-9155-62881aa67e0a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:47.586887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659f93f-04dd-4a48-9155-62881aa67e0a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:47.587262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659f93f-04dd-4a48-9155-62881aa67e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:47.628443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a659f93f-04dd-4a48-9155-62881aa67e0a None None] MFA Rules not processed for user `dd498f921baf4e4890c5f29233ac7e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:47.629803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a659f93f-04dd-4a48-9155-62881aa67e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:47.713241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c577e-91e1-448d-84c6-2437793b8094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:47.714767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c577e-91e1-448d-84c6-2437793b8094 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:47.715344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c577e-91e1-448d-84c6-2437793b8094 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:47.715814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c577e-91e1-448d-84c6-2437793b8094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:47.751891 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3662/7376] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:34:47.757092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659f93f-04dd-4a48-9155-62881aa67e0a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:47.760495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a659f93f-04dd-4a48-9155-62881aa67e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:47.820011 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:47.828142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c577e-91e1-448d-84c6-2437793b8094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:47.829983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c577e-91e1-448d-84c6-2437793b8094 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:47.855977 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3715/7377] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:47.858266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c577e-91e1-448d-84c6-2437793b8094 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:47.883637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c577e-91e1-448d-84c6-2437793b8094 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:47.895273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a0466-0a02-4348-9b60-1f96e0793f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:47.896057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0466-0a02-4348-9b60-1f96e0793f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:47.896323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0466-0a02-4348-9b60-1f96e0793f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:47.896596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0466-0a02-4348-9b60-1f96e0793f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:47.897324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a0466-0a02-4348-9b60-1f96e0793f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:47.902005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a0466-0a02-4348-9b60-1f96e0793f90 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:47.914616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659f93f-04dd-4a48-9155-62881aa67e0a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:47.920965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:47.921751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:47.922653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:47.923145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] PATH_INFO: `/v3/projects/264d375b991b41e39c7f903376c346e7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:47.924528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=264d375b991b41e39c7f903376c346e7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:47.926757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:47.958847 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3716/7378] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:47 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:47.958847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a0466-0a02-4348-9b60-1f96e0793f90 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:47.963582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6f9a0466-0a02-4348-9b60-1f96e0793f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:47.992764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264d375b991b41e39c7f903376c346e7', 'request_id': 'req-66ee9c68-f34f-4fe7-8da7-5ebb58592116'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:47.999665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264d375b991b41e39c7f903376c346e7', 'request_id': 'req-66ee9c68-f34f-4fe7-8da7-5ebb58592116'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.008503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264d375b991b41e39c7f903376c346e7', 'request_id': 'req-66ee9c68-f34f-4fe7-8da7-5ebb58592116'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.023145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] The token cache is being invalidate because project 264d375b991b41e39c7f903376c346e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:48.023524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.024330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.029327 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3663/7379] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:47 2022] DELETE /identity/v3/projects/264d375b991b41e39c7f903376c346e7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:48.029327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:48.029327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:48.056304 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:48.057664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a0466-0a02-4348-9b60-1f96e0793f90 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:48.123772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee9c68-f34f-4fe7-8da7-5ebb58592116 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:48.129746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c1455-be57-49d6-be34-1e5310eb718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:48.130396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c1455-be57-49d6-be34-1e5310eb718c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.130675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c1455-be57-49d6-be34-1e5310eb718c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.130977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c1455-be57-49d6-be34-1e5310eb718c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:48.131931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c1455-be57-49d6-be34-1e5310eb718c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:48.135373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c1455-be57-49d6-be34-1e5310eb718c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:48.150484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:48.151707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.152039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.152524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] PATH_INFO: `/v3/projects/0901e2e12cda4feda7568f48c611f6e4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:48.154047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0901e2e12cda4feda7568f48c611f6e4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:48.157079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:48.164205 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3664/7380] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:48 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:48.165816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063a9a-f6fd-4e19-b198-e8c3b93cef14 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.166174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063a9a-f6fd-4e19-b198-e8c3b93cef14 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.166518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063a9a-f6fd-4e19-b198-e8c3b93cef14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:48.205234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-17063a9a-f6fd-4e19-b198-e8c3b93cef14 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:48.206767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-17063a9a-f6fd-4e19-b198-e8c3b93cef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:48.215835 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3665/7381] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:48.217032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17063a9a-f6fd-4e19-b198-e8c3b93cef14 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:48.231447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17063a9a-f6fd-4e19-b198-e8c3b93cef14 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:48.242383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cd012-9aca-4ba5-bbef-4cebdc6cb44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:48.243480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cd012-9aca-4ba5-bbef-4cebdc6cb44a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.245568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cd012-9aca-4ba5-bbef-4cebdc6cb44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.246029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cd012-9aca-4ba5-bbef-4cebdc6cb44a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:48.248166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cd012-9aca-4ba5-bbef-4cebdc6cb44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:48.252960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cd012-9aca-4ba5-bbef-4cebdc6cb44a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:48.272406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0901e2e12cda4feda7568f48c611f6e4', 'request_id': 'req-af0bc916-a5cb-4974-8e55-46233ee7e6b5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.283425 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3666/7382] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:48.283425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f847b3f-cdf1-4d63-9328-8a02a6288458 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.283425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f847b3f-cdf1-4d63-9328-8a02a6288458 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.284636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0901e2e12cda4feda7568f48c611f6e4', 'request_id': 'req-af0bc916-a5cb-4974-8e55-46233ee7e6b5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.286530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f847b3f-cdf1-4d63-9328-8a02a6288458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:48.303451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0901e2e12cda4feda7568f48c611f6e4', 'request_id': 'req-af0bc916-a5cb-4974-8e55-46233ee7e6b5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.316037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7f847b3f-cdf1-4d63-9328-8a02a6288458 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:48.317993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7f847b3f-cdf1-4d63-9328-8a02a6288458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:48.324779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] The token cache is being invalidate because project 0901e2e12cda4feda7568f48c611f6e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:48.325343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.326229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.332557 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3717/7383] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:47 2022] DELETE /identity/v3/projects/0901e2e12cda4feda7568f48c611f6e4 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:48.334033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:48.335754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:48.352061 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:48.441650 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3667/7384] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:48.443179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f847b3f-cdf1-4d63-9328-8a02a6288458 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:48.445363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7f847b3f-cdf1-4d63-9328-8a02a6288458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:48.450616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bc916-a5cb-4974-8e55-46233ee7e6b5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:48.458576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5f0d0-b597-40b7-9917-513ae731a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:48.459298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5f0d0-b597-40b7-9917-513ae731a04e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.459744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5f0d0-b597-40b7-9917-513ae731a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.460160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5f0d0-b597-40b7-9917-513ae731a04e admin admin] PATH_INFO: `/v3/projects/8f945c6ef9204af38161ac451f73ee25/users/df9b7124dcd5471f8411ace22a0994f3/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:48.462374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f847b3f-cdf1-4d63-9328-8a02a6288458 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:48.469906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:48.471147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.471540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.471928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] PATH_INFO: `/v3/users/bb4b3c86e3e0407f9f4a5924c9ff8610` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:48.473549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4b3c86e3e0407f9f4a5924c9ff8610)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:48.475889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:48.481027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5f0d0-b597-40b7-9917-513ae731a04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f945c6ef9204af38161ac451f73ee25, user_id=df9b7124dcd5471f8411ace22a0994f3, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:48.486221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5f0d0-b597-40b7-9917-513ae731a04e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:48.511312 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3718/7385] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:48 2022] PUT /identity/v3/projects/8f945c6ef9204af38161ac451f73ee25/users/df9b7124dcd5471f8411ace22a0994f3/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:48.512493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5f0d0-b597-40b7-9917-513ae731a04e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:48.541537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4b3c86e3e0407f9f4a5924c9ff8610'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.542208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4b3c86e3e0407f9f4a5924c9ff8610'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.567827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4b3c86e3e0407f9f4a5924c9ff8610'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.577742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4b3c86e3e0407f9f4a5924c9ff8610'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.579113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4b3c86e3e0407f9f4a5924c9ff8610'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:48.589948 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:48.597908 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3668/7386] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:48 2022] DELETE /identity/v3/users/bb4b3c86e3e0407f9f4a5924c9ff8610 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:48.598420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:48.600142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:48.603576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5f0d0-b597-40b7-9917-513ae731a04e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:48.714355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b5653-7a7d-4fef-b096-69b473fd05bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:48.715003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5653-7a7d-4fef-b096-69b473fd05bd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.715286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5653-7a7d-4fef-b096-69b473fd05bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.715557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5653-7a7d-4fef-b096-69b473fd05bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:48.716324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b5653-7a7d-4fef-b096-69b473fd05bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:48.717410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b5653-7a7d-4fef-b096-69b473fd05bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:48.719765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b5653-7a7d-4fef-b096-69b473fd05bd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:48.721260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43480cdd-2fc9-414e-8dd8-7b92853add7d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:48.738135 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3719/7387] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:48.738352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3b685-ecfe-45ec-a86c-db6adf0e9b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:48.738352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3b685-ecfe-45ec-a86c-db6adf0e9b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.738616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e89cf-e27c-4a89-a2ec-d44ebf87e680 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.738715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3b685-ecfe-45ec-a86c-db6adf0e9b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.738858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e89cf-e27c-4a89-a2ec-d44ebf87e680 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.739001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3b685-ecfe-45ec-a86c-db6adf0e9b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:48.740027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e89cf-e27c-4a89-a2ec-d44ebf87e680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:48.740199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3b685-ecfe-45ec-a86c-db6adf0e9b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:48.740199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3b685-ecfe-45ec-a86c-db6adf0e9b4e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:48.769510 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3669/7388] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:48.769799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4a5e89cf-e27c-4a89-a2ec-d44ebf87e680 None None] MFA Rules not processed for user `4bdb352285134f4b93ab4879db31c8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:48.771332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4a5e89cf-e27c-4a89-a2ec-d44ebf87e680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:48.773800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3b685-ecfe-45ec-a86c-db6adf0e9b4e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:48.775714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b6f3b685-ecfe-45ec-a86c-db6adf0e9b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:48.791822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3b685-ecfe-45ec-a86c-db6adf0e9b4e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:48.798394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c152-15da-4149-9ccc-1d0cfcd5404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:48.799238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c152-15da-4149-9ccc-1d0cfcd5404e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.799636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c152-15da-4149-9ccc-1d0cfcd5404e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.800102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c152-15da-4149-9ccc-1d0cfcd5404e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:48.800995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44c152-15da-4149-9ccc-1d0cfcd5404e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:48.803289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44c152-15da-4149-9ccc-1d0cfcd5404e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:48.831745 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:48.845700 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3670/7389] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:48 2022] POST /identity/v3/projects => generated 359 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:48.847252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c152-15da-4149-9ccc-1d0cfcd5404e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:48.910491 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3720/7390] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:48.911925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e89cf-e27c-4a89-a2ec-d44ebf87e680 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:48.931072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e89cf-e27c-4a89-a2ec-d44ebf87e680 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:48.933520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c152-15da-4149-9ccc-1d0cfcd5404e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:48.936402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37720f-ab30-4574-83e8-1248fd9d00ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:48.937078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37720f-ab30-4574-83e8-1248fd9d00ab admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.937978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37720f-ab30-4574-83e8-1248fd9d00ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.938327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37720f-ab30-4574-83e8-1248fd9d00ab admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:48.939114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37720f-ab30-4574-83e8-1248fd9d00ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:48.939669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90a945-2064-481a-9478-5718a15c8afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:48.940417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90a945-2064-481a-9478-5718a15c8afb admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.940767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90a945-2064-481a-9478-5718a15c8afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.941113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90a945-2064-481a-9478-5718a15c8afb admin admin] PATH_INFO: `/v3/projects/8f945c6ef9204af38161ac451f73ee25/users/df9b7124dcd5471f8411ace22a0994f3/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:48.941427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37720f-ab30-4574-83e8-1248fd9d00ab admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:48.943569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90a945-2064-481a-9478-5718a15c8afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f945c6ef9204af38161ac451f73ee25, user_id=df9b7124dcd5471f8411ace22a0994f3, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:48.946282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90a945-2064-481a-9478-5718a15c8afb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:48.962625 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3671/7391] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:48 2022] PUT /identity/v3/projects/8f945c6ef9204af38161ac451f73ee25/users/df9b7124dcd5471f8411ace22a0994f3/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:48.963943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90a945-2064-481a-9478-5718a15c8afb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:48.966286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2b90a945-2064-481a-9478-5718a15c8afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:48.978982 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3721/7392] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:48 2022] POST /identity/v3/users => generated 280 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:48.980233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4637b-7c0e-4e84-bc8b-5d26b679ce1c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:48.980636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4637b-7c0e-4e84-bc8b-5d26b679ce1c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:48.981690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4637b-7c0e-4e84-bc8b-5d26b679ce1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.018595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f8a4637b-7c0e-4e84-bc8b-5d26b679ce1c None None] MFA Rules not processed for user `df9b7124dcd5471f8411ace22a0994f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:49.024154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f8a4637b-7c0e-4e84-bc8b-5d26b679ce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:49.056337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90a945-2064-481a-9478-5718a15c8afb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:49.060711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5236d7a-e3b7-4e3d-a4a3-f9d4fb0cb445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:49.061829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5236d7a-e3b7-4e3d-a4a3-f9d4fb0cb445 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.062186 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5236d7a-e3b7-4e3d-a4a3-f9d4fb0cb445 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.063125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5236d7a-e3b7-4e3d-a4a3-f9d4fb0cb445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.088114 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:49.121495 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3722/7393] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:49.122202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4637b-7c0e-4e84-bc8b-5d26b679ce1c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:49.135097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5236d7a-e3b7-4e3d-a4a3-f9d4fb0cb445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:49.136706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5236d7a-e3b7-4e3d-a4a3-f9d4fb0cb445 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:49.146304 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3672/7394] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:49.147404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5236d7a-e3b7-4e3d-a4a3-f9d4fb0cb445 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:49.148949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c5236d7a-e3b7-4e3d-a4a3-f9d4fb0cb445 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:49.204743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4637b-7c0e-4e84-bc8b-5d26b679ce1c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:49.213079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1717379-0a5f-4e6d-aeea-1228ae377957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:49.213823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1717379-0a5f-4e6d-aeea-1228ae377957 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.214235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1717379-0a5f-4e6d-aeea-1228ae377957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.214697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1717379-0a5f-4e6d-aeea-1228ae377957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.215493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1717379-0a5f-4e6d-aeea-1228ae377957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:49.217214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1717379-0a5f-4e6d-aeea-1228ae377957 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:49.230364 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3723/7395] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:49.235212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1717379-0a5f-4e6d-aeea-1228ae377957 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:49.240985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5236d7a-e3b7-4e3d-a4a3-f9d4fb0cb445 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:49.245869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:49.246515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.247087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.247373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] PATH_INFO: `/v3/projects/5ca80bb39bd34c08bc3a1d40d8ede3cd` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.248537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca80bb39bd34c08bc3a1d40d8ede3cd)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:49.251168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:49.256343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1717379-0a5f-4e6d-aeea-1228ae377957 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:49.267306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba178b-af94-49fc-9815-e4c0c0e6d6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:49.268200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba178b-af94-49fc-9815-e4c0c0e6d6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.269308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba178b-af94-49fc-9815-e4c0c0e6d6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.269749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba178b-af94-49fc-9815-e4c0c0e6d6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.270622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba178b-af94-49fc-9815-e4c0c0e6d6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:49.272797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba178b-af94-49fc-9815-e4c0c0e6d6b1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:49.287585 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3724/7396] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:49.287585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba178b-af94-49fc-9815-e4c0c0e6d6b1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:49.289858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-60ba178b-af94-49fc-9815-e4c0c0e6d6b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:49.318300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba178b-af94-49fc-9815-e4c0c0e6d6b1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:49.321252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca80bb39bd34c08bc3a1d40d8ede3cd', 'request_id': 'req-6a745d32-10ca-4615-b73d-639844da4fb0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:49.333175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca80bb39bd34c08bc3a1d40d8ede3cd', 'request_id': 'req-6a745d32-10ca-4615-b73d-639844da4fb0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:49.337699 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:49.347318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca80bb39bd34c08bc3a1d40d8ede3cd', 'request_id': 'req-6a745d32-10ca-4615-b73d-639844da4fb0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:49.376188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] The token cache is being invalidate because project 5ca80bb39bd34c08bc3a1d40d8ede3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:49.376902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:49.377819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:49.380597 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3673/7397] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:49 2022] DELETE /identity/v3/projects/5ca80bb39bd34c08bc3a1d40d8ede3cd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:49.383820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:49.386384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:49.397106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b7e87-c41b-4429-98ff-e8c14b50d791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:49.398134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7e87-c41b-4429-98ff-e8c14b50d791 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.398694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7e87-c41b-4429-98ff-e8c14b50d791 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.399417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7e87-c41b-4429-98ff-e8c14b50d791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.402741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e48b7e87-c41b-4429-98ff-e8c14b50d791 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:49.457758 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:49.474360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a745d32-10ca-4615-b73d-639844da4fb0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:49.481745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e770176-93e2-4727-b76e-26524dff9dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:49.483110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770176-93e2-4727-b76e-26524dff9dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.483393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770176-93e2-4727-b76e-26524dff9dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.483717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770176-93e2-4727-b76e-26524dff9dfc admin admin] PATH_INFO: `/v3/projects/fb08edc443064c64b8b7279ad6e38f75/users/3143b7d627e94a1cb751968ed622ccb6/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.514586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e770176-93e2-4727-b76e-26524dff9dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb08edc443064c64b8b7279ad6e38f75, user_id=3143b7d627e94a1cb751968ed622ccb6, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:49.517772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e770176-93e2-4727-b76e-26524dff9dfc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:49.539729 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3674/7398] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:49 2022] PUT /identity/v3/projects/fb08edc443064c64b8b7279ad6e38f75/users/3143b7d627e94a1cb751968ed622ccb6/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:49.541756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3aaf9-e4c5-440f-a3b5-e7694dccb895 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.542100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3aaf9-e4c5-440f-a3b5-e7694dccb895 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.542381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3aaf9-e4c5-440f-a3b5-e7694dccb895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.549853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b7e87-c41b-4429-98ff-e8c14b50d791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:49.551372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b7e87-c41b-4429-98ff-e8c14b50d791 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:49.577343 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3725/7399] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:49.578703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca153f8-df79-453d-b6bd-5d42180ce66f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.579191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca153f8-df79-453d-b6bd-5d42180ce66f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.579391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca153f8-df79-453d-b6bd-5d42180ce66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.620007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-68b3aaf9-e4c5-440f-a3b5-e7694dccb895 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:49.621409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-68b3aaf9-e4c5-440f-a3b5-e7694dccb895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:49.622983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5ca153f8-df79-453d-b6bd-5d42180ce66f None None] MFA Rules not processed for user `3143b7d627e94a1cb751968ed622ccb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:49.624246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5ca153f8-df79-453d-b6bd-5d42180ce66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:49.735546 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3675/7400] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:49.736525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3aaf9-e4c5-440f-a3b5-e7694dccb895 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:49.737929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-68b3aaf9-e4c5-440f-a3b5-e7694dccb895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:49.741646 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3726/7401] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:49.745299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79994756-7df2-4a6d-8dc6-037378b839f8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.745299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79994756-7df2-4a6d-8dc6-037378b839f8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.745299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79994756-7df2-4a6d-8dc6-037378b839f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.774727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-79994756-7df2-4a6d-8dc6-037378b839f8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:49.776465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79994756-7df2-4a6d-8dc6-037378b839f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:49.789293 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3727/7402] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:49.794293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482ec1a-bf51-4657-b241-60e5e1991ec3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.795003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482ec1a-bf51-4657-b241-60e5e1991ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.795286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482ec1a-bf51-4657-b241-60e5e1991ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.815112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3aaf9-e4c5-440f-a3b5-e7694dccb895 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:49.819854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c482ec1a-bf51-4657-b241-60e5e1991ec3 None None] MFA Rules not processed for user `3143b7d627e94a1cb751968ed622ccb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:49.820709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c482ec1a-bf51-4657-b241-60e5e1991ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:49.821402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71407d8f-253f-4e41-9bf0-19cbf3868fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:49.822020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71407d8f-253f-4e41-9bf0-19cbf3868fac service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.822417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71407d8f-253f-4e41-9bf0-19cbf3868fac service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.822714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71407d8f-253f-4e41-9bf0-19cbf3868fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.824359 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3728/7403] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:49 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:34:49.825033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482ec1a-bf51-4657-b241-60e5e1991ec3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:49.829202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-71407d8f-253f-4e41-9bf0-19cbf3868fac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:49.839628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482ec1a-bf51-4657-b241-60e5e1991ec3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:49.845556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f13c3-70ac-41e0-b1ea-23149aab02c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:49.846166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f13c3-70ac-41e0-b1ea-23149aab02c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.846450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f13c3-70ac-41e0-b1ea-23149aab02c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.846725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f13c3-70ac-41e0-b1ea-23149aab02c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.847623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f13c3-70ac-41e0-b1ea-23149aab02c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:49.847929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f13c3-70ac-41e0-b1ea-23149aab02c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:49.850429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f13c3-70ac-41e0-b1ea-23149aab02c8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:49.870536 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3729/7404] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:49.876313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876533b-0fe9-486b-b2d3-63e09b30f084 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.876805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876533b-0fe9-486b-b2d3-63e09b30f084 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.877649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876533b-0fe9-486b-b2d3-63e09b30f084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.904678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2876533b-0fe9-486b-b2d3-63e09b30f084 None None] MFA Rules not processed for user `3143b7d627e94a1cb751968ed622ccb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:49.907349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2876533b-0fe9-486b-b2d3-63e09b30f084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:49.911750 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3730/7405] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:49 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:34:49.912719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876533b-0fe9-486b-b2d3-63e09b30f084 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:49.922394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71407d8f-253f-4e41-9bf0-19cbf3868fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:49.924465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71407d8f-253f-4e41-9bf0-19cbf3868fac service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:49.927329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876533b-0fe9-486b-b2d3-63e09b30f084 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:49.933485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cba3be-0f32-4640-8190-06068f729c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:49.934578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cba3be-0f32-4640-8190-06068f729c3f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.935070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cba3be-0f32-4640-8190-06068f729c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.935508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cba3be-0f32-4640-8190-06068f729c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.936450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cba3be-0f32-4640-8190-06068f729c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:49.938477 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3676/7406] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:49.939317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71407d8f-253f-4e41-9bf0-19cbf3868fac service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:49.950741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71407d8f-253f-4e41-9bf0-19cbf3868fac service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:49.951651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cba3be-0f32-4640-8190-06068f729c3f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:49.958634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758f920-b158-4a35-bc08-ddbd89f271e7 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3143b7d627e94a1cb751968ed622ccb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb08edc443064c64b8b7279ad6e38f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:49.959420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758f920-b158-4a35-bc08-ddbd89f271e7 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] REQUEST_METHOD: `HEAD` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:49.959804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758f920-b158-4a35-bc08-ddbd89f271e7 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:49.960183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758f920-b158-4a35-bc08-ddbd89f271e7 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:49.969771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758f920-b158-4a35-bc08-ddbd89f271e7 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: Authorizing `identity:check_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:49.971849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758f920-b158-4a35-bc08-ddbd89f271e7 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:49.979570 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3677/7407] 10.222.0.39 () {56 vars in 1264 bytes} [Sun Oct 16 01:34:49 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Oct 16 01:34:49.983903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758f920-b158-4a35-bc08-ddbd89f271e7 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:49.995530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758f920-b158-4a35-bc08-ddbd89f271e7 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:50.002112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0643-a8d6-4cad-9c46-b3d300e525e2 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3143b7d627e94a1cb751968ed622ccb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb08edc443064c64b8b7279ad6e38f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:50.003264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0643-a8d6-4cad-9c46-b3d300e525e2 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.003772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0643-a8d6-4cad-9c46-b3d300e525e2 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.004207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0643-a8d6-4cad-9c46-b3d300e525e2 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.015986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d0643-a8d6-4cad-9c46-b3d300e525e2 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:50.020793 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3731/7408] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:49 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:50.020950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d0643-a8d6-4cad-9c46-b3d300e525e2 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:50.021966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cba3be-0f32-4640-8190-06068f729c3f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:50.032639 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3678/7409] 10.222.0.39 () {56 vars in 1263 bytes} [Sun Oct 16 01:34:49 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:50.034476 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:50.040595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0643-a8d6-4cad-9c46-b3d300e525e2 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:50.052331 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:50.058095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0643-a8d6-4cad-9c46-b3d300e525e2 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:50.142092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69242e84-aa81-4406-a6a5-a581ad6537c0 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3143b7d627e94a1cb751968ed622ccb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb08edc443064c64b8b7279ad6e38f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:50.142719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69242e84-aa81-4406-a6a5-a581ad6537c0 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.143035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69242e84-aa81-4406-a6a5-a581ad6537c0 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.143310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69242e84-aa81-4406-a6a5-a581ad6537c0 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.150635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69242e84-aa81-4406-a6a5-a581ad6537c0 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:50.152733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69242e84-aa81-4406-a6a5-a581ad6537c0 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:50.167349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cba3be-0f32-4640-8190-06068f729c3f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:50.172419 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3679/7410] 10.222.0.39 () {56 vars in 1266 bytes} [Sun Oct 16 01:34:50 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:50.176372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69242e84-aa81-4406-a6a5-a581ad6537c0 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:50.176559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2556dd-d017-486d-81fe-9750b1c73e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:50.177132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2556dd-d017-486d-81fe-9750b1c73e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.177414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2556dd-d017-486d-81fe-9750b1c73e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.177690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2556dd-d017-486d-81fe-9750b1c73e21 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.178332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2556dd-d017-486d-81fe-9750b1c73e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:50.180309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2556dd-d017-486d-81fe-9750b1c73e21 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:50.198840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69242e84-aa81-4406-a6a5-a581ad6537c0 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:50.211977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e28a7-d043-4712-b541-f178a7e03a92 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3143b7d627e94a1cb751968ed622ccb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb08edc443064c64b8b7279ad6e38f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:50.213265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e28a7-d043-4712-b541-f178a7e03a92 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] REQUEST_METHOD: `HEAD` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.213550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e28a7-d043-4712-b541-f178a7e03a92 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.214131 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3732/7411] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:50 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:50.214367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e28a7-d043-4712-b541-f178a7e03a92 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.216615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7d7e28a7-d043-4712-b541-f178a7e03a92 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:50.218886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2556dd-d017-486d-81fe-9750b1c73e21 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:50.239549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2556dd-d017-486d-81fe-9750b1c73e21 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-7d7e28a7-d043-4712-b541-f178a7e03a92 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 16 01:34:50.245517 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 16 01:34:50.247083 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 16 01:34:50.248313 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:50.248313 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:50.248313 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 16 01:34:50.248313 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 16 01:34:50.248313 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 16 01:34:50.248313 n-d-master-1 devstack@keystone.service[81805]: ERROR keystone.server.flask.application Oct 16 01:34:50.248313 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3680/7412] 10.222.0.39 () {56 vars in 1264 bytes} [Sun Oct 16 01:34:50 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Oct 16 01:34:50.258325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29fed-e599-4472-8033-9fac6170a513 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.258635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29fed-e599-4472-8033-9fac6170a513 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.259596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29fed-e599-4472-8033-9fac6170a513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.261614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8979-67d6-4e01-b44f-2d7dc8a02f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:50.262575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8979-67d6-4e01-b44f-2d7dc8a02f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.262979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8979-67d6-4e01-b44f-2d7dc8a02f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.263382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8979-67d6-4e01-b44f-2d7dc8a02f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.264026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf8979-67d6-4e01-b44f-2d7dc8a02f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:50.266868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf8979-67d6-4e01-b44f-2d7dc8a02f03 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:50.289398 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3733/7413] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:50.293586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8979-67d6-4e01-b44f-2d7dc8a02f03 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:50.296707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-06b29fed-e599-4472-8033-9fac6170a513 None None] MFA Rules not processed for user `3143b7d627e94a1cb751968ed622ccb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:50.298209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-06b29fed-e599-4472-8033-9fac6170a513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:50.304763 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3681/7414] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:50 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 01:34:50.305600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b29fed-e599-4472-8033-9fac6170a513 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:50.312777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8979-67d6-4e01-b44f-2d7dc8a02f03 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:50.320813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b29fed-e599-4472-8033-9fac6170a513 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:50.326090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f34c-a5ba-4e24-98e6-cb9d5f804f48 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3143b7d627e94a1cb751968ed622ccb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb08edc443064c64b8b7279ad6e38f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:50.326551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f34c-a5ba-4e24-98e6-cb9d5f804f48 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.326882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f34c-a5ba-4e24-98e6-cb9d5f804f48 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.327191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f34c-a5ba-4e24-98e6-cb9d5f804f48 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.335469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585f34c-a5ba-4e24-98e6-cb9d5f804f48 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:50.336540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75829e9a-00d8-40f4-95f8-e1abd68be38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:50.337285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585f34c-a5ba-4e24-98e6-cb9d5f804f48 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:50.338757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75829e9a-00d8-40f4-95f8-e1abd68be38e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.340702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75829e9a-00d8-40f4-95f8-e1abd68be38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.341105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75829e9a-00d8-40f4-95f8-e1abd68be38e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.341851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75829e9a-00d8-40f4-95f8-e1abd68be38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:50.345598 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3682/7415] 10.222.0.39 () {56 vars in 1263 bytes} [Sun Oct 16 01:34:50 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:50.349048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75829e9a-00d8-40f4-95f8-e1abd68be38e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:50.350207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f34c-a5ba-4e24-98e6-cb9d5f804f48 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:50.362374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f34c-a5ba-4e24-98e6-cb9d5f804f48 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:50.369293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efb596-cd23-4039-8ced-fb9240eda196 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3143b7d627e94a1cb751968ed622ccb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb08edc443064c64b8b7279ad6e38f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:50.370043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efb596-cd23-4039-8ced-fb9240eda196 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.370326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efb596-cd23-4039-8ced-fb9240eda196 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.370600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efb596-cd23-4039-8ced-fb9240eda196 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.379292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efb596-cd23-4039-8ced-fb9240eda196 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:50.380916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efb596-cd23-4039-8ced-fb9240eda196 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:50.405162 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3734/7417] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:50.405322 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3683/7417] 10.222.0.39 () {56 vars in 1266 bytes} [Sun Oct 16 01:34:50 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:50.405454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75829e9a-00d8-40f4-95f8-e1abd68be38e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:50.406724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efb596-cd23-4039-8ced-fb9240eda196 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:50.423493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efb596-cd23-4039-8ced-fb9240eda196 tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:50.427858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78ab46-003d-4b45-8c77-eb292f0c1733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:50.428537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78ab46-003d-4b45-8c77-eb292f0c1733 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.428870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78ab46-003d-4b45-8c77-eb292f0c1733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.429874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78ab46-003d-4b45-8c77-eb292f0c1733 admin admin] PATH_INFO: `/v3/projects/59856008e5d1474a916e494267001984/users/94aefc3d45e24a2a90c1e4eac92b2697/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.445731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75829e9a-00d8-40f4-95f8-e1abd68be38e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:50.454284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78ab46-003d-4b45-8c77-eb292f0c1733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59856008e5d1474a916e494267001984, user_id=94aefc3d45e24a2a90c1e4eac92b2697, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:50.457409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785afa5-b9fd-4aa5-a161-0c326d8a297e tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3143b7d627e94a1cb751968ed622ccb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb08edc443064c64b8b7279ad6e38f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:50.457776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78ab46-003d-4b45-8c77-eb292f0c1733 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:50.458471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785afa5-b9fd-4aa5-a161-0c326d8a297e tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.461542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785afa5-b9fd-4aa5-a161-0c326d8a297e tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.461907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785afa5-b9fd-4aa5-a161-0c326d8a297e tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.468285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3785afa5-b9fd-4aa5-a161-0c326d8a297e tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:50.478119 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3684/7418] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:50 2022] PUT /identity/v3/projects/59856008e5d1474a916e494267001984/users/94aefc3d45e24a2a90c1e4eac92b2697/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:50.490909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c98f6-31ed-4bbd-9487-5e54a9255eb8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.495245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c98f6-31ed-4bbd-9487-5e54a9255eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.495537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c98f6-31ed-4bbd-9487-5e54a9255eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3785afa5-b9fd-4aa5-a161-0c326d8a297e tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 16 01:34:50.497796 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 16 01:34:50.499240 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 16 01:34:50.501258 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 01:34:50.501258 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 01:34:50.501258 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 16 01:34:50.501258 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 16 01:34:50.501258 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 16 01:34:50.501258 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:34:50.502780 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3735/7419] 10.222.0.39 () {56 vars in 1263 bytes} [Sun Oct 16 01:34:50 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 01:34:50.509122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785afa5-b9fd-4aa5-a161-0c326d8a297e tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:50.542302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785afa5-b9fd-4aa5-a161-0c326d8a297e tempest-TokensV3Test-207147966 tempest-TokensV3Test-207147966-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:50.560732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-609c98f6-31ed-4bbd-9487-5e54a9255eb8 None None] MFA Rules not processed for user `94aefc3d45e24a2a90c1e4eac92b2697`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:50.565785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-609c98f6-31ed-4bbd-9487-5e54a9255eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:50.693003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72348170-ed31-4ca6-83a5-96fd99efd613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:50.694035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72348170-ed31-4ca6-83a5-96fd99efd613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.694438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72348170-ed31-4ca6-83a5-96fd99efd613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.694882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72348170-ed31-4ca6-83a5-96fd99efd613 admin admin] PATH_INFO: `/v3/users/3143b7d627e94a1cb751968ed622ccb6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.696279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72348170-ed31-4ca6-83a5-96fd99efd613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3143b7d627e94a1cb751968ed622ccb6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:50.698599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72348170-ed31-4ca6-83a5-96fd99efd613 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:50.719692 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3685/7420] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:50.731698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c98f6-31ed-4bbd-9487-5e54a9255eb8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:50.767018 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:50.784475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72348170-ed31-4ca6-83a5-96fd99efd613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3143b7d627e94a1cb751968ed622ccb6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:50.785462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72348170-ed31-4ca6-83a5-96fd99efd613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3143b7d627e94a1cb751968ed622ccb6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:50.811280 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:50.815317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72348170-ed31-4ca6-83a5-96fd99efd613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3143b7d627e94a1cb751968ed622ccb6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:50.827644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72348170-ed31-4ca6-83a5-96fd99efd613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3143b7d627e94a1cb751968ed622ccb6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:50.829265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c98f6-31ed-4bbd-9487-5e54a9255eb8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:50.829542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-72348170-ed31-4ca6-83a5-96fd99efd613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3143b7d627e94a1cb751968ed622ccb6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:50.834220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777b043-cc67-49c3-937f-c7cd4d58a8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:50.835216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777b043-cc67-49c3-937f-c7cd4d58a8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.835500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777b043-cc67-49c3-937f-c7cd4d58a8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.835776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777b043-cc67-49c3-937f-c7cd4d58a8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.838753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c777b043-cc67-49c3-937f-c7cd4d58a8b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:50.846521 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3736/7421] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:50 2022] DELETE /identity/v3/users/3143b7d627e94a1cb751968ed622ccb6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:50.851822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1d8ee-3d01-4ef2-86db-03df3b24976b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:50.852853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1d8ee-3d01-4ef2-86db-03df3b24976b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:50.853253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1d8ee-3d01-4ef2-86db-03df3b24976b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:50.853688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777b043-cc67-49c3-937f-c7cd4d58a8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:50.855206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777b043-cc67-49c3-937f-c7cd4d58a8b2 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:50.866881 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3686/7422] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:34:50.877827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9aa1d8ee-3d01-4ef2-86db-03df3b24976b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:50.879236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9aa1d8ee-3d01-4ef2-86db-03df3b24976b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:50.952151 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3737/7423] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:50.962345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777b043-cc67-49c3-937f-c7cd4d58a8b2 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:50.964918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c777b043-cc67-49c3-937f-c7cd4d58a8b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:51.041202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777b043-cc67-49c3-937f-c7cd4d58a8b2 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:51.135068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de5481-dfe2-4a04-a5e6-49026353b9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:51.136195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de5481-dfe2-4a04-a5e6-49026353b9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:51.136807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de5481-dfe2-4a04-a5e6-49026353b9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:51.137261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de5481-dfe2-4a04-a5e6-49026353b9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:51.151725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de5481-dfe2-4a04-a5e6-49026353b9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:51.154167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de5481-dfe2-4a04-a5e6-49026353b9f5 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:51.165922 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3687/7424] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:51.496865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1d8ee-3d01-4ef2-86db-03df3b24976b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:51.499882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9aa1d8ee-3d01-4ef2-86db-03df3b24976b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:51.528449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1d8ee-3d01-4ef2-86db-03df3b24976b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:51.575241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:51.576158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:51.576601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:51.577083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f admin admin] PATH_INFO: `/v3/projects/fb08edc443064c64b8b7279ad6e38f75` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:51.579620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb08edc443064c64b8b7279ad6e38f75)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:51.582398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:51.692759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb08edc443064c64b8b7279ad6e38f75', 'request_id': 'req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:51.704749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb08edc443064c64b8b7279ad6e38f75', 'request_id': 'req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:51.712068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb08edc443064c64b8b7279ad6e38f75', 'request_id': 'req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:51.727364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f admin admin] The token cache is being invalidate because project fb08edc443064c64b8b7279ad6e38f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:51.727658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:51.728454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-086b65b8-abb9-474f-b9f9-9c2c1d68ad4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:51.733539 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3738/7425] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:51 2022] DELETE /identity/v3/projects/fb08edc443064c64b8b7279ad6e38f75 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:51.735458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0ca4c-43ac-4d61-b518-1e5a3c0765a4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:51.736020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0ca4c-43ac-4d61-b518-1e5a3c0765a4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:51.736020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0ca4c-43ac-4d61-b518-1e5a3c0765a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:51.761444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e3a0ca4c-43ac-4d61-b518-1e5a3c0765a4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:51.762939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e3a0ca4c-43ac-4d61-b518-1e5a3c0765a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:51.910263 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3688/7426] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:51.912756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d44691-57ee-4ab7-978c-11e77f8ecfed None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:51.913224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d44691-57ee-4ab7-978c-11e77f8ecfed None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:51.913624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d44691-57ee-4ab7-978c-11e77f8ecfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:51.954012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-09d44691-57ee-4ab7-978c-11e77f8ecfed None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:51.955587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-09d44691-57ee-4ab7-978c-11e77f8ecfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:51.967911 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3739/7427] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:51.969343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0ca4c-43ac-4d61-b518-1e5a3c0765a4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:51.980948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0ca4c-43ac-4d61-b518-1e5a3c0765a4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:51.987788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413503e-ca84-4887-a63a-5ed1140302cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:51.988592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413503e-ca84-4887-a63a-5ed1140302cf admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:51.988968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413503e-ca84-4887-a63a-5ed1140302cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:51.989335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413503e-ca84-4887-a63a-5ed1140302cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:51.990281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413503e-ca84-4887-a63a-5ed1140302cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:51.990678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413503e-ca84-4887-a63a-5ed1140302cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:51.993230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413503e-ca84-4887-a63a-5ed1140302cf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:52.025246 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3689/7428] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:52.029733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d44691-57ee-4ab7-978c-11e77f8ecfed None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:52.043039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d44691-57ee-4ab7-978c-11e77f8ecfed None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:52.049433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9b234-59b1-4f31-bcfc-b65d55067d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:52.050176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9b234-59b1-4f31-bcfc-b65d55067d07 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:52.050584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9b234-59b1-4f31-bcfc-b65d55067d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:52.050960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9b234-59b1-4f31-bcfc-b65d55067d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:52.051734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9b234-59b1-4f31-bcfc-b65d55067d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:52.054196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9b234-59b1-4f31-bcfc-b65d55067d07 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:52.105913 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3740/7429] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:52 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:52.107983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413503e-ca84-4887-a63a-5ed1140302cf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:52.117366 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:52.123519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413503e-ca84-4887-a63a-5ed1140302cf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:52.267672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21267c1-48e3-43cb-90fd-82bf2063d5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:52.268425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21267c1-48e3-43cb-90fd-82bf2063d5ce admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:52.268604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21267c1-48e3-43cb-90fd-82bf2063d5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:52.268881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21267c1-48e3-43cb-90fd-82bf2063d5ce admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:52.269570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21267c1-48e3-43cb-90fd-82bf2063d5ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:52.271976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21267c1-48e3-43cb-90fd-82bf2063d5ce admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:52.303425 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3690/7430] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:52 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:52.304640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9b234-59b1-4f31-bcfc-b65d55067d07 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:52.318114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9b234-59b1-4f31-bcfc-b65d55067d07 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:52.323646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec0cde-f057-457b-aff4-619a82d73d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:52.324380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec0cde-f057-457b-aff4-619a82d73d4f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:52.324798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec0cde-f057-457b-aff4-619a82d73d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:52.325113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec0cde-f057-457b-aff4-619a82d73d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:52.325813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec0cde-f057-457b-aff4-619a82d73d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:52.328327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec0cde-f057-457b-aff4-619a82d73d4f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:52.354576 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3741/7431] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:52.358720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21267c1-48e3-43cb-90fd-82bf2063d5ce admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:52.371281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21267c1-48e3-43cb-90fd-82bf2063d5ce admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:52.376546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11056904-4abe-4e41-889c-b98a415742ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:52.377220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11056904-4abe-4e41-889c-b98a415742ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:52.377501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11056904-4abe-4e41-889c-b98a415742ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:52.377775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11056904-4abe-4e41-889c-b98a415742ea admin admin] PATH_INFO: `/v3/projects/4fc9d4474b5a41c5a932c202f38ef7bf/users/d704fd35fe12424ebd8a054c557dbf3f/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:52.395928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11056904-4abe-4e41-889c-b98a415742ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc9d4474b5a41c5a932c202f38ef7bf, user_id=d704fd35fe12424ebd8a054c557dbf3f, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:52.398574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11056904-4abe-4e41-889c-b98a415742ea admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:52.414648 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3691/7432] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:52 2022] PUT /identity/v3/projects/4fc9d4474b5a41c5a932c202f38ef7bf/users/d704fd35fe12424ebd8a054c557dbf3f/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:52.418599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec0cde-f057-457b-aff4-619a82d73d4f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:52.429581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec0cde-f057-457b-aff4-619a82d73d4f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:52.454789 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:52.497286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca381940-84b3-47f0-ae1e-20d3e51d8c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:52.497807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca381940-84b3-47f0-ae1e-20d3e51d8c4b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:52.498082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca381940-84b3-47f0-ae1e-20d3e51d8c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:52.498350 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca381940-84b3-47f0-ae1e-20d3e51d8c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:52.499007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca381940-84b3-47f0-ae1e-20d3e51d8c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:52.500767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca381940-84b3-47f0-ae1e-20d3e51d8c4b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:52.511414 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3742/7433] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:52.515855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11056904-4abe-4e41-889c-b98a415742ea admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:52.527886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11056904-4abe-4e41-889c-b98a415742ea admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:52.533298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d271c1-0263-45d7-8e82-1de5f5d5c373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:52.534058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d271c1-0263-45d7-8e82-1de5f5d5c373 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:52.534412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d271c1-0263-45d7-8e82-1de5f5d5c373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:52.534758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d271c1-0263-45d7-8e82-1de5f5d5c373 admin admin] PATH_INFO: `/v3/projects/4fc9d4474b5a41c5a932c202f38ef7bf/users/d704fd35fe12424ebd8a054c557dbf3f/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:52.536815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d271c1-0263-45d7-8e82-1de5f5d5c373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc9d4474b5a41c5a932c202f38ef7bf, user_id=d704fd35fe12424ebd8a054c557dbf3f, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:52.539591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d271c1-0263-45d7-8e82-1de5f5d5c373 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:52.559805 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3692/7434] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:52 2022] PUT /identity/v3/projects/4fc9d4474b5a41c5a932c202f38ef7bf/users/d704fd35fe12424ebd8a054c557dbf3f/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:52.572309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5e5ac-fd30-40ae-84e8-5e60905f1841 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:52.572612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5e5ac-fd30-40ae-84e8-5e60905f1841 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:52.572873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5e5ac-fd30-40ae-84e8-5e60905f1841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:52.604342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-24f5e5ac-fd30-40ae-84e8-5e60905f1841 None None] MFA Rules not processed for user `d704fd35fe12424ebd8a054c557dbf3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:52.605674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-24f5e5ac-fd30-40ae-84e8-5e60905f1841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:52.693512 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3743/7435] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:52.694763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d271c1-0263-45d7-8e82-1de5f5d5c373 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:52.770746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d271c1-0263-45d7-8e82-1de5f5d5c373 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:52.776563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94657554-210f-42d3-ad07-9807d73e6c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:52.777437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94657554-210f-42d3-ad07-9807d73e6c23 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:52.777933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94657554-210f-42d3-ad07-9807d73e6c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:52.778434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94657554-210f-42d3-ad07-9807d73e6c23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:52.779311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94657554-210f-42d3-ad07-9807d73e6c23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:52.782134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94657554-210f-42d3-ad07-9807d73e6c23 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:52.813967 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3693/7436] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:52 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:52.818449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5e5ac-fd30-40ae-84e8-5e60905f1841 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:52.831647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5e5ac-fd30-40ae-84e8-5e60905f1841 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:52.900980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a730c-0bda-4d31-98eb-1e5a3a205b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:52.901713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a730c-0bda-4d31-98eb-1e5a3a205b63 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:52.902054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a730c-0bda-4d31-98eb-1e5a3a205b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:52.902517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a730c-0bda-4d31-98eb-1e5a3a205b63 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:52.903280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a730c-0bda-4d31-98eb-1e5a3a205b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:52.905291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a730c-0bda-4d31-98eb-1e5a3a205b63 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:52.931886 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3744/7437] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:52 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:52.936070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94657554-210f-42d3-ad07-9807d73e6c23 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:52.948565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94657554-210f-42d3-ad07-9807d73e6c23 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:52.954685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5775f-8921-4519-9aab-ec5795cf2b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:52.955350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5775f-8921-4519-9aab-ec5795cf2b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:52.955630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5775f-8921-4519-9aab-ec5795cf2b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:52.955903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5775f-8921-4519-9aab-ec5795cf2b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:52.956560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5775f-8921-4519-9aab-ec5795cf2b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:52.958220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5775f-8921-4519-9aab-ec5795cf2b5b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:52.971681 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3694/7438] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:34:52.975901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a730c-0bda-4d31-98eb-1e5a3a205b63 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:52.987846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a730c-0bda-4d31-98eb-1e5a3a205b63 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:52.992925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff681bb-3104-4a99-94a5-06da9f44a76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:52.993662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff681bb-3104-4a99-94a5-06da9f44a76f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:52.994296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff681bb-3104-4a99-94a5-06da9f44a76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:52.994933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff681bb-3104-4a99-94a5-06da9f44a76f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:52.995453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff681bb-3104-4a99-94a5-06da9f44a76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:52.997119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff681bb-3104-4a99-94a5-06da9f44a76f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:53.011113 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3745/7439] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:34:53.012687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5775f-8921-4519-9aab-ec5795cf2b5b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:53.024021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5775f-8921-4519-9aab-ec5795cf2b5b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:53.029067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67744f3-3bfc-45c4-a3e1-d87635fad3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:53.029895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67744f3-3bfc-45c4-a3e1-d87635fad3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:53.030275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67744f3-3bfc-45c4-a3e1-d87635fad3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:53.030656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67744f3-3bfc-45c4-a3e1-d87635fad3e3 admin admin] PATH_INFO: `/v3/projects/d496154015bd4a2c80b0e8431582c1e5/users/82d3992f73ec48f598c0011317a7d7cd/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:53.047362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67744f3-3bfc-45c4-a3e1-d87635fad3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d496154015bd4a2c80b0e8431582c1e5, user_id=82d3992f73ec48f598c0011317a7d7cd, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:53.050167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67744f3-3bfc-45c4-a3e1-d87635fad3e3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:53.067674 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3695/7440] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:53 2022] PUT /identity/v3/projects/d496154015bd4a2c80b0e8431582c1e5/users/82d3992f73ec48f598c0011317a7d7cd/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:34:53.076413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972773a9-8de2-49b4-a85a-7076265e441b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:53.076972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972773a9-8de2-49b4-a85a-7076265e441b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:53.077499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972773a9-8de2-49b4-a85a-7076265e441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:53.109873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-972773a9-8de2-49b4-a85a-7076265e441b None None] MFA Rules not processed for user `82d3992f73ec48f598c0011317a7d7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:53.111181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-972773a9-8de2-49b4-a85a-7076265e441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:53.125750 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:53.185820 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3746/7441] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:53.199287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67744f3-3bfc-45c4-a3e1-d87635fad3e3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:53.200999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f67744f3-3bfc-45c4-a3e1-d87635fad3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:53.216438 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:53.305176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67744f3-3bfc-45c4-a3e1-d87635fad3e3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:53.309608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663816-9980-435f-a173-5123e5b7aa35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:53.310528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663816-9980-435f-a173-5123e5b7aa35 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:53.310908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663816-9980-435f-a173-5123e5b7aa35 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:53.311305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663816-9980-435f-a173-5123e5b7aa35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:53.426657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96663816-9980-435f-a173-5123e5b7aa35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:53.429274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96663816-9980-435f-a173-5123e5b7aa35 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:53.439933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c7ac0-3e35-46af-bc75-7bf0a1e2c990 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:53.440683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c7ac0-3e35-46af-bc75-7bf0a1e2c990 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:53.440970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c7ac0-3e35-46af-bc75-7bf0a1e2c990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:53.451308 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3696/7442] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:53.466847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ba9c7ac0-3e35-46af-bc75-7bf0a1e2c990 None None] MFA Rules not processed for user `94aefc3d45e24a2a90c1e4eac92b2697`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:53.468171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ba9c7ac0-3e35-46af-bc75-7bf0a1e2c990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:53.549981 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3747/7443] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:34:54.269899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663816-9980-435f-a173-5123e5b7aa35 service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:54.273652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-96663816-9980-435f-a173-5123e5b7aa35 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:54.479014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663816-9980-435f-a173-5123e5b7aa35 service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:54.508718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eae67-fe90-4679-98da-53ba10469330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:54.509655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eae67-fe90-4679-98da-53ba10469330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:54.510156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eae67-fe90-4679-98da-53ba10469330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:54.510940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eae67-fe90-4679-98da-53ba10469330 admin admin] PATH_INFO: `/v3/users/dd498f921baf4e4890c5f29233ac7e7b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:54.512814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495eae67-fe90-4679-98da-53ba10469330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd498f921baf4e4890c5f29233ac7e7b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:54.516914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495eae67-fe90-4679-98da-53ba10469330 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:54.556795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c7ac0-3e35-46af-bc75-7bf0a1e2c990 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:54.581500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c7ac0-3e35-46af-bc75-7bf0a1e2c990 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:54.591855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3f990-bdbd-49a6-adbf-505e8109247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:54.592912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3f990-bdbd-49a6-adbf-505e8109247a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:54.593195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3f990-bdbd-49a6-adbf-505e8109247a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:54.593497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3f990-bdbd-49a6-adbf-505e8109247a admin admin] PATH_INFO: `/v3/users/d704fd35fe12424ebd8a054c557dbf3f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:54.598437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3f990-bdbd-49a6-adbf-505e8109247a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d704fd35fe12424ebd8a054c557dbf3f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:54.600511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3f990-bdbd-49a6-adbf-505e8109247a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:54.639786 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:54.648026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-495eae67-fe90-4679-98da-53ba10469330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd498f921baf4e4890c5f29233ac7e7b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:54.651120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-495eae67-fe90-4679-98da-53ba10469330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd498f921baf4e4890c5f29233ac7e7b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:54.673112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-495eae67-fe90-4679-98da-53ba10469330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd498f921baf4e4890c5f29233ac7e7b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:54.686081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9b3f990-bdbd-49a6-adbf-505e8109247a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd704fd35fe12424ebd8a054c557dbf3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:54.689649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-495eae67-fe90-4679-98da-53ba10469330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd498f921baf4e4890c5f29233ac7e7b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:54.690494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-495eae67-fe90-4679-98da-53ba10469330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd498f921baf4e4890c5f29233ac7e7b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:54.691031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9b3f990-bdbd-49a6-adbf-505e8109247a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd704fd35fe12424ebd8a054c557dbf3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:54.718069 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3697/7444] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:54 2022] DELETE /identity/v3/users/dd498f921baf4e4890c5f29233ac7e7b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:54.719501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9b3f990-bdbd-49a6-adbf-505e8109247a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd704fd35fe12424ebd8a054c557dbf3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:54.720497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e59f-336a-4459-97ff-d3bb558c8a1e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:54.720888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e59f-336a-4459-97ff-d3bb558c8a1e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:54.721293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e59f-336a-4459-97ff-d3bb558c8a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:54.745009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9b3f990-bdbd-49a6-adbf-505e8109247a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd704fd35fe12424ebd8a054c557dbf3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:54.746332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e9b3f990-bdbd-49a6-adbf-505e8109247a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd704fd35fe12424ebd8a054c557dbf3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:54.751458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-34b4e59f-336a-4459-97ff-d3bb558c8a1e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:54.752853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-34b4e59f-336a-4459-97ff-d3bb558c8a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:54.768317 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3748/7445] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:54 2022] DELETE /identity/v3/users/d704fd35fe12424ebd8a054c557dbf3f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:54.773077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9bf29-e629-46c9-a588-2560c7d5e11b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:54.774796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9bf29-e629-46c9-a588-2560c7d5e11b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:54.777736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9bf29-e629-46c9-a588-2560c7d5e11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:54.819850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dcd9bf29-e629-46c9-a588-2560c7d5e11b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:54.821206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dcd9bf29-e629-46c9-a588-2560c7d5e11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:54.865408 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3698/7446] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:54.881083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4e59f-336a-4459-97ff-d3bb558c8a1e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:54.884315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-34b4e59f-336a-4459-97ff-d3bb558c8a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:54.889914 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:54.973286 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3749/7447] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:54.980840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9bf29-e629-46c9-a588-2560c7d5e11b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:54.986557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dcd9bf29-e629-46c9-a588-2560c7d5e11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:55.047146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4e59f-336a-4459-97ff-d3bb558c8a1e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:55.081459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9bf29-e629-46c9-a588-2560c7d5e11b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:55.086241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214b638-6478-442c-8abc-18e6319f58e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:55.087110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214b638-6478-442c-8abc-18e6319f58e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:55.087388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214b638-6478-442c-8abc-18e6319f58e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:55.087657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214b638-6478-442c-8abc-18e6319f58e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:55.101038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214b638-6478-442c-8abc-18e6319f58e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:55.102654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214b638-6478-442c-8abc-18e6319f58e6 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:55.117232 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3750/7448] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:34:55.139956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1907da-ae54-4fdc-96c1-611eac0c2ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:55.141846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1907da-ae54-4fdc-96c1-611eac0c2ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:55.142538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1907da-ae54-4fdc-96c1-611eac0c2ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:55.143446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1907da-ae54-4fdc-96c1-611eac0c2ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:55.157985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1907da-ae54-4fdc-96c1-611eac0c2ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:55.159885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1907da-ae54-4fdc-96c1-611eac0c2ff0 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:55.174044 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3699/7449] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:34:55.841865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214b638-6478-442c-8abc-18e6319f58e6 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:55.847225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3214b638-6478-442c-8abc-18e6319f58e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:55.873661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214b638-6478-442c-8abc-18e6319f58e6 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:55.893657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:55.894303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:55.894579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:55.894848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] PATH_INFO: `/v3/projects/3676910f27a54f2e928aa73c78a75602` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:55.896039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3676910f27a54f2e928aa73c78a75602)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:55.897956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:55.976027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1907da-ae54-4fdc-96c1-611eac0c2ff0 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:55.977558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6d1907da-ae54-4fdc-96c1-611eac0c2ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:55.999333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1907da-ae54-4fdc-96c1-611eac0c2ff0 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:56.009667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3676910f27a54f2e928aa73c78a75602', 'request_id': 'req-f1202163-8ce8-46a9-981d-57753925618a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.019372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3676910f27a54f2e928aa73c78a75602', 'request_id': 'req-f1202163-8ce8-46a9-981d-57753925618a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.036143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3676910f27a54f2e928aa73c78a75602', 'request_id': 'req-f1202163-8ce8-46a9-981d-57753925618a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.044297 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:56.065212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] The token cache is being invalidate because project 3676910f27a54f2e928aa73c78a75602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:56.066482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.068483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.073726 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3751/7450] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:55 2022] DELETE /identity/v3/projects/3676910f27a54f2e928aa73c78a75602 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:56.079698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:56.081784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:56.139977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:56.140778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:56.141161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:56.141556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] PATH_INFO: `/v3/projects/4fc9d4474b5a41c5a932c202f38ef7bf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:56.143498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc9d4474b5a41c5a932c202f38ef7bf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:56.158000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:56.178832 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:56.190156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1202163-8ce8-46a9-981d-57753925618a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:56.203953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:56.204879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:56.205164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:56.205442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] PATH_INFO: `/v3/users/df9b7124dcd5471f8411ace22a0994f3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:56.206665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9b7124dcd5471f8411ace22a0994f3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:56.209134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:56.248894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc9d4474b5a41c5a932c202f38ef7bf', 'request_id': 'req-870335cd-17af-4c66-9a08-b10d5391711b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.259018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc9d4474b5a41c5a932c202f38ef7bf', 'request_id': 'req-870335cd-17af-4c66-9a08-b10d5391711b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.277639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc9d4474b5a41c5a932c202f38ef7bf', 'request_id': 'req-870335cd-17af-4c66-9a08-b10d5391711b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.300215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] The token cache is being invalidate because project 4fc9d4474b5a41c5a932c202f38ef7bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:56.303280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.306209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.309377 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3700/7451] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:55 2022] DELETE /identity/v3/projects/4fc9d4474b5a41c5a932c202f38ef7bf => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:56.313936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:56.315205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9b7124dcd5471f8411ace22a0994f3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.315924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9b7124dcd5471f8411ace22a0994f3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.316390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:56.341553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9b7124dcd5471f8411ace22a0994f3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.356585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9b7124dcd5471f8411ace22a0994f3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.357282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9b7124dcd5471f8411ace22a0994f3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.380540 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3752/7452] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:56 2022] DELETE /identity/v3/users/df9b7124dcd5471f8411ace22a0994f3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:56.417736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870335cd-17af-4c66-9a08-b10d5391711b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:56.503500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:56.504874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:56.505537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:56.506208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] PATH_INFO: `/v3/users/82d3992f73ec48f598c0011317a7d7cd` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:56.509396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d3992f73ec48f598c0011317a7d7cd)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:56.512996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:56.516179 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:56.609473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d3992f73ec48f598c0011317a7d7cd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.610348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d3992f73ec48f598c0011317a7d7cd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.626872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d3992f73ec48f598c0011317a7d7cd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.638341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d3992f73ec48f598c0011317a7d7cd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.640026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d3992f73ec48f598c0011317a7d7cd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:56.666408 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3701/7453] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:34:56 2022] DELETE /identity/v3/users/82d3992f73ec48f598c0011317a7d7cd => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:56.904001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:56.906713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:56.930131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc5898-5e66-457d-9744-5321d582cc50 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:57.089478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be7a93-4b2c-4530-ad02-5c001c55c2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:57.090453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be7a93-4b2c-4530-ad02-5c001c55c2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:57.090899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be7a93-4b2c-4530-ad02-5c001c55c2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:57.091377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be7a93-4b2c-4530-ad02-5c001c55c2e1 admin admin] PATH_INFO: `/v3/projects/8f945c6ef9204af38161ac451f73ee25` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:57.095222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be7a93-4b2c-4530-ad02-5c001c55c2e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f945c6ef9204af38161ac451f73ee25)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:57.097419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be7a93-4b2c-4530-ad02-5c001c55c2e1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:57.213476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76be7a93-4b2c-4530-ad02-5c001c55c2e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f945c6ef9204af38161ac451f73ee25', 'request_id': 'req-76be7a93-4b2c-4530-ad02-5c001c55c2e1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:57.225122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76be7a93-4b2c-4530-ad02-5c001c55c2e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f945c6ef9204af38161ac451f73ee25', 'request_id': 'req-76be7a93-4b2c-4530-ad02-5c001c55c2e1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:57.233074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:57.235651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:57.252101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76be7a93-4b2c-4530-ad02-5c001c55c2e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f945c6ef9204af38161ac451f73ee25', 'request_id': 'req-76be7a93-4b2c-4530-ad02-5c001c55c2e1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:57.263393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592859ba-f50c-4dd6-96a6-bff275a778d7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:57.282538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76be7a93-4b2c-4530-ad02-5c001c55c2e1 admin admin] The token cache is being invalidate because project 8f945c6ef9204af38161ac451f73ee25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:57.284948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76be7a93-4b2c-4530-ad02-5c001c55c2e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:57.286717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-76be7a93-4b2c-4530-ad02-5c001c55c2e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:57.293772 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3753/7454] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:56 2022] DELETE /identity/v3/projects/8f945c6ef9204af38161ac451f73ee25 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:57.295472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634318-7ebf-4174-8468-58f7182a0f3d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:57.295759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634318-7ebf-4174-8468-58f7182a0f3d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:57.296029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634318-7ebf-4174-8468-58f7182a0f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:57.321172 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:57.330732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-26634318-7ebf-4174-8468-58f7182a0f3d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:57.337900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-26634318-7ebf-4174-8468-58f7182a0f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:57.410805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b075edf-9381-47d6-b203-26b0439c39c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:57.411638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b075edf-9381-47d6-b203-26b0439c39c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:57.412276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b075edf-9381-47d6-b203-26b0439c39c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:57.412276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b075edf-9381-47d6-b203-26b0439c39c4 admin admin] PATH_INFO: `/v3/projects/d496154015bd4a2c80b0e8431582c1e5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:57.414045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b075edf-9381-47d6-b203-26b0439c39c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d496154015bd4a2c80b0e8431582c1e5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:57.416682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b075edf-9381-47d6-b203-26b0439c39c4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:57.482799 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3754/7455] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:57.491523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439e15e-8b39-4e64-8eee-a7f8ea36bda4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:57.491523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439e15e-8b39-4e64-8eee-a7f8ea36bda4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:57.491523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439e15e-8b39-4e64-8eee-a7f8ea36bda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:57.512826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b075edf-9381-47d6-b203-26b0439c39c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd496154015bd4a2c80b0e8431582c1e5', 'request_id': 'req-3b075edf-9381-47d6-b203-26b0439c39c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:57.529677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b075edf-9381-47d6-b203-26b0439c39c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd496154015bd4a2c80b0e8431582c1e5', 'request_id': 'req-3b075edf-9381-47d6-b203-26b0439c39c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:57.547792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7439e15e-8b39-4e64-8eee-a7f8ea36bda4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:57.547792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7439e15e-8b39-4e64-8eee-a7f8ea36bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:57.553464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b075edf-9381-47d6-b203-26b0439c39c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd496154015bd4a2c80b0e8431582c1e5', 'request_id': 'req-3b075edf-9381-47d6-b203-26b0439c39c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:57.607388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b075edf-9381-47d6-b203-26b0439c39c4 admin admin] The token cache is being invalidate because project d496154015bd4a2c80b0e8431582c1e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:34:57.607879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b075edf-9381-47d6-b203-26b0439c39c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:57.608693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3b075edf-9381-47d6-b203-26b0439c39c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:34:57.611876 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3702/7456] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:34:57 2022] DELETE /identity/v3/projects/d496154015bd4a2c80b0e8431582c1e5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:57.620609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5bafd-7456-41bb-a784-2460609d693f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:57.620972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5bafd-7456-41bb-a784-2460609d693f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:57.621327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5bafd-7456-41bb-a784-2460609d693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:57.658562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a7b5bafd-7456-41bb-a784-2460609d693f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:57.660482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a7b5bafd-7456-41bb-a784-2460609d693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:57.671747 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:57.691296 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3755/7457] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:34:57.695801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439e15e-8b39-4e64-8eee-a7f8ea36bda4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:57.711926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439e15e-8b39-4e64-8eee-a7f8ea36bda4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:57.718269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf9456-381b-483e-83d5-869f49c31aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:57.720207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf9456-381b-483e-83d5-869f49c31aea admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:57.720838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf9456-381b-483e-83d5-869f49c31aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:57.721568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf9456-381b-483e-83d5-869f49c31aea admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:57.723148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf9456-381b-483e-83d5-869f49c31aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:57.723734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf9456-381b-483e-83d5-869f49c31aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:57.726381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf9456-381b-483e-83d5-869f49c31aea admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:57.743417 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3756/7458] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:57.747854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf9456-381b-483e-83d5-869f49c31aea admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:57.772527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf9456-381b-483e-83d5-869f49c31aea admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:57.788469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b82ff2-732b-411b-8e75-c5d960da592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:57.789394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b82ff2-732b-411b-8e75-c5d960da592c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:57.790559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b82ff2-732b-411b-8e75-c5d960da592c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:57.791118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b82ff2-732b-411b-8e75-c5d960da592c admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:57.793244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b82ff2-732b-411b-8e75-c5d960da592c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:57.800020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b82ff2-732b-411b-8e75-c5d960da592c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:57.825029 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3703/7459] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:57.834510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb6686-54c1-428e-939d-f4491b908567 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:57.834855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb6686-54c1-428e-939d-f4491b908567 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:57.835146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb6686-54c1-428e-939d-f4491b908567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:57.884500 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3757/7460] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:57 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:57.884726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-17fb6686-54c1-428e-939d-f4491b908567 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:57.885742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b82ff2-732b-411b-8e75-c5d960da592c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:57.888097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-17fb6686-54c1-428e-939d-f4491b908567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:58.027782 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3704/7461] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:34:58.031593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb6686-54c1-428e-939d-f4491b908567 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:58.040309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b82ff2-732b-411b-8e75-c5d960da592c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:58.042188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb6686-54c1-428e-939d-f4491b908567 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:58.045477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244be94-4076-4b46-b017-042619ba7e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:58.047305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244be94-4076-4b46-b017-042619ba7e1b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:58.049250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9b9fd-d6eb-4fb6-a1e1-cc708b9651b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:58.050250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244be94-4076-4b46-b017-042619ba7e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:58.050531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244be94-4076-4b46-b017-042619ba7e1b admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:58.050658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b9fd-d6eb-4fb6-a1e1-cc708b9651b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:58.050905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b9fd-d6eb-4fb6-a1e1-cc708b9651b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:58.051212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244be94-4076-4b46-b017-042619ba7e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:58.051377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b9fd-d6eb-4fb6-a1e1-cc708b9651b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:58.051868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9b9fd-d6eb-4fb6-a1e1-cc708b9651b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:34:58.052174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9b9fd-d6eb-4fb6-a1e1-cc708b9651b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:58.053164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244be94-4076-4b46-b017-042619ba7e1b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:58.054309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9b9fd-d6eb-4fb6-a1e1-cc708b9651b2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:58.069479 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3705/7462] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:34:58.073579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9b9fd-d6eb-4fb6-a1e1-cc708b9651b2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:58.098141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9b9fd-d6eb-4fb6-a1e1-cc708b9651b2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:58.098935 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3758/7463] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:57 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:58.102946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244be94-4076-4b46-b017-042619ba7e1b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:58.111488 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:58.116040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedd48a-b863-47d5-87c3-255a6e55abdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:58.116861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedd48a-b863-47d5-87c3-255a6e55abdb admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:58.117303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedd48a-b863-47d5-87c3-255a6e55abdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:58.117812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedd48a-b863-47d5-87c3-255a6e55abdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:58.118607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedd48a-b863-47d5-87c3-255a6e55abdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:58.119509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244be94-4076-4b46-b017-042619ba7e1b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:58.120954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedd48a-b863-47d5-87c3-255a6e55abdb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:58.132906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba748e3-40e8-402c-b649-7ecb75a460da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:58.133461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba748e3-40e8-402c-b649-7ecb75a460da admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:58.133737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba748e3-40e8-402c-b649-7ecb75a460da admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:58.140334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba748e3-40e8-402c-b649-7ecb75a460da admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:58.142301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba748e3-40e8-402c-b649-7ecb75a460da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:58.144636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba748e3-40e8-402c-b649-7ecb75a460da admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:58.158265 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3759/7464] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:34:58.160457 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3706/7465] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:58 2022] POST /identity/v3/projects => generated 411 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:58.164786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedd48a-b863-47d5-87c3-255a6e55abdb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:58.164993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba748e3-40e8-402c-b649-7ecb75a460da admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:58.182653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba748e3-40e8-402c-b649-7ecb75a460da admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:58.291185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d5664-f88f-470e-9f8e-6fe94ecbe852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:58.293116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d5664-f88f-470e-9f8e-6fe94ecbe852 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:58.294055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d5664-f88f-470e-9f8e-6fe94ecbe852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:58.295259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d5664-f88f-470e-9f8e-6fe94ecbe852 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:58.298793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d5664-f88f-470e-9f8e-6fe94ecbe852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:58.302663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedd48a-b863-47d5-87c3-255a6e55abdb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:58.307594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d5664-f88f-470e-9f8e-6fe94ecbe852 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:58.313409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a63c5-abbf-46ed-a4b7-a5947b476a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:58.314079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a63c5-abbf-46ed-a4b7-a5947b476a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:58.314359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a63c5-abbf-46ed-a4b7-a5947b476a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:58.314634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a63c5-abbf-46ed-a4b7-a5947b476a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:58.315411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a63c5-abbf-46ed-a4b7-a5947b476a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:58.317613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a63c5-abbf-46ed-a4b7-a5947b476a08 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:58.329805 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3707/7466] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:58.334041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a63c5-abbf-46ed-a4b7-a5947b476a08 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:58.348493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a63c5-abbf-46ed-a4b7-a5947b476a08 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:58.362728 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3760/7467] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:58 2022] POST /identity/v3/users => generated 306 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:58.367135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d5664-f88f-470e-9f8e-6fe94ecbe852 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:58.368051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5800a-34ce-4bf7-bc3e-67f097f239dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:58.368734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5800a-34ce-4bf7-bc3e-67f097f239dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:58.369012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5800a-34ce-4bf7-bc3e-67f097f239dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:58.369286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5800a-34ce-4bf7-bc3e-67f097f239dc admin admin] PATH_INFO: `/v3/projects/49ba8861d5884f04a7c9e2878848b26e/users/303d9c9df6534f7aae14c8f96f5a48e0/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:58.381640 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:58.392091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d5664-f88f-470e-9f8e-6fe94ecbe852 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:58.399151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0444e-38e1-4742-bbfd-f35c38c40301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:58.400022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0444e-38e1-4742-bbfd-f35c38c40301 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:58.400461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0444e-38e1-4742-bbfd-f35c38c40301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:58.400949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0444e-38e1-4742-bbfd-f35c38c40301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:58.402021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0444e-38e1-4742-bbfd-f35c38c40301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:58.403847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0444e-38e1-4742-bbfd-f35c38c40301 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:58.405074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5800a-34ce-4bf7-bc3e-67f097f239dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ba8861d5884f04a7c9e2878848b26e, user_id=303d9c9df6534f7aae14c8f96f5a48e0, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:58.408652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5800a-34ce-4bf7-bc3e-67f097f239dc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:58.430324 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3761/7468] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:58.431520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0444e-38e1-4742-bbfd-f35c38c40301 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:58.445748 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3708/7469] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:58 2022] PUT /identity/v3/projects/49ba8861d5884f04a7c9e2878848b26e/users/303d9c9df6534f7aae14c8f96f5a48e0/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:58.447098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0444e-38e1-4742-bbfd-f35c38c40301 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:58.449275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7f68b-64ce-4e58-95fc-306207c948c0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:58.449564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7f68b-64ce-4e58-95fc-306207c948c0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:58.449893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7f68b-64ce-4e58-95fc-306207c948c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:58.518810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bce7f68b-64ce-4e58-95fc-306207c948c0 None None] MFA Rules not processed for user `303d9c9df6534f7aae14c8f96f5a48e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:58.520061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bce7f68b-64ce-4e58-95fc-306207c948c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:58.572010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14385bf-4dfc-47d9-adf2-cb32ada4488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:58.572820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14385bf-4dfc-47d9-adf2-cb32ada4488a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:58.573288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14385bf-4dfc-47d9-adf2-cb32ada4488a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:58.573660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14385bf-4dfc-47d9-adf2-cb32ada4488a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:58.574418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14385bf-4dfc-47d9-adf2-cb32ada4488a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:58.576300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14385bf-4dfc-47d9-adf2-cb32ada4488a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:58.594248 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3762/7470] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:58.595794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14385bf-4dfc-47d9-adf2-cb32ada4488a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:58.610558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14385bf-4dfc-47d9-adf2-cb32ada4488a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:58.619131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792fc52-4025-4a79-81ca-e9dc461cab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:58.620486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792fc52-4025-4a79-81ca-e9dc461cab36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:58.621424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792fc52-4025-4a79-81ca-e9dc461cab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:58.621424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792fc52-4025-4a79-81ca-e9dc461cab36 admin admin] PATH_INFO: `/v3/projects/3fa6c1321b964333a61346e4f3f4074d/users/1aad4fac292444c785d1a589f99ff830/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:58.642844 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3709/7471] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:34:58.651080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7f68b-64ce-4e58-95fc-306207c948c0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:58.651691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792fc52-4025-4a79-81ca-e9dc461cab36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa6c1321b964333a61346e4f3f4074d, user_id=1aad4fac292444c785d1a589f99ff830, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:58.652708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bce7f68b-64ce-4e58-95fc-306207c948c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:58.654871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792fc52-4025-4a79-81ca-e9dc461cab36 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:58.692587 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3763/7472] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:58 2022] PUT /identity/v3/projects/3fa6c1321b964333a61346e4f3f4074d/users/1aad4fac292444c785d1a589f99ff830/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:58.697989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3763466-5cc0-4ce5-9841-4abc15c13b54 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:58.698303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3763466-5cc0-4ce5-9841-4abc15c13b54 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:58.698709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3763466-5cc0-4ce5-9841-4abc15c13b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:58.726218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7f68b-64ce-4e58-95fc-306207c948c0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:58.769276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c3763466-5cc0-4ce5-9841-4abc15c13b54 None None] MFA Rules not processed for user `1aad4fac292444c785d1a589f99ff830`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:34:58.771625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c3763466-5cc0-4ce5-9841-4abc15c13b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:34:58.848273 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:58.870960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f129d-b734-4936-92bb-2835c9767b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:58.871771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f129d-b734-4936-92bb-2835c9767b63 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:58.872122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f129d-b734-4936-92bb-2835c9767b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:58.872546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f129d-b734-4936-92bb-2835c9767b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:58.911501 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3764/7473] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:34:58 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:34:58.920281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3763466-5cc0-4ce5-9841-4abc15c13b54 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:58.965675 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:59.001927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f129d-b734-4936-92bb-2835c9767b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:59.008506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f129d-b734-4936-92bb-2835c9767b63 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:59.035567 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3710/7474] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:34:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:34:59.127231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3763466-5cc0-4ce5-9841-4abc15c13b54 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:59.151828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615d04b-1482-4c15-88b6-f3e018ee3d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:59.155179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615d04b-1482-4c15-88b6-f3e018ee3d05 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:59.158394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615d04b-1482-4c15-88b6-f3e018ee3d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:59.159064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615d04b-1482-4c15-88b6-f3e018ee3d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:59.160266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615d04b-1482-4c15-88b6-f3e018ee3d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:59.164084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615d04b-1482-4c15-88b6-f3e018ee3d05 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:59.210744 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3765/7475] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:34:58 2022] POST /identity/v3/projects => generated 411 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:34:59.216561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f129d-b734-4936-92bb-2835c9767b63 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:59.230805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f129d-b734-4936-92bb-2835c9767b63 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:59.409069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231c28d-a439-4a88-afac-8576d19ff6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:59.409832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231c28d-a439-4a88-afac-8576d19ff6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:59.410313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231c28d-a439-4a88-afac-8576d19ff6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:59.410628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231c28d-a439-4a88-afac-8576d19ff6e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:59.411418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231c28d-a439-4a88-afac-8576d19ff6e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:59.413820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231c28d-a439-4a88-afac-8576d19ff6e0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:59.448929 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3711/7476] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:34:59 2022] POST /identity/v3/users => generated 312 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:34:59.454622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615d04b-1482-4c15-88b6-f3e018ee3d05 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:59.472991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615d04b-1482-4c15-88b6-f3e018ee3d05 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:59.488952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f35c1-08a2-4f52-ac85-75709727a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:59.490021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f35c1-08a2-4f52-ac85-75709727a51b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:59.490462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f35c1-08a2-4f52-ac85-75709727a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:59.490949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f35c1-08a2-4f52-ac85-75709727a51b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:59.491846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f35c1-08a2-4f52-ac85-75709727a51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:59.493926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f35c1-08a2-4f52-ac85-75709727a51b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:59.518314 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3766/7477] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:59.522155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231c28d-a439-4a88-afac-8576d19ff6e0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:59.579211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231c28d-a439-4a88-afac-8576d19ff6e0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:59.620151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594e66c-e7eb-4c08-8831-bd6ba4b1984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:59.626725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594e66c-e7eb-4c08-8831-bd6ba4b1984b admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:59.628401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594e66c-e7eb-4c08-8831-bd6ba4b1984b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:59.629307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594e66c-e7eb-4c08-8831-bd6ba4b1984b admin admin] PATH_INFO: `/v3/projects/d803d71879e840f3bf740c3978552bc8/users/12ce5145b4374edc8bfce9e4fa1989fc/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:59.693725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594e66c-e7eb-4c08-8831-bd6ba4b1984b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d803d71879e840f3bf740c3978552bc8, user_id=12ce5145b4374edc8bfce9e4fa1989fc, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:59.697376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594e66c-e7eb-4c08-8831-bd6ba4b1984b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:59.730356 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3712/7478] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:59 2022] PUT /identity/v3/projects/d803d71879e840f3bf740c3978552bc8/users/12ce5145b4374edc8bfce9e4fa1989fc/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:34:59.737815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f35c1-08a2-4f52-ac85-75709727a51b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:59.788424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f35c1-08a2-4f52-ac85-75709727a51b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:59.948965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fd9ed-2813-458f-879b-0db3f3ca7acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:59.949572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fd9ed-2813-458f-879b-0db3f3ca7acd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:59.949904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fd9ed-2813-458f-879b-0db3f3ca7acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:59.950958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fd9ed-2813-458f-879b-0db3f3ca7acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:34:59.951606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fd9ed-2813-458f-879b-0db3f3ca7acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:34:59.953985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fd9ed-2813-458f-879b-0db3f3ca7acd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:34:59.968164 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3767/7479] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:34:59.970382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594e66c-e7eb-4c08-8831-bd6ba4b1984b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:34:59.983240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594e66c-e7eb-4c08-8831-bd6ba4b1984b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:34:59.995802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7efce8-4ae5-4eaf-91d1-f3024ca1b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:34:59.996709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7efce8-4ae5-4eaf-91d1-f3024ca1b96d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:34:59.996709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7efce8-4ae5-4eaf-91d1-f3024ca1b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:34:59.998067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7efce8-4ae5-4eaf-91d1-f3024ca1b96d admin admin] PATH_INFO: `/v3/projects/d803d71879e840f3bf740c3978552bc8/users/12ce5145b4374edc8bfce9e4fa1989fc/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:00.003975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7efce8-4ae5-4eaf-91d1-f3024ca1b96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d803d71879e840f3bf740c3978552bc8, user_id=12ce5145b4374edc8bfce9e4fa1989fc, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:00.006705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7efce8-4ae5-4eaf-91d1-f3024ca1b96d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:00.044385 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3713/7480] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:34:59 2022] PUT /identity/v3/projects/d803d71879e840f3bf740c3978552bc8/users/12ce5145b4374edc8bfce9e4fa1989fc/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:00.054942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8485-afb3-4bc7-b7f7-b75515f5635c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:00.055524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8485-afb3-4bc7-b7f7-b75515f5635c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:00.056047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8485-afb3-4bc7-b7f7-b75515f5635c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:00.136057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-18cc8485-afb3-4bc7-b7f7-b75515f5635c None None] MFA Rules not processed for user `12ce5145b4374edc8bfce9e4fa1989fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:00.137340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-18cc8485-afb3-4bc7-b7f7-b75515f5635c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:00.200469 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:00.269538 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3768/7481] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:00 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:00.279691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7efce8-4ae5-4eaf-91d1-f3024ca1b96d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:00.281825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bc7efce8-4ae5-4eaf-91d1-f3024ca1b96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:00.360485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7efce8-4ae5-4eaf-91d1-f3024ca1b96d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:00.364846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5a8aa-7aec-4cd5-9dbd-9d8b8bdd1e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:00.365446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5a8aa-7aec-4cd5-9dbd-9d8b8bdd1e2f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:00.365731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5a8aa-7aec-4cd5-9dbd-9d8b8bdd1e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:00.365998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5a8aa-7aec-4cd5-9dbd-9d8b8bdd1e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:00.377683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5a8aa-7aec-4cd5-9dbd-9d8b8bdd1e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:00.379241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5a8aa-7aec-4cd5-9dbd-9d8b8bdd1e2f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:00.401676 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3714/7482] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:00 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:35:01.204122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc8485-afb3-4bc7-b7f7-b75515f5635c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:01.205623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-18cc8485-afb3-4bc7-b7f7-b75515f5635c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:01.303679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc8485-afb3-4bc7-b7f7-b75515f5635c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:01.309069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5706c-5c7d-4ed3-85ab-884a27f3a25a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:01.309802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5706c-5c7d-4ed3-85ab-884a27f3a25a service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:01.310143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5706c-5c7d-4ed3-85ab-884a27f3a25a service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:01.310490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5706c-5c7d-4ed3-85ab-884a27f3a25a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:01.313661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c3d5706c-5c7d-4ed3-85ab-884a27f3a25a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:01.408614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5706c-5c7d-4ed3-85ab-884a27f3a25a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:01.410612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5706c-5c7d-4ed3-85ab-884a27f3a25a service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:01.428984 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3769/7483] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:35:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:35:03.134373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5a8aa-7aec-4cd5-9dbd-9d8b8bdd1e2f service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:03.269174 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:03.303878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5a8aa-7aec-4cd5-9dbd-9d8b8bdd1e2f service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:03.309391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:03.310050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:03.310270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:03.310573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] PATH_INFO: `/v3/users/1aad4fac292444c785d1a589f99ff830` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:03.311837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aad4fac292444c785d1a589f99ff830)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:03.315233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:03.466627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aad4fac292444c785d1a589f99ff830'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:03.467472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aad4fac292444c785d1a589f99ff830'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:03.507430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aad4fac292444c785d1a589f99ff830'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:03.521025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aad4fac292444c785d1a589f99ff830'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:03.521734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aad4fac292444c785d1a589f99ff830'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:03.565982 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3715/7484] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:35:03 2022] DELETE /identity/v3/users/1aad4fac292444c785d1a589f99ff830 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:35:03.568576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1472db-a399-4428-a46e-0ec082e869b5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:03.568576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1472db-a399-4428-a46e-0ec082e869b5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:03.571877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1472db-a399-4428-a46e-0ec082e869b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:03.629916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0b1472db-a399-4428-a46e-0ec082e869b5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:03.635154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0b1472db-a399-4428-a46e-0ec082e869b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:03.825278 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3770/7485] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:03.844172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:03.846154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:04.024736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb2e17-e20f-451b-949d-0899656bc0a2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:04.036274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d01bd-4502-40f2-b599-2eb46dc422bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:04.036724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d01bd-4502-40f2-b599-2eb46dc422bc service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:04.039311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d01bd-4502-40f2-b599-2eb46dc422bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:04.047577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d01bd-4502-40f2-b599-2eb46dc422bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:04.089318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d01bd-4502-40f2-b599-2eb46dc422bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:04.095902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d01bd-4502-40f2-b599-2eb46dc422bc service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:04.120887 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3716/7486] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:35:04.621168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1472db-a399-4428-a46e-0ec082e869b5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:04.624276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0b1472db-a399-4428-a46e-0ec082e869b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:04.647334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1472db-a399-4428-a46e-0ec082e869b5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:04.666074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:04.666735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:04.667556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:04.667556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] PATH_INFO: `/v3/projects/3fa6c1321b964333a61346e4f3f4074d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:04.668467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa6c1321b964333a61346e4f3f4074d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:04.671023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:04.674840 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:04.763744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa6c1321b964333a61346e4f3f4074d', 'request_id': 'req-ed90099d-e271-43f8-ae41-c2e308efc190'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:04.775319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa6c1321b964333a61346e4f3f4074d', 'request_id': 'req-ed90099d-e271-43f8-ae41-c2e308efc190'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:04.789661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa6c1321b964333a61346e4f3f4074d', 'request_id': 'req-ed90099d-e271-43f8-ae41-c2e308efc190'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:04.808059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] The token cache is being invalidate because project 3fa6c1321b964333a61346e4f3f4074d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:35:04.809008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:04.810015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:04.811920 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3771/7487] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:35:04 2022] DELETE /identity/v3/projects/3fa6c1321b964333a61346e4f3f4074d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:04.816222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d01bd-4502-40f2-b599-2eb46dc422bc service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:04.830905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d01bd-4502-40f2-b599-2eb46dc422bc service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:04.928565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eb996-d265-4c03-9646-759871756510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:04.937278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eb996-d265-4c03-9646-759871756510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:04.938659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eb996-d265-4c03-9646-759871756510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:04.939043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eb996-d265-4c03-9646-759871756510 admin admin] PATH_INFO: `/v3/users/12ce5145b4374edc8bfce9e4fa1989fc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:04.941483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108eb996-d265-4c03-9646-759871756510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ce5145b4374edc8bfce9e4fa1989fc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:04.943981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108eb996-d265-4c03-9646-759871756510 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:04.949497 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:05.042595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-108eb996-d265-4c03-9646-759871756510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ce5145b4374edc8bfce9e4fa1989fc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:05.043626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-108eb996-d265-4c03-9646-759871756510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ce5145b4374edc8bfce9e4fa1989fc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:05.059781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-108eb996-d265-4c03-9646-759871756510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ce5145b4374edc8bfce9e4fa1989fc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:05.071419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-108eb996-d265-4c03-9646-759871756510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ce5145b4374edc8bfce9e4fa1989fc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:05.072619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-108eb996-d265-4c03-9646-759871756510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ce5145b4374edc8bfce9e4fa1989fc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:05.122591 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3717/7488] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:35:04 2022] DELETE /identity/v3/users/12ce5145b4374edc8bfce9e4fa1989fc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:35:05.389016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:05.391809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:05.419383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90099d-e271-43f8-ae41-c2e308efc190 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:05.599859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b9c1c-bc45-480e-91af-e1897424c17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:05.600442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b9c1c-bc45-480e-91af-e1897424c17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:05.600716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b9c1c-bc45-480e-91af-e1897424c17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:05.600983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b9c1c-bc45-480e-91af-e1897424c17c admin admin] PATH_INFO: `/v3/projects/d803d71879e840f3bf740c3978552bc8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:05.603364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b9c1c-bc45-480e-91af-e1897424c17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d803d71879e840f3bf740c3978552bc8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:05.616481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b9c1c-bc45-480e-91af-e1897424c17c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:05.719554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b4b9c1c-bc45-480e-91af-e1897424c17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd803d71879e840f3bf740c3978552bc8', 'request_id': 'req-2b4b9c1c-bc45-480e-91af-e1897424c17c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:05.752134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b4b9c1c-bc45-480e-91af-e1897424c17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd803d71879e840f3bf740c3978552bc8', 'request_id': 'req-2b4b9c1c-bc45-480e-91af-e1897424c17c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:05.768671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b4b9c1c-bc45-480e-91af-e1897424c17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd803d71879e840f3bf740c3978552bc8', 'request_id': 'req-2b4b9c1c-bc45-480e-91af-e1897424c17c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:05.799125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b4b9c1c-bc45-480e-91af-e1897424c17c admin admin] The token cache is being invalidate because project d803d71879e840f3bf740c3978552bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:35:05.799701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b4b9c1c-bc45-480e-91af-e1897424c17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:05.800723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2b4b9c1c-bc45-480e-91af-e1897424c17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:05.803826 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3772/7489] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:35:05 2022] DELETE /identity/v3/projects/d803d71879e840f3bf740c3978552bc8 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:05.808951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e8856-770f-47f3-97a9-006db32f3d2b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:05.809240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e8856-770f-47f3-97a9-006db32f3d2b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:05.809571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e8856-770f-47f3-97a9-006db32f3d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:05.840687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-437e8856-770f-47f3-97a9-006db32f3d2b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:05.842742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-437e8856-770f-47f3-97a9-006db32f3d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:05.960351 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3718/7490] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:05.962679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144f558-2747-49cb-b4ca-ef6f0b673cac None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:05.963097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144f558-2747-49cb-b4ca-ef6f0b673cac None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:05.963298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144f558-2747-49cb-b4ca-ef6f0b673cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:05.987147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4144f558-2747-49cb-b4ca-ef6f0b673cac None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:05.988391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4144f558-2747-49cb-b4ca-ef6f0b673cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:05.999016 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3773/7491] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:06.002234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e8856-770f-47f3-97a9-006db32f3d2b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:06.014743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e8856-770f-47f3-97a9-006db32f3d2b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:06.020427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a4432-d569-42dc-9e3a-630c513ca3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:06.021981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a4432-d569-42dc-9e3a-630c513ca3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:06.022264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a4432-d569-42dc-9e3a-630c513ca3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:06.022537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a4432-d569-42dc-9e3a-630c513ca3e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:06.023417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a4432-d569-42dc-9e3a-630c513ca3e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:35:06.023765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a4432-d569-42dc-9e3a-630c513ca3e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:06.025378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a4432-d569-42dc-9e3a-630c513ca3e2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:06.045364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144f558-2747-49cb-b4ca-ef6f0b673cac None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:06.045935 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3719/7492] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:35:06.057533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144f558-2747-49cb-b4ca-ef6f0b673cac None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:06.069491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd762e8-eb1e-4b47-a3e6-8cb0db3d9817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:06.070118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd762e8-eb1e-4b47-a3e6-8cb0db3d9817 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:06.070543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd762e8-eb1e-4b47-a3e6-8cb0db3d9817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:06.070825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd762e8-eb1e-4b47-a3e6-8cb0db3d9817 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:06.071508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd762e8-eb1e-4b47-a3e6-8cb0db3d9817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:06.073447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd762e8-eb1e-4b47-a3e6-8cb0db3d9817 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:06.108809 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:06.128964 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3774/7493] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:35:06 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:35:06.132922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a4432-d569-42dc-9e3a-630c513ca3e2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:06.146906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a4432-d569-42dc-9e3a-630c513ca3e2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:06.218827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a519c-31af-46d2-a237-56e56f0c73c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:06.219684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a519c-31af-46d2-a237-56e56f0c73c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:06.219930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a519c-31af-46d2-a237-56e56f0c73c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:06.220338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a519c-31af-46d2-a237-56e56f0c73c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:06.221067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a519c-31af-46d2-a237-56e56f0c73c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:06.223094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a519c-31af-46d2-a237-56e56f0c73c6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:06.242776 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:06.252232 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3720/7494] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:35:06 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:35:06.253367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd762e8-eb1e-4b47-a3e6-8cb0db3d9817 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:06.264488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd762e8-eb1e-4b47-a3e6-8cb0db3d9817 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:06.269882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bea575-2709-420b-b9f7-b99ec5e670d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:06.270484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bea575-2709-420b-b9f7-b99ec5e670d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:06.270765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bea575-2709-420b-b9f7-b99ec5e670d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:06.271087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bea575-2709-420b-b9f7-b99ec5e670d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:06.271723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bea575-2709-420b-b9f7-b99ec5e670d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:06.273325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bea575-2709-420b-b9f7-b99ec5e670d2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:06.284426 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3775/7495] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:35:06.288414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a519c-31af-46d2-a237-56e56f0c73c6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:06.301830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a519c-31af-46d2-a237-56e56f0c73c6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:06.311434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfda45e-c7d7-45a4-bbda-3d4db94da248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:06.312274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfda45e-c7d7-45a4-bbda-3d4db94da248 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:06.313605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfda45e-c7d7-45a4-bbda-3d4db94da248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:06.313980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfda45e-c7d7-45a4-bbda-3d4db94da248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:06.314747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfda45e-c7d7-45a4-bbda-3d4db94da248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:06.317379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfda45e-c7d7-45a4-bbda-3d4db94da248 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:06.338755 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3721/7496] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:35:06.345918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bea575-2709-420b-b9f7-b99ec5e670d2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:06.369513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bea575-2709-420b-b9f7-b99ec5e670d2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:06.375430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cabcd-70e4-4389-a3ae-f6d17b943fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:06.375989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cabcd-70e4-4389-a3ae-f6d17b943fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:06.376275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cabcd-70e4-4389-a3ae-f6d17b943fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:06.376543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cabcd-70e4-4389-a3ae-f6d17b943fa6 admin admin] PATH_INFO: `/v3/projects/1275006c4b5c4f0ba3e3d5b264bd8ad7/users/a86be9b2c1774de4b6913c7900e1574d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:06.396473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4cabcd-70e4-4389-a3ae-f6d17b943fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1275006c4b5c4f0ba3e3d5b264bd8ad7, user_id=a86be9b2c1774de4b6913c7900e1574d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:06.399305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4cabcd-70e4-4389-a3ae-f6d17b943fa6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:06.428744 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3776/7497] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:35:06 2022] PUT /identity/v3/projects/1275006c4b5c4f0ba3e3d5b264bd8ad7/users/a86be9b2c1774de4b6913c7900e1574d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:06.430453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e11d8-810d-47c9-8d28-2d4439cde7ed None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:06.431009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e11d8-810d-47c9-8d28-2d4439cde7ed None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:06.431626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e11d8-810d-47c9-8d28-2d4439cde7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:06.468876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f97e11d8-810d-47c9-8d28-2d4439cde7ed None None] MFA Rules not processed for user `a86be9b2c1774de4b6913c7900e1574d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:06.471986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f97e11d8-810d-47c9-8d28-2d4439cde7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:06.597299 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3722/7498] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:06.601707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cabcd-70e4-4389-a3ae-f6d17b943fa6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:06.671307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cabcd-70e4-4389-a3ae-f6d17b943fa6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:06.677115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398f29-eeed-4426-a2cd-9a7700c2f7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:06.677936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398f29-eeed-4426-a2cd-9a7700c2f7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:06.678218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398f29-eeed-4426-a2cd-9a7700c2f7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:06.678488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398f29-eeed-4426-a2cd-9a7700c2f7b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:06.679171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb398f29-eeed-4426-a2cd-9a7700c2f7b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:06.681111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb398f29-eeed-4426-a2cd-9a7700c2f7b3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:06.711237 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3777/7499] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:35:06 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:35:06.715421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e11d8-810d-47c9-8d28-2d4439cde7ed None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:06.727012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e11d8-810d-47c9-8d28-2d4439cde7ed None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:06.797158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f6b16-77ea-416e-9d98-c7a1c44f9296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:06.797999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f6b16-77ea-416e-9d98-c7a1c44f9296 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:06.798308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f6b16-77ea-416e-9d98-c7a1c44f9296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:06.798713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f6b16-77ea-416e-9d98-c7a1c44f9296 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:06.799467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f6b16-77ea-416e-9d98-c7a1c44f9296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:06.801531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f6b16-77ea-416e-9d98-c7a1c44f9296 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:06.833568 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3723/7500] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:35:06 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:35:06.834817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398f29-eeed-4426-a2cd-9a7700c2f7b3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:06.845898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398f29-eeed-4426-a2cd-9a7700c2f7b3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:06.850864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87e3bc-aac0-4ebf-9edb-624b82230e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:06.851504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e3bc-aac0-4ebf-9edb-624b82230e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:06.851812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e3bc-aac0-4ebf-9edb-624b82230e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:06.852053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e3bc-aac0-4ebf-9edb-624b82230e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:06.852697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87e3bc-aac0-4ebf-9edb-624b82230e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:06.854519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87e3bc-aac0-4ebf-9edb-624b82230e87 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:06.866949 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3778/7501] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:35:06.872217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f6b16-77ea-416e-9d98-c7a1c44f9296 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:06.884159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f6b16-77ea-416e-9d98-c7a1c44f9296 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:06.889314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8104d6f-18e1-405c-8f33-46de1ba3398c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:06.890657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8104d6f-18e1-405c-8f33-46de1ba3398c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:06.891053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8104d6f-18e1-405c-8f33-46de1ba3398c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:06.891405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8104d6f-18e1-405c-8f33-46de1ba3398c admin admin] PATH_INFO: `/v3/projects/13c1ac97c4c7497493bea5f36880b829/users/5763d1b64139488d8a55f5402ce8a7e6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:06.909591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8104d6f-18e1-405c-8f33-46de1ba3398c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c1ac97c4c7497493bea5f36880b829, user_id=5763d1b64139488d8a55f5402ce8a7e6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:06.912414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8104d6f-18e1-405c-8f33-46de1ba3398c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:06.927849 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3724/7502] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:35:06 2022] PUT /identity/v3/projects/13c1ac97c4c7497493bea5f36880b829/users/5763d1b64139488d8a55f5402ce8a7e6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:06.931679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87e3bc-aac0-4ebf-9edb-624b82230e87 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:06.942474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87e3bc-aac0-4ebf-9edb-624b82230e87 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:07.006157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177039e-cf98-4fc7-9c17-02f021190e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:07.006800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177039e-cf98-4fc7-9c17-02f021190e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:07.007127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177039e-cf98-4fc7-9c17-02f021190e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:07.007402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177039e-cf98-4fc7-9c17-02f021190e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:07.008036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177039e-cf98-4fc7-9c17-02f021190e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:07.010541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177039e-cf98-4fc7-9c17-02f021190e60 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:07.021644 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3779/7503] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:35:07.026166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8104d6f-18e1-405c-8f33-46de1ba3398c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:07.041781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8104d6f-18e1-405c-8f33-46de1ba3398c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:07.050502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522fa44-2aff-46f1-ab1b-0c674d8cc6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:07.052881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522fa44-2aff-46f1-ab1b-0c674d8cc6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:07.053254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522fa44-2aff-46f1-ab1b-0c674d8cc6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:07.053602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522fa44-2aff-46f1-ab1b-0c674d8cc6a7 admin admin] PATH_INFO: `/v3/projects/13c1ac97c4c7497493bea5f36880b829/users/5763d1b64139488d8a55f5402ce8a7e6/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:07.058366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522fa44-2aff-46f1-ab1b-0c674d8cc6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c1ac97c4c7497493bea5f36880b829, user_id=5763d1b64139488d8a55f5402ce8a7e6, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:07.061153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522fa44-2aff-46f1-ab1b-0c674d8cc6a7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:07.091310 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3725/7504] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:35:07 2022] PUT /identity/v3/projects/13c1ac97c4c7497493bea5f36880b829/users/5763d1b64139488d8a55f5402ce8a7e6/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:07.096669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdad8a-45dc-43ba-b57f-f09fe100bea1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:07.097566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdad8a-45dc-43ba-b57f-f09fe100bea1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:07.097852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdad8a-45dc-43ba-b57f-f09fe100bea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:07.130508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-34fdad8a-45dc-43ba-b57f-f09fe100bea1 None None] MFA Rules not processed for user `5763d1b64139488d8a55f5402ce8a7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:07.131896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-34fdad8a-45dc-43ba-b57f-f09fe100bea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:07.150448 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:07.252962 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3780/7505] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:07.265165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522fa44-2aff-46f1-ab1b-0c674d8cc6a7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:07.267767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e522fa44-2aff-46f1-ab1b-0c674d8cc6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:07.311252 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:07.344661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522fa44-2aff-46f1-ab1b-0c674d8cc6a7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:07.348498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780d57b-f822-470b-81f3-7a6d8c1285d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:07.349336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d57b-f822-470b-81f3-7a6d8c1285d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:07.349719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d57b-f822-470b-81f3-7a6d8c1285d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:07.350059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d57b-f822-470b-81f3-7a6d8c1285d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:07.363070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780d57b-f822-470b-81f3-7a6d8c1285d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:07.365053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780d57b-f822-470b-81f3-7a6d8c1285d6 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:07.377166 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3726/7506] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:35:09.522250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdad8a-45dc-43ba-b57f-f09fe100bea1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:09.602425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdad8a-45dc-43ba-b57f-f09fe100bea1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:09.607223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:09.607957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:09.608316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:09.608669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] PATH_INFO: `/v3/users/a86be9b2c1774de4b6913c7900e1574d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:09.610453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86be9b2c1774de4b6913c7900e1574d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:09.612491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:09.685844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86be9b2c1774de4b6913c7900e1574d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:09.686826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86be9b2c1774de4b6913c7900e1574d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:09.701107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86be9b2c1774de4b6913c7900e1574d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:09.709298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86be9b2c1774de4b6913c7900e1574d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:09.710041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86be9b2c1774de4b6913c7900e1574d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:09.724522 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3781/7507] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:35:09 2022] DELETE /identity/v3/users/a86be9b2c1774de4b6913c7900e1574d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:09.729098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e03c1-8efe-4323-b1e1-4d26a3cc09f2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:09.729616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e03c1-8efe-4323-b1e1-4d26a3cc09f2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:09.729738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e03c1-8efe-4323-b1e1-4d26a3cc09f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:09.752126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f79e03c1-8efe-4323-b1e1-4d26a3cc09f2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:09.753347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f79e03c1-8efe-4323-b1e1-4d26a3cc09f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:09.820990 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3727/7508] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:09.832142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:09.833672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:09.880414 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:09.909610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143394d2-9e11-4e71-bd28-026a14fbcf3e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:09.913490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bd5d7-1517-4bfd-aba8-45af72c64a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:09.914239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bd5d7-1517-4bfd-aba8-45af72c64a9d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:09.914526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bd5d7-1517-4bfd-aba8-45af72c64a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:09.914797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bd5d7-1517-4bfd-aba8-45af72c64a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:09.926219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bd5d7-1517-4bfd-aba8-45af72c64a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:09.928067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bd5d7-1517-4bfd-aba8-45af72c64a9d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:09.939560 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3782/7509] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:35:10.245121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e03c1-8efe-4323-b1e1-4d26a3cc09f2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:10.247291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f79e03c1-8efe-4323-b1e1-4d26a3cc09f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:10.263344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e03c1-8efe-4323-b1e1-4d26a3cc09f2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:10.268395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:10.269124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:10.269474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:10.269869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] PATH_INFO: `/v3/projects/1275006c4b5c4f0ba3e3d5b264bd8ad7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:10.271118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1275006c4b5c4f0ba3e3d5b264bd8ad7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:10.274446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:10.329438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1275006c4b5c4f0ba3e3d5b264bd8ad7', 'request_id': 'req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:10.341592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1275006c4b5c4f0ba3e3d5b264bd8ad7', 'request_id': 'req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:10.355996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1275006c4b5c4f0ba3e3d5b264bd8ad7', 'request_id': 'req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:10.368538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] The token cache is being invalidate because project 1275006c4b5c4f0ba3e3d5b264bd8ad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:35:10.368884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:10.369602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:10.371515 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3728/7510] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:35:10 2022] DELETE /identity/v3/projects/1275006c4b5c4f0ba3e3d5b264bd8ad7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:10.377102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bd5d7-1517-4bfd-aba8-45af72c64a9d service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:10.392155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bd5d7-1517-4bfd-aba8-45af72c64a9d service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:10.458549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b6929-7012-4565-ae46-5ee103a61316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:10.459213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b6929-7012-4565-ae46-5ee103a61316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:10.459492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b6929-7012-4565-ae46-5ee103a61316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:10.459755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b6929-7012-4565-ae46-5ee103a61316 admin admin] PATH_INFO: `/v3/users/5763d1b64139488d8a55f5402ce8a7e6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:10.461072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b6929-7012-4565-ae46-5ee103a61316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5763d1b64139488d8a55f5402ce8a7e6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:10.463219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b6929-7012-4565-ae46-5ee103a61316 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:10.534190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e66b6929-7012-4565-ae46-5ee103a61316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5763d1b64139488d8a55f5402ce8a7e6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:10.535656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e66b6929-7012-4565-ae46-5ee103a61316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5763d1b64139488d8a55f5402ce8a7e6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:10.554363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e66b6929-7012-4565-ae46-5ee103a61316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5763d1b64139488d8a55f5402ce8a7e6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:10.566147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e66b6929-7012-4565-ae46-5ee103a61316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5763d1b64139488d8a55f5402ce8a7e6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:10.567715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e66b6929-7012-4565-ae46-5ee103a61316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5763d1b64139488d8a55f5402ce8a7e6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:10.583366 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3783/7511] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:35:10 2022] DELETE /identity/v3/users/5763d1b64139488d8a55f5402ce8a7e6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:10.943487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:10.945052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:10.961079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0f2d0-882c-46b2-9cc8-a487e6c998d4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:11.022230 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:11.030207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a1582-67a5-4ecf-adf2-34a5678bccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:11.030962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1582-67a5-4ecf-adf2-34a5678bccca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:11.031437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1582-67a5-4ecf-adf2-34a5678bccca admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:11.032213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1582-67a5-4ecf-adf2-34a5678bccca admin admin] PATH_INFO: `/v3/projects/13c1ac97c4c7497493bea5f36880b829` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:11.034465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a1582-67a5-4ecf-adf2-34a5678bccca admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c1ac97c4c7497493bea5f36880b829)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:11.036946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a1582-67a5-4ecf-adf2-34a5678bccca admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:11.093058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-931a1582-67a5-4ecf-adf2-34a5678bccca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c1ac97c4c7497493bea5f36880b829', 'request_id': 'req-931a1582-67a5-4ecf-adf2-34a5678bccca'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:11.100537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-931a1582-67a5-4ecf-adf2-34a5678bccca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c1ac97c4c7497493bea5f36880b829', 'request_id': 'req-931a1582-67a5-4ecf-adf2-34a5678bccca'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:11.110403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-931a1582-67a5-4ecf-adf2-34a5678bccca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c1ac97c4c7497493bea5f36880b829', 'request_id': 'req-931a1582-67a5-4ecf-adf2-34a5678bccca'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:11.122291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-931a1582-67a5-4ecf-adf2-34a5678bccca admin admin] The token cache is being invalidate because project 13c1ac97c4c7497493bea5f36880b829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:35:11.122712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-931a1582-67a5-4ecf-adf2-34a5678bccca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:11.123271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-931a1582-67a5-4ecf-adf2-34a5678bccca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:11.125359 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3729/7512] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:35:10 2022] DELETE /identity/v3/projects/13c1ac97c4c7497493bea5f36880b829 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:11.131332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81fa0d-1ed4-49ea-a6f4-4af498536a22 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:11.132117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81fa0d-1ed4-49ea-a6f4-4af498536a22 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:11.132716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81fa0d-1ed4-49ea-a6f4-4af498536a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:11.155557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ce81fa0d-1ed4-49ea-a6f4-4af498536a22 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:11.157846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ce81fa0d-1ed4-49ea-a6f4-4af498536a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:11.213853 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:11.230823 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3784/7513] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:11.240278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39dd55-dc9f-4c03-a62d-d13920b7e304 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:11.240575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39dd55-dc9f-4c03-a62d-d13920b7e304 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:11.240837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39dd55-dc9f-4c03-a62d-d13920b7e304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:11.262076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3a39dd55-dc9f-4c03-a62d-d13920b7e304 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:11.263349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a39dd55-dc9f-4c03-a62d-d13920b7e304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:11.271931 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3730/7514] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:11.276166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81fa0d-1ed4-49ea-a6f4-4af498536a22 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:11.287292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81fa0d-1ed4-49ea-a6f4-4af498536a22 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:11.292386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf13f0-837b-4d1e-acce-101097a43fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:11.293125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf13f0-837b-4d1e-acce-101097a43fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:11.293493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf13f0-837b-4d1e-acce-101097a43fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:11.293854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf13f0-837b-4d1e-acce-101097a43fd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:11.294569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf13f0-837b-4d1e-acce-101097a43fd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:35:11.295231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf13f0-837b-4d1e-acce-101097a43fd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:11.296911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf13f0-837b-4d1e-acce-101097a43fd6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:11.313547 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3785/7515] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:35:11.318215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39dd55-dc9f-4c03-a62d-d13920b7e304 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:11.329353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39dd55-dc9f-4c03-a62d-d13920b7e304 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:11.335150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1352fa-caca-469f-b661-2a88c2047880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:11.336021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1352fa-caca-469f-b661-2a88c2047880 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:11.336376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1352fa-caca-469f-b661-2a88c2047880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:11.336716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1352fa-caca-469f-b661-2a88c2047880 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:11.337429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1352fa-caca-469f-b661-2a88c2047880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:11.340038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1352fa-caca-469f-b661-2a88c2047880 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:11.379978 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3731/7516] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:35:11 2022] POST /identity/v3/projects => generated 399 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:35:11.384104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf13f0-837b-4d1e-acce-101097a43fd6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:11.398416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf13f0-837b-4d1e-acce-101097a43fd6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:11.504792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb8331-5bb8-43b7-ab46-ccbc4b0d86d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:11.505542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb8331-5bb8-43b7-ab46-ccbc4b0d86d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:11.505973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb8331-5bb8-43b7-ab46-ccbc4b0d86d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:11.506423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb8331-5bb8-43b7-ab46-ccbc4b0d86d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:11.507200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb8331-5bb8-43b7-ab46-ccbc4b0d86d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:11.509378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb8331-5bb8-43b7-ab46-ccbc4b0d86d8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:11.536336 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3786/7517] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:35:11 2022] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:35:11.544513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1352fa-caca-469f-b661-2a88c2047880 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:11.559512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1352fa-caca-469f-b661-2a88c2047880 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:11.565416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbb6d1-fd84-4d93-97b8-0f5cdcdbe7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:11.566119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbb6d1-fd84-4d93-97b8-0f5cdcdbe7cb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:11.566556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbb6d1-fd84-4d93-97b8-0f5cdcdbe7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:11.566907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbb6d1-fd84-4d93-97b8-0f5cdcdbe7cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:11.567913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbb6d1-fd84-4d93-97b8-0f5cdcdbe7cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:11.569604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbb6d1-fd84-4d93-97b8-0f5cdcdbe7cb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:11.582831 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3732/7518] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:35:11.586884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb8331-5bb8-43b7-ab46-ccbc4b0d86d8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:11.600203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb8331-5bb8-43b7-ab46-ccbc4b0d86d8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:11.606637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef361a-decc-43bb-9392-56ed7207e9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:11.607459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef361a-decc-43bb-9392-56ed7207e9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:11.607802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef361a-decc-43bb-9392-56ed7207e9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:11.608082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef361a-decc-43bb-9392-56ed7207e9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:11.608753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef361a-decc-43bb-9392-56ed7207e9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:11.611806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef361a-decc-43bb-9392-56ed7207e9c9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:11.624265 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3787/7519] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:35:11.628271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbb6d1-fd84-4d93-97b8-0f5cdcdbe7cb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:11.639766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbb6d1-fd84-4d93-97b8-0f5cdcdbe7cb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:11.645506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0bc5d-f1a1-4f8f-8a81-5defdbbf28f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:11.646192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0bc5d-f1a1-4f8f-8a81-5defdbbf28f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:11.646522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0bc5d-f1a1-4f8f-8a81-5defdbbf28f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:11.646804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0bc5d-f1a1-4f8f-8a81-5defdbbf28f0 admin admin] PATH_INFO: `/v3/projects/820571cc4ac041d091131800155e2d87/users/5a7df7ddd5bb467796d8d47080112b63/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:11.663583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0bc5d-f1a1-4f8f-8a81-5defdbbf28f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=820571cc4ac041d091131800155e2d87, user_id=5a7df7ddd5bb467796d8d47080112b63, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:11.665927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0bc5d-f1a1-4f8f-8a81-5defdbbf28f0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:11.687890 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3733/7520] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:35:11 2022] PUT /identity/v3/projects/820571cc4ac041d091131800155e2d87/users/5a7df7ddd5bb467796d8d47080112b63/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:35:11.698677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c82af-9dab-43ec-9a7e-cd5cc056c83a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:11.698945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c82af-9dab-43ec-9a7e-cd5cc056c83a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:11.699225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c82af-9dab-43ec-9a7e-cd5cc056c83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:11.740369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-938c82af-9dab-43ec-9a7e-cd5cc056c83a None None] MFA Rules not processed for user `5a7df7ddd5bb467796d8d47080112b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:11.744733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-938c82af-9dab-43ec-9a7e-cd5cc056c83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:11.833753 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3788/7521] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:11.838070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0bc5d-f1a1-4f8f-8a81-5defdbbf28f0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:11.927900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0bc5d-f1a1-4f8f-8a81-5defdbbf28f0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:11.934623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9765d-2a68-4050-8be8-b8f8bc407b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:11.935288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9765d-2a68-4050-8be8-b8f8bc407b20 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:11.935571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9765d-2a68-4050-8be8-b8f8bc407b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:11.935843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9765d-2a68-4050-8be8-b8f8bc407b20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:11.936521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9765d-2a68-4050-8be8-b8f8bc407b20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:11.939669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9765d-2a68-4050-8be8-b8f8bc407b20 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:11.978473 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3734/7522] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:35:11 2022] POST /identity/v3/projects => generated 399 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:35:11.979138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c82af-9dab-43ec-9a7e-cd5cc056c83a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:12.001582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c82af-9dab-43ec-9a7e-cd5cc056c83a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:12.074820 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:12.087162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f92fef-165a-4cff-bba7-e731f157159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:12.088121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f92fef-165a-4cff-bba7-e731f157159b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:12.088586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f92fef-165a-4cff-bba7-e731f157159b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:12.088989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f92fef-165a-4cff-bba7-e731f157159b admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:12.089890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f92fef-165a-4cff-bba7-e731f157159b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:12.091954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f92fef-165a-4cff-bba7-e731f157159b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:12.122994 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3789/7523] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:35:11 2022] POST /identity/v3/users => generated 306 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:35:12.126095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9765d-2a68-4050-8be8-b8f8bc407b20 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:12.137463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9765d-2a68-4050-8be8-b8f8bc407b20 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:12.153801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5c781-5b26-4722-a17c-427cbfdfa864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:12.154431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5c781-5b26-4722-a17c-427cbfdfa864 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:12.154713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5c781-5b26-4722-a17c-427cbfdfa864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:12.155060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5c781-5b26-4722-a17c-427cbfdfa864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:12.155706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5c781-5b26-4722-a17c-427cbfdfa864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:12.158008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5c781-5b26-4722-a17c-427cbfdfa864 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:12.160674 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:12.170996 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3735/7524] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:35:12.175235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f92fef-165a-4cff-bba7-e731f157159b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:12.186939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f92fef-165a-4cff-bba7-e731f157159b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:12.192624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7d6c7-202f-4a8d-8e63-77a354ef9531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:12.193299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7d6c7-202f-4a8d-8e63-77a354ef9531 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:12.193570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7d6c7-202f-4a8d-8e63-77a354ef9531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:12.193845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7d6c7-202f-4a8d-8e63-77a354ef9531 admin admin] PATH_INFO: `/v3/projects/8fa284769f95496a8cb1d5f9e8499d13/users/3a1e0c871f834036b464a5d4f5bea5e5/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:12.212693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7d6c7-202f-4a8d-8e63-77a354ef9531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa284769f95496a8cb1d5f9e8499d13, user_id=3a1e0c871f834036b464a5d4f5bea5e5, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:12.215476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7d6c7-202f-4a8d-8e63-77a354ef9531 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:12.230715 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3790/7525] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:35:12 2022] PUT /identity/v3/projects/8fa284769f95496a8cb1d5f9e8499d13/users/3a1e0c871f834036b464a5d4f5bea5e5/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:35:12.235278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5c781-5b26-4722-a17c-427cbfdfa864 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:12.246822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5c781-5b26-4722-a17c-427cbfdfa864 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:12.310754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3241a-71a0-46c8-9f38-618f5f6b1e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:12.312001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3241a-71a0-46c8-9f38-618f5f6b1e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:12.312844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3241a-71a0-46c8-9f38-618f5f6b1e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:12.313111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3241a-71a0-46c8-9f38-618f5f6b1e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:12.327082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3241a-71a0-46c8-9f38-618f5f6b1e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:12.327082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3241a-71a0-46c8-9f38-618f5f6b1e8e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:12.327607 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3736/7526] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:35:12.331974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7d6c7-202f-4a8d-8e63-77a354ef9531 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:12.344036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7d6c7-202f-4a8d-8e63-77a354ef9531 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:12.349169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625fd37-aa58-4da0-9717-220c6a87f672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:12.349959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625fd37-aa58-4da0-9717-220c6a87f672 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:12.350360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625fd37-aa58-4da0-9717-220c6a87f672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:12.350723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625fd37-aa58-4da0-9717-220c6a87f672 admin admin] PATH_INFO: `/v3/projects/8fa284769f95496a8cb1d5f9e8499d13/users/3a1e0c871f834036b464a5d4f5bea5e5/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:12.352765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625fd37-aa58-4da0-9717-220c6a87f672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa284769f95496a8cb1d5f9e8499d13, user_id=3a1e0c871f834036b464a5d4f5bea5e5, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:12.355545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625fd37-aa58-4da0-9717-220c6a87f672 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:12.368052 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3791/7527] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:35:12 2022] PUT /identity/v3/projects/8fa284769f95496a8cb1d5f9e8499d13/users/3a1e0c871f834036b464a5d4f5bea5e5/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:12.379928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981c76-049e-4e45-9a1a-a7ce768fdc58 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:12.380216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981c76-049e-4e45-9a1a-a7ce768fdc58 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:12.380495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981c76-049e-4e45-9a1a-a7ce768fdc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:12.411413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e4981c76-049e-4e45-9a1a-a7ce768fdc58 None None] MFA Rules not processed for user `3a1e0c871f834036b464a5d4f5bea5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:12.412616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e4981c76-049e-4e45-9a1a-a7ce768fdc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:12.505377 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3737/7528] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:12.528341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625fd37-aa58-4da0-9717-220c6a87f672 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:12.530354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a625fd37-aa58-4da0-9717-220c6a87f672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:12.637613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625fd37-aa58-4da0-9717-220c6a87f672 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:12.642910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed78cd2-2e3b-4aa5-9cd8-672e8ecf3666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:12.643642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed78cd2-2e3b-4aa5-9cd8-672e8ecf3666 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:12.643984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed78cd2-2e3b-4aa5-9cd8-672e8ecf3666 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:12.644450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed78cd2-2e3b-4aa5-9cd8-672e8ecf3666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:12.715028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed78cd2-2e3b-4aa5-9cd8-672e8ecf3666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:12.716831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed78cd2-2e3b-4aa5-9cd8-672e8ecf3666 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:12.727341 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3792/7529] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:12 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:35:13.091372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4981c76-049e-4e45-9a1a-a7ce768fdc58 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:13.092793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e4981c76-049e-4e45-9a1a-a7ce768fdc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:13.194255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4981c76-049e-4e45-9a1a-a7ce768fdc58 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:13.200474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529dd20-51bf-4deb-b55c-0e26263c6805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:13.201168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529dd20-51bf-4deb-b55c-0e26263c6805 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:13.201449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529dd20-51bf-4deb-b55c-0e26263c6805 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:13.201722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529dd20-51bf-4deb-b55c-0e26263c6805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:13.214052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529dd20-51bf-4deb-b55c-0e26263c6805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:13.215958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529dd20-51bf-4deb-b55c-0e26263c6805 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:13.239380 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3738/7530] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:35:13.850380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed78cd2-2e3b-4aa5-9cd8-672e8ecf3666 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:13.852430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eed78cd2-2e3b-4aa5-9cd8-672e8ecf3666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:13.949478 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:13.987022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed78cd2-2e3b-4aa5-9cd8-672e8ecf3666 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:14.018346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405db4d-bd9a-4b00-ba8b-b3cdd5327037 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:14.019338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405db4d-bd9a-4b00-ba8b-b3cdd5327037 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:14.019784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405db4d-bd9a-4b00-ba8b-b3cdd5327037 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:14.020243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405db4d-bd9a-4b00-ba8b-b3cdd5327037 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:14.026042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0405db4d-bd9a-4b00-ba8b-b3cdd5327037 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:14.178651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405db4d-bd9a-4b00-ba8b-b3cdd5327037 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:14.180886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405db4d-bd9a-4b00-ba8b-b3cdd5327037 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:14.191361 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3793/7531] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:35:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:35:16.180979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529dd20-51bf-4deb-b55c-0e26263c6805 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:16.194892 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:16.202757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529dd20-51bf-4deb-b55c-0e26263c6805 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:16.211637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abb458-cd9c-47f5-abce-cb6889b5cd33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:16.212544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abb458-cd9c-47f5-abce-cb6889b5cd33 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:16.213018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abb458-cd9c-47f5-abce-cb6889b5cd33 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:16.213588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abb458-cd9c-47f5-abce-cb6889b5cd33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:16.215723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f1abb458-cd9c-47f5-abce-cb6889b5cd33 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:16.372735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abb458-cd9c-47f5-abce-cb6889b5cd33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:16.376282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abb458-cd9c-47f5-abce-cb6889b5cd33 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:16.387845 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3739/7532] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:35:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:35:20.908120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405db4d-bd9a-4b00-ba8b-b3cdd5327037 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:20.909652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0405db4d-bd9a-4b00-ba8b-b3cdd5327037 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:21.126490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abb458-cd9c-47f5-abce-cb6889b5cd33 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:21.139966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405db4d-bd9a-4b00-ba8b-b3cdd5327037 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:21.145537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3416d-1f2b-453d-9977-e34622d194d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:21.146152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3416d-1f2b-453d-9977-e34622d194d3 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:21.146450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3416d-1f2b-453d-9977-e34622d194d3 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:21.146716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3416d-1f2b-453d-9977-e34622d194d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:21.149210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-82b3416d-1f2b-453d-9977-e34622d194d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:21.165387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3416d-1f2b-453d-9977-e34622d194d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:21.167014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3416d-1f2b-453d-9977-e34622d194d3 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:21.182695 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3794/7533] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:35:21.310232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abb458-cd9c-47f5-abce-cb6889b5cd33 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:21.319418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:21.320241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:21.320708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:21.321136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] PATH_INFO: `/v3/users/5a7df7ddd5bb467796d8d47080112b63` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:21.322559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7df7ddd5bb467796d8d47080112b63)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:21.324756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:21.430256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7df7ddd5bb467796d8d47080112b63'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:21.431332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7df7ddd5bb467796d8d47080112b63'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:21.454211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7df7ddd5bb467796d8d47080112b63'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:21.464130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7df7ddd5bb467796d8d47080112b63'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:21.465031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7df7ddd5bb467796d8d47080112b63'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:21.486564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc57fb-1385-434e-bcb1-baf3fcf4f4f5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:21.486849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc57fb-1385-434e-bcb1-baf3fcf4f4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:21.487183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc57fb-1385-434e-bcb1-baf3fcf4f4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:21.495949 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3740/7534] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:35:21 2022] DELETE /identity/v3/users/5a7df7ddd5bb467796d8d47080112b63 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:21.512648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-92cc57fb-1385-434e-bcb1-baf3fcf4f4f5 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:21.513929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-92cc57fb-1385-434e-bcb1-baf3fcf4f4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:21.669727 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3795/7535] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:21.679928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:21.682558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:21.714724 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:21.755899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bc9bb-d7a2-45ad-ad7d-9115e0336562 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:21.759687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46ad1e-554c-4857-99d2-71a4dd0c966f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:21.760404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46ad1e-554c-4857-99d2-71a4dd0c966f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:21.760834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46ad1e-554c-4857-99d2-71a4dd0c966f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:21.761223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46ad1e-554c-4857-99d2-71a4dd0c966f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:21.774611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46ad1e-554c-4857-99d2-71a4dd0c966f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:21.776446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46ad1e-554c-4857-99d2-71a4dd0c966f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:21.789423 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3741/7536] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:35:22.063478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc57fb-1385-434e-bcb1-baf3fcf4f4f5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:22.065302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-92cc57fb-1385-434e-bcb1-baf3fcf4f4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:22.090322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc57fb-1385-434e-bcb1-baf3fcf4f4f5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:22.099513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:22.100416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:22.101115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:22.101570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] PATH_INFO: `/v3/projects/820571cc4ac041d091131800155e2d87` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:22.103438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=820571cc4ac041d091131800155e2d87)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:22.105961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:22.150734 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:22.177444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820571cc4ac041d091131800155e2d87', 'request_id': 'req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:22.183947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820571cc4ac041d091131800155e2d87', 'request_id': 'req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:22.195377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820571cc4ac041d091131800155e2d87', 'request_id': 'req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:22.218815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] The token cache is being invalidate because project 820571cc4ac041d091131800155e2d87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:35:22.219217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:22.227370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:22.229162 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3796/7537] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:35:22 2022] DELETE /identity/v3/projects/820571cc4ac041d091131800155e2d87 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:22.232827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46ad1e-554c-4857-99d2-71a4dd0c966f service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:22.244878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46ad1e-554c-4857-99d2-71a4dd0c966f service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:22.339805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089e1b4-1f8f-440a-981c-70b428c4b322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:22.341130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089e1b4-1f8f-440a-981c-70b428c4b322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:22.341615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089e1b4-1f8f-440a-981c-70b428c4b322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:22.341884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089e1b4-1f8f-440a-981c-70b428c4b322 admin admin] PATH_INFO: `/v3/users/3a1e0c871f834036b464a5d4f5bea5e5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:22.343065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089e1b4-1f8f-440a-981c-70b428c4b322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1e0c871f834036b464a5d4f5bea5e5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:22.345951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089e1b4-1f8f-440a-981c-70b428c4b322 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:22.486374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5089e1b4-1f8f-440a-981c-70b428c4b322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1e0c871f834036b464a5d4f5bea5e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:22.487229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5089e1b4-1f8f-440a-981c-70b428c4b322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1e0c871f834036b464a5d4f5bea5e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:22.527381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5089e1b4-1f8f-440a-981c-70b428c4b322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1e0c871f834036b464a5d4f5bea5e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:22.543370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5089e1b4-1f8f-440a-981c-70b428c4b322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1e0c871f834036b464a5d4f5bea5e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:22.551794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5089e1b4-1f8f-440a-981c-70b428c4b322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1e0c871f834036b464a5d4f5bea5e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:22.587238 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3742/7538] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:35:22 2022] DELETE /identity/v3/users/3a1e0c871f834036b464a5d4f5bea5e5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:22.848920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:22.850498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:22.865216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391bcf7-4b3b-4e0c-96f0-26aba3204e60 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:23.012207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29867f-767f-4c64-b882-bbf51f171b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:23.012488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29867f-767f-4c64-b882-bbf51f171b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:23.012935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29867f-767f-4c64-b882-bbf51f171b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:23.013285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29867f-767f-4c64-b882-bbf51f171b73 admin admin] PATH_INFO: `/v3/projects/8fa284769f95496a8cb1d5f9e8499d13` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:23.014591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29867f-767f-4c64-b882-bbf51f171b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa284769f95496a8cb1d5f9e8499d13)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:23.016852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29867f-767f-4c64-b882-bbf51f171b73 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:23.082188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0c29867f-767f-4c64-b882-bbf51f171b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa284769f95496a8cb1d5f9e8499d13', 'request_id': 'req-0c29867f-767f-4c64-b882-bbf51f171b73'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:23.090041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0c29867f-767f-4c64-b882-bbf51f171b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa284769f95496a8cb1d5f9e8499d13', 'request_id': 'req-0c29867f-767f-4c64-b882-bbf51f171b73'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:23.106774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0c29867f-767f-4c64-b882-bbf51f171b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa284769f95496a8cb1d5f9e8499d13', 'request_id': 'req-0c29867f-767f-4c64-b882-bbf51f171b73'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:23.131082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0c29867f-767f-4c64-b882-bbf51f171b73 admin admin] The token cache is being invalidate because project 8fa284769f95496a8cb1d5f9e8499d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:35:23.131404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0c29867f-767f-4c64-b882-bbf51f171b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:23.134501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0c29867f-767f-4c64-b882-bbf51f171b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:23.141226 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3797/7539] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:35:22 2022] DELETE /identity/v3/projects/8fa284769f95496a8cb1d5f9e8499d13 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:23.142979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf270e-3152-45c1-9911-d1c81bb2d241 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:23.143434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf270e-3152-45c1-9911-d1c81bb2d241 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:23.143737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf270e-3152-45c1-9911-d1c81bb2d241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:23.177030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4aaf270e-3152-45c1-9911-d1c81bb2d241 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:23.181991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4aaf270e-3152-45c1-9911-d1c81bb2d241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:23.233218 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:23.261052 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3743/7540] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:23.268584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41da7f8-0b79-462b-aa55-95881bcea02a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:23.269791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41da7f8-0b79-462b-aa55-95881bcea02a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:23.269791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41da7f8-0b79-462b-aa55-95881bcea02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:23.306800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e41da7f8-0b79-462b-aa55-95881bcea02a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:23.308278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e41da7f8-0b79-462b-aa55-95881bcea02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:23.331539 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3798/7541] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:35:23.335118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf270e-3152-45c1-9911-d1c81bb2d241 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:23.350579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf270e-3152-45c1-9911-d1c81bb2d241 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:23.356401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640d07d-d81a-4196-be2a-473b20f6b024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:23.357024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640d07d-d81a-4196-be2a-473b20f6b024 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:23.357301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640d07d-d81a-4196-be2a-473b20f6b024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:23.357570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640d07d-d81a-4196-be2a-473b20f6b024 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:23.358216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640d07d-d81a-4196-be2a-473b20f6b024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:35:23.358515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640d07d-d81a-4196-be2a-473b20f6b024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:23.360766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640d07d-d81a-4196-be2a-473b20f6b024 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:23.404636 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3744/7542] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:35:23.409609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41da7f8-0b79-462b-aa55-95881bcea02a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:23.441262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41da7f8-0b79-462b-aa55-95881bcea02a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:23.446746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611efa6-8a62-40fb-bd7e-8dbde4933a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:23.447594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611efa6-8a62-40fb-bd7e-8dbde4933a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:23.448059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611efa6-8a62-40fb-bd7e-8dbde4933a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:23.448513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611efa6-8a62-40fb-bd7e-8dbde4933a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:23.449397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611efa6-8a62-40fb-bd7e-8dbde4933a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:23.451525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611efa6-8a62-40fb-bd7e-8dbde4933a73 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:23.500188 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3799/7543] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:35:23 2022] POST /identity/v3/projects => generated 357 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:35:23.501305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640d07d-d81a-4196-be2a-473b20f6b024 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:23.518835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640d07d-d81a-4196-be2a-473b20f6b024 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:23.685184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277c2d8-4d00-4dbe-97b2-e60e413f07a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:23.686011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277c2d8-4d00-4dbe-97b2-e60e413f07a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:23.686542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277c2d8-4d00-4dbe-97b2-e60e413f07a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:23.687149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277c2d8-4d00-4dbe-97b2-e60e413f07a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:23.688057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277c2d8-4d00-4dbe-97b2-e60e413f07a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:23.691430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277c2d8-4d00-4dbe-97b2-e60e413f07a0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:23.732033 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3745/7544] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:35:23 2022] POST /identity/v3/users => generated 279 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:35:23.736009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611efa6-8a62-40fb-bd7e-8dbde4933a73 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:23.766602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611efa6-8a62-40fb-bd7e-8dbde4933a73 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:23.766602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca122a65-02d5-47ba-b206-33d73e69c915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:23.766602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122a65-02d5-47ba-b206-33d73e69c915 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:23.766602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122a65-02d5-47ba-b206-33d73e69c915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:23.767222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122a65-02d5-47ba-b206-33d73e69c915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:23.767222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca122a65-02d5-47ba-b206-33d73e69c915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:23.767577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca122a65-02d5-47ba-b206-33d73e69c915 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:23.785357 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3800/7545] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:35:23.786057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277c2d8-4d00-4dbe-97b2-e60e413f07a0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:23.808789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277c2d8-4d00-4dbe-97b2-e60e413f07a0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:23.834075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94411793-86e3-424d-8e0a-c75ff876eef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:23.835464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94411793-86e3-424d-8e0a-c75ff876eef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:23.837768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94411793-86e3-424d-8e0a-c75ff876eef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:23.838711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94411793-86e3-424d-8e0a-c75ff876eef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:23.839696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94411793-86e3-424d-8e0a-c75ff876eef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:23.843869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94411793-86e3-424d-8e0a-c75ff876eef0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:23.874169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca122a65-02d5-47ba-b206-33d73e69c915 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:23.880811 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3746/7546] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:35:23.881285 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:23.891098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca122a65-02d5-47ba-b206-33d73e69c915 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:23.899822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cbfac-6d66-4d5e-b4fa-af3e967bc178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:23.900923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cbfac-6d66-4d5e-b4fa-af3e967bc178 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:23.901275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cbfac-6d66-4d5e-b4fa-af3e967bc178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:23.901722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cbfac-6d66-4d5e-b4fa-af3e967bc178 admin admin] PATH_INFO: `/v3/projects/a09a9ac6af9a4bf5a65e4266d595a0d3/users/82258b8971144bfd96139d93a64defa6/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:23.925825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cbfac-6d66-4d5e-b4fa-af3e967bc178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09a9ac6af9a4bf5a65e4266d595a0d3, user_id=82258b8971144bfd96139d93a64defa6, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:23.929753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cbfac-6d66-4d5e-b4fa-af3e967bc178 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:23.957970 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3801/7547] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:35:23 2022] PUT /identity/v3/projects/a09a9ac6af9a4bf5a65e4266d595a0d3/users/82258b8971144bfd96139d93a64defa6/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:35:23.970236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0607b5-ebc9-4bc4-a5c1-fa8714346c34 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:23.970585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0607b5-ebc9-4bc4-a5c1-fa8714346c34 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:23.970807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0607b5-ebc9-4bc4-a5c1-fa8714346c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:24.005892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0b0607b5-ebc9-4bc4-a5c1-fa8714346c34 None None] MFA Rules not processed for user `82258b8971144bfd96139d93a64defa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:24.007124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0b0607b5-ebc9-4bc4-a5c1-fa8714346c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:24.100276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cbfac-6d66-4d5e-b4fa-af3e967bc178 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:24.103028 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3747/7548] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:24.196082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cbfac-6d66-4d5e-b4fa-af3e967bc178 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:24.202020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c14218-2af4-495f-8d22-febed66d38c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:24.202865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c14218-2af4-495f-8d22-febed66d38c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:24.203305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c14218-2af4-495f-8d22-febed66d38c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:24.203830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c14218-2af4-495f-8d22-febed66d38c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:24.204957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c14218-2af4-495f-8d22-febed66d38c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:24.207474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c14218-2af4-495f-8d22-febed66d38c5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:24.247070 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3802/7549] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:35:24 2022] POST /identity/v3/projects => generated 355 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:35:24.250258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0607b5-ebc9-4bc4-a5c1-fa8714346c34 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:24.263178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0607b5-ebc9-4bc4-a5c1-fa8714346c34 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:24.364478 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:24.393243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5abd3-ad8a-4878-8753-37348cf8a48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:24.394145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5abd3-ad8a-4878-8753-37348cf8a48c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:24.394582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5abd3-ad8a-4878-8753-37348cf8a48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:24.395204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5abd3-ad8a-4878-8753-37348cf8a48c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:24.395992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5abd3-ad8a-4878-8753-37348cf8a48c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:24.398154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5abd3-ad8a-4878-8753-37348cf8a48c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:24.438377 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3748/7550] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:35:24 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:35:24.440047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c14218-2af4-495f-8d22-febed66d38c5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:24.453803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c14218-2af4-495f-8d22-febed66d38c5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:24.459426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9c458-0f34-4056-b35a-374cffb283af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:24.460363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c458-0f34-4056-b35a-374cffb283af admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:24.460688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c458-0f34-4056-b35a-374cffb283af admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:24.461177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c458-0f34-4056-b35a-374cffb283af admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:24.462124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9c458-0f34-4056-b35a-374cffb283af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:24.464167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9c458-0f34-4056-b35a-374cffb283af admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:24.492302 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3803/7551] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:35:24.496559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5abd3-ad8a-4878-8753-37348cf8a48c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:24.510026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5abd3-ad8a-4878-8753-37348cf8a48c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:24.516642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa71ca1-d32f-4cbc-b94a-a68fd8d31d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:24.517571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa71ca1-d32f-4cbc-b94a-a68fd8d31d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:24.518015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa71ca1-d32f-4cbc-b94a-a68fd8d31d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:24.518526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa71ca1-d32f-4cbc-b94a-a68fd8d31d5b admin admin] PATH_INFO: `/v3/projects/aa249c0a6f0f49d2994e37462c4bdff2/users/900969e85b864a11b1de77ed6a1b21cd/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:24.538574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa71ca1-d32f-4cbc-b94a-a68fd8d31d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa249c0a6f0f49d2994e37462c4bdff2, user_id=900969e85b864a11b1de77ed6a1b21cd, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:24.545958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa71ca1-d32f-4cbc-b94a-a68fd8d31d5b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:24.591780 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3749/7552] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:35:24 2022] PUT /identity/v3/projects/aa249c0a6f0f49d2994e37462c4bdff2/users/900969e85b864a11b1de77ed6a1b21cd/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:24.593784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9c458-0f34-4056-b35a-374cffb283af admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:24.604810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9c458-0f34-4056-b35a-374cffb283af admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:24.774094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc460119-1891-4583-9178-fce96087fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:24.775001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc460119-1891-4583-9178-fce96087fa73 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:24.775425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc460119-1891-4583-9178-fce96087fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:24.775814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc460119-1891-4583-9178-fce96087fa73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:24.776754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc460119-1891-4583-9178-fce96087fa73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:24.783745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc460119-1891-4583-9178-fce96087fa73 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:24.806555 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3804/7553] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:35:24.810412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa71ca1-d32f-4cbc-b94a-a68fd8d31d5b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:24.825823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa71ca1-d32f-4cbc-b94a-a68fd8d31d5b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:24.840123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a58a7-71c3-4112-87e1-9424f500b43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:24.840649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a58a7-71c3-4112-87e1-9424f500b43d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:24.840927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a58a7-71c3-4112-87e1-9424f500b43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:24.841198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a58a7-71c3-4112-87e1-9424f500b43d admin admin] PATH_INFO: `/v3/projects/aa249c0a6f0f49d2994e37462c4bdff2/users/900969e85b864a11b1de77ed6a1b21cd/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:24.845200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a58a7-71c3-4112-87e1-9424f500b43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa249c0a6f0f49d2994e37462c4bdff2, user_id=900969e85b864a11b1de77ed6a1b21cd, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:24.852902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a58a7-71c3-4112-87e1-9424f500b43d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:24.872966 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3750/7554] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:35:24 2022] PUT /identity/v3/projects/aa249c0a6f0f49d2994e37462c4bdff2/users/900969e85b864a11b1de77ed6a1b21cd/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:24.885786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d40e3-0b6c-4ae2-9b2c-e7104e30eb1b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:24.887663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d40e3-0b6c-4ae2-9b2c-e7104e30eb1b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:24.888268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d40e3-0b6c-4ae2-9b2c-e7104e30eb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:24.976419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-487d40e3-0b6c-4ae2-9b2c-e7104e30eb1b None None] MFA Rules not processed for user `900969e85b864a11b1de77ed6a1b21cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:24.976419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-487d40e3-0b6c-4ae2-9b2c-e7104e30eb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:25.057223 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:25.112862 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3805/7555] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:25.117541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a58a7-71c3-4112-87e1-9424f500b43d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:25.133839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a58a7-71c3-4112-87e1-9424f500b43d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:25.144776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cae6b-df33-4b7b-8d1d-1d90646a4532 tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '900969e85b864a11b1de77ed6a1b21cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa249c0a6f0f49d2994e37462c4bdff2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:25.145399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cae6b-df33-4b7b-8d1d-1d90646a4532 tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:25.145680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cae6b-df33-4b7b-8d1d-1d90646a4532 tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:25.145961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cae6b-df33-4b7b-8d1d-1d90646a4532 tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:25.146619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cae6b-df33-4b7b-8d1d-1d90646a4532 tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:35:25.146937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cae6b-df33-4b7b-8d1d-1d90646a4532 tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:25.148563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cae6b-df33-4b7b-8d1d-1d90646a4532 tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:25.185961 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3751/7556] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:35:25.188338 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d40e3-0b6c-4ae2-9b2c-e7104e30eb1b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:25.205394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d40e3-0b6c-4ae2-9b2c-e7104e30eb1b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:25.222884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231400c-e861-4fd5-8c46-8de712f2bc5f tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '900969e85b864a11b1de77ed6a1b21cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa249c0a6f0f49d2994e37462c4bdff2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:25.223645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231400c-e861-4fd5-8c46-8de712f2bc5f tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:25.224028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231400c-e861-4fd5-8c46-8de712f2bc5f tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:25.224407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231400c-e861-4fd5-8c46-8de712f2bc5f tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:25.225259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231400c-e861-4fd5-8c46-8de712f2bc5f tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:25.230184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231400c-e861-4fd5-8c46-8de712f2bc5f tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:25.324058 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3806/7557] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:35:25 2022] POST /identity/v3/projects => generated 349 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:35:25.328843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cae6b-df33-4b7b-8d1d-1d90646a4532 tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:25.342488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cae6b-df33-4b7b-8d1d-1d90646a4532 tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:25.441240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a79ee9-13c1-4722-80d2-9382381fc9ee tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '900969e85b864a11b1de77ed6a1b21cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa249c0a6f0f49d2994e37462c4bdff2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:25.441987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79ee9-13c1-4722-80d2-9382381fc9ee tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:25.443452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79ee9-13c1-4722-80d2-9382381fc9ee tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:25.443959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79ee9-13c1-4722-80d2-9382381fc9ee tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:25.445076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a79ee9-13c1-4722-80d2-9382381fc9ee tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:35:25.445485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a79ee9-13c1-4722-80d2-9382381fc9ee tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:25.458829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a79ee9-13c1-4722-80d2-9382381fc9ee tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:25.483192 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3752/7558] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:35:25.495245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231400c-e861-4fd5-8c46-8de712f2bc5f tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:25.497010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6231400c-e861-4fd5-8c46-8de712f2bc5f tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:25.660922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231400c-e861-4fd5-8c46-8de712f2bc5f tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:25.670519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68884fb-b7b6-41ca-8bf2-9d6fe0e10488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:25.683413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68884fb-b7b6-41ca-8bf2-9d6fe0e10488 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:25.683662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68884fb-b7b6-41ca-8bf2-9d6fe0e10488 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:25.683875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68884fb-b7b6-41ca-8bf2-9d6fe0e10488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:25.704442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68884fb-b7b6-41ca-8bf2-9d6fe0e10488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:25.705922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68884fb-b7b6-41ca-8bf2-9d6fe0e10488 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:25.774237 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3807/7559] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:35:26.092697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a79ee9-13c1-4722-80d2-9382381fc9ee tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:26.148806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a79ee9-13c1-4722-80d2-9382381fc9ee tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:26.165137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba120f4-646a-4151-867e-d977bcabee5a tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '900969e85b864a11b1de77ed6a1b21cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa249c0a6f0f49d2994e37462c4bdff2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:26.165826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba120f4-646a-4151-867e-d977bcabee5a tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:26.166483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba120f4-646a-4151-867e-d977bcabee5a tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:26.166803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba120f4-646a-4151-867e-d977bcabee5a tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] PATH_INFO: `/v3/projects/186239cd63c44cc2ad90c22edb269cb0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:26.168810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba120f4-646a-4151-867e-d977bcabee5a tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: Authorizing `identity:delete_project(project_id=186239cd63c44cc2ad90c22edb269cb0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:26.170746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba120f4-646a-4151-867e-d977bcabee5a tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:26.287996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ba120f4-646a-4151-867e-d977bcabee5a tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '186239cd63c44cc2ad90c22edb269cb0', 'request_id': 'req-0ba120f4-646a-4151-867e-d977bcabee5a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:26.306936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ba120f4-646a-4151-867e-d977bcabee5a tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '186239cd63c44cc2ad90c22edb269cb0', 'request_id': 'req-0ba120f4-646a-4151-867e-d977bcabee5a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:26.339480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ba120f4-646a-4151-867e-d977bcabee5a tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '186239cd63c44cc2ad90c22edb269cb0', 'request_id': 'req-0ba120f4-646a-4151-867e-d977bcabee5a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:26.371234 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:26.381818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ba120f4-646a-4151-867e-d977bcabee5a tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] The token cache is being invalidate because project 186239cd63c44cc2ad90c22edb269cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:35:26.382434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ba120f4-646a-4151-867e-d977bcabee5a tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:26.383865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ba120f4-646a-4151-867e-d977bcabee5a tempest-QuotasTest-304454733 tempest-QuotasTest-304454733-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:26.394579 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3753/7560] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:35:26 2022] DELETE /identity/v3/projects/186239cd63c44cc2ad90c22edb269cb0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:26.600999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68884fb-b7b6-41ca-8bf2-9d6fe0e10488 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:26.763122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68884fb-b7b6-41ca-8bf2-9d6fe0e10488 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:26.883841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:26.884476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:26.884750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:26.885021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] PATH_INFO: `/v3/users/82258b8971144bfd96139d93a64defa6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:26.887486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=82258b8971144bfd96139d93a64defa6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:26.889583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:26.896917 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:27.026095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82258b8971144bfd96139d93a64defa6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:27.026095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82258b8971144bfd96139d93a64defa6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:27.051328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82258b8971144bfd96139d93a64defa6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:27.076112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82258b8971144bfd96139d93a64defa6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:27.076886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82258b8971144bfd96139d93a64defa6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:27.116668 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3808/7561] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:35:26 2022] DELETE /identity/v3/users/82258b8971144bfd96139d93a64defa6 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:27.121445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a04e8-3f3e-4e97-9526-f8f600e0b120 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:27.121776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a04e8-3f3e-4e97-9526-f8f600e0b120 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:27.122059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a04e8-3f3e-4e97-9526-f8f600e0b120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:27.179334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f78a04e8-3f3e-4e97-9526-f8f600e0b120 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:27.184153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f78a04e8-3f3e-4e97-9526-f8f600e0b120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:27.350358 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3754/7562] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:27.361710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:27.363273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:27.529680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfabbea-eb95-489c-ba12-26881598cb2d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:27.543472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a993-7501-4ba6-82fa-fbdd3ab0cd75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:27.544052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a993-7501-4ba6-82fa-fbdd3ab0cd75 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:27.544339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a993-7501-4ba6-82fa-fbdd3ab0cd75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:27.544701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a993-7501-4ba6-82fa-fbdd3ab0cd75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:27.560611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70a993-7501-4ba6-82fa-fbdd3ab0cd75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:27.562480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70a993-7501-4ba6-82fa-fbdd3ab0cd75 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:27.586384 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3809/7563] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:35:27.959849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a04e8-3f3e-4e97-9526-f8f600e0b120 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:27.961659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f78a04e8-3f3e-4e97-9526-f8f600e0b120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:27.987115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a04e8-3f3e-4e97-9526-f8f600e0b120 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:28.019718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:28.028104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:28.029078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:28.031530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] PATH_INFO: `/v3/projects/a09a9ac6af9a4bf5a65e4266d595a0d3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:28.033991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09a9ac6af9a4bf5a65e4266d595a0d3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:28.036152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:28.157372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09a9ac6af9a4bf5a65e4266d595a0d3', 'request_id': 'req-d8beb381-1754-4d28-90a9-dcbf91eb852a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:28.165797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09a9ac6af9a4bf5a65e4266d595a0d3', 'request_id': 'req-d8beb381-1754-4d28-90a9-dcbf91eb852a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:28.183404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09a9ac6af9a4bf5a65e4266d595a0d3', 'request_id': 'req-d8beb381-1754-4d28-90a9-dcbf91eb852a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:28.209572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] The token cache is being invalidate because project a09a9ac6af9a4bf5a65e4266d595a0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:35:28.210309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:28.211232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:28.213018 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3755/7564] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:35:27 2022] DELETE /identity/v3/projects/a09a9ac6af9a4bf5a65e4266d595a0d3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:28.217323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a993-7501-4ba6-82fa-fbdd3ab0cd75 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:28.236397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a993-7501-4ba6-82fa-fbdd3ab0cd75 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:28.347914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:28.348459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:28.348953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:28.349389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] PATH_INFO: `/v3/users/900969e85b864a11b1de77ed6a1b21cd` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:28.350808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900969e85b864a11b1de77ed6a1b21cd)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:28.353147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:28.386102 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:28.412080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900969e85b864a11b1de77ed6a1b21cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:28.412808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900969e85b864a11b1de77ed6a1b21cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:28.426785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900969e85b864a11b1de77ed6a1b21cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:28.435322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900969e85b864a11b1de77ed6a1b21cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:28.436040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900969e85b864a11b1de77ed6a1b21cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:28.453708 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3810/7565] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:35:28 2022] DELETE /identity/v3/users/900969e85b864a11b1de77ed6a1b21cd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:35:28.775512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:28.778021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:28.941783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beb381-1754-4d28-90a9-dcbf91eb852a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:29.008127 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:29.009670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:29.011344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:29.044175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655744f-bff7-4255-9a4a-0a93c46423dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:29.056920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655744f-bff7-4255-9a4a-0a93c46423dd service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:29.059524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655744f-bff7-4255-9a4a-0a93c46423dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:29.060118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655744f-bff7-4255-9a4a-0a93c46423dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:29.080279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1655744f-bff7-4255-9a4a-0a93c46423dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:29.175917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd5e8f-ba88-4b5e-b4bf-9be62f92c565 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:29.187503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ca681-d0c7-4852-9fd3-a55a8ba565c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:29.188301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ca681-d0c7-4852-9fd3-a55a8ba565c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:29.188588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ca681-d0c7-4852-9fd3-a55a8ba565c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:29.190962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ca681-d0c7-4852-9fd3-a55a8ba565c4 admin admin] PATH_INFO: `/v3/projects/aa249c0a6f0f49d2994e37462c4bdff2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:29.196549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ca681-d0c7-4852-9fd3-a55a8ba565c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa249c0a6f0f49d2994e37462c4bdff2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:29.198824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ca681-d0c7-4852-9fd3-a55a8ba565c4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:29.226112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655744f-bff7-4255-9a4a-0a93c46423dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:29.228683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655744f-bff7-4255-9a4a-0a93c46423dd service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:29.261309 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3756/7566] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:35:29.301483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-998ca681-d0c7-4852-9fd3-a55a8ba565c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa249c0a6f0f49d2994e37462c4bdff2', 'request_id': 'req-998ca681-d0c7-4852-9fd3-a55a8ba565c4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:29.310403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-998ca681-d0c7-4852-9fd3-a55a8ba565c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa249c0a6f0f49d2994e37462c4bdff2', 'request_id': 'req-998ca681-d0c7-4852-9fd3-a55a8ba565c4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:29.347983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-998ca681-d0c7-4852-9fd3-a55a8ba565c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa249c0a6f0f49d2994e37462c4bdff2', 'request_id': 'req-998ca681-d0c7-4852-9fd3-a55a8ba565c4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:29.382312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-998ca681-d0c7-4852-9fd3-a55a8ba565c4 admin admin] The token cache is being invalidate because project aa249c0a6f0f49d2994e37462c4bdff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:35:29.382609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-998ca681-d0c7-4852-9fd3-a55a8ba565c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:29.383376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-998ca681-d0c7-4852-9fd3-a55a8ba565c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:29.398310 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3811/7567] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:35:29 2022] DELETE /identity/v3/projects/aa249c0a6f0f49d2994e37462c4bdff2 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:29.404382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7179a1-faf3-4151-9aab-c22ce0507408 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:29.405069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7179a1-faf3-4151-9aab-c22ce0507408 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:29.405529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7179a1-faf3-4151-9aab-c22ce0507408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:29.444496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bd7179a1-faf3-4151-9aab-c22ce0507408 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:29.446359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bd7179a1-faf3-4151-9aab-c22ce0507408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:29.522980 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3757/7568] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:29.525624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad672e8e-1cd5-427c-9ba6-e6fdac1c98d9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:29.525929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad672e8e-1cd5-427c-9ba6-e6fdac1c98d9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:29.526207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad672e8e-1cd5-427c-9ba6-e6fdac1c98d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:29.582354 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ad672e8e-1cd5-427c-9ba6-e6fdac1c98d9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:29.584156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ad672e8e-1cd5-427c-9ba6-e6fdac1c98d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:29.595511 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3812/7569] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:29.599409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7179a1-faf3-4151-9aab-c22ce0507408 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:29.611494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7179a1-faf3-4151-9aab-c22ce0507408 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:29.616389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4981ed-def1-4959-b462-7e13c58a8329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:29.617122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4981ed-def1-4959-b462-7e13c58a8329 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:29.617491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4981ed-def1-4959-b462-7e13c58a8329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:29.617859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4981ed-def1-4959-b462-7e13c58a8329 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:29.618596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4981ed-def1-4959-b462-7e13c58a8329 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:35:29.619136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4981ed-def1-4959-b462-7e13c58a8329 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:29.620991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4981ed-def1-4959-b462-7e13c58a8329 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:29.644515 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3758/7570] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:35:29.648268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad672e8e-1cd5-427c-9ba6-e6fdac1c98d9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:29.660934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad672e8e-1cd5-427c-9ba6-e6fdac1c98d9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:29.674788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb239066-10b1-4f4c-92a1-8aa9d5285410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:29.675437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb239066-10b1-4f4c-92a1-8aa9d5285410 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:29.675718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb239066-10b1-4f4c-92a1-8aa9d5285410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:29.675985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb239066-10b1-4f4c-92a1-8aa9d5285410 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:29.676753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb239066-10b1-4f4c-92a1-8aa9d5285410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:29.678664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb239066-10b1-4f4c-92a1-8aa9d5285410 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:29.718978 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3813/7571] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:35:29 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:35:29.722683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4981ed-def1-4959-b462-7e13c58a8329 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:29.737229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4981ed-def1-4959-b462-7e13c58a8329 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:29.864971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909cb7-682b-4951-82cc-aae9beaae099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:29.882827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909cb7-682b-4951-82cc-aae9beaae099 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:29.882827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909cb7-682b-4951-82cc-aae9beaae099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:29.882827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909cb7-682b-4951-82cc-aae9beaae099 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:29.882827 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909cb7-682b-4951-82cc-aae9beaae099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:29.888205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909cb7-682b-4951-82cc-aae9beaae099 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:29.914077 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:29.970822 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3759/7572] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:35:29 2022] POST /identity/v3/users => generated 284 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:35:29.972264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb239066-10b1-4f4c-92a1-8aa9d5285410 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:29.982289 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:29.994081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb239066-10b1-4f4c-92a1-8aa9d5285410 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:30.016770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219601e-1ac4-4bd3-b099-7b002a1147f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:30.017702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219601e-1ac4-4bd3-b099-7b002a1147f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:30.018800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219601e-1ac4-4bd3-b099-7b002a1147f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:30.019285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219601e-1ac4-4bd3-b099-7b002a1147f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:30.020136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219601e-1ac4-4bd3-b099-7b002a1147f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:30.021974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219601e-1ac4-4bd3-b099-7b002a1147f4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:30.062515 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3814/7573] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:35:30.065005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909cb7-682b-4951-82cc-aae9beaae099 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:30.092260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909cb7-682b-4951-82cc-aae9beaae099 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:30.098098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856ee19-68f1-427c-9980-ce9f94321c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:30.098856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ee19-68f1-427c-9980-ce9f94321c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:30.099355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ee19-68f1-427c-9980-ce9f94321c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:30.099893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ee19-68f1-427c-9980-ce9f94321c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:30.100604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856ee19-68f1-427c-9980-ce9f94321c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:30.102878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856ee19-68f1-427c-9980-ce9f94321c2b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:30.155814 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3760/7574] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:35:30.157087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219601e-1ac4-4bd3-b099-7b002a1147f4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:30.167648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219601e-1ac4-4bd3-b099-7b002a1147f4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:30.172737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea840dc-fb1d-4446-b1ae-efcf407cddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:30.173402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea840dc-fb1d-4446-b1ae-efcf407cddb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:30.173682 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea840dc-fb1d-4446-b1ae-efcf407cddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:30.174074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea840dc-fb1d-4446-b1ae-efcf407cddb1 admin admin] PATH_INFO: `/v3/projects/380d3c7e6a454ff19519535bb76f9c20/users/c756aa6454d344bca411cb6c7b2ed32d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:30.224949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea840dc-fb1d-4446-b1ae-efcf407cddb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380d3c7e6a454ff19519535bb76f9c20, user_id=c756aa6454d344bca411cb6c7b2ed32d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:30.240195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea840dc-fb1d-4446-b1ae-efcf407cddb1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:30.258193 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3815/7575] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:35:30 2022] PUT /identity/v3/projects/380d3c7e6a454ff19519535bb76f9c20/users/c756aa6454d344bca411cb6c7b2ed32d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:30.281608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c999bb-4399-4470-99ab-10e7dce53d49 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:30.281935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c999bb-4399-4470-99ab-10e7dce53d49 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:30.282898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c999bb-4399-4470-99ab-10e7dce53d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:30.373185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d9c999bb-4399-4470-99ab-10e7dce53d49 None None] MFA Rules not processed for user `c756aa6454d344bca411cb6c7b2ed32d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:30.375421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d9c999bb-4399-4470-99ab-10e7dce53d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:30.509512 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3761/7576] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:30.510724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea840dc-fb1d-4446-b1ae-efcf407cddb1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:30.542461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c999bb-4399-4470-99ab-10e7dce53d49 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:30.545602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d9c999bb-4399-4470-99ab-10e7dce53d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:30.644138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea840dc-fb1d-4446-b1ae-efcf407cddb1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:30.650055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cc719-db26-48cc-971e-0dfd7a4e6cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:30.650839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cc719-db26-48cc-971e-0dfd7a4e6cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:30.651322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cc719-db26-48cc-971e-0dfd7a4e6cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:30.651986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cc719-db26-48cc-971e-0dfd7a4e6cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:30.653787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cc719-db26-48cc-971e-0dfd7a4e6cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:30.658952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cc719-db26-48cc-971e-0dfd7a4e6cd9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:30.714519 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3816/7577] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:35:30 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:35:30.716053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cc719-db26-48cc-971e-0dfd7a4e6cd9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:30.766495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c999bb-4399-4470-99ab-10e7dce53d49 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:30.853003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cc719-db26-48cc-971e-0dfd7a4e6cd9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:30.857012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdcc92-9847-4a96-aca3-04d4c843786b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:30.857964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdcc92-9847-4a96-aca3-04d4c843786b service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:30.858567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdcc92-9847-4a96-aca3-04d4c843786b service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:30.859309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdcc92-9847-4a96-aca3-04d4c843786b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:30.861580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f2fdcc92-9847-4a96-aca3-04d4c843786b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:30.866233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77119a47-b590-493f-bdc6-bf27cddf4513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:30.867931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77119a47-b590-493f-bdc6-bf27cddf4513 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:30.868210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77119a47-b590-493f-bdc6-bf27cddf4513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:30.868482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77119a47-b590-493f-bdc6-bf27cddf4513 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:30.869115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77119a47-b590-493f-bdc6-bf27cddf4513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:30.872750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77119a47-b590-493f-bdc6-bf27cddf4513 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:30.881070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdcc92-9847-4a96-aca3-04d4c843786b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:30.883457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdcc92-9847-4a96-aca3-04d4c843786b service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:30.905683 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3762/7578] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:35:30.925238 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3817/7579] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:35:30 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:35:30.929612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdcc92-9847-4a96-aca3-04d4c843786b service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:30.948699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdcc92-9847-4a96-aca3-04d4c843786b service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:30.961968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6794ac0-f210-4419-b423-baa35abc1e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:30.962990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6794ac0-f210-4419-b423-baa35abc1e7d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:30.963431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6794ac0-f210-4419-b423-baa35abc1e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:30.964073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6794ac0-f210-4419-b423-baa35abc1e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:30.964904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6794ac0-f210-4419-b423-baa35abc1e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:30.966689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6794ac0-f210-4419-b423-baa35abc1e7d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:30.989017 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3763/7580] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:35:30.992281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77119a47-b590-493f-bdc6-bf27cddf4513 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:31.006677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77119a47-b590-493f-bdc6-bf27cddf4513 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:31.013613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfe50c-5d11-4f2c-8485-8acf4f447c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:31.015644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfe50c-5d11-4f2c-8485-8acf4f447c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:31.017650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfe50c-5d11-4f2c-8485-8acf4f447c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:31.018131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfe50c-5d11-4f2c-8485-8acf4f447c45 admin admin] PATH_INFO: `/v3/projects/7e241815a72d443ca19b392e2b787885/users/f0b17e4c8258428998c331fbec75d8f9/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:31.056763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfe50c-5d11-4f2c-8485-8acf4f447c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e241815a72d443ca19b392e2b787885, user_id=f0b17e4c8258428998c331fbec75d8f9, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:31.065226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfe50c-5d11-4f2c-8485-8acf4f447c45 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:31.106696 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3818/7581] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:35:30 2022] PUT /identity/v3/projects/7e241815a72d443ca19b392e2b787885/users/f0b17e4c8258428998c331fbec75d8f9/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:35:31.110996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6794ac0-f210-4419-b423-baa35abc1e7d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:31.124172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6794ac0-f210-4419-b423-baa35abc1e7d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:31.162286 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:31.318769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7eade4-cf82-4e7b-bb43-1580d6f10e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:31.321350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eade4-cf82-4e7b-bb43-1580d6f10e77 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:31.324406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eade4-cf82-4e7b-bb43-1580d6f10e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:31.324818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eade4-cf82-4e7b-bb43-1580d6f10e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:31.325540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7eade4-cf82-4e7b-bb43-1580d6f10e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:31.328422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7eade4-cf82-4e7b-bb43-1580d6f10e77 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:31.353493 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3764/7582] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:35:31.357713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfe50c-5d11-4f2c-8485-8acf4f447c45 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:31.372616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfe50c-5d11-4f2c-8485-8acf4f447c45 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:31.384217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdad16-6fc0-48fa-ae99-73a09cabf765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:31.386087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdad16-6fc0-48fa-ae99-73a09cabf765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:31.386541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdad16-6fc0-48fa-ae99-73a09cabf765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:31.386671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdad16-6fc0-48fa-ae99-73a09cabf765 admin admin] PATH_INFO: `/v3/projects/7e241815a72d443ca19b392e2b787885/users/f0b17e4c8258428998c331fbec75d8f9/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:31.391870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdad16-6fc0-48fa-ae99-73a09cabf765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e241815a72d443ca19b392e2b787885, user_id=f0b17e4c8258428998c331fbec75d8f9, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:31.394550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdad16-6fc0-48fa-ae99-73a09cabf765 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:31.431855 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3819/7583] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:35:31 2022] PUT /identity/v3/projects/7e241815a72d443ca19b392e2b787885/users/f0b17e4c8258428998c331fbec75d8f9/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:35:31.552005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f3f3-444e-4286-82b8-a0966efaf4c8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:31.552568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f3f3-444e-4286-82b8-a0966efaf4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:31.552568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f3f3-444e-4286-82b8-a0966efaf4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:31.665108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-30c2f3f3-444e-4286-82b8-a0966efaf4c8 None None] MFA Rules not processed for user `f0b17e4c8258428998c331fbec75d8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:35:31.666662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-30c2f3f3-444e-4286-82b8-a0966efaf4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:31.816248 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3765/7584] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:35:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:35:31.834832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdad16-6fc0-48fa-ae99-73a09cabf765 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:31.860056 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:32.125252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdad16-6fc0-48fa-ae99-73a09cabf765 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:32.147926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b41450-c6c3-40a9-b8f8-bf4b174c5fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:32.149108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41450-c6c3-40a9-b8f8-bf4b174c5fdd service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:32.149656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41450-c6c3-40a9-b8f8-bf4b174c5fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:32.150751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41450-c6c3-40a9-b8f8-bf4b174c5fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:32.198087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b41450-c6c3-40a9-b8f8-bf4b174c5fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:32.201727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b41450-c6c3-40a9-b8f8-bf4b174c5fdd service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:32.255395 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3820/7585] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:35:39.395219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2f3f3-444e-4286-82b8-a0966efaf4c8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:39.396651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-30c2f3f3-444e-4286-82b8-a0966efaf4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:39.415430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2f3f3-444e-4286-82b8-a0966efaf4c8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:39.423775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101211a-0f96-4327-bde0-c2013024464b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:39.423917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101211a-0f96-4327-bde0-c2013024464b service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:39.424142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101211a-0f96-4327-bde0-c2013024464b service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:39.424413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101211a-0f96-4327-bde0-c2013024464b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:39.426414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a101211a-0f96-4327-bde0-c2013024464b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:39.667819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101211a-0f96-4327-bde0-c2013024464b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:39.669287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101211a-0f96-4327-bde0-c2013024464b service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:39.701155 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3766/7586] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:35:42.225601 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=23 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:42.362131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b41450-c6c3-40a9-b8f8-bf4b174c5fdd service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:42.377650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b41450-c6c3-40a9-b8f8-bf4b174c5fdd service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:42.396360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f071b-18a4-4af9-aff3-34e42e7021cd tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b17e4c8258428998c331fbec75d8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e241815a72d443ca19b392e2b787885', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:42.397620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f071b-18a4-4af9-aff3-34e42e7021cd tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:42.398141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f071b-18a4-4af9-aff3-34e42e7021cd tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:42.399178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f071b-18a4-4af9-aff3-34e42e7021cd tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:42.401165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f071b-18a4-4af9-aff3-34e42e7021cd tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:35:42.401782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f071b-18a4-4af9-aff3-34e42e7021cd tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:42.404846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f071b-18a4-4af9-aff3-34e42e7021cd tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:42.433837 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3821/7587] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:35:42.437140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101211a-0f96-4327-bde0-c2013024464b service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:42.455948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101211a-0f96-4327-bde0-c2013024464b service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:42.467395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0aa8ee-610e-48e4-a22f-39e481ec4bab tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b17e4c8258428998c331fbec75d8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e241815a72d443ca19b392e2b787885', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:42.469043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aa8ee-610e-48e4-a22f-39e481ec4bab tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:42.470044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aa8ee-610e-48e4-a22f-39e481ec4bab tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:42.471169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aa8ee-610e-48e4-a22f-39e481ec4bab tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:42.475329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0aa8ee-610e-48e4-a22f-39e481ec4bab tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:42.477468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0aa8ee-610e-48e4-a22f-39e481ec4bab tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:42.537948 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3767/7588] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:35:42 2022] POST /identity/v3/projects => generated 348 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:35:42.541663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f071b-18a4-4af9-aff3-34e42e7021cd tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:42.556605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f071b-18a4-4af9-aff3-34e42e7021cd tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:42.631783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cad49-f0f9-4bad-a858-3d5eff7bbf98 tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b17e4c8258428998c331fbec75d8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e241815a72d443ca19b392e2b787885', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:42.632700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cad49-f0f9-4bad-a858-3d5eff7bbf98 tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:42.633087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cad49-f0f9-4bad-a858-3d5eff7bbf98 tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:42.633511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cad49-f0f9-4bad-a858-3d5eff7bbf98 tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:42.634390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cad49-f0f9-4bad-a858-3d5eff7bbf98 tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:35:42.634797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cad49-f0f9-4bad-a858-3d5eff7bbf98 tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:42.637553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cad49-f0f9-4bad-a858-3d5eff7bbf98 tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:42.652641 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3822/7589] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:35:43.518342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0aa8ee-610e-48e4-a22f-39e481ec4bab tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:43.536718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0aa8ee-610e-48e4-a22f-39e481ec4bab tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:43.541247 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:43.546886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b17e4c8258428998c331fbec75d8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e241815a72d443ca19b392e2b787885', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:43.548096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:43.548606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:43.549150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] PATH_INFO: `/v3/projects/0919890409a247c49d4d5f79ecf92904` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:43.551399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0919890409a247c49d4d5f79ecf92904)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:43.553610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:43.624308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0919890409a247c49d4d5f79ecf92904', 'request_id': 'req-311e1f9f-587d-47be-bdf2-9c9db0fb640e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:43.637443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0919890409a247c49d4d5f79ecf92904', 'request_id': 'req-311e1f9f-587d-47be-bdf2-9c9db0fb640e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:43.647523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0919890409a247c49d4d5f79ecf92904', 'request_id': 'req-311e1f9f-587d-47be-bdf2-9c9db0fb640e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:43.668766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] The token cache is being invalidate because project 0919890409a247c49d4d5f79ecf92904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:35:43.669086 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:43.673480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:35:43.675763 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3768/7590] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:35:43 2022] DELETE /identity/v3/projects/0919890409a247c49d4d5f79ecf92904 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:35:43.687048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cad49-f0f9-4bad-a858-3d5eff7bbf98 tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:43.689583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-893cad49-f0f9-4bad-a858-3d5eff7bbf98 tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:43.757890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cad49-f0f9-4bad-a858-3d5eff7bbf98 tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:43.813765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc564495-e7fd-4e53-acb6-b4a3b7587f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:43.825664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc564495-e7fd-4e53-acb6-b4a3b7587f2f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:43.827167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc564495-e7fd-4e53-acb6-b4a3b7587f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:43.828605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc564495-e7fd-4e53-acb6-b4a3b7587f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:43.835881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc564495-e7fd-4e53-acb6-b4a3b7587f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:43.998460 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:44.035450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc564495-e7fd-4e53-acb6-b4a3b7587f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:44.036902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc564495-e7fd-4e53-acb6-b4a3b7587f2f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:44.047176 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3823/7591] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:35:53.665507 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:54.042665 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:55.463625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:55.465404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:55.692792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e1f9f-587d-47be-bdf2-9c9db0fb640e tempest-RoutersAdminTest-2061793832 tempest-RoutersAdminTest-2061793832-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:55.698350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb226bd0-f51d-475e-947f-4dcc49104fae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:55.699490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb226bd0-f51d-475e-947f-4dcc49104fae service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:55.700698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb226bd0-f51d-475e-947f-4dcc49104fae service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:55.701271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb226bd0-f51d-475e-947f-4dcc49104fae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:55.704448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bb226bd0-f51d-475e-947f-4dcc49104fae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:55.830955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb226bd0-f51d-475e-947f-4dcc49104fae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:55.833346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb226bd0-f51d-475e-947f-4dcc49104fae service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:55.844112 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3769/7592] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:35:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:35:57.837859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc564495-e7fd-4e53-acb6-b4a3b7587f2f service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:35:57.839516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc564495-e7fd-4e53-acb6-b4a3b7587f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:57.960669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc564495-e7fd-4e53-acb6-b4a3b7587f2f service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:35:57.981953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c90c3-9512-46bc-90eb-91a33d2cab45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:35:57.983205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c90c3-9512-46bc-90eb-91a33d2cab45 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:35:57.983656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c90c3-9512-46bc-90eb-91a33d2cab45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:35:57.985188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c90c3-9512-46bc-90eb-91a33d2cab45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:35:57.988435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e76c90c3-9512-46bc-90eb-91a33d2cab45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:35:58.118040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c90c3-9512-46bc-90eb-91a33d2cab45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:35:58.121086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c90c3-9512-46bc-90eb-91a33d2cab45 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:35:58.135383 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3824/7593] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:35:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:36:05.839396 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=54 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:08.130426 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=50 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:18.351478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb226bd0-f51d-475e-947f-4dcc49104fae service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:18.352981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bb226bd0-f51d-475e-947f-4dcc49104fae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:18.452775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb226bd0-f51d-475e-947f-4dcc49104fae service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:18.470446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:18.471406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:18.471783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:18.472155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] PATH_INFO: `/v3/users/c756aa6454d344bca411cb6c7b2ed32d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:18.473413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c756aa6454d344bca411cb6c7b2ed32d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:18.475463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:18.601694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c756aa6454d344bca411cb6c7b2ed32d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:18.602720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c756aa6454d344bca411cb6c7b2ed32d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:18.652559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c756aa6454d344bca411cb6c7b2ed32d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:18.676230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c756aa6454d344bca411cb6c7b2ed32d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:18.677035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c756aa6454d344bca411cb6c7b2ed32d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:18.714772 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3770/7594] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:36:18 2022] DELETE /identity/v3/users/c756aa6454d344bca411cb6c7b2ed32d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:18.716355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e0677-0185-47f1-a313-75940efa4f99 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:18.716778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e0677-0185-47f1-a313-75940efa4f99 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:18.717013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e0677-0185-47f1-a313-75940efa4f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:18.762016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-476e0677-0185-47f1-a313-75940efa4f99 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:18.765763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-476e0677-0185-47f1-a313-75940efa4f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:18.962190 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3825/7595] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:18.974083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:18.975666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:19.210848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdc021-89a9-4560-8aed-49ac9af5abc0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:19.236522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150e15-9470-413c-85f8-73f646e90879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:19.241149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150e15-9470-413c-85f8-73f646e90879 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:19.241444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150e15-9470-413c-85f8-73f646e90879 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:19.241719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150e15-9470-413c-85f8-73f646e90879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:19.277748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f150e15-9470-413c-85f8-73f646e90879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:19.279374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f150e15-9470-413c-85f8-73f646e90879 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:19.316234 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3771/7596] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:36:19.924637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e0677-0185-47f1-a313-75940efa4f99 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:19.927161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-476e0677-0185-47f1-a313-75940efa4f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:19.988510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e0677-0185-47f1-a313-75940efa4f99 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:20.016643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:20.017292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:20.021766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:20.030569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] PATH_INFO: `/v3/projects/380d3c7e6a454ff19519535bb76f9c20` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:20.043325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] RBAC: Authorizing `identity:delete_project(project_id=380d3c7e6a454ff19519535bb76f9c20)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:20.063373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:20.256203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380d3c7e6a454ff19519535bb76f9c20', 'request_id': 'req-9f5fea09-b8b6-4bf2-915c-880ee672981d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:20.272035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380d3c7e6a454ff19519535bb76f9c20', 'request_id': 'req-9f5fea09-b8b6-4bf2-915c-880ee672981d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:20.283363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380d3c7e6a454ff19519535bb76f9c20', 'request_id': 'req-9f5fea09-b8b6-4bf2-915c-880ee672981d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:20.304875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] The token cache is being invalidate because project 380d3c7e6a454ff19519535bb76f9c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:36:20.305177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:20.305903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:20.316415 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3826/7597] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:36:19 2022] DELETE /identity/v3/projects/380d3c7e6a454ff19519535bb76f9c20 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:20.317685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150e15-9470-413c-85f8-73f646e90879 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:20.356026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150e15-9470-413c-85f8-73f646e90879 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:20.404997 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:20.572053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7747336-c47e-4dca-826f-2638f7984dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:20.575819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7747336-c47e-4dca-826f-2638f7984dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:20.576467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7747336-c47e-4dca-826f-2638f7984dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:20.576978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7747336-c47e-4dca-826f-2638f7984dcc admin admin] PATH_INFO: `/v3/users/f0b17e4c8258428998c331fbec75d8f9` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:20.579864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7747336-c47e-4dca-826f-2638f7984dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b17e4c8258428998c331fbec75d8f9)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:20.585120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7747336-c47e-4dca-826f-2638f7984dcc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:20.700898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7747336-c47e-4dca-826f-2638f7984dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b17e4c8258428998c331fbec75d8f9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:20.701584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7747336-c47e-4dca-826f-2638f7984dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b17e4c8258428998c331fbec75d8f9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:20.719406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7747336-c47e-4dca-826f-2638f7984dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b17e4c8258428998c331fbec75d8f9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:20.731613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7747336-c47e-4dca-826f-2638f7984dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b17e4c8258428998c331fbec75d8f9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:20.732256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f7747336-c47e-4dca-826f-2638f7984dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b17e4c8258428998c331fbec75d8f9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:20.767013 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3772/7598] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:36:20 2022] DELETE /identity/v3/users/f0b17e4c8258428998c331fbec75d8f9 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:21.271005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:21.272514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:21.320234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fea09-b8b6-4bf2-915c-880ee672981d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:21.483934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c23df-a2ff-4b38-bd23-c64e65da35a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:21.485208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c23df-a2ff-4b38-bd23-c64e65da35a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:21.485750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c23df-a2ff-4b38-bd23-c64e65da35a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:21.486473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c23df-a2ff-4b38-bd23-c64e65da35a2 admin admin] PATH_INFO: `/v3/projects/7e241815a72d443ca19b392e2b787885` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:21.488032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c23df-a2ff-4b38-bd23-c64e65da35a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e241815a72d443ca19b392e2b787885)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:21.512666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c23df-a2ff-4b38-bd23-c64e65da35a2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:21.600799 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:21.722382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-169c23df-a2ff-4b38-bd23-c64e65da35a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e241815a72d443ca19b392e2b787885', 'request_id': 'req-169c23df-a2ff-4b38-bd23-c64e65da35a2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:21.731129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-169c23df-a2ff-4b38-bd23-c64e65da35a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e241815a72d443ca19b392e2b787885', 'request_id': 'req-169c23df-a2ff-4b38-bd23-c64e65da35a2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:21.747622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-169c23df-a2ff-4b38-bd23-c64e65da35a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e241815a72d443ca19b392e2b787885', 'request_id': 'req-169c23df-a2ff-4b38-bd23-c64e65da35a2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:21.795237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-169c23df-a2ff-4b38-bd23-c64e65da35a2 admin admin] The token cache is being invalidate because project 7e241815a72d443ca19b392e2b787885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:36:21.797584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-169c23df-a2ff-4b38-bd23-c64e65da35a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:21.798873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-169c23df-a2ff-4b38-bd23-c64e65da35a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:21.804435 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3827/7599] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:36:21 2022] DELETE /identity/v3/projects/7e241815a72d443ca19b392e2b787885 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:21.809646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ec355-a750-4cd2-83eb-e4e6342e8536 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:21.810112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ec355-a750-4cd2-83eb-e4e6342e8536 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:21.810413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ec355-a750-4cd2-83eb-e4e6342e8536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:21.880880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f54ec355-a750-4cd2-83eb-e4e6342e8536 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:21.883107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f54ec355-a750-4cd2-83eb-e4e6342e8536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:22.095502 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3773/7600] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:22.107642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af17b57-8ce2-4f28-a61c-98064cf8b1ae None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:22.107931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af17b57-8ce2-4f28-a61c-98064cf8b1ae None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:22.108246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af17b57-8ce2-4f28-a61c-98064cf8b1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:22.215956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2af17b57-8ce2-4f28-a61c-98064cf8b1ae None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:22.217294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2af17b57-8ce2-4f28-a61c-98064cf8b1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:22.253436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ec355-a750-4cd2-83eb-e4e6342e8536 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:22.265491 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3828/7601] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:22.270531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ec355-a750-4cd2-83eb-e4e6342e8536 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:22.280227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a42e2-d5b2-40b4-abfe-3e2ba3c98fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:22.281082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a42e2-d5b2-40b4-abfe-3e2ba3c98fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:22.281545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a42e2-d5b2-40b4-abfe-3e2ba3c98fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:22.282234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a42e2-d5b2-40b4-abfe-3e2ba3c98fe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:22.283157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a42e2-d5b2-40b4-abfe-3e2ba3c98fe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:36:22.283616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a42e2-d5b2-40b4-abfe-3e2ba3c98fe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:22.285889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a42e2-d5b2-40b4-abfe-3e2ba3c98fe4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:22.315688 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3774/7602] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:36:22.321090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af17b57-8ce2-4f28-a61c-98064cf8b1ae None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:22.336778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af17b57-8ce2-4f28-a61c-98064cf8b1ae None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:22.353272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385ebbc-d5f6-4925-acff-d2aa65fce1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:22.354048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385ebbc-d5f6-4925-acff-d2aa65fce1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:22.354329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385ebbc-d5f6-4925-acff-d2aa65fce1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:22.355039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385ebbc-d5f6-4925-acff-d2aa65fce1f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:22.356084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385ebbc-d5f6-4925-acff-d2aa65fce1f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:22.361913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385ebbc-d5f6-4925-acff-d2aa65fce1f0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:22.442588 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3829/7603] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:36:22 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:36:22.448061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a42e2-d5b2-40b4-abfe-3e2ba3c98fe4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:22.470881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a42e2-d5b2-40b4-abfe-3e2ba3c98fe4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:22.565839 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:22.720896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df0ac8-59a2-4883-b7d3-eba98916e5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:22.721660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df0ac8-59a2-4883-b7d3-eba98916e5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:22.722015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df0ac8-59a2-4883-b7d3-eba98916e5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:22.722356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df0ac8-59a2-4883-b7d3-eba98916e5f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:22.723267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df0ac8-59a2-4883-b7d3-eba98916e5f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:22.725471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df0ac8-59a2-4883-b7d3-eba98916e5f3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:22.754834 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3775/7604] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:36:22 2022] POST /identity/v3/users => generated 297 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:36:22.758721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385ebbc-d5f6-4925-acff-d2aa65fce1f0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:22.781007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385ebbc-d5f6-4925-acff-d2aa65fce1f0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:22.790536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aafe77-00b3-4d56-940f-bb5ca1c71ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:22.791443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aafe77-00b3-4d56-940f-bb5ca1c71ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:22.791821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aafe77-00b3-4d56-940f-bb5ca1c71ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:22.792259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aafe77-00b3-4d56-940f-bb5ca1c71ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:22.793147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aafe77-00b3-4d56-940f-bb5ca1c71ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:22.794947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aafe77-00b3-4d56-940f-bb5ca1c71ce8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:22.807201 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3830/7605] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:36:22.810808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df0ac8-59a2-4883-b7d3-eba98916e5f3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:22.825003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df0ac8-59a2-4883-b7d3-eba98916e5f3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:22.832220 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2ccaa-b44b-474e-9cb6-ed8aa77302c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:22.833775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2ccaa-b44b-474e-9cb6-ed8aa77302c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:22.834464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2ccaa-b44b-474e-9cb6-ed8aa77302c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:22.834983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2ccaa-b44b-474e-9cb6-ed8aa77302c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:22.837515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2ccaa-b44b-474e-9cb6-ed8aa77302c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:22.840293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2ccaa-b44b-474e-9cb6-ed8aa77302c3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:22.875362 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3776/7606] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:36:22.876783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aafe77-00b3-4d56-940f-bb5ca1c71ce8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:22.891448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aafe77-00b3-4d56-940f-bb5ca1c71ce8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:22.899868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdda78-2a1a-4395-b075-6dd0d3313fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:22.900789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdda78-2a1a-4395-b075-6dd0d3313fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:22.901402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdda78-2a1a-4395-b075-6dd0d3313fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:22.902374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdda78-2a1a-4395-b075-6dd0d3313fd7 admin admin] PATH_INFO: `/v3/projects/7b1a313bbc5040da87642197693c9519/users/9e9d236d37164a1cae2672e2a1567830/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:22.954424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdda78-2a1a-4395-b075-6dd0d3313fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1a313bbc5040da87642197693c9519, user_id=9e9d236d37164a1cae2672e2a1567830, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:22.972050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdda78-2a1a-4395-b075-6dd0d3313fd7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:23.002572 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3831/7607] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:36:22 2022] PUT /identity/v3/projects/7b1a313bbc5040da87642197693c9519/users/9e9d236d37164a1cae2672e2a1567830/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:23.012470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1845e5-932b-4d14-9177-97f70a8f6d6d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:23.013077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1845e5-932b-4d14-9177-97f70a8f6d6d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:23.013646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1845e5-932b-4d14-9177-97f70a8f6d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:23.063802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ea1845e5-932b-4d14-9177-97f70a8f6d6d None None] MFA Rules not processed for user `9e9d236d37164a1cae2672e2a1567830`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:23.065391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ea1845e5-932b-4d14-9177-97f70a8f6d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:23.229594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ea625-d512-4834-b6b1-bec0298a310b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:23.230313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ea625-d512-4834-b6b1-bec0298a310b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:23.230899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ea625-d512-4834-b6b1-bec0298a310b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:23.267135 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3777/7608] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:23.274682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1845e5-932b-4d14-9177-97f70a8f6d6d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:23.291750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8b0ea625-d512-4834-b6b1-bec0298a310b None None] MFA Rules not processed for user `4bdb352285134f4b93ab4879db31c8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:23.293521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8b0ea625-d512-4834-b6b1-bec0298a310b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:23.467297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1845e5-932b-4d14-9177-97f70a8f6d6d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:23.505934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c5531-1a10-4c7e-8b84-3a8f0b43e344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:23.506537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c5531-1a10-4c7e-8b84-3a8f0b43e344 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:23.506820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c5531-1a10-4c7e-8b84-3a8f0b43e344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:23.508929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c5531-1a10-4c7e-8b84-3a8f0b43e344 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:23.519688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c5531-1a10-4c7e-8b84-3a8f0b43e344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:23.521247 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3832/7609] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:23.530963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c5531-1a10-4c7e-8b84-3a8f0b43e344 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:23.621787 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3778/7610] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:36:23 2022] POST /identity/v3/projects => generated 393 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:36:23.626737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ea625-d512-4834-b6b1-bec0298a310b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:23.671236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ea625-d512-4834-b6b1-bec0298a310b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:23.768263 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:23.804265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb622711-107d-4fe0-a35a-11564dd7855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:23.806619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb622711-107d-4fe0-a35a-11564dd7855a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:23.806995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb622711-107d-4fe0-a35a-11564dd7855a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:23.808572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb622711-107d-4fe0-a35a-11564dd7855a admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:23.809405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb622711-107d-4fe0-a35a-11564dd7855a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:23.813444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb622711-107d-4fe0-a35a-11564dd7855a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:23.876880 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3833/7611] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:36:23 2022] POST /identity/v3/users => generated 303 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:36:23.880659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c5531-1a10-4c7e-8b84-3a8f0b43e344 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:23.894198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c5531-1a10-4c7e-8b84-3a8f0b43e344 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:23.904489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf1147-9458-4f16-95b9-d0187e0d1433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:23.907709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf1147-9458-4f16-95b9-d0187e0d1433 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:23.908249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf1147-9458-4f16-95b9-d0187e0d1433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:23.908718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf1147-9458-4f16-95b9-d0187e0d1433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:23.909524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf1147-9458-4f16-95b9-d0187e0d1433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:23.917436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf1147-9458-4f16-95b9-d0187e0d1433 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:23.933386 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3779/7612] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:36:23.935367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb622711-107d-4fe0-a35a-11564dd7855a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:23.952646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb622711-107d-4fe0-a35a-11564dd7855a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:23.990103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3afd0b-0c6c-4572-b166-77d2a904804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:23.993040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3afd0b-0c6c-4572-b166-77d2a904804a admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:23.993728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3afd0b-0c6c-4572-b166-77d2a904804a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:23.994430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3afd0b-0c6c-4572-b166-77d2a904804a admin admin] PATH_INFO: `/v3/projects/79c2e11e21c248789b3b80266abdc1f0/users/31cd342a8a3341f69fed6b0489b72508/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:24.028832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3afd0b-0c6c-4572-b166-77d2a904804a admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c2e11e21c248789b3b80266abdc1f0, user_id=31cd342a8a3341f69fed6b0489b72508, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:24.032911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3afd0b-0c6c-4572-b166-77d2a904804a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:24.059561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf1147-9458-4f16-95b9-d0187e0d1433 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:24.062735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2dcf1147-9458-4f16-95b9-d0187e0d1433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:24.072846 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3834/7613] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:36:23 2022] PUT /identity/v3/projects/79c2e11e21c248789b3b80266abdc1f0/users/31cd342a8a3341f69fed6b0489b72508/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:24.076411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3afd0b-0c6c-4572-b166-77d2a904804a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:24.088602 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:24.204138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf1147-9458-4f16-95b9-d0187e0d1433 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:24.239696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3afd0b-0c6c-4572-b166-77d2a904804a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:24.247381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ff1bf-8788-4783-bd4e-d6b7bb11eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:24.248207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ff1bf-8788-4783-bd4e-d6b7bb11eeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:24.248492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ff1bf-8788-4783-bd4e-d6b7bb11eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:24.249275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ff1bf-8788-4783-bd4e-d6b7bb11eeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:24.249906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ff1bf-8788-4783-bd4e-d6b7bb11eeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:24.252361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ff1bf-8788-4783-bd4e-d6b7bb11eeb6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:24.283851 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3835/7614] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:36:24.287158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ff1bf-8788-4783-bd4e-d6b7bb11eeb6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:24.314600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ff1bf-8788-4783-bd4e-d6b7bb11eeb6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:24.326116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14361248-0041-4e2f-9eb3-ad55d86c9fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:24.328615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14361248-0041-4e2f-9eb3-ad55d86c9fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:24.331315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14361248-0041-4e2f-9eb3-ad55d86c9fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:24.331896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14361248-0041-4e2f-9eb3-ad55d86c9fd2 admin admin] PATH_INFO: `/v3/projects/79c2e11e21c248789b3b80266abdc1f0/users/31cd342a8a3341f69fed6b0489b72508/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:24.335506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14361248-0041-4e2f-9eb3-ad55d86c9fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c2e11e21c248789b3b80266abdc1f0, user_id=31cd342a8a3341f69fed6b0489b72508, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:24.339341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14361248-0041-4e2f-9eb3-ad55d86c9fd2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:24.381580 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3836/7615] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:36:24 2022] PUT /identity/v3/projects/79c2e11e21c248789b3b80266abdc1f0/users/31cd342a8a3341f69fed6b0489b72508/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:24.406156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda5194-ef7f-4016-bb1e-20664f5ce0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:24.406779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda5194-ef7f-4016-bb1e-20664f5ce0ea service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:24.407089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda5194-ef7f-4016-bb1e-20664f5ce0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:24.407366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda5194-ef7f-4016-bb1e-20664f5ce0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:24.408166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d4433-86fa-4b0a-bf74-b26a6a4eeb14 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:24.408617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d4433-86fa-4b0a-bf74-b26a6a4eeb14 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:24.408914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d4433-86fa-4b0a-bf74-b26a6a4eeb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:24.423324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dbda5194-ef7f-4016-bb1e-20664f5ce0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:24.444760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda5194-ef7f-4016-bb1e-20664f5ce0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:24.446227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda5194-ef7f-4016-bb1e-20664f5ce0ea service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:24.460424 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3780/7616] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:36:24.461353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5b4d4433-86fa-4b0a-bf74-b26a6a4eeb14 None None] MFA Rules not processed for user `31cd342a8a3341f69fed6b0489b72508`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:24.462677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5b4d4433-86fa-4b0a-bf74-b26a6a4eeb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:24.595064 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3837/7617] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:24.611457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda5194-ef7f-4016-bb1e-20664f5ce0ea service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:24.626867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda5194-ef7f-4016-bb1e-20664f5ce0ea service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:24.724963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235f47e-8006-4ad1-9f1a-46e2f3bd69e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:24.725797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235f47e-8006-4ad1-9f1a-46e2f3bd69e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:24.729142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235f47e-8006-4ad1-9f1a-46e2f3bd69e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:24.729661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235f47e-8006-4ad1-9f1a-46e2f3bd69e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:24.755045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235f47e-8006-4ad1-9f1a-46e2f3bd69e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:24.757011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235f47e-8006-4ad1-9f1a-46e2f3bd69e4 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:24.800519 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3781/7618] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:36:25.985212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ad16-40c1-4ba7-a2da-e1d64a5b0140 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:25.986088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ad16-40c1-4ba7-a2da-e1d64a5b0140 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:25.986506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ad16-40c1-4ba7-a2da-e1d64a5b0140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:26.024646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1fc1ad16-40c1-4ba7-a2da-e1d64a5b0140 None None] MFA Rules not processed for user `6a10008a2a4e41c5be09552821db8fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:26.027016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1fc1ad16-40c1-4ba7-a2da-e1d64a5b0140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:26.059023 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:26.169064 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3838/7619] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:29.159407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235f47e-8006-4ad1-9f1a-46e2f3bd69e4 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:29.380284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235f47e-8006-4ad1-9f1a-46e2f3bd69e4 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:29.396538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:29.398212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:29.398718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:29.399239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] PATH_INFO: `/v3/users/9e9d236d37164a1cae2672e2a1567830` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:29.400922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9d236d37164a1cae2672e2a1567830)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:29.403448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:29.414148 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:29.532813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9d236d37164a1cae2672e2a1567830'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:29.533899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9d236d37164a1cae2672e2a1567830'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:29.581618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9d236d37164a1cae2672e2a1567830'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:29.602215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9d236d37164a1cae2672e2a1567830'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:29.603694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9d236d37164a1cae2672e2a1567830'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:29.628543 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3782/7620] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:36:29 2022] DELETE /identity/v3/users/9e9d236d37164a1cae2672e2a1567830 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:29.630353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20461750-d2dc-486a-8f2d-ea431904222f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:29.631600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20461750-d2dc-486a-8f2d-ea431904222f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:29.631742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20461750-d2dc-486a-8f2d-ea431904222f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:29.674759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-20461750-d2dc-486a-8f2d-ea431904222f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:29.676328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-20461750-d2dc-486a-8f2d-ea431904222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:29.759964 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3839/7621] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:29.770530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:29.775101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:29.927241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad06c-1c74-420d-8128-d0da2716ca50 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:29.951493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96f983-30d0-4d87-8963-48d15e9b95ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:29.953028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96f983-30d0-4d87-8963-48d15e9b95ce service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:29.953322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96f983-30d0-4d87-8963-48d15e9b95ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:29.953602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96f983-30d0-4d87-8963-48d15e9b95ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:29.984818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96f983-30d0-4d87-8963-48d15e9b95ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:29.987959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96f983-30d0-4d87-8963-48d15e9b95ce service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:30.021715 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3783/7622] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:36:30.612340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20461750-d2dc-486a-8f2d-ea431904222f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:30.614145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-20461750-d2dc-486a-8f2d-ea431904222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:30.644396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20461750-d2dc-486a-8f2d-ea431904222f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:30.663255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:30.664156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:30.666876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:30.667320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] PATH_INFO: `/v3/projects/7b1a313bbc5040da87642197693c9519` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:30.670111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b1a313bbc5040da87642197693c9519)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:30.679757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:30.855170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b1a313bbc5040da87642197693c9519', 'request_id': 'req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:30.855170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b1a313bbc5040da87642197693c9519', 'request_id': 'req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:30.867436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b1a313bbc5040da87642197693c9519', 'request_id': 'req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:30.903699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] The token cache is being invalidate because project 7b1a313bbc5040da87642197693c9519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:36:30.904402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:30.906849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:30.913319 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3840/7623] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:36:30 2022] DELETE /identity/v3/projects/7b1a313bbc5040da87642197693c9519 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:30.918835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96f983-30d0-4d87-8963-48d15e9b95ce service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:30.949833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96f983-30d0-4d87-8963-48d15e9b95ce service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:31.060970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c26be-fabb-4c87-99df-380e6da36c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:31.062062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c26be-fabb-4c87-99df-380e6da36c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:31.062340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c26be-fabb-4c87-99df-380e6da36c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:31.062617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c26be-fabb-4c87-99df-380e6da36c0e admin admin] PATH_INFO: `/v3/users/31cd342a8a3341f69fed6b0489b72508` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:31.064294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c26be-fabb-4c87-99df-380e6da36c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=31cd342a8a3341f69fed6b0489b72508)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:31.066226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c26be-fabb-4c87-99df-380e6da36c0e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:31.127508 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:31.155900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-152c26be-fabb-4c87-99df-380e6da36c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31cd342a8a3341f69fed6b0489b72508'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:31.156695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-152c26be-fabb-4c87-99df-380e6da36c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31cd342a8a3341f69fed6b0489b72508'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:31.190638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-152c26be-fabb-4c87-99df-380e6da36c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31cd342a8a3341f69fed6b0489b72508'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:31.219253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-152c26be-fabb-4c87-99df-380e6da36c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31cd342a8a3341f69fed6b0489b72508'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:31.220141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-152c26be-fabb-4c87-99df-380e6da36c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31cd342a8a3341f69fed6b0489b72508'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:31.255312 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3784/7624] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:36:30 2022] DELETE /identity/v3/users/31cd342a8a3341f69fed6b0489b72508 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:31.511621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:31.513337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:31.588672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b96ef-3e2c-4779-a09e-d0c48a6834bf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:31.741938 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:31.788232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95084b6b-d263-4f69-b1a7-240285fe2ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:31.790530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95084b6b-d263-4f69-b1a7-240285fe2ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:31.790981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95084b6b-d263-4f69-b1a7-240285fe2ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:31.792057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95084b6b-d263-4f69-b1a7-240285fe2ba1 admin admin] PATH_INFO: `/v3/projects/79c2e11e21c248789b3b80266abdc1f0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:31.797628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95084b6b-d263-4f69-b1a7-240285fe2ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c2e11e21c248789b3b80266abdc1f0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:31.804647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95084b6b-d263-4f69-b1a7-240285fe2ba1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:31.964588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-95084b6b-d263-4f69-b1a7-240285fe2ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c2e11e21c248789b3b80266abdc1f0', 'request_id': 'req-95084b6b-d263-4f69-b1a7-240285fe2ba1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:31.972270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-95084b6b-d263-4f69-b1a7-240285fe2ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c2e11e21c248789b3b80266abdc1f0', 'request_id': 'req-95084b6b-d263-4f69-b1a7-240285fe2ba1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:31.982459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-95084b6b-d263-4f69-b1a7-240285fe2ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c2e11e21c248789b3b80266abdc1f0', 'request_id': 'req-95084b6b-d263-4f69-b1a7-240285fe2ba1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:32.069397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-95084b6b-d263-4f69-b1a7-240285fe2ba1 admin admin] The token cache is being invalidate because project 79c2e11e21c248789b3b80266abdc1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:36:32.069694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-95084b6b-d263-4f69-b1a7-240285fe2ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:32.074230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-95084b6b-d263-4f69-b1a7-240285fe2ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:32.076987 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3841/7625] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:36:31 2022] DELETE /identity/v3/projects/79c2e11e21c248789b3b80266abdc1f0 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:32.083813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d26a96-fab7-4610-8dcb-6682d3b0486b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:32.083813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d26a96-fab7-4610-8dcb-6682d3b0486b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:32.083813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d26a96-fab7-4610-8dcb-6682d3b0486b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:32.118911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d3d26a96-fab7-4610-8dcb-6682d3b0486b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:32.120258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d3d26a96-fab7-4610-8dcb-6682d3b0486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:32.264267 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3785/7626] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:32.273802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fdaaa-9634-4397-9ec6-6c765bd0971c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:32.274100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fdaaa-9634-4397-9ec6-6c765bd0971c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:32.274380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fdaaa-9634-4397-9ec6-6c765bd0971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:32.305868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-434fdaaa-9634-4397-9ec6-6c765bd0971c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:32.313991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-434fdaaa-9634-4397-9ec6-6c765bd0971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:32.336393 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3842/7627] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:32.341468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d26a96-fab7-4610-8dcb-6682d3b0486b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:32.360885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d26a96-fab7-4610-8dcb-6682d3b0486b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:32.377446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408cc59-7d9a-4abd-a205-3a492b6a35c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:32.378136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408cc59-7d9a-4abd-a205-3a492b6a35c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:32.378473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408cc59-7d9a-4abd-a205-3a492b6a35c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:32.378722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408cc59-7d9a-4abd-a205-3a492b6a35c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:32.379415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408cc59-7d9a-4abd-a205-3a492b6a35c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:36:32.380026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408cc59-7d9a-4abd-a205-3a492b6a35c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:32.384379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408cc59-7d9a-4abd-a205-3a492b6a35c8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:32.399662 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3786/7628] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:36:32.405308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fdaaa-9634-4397-9ec6-6c765bd0971c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:32.415319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fdaaa-9634-4397-9ec6-6c765bd0971c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:32.422534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe64f3-ef61-4f5d-a4b0-12fb742deaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:32.423494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe64f3-ef61-4f5d-a4b0-12fb742deaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:32.423909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe64f3-ef61-4f5d-a4b0-12fb742deaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:32.424309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe64f3-ef61-4f5d-a4b0-12fb742deaf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:32.425037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe64f3-ef61-4f5d-a4b0-12fb742deaf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:32.428216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe64f3-ef61-4f5d-a4b0-12fb742deaf9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:32.517043 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3843/7629] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:36:32 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:36:32.520994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408cc59-7d9a-4abd-a205-3a492b6a35c8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:32.541558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408cc59-7d9a-4abd-a205-3a492b6a35c8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:32.630009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb99335-fc25-425d-a52f-f8090a524d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:32.630951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb99335-fc25-425d-a52f-f8090a524d1f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:32.630951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb99335-fc25-425d-a52f-f8090a524d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:32.631344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb99335-fc25-425d-a52f-f8090a524d1f admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:32.631883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb99335-fc25-425d-a52f-f8090a524d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:32.634030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb99335-fc25-425d-a52f-f8090a524d1f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:32.684758 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3787/7630] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:36:32 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:36:32.687394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe64f3-ef61-4f5d-a4b0-12fb742deaf9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:32.701061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe64f3-ef61-4f5d-a4b0-12fb742deaf9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:32.715666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126fccf-9bc1-443c-a628-d273c7498cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:32.717038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126fccf-9bc1-443c-a628-d273c7498cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:32.717537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126fccf-9bc1-443c-a628-d273c7498cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:32.718436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126fccf-9bc1-443c-a628-d273c7498cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:32.719259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126fccf-9bc1-443c-a628-d273c7498cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:32.727871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126fccf-9bc1-443c-a628-d273c7498cf3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:32.748594 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3844/7631] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:36:32.752577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb99335-fc25-425d-a52f-f8090a524d1f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:32.770359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb99335-fc25-425d-a52f-f8090a524d1f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:32.792856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2550e-8124-41e1-87bf-524ffe0647fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:32.798050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2550e-8124-41e1-87bf-524ffe0647fa admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:32.799178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2550e-8124-41e1-87bf-524ffe0647fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:32.801024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2550e-8124-41e1-87bf-524ffe0647fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:32.802424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2550e-8124-41e1-87bf-524ffe0647fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:32.809450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2550e-8124-41e1-87bf-524ffe0647fa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:32.835170 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3788/7632] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:36:32.840032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126fccf-9bc1-443c-a628-d273c7498cf3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:32.871485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126fccf-9bc1-443c-a628-d273c7498cf3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:32.938796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769b0cc-5e3f-42f9-a1c3-9c3d89c6ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:32.945847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769b0cc-5e3f-42f9-a1c3-9c3d89c6ff83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:32.946697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769b0cc-5e3f-42f9-a1c3-9c3d89c6ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:32.946998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769b0cc-5e3f-42f9-a1c3-9c3d89c6ff83 admin admin] PATH_INFO: `/v3/projects/8500275073ce4f1fbb1c7b2177560f43/users/cc7ba9fabe7f46558acdff02c65930e0/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:32.996756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769b0cc-5e3f-42f9-a1c3-9c3d89c6ff83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8500275073ce4f1fbb1c7b2177560f43, user_id=cc7ba9fabe7f46558acdff02c65930e0, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:33.001734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769b0cc-5e3f-42f9-a1c3-9c3d89c6ff83 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:33.032275 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3845/7633] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:36:32 2022] PUT /identity/v3/projects/8500275073ce4f1fbb1c7b2177560f43/users/cc7ba9fabe7f46558acdff02c65930e0/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:33.043812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df323fd8-4321-44eb-b4c2-c11e2b36e9b1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:33.045364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df323fd8-4321-44eb-b4c2-c11e2b36e9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:33.045364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df323fd8-4321-44eb-b4c2-c11e2b36e9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:33.081719 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:33.132114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-df323fd8-4321-44eb-b4c2-c11e2b36e9b1 None None] MFA Rules not processed for user `cc7ba9fabe7f46558acdff02c65930e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:33.133369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-df323fd8-4321-44eb-b4c2-c11e2b36e9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:33.190448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769b0cc-5e3f-42f9-a1c3-9c3d89c6ff83 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:33.193451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c769b0cc-5e3f-42f9-a1c3-9c3d89c6ff83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:33.317534 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3789/7634] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:33.369783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769b0cc-5e3f-42f9-a1c3-9c3d89c6ff83 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:33.385915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df323fd8-4321-44eb-b4c2-c11e2b36e9b1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:33.387033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:33.387696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:33.387981 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-df323fd8-4321-44eb-b4c2-c11e2b36e9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:33.388241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:33.388527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] PATH_INFO: `/v3/users/303d9c9df6534f7aae14c8f96f5a48e0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:33.391655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] RBAC: Authorizing `identity:delete_user(user_id=303d9c9df6534f7aae14c8f96f5a48e0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:33.394086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:33.476725 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:33.534087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df323fd8-4321-44eb-b4c2-c11e2b36e9b1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:33.596915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6758e6-28ef-40eb-9f3e-7d6b1efe54a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:33.597803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6758e6-28ef-40eb-9f3e-7d6b1efe54a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:33.598046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6758e6-28ef-40eb-9f3e-7d6b1efe54a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:33.598216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '303d9c9df6534f7aae14c8f96f5a48e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:33.598350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6758e6-28ef-40eb-9f3e-7d6b1efe54a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:33.599021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '303d9c9df6534f7aae14c8f96f5a48e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:33.600491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6d6758e6-28ef-40eb-9f3e-7d6b1efe54a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:33.616796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6758e6-28ef-40eb-9f3e-7d6b1efe54a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:33.618983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6758e6-28ef-40eb-9f3e-7d6b1efe54a2 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:33.629787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '303d9c9df6534f7aae14c8f96f5a48e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:33.641030 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3790/7635] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:36:33.643317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '303d9c9df6534f7aae14c8f96f5a48e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:33.644010 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '303d9c9df6534f7aae14c8f96f5a48e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:33.675815 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3846/7636] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:36:33 2022] DELETE /identity/v3/users/303d9c9df6534f7aae14c8f96f5a48e0 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:36:33.682038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146b09b-fafb-474b-bfff-b2b90e4f8817 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:33.687437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146b09b-fafb-474b-bfff-b2b90e4f8817 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:33.687437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146b09b-fafb-474b-bfff-b2b90e4f8817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:33.734659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0146b09b-fafb-474b-bfff-b2b90e4f8817 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:33.736077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0146b09b-fafb-474b-bfff-b2b90e4f8817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:33.817531 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3791/7637] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:33.842160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:33.848932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:34.064389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c745b8-5d46-4419-8ddb-01e32775702f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:34.070834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c205e-9868-4610-9210-4b37cbf689ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:34.071490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c205e-9868-4610-9210-4b37cbf689ef service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:34.071767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c205e-9868-4610-9210-4b37cbf689ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:34.072038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c205e-9868-4610-9210-4b37cbf689ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:34.099471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c205e-9868-4610-9210-4b37cbf689ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:34.101986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c205e-9868-4610-9210-4b37cbf689ef service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:34.116719 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3847/7638] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:36:34.627559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146b09b-fafb-474b-bfff-b2b90e4f8817 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:34.629054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0146b09b-fafb-474b-bfff-b2b90e4f8817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:34.659302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146b09b-fafb-474b-bfff-b2b90e4f8817 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:34.670465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12404ad-2ec5-4661-8f52-cd902dde2dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:34.671477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12404ad-2ec5-4661-8f52-cd902dde2dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:34.671990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12404ad-2ec5-4661-8f52-cd902dde2dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:34.672277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12404ad-2ec5-4661-8f52-cd902dde2dd4 admin admin] PATH_INFO: `/v3/projects/49ba8861d5884f04a7c9e2878848b26e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:34.673458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12404ad-2ec5-4661-8f52-cd902dde2dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ba8861d5884f04a7c9e2878848b26e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:34.675568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12404ad-2ec5-4661-8f52-cd902dde2dd4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:34.772121 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:34.796250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e12404ad-2ec5-4661-8f52-cd902dde2dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ba8861d5884f04a7c9e2878848b26e', 'request_id': 'req-e12404ad-2ec5-4661-8f52-cd902dde2dd4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:34.815024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e12404ad-2ec5-4661-8f52-cd902dde2dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ba8861d5884f04a7c9e2878848b26e', 'request_id': 'req-e12404ad-2ec5-4661-8f52-cd902dde2dd4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:34.840004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e12404ad-2ec5-4661-8f52-cd902dde2dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ba8861d5884f04a7c9e2878848b26e', 'request_id': 'req-e12404ad-2ec5-4661-8f52-cd902dde2dd4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:34.880384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e12404ad-2ec5-4661-8f52-cd902dde2dd4 admin admin] The token cache is being invalidate because project 49ba8861d5884f04a7c9e2878848b26e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:36:34.880384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e12404ad-2ec5-4661-8f52-cd902dde2dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:34.881478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e12404ad-2ec5-4661-8f52-cd902dde2dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:34.884891 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3792/7639] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:36:34 2022] DELETE /identity/v3/projects/49ba8861d5884f04a7c9e2878848b26e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:36:34.889648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b05e43-9f91-49ed-8856-9d2512644315 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:34.890293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b05e43-9f91-49ed-8856-9d2512644315 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:34.890293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b05e43-9f91-49ed-8856-9d2512644315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:34.932216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-67b05e43-9f91-49ed-8856-9d2512644315 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:34.933490 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-67b05e43-9f91-49ed-8856-9d2512644315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:35.042347 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3848/7640] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:35.044541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfd2ca-3395-4a63-adaf-1ca70bfb6b4f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:35.044836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfd2ca-3395-4a63-adaf-1ca70bfb6b4f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:35.045143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfd2ca-3395-4a63-adaf-1ca70bfb6b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:35.072190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8acfd2ca-3395-4a63-adaf-1ca70bfb6b4f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:35.073403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8acfd2ca-3395-4a63-adaf-1ca70bfb6b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:35.162331 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3793/7641] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:35.167062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b05e43-9f91-49ed-8856-9d2512644315 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:35.188851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b05e43-9f91-49ed-8856-9d2512644315 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:35.208397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68179f6-7a8b-48bc-bae3-14bfc44df6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:35.209320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68179f6-7a8b-48bc-bae3-14bfc44df6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:35.211230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68179f6-7a8b-48bc-bae3-14bfc44df6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:35.211694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68179f6-7a8b-48bc-bae3-14bfc44df6d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:35.215121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68179f6-7a8b-48bc-bae3-14bfc44df6d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:36:35.215605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68179f6-7a8b-48bc-bae3-14bfc44df6d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:35.218826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68179f6-7a8b-48bc-bae3-14bfc44df6d4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:35.244136 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3849/7642] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:36:35.248639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfd2ca-3395-4a63-adaf-1ca70bfb6b4f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:35.259854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfd2ca-3395-4a63-adaf-1ca70bfb6b4f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:35.265373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381442fb-b321-42e0-a4db-d4b95465bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:35.266267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381442fb-b321-42e0-a4db-d4b95465bf05 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:35.266700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381442fb-b321-42e0-a4db-d4b95465bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:35.267244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381442fb-b321-42e0-a4db-d4b95465bf05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:35.268246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381442fb-b321-42e0-a4db-d4b95465bf05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:35.271560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381442fb-b321-42e0-a4db-d4b95465bf05 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:35.316116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68179f6-7a8b-48bc-bae3-14bfc44df6d4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:35.325964 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3794/7643] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:36:35 2022] POST /identity/v3/projects => generated 389 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:36:35.336933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68179f6-7a8b-48bc-bae3-14bfc44df6d4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:35.373779 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:35.467804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35c05-ef9d-420d-8dc3-b447790fe14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:35.469487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35c05-ef9d-420d-8dc3-b447790fe14e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:35.469934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35c05-ef9d-420d-8dc3-b447790fe14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:35.470368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35c05-ef9d-420d-8dc3-b447790fe14e admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:35.471273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f35c05-ef9d-420d-8dc3-b447790fe14e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:35.480545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f35c05-ef9d-420d-8dc3-b447790fe14e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:35.512429 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3850/7644] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:36:35 2022] POST /identity/v3/users => generated 295 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:36:35.516936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381442fb-b321-42e0-a4db-d4b95465bf05 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:35.564760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381442fb-b321-42e0-a4db-d4b95465bf05 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:35.587351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96670b-2ce0-4b3c-88d0-4bf47a46904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:35.588081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96670b-2ce0-4b3c-88d0-4bf47a46904d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:35.588435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96670b-2ce0-4b3c-88d0-4bf47a46904d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:35.588776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96670b-2ce0-4b3c-88d0-4bf47a46904d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:35.589658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96670b-2ce0-4b3c-88d0-4bf47a46904d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:35.591422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96670b-2ce0-4b3c-88d0-4bf47a46904d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:35.604076 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3795/7645] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:36:35.607845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35c05-ef9d-420d-8dc3-b447790fe14e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:35.626253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35c05-ef9d-420d-8dc3-b447790fe14e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:35.634216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae71d-a23b-486f-aedd-81d98627fc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:35.635277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae71d-a23b-486f-aedd-81d98627fc92 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:35.635695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae71d-a23b-486f-aedd-81d98627fc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:35.636013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae71d-a23b-486f-aedd-81d98627fc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:35.636786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ae71d-a23b-486f-aedd-81d98627fc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:35.638870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ae71d-a23b-486f-aedd-81d98627fc92 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:35.666804 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3851/7646] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:36:35.671731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96670b-2ce0-4b3c-88d0-4bf47a46904d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:35.713408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96670b-2ce0-4b3c-88d0-4bf47a46904d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:35.728073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3018272-1b0b-455c-9f42-7f520b3e08d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:35.729022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3018272-1b0b-455c-9f42-7f520b3e08d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:35.729924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3018272-1b0b-455c-9f42-7f520b3e08d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:35.730567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3018272-1b0b-455c-9f42-7f520b3e08d5 admin admin] PATH_INFO: `/v3/projects/42278fe3ce894826b10ccfcca931b310/users/44692fa77b024f2c93f87721137a2c4d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:35.776911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3018272-1b0b-455c-9f42-7f520b3e08d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42278fe3ce894826b10ccfcca931b310, user_id=44692fa77b024f2c93f87721137a2c4d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:35.781341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3018272-1b0b-455c-9f42-7f520b3e08d5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:35.805222 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3796/7647] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:36:35 2022] PUT /identity/v3/projects/42278fe3ce894826b10ccfcca931b310/users/44692fa77b024f2c93f87721137a2c4d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:35.816502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1cfa6-4d67-45f7-b8d0-066d235c4c17 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:35.818489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1cfa6-4d67-45f7-b8d0-066d235c4c17 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:35.819205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1cfa6-4d67-45f7-b8d0-066d235c4c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:35.877730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-74a1cfa6-4d67-45f7-b8d0-066d235c4c17 None None] MFA Rules not processed for user `44692fa77b024f2c93f87721137a2c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:35.880243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-74a1cfa6-4d67-45f7-b8d0-066d235c4c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:36.039201 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3852/7648] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:36.051944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3018272-1b0b-455c-9f42-7f520b3e08d5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:36.053743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c3018272-1b0b-455c-9f42-7f520b3e08d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:36.169790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3018272-1b0b-455c-9f42-7f520b3e08d5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:36.175654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b91654-f6e7-4d28-a526-dec4cc2ec259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:36.177185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b91654-f6e7-4d28-a526-dec4cc2ec259 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:36.177669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b91654-f6e7-4d28-a526-dec4cc2ec259 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:36.178138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b91654-f6e7-4d28-a526-dec4cc2ec259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:36.195815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b91654-f6e7-4d28-a526-dec4cc2ec259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:36.197368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b91654-f6e7-4d28-a526-dec4cc2ec259 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:36.218228 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3797/7649] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:36:40.207353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1cfa6-4d67-45f7-b8d0-066d235c4c17 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:40.209194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-74a1cfa6-4d67-45f7-b8d0-066d235c4c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:40.371849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1cfa6-4d67-45f7-b8d0-066d235c4c17 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:40.388413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895b7b4-b977-4e1d-a1d0-d3e964722412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:40.389045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895b7b4-b977-4e1d-a1d0-d3e964722412 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:40.389943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895b7b4-b977-4e1d-a1d0-d3e964722412 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:40.390396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895b7b4-b977-4e1d-a1d0-d3e964722412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:40.395344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d895b7b4-b977-4e1d-a1d0-d3e964722412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:40.428316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895b7b4-b977-4e1d-a1d0-d3e964722412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:40.429933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895b7b4-b977-4e1d-a1d0-d3e964722412 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:40.478310 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3853/7650] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:36:43.210421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b91654-f6e7-4d28-a526-dec4cc2ec259 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:43.212469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e1b91654-f6e7-4d28-a526-dec4cc2ec259 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:43.330611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b91654-f6e7-4d28-a526-dec4cc2ec259 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:43.339482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:43.340130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:43.340406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:43.340713 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] PATH_INFO: `/v3/users/cc7ba9fabe7f46558acdff02c65930e0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:43.342031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc7ba9fabe7f46558acdff02c65930e0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:43.344847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:43.360544 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:43.500203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc7ba9fabe7f46558acdff02c65930e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:43.501740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc7ba9fabe7f46558acdff02c65930e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:43.532745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc7ba9fabe7f46558acdff02c65930e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:43.549707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc7ba9fabe7f46558acdff02c65930e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:43.550532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc7ba9fabe7f46558acdff02c65930e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:43.579226 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3798/7651] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:36:43 2022] DELETE /identity/v3/users/cc7ba9fabe7f46558acdff02c65930e0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:43.583627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae71821-7f94-4e1e-bd3e-985155d2e072 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:43.585406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae71821-7f94-4e1e-bd3e-985155d2e072 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:43.586392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae71821-7f94-4e1e-bd3e-985155d2e072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:43.649610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dae71821-7f94-4e1e-bd3e-985155d2e072 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:43.651171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dae71821-7f94-4e1e-bd3e-985155d2e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:43.672286 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:43.787168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:43.789258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:43.801423 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3854/7652] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:43.812373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae71821-7f94-4e1e-bd3e-985155d2e072 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:43.814044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dae71821-7f94-4e1e-bd3e-985155d2e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:43.957338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8d7a2-bd71-4ad7-a462-f872395a2947 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:43.964334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae71821-7f94-4e1e-bd3e-985155d2e072 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:43.975896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22968140-9b57-47f7-82cd-5a42015785ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:43.976306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22968140-9b57-47f7-82cd-5a42015785ef service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:43.976606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22968140-9b57-47f7-82cd-5a42015785ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:43.977230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c38e7-b324-4cba-9302-d3061cc86622 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:43.978266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c38e7-b324-4cba-9302-d3061cc86622 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:43.978554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c38e7-b324-4cba-9302-d3061cc86622 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:43.979376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c38e7-b324-4cba-9302-d3061cc86622 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:43.979666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22968140-9b57-47f7-82cd-5a42015785ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:43.982042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-932c38e7-b324-4cba-9302-d3061cc86622 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:44.005048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22968140-9b57-47f7-82cd-5a42015785ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:44.006494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22968140-9b57-47f7-82cd-5a42015785ef service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:44.047221 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3855/7653] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:36:44.094473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c38e7-b324-4cba-9302-d3061cc86622 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:44.096329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c38e7-b324-4cba-9302-d3061cc86622 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:44.107927 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3799/7654] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:36:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:36:44.345163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22968140-9b57-47f7-82cd-5a42015785ef service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:44.347147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22968140-9b57-47f7-82cd-5a42015785ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:44.375616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22968140-9b57-47f7-82cd-5a42015785ef service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:44.385480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d2b19-7280-4664-bfdd-626ecd1d6524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:44.386246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d2b19-7280-4664-bfdd-626ecd1d6524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:44.386758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d2b19-7280-4664-bfdd-626ecd1d6524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:44.388024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d2b19-7280-4664-bfdd-626ecd1d6524 admin admin] PATH_INFO: `/v3/projects/8500275073ce4f1fbb1c7b2177560f43` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:44.390196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d2b19-7280-4664-bfdd-626ecd1d6524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8500275073ce4f1fbb1c7b2177560f43)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:44.393309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d2b19-7280-4664-bfdd-626ecd1d6524 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:44.464021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a58d2b19-7280-4664-bfdd-626ecd1d6524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8500275073ce4f1fbb1c7b2177560f43', 'request_id': 'req-a58d2b19-7280-4664-bfdd-626ecd1d6524'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:44.472257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a58d2b19-7280-4664-bfdd-626ecd1d6524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8500275073ce4f1fbb1c7b2177560f43', 'request_id': 'req-a58d2b19-7280-4664-bfdd-626ecd1d6524'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:44.484127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a58d2b19-7280-4664-bfdd-626ecd1d6524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8500275073ce4f1fbb1c7b2177560f43', 'request_id': 'req-a58d2b19-7280-4664-bfdd-626ecd1d6524'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:44.496932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a58d2b19-7280-4664-bfdd-626ecd1d6524 admin admin] The token cache is being invalidate because project 8500275073ce4f1fbb1c7b2177560f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:36:44.497416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a58d2b19-7280-4664-bfdd-626ecd1d6524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:44.498225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a58d2b19-7280-4664-bfdd-626ecd1d6524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:44.503827 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3856/7655] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:36:44 2022] DELETE /identity/v3/projects/8500275073ce4f1fbb1c7b2177560f43 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:44.505502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce2ee2-fc9a-4122-a2fa-843d8cb004e0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:44.505968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce2ee2-fc9a-4122-a2fa-843d8cb004e0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:44.506191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce2ee2-fc9a-4122-a2fa-843d8cb004e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:44.530967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9dce2ee2-fc9a-4122-a2fa-843d8cb004e0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:44.532539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9dce2ee2-fc9a-4122-a2fa-843d8cb004e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:44.559799 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:44.627406 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3800/7656] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:44.635830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7f703-85eb-48ff-9dce-a60cbdf8bddd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:44.637016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7f703-85eb-48ff-9dce-a60cbdf8bddd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:44.637828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7f703-85eb-48ff-9dce-a60cbdf8bddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:44.668415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9de7f703-85eb-48ff-9dce-a60cbdf8bddd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:44.669895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9de7f703-85eb-48ff-9dce-a60cbdf8bddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:44.689025 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3857/7657] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:44.690298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce2ee2-fc9a-4122-a2fa-843d8cb004e0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:44.701068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce2ee2-fc9a-4122-a2fa-843d8cb004e0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:44.709298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66fb44-89e9-4c97-9a0a-e347697dbda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:44.710179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66fb44-89e9-4c97-9a0a-e347697dbda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:44.710455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66fb44-89e9-4c97-9a0a-e347697dbda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:44.710722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66fb44-89e9-4c97-9a0a-e347697dbda9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:44.711626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66fb44-89e9-4c97-9a0a-e347697dbda9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:36:44.711953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66fb44-89e9-4c97-9a0a-e347697dbda9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:44.713589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66fb44-89e9-4c97-9a0a-e347697dbda9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:44.744082 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3801/7658] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:36:44.746636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7f703-85eb-48ff-9dce-a60cbdf8bddd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:44.760747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7f703-85eb-48ff-9dce-a60cbdf8bddd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:44.807135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aba2cd-a6e3-4e97-b19c-c5ac431493aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:44.807765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aba2cd-a6e3-4e97-b19c-c5ac431493aa admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:44.808086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aba2cd-a6e3-4e97-b19c-c5ac431493aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:44.812183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aba2cd-a6e3-4e97-b19c-c5ac431493aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:44.814230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aba2cd-a6e3-4e97-b19c-c5ac431493aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:44.816393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aba2cd-a6e3-4e97-b19c-c5ac431493aa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:44.924541 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3858/7659] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:36:44 2022] POST /identity/v3/projects => generated 405 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:36:44.926377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66fb44-89e9-4c97-9a0a-e347697dbda9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:44.944638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66fb44-89e9-4c97-9a0a-e347697dbda9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:45.101924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1f8fa-be4f-4ba4-8466-6c5aa611b8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:45.102557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1f8fa-be4f-4ba4-8466-6c5aa611b8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:45.102838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1f8fa-be4f-4ba4-8466-6c5aa611b8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:45.103154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1f8fa-be4f-4ba4-8466-6c5aa611b8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:45.103797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1f8fa-be4f-4ba4-8466-6c5aa611b8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:45.109767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1f8fa-be4f-4ba4-8466-6c5aa611b8a8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:45.158534 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3802/7660] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:36:44 2022] POST /identity/v3/users => generated 303 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:36:45.160084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aba2cd-a6e3-4e97-b19c-c5ac431493aa admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:45.176515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aba2cd-a6e3-4e97-b19c-c5ac431493aa admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:45.183327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a57f3-1566-46c5-b04e-8cc643302994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:45.184002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a57f3-1566-46c5-b04e-8cc643302994 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:45.184291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a57f3-1566-46c5-b04e-8cc643302994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:45.184567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a57f3-1566-46c5-b04e-8cc643302994 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:45.185218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a57f3-1566-46c5-b04e-8cc643302994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:45.187160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a57f3-1566-46c5-b04e-8cc643302994 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:45.191964 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:45.227921 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3859/7661] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:36:45.231344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1f8fa-be4f-4ba4-8466-6c5aa611b8a8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:45.255911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1f8fa-be4f-4ba4-8466-6c5aa611b8a8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:45.273860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3a509-8561-4bd2-bd29-42f076768fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:45.275595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3a509-8561-4bd2-bd29-42f076768fac admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:45.275898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3a509-8561-4bd2-bd29-42f076768fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:45.276360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3a509-8561-4bd2-bd29-42f076768fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:45.277750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3a509-8561-4bd2-bd29-42f076768fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:45.287020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3a509-8561-4bd2-bd29-42f076768fac admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:45.324449 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3803/7662] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:36:45.332958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a57f3-1566-46c5-b04e-8cc643302994 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:45.347687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a57f3-1566-46c5-b04e-8cc643302994 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:45.355390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa3a8a-5675-4a24-8f16-6a0d6fcb2e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:45.356303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3a8a-5675-4a24-8f16-6a0d6fcb2e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:45.356729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3a8a-5675-4a24-8f16-6a0d6fcb2e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:45.357159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3a8a-5675-4a24-8f16-6a0d6fcb2e30 admin admin] PATH_INFO: `/v3/projects/5ae253568991452390bac561064f9725/users/61bd10b9ba054a4db60dc8d9b37c9e3f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:45.379079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa3a8a-5675-4a24-8f16-6a0d6fcb2e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae253568991452390bac561064f9725, user_id=61bd10b9ba054a4db60dc8d9b37c9e3f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:45.383148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa3a8a-5675-4a24-8f16-6a0d6fcb2e30 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:45.423338 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3860/7663] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:36:45 2022] PUT /identity/v3/projects/5ae253568991452390bac561064f9725/users/61bd10b9ba054a4db60dc8d9b37c9e3f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:45.433401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4a917-6ad4-4a20-af3e-aaf2fc51870d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:45.433763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4a917-6ad4-4a20-af3e-aaf2fc51870d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:45.434101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4a917-6ad4-4a20-af3e-aaf2fc51870d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:45.489231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bfe4a917-6ad4-4a20-af3e-aaf2fc51870d None None] MFA Rules not processed for user `61bd10b9ba054a4db60dc8d9b37c9e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:45.490444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bfe4a917-6ad4-4a20-af3e-aaf2fc51870d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:45.591201 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3804/7664] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:45 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:45.591760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa3a8a-5675-4a24-8f16-6a0d6fcb2e30 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:45.750052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa3a8a-5675-4a24-8f16-6a0d6fcb2e30 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:45.757844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04bac1-3b43-4a27-bf8c-82abd008744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:45.758564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04bac1-3b43-4a27-bf8c-82abd008744f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:45.758968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04bac1-3b43-4a27-bf8c-82abd008744f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:45.759346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04bac1-3b43-4a27-bf8c-82abd008744f admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:45.760371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04bac1-3b43-4a27-bf8c-82abd008744f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:45.762394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04bac1-3b43-4a27-bf8c-82abd008744f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:45.808960 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3861/7665] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:36:45 2022] POST /identity/v3/projects => generated 405 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:36:45.813032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4a917-6ad4-4a20-af3e-aaf2fc51870d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:45.831808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4a917-6ad4-4a20-af3e-aaf2fc51870d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:45.850862 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:45.983979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07587fd-7888-4c84-ab48-7ec998ab2807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:45.984937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07587fd-7888-4c84-ab48-7ec998ab2807 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:45.985444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07587fd-7888-4c84-ab48-7ec998ab2807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:45.985934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07587fd-7888-4c84-ab48-7ec998ab2807 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:45.986789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07587fd-7888-4c84-ab48-7ec998ab2807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:45.989504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07587fd-7888-4c84-ab48-7ec998ab2807 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:46.055328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04bac1-3b43-4a27-bf8c-82abd008744f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:46.067063 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3805/7666] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:36:45 2022] POST /identity/v3/users => generated 309 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:36:46.076992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04bac1-3b43-4a27-bf8c-82abd008744f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:46.099621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb96f-4cef-4811-a6f1-cd4054c3c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:46.100533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb96f-4cef-4811-a6f1-cd4054c3c8ff admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:46.101732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb96f-4cef-4811-a6f1-cd4054c3c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:46.102014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb96f-4cef-4811-a6f1-cd4054c3c8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:46.103634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffb96f-4cef-4811-a6f1-cd4054c3c8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:46.107732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffb96f-4cef-4811-a6f1-cd4054c3c8ff admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:46.152373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07587fd-7888-4c84-ab48-7ec998ab2807 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:46.154098 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3862/7667] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:36:46.167183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07587fd-7888-4c84-ab48-7ec998ab2807 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:46.175970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8e065-9682-4c45-94be-2db95eac726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:46.176918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8e065-9682-4c45-94be-2db95eac726e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:46.177403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8e065-9682-4c45-94be-2db95eac726e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:46.178104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8e065-9682-4c45-94be-2db95eac726e admin admin] PATH_INFO: `/v3/projects/2b3fa63b978141f2928cd9b2243a8eb6/users/467367df80b848d7955f8ebf43010a34/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:46.202631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8e065-9682-4c45-94be-2db95eac726e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3fa63b978141f2928cd9b2243a8eb6, user_id=467367df80b848d7955f8ebf43010a34, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:46.205880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8e065-9682-4c45-94be-2db95eac726e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:46.229536 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3806/7668] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:36:46 2022] PUT /identity/v3/projects/2b3fa63b978141f2928cd9b2243a8eb6/users/467367df80b848d7955f8ebf43010a34/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:36:46.234627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb96f-4cef-4811-a6f1-cd4054c3c8ff admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:46.250802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb96f-4cef-4811-a6f1-cd4054c3c8ff admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:46.412969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4719596-8cf6-40a7-a863-bc6afb06dedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:46.413664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4719596-8cf6-40a7-a863-bc6afb06dedf admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:46.413950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4719596-8cf6-40a7-a863-bc6afb06dedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:46.414227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4719596-8cf6-40a7-a863-bc6afb06dedf admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:46.414871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4719596-8cf6-40a7-a863-bc6afb06dedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:46.417460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4719596-8cf6-40a7-a863-bc6afb06dedf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:46.429804 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3863/7669] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:36:46.433989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8e065-9682-4c45-94be-2db95eac726e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:46.446366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8e065-9682-4c45-94be-2db95eac726e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:46.451928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bb1dc-009c-46c2-9a4e-4e37fac1d707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:46.452785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb1dc-009c-46c2-9a4e-4e37fac1d707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:46.453214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb1dc-009c-46c2-9a4e-4e37fac1d707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:46.453974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb1dc-009c-46c2-9a4e-4e37fac1d707 admin admin] PATH_INFO: `/v3/projects/2b3fa63b978141f2928cd9b2243a8eb6/users/467367df80b848d7955f8ebf43010a34/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:46.457466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bb1dc-009c-46c2-9a4e-4e37fac1d707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3fa63b978141f2928cd9b2243a8eb6, user_id=467367df80b848d7955f8ebf43010a34, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:46.460601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bb1dc-009c-46c2-9a4e-4e37fac1d707 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:46.493197 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3807/7670] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:36:46 2022] PUT /identity/v3/projects/2b3fa63b978141f2928cd9b2243a8eb6/users/467367df80b848d7955f8ebf43010a34/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:46.494969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d81bc5-f3da-4bd4-ad1b-2659d6ba15fe None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:46.495258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d81bc5-f3da-4bd4-ad1b-2659d6ba15fe None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:46.495537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d81bc5-f3da-4bd4-ad1b-2659d6ba15fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:46.571979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b7d81bc5-f3da-4bd4-ad1b-2659d6ba15fe None None] MFA Rules not processed for user `467367df80b848d7955f8ebf43010a34`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:46.573213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b7d81bc5-f3da-4bd4-ad1b-2659d6ba15fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:46.651988 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:46.755191 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3864/7671] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:46 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:46.762885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bb1dc-009c-46c2-9a4e-4e37fac1d707 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:46.765977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0f9bb1dc-009c-46c2-9a4e-4e37fac1d707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:46.913262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bb1dc-009c-46c2-9a4e-4e37fac1d707 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:46.921023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edf345-8e14-46b0-91fe-ba635d6310bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:46.921989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edf345-8e14-46b0-91fe-ba635d6310bd service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:46.922470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edf345-8e14-46b0-91fe-ba635d6310bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:46.922883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edf345-8e14-46b0-91fe-ba635d6310bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:46.937207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edf345-8e14-46b0-91fe-ba635d6310bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:46.940896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edf345-8e14-46b0-91fe-ba635d6310bd service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:46.957040 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3808/7672] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:46 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:36:47.207467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d81bc5-f3da-4bd4-ad1b-2659d6ba15fe None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:47.402330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edf345-8e14-46b0-91fe-ba635d6310bd service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:47.404243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a3edf345-8e14-46b0-91fe-ba635d6310bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:47.467137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d81bc5-f3da-4bd4-ad1b-2659d6ba15fe None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:47.496458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:47.497416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:47.498093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:47.499799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] PATH_INFO: `/v3/users/61bd10b9ba054a4db60dc8d9b37c9e3f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:47.504837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61bd10b9ba054a4db60dc8d9b37c9e3f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:47.510990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:47.634501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edf345-8e14-46b0-91fe-ba635d6310bd service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:47.653694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbd7a0-b45d-4ad8-8b24-9722cb126d13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:47.655562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbd7a0-b45d-4ad8-8b24-9722cb126d13 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:47.656041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbd7a0-b45d-4ad8-8b24-9722cb126d13 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:47.656318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbd7a0-b45d-4ad8-8b24-9722cb126d13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:47.663803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9ccbd7a0-b45d-4ad8-8b24-9722cb126d13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:47.681858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61bd10b9ba054a4db60dc8d9b37c9e3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:47.685217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61bd10b9ba054a4db60dc8d9b37c9e3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:47.703217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbd7a0-b45d-4ad8-8b24-9722cb126d13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:47.706107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbd7a0-b45d-4ad8-8b24-9722cb126d13 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:47.732176 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:47.735024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61bd10b9ba054a4db60dc8d9b37c9e3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:47.749244 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3809/7673] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:36:47.762137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61bd10b9ba054a4db60dc8d9b37c9e3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:47.763101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61bd10b9ba054a4db60dc8d9b37c9e3f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:47.796840 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3865/7674] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:36:47 2022] DELETE /identity/v3/users/61bd10b9ba054a4db60dc8d9b37c9e3f => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:47.801387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db3683-9bb8-4226-b16f-a865f6711549 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:47.802196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db3683-9bb8-4226-b16f-a865f6711549 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:47.802652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db3683-9bb8-4226-b16f-a865f6711549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:47.855280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-82db3683-9bb8-4226-b16f-a865f6711549 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:47.860206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-82db3683-9bb8-4226-b16f-a865f6711549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:48.051338 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3810/7675] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:48.064889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:48.078146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:48.327409 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:48.355914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b9d60-9a6d-4a97-a55f-c6a10cd8f8a3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:48.378331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46928135-5391-47bd-8ab9-52f8c21bff59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:48.378795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46928135-5391-47bd-8ab9-52f8c21bff59 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:48.379111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46928135-5391-47bd-8ab9-52f8c21bff59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:48.379442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46928135-5391-47bd-8ab9-52f8c21bff59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:48.412757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46928135-5391-47bd-8ab9-52f8c21bff59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:48.417869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46928135-5391-47bd-8ab9-52f8c21bff59 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:48.446541 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3866/7676] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:36:49.446689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db3683-9bb8-4226-b16f-a865f6711549 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:49.448693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-82db3683-9bb8-4226-b16f-a865f6711549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:49.449883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46928135-5391-47bd-8ab9-52f8c21bff59 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:49.451828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-46928135-5391-47bd-8ab9-52f8c21bff59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:49.508375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db3683-9bb8-4226-b16f-a865f6711549 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:49.518859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46928135-5391-47bd-8ab9-52f8c21bff59 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:49.542014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b0879-af42-47ed-8c1d-1ae6909fd5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:49.542655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b0879-af42-47ed-8c1d-1ae6909fd5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:49.569573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b0879-af42-47ed-8c1d-1ae6909fd5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:49.570451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b0879-af42-47ed-8c1d-1ae6909fd5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:49.571693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:49.574692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:49.578005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8e5b0879-af42-47ed-8c1d-1ae6909fd5d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:49.578412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:49.578799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] PATH_INFO: `/v3/projects/5ae253568991452390bac561064f9725` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:49.584058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae253568991452390bac561064f9725)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:49.586192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:49.637298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b0879-af42-47ed-8c1d-1ae6909fd5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:49.642006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b0879-af42-47ed-8c1d-1ae6909fd5d3 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:49.695165 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3811/7677] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:36:49.819676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae253568991452390bac561064f9725', 'request_id': 'req-1ed32889-53b1-4168-9bae-0be79ae41ae7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:49.854179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae253568991452390bac561064f9725', 'request_id': 'req-1ed32889-53b1-4168-9bae-0be79ae41ae7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:49.899464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae253568991452390bac561064f9725', 'request_id': 'req-1ed32889-53b1-4168-9bae-0be79ae41ae7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:49.965955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] The token cache is being invalidate because project 5ae253568991452390bac561064f9725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:36:49.966259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:49.968565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:49.972857 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3867/7678] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:36:49 2022] DELETE /identity/v3/projects/5ae253568991452390bac561064f9725 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:49.977957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b0879-af42-47ed-8c1d-1ae6909fd5d3 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:50.078961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b0879-af42-47ed-8c1d-1ae6909fd5d3 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:50.328134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80136db8-48fa-4f70-91a3-6dd27243b8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:50.339954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80136db8-48fa-4f70-91a3-6dd27243b8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:50.340474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80136db8-48fa-4f70-91a3-6dd27243b8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:50.340962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80136db8-48fa-4f70-91a3-6dd27243b8f1 admin admin] PATH_INFO: `/v3/users/467367df80b848d7955f8ebf43010a34` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:50.343502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80136db8-48fa-4f70-91a3-6dd27243b8f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=467367df80b848d7955f8ebf43010a34)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:50.357467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80136db8-48fa-4f70-91a3-6dd27243b8f1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:50.487743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-80136db8-48fa-4f70-91a3-6dd27243b8f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467367df80b848d7955f8ebf43010a34'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:50.488632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-80136db8-48fa-4f70-91a3-6dd27243b8f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467367df80b848d7955f8ebf43010a34'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:50.527002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-80136db8-48fa-4f70-91a3-6dd27243b8f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467367df80b848d7955f8ebf43010a34'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:50.556148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-80136db8-48fa-4f70-91a3-6dd27243b8f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467367df80b848d7955f8ebf43010a34'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:50.563997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-80136db8-48fa-4f70-91a3-6dd27243b8f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467367df80b848d7955f8ebf43010a34'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:50.607488 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3812/7679] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:36:49 2022] DELETE /identity/v3/users/467367df80b848d7955f8ebf43010a34 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:51.309947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:51.312278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:51.355486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed32889-53b1-4168-9bae-0be79ae41ae7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:51.457259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509afb4c-4644-48a5-aeff-4ccbfcc83b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:51.458491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509afb4c-4644-48a5-aeff-4ccbfcc83b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:51.459072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509afb4c-4644-48a5-aeff-4ccbfcc83b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:51.460050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509afb4c-4644-48a5-aeff-4ccbfcc83b13 admin admin] PATH_INFO: `/v3/projects/2b3fa63b978141f2928cd9b2243a8eb6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:51.462783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509afb4c-4644-48a5-aeff-4ccbfcc83b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3fa63b978141f2928cd9b2243a8eb6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:51.466650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509afb4c-4644-48a5-aeff-4ccbfcc83b13 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:51.543595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-509afb4c-4644-48a5-aeff-4ccbfcc83b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3fa63b978141f2928cd9b2243a8eb6', 'request_id': 'req-509afb4c-4644-48a5-aeff-4ccbfcc83b13'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:51.572283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-509afb4c-4644-48a5-aeff-4ccbfcc83b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3fa63b978141f2928cd9b2243a8eb6', 'request_id': 'req-509afb4c-4644-48a5-aeff-4ccbfcc83b13'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:51.586433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-509afb4c-4644-48a5-aeff-4ccbfcc83b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3fa63b978141f2928cd9b2243a8eb6', 'request_id': 'req-509afb4c-4644-48a5-aeff-4ccbfcc83b13'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:51.613993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-509afb4c-4644-48a5-aeff-4ccbfcc83b13 admin admin] The token cache is being invalidate because project 2b3fa63b978141f2928cd9b2243a8eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:36:51.616764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-509afb4c-4644-48a5-aeff-4ccbfcc83b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:51.617869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-509afb4c-4644-48a5-aeff-4ccbfcc83b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:36:51.623089 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3868/7680] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:36:51 2022] DELETE /identity/v3/projects/2b3fa63b978141f2928cd9b2243a8eb6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:51.626432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d500d-ba6c-4db6-b2ac-695eb23c68fe None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:51.627075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d500d-ba6c-4db6-b2ac-695eb23c68fe None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:51.627171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d500d-ba6c-4db6-b2ac-695eb23c68fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:51.642600 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:51.696524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a19d500d-ba6c-4db6-b2ac-695eb23c68fe None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:51.699665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a19d500d-ba6c-4db6-b2ac-695eb23c68fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:51.964476 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3813/7681] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:51.977055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202fcfb-9c5a-4d91-88fb-cc17e77076e3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:51.977515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202fcfb-9c5a-4d91-88fb-cc17e77076e3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:51.978036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202fcfb-9c5a-4d91-88fb-cc17e77076e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:51.989033 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:52.021204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e202fcfb-9c5a-4d91-88fb-cc17e77076e3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:52.022439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e202fcfb-9c5a-4d91-88fb-cc17e77076e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:52.050405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d500d-ba6c-4db6-b2ac-695eb23c68fe None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:52.065944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d500d-ba6c-4db6-b2ac-695eb23c68fe None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:52.073051 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3869/7682] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:52.078792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf50dbd-2a01-45c0-a452-4c1043db522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:52.081207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf50dbd-2a01-45c0-a452-4c1043db522c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:52.081491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf50dbd-2a01-45c0-a452-4c1043db522c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:52.081766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf50dbd-2a01-45c0-a452-4c1043db522c admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:52.082425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf50dbd-2a01-45c0-a452-4c1043db522c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:36:52.082730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf50dbd-2a01-45c0-a452-4c1043db522c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:52.085289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf50dbd-2a01-45c0-a452-4c1043db522c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:52.112157 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3814/7683] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:36:52.117963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202fcfb-9c5a-4d91-88fb-cc17e77076e3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:52.129895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202fcfb-9c5a-4d91-88fb-cc17e77076e3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:52.134873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c5f03-6200-424c-bffb-7817d569cda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:52.137498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c5f03-6200-424c-bffb-7817d569cda5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:52.137498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c5f03-6200-424c-bffb-7817d569cda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:52.137498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c5f03-6200-424c-bffb-7817d569cda5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:52.137498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c5f03-6200-424c-bffb-7817d569cda5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:52.138981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c5f03-6200-424c-bffb-7817d569cda5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:52.200683 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3870/7684] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:36:52 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:36:52.205454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf50dbd-2a01-45c0-a452-4c1043db522c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:52.218546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf50dbd-2a01-45c0-a452-4c1043db522c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:52.317334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcb733-03a9-46f3-8a08-b9440c05c41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:52.318174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcb733-03a9-46f3-8a08-b9440c05c41d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:52.318526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcb733-03a9-46f3-8a08-b9440c05c41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:52.318804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcb733-03a9-46f3-8a08-b9440c05c41d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:52.319740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcb733-03a9-46f3-8a08-b9440c05c41d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:52.322744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcb733-03a9-46f3-8a08-b9440c05c41d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:52.375355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c5f03-6200-424c-bffb-7817d569cda5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:52.386611 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3815/7685] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:36:52 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:36:52.392251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c5f03-6200-424c-bffb-7817d569cda5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:52.398859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18597e8-214a-462a-bc5d-1ecb33be12ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:52.399706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18597e8-214a-462a-bc5d-1ecb33be12ba admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:52.399991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18597e8-214a-462a-bc5d-1ecb33be12ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:52.400263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18597e8-214a-462a-bc5d-1ecb33be12ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:52.400937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18597e8-214a-462a-bc5d-1ecb33be12ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:52.402907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18597e8-214a-462a-bc5d-1ecb33be12ba admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:52.423722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcb733-03a9-46f3-8a08-b9440c05c41d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:52.431141 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3871/7686] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:36:52.456590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcb733-03a9-46f3-8a08-b9440c05c41d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:52.470790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d341c44-c646-482c-9c9d-7f74184e7f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:52.471380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d341c44-c646-482c-9c9d-7f74184e7f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:52.471659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d341c44-c646-482c-9c9d-7f74184e7f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:52.471929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d341c44-c646-482c-9c9d-7f74184e7f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:52.472596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d341c44-c646-482c-9c9d-7f74184e7f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:52.474317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d341c44-c646-482c-9c9d-7f74184e7f70 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:52.507048 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3816/7687] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:36:52.507276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18597e8-214a-462a-bc5d-1ecb33be12ba admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:52.537745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18597e8-214a-462a-bc5d-1ecb33be12ba admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:52.543812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae628f8c-cc21-4f2a-9317-b86d1dfe4f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:52.551057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae628f8c-cc21-4f2a-9317-b86d1dfe4f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:52.551057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae628f8c-cc21-4f2a-9317-b86d1dfe4f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:52.551057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae628f8c-cc21-4f2a-9317-b86d1dfe4f51 admin admin] PATH_INFO: `/v3/projects/3287e63e7f62492aaf1287f5de795cf6/users/6d7da708fbfd4ff4927de400ab829f3b/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:52.607576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae628f8c-cc21-4f2a-9317-b86d1dfe4f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3287e63e7f62492aaf1287f5de795cf6, user_id=6d7da708fbfd4ff4927de400ab829f3b, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:52.615825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae628f8c-cc21-4f2a-9317-b86d1dfe4f51 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:52.641898 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3872/7688] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:36:52 2022] PUT /identity/v3/projects/3287e63e7f62492aaf1287f5de795cf6/users/6d7da708fbfd4ff4927de400ab829f3b/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:36:52.654108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849b74a-1c96-47e6-a1d2-61c0bcbb9ab9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:52.657732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849b74a-1c96-47e6-a1d2-61c0bcbb9ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:52.658242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849b74a-1c96-47e6-a1d2-61c0bcbb9ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:52.735968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c849b74a-1c96-47e6-a1d2-61c0bcbb9ab9 None None] MFA Rules not processed for user `6d7da708fbfd4ff4927de400ab829f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:52.737251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c849b74a-1c96-47e6-a1d2-61c0bcbb9ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:52.889775 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:52.898394 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3817/7689] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:36:52.899635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae628f8c-cc21-4f2a-9317-b86d1dfe4f51 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:53.028623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae628f8c-cc21-4f2a-9317-b86d1dfe4f51 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:53.037162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2f4d3-ddd7-4b9f-b88f-d747028ee543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:53.037830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f4d3-ddd7-4b9f-b88f-d747028ee543 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:53.038112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f4d3-ddd7-4b9f-b88f-d747028ee543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:53.038383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f4d3-ddd7-4b9f-b88f-d747028ee543 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:53.040642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2f4d3-ddd7-4b9f-b88f-d747028ee543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:53.048679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2f4d3-ddd7-4b9f-b88f-d747028ee543 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:53.106072 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3873/7690] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:36:52 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:36:53.110643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849b74a-1c96-47e6-a1d2-61c0bcbb9ab9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:53.124433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849b74a-1c96-47e6-a1d2-61c0bcbb9ab9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:53.261123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b100a2e-8e6c-4a9c-967e-f40a874bfd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:53.266088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100a2e-8e6c-4a9c-967e-f40a874bfd04 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:53.267250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100a2e-8e6c-4a9c-967e-f40a874bfd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:53.268915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100a2e-8e6c-4a9c-967e-f40a874bfd04 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:53.270515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b100a2e-8e6c-4a9c-967e-f40a874bfd04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:53.276875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b100a2e-8e6c-4a9c-967e-f40a874bfd04 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:53.326239 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3818/7691] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:36:53 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:36:53.330656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2f4d3-ddd7-4b9f-b88f-d747028ee543 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:53.345177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2f4d3-ddd7-4b9f-b88f-d747028ee543 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:53.355596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243146b6-1a95-4ab7-8e58-a3b6b11ce470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:53.355596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243146b6-1a95-4ab7-8e58-a3b6b11ce470 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:53.355596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243146b6-1a95-4ab7-8e58-a3b6b11ce470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:53.355596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243146b6-1a95-4ab7-8e58-a3b6b11ce470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:53.358128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243146b6-1a95-4ab7-8e58-a3b6b11ce470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:53.359891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243146b6-1a95-4ab7-8e58-a3b6b11ce470 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:53.388530 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3874/7692] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:36:53.392325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b100a2e-8e6c-4a9c-967e-f40a874bfd04 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:53.406375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b100a2e-8e6c-4a9c-967e-f40a874bfd04 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:53.415856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6b436-d085-4a87-a19c-16e1e04c051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:53.416490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b436-d085-4a87-a19c-16e1e04c051f admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:53.416771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b436-d085-4a87-a19c-16e1e04c051f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:53.417045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b436-d085-4a87-a19c-16e1e04c051f admin admin] PATH_INFO: `/v3/projects/9e3639ba91d443b0a1852473b760fea5/users/ff1936f04d8044ce90715d3470381a88/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:53.477968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6b436-d085-4a87-a19c-16e1e04c051f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3639ba91d443b0a1852473b760fea5, user_id=ff1936f04d8044ce90715d3470381a88, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:53.489171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6b436-d085-4a87-a19c-16e1e04c051f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:53.540054 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3819/7693] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:36:53 2022] PUT /identity/v3/projects/9e3639ba91d443b0a1852473b760fea5/users/ff1936f04d8044ce90715d3470381a88/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:53.541188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243146b6-1a95-4ab7-8e58-a3b6b11ce470 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:53.562318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243146b6-1a95-4ab7-8e58-a3b6b11ce470 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:53.769351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd5734-17b3-4b27-bf1b-6335012c8f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:53.771184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd5734-17b3-4b27-bf1b-6335012c8f47 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:53.786607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd5734-17b3-4b27-bf1b-6335012c8f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:53.787233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd5734-17b3-4b27-bf1b-6335012c8f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:53.789538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd5734-17b3-4b27-bf1b-6335012c8f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:53.793100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd5734-17b3-4b27-bf1b-6335012c8f47 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:53.840052 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3875/7694] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:36:53.847496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6b436-d085-4a87-a19c-16e1e04c051f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:53.865313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6b436-d085-4a87-a19c-16e1e04c051f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:53.873008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd36a5a-0110-4bf3-96d1-864cadbc0b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:53.874414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd36a5a-0110-4bf3-96d1-864cadbc0b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:53.874845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd36a5a-0110-4bf3-96d1-864cadbc0b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:53.875300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd36a5a-0110-4bf3-96d1-864cadbc0b36 admin admin] PATH_INFO: `/v3/projects/9e3639ba91d443b0a1852473b760fea5/users/ff1936f04d8044ce90715d3470381a88/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:53.878810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd36a5a-0110-4bf3-96d1-864cadbc0b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3639ba91d443b0a1852473b760fea5, user_id=ff1936f04d8044ce90715d3470381a88, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:53.882567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd36a5a-0110-4bf3-96d1-864cadbc0b36 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:53.900371 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3820/7695] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:36:53 2022] PUT /identity/v3/projects/9e3639ba91d443b0a1852473b760fea5/users/ff1936f04d8044ce90715d3470381a88/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:36:53.913164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1795e6a-190c-4d1f-9495-2b01288b6395 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:53.913651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1795e6a-190c-4d1f-9495-2b01288b6395 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:53.914027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1795e6a-190c-4d1f-9495-2b01288b6395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:53.959653 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:53.982020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c1795e6a-190c-4d1f-9495-2b01288b6395 None None] MFA Rules not processed for user `ff1936f04d8044ce90715d3470381a88`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:36:53.984252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c1795e6a-190c-4d1f-9495-2b01288b6395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:54.122289 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3876/7696] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:36:54.133615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd36a5a-0110-4bf3-96d1-864cadbc0b36 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:54.137222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7cd36a5a-0110-4bf3-96d1-864cadbc0b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:54.297163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd36a5a-0110-4bf3-96d1-864cadbc0b36 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:54.306788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4ede5-fc90-4242-a150-4f2c80ccc6e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:54.308755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4ede5-fc90-4242-a150-4f2c80ccc6e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:54.310697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4ede5-fc90-4242-a150-4f2c80ccc6e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:54.313111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4ede5-fc90-4242-a150-4f2c80ccc6e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:54.560711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4ede5-fc90-4242-a150-4f2c80ccc6e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:54.563615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4ede5-fc90-4242-a150-4f2c80ccc6e2 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:54.591413 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3821/7697] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:36:57.466774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1795e6a-190c-4d1f-9495-2b01288b6395 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:36:57.469950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c1795e6a-190c-4d1f-9495-2b01288b6395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:36:57.492017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1795e6a-190c-4d1f-9495-2b01288b6395 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:36:57.499383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b563ef-4b6b-4e09-983e-666ce77756bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:36:57.500459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b563ef-4b6b-4e09-983e-666ce77756bd service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:36:57.500975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b563ef-4b6b-4e09-983e-666ce77756bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:36:57.501461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b563ef-4b6b-4e09-983e-666ce77756bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:36:57.546232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b563ef-4b6b-4e09-983e-666ce77756bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:36:57.551939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b563ef-4b6b-4e09-983e-666ce77756bd service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:36:57.570367 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3877/7698] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:36:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:04.569994 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:04.630025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4ede5-fc90-4242-a150-4f2c80ccc6e2 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:04.631505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-35e4ede5-fc90-4242-a150-4f2c80ccc6e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:04.849068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4ede5-fc90-4242-a150-4f2c80ccc6e2 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:04.856043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:04.857061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:04.857518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:04.857982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] PATH_INFO: `/v3/users/44692fa77b024f2c93f87721137a2c4d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:04.859319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44692fa77b024f2c93f87721137a2c4d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:04.861555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:04.969487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44692fa77b024f2c93f87721137a2c4d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:04.971234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44692fa77b024f2c93f87721137a2c4d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:04.992627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44692fa77b024f2c93f87721137a2c4d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:05.009918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44692fa77b024f2c93f87721137a2c4d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:05.010694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44692fa77b024f2c93f87721137a2c4d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:05.036170 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3822/7699] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:37:04 2022] DELETE /identity/v3/users/44692fa77b024f2c93f87721137a2c4d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:05.038173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b9bf0-85ae-4ca8-a6d3-e93ebc109416 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:05.038638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b9bf0-85ae-4ca8-a6d3-e93ebc109416 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:05.039172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b9bf0-85ae-4ca8-a6d3-e93ebc109416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:05.089752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fd3b9bf0-85ae-4ca8-a6d3-e93ebc109416 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:05.093062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fd3b9bf0-85ae-4ca8-a6d3-e93ebc109416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:05.314195 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3878/7700] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:37:05.325134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:05.327226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:05.386678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b9bf0-85ae-4ca8-a6d3-e93ebc109416 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:05.388478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fd3b9bf0-85ae-4ca8-a6d3-e93ebc109416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:05.414627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b9bf0-85ae-4ca8-a6d3-e93ebc109416 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:05.436480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:05.442253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:05.446330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:05.446622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] PATH_INFO: `/v3/users/6d7da708fbfd4ff4927de400ab829f3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:05.449040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5bfc7-c609-48fd-b8f8-a0f8f6399cd7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:05.449167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7da708fbfd4ff4927de400ab829f3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:05.451059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:05.460387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb9560-f773-4cd8-9234-902481cd04f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:05.461029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb9560-f773-4cd8-9234-902481cd04f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:05.461308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb9560-f773-4cd8-9234-902481cd04f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:05.461584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb9560-f773-4cd8-9234-902481cd04f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:05.484904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb9560-f773-4cd8-9234-902481cd04f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:05.486369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb9560-f773-4cd8-9234-902481cd04f8 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:05.528066 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3823/7701] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:05.628326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7da708fbfd4ff4927de400ab829f3b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:05.628326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7da708fbfd4ff4927de400ab829f3b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:05.659219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7da708fbfd4ff4927de400ab829f3b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:05.678341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7da708fbfd4ff4927de400ab829f3b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:05.680062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7da708fbfd4ff4927de400ab829f3b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:05.691802 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:05.718187 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3879/7702] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:37:05 2022] DELETE /identity/v3/users/6d7da708fbfd4ff4927de400ab829f3b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:05.719739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023340db-2062-4095-9135-1051534a3d04 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:05.720205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023340db-2062-4095-9135-1051534a3d04 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:05.720282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023340db-2062-4095-9135-1051534a3d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:05.772193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-023340db-2062-4095-9135-1051534a3d04 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:05.773726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-023340db-2062-4095-9135-1051534a3d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:05.833346 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:05.976198 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3824/7703] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:37:05.989763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:05.993758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:06.153943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f814b3f-56bd-4dc3-a1f2-85b1d82388bd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:06.163527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb4d2-881a-4d99-b69a-6d399e477967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:06.164503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb4d2-881a-4d99-b69a-6d399e477967 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:06.165758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb4d2-881a-4d99-b69a-6d399e477967 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:06.166225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb4d2-881a-4d99-b69a-6d399e477967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:06.180017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecb4d2-881a-4d99-b69a-6d399e477967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:06.182543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecb4d2-881a-4d99-b69a-6d399e477967 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:06.203371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023340db-2062-4095-9135-1051534a3d04 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:06.204849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-023340db-2062-4095-9135-1051534a3d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:06.220336 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3880/7704] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:06.256579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023340db-2062-4095-9135-1051534a3d04 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:06.264953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b2461-8052-41bd-89fd-fa5b1f8b5cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:06.265622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b2461-8052-41bd-89fd-fa5b1f8b5cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:06.265901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b2461-8052-41bd-89fd-fa5b1f8b5cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:06.266790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b2461-8052-41bd-89fd-fa5b1f8b5cae admin admin] PATH_INFO: `/v3/projects/42278fe3ce894826b10ccfcca931b310` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:06.269067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b2461-8052-41bd-89fd-fa5b1f8b5cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=42278fe3ce894826b10ccfcca931b310)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:06.275934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b2461-8052-41bd-89fd-fa5b1f8b5cae admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:06.390103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-916b2461-8052-41bd-89fd-fa5b1f8b5cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42278fe3ce894826b10ccfcca931b310', 'request_id': 'req-916b2461-8052-41bd-89fd-fa5b1f8b5cae'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:06.400133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-916b2461-8052-41bd-89fd-fa5b1f8b5cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42278fe3ce894826b10ccfcca931b310', 'request_id': 'req-916b2461-8052-41bd-89fd-fa5b1f8b5cae'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:06.445035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-916b2461-8052-41bd-89fd-fa5b1f8b5cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42278fe3ce894826b10ccfcca931b310', 'request_id': 'req-916b2461-8052-41bd-89fd-fa5b1f8b5cae'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:06.497004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-916b2461-8052-41bd-89fd-fa5b1f8b5cae admin admin] The token cache is being invalidate because project 42278fe3ce894826b10ccfcca931b310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:37:06.497303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-916b2461-8052-41bd-89fd-fa5b1f8b5cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:06.499947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-916b2461-8052-41bd-89fd-fa5b1f8b5cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:06.510869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519529b1-6088-4a1b-8e30-fb6195d664b1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:06.511225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519529b1-6088-4a1b-8e30-fb6195d664b1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:06.511543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519529b1-6088-4a1b-8e30-fb6195d664b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:06.520092 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3825/7705] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:37:06 2022] DELETE /identity/v3/projects/42278fe3ce894826b10ccfcca931b310 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:06.564294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-519529b1-6088-4a1b-8e30-fb6195d664b1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:06.565482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-519529b1-6088-4a1b-8e30-fb6195d664b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:06.711370 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3881/7706] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:06.720996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77faa1-5b30-4771-a338-3ac653549887 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:06.721577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77faa1-5b30-4771-a338-3ac653549887 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:06.721719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77faa1-5b30-4771-a338-3ac653549887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:06.732260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519529b1-6088-4a1b-8e30-fb6195d664b1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:06.739480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-519529b1-6088-4a1b-8e30-fb6195d664b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:06.748923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3c77faa1-5b30-4771-a338-3ac653549887 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:06.751265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3c77faa1-5b30-4771-a338-3ac653549887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:06.761295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519529b1-6088-4a1b-8e30-fb6195d664b1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:06.767630 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3826/7707] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:37:06.773195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:06.773357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77faa1-5b30-4771-a338-3ac653549887 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:06.774040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:06.774417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:06.774860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] PATH_INFO: `/v3/projects/3287e63e7f62492aaf1287f5de795cf6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:06.776220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3287e63e7f62492aaf1287f5de795cf6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:06.778251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:06.797513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77faa1-5b30-4771-a338-3ac653549887 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:06.826523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b52ed0-7d16-47d5-aab0-512b312d95f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:06.828561 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b52ed0-7d16-47d5-aab0-512b312d95f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:06.828744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b52ed0-7d16-47d5-aab0-512b312d95f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:06.829022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b52ed0-7d16-47d5-aab0-512b312d95f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:06.829720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b52ed0-7d16-47d5-aab0-512b312d95f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:37:06.832502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b52ed0-7d16-47d5-aab0-512b312d95f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:06.834578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b52ed0-7d16-47d5-aab0-512b312d95f6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:06.859497 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3827/7708] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:37:06.864052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b52ed0-7d16-47d5-aab0-512b312d95f6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:06.908463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b52ed0-7d16-47d5-aab0-512b312d95f6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:06.925968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3287e63e7f62492aaf1287f5de795cf6', 'request_id': 'req-1af82f6d-a66c-4bcc-a578-247ba8cc2018'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:06.942372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3287e63e7f62492aaf1287f5de795cf6', 'request_id': 'req-1af82f6d-a66c-4bcc-a578-247ba8cc2018'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:06.963253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3287e63e7f62492aaf1287f5de795cf6', 'request_id': 'req-1af82f6d-a66c-4bcc-a578-247ba8cc2018'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:07.035009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] The token cache is being invalidate because project 3287e63e7f62492aaf1287f5de795cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:37:07.036108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:07.044081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20531f3f-0f48-4b6c-996e-6bd903039566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:07.044961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20531f3f-0f48-4b6c-996e-6bd903039566 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:07.045969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20531f3f-0f48-4b6c-996e-6bd903039566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:07.048080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20531f3f-0f48-4b6c-996e-6bd903039566 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:07.048512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:07.048893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20531f3f-0f48-4b6c-996e-6bd903039566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:07.054081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20531f3f-0f48-4b6c-996e-6bd903039566 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:07.054664 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3882/7709] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:37:06 2022] DELETE /identity/v3/projects/3287e63e7f62492aaf1287f5de795cf6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:37:07.059425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:07.063173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:07.084505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af82f6d-a66c-4bcc-a578-247ba8cc2018 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:07.099086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:07.100260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:07.100766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:07.101247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] PATH_INFO: `/v3/users/ff1936f04d8044ce90715d3470381a88` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:07.103722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1936f04d8044ce90715d3470381a88)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:07.106549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:07.121967 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3828/7710] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:37:06 2022] POST /identity/v3/projects => generated 373 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:37:07.122964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20531f3f-0f48-4b6c-996e-6bd903039566 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:07.126888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-20531f3f-0f48-4b6c-996e-6bd903039566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:07.129209 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:07.154669 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:07.207413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1936f04d8044ce90715d3470381a88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:07.209061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1936f04d8044ce90715d3470381a88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:07.228200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1936f04d8044ce90715d3470381a88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:07.238286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1936f04d8044ce90715d3470381a88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:07.239683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1936f04d8044ce90715d3470381a88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:07.266098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20531f3f-0f48-4b6c-996e-6bd903039566 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:07.277949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99e9e3-47ce-4f53-bc95-59835dab348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:07.278585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99e9e3-47ce-4f53-bc95-59835dab348c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:07.278865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99e9e3-47ce-4f53-bc95-59835dab348c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:07.279164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99e9e3-47ce-4f53-bc95-59835dab348c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:07.279928 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99e9e3-47ce-4f53-bc95-59835dab348c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:07.281886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99e9e3-47ce-4f53-bc95-59835dab348c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:07.290057 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3883/7711] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:37:07 2022] DELETE /identity/v3/users/ff1936f04d8044ce90715d3470381a88 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:07.345053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:07.346981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:07.348401 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3829/7712] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:37:07 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:07.499831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5810716-e8f3-4821-a5f7-a72d86b04023 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:07.506579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779404a-05b1-47d3-89a5-22c3d48132c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:07.507627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779404a-05b1-47d3-89a5-22c3d48132c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:07.507627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779404a-05b1-47d3-89a5-22c3d48132c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:07.507919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779404a-05b1-47d3-89a5-22c3d48132c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:07.508622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779404a-05b1-47d3-89a5-22c3d48132c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:07.510619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779404a-05b1-47d3-89a5-22c3d48132c3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:07.528882 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3884/7713] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:07.531938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99e9e3-47ce-4f53-bc95-59835dab348c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:07.548783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99e9e3-47ce-4f53-bc95-59835dab348c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:07.562709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938a70-6c42-4f03-a4fb-d96dcb5799c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:07.563621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938a70-6c42-4f03-a4fb-d96dcb5799c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:07.564052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938a70-6c42-4f03-a4fb-d96dcb5799c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:07.564470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938a70-6c42-4f03-a4fb-d96dcb5799c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:07.565427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65938a70-6c42-4f03-a4fb-d96dcb5799c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:07.567235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65938a70-6c42-4f03-a4fb-d96dcb5799c2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:07.595704 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3830/7714] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:07.599986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779404a-05b1-47d3-89a5-22c3d48132c3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:07.615613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779404a-05b1-47d3-89a5-22c3d48132c3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:07.628805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8826eb0-193f-4ba3-9a9c-1785f3d215eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:07.630903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8826eb0-193f-4ba3-9a9c-1785f3d215eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:07.631362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8826eb0-193f-4ba3-9a9c-1785f3d215eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:07.632533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8826eb0-193f-4ba3-9a9c-1785f3d215eb admin admin] PATH_INFO: `/v3/projects/b24b295fa68544209069d621d058187e/users/8a4ee7f9ed494c0aae51a38f4022d1cd/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:07.677883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8826eb0-193f-4ba3-9a9c-1785f3d215eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24b295fa68544209069d621d058187e, user_id=8a4ee7f9ed494c0aae51a38f4022d1cd, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:07.681416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8826eb0-193f-4ba3-9a9c-1785f3d215eb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:07.708298 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3885/7715] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:07 2022] PUT /identity/v3/projects/b24b295fa68544209069d621d058187e/users/8a4ee7f9ed494c0aae51a38f4022d1cd/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:07.713333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9374-fe87-4846-b32a-c2100f9953fc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:07.713454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9374-fe87-4846-b32a-c2100f9953fc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:07.713641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9374-fe87-4846-b32a-c2100f9953fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:07.749458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b51f9374-fe87-4846-b32a-c2100f9953fc None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:07.752666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b51f9374-fe87-4846-b32a-c2100f9953fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:07.902130 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3831/7716] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:07.912646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8826eb0-193f-4ba3-9a9c-1785f3d215eb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:07.916085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c8826eb0-193f-4ba3-9a9c-1785f3d215eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:07.947986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f9374-fe87-4846-b32a-c2100f9953fc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:07.949476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b51f9374-fe87-4846-b32a-c2100f9953fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:07.984847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f9374-fe87-4846-b32a-c2100f9953fc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:07.990440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e1843-81a6-4597-81a5-9e9f59775b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:07.991122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e1843-81a6-4597-81a5-9e9f59775b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:07.991405 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e1843-81a6-4597-81a5-9e9f59775b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:07.992424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e1843-81a6-4597-81a5-9e9f59775b7a admin admin] PATH_INFO: `/v3/projects/9e3639ba91d443b0a1852473b760fea5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:07.993690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e1843-81a6-4597-81a5-9e9f59775b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3639ba91d443b0a1852473b760fea5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:07.995740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e1843-81a6-4597-81a5-9e9f59775b7a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:08.055391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8826eb0-193f-4ba3-9a9c-1785f3d215eb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:08.071336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cf4e1843-81a6-4597-81a5-9e9f59775b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3639ba91d443b0a1852473b760fea5', 'request_id': 'req-cf4e1843-81a6-4597-81a5-9e9f59775b7a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:08.075528 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:08.083023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cf4e1843-81a6-4597-81a5-9e9f59775b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3639ba91d443b0a1852473b760fea5', 'request_id': 'req-cf4e1843-81a6-4597-81a5-9e9f59775b7a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:08.098403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cf4e1843-81a6-4597-81a5-9e9f59775b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3639ba91d443b0a1852473b760fea5', 'request_id': 'req-cf4e1843-81a6-4597-81a5-9e9f59775b7a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:08.121752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cf4e1843-81a6-4597-81a5-9e9f59775b7a admin admin] The token cache is being invalidate because project 9e3639ba91d443b0a1852473b760fea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:37:08.121752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cf4e1843-81a6-4597-81a5-9e9f59775b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:08.123087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cf4e1843-81a6-4597-81a5-9e9f59775b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:08.125729 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3832/7717] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:37:07 2022] DELETE /identity/v3/projects/9e3639ba91d443b0a1852473b760fea5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:08.130195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5080-c3e4-4135-85e5-4f395d3990e1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:08.130756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5080-c3e4-4135-85e5-4f395d3990e1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:08.131203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5080-c3e4-4135-85e5-4f395d3990e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:08.134843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ba5c9-36fd-4837-80d7-fadf57b804b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:08.135641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ba5c9-36fd-4837-80d7-fadf57b804b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:08.136144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ba5c9-36fd-4837-80d7-fadf57b804b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:08.136598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ba5c9-36fd-4837-80d7-fadf57b804b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:08.138743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ab3ba5c9-36fd-4837-80d7-fadf57b804b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:08.155851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f84d5080-c3e4-4135-85e5-4f395d3990e1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:08.157347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f84d5080-c3e4-4135-85e5-4f395d3990e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:08.168552 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:08.220290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ba5c9-36fd-4837-80d7-fadf57b804b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:08.222086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ba5c9-36fd-4837-80d7-fadf57b804b0 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:08.246464 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3886/7718] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:08.265883 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3833/7719] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:08.266619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42a303-123c-4df7-ad35-5d95e26132a4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:08.267168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42a303-123c-4df7-ad35-5d95e26132a4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:08.267632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42a303-123c-4df7-ad35-5d95e26132a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:08.293794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3d42a303-123c-4df7-ad35-5d95e26132a4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:08.295136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3d42a303-123c-4df7-ad35-5d95e26132a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:08.306007 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3887/7720] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:08.310000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d5080-c3e4-4135-85e5-4f395d3990e1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:08.322222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d5080-c3e4-4135-85e5-4f395d3990e1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:08.327156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bccda1-2ef7-4da1-8b1b-80c6b78f555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:08.327845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bccda1-2ef7-4da1-8b1b-80c6b78f555c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:08.328119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bccda1-2ef7-4da1-8b1b-80c6b78f555c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:08.328432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bccda1-2ef7-4da1-8b1b-80c6b78f555c admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:08.329079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bccda1-2ef7-4da1-8b1b-80c6b78f555c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:37:08.329377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bccda1-2ef7-4da1-8b1b-80c6b78f555c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:08.331406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bccda1-2ef7-4da1-8b1b-80c6b78f555c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:08.352443 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3834/7721] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:37:08.353619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42a303-123c-4df7-ad35-5d95e26132a4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:08.364959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42a303-123c-4df7-ad35-5d95e26132a4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:08.370450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4dd46-c4bc-46b0-ad6e-e8b5daf84331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:08.371469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4dd46-c4bc-46b0-ad6e-e8b5daf84331 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:08.371707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4dd46-c4bc-46b0-ad6e-e8b5daf84331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:08.372122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4dd46-c4bc-46b0-ad6e-e8b5daf84331 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:08.372778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4dd46-c4bc-46b0-ad6e-e8b5daf84331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:08.375112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4dd46-c4bc-46b0-ad6e-e8b5daf84331 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:08.414407 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3888/7722] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:37:08 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:08.415772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bccda1-2ef7-4da1-8b1b-80c6b78f555c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:08.429410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bccda1-2ef7-4da1-8b1b-80c6b78f555c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:08.547946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123008fa-bac4-4063-b7e6-eb2aeb1f0cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:08.548781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123008fa-bac4-4063-b7e6-eb2aeb1f0cfa admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:08.549169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123008fa-bac4-4063-b7e6-eb2aeb1f0cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:08.549472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123008fa-bac4-4063-b7e6-eb2aeb1f0cfa admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:08.550310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123008fa-bac4-4063-b7e6-eb2aeb1f0cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:08.553899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123008fa-bac4-4063-b7e6-eb2aeb1f0cfa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:08.586987 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3835/7723] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:37:08 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:08.591091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4dd46-c4bc-46b0-ad6e-e8b5daf84331 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:08.610433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4dd46-c4bc-46b0-ad6e-e8b5daf84331 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:08.635563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f994b69-52a0-4727-99ad-1397d8f22caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:08.637037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f994b69-52a0-4727-99ad-1397d8f22caf admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:08.637471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f994b69-52a0-4727-99ad-1397d8f22caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:08.638164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f994b69-52a0-4727-99ad-1397d8f22caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:08.639512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f994b69-52a0-4727-99ad-1397d8f22caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:08.641545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f994b69-52a0-4727-99ad-1397d8f22caf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:08.657443 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3889/7724] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:08.660968 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123008fa-bac4-4063-b7e6-eb2aeb1f0cfa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:08.674641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123008fa-bac4-4063-b7e6-eb2aeb1f0cfa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:08.690452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d0967-3849-4098-a8df-53e680cd7674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:08.691117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0967-3849-4098-a8df-53e680cd7674 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:08.691402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0967-3849-4098-a8df-53e680cd7674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:08.691675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0967-3849-4098-a8df-53e680cd7674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:08.692326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d0967-3849-4098-a8df-53e680cd7674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:08.693943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d0967-3849-4098-a8df-53e680cd7674 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:08.725287 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3836/7725] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:08.727063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f994b69-52a0-4727-99ad-1397d8f22caf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:08.742220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f994b69-52a0-4727-99ad-1397d8f22caf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:08.755399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd8dde-d8fa-4738-9e06-4280e805508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:08.756087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd8dde-d8fa-4738-9e06-4280e805508b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:08.756371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd8dde-d8fa-4738-9e06-4280e805508b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:08.756648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd8dde-d8fa-4738-9e06-4280e805508b admin admin] PATH_INFO: `/v3/projects/28f58e1e48b4471a8baf2391d4f0bb64/users/f31248c467824addb1b84b8494a04fa0/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:08.788655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd8dde-d8fa-4738-9e06-4280e805508b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f58e1e48b4471a8baf2391d4f0bb64, user_id=f31248c467824addb1b84b8494a04fa0, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:08.791278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd8dde-d8fa-4738-9e06-4280e805508b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:08.867630 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3890/7726] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:08 2022] PUT /identity/v3/projects/28f58e1e48b4471a8baf2391d4f0bb64/users/f31248c467824addb1b84b8494a04fa0/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:08.875110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393260e3-4211-4167-8841-e05754943a85 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:08.875588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393260e3-4211-4167-8841-e05754943a85 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:08.875781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393260e3-4211-4167-8841-e05754943a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:08.972211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-393260e3-4211-4167-8841-e05754943a85 None None] MFA Rules not processed for user `f31248c467824addb1b84b8494a04fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:08.975251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-393260e3-4211-4167-8841-e05754943a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:09.088833 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3837/7727] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:37:09.092922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd8dde-d8fa-4738-9e06-4280e805508b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:09.212479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd8dde-d8fa-4738-9e06-4280e805508b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:09.221133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6dac6-c7a9-47ac-b8bc-3ea956aafdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:09.222595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6dac6-c7a9-47ac-b8bc-3ea956aafdb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:09.223279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6dac6-c7a9-47ac-b8bc-3ea956aafdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:09.223714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6dac6-c7a9-47ac-b8bc-3ea956aafdb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:09.224509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6dac6-c7a9-47ac-b8bc-3ea956aafdb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:09.227222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6dac6-c7a9-47ac-b8bc-3ea956aafdb7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:09.254756 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:09.283666 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3891/7728] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:37:09 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:09.289014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393260e3-4211-4167-8841-e05754943a85 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:09.320608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393260e3-4211-4167-8841-e05754943a85 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:09.331727 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:09.430419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8ba8a-3d55-4639-a8d7-79b6dfe6034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:09.431083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8ba8a-3d55-4639-a8d7-79b6dfe6034f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:09.431472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8ba8a-3d55-4639-a8d7-79b6dfe6034f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:09.431813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8ba8a-3d55-4639-a8d7-79b6dfe6034f admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:09.432493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8ba8a-3d55-4639-a8d7-79b6dfe6034f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:09.434781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8ba8a-3d55-4639-a8d7-79b6dfe6034f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:09.490969 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3838/7729] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:37:09 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:09.496100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6dac6-c7a9-47ac-b8bc-3ea956aafdb7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:09.511752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6dac6-c7a9-47ac-b8bc-3ea956aafdb7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:09.523307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80ef4d-5cab-4ec1-a548-5249a8118402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:09.524162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80ef4d-5cab-4ec1-a548-5249a8118402 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:09.524562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80ef4d-5cab-4ec1-a548-5249a8118402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:09.525960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80ef4d-5cab-4ec1-a548-5249a8118402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:09.525960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80ef4d-5cab-4ec1-a548-5249a8118402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:09.529477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80ef4d-5cab-4ec1-a548-5249a8118402 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:09.541004 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3892/7730] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:09.560382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8ba8a-3d55-4639-a8d7-79b6dfe6034f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:09.574649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8ba8a-3d55-4639-a8d7-79b6dfe6034f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:09.609949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180f766-5e1f-448f-85f5-8e9bf33133b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:09.610604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180f766-5e1f-448f-85f5-8e9bf33133b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:09.610890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180f766-5e1f-448f-85f5-8e9bf33133b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:09.611236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180f766-5e1f-448f-85f5-8e9bf33133b6 admin admin] PATH_INFO: `/v3/projects/e37df2bf60cc446482c971a0a1757483/users/9d10863388d04783997208494981b320/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:09.646137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180f766-5e1f-448f-85f5-8e9bf33133b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37df2bf60cc446482c971a0a1757483, user_id=9d10863388d04783997208494981b320, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:09.650004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180f766-5e1f-448f-85f5-8e9bf33133b6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:09.675651 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3839/7731] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:09 2022] PUT /identity/v3/projects/e37df2bf60cc446482c971a0a1757483/users/9d10863388d04783997208494981b320/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:09.679746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80ef4d-5cab-4ec1-a548-5249a8118402 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:09.692198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80ef4d-5cab-4ec1-a548-5249a8118402 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:09.813519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4d657-e941-4547-918e-e700cdf44ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:09.814822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4d657-e941-4547-918e-e700cdf44ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:09.815348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4d657-e941-4547-918e-e700cdf44ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:09.816341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4d657-e941-4547-918e-e700cdf44ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:09.816685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4d657-e941-4547-918e-e700cdf44ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:09.819721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4d657-e941-4547-918e-e700cdf44ac5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:09.833432 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3893/7732] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:37:09.836938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180f766-5e1f-448f-85f5-8e9bf33133b6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:09.853581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180f766-5e1f-448f-85f5-8e9bf33133b6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:09.865146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828539b-cf53-4f77-a44f-6f79e5deaffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:09.865845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828539b-cf53-4f77-a44f-6f79e5deaffe admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:09.866196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828539b-cf53-4f77-a44f-6f79e5deaffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:09.866801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828539b-cf53-4f77-a44f-6f79e5deaffe admin admin] PATH_INFO: `/v3/projects/e37df2bf60cc446482c971a0a1757483/users/9d10863388d04783997208494981b320/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:09.868871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828539b-cf53-4f77-a44f-6f79e5deaffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37df2bf60cc446482c971a0a1757483, user_id=9d10863388d04783997208494981b320, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:09.871936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828539b-cf53-4f77-a44f-6f79e5deaffe admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:09.890360 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3840/7733] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:09 2022] PUT /identity/v3/projects/e37df2bf60cc446482c971a0a1757483/users/9d10863388d04783997208494981b320/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:09.900598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d85f3-5ace-4652-9aef-62f82371e114 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:09.900904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d85f3-5ace-4652-9aef-62f82371e114 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:09.901152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d85f3-5ace-4652-9aef-62f82371e114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:09.949975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9d1d85f3-5ace-4652-9aef-62f82371e114 None None] MFA Rules not processed for user `9d10863388d04783997208494981b320`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:09.952233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d1d85f3-5ace-4652-9aef-62f82371e114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:10.094812 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3894/7734] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:10.109174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828539b-cf53-4f77-a44f-6f79e5deaffe admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:10.111088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3828539b-cf53-4f77-a44f-6f79e5deaffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:10.218361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828539b-cf53-4f77-a44f-6f79e5deaffe admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:10.226959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f171526-0a52-45f8-bba2-b310d7f55bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:10.227708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f171526-0a52-45f8-bba2-b310d7f55bfe service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:10.228520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f171526-0a52-45f8-bba2-b310d7f55bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:10.228898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f171526-0a52-45f8-bba2-b310d7f55bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:10.253307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f171526-0a52-45f8-bba2-b310d7f55bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:10.257686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f171526-0a52-45f8-bba2-b310d7f55bfe service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:10.298483 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3841/7735] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:11.057224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d85f3-5ace-4652-9aef-62f82371e114 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:11.069737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d85f3-5ace-4652-9aef-62f82371e114 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:11.083539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a25b8-f55c-48d6-a9ab-aee5d6b18187 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d10863388d04783997208494981b320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37df2bf60cc446482c971a0a1757483', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:11.086185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a25b8-f55c-48d6-a9ab-aee5d6b18187 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:11.086631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a25b8-f55c-48d6-a9ab-aee5d6b18187 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:11.086941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a25b8-f55c-48d6-a9ab-aee5d6b18187 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:11.087640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a25b8-f55c-48d6-a9ab-aee5d6b18187 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:37:11.088012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a25b8-f55c-48d6-a9ab-aee5d6b18187 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:11.094651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a25b8-f55c-48d6-a9ab-aee5d6b18187 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:11.138557 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3895/7736] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:37:11.142871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f171526-0a52-45f8-bba2-b310d7f55bfe service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:11.175322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f171526-0a52-45f8-bba2-b310d7f55bfe service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:11.188027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85172a-db1a-4ba5-8d65-17c0446bb96f tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d10863388d04783997208494981b320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37df2bf60cc446482c971a0a1757483', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:11.188651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85172a-db1a-4ba5-8d65-17c0446bb96f tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:11.188937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85172a-db1a-4ba5-8d65-17c0446bb96f tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:11.189208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85172a-db1a-4ba5-8d65-17c0446bb96f tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:11.190033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85172a-db1a-4ba5-8d65-17c0446bb96f tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:11.192144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85172a-db1a-4ba5-8d65-17c0446bb96f tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:11.267823 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3842/7737] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:37:11 2022] POST /identity/v3/projects => generated 354 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:11.271639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a25b8-f55c-48d6-a9ab-aee5d6b18187 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:11.285102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a25b8-f55c-48d6-a9ab-aee5d6b18187 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:11.341110 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:11.359223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87687000-94ed-42a4-9d0e-990a43d59eb9 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d10863388d04783997208494981b320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37df2bf60cc446482c971a0a1757483', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:11.359917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87687000-94ed-42a4-9d0e-990a43d59eb9 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:11.360202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87687000-94ed-42a4-9d0e-990a43d59eb9 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:11.360623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87687000-94ed-42a4-9d0e-990a43d59eb9 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:11.361282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87687000-94ed-42a4-9d0e-990a43d59eb9 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:37:11.361587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87687000-94ed-42a4-9d0e-990a43d59eb9 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:11.363303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87687000-94ed-42a4-9d0e-990a43d59eb9 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:11.377826 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3896/7738] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:37:11.423144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85172a-db1a-4ba5-8d65-17c0446bb96f tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:11.436808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85172a-db1a-4ba5-8d65-17c0446bb96f tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:11.441879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b21974-5217-4142-bd1d-d926e7c20202 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d10863388d04783997208494981b320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e37df2bf60cc446482c971a0a1757483', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:11.443046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b21974-5217-4142-bd1d-d926e7c20202 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:11.443518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b21974-5217-4142-bd1d-d926e7c20202 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:11.444095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b21974-5217-4142-bd1d-d926e7c20202 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] PATH_INFO: `/v3/projects/b44bdbed1c214160aa2c2a513464391d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:11.446323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b21974-5217-4142-bd1d-d926e7c20202 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b44bdbed1c214160aa2c2a513464391d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:11.448600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b21974-5217-4142-bd1d-d926e7c20202 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:11.594603 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:11.621460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-24b21974-5217-4142-bd1d-d926e7c20202 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44bdbed1c214160aa2c2a513464391d', 'request_id': 'req-24b21974-5217-4142-bd1d-d926e7c20202'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:11.650815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-24b21974-5217-4142-bd1d-d926e7c20202 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44bdbed1c214160aa2c2a513464391d', 'request_id': 'req-24b21974-5217-4142-bd1d-d926e7c20202'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:11.668328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-24b21974-5217-4142-bd1d-d926e7c20202 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44bdbed1c214160aa2c2a513464391d', 'request_id': 'req-24b21974-5217-4142-bd1d-d926e7c20202'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:11.684388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-24b21974-5217-4142-bd1d-d926e7c20202 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] The token cache is being invalidate because project b44bdbed1c214160aa2c2a513464391d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:37:11.684742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-24b21974-5217-4142-bd1d-d926e7c20202 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:11.687062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-24b21974-5217-4142-bd1d-d926e7c20202 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:11.692552 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3843/7739] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:37:11 2022] DELETE /identity/v3/projects/b44bdbed1c214160aa2c2a513464391d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:12.177073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87687000-94ed-42a4-9d0e-990a43d59eb9 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:12.178891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-87687000-94ed-42a4-9d0e-990a43d59eb9 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:12.352474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87687000-94ed-42a4-9d0e-990a43d59eb9 tempest-VolumeQuotaClassesTest-1653636433 tempest-VolumeQuotaClassesTest-1653636433-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:12.464909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:12.466185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:12.466604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:12.467884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] PATH_INFO: `/v3/users/f31248c467824addb1b84b8494a04fa0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:12.471303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31248c467824addb1b84b8494a04fa0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:12.473496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:12.612584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31248c467824addb1b84b8494a04fa0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:12.618104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31248c467824addb1b84b8494a04fa0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:12.638064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31248c467824addb1b84b8494a04fa0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:12.648349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31248c467824addb1b84b8494a04fa0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:12.649227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31248c467824addb1b84b8494a04fa0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:12.685375 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3897/7740] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:37:12 2022] DELETE /identity/v3/users/f31248c467824addb1b84b8494a04fa0 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:12.685682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b82e-fd09-47a7-8292-dd9bb9d7f4d7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:12.686665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b82e-fd09-47a7-8292-dd9bb9d7f4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:12.687140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b82e-fd09-47a7-8292-dd9bb9d7f4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:12.723295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3920b82e-fd09-47a7-8292-dd9bb9d7f4d7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:12.726404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3920b82e-fd09-47a7-8292-dd9bb9d7f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:12.850965 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3844/7741] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:37:12.859356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:12.863863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:12.880290 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:13.003062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d3203-83f6-464b-8bea-6be24e476c05 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:13.012131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1477fe3-0632-4d3d-9026-4379091696fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:13.012769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1477fe3-0632-4d3d-9026-4379091696fa service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:13.013053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1477fe3-0632-4d3d-9026-4379091696fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:13.013330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1477fe3-0632-4d3d-9026-4379091696fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:13.042720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1477fe3-0632-4d3d-9026-4379091696fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:13.044874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1477fe3-0632-4d3d-9026-4379091696fa service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:13.066092 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3898/7742] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:14.031508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920b82e-fd09-47a7-8292-dd9bb9d7f4d7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:14.034087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3920b82e-fd09-47a7-8292-dd9bb9d7f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:14.083486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920b82e-fd09-47a7-8292-dd9bb9d7f4d7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:14.112993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:14.126702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:14.127099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:14.130681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] PATH_INFO: `/v3/projects/28f58e1e48b4471a8baf2391d4f0bb64` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:14.146382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f58e1e48b4471a8baf2391d4f0bb64)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:14.152537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:14.375227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f58e1e48b4471a8baf2391d4f0bb64', 'request_id': 'req-ef0268d1-077a-4030-856b-3982e3fb4c01'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:14.402363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f58e1e48b4471a8baf2391d4f0bb64', 'request_id': 'req-ef0268d1-077a-4030-856b-3982e3fb4c01'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:14.441915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f58e1e48b4471a8baf2391d4f0bb64', 'request_id': 'req-ef0268d1-077a-4030-856b-3982e3fb4c01'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:14.493517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] The token cache is being invalidate because project 28f58e1e48b4471a8baf2391d4f0bb64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:37:14.494777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:14.497089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:14.503203 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3845/7743] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:37:14 2022] DELETE /identity/v3/projects/28f58e1e48b4471a8baf2391d4f0bb64 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:14.507771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1477fe3-0632-4d3d-9026-4379091696fa service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:14.524196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1477fe3-0632-4d3d-9026-4379091696fa service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:14.729619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893fb61-2d01-492c-a2c6-399c2e396973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:14.731050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893fb61-2d01-492c-a2c6-399c2e396973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:14.731394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893fb61-2d01-492c-a2c6-399c2e396973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:14.731680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893fb61-2d01-492c-a2c6-399c2e396973 admin admin] PATH_INFO: `/v3/users/9d10863388d04783997208494981b320` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:14.734403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893fb61-2d01-492c-a2c6-399c2e396973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d10863388d04783997208494981b320)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:14.736465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893fb61-2d01-492c-a2c6-399c2e396973 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:14.840531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0893fb61-2d01-492c-a2c6-399c2e396973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d10863388d04783997208494981b320'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:14.841423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0893fb61-2d01-492c-a2c6-399c2e396973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d10863388d04783997208494981b320'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:14.871489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0893fb61-2d01-492c-a2c6-399c2e396973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d10863388d04783997208494981b320'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:14.887653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0893fb61-2d01-492c-a2c6-399c2e396973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d10863388d04783997208494981b320'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:14.888464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0893fb61-2d01-492c-a2c6-399c2e396973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d10863388d04783997208494981b320'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:14.913834 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3899/7744] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:37:14 2022] DELETE /identity/v3/users/9d10863388d04783997208494981b320 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:15.550070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:15.551722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:15.605957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0268d1-077a-4030-856b-3982e3fb4c01 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:15.701001 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:15.716906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:15.718634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:15.719533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:15.719914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5 admin admin] PATH_INFO: `/v3/projects/e37df2bf60cc446482c971a0a1757483` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:15.721138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37df2bf60cc446482c971a0a1757483)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:15.723153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:15.801593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37df2bf60cc446482c971a0a1757483', 'request_id': 'req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:15.811818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37df2bf60cc446482c971a0a1757483', 'request_id': 'req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:15.825741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37df2bf60cc446482c971a0a1757483', 'request_id': 'req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:15.846182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5 admin admin] The token cache is being invalidate because project e37df2bf60cc446482c971a0a1757483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:37:15.846834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:15.847748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6c94955d-566b-46fd-9b5f-ab29cdcda5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:15.849668 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3846/7745] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:37:15 2022] DELETE /identity/v3/projects/e37df2bf60cc446482c971a0a1757483 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:15.854870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d1b45-653a-473b-89ed-a68142cf5354 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:15.855606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d1b45-653a-473b-89ed-a68142cf5354 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:15.855977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d1b45-653a-473b-89ed-a68142cf5354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:15.896777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e46d1b45-653a-473b-89ed-a68142cf5354 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:15.898317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e46d1b45-653a-473b-89ed-a68142cf5354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:15.951330 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:16.052737 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3900/7746] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:16.054729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0817355-9a57-4b92-94c5-62d08f8e10f8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:16.055261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0817355-9a57-4b92-94c5-62d08f8e10f8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:16.055770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0817355-9a57-4b92-94c5-62d08f8e10f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:16.083710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e0817355-9a57-4b92-94c5-62d08f8e10f8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:16.085522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e0817355-9a57-4b92-94c5-62d08f8e10f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:16.110783 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3847/7747] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:16.115265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d1b45-653a-473b-89ed-a68142cf5354 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:16.131938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d1b45-653a-473b-89ed-a68142cf5354 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:16.143920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fc18e-e509-44fb-a645-074cf042e92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:16.144880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fc18e-e509-44fb-a645-074cf042e92d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:16.145644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fc18e-e509-44fb-a645-074cf042e92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:16.146116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fc18e-e509-44fb-a645-074cf042e92d admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:16.147042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fc18e-e509-44fb-a645-074cf042e92d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:37:16.147565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fc18e-e509-44fb-a645-074cf042e92d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:16.149384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fc18e-e509-44fb-a645-074cf042e92d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:16.175812 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3901/7748] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:37:16.181394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0817355-9a57-4b92-94c5-62d08f8e10f8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:16.195530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0817355-9a57-4b92-94c5-62d08f8e10f8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:16.208714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f458f-4dfc-47f7-a7cd-3d12ecbb6453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:16.209787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f458f-4dfc-47f7-a7cd-3d12ecbb6453 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:16.210264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f458f-4dfc-47f7-a7cd-3d12ecbb6453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:16.210746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f458f-4dfc-47f7-a7cd-3d12ecbb6453 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:16.211628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f458f-4dfc-47f7-a7cd-3d12ecbb6453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:16.213919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f458f-4dfc-47f7-a7cd-3d12ecbb6453 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:16.271015 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3848/7749] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:37:16 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:16.275066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fc18e-e509-44fb-a645-074cf042e92d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:16.290892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fc18e-e509-44fb-a645-074cf042e92d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:16.502685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71e057-f385-4ec7-9453-592e286ef3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:16.503623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71e057-f385-4ec7-9453-592e286ef3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:16.504374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71e057-f385-4ec7-9453-592e286ef3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:16.504374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71e057-f385-4ec7-9453-592e286ef3a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:16.505012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71e057-f385-4ec7-9453-592e286ef3a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:16.507331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71e057-f385-4ec7-9453-592e286ef3a2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:16.598172 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3902/7750] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:37:16 2022] POST /identity/v3/users => generated 288 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:16.599705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f458f-4dfc-47f7-a7cd-3d12ecbb6453 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:16.614746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f458f-4dfc-47f7-a7cd-3d12ecbb6453 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:16.627736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a2572-b80a-4def-a4a2-3306d2ca0be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:16.628774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a2572-b80a-4def-a4a2-3306d2ca0be4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:16.629058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a2572-b80a-4def-a4a2-3306d2ca0be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:16.629340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a2572-b80a-4def-a4a2-3306d2ca0be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:16.630249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a2572-b80a-4def-a4a2-3306d2ca0be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:16.633752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a2572-b80a-4def-a4a2-3306d2ca0be4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:16.684920 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3849/7751] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:16.689737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71e057-f385-4ec7-9453-592e286ef3a2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:16.709891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71e057-f385-4ec7-9453-592e286ef3a2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:16.729976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b0f75-2b9b-4922-849c-b1df9f4ac348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:16.730603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b0f75-2b9b-4922-849c-b1df9f4ac348 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:16.730886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b0f75-2b9b-4922-849c-b1df9f4ac348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:16.731479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b0f75-2b9b-4922-849c-b1df9f4ac348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:16.732142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b0f75-2b9b-4922-849c-b1df9f4ac348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:16.733810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b0f75-2b9b-4922-849c-b1df9f4ac348 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:16.770589 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3903/7752] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:16.771596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a2572-b80a-4def-a4a2-3306d2ca0be4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:16.785735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a2572-b80a-4def-a4a2-3306d2ca0be4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:16.806399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79974d77-095c-4e5b-b624-bd47898e0801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:16.807261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79974d77-095c-4e5b-b624-bd47898e0801 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:16.807541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79974d77-095c-4e5b-b624-bd47898e0801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:16.807817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79974d77-095c-4e5b-b624-bd47898e0801 admin admin] PATH_INFO: `/v3/projects/1bd449a909f0405ea21df393db3f7bb5/users/1c54d463d9194d01ba2923168afd0af7/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:16.813609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac419-a969-4f40-bb0c-2047dd240468 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:16.813897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac419-a969-4f40-bb0c-2047dd240468 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:16.814188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac419-a969-4f40-bb0c-2047dd240468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:16.867232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79974d77-095c-4e5b-b624-bd47898e0801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd449a909f0405ea21df393db3f7bb5, user_id=1c54d463d9194d01ba2923168afd0af7, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:16.882698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79974d77-095c-4e5b-b624-bd47898e0801 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:16.894809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dc7ac419-a969-4f40-bb0c-2047dd240468 None None] MFA Rules not processed for user `8a4ee7f9ed494c0aae51a38f4022d1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:16.897767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dc7ac419-a969-4f40-bb0c-2047dd240468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:16.917126 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3850/7753] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:16 2022] PUT /identity/v3/projects/1bd449a909f0405ea21df393db3f7bb5/users/1c54d463d9194d01ba2923168afd0af7/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:37:16.919160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5223-be8b-48c0-8a80-9195dd3e7dff None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:16.919449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5223-be8b-48c0-8a80-9195dd3e7dff None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:16.919723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5223-be8b-48c0-8a80-9195dd3e7dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:16.960552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2e1a5223-be8b-48c0-8a80-9195dd3e7dff None None] MFA Rules not processed for user `1c54d463d9194d01ba2923168afd0af7`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:16.963790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2e1a5223-be8b-48c0-8a80-9195dd3e7dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:17.059431 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3851/7754] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:17.065644 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a5223-be8b-48c0-8a80-9195dd3e7dff None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:17.076022 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:17.101051 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3904/7755] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:17.105230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac419-a969-4f40-bb0c-2047dd240468 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:17.109250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dc7ac419-a969-4f40-bb0c-2047dd240468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:17.204788 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:17.242427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a5223-be8b-48c0-8a80-9195dd3e7dff None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:17.282433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac419-a969-4f40-bb0c-2047dd240468 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:17.283429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e0924-ea9f-4da7-b13a-f80b9190a488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:17.284692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e0924-ea9f-4da7-b13a-f80b9190a488 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:17.287609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e0924-ea9f-4da7-b13a-f80b9190a488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:17.288095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e0924-ea9f-4da7-b13a-f80b9190a488 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:17.288957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e0924-ea9f-4da7-b13a-f80b9190a488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:17.295930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0308089-e10c-4091-a829-b5af12a5c76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:17.296766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e0924-ea9f-4da7-b13a-f80b9190a488 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:17.298802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0308089-e10c-4091-a829-b5af12a5c76b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:17.299832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0308089-e10c-4091-a829-b5af12a5c76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:17.300209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0308089-e10c-4091-a829-b5af12a5c76b admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:17.303786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0308089-e10c-4091-a829-b5af12a5c76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:17.308256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0308089-e10c-4091-a829-b5af12a5c76b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:17.389475 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3852/7756] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:37:17 2022] POST /identity/v3/projects => generated 377 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:17.391200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e0924-ea9f-4da7-b13a-f80b9190a488 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:17.391680 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3905/7757] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:37:17 2022] POST /identity/v3/projects => generated 375 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:17.392789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0308089-e10c-4091-a829-b5af12a5c76b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:17.500464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e0924-ea9f-4da7-b13a-f80b9190a488 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:17.502190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0308089-e10c-4091-a829-b5af12a5c76b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:17.506045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a3189-5a3f-4a26-b6c7-3817fcf01036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:17.506701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a3189-5a3f-4a26-b6c7-3817fcf01036 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:17.507061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a3189-5a3f-4a26-b6c7-3817fcf01036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:17.507308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a3189-5a3f-4a26-b6c7-3817fcf01036 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:17.508072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a3189-5a3f-4a26-b6c7-3817fcf01036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:17.509434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158447be-59a8-4c55-bcf9-de7d5eec7db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:17.510011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a3189-5a3f-4a26-b6c7-3817fcf01036 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:17.510725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158447be-59a8-4c55-bcf9-de7d5eec7db5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:17.511251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158447be-59a8-4c55-bcf9-de7d5eec7db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:17.511975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158447be-59a8-4c55-bcf9-de7d5eec7db5 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:17.517760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158447be-59a8-4c55-bcf9-de7d5eec7db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:17.520315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158447be-59a8-4c55-bcf9-de7d5eec7db5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:17.549891 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3853/7758] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:37:17 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:17.554909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a3189-5a3f-4a26-b6c7-3817fcf01036 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:17.563925 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3906/7759] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:37:17 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:17.569084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158447be-59a8-4c55-bcf9-de7d5eec7db5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:17.578786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a3189-5a3f-4a26-b6c7-3817fcf01036 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:17.592658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158447be-59a8-4c55-bcf9-de7d5eec7db5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:17.593436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e2e6b-936a-4344-83a8-089eeb1ef8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:17.594076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e2e6b-936a-4344-83a8-089eeb1ef8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:17.594356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e2e6b-936a-4344-83a8-089eeb1ef8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:17.594629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e2e6b-936a-4344-83a8-089eeb1ef8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:17.595322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e2e6b-936a-4344-83a8-089eeb1ef8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:17.596974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e2e6b-936a-4344-83a8-089eeb1ef8e9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:17.599404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90db18b-6fd8-47a9-92c1-a232ecadf849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:17.600484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90db18b-6fd8-47a9-92c1-a232ecadf849 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:17.601678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90db18b-6fd8-47a9-92c1-a232ecadf849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:17.602399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90db18b-6fd8-47a9-92c1-a232ecadf849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:17.603389 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90db18b-6fd8-47a9-92c1-a232ecadf849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:17.605859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90db18b-6fd8-47a9-92c1-a232ecadf849 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:17.618880 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3854/7760] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:37:17.627763 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3907/7761] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:17.641783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e2e6b-936a-4344-83a8-089eeb1ef8e9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:17.646625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90db18b-6fd8-47a9-92c1-a232ecadf849 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:17.658014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e2e6b-936a-4344-83a8-089eeb1ef8e9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:17.664748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90db18b-6fd8-47a9-92c1-a232ecadf849 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:17.671874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e2c91-d267-4630-85a0-77e40dad5727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:17.672575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2c91-d267-4630-85a0-77e40dad5727 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:17.672841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2c91-d267-4630-85a0-77e40dad5727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:17.673115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2c91-d267-4630-85a0-77e40dad5727 admin admin] PATH_INFO: `/v3/projects/2f9ad54a91194b49823b9b4a704cb546/users/1bced1656a3344968447b4152d7bec15/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:17.673871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ab7c5-efed-4919-b3e2-77ae83771806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:17.674783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ab7c5-efed-4919-b3e2-77ae83771806 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:17.675302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ab7c5-efed-4919-b3e2-77ae83771806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:17.675997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ab7c5-efed-4919-b3e2-77ae83771806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:17.676839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ab7c5-efed-4919-b3e2-77ae83771806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:17.678960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ab7c5-efed-4919-b3e2-77ae83771806 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:17.705224 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3908/7762] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:17.706349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ab7c5-efed-4919-b3e2-77ae83771806 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:17.709556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e2c91-d267-4630-85a0-77e40dad5727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9ad54a91194b49823b9b4a704cb546, user_id=1bced1656a3344968447b4152d7bec15, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:17.712935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e2c91-d267-4630-85a0-77e40dad5727 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:17.725291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ab7c5-efed-4919-b3e2-77ae83771806 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:17.730817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44794dc8-3f3e-4b7f-9387-621f5848575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:17.731537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44794dc8-3f3e-4b7f-9387-621f5848575f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:17.731814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44794dc8-3f3e-4b7f-9387-621f5848575f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:17.732085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44794dc8-3f3e-4b7f-9387-621f5848575f admin admin] PATH_INFO: `/v3/projects/f6f7594b0af6471db497d8d270cc6412/users/17caae92991144cca6a472d1427aaa31/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:17.749006 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3855/7763] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:17 2022] PUT /identity/v3/projects/2f9ad54a91194b49823b9b4a704cb546/users/1bced1656a3344968447b4152d7bec15/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:17.753544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e2c91-d267-4630-85a0-77e40dad5727 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:17.760592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44794dc8-3f3e-4b7f-9387-621f5848575f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f7594b0af6471db497d8d270cc6412, user_id=17caae92991144cca6a472d1427aaa31, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:17.763597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44794dc8-3f3e-4b7f-9387-621f5848575f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:17.828482 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3909/7764] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:17 2022] PUT /identity/v3/projects/f6f7594b0af6471db497d8d270cc6412/users/17caae92991144cca6a472d1427aaa31/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:37:17.838981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae2bd3-c196-4a5c-8754-f3dce8e9f0b7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:17.839265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae2bd3-c196-4a5c-8754-f3dce8e9f0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:17.839657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae2bd3-c196-4a5c-8754-f3dce8e9f0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:17.906993 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:17.928188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0bae2bd3-c196-4a5c-8754-f3dce8e9f0b7 None None] MFA Rules not processed for user `17caae92991144cca6a472d1427aaa31`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:17.929383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0bae2bd3-c196-4a5c-8754-f3dce8e9f0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:17.935502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e2c91-d267-4630-85a0-77e40dad5727 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:18.038485 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:18.046614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d4656-b351-4c8f-9167-ffaac6fb423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:18.050507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d4656-b351-4c8f-9167-ffaac6fb423c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:18.050800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d4656-b351-4c8f-9167-ffaac6fb423c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:18.051950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d4656-b351-4c8f-9167-ffaac6fb423c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:18.052618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d4656-b351-4c8f-9167-ffaac6fb423c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:18.054308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d4656-b351-4c8f-9167-ffaac6fb423c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:18.079407 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3856/7765] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:18.083528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d4656-b351-4c8f-9167-ffaac6fb423c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:18.095078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d4656-b351-4c8f-9167-ffaac6fb423c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:18.099306 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3910/7766] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:18.104011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae2bd3-c196-4a5c-8754-f3dce8e9f0b7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:18.122939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8ceab-4f0c-446c-ad07-7afffd65b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:18.122939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8ceab-4f0c-446c-ad07-7afffd65b837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:18.122939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8ceab-4f0c-446c-ad07-7afffd65b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:18.122939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8ceab-4f0c-446c-ad07-7afffd65b837 admin admin] PATH_INFO: `/v3/projects/2f9ad54a91194b49823b9b4a704cb546/users/1bced1656a3344968447b4152d7bec15/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:18.129287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8ceab-4f0c-446c-ad07-7afffd65b837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9ad54a91194b49823b9b4a704cb546, user_id=1bced1656a3344968447b4152d7bec15, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:18.143774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae2bd3-c196-4a5c-8754-f3dce8e9f0b7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:18.145474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8ceab-4f0c-446c-ad07-7afffd65b837 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:18.155912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958279f4-0dd4-4ae2-b742-1ec0a6230681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:18.157803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958279f4-0dd4-4ae2-b742-1ec0a6230681 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:18.159182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958279f4-0dd4-4ae2-b742-1ec0a6230681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:18.159759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958279f4-0dd4-4ae2-b742-1ec0a6230681 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:18.160642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958279f4-0dd4-4ae2-b742-1ec0a6230681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:18.162828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958279f4-0dd4-4ae2-b742-1ec0a6230681 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:18.165397 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3857/7767] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:18 2022] PUT /identity/v3/projects/2f9ad54a91194b49823b9b4a704cb546/users/1bced1656a3344968447b4152d7bec15/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:18.236473 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3911/7768] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:37:18 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:37:18.237689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8ceab-4f0c-446c-ad07-7afffd65b837 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:18.430069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8ceab-4f0c-446c-ad07-7afffd65b837 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:18.621705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed42c2a-0a17-4990-9c31-27ebfb5cc7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:18.622276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed42c2a-0a17-4990-9c31-27ebfb5cc7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:18.622276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed42c2a-0a17-4990-9c31-27ebfb5cc7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:18.622547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed42c2a-0a17-4990-9c31-27ebfb5cc7e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:18.623310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed42c2a-0a17-4990-9c31-27ebfb5cc7e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:18.626158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed42c2a-0a17-4990-9c31-27ebfb5cc7e3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:18.706873 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3858/7769] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:37:18 2022] POST /identity/v3/users => generated 295 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:18.708573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958279f4-0dd4-4ae2-b742-1ec0a6230681 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:18.734726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958279f4-0dd4-4ae2-b742-1ec0a6230681 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:18.755078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d8977-b93b-45c2-938a-cc52cc6bd4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:18.755735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d8977-b93b-45c2-938a-cc52cc6bd4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:18.756028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d8977-b93b-45c2-938a-cc52cc6bd4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:18.756310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d8977-b93b-45c2-938a-cc52cc6bd4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:18.758494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d8977-b93b-45c2-938a-cc52cc6bd4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:18.762429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d8977-b93b-45c2-938a-cc52cc6bd4a3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:18.802177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed42c2a-0a17-4990-9c31-27ebfb5cc7e3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:18.812036 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3912/7770] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:18.818399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed42c2a-0a17-4990-9c31-27ebfb5cc7e3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:18.831795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d6d15-3c40-4c8a-8588-57a583fca4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:18.832589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d6d15-3c40-4c8a-8588-57a583fca4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:18.832949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d6d15-3c40-4c8a-8588-57a583fca4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:18.833229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d6d15-3c40-4c8a-8588-57a583fca4d9 admin admin] PATH_INFO: `/v3/projects/ffdd249c8e6545dc82afb0ffa4849bf2/users/55370724ef0941348494f6b2eb83de8b/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:18.845276 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:18.864012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d6d15-3c40-4c8a-8588-57a583fca4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdd249c8e6545dc82afb0ffa4849bf2, user_id=55370724ef0941348494f6b2eb83de8b, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:18.876494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d6d15-3c40-4c8a-8588-57a583fca4d9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:18.988829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d8977-b93b-45c2-938a-cc52cc6bd4a3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:18.989922 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3859/7771] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:18 2022] PUT /identity/v3/projects/ffdd249c8e6545dc82afb0ffa4849bf2/users/55370724ef0941348494f6b2eb83de8b/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:19.004108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d8977-b93b-45c2-938a-cc52cc6bd4a3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:19.241629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d178b4c-b0ff-4c12-8770-d45323a690b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:19.242272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d178b4c-b0ff-4c12-8770-d45323a690b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:19.242534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d178b4c-b0ff-4c12-8770-d45323a690b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:19.244054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d178b4c-b0ff-4c12-8770-d45323a690b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:19.244699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d178b4c-b0ff-4c12-8770-d45323a690b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:19.250265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d178b4c-b0ff-4c12-8770-d45323a690b8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:19.284962 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3913/7772] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:19.286359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d6d15-3c40-4c8a-8588-57a583fca4d9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:19.298259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d6d15-3c40-4c8a-8588-57a583fca4d9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:19.307451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bef456-6f2c-4dc1-be7f-9b19e6046b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:19.308388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bef456-6f2c-4dc1-be7f-9b19e6046b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:19.309657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bef456-6f2c-4dc1-be7f-9b19e6046b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:19.310976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bef456-6f2c-4dc1-be7f-9b19e6046b48 admin admin] PATH_INFO: `/v3/projects/ffdd249c8e6545dc82afb0ffa4849bf2/users/55370724ef0941348494f6b2eb83de8b/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:19.318029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bef456-6f2c-4dc1-be7f-9b19e6046b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdd249c8e6545dc82afb0ffa4849bf2, user_id=55370724ef0941348494f6b2eb83de8b, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:19.325911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bef456-6f2c-4dc1-be7f-9b19e6046b48 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:19.358851 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3860/7773] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:19 2022] PUT /identity/v3/projects/ffdd249c8e6545dc82afb0ffa4849bf2/users/55370724ef0941348494f6b2eb83de8b/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:19.359936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c61c9f-8147-4fb8-8618-438abd14b342 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:19.360300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c61c9f-8147-4fb8-8618-438abd14b342 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:19.360554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c61c9f-8147-4fb8-8618-438abd14b342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:19.420985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-22c61c9f-8147-4fb8-8618-438abd14b342 None None] MFA Rules not processed for user `55370724ef0941348494f6b2eb83de8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:19.423440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22c61c9f-8147-4fb8-8618-438abd14b342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:19.616448 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3914/7774] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:19.847199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bef456-6f2c-4dc1-be7f-9b19e6046b48 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:19.849698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-74bef456-6f2c-4dc1-be7f-9b19e6046b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:19.990298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bef456-6f2c-4dc1-be7f-9b19e6046b48 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:20.012963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0844b92-a982-4f04-85ea-14b05cffc4ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:20.013730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0844b92-a982-4f04-85ea-14b05cffc4ac service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:20.014681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0844b92-a982-4f04-85ea-14b05cffc4ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:20.017192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0844b92-a982-4f04-85ea-14b05cffc4ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:20.167224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0844b92-a982-4f04-85ea-14b05cffc4ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:20.171310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0844b92-a982-4f04-85ea-14b05cffc4ac service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:20.206507 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3861/7775] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:25.293113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c61c9f-8147-4fb8-8618-438abd14b342 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:25.313991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c61c9f-8147-4fb8-8618-438abd14b342 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:25.332420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e305531-f762-4d91-81c2-9d9b43334131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:25.334126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e305531-f762-4d91-81c2-9d9b43334131 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:25.335861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e305531-f762-4d91-81c2-9d9b43334131 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:25.336242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e305531-f762-4d91-81c2-9d9b43334131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:25.456829 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:25.545886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e305531-f762-4d91-81c2-9d9b43334131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:25.550968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e305531-f762-4d91-81c2-9d9b43334131 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:25.591585 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3915/7776] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:28.670729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb2233-1401-454e-a247-83b38b6cb2d2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:28.671645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb2233-1401-454e-a247-83b38b6cb2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:28.671920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb2233-1401-454e-a247-83b38b6cb2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:28.744081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-06bb2233-1401-454e-a247-83b38b6cb2d2 None None] MFA Rules not processed for user `1bced1656a3344968447b4152d7bec15`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:28.745291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-06bb2233-1401-454e-a247-83b38b6cb2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:28.939639 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3862/7777] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:28.953629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e305531-f762-4d91-81c2-9d9b43334131 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:28.954180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2e305531-f762-4d91-81c2-9d9b43334131 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:29.081774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e305531-f762-4d91-81c2-9d9b43334131 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:29.088640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62c1d-c3e3-460e-bdf4-4b670b748b8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:29.089330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62c1d-c3e3-460e-bdf4-4b670b748b8a service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:29.089911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62c1d-c3e3-460e-bdf4-4b670b748b8a service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:29.090264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62c1d-c3e3-460e-bdf4-4b670b748b8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:29.101568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d62c1d-c3e3-460e-bdf4-4b670b748b8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:29.103689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d62c1d-c3e3-460e-bdf4-4b670b748b8a service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:29.116070 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3916/7778] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:29.230705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6004ea-7707-46d0-a161-a657104056b1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:29.231273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6004ea-7707-46d0-a161-a657104056b1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:29.231647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6004ea-7707-46d0-a161-a657104056b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:29.255348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0b6004ea-7707-46d0-a161-a657104056b1 None None] MFA Rules not processed for user `8a4ee7f9ed494c0aae51a38f4022d1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:29.257006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0b6004ea-7707-46d0-a161-a657104056b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:29.272003 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:29.322456 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3863/7779] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:29.501730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62c1d-c3e3-460e-bdf4-4b670b748b8a service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:29.503652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-95d62c1d-c3e3-460e-bdf4-4b670b748b8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:29.527255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62c1d-c3e3-460e-bdf4-4b670b748b8a service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:29.534064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ab81-dfee-4d00-b351-afdd952f3180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:29.534964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ab81-dfee-4d00-b351-afdd952f3180 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:29.535403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ab81-dfee-4d00-b351-afdd952f3180 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:29.535820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ab81-dfee-4d00-b351-afdd952f3180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:29.592417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871ab81-dfee-4d00-b351-afdd952f3180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:29.602668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871ab81-dfee-4d00-b351-afdd952f3180 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:29.632438 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3917/7780] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:31.788847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6004ea-7707-46d0-a161-a657104056b1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:31.791280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0b6004ea-7707-46d0-a161-a657104056b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:32.089519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6004ea-7707-46d0-a161-a657104056b1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:32.098045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f61bec-ad6f-443b-9c70-a0f1693d80cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:32.098854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f61bec-ad6f-443b-9c70-a0f1693d80cc service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:32.099260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f61bec-ad6f-443b-9c70-a0f1693d80cc service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:32.099633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f61bec-ad6f-443b-9c70-a0f1693d80cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:32.101550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b4f61bec-ad6f-443b-9c70-a0f1693d80cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:32.134320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f61bec-ad6f-443b-9c70-a0f1693d80cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:32.137436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f61bec-ad6f-443b-9c70-a0f1693d80cc service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:32.176010 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3864/7781] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:39.604615 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=53 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:42.157591 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=55 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:42.566744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ab81-dfee-4d00-b351-afdd952f3180 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:42.730689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ab81-dfee-4d00-b351-afdd952f3180 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:42.741745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:42.743103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:42.743543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:42.744028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] PATH_INFO: `/v3/users/1c54d463d9194d01ba2923168afd0af7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:42.745604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c54d463d9194d01ba2923168afd0af7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:42.749633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:42.866334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c54d463d9194d01ba2923168afd0af7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:42.867235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c54d463d9194d01ba2923168afd0af7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:42.904956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c54d463d9194d01ba2923168afd0af7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:42.920238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c54d463d9194d01ba2923168afd0af7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:42.921187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c54d463d9194d01ba2923168afd0af7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:42.957613 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3918/7782] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:37:42 2022] DELETE /identity/v3/users/1c54d463d9194d01ba2923168afd0af7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:42.959951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142581e9-30ae-45ae-8f04-259edc667f9f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:42.960701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142581e9-30ae-45ae-8f04-259edc667f9f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:42.961328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142581e9-30ae-45ae-8f04-259edc667f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:43.044312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-142581e9-30ae-45ae-8f04-259edc667f9f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:43.050593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-142581e9-30ae-45ae-8f04-259edc667f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:43.230358 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3865/7783] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:43.241937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:43.244838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:43.331206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c86322-5b68-4981-b227-a68d2577e35d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:43.344876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98fd97-4a2b-4558-b490-e041c2d44543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:43.345998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98fd97-4a2b-4558-b490-e041c2d44543 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:43.346255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98fd97-4a2b-4558-b490-e041c2d44543 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:43.346535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98fd97-4a2b-4558-b490-e041c2d44543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:43.365996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98fd97-4a2b-4558-b490-e041c2d44543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:43.367053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98fd97-4a2b-4558-b490-e041c2d44543 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:43.381274 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3919/7784] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:43.903540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142581e9-30ae-45ae-8f04-259edc667f9f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:43.906591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-142581e9-30ae-45ae-8f04-259edc667f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:43.963243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142581e9-30ae-45ae-8f04-259edc667f9f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:43.973343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:43.975153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:43.976367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:43.977111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] PATH_INFO: `/v3/projects/1bd449a909f0405ea21df393db3f7bb5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:43.979991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bd449a909f0405ea21df393db3f7bb5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:43.984789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:44.064184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bd449a909f0405ea21df393db3f7bb5', 'request_id': 'req-164c5cfc-fd63-49fb-a42f-eac4cd702358'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:44.078745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bd449a909f0405ea21df393db3f7bb5', 'request_id': 'req-164c5cfc-fd63-49fb-a42f-eac4cd702358'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:44.090342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bd449a909f0405ea21df393db3f7bb5', 'request_id': 'req-164c5cfc-fd63-49fb-a42f-eac4cd702358'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:44.121645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] The token cache is being invalidate because project 1bd449a909f0405ea21df393db3f7bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:37:44.121948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:44.130142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:44.147981 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3866/7785] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:37:43 2022] DELETE /identity/v3/projects/1bd449a909f0405ea21df393db3f7bb5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:44.149194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98fd97-4a2b-4558-b490-e041c2d44543 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:44.165226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98fd97-4a2b-4558-b490-e041c2d44543 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:44.240312 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:44.322175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:44.323159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:44.323544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:44.323889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] PATH_INFO: `/v3/users/17caae92991144cca6a472d1427aaa31` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:44.325712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=17caae92991144cca6a472d1427aaa31)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:44.328304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:44.411312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17caae92991144cca6a472d1427aaa31'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:44.412390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17caae92991144cca6a472d1427aaa31'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:44.464149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17caae92991144cca6a472d1427aaa31'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:44.504489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17caae92991144cca6a472d1427aaa31'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:44.506448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17caae92991144cca6a472d1427aaa31'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:44.554864 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3920/7786] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:37:44 2022] DELETE /identity/v3/users/17caae92991144cca6a472d1427aaa31 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:44.993032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:44.995260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:45.023210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c5cfc-fd63-49fb-a42f-eac4cd702358 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:45.158823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:45.168826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:45.169715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:45.204333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] PATH_INFO: `/v3/projects/f6f7594b0af6471db497d8d270cc6412` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:45.205941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6f7594b0af6471db497d8d270cc6412)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:45.208403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:45.287740 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:45.332042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f7594b0af6471db497d8d270cc6412', 'request_id': 'req-f1821022-e171-45ad-b2ba-2d00017cc96d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:45.341733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f7594b0af6471db497d8d270cc6412', 'request_id': 'req-f1821022-e171-45ad-b2ba-2d00017cc96d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:45.351958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f7594b0af6471db497d8d270cc6412', 'request_id': 'req-f1821022-e171-45ad-b2ba-2d00017cc96d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:45.368413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] The token cache is being invalidate because project f6f7594b0af6471db497d8d270cc6412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:37:45.368940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:45.369834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:45.371659 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3867/7787] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:37:44 2022] DELETE /identity/v3/projects/f6f7594b0af6471db497d8d270cc6412 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:45.376076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:45.377679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:45.392501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0934-9aa1-40b6-aa4e-3612215735ca admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:45.470644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584695b-5cf7-4f47-b824-5325adc90ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:45.471416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584695b-5cf7-4f47-b824-5325adc90ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:45.471703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584695b-5cf7-4f47-b824-5325adc90ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:45.471979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584695b-5cf7-4f47-b824-5325adc90ff6 admin admin] PATH_INFO: `/v3/users/55370724ef0941348494f6b2eb83de8b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:45.473154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584695b-5cf7-4f47-b824-5325adc90ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55370724ef0941348494f6b2eb83de8b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:45.475340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584695b-5cf7-4f47-b824-5325adc90ff6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:45.550656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3584695b-5cf7-4f47-b824-5325adc90ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55370724ef0941348494f6b2eb83de8b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:45.551440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3584695b-5cf7-4f47-b824-5325adc90ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55370724ef0941348494f6b2eb83de8b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:45.554382 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:45.568177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3584695b-5cf7-4f47-b824-5325adc90ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55370724ef0941348494f6b2eb83de8b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:45.578895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3584695b-5cf7-4f47-b824-5325adc90ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55370724ef0941348494f6b2eb83de8b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:45.579599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3584695b-5cf7-4f47-b824-5325adc90ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55370724ef0941348494f6b2eb83de8b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:45.597908 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3921/7788] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:37:45 2022] DELETE /identity/v3/users/55370724ef0941348494f6b2eb83de8b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:46.088354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:46.092400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:46.127507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1821022-e171-45ad-b2ba-2d00017cc96d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:46.268441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:46.270068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:46.270355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:46.270625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e admin admin] PATH_INFO: `/v3/projects/ffdd249c8e6545dc82afb0ffa4849bf2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:46.276871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffdd249c8e6545dc82afb0ffa4849bf2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:46.279033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:46.399065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffdd249c8e6545dc82afb0ffa4849bf2', 'request_id': 'req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:46.411909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffdd249c8e6545dc82afb0ffa4849bf2', 'request_id': 'req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:46.440139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffdd249c8e6545dc82afb0ffa4849bf2', 'request_id': 'req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:46.464161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e admin admin] The token cache is being invalidate because project ffdd249c8e6545dc82afb0ffa4849bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:37:46.464646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:46.465737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9dd7fa3a-4bcf-4354-9e23-f8533ab2ce5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:37:46.472585 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3868/7789] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:37:46 2022] DELETE /identity/v3/projects/ffdd249c8e6545dc82afb0ffa4849bf2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:46.480225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dda3ea-4a09-4628-8916-6bc60266e7e9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:46.481031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dda3ea-4a09-4628-8916-6bc60266e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:46.481461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dda3ea-4a09-4628-8916-6bc60266e7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:46.525984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-58dda3ea-4a09-4628-8916-6bc60266e7e9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:46.527494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-58dda3ea-4a09-4628-8916-6bc60266e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:46.793922 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3922/7790] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:37:46.800106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267aab-25d2-4eee-aa7f-00bde68b1bc0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:46.800489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267aab-25d2-4eee-aa7f-00bde68b1bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:46.800818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267aab-25d2-4eee-aa7f-00bde68b1bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:46.875531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-da267aab-25d2-4eee-aa7f-00bde68b1bc0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:46.879786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-da267aab-25d2-4eee-aa7f-00bde68b1bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:46.913632 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3869/7791] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:46.927936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dda3ea-4a09-4628-8916-6bc60266e7e9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:46.961601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dda3ea-4a09-4628-8916-6bc60266e7e9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:46.967828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798de3f-1863-49e2-b77d-3d4e2347d063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:46.968837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798de3f-1863-49e2-b77d-3d4e2347d063 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:46.969312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798de3f-1863-49e2-b77d-3d4e2347d063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:46.969811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798de3f-1863-49e2-b77d-3d4e2347d063 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:46.970653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798de3f-1863-49e2-b77d-3d4e2347d063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:37:46.971170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798de3f-1863-49e2-b77d-3d4e2347d063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:46.973147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798de3f-1863-49e2-b77d-3d4e2347d063 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:46.993171 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3923/7792] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:37:46.994055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da267aab-25d2-4eee-aa7f-00bde68b1bc0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:47.008548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da267aab-25d2-4eee-aa7f-00bde68b1bc0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:47.014105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82746fdd-3737-44f5-aeea-8cb0117f483f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:47.014737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82746fdd-3737-44f5-aeea-8cb0117f483f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:47.015068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82746fdd-3737-44f5-aeea-8cb0117f483f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:47.015342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82746fdd-3737-44f5-aeea-8cb0117f483f admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:47.015973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82746fdd-3737-44f5-aeea-8cb0117f483f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:47.018079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82746fdd-3737-44f5-aeea-8cb0117f483f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:47.063038 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3870/7793] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:37:46 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:37:47.064648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798de3f-1863-49e2-b77d-3d4e2347d063 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:47.083395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798de3f-1863-49e2-b77d-3d4e2347d063 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:47.202303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888633d8-36e4-4b85-a819-c01fcf23ccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:47.203562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888633d8-36e4-4b85-a819-c01fcf23ccc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:47.204036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888633d8-36e4-4b85-a819-c01fcf23ccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:47.204457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888633d8-36e4-4b85-a819-c01fcf23ccc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:47.205302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888633d8-36e4-4b85-a819-c01fcf23ccc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:47.207571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888633d8-36e4-4b85-a819-c01fcf23ccc3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:47.228410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf5ea0-921c-4f2f-8723-d8c822cb2253 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:47.229451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf5ea0-921c-4f2f-8723-d8c822cb2253 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:47.229935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf5ea0-921c-4f2f-8723-d8c822cb2253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:47.244349 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3924/7794] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:37:47 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:47.251100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888633d8-36e4-4b85-a819-c01fcf23ccc3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:47.278836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888633d8-36e4-4b85-a819-c01fcf23ccc3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:47.280667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cebf5ea0-921c-4f2f-8723-d8c822cb2253 None None] MFA Rules not processed for user `8a4ee7f9ed494c0aae51a38f4022d1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:47.282165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cebf5ea0-921c-4f2f-8723-d8c822cb2253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:47.290903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e593572-a3ac-41a7-9be0-bf87a367d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:47.292040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e593572-a3ac-41a7-9be0-bf87a367d660 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:47.292323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e593572-a3ac-41a7-9be0-bf87a367d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:47.294632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e593572-a3ac-41a7-9be0-bf87a367d660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:47.296701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e593572-a3ac-41a7-9be0-bf87a367d660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:47.298823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e593572-a3ac-41a7-9be0-bf87a367d660 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:47.348641 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:47.363300 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3925/7795] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:47.367228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e593572-a3ac-41a7-9be0-bf87a367d660 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:47.394509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e593572-a3ac-41a7-9be0-bf87a367d660 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:47.405618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c245ae-622b-49dc-b67c-ce6088e8a589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:47.406608 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c245ae-622b-49dc-b67c-ce6088e8a589 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:47.407570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c245ae-622b-49dc-b67c-ce6088e8a589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:47.408409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c245ae-622b-49dc-b67c-ce6088e8a589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:47.410616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c245ae-622b-49dc-b67c-ce6088e8a589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:47.414817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c245ae-622b-49dc-b67c-ce6088e8a589 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:47.424697 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3871/7796] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:47.455135 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3926/7797] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:37:47.459532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf5ea0-921c-4f2f-8723-d8c822cb2253 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:47.478622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf5ea0-921c-4f2f-8723-d8c822cb2253 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:47.493079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddcca1-83cb-4c3f-97ae-6ff9fc046d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:47.493749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddcca1-83cb-4c3f-97ae-6ff9fc046d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:47.494524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddcca1-83cb-4c3f-97ae-6ff9fc046d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:47.494804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddcca1-83cb-4c3f-97ae-6ff9fc046d77 admin admin] PATH_INFO: `/v3/projects/30edd0c4d4444acf8f0ffafeb955a96c/users/689a1fbe244d42e6b83fc684e83f5151/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:47.527646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddcca1-83cb-4c3f-97ae-6ff9fc046d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30edd0c4d4444acf8f0ffafeb955a96c, user_id=689a1fbe244d42e6b83fc684e83f5151, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:47.534051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddcca1-83cb-4c3f-97ae-6ff9fc046d77 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:47.578569 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3872/7798] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:47 2022] PUT /identity/v3/projects/30edd0c4d4444acf8f0ffafeb955a96c/users/689a1fbe244d42e6b83fc684e83f5151/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:47.592938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0a262-415a-4d19-8b0e-124cd84c018f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:47.593469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0a262-415a-4d19-8b0e-124cd84c018f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:47.593469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0a262-415a-4d19-8b0e-124cd84c018f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:47.657071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9ed0a262-415a-4d19-8b0e-124cd84c018f None None] MFA Rules not processed for user `689a1fbe244d42e6b83fc684e83f5151`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:47.658425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9ed0a262-415a-4d19-8b0e-124cd84c018f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:47.665553 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:47.832757 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3927/7799] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:47.850793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddcca1-83cb-4c3f-97ae-6ff9fc046d77 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:47.980391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddcca1-83cb-4c3f-97ae-6ff9fc046d77 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:47.994603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587c2e3-a34f-4123-8744-64f58bab5672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:47.995258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587c2e3-a34f-4123-8744-64f58bab5672 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:47.995544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587c2e3-a34f-4123-8744-64f58bab5672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:47.995929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587c2e3-a34f-4123-8744-64f58bab5672 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:47.997712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587c2e3-a34f-4123-8744-64f58bab5672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:48.008274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587c2e3-a34f-4123-8744-64f58bab5672 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:48.074347 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3873/7800] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:37:47 2022] POST /identity/v3/projects => generated 383 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:37:48.075945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0a262-415a-4d19-8b0e-124cd84c018f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:48.091253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0a262-415a-4d19-8b0e-124cd84c018f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:48.265783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1bce2-ddbb-46ad-90c4-6c300e26ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:48.267345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1bce2-ddbb-46ad-90c4-6c300e26ba26 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:48.267861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1bce2-ddbb-46ad-90c4-6c300e26ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:48.268541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1bce2-ddbb-46ad-90c4-6c300e26ba26 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:48.269586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1bce2-ddbb-46ad-90c4-6c300e26ba26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:48.272106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1bce2-ddbb-46ad-90c4-6c300e26ba26 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:48.304954 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3928/7801] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:37:48 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:48.306340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587c2e3-a34f-4123-8744-64f58bab5672 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:48.325152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587c2e3-a34f-4123-8744-64f58bab5672 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:48.334624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e39fb-b7f6-42d9-b13e-6e16d609b066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:48.335926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e39fb-b7f6-42d9-b13e-6e16d609b066 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:48.336192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e39fb-b7f6-42d9-b13e-6e16d609b066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:48.337936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e39fb-b7f6-42d9-b13e-6e16d609b066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:48.338594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e39fb-b7f6-42d9-b13e-6e16d609b066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:48.343663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e39fb-b7f6-42d9-b13e-6e16d609b066 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:48.366960 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3874/7802] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:48.375201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1bce2-ddbb-46ad-90c4-6c300e26ba26 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:48.403945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1bce2-ddbb-46ad-90c4-6c300e26ba26 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:48.433728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdab456-ea5d-4bcb-a221-636f4e5ebb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:48.436875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdab456-ea5d-4bcb-a221-636f4e5ebb93 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:48.440700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdab456-ea5d-4bcb-a221-636f4e5ebb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:48.441103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdab456-ea5d-4bcb-a221-636f4e5ebb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:48.441988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdab456-ea5d-4bcb-a221-636f4e5ebb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:48.446643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdab456-ea5d-4bcb-a221-636f4e5ebb93 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:48.476246 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3929/7803] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:48.476940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e39fb-b7f6-42d9-b13e-6e16d609b066 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:48.493311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e39fb-b7f6-42d9-b13e-6e16d609b066 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:48.509788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa5c04-876f-4fdc-aa08-f430e43aa845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:48.510461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5c04-876f-4fdc-aa08-f430e43aa845 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:48.510741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5c04-876f-4fdc-aa08-f430e43aa845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:48.511307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5c04-876f-4fdc-aa08-f430e43aa845 admin admin] PATH_INFO: `/v3/projects/60cf097c73454a7e9441e9a28c9de413/users/6eb223540334433cab50f402cec3b997/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:48.542149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa5c04-876f-4fdc-aa08-f430e43aa845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cf097c73454a7e9441e9a28c9de413, user_id=6eb223540334433cab50f402cec3b997, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:48.545457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa5c04-876f-4fdc-aa08-f430e43aa845 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:48.591862 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3875/7804] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:48 2022] PUT /identity/v3/projects/60cf097c73454a7e9441e9a28c9de413/users/6eb223540334433cab50f402cec3b997/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:37:48.605922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a34d2-2cf0-47bb-bd10-9891a75086b1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:48.606372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a34d2-2cf0-47bb-bd10-9891a75086b1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:48.606766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a34d2-2cf0-47bb-bd10-9891a75086b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:48.679595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa5c04-876f-4fdc-aa08-f430e43aa845 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:48.681418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6faa5c04-876f-4fdc-aa08-f430e43aa845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:48.703676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-061a34d2-2cf0-47bb-bd10-9891a75086b1 None None] MFA Rules not processed for user `6eb223540334433cab50f402cec3b997`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:48.704929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-061a34d2-2cf0-47bb-bd10-9891a75086b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:48.838064 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3930/7805] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:37:48.843989 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:48.844159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a34d2-2cf0-47bb-bd10-9891a75086b1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:48.857161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa5c04-876f-4fdc-aa08-f430e43aa845 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:48.869070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99254d62-21f3-462b-990e-6833f4727e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:48.869707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99254d62-21f3-462b-990e-6833f4727e2d service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:48.869987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99254d62-21f3-462b-990e-6833f4727e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:48.870260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99254d62-21f3-462b-990e-6833f4727e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:48.872117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-99254d62-21f3-462b-990e-6833f4727e2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:48.877858 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:48.984491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a34d2-2cf0-47bb-bd10-9891a75086b1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:49.006478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99254d62-21f3-462b-990e-6833f4727e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:49.008907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99254d62-21f3-462b-990e-6833f4727e2d service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:49.010184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dc68e-d3a8-45e9-9ba1-47b30706c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:49.010848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dc68e-d3a8-45e9-9ba1-47b30706c6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:49.011180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dc68e-d3a8-45e9-9ba1-47b30706c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:49.011407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dc68e-d3a8-45e9-9ba1-47b30706c6d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:49.012058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19dc68e-d3a8-45e9-9ba1-47b30706c6d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:49.019712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19dc68e-d3a8-45e9-9ba1-47b30706c6d5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:49.047170 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3876/7806] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:49.097745 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3931/7807] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:37:48 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:49.099131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99254d62-21f3-462b-990e-6833f4727e2d service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:49.117965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99254d62-21f3-462b-990e-6833f4727e2d service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:49.220467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a83b8-1704-4cfc-9930-d093dae11dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:49.221203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a83b8-1704-4cfc-9930-d093dae11dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:49.221482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a83b8-1704-4cfc-9930-d093dae11dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:49.221748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a83b8-1704-4cfc-9930-d093dae11dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:49.222385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a83b8-1704-4cfc-9930-d093dae11dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:49.224888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a83b8-1704-4cfc-9930-d093dae11dd6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:49.258829 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3877/7808] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:37:49 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:37:49.262907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dc68e-d3a8-45e9-9ba1-47b30706c6d5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:49.276902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dc68e-d3a8-45e9-9ba1-47b30706c6d5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:49.289866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3aaf5-f4d8-4744-b455-41c2e016b404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:49.290611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3aaf5-f4d8-4744-b455-41c2e016b404 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:49.290880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3aaf5-f4d8-4744-b455-41c2e016b404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:49.291221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3aaf5-f4d8-4744-b455-41c2e016b404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:49.292070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3aaf5-f4d8-4744-b455-41c2e016b404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:49.293985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3aaf5-f4d8-4744-b455-41c2e016b404 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:49.312397 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3932/7809] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:49.313327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a83b8-1704-4cfc-9930-d093dae11dd6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:49.326764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a83b8-1704-4cfc-9930-d093dae11dd6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:49.334422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c6716-31fa-4ea2-aa5f-f5e49418136c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:49.335210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c6716-31fa-4ea2-aa5f-f5e49418136c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:49.335485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c6716-31fa-4ea2-aa5f-f5e49418136c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:49.335753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c6716-31fa-4ea2-aa5f-f5e49418136c admin admin] PATH_INFO: `/v3/projects/9c116d9cf32c4d4db4b5600f192b5c48/users/db3fea5000a843318a2dc490e532ee3c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:49.353864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c6716-31fa-4ea2-aa5f-f5e49418136c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c116d9cf32c4d4db4b5600f192b5c48, user_id=db3fea5000a843318a2dc490e532ee3c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:49.356679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c6716-31fa-4ea2-aa5f-f5e49418136c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:49.381305 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3878/7810] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:49 2022] PUT /identity/v3/projects/9c116d9cf32c4d4db4b5600f192b5c48/users/db3fea5000a843318a2dc490e532ee3c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:37:49.385163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3aaf5-f4d8-4744-b455-41c2e016b404 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:49.399244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3aaf5-f4d8-4744-b455-41c2e016b404 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:49.521007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6795e-b85b-45d8-ad29-fd20051748bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:49.521637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6795e-b85b-45d8-ad29-fd20051748bd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:49.525467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6795e-b85b-45d8-ad29-fd20051748bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:49.525933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6795e-b85b-45d8-ad29-fd20051748bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:49.526749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6795e-b85b-45d8-ad29-fd20051748bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:49.530616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6795e-b85b-45d8-ad29-fd20051748bd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:49.551551 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3933/7811] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:37:49.556356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c6716-31fa-4ea2-aa5f-f5e49418136c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:49.575078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c6716-31fa-4ea2-aa5f-f5e49418136c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:49.583628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188de245-55c1-4af1-b6b4-8951eaf157d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:49.584484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188de245-55c1-4af1-b6b4-8951eaf157d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:49.584878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188de245-55c1-4af1-b6b4-8951eaf157d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:49.585218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188de245-55c1-4af1-b6b4-8951eaf157d8 admin admin] PATH_INFO: `/v3/projects/9c116d9cf32c4d4db4b5600f192b5c48/users/db3fea5000a843318a2dc490e532ee3c/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:49.588008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188de245-55c1-4af1-b6b4-8951eaf157d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c116d9cf32c4d4db4b5600f192b5c48, user_id=db3fea5000a843318a2dc490e532ee3c, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:49.592792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188de245-55c1-4af1-b6b4-8951eaf157d8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:49.618759 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3879/7812] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:37:49 2022] PUT /identity/v3/projects/9c116d9cf32c4d4db4b5600f192b5c48/users/db3fea5000a843318a2dc490e532ee3c/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:37:49.620545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3abd2-8700-4c5e-8836-2a29977c8645 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:49.621332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3abd2-8700-4c5e-8836-2a29977c8645 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:49.621776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3abd2-8700-4c5e-8836-2a29977c8645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:49.707616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f1d3abd2-8700-4c5e-8836-2a29977c8645 None None] MFA Rules not processed for user `db3fea5000a843318a2dc490e532ee3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:37:49.711638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f1d3abd2-8700-4c5e-8836-2a29977c8645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:37:49.898175 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3934/7813] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:37:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:37:49.973361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188de245-55c1-4af1-b6b4-8951eaf157d8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:50.136228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188de245-55c1-4af1-b6b4-8951eaf157d8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:50.143683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1fc19-4963-45e9-80a1-cc9ffe0cf0ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:50.144407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1fc19-4963-45e9-80a1-cc9ffe0cf0ca service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:50.144688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1fc19-4963-45e9-80a1-cc9ffe0cf0ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:50.144964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1fc19-4963-45e9-80a1-cc9ffe0cf0ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:50.153376 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:50.336084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1fc19-4963-45e9-80a1-cc9ffe0cf0ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:50.337536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1fc19-4963-45e9-80a1-cc9ffe0cf0ca service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:50.377225 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3880/7814] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:54.109934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3abd2-8700-4c5e-8836-2a29977c8645 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:54.125002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3abd2-8700-4c5e-8836-2a29977c8645 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:54.128820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45b52f-4b12-43c4-be8d-86cc99614724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:54.129456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45b52f-4b12-43c4-be8d-86cc99614724 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:54.129799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45b52f-4b12-43c4-be8d-86cc99614724 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:54.130140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45b52f-4b12-43c4-be8d-86cc99614724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:54.137448 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:54.209295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45b52f-4b12-43c4-be8d-86cc99614724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:54.211129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45b52f-4b12-43c4-be8d-86cc99614724 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:54.233704 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3935/7815] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:37:55.352768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1fc19-4963-45e9-80a1-cc9ffe0cf0ca service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:37:55.367008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1fc19-4963-45e9-80a1-cc9ffe0cf0ca service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:37:55.371213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40833a-2bce-4355-ba76-e945476d9773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:37:55.371952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40833a-2bce-4355-ba76-e945476d9773 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:37:55.372263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40833a-2bce-4355-ba76-e945476d9773 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:37:55.372540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40833a-2bce-4355-ba76-e945476d9773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:37:55.384124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40833a-2bce-4355-ba76-e945476d9773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:37:55.385935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40833a-2bce-4355-ba76-e945476d9773 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:37:55.413648 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3881/7816] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:37:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:38:04.218471 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=24 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:05.394333 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=30 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:11.025887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45b52f-4b12-43c4-be8d-86cc99614724 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:11.174299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45b52f-4b12-43c4-be8d-86cc99614724 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:11.185117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:11.185877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:11.186237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:11.186628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] PATH_INFO: `/v3/users/689a1fbe244d42e6b83fc684e83f5151` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:11.188317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=689a1fbe244d42e6b83fc684e83f5151)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:11.190503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:11.288924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '689a1fbe244d42e6b83fc684e83f5151'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:11.289351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '689a1fbe244d42e6b83fc684e83f5151'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:11.321274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '689a1fbe244d42e6b83fc684e83f5151'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:11.334993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '689a1fbe244d42e6b83fc684e83f5151'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:11.335683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '689a1fbe244d42e6b83fc684e83f5151'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:11.378087 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3936/7817] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:38:11 2022] DELETE /identity/v3/users/689a1fbe244d42e6b83fc684e83f5151 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:11.380182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c7bde-d743-4abe-8247-cacb799f8b54 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:11.381271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c7bde-d743-4abe-8247-cacb799f8b54 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:11.381777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c7bde-d743-4abe-8247-cacb799f8b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:11.476049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-022c7bde-d743-4abe-8247-cacb799f8b54 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:11.477839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-022c7bde-d743-4abe-8247-cacb799f8b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:11.604092 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3882/7818] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:38:11.614046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:11.615498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:11.766514 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:11.799196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac2252-7087-4e7b-be2d-7edda20b69e0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:11.815821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ae4a0-066b-4d1a-b7d0-e434e74e3b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:11.817520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ae4a0-066b-4d1a-b7d0-e434e74e3b13 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:11.818142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ae4a0-066b-4d1a-b7d0-e434e74e3b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:11.818624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ae4a0-066b-4d1a-b7d0-e434e74e3b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:11.843563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ae4a0-066b-4d1a-b7d0-e434e74e3b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:11.845168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ae4a0-066b-4d1a-b7d0-e434e74e3b13 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:11.871102 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3937/7819] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:38:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:38:12.579307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c7bde-d743-4abe-8247-cacb799f8b54 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:12.582385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-022c7bde-d743-4abe-8247-cacb799f8b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:12.620189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c7bde-d743-4abe-8247-cacb799f8b54 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:12.641333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:12.644389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:12.644845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:12.647451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] PATH_INFO: `/v3/projects/30edd0c4d4444acf8f0ffafeb955a96c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:12.664017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30edd0c4d4444acf8f0ffafeb955a96c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:12.665984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:12.799584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30edd0c4d4444acf8f0ffafeb955a96c', 'request_id': 'req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:12.812947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30edd0c4d4444acf8f0ffafeb955a96c', 'request_id': 'req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:12.830570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30edd0c4d4444acf8f0ffafeb955a96c', 'request_id': 'req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:12.848471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] The token cache is being invalidate because project 30edd0c4d4444acf8f0ffafeb955a96c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:38:12.849071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:12.849908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:12.852083 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3883/7820] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:38:12 2022] DELETE /identity/v3/projects/30edd0c4d4444acf8f0ffafeb955a96c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:12.855968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ae4a0-066b-4d1a-b7d0-e434e74e3b13 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:12.871938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ae4a0-066b-4d1a-b7d0-e434e74e3b13 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:12.950371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:12.951422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:12.951921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:12.952764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] PATH_INFO: `/v3/users/6eb223540334433cab50f402cec3b997` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:12.954410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb223540334433cab50f402cec3b997)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:12.956826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:13.053270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb223540334433cab50f402cec3b997'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:13.054512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb223540334433cab50f402cec3b997'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:13.099366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb223540334433cab50f402cec3b997'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:13.118009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb223540334433cab50f402cec3b997'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:13.118757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb223540334433cab50f402cec3b997'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:13.156710 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3938/7821] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:38:12 2022] DELETE /identity/v3/users/6eb223540334433cab50f402cec3b997 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:38:13.679783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:13.681277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:13.702068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0ece2-4cd4-4fe1-bf45-c43345bf3672 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:13.856442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:13.857942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:13.858385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:13.858818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] PATH_INFO: `/v3/projects/60cf097c73454a7e9441e9a28c9de413` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:13.860222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60cf097c73454a7e9441e9a28c9de413)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:13.862330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:13.907722 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:13.979200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60cf097c73454a7e9441e9a28c9de413', 'request_id': 'req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:13.987455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60cf097c73454a7e9441e9a28c9de413', 'request_id': 'req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:14.032260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60cf097c73454a7e9441e9a28c9de413', 'request_id': 'req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:14.080694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] The token cache is being invalidate because project 60cf097c73454a7e9441e9a28c9de413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:38:14.081156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:14.082209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:14.084075 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3884/7822] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:38:13 2022] DELETE /identity/v3/projects/60cf097c73454a7e9441e9a28c9de413 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:14.088561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:14.091363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:14.118151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f21964-20db-4c6e-9e18-f58d80e074b4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:14.250436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73dc07-3014-4eb0-a262-889418ab448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:14.252620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73dc07-3014-4eb0-a262-889418ab448b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:14.253132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73dc07-3014-4eb0-a262-889418ab448b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:14.253653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73dc07-3014-4eb0-a262-889418ab448b admin admin] PATH_INFO: `/v3/users/db3fea5000a843318a2dc490e532ee3c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:14.255175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73dc07-3014-4eb0-a262-889418ab448b admin admin] RBAC: Authorizing `identity:delete_user(user_id=db3fea5000a843318a2dc490e532ee3c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:14.257549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73dc07-3014-4eb0-a262-889418ab448b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:14.260895 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:14.386309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca73dc07-3014-4eb0-a262-889418ab448b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db3fea5000a843318a2dc490e532ee3c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:14.387478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca73dc07-3014-4eb0-a262-889418ab448b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db3fea5000a843318a2dc490e532ee3c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:14.418892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca73dc07-3014-4eb0-a262-889418ab448b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db3fea5000a843318a2dc490e532ee3c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:14.437914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca73dc07-3014-4eb0-a262-889418ab448b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db3fea5000a843318a2dc490e532ee3c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:14.438814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca73dc07-3014-4eb0-a262-889418ab448b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db3fea5000a843318a2dc490e532ee3c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:14.464476 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3939/7823] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:38:14 2022] DELETE /identity/v3/users/db3fea5000a843318a2dc490e532ee3c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:15.073950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:15.075606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:15.109224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985c7ac-4fd1-4ff1-9711-6866a36ca33a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:15.286203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cc049-2f48-4623-ac6d-07874ece40e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:15.286992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cc049-2f48-4623-ac6d-07874ece40e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:15.287277 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cc049-2f48-4623-ac6d-07874ece40e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:15.287549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cc049-2f48-4623-ac6d-07874ece40e3 admin admin] PATH_INFO: `/v3/projects/9c116d9cf32c4d4db4b5600f192b5c48` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:15.291383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cc049-2f48-4623-ac6d-07874ece40e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c116d9cf32c4d4db4b5600f192b5c48)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:15.293334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cc049-2f48-4623-ac6d-07874ece40e3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:15.407263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-119cc049-2f48-4623-ac6d-07874ece40e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c116d9cf32c4d4db4b5600f192b5c48', 'request_id': 'req-119cc049-2f48-4623-ac6d-07874ece40e3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:15.433811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-119cc049-2f48-4623-ac6d-07874ece40e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c116d9cf32c4d4db4b5600f192b5c48', 'request_id': 'req-119cc049-2f48-4623-ac6d-07874ece40e3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:15.456142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-119cc049-2f48-4623-ac6d-07874ece40e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c116d9cf32c4d4db4b5600f192b5c48', 'request_id': 'req-119cc049-2f48-4623-ac6d-07874ece40e3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:15.477336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-119cc049-2f48-4623-ac6d-07874ece40e3 admin admin] The token cache is being invalidate because project 9c116d9cf32c4d4db4b5600f192b5c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:38:15.477642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-119cc049-2f48-4623-ac6d-07874ece40e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:15.478410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-119cc049-2f48-4623-ac6d-07874ece40e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:15.480266 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3885/7824] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:38:15 2022] DELETE /identity/v3/projects/9c116d9cf32c4d4db4b5600f192b5c48 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:15.486494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8592f5-a20b-471d-97f3-15a51ed1529f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:15.487042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8592f5-a20b-471d-97f3-15a51ed1529f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:15.487042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8592f5-a20b-471d-97f3-15a51ed1529f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:15.619911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ba8592f5-a20b-471d-97f3-15a51ed1529f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:15.621299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ba8592f5-a20b-471d-97f3-15a51ed1529f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:15.739099 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3940/7825] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:15.746851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282c529-6b4e-4893-93ab-9e1330061a63 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:15.747167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282c529-6b4e-4893-93ab-9e1330061a63 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:15.747445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282c529-6b4e-4893-93ab-9e1330061a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:15.790784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4282c529-6b4e-4893-93ab-9e1330061a63 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:15.792011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4282c529-6b4e-4893-93ab-9e1330061a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:15.807785 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3886/7826] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:15.815263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8592f5-a20b-471d-97f3-15a51ed1529f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:15.853945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8592f5-a20b-471d-97f3-15a51ed1529f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:15.868261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2804f-5ce5-4431-98cd-d2335d6116ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:15.870408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2804f-5ce5-4431-98cd-d2335d6116ca admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:15.870408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2804f-5ce5-4431-98cd-d2335d6116ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:15.870810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2804f-5ce5-4431-98cd-d2335d6116ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:15.871968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2804f-5ce5-4431-98cd-d2335d6116ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:38:15.874224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2804f-5ce5-4431-98cd-d2335d6116ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:15.876502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2804f-5ce5-4431-98cd-d2335d6116ca admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:15.906495 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3941/7827] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:38:15.907630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282c529-6b4e-4893-93ab-9e1330061a63 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:15.921051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282c529-6b4e-4893-93ab-9e1330061a63 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:15.937141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a807b-1e17-49cd-bf2c-32eb3d8acfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:15.937767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a807b-1e17-49cd-bf2c-32eb3d8acfd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:15.938038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a807b-1e17-49cd-bf2c-32eb3d8acfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:15.938309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a807b-1e17-49cd-bf2c-32eb3d8acfd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:15.938967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a807b-1e17-49cd-bf2c-32eb3d8acfd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:15.941575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a807b-1e17-49cd-bf2c-32eb3d8acfd0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:16.000672 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3887/7828] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:38:15 2022] POST /identity/v3/projects => generated 369 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:38:16.001861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2804f-5ce5-4431-98cd-d2335d6116ca admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:16.019777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2804f-5ce5-4431-98cd-d2335d6116ca admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:16.166505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f7e8f-83eb-47d8-88b0-47f6bd4178bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:16.167247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f7e8f-83eb-47d8-88b0-47f6bd4178bf admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:16.167621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f7e8f-83eb-47d8-88b0-47f6bd4178bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:16.167987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f7e8f-83eb-47d8-88b0-47f6bd4178bf admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:16.168717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f7e8f-83eb-47d8-88b0-47f6bd4178bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:16.171862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f7e8f-83eb-47d8-88b0-47f6bd4178bf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:16.195283 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:16.234745 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3942/7829] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:38:16 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:38:16.236038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a807b-1e17-49cd-bf2c-32eb3d8acfd0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:16.253433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a807b-1e17-49cd-bf2c-32eb3d8acfd0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:16.268150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364770cd-9492-4647-af6a-25ac80cce1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:16.268779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364770cd-9492-4647-af6a-25ac80cce1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:16.269056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364770cd-9492-4647-af6a-25ac80cce1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:16.269333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364770cd-9492-4647-af6a-25ac80cce1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:16.269975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364770cd-9492-4647-af6a-25ac80cce1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:16.271650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364770cd-9492-4647-af6a-25ac80cce1e0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:16.273260 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:16.298411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f7e8f-83eb-47d8-88b0-47f6bd4178bf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:16.302671 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3888/7830] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:38:16.318780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f7e8f-83eb-47d8-88b0-47f6bd4178bf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:16.330611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10093da-dee8-4c1b-93c0-8d609376d689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:16.332638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10093da-dee8-4c1b-93c0-8d609376d689 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:16.333291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10093da-dee8-4c1b-93c0-8d609376d689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:16.333774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10093da-dee8-4c1b-93c0-8d609376d689 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:16.334645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10093da-dee8-4c1b-93c0-8d609376d689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:16.340050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10093da-dee8-4c1b-93c0-8d609376d689 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:16.378438 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3943/7831] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:38:16.379408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364770cd-9492-4647-af6a-25ac80cce1e0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:16.393958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364770cd-9492-4647-af6a-25ac80cce1e0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:16.400144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1881c2-c2fa-436c-aec3-5ada04c78084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:16.401308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1881c2-c2fa-436c-aec3-5ada04c78084 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:16.401904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1881c2-c2fa-436c-aec3-5ada04c78084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:16.402394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1881c2-c2fa-436c-aec3-5ada04c78084 admin admin] PATH_INFO: `/v3/projects/b81b48a6579e43ee888375e97773baf0/users/a9d9205fc307432ead11126ce0ed36e3/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:16.423842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1881c2-c2fa-436c-aec3-5ada04c78084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81b48a6579e43ee888375e97773baf0, user_id=a9d9205fc307432ead11126ce0ed36e3, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:16.427680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1881c2-c2fa-436c-aec3-5ada04c78084 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:16.446286 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3889/7832] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:38:16 2022] PUT /identity/v3/projects/b81b48a6579e43ee888375e97773baf0/users/a9d9205fc307432ead11126ce0ed36e3/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:16.456653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8f13-b73c-4890-9cb5-6670942d654a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:16.457014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8f13-b73c-4890-9cb5-6670942d654a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:16.457250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8f13-b73c-4890-9cb5-6670942d654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:16.499130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-904c8f13-b73c-4890-9cb5-6670942d654a None None] MFA Rules not processed for user `a9d9205fc307432ead11126ce0ed36e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:16.501584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-904c8f13-b73c-4890-9cb5-6670942d654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:16.693665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1881c2-c2fa-436c-aec3-5ada04c78084 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:16.703484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6f1881c2-c2fa-436c-aec3-5ada04c78084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:16.710383 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3944/7833] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:16.800467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1881c2-c2fa-436c-aec3-5ada04c78084 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:16.804936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d01a11-5f41-40d3-9a4c-638acafe1930 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:16.806414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d01a11-5f41-40d3-9a4c-638acafe1930 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:16.807250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d01a11-5f41-40d3-9a4c-638acafe1930 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:16.807747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d01a11-5f41-40d3-9a4c-638acafe1930 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:16.843939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d01a11-5f41-40d3-9a4c-638acafe1930 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:16.850143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d01a11-5f41-40d3-9a4c-638acafe1930 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:16.903256 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3890/7834] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:38:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:38:19.230540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0244545-51c2-4836-bae2-3c8b26417401 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:19.231762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0244545-51c2-4836-bae2-3c8b26417401 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:19.232280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0244545-51c2-4836-bae2-3c8b26417401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:19.280092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d0244545-51c2-4836-bae2-3c8b26417401 None None] MFA Rules not processed for user `4bdb352285134f4b93ab4879db31c8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:19.283139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d0244545-51c2-4836-bae2-3c8b26417401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:19.441753 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3945/7835] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:38:25.516360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d01a11-5f41-40d3-9a4c-638acafe1930 service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:25.516360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-18d01a11-5f41-40d3-9a4c-638acafe1930 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:25.617955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d01a11-5f41-40d3-9a4c-638acafe1930 service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:25.625147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:25.626058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:25.626535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:25.627056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] PATH_INFO: `/v3/users/8a4ee7f9ed494c0aae51a38f4022d1cd` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:25.628655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4ee7f9ed494c0aae51a38f4022d1cd)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:25.630952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:25.729872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4ee7f9ed494c0aae51a38f4022d1cd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:25.735999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4ee7f9ed494c0aae51a38f4022d1cd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:25.758133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4ee7f9ed494c0aae51a38f4022d1cd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:25.761000 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:25.769850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4ee7f9ed494c0aae51a38f4022d1cd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:25.770589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4ee7f9ed494c0aae51a38f4022d1cd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:25.799848 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3891/7836] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:38:25 2022] DELETE /identity/v3/users/8a4ee7f9ed494c0aae51a38f4022d1cd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:26.244004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0244545-51c2-4836-bae2-3c8b26417401 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:26.266423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0244545-51c2-4836-bae2-3c8b26417401 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:26.417656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:26.418644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:26.419193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:26.419957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] PATH_INFO: `/v3/projects/b24b295fa68544209069d621d058187e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:26.423366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24b295fa68544209069d621d058187e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:26.425752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:26.482517 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:26.571388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24b295fa68544209069d621d058187e', 'request_id': 'req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:26.585274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24b295fa68544209069d621d058187e', 'request_id': 'req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:26.599154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24b295fa68544209069d621d058187e', 'request_id': 'req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:26.637534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] The token cache is being invalidate because project b24b295fa68544209069d621d058187e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:38:26.638385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:26.639436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:26.641430 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3946/7837] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:38:26 2022] DELETE /identity/v3/projects/b24b295fa68544209069d621d058187e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:26.645915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:26.648270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:26.667638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3857df-6490-4651-8e8c-3ead9d573a47 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:26.753959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2701b8-d53a-494d-819d-20a3291f32a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:26.754613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2701b8-d53a-494d-819d-20a3291f32a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:26.754895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2701b8-d53a-494d-819d-20a3291f32a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:26.755250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2701b8-d53a-494d-819d-20a3291f32a8 admin admin] PATH_INFO: `/v3/users/1bced1656a3344968447b4152d7bec15` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:26.758638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2701b8-d53a-494d-819d-20a3291f32a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bced1656a3344968447b4152d7bec15)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:26.760917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2701b8-d53a-494d-819d-20a3291f32a8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:26.839710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a2701b8-d53a-494d-819d-20a3291f32a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bced1656a3344968447b4152d7bec15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:26.841365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a2701b8-d53a-494d-819d-20a3291f32a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bced1656a3344968447b4152d7bec15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:26.867803 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a2701b8-d53a-494d-819d-20a3291f32a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bced1656a3344968447b4152d7bec15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:26.881043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a2701b8-d53a-494d-819d-20a3291f32a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bced1656a3344968447b4152d7bec15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:26.881043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a2701b8-d53a-494d-819d-20a3291f32a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bced1656a3344968447b4152d7bec15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:26.910095 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3892/7838] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:38:26 2022] DELETE /identity/v3/users/1bced1656a3344968447b4152d7bec15 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:27.156193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:27.159466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:27.196685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f6a63-1034-4a7c-951e-e4a9a7a19916 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:27.297114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106702a2-4057-4be8-81e5-0ff4dc208645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:27.298704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106702a2-4057-4be8-81e5-0ff4dc208645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:27.299310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106702a2-4057-4be8-81e5-0ff4dc208645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:27.299783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106702a2-4057-4be8-81e5-0ff4dc208645 admin admin] PATH_INFO: `/v3/projects/2f9ad54a91194b49823b9b4a704cb546` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:27.301423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106702a2-4057-4be8-81e5-0ff4dc208645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9ad54a91194b49823b9b4a704cb546)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:27.303718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106702a2-4057-4be8-81e5-0ff4dc208645 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:27.370437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-106702a2-4057-4be8-81e5-0ff4dc208645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9ad54a91194b49823b9b4a704cb546', 'request_id': 'req-106702a2-4057-4be8-81e5-0ff4dc208645'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:27.387491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-106702a2-4057-4be8-81e5-0ff4dc208645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9ad54a91194b49823b9b4a704cb546', 'request_id': 'req-106702a2-4057-4be8-81e5-0ff4dc208645'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:27.406784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-106702a2-4057-4be8-81e5-0ff4dc208645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9ad54a91194b49823b9b4a704cb546', 'request_id': 'req-106702a2-4057-4be8-81e5-0ff4dc208645'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:27.432190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-106702a2-4057-4be8-81e5-0ff4dc208645 admin admin] The token cache is being invalidate because project 2f9ad54a91194b49823b9b4a704cb546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:38:27.432474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-106702a2-4057-4be8-81e5-0ff4dc208645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:27.434095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-106702a2-4057-4be8-81e5-0ff4dc208645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:27.444808 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3947/7839] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:38:27 2022] DELETE /identity/v3/projects/2f9ad54a91194b49823b9b4a704cb546 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:27.446722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268558-a3d2-41e1-a0f9-2cd2bbaeee34 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:27.447037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268558-a3d2-41e1-a0f9-2cd2bbaeee34 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:27.447316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268558-a3d2-41e1-a0f9-2cd2bbaeee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:27.516105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ff268558-a3d2-41e1-a0f9-2cd2bbaeee34 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:27.517319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ff268558-a3d2-41e1-a0f9-2cd2bbaeee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:27.667788 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3893/7840] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:27.691480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d5b97-8153-48c5-addc-b0b47c84af68 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:27.691769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d5b97-8153-48c5-addc-b0b47c84af68 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:27.692049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d5b97-8153-48c5-addc-b0b47c84af68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:27.729855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9b7d5b97-8153-48c5-addc-b0b47c84af68 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:27.731544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9b7d5b97-8153-48c5-addc-b0b47c84af68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:27.742565 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3948/7841] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:27.746254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff268558-a3d2-41e1-a0f9-2cd2bbaeee34 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:27.753560 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:27.759854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff268558-a3d2-41e1-a0f9-2cd2bbaeee34 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:27.767442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be136a-de8f-4bbe-aff6-3c6a12bc7601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:27.768263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be136a-de8f-4bbe-aff6-3c6a12bc7601 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:27.768921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be136a-de8f-4bbe-aff6-3c6a12bc7601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:27.769501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be136a-de8f-4bbe-aff6-3c6a12bc7601 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:27.770904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be136a-de8f-4bbe-aff6-3c6a12bc7601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:38:27.771452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be136a-de8f-4bbe-aff6-3c6a12bc7601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:27.773343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be136a-de8f-4bbe-aff6-3c6a12bc7601 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:27.799648 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3894/7842] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:38:27.803663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d5b97-8153-48c5-addc-b0b47c84af68 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:27.817092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d5b97-8153-48c5-addc-b0b47c84af68 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:27.824858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472add3-7b72-4e10-836f-6413b47e3423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:27.825596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472add3-7b72-4e10-836f-6413b47e3423 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:27.826147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472add3-7b72-4e10-836f-6413b47e3423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:27.826828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472add3-7b72-4e10-836f-6413b47e3423 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:27.827840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472add3-7b72-4e10-836f-6413b47e3423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:27.830485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472add3-7b72-4e10-836f-6413b47e3423 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:27.876799 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3949/7843] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:38:27 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:38:27.881353 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be136a-de8f-4bbe-aff6-3c6a12bc7601 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:27.896971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be136a-de8f-4bbe-aff6-3c6a12bc7601 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:27.997248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc4a50-a708-4418-aec7-42bc0714d7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:27.997248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc4a50-a708-4418-aec7-42bc0714d7ff admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:27.997248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc4a50-a708-4418-aec7-42bc0714d7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:27.997248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc4a50-a708-4418-aec7-42bc0714d7ff admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:27.997779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc4a50-a708-4418-aec7-42bc0714d7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:27.999897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc4a50-a708-4418-aec7-42bc0714d7ff admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:28.045605 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3895/7844] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:38:27 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:38:28.049680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472add3-7b72-4e10-836f-6413b47e3423 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:28.058909 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:28.064420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472add3-7b72-4e10-836f-6413b47e3423 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:28.070652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd75f8-b25a-4448-9860-fd1a7a8687e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:28.071983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd75f8-b25a-4448-9860-fd1a7a8687e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:28.072409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd75f8-b25a-4448-9860-fd1a7a8687e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:28.073043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd75f8-b25a-4448-9860-fd1a7a8687e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:28.074523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd75f8-b25a-4448-9860-fd1a7a8687e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:28.077496 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd75f8-b25a-4448-9860-fd1a7a8687e8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:28.097210 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3950/7845] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:38:28.103106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc4a50-a708-4418-aec7-42bc0714d7ff admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:28.139382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc4a50-a708-4418-aec7-42bc0714d7ff admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:28.152751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff102f8-1e5d-4679-9062-1fa1a355a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:28.153587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff102f8-1e5d-4679-9062-1fa1a355a4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:28.156042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff102f8-1e5d-4679-9062-1fa1a355a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:28.156745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff102f8-1e5d-4679-9062-1fa1a355a4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:28.158518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff102f8-1e5d-4679-9062-1fa1a355a4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:28.162245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff102f8-1e5d-4679-9062-1fa1a355a4b3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:28.193141 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3896/7846] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:38:28.195128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd75f8-b25a-4448-9860-fd1a7a8687e8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:28.227426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd75f8-b25a-4448-9860-fd1a7a8687e8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:28.236774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167b9ad-2898-4ece-be49-f32664cda965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:28.237462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167b9ad-2898-4ece-be49-f32664cda965 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:28.237745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167b9ad-2898-4ece-be49-f32664cda965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:28.238017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167b9ad-2898-4ece-be49-f32664cda965 admin admin] PATH_INFO: `/v3/projects/8eda337f3d1440489b32ada0eb50e9ea/users/2eabe99e40ef44a09c3f7dc1c78d7608/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:28.277627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167b9ad-2898-4ece-be49-f32664cda965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eda337f3d1440489b32ada0eb50e9ea, user_id=2eabe99e40ef44a09c3f7dc1c78d7608, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:28.280452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167b9ad-2898-4ece-be49-f32664cda965 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:28.310743 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3951/7847] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:38:28 2022] PUT /identity/v3/projects/8eda337f3d1440489b32ada0eb50e9ea/users/2eabe99e40ef44a09c3f7dc1c78d7608/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:28.313060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d9fa4-d157-4c15-bd94-b07a431da1b0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:28.313349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d9fa4-d157-4c15-bd94-b07a431da1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:28.313624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d9fa4-d157-4c15-bd94-b07a431da1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:28.378881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8f0d9fa4-d157-4c15-bd94-b07a431da1b0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:28.385210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8f0d9fa4-d157-4c15-bd94-b07a431da1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:28.594379 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3897/7848] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:28.604975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167b9ad-2898-4ece-be49-f32664cda965 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:28.606747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3167b9ad-2898-4ece-be49-f32664cda965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:28.809935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167b9ad-2898-4ece-be49-f32664cda965 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:28.827665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b8455-d3e6-42b4-8288-129b1e9b02c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:28.828591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b8455-d3e6-42b4-8288-129b1e9b02c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:28.828851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b8455-d3e6-42b4-8288-129b1e9b02c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:28.829129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b8455-d3e6-42b4-8288-129b1e9b02c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:28.848128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b8455-d3e6-42b4-8288-129b1e9b02c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:28.855883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b8455-d3e6-42b4-8288-129b1e9b02c2 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:28.883336 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3952/7849] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:38:33.744093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d9fa4-d157-4c15-bd94-b07a431da1b0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:33.746285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8f0d9fa4-d157-4c15-bd94-b07a431da1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:33.769950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d9fa4-d157-4c15-bd94-b07a431da1b0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:33.783438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:33.784120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:33.784456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:33.784732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] PATH_INFO: `/v3/users/546c615defb6447ebea66cf0b2c8f067` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:33.796966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546c615defb6447ebea66cf0b2c8f067)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:33.799136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:33.972425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546c615defb6447ebea66cf0b2c8f067'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:33.973137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546c615defb6447ebea66cf0b2c8f067'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:34.014731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546c615defb6447ebea66cf0b2c8f067'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:34.016883 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:34.033442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546c615defb6447ebea66cf0b2c8f067'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:34.033676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546c615defb6447ebea66cf0b2c8f067'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:34.103817 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3898/7850] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:38:33 2022] DELETE /identity/v3/users/546c615defb6447ebea66cf0b2c8f067 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:34.109768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a445a5d-030f-448b-a2ee-d543ac690c02 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:34.111093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a445a5d-030f-448b-a2ee-d543ac690c02 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:34.111533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a445a5d-030f-448b-a2ee-d543ac690c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:34.153167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2a445a5d-030f-448b-a2ee-d543ac690c02 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:34.160716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2a445a5d-030f-448b-a2ee-d543ac690c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:34.413967 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3953/7851] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:34.419922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:34.421427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:34.621087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ae34c-de13-4105-891e-e2cfbccc2c44 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:34.632568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84755a-2650-4acc-b6b7-2768a87e7eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:34.633240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84755a-2650-4acc-b6b7-2768a87e7eca service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:34.634736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84755a-2650-4acc-b6b7-2768a87e7eca service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:34.635113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84755a-2650-4acc-b6b7-2768a87e7eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:34.661567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84755a-2650-4acc-b6b7-2768a87e7eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:34.663782 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84755a-2650-4acc-b6b7-2768a87e7eca service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:34.704442 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3899/7852] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:38:36.149602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a445a5d-030f-448b-a2ee-d543ac690c02 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:36.151339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2a445a5d-030f-448b-a2ee-d543ac690c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:36.181427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a445a5d-030f-448b-a2ee-d543ac690c02 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:36.198096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:36.199025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:36.203426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:36.203902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] PATH_INFO: `/v3/projects/22b55a98a2384d51bad21d5c7915e862` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:36.205924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b55a98a2384d51bad21d5c7915e862)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:36.208106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:36.290833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b55a98a2384d51bad21d5c7915e862', 'request_id': 'req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:36.298808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b55a98a2384d51bad21d5c7915e862', 'request_id': 'req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:36.311088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b55a98a2384d51bad21d5c7915e862', 'request_id': 'req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:36.322807 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:36.338656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84755a-2650-4acc-b6b7-2768a87e7eca service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:36.340639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8c84755a-2650-4acc-b6b7-2768a87e7eca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:36.352181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] The token cache is being invalidate because project 22b55a98a2384d51bad21d5c7915e862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:38:36.352830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:36.353763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:36.358374 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3954/7853] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:38:36 2022] DELETE /identity/v3/projects/22b55a98a2384d51bad21d5c7915e862 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:36.362443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:36.364192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:36.565223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3159c-d6b9-4f25-8f74-f2bf5ba6e3f5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:36.570156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a8e0b-2a7f-47cc-8b13-d687cfbdb88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:36.574114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a8e0b-2a7f-47cc-8b13-d687cfbdb88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:36.574418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a8e0b-2a7f-47cc-8b13-d687cfbdb88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:36.574687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a8e0b-2a7f-47cc-8b13-d687cfbdb88a admin admin] PATH_INFO: `/v3/users/99e2655dedfa49c1a1622bdf76d00f04` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:36.576579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a8e0b-2a7f-47cc-8b13-d687cfbdb88a admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e2655dedfa49c1a1622bdf76d00f04)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:36.579573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a8e0b-2a7f-47cc-8b13-d687cfbdb88a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:36.585828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84755a-2650-4acc-b6b7-2768a87e7eca service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:36.746247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c419e9-39c0-4926-a7ee-3d2d5d840479 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:36.747023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c419e9-39c0-4926-a7ee-3d2d5d840479 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:36.748554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c419e9-39c0-4926-a7ee-3d2d5d840479 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:36.749536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c419e9-39c0-4926-a7ee-3d2d5d840479 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:36.754518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-28c419e9-39c0-4926-a7ee-3d2d5d840479 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:36.775775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-192a8e0b-2a7f-47cc-8b13-d687cfbdb88a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e2655dedfa49c1a1622bdf76d00f04'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:36.776597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-192a8e0b-2a7f-47cc-8b13-d687cfbdb88a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e2655dedfa49c1a1622bdf76d00f04'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:36.791874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c419e9-39c0-4926-a7ee-3d2d5d840479 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:36.795633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c419e9-39c0-4926-a7ee-3d2d5d840479 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:36.803762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-192a8e0b-2a7f-47cc-8b13-d687cfbdb88a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e2655dedfa49c1a1622bdf76d00f04'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:36.816852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-192a8e0b-2a7f-47cc-8b13-d687cfbdb88a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e2655dedfa49c1a1622bdf76d00f04'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:36.817790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-192a8e0b-2a7f-47cc-8b13-d687cfbdb88a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e2655dedfa49c1a1622bdf76d00f04'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:36.831195 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3900/7854] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:38:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:38:36.874102 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3955/7855] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:38:36 2022] DELETE /identity/v3/users/99e2655dedfa49c1a1622bdf76d00f04 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:37.532624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c419e9-39c0-4926-a7ee-3d2d5d840479 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:37.571858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c419e9-39c0-4926-a7ee-3d2d5d840479 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:37.589787 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:37.706582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea1d11-6ecc-445b-91a3-0f22650133f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:37.707274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1d11-6ecc-445b-91a3-0f22650133f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:37.707552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1d11-6ecc-445b-91a3-0f22650133f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:37.707881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1d11-6ecc-445b-91a3-0f22650133f4 admin admin] PATH_INFO: `/v3/projects/47ede506015540f2a9e53e6f2dc680d0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:37.709489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea1d11-6ecc-445b-91a3-0f22650133f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47ede506015540f2a9e53e6f2dc680d0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:37.711781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea1d11-6ecc-445b-91a3-0f22650133f4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:37.804255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2ea1d11-6ecc-445b-91a3-0f22650133f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47ede506015540f2a9e53e6f2dc680d0', 'request_id': 'req-e2ea1d11-6ecc-445b-91a3-0f22650133f4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:37.819799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2ea1d11-6ecc-445b-91a3-0f22650133f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47ede506015540f2a9e53e6f2dc680d0', 'request_id': 'req-e2ea1d11-6ecc-445b-91a3-0f22650133f4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:37.843386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2ea1d11-6ecc-445b-91a3-0f22650133f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47ede506015540f2a9e53e6f2dc680d0', 'request_id': 'req-e2ea1d11-6ecc-445b-91a3-0f22650133f4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:37.865192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2ea1d11-6ecc-445b-91a3-0f22650133f4 admin admin] The token cache is being invalidate because project 47ede506015540f2a9e53e6f2dc680d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:38:37.865494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2ea1d11-6ecc-445b-91a3-0f22650133f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:37.867330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e2ea1d11-6ecc-445b-91a3-0f22650133f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:37.877072 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3901/7856] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:38:37 2022] DELETE /identity/v3/projects/47ede506015540f2a9e53e6f2dc680d0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:37.878894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21058fff-9a8c-42dc-aca3-e2180ec14d0b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:37.879521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21058fff-9a8c-42dc-aca3-e2180ec14d0b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:37.879754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21058fff-9a8c-42dc-aca3-e2180ec14d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:37.961512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-21058fff-9a8c-42dc-aca3-e2180ec14d0b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:37.965951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-21058fff-9a8c-42dc-aca3-e2180ec14d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:38.136132 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3956/7857] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:38.137828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b8a1e-09c4-45ab-87e7-82dbdb666314 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:38.138932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b8a1e-09c4-45ab-87e7-82dbdb666314 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:38.139628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b8a1e-09c4-45ab-87e7-82dbdb666314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:38.187371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0b1b8a1e-09c4-45ab-87e7-82dbdb666314 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:38.189556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0b1b8a1e-09c4-45ab-87e7-82dbdb666314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:38.213312 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3902/7858] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:38.214619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21058fff-9a8c-42dc-aca3-e2180ec14d0b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:38.233751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21058fff-9a8c-42dc-aca3-e2180ec14d0b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:38.256771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48af5b9-7cb5-450f-8107-1d9420488fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:38.257931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48af5b9-7cb5-450f-8107-1d9420488fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:38.258405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48af5b9-7cb5-450f-8107-1d9420488fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:38.258796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48af5b9-7cb5-450f-8107-1d9420488fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:38.259871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48af5b9-7cb5-450f-8107-1d9420488fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:38:38.261132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48af5b9-7cb5-450f-8107-1d9420488fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:38.265689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48af5b9-7cb5-450f-8107-1d9420488fa4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:38.299185 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3957/7859] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:38:38.300620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b8a1e-09c4-45ab-87e7-82dbdb666314 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:38.316742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b8a1e-09c4-45ab-87e7-82dbdb666314 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:38.334233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e585dd-5802-45ec-8769-5769e27a878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:38.338126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e585dd-5802-45ec-8769-5769e27a878d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:38.338407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e585dd-5802-45ec-8769-5769e27a878d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:38.338744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e585dd-5802-45ec-8769-5769e27a878d admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:38.340201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e585dd-5802-45ec-8769-5769e27a878d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:38.347070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e585dd-5802-45ec-8769-5769e27a878d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:38.394935 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3903/7860] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:38:38 2022] POST /identity/v3/projects => generated 361 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:38:38.396728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48af5b9-7cb5-450f-8107-1d9420488fa4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:38.402822 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:38.441689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48af5b9-7cb5-450f-8107-1d9420488fa4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:38.677178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c29e2-7acf-48c6-89e2-7b3dbaa8edcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:38.678797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c29e2-7acf-48c6-89e2-7b3dbaa8edcf admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:38.679689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c29e2-7acf-48c6-89e2-7b3dbaa8edcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:38.680170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c29e2-7acf-48c6-89e2-7b3dbaa8edcf admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:38.699219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c29e2-7acf-48c6-89e2-7b3dbaa8edcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:38.715528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c29e2-7acf-48c6-89e2-7b3dbaa8edcf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:38.755887 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3958/7861] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:38:38 2022] POST /identity/v3/users => generated 281 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:38:38.757169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e585dd-5802-45ec-8769-5769e27a878d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:38.775883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e585dd-5802-45ec-8769-5769e27a878d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:38.788797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75bd46-c08f-4a9f-8799-20bd9749bc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:38.789426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75bd46-c08f-4a9f-8799-20bd9749bc9f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:38.789705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75bd46-c08f-4a9f-8799-20bd9749bc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:38.790022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75bd46-c08f-4a9f-8799-20bd9749bc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:38.791007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75bd46-c08f-4a9f-8799-20bd9749bc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:38.795484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75bd46-c08f-4a9f-8799-20bd9749bc9f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:38.821788 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3904/7862] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:38:38.825894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c29e2-7acf-48c6-89e2-7b3dbaa8edcf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:38.838967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c29e2-7acf-48c6-89e2-7b3dbaa8edcf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:38.849426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdc512-2d0d-43de-ad29-0755a482268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:38.850137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdc512-2d0d-43de-ad29-0755a482268d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:38.850493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdc512-2d0d-43de-ad29-0755a482268d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:38.851080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdc512-2d0d-43de-ad29-0755a482268d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:38.851853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdc512-2d0d-43de-ad29-0755a482268d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:38.853538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdc512-2d0d-43de-ad29-0755a482268d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:38.882735 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3959/7863] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:38:38.890929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75bd46-c08f-4a9f-8799-20bd9749bc9f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:38.912501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75bd46-c08f-4a9f-8799-20bd9749bc9f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:38.924826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2793f4f-cf18-4238-93e9-00b760f3042d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:38.925898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2793f4f-cf18-4238-93e9-00b760f3042d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:38.926552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2793f4f-cf18-4238-93e9-00b760f3042d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:38.927214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2793f4f-cf18-4238-93e9-00b760f3042d admin admin] PATH_INFO: `/v3/projects/8fe6715a414342bab0ae98fbeaad63ae/users/9ad85d503fc040679d2c31d52a4b4c65/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:38.970328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2793f4f-cf18-4238-93e9-00b760f3042d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe6715a414342bab0ae98fbeaad63ae, user_id=9ad85d503fc040679d2c31d52a4b4c65, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:38.973209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2793f4f-cf18-4238-93e9-00b760f3042d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:38.994251 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3905/7864] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:38:38 2022] PUT /identity/v3/projects/8fe6715a414342bab0ae98fbeaad63ae/users/9ad85d503fc040679d2c31d52a4b4c65/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:39.004648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89b0af-50e4-4143-ba08-3b32adf79325 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:39.004974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89b0af-50e4-4143-ba08-3b32adf79325 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:39.005196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89b0af-50e4-4143-ba08-3b32adf79325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:39.081661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8d89b0af-50e4-4143-ba08-3b32adf79325 None None] MFA Rules not processed for user `9ad85d503fc040679d2c31d52a4b4c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:39.083642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8d89b0af-50e4-4143-ba08-3b32adf79325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:39.337630 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3960/7865] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:39.458469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2793f4f-cf18-4238-93e9-00b760f3042d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:39.460801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e2793f4f-cf18-4238-93e9-00b760f3042d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:39.577502 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:39.651736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2793f4f-cf18-4238-93e9-00b760f3042d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:39.671447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a4730-2b54-4e07-90c4-eab14999867a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:39.672165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a4730-2b54-4e07-90c4-eab14999867a service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:39.672449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a4730-2b54-4e07-90c4-eab14999867a service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:39.672721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a4730-2b54-4e07-90c4-eab14999867a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:39.697740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a4730-2b54-4e07-90c4-eab14999867a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:39.699591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a4730-2b54-4e07-90c4-eab14999867a service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:39.722560 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3906/7866] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:38:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:38:39.746293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a4730-2b54-4e07-90c4-eab14999867a service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:39.747403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce5b8-e823-4fdd-a545-68b1d4c0359d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:39.748839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce5b8-e823-4fdd-a545-68b1d4c0359d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:39.749305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce5b8-e823-4fdd-a545-68b1d4c0359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:39.823110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-490ce5b8-e823-4fdd-a545-68b1d4c0359d None None] MFA Rules not processed for user `2eabe99e40ef44a09c3f7dc1c78d7608`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:39.839562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-490ce5b8-e823-4fdd-a545-68b1d4c0359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:39.897912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a4730-2b54-4e07-90c4-eab14999867a service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:39.914251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef088a-c26f-4b13-8c88-3fd348ffd77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:39.914852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef088a-c26f-4b13-8c88-3fd348ffd77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:39.915196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef088a-c26f-4b13-8c88-3fd348ffd77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:39.915472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef088a-c26f-4b13-8c88-3fd348ffd77c admin admin] PATH_INFO: `/v3/users/9ad85d503fc040679d2c31d52a4b4c65` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:39.917893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef088a-c26f-4b13-8c88-3fd348ffd77c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad85d503fc040679d2c31d52a4b4c65)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:39.924052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef088a-c26f-4b13-8c88-3fd348ffd77c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:39.982753 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:39.991758 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3961/7867] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:39.995982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce5b8-e823-4fdd-a545-68b1d4c0359d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:40.000504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-490ce5b8-e823-4fdd-a545-68b1d4c0359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:40.046218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce5b8-e823-4fdd-a545-68b1d4c0359d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:40.064345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6eef088a-c26f-4b13-8c88-3fd348ffd77c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad85d503fc040679d2c31d52a4b4c65'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:40.066077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6eef088a-c26f-4b13-8c88-3fd348ffd77c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad85d503fc040679d2c31d52a4b4c65'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:40.082995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61468a2-a433-4754-b2f7-db9a29ce56c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:40.084426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61468a2-a433-4754-b2f7-db9a29ce56c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:40.086153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61468a2-a433-4754-b2f7-db9a29ce56c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:40.101391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6eef088a-c26f-4b13-8c88-3fd348ffd77c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad85d503fc040679d2c31d52a4b4c65'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:40.105314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61468a2-a433-4754-b2f7-db9a29ce56c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:40.108218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61468a2-a433-4754-b2f7-db9a29ce56c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:40.116113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61468a2-a433-4754-b2f7-db9a29ce56c5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:40.125342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6eef088a-c26f-4b13-8c88-3fd348ffd77c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad85d503fc040679d2c31d52a4b4c65'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:40.126108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6eef088a-c26f-4b13-8c88-3fd348ffd77c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad85d503fc040679d2c31d52a4b4c65'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:40.156440 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3907/7868] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:38:39 2022] DELETE /identity/v3/users/9ad85d503fc040679d2c31d52a4b4c65 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:40.160560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95540b27-8b79-478c-a354-409865b0a404 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:40.161729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95540b27-8b79-478c-a354-409865b0a404 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:40.161729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95540b27-8b79-478c-a354-409865b0a404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:40.213138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-95540b27-8b79-478c-a354-409865b0a404 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:40.215522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-95540b27-8b79-478c-a354-409865b0a404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:40.240182 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3962/7869] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:38:39 2022] POST /identity/v3/projects => generated 379 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:38:40.244559 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61468a2-a433-4754-b2f7-db9a29ce56c5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:40.247763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e61468a2-a433-4754-b2f7-db9a29ce56c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:40.338892 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:40.366490 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3908/7870] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:40.378614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95540b27-8b79-478c-a354-409865b0a404 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:40.378940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61468a2-a433-4754-b2f7-db9a29ce56c5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:40.380751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-95540b27-8b79-478c-a354-409865b0a404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:40.385158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bddbb-6f74-4cfc-a4cd-f7da31d18f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:40.386004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bddbb-6f74-4cfc-a4cd-f7da31d18f7a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:40.386441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bddbb-6f74-4cfc-a4cd-f7da31d18f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:40.387200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bddbb-6f74-4cfc-a4cd-f7da31d18f7a admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:40.389200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bddbb-6f74-4cfc-a4cd-f7da31d18f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:40.391856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bddbb-6f74-4cfc-a4cd-f7da31d18f7a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:40.437010 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3963/7871] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:38:40 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:38:40.440926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bddbb-6f74-4cfc-a4cd-f7da31d18f7a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:40.458084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bddbb-6f74-4cfc-a4cd-f7da31d18f7a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:40.477515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53785d8-2459-4a1d-afbf-e73aad8f4b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:40.477515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53785d8-2459-4a1d-afbf-e73aad8f4b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:40.477720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53785d8-2459-4a1d-afbf-e73aad8f4b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:40.477871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53785d8-2459-4a1d-afbf-e73aad8f4b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:40.478618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53785d8-2459-4a1d-afbf-e73aad8f4b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:40.480792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53785d8-2459-4a1d-afbf-e73aad8f4b44 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:40.521573 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3964/7872] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:38:40.523255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53785d8-2459-4a1d-afbf-e73aad8f4b44 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:40.535564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95540b27-8b79-478c-a354-409865b0a404 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:40.547456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53785d8-2459-4a1d-afbf-e73aad8f4b44 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:40.594064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3771f-70e1-4776-9885-602c299ac649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:40.594834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3771f-70e1-4776-9885-602c299ac649 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:40.595202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3771f-70e1-4776-9885-602c299ac649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:40.595573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3771f-70e1-4776-9885-602c299ac649 admin admin] PATH_INFO: `/v3/projects/c67631f6e2664762b3689c20f9ae7bf5/users/1817ed42d6bd476895afd6de5a8b21ff/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:40.610540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540e17-590f-4689-a81f-20bd02f769cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:40.611250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540e17-590f-4689-a81f-20bd02f769cf service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:40.611564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540e17-590f-4689-a81f-20bd02f769cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:40.611836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540e17-590f-4689-a81f-20bd02f769cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:40.621974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47540e17-590f-4689-a81f-20bd02f769cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:40.624161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47540e17-590f-4689-a81f-20bd02f769cf service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:40.625234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3771f-70e1-4776-9885-602c299ac649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67631f6e2664762b3689c20f9ae7bf5, user_id=1817ed42d6bd476895afd6de5a8b21ff, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:40.628266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3771f-70e1-4776-9885-602c299ac649 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:40.635452 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3909/7873] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:38:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:38:40.662883 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3965/7874] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:38:40 2022] PUT /identity/v3/projects/c67631f6e2664762b3689c20f9ae7bf5/users/1817ed42d6bd476895afd6de5a8b21ff/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:38:40.664336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540e17-590f-4689-a81f-20bd02f769cf service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:40.680117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540e17-590f-4689-a81f-20bd02f769cf service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:40.772442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c16bb-b45a-423a-a80e-cb913e9a021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:40.773452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c16bb-b45a-423a-a80e-cb913e9a021d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:40.773966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c16bb-b45a-423a-a80e-cb913e9a021d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:40.774584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c16bb-b45a-423a-a80e-cb913e9a021d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:40.775524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c16bb-b45a-423a-a80e-cb913e9a021d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:40.777760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c16bb-b45a-423a-a80e-cb913e9a021d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:40.798964 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3910/7875] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:38:40.801523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3771f-70e1-4776-9885-602c299ac649 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:40.822874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3771f-70e1-4776-9885-602c299ac649 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:40.830780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcea59b-3161-4fd4-906d-e4c495007837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:40.833080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcea59b-3161-4fd4-906d-e4c495007837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:40.833722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcea59b-3161-4fd4-906d-e4c495007837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:40.833933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcea59b-3161-4fd4-906d-e4c495007837 admin admin] PATH_INFO: `/v3/projects/c67631f6e2664762b3689c20f9ae7bf5/users/1817ed42d6bd476895afd6de5a8b21ff/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:40.837686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcea59b-3161-4fd4-906d-e4c495007837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67631f6e2664762b3689c20f9ae7bf5, user_id=1817ed42d6bd476895afd6de5a8b21ff, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:40.841908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcea59b-3161-4fd4-906d-e4c495007837 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:40.871208 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3966/7876] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:38:40 2022] PUT /identity/v3/projects/c67631f6e2664762b3689c20f9ae7bf5/users/1817ed42d6bd476895afd6de5a8b21ff/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:38:41.079779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c16bb-b45a-423a-a80e-cb913e9a021d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:41.082259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2c7c16bb-b45a-423a-a80e-cb913e9a021d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:41.110272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c16bb-b45a-423a-a80e-cb913e9a021d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:41.264673 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:41.300381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:41.301300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:41.301761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:41.302213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7 admin admin] PATH_INFO: `/v3/projects/8fe6715a414342bab0ae98fbeaad63ae` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:41.304314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe6715a414342bab0ae98fbeaad63ae)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:41.307865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:41.412234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe6715a414342bab0ae98fbeaad63ae', 'request_id': 'req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:41.425098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe6715a414342bab0ae98fbeaad63ae', 'request_id': 'req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:41.438910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe6715a414342bab0ae98fbeaad63ae', 'request_id': 'req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:41.455856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7 admin admin] The token cache is being invalidate because project 8fe6715a414342bab0ae98fbeaad63ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:38:41.456577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:41.457600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7fcd8b60-9132-41d7-85a2-ff05fa1f07f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:41.460371 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3911/7877] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:38:41 2022] DELETE /identity/v3/projects/8fe6715a414342bab0ae98fbeaad63ae => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:41.464943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cae207-00cb-45de-9b00-dc532dcaa245 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:41.465428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cae207-00cb-45de-9b00-dc532dcaa245 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:41.465523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cae207-00cb-45de-9b00-dc532dcaa245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:41.511820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-85cae207-00cb-45de-9b00-dc532dcaa245 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:41.513089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-85cae207-00cb-45de-9b00-dc532dcaa245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:41.660577 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3967/7878] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:41.669842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31372dcb-7bfc-4cf1-b27a-12bc4c3b78de None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:41.670167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31372dcb-7bfc-4cf1-b27a-12bc4c3b78de None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:41.670681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31372dcb-7bfc-4cf1-b27a-12bc4c3b78de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:41.724088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-31372dcb-7bfc-4cf1-b27a-12bc4c3b78de None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:41.725402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-31372dcb-7bfc-4cf1-b27a-12bc4c3b78de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:41.770413 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3912/7879] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:38:41.772572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cae207-00cb-45de-9b00-dc532dcaa245 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:41.828507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cae207-00cb-45de-9b00-dc532dcaa245 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:41.869695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba58ff1-3d14-4d6d-88bd-66143edcbbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:41.870343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba58ff1-3d14-4d6d-88bd-66143edcbbaa admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:41.870626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba58ff1-3d14-4d6d-88bd-66143edcbbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:41.870904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba58ff1-3d14-4d6d-88bd-66143edcbbaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:41.871637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba58ff1-3d14-4d6d-88bd-66143edcbbaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:38:41.871978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba58ff1-3d14-4d6d-88bd-66143edcbbaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:41.873858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba58ff1-3d14-4d6d-88bd-66143edcbbaa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:41.912779 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3968/7880] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:38:41.921179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31372dcb-7bfc-4cf1-b27a-12bc4c3b78de None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:41.940092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31372dcb-7bfc-4cf1-b27a-12bc4c3b78de None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:41.964906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046c19c-1c1f-405f-be1f-a222d601d70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:41.965589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c19c-1c1f-405f-be1f-a222d601d70a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:41.965870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c19c-1c1f-405f-be1f-a222d601d70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:41.966149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c19c-1c1f-405f-be1f-a222d601d70a admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:41.966837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046c19c-1c1f-405f-be1f-a222d601d70a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:41.980045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046c19c-1c1f-405f-be1f-a222d601d70a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:42.081711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba58ff1-3d14-4d6d-88bd-66143edcbbaa admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:42.085632 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3913/7881] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:38:41 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:38:42.096322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba58ff1-3d14-4d6d-88bd-66143edcbbaa admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:42.101413 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:42.192109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085aa21-95ab-4e92-975c-16960751711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:42.194159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085aa21-95ab-4e92-975c-16960751711a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:42.194592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085aa21-95ab-4e92-975c-16960751711a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:42.195643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085aa21-95ab-4e92-975c-16960751711a admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:42.196696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085aa21-95ab-4e92-975c-16960751711a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:42.198842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085aa21-95ab-4e92-975c-16960751711a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:42.251536 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3969/7882] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:38:42 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:38:42.252825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046c19c-1c1f-405f-be1f-a222d601d70a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:42.265903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046c19c-1c1f-405f-be1f-a222d601d70a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:42.289302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212363b-239a-4034-b3ae-4bdbf2efd152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:42.289926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212363b-239a-4034-b3ae-4bdbf2efd152 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:42.290209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212363b-239a-4034-b3ae-4bdbf2efd152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:42.290475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212363b-239a-4034-b3ae-4bdbf2efd152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:42.291142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212363b-239a-4034-b3ae-4bdbf2efd152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:42.292764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212363b-239a-4034-b3ae-4bdbf2efd152 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:42.334363 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3914/7883] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:38:42.335692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085aa21-95ab-4e92-975c-16960751711a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:42.353976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085aa21-95ab-4e92-975c-16960751711a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:42.369731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c85ec-d513-4b7b-9629-0673bf0f372b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:42.370529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c85ec-d513-4b7b-9629-0673bf0f372b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:42.370980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c85ec-d513-4b7b-9629-0673bf0f372b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:42.371512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c85ec-d513-4b7b-9629-0673bf0f372b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:42.372667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c85ec-d513-4b7b-9629-0673bf0f372b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:42.375873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c85ec-d513-4b7b-9629-0673bf0f372b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:42.403529 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3970/7884] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:38:42.407593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212363b-239a-4034-b3ae-4bdbf2efd152 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:42.421817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212363b-239a-4034-b3ae-4bdbf2efd152 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:42.435457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde05d3-cd61-46c2-ae30-ecc3f9bea482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:42.436406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde05d3-cd61-46c2-ae30-ecc3f9bea482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:42.436863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde05d3-cd61-46c2-ae30-ecc3f9bea482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:42.437298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde05d3-cd61-46c2-ae30-ecc3f9bea482 admin admin] PATH_INFO: `/v3/projects/bc92c399f6144660aeb50b694c7a8d19/users/00fa83ac31d34d4cbcc1302c596841a6/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:42.468425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde05d3-cd61-46c2-ae30-ecc3f9bea482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc92c399f6144660aeb50b694c7a8d19, user_id=00fa83ac31d34d4cbcc1302c596841a6, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:42.471382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde05d3-cd61-46c2-ae30-ecc3f9bea482 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:42.501871 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3915/7885] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:38:42 2022] PUT /identity/v3/projects/bc92c399f6144660aeb50b694c7a8d19/users/00fa83ac31d34d4cbcc1302c596841a6/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:42.513719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f84ab-4bd7-4fba-b957-2a11fa7eb899 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:42.514435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f84ab-4bd7-4fba-b957-2a11fa7eb899 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:42.514435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f84ab-4bd7-4fba-b957-2a11fa7eb899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:42.578961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9d2f84ab-4bd7-4fba-b957-2a11fa7eb899 None None] MFA Rules not processed for user `00fa83ac31d34d4cbcc1302c596841a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:42.583449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d2f84ab-4bd7-4fba-b957-2a11fa7eb899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:42.760542 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3971/7886] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:42.764402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde05d3-cd61-46c2-ae30-ecc3f9bea482 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:42.927832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde05d3-cd61-46c2-ae30-ecc3f9bea482 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:42.940391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c271629-594d-4f15-90dc-461bd74e63b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:42.941017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c271629-594d-4f15-90dc-461bd74e63b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:42.941295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c271629-594d-4f15-90dc-461bd74e63b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:42.941567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c271629-594d-4f15-90dc-461bd74e63b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:42.942218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c271629-594d-4f15-90dc-461bd74e63b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:42.944206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c271629-594d-4f15-90dc-461bd74e63b9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:42.983173 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:43.005922 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3916/7887] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:38:42 2022] POST /identity/v3/projects => generated 373 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:38:43.009724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f84ab-4bd7-4fba-b957-2a11fa7eb899 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:43.033097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f84ab-4bd7-4fba-b957-2a11fa7eb899 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:43.198572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090288a-17dc-413f-93e6-70ded068345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:43.199191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090288a-17dc-413f-93e6-70ded068345c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:43.199658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090288a-17dc-413f-93e6-70ded068345c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:43.200089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090288a-17dc-413f-93e6-70ded068345c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:43.200963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090288a-17dc-413f-93e6-70ded068345c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:43.209228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090288a-17dc-413f-93e6-70ded068345c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:43.286991 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:43.313737 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3972/7888] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:38:43 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:38:43.316714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c271629-594d-4f15-90dc-461bd74e63b9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:43.338576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c271629-594d-4f15-90dc-461bd74e63b9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:43.369291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454c6ff-7c40-4f5b-8948-c62f708877be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:43.369925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454c6ff-7c40-4f5b-8948-c62f708877be admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:43.370440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454c6ff-7c40-4f5b-8948-c62f708877be admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:43.370884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454c6ff-7c40-4f5b-8948-c62f708877be admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:43.371733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454c6ff-7c40-4f5b-8948-c62f708877be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:43.373410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454c6ff-7c40-4f5b-8948-c62f708877be admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:43.437718 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3917/7889] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:38:43.442707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090288a-17dc-413f-93e6-70ded068345c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:43.458115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090288a-17dc-413f-93e6-70ded068345c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:43.473219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7a198-bf27-4b7b-a024-951ad8e9eb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:43.474060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7a198-bf27-4b7b-a024-951ad8e9eb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:43.474444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7a198-bf27-4b7b-a024-951ad8e9eb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:43.474992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7a198-bf27-4b7b-a024-951ad8e9eb8f admin admin] PATH_INFO: `/v3/projects/b93c77a3af874518ba66cece5fec2368/users/f7c56701931e45f4961cce110dd60a79/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:43.532256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7a198-bf27-4b7b-a024-951ad8e9eb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93c77a3af874518ba66cece5fec2368, user_id=f7c56701931e45f4961cce110dd60a79, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:43.537516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7a198-bf27-4b7b-a024-951ad8e9eb8f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:43.570134 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3973/7890] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:38:43 2022] PUT /identity/v3/projects/b93c77a3af874518ba66cece5fec2368/users/f7c56701931e45f4961cce110dd60a79/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:43.574053 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454c6ff-7c40-4f5b-8948-c62f708877be admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:43.592914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454c6ff-7c40-4f5b-8948-c62f708877be admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:43.772580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c9641-1194-4230-b110-7d996fa43a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:43.773489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c9641-1194-4230-b110-7d996fa43a16 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:43.773949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c9641-1194-4230-b110-7d996fa43a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:43.774393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c9641-1194-4230-b110-7d996fa43a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:43.775216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c9641-1194-4230-b110-7d996fa43a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:43.776993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c9641-1194-4230-b110-7d996fa43a16 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:43.806744 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3918/7891] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:38:43.811144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7a198-bf27-4b7b-a024-951ad8e9eb8f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:43.837884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7a198-bf27-4b7b-a024-951ad8e9eb8f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:43.853312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3017118-3d09-44dc-8918-1027e45b63e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:43.854290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017118-3d09-44dc-8918-1027e45b63e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:43.854726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017118-3d09-44dc-8918-1027e45b63e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:43.855194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017118-3d09-44dc-8918-1027e45b63e9 admin admin] PATH_INFO: `/v3/projects/b93c77a3af874518ba66cece5fec2368/users/f7c56701931e45f4961cce110dd60a79/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:43.859118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3017118-3d09-44dc-8918-1027e45b63e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93c77a3af874518ba66cece5fec2368, user_id=f7c56701931e45f4961cce110dd60a79, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:43.862070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3017118-3d09-44dc-8918-1027e45b63e9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:43.894530 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3974/7892] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:38:43 2022] PUT /identity/v3/projects/b93c77a3af874518ba66cece5fec2368/users/f7c56701931e45f4961cce110dd60a79/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:43.905621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228a906-bd9c-4f1f-bc29-9c36cb72ef95 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:43.906200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228a906-bd9c-4f1f-bc29-9c36cb72ef95 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:43.906641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228a906-bd9c-4f1f-bc29-9c36cb72ef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:43.975449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4228a906-bd9c-4f1f-bc29-9c36cb72ef95 None None] MFA Rules not processed for user `f7c56701931e45f4961cce110dd60a79`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:43.976777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4228a906-bd9c-4f1f-bc29-9c36cb72ef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:44.130637 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3919/7893] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:44.139313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3017118-3d09-44dc-8918-1027e45b63e9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:44.150121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d3017118-3d09-44dc-8918-1027e45b63e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:44.314009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3017118-3d09-44dc-8918-1027e45b63e9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:44.322817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5e1ea-107b-44e4-b04e-1b8449454847 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:44.323654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5e1ea-107b-44e4-b04e-1b8449454847 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:44.324041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5e1ea-107b-44e4-b04e-1b8449454847 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:44.324423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5e1ea-107b-44e4-b04e-1b8449454847 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:44.490269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5e1ea-107b-44e4-b04e-1b8449454847 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:44.498100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5e1ea-107b-44e4-b04e-1b8449454847 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:44.522505 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3975/7894] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:38:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:38:54.024709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07494d-fc82-4f17-bd41-0076225d577f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:54.025597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07494d-fc82-4f17-bd41-0076225d577f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:54.026067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07494d-fc82-4f17-bd41-0076225d577f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:54.116350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bc07494d-fc82-4f17-bd41-0076225d577f None None] MFA Rules not processed for user `1817ed42d6bd476895afd6de5a8b21ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:54.117579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bc07494d-fc82-4f17-bd41-0076225d577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:54.206695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5e1ea-107b-44e4-b04e-1b8449454847 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:54.240287 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:54.290540 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3920/7895] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:54.299982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07494d-fc82-4f17-bd41-0076225d577f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:54.315587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07494d-fc82-4f17-bd41-0076225d577f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:54.325111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b638a7-5926-41a2-a08c-044bd3b1166d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:54.326367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b638a7-5926-41a2-a08c-044bd3b1166d service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:54.326619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b638a7-5926-41a2-a08c-044bd3b1166d service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:54.326887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b638a7-5926-41a2-a08c-044bd3b1166d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:54.348070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5e1ea-107b-44e4-b04e-1b8449454847 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:54.353082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b638a7-5926-41a2-a08c-044bd3b1166d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:54.354615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b638a7-5926-41a2-a08c-044bd3b1166d service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:54.376572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94236982-cd68-4394-a55a-0c6e2c7d8b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:54.377371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236982-cd68-4394-a55a-0c6e2c7d8b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:54.377767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236982-cd68-4394-a55a-0c6e2c7d8b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:54.378145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236982-cd68-4394-a55a-0c6e2c7d8b23 admin admin] PATH_INFO: `/v3/users/00fa83ac31d34d4cbcc1302c596841a6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:54.379858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94236982-cd68-4394-a55a-0c6e2c7d8b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00fa83ac31d34d4cbcc1302c596841a6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:54.388496 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3921/7896] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:38:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:38:54.403181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94236982-cd68-4394-a55a-0c6e2c7d8b23 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:54.440369 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:54.555310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-94236982-cd68-4394-a55a-0c6e2c7d8b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00fa83ac31d34d4cbcc1302c596841a6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:54.557655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-94236982-cd68-4394-a55a-0c6e2c7d8b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00fa83ac31d34d4cbcc1302c596841a6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:54.589005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-94236982-cd68-4394-a55a-0c6e2c7d8b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00fa83ac31d34d4cbcc1302c596841a6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:54.615814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b638a7-5926-41a2-a08c-044bd3b1166d service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:54.617399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-94236982-cd68-4394-a55a-0c6e2c7d8b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00fa83ac31d34d4cbcc1302c596841a6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:54.618278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-94236982-cd68-4394-a55a-0c6e2c7d8b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00fa83ac31d34d4cbcc1302c596841a6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:54.637163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b638a7-5926-41a2-a08c-044bd3b1166d service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:54.643845 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3976/7897] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:38:54 2022] DELETE /identity/v3/users/00fa83ac31d34d4cbcc1302c596841a6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:38:54.649199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0efd55-d3a6-4aa5-9371-54a702ebaa00 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:54.649578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35bc7d-e833-4279-a75d-cc70f257aca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:54.650194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35bc7d-e833-4279-a75d-cc70f257aca2 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:54.650472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35bc7d-e833-4279-a75d-cc70f257aca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:54.650742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35bc7d-e833-4279-a75d-cc70f257aca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:54.653069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0efd55-d3a6-4aa5-9371-54a702ebaa00 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:54.654774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0efd55-d3a6-4aa5-9371-54a702ebaa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:54.658026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b35bc7d-e833-4279-a75d-cc70f257aca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:54.750508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0d0efd55-d3a6-4aa5-9371-54a702ebaa00 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:54.752032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0d0efd55-d3a6-4aa5-9371-54a702ebaa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:54.791253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35bc7d-e833-4279-a75d-cc70f257aca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:54.792699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35bc7d-e833-4279-a75d-cc70f257aca2 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:54.816483 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3922/7898] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:38:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:38:54.952864 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3977/7899] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:54.962816 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35bc7d-e833-4279-a75d-cc70f257aca2 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:54.964851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b35bc7d-e833-4279-a75d-cc70f257aca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:55.295176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35bc7d-e833-4279-a75d-cc70f257aca2 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:55.429815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d996-7150-4438-885f-7e9e65f3abf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:55.432741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d996-7150-4438-885f-7e9e65f3abf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:55.433988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d996-7150-4438-885f-7e9e65f3abf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:55.434276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d996-7150-4438-885f-7e9e65f3abf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:55.476272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77d996-7150-4438-885f-7e9e65f3abf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:55.477864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77d996-7150-4438-885f-7e9e65f3abf4 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:55.507898 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3923/7900] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:38:56.277125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0efd55-d3a6-4aa5-9371-54a702ebaa00 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:56.279630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0d0efd55-d3a6-4aa5-9371-54a702ebaa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:56.315235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0efd55-d3a6-4aa5-9371-54a702ebaa00 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:56.324428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:56.329855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:56.330184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:56.330471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] PATH_INFO: `/v3/projects/bc92c399f6144660aeb50b694c7a8d19` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:56.333243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc92c399f6144660aeb50b694c7a8d19)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:56.336365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:56.507806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc92c399f6144660aeb50b694c7a8d19', 'request_id': 'req-f08a5170-0af4-4c6e-bfc5-42ee2186996c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:56.517616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc92c399f6144660aeb50b694c7a8d19', 'request_id': 'req-f08a5170-0af4-4c6e-bfc5-42ee2186996c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:56.540274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc92c399f6144660aeb50b694c7a8d19', 'request_id': 'req-f08a5170-0af4-4c6e-bfc5-42ee2186996c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:56.560539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] The token cache is being invalidate because project bc92c399f6144660aeb50b694c7a8d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:38:56.561454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:56.566228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:56.570373 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3978/7901] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:38:56 2022] DELETE /identity/v3/projects/bc92c399f6144660aeb50b694c7a8d19 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:56.574584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d996-7150-4438-885f-7e9e65f3abf4 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:56.591167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d996-7150-4438-885f-7e9e65f3abf4 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:56.629082 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:56.721303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fe212-0b01-4da6-b8fb-1918754d25aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:56.722362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fe212-0b01-4da6-b8fb-1918754d25aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:56.722824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fe212-0b01-4da6-b8fb-1918754d25aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:56.724689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fe212-0b01-4da6-b8fb-1918754d25aa admin admin] PATH_INFO: `/v3/users/f7c56701931e45f4961cce110dd60a79` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:56.726124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fe212-0b01-4da6-b8fb-1918754d25aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c56701931e45f4961cce110dd60a79)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:56.730597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fe212-0b01-4da6-b8fb-1918754d25aa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:56.837815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c7fe212-0b01-4da6-b8fb-1918754d25aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c56701931e45f4961cce110dd60a79'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:56.838525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c7fe212-0b01-4da6-b8fb-1918754d25aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c56701931e45f4961cce110dd60a79'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:56.867636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c7fe212-0b01-4da6-b8fb-1918754d25aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c56701931e45f4961cce110dd60a79'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:56.884616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c7fe212-0b01-4da6-b8fb-1918754d25aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c56701931e45f4961cce110dd60a79'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:56.885970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4c7fe212-0b01-4da6-b8fb-1918754d25aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c56701931e45f4961cce110dd60a79'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:56.912980 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3924/7902] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:38:56 2022] DELETE /identity/v3/users/f7c56701931e45f4961cce110dd60a79 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:57.814722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:57.817092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:57.852758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a5170-0af4-4c6e-bfc5-42ee2186996c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:57.863397 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:58.136242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4a6b9-aa20-45f2-ac31-1869b1f88592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:58.141149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4a6b9-aa20-45f2-ac31-1869b1f88592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:58.141658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4a6b9-aa20-45f2-ac31-1869b1f88592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:58.142055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4a6b9-aa20-45f2-ac31-1869b1f88592 admin admin] PATH_INFO: `/v3/projects/b93c77a3af874518ba66cece5fec2368` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:58.147320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4a6b9-aa20-45f2-ac31-1869b1f88592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93c77a3af874518ba66cece5fec2368)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:58.152031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4a6b9-aa20-45f2-ac31-1869b1f88592 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:58.316387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14d4a6b9-aa20-45f2-ac31-1869b1f88592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93c77a3af874518ba66cece5fec2368', 'request_id': 'req-14d4a6b9-aa20-45f2-ac31-1869b1f88592'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:58.331201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14d4a6b9-aa20-45f2-ac31-1869b1f88592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93c77a3af874518ba66cece5fec2368', 'request_id': 'req-14d4a6b9-aa20-45f2-ac31-1869b1f88592'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:58.348562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14d4a6b9-aa20-45f2-ac31-1869b1f88592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93c77a3af874518ba66cece5fec2368', 'request_id': 'req-14d4a6b9-aa20-45f2-ac31-1869b1f88592'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:58.371847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14d4a6b9-aa20-45f2-ac31-1869b1f88592 admin admin] The token cache is being invalidate because project b93c77a3af874518ba66cece5fec2368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:38:58.372215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14d4a6b9-aa20-45f2-ac31-1869b1f88592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:58.375293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14d4a6b9-aa20-45f2-ac31-1869b1f88592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:38:58.381973 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3979/7903] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:38:57 2022] DELETE /identity/v3/projects/b93c77a3af874518ba66cece5fec2368 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:58.383872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a38c0b-6b31-4836-8558-c24e866da032 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:58.384344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a38c0b-6b31-4836-8558-c24e866da032 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:58.384426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a38c0b-6b31-4836-8558-c24e866da032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:58.469862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-99a38c0b-6b31-4836-8558-c24e866da032 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:58.471234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-99a38c0b-6b31-4836-8558-c24e866da032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:58.647953 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3925/7904] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:58.656094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2459179-8c6c-43ad-8ae7-b82489721589 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:58.656382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2459179-8c6c-43ad-8ae7-b82489721589 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:58.656660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2459179-8c6c-43ad-8ae7-b82489721589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:58.708051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a2459179-8c6c-43ad-8ae7-b82489721589 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:58.709315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a2459179-8c6c-43ad-8ae7-b82489721589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:58.748352 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3980/7905] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:58.752485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a38c0b-6b31-4836-8558-c24e866da032 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:58.764219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a38c0b-6b31-4836-8558-c24e866da032 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:58.770096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d5cc1-de7f-434b-8095-82d5b6076ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:58.770988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d5cc1-de7f-434b-8095-82d5b6076ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:58.771570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d5cc1-de7f-434b-8095-82d5b6076ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:58.771999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d5cc1-de7f-434b-8095-82d5b6076ce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:58.772932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d5cc1-de7f-434b-8095-82d5b6076ce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:38:58.773386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d5cc1-de7f-434b-8095-82d5b6076ce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:58.775513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d5cc1-de7f-434b-8095-82d5b6076ce8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:58.791221 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3926/7906] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:38:58.795858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2459179-8c6c-43ad-8ae7-b82489721589 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:58.807631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2459179-8c6c-43ad-8ae7-b82489721589 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:58.815377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59e967-03ce-439e-8491-8b9a65c94bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:58.816801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59e967-03ce-439e-8491-8b9a65c94bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:58.817270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59e967-03ce-439e-8491-8b9a65c94bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:58.817771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59e967-03ce-439e-8491-8b9a65c94bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:58.819251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59e967-03ce-439e-8491-8b9a65c94bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:58.824888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59e967-03ce-439e-8491-8b9a65c94bdf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:58.910476 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3981/7907] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:38:58 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:38:58.913480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d5cc1-de7f-434b-8095-82d5b6076ce8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:58.931167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d5cc1-de7f-434b-8095-82d5b6076ce8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:58.958188 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:59.104668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7959c-0ab9-4b41-bf87-8d3c4eb81ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:59.105470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7959c-0ab9-4b41-bf87-8d3c4eb81ffb admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:59.105998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7959c-0ab9-4b41-bf87-8d3c4eb81ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:59.109886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7959c-0ab9-4b41-bf87-8d3c4eb81ffb admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:59.111915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7959c-0ab9-4b41-bf87-8d3c4eb81ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:59.116570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7959c-0ab9-4b41-bf87-8d3c4eb81ffb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:59.179198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dc17e-5214-467b-b881-26deeab3de60 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:59.179493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dc17e-5214-467b-b881-26deeab3de60 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:59.179774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dc17e-5214-467b-b881-26deeab3de60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:59.182968 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3927/7908] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:38:58 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:38:59.185715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7959c-0ab9-4b41-bf87-8d3c4eb81ffb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:59.208047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7959c-0ab9-4b41-bf87-8d3c4eb81ffb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:59.225248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-798dc17e-5214-467b-b881-26deeab3de60 None None] MFA Rules not processed for user `2eabe99e40ef44a09c3f7dc1c78d7608`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:59.226487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-798dc17e-5214-467b-b881-26deeab3de60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:59.228702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca932dbd-c0d9-4632-8d52-391052b36b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:59.229507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca932dbd-c0d9-4632-8d52-391052b36b9c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:59.230010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca932dbd-c0d9-4632-8d52-391052b36b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:59.230432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca932dbd-c0d9-4632-8d52-391052b36b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:59.231448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca932dbd-c0d9-4632-8d52-391052b36b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:59.234638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca932dbd-c0d9-4632-8d52-391052b36b9c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:59.260512 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3928/7909] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:38:59.264198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca932dbd-c0d9-4632-8d52-391052b36b9c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:59.285577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca932dbd-c0d9-4632-8d52-391052b36b9c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:59.301350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced4c95-f6ad-4f0d-b011-1e95b0ebf011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:59.302234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced4c95-f6ad-4f0d-b011-1e95b0ebf011 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:59.302669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced4c95-f6ad-4f0d-b011-1e95b0ebf011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:59.303169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced4c95-f6ad-4f0d-b011-1e95b0ebf011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:59.303983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced4c95-f6ad-4f0d-b011-1e95b0ebf011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:59.305743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced4c95-f6ad-4f0d-b011-1e95b0ebf011 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:59.333848 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3929/7910] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:38:59.338070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced4c95-f6ad-4f0d-b011-1e95b0ebf011 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:59.370417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced4c95-f6ad-4f0d-b011-1e95b0ebf011 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:38:59.390454 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3982/7911] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:38:59.396417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388928fa-d919-4770-8ed7-cbf44de91075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:38:59.397101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388928fa-d919-4770-8ed7-cbf44de91075 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:59.397388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388928fa-d919-4770-8ed7-cbf44de91075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:59.398667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388928fa-d919-4770-8ed7-cbf44de91075 admin admin] PATH_INFO: `/v3/projects/54874325666649079b00b104cfa536bb/users/43c446d627be4d7ca5a2ba6ea2563e1c/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:59.438948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388928fa-d919-4770-8ed7-cbf44de91075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54874325666649079b00b104cfa536bb, user_id=43c446d627be4d7ca5a2ba6ea2563e1c, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:38:59.442466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388928fa-d919-4770-8ed7-cbf44de91075 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:38:59.521389 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3930/7912] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:38:59 2022] PUT /identity/v3/projects/54874325666649079b00b104cfa536bb/users/43c446d627be4d7ca5a2ba6ea2563e1c/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:38:59.542368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e5580-5b0c-4feb-80bd-393c26e3adcb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:38:59.542715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e5580-5b0c-4feb-80bd-393c26e3adcb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:38:59.547636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e5580-5b0c-4feb-80bd-393c26e3adcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:38:59.651603 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:59.671054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2d9e5580-5b0c-4feb-80bd-393c26e3adcb None None] MFA Rules not processed for user `43c446d627be4d7ca5a2ba6ea2563e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:38:59.671619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2d9e5580-5b0c-4feb-80bd-393c26e3adcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:38:59.912342 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3983/7913] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:38:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:38:59.921166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388928fa-d919-4770-8ed7-cbf44de91075 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:38:59.925322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-388928fa-d919-4770-8ed7-cbf44de91075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:00.080818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388928fa-d919-4770-8ed7-cbf44de91075 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:00.089949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1f0ed-df49-4387-90d2-d51bbae39344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:00.090592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1f0ed-df49-4387-90d2-d51bbae39344 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:00.090872 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1f0ed-df49-4387-90d2-d51bbae39344 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:00.092098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1f0ed-df49-4387-90d2-d51bbae39344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:00.115413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1f0ed-df49-4387-90d2-d51bbae39344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:00.117014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1f0ed-df49-4387-90d2-d51bbae39344 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:00.149388 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3931/7914] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:38:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:39:00.202425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e5580-5b0c-4feb-80bd-393c26e3adcb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:00.204170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2d9e5580-5b0c-4feb-80bd-393c26e3adcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:00.330476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e5580-5b0c-4feb-80bd-393c26e3adcb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:00.340493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ac790-c9ad-4068-8226-7a427ff30a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:00.342277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ac790-c9ad-4068-8226-7a427ff30a39 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:00.344508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ac790-c9ad-4068-8226-7a427ff30a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:00.344979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ac790-c9ad-4068-8226-7a427ff30a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:00.349059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5b4ac790-c9ad-4068-8226-7a427ff30a39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:00.372196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ac790-c9ad-4068-8226-7a427ff30a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:00.374472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ac790-c9ad-4068-8226-7a427ff30a39 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:00.411955 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3984/7915] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:39:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:39:10.136685 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=69,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:10.385947 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=52 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:10.540604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1f0ed-df49-4387-90d2-d51bbae39344 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:10.783890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1f0ed-df49-4387-90d2-d51bbae39344 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:10.811149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:10.811819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:10.812099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:10.812375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] PATH_INFO: `/v3/users/43c446d627be4d7ca5a2ba6ea2563e1c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:10.813628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c446d627be4d7ca5a2ba6ea2563e1c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:10.815630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:10.916352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c446d627be4d7ca5a2ba6ea2563e1c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:10.917553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c446d627be4d7ca5a2ba6ea2563e1c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:11.015635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c446d627be4d7ca5a2ba6ea2563e1c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:11.047567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c446d627be4d7ca5a2ba6ea2563e1c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:11.048615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c446d627be4d7ca5a2ba6ea2563e1c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:11.071133 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3932/7916] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:39:10 2022] DELETE /identity/v3/users/43c446d627be4d7ca5a2ba6ea2563e1c => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:11.076718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7cc4c-6269-4d3e-8772-b681b871526d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:11.077036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7cc4c-6269-4d3e-8772-b681b871526d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:11.077317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7cc4c-6269-4d3e-8772-b681b871526d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:11.113197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2bd7cc4c-6269-4d3e-8772-b681b871526d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:11.114739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2bd7cc4c-6269-4d3e-8772-b681b871526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:11.297147 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3985/7917] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:11.311820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:11.313387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:11.462143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c005f2-9770-4216-a160-d3bcd26e43c2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:11.474024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16389b1f-3810-4f6d-9a94-a980889d1d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:11.475271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16389b1f-3810-4f6d-9a94-a980889d1d86 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:11.475766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16389b1f-3810-4f6d-9a94-a980889d1d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:11.476190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16389b1f-3810-4f6d-9a94-a980889d1d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:11.505746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16389b1f-3810-4f6d-9a94-a980889d1d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:11.510444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16389b1f-3810-4f6d-9a94-a980889d1d86 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:11.543606 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3933/7918] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:39:12.345123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7cc4c-6269-4d3e-8772-b681b871526d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:12.364166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7cc4c-6269-4d3e-8772-b681b871526d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:12.371462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f879abe-9e72-41e5-bd06-8d1ee165cc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:12.372417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f879abe-9e72-41e5-bd06-8d1ee165cc1f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:12.372921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f879abe-9e72-41e5-bd06-8d1ee165cc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:12.373522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f879abe-9e72-41e5-bd06-8d1ee165cc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:12.381301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3f879abe-9e72-41e5-bd06-8d1ee165cc1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:12.411392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f879abe-9e72-41e5-bd06-8d1ee165cc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:12.413146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f879abe-9e72-41e5-bd06-8d1ee165cc1f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:12.451010 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3986/7919] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:39:12.756746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16389b1f-3810-4f6d-9a94-a980889d1d86 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:12.758243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-16389b1f-3810-4f6d-9a94-a980889d1d86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:12.793910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16389b1f-3810-4f6d-9a94-a980889d1d86 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:12.809840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:12.811307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:12.811978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:12.812418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f admin admin] PATH_INFO: `/v3/projects/54874325666649079b00b104cfa536bb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:12.814051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=54874325666649079b00b104cfa536bb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:12.831542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:12.933871 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:13.108584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54874325666649079b00b104cfa536bb', 'request_id': 'req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:13.124219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54874325666649079b00b104cfa536bb', 'request_id': 'req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:13.140610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54874325666649079b00b104cfa536bb', 'request_id': 'req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:13.161184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f admin admin] The token cache is being invalidate because project 54874325666649079b00b104cfa536bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:39:13.161856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:13.163212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a26ca0c4-a0cb-4feb-a1ee-39b626404a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:13.164972 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3934/7920] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:39:12 2022] DELETE /identity/v3/projects/54874325666649079b00b104cfa536bb => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:13.170506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12f26-059f-4811-9148-999b8e53e19c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:13.171135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12f26-059f-4811-9148-999b8e53e19c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:13.171963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12f26-059f-4811-9148-999b8e53e19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:13.227056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4bd12f26-059f-4811-9148-999b8e53e19c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:13.228602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4bd12f26-059f-4811-9148-999b8e53e19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:13.403060 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3987/7921] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:13.409367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96b059-ab38-45da-a4d3-acc5c9398426 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:13.409643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96b059-ab38-45da-a4d3-acc5c9398426 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:13.409913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96b059-ab38-45da-a4d3-acc5c9398426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:13.510666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ef96b059-ab38-45da-a4d3-acc5c9398426 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:13.523046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef96b059-ab38-45da-a4d3-acc5c9398426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:13.558468 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3935/7922] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:13.560045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd12f26-059f-4811-9148-999b8e53e19c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:13.577103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd12f26-059f-4811-9148-999b8e53e19c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:13.587966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b49605-08ae-4098-96a5-cc28814dc14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:13.591797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b49605-08ae-4098-96a5-cc28814dc14b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:13.592446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b49605-08ae-4098-96a5-cc28814dc14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:13.592949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b49605-08ae-4098-96a5-cc28814dc14b admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:13.594264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b49605-08ae-4098-96a5-cc28814dc14b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:39:13.595870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b49605-08ae-4098-96a5-cc28814dc14b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:13.597758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b49605-08ae-4098-96a5-cc28814dc14b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:13.631378 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3988/7923] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:39:13.633109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96b059-ab38-45da-a4d3-acc5c9398426 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:13.646198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96b059-ab38-45da-a4d3-acc5c9398426 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:13.675637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd09ea2-6187-4dab-966d-e1451367a55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:13.676269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd09ea2-6187-4dab-966d-e1451367a55d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:13.676546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd09ea2-6187-4dab-966d-e1451367a55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:13.676815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd09ea2-6187-4dab-966d-e1451367a55d admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:13.677451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd09ea2-6187-4dab-966d-e1451367a55d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:13.679481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd09ea2-6187-4dab-966d-e1451367a55d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:13.776250 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3936/7924] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:39:13 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:13.781005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b49605-08ae-4098-96a5-cc28814dc14b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:13.798131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b49605-08ae-4098-96a5-cc28814dc14b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:14.004951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35840a34-bd1d-4a2f-866d-b1f10f74d652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:14.008495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35840a34-bd1d-4a2f-866d-b1f10f74d652 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:14.010688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35840a34-bd1d-4a2f-866d-b1f10f74d652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:14.022454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35840a34-bd1d-4a2f-866d-b1f10f74d652 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:14.029785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35840a34-bd1d-4a2f-866d-b1f10f74d652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:14.032187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35840a34-bd1d-4a2f-866d-b1f10f74d652 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:14.077665 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3989/7925] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:39:13 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:14.082116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd09ea2-6187-4dab-966d-e1451367a55d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:14.096045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd09ea2-6187-4dab-966d-e1451367a55d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:14.121215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa02c75-f6a9-4207-8b0d-a2a193963a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:14.122282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02c75-f6a9-4207-8b0d-a2a193963a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:14.122762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02c75-f6a9-4207-8b0d-a2a193963a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:14.123252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02c75-f6a9-4207-8b0d-a2a193963a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:14.125305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa02c75-f6a9-4207-8b0d-a2a193963a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:14.127138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa02c75-f6a9-4207-8b0d-a2a193963a21 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:14.165459 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3937/7926] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:39:14.169884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35840a34-bd1d-4a2f-866d-b1f10f74d652 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:14.180902 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:14.192402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35840a34-bd1d-4a2f-866d-b1f10f74d652 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:14.206103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a58896-2bfd-4305-b9d5-27d41ff41cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:14.212901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58896-2bfd-4305-b9d5-27d41ff41cef admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:14.213521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58896-2bfd-4305-b9d5-27d41ff41cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:14.222618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58896-2bfd-4305-b9d5-27d41ff41cef admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:14.223538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a58896-2bfd-4305-b9d5-27d41ff41cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:14.226951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a58896-2bfd-4305-b9d5-27d41ff41cef admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:14.286488 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3990/7927] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:39:14.297194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa02c75-f6a9-4207-8b0d-a2a193963a21 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:14.343206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa02c75-f6a9-4207-8b0d-a2a193963a21 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:14.357686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a84177-87c2-4fc8-8e70-4ba74e9a9c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:14.371847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a84177-87c2-4fc8-8e70-4ba74e9a9c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:14.371847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a84177-87c2-4fc8-8e70-4ba74e9a9c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:14.371847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a84177-87c2-4fc8-8e70-4ba74e9a9c41 admin admin] PATH_INFO: `/v3/projects/3006edea3cd547909615ce3275b58597/users/22bcdb6c0e89492ba77baf34456dca3c/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:14.440241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a84177-87c2-4fc8-8e70-4ba74e9a9c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3006edea3cd547909615ce3275b58597, user_id=22bcdb6c0e89492ba77baf34456dca3c, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:14.447372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a84177-87c2-4fc8-8e70-4ba74e9a9c41 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:14.502967 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3938/7928] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:39:14 2022] PUT /identity/v3/projects/3006edea3cd547909615ce3275b58597/users/22bcdb6c0e89492ba77baf34456dca3c/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:14.514130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744a537-e3c2-4be2-8ffa-60a9df7d1921 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:14.514696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744a537-e3c2-4be2-8ffa-60a9df7d1921 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:14.514801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744a537-e3c2-4be2-8ffa-60a9df7d1921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:14.613346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d744a537-e3c2-4be2-8ffa-60a9df7d1921 None None] MFA Rules not processed for user `22bcdb6c0e89492ba77baf34456dca3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:14.615618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d744a537-e3c2-4be2-8ffa-60a9df7d1921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:14.801670 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3991/7929] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:14.890851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a84177-87c2-4fc8-8e70-4ba74e9a9c41 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:14.893543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-43a84177-87c2-4fc8-8e70-4ba74e9a9c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:15.000703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a84177-87c2-4fc8-8e70-4ba74e9a9c41 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:15.005582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684a42a-c92a-48de-b9ac-952b690f3e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:15.006379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684a42a-c92a-48de-b9ac-952b690f3e84 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:15.006821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684a42a-c92a-48de-b9ac-952b690f3e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:15.007589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684a42a-c92a-48de-b9ac-952b690f3e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:15.021701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684a42a-c92a-48de-b9ac-952b690f3e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:15.023525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684a42a-c92a-48de-b9ac-952b690f3e84 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:15.035740 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3939/7930] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:39:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:39:19.012205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0ede4-262c-4e61-a722-6d95aabf7942 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:19.013668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0ede4-262c-4e61-a722-6d95aabf7942 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:19.014264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0ede4-262c-4e61-a722-6d95aabf7942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:19.061171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7ed0ede4-262c-4e61-a722-6d95aabf7942 None None] MFA Rules not processed for user `22bcdb6c0e89492ba77baf34456dca3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:19.062426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7ed0ede4-262c-4e61-a722-6d95aabf7942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:19.120334 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3992/7931] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:19.715243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684a42a-c92a-48de-b9ac-952b690f3e84 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:19.717378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4684a42a-c92a-48de-b9ac-952b690f3e84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:19.782798 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:19.845280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684a42a-c92a-48de-b9ac-952b690f3e84 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:19.857112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe25ce-5e8c-498e-b457-7a7aa7078e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:19.859815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe25ce-5e8c-498e-b457-7a7aa7078e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:19.863272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe25ce-5e8c-498e-b457-7a7aa7078e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:19.863740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe25ce-5e8c-498e-b457-7a7aa7078e64 admin admin] PATH_INFO: `/v3/users/6a10008a2a4e41c5be09552821db8fad` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:19.865817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe25ce-5e8c-498e-b457-7a7aa7078e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a10008a2a4e41c5be09552821db8fad)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:19.867970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe25ce-5e8c-498e-b457-7a7aa7078e64 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:19.987630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-62fe25ce-5e8c-498e-b457-7a7aa7078e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a10008a2a4e41c5be09552821db8fad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:19.989305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-62fe25ce-5e8c-498e-b457-7a7aa7078e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a10008a2a4e41c5be09552821db8fad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:20.033507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-62fe25ce-5e8c-498e-b457-7a7aa7078e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a10008a2a4e41c5be09552821db8fad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:20.054451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-62fe25ce-5e8c-498e-b457-7a7aa7078e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a10008a2a4e41c5be09552821db8fad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:20.056946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-62fe25ce-5e8c-498e-b457-7a7aa7078e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a10008a2a4e41c5be09552821db8fad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:20.089803 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3940/7932] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:39:19 2022] DELETE /identity/v3/users/6a10008a2a4e41c5be09552821db8fad => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:20.457186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0ede4-262c-4e61-a722-6d95aabf7942 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:20.482771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0ede4-262c-4e61-a722-6d95aabf7942 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:20.578644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb97341-789d-4657-9bc6-ee382be68a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:20.579809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97341-789d-4657-9bc6-ee382be68a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:20.580461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97341-789d-4657-9bc6-ee382be68a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:20.580949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97341-789d-4657-9bc6-ee382be68a05 admin admin] PATH_INFO: `/v3/projects/3bf371ee661342e193e6d9d4aacda40d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:20.582318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb97341-789d-4657-9bc6-ee382be68a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf371ee661342e193e6d9d4aacda40d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:20.584755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb97341-789d-4657-9bc6-ee382be68a05 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:20.675597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0cb97341-789d-4657-9bc6-ee382be68a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf371ee661342e193e6d9d4aacda40d', 'request_id': 'req-0cb97341-789d-4657-9bc6-ee382be68a05'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:20.683941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0cb97341-789d-4657-9bc6-ee382be68a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf371ee661342e193e6d9d4aacda40d', 'request_id': 'req-0cb97341-789d-4657-9bc6-ee382be68a05'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:20.692603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0cb97341-789d-4657-9bc6-ee382be68a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf371ee661342e193e6d9d4aacda40d', 'request_id': 'req-0cb97341-789d-4657-9bc6-ee382be68a05'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:20.705913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0cb97341-789d-4657-9bc6-ee382be68a05 admin admin] The token cache is being invalidate because project 3bf371ee661342e193e6d9d4aacda40d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:39:20.706399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0cb97341-789d-4657-9bc6-ee382be68a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:20.707170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0cb97341-789d-4657-9bc6-ee382be68a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:20.708832 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3993/7933] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:39:20 2022] DELETE /identity/v3/projects/3bf371ee661342e193e6d9d4aacda40d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:20.714070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f8186-cafd-465e-9254-4f03ab280196 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:20.714355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f8186-cafd-465e-9254-4f03ab280196 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:20.714623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f8186-cafd-465e-9254-4f03ab280196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:20.738441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-560f8186-cafd-465e-9254-4f03ab280196 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:20.741149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-560f8186-cafd-465e-9254-4f03ab280196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:20.839081 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3941/7934] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:20.842637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe610cf-6737-4b7e-96aa-f5412f64682f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:20.842948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe610cf-6737-4b7e-96aa-f5412f64682f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:20.843223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe610cf-6737-4b7e-96aa-f5412f64682f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:20.858884 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:20.865353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9fe610cf-6737-4b7e-96aa-f5412f64682f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:20.867494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9fe610cf-6737-4b7e-96aa-f5412f64682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:20.877943 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3994/7935] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:20.882042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f8186-cafd-465e-9254-4f03ab280196 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:20.893344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f8186-cafd-465e-9254-4f03ab280196 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:20.898474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd036e-60a7-4b09-9b7a-b7cac82a9e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:20.900110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd036e-60a7-4b09-9b7a-b7cac82a9e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:20.900440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd036e-60a7-4b09-9b7a-b7cac82a9e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:20.900858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd036e-60a7-4b09-9b7a-b7cac82a9e0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:20.901764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd036e-60a7-4b09-9b7a-b7cac82a9e0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:39:20.902370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd036e-60a7-4b09-9b7a-b7cac82a9e0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:20.904249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd036e-60a7-4b09-9b7a-b7cac82a9e0a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:20.921949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe610cf-6737-4b7e-96aa-f5412f64682f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:20.924731 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3942/7936] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:39:20.932548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe610cf-6737-4b7e-96aa-f5412f64682f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:20.938293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad812e-956e-4682-bea5-64d713d4decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:20.939671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad812e-956e-4682-bea5-64d713d4decd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:20.940071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad812e-956e-4682-bea5-64d713d4decd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:20.940459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad812e-956e-4682-bea5-64d713d4decd admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:20.941207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad812e-956e-4682-bea5-64d713d4decd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:20.944531 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad812e-956e-4682-bea5-64d713d4decd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:20.982934 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3995/7937] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:39:20 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:20.983813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd036e-60a7-4b09-9b7a-b7cac82a9e0a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:20.995601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd036e-60a7-4b09-9b7a-b7cac82a9e0a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:21.074582 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:21.098311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebb2d5-3591-4a32-9eaf-4a6290b0b4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:21.099135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebb2d5-3591-4a32-9eaf-4a6290b0b4ec admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:21.099413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebb2d5-3591-4a32-9eaf-4a6290b0b4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:21.099685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebb2d5-3591-4a32-9eaf-4a6290b0b4ec admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:21.102142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebb2d5-3591-4a32-9eaf-4a6290b0b4ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:21.104206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebb2d5-3591-4a32-9eaf-4a6290b0b4ec admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:21.149904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad812e-956e-4682-bea5-64d713d4decd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:21.160046 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3943/7938] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:39:20 2022] POST /identity/v3/users => generated 283 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:21.162516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad812e-956e-4682-bea5-64d713d4decd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:21.167614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebfe40-c42b-46ea-a668-ea7fd37ecb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:21.168459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebfe40-c42b-46ea-a668-ea7fd37ecb35 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:21.168993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebfe40-c42b-46ea-a668-ea7fd37ecb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:21.170056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebfe40-c42b-46ea-a668-ea7fd37ecb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:21.170938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebfe40-c42b-46ea-a668-ea7fd37ecb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:21.173202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebfe40-c42b-46ea-a668-ea7fd37ecb35 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:21.187910 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3996/7939] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:39:21.189148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebb2d5-3591-4a32-9eaf-4a6290b0b4ec admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:21.212575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebb2d5-3591-4a32-9eaf-4a6290b0b4ec admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:21.224902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598ac05-f9fe-423d-a0c9-2738ba78c02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:21.226093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ac05-f9fe-423d-a0c9-2738ba78c02c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:21.227226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ac05-f9fe-423d-a0c9-2738ba78c02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:21.227726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ac05-f9fe-423d-a0c9-2738ba78c02c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:21.228864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598ac05-f9fe-423d-a0c9-2738ba78c02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:21.230729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598ac05-f9fe-423d-a0c9-2738ba78c02c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:21.249962 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3944/7940] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:39:21.250662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebfe40-c42b-46ea-a668-ea7fd37ecb35 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:21.262639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebfe40-c42b-46ea-a668-ea7fd37ecb35 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:21.268799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0447d0-9624-4173-b049-6bd46dbc2a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:21.269478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0447d0-9624-4173-b049-6bd46dbc2a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:21.269756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0447d0-9624-4173-b049-6bd46dbc2a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:21.270161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0447d0-9624-4173-b049-6bd46dbc2a3c admin admin] PATH_INFO: `/v3/projects/199b38aca92e4c769da6e79044d97d33/users/171a5b6bbb994df88fac8e851a49d931/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:21.303816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0447d0-9624-4173-b049-6bd46dbc2a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=199b38aca92e4c769da6e79044d97d33, user_id=171a5b6bbb994df88fac8e851a49d931, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:21.313396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0447d0-9624-4173-b049-6bd46dbc2a3c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:21.367203 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3997/7941] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:39:21 2022] PUT /identity/v3/projects/199b38aca92e4c769da6e79044d97d33/users/171a5b6bbb994df88fac8e851a49d931/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:21.378132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f2709-daa3-41dd-af94-5a3b61797ab8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:21.378273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f2709-daa3-41dd-af94-5a3b61797ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:21.378479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f2709-daa3-41dd-af94-5a3b61797ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:21.433748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-385f2709-daa3-41dd-af94-5a3b61797ab8 None None] MFA Rules not processed for user `171a5b6bbb994df88fac8e851a49d931`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:21.435168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-385f2709-daa3-41dd-af94-5a3b61797ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:21.576460 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3945/7942] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:21.661386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0447d0-9624-4173-b049-6bd46dbc2a3c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:21.664167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c0447d0-9624-4173-b049-6bd46dbc2a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:21.795472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0447d0-9624-4173-b049-6bd46dbc2a3c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:21.807967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7eb34-0753-49fa-a2dd-b3287dc7efb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:21.808807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7eb34-0753-49fa-a2dd-b3287dc7efb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:21.809261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7eb34-0753-49fa-a2dd-b3287dc7efb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:21.810223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7eb34-0753-49fa-a2dd-b3287dc7efb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:21.822904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7eb34-0753-49fa-a2dd-b3287dc7efb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:21.827307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7eb34-0753-49fa-a2dd-b3287dc7efb1 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:21.840124 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3998/7943] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:39:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:39:31.559664 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=43,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:31.834308 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:38.794885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e7247-eea7-47bb-84b5-ff78002cc89f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:38.795493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e7247-eea7-47bb-84b5-ff78002cc89f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:38.795610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e7247-eea7-47bb-84b5-ff78002cc89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:38.877878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-647e7247-eea7-47bb-84b5-ff78002cc89f None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:38.879411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-647e7247-eea7-47bb-84b5-ff78002cc89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:39.107267 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3946/7944] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:39:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:39.178125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7eb34-0753-49fa-a2dd-b3287dc7efb1 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:39.179753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bed7eb34-0753-49fa-a2dd-b3287dc7efb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:39.434279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7eb34-0753-49fa-a2dd-b3287dc7efb1 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:39.460396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa476e-bae6-4dd2-a87f-bac0f1b889aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:39.461057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa476e-bae6-4dd2-a87f-bac0f1b889aa service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:39.461305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa476e-bae6-4dd2-a87f-bac0f1b889aa service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:39.461626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa476e-bae6-4dd2-a87f-bac0f1b889aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:39.488385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa476e-bae6-4dd2-a87f-bac0f1b889aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:39.490342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa476e-bae6-4dd2-a87f-bac0f1b889aa service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:39.520234 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3999/7945] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:39:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:39:40.571195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9758c-2198-461b-9c5e-7088f532d7b8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:40.572033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9758c-2198-461b-9c5e-7088f532d7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:40.572858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9758c-2198-461b-9c5e-7088f532d7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:40.599847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-36d9758c-2198-461b-9c5e-7088f532d7b8 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:40.601577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-36d9758c-2198-461b-9c5e-7088f532d7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:40.611230 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3947/7946] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:39:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:40.627434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa476e-bae6-4dd2-a87f-bac0f1b889aa service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:40.645974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa476e-bae6-4dd2-a87f-bac0f1b889aa service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:40.652774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b4dcb-f8cf-4bb3-b8c9-2ab3fc41efcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:40.654397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b4dcb-f8cf-4bb3-b8c9-2ab3fc41efcc service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:40.655334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b4dcb-f8cf-4bb3-b8c9-2ab3fc41efcc service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:40.655834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b4dcb-f8cf-4bb3-b8c9-2ab3fc41efcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:40.677752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b4dcb-f8cf-4bb3-b8c9-2ab3fc41efcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:40.680892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b4dcb-f8cf-4bb3-b8c9-2ab3fc41efcc service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:40.692678 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4000/7947] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:39:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:39:40.923957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9758c-2198-461b-9c5e-7088f532d7b8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:40.926281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-36d9758c-2198-461b-9c5e-7088f532d7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:41.063848 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9758c-2198-461b-9c5e-7088f532d7b8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:41.078599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34d5bf-ce83-46e2-91b1-4846c627704d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:41.079265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34d5bf-ce83-46e2-91b1-4846c627704d service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:41.080751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34d5bf-ce83-46e2-91b1-4846c627704d service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:41.081035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34d5bf-ce83-46e2-91b1-4846c627704d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:41.085792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ea34d5bf-ce83-46e2-91b1-4846c627704d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:41.128880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34d5bf-ce83-46e2-91b1-4846c627704d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:41.134231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34d5bf-ce83-46e2-91b1-4846c627704d service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:41.144604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ec6ed-0b41-4722-a084-07de361f92be None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:41.144890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ec6ed-0b41-4722-a084-07de361f92be None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:41.145162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ec6ed-0b41-4722-a084-07de361f92be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:41.164329 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3948/7948] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:39:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:39:41.200288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c44ec6ed-0b41-4722-a084-07de361f92be None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:41.201572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c44ec6ed-0b41-4722-a084-07de361f92be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:41.233992 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4001/7949] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:39:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:39:41.234874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34d5bf-ce83-46e2-91b1-4846c627704d service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:41.258478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34d5bf-ce83-46e2-91b1-4846c627704d service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:41.291399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07572a56-b1ba-4236-a184-58cdec726c37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:41.292014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572a56-b1ba-4236-a184-58cdec726c37 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:41.297205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572a56-b1ba-4236-a184-58cdec726c37 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:41.297499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572a56-b1ba-4236-a184-58cdec726c37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:41.324792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07572a56-b1ba-4236-a184-58cdec726c37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:41.345659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07572a56-b1ba-4236-a184-58cdec726c37 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:41.389368 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3949/7950] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:39:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:39:42.169392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe8de9-8e6a-43b4-815f-f997a9eb7102 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:42.169943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe8de9-8e6a-43b4-815f-f997a9eb7102 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:42.169943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe8de9-8e6a-43b4-815f-f997a9eb7102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:42.228806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-67fe8de9-8e6a-43b4-815f-f997a9eb7102 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:42.230053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-67fe8de9-8e6a-43b4-815f-f997a9eb7102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:42.257125 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4002/7951] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:42.293055 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07572a56-b1ba-4236-a184-58cdec726c37 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:42.329905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07572a56-b1ba-4236-a184-58cdec726c37 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:42.362439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26c202-8c47-41ea-93f0-067b96a572e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:42.363088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26c202-8c47-41ea-93f0-067b96a572e4 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:42.363366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26c202-8c47-41ea-93f0-067b96a572e4 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:42.363639 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26c202-8c47-41ea-93f0-067b96a572e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:42.379825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26c202-8c47-41ea-93f0-067b96a572e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:42.390642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26c202-8c47-41ea-93f0-067b96a572e4 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:42.418445 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3950/7952] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:39:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:39:46.163132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe8de9-8e6a-43b4-815f-f997a9eb7102 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:46.378312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe8de9-8e6a-43b4-815f-f997a9eb7102 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:46.389767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:46.390711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:46.391198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:46.391638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] PATH_INFO: `/v3/users/171a5b6bbb994df88fac8e851a49d931` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:46.392942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=171a5b6bbb994df88fac8e851a49d931)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:46.403518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:46.508737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '171a5b6bbb994df88fac8e851a49d931'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:46.511847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '171a5b6bbb994df88fac8e851a49d931'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:46.533540 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:46.547973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '171a5b6bbb994df88fac8e851a49d931'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:46.572260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '171a5b6bbb994df88fac8e851a49d931'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:46.573435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '171a5b6bbb994df88fac8e851a49d931'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:46.597859 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4003/7953] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:39:46 2022] DELETE /identity/v3/users/171a5b6bbb994df88fac8e851a49d931 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:46.602106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab83e7c-9107-4346-81ac-bcfb6b2d2490 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:46.602606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab83e7c-9107-4346-81ac-bcfb6b2d2490 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:46.602709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab83e7c-9107-4346-81ac-bcfb6b2d2490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:46.895491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cab83e7c-9107-4346-81ac-bcfb6b2d2490 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:46.909532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cab83e7c-9107-4346-81ac-bcfb6b2d2490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:46.977353 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:47.033416 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3951/7954] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:47.044580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:47.046533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:47.185444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751176b5-c0b0-4cf0-ae39-6ad913384923 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:47.193165 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb4ede-466a-4bb6-9143-c7c9419fee8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:47.196056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb4ede-466a-4bb6-9143-c7c9419fee8d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:47.196346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb4ede-466a-4bb6-9143-c7c9419fee8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:47.196627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb4ede-466a-4bb6-9143-c7c9419fee8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:47.224023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb4ede-466a-4bb6-9143-c7c9419fee8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:47.227821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb4ede-466a-4bb6-9143-c7c9419fee8d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:47.254533 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4004/7955] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:39:47.924085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab83e7c-9107-4346-81ac-bcfb6b2d2490 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:47.926357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cab83e7c-9107-4346-81ac-bcfb6b2d2490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:47.955337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab83e7c-9107-4346-81ac-bcfb6b2d2490 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:47.975624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:47.976533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:47.976812 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:47.977081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c admin admin] PATH_INFO: `/v3/projects/199b38aca92e4c769da6e79044d97d33` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:47.979668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=199b38aca92e4c769da6e79044d97d33)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:47.981667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:48.110955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199b38aca92e4c769da6e79044d97d33', 'request_id': 'req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:48.125756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199b38aca92e4c769da6e79044d97d33', 'request_id': 'req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:48.139137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199b38aca92e4c769da6e79044d97d33', 'request_id': 'req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:48.151775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c admin admin] The token cache is being invalidate because project 199b38aca92e4c769da6e79044d97d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:39:48.152163 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:48.152698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3c18b9bf-8fcb-4206-90ca-560aaf46bf2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:48.155087 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3952/7956] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:39:47 2022] DELETE /identity/v3/projects/199b38aca92e4c769da6e79044d97d33 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:48.161926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096f576-42ec-4dff-8eec-570db044205e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:48.162715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096f576-42ec-4dff-8eec-570db044205e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:48.163195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096f576-42ec-4dff-8eec-570db044205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:48.186404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8096f576-42ec-4dff-8eec-570db044205e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:48.188381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8096f576-42ec-4dff-8eec-570db044205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:48.317844 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4005/7957] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:48.327775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4eab-0205-4dd2-97ab-854fd5ba4138 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:48.328171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4eab-0205-4dd2-97ab-854fd5ba4138 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:48.328587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4eab-0205-4dd2-97ab-854fd5ba4138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:48.367712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-74ff4eab-0205-4dd2-97ab-854fd5ba4138 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:48.368007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-74ff4eab-0205-4dd2-97ab-854fd5ba4138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:48.388174 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3953/7958] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:48.393529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096f576-42ec-4dff-8eec-570db044205e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:48.410243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096f576-42ec-4dff-8eec-570db044205e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:48.425721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc236cb-8fff-43aa-bc5e-66656c7abdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:48.426762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc236cb-8fff-43aa-bc5e-66656c7abdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:48.427260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc236cb-8fff-43aa-bc5e-66656c7abdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:48.429822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc236cb-8fff-43aa-bc5e-66656c7abdb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:48.431762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc236cb-8fff-43aa-bc5e-66656c7abdb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:39:48.432404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc236cb-8fff-43aa-bc5e-66656c7abdb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:48.438060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc236cb-8fff-43aa-bc5e-66656c7abdb2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:48.474422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff4eab-0205-4dd2-97ab-854fd5ba4138 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:48.474707 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4006/7959] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:39:48.485226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff4eab-0205-4dd2-97ab-854fd5ba4138 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:48.505058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e77ae-92e2-40ac-b460-b78715059ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:48.505788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e77ae-92e2-40ac-b460-b78715059ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:48.507464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e77ae-92e2-40ac-b460-b78715059ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:48.507913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e77ae-92e2-40ac-b460-b78715059ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:48.508680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e77ae-92e2-40ac-b460-b78715059ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:48.513477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e77ae-92e2-40ac-b460-b78715059ac3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:48.603668 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3954/7960] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:39:48 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:39:48.608593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc236cb-8fff-43aa-bc5e-66656c7abdb2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:48.627377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc236cb-8fff-43aa-bc5e-66656c7abdb2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:48.799935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223a9e1-a9f6-4fc2-9f59-25265d4b9b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:48.800631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223a9e1-a9f6-4fc2-9f59-25265d4b9b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:48.801295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223a9e1-a9f6-4fc2-9f59-25265d4b9b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:48.801597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223a9e1-a9f6-4fc2-9f59-25265d4b9b9e admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:48.802250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223a9e1-a9f6-4fc2-9f59-25265d4b9b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:48.808384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223a9e1-a9f6-4fc2-9f59-25265d4b9b9e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:48.831997 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:48.857373 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4007/7961] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:39:48 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:48.858836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e77ae-92e2-40ac-b460-b78715059ac3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:48.875111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e77ae-92e2-40ac-b460-b78715059ac3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:48.883821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d7f2f-71ff-4572-a321-6bf66be7be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:48.885526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d7f2f-71ff-4572-a321-6bf66be7be38 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:48.885526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d7f2f-71ff-4572-a321-6bf66be7be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:48.885526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d7f2f-71ff-4572-a321-6bf66be7be38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:48.888159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d7f2f-71ff-4572-a321-6bf66be7be38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:48.889658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d7f2f-71ff-4572-a321-6bf66be7be38 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:48.929343 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3955/7962] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:39:48.930855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223a9e1-a9f6-4fc2-9f59-25265d4b9b9e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:48.953420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223a9e1-a9f6-4fc2-9f59-25265d4b9b9e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:48.969274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d0cbb-51ab-4cf7-8eca-6eeae4f0a886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:48.974270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d0cbb-51ab-4cf7-8eca-6eeae4f0a886 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:48.976405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d0cbb-51ab-4cf7-8eca-6eeae4f0a886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:48.976796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d0cbb-51ab-4cf7-8eca-6eeae4f0a886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:48.977541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d0cbb-51ab-4cf7-8eca-6eeae4f0a886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:48.979214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d0cbb-51ab-4cf7-8eca-6eeae4f0a886 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:49.007953 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4008/7963] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:39:49.008321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d7f2f-71ff-4572-a321-6bf66be7be38 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:49.041698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d7f2f-71ff-4572-a321-6bf66be7be38 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:49.070652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1fc15-6779-429d-9e5b-16924bfb2744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:49.071468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1fc15-6779-429d-9e5b-16924bfb2744 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:49.071750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1fc15-6779-429d-9e5b-16924bfb2744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:49.072017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1fc15-6779-429d-9e5b-16924bfb2744 admin admin] PATH_INFO: `/v3/projects/29a6331112ec4596a419e314b36ba7aa/users/7f2398002f0c4fe2be89526abcc83f1c/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:49.133087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1fc15-6779-429d-9e5b-16924bfb2744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a6331112ec4596a419e314b36ba7aa, user_id=7f2398002f0c4fe2be89526abcc83f1c, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:49.146264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1fc15-6779-429d-9e5b-16924bfb2744 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:49.201819 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3956/7964] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:39:49 2022] PUT /identity/v3/projects/29a6331112ec4596a419e314b36ba7aa/users/7f2398002f0c4fe2be89526abcc83f1c/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:39:49.211753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1283d-e20c-44e6-aa9e-035462c89d04 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:49.212334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1283d-e20c-44e6-aa9e-035462c89d04 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:49.212334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1283d-e20c-44e6-aa9e-035462c89d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:49.224986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1fc15-6779-429d-9e5b-16924bfb2744 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:49.227032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d4d1fc15-6779-429d-9e5b-16924bfb2744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:49.313032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d4e1283d-e20c-44e6-aa9e-035462c89d04 None None] MFA Rules not processed for user `7f2398002f0c4fe2be89526abcc83f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:49.314237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d4e1283d-e20c-44e6-aa9e-035462c89d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:49.375912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1fc15-6779-429d-9e5b-16924bfb2744 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:49.414177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ea859-5cc0-45da-90b4-e75bb02ea969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:49.415692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ea859-5cc0-45da-90b4-e75bb02ea969 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:49.417420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ea859-5cc0-45da-90b4-e75bb02ea969 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:49.418123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ea859-5cc0-45da-90b4-e75bb02ea969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:49.428404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-892ea859-5cc0-45da-90b4-e75bb02ea969 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:49.471310 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:49.545078 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4009/7965] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:49.552089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1283d-e20c-44e6-aa9e-035462c89d04 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:49.669449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ea859-5cc0-45da-90b4-e75bb02ea969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:49.673549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ea859-5cc0-45da-90b4-e75bb02ea969 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:49.705578 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3957/7966] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:39:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:39:49.741298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ea859-5cc0-45da-90b4-e75bb02ea969 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:49.748766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-892ea859-5cc0-45da-90b4-e75bb02ea969 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:49.944067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ea859-5cc0-45da-90b4-e75bb02ea969 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:49.953907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1283d-e20c-44e6-aa9e-035462c89d04 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:49.956654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59995463-7397-4dad-a721-dcc4c7c7b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:49.960026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59995463-7397-4dad-a721-dcc4c7c7b8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:49.960026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59995463-7397-4dad-a721-dcc4c7c7b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:49.960026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59995463-7397-4dad-a721-dcc4c7c7b8ec admin admin] PATH_INFO: `/v3/users/22bcdb6c0e89492ba77baf34456dca3c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:49.961008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59995463-7397-4dad-a721-dcc4c7c7b8ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=22bcdb6c0e89492ba77baf34456dca3c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:49.963266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59995463-7397-4dad-a721-dcc4c7c7b8ec admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:49.971478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9498cf-30c3-4b31-8a8b-40568d8596d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:49.972475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9498cf-30c3-4b31-8a8b-40568d8596d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:49.973181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9498cf-30c3-4b31-8a8b-40568d8596d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:49.973636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9498cf-30c3-4b31-8a8b-40568d8596d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:49.975993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9498cf-30c3-4b31-8a8b-40568d8596d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:49.978794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9498cf-30c3-4b31-8a8b-40568d8596d7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:50.096513 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4010/7967] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:39:49 2022] POST /identity/v3/projects => generated 367 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:50.102103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9498cf-30c3-4b31-8a8b-40568d8596d7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:50.155535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-59995463-7397-4dad-a721-dcc4c7c7b8ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22bcdb6c0e89492ba77baf34456dca3c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:50.158016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-59995463-7397-4dad-a721-dcc4c7c7b8ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22bcdb6c0e89492ba77baf34456dca3c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:50.191466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-59995463-7397-4dad-a721-dcc4c7c7b8ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22bcdb6c0e89492ba77baf34456dca3c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:50.210581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-59995463-7397-4dad-a721-dcc4c7c7b8ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22bcdb6c0e89492ba77baf34456dca3c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:50.211890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-59995463-7397-4dad-a721-dcc4c7c7b8ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22bcdb6c0e89492ba77baf34456dca3c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:50.241933 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3958/7968] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:39:49 2022] DELETE /identity/v3/users/22bcdb6c0e89492ba77baf34456dca3c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:50.247716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c832e-57a2-429d-b0c0-29cfaa60092d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:50.248944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c832e-57a2-429d-b0c0-29cfaa60092d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:50.249392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c832e-57a2-429d-b0c0-29cfaa60092d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:50.316293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-579c832e-57a2-429d-b0c0-29cfaa60092d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:50.317842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-579c832e-57a2-429d-b0c0-29cfaa60092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:50.337086 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:50.349042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9498cf-30c3-4b31-8a8b-40568d8596d7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:50.374824 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:50.455166 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3959/7969] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:50.466576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c832e-57a2-429d-b0c0-29cfaa60092d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:50.472986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-579c832e-57a2-429d-b0c0-29cfaa60092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:50.491208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5fb59-c665-4d16-94aa-cfc05b16d206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:50.492144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5fb59-c665-4d16-94aa-cfc05b16d206 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:50.492842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5fb59-c665-4d16-94aa-cfc05b16d206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:50.496377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5fb59-c665-4d16-94aa-cfc05b16d206 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:50.501649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5fb59-c665-4d16-94aa-cfc05b16d206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:50.506889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5fb59-c665-4d16-94aa-cfc05b16d206 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:50.579697 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4011/7970] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:39:50 2022] POST /identity/v3/users => generated 290 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:50.592171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5fb59-c665-4d16-94aa-cfc05b16d206 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:50.594430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-59b5fb59-c665-4d16-94aa-cfc05b16d206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:50.636528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c832e-57a2-429d-b0c0-29cfaa60092d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:50.641812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5fb59-c665-4d16-94aa-cfc05b16d206 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:50.646566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff45e1-094a-4ce3-8a94-3407b3b75638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:50.647667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff45e1-094a-4ce3-8a94-3407b3b75638 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:50.648256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff45e1-094a-4ce3-8a94-3407b3b75638 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:50.649370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff45e1-094a-4ce3-8a94-3407b3b75638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:50.659428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad92433-e29c-4caa-a561-26f73c7dc51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:50.660771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad92433-e29c-4caa-a561-26f73c7dc51e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:50.661208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad92433-e29c-4caa-a561-26f73c7dc51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:50.664022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad92433-e29c-4caa-a561-26f73c7dc51e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:50.666022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad92433-e29c-4caa-a561-26f73c7dc51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:50.669031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad92433-e29c-4caa-a561-26f73c7dc51e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:50.674134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff45e1-094a-4ce3-8a94-3407b3b75638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:50.679672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff45e1-094a-4ce3-8a94-3407b3b75638 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:50.707346 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4012/7971] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:39:50.709908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad92433-e29c-4caa-a561-26f73c7dc51e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:50.732921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad92433-e29c-4caa-a561-26f73c7dc51e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:50.754141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb149b7-4d75-4111-98cf-0295954e5e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:50.755198 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3960/7972] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:39:50.757020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb149b7-4d75-4111-98cf-0295954e5e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:50.757497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb149b7-4d75-4111-98cf-0295954e5e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:50.757935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb149b7-4d75-4111-98cf-0295954e5e12 admin admin] PATH_INFO: `/v3/projects/ec80839cde944c3c8de1b4e2ff6e0a5b/users/dbf957cbe8d74018977ed74784779b88/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:50.818951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb149b7-4d75-4111-98cf-0295954e5e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec80839cde944c3c8de1b4e2ff6e0a5b, user_id=dbf957cbe8d74018977ed74784779b88, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:50.828807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb149b7-4d75-4111-98cf-0295954e5e12 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:50.860632 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4013/7973] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:39:50 2022] PUT /identity/v3/projects/ec80839cde944c3c8de1b4e2ff6e0a5b/users/dbf957cbe8d74018977ed74784779b88/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:50.867081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff45e1-094a-4ce3-8a94-3407b3b75638 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:50.883325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff45e1-094a-4ce3-8a94-3407b3b75638 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:51.071067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05926ebb-d1a2-45f8-b9b6-bafdca512b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:51.072382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05926ebb-d1a2-45f8-b9b6-bafdca512b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:51.077083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05926ebb-d1a2-45f8-b9b6-bafdca512b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:51.077563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05926ebb-d1a2-45f8-b9b6-bafdca512b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:51.078539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05926ebb-d1a2-45f8-b9b6-bafdca512b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:51.081365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05926ebb-d1a2-45f8-b9b6-bafdca512b5b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:51.145604 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3961/7974] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:39:51.146879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb149b7-4d75-4111-98cf-0295954e5e12 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:51.169632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb149b7-4d75-4111-98cf-0295954e5e12 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:51.193495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05926ebb-d1a2-45f8-b9b6-bafdca512b5b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:51.195401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-05926ebb-d1a2-45f8-b9b6-bafdca512b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:51.201994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e667096-650a-4986-82eb-6a122e719a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:51.202681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e667096-650a-4986-82eb-6a122e719a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:51.202979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e667096-650a-4986-82eb-6a122e719a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:51.208901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e667096-650a-4986-82eb-6a122e719a30 admin admin] PATH_INFO: `/v3/projects/ec80839cde944c3c8de1b4e2ff6e0a5b/users/dbf957cbe8d74018977ed74784779b88/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:51.221777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e667096-650a-4986-82eb-6a122e719a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec80839cde944c3c8de1b4e2ff6e0a5b, user_id=dbf957cbe8d74018977ed74784779b88, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:51.242412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e667096-650a-4986-82eb-6a122e719a30 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:51.300986 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4014/7975] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:39:51 2022] PUT /identity/v3/projects/ec80839cde944c3c8de1b4e2ff6e0a5b/users/dbf957cbe8d74018977ed74784779b88/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:51.306269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabf834-7ce7-499f-bce7-79261bece3c5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:51.306548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabf834-7ce7-499f-bce7-79261bece3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:51.306819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabf834-7ce7-499f-bce7-79261bece3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:51.402535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05926ebb-d1a2-45f8-b9b6-bafdca512b5b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:51.487485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bbabf834-7ce7-499f-bce7-79261bece3c5 None None] MFA Rules not processed for user `dbf957cbe8d74018977ed74784779b88`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:51.493067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bbabf834-7ce7-499f-bce7-79261bece3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:51.515038 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:51.645382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72dba9-74ae-4c21-985f-dc1b89490ada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:51.646095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72dba9-74ae-4c21-985f-dc1b89490ada service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:51.646456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72dba9-74ae-4c21-985f-dc1b89490ada service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:51.646734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72dba9-74ae-4c21-985f-dc1b89490ada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:51.652901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba72dba9-74ae-4c21-985f-dc1b89490ada service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:51.874073 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4015/7976] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 569 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:51.878032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabf834-7ce7-499f-bce7-79261bece3c5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:51.885616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bbabf834-7ce7-499f-bce7-79261bece3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:51.917893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72dba9-74ae-4c21-985f-dc1b89490ada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:51.920452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72dba9-74ae-4c21-985f-dc1b89490ada service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:51.973318 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3962/7977] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:39:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:39:51.981169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72dba9-74ae-4c21-985f-dc1b89490ada service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:52.036396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72dba9-74ae-4c21-985f-dc1b89490ada service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:52.063062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004294de-6333-4257-8beb-91fbb27ef13e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf957cbe8d74018977ed74784779b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:52.063690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004294de-6333-4257-8beb-91fbb27ef13e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:52.063971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004294de-6333-4257-8beb-91fbb27ef13e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:52.064244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004294de-6333-4257-8beb-91fbb27ef13e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] PATH_INFO: `/v3/policies` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:52.070604 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:52.087064 n-d-master-1 devstack@keystone.service[81805]: WARNING oslo_log.versionutils [None req-004294de-6333-4257-8beb-91fbb27ef13e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 16 01:39:52.087603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004294de-6333-4257-8beb-91fbb27ef13e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:52.089689 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-004294de-6333-4257-8beb-91fbb27ef13e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:39:52.089689 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:39:52.089689 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:39:52.091214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004294de-6333-4257-8beb-91fbb27ef13e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:52.198396 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3963/7978] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:39:51 2022] POST /identity/v3/policies => generated 228 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:52.202101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004294de-6333-4257-8beb-91fbb27ef13e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:52.228486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabf834-7ce7-499f-bce7-79261bece3c5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:52.230823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004294de-6333-4257-8beb-91fbb27ef13e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:52.244391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ac053-2337-446c-a7c7-ea1488454ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:52.248960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ac053-2337-446c-a7c7-ea1488454ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:52.251060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458a180-8486-408a-8bc5-321186fba98f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf957cbe8d74018977ed74784779b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:52.251596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458a180-8486-408a-8bc5-321186fba98f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:52.251873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458a180-8486-408a-8bc5-321186fba98f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:52.252202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ac053-2337-446c-a7c7-ea1488454ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:52.252486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ac053-2337-446c-a7c7-ea1488454ec9 admin admin] PATH_INFO: `/v3/projects/3006edea3cd547909615ce3275b58597` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:52.254769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ac053-2337-446c-a7c7-ea1488454ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3006edea3cd547909615ce3275b58597)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:52.256208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458a180-8486-408a-8bc5-321186fba98f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] PATH_INFO: `/v3/policies/3ad7dbfb34ac420f9b9e3162e2619950` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:52.257187 n-d-master-1 devstack@keystone.service[81805]: WARNING oslo_log.versionutils [None req-7458a180-8486-408a-8bc5-321186fba98f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 16 01:39:52.261205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ac053-2337-446c-a7c7-ea1488454ec9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:52.261613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458a180-8486-408a-8bc5-321186fba98f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=3ad7dbfb34ac420f9b9e3162e2619950)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:52.264724 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-7458a180-8486-408a-8bc5-321186fba98f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:39:52.264724 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:39:52.264724 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:39:52.268475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458a180-8486-408a-8bc5-321186fba98f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:52.347809 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3964/7979] 10.222.0.39 () {60 vars in 1252 bytes} [Sun Oct 16 01:39:52 2022] PATCH /identity/v3/policies/3ad7dbfb34ac420f9b9e3162e2619950 => generated 236 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:39:52.350635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458a180-8486-408a-8bc5-321186fba98f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:52.389149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458a180-8486-408a-8bc5-321186fba98f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:52.441556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-122ac053-2337-446c-a7c7-ea1488454ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3006edea3cd547909615ce3275b58597', 'request_id': 'req-122ac053-2337-446c-a7c7-ea1488454ec9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:52.473180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-122ac053-2337-446c-a7c7-ea1488454ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3006edea3cd547909615ce3275b58597', 'request_id': 'req-122ac053-2337-446c-a7c7-ea1488454ec9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:52.498899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-122ac053-2337-446c-a7c7-ea1488454ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3006edea3cd547909615ce3275b58597', 'request_id': 'req-122ac053-2337-446c-a7c7-ea1488454ec9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:52.527504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-122ac053-2337-446c-a7c7-ea1488454ec9 admin admin] The token cache is being invalidate because project 3006edea3cd547909615ce3275b58597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:39:52.527804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-122ac053-2337-446c-a7c7-ea1488454ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:52.530898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-122ac053-2337-446c-a7c7-ea1488454ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:52.535713 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4016/7980] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:39:51 2022] DELETE /identity/v3/projects/3006edea3cd547909615ce3275b58597 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:52.541610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139d0f-ad7a-48af-a528-ce12ba6b3888 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:52.541916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139d0f-ad7a-48af-a528-ce12ba6b3888 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:52.566572 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139d0f-ad7a-48af-a528-ce12ba6b3888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:52.639512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c127b-01f6-4740-9f93-a4bdd88ebb1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf957cbe8d74018977ed74784779b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:52.643258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c127b-01f6-4740-9f93-a4bdd88ebb1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:52.643545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c127b-01f6-4740-9f93-a4bdd88ebb1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:52.643818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c127b-01f6-4740-9f93-a4bdd88ebb1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] PATH_INFO: `/v3/policies/3ad7dbfb34ac420f9b9e3162e2619950` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:52.646315 n-d-master-1 devstack@keystone.service[81805]: WARNING oslo_log.versionutils [None req-667c127b-01f6-4740-9f93-a4bdd88ebb1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 16 01:39:52.648661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bd139d0f-ad7a-48af-a528-ce12ba6b3888 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:52.649094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c127b-01f6-4740-9f93-a4bdd88ebb1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=3ad7dbfb34ac420f9b9e3162e2619950)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:52.652299 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-667c127b-01f6-4740-9f93-a4bdd88ebb1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:39:52.652299 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:39:52.652299 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:39:52.655375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bd139d0f-ad7a-48af-a528-ce12ba6b3888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:52.658611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c127b-01f6-4740-9f93-a4bdd88ebb1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:52.683082 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3965/7981] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:39:52 2022] GET /identity/v3/policies/3ad7dbfb34ac420f9b9e3162e2619950 => generated 236 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:39:52.687486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c127b-01f6-4740-9f93-a4bdd88ebb1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:52.689436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-667c127b-01f6-4740-9f93-a4bdd88ebb1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:52.719941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c127b-01f6-4740-9f93-a4bdd88ebb1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:52.729963 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ec182-3a20-49c3-8817-564bf4c9a76e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf957cbe8d74018977ed74784779b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:52.730761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ec182-3a20-49c3-8817-564bf4c9a76e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:52.731074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ec182-3a20-49c3-8817-564bf4c9a76e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:52.731575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ec182-3a20-49c3-8817-564bf4c9a76e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] PATH_INFO: `/v3/policies/3ad7dbfb34ac420f9b9e3162e2619950` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:52.732416 n-d-master-1 devstack@keystone.service[81805]: WARNING oslo_log.versionutils [None req-2f8ec182-3a20-49c3-8817-564bf4c9a76e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 16 01:39:52.732975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ec182-3a20-49c3-8817-564bf4c9a76e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=3ad7dbfb34ac420f9b9e3162e2619950)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:52.734209 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-2f8ec182-3a20-49c3-8817-564bf4c9a76e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:39:52.734209 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:39:52.734209 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:39:52.735125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ec182-3a20-49c3-8817-564bf4c9a76e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:52.769123 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3966/7982] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:39:52 2022] DELETE /identity/v3/policies/3ad7dbfb34ac420f9b9e3162e2619950 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:39:52.780877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ec182-3a20-49c3-8817-564bf4c9a76e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:52.840637 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4017/7983] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:52.864930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb475f-89e5-4d52-8fda-9d1fc9e03353 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:52.871310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb475f-89e5-4d52-8fda-9d1fc9e03353 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:52.874228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ec182-3a20-49c3-8817-564bf4c9a76e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:52.875023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb475f-89e5-4d52-8fda-9d1fc9e03353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:52.908061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb50412-4474-4778-bb24-d9532219c74f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf957cbe8d74018977ed74784779b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:52.909288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb50412-4474-4778-bb24-d9532219c74f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:52.910645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb50412-4474-4778-bb24-d9532219c74f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:52.910971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb50412-4474-4778-bb24-d9532219c74f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] PATH_INFO: `/v3/policies` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:52.912078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb50412-4474-4778-bb24-d9532219c74f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:52.915884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb50412-4474-4778-bb24-d9532219c74f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:52.986534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c0fb475f-89e5-4d52-8fda-9d1fc9e03353 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:52.991513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c0fb475f-89e5-4d52-8fda-9d1fc9e03353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:53.002544 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3967/7984] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:39:52 2022] POST /identity/v3/policies => generated 229 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:53.005091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb50412-4474-4778-bb24-d9532219c74f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:53.030067 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4018/7985] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:53.049558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb475f-89e5-4d52-8fda-9d1fc9e03353 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:53.083749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb50412-4474-4778-bb24-d9532219c74f tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:53.113325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972751a5-abed-44ca-815b-29fa22e17c6b tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf957cbe8d74018977ed74784779b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:53.114025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972751a5-abed-44ca-815b-29fa22e17c6b tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:53.114269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972751a5-abed-44ca-815b-29fa22e17c6b tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:53.114515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972751a5-abed-44ca-815b-29fa22e17c6b tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] PATH_INFO: `/v3/policies` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:53.118095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972751a5-abed-44ca-815b-29fa22e17c6b tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:53.120007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972751a5-abed-44ca-815b-29fa22e17c6b tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:53.138155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb475f-89e5-4d52-8fda-9d1fc9e03353 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:53.154585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a6014-375b-4328-ab15-19a01c5ca5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:53.159832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a6014-375b-4328-ab15-19a01c5ca5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:53.160515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a6014-375b-4328-ab15-19a01c5ca5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:53.163563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a6014-375b-4328-ab15-19a01c5ca5b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:53.164934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a6014-375b-4328-ab15-19a01c5ca5b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:39:53.165503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a6014-375b-4328-ab15-19a01c5ca5b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:53.167404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a6014-375b-4328-ab15-19a01c5ca5b0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:53.183000 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3968/7986] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:39:53 2022] POST /identity/v3/policies => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:53.189443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972751a5-abed-44ca-815b-29fa22e17c6b tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:53.203765 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4019/7987] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:39:53.207823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a6014-375b-4328-ab15-19a01c5ca5b0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:53.227113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972751a5-abed-44ca-815b-29fa22e17c6b tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:53.228387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a6014-375b-4328-ab15-19a01c5ca5b0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:53.241148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df6f7-2322-4dea-9057-b8a1dd2ade51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:53.241765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df6f7-2322-4dea-9057-b8a1dd2ade51 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:53.242098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df6f7-2322-4dea-9057-b8a1dd2ade51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:53.242378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df6f7-2322-4dea-9057-b8a1dd2ade51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:53.244397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20df6f7-2322-4dea-9057-b8a1dd2ade51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:53.247358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20df6f7-2322-4dea-9057-b8a1dd2ade51 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:53.254646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79e963-8343-4281-9f65-f80d5a2be770 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf957cbe8d74018977ed74784779b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:53.255558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79e963-8343-4281-9f65-f80d5a2be770 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:53.256687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79e963-8343-4281-9f65-f80d5a2be770 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:53.259336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79e963-8343-4281-9f65-f80d5a2be770 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] PATH_INFO: `/v3/policies` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:53.261068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79e963-8343-4281-9f65-f80d5a2be770 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:53.266870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79e963-8343-4281-9f65-f80d5a2be770 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:53.304599 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:53.336760 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4020/7988] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:39:53 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:53.337866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df6f7-2322-4dea-9057-b8a1dd2ade51 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:53.360586 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3969/7989] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Oct 16 01:39:53 2022] POST /identity/v3/policies => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:53.362523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79e963-8343-4281-9f65-f80d5a2be770 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:53.374944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79e963-8343-4281-9f65-f80d5a2be770 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:53.401728 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:53.576135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df6f7-2322-4dea-9057-b8a1dd2ade51 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:53.583815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd9028-50b0-459d-a424-d23db9a96011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:53.584429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd9028-50b0-459d-a424-d23db9a96011 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:53.584707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd9028-50b0-459d-a424-d23db9a96011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:53.584979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd9028-50b0-459d-a424-d23db9a96011 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:53.585622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd9028-50b0-459d-a424-d23db9a96011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:53.587590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd9028-50b0-459d-a424-d23db9a96011 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:53.633478 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4021/7990] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:39:53 2022] POST /identity/v3/users => generated 297 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:53.644055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd9028-50b0-459d-a424-d23db9a96011 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:53.663530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c26fa3-2301-4dcb-a204-8399405d2b1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf957cbe8d74018977ed74784779b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:53.664209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd9028-50b0-459d-a424-d23db9a96011 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:53.665902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c26fa3-2301-4dcb-a204-8399405d2b1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:53.666455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c26fa3-2301-4dcb-a204-8399405d2b1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:53.669600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c26fa3-2301-4dcb-a204-8399405d2b1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] PATH_INFO: `/v3/policies` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:53.672237 n-d-master-1 devstack@keystone.service[81805]: WARNING oslo_log.versionutils [None req-09c26fa3-2301-4dcb-a204-8399405d2b1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 16 01:39:53.677900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c26fa3-2301-4dcb-a204-8399405d2b1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:53.678402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aeca1-24ad-42e9-bbc7-d60bc2b7f458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:53.679042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aeca1-24ad-42e9-bbc7-d60bc2b7f458 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:53.679326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aeca1-24ad-42e9-bbc7-d60bc2b7f458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:53.679598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aeca1-24ad-42e9-bbc7-d60bc2b7f458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:53.680238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aeca1-24ad-42e9-bbc7-d60bc2b7f458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:53.682395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aeca1-24ad-42e9-bbc7-d60bc2b7f458 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:53.694989 n-d-master-1 devstack@keystone.service[81805]: WARNING py.warnings [None req-09c26fa3-2301-4dcb-a204-8399405d2b1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 01:39:53.694989 n-d-master-1 devstack@keystone.service[81805]: warnings.warn(msg) Oct 16 01:39:53.694989 n-d-master-1 devstack@keystone.service[81805]: Oct 16 01:39:53.694989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c26fa3-2301-4dcb-a204-8399405d2b1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:53.712894 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4022/7991] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:39:53.717764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aeca1-24ad-42e9-bbc7-d60bc2b7f458 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:53.725985 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3970/7992] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Oct 16 01:39:53 2022] GET /identity/v3/policies => generated 763 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:39:53.736173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c26fa3-2301-4dcb-a204-8399405d2b1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:53.793067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aeca1-24ad-42e9-bbc7-d60bc2b7f458 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:53.801663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c26fa3-2301-4dcb-a204-8399405d2b1c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:53.818835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1cb68-ddde-4207-ad00-d67684e2c0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:53.822885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1cb68-ddde-4207-ad00-d67684e2c0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:53.827971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1cb68-ddde-4207-ad00-d67684e2c0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:53.828362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1cb68-ddde-4207-ad00-d67684e2c0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:53.829420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1cb68-ddde-4207-ad00-d67684e2c0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:53.834982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1cb68-ddde-4207-ad00-d67684e2c0a7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:53.836468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c84e70-244f-42ef-bf8e-b148fdcaeb0c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf957cbe8d74018977ed74784779b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:53.838138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c84e70-244f-42ef-bf8e-b148fdcaeb0c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:53.849824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c84e70-244f-42ef-bf8e-b148fdcaeb0c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:53.853039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c84e70-244f-42ef-bf8e-b148fdcaeb0c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] PATH_INFO: `/v3/policies/8b26b9f7e3854a25865c8000513348c3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:53.857370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c84e70-244f-42ef-bf8e-b148fdcaeb0c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=8b26b9f7e3854a25865c8000513348c3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:53.865247 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4023/7993] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:39:53.868822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1cb68-ddde-4207-ad00-d67684e2c0a7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:53.881742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c84e70-244f-42ef-bf8e-b148fdcaeb0c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:53.893961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1cb68-ddde-4207-ad00-d67684e2c0a7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:53.923947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d21c3-267e-4af0-8099-af3472a2d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:53.928726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d21c3-267e-4af0-8099-af3472a2d916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:53.931061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d21c3-267e-4af0-8099-af3472a2d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:53.931360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d21c3-267e-4af0-8099-af3472a2d916 admin admin] PATH_INFO: `/v3/projects/855792b0264144dd941200c8468ac26d/users/83bbcff8a1f64cfa936f13f3cb3955b6/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:53.945098 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3971/7994] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:39:53 2022] DELETE /identity/v3/policies/8b26b9f7e3854a25865c8000513348c3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:53.950524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c84e70-244f-42ef-bf8e-b148fdcaeb0c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:53.978680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d21c3-267e-4af0-8099-af3472a2d916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855792b0264144dd941200c8468ac26d, user_id=83bbcff8a1f64cfa936f13f3cb3955b6, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:53.979409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c84e70-244f-42ef-bf8e-b148fdcaeb0c tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:53.984803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d21c3-267e-4af0-8099-af3472a2d916 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:53.995121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f2f4e-28a6-427c-85d8-8ee5fd93c75e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf957cbe8d74018977ed74784779b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:53.995891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f2f4e-28a6-427c-85d8-8ee5fd93c75e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:53.996178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f2f4e-28a6-427c-85d8-8ee5fd93c75e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:53.996483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f2f4e-28a6-427c-85d8-8ee5fd93c75e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] PATH_INFO: `/v3/policies/27cedf6ba1e34a51ba9f5f6a55c24261` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:54.005287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f2f4e-28a6-427c-85d8-8ee5fd93c75e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=27cedf6ba1e34a51ba9f5f6a55c24261)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:54.007229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f2f4e-28a6-427c-85d8-8ee5fd93c75e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:54.022694 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4024/7995] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:39:53 2022] PUT /identity/v3/projects/855792b0264144dd941200c8468ac26d/users/83bbcff8a1f64cfa936f13f3cb3955b6/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:39:54.024455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2fdc4-dabb-4c35-a0e5-ae637e58f4b1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:54.024791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2fdc4-dabb-4c35-a0e5-ae637e58f4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:54.025119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2fdc4-dabb-4c35-a0e5-ae637e58f4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:54.045789 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3972/7996] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:39:53 2022] DELETE /identity/v3/policies/27cedf6ba1e34a51ba9f5f6a55c24261 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:54.056483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f2f4e-28a6-427c-85d8-8ee5fd93c75e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:54.085363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f2f4e-28a6-427c-85d8-8ee5fd93c75e tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:54.092216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4ca2fdc4-dabb-4c35-a0e5-ae637e58f4b1 None None] MFA Rules not processed for user `83bbcff8a1f64cfa936f13f3cb3955b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:54.094084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4ca2fdc4-dabb-4c35-a0e5-ae637e58f4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:54.268610 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4025/7997] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:39:54.268866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2fdc4-dabb-4c35-a0e5-ae637e58f4b1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:54.320526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6121db3-b92f-4a9d-a39f-84138fba6334 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf957cbe8d74018977ed74784779b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:54.321225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6121db3-b92f-4a9d-a39f-84138fba6334 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:54.321496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6121db3-b92f-4a9d-a39f-84138fba6334 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:54.321766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6121db3-b92f-4a9d-a39f-84138fba6334 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] PATH_INFO: `/v3/policies/c22dc54033a64f11bebf4da89acdfea2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:54.323138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6121db3-b92f-4a9d-a39f-84138fba6334 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=c22dc54033a64f11bebf4da89acdfea2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:54.353120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6121db3-b92f-4a9d-a39f-84138fba6334 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:54.381094 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:54.414664 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3973/7998] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:39:54 2022] DELETE /identity/v3/policies/c22dc54033a64f11bebf4da89acdfea2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:54.419450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2fdc4-dabb-4c35-a0e5-ae637e58f4b1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:54.421433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6121db3-b92f-4a9d-a39f-84138fba6334 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:54.425356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e6121db3-b92f-4a9d-a39f-84138fba6334 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:54.434871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1063ed9-cd26-4c54-8af2-c464b519e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:54.435510 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1063ed9-cd26-4c54-8af2-c464b519e775 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:54.435795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1063ed9-cd26-4c54-8af2-c464b519e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:54.437886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1063ed9-cd26-4c54-8af2-c464b519e775 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:54.437886 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1063ed9-cd26-4c54-8af2-c464b519e775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:54.439376 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1063ed9-cd26-4c54-8af2-c464b519e775 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:54.477377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6121db3-b92f-4a9d-a39f-84138fba6334 tempest-PoliciesTestJSON-576304404 tempest-PoliciesTestJSON-576304404-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:54.499476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabe3d6-d0f4-4a2c-9811-b095a5e049a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:54.500166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabe3d6-d0f4-4a2c-9811-b095a5e049a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:54.500449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabe3d6-d0f4-4a2c-9811-b095a5e049a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:54.501940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabe3d6-d0f4-4a2c-9811-b095a5e049a9 admin admin] PATH_INFO: `/v3/users/7f2398002f0c4fe2be89526abcc83f1c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:54.505997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabe3d6-d0f4-4a2c-9811-b095a5e049a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2398002f0c4fe2be89526abcc83f1c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:54.511719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabe3d6-d0f4-4a2c-9811-b095a5e049a9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:54.541845 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4026/7999] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:39:54 2022] POST /identity/v3/projects => generated 391 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:54.544040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1063ed9-cd26-4c54-8af2-c464b519e775 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:54.622778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-daabe3d6-d0f4-4a2c-9811-b095a5e049a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2398002f0c4fe2be89526abcc83f1c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:54.623720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-daabe3d6-d0f4-4a2c-9811-b095a5e049a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2398002f0c4fe2be89526abcc83f1c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:54.635352 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:54.657437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-daabe3d6-d0f4-4a2c-9811-b095a5e049a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2398002f0c4fe2be89526abcc83f1c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:54.668694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-daabe3d6-d0f4-4a2c-9811-b095a5e049a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2398002f0c4fe2be89526abcc83f1c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:54.668694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-daabe3d6-d0f4-4a2c-9811-b095a5e049a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2398002f0c4fe2be89526abcc83f1c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:54.689247 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3974/8000] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:39:54 2022] DELETE /identity/v3/users/7f2398002f0c4fe2be89526abcc83f1c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:54.693629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19b797-0483-4194-a0eb-088ad724b4a0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:54.695089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19b797-0483-4194-a0eb-088ad724b4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:54.695089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19b797-0483-4194-a0eb-088ad724b4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:54.756786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4b19b797-0483-4194-a0eb-088ad724b4a0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:54.760088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4b19b797-0483-4194-a0eb-088ad724b4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:54.843328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1063ed9-cd26-4c54-8af2-c464b519e775 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:54.946575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987319c-f87a-43c5-bdb9-8d0e6002c1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:54.949387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987319c-f87a-43c5-bdb9-8d0e6002c1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:54.949798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987319c-f87a-43c5-bdb9-8d0e6002c1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:54.950784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987319c-f87a-43c5-bdb9-8d0e6002c1f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:54.954867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987319c-f87a-43c5-bdb9-8d0e6002c1f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:54.961631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987319c-f87a-43c5-bdb9-8d0e6002c1f2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:55.085768 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4027/8001] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:39:54 2022] POST /identity/v3/users => generated 302 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:55.101088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987319c-f87a-43c5-bdb9-8d0e6002c1f2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:55.103468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f987319c-f87a-43c5-bdb9-8d0e6002c1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:55.129489 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3975/8002] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:39:55.130744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19b797-0483-4194-a0eb-088ad724b4a0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:55.133842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4b19b797-0483-4194-a0eb-088ad724b4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:55.137057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987319c-f87a-43c5-bdb9-8d0e6002c1f2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:55.149208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07ef3c-6076-4028-abe5-e3009a30d1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:55.150032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07ef3c-6076-4028-abe5-e3009a30d1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:55.150618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07ef3c-6076-4028-abe5-e3009a30d1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:55.151069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07ef3c-6076-4028-abe5-e3009a30d1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:55.154675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07ef3c-6076-4028-abe5-e3009a30d1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:55.158908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07ef3c-6076-4028-abe5-e3009a30d1a1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:55.202875 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4028/8003] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:39:55.205303 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07ef3c-6076-4028-abe5-e3009a30d1a1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:55.245776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07ef3c-6076-4028-abe5-e3009a30d1a1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:55.275374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b336d-f10c-4dc0-8817-b25d9e0ba124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:55.275982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b336d-f10c-4dc0-8817-b25d9e0ba124 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:55.276266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b336d-f10c-4dc0-8817-b25d9e0ba124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:55.276916 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b336d-f10c-4dc0-8817-b25d9e0ba124 admin admin] PATH_INFO: `/v3/projects/0006d55fa66e4e34883f683f439fed71/users/358a87063f3f42db9eaf4c91eeed863a/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:55.314909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b336d-f10c-4dc0-8817-b25d9e0ba124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0006d55fa66e4e34883f683f439fed71, user_id=358a87063f3f42db9eaf4c91eeed863a, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:55.317893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b336d-f10c-4dc0-8817-b25d9e0ba124 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:55.347349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19b797-0483-4194-a0eb-088ad724b4a0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:55.368829 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4029/8004] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:39:55 2022] PUT /identity/v3/projects/0006d55fa66e4e34883f683f439fed71/users/358a87063f3f42db9eaf4c91eeed863a/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:55.369944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b336d-f10c-4dc0-8817-b25d9e0ba124 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:55.489404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe3fc2-787d-46d5-a964-0b339a65f730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:55.490070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe3fc2-787d-46d5-a964-0b339a65f730 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:55.490348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe3fc2-787d-46d5-a964-0b339a65f730 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:55.490619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe3fc2-787d-46d5-a964-0b339a65f730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:55.594993 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:55.674853 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b336d-f10c-4dc0-8817-b25d9e0ba124 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:55.678067 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:55.706092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49ce52-2e83-48af-a243-0a8f08adabfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:55.706877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49ce52-2e83-48af-a243-0a8f08adabfa admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:55.707191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49ce52-2e83-48af-a243-0a8f08adabfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:55.707468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49ce52-2e83-48af-a243-0a8f08adabfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:55.708141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49ce52-2e83-48af-a243-0a8f08adabfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:55.709776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49ce52-2e83-48af-a243-0a8f08adabfa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:55.748479 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4030/8005] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:39:55.749715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49ce52-2e83-48af-a243-0a8f08adabfa admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:55.751681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe3fc2-787d-46d5-a964-0b339a65f730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:55.754992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe3fc2-787d-46d5-a964-0b339a65f730 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:55.780273 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3976/8006] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:39:55.797770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49ce52-2e83-48af-a243-0a8f08adabfa admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:55.823741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b145f-32fe-4d3a-8e0c-d4d330c62095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:55.824481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b145f-32fe-4d3a-8e0c-d4d330c62095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:55.824791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b145f-32fe-4d3a-8e0c-d4d330c62095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:55.825621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b145f-32fe-4d3a-8e0c-d4d330c62095 admin admin] PATH_INFO: `/v3/projects/0006d55fa66e4e34883f683f439fed71/users/358a87063f3f42db9eaf4c91eeed863a/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:55.836258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b145f-32fe-4d3a-8e0c-d4d330c62095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0006d55fa66e4e34883f683f439fed71, user_id=358a87063f3f42db9eaf4c91eeed863a, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:55.839098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b145f-32fe-4d3a-8e0c-d4d330c62095 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:55.877776 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4031/8007] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:39:55 2022] PUT /identity/v3/projects/0006d55fa66e4e34883f683f439fed71/users/358a87063f3f42db9eaf4c91eeed863a/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:55.888715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e071d-da37-4b26-a0ad-7500702493be None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:55.889319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e071d-da37-4b26-a0ad-7500702493be None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:55.889700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e071d-da37-4b26-a0ad-7500702493be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:56.004707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-044e071d-da37-4b26-a0ad-7500702493be None None] MFA Rules not processed for user `358a87063f3f42db9eaf4c91eeed863a`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:56.015075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-044e071d-da37-4b26-a0ad-7500702493be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:56.348405 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3977/8008] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:56.381831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b145f-32fe-4d3a-8e0c-d4d330c62095 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:56.384534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f00b145f-32fe-4d3a-8e0c-d4d330c62095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:56.536633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e071d-da37-4b26-a0ad-7500702493be None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:56.538330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-044e071d-da37-4b26-a0ad-7500702493be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:56.704450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b145f-32fe-4d3a-8e0c-d4d330c62095 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:56.723914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a469c68-6975-4a11-b654-2609c768f457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:56.724781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a469c68-6975-4a11-b654-2609c768f457 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:56.725248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a469c68-6975-4a11-b654-2609c768f457 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:56.725681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a469c68-6975-4a11-b654-2609c768f457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:56.733481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3a469c68-6975-4a11-b654-2609c768f457 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:56.769922 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e071d-da37-4b26-a0ad-7500702493be None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:56.784383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ee497-f376-4d4b-96de-396cf7bc516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:56.785140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ee497-f376-4d4b-96de-396cf7bc516b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:56.785488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ee497-f376-4d4b-96de-396cf7bc516b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:56.785830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ee497-f376-4d4b-96de-396cf7bc516b admin admin] PATH_INFO: `/v3/projects/29a6331112ec4596a419e314b36ba7aa` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:56.788035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ee497-f376-4d4b-96de-396cf7bc516b admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a6331112ec4596a419e314b36ba7aa)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:56.794608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ee497-f376-4d4b-96de-396cf7bc516b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:56.945309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a469c68-6975-4a11-b654-2609c768f457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:56.952706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a469c68-6975-4a11-b654-2609c768f457 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:56.966869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-955ee497-f376-4d4b-96de-396cf7bc516b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a6331112ec4596a419e314b36ba7aa', 'request_id': 'req-955ee497-f376-4d4b-96de-396cf7bc516b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:56.975078 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4032/8009] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:39:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:39:56.991044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-955ee497-f376-4d4b-96de-396cf7bc516b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a6331112ec4596a419e314b36ba7aa', 'request_id': 'req-955ee497-f376-4d4b-96de-396cf7bc516b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:57.018280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-955ee497-f376-4d4b-96de-396cf7bc516b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a6331112ec4596a419e314b36ba7aa', 'request_id': 'req-955ee497-f376-4d4b-96de-396cf7bc516b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:57.020064 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:57.041302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-955ee497-f376-4d4b-96de-396cf7bc516b admin admin] The token cache is being invalidate because project 29a6331112ec4596a419e314b36ba7aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:39:57.041655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-955ee497-f376-4d4b-96de-396cf7bc516b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:57.044101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-955ee497-f376-4d4b-96de-396cf7bc516b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:57.050304 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3978/8010] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:39:56 2022] DELETE /identity/v3/projects/29a6331112ec4596a419e314b36ba7aa => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:57.051132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a469c68-6975-4a11-b654-2609c768f457 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:57.068173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a469c68-6975-4a11-b654-2609c768f457 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:57.205126 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:57.228555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:57.229344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:57.229827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:57.230201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] PATH_INFO: `/v3/users/dbf957cbe8d74018977ed74784779b88` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:57.236454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf957cbe8d74018977ed74784779b88)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:57.236454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:57.360436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf957cbe8d74018977ed74784779b88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:57.361512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf957cbe8d74018977ed74784779b88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:57.381708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf957cbe8d74018977ed74784779b88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:57.406158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf957cbe8d74018977ed74784779b88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:57.407772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf957cbe8d74018977ed74784779b88'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:57.437717 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4033/8011] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:39:57 2022] DELETE /identity/v3/users/dbf957cbe8d74018977ed74784779b88 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:39:57.729888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bb093-6105-4518-b106-f5ae42fac96b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:57.730430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bb093-6105-4518-b106-f5ae42fac96b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:57.730430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bb093-6105-4518-b106-f5ae42fac96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:57.769756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-097bb093-6105-4518-b106-f5ae42fac96b None None] MFA Rules not processed for user `2eabe99e40ef44a09c3f7dc1c78d7608`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:57.773426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-097bb093-6105-4518-b106-f5ae42fac96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:57.942969 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3979/8012] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:58.140103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:58.142463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:58.333252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca302460-ccc7-45d0-9229-f989c558a23b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:58.350764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3c3b4-4ab3-4723-9381-7987855d7f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:58.351876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3c3b4-4ab3-4723-9381-7987855d7f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:58.352154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3c3b4-4ab3-4723-9381-7987855d7f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:58.352426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3c3b4-4ab3-4723-9381-7987855d7f19 admin admin] PATH_INFO: `/v3/projects/ec80839cde944c3c8de1b4e2ff6e0a5b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:58.354104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3c3b4-4ab3-4723-9381-7987855d7f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec80839cde944c3c8de1b4e2ff6e0a5b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:58.356743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3c3b4-4ab3-4723-9381-7987855d7f19 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:58.478765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ab3c3b4-4ab3-4723-9381-7987855d7f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'request_id': 'req-3ab3c3b4-4ab3-4723-9381-7987855d7f19'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:58.495315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ab3c3b4-4ab3-4723-9381-7987855d7f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'request_id': 'req-3ab3c3b4-4ab3-4723-9381-7987855d7f19'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:58.512871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ab3c3b4-4ab3-4723-9381-7987855d7f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec80839cde944c3c8de1b4e2ff6e0a5b', 'request_id': 'req-3ab3c3b4-4ab3-4723-9381-7987855d7f19'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:58.525913 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:58.538858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ab3c3b4-4ab3-4723-9381-7987855d7f19 admin admin] The token cache is being invalidate because project ec80839cde944c3c8de1b4e2ff6e0a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:39:58.539632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ab3c3b4-4ab3-4723-9381-7987855d7f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:58.541481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3ab3c3b4-4ab3-4723-9381-7987855d7f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:58.546340 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4034/8013] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:39:58 2022] DELETE /identity/v3/projects/ec80839cde944c3c8de1b4e2ff6e0a5b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:58.550716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92387c4b-5c0e-4789-9e30-286c42e4ce14 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:58.551290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92387c4b-5c0e-4789-9e30-286c42e4ce14 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:58.551799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92387c4b-5c0e-4789-9e30-286c42e4ce14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:58.588139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-92387c4b-5c0e-4789-9e30-286c42e4ce14 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:58.589837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-92387c4b-5c0e-4789-9e30-286c42e4ce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:58.685641 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3980/8014] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:58.694209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d06be-9330-42ad-bc12-45ce36a76bda None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:58.694742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d06be-9330-42ad-bc12-45ce36a76bda None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:58.695260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d06be-9330-42ad-bc12-45ce36a76bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:58.738023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6a7d06be-9330-42ad-bc12-45ce36a76bda None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:58.739932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6a7d06be-9330-42ad-bc12-45ce36a76bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:58.759957 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4035/8015] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:58.765598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92387c4b-5c0e-4789-9e30-286c42e4ce14 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:58.800001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92387c4b-5c0e-4789-9e30-286c42e4ce14 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:58.813815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb63040-86c7-4299-b7e5-2f54305fb44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:58.814832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb63040-86c7-4299-b7e5-2f54305fb44e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:58.818964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb63040-86c7-4299-b7e5-2f54305fb44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:58.819727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb63040-86c7-4299-b7e5-2f54305fb44e admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:58.821600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb63040-86c7-4299-b7e5-2f54305fb44e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:39:58.822455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb63040-86c7-4299-b7e5-2f54305fb44e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:58.825380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb63040-86c7-4299-b7e5-2f54305fb44e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:58.842862 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3981/8016] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:39:58.847486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d06be-9330-42ad-bc12-45ce36a76bda None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:58.872486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d06be-9330-42ad-bc12-45ce36a76bda None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:58.889734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288331cf-a24f-448d-8937-d404f83e7395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:58.890387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288331cf-a24f-448d-8937-d404f83e7395 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:58.890869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288331cf-a24f-448d-8937-d404f83e7395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:58.891332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288331cf-a24f-448d-8937-d404f83e7395 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:58.892155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288331cf-a24f-448d-8937-d404f83e7395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:58.894305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288331cf-a24f-448d-8937-d404f83e7395 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:58.943395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb63040-86c7-4299-b7e5-2f54305fb44e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:58.950183 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4036/8017] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:39:58 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:58.957494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb63040-86c7-4299-b7e5-2f54305fb44e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:59.094244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5c212-51c4-4d9b-9854-b6ba3250340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:59.096213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c212-51c4-4d9b-9854-b6ba3250340e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:59.096564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c212-51c4-4d9b-9854-b6ba3250340e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:59.096959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c212-51c4-4d9b-9854-b6ba3250340e admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:59.102949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5c212-51c4-4d9b-9854-b6ba3250340e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:59.104878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5c212-51c4-4d9b-9854-b6ba3250340e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:59.155829 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3982/8018] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:39:58 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:59.160138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288331cf-a24f-448d-8937-d404f83e7395 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:59.171763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288331cf-a24f-448d-8937-d404f83e7395 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:59.199436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c7ab2-0800-4a07-a2aa-e8b69654d5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:59.201264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c7ab2-0800-4a07-a2aa-e8b69654d5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:59.201264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c7ab2-0800-4a07-a2aa-e8b69654d5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:59.201486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c7ab2-0800-4a07-a2aa-e8b69654d5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:59.202066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c7ab2-0800-4a07-a2aa-e8b69654d5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:59.203743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c7ab2-0800-4a07-a2aa-e8b69654d5a7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:59.226631 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4037/8019] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:39:59.227548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5c212-51c4-4d9b-9854-b6ba3250340e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:59.244476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5c212-51c4-4d9b-9854-b6ba3250340e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:59.258357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d4d83-5157-4540-a4c3-40e1b407cacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:59.259021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d4d83-5157-4540-a4c3-40e1b407cacc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:59.259330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d4d83-5157-4540-a4c3-40e1b407cacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:59.259638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d4d83-5157-4540-a4c3-40e1b407cacc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:59.260338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d4d83-5157-4540-a4c3-40e1b407cacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:59.262068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d4d83-5157-4540-a4c3-40e1b407cacc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:59.277781 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:59.300845 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3983/8020] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:39:59.303000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c7ab2-0800-4a07-a2aa-e8b69654d5a7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:59.320689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c7ab2-0800-4a07-a2aa-e8b69654d5a7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:59.334060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b05b5-3825-472e-827f-cc9cc6127c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:59.335012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b05b5-3825-472e-827f-cc9cc6127c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:59.335824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b05b5-3825-472e-827f-cc9cc6127c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:59.336205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b05b5-3825-472e-827f-cc9cc6127c5e admin admin] PATH_INFO: `/v3/projects/f27274352e834f9b8afa73561c209e52/users/c029c5a4167f48febe2f20843aabee31/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:59.370747 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b05b5-3825-472e-827f-cc9cc6127c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27274352e834f9b8afa73561c209e52, user_id=c029c5a4167f48febe2f20843aabee31, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:59.374698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b05b5-3825-472e-827f-cc9cc6127c5e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:59.400650 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4038/8021] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:39:59 2022] PUT /identity/v3/projects/f27274352e834f9b8afa73561c209e52/users/c029c5a4167f48febe2f20843aabee31/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:39:59.411820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7b0b4-ec2b-4033-b3b1-cf38454363e8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:59.412419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7b0b4-ec2b-4033-b3b1-cf38454363e8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:59.412911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7b0b4-ec2b-4033-b3b1-cf38454363e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:59.500989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b05b5-3825-472e-827f-cc9cc6127c5e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:59.503002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-262b05b5-3825-472e-827f-cc9cc6127c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:59.505869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d5b7b0b4-ec2b-4033-b3b1-cf38454363e8 None None] MFA Rules not processed for user `c029c5a4167f48febe2f20843aabee31`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:59.508063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d5b7b0b4-ec2b-4033-b3b1-cf38454363e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:59.692675 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3984/8022] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:39:59.693703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b05b5-3825-472e-827f-cc9cc6127c5e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:59.694162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7b0b4-ec2b-4033-b3b1-cf38454363e8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:59.709910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271f039-a092-48b5-b124-45541c14d323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:59.710638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271f039-a092-48b5-b124-45541c14d323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:59.711129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271f039-a092-48b5-b124-45541c14d323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:59.712621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271f039-a092-48b5-b124-45541c14d323 admin admin] PATH_INFO: `/v3/users/a9d9205fc307432ead11126ce0ed36e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:59.718549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271f039-a092-48b5-b124-45541c14d323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d9205fc307432ead11126ce0ed36e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:59.720678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7b0b4-ec2b-4033-b3b1-cf38454363e8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:39:59.721792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271f039-a092-48b5-b124-45541c14d323 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:59.734832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316ae52-7fe7-45f6-b19c-4a4573281b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:39:59.735502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ae52-7fe7-45f6-b19c-4a4573281b04 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:59.735954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ae52-7fe7-45f6-b19c-4a4573281b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:59.736574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ae52-7fe7-45f6-b19c-4a4573281b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:59.737920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316ae52-7fe7-45f6-b19c-4a4573281b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:39:59.740402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316ae52-7fe7-45f6-b19c-4a4573281b04 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:39:59.837162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f271f039-a092-48b5-b124-45541c14d323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d9205fc307432ead11126ce0ed36e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:59.838558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f271f039-a092-48b5-b124-45541c14d323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d9205fc307432ead11126ce0ed36e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:59.845670 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3985/8023] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:39:59 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:39:59.851135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316ae52-7fe7-45f6-b19c-4a4573281b04 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:39:59.859105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f271f039-a092-48b5-b124-45541c14d323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d9205fc307432ead11126ce0ed36e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:59.860151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f316ae52-7fe7-45f6-b19c-4a4573281b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:59.874817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f271f039-a092-48b5-b124-45541c14d323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d9205fc307432ead11126ce0ed36e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:59.875792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f271f039-a092-48b5-b124-45541c14d323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d9205fc307432ead11126ce0ed36e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:39:59.906272 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4039/8024] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:39:59 2022] DELETE /identity/v3/users/a9d9205fc307432ead11126ce0ed36e3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:39:59.915713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddb6bd-b0ad-4a28-9544-9d6aff5826f2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:39:59.919547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddb6bd-b0ad-4a28-9544-9d6aff5826f2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:39:59.919691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddb6bd-b0ad-4a28-9544-9d6aff5826f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:39:59.970331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-82ddb6bd-b0ad-4a28-9544-9d6aff5826f2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:39:59.973328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-82ddb6bd-b0ad-4a28-9544-9d6aff5826f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:39:59.990410 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:00.035719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316ae52-7fe7-45f6-b19c-4a4573281b04 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:00.147974 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4040/8025] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:00.173864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddb6bd-b0ad-4a28-9544-9d6aff5826f2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:00.183532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6610fe9-242f-4196-b6a3-4c418f395bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:00.183963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-82ddb6bd-b0ad-4a28-9544-9d6aff5826f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:00.184702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6610fe9-242f-4196-b6a3-4c418f395bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:00.185193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6610fe9-242f-4196-b6a3-4c418f395bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:00.186128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6610fe9-242f-4196-b6a3-4c418f395bfc admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:00.186864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6610fe9-242f-4196-b6a3-4c418f395bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:00.190728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6610fe9-242f-4196-b6a3-4c418f395bfc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:00.238466 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3986/8026] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:39:59 2022] POST /identity/v3/users => generated 299 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:00.239853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6610fe9-242f-4196-b6a3-4c418f395bfc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:00.259697 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:00.265621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6610fe9-242f-4196-b6a3-4c418f395bfc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:00.284563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb1f3f-9a67-4c66-a678-080f1fa4fc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:00.285567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1f3f-9a67-4c66-a678-080f1fa4fc1f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:00.286162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1f3f-9a67-4c66-a678-080f1fa4fc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:00.286673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1f3f-9a67-4c66-a678-080f1fa4fc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:00.288096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb1f3f-9a67-4c66-a678-080f1fa4fc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:00.290015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb1f3f-9a67-4c66-a678-080f1fa4fc1f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:00.317036 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3987/8027] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:00.318317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb1f3f-9a67-4c66-a678-080f1fa4fc1f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:00.332542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddb6bd-b0ad-4a28-9544-9d6aff5826f2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:00.336787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb1f3f-9a67-4c66-a678-080f1fa4fc1f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:00.343413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b982d-7b47-48c6-ac52-f5a811071876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:00.344054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4175e-a5f1-42a5-8a2b-20d467120d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:00.344273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b982d-7b47-48c6-ac52-f5a811071876 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:00.345083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b982d-7b47-48c6-ac52-f5a811071876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:00.345211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b982d-7b47-48c6-ac52-f5a811071876 admin admin] PATH_INFO: `/v3/projects/10387f6003f64bb6b64734e09b4caab4/users/d22b603ef9b442deab45ddc01acb5006/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:00.345946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4175e-a5f1-42a5-8a2b-20d467120d78 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:00.346876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4175e-a5f1-42a5-8a2b-20d467120d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:00.347873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4175e-a5f1-42a5-8a2b-20d467120d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:00.391040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4175e-a5f1-42a5-8a2b-20d467120d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:00.394524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4175e-a5f1-42a5-8a2b-20d467120d78 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:00.403106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b982d-7b47-48c6-ac52-f5a811071876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10387f6003f64bb6b64734e09b4caab4, user_id=d22b603ef9b442deab45ddc01acb5006, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:00.405940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b982d-7b47-48c6-ac52-f5a811071876 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:00.424240 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4041/8028] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:00.452350 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3988/8029] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:00 2022] PUT /identity/v3/projects/10387f6003f64bb6b64734e09b4caab4/users/d22b603ef9b442deab45ddc01acb5006/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:00.454650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4175e-a5f1-42a5-8a2b-20d467120d78 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:00.471093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4175e-a5f1-42a5-8a2b-20d467120d78 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:00.644577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bd038-47fa-43e2-9701-0e16a5c4ce1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:00.645385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bd038-47fa-43e2-9701-0e16a5c4ce1f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:00.645766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bd038-47fa-43e2-9701-0e16a5c4ce1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:00.646176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bd038-47fa-43e2-9701-0e16a5c4ce1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:00.646899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bd038-47fa-43e2-9701-0e16a5c4ce1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:00.648691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bd038-47fa-43e2-9701-0e16a5c4ce1f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:00.667892 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4042/8030] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:00.672840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b982d-7b47-48c6-ac52-f5a811071876 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:00.686151 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b982d-7b47-48c6-ac52-f5a811071876 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:00.703517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62942a-76b3-40f4-bea0-eda331e13051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:00.707034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62942a-76b3-40f4-bea0-eda331e13051 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:00.707446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62942a-76b3-40f4-bea0-eda331e13051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:00.707751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62942a-76b3-40f4-bea0-eda331e13051 admin admin] PATH_INFO: `/v3/projects/10387f6003f64bb6b64734e09b4caab4/users/d22b603ef9b442deab45ddc01acb5006/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:00.713704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62942a-76b3-40f4-bea0-eda331e13051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10387f6003f64bb6b64734e09b4caab4, user_id=d22b603ef9b442deab45ddc01acb5006, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:00.718622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62942a-76b3-40f4-bea0-eda331e13051 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:00.735488 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3989/8031] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:00 2022] PUT /identity/v3/projects/10387f6003f64bb6b64734e09b4caab4/users/d22b603ef9b442deab45ddc01acb5006/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:00.747013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de98a52-651d-480d-9a00-50fb3737f1e6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:00.747331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de98a52-651d-480d-9a00-50fb3737f1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:00.747568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de98a52-651d-480d-9a00-50fb3737f1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:00.857359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9de98a52-651d-480d-9a00-50fb3737f1e6 None None] MFA Rules not processed for user `d22b603ef9b442deab45ddc01acb5006`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:00.860385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9de98a52-651d-480d-9a00-50fb3737f1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:00.940580 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:00.980746 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4043/8032] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:00.988199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62942a-76b3-40f4-bea0-eda331e13051 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:01.011483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62942a-76b3-40f4-bea0-eda331e13051 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:01.023403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c199a05-47a0-46b9-9311-ca65fb2531e5 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22b603ef9b442deab45ddc01acb5006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10387f6003f64bb6b64734e09b4caab4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:01.024244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c199a05-47a0-46b9-9311-ca65fb2531e5 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:01.024670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c199a05-47a0-46b9-9311-ca65fb2531e5 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:01.025132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c199a05-47a0-46b9-9311-ca65fb2531e5 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:01.025958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c199a05-47a0-46b9-9311-ca65fb2531e5 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:01.028609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c199a05-47a0-46b9-9311-ca65fb2531e5 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:01.123524 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3990/8033] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:00 2022] POST /identity/v3/projects => generated 359 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:01.125386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de98a52-651d-480d-9a00-50fb3737f1e6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:01.126844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9de98a52-651d-480d-9a00-50fb3737f1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:01.307702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de98a52-651d-480d-9a00-50fb3737f1e6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:01.486588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5addd7-3b41-4d0c-ab62-61cf93eeba8e tempest-ProjectsNegativeTestJSON-297697136 tempest-ProjectsNegativeTestJSON-297697136-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c029c5a4167f48febe2f20843aabee31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f27274352e834f9b8afa73561c209e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:01.487541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5addd7-3b41-4d0c-ab62-61cf93eeba8e tempest-ProjectsNegativeTestJSON-297697136 tempest-ProjectsNegativeTestJSON-297697136-project] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:01.487828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5addd7-3b41-4d0c-ab62-61cf93eeba8e tempest-ProjectsNegativeTestJSON-297697136 tempest-ProjectsNegativeTestJSON-297697136-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:01.488106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5addd7-3b41-4d0c-ab62-61cf93eeba8e tempest-ProjectsNegativeTestJSON-297697136 tempest-ProjectsNegativeTestJSON-297697136-project] PATH_INFO: `/v3/projects/82488f6140d94673a4c2e38023cad904` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:01.489998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5addd7-3b41-4d0c-ab62-61cf93eeba8e tempest-ProjectsNegativeTestJSON-297697136 tempest-ProjectsNegativeTestJSON-297697136-project] RBAC: Authorizing `identity:delete_project(project_id=82488f6140d94673a4c2e38023cad904)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-ed5addd7-3b41-4d0c-ab62-61cf93eeba8e tempest-ProjectsNegativeTestJSON-297697136 tempest-ProjectsNegativeTestJSON-297697136-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 16 01:40:01.514188 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 16 01:40:01.515648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 16 01:40:01.515648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 16 01:40:01.515648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 16 01:40:01.515648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 16 01:40:01.515648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:40:01.515648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 16 01:40:01.515648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 16 01:40:01.515648 n-d-master-1 devstack@keystone.service[81804]: ERROR keystone.server.flask.application Oct 16 01:40:01.516316 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4044/8034] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:01 2022] DELETE /identity/v3/projects/82488f6140d94673a4c2e38023cad904 => generated 136 bytes in 391 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 16 01:40:01.520395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c199a05-47a0-46b9-9311-ca65fb2531e5 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:01.594573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5addd7-3b41-4d0c-ab62-61cf93eeba8e tempest-ProjectsNegativeTestJSON-297697136 tempest-ProjectsNegativeTestJSON-297697136-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:01.596697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ed5addd7-3b41-4d0c-ab62-61cf93eeba8e tempest-ProjectsNegativeTestJSON-297697136 tempest-ProjectsNegativeTestJSON-297697136-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:01.766255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c199a05-47a0-46b9-9311-ca65fb2531e5 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:01.772202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd22b603ef9b442deab45ddc01acb5006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10387f6003f64bb6b64734e09b4caab4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:01.773480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:01.773835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:01.774320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] PATH_INFO: `/v3/projects/82488f6140d94673a4c2e38023cad904` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:01.775596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] RBAC: Authorizing `identity:delete_project(project_id=82488f6140d94673a4c2e38023cad904)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:01.781923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:01.811458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5addd7-3b41-4d0c-ab62-61cf93eeba8e tempest-ProjectsNegativeTestJSON-297697136 tempest-ProjectsNegativeTestJSON-297697136-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:01.816720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b192412-0a04-42bd-95c3-aa875cfe84f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:01.817704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b192412-0a04-42bd-95c3-aa875cfe84f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:01.818265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b192412-0a04-42bd-95c3-aa875cfe84f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:01.820185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b192412-0a04-42bd-95c3-aa875cfe84f3 admin admin] PATH_INFO: `/v3/projects/b81b48a6579e43ee888375e97773baf0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:01.821850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b192412-0a04-42bd-95c3-aa875cfe84f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81b48a6579e43ee888375e97773baf0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:01.851498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b192412-0a04-42bd-95c3-aa875cfe84f3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:01.877533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82488f6140d94673a4c2e38023cad904', 'request_id': 'req-d01a03f3-2e99-4876-a1bc-dc646367c130'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:01.889096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82488f6140d94673a4c2e38023cad904', 'request_id': 'req-d01a03f3-2e99-4876-a1bc-dc646367c130'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:01.907869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82488f6140d94673a4c2e38023cad904', 'request_id': 'req-d01a03f3-2e99-4876-a1bc-dc646367c130'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:01.934433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] The token cache is being invalidate because project 82488f6140d94673a4c2e38023cad904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:01.937137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:01.940552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:01.947470 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3991/8035] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:01 2022] DELETE /identity/v3/projects/82488f6140d94673a4c2e38023cad904 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:01.953777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:01.957218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:01.987824 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:02.021408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9b192412-0a04-42bd-95c3-aa875cfe84f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81b48a6579e43ee888375e97773baf0', 'request_id': 'req-9b192412-0a04-42bd-95c3-aa875cfe84f3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:02.035301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9b192412-0a04-42bd-95c3-aa875cfe84f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81b48a6579e43ee888375e97773baf0', 'request_id': 'req-9b192412-0a04-42bd-95c3-aa875cfe84f3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:02.064481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9b192412-0a04-42bd-95c3-aa875cfe84f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81b48a6579e43ee888375e97773baf0', 'request_id': 'req-9b192412-0a04-42bd-95c3-aa875cfe84f3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:02.076754 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:02.083142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9b192412-0a04-42bd-95c3-aa875cfe84f3 admin admin] The token cache is being invalidate because project b81b48a6579e43ee888375e97773baf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:02.083473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9b192412-0a04-42bd-95c3-aa875cfe84f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:02.084138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9b192412-0a04-42bd-95c3-aa875cfe84f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:02.089784 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4045/8036] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:01 2022] DELETE /identity/v3/projects/b81b48a6579e43ee888375e97773baf0 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:40:02.094811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd7b5d-0146-4b7d-9343-61353516969b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:02.095171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd7b5d-0146-4b7d-9343-61353516969b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:02.095375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd7b5d-0146-4b7d-9343-61353516969b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:02.120845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2ecd7b5d-0146-4b7d-9343-61353516969b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:02.122755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2ecd7b5d-0146-4b7d-9343-61353516969b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:02.196860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a03f3-2e99-4876-a1bc-dc646367c130 tempest-ProjectsNegativeTestJSON-1779524732 tempest-ProjectsNegativeTestJSON-1779524732-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:02.260337 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4046/8037] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:02.269877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad777c-21fe-4abb-b7b3-3219c0e545c0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:02.271552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad777c-21fe-4abb-b7b3-3219c0e545c0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:02.271841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad777c-21fe-4abb-b7b3-3219c0e545c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:02.337261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0cad777c-21fe-4abb-b7b3-3219c0e545c0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:02.341676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0cad777c-21fe-4abb-b7b3-3219c0e545c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:02.364474 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4047/8038] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:02.365440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad777c-21fe-4abb-b7b3-3219c0e545c0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:02.390069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad777c-21fe-4abb-b7b3-3219c0e545c0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:02.399248 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287792f7-ea2b-4ce9-93ad-63b8c3ca4e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:02.400126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287792f7-ea2b-4ce9-93ad-63b8c3ca4e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:02.400424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287792f7-ea2b-4ce9-93ad-63b8c3ca4e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:02.400686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287792f7-ea2b-4ce9-93ad-63b8c3ca4e70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:02.401342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287792f7-ea2b-4ce9-93ad-63b8c3ca4e70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:40:02.401645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287792f7-ea2b-4ce9-93ad-63b8c3ca4e70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:02.411578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287792f7-ea2b-4ce9-93ad-63b8c3ca4e70 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:02.438691 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4048/8039] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:40:02.440096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287792f7-ea2b-4ce9-93ad-63b8c3ca4e70 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:02.452293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287792f7-ea2b-4ce9-93ad-63b8c3ca4e70 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:02.458048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2641a20-e246-47c0-be78-dc77525ea702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:02.459188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2641a20-e246-47c0-be78-dc77525ea702 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:02.459870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2641a20-e246-47c0-be78-dc77525ea702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:02.460060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2641a20-e246-47c0-be78-dc77525ea702 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:02.460822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2641a20-e246-47c0-be78-dc77525ea702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:02.463199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2641a20-e246-47c0-be78-dc77525ea702 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:02.467668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0a580-4135-4a26-8ab3-757303b53b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:02.468340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0a580-4135-4a26-8ab3-757303b53b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:02.468756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0a580-4135-4a26-8ab3-757303b53b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:02.468895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0a580-4135-4a26-8ab3-757303b53b5e admin admin] PATH_INFO: `/v3/users/c029c5a4167f48febe2f20843aabee31` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:02.471547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0a580-4135-4a26-8ab3-757303b53b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c029c5a4167f48febe2f20843aabee31)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:02.473489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0a580-4135-4a26-8ab3-757303b53b5e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:02.510303 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4049/8040] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:02 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:02.510789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2641a20-e246-47c0-be78-dc77525ea702 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:02.608057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0cd0a580-4135-4a26-8ab3-757303b53b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c029c5a4167f48febe2f20843aabee31'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:02.608986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0cd0a580-4135-4a26-8ab3-757303b53b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c029c5a4167f48febe2f20843aabee31'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:02.635274 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0cd0a580-4135-4a26-8ab3-757303b53b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c029c5a4167f48febe2f20843aabee31'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:02.658735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0cd0a580-4135-4a26-8ab3-757303b53b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c029c5a4167f48febe2f20843aabee31'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:02.659616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0cd0a580-4135-4a26-8ab3-757303b53b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c029c5a4167f48febe2f20843aabee31'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:02.660152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2641a20-e246-47c0-be78-dc77525ea702 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:02.665936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfd1d3-12b9-4349-9e9b-0c81e6230dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:02.668188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfd1d3-12b9-4349-9e9b-0c81e6230dbd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:02.669442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfd1d3-12b9-4349-9e9b-0c81e6230dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:02.670597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfd1d3-12b9-4349-9e9b-0c81e6230dbd admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:02.672103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dfd1d3-12b9-4349-9e9b-0c81e6230dbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:02.675342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dfd1d3-12b9-4349-9e9b-0c81e6230dbd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:02.679519 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3992/8041] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:40:01 2022] DELETE /identity/v3/users/c029c5a4167f48febe2f20843aabee31 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:02.685513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d03f3-bee9-4695-acdc-67cfe7aa48aa None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:02.685792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d03f3-bee9-4695-acdc-67cfe7aa48aa None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:02.686067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d03f3-bee9-4695-acdc-67cfe7aa48aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:02.723701 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4050/8042] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:40:02 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:02.723931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b14d03f3-bee9-4695-acdc-67cfe7aa48aa None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:02.723931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b14d03f3-bee9-4695-acdc-67cfe7aa48aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:02.724833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfd1d3-12b9-4349-9e9b-0c81e6230dbd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:02.730591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-90dfd1d3-12b9-4349-9e9b-0c81e6230dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:02.755772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfd1d3-12b9-4349-9e9b-0c81e6230dbd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:02.791431 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:02.817343 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:02.850860 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3993/8043] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:02.860608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d03f3-bee9-4695-acdc-67cfe7aa48aa None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:02.864413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b14d03f3-bee9-4695-acdc-67cfe7aa48aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:02.907305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351763bb-6731-4784-ad77-a9785b7b4fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:02.907940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351763bb-6731-4784-ad77-a9785b7b4fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:02.908227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351763bb-6731-4784-ad77-a9785b7b4fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:02.908504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351763bb-6731-4784-ad77-a9785b7b4fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:02.909284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351763bb-6731-4784-ad77-a9785b7b4fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:02.911224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351763bb-6731-4784-ad77-a9785b7b4fdc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:02.924812 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4051/8044] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:02.928484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351763bb-6731-4784-ad77-a9785b7b4fdc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:02.956946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351763bb-6731-4784-ad77-a9785b7b4fdc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:02.969444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d03f3-bee9-4695-acdc-67cfe7aa48aa None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:02.972393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b400e-584c-4590-a112-ff4efad3b6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:02.973140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b400e-584c-4590-a112-ff4efad3b6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:02.973529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b400e-584c-4590-a112-ff4efad3b6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:02.973927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b400e-584c-4590-a112-ff4efad3b6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:02.974769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b400e-584c-4590-a112-ff4efad3b6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:02.976546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b400e-584c-4590-a112-ff4efad3b6c7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:02.977756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739aaaf9-0cd6-48e5-9458-02c19806ef30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:02.978414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aaaf9-0cd6-48e5-9458-02c19806ef30 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:02.978699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aaaf9-0cd6-48e5-9458-02c19806ef30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:02.979037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aaaf9-0cd6-48e5-9458-02c19806ef30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:03.002398 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739aaaf9-0cd6-48e5-9458-02c19806ef30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:03.003676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739aaaf9-0cd6-48e5-9458-02c19806ef30 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:03.008199 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4052/8045] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:03.009428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b400e-584c-4590-a112-ff4efad3b6c7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:03.030051 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3994/8046] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:03.033160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b400e-584c-4590-a112-ff4efad3b6c7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:03.044658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c176f-702b-49c8-9479-90b07c4d568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:03.045732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c176f-702b-49c8-9479-90b07c4d568b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:03.045964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c176f-702b-49c8-9479-90b07c4d568b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:03.046342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c176f-702b-49c8-9479-90b07c4d568b admin admin] PATH_INFO: `/v3/projects/ebb5bf71a8ec402ab3baa195df5420eb/users/cc1876ecb5ca4574a580dc2d1232f487/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:03.081480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c176f-702b-49c8-9479-90b07c4d568b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb5bf71a8ec402ab3baa195df5420eb, user_id=cc1876ecb5ca4574a580dc2d1232f487, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:03.086546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c176f-702b-49c8-9479-90b07c4d568b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:03.135798 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4053/8047] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:03 2022] PUT /identity/v3/projects/ebb5bf71a8ec402ab3baa195df5420eb/users/cc1876ecb5ca4574a580dc2d1232f487/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:03.147056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaaadd-5420-4e23-9d69-b72300292b4d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:03.147532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaaadd-5420-4e23-9d69-b72300292b4d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:03.147656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaaadd-5420-4e23-9d69-b72300292b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:03.217129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ddfaaadd-5420-4e23-9d69-b72300292b4d None None] MFA Rules not processed for user `cc1876ecb5ca4574a580dc2d1232f487`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:03.220101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ddfaaadd-5420-4e23-9d69-b72300292b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:03.407664 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3995/8048] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:03.418154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c176f-702b-49c8-9479-90b07c4d568b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:03.420781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a50c176f-702b-49c8-9479-90b07c4d568b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:03.541337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaaadd-5420-4e23-9d69-b72300292b4d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:03.543357 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ddfaaadd-5420-4e23-9d69-b72300292b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:03.575466 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c176f-702b-49c8-9479-90b07c4d568b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:03.596273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a51c59-0862-4bca-909b-30650079e9e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:03.597168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a51c59-0862-4bca-909b-30650079e9e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:03.597611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a51c59-0862-4bca-909b-30650079e9e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:03.598514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a51c59-0862-4bca-909b-30650079e9e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:03.632815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a51c59-0862-4bca-909b-30650079e9e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:03.634556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a51c59-0862-4bca-909b-30650079e9e6 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:03.662133 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4054/8049] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:03.701625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a51c59-0862-4bca-909b-30650079e9e6 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:03.720740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaaadd-5420-4e23-9d69-b72300292b4d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:03.723153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a51c59-0862-4bca-909b-30650079e9e6 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:03.733474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:03.734231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:03.734577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:03.734934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] PATH_INFO: `/v3/projects/f27274352e834f9b8afa73561c209e52` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:03.740676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27274352e834f9b8afa73561c209e52)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:03.743071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:03.744029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7d166-b141-4668-966a-319bfc6729b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:03.745046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d166-b141-4668-966a-319bfc6729b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:03.745460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d166-b141-4668-966a-319bfc6729b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:03.745901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d166-b141-4668-966a-319bfc6729b9 admin admin] PATH_INFO: `/v3/users/cc1876ecb5ca4574a580dc2d1232f487` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:03.750947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7d166-b141-4668-966a-319bfc6729b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1876ecb5ca4574a580dc2d1232f487)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:03.756012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7d166-b141-4668-966a-319bfc6729b9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:03.838146 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:03.878670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27274352e834f9b8afa73561c209e52', 'request_id': 'req-22252317-bd48-4375-bd0e-2bd31f150d6a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:03.888512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27274352e834f9b8afa73561c209e52', 'request_id': 'req-22252317-bd48-4375-bd0e-2bd31f150d6a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:03.897211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03c7d166-b141-4668-966a-319bfc6729b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1876ecb5ca4574a580dc2d1232f487'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:03.899299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03c7d166-b141-4668-966a-319bfc6729b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1876ecb5ca4574a580dc2d1232f487'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:03.900072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27274352e834f9b8afa73561c209e52', 'request_id': 'req-22252317-bd48-4375-bd0e-2bd31f150d6a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:03.921847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03c7d166-b141-4668-966a-319bfc6729b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1876ecb5ca4574a580dc2d1232f487'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:03.922355 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] The token cache is being invalidate because project f27274352e834f9b8afa73561c209e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:03.922660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:03.923506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:03.927001 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3996/8050] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:03 2022] DELETE /identity/v3/projects/f27274352e834f9b8afa73561c209e52 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:40:03.931672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:03.936575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:03.937073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03c7d166-b141-4668-966a-319bfc6729b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1876ecb5ca4574a580dc2d1232f487'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:03.938545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03c7d166-b141-4668-966a-319bfc6729b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1876ecb5ca4574a580dc2d1232f487'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:03.944348 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:03.975426 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4055/8051] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:40:03 2022] DELETE /identity/v3/users/cc1876ecb5ca4574a580dc2d1232f487 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:03.977753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f3e18-017d-42f0-b49c-1a04ee167578 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:03.978216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f3e18-017d-42f0-b49c-1a04ee167578 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:03.978489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f3e18-017d-42f0-b49c-1a04ee167578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:04.017958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3e5f3e18-017d-42f0-b49c-1a04ee167578 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:04.020023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3e5f3e18-017d-42f0-b49c-1a04ee167578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:04.097736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22252317-bd48-4375-bd0e-2bd31f150d6a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:04.157247 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4056/8052] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:04.174657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f3e18-017d-42f0-b49c-1a04ee167578 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:04.177731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3e5f3e18-017d-42f0-b49c-1a04ee167578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:04.199307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:04.200494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:04.200776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:04.201047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] PATH_INFO: `/v3/users/d22b603ef9b442deab45ddc01acb5006` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:04.202251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22b603ef9b442deab45ddc01acb5006)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:04.205684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:04.276404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22b603ef9b442deab45ddc01acb5006'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:04.278108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22b603ef9b442deab45ddc01acb5006'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:04.280775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f3e18-017d-42f0-b49c-1a04ee167578 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:04.288401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaad8e3-5f90-4f54-974d-27aa0a1b10f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:04.288587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaad8e3-5f90-4f54-974d-27aa0a1b10f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:04.288811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaad8e3-5f90-4f54-974d-27aa0a1b10f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:04.289099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaad8e3-5f90-4f54-974d-27aa0a1b10f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:04.291517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bcaad8e3-5f90-4f54-974d-27aa0a1b10f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:04.299148 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:04.301218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22b603ef9b442deab45ddc01acb5006'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:04.320529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22b603ef9b442deab45ddc01acb5006'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:04.321349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22b603ef9b442deab45ddc01acb5006'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:04.321474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaad8e3-5f90-4f54-974d-27aa0a1b10f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:04.323379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaad8e3-5f90-4f54-974d-27aa0a1b10f2 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:04.353743 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3997/8053] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:40:03 2022] DELETE /identity/v3/users/d22b603ef9b442deab45ddc01acb5006 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:04.360058 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4057/8054] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:05.087380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:05.089426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:05.128226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaad8e3-5f90-4f54-974d-27aa0a1b10f2 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:05.131080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bcaad8e3-5f90-4f54-974d-27aa0a1b10f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:05.166688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaad8e3-5f90-4f54-974d-27aa0a1b10f2 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:05.224168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d4eb8-c3af-4e28-99de-b590450b5b68 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:05.231844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374b329-da67-4895-99fe-9053e792e9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:05.233046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374b329-da67-4895-99fe-9053e792e9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:05.233931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374b329-da67-4895-99fe-9053e792e9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:05.234365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374b329-da67-4895-99fe-9053e792e9c4 admin admin] PATH_INFO: `/v3/projects/10387f6003f64bb6b64734e09b4caab4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:05.236013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374b329-da67-4895-99fe-9053e792e9c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10387f6003f64bb6b64734e09b4caab4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:05.238455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374b329-da67-4895-99fe-9053e792e9c4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:05.308685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7bcae-2879-4b48-85c3-1691d51e1493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:05.311508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7bcae-2879-4b48-85c3-1691d51e1493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:05.311789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7bcae-2879-4b48-85c3-1691d51e1493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:05.312063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7bcae-2879-4b48-85c3-1691d51e1493 admin admin] PATH_INFO: `/v3/projects/ebb5bf71a8ec402ab3baa195df5420eb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:05.313735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7bcae-2879-4b48-85c3-1691d51e1493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb5bf71a8ec402ab3baa195df5420eb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:05.318842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7bcae-2879-4b48-85c3-1691d51e1493 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:05.335354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6374b329-da67-4895-99fe-9053e792e9c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10387f6003f64bb6b64734e09b4caab4', 'request_id': 'req-6374b329-da67-4895-99fe-9053e792e9c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:05.348529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6374b329-da67-4895-99fe-9053e792e9c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10387f6003f64bb6b64734e09b4caab4', 'request_id': 'req-6374b329-da67-4895-99fe-9053e792e9c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:05.365756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6374b329-da67-4895-99fe-9053e792e9c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10387f6003f64bb6b64734e09b4caab4', 'request_id': 'req-6374b329-da67-4895-99fe-9053e792e9c4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:05.381151 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:05.399264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-99e7bcae-2879-4b48-85c3-1691d51e1493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb5bf71a8ec402ab3baa195df5420eb', 'request_id': 'req-99e7bcae-2879-4b48-85c3-1691d51e1493'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:05.401954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6374b329-da67-4895-99fe-9053e792e9c4 admin admin] The token cache is being invalidate because project 10387f6003f64bb6b64734e09b4caab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:05.402258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6374b329-da67-4895-99fe-9053e792e9c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:05.403994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6374b329-da67-4895-99fe-9053e792e9c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:05.408723 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3998/8055] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:05 2022] DELETE /identity/v3/projects/10387f6003f64bb6b64734e09b4caab4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:05.408903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-99e7bcae-2879-4b48-85c3-1691d51e1493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb5bf71a8ec402ab3baa195df5420eb', 'request_id': 'req-99e7bcae-2879-4b48-85c3-1691d51e1493'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:05.413950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281de86-4d6a-45a2-ad62-c475c1cdba2b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:05.414185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281de86-4d6a-45a2-ad62-c475c1cdba2b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:05.414418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281de86-4d6a-45a2-ad62-c475c1cdba2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:05.419784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-99e7bcae-2879-4b48-85c3-1691d51e1493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb5bf71a8ec402ab3baa195df5420eb', 'request_id': 'req-99e7bcae-2879-4b48-85c3-1691d51e1493'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:05.442894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-99e7bcae-2879-4b48-85c3-1691d51e1493 admin admin] The token cache is being invalidate because project ebb5bf71a8ec402ab3baa195df5420eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:05.443215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-99e7bcae-2879-4b48-85c3-1691d51e1493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:05.445563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-99e7bcae-2879-4b48-85c3-1691d51e1493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:05.449626 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4058/8056] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:05 2022] DELETE /identity/v3/projects/ebb5bf71a8ec402ab3baa195df5420eb => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:40:05.451265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f281de86-4d6a-45a2-ad62-c475c1cdba2b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:05.452464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f281de86-4d6a-45a2-ad62-c475c1cdba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:05.455113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1317e0e-d05f-464e-834a-8b067e4a9d99 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:05.455551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1317e0e-d05f-464e-834a-8b067e4a9d99 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:05.455835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1317e0e-d05f-464e-834a-8b067e4a9d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:05.496221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f1317e0e-d05f-464e-834a-8b067e4a9d99 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:05.499060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f1317e0e-d05f-464e-834a-8b067e4a9d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:05.605943 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3999/8057] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:05.610026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae35c45-fb67-4a90-8ac5-de680cbc7aa4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:05.610370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae35c45-fb67-4a90-8ac5-de680cbc7aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:05.610703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae35c45-fb67-4a90-8ac5-de680cbc7aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:05.641464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9ae35c45-fb67-4a90-8ac5-de680cbc7aa4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:05.644797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9ae35c45-fb67-4a90-8ac5-de680cbc7aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:05.659829 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4000/8058] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:05.660970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae35c45-fb67-4a90-8ac5-de680cbc7aa4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:05.669626 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:05.675014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae35c45-fb67-4a90-8ac5-de680cbc7aa4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:05.687877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a8d0a-b426-4c9d-a3fe-c4b909ebe4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:05.690352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8d0a-b426-4c9d-a3fe-c4b909ebe4bd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:05.690648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8d0a-b426-4c9d-a3fe-c4b909ebe4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:05.690948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8d0a-b426-4c9d-a3fe-c4b909ebe4bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:05.692867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a8d0a-b426-4c9d-a3fe-c4b909ebe4bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:40:05.693341 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4059/8059] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:40:05.693550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a8d0a-b426-4c9d-a3fe-c4b909ebe4bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:05.695319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a8d0a-b426-4c9d-a3fe-c4b909ebe4bd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:05.702678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251f6b1-3d03-4b09-b630-8b7ef3f70797 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:05.702993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251f6b1-3d03-4b09-b630-8b7ef3f70797 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:05.703273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251f6b1-3d03-4b09-b630-8b7ef3f70797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:05.734335 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4001/8060] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:40:05.741852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a8d0a-b426-4c9d-a3fe-c4b909ebe4bd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:05.754347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e251f6b1-3d03-4b09-b630-8b7ef3f70797 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:05.755605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e251f6b1-3d03-4b09-b630-8b7ef3f70797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:05.764493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a8d0a-b426-4c9d-a3fe-c4b909ebe4bd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:05.778731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf769c3-5993-4d29-bb17-4ecb04e36736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:05.780062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf769c3-5993-4d29-bb17-4ecb04e36736 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:05.780657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf769c3-5993-4d29-bb17-4ecb04e36736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:05.781106 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4060/8061] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:05.781323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf769c3-5993-4d29-bb17-4ecb04e36736 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:05.782083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf769c3-5993-4d29-bb17-4ecb04e36736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:05.785106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251f6b1-3d03-4b09-b630-8b7ef3f70797 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:05.787984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf769c3-5993-4d29-bb17-4ecb04e36736 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:05.808663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251f6b1-3d03-4b09-b630-8b7ef3f70797 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:05.822760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d245db-e81d-47c9-8d6d-8f3aa48108cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:05.823671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d245db-e81d-47c9-8d6d-8f3aa48108cb admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:05.823948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d245db-e81d-47c9-8d6d-8f3aa48108cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:05.824218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d245db-e81d-47c9-8d6d-8f3aa48108cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:05.826670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d245db-e81d-47c9-8d6d-8f3aa48108cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:40:05.827333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d245db-e81d-47c9-8d6d-8f3aa48108cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:05.834082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d245db-e81d-47c9-8d6d-8f3aa48108cb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:05.853686 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4002/8062] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:05 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:05.858740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf769c3-5993-4d29-bb17-4ecb04e36736 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:05.862176 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4061/8063] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:40:05.867614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d245db-e81d-47c9-8d6d-8f3aa48108cb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:05.881164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d245db-e81d-47c9-8d6d-8f3aa48108cb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:05.965383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf769c3-5993-4d29-bb17-4ecb04e36736 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:05.994521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139d8c-5eaf-4fcc-aa4f-6fb4788f8cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:05.995469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139d8c-5eaf-4fcc-aa4f-6fb4788f8cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:05.995894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139d8c-5eaf-4fcc-aa4f-6fb4788f8cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:05.996260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139d8c-5eaf-4fcc-aa4f-6fb4788f8cbf admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:05.998019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0139d8c-5eaf-4fcc-aa4f-6fb4788f8cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:06.001799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0139d8c-5eaf-4fcc-aa4f-6fb4788f8cbf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:06.026218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d503143-0166-4bae-a953-95e5d8562051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:06.027107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d503143-0166-4bae-a953-95e5d8562051 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.027522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d503143-0166-4bae-a953-95e5d8562051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.028438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d503143-0166-4bae-a953-95e5d8562051 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.029812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d503143-0166-4bae-a953-95e5d8562051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:06.035775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d503143-0166-4bae-a953-95e5d8562051 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:06.057000 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4003/8064] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:40:05 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:06.058771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139d8c-5eaf-4fcc-aa4f-6fb4788f8cbf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:06.065472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f0139d8c-5eaf-4fcc-aa4f-6fb4788f8cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:06.107669 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4062/8065] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:05 2022] POST /identity/v3/projects => generated 371 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:06.108641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d503143-0166-4bae-a953-95e5d8562051 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:06.183216 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:06.197549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139d8c-5eaf-4fcc-aa4f-6fb4788f8cbf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:06.250701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d503143-0166-4bae-a953-95e5d8562051 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:06.264089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c9f53-9c28-4fd1-92ea-0e9566d1b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:06.264783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c9f53-9c28-4fd1-92ea-0e9566d1b873 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.265038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c9f53-9c28-4fd1-92ea-0e9566d1b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.265307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c9f53-9c28-4fd1-92ea-0e9566d1b873 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.265946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c9f53-9c28-4fd1-92ea-0e9566d1b873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:06.267576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c9f53-9c28-4fd1-92ea-0e9566d1b873 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:06.294635 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4063/8066] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:06.296598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c9f53-9c28-4fd1-92ea-0e9566d1b873 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:06.320256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c9f53-9c28-4fd1-92ea-0e9566d1b873 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:06.334581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8ae4c-48ed-4f8a-9830-2e91ab477584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:06.335233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ae4c-48ed-4f8a-9830-2e91ab477584 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.335505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ae4c-48ed-4f8a-9830-2e91ab477584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.335771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ae4c-48ed-4f8a-9830-2e91ab477584 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.336403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ae4c-48ed-4f8a-9830-2e91ab477584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:06.338325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ae4c-48ed-4f8a-9830-2e91ab477584 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:06.345384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca7dc6-ef5d-4db3-b2f2-9edf1944bae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:06.346167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca7dc6-ef5d-4db3-b2f2-9edf1944bae4 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.346566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca7dc6-ef5d-4db3-b2f2-9edf1944bae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.347009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca7dc6-ef5d-4db3-b2f2-9edf1944bae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.350857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2dca7dc6-ef5d-4db3-b2f2-9edf1944bae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:06.387029 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4064/8067] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:40:06 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:06.388246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8ae4c-48ed-4f8a-9830-2e91ab477584 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:06.400210 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:06.427366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8ae4c-48ed-4f8a-9830-2e91ab477584 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:06.443266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca7dc6-ef5d-4db3-b2f2-9edf1944bae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:06.443493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2e8ba-2cbb-4d54-963c-180e2084e246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:06.444042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2e8ba-2cbb-4d54-963c-180e2084e246 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.444322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2e8ba-2cbb-4d54-963c-180e2084e246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.444929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca7dc6-ef5d-4db3-b2f2-9edf1944bae4 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:06.447022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2e8ba-2cbb-4d54-963c-180e2084e246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.447734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2e8ba-2cbb-4d54-963c-180e2084e246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:06.458812 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4004/8068] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:06 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:06.460231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca7dc6-ef5d-4db3-b2f2-9edf1944bae4 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:06.464673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2e8ba-2cbb-4d54-963c-180e2084e246 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:06.473869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca7dc6-ef5d-4db3-b2f2-9edf1944bae4 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:06.480660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c539ed-0382-4915-9857-e2f87a105bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:06.482328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c539ed-0382-4915-9857-e2f87a105bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.482805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c539ed-0382-4915-9857-e2f87a105bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.483200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c539ed-0382-4915-9857-e2f87a105bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.484266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c539ed-0382-4915-9857-e2f87a105bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:06.485690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c539ed-0382-4915-9857-e2f87a105bfa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:06.502342 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4005/8069] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:06.507901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c539ed-0382-4915-9857-e2f87a105bfa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:06.508759 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4065/8070] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:06.518844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2e8ba-2cbb-4d54-963c-180e2084e246 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:06.535686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c539ed-0382-4915-9857-e2f87a105bfa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:06.541946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2e8ba-2cbb-4d54-963c-180e2084e246 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:06.566737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b715e-f276-4309-8249-84deeafe2c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:06.567548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b715e-f276-4309-8249-84deeafe2c41 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.568168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b715e-f276-4309-8249-84deeafe2c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.568547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b715e-f276-4309-8249-84deeafe2c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.569302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b715e-f276-4309-8249-84deeafe2c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:06.571058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b715e-f276-4309-8249-84deeafe2c41 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:06.584931 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1f7ce-fcda-4f8d-a574-1aaecb69b610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:06.585609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1f7ce-fcda-4f8d-a574-1aaecb69b610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.585903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1f7ce-fcda-4f8d-a574-1aaecb69b610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.586153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1f7ce-fcda-4f8d-a574-1aaecb69b610 admin admin] PATH_INFO: `/v3/projects/77f0105d8aaa4ff4bb639431591103d6/users/dbd9655f58ff4f86b180ab0a6dadddb8/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.589531 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4006/8071] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:06.592035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b715e-f276-4309-8249-84deeafe2c41 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:06.606611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b715e-f276-4309-8249-84deeafe2c41 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:06.612352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e7778-2a73-4c14-aeff-54bb862ca489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:06.613087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e7778-2a73-4c14-aeff-54bb862ca489 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.614009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e7778-2a73-4c14-aeff-54bb862ca489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.614689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e7778-2a73-4c14-aeff-54bb862ca489 admin admin] PATH_INFO: `/v3/projects/ec6724e74aa140e7826844a05b404a27/users/7f58f86160d54e0380ff27912f42417d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.627021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1f7ce-fcda-4f8d-a574-1aaecb69b610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f0105d8aaa4ff4bb639431591103d6, user_id=dbd9655f58ff4f86b180ab0a6dadddb8, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:06.629485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1f7ce-fcda-4f8d-a574-1aaecb69b610 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:06.635909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e7778-2a73-4c14-aeff-54bb862ca489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6724e74aa140e7826844a05b404a27, user_id=7f58f86160d54e0380ff27912f42417d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:06.638818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e7778-2a73-4c14-aeff-54bb862ca489 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:06.657577 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4066/8072] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:06 2022] PUT /identity/v3/projects/77f0105d8aaa4ff4bb639431591103d6/users/dbd9655f58ff4f86b180ab0a6dadddb8/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:06.668147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c62f3-416f-46d5-82cb-ba2c6bc6e92d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.668431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c62f3-416f-46d5-82cb-ba2c6bc6e92d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.669313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c62f3-416f-46d5-82cb-ba2c6bc6e92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.676650 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4007/8073] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:06 2022] PUT /identity/v3/projects/ec6724e74aa140e7826844a05b404a27/users/7f58f86160d54e0380ff27912f42417d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:06.679054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc583-41b3-40c0-9625-53121474205b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.679455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc583-41b3-40c0-9625-53121474205b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.679980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc583-41b3-40c0-9625-53121474205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.733777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2c7c62f3-416f-46d5-82cb-ba2c6bc6e92d None None] MFA Rules not processed for user `dbd9655f58ff4f86b180ab0a6dadddb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:06.735906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b36bc583-41b3-40c0-9625-53121474205b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:06.737292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b36bc583-41b3-40c0-9625-53121474205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:06.741004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2c7c62f3-416f-46d5-82cb-ba2c6bc6e92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:06.844193 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4008/8074] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:06.858396 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bc583-41b3-40c0-9625-53121474205b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:06.900840 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4067/8075] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:06.905826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c62f3-416f-46d5-82cb-ba2c6bc6e92d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:06.924269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c62f3-416f-46d5-82cb-ba2c6bc6e92d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:06.934607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1290b2-3b2d-4828-bca9-cd1515f97f5f tempest-DefaultDomainTestJSON-1962174821 tempest-DefaultDomainTestJSON-1962174821-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbd9655f58ff4f86b180ab0a6dadddb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77f0105d8aaa4ff4bb639431591103d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:06.935423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1290b2-3b2d-4828-bca9-cd1515f97f5f tempest-DefaultDomainTestJSON-1962174821 tempest-DefaultDomainTestJSON-1962174821-project] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.936039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1290b2-3b2d-4828-bca9-cd1515f97f5f tempest-DefaultDomainTestJSON-1962174821 tempest-DefaultDomainTestJSON-1962174821-project] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.936321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1290b2-3b2d-4828-bca9-cd1515f97f5f tempest-DefaultDomainTestJSON-1962174821 tempest-DefaultDomainTestJSON-1962174821-project] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.941878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1290b2-3b2d-4828-bca9-cd1515f97f5f tempest-DefaultDomainTestJSON-1962174821 tempest-DefaultDomainTestJSON-1962174821-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:06.945041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1290b2-3b2d-4828-bca9-cd1515f97f5f tempest-DefaultDomainTestJSON-1962174821 tempest-DefaultDomainTestJSON-1962174821-project] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:06.950526 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4068/8076] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:40:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:40:06.952141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1290b2-3b2d-4828-bca9-cd1515f97f5f tempest-DefaultDomainTestJSON-1962174821 tempest-DefaultDomainTestJSON-1962174821-project] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:06.955798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bc583-41b3-40c0-9625-53121474205b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:06.964844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586efd5b-8193-4401-9b80-8b9749816c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:06.965579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586efd5b-8193-4401-9b80-8b9749816c2b service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.965799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586efd5b-8193-4401-9b80-8b9749816c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.966076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586efd5b-8193-4401-9b80-8b9749816c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.977438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1290b2-3b2d-4828-bca9-cd1515f97f5f tempest-DefaultDomainTestJSON-1962174821 tempest-DefaultDomainTestJSON-1962174821-project] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:06.986546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:06.987810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586efd5b-8193-4401-9b80-8b9749816c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:06.999001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:06.999001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:06.999001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] PATH_INFO: `/v3/users/dbd9655f58ff4f86b180ab0a6dadddb8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:06.999001 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd9655f58ff4f86b180ab0a6dadddb8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:06.999667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586efd5b-8193-4401-9b80-8b9749816c2b service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:06.999764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:07.028382 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4009/8077] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:07.113842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd9655f58ff4f86b180ab0a6dadddb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:07.114551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd9655f58ff4f86b180ab0a6dadddb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:07.129449 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:07.145900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd9655f58ff4f86b180ab0a6dadddb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:07.166903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd9655f58ff4f86b180ab0a6dadddb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:07.167794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd9655f58ff4f86b180ab0a6dadddb8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:07.191323 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4069/8078] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:40:06 2022] DELETE /identity/v3/users/dbd9655f58ff4f86b180ab0a6dadddb8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:40:07.195938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc65c8-af11-4c61-aadc-8797f6b4ec18 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:07.196227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc65c8-af11-4c61-aadc-8797f6b4ec18 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:07.196501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc65c8-af11-4c61-aadc-8797f6b4ec18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:07.237728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a7cc65c8-af11-4c61-aadc-8797f6b4ec18 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:07.239240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a7cc65c8-af11-4c61-aadc-8797f6b4ec18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:07.283806 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:07.387100 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4010/8079] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:07.417492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:07.419111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:07.556685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e24393-be49-4e0b-b940-f97dee421806 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:07.567311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30f968-4fdd-42be-a385-8e47d19a5ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:07.567968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30f968-4fdd-42be-a385-8e47d19a5ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:07.568418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30f968-4fdd-42be-a385-8e47d19a5ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:07.569253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30f968-4fdd-42be-a385-8e47d19a5ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:07.593592 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30f968-4fdd-42be-a385-8e47d19a5ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:07.595271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30f968-4fdd-42be-a385-8e47d19a5ff5 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:07.619272 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4070/8080] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:08.801829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc65c8-af11-4c61-aadc-8797f6b4ec18 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:08.803449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a7cc65c8-af11-4c61-aadc-8797f6b4ec18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:08.824462 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc65c8-af11-4c61-aadc-8797f6b4ec18 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:08.836770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bc895-9f54-4508-b78c-3c269c6bb55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:08.837707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bc895-9f54-4508-b78c-3c269c6bb55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:08.838074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bc895-9f54-4508-b78c-3c269c6bb55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:08.838425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bc895-9f54-4508-b78c-3c269c6bb55a admin admin] PATH_INFO: `/v3/projects/77f0105d8aaa4ff4bb639431591103d6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:08.843541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bc895-9f54-4508-b78c-3c269c6bb55a admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f0105d8aaa4ff4bb639431591103d6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:08.851926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bc895-9f54-4508-b78c-3c269c6bb55a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:08.946293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-df0bc895-9f54-4508-b78c-3c269c6bb55a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f0105d8aaa4ff4bb639431591103d6', 'request_id': 'req-df0bc895-9f54-4508-b78c-3c269c6bb55a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:08.963618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-df0bc895-9f54-4508-b78c-3c269c6bb55a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f0105d8aaa4ff4bb639431591103d6', 'request_id': 'req-df0bc895-9f54-4508-b78c-3c269c6bb55a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:08.984586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-df0bc895-9f54-4508-b78c-3c269c6bb55a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f0105d8aaa4ff4bb639431591103d6', 'request_id': 'req-df0bc895-9f54-4508-b78c-3c269c6bb55a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:08.998845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-df0bc895-9f54-4508-b78c-3c269c6bb55a admin admin] The token cache is being invalidate because project 77f0105d8aaa4ff4bb639431591103d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:08.999184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-df0bc895-9f54-4508-b78c-3c269c6bb55a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:09.000146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-df0bc895-9f54-4508-b78c-3c269c6bb55a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:09.004857 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4011/8081] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:08 2022] DELETE /identity/v3/projects/77f0105d8aaa4ff4bb639431591103d6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:09.006601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714aae8a-6bb3-4661-93e7-2939ee531072 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:09.007102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714aae8a-6bb3-4661-93e7-2939ee531072 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:09.007216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714aae8a-6bb3-4661-93e7-2939ee531072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:09.051305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-714aae8a-6bb3-4661-93e7-2939ee531072 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:09.052232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-714aae8a-6bb3-4661-93e7-2939ee531072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:09.246690 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4071/8082] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:09.249778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0334ad-e86f-4295-8a46-50807f7997b6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:09.250386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0334ad-e86f-4295-8a46-50807f7997b6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:09.251300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0334ad-e86f-4295-8a46-50807f7997b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:09.283330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7f0334ad-e86f-4295-8a46-50807f7997b6 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:09.284595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7f0334ad-e86f-4295-8a46-50807f7997b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:09.300519 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4012/8083] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:40:09.304851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714aae8a-6bb3-4661-93e7-2939ee531072 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:09.325499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714aae8a-6bb3-4661-93e7-2939ee531072 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:09.346359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0ab70-71bb-42df-8850-d3eed8d4b3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:09.347709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0ab70-71bb-42df-8850-d3eed8d4b3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:09.347709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0ab70-71bb-42df-8850-d3eed8d4b3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:09.354433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0ab70-71bb-42df-8850-d3eed8d4b3cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:09.357000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0ab70-71bb-42df-8850-d3eed8d4b3cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:40:09.357316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0ab70-71bb-42df-8850-d3eed8d4b3cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:09.359360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0ab70-71bb-42df-8850-d3eed8d4b3cb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:09.377715 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4072/8084] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:40:09.382008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0334ad-e86f-4295-8a46-50807f7997b6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:09.409883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0334ad-e86f-4295-8a46-50807f7997b6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:09.426510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fef17d-24bb-402e-af20-a02a3a4102b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:09.430583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fef17d-24bb-402e-af20-a02a3a4102b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:09.431762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fef17d-24bb-402e-af20-a02a3a4102b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:09.432562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fef17d-24bb-402e-af20-a02a3a4102b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:09.434626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fef17d-24bb-402e-af20-a02a3a4102b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:09.436602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fef17d-24bb-402e-af20-a02a3a4102b7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:09.509860 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4013/8085] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:09 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:09.514729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0ab70-71bb-42df-8850-d3eed8d4b3cb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:09.534260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0ab70-71bb-42df-8850-d3eed8d4b3cb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:09.688147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0efd6-ac22-4ceb-895f-28c8cc2256be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:09.689157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0efd6-ac22-4ceb-895f-28c8cc2256be admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:09.689660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0efd6-ac22-4ceb-895f-28c8cc2256be admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:09.691813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0efd6-ac22-4ceb-895f-28c8cc2256be admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:09.693411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0efd6-ac22-4ceb-895f-28c8cc2256be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:09.700808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0efd6-ac22-4ceb-895f-28c8cc2256be admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:09.717664 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:09.742657 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fef17d-24bb-402e-af20-a02a3a4102b7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:09.754326 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4073/8086] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:40:09 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:09.757800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fef17d-24bb-402e-af20-a02a3a4102b7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:09.768746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00385537-f573-4560-944b-45c23c2598c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:09.769884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385537-f573-4560-944b-45c23c2598c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:09.770166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385537-f573-4560-944b-45c23c2598c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:09.771115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385537-f573-4560-944b-45c23c2598c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:09.771406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00385537-f573-4560-944b-45c23c2598c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:09.773288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00385537-f573-4560-944b-45c23c2598c9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:09.794401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0efd6-ac22-4ceb-895f-28c8cc2256be admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:09.807449 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4014/8087] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:09.812126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0efd6-ac22-4ceb-895f-28c8cc2256be admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:09.824515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d3474-16e3-496f-84e3-653bf0476a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:09.826375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3474-16e3-496f-84e3-653bf0476a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:09.826734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3474-16e3-496f-84e3-653bf0476a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:09.827124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3474-16e3-496f-84e3-653bf0476a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:09.827864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d3474-16e3-496f-84e3-653bf0476a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:09.830151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d3474-16e3-496f-84e3-653bf0476a18 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:09.847963 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4074/8088] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:40:09.854004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00385537-f573-4560-944b-45c23c2598c9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:09.882283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00385537-f573-4560-944b-45c23c2598c9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:09.890937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74cbae-04cf-43c5-a468-71f67c07636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:09.891775 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74cbae-04cf-43c5-a468-71f67c07636f admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:09.892209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74cbae-04cf-43c5-a468-71f67c07636f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:09.892725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74cbae-04cf-43c5-a468-71f67c07636f admin admin] PATH_INFO: `/v3/projects/d9959a9d546c48fda3d6c4328263f477/users/ce7e6e279f2e41ba9774a4611dc7927d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:09.930721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74cbae-04cf-43c5-a468-71f67c07636f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9959a9d546c48fda3d6c4328263f477, user_id=ce7e6e279f2e41ba9774a4611dc7927d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:09.933738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74cbae-04cf-43c5-a468-71f67c07636f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:09.963278 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4015/8089] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:09 2022] PUT /identity/v3/projects/d9959a9d546c48fda3d6c4328263f477/users/ce7e6e279f2e41ba9774a4611dc7927d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:09.974431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de9ec2-a7d5-41a1-af8c-69c8b17f7083 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:09.974709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de9ec2-a7d5-41a1-af8c-69c8b17f7083 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:09.975187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de9ec2-a7d5-41a1-af8c-69c8b17f7083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:10.016281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-78de9ec2-a7d5-41a1-af8c-69c8b17f7083 None None] MFA Rules not processed for user `ce7e6e279f2e41ba9774a4611dc7927d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:10.017733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-78de9ec2-a7d5-41a1-af8c-69c8b17f7083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:10.129976 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4075/8090] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:10.135431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74cbae-04cf-43c5-a468-71f67c07636f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:10.240517 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:10.306441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74cbae-04cf-43c5-a468-71f67c07636f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:10.323263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ba882-4032-4875-a572-1baf940b06d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:10.324209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ba882-4032-4875-a572-1baf940b06d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:10.324651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ba882-4032-4875-a572-1baf940b06d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:10.326685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ba882-4032-4875-a572-1baf940b06d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:10.327573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ba882-4032-4875-a572-1baf940b06d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:10.333338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ba882-4032-4875-a572-1baf940b06d3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:10.392301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de9ec2-a7d5-41a1-af8c-69c8b17f7083 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:10.396691 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4016/8091] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:10 2022] POST /identity/v3/projects => generated 379 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:10.425938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de9ec2-a7d5-41a1-af8c-69c8b17f7083 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:10.548615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d56c6c-819b-4218-9038-9600106dd250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:10.548615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d56c6c-819b-4218-9038-9600106dd250 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:10.548615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d56c6c-819b-4218-9038-9600106dd250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:10.548615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d56c6c-819b-4218-9038-9600106dd250 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:10.549124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d56c6c-819b-4218-9038-9600106dd250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:10.549124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d56c6c-819b-4218-9038-9600106dd250 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:10.608753 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4076/8092] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:40:10 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:40:10.610676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ba882-4032-4875-a572-1baf940b06d3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:10.628993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ba882-4032-4875-a572-1baf940b06d3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:10.643410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30c7dc-6521-4089-9990-be23f3f47f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:10.647970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30c7dc-6521-4089-9990-be23f3f47f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:10.648449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30c7dc-6521-4089-9990-be23f3f47f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:10.649124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30c7dc-6521-4089-9990-be23f3f47f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:10.649716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30c7dc-6521-4089-9990-be23f3f47f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:10.655504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30c7dc-6521-4089-9990-be23f3f47f3f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:10.682930 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4017/8093] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:10.687708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d56c6c-819b-4218-9038-9600106dd250 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:10.703305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d56c6c-819b-4218-9038-9600106dd250 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:10.718084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea7ec2-1130-41a3-adf3-d0bd060f3bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:10.718706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea7ec2-1130-41a3-adf3-d0bd060f3bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:10.719007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea7ec2-1130-41a3-adf3-d0bd060f3bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:10.719294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea7ec2-1130-41a3-adf3-d0bd060f3bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:10.719923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea7ec2-1130-41a3-adf3-d0bd060f3bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:10.722032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea7ec2-1130-41a3-adf3-d0bd060f3bb1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:10.749686 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4077/8094] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:10.750563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30c7dc-6521-4089-9990-be23f3f47f3f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:10.765936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30c7dc-6521-4089-9990-be23f3f47f3f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:10.777447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6db6cb-5cdd-4757-801d-4da195f4b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:10.778192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6db6cb-5cdd-4757-801d-4da195f4b640 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:10.779160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6db6cb-5cdd-4757-801d-4da195f4b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:10.779418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6db6cb-5cdd-4757-801d-4da195f4b640 admin admin] PATH_INFO: `/v3/projects/6653554a601744b2a31b602cfd5a13e5/users/e045da4fa0134308a7ff4c96a1946e9d/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:10.817831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6db6cb-5cdd-4757-801d-4da195f4b640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6653554a601744b2a31b602cfd5a13e5, user_id=e045da4fa0134308a7ff4c96a1946e9d, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:10.825634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6db6cb-5cdd-4757-801d-4da195f4b640 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:10.861839 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4018/8095] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:10 2022] PUT /identity/v3/projects/6653554a601744b2a31b602cfd5a13e5/users/e045da4fa0134308a7ff4c96a1946e9d/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:40:10.873251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34870893-311b-4164-ba9e-37bf436faacd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:10.873779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34870893-311b-4164-ba9e-37bf436faacd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:10.874226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34870893-311b-4164-ba9e-37bf436faacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:10.942499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-34870893-311b-4164-ba9e-37bf436faacd None None] MFA Rules not processed for user `e045da4fa0134308a7ff4c96a1946e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:10.943926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-34870893-311b-4164-ba9e-37bf436faacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:11.048313 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:11.111529 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4078/8096] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:11.112992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6db6cb-5cdd-4757-801d-4da195f4b640 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:11.271097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6db6cb-5cdd-4757-801d-4da195f4b640 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:11.293052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ad3be-50d1-4a95-8a0e-c4eab4adad3d tempest-IdentityV3ProjectsTest-1002760860 tempest-IdentityV3ProjectsTest-1002760860-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce7e6e279f2e41ba9774a4611dc7927d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9959a9d546c48fda3d6c4328263f477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:11.295346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ad3be-50d1-4a95-8a0e-c4eab4adad3d tempest-IdentityV3ProjectsTest-1002760860 tempest-IdentityV3ProjectsTest-1002760860-project] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:11.295638 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ad3be-50d1-4a95-8a0e-c4eab4adad3d tempest-IdentityV3ProjectsTest-1002760860 tempest-IdentityV3ProjectsTest-1002760860-project] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:11.295916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ad3be-50d1-4a95-8a0e-c4eab4adad3d tempest-IdentityV3ProjectsTest-1002760860 tempest-IdentityV3ProjectsTest-1002760860-project] PATH_INFO: `/v3/users/ce7e6e279f2e41ba9774a4611dc7927d/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:11.304918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ad3be-50d1-4a95-8a0e-c4eab4adad3d tempest-IdentityV3ProjectsTest-1002760860 tempest-IdentityV3ProjectsTest-1002760860-project] RBAC: Authorizing `identity:list_user_projects(user_id=ce7e6e279f2e41ba9774a4611dc7927d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:11.306757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ad3be-50d1-4a95-8a0e-c4eab4adad3d tempest-IdentityV3ProjectsTest-1002760860 tempest-IdentityV3ProjectsTest-1002760860-project] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:11.396001 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4019/8097] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:40:11 2022] GET /identity/v3/users/ce7e6e279f2e41ba9774a4611dc7927d/projects => generated 517 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:40:11.400163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1004d9-c65e-4fb1-850f-b68b55c93a0c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:11.400590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1004d9-c65e-4fb1-850f-b68b55c93a0c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:11.400972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1004d9-c65e-4fb1-850f-b68b55c93a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:11.460891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5c1004d9-c65e-4fb1-850f-b68b55c93a0c None None] MFA Rules not processed for user `ce7e6e279f2e41ba9774a4611dc7927d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:11.462286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5c1004d9-c65e-4fb1-850f-b68b55c93a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:11.480081 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4079/8098] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:11.482249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264f537-1fe8-4ee0-bb45-0b09bbaf647e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:11.482537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264f537-1fe8-4ee0-bb45-0b09bbaf647e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:11.482813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264f537-1fe8-4ee0-bb45-0b09bbaf647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:11.504268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3264f537-1fe8-4ee0-bb45-0b09bbaf647e None None] MFA Rules not processed for user `ce7e6e279f2e41ba9774a4611dc7927d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:11.505486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3264f537-1fe8-4ee0-bb45-0b09bbaf647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:11.578755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.models.token_model [None req-3264f537-1fe8-4ee0-bb45-0b09bbaf647e None None] User ce7e6e279f2e41ba9774a4611dc7927d has no access to project 6653554a601744b2a31b602cfd5a13e5 {{(pid=81805) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 16 01:40:11.582815 n-d-master-1 devstack@keystone.service[81805]: WARNING keystone.server.flask.application [None req-3264f537-1fe8-4ee0-bb45-0b09bbaf647e None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 16 01:40:11.584297 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4020/8099] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:11 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 104 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 16 01:40:11.589668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1004d9-c65e-4fb1-850f-b68b55c93a0c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:11.695074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1004d9-c65e-4fb1-850f-b68b55c93a0c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:11.706775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:11.713729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:11.714198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:11.714596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] PATH_INFO: `/v3/users/ce7e6e279f2e41ba9774a4611dc7927d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:11.718979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7e6e279f2e41ba9774a4611dc7927d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:11.721619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:11.882779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7e6e279f2e41ba9774a4611dc7927d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:11.883586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7e6e279f2e41ba9774a4611dc7927d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:11.910260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7e6e279f2e41ba9774a4611dc7927d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:11.933801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7e6e279f2e41ba9774a4611dc7927d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:11.935123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7e6e279f2e41ba9774a4611dc7927d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:11.964081 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4080/8100] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:40:11 2022] DELETE /identity/v3/users/ce7e6e279f2e41ba9774a4611dc7927d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:11.966196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e81c4-9e6d-428d-92f6-3820feecbb7f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:11.967431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e81c4-9e6d-428d-92f6-3820feecbb7f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:11.967894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e81c4-9e6d-428d-92f6-3820feecbb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:12.018615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b39e81c4-9e6d-428d-92f6-3820feecbb7f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:12.019923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b39e81c4-9e6d-428d-92f6-3820feecbb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:12.046019 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:12.187005 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4021/8101] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:12.292828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:12.295250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:12.515718 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:12.556921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266a61c-0242-44de-a880-e743ca6b2b95 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:12.568075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e7e79-ea46-46c6-a96d-4511ce88f1cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:12.568714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e7e79-ea46-46c6-a96d-4511ce88f1cf service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:12.571488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e7e79-ea46-46c6-a96d-4511ce88f1cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:12.571779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e7e79-ea46-46c6-a96d-4511ce88f1cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:12.618235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e7e79-ea46-46c6-a96d-4511ce88f1cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:12.621061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e7e79-ea46-46c6-a96d-4511ce88f1cf service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:12.644181 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4081/8102] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:13.367377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e81c4-9e6d-428d-92f6-3820feecbb7f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:13.369272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b39e81c4-9e6d-428d-92f6-3820feecbb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:13.397223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e81c4-9e6d-428d-92f6-3820feecbb7f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:13.421885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:13.423047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:13.423464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:13.423947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] PATH_INFO: `/v3/projects/d9959a9d546c48fda3d6c4328263f477` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:13.429466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9959a9d546c48fda3d6c4328263f477)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:13.435925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:13.652356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9959a9d546c48fda3d6c4328263f477', 'request_id': 'req-b6074e28-35a8-4445-b784-14583337de89'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:13.677626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9959a9d546c48fda3d6c4328263f477', 'request_id': 'req-b6074e28-35a8-4445-b784-14583337de89'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:13.706798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9959a9d546c48fda3d6c4328263f477', 'request_id': 'req-b6074e28-35a8-4445-b784-14583337de89'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:13.752921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] The token cache is being invalidate because project d9959a9d546c48fda3d6c4328263f477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:13.755630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:13.756852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:13.763938 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4022/8103] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:13 2022] DELETE /identity/v3/projects/d9959a9d546c48fda3d6c4328263f477 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:13.765174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e7e79-ea46-46c6-a96d-4511ce88f1cf service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:13.775970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e7e79-ea46-46c6-a96d-4511ce88f1cf service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:13.939349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac80296-4cb4-42d9-8d32-4a1995361a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:13.940053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac80296-4cb4-42d9-8d32-4a1995361a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:13.940340 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac80296-4cb4-42d9-8d32-4a1995361a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:13.940617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac80296-4cb4-42d9-8d32-4a1995361a74 admin admin] PATH_INFO: `/v3/users/e045da4fa0134308a7ff4c96a1946e9d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:13.945935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac80296-4cb4-42d9-8d32-4a1995361a74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e045da4fa0134308a7ff4c96a1946e9d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:13.952635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac80296-4cb4-42d9-8d32-4a1995361a74 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:14.057190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0ac80296-4cb4-42d9-8d32-4a1995361a74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e045da4fa0134308a7ff4c96a1946e9d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:14.070464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0ac80296-4cb4-42d9-8d32-4a1995361a74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e045da4fa0134308a7ff4c96a1946e9d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:14.098288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0ac80296-4cb4-42d9-8d32-4a1995361a74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e045da4fa0134308a7ff4c96a1946e9d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:14.115767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0ac80296-4cb4-42d9-8d32-4a1995361a74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e045da4fa0134308a7ff4c96a1946e9d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:14.116806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0ac80296-4cb4-42d9-8d32-4a1995361a74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e045da4fa0134308a7ff4c96a1946e9d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:14.147495 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4082/8104] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:40:13 2022] DELETE /identity/v3/users/e045da4fa0134308a7ff4c96a1946e9d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:14.676089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:14.680094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:14.703346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6074e28-35a8-4445-b784-14583337de89 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:14.843726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c70d4-78fd-4d91-b148-448612993611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:14.847788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c70d4-78fd-4d91-b148-448612993611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:14.848230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c70d4-78fd-4d91-b148-448612993611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:14.849499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c70d4-78fd-4d91-b148-448612993611 admin admin] PATH_INFO: `/v3/projects/6653554a601744b2a31b602cfd5a13e5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:14.857172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c70d4-78fd-4d91-b148-448612993611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6653554a601744b2a31b602cfd5a13e5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:14.863833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c70d4-78fd-4d91-b148-448612993611 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:14.994861 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:15.018239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2f0c70d4-78fd-4d91-b148-448612993611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6653554a601744b2a31b602cfd5a13e5', 'request_id': 'req-2f0c70d4-78fd-4d91-b148-448612993611'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:15.046150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2f0c70d4-78fd-4d91-b148-448612993611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6653554a601744b2a31b602cfd5a13e5', 'request_id': 'req-2f0c70d4-78fd-4d91-b148-448612993611'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:15.069748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2f0c70d4-78fd-4d91-b148-448612993611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6653554a601744b2a31b602cfd5a13e5', 'request_id': 'req-2f0c70d4-78fd-4d91-b148-448612993611'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:15.099004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2f0c70d4-78fd-4d91-b148-448612993611 admin admin] The token cache is being invalidate because project 6653554a601744b2a31b602cfd5a13e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:15.099397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2f0c70d4-78fd-4d91-b148-448612993611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:15.104994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2f0c70d4-78fd-4d91-b148-448612993611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:15.108513 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4023/8105] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:14 2022] DELETE /identity/v3/projects/6653554a601744b2a31b602cfd5a13e5 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:15.115233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa4c1d-2d58-4c5c-9246-25dd4310586f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:15.115762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa4c1d-2d58-4c5c-9246-25dd4310586f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:15.115762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa4c1d-2d58-4c5c-9246-25dd4310586f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:15.160745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e8fa4c1d-2d58-4c5c-9246-25dd4310586f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:15.163923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e8fa4c1d-2d58-4c5c-9246-25dd4310586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:15.351892 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4083/8106] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:15.362188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714cd9a-b9f6-4908-8e7d-d1b8a8fe6c87 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:15.362756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714cd9a-b9f6-4908-8e7d-d1b8a8fe6c87 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:15.363144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714cd9a-b9f6-4908-8e7d-d1b8a8fe6c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:15.403713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3feb-9499-4d77-ac5b-e68b1d9e10c8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:15.403995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3feb-9499-4d77-ac5b-e68b1d9e10c8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:15.404362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3feb-9499-4d77-ac5b-e68b1d9e10c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:15.448982 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:15.470292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0714cd9a-b9f6-4908-8e7d-d1b8a8fe6c87 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:15.472816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a15b3feb-9499-4d77-ac5b-e68b1d9e10c8 None None] MFA Rules not processed for user `83bbcff8a1f64cfa936f13f3cb3955b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:15.475266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0714cd9a-b9f6-4908-8e7d-d1b8a8fe6c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:15.476291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a15b3feb-9499-4d77-ac5b-e68b1d9e10c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:15.488630 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4024/8107] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:15.494066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714cd9a-b9f6-4908-8e7d-d1b8a8fe6c87 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:15.532964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714cd9a-b9f6-4908-8e7d-d1b8a8fe6c87 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:15.546517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f44d4-1b47-4199-9920-879b4adc9076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:15.549239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f44d4-1b47-4199-9920-879b4adc9076 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:15.549545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f44d4-1b47-4199-9920-879b4adc9076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:15.550177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f44d4-1b47-4199-9920-879b4adc9076 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:15.551878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f44d4-1b47-4199-9920-879b4adc9076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:40:15.552299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f44d4-1b47-4199-9920-879b4adc9076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:15.556240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f44d4-1b47-4199-9920-879b4adc9076 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:15.599013 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4025/8108] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:40:15.601473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f44d4-1b47-4199-9920-879b4adc9076 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:15.631065 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4084/8109] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:40:15.642646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f44d4-1b47-4199-9920-879b4adc9076 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:15.666770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9be52-4d77-4646-a604-8d5da7f22ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:15.667427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9be52-4d77-4646-a604-8d5da7f22ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:15.667702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9be52-4d77-4646-a604-8d5da7f22ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:15.667971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9be52-4d77-4646-a604-8d5da7f22ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:15.675464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9be52-4d77-4646-a604-8d5da7f22ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:15.679201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9be52-4d77-4646-a604-8d5da7f22ac6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:15.753387 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4026/8110] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:15 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:15.760029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b3feb-9499-4d77-ac5b-e68b1d9e10c8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:15.807883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b3feb-9499-4d77-ac5b-e68b1d9e10c8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:15.963862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d88d4-52ef-4d23-b22f-67d4143d2522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:15.964601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d88d4-52ef-4d23-b22f-67d4143d2522 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:15.964979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d88d4-52ef-4d23-b22f-67d4143d2522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:15.966223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d88d4-52ef-4d23-b22f-67d4143d2522 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:15.967512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d88d4-52ef-4d23-b22f-67d4143d2522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:15.974678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d88d4-52ef-4d23-b22f-67d4143d2522 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:16.035518 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4085/8111] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:40:15 2022] POST /identity/v3/users => generated 292 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:16.039549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9be52-4d77-4646-a604-8d5da7f22ac6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:16.064476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9be52-4d77-4646-a604-8d5da7f22ac6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:16.100122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f35f2-ee38-4549-8414-c58213958dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:16.103926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f35f2-ee38-4549-8414-c58213958dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:16.104256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f35f2-ee38-4549-8414-c58213958dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:16.106586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f35f2-ee38-4549-8414-c58213958dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:16.107370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f35f2-ee38-4549-8414-c58213958dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:16.109034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f35f2-ee38-4549-8414-c58213958dc0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:16.142356 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4027/8112] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:16.146424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d88d4-52ef-4d23-b22f-67d4143d2522 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:16.168404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d88d4-52ef-4d23-b22f-67d4143d2522 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:16.183226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67996051-f9b6-46fd-8243-a76be79047f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:16.183860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67996051-f9b6-46fd-8243-a76be79047f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:16.184707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67996051-f9b6-46fd-8243-a76be79047f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:16.184990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67996051-f9b6-46fd-8243-a76be79047f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:16.185972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67996051-f9b6-46fd-8243-a76be79047f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:16.191413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67996051-f9b6-46fd-8243-a76be79047f9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:16.222752 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4086/8113] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:16.224066 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f35f2-ee38-4549-8414-c58213958dc0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:16.237727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f35f2-ee38-4549-8414-c58213958dc0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:16.248328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194c6bc-0350-411d-9327-54c967f94ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:16.249015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194c6bc-0350-411d-9327-54c967f94ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:16.249296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194c6bc-0350-411d-9327-54c967f94ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:16.249569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194c6bc-0350-411d-9327-54c967f94ad9 admin admin] PATH_INFO: `/v3/projects/fc2dcdc4d5f54f35811466d98a5743fc/users/a0caaf3c30304687819e44a12d63d0c6/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:16.289740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194c6bc-0350-411d-9327-54c967f94ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2dcdc4d5f54f35811466d98a5743fc, user_id=a0caaf3c30304687819e44a12d63d0c6, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:16.312098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194c6bc-0350-411d-9327-54c967f94ad9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:16.335512 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4028/8114] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:16 2022] PUT /identity/v3/projects/fc2dcdc4d5f54f35811466d98a5743fc/users/a0caaf3c30304687819e44a12d63d0c6/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:16.346733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d4905-9f42-4f73-9362-7cc95199c1fc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:16.347550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d4905-9f42-4f73-9362-7cc95199c1fc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:16.348217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d4905-9f42-4f73-9362-7cc95199c1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:16.459541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-987d4905-9f42-4f73-9362-7cc95199c1fc None None] MFA Rules not processed for user `a0caaf3c30304687819e44a12d63d0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:16.461262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-987d4905-9f42-4f73-9362-7cc95199c1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:16.755240 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4087/8115] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:16.759731 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194c6bc-0350-411d-9327-54c967f94ad9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:16.929801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194c6bc-0350-411d-9327-54c967f94ad9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:16.943901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d85da0-a9d7-486e-97c2-1e2fc68f72a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:16.944990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d85da0-a9d7-486e-97c2-1e2fc68f72a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:16.945280 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d85da0-a9d7-486e-97c2-1e2fc68f72a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:16.945552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d85da0-a9d7-486e-97c2-1e2fc68f72a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:16.946379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d85da0-a9d7-486e-97c2-1e2fc68f72a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:16.952056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d85da0-a9d7-486e-97c2-1e2fc68f72a2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:17.037518 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4029/8116] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:16 2022] POST /identity/v3/projects => generated 383 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:17.040602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d4905-9f42-4f73-9362-7cc95199c1fc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:17.055149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d4905-9f42-4f73-9362-7cc95199c1fc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:17.098791 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:17.259948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ec50e-0fda-4e7c-8347-d0c77944bed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:17.268595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ec50e-0fda-4e7c-8347-d0c77944bed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:17.268595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ec50e-0fda-4e7c-8347-d0c77944bed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:17.268904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ec50e-0fda-4e7c-8347-d0c77944bed9 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:17.269479 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ec50e-0fda-4e7c-8347-d0c77944bed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:17.290385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ec50e-0fda-4e7c-8347-d0c77944bed9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:17.343069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d85da0-a9d7-486e-97c2-1e2fc68f72a2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:17.345596 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4088/8117] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:40:17 2022] POST /identity/v3/users => generated 292 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:17.364610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d85da0-a9d7-486e-97c2-1e2fc68f72a2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:17.395640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced44e1-9dba-4269-a5e0-1d7445e41386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:17.396315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced44e1-9dba-4269-a5e0-1d7445e41386 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:17.398022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced44e1-9dba-4269-a5e0-1d7445e41386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:17.398307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced44e1-9dba-4269-a5e0-1d7445e41386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:17.407035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced44e1-9dba-4269-a5e0-1d7445e41386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:17.414833 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced44e1-9dba-4269-a5e0-1d7445e41386 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:17.478656 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4030/8118] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:17.487033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ec50e-0fda-4e7c-8347-d0c77944bed9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:17.510625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ec50e-0fda-4e7c-8347-d0c77944bed9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:17.542227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2d8a3-5093-47cc-9ad7-938a67a6f5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:17.542851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d8a3-5093-47cc-9ad7-938a67a6f5db admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:17.567783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d8a3-5093-47cc-9ad7-938a67a6f5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:17.568107 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d8a3-5093-47cc-9ad7-938a67a6f5db admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:17.569743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2d8a3-5093-47cc-9ad7-938a67a6f5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:17.583462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2d8a3-5093-47cc-9ad7-938a67a6f5db admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:17.651938 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4089/8119] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:17.657138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced44e1-9dba-4269-a5e0-1d7445e41386 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:17.665800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364fb7b-5d48-47c7-a87f-07d9496a0210 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:17.665800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364fb7b-5d48-47c7-a87f-07d9496a0210 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:17.666464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364fb7b-5d48-47c7-a87f-07d9496a0210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:17.676375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced44e1-9dba-4269-a5e0-1d7445e41386 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:17.695098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316dae-c074-41d3-bc39-72ac217bd097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:17.696176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316dae-c074-41d3-bc39-72ac217bd097 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:17.696618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316dae-c074-41d3-bc39-72ac217bd097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:17.697057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316dae-c074-41d3-bc39-72ac217bd097 admin admin] PATH_INFO: `/v3/projects/060fc6928501435db88d88135a0272c3/users/5b57972f70344226bbe5a0f975c41334/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:17.766031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26316dae-c074-41d3-bc39-72ac217bd097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=060fc6928501435db88d88135a0272c3, user_id=5b57972f70344226bbe5a0f975c41334, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:17.776128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26316dae-c074-41d3-bc39-72ac217bd097 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:17.833603 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4031/8120] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:17 2022] PUT /identity/v3/projects/060fc6928501435db88d88135a0272c3/users/5b57972f70344226bbe5a0f975c41334/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:17.835628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbb5fa-b82b-4646-a679-0a38d162c477 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:17.840987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbb5fa-b82b-4646-a679-0a38d162c477 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:17.845196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbb5fa-b82b-4646-a679-0a38d162c477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:17.851092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d364fb7b-5d48-47c7-a87f-07d9496a0210 None None] MFA Rules not processed for user `7f58f86160d54e0380ff27912f42417d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:17.863121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d364fb7b-5d48-47c7-a87f-07d9496a0210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:17.871009 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:17.959988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-13bbb5fa-b82b-4646-a679-0a38d162c477 None None] MFA Rules not processed for user `5b57972f70344226bbe5a0f975c41334`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:17.965421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-13bbb5fa-b82b-4646-a679-0a38d162c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:18.173364 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4090/8121] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:18.174409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364fb7b-5d48-47c7-a87f-07d9496a0210 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:18.174531 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4032/8122] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:18.176809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d364fb7b-5d48-47c7-a87f-07d9496a0210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:18.190214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbb5fa-b82b-4646-a679-0a38d162c477 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:18.194983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-13bbb5fa-b82b-4646-a679-0a38d162c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:18.371020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364fb7b-5d48-47c7-a87f-07d9496a0210 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:18.404244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de76a2-5541-4ebb-abbe-7fddb5967ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:18.405053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de76a2-5541-4ebb-abbe-7fddb5967ccd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:18.405336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de76a2-5541-4ebb-abbe-7fddb5967ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:18.405895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de76a2-5541-4ebb-abbe-7fddb5967ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:18.410227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de76a2-5541-4ebb-abbe-7fddb5967ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:18.418873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de76a2-5541-4ebb-abbe-7fddb5967ccd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:18.495135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbb5fa-b82b-4646-a679-0a38d162c477 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:18.508454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323c76d-f485-4def-b780-2f439e6271fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:18.509431 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323c76d-f485-4def-b780-2f439e6271fb service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:18.511447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323c76d-f485-4def-b780-2f439e6271fb service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:18.511917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323c76d-f485-4def-b780-2f439e6271fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:18.533667 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4091/8123] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:18 2022] POST /identity/v3/projects => generated 367 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:18.535658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de76a2-5541-4ebb-abbe-7fddb5967ccd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:18.636995 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:18.781301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323c76d-f485-4def-b780-2f439e6271fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:18.783442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323c76d-f485-4def-b780-2f439e6271fb service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:18.811770 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4033/8124] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:18.826717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de76a2-5541-4ebb-abbe-7fddb5967ccd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:18.838891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c3707-aefd-4634-9c81-e3aa1cc28c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:18.839543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c3707-aefd-4634-9c81-e3aa1cc28c61 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:18.839821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c3707-aefd-4634-9c81-e3aa1cc28c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:18.840114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c3707-aefd-4634-9c81-e3aa1cc28c61 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:18.841616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c3707-aefd-4634-9c81-e3aa1cc28c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:18.846392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c3707-aefd-4634-9c81-e3aa1cc28c61 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:18.898076 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4092/8125] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:40:18 2022] POST /identity/v3/users => generated 290 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:18.899207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323c76d-f485-4def-b780-2f439e6271fb service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:18.942110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323c76d-f485-4def-b780-2f439e6271fb service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:18.960384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5972b2b-e47c-41df-9731-299c2a558f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:18.962036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5972b2b-e47c-41df-9731-299c2a558f57 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:18.962315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5972b2b-e47c-41df-9731-299c2a558f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:18.962596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5972b2b-e47c-41df-9731-299c2a558f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:18.963608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5972b2b-e47c-41df-9731-299c2a558f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:18.969241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5972b2b-e47c-41df-9731-299c2a558f57 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:19.002102 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4034/8126] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:19.003202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c3707-aefd-4634-9c81-e3aa1cc28c61 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:19.020219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c3707-aefd-4634-9c81-e3aa1cc28c61 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:19.043911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9511fb-4c63-478c-b580-2023019a393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:19.044830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9511fb-4c63-478c-b580-2023019a393b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:19.045699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9511fb-4c63-478c-b580-2023019a393b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:19.046081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9511fb-4c63-478c-b580-2023019a393b admin admin] PATH_INFO: `/v3/projects/d30b3d7f56ff4f318f23798c64dda5d8/users/dca89c1fe35840418ebefd193e58ca6d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:19.104127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9511fb-4c63-478c-b580-2023019a393b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30b3d7f56ff4f318f23798c64dda5d8, user_id=dca89c1fe35840418ebefd193e58ca6d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:19.115631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9511fb-4c63-478c-b580-2023019a393b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:19.158285 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4093/8127] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:19 2022] PUT /identity/v3/projects/d30b3d7f56ff4f318f23798c64dda5d8/users/dca89c1fe35840418ebefd193e58ca6d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:19.162427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5972b2b-e47c-41df-9731-299c2a558f57 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:19.178315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5972b2b-e47c-41df-9731-299c2a558f57 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:19.178638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9511fb-4c63-478c-b580-2023019a393b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:19.269646 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:19.314942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9511fb-4c63-478c-b580-2023019a393b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:19.320065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2ac20-cf09-415c-953f-62a3703d9f55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:19.321039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2ac20-cf09-415c-953f-62a3703d9f55 service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:19.321563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2ac20-cf09-415c-953f-62a3703d9f55 service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:19.322091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2ac20-cf09-415c-953f-62a3703d9f55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:19.328590 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18f470-f7d6-449e-8b68-9b7dfa86df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:19.329289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18f470-f7d6-449e-8b68-9b7dfa86df0d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:19.329574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18f470-f7d6-449e-8b68-9b7dfa86df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:19.329860 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18f470-f7d6-449e-8b68-9b7dfa86df0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:19.330501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18f470-f7d6-449e-8b68-9b7dfa86df0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:19.332161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18f470-f7d6-449e-8b68-9b7dfa86df0d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:19.378381 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4035/8128] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:19.383886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18f470-f7d6-449e-8b68-9b7dfa86df0d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:19.412360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2ac20-cf09-415c-953f-62a3703d9f55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:19.414732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2ac20-cf09-415c-953f-62a3703d9f55 service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:19.420951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18f470-f7d6-449e-8b68-9b7dfa86df0d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:19.428347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5428c-71ff-42c9-9218-468c74136e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:19.429170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5428c-71ff-42c9-9218-468c74136e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:19.429687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5428c-71ff-42c9-9218-468c74136e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:19.430234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5428c-71ff-42c9-9218-468c74136e12 admin admin] PATH_INFO: `/v3/projects/d30b3d7f56ff4f318f23798c64dda5d8/users/dca89c1fe35840418ebefd193e58ca6d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:19.433755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5428c-71ff-42c9-9218-468c74136e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30b3d7f56ff4f318f23798c64dda5d8, user_id=dca89c1fe35840418ebefd193e58ca6d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:19.437341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5428c-71ff-42c9-9218-468c74136e12 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:19.457515 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4094/8129] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:40:19.476822 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4036/8130] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:19 2022] PUT /identity/v3/projects/d30b3d7f56ff4f318f23798c64dda5d8/users/dca89c1fe35840418ebefd193e58ca6d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:20.461083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2ac20-cf09-415c-953f-62a3703d9f55 service glance] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:20.487650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2ac20-cf09-415c-953f-62a3703d9f55 service glance] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:20.640612 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:20.816033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:20.817229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:20.817519 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:20.817812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] PATH_INFO: `/v3/users/a0caaf3c30304687819e44a12d63d0c6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:20.820038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0caaf3c30304687819e44a12d63d0c6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:20.822739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:21.050184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0caaf3c30304687819e44a12d63d0c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:21.051073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0caaf3c30304687819e44a12d63d0c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:21.097757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0caaf3c30304687819e44a12d63d0c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:21.129578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0caaf3c30304687819e44a12d63d0c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:21.141306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0caaf3c30304687819e44a12d63d0c6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:21.223317 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4095/8131] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:40:20 2022] DELETE /identity/v3/users/a0caaf3c30304687819e44a12d63d0c6 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:40:21.228523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116644b-fae4-425c-8b74-8b4bd77c63e2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:21.228523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116644b-fae4-425c-8b74-8b4bd77c63e2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:21.230631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116644b-fae4-425c-8b74-8b4bd77c63e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:21.294198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f116644b-fae4-425c-8b74-8b4bd77c63e2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:21.299303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f116644b-fae4-425c-8b74-8b4bd77c63e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:21.583881 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4037/8132] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:21.600150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:21.602359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:21.792070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0443c-5852-45ab-9b88-4279c1c9f903 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:21.813217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed51e55-ab93-41fa-bb44-f1333f2cecd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:21.813989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed51e55-ab93-41fa-bb44-f1333f2cecd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:21.814374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed51e55-ab93-41fa-bb44-f1333f2cecd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:21.814776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed51e55-ab93-41fa-bb44-f1333f2cecd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:21.854820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed51e55-ab93-41fa-bb44-f1333f2cecd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:21.860230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed51e55-ab93-41fa-bb44-f1333f2cecd1 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:21.892333 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4096/8133] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:24.624606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116644b-fae4-425c-8b74-8b4bd77c63e2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:24.630710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f116644b-fae4-425c-8b74-8b4bd77c63e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:24.663184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116644b-fae4-425c-8b74-8b4bd77c63e2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:24.688138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:24.688904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:24.690294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:24.690673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] PATH_INFO: `/v3/projects/fc2dcdc4d5f54f35811466d98a5743fc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:24.693301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc2dcdc4d5f54f35811466d98a5743fc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:24.701402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:24.949673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2dcdc4d5f54f35811466d98a5743fc', 'request_id': 'req-66d41ab9-aa47-4d08-8369-264aa7919e7d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:24.961835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2dcdc4d5f54f35811466d98a5743fc', 'request_id': 'req-66d41ab9-aa47-4d08-8369-264aa7919e7d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:24.983910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2dcdc4d5f54f35811466d98a5743fc', 'request_id': 'req-66d41ab9-aa47-4d08-8369-264aa7919e7d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:25.008423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] The token cache is being invalidate because project fc2dcdc4d5f54f35811466d98a5743fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:25.008799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:25.009502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:25.016890 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4038/8134] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:24 2022] DELETE /identity/v3/projects/fc2dcdc4d5f54f35811466d98a5743fc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:25.021088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed51e55-ab93-41fa-bb44-f1333f2cecd1 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:25.034108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed51e55-ab93-41fa-bb44-f1333f2cecd1 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:25.160643 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:25.184558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2787122-f12d-4a1a-8172-eb5e8153f4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:25.193578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2787122-f12d-4a1a-8172-eb5e8153f4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:25.194065 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2787122-f12d-4a1a-8172-eb5e8153f4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:25.194421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2787122-f12d-4a1a-8172-eb5e8153f4d8 admin admin] PATH_INFO: `/v3/users/5b57972f70344226bbe5a0f975c41334` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:25.203832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2787122-f12d-4a1a-8172-eb5e8153f4d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b57972f70344226bbe5a0f975c41334)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:25.206201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2787122-f12d-4a1a-8172-eb5e8153f4d8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:25.364220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2787122-f12d-4a1a-8172-eb5e8153f4d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b57972f70344226bbe5a0f975c41334'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:25.365269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2787122-f12d-4a1a-8172-eb5e8153f4d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b57972f70344226bbe5a0f975c41334'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:25.382383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2787122-f12d-4a1a-8172-eb5e8153f4d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b57972f70344226bbe5a0f975c41334'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:25.396232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2787122-f12d-4a1a-8172-eb5e8153f4d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b57972f70344226bbe5a0f975c41334'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:25.397266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e2787122-f12d-4a1a-8172-eb5e8153f4d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b57972f70344226bbe5a0f975c41334'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:25.428792 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4097/8135] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:40:25 2022] DELETE /identity/v3/users/5b57972f70344226bbe5a0f975c41334 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:27.359475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:27.361788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:27.390154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d41ab9-aa47-4d08-8369-264aa7919e7d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:27.476356 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:27.501390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ef9b9-8b5e-4cde-8ef0-f381f893f235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:27.502197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ef9b9-8b5e-4cde-8ef0-f381f893f235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:27.502574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ef9b9-8b5e-4cde-8ef0-f381f893f235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:27.503140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ef9b9-8b5e-4cde-8ef0-f381f893f235 admin admin] PATH_INFO: `/v3/projects/060fc6928501435db88d88135a0272c3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:27.504400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ef9b9-8b5e-4cde-8ef0-f381f893f235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=060fc6928501435db88d88135a0272c3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:27.506626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ef9b9-8b5e-4cde-8ef0-f381f893f235 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:27.623173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-639ef9b9-8b5e-4cde-8ef0-f381f893f235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060fc6928501435db88d88135a0272c3', 'request_id': 'req-639ef9b9-8b5e-4cde-8ef0-f381f893f235'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:27.641005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-639ef9b9-8b5e-4cde-8ef0-f381f893f235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060fc6928501435db88d88135a0272c3', 'request_id': 'req-639ef9b9-8b5e-4cde-8ef0-f381f893f235'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:27.664525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-639ef9b9-8b5e-4cde-8ef0-f381f893f235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060fc6928501435db88d88135a0272c3', 'request_id': 'req-639ef9b9-8b5e-4cde-8ef0-f381f893f235'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:27.691478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-639ef9b9-8b5e-4cde-8ef0-f381f893f235 admin admin] The token cache is being invalidate because project 060fc6928501435db88d88135a0272c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:27.696027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-639ef9b9-8b5e-4cde-8ef0-f381f893f235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:27.697247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-639ef9b9-8b5e-4cde-8ef0-f381f893f235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:27.700923 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4039/8136] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:27 2022] DELETE /identity/v3/projects/060fc6928501435db88d88135a0272c3 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:27.706958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f53a8f-f484-45e2-a307-831f9a07bf58 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:27.707909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f53a8f-f484-45e2-a307-831f9a07bf58 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:27.708403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f53a8f-f484-45e2-a307-831f9a07bf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:27.763373 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b2f53a8f-f484-45e2-a307-831f9a07bf58 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:27.768624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b2f53a8f-f484-45e2-a307-831f9a07bf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:27.934583 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4098/8137] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:27.945944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa7f0b-3f06-47c2-acee-b70b52f531b1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:27.945944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa7f0b-3f06-47c2-acee-b70b52f531b1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:27.945944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa7f0b-3f06-47c2-acee-b70b52f531b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:27.984337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-89aa7f0b-3f06-47c2-acee-b70b52f531b1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:27.987001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-89aa7f0b-3f06-47c2-acee-b70b52f531b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:28.009324 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4040/8138] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:28.011144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f53a8f-f484-45e2-a307-831f9a07bf58 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:28.026724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f53a8f-f484-45e2-a307-831f9a07bf58 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:28.054874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef6010-43e7-4308-849e-c77b450382dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:28.055536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef6010-43e7-4308-849e-c77b450382dc admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:28.055826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef6010-43e7-4308-849e-c77b450382dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:28.056089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef6010-43e7-4308-849e-c77b450382dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:28.056745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef6010-43e7-4308-849e-c77b450382dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:40:28.057041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef6010-43e7-4308-849e-c77b450382dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:28.058723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef6010-43e7-4308-849e-c77b450382dc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:28.094732 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4099/8139] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:40:28.100052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa7f0b-3f06-47c2-acee-b70b52f531b1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:28.125838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa7f0b-3f06-47c2-acee-b70b52f531b1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:28.144668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ba021-018a-43b9-9d01-0d159dbe53b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:28.145376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ba021-018a-43b9-9d01-0d159dbe53b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:28.145658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ba021-018a-43b9-9d01-0d159dbe53b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:28.145931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ba021-018a-43b9-9d01-0d159dbe53b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:28.155652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ba021-018a-43b9-9d01-0d159dbe53b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:28.174547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ba021-018a-43b9-9d01-0d159dbe53b3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:28.273040 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4041/8140] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:28 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:28.273823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef6010-43e7-4308-849e-c77b450382dc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:28.290220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef6010-43e7-4308-849e-c77b450382dc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:28.466342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e1fa5-2faf-4f54-9c0e-07c8e5b3c5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:28.467024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e1fa5-2faf-4f54-9c0e-07c8e5b3c5bb admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:28.469441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e1fa5-2faf-4f54-9c0e-07c8e5b3c5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:28.469441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e1fa5-2faf-4f54-9c0e-07c8e5b3c5bb admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:28.469441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e1fa5-2faf-4f54-9c0e-07c8e5b3c5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:28.470428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e1fa5-2faf-4f54-9c0e-07c8e5b3c5bb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:28.493158 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:28.517689 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4100/8141] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:40:28 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:40:28.522564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ba021-018a-43b9-9d01-0d159dbe53b3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:28.545305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ba021-018a-43b9-9d01-0d159dbe53b3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:28.559777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33f263-7783-470e-97a0-ef7d40f9233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:28.560442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33f263-7783-470e-97a0-ef7d40f9233a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:28.560732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33f263-7783-470e-97a0-ef7d40f9233a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:28.560997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33f263-7783-470e-97a0-ef7d40f9233a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:28.561646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33f263-7783-470e-97a0-ef7d40f9233a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:28.563316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33f263-7783-470e-97a0-ef7d40f9233a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:28.594327 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4042/8142] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:28.594621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e1fa5-2faf-4f54-9c0e-07c8e5b3c5bb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:28.612051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e1fa5-2faf-4f54-9c0e-07c8e5b3c5bb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:28.621484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b664a-c063-46c3-9b28-c74c084087e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:28.622513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b664a-c063-46c3-9b28-c74c084087e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:28.622803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b664a-c063-46c3-9b28-c74c084087e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:28.625265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b664a-c063-46c3-9b28-c74c084087e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:28.627906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b664a-c063-46c3-9b28-c74c084087e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:28.632729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b664a-c063-46c3-9b28-c74c084087e8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:28.675940 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4101/8143] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:28.680651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33f263-7783-470e-97a0-ef7d40f9233a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:28.695961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33f263-7783-470e-97a0-ef7d40f9233a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:28.711728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc24e1-5dd5-4f41-9ceb-f039ac0d7c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:28.712426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc24e1-5dd5-4f41-9ceb-f039ac0d7c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:28.712714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc24e1-5dd5-4f41-9ceb-f039ac0d7c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:28.712998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc24e1-5dd5-4f41-9ceb-f039ac0d7c57 admin admin] PATH_INFO: `/v3/projects/048a419139e342c1a0a83b1f17b55230/users/cf2f03e71d5c4613b8559037eb30924a/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:28.743261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc24e1-5dd5-4f41-9ceb-f039ac0d7c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=048a419139e342c1a0a83b1f17b55230, user_id=cf2f03e71d5c4613b8559037eb30924a, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:28.745983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc24e1-5dd5-4f41-9ceb-f039ac0d7c57 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:28.773692 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4043/8144] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:28 2022] PUT /identity/v3/projects/048a419139e342c1a0a83b1f17b55230/users/cf2f03e71d5c4613b8559037eb30924a/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:28.790007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039bf03-b47d-4484-9c4f-bd00f6fe31be None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:28.790548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039bf03-b47d-4484-9c4f-bd00f6fe31be None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:28.790548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039bf03-b47d-4484-9c4f-bd00f6fe31be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:28.850760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5039bf03-b47d-4484-9c4f-bd00f6fe31be None None] MFA Rules not processed for user `cf2f03e71d5c4613b8559037eb30924a`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:28.852707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5039bf03-b47d-4484-9c4f-bd00f6fe31be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:29.095045 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4102/8145] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:29.095486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc24e1-5dd5-4f41-9ceb-f039ac0d7c57 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:29.259753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc24e1-5dd5-4f41-9ceb-f039ac0d7c57 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:29.267814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12993e46-9709-4d68-9c2e-52014dad1157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:29.268505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12993e46-9709-4d68-9c2e-52014dad1157 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:29.268790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12993e46-9709-4d68-9c2e-52014dad1157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:29.269063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12993e46-9709-4d68-9c2e-52014dad1157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:29.269704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12993e46-9709-4d68-9c2e-52014dad1157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:29.271727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12993e46-9709-4d68-9c2e-52014dad1157 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:29.280123 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:29.311210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039bf03-b47d-4484-9c4f-bd00f6fe31be None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:29.313045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5039bf03-b47d-4484-9c4f-bd00f6fe31be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:29.354940 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4044/8146] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:29 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:29.360548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12993e46-9709-4d68-9c2e-52014dad1157 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:29.448160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039bf03-b47d-4484-9c4f-bd00f6fe31be None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:29.538349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12993e46-9709-4d68-9c2e-52014dad1157 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:29.553153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1508d6c-69f1-4302-a78e-5f7a3b4cca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:29.555342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1508d6c-69f1-4302-a78e-5f7a3b4cca9a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:29.563473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1508d6c-69f1-4302-a78e-5f7a3b4cca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:29.563473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1508d6c-69f1-4302-a78e-5f7a3b4cca9a admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:29.563473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1508d6c-69f1-4302-a78e-5f7a3b4cca9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:29.563473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1508d6c-69f1-4302-a78e-5f7a3b4cca9a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:29.588974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5bde9-f450-4147-a862-53dfdc0827ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:29.589890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5bde9-f450-4147-a862-53dfdc0827ec service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:29.590478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5bde9-f450-4147-a862-53dfdc0827ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:29.590938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5bde9-f450-4147-a862-53dfdc0827ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:29.597396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dfa5bde9-f450-4147-a862-53dfdc0827ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:29.659758 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4045/8147] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:40:29 2022] POST /identity/v3/users => generated 299 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:29.664596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1508d6c-69f1-4302-a78e-5f7a3b4cca9a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:29.679618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1508d6c-69f1-4302-a78e-5f7a3b4cca9a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:29.682316 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:29.688658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b49c7-32b2-461a-978b-d33d0f8f0c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:29.689470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b49c7-32b2-461a-978b-d33d0f8f0c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:29.691900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b49c7-32b2-461a-978b-d33d0f8f0c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:29.692339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b49c7-32b2-461a-978b-d33d0f8f0c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:29.693571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b49c7-32b2-461a-978b-d33d0f8f0c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:29.695798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b49c7-32b2-461a-978b-d33d0f8f0c94 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:29.712419 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4046/8148] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:29.716649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b49c7-32b2-461a-978b-d33d0f8f0c94 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:29.734467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b49c7-32b2-461a-978b-d33d0f8f0c94 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:29.756761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5bde9-f450-4147-a862-53dfdc0827ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:29.758401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5bde9-f450-4147-a862-53dfdc0827ec service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:29.763753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56db75-04af-4cac-8455-b316277193a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:29.764568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56db75-04af-4cac-8455-b316277193a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:29.767133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56db75-04af-4cac-8455-b316277193a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:29.767547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56db75-04af-4cac-8455-b316277193a3 admin admin] PATH_INFO: `/v3/projects/42ce0b021f394d1d8fbea46d81249740/users/79b9603cee5a4f098c59f7e3a9ee1f6e/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:29.793914 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4103/8149] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:29.819598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56db75-04af-4cac-8455-b316277193a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ce0b021f394d1d8fbea46d81249740, user_id=79b9603cee5a4f098c59f7e3a9ee1f6e, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:29.822681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56db75-04af-4cac-8455-b316277193a3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:29.869476 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4047/8150] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:29 2022] PUT /identity/v3/projects/42ce0b021f394d1d8fbea46d81249740/users/79b9603cee5a4f098c59f7e3a9ee1f6e/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:29.875013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5bde9-f450-4147-a862-53dfdc0827ec service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:29.892577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5bde9-f450-4147-a862-53dfdc0827ec service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:30.047780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ef829-1c1d-48e7-9535-7bdf3ade7805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:30.048649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ef829-1c1d-48e7-9535-7bdf3ade7805 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:30.048961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ef829-1c1d-48e7-9535-7bdf3ade7805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:30.049455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ef829-1c1d-48e7-9535-7bdf3ade7805 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:30.051873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ef829-1c1d-48e7-9535-7bdf3ade7805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:30.053585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ef829-1c1d-48e7-9535-7bdf3ade7805 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:30.091023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56db75-04af-4cac-8455-b316277193a3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:30.111563 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4104/8151] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:30.112344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56db75-04af-4cac-8455-b316277193a3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:30.134897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624ac6d-eb69-4880-92d6-766b8da833df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:30.135601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624ac6d-eb69-4880-92d6-766b8da833df admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:30.136062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624ac6d-eb69-4880-92d6-766b8da833df admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:30.136062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624ac6d-eb69-4880-92d6-766b8da833df admin admin] PATH_INFO: `/v3/projects/42ce0b021f394d1d8fbea46d81249740/users/79b9603cee5a4f098c59f7e3a9ee1f6e/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:30.139694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624ac6d-eb69-4880-92d6-766b8da833df admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ce0b021f394d1d8fbea46d81249740, user_id=79b9603cee5a4f098c59f7e3a9ee1f6e, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:30.143087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624ac6d-eb69-4880-92d6-766b8da833df admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:30.195296 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4048/8152] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:30 2022] PUT /identity/v3/projects/42ce0b021f394d1d8fbea46d81249740/users/79b9603cee5a4f098c59f7e3a9ee1f6e/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:40:30.198006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddf9bc-d51c-4e6d-a0a5-431601bf04e8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:30.198299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddf9bc-d51c-4e6d-a0a5-431601bf04e8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:30.198818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddf9bc-d51c-4e6d-a0a5-431601bf04e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:30.290670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-eaddf9bc-d51c-4e6d-a0a5-431601bf04e8 None None] MFA Rules not processed for user `79b9603cee5a4f098c59f7e3a9ee1f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:30.292827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eaddf9bc-d51c-4e6d-a0a5-431601bf04e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:30.424345 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4105/8153] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:40:30.433259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624ac6d-eb69-4880-92d6-766b8da833df admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:30.557497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624ac6d-eb69-4880-92d6-766b8da833df admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:30.563996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139945a0-62fa-47aa-b4f2-d6d28a3d4cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:30.565116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139945a0-62fa-47aa-b4f2-d6d28a3d4cfc service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:30.565815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139945a0-62fa-47aa-b4f2-d6d28a3d4cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:30.566174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139945a0-62fa-47aa-b4f2-d6d28a3d4cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:30.577971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139945a0-62fa-47aa-b4f2-d6d28a3d4cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:30.579704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139945a0-62fa-47aa-b4f2-d6d28a3d4cfc service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:30.592421 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4049/8154] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:31.661025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d1762-7157-4198-9958-a770e88a026c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:31.662979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d1762-7157-4198-9958-a770e88a026c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:31.663477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d1762-7157-4198-9958-a770e88a026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:31.755423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-aa7d1762-7157-4198-9958-a770e88a026c None None] MFA Rules not processed for user `dca89c1fe35840418ebefd193e58ca6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:31.758499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aa7d1762-7157-4198-9958-a770e88a026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:31.860306 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:31.925889 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4106/8155] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:40:31.939834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139945a0-62fa-47aa-b4f2-d6d28a3d4cfc service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:31.946490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-139945a0-62fa-47aa-b4f2-d6d28a3d4cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:32.023185 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:32.119383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139945a0-62fa-47aa-b4f2-d6d28a3d4cfc service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:32.147245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b8b6d-1dbb-4975-bc1a-193642ceeea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:32.149120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b8b6d-1dbb-4975-bc1a-193642ceeea0 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:32.149404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b8b6d-1dbb-4975-bc1a-193642ceeea0 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:32.151591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b8b6d-1dbb-4975-bc1a-193642ceeea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:32.160327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cc4b8b6d-1dbb-4975-bc1a-193642ceeea0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:32.313097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b8b6d-1dbb-4975-bc1a-193642ceeea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:32.315883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b8b6d-1dbb-4975-bc1a-193642ceeea0 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:32.345330 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4050/8156] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:35.755492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d7d44-c8fd-46ad-9d14-ff7850f216b7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:35.756094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d7d44-c8fd-46ad-9d14-ff7850f216b7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:35.756280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d7d44-c8fd-46ad-9d14-ff7850f216b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:35.782711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d35d7d44-c8fd-46ad-9d14-ff7850f216b7 None None] MFA Rules not processed for user `7f58f86160d54e0380ff27912f42417d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:35.784259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d35d7d44-c8fd-46ad-9d14-ff7850f216b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:35.795297 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4107/8157] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:35.849622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b8b6d-1dbb-4975-bc1a-193642ceeea0 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:36.005891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b8b6d-1dbb-4975-bc1a-193642ceeea0 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:36.016913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:36.023047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:36.023662 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:36.024254 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] PATH_INFO: `/v3/users/cf2f03e71d5c4613b8559037eb30924a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:36.028698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2f03e71d5c4613b8559037eb30924a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:36.036777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:36.120237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2f03e71d5c4613b8559037eb30924a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:36.122039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2f03e71d5c4613b8559037eb30924a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:36.140724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2f03e71d5c4613b8559037eb30924a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:36.144210 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:36.157298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2f03e71d5c4613b8559037eb30924a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:36.158668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2f03e71d5c4613b8559037eb30924a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:36.178786 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4051/8158] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:40:35 2022] DELETE /identity/v3/users/cf2f03e71d5c4613b8559037eb30924a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:36.187091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939434-8aa1-4386-bafc-29c63e801edf None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:36.187756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939434-8aa1-4386-bafc-29c63e801edf None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:36.188186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939434-8aa1-4386-bafc-29c63e801edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:36.250289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a1939434-8aa1-4386-bafc-29c63e801edf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:36.251442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a1939434-8aa1-4386-bafc-29c63e801edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:36.353338 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4108/8159] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:36.363408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:36.367813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:36.503156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa758af-bd08-4e73-a36e-ac8274f4052d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:36.511558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4b0c9-224f-4e5b-b408-cd44e3eaa7aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:36.513181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4b0c9-224f-4e5b-b408-cd44e3eaa7aa service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:36.513736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4b0c9-224f-4e5b-b408-cd44e3eaa7aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:36.514473 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4b0c9-224f-4e5b-b408-cd44e3eaa7aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:36.526604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4b0c9-224f-4e5b-b408-cd44e3eaa7aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:36.529634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4b0c9-224f-4e5b-b408-cd44e3eaa7aa service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:36.550584 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4052/8160] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:37.296605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1939434-8aa1-4386-bafc-29c63e801edf None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:37.298213 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a1939434-8aa1-4386-bafc-29c63e801edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:37.360380 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1939434-8aa1-4386-bafc-29c63e801edf None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:37.371121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:37.372522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:37.373696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:37.374794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] PATH_INFO: `/v3/projects/048a419139e342c1a0a83b1f17b55230` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:37.376356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=048a419139e342c1a0a83b1f17b55230)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:37.379089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:37.450866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '048a419139e342c1a0a83b1f17b55230', 'request_id': 'req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:37.459428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '048a419139e342c1a0a83b1f17b55230', 'request_id': 'req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:37.476384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '048a419139e342c1a0a83b1f17b55230', 'request_id': 'req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:37.504315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] The token cache is being invalidate because project 048a419139e342c1a0a83b1f17b55230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:37.505421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:37.506196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:37.509344 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4109/8161] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:37 2022] DELETE /identity/v3/projects/048a419139e342c1a0a83b1f17b55230 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:37.515500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4b0c9-224f-4e5b-b408-cd44e3eaa7aa service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:37.526973 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4b0c9-224f-4e5b-b408-cd44e3eaa7aa service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:37.637610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:37.639648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:37.640042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:37.641101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] PATH_INFO: `/v3/users/79b9603cee5a4f098c59f7e3a9ee1f6e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:37.643018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b9603cee5a4f098c59f7e3a9ee1f6e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:37.645998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:37.746952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:37.748803 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:37.804310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b9603cee5a4f098c59f7e3a9ee1f6e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:37.805906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b9603cee5a4f098c59f7e3a9ee1f6e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:37.838753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b9603cee5a4f098c59f7e3a9ee1f6e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:37.860801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b9603cee5a4f098c59f7e3a9ee1f6e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:37.861550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b9603cee5a4f098c59f7e3a9ee1f6e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:37.882862 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4053/8162] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:40:37 2022] DELETE /identity/v3/users/79b9603cee5a4f098c59f7e3a9ee1f6e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:37.931292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1aebd-5881-47c5-a2ea-7ee5b8ee21c9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:37.938844 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:38.110734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61b607-7410-44c8-96a4-424e4fabf398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:38.111402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61b607-7410-44c8-96a4-424e4fabf398 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:38.111684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61b607-7410-44c8-96a4-424e4fabf398 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:38.119624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61b607-7410-44c8-96a4-424e4fabf398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:38.140212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5b61b607-7410-44c8-96a4-424e4fabf398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:38.186322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61b607-7410-44c8-96a4-424e4fabf398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:38.190507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61b607-7410-44c8-96a4-424e4fabf398 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:38.230287 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4110/8163] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:40:38.552381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:38.555380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:38.581056 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:38.722717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e1e9c-f3c7-49e2-805e-ce43a61635de admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:38.739879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154319fa-8c1c-4ecf-aaf9-6bf65565b251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:38.740732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154319fa-8c1c-4ecf-aaf9-6bf65565b251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:38.740943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154319fa-8c1c-4ecf-aaf9-6bf65565b251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:38.741189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154319fa-8c1c-4ecf-aaf9-6bf65565b251 admin admin] PATH_INFO: `/v3/projects/42ce0b021f394d1d8fbea46d81249740` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:38.747456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154319fa-8c1c-4ecf-aaf9-6bf65565b251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ce0b021f394d1d8fbea46d81249740)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:38.749607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154319fa-8c1c-4ecf-aaf9-6bf65565b251 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:38.875245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-154319fa-8c1c-4ecf-aaf9-6bf65565b251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ce0b021f394d1d8fbea46d81249740', 'request_id': 'req-154319fa-8c1c-4ecf-aaf9-6bf65565b251'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:38.888685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-154319fa-8c1c-4ecf-aaf9-6bf65565b251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ce0b021f394d1d8fbea46d81249740', 'request_id': 'req-154319fa-8c1c-4ecf-aaf9-6bf65565b251'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:38.902471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-154319fa-8c1c-4ecf-aaf9-6bf65565b251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ce0b021f394d1d8fbea46d81249740', 'request_id': 'req-154319fa-8c1c-4ecf-aaf9-6bf65565b251'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:38.952536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-154319fa-8c1c-4ecf-aaf9-6bf65565b251 admin admin] The token cache is being invalidate because project 42ce0b021f394d1d8fbea46d81249740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:38.953182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-154319fa-8c1c-4ecf-aaf9-6bf65565b251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:38.954652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-154319fa-8c1c-4ecf-aaf9-6bf65565b251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:38.960234 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4054/8164] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:38 2022] DELETE /identity/v3/projects/42ce0b021f394d1d8fbea46d81249740 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:38.966279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43989389-9ef7-4439-bee3-d50936e0bfad None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:38.966785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43989389-9ef7-4439-bee3-d50936e0bfad None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:38.967028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43989389-9ef7-4439-bee3-d50936e0bfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:39.004498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-43989389-9ef7-4439-bee3-d50936e0bfad None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:39.007788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-43989389-9ef7-4439-bee3-d50936e0bfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:39.105281 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4111/8165] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:39.114325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecadd33-035d-444b-982c-11b7e9ac13e3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:39.114741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecadd33-035d-444b-982c-11b7e9ac13e3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:39.115170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecadd33-035d-444b-982c-11b7e9ac13e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:39.136500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7ecadd33-035d-444b-982c-11b7e9ac13e3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:39.138577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7ecadd33-035d-444b-982c-11b7e9ac13e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:39.147074 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4055/8166] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:39.151164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43989389-9ef7-4439-bee3-d50936e0bfad None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:39.171798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43989389-9ef7-4439-bee3-d50936e0bfad None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:39.179637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdb5a2-5373-44f2-ac09-1f4ef688fc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:39.180723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdb5a2-5373-44f2-ac09-1f4ef688fc62 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:39.181184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdb5a2-5373-44f2-ac09-1f4ef688fc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:39.181455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdb5a2-5373-44f2-ac09-1f4ef688fc62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:39.182108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdb5a2-5373-44f2-ac09-1f4ef688fc62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:40:39.182412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdb5a2-5373-44f2-ac09-1f4ef688fc62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:39.189523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdb5a2-5373-44f2-ac09-1f4ef688fc62 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:39.230550 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4112/8167] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:40:39.235347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecadd33-035d-444b-982c-11b7e9ac13e3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:39.251720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecadd33-035d-444b-982c-11b7e9ac13e3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:39.286266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7252b5-6a1a-477e-8010-e96df11f18bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:39.286900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7252b5-6a1a-477e-8010-e96df11f18bc admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:39.287207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7252b5-6a1a-477e-8010-e96df11f18bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:39.287479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7252b5-6a1a-477e-8010-e96df11f18bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:39.288420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7252b5-6a1a-477e-8010-e96df11f18bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:39.290475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7252b5-6a1a-477e-8010-e96df11f18bc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:39.354764 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4056/8168] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:39 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:40:39.358808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdb5a2-5373-44f2-ac09-1f4ef688fc62 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:39.372703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdb5a2-5373-44f2-ac09-1f4ef688fc62 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:39.415641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7252b5-6a1a-477e-8010-e96df11f18bc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:39.419400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6d7252b5-6a1a-477e-8010-e96df11f18bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:39.484756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78cf06-a333-40c2-8766-b8ca1fc59660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:39.485576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78cf06-a333-40c2-8766-b8ca1fc59660 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:39.486068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78cf06-a333-40c2-8766-b8ca1fc59660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:39.486653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78cf06-a333-40c2-8766-b8ca1fc59660 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:39.487773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78cf06-a333-40c2-8766-b8ca1fc59660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:39.490269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78cf06-a333-40c2-8766-b8ca1fc59660 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:39.544925 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4113/8169] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:40:39 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:39.548875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78cf06-a333-40c2-8766-b8ca1fc59660 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:39.575035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78cf06-a333-40c2-8766-b8ca1fc59660 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:39.588962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7252b5-6a1a-477e-8010-e96df11f18bc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:39.595148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883f7b0-fcd1-47cc-becf-3d92e484eeb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:39.595982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb03fbb-d9a1-4c1c-bb5e-2ebdd154496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:39.596349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883f7b0-fcd1-47cc-becf-3d92e484eeb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:39.596776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb03fbb-d9a1-4c1c-bb5e-2ebdd154496f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:39.597023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883f7b0-fcd1-47cc-becf-3d92e484eeb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:39.597189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb03fbb-d9a1-4c1c-bb5e-2ebdd154496f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:39.597296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883f7b0-fcd1-47cc-becf-3d92e484eeb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:39.597548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb03fbb-d9a1-4c1c-bb5e-2ebdd154496f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:39.599227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7883f7b0-fcd1-47cc-becf-3d92e484eeb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:39.600534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb03fbb-d9a1-4c1c-bb5e-2ebdd154496f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:39.602218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb03fbb-d9a1-4c1c-bb5e-2ebdd154496f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:39.626115 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:39.636368 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4114/8170] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:40:39.641005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb03fbb-d9a1-4c1c-bb5e-2ebdd154496f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:39.661268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb03fbb-d9a1-4c1c-bb5e-2ebdd154496f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:39.674156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c22309-57fe-4cd9-b88b-fdf29c47d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:39.674962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c22309-57fe-4cd9-b88b-fdf29c47d7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:39.675348 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c22309-57fe-4cd9-b88b-fdf29c47d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:39.675725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c22309-57fe-4cd9-b88b-fdf29c47d7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:39.676467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c22309-57fe-4cd9-b88b-fdf29c47d7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:39.678402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c22309-57fe-4cd9-b88b-fdf29c47d7b5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:39.712654 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4115/8171] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:40:39.714228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c22309-57fe-4cd9-b88b-fdf29c47d7b5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:39.761407 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:39.773002 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883f7b0-fcd1-47cc-becf-3d92e484eeb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:39.776875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c22309-57fe-4cd9-b88b-fdf29c47d7b5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:39.781509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883f7b0-fcd1-47cc-becf-3d92e484eeb0 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:39.818367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eedf3-681f-4f97-84f1-68cc37a48c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:39.819448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eedf3-681f-4f97-84f1-68cc37a48c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:39.819907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eedf3-681f-4f97-84f1-68cc37a48c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:39.821316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eedf3-681f-4f97-84f1-68cc37a48c5b admin admin] PATH_INFO: `/v3/projects/3518811c0afc460c89d2395305e3406d/users/b3259993d72c41bf8d8f214ffeb79682/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:39.823922 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4057/8172] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:39.866318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9eedf3-681f-4f97-84f1-68cc37a48c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3518811c0afc460c89d2395305e3406d, user_id=b3259993d72c41bf8d8f214ffeb79682, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:39.869471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9eedf3-681f-4f97-84f1-68cc37a48c5b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:39.901311 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4116/8173] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:39 2022] PUT /identity/v3/projects/3518811c0afc460c89d2395305e3406d/users/b3259993d72c41bf8d8f214ffeb79682/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:39.912093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b818375-dd52-4578-af0b-dac57ed22eea None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:39.912402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b818375-dd52-4578-af0b-dac57ed22eea None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:39.913227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b818375-dd52-4578-af0b-dac57ed22eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:40.015131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5b818375-dd52-4578-af0b-dac57ed22eea None None] MFA Rules not processed for user `b3259993d72c41bf8d8f214ffeb79682`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:40.016385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5b818375-dd52-4578-af0b-dac57ed22eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:40.153461 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4058/8174] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:40.173061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eedf3-681f-4f97-84f1-68cc37a48c5b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:40.288643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eedf3-681f-4f97-84f1-68cc37a48c5b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:40.293912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb6907-e58e-4e73-8dc3-425922a74500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:40.294992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb6907-e58e-4e73-8dc3-425922a74500 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:40.295448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb6907-e58e-4e73-8dc3-425922a74500 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:40.295824 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb6907-e58e-4e73-8dc3-425922a74500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:40.318649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb6907-e58e-4e73-8dc3-425922a74500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:40.320321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb6907-e58e-4e73-8dc3-425922a74500 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:40.333266 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4117/8175] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:50.146059 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=55 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:50.328141 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:51.211213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b818375-dd52-4578-af0b-dac57ed22eea None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:51.212885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5b818375-dd52-4578-af0b-dac57ed22eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:51.308551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb6907-e58e-4e73-8dc3-425922a74500 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:51.354781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b818375-dd52-4578-af0b-dac57ed22eea None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:51.363565 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2874c-1489-4c62-a16a-7336b3e08861 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:51.364936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2874c-1489-4c62-a16a-7336b3e08861 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:51.365455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2874c-1489-4c62-a16a-7336b3e08861 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:51.366824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2874c-1489-4c62-a16a-7336b3e08861 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:51.368926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c1a2874c-1489-4c62-a16a-7336b3e08861 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:51.391201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2874c-1489-4c62-a16a-7336b3e08861 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:51.393964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2874c-1489-4c62-a16a-7336b3e08861 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:51.437410 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4059/8176] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:51.500956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb6907-e58e-4e73-8dc3-425922a74500 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:51.507437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:51.508089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:51.508367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:51.508639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] PATH_INFO: `/v3/users/b3259993d72c41bf8d8f214ffeb79682` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:51.509788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3259993d72c41bf8d8f214ffeb79682)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:51.512573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:51.612412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3259993d72c41bf8d8f214ffeb79682'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:51.614176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3259993d72c41bf8d8f214ffeb79682'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:51.641096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3259993d72c41bf8d8f214ffeb79682'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:51.664273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3259993d72c41bf8d8f214ffeb79682'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:51.665735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3259993d72c41bf8d8f214ffeb79682'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:51.748161 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4118/8177] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:40:51 2022] DELETE /identity/v3/users/b3259993d72c41bf8d8f214ffeb79682 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:40:51.752523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d5676-4e60-4fab-a5bf-f748d8644ca9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:51.754637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d5676-4e60-4fab-a5bf-f748d8644ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:51.755010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d5676-4e60-4fab-a5bf-f748d8644ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:51.822488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-746d5676-4e60-4fab-a5bf-f748d8644ca9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:51.824144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-746d5676-4e60-4fab-a5bf-f748d8644ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:51.979762 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4060/8178] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:52.003006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:52.005206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:52.128805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a4a2-b283-4398-8a9c-6ecee0323e07 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:52.141858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54533c67-cfc4-4f6a-9e45-e42b45f70283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:52.141858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54533c67-cfc4-4f6a-9e45-e42b45f70283 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:52.144696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54533c67-cfc4-4f6a-9e45-e42b45f70283 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:52.144696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54533c67-cfc4-4f6a-9e45-e42b45f70283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:52.179579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54533c67-cfc4-4f6a-9e45-e42b45f70283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:52.181703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54533c67-cfc4-4f6a-9e45-e42b45f70283 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:52.193443 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4119/8179] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:52.571069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d5676-4e60-4fab-a5bf-f748d8644ca9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:52.573694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-746d5676-4e60-4fab-a5bf-f748d8644ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:52.599774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d5676-4e60-4fab-a5bf-f748d8644ca9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:52.609036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a303d8-66f5-4daf-b55e-7cdf6064e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:52.609762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a303d8-66f5-4daf-b55e-7cdf6064e073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:52.610155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a303d8-66f5-4daf-b55e-7cdf6064e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:52.610758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a303d8-66f5-4daf-b55e-7cdf6064e073 admin admin] PATH_INFO: `/v3/projects/3518811c0afc460c89d2395305e3406d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:52.612011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a303d8-66f5-4daf-b55e-7cdf6064e073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3518811c0afc460c89d2395305e3406d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:52.614858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a303d8-66f5-4daf-b55e-7cdf6064e073 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:52.679381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8a303d8-66f5-4daf-b55e-7cdf6064e073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3518811c0afc460c89d2395305e3406d', 'request_id': 'req-d8a303d8-66f5-4daf-b55e-7cdf6064e073'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:52.687798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8a303d8-66f5-4daf-b55e-7cdf6064e073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3518811c0afc460c89d2395305e3406d', 'request_id': 'req-d8a303d8-66f5-4daf-b55e-7cdf6064e073'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:52.701122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8a303d8-66f5-4daf-b55e-7cdf6064e073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3518811c0afc460c89d2395305e3406d', 'request_id': 'req-d8a303d8-66f5-4daf-b55e-7cdf6064e073'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:52.715422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8a303d8-66f5-4daf-b55e-7cdf6064e073 admin admin] The token cache is being invalidate because project 3518811c0afc460c89d2395305e3406d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:52.715735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8a303d8-66f5-4daf-b55e-7cdf6064e073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:52.716792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d8a303d8-66f5-4daf-b55e-7cdf6064e073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:52.722034 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4061/8180] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:52 2022] DELETE /identity/v3/projects/3518811c0afc460c89d2395305e3406d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:52.723819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4384-dcc9-4a64-bb22-f7ae0006c73f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:52.724293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4384-dcc9-4a64-bb22-f7ae0006c73f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:52.724643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4384-dcc9-4a64-bb22-f7ae0006c73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:52.756876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-595a4384-dcc9-4a64-bb22-f7ae0006c73f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:52.758403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-595a4384-dcc9-4a64-bb22-f7ae0006c73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:52.778012 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:52.838372 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4120/8181] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:52.848364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c277a-9a31-4b60-af93-25b971720539 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:52.848645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c277a-9a31-4b60-af93-25b971720539 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:52.848920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c277a-9a31-4b60-af93-25b971720539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:52.875555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ab7c277a-9a31-4b60-af93-25b971720539 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:52.876766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ab7c277a-9a31-4b60-af93-25b971720539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:52.884951 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4062/8182] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:52.889300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a4384-dcc9-4a64-bb22-f7ae0006c73f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:52.900386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a4384-dcc9-4a64-bb22-f7ae0006c73f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:52.905584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb81c15-ef4c-423f-a342-8accfef33c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:52.906235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb81c15-ef4c-423f-a342-8accfef33c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:52.906662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb81c15-ef4c-423f-a342-8accfef33c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:52.906782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb81c15-ef4c-423f-a342-8accfef33c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:52.907577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb81c15-ef4c-423f-a342-8accfef33c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:40:52.907998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb81c15-ef4c-423f-a342-8accfef33c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:52.909750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb81c15-ef4c-423f-a342-8accfef33c8f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:52.928065 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4121/8183] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:40:52.932227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c277a-9a31-4b60-af93-25b971720539 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:52.942503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c277a-9a31-4b60-af93-25b971720539 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:52.947457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7b176-ca57-4242-b935-3b5c24b48baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:52.947920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7b176-ca57-4242-b935-3b5c24b48baf admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:52.948204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7b176-ca57-4242-b935-3b5c24b48baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:52.948487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7b176-ca57-4242-b935-3b5c24b48baf admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:52.949600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7b176-ca57-4242-b935-3b5c24b48baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:52.951358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7b176-ca57-4242-b935-3b5c24b48baf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:52.956194 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:52.987018 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4063/8184] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:52 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:52.988252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb81c15-ef4c-423f-a342-8accfef33c8f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:53.000403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb81c15-ef4c-423f-a342-8accfef33c8f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:53.075492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19157efc-815c-4a7e-b66b-a85a2bfa032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:53.076115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157efc-815c-4a7e-b66b-a85a2bfa032a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:53.076395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157efc-815c-4a7e-b66b-a85a2bfa032a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:53.076788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157efc-815c-4a7e-b66b-a85a2bfa032a admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:53.077432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19157efc-815c-4a7e-b66b-a85a2bfa032a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:53.079439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19157efc-815c-4a7e-b66b-a85a2bfa032a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:53.101366 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4122/8185] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:40:52 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:53.106251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7b176-ca57-4242-b935-3b5c24b48baf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:53.117240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7b176-ca57-4242-b935-3b5c24b48baf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:53.123793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365c223-bc27-4ab0-9cfd-f72dfead1c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:53.124425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365c223-bc27-4ab0-9cfd-f72dfead1c0d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:53.124702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365c223-bc27-4ab0-9cfd-f72dfead1c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:53.124972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365c223-bc27-4ab0-9cfd-f72dfead1c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:53.126623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365c223-bc27-4ab0-9cfd-f72dfead1c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:53.127746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365c223-bc27-4ab0-9cfd-f72dfead1c0d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:53.142093 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4064/8186] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:53.155756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19157efc-815c-4a7e-b66b-a85a2bfa032a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:53.170295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19157efc-815c-4a7e-b66b-a85a2bfa032a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:53.175698 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b644c7f-e77a-4698-ba9a-23af3b3b2bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:53.176938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b644c7f-e77a-4698-ba9a-23af3b3b2bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:53.176938 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b644c7f-e77a-4698-ba9a-23af3b3b2bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:53.177130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b644c7f-e77a-4698-ba9a-23af3b3b2bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:53.177704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b644c7f-e77a-4698-ba9a-23af3b3b2bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:53.179356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b644c7f-e77a-4698-ba9a-23af3b3b2bb6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:53.192911 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4123/8187] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:53.197217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365c223-bc27-4ab0-9cfd-f72dfead1c0d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:53.208477 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365c223-bc27-4ab0-9cfd-f72dfead1c0d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:53.213454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529a9e4-745f-4351-bda5-8f7b935fb973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:53.214130 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529a9e4-745f-4351-bda5-8f7b935fb973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:53.214413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529a9e4-745f-4351-bda5-8f7b935fb973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:53.214690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529a9e4-745f-4351-bda5-8f7b935fb973 admin admin] PATH_INFO: `/v3/projects/c95efcb65f814331987ec1156c16c21d/users/937e0e9e6772462d90708a7225e04f00/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:53.233794 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529a9e4-745f-4351-bda5-8f7b935fb973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95efcb65f814331987ec1156c16c21d, user_id=937e0e9e6772462d90708a7225e04f00, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:53.236895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529a9e4-745f-4351-bda5-8f7b935fb973 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:53.265194 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4065/8188] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:53 2022] PUT /identity/v3/projects/c95efcb65f814331987ec1156c16c21d/users/937e0e9e6772462d90708a7225e04f00/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:53.266569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d99a9-4028-465f-8531-2480b17b8d52 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:53.266865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d99a9-4028-465f-8531-2480b17b8d52 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:53.267234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d99a9-4028-465f-8531-2480b17b8d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:53.303943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ca3d99a9-4028-465f-8531-2480b17b8d52 None None] MFA Rules not processed for user `937e0e9e6772462d90708a7225e04f00`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:53.305247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ca3d99a9-4028-465f-8531-2480b17b8d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:53.395025 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4124/8189] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:40:53.409645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529a9e4-745f-4351-bda5-8f7b935fb973 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:53.411633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3529a9e4-745f-4351-bda5-8f7b935fb973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:53.533161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529a9e4-745f-4351-bda5-8f7b935fb973 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:53.537113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875bf2c-ac1b-419f-9c8e-1f4dc57cd129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:53.537722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875bf2c-ac1b-419f-9c8e-1f4dc57cd129 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:53.537996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875bf2c-ac1b-419f-9c8e-1f4dc57cd129 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:53.538265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875bf2c-ac1b-419f-9c8e-1f4dc57cd129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:53.558974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875bf2c-ac1b-419f-9c8e-1f4dc57cd129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:53.558974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875bf2c-ac1b-419f-9c8e-1f4dc57cd129 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:53.565893 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4066/8190] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:53.991072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d99a9-4028-465f-8531-2480b17b8d52 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:54.015689 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:54.073584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d99a9-4028-465f-8531-2480b17b8d52 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:54.079345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:54.080061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:54.080281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:54.080557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] PATH_INFO: `/v3/users/937e0e9e6772462d90708a7225e04f00` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:54.081771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] RBAC: Authorizing `identity:delete_user(user_id=937e0e9e6772462d90708a7225e04f00)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:54.083731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:54.135570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937e0e9e6772462d90708a7225e04f00'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:54.136267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937e0e9e6772462d90708a7225e04f00'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:54.152924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937e0e9e6772462d90708a7225e04f00'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:54.164212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937e0e9e6772462d90708a7225e04f00'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:54.165558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937e0e9e6772462d90708a7225e04f00'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:54.181551 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4125/8191] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:40:53 2022] DELETE /identity/v3/users/937e0e9e6772462d90708a7225e04f00 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:54.187351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f8692-291a-4e3d-8ba0-39f1ebf55f2c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:54.187799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f8692-291a-4e3d-8ba0-39f1ebf55f2c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:54.187998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f8692-291a-4e3d-8ba0-39f1ebf55f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:54.236793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-174f8692-291a-4e3d-8ba0-39f1ebf55f2c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:54.238197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-174f8692-291a-4e3d-8ba0-39f1ebf55f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:54.316487 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4067/8192] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:54.328356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:54.330068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:54.435784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f0ccb-5f63-4aa7-b5a5-8c59b734732c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:54.440906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f87227-6ee2-4216-83a0-fa97dd06d017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:54.441622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f87227-6ee2-4216-83a0-fa97dd06d017 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:54.441946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f87227-6ee2-4216-83a0-fa97dd06d017 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:54.442246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f87227-6ee2-4216-83a0-fa97dd06d017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:54.454478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f87227-6ee2-4216-83a0-fa97dd06d017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:54.456058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f87227-6ee2-4216-83a0-fa97dd06d017 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:54.469036 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4126/8193] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:54.967861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f8692-291a-4e3d-8ba0-39f1ebf55f2c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:54.969348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-174f8692-291a-4e3d-8ba0-39f1ebf55f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:54.992600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f8692-291a-4e3d-8ba0-39f1ebf55f2c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:54.999501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a74291-93d2-4010-8d84-21514bec4d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:55.000576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74291-93d2-4010-8d84-21514bec4d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:55.001082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74291-93d2-4010-8d84-21514bec4d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:55.001700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74291-93d2-4010-8d84-21514bec4d24 admin admin] PATH_INFO: `/v3/projects/c95efcb65f814331987ec1156c16c21d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:55.003206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a74291-93d2-4010-8d84-21514bec4d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95efcb65f814331987ec1156c16c21d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:55.005663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a74291-93d2-4010-8d84-21514bec4d24 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:55.076223 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:55.096402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68a74291-93d2-4010-8d84-21514bec4d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95efcb65f814331987ec1156c16c21d', 'request_id': 'req-68a74291-93d2-4010-8d84-21514bec4d24'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:55.109103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68a74291-93d2-4010-8d84-21514bec4d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95efcb65f814331987ec1156c16c21d', 'request_id': 'req-68a74291-93d2-4010-8d84-21514bec4d24'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:55.125887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68a74291-93d2-4010-8d84-21514bec4d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95efcb65f814331987ec1156c16c21d', 'request_id': 'req-68a74291-93d2-4010-8d84-21514bec4d24'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:55.142739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68a74291-93d2-4010-8d84-21514bec4d24 admin admin] The token cache is being invalidate because project c95efcb65f814331987ec1156c16c21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:40:55.144275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68a74291-93d2-4010-8d84-21514bec4d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:55.145637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68a74291-93d2-4010-8d84-21514bec4d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:40:55.148223 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4068/8194] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:40:54 2022] DELETE /identity/v3/projects/c95efcb65f814331987ec1156c16c21d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:55.154349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b48f87-cca3-4589-b5d2-baa92bf2e79b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:55.154827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b48f87-cca3-4589-b5d2-baa92bf2e79b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:55.154963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b48f87-cca3-4589-b5d2-baa92bf2e79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:55.189405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-61b48f87-cca3-4589-b5d2-baa92bf2e79b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:55.190737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-61b48f87-cca3-4589-b5d2-baa92bf2e79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:55.230210 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:55.279333 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4127/8195] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:55.287276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e02962-a2de-4676-aaed-e8e805861689 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:55.287818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e02962-a2de-4676-aaed-e8e805861689 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:55.288242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e02962-a2de-4676-aaed-e8e805861689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:55.311691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-63e02962-a2de-4676-aaed-e8e805861689 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:55.312942 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-63e02962-a2de-4676-aaed-e8e805861689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:55.323167 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4069/8196] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:55.328190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b48f87-cca3-4589-b5d2-baa92bf2e79b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:55.338532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b48f87-cca3-4589-b5d2-baa92bf2e79b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:55.344188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63381c-7c99-4b45-87fe-ce4ff664dc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:55.344871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63381c-7c99-4b45-87fe-ce4ff664dc2f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:55.345701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63381c-7c99-4b45-87fe-ce4ff664dc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:55.345701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63381c-7c99-4b45-87fe-ce4ff664dc2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:55.346048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63381c-7c99-4b45-87fe-ce4ff664dc2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:40:55.346866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63381c-7c99-4b45-87fe-ce4ff664dc2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:55.347951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63381c-7c99-4b45-87fe-ce4ff664dc2f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:55.360478 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4128/8197] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:40:55.365109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e02962-a2de-4676-aaed-e8e805861689 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:55.376146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e02962-a2de-4676-aaed-e8e805861689 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:55.381201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d592d1-f07d-4c1a-8186-464e8c0d07db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:55.381828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d592d1-f07d-4c1a-8186-464e8c0d07db admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:55.382109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d592d1-f07d-4c1a-8186-464e8c0d07db admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:55.382382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d592d1-f07d-4c1a-8186-464e8c0d07db admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:55.383089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d592d1-f07d-4c1a-8186-464e8c0d07db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:55.385069 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d592d1-f07d-4c1a-8186-464e8c0d07db admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:55.421217 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4070/8198] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:40:55 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:40:55.425518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63381c-7c99-4b45-87fe-ce4ff664dc2f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:55.450401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63381c-7c99-4b45-87fe-ce4ff664dc2f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:55.530452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20295d28-94de-4453-a0ba-ea31ba78cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:55.531091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20295d28-94de-4453-a0ba-ea31ba78cc6f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:55.531532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20295d28-94de-4453-a0ba-ea31ba78cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:55.531812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20295d28-94de-4453-a0ba-ea31ba78cc6f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:55.532504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20295d28-94de-4453-a0ba-ea31ba78cc6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:55.534587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20295d28-94de-4453-a0ba-ea31ba78cc6f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:55.578998 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4129/8199] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:40:55 2022] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:40:55.583209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d592d1-f07d-4c1a-8186-464e8c0d07db admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:55.599903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d592d1-f07d-4c1a-8186-464e8c0d07db admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:55.608217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced63fa4-76a1-4c42-a61c-5b32bae6c8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:55.608914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63fa4-76a1-4c42-a61c-5b32bae6c8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:55.609194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63fa4-76a1-4c42-a61c-5b32bae6c8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:55.609517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63fa4-76a1-4c42-a61c-5b32bae6c8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:55.610095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced63fa4-76a1-4c42-a61c-5b32bae6c8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:55.611772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced63fa4-76a1-4c42-a61c-5b32bae6c8e3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:55.627261 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4071/8200] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:40:55.632011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20295d28-94de-4453-a0ba-ea31ba78cc6f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:55.659090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20295d28-94de-4453-a0ba-ea31ba78cc6f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:55.664562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3f5e9-ee7c-44be-b5d7-a83cc3053895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:55.665249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3f5e9-ee7c-44be-b5d7-a83cc3053895 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:55.665595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3f5e9-ee7c-44be-b5d7-a83cc3053895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:55.665934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3f5e9-ee7c-44be-b5d7-a83cc3053895 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:55.666982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3f5e9-ee7c-44be-b5d7-a83cc3053895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:55.673028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3f5e9-ee7c-44be-b5d7-a83cc3053895 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:55.688053 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4130/8201] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:40:55.692388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced63fa4-76a1-4c42-a61c-5b32bae6c8e3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:55.707677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced63fa4-76a1-4c42-a61c-5b32bae6c8e3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:55.713373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb68de-dcfb-4df9-a87b-268f9feb686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:55.714261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb68de-dcfb-4df9-a87b-268f9feb686c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:55.714839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb68de-dcfb-4df9-a87b-268f9feb686c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:55.715519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb68de-dcfb-4df9-a87b-268f9feb686c admin admin] PATH_INFO: `/v3/projects/27cd8cdf358a4a429fb75f525f799fb3/users/a8a04761e0fa48b9a48e64b6fd672657/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:55.740047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb68de-dcfb-4df9-a87b-268f9feb686c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cd8cdf358a4a429fb75f525f799fb3, user_id=a8a04761e0fa48b9a48e64b6fd672657, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:55.743293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb68de-dcfb-4df9-a87b-268f9feb686c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:55.792226 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4072/8202] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:40:55 2022] PUT /identity/v3/projects/27cd8cdf358a4a429fb75f525f799fb3/users/a8a04761e0fa48b9a48e64b6fd672657/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:40:55.802669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b53aa3-0c3e-44c7-9b5d-c2d96639381f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:55.803041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b53aa3-0c3e-44c7-9b5d-c2d96639381f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:55.803388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b53aa3-0c3e-44c7-9b5d-c2d96639381f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:55.863991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-05b53aa3-0c3e-44c7-9b5d-c2d96639381f None None] MFA Rules not processed for user `a8a04761e0fa48b9a48e64b6fd672657`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:40:55.865305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05b53aa3-0c3e-44c7-9b5d-c2d96639381f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:55.988718 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4131/8203] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:40:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:40:55.993790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb68de-dcfb-4df9-a87b-268f9feb686c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:55.995567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2ebb68de-dcfb-4df9-a87b-268f9feb686c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:56.088772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb68de-dcfb-4df9-a87b-268f9feb686c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:56.094035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e675a5-498e-42ef-85d4-980a4386192d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:56.094683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e675a5-498e-42ef-85d4-980a4386192d service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:56.095085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e675a5-498e-42ef-85d4-980a4386192d service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:56.095330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e675a5-498e-42ef-85d4-980a4386192d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:56.107065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e675a5-498e-42ef-85d4-980a4386192d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:56.108482 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e675a5-498e-42ef-85d4-980a4386192d service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:56.119489 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4073/8204] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:40:56.474616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b53aa3-0c3e-44c7-9b5d-c2d96639381f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:40:56.476138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05b53aa3-0c3e-44c7-9b5d-c2d96639381f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:56.506043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b53aa3-0c3e-44c7-9b5d-c2d96639381f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:40:56.515675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df6173-1350-4ba7-80d7-b1d98a667642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:40:56.516307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df6173-1350-4ba7-80d7-b1d98a667642 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:40:56.516589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df6173-1350-4ba7-80d7-b1d98a667642 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:40:56.516856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df6173-1350-4ba7-80d7-b1d98a667642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:40:56.525106 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-01df6173-1350-4ba7-80d7-b1d98a667642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:40:56.602260 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:56.640333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df6173-1350-4ba7-80d7-b1d98a667642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:40:56.641702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df6173-1350-4ba7-80d7-b1d98a667642 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:40:56.653524 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4132/8205] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:40:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:41:00.966806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e675a5-498e-42ef-85d4-980a4386192d service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:41:00.968746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a7e675a5-498e-42ef-85d4-980a4386192d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:01.247822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e675a5-498e-42ef-85d4-980a4386192d service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:41:01.273273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2da8c8-e2cc-4d28-911d-7e6e308edff4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:41:01.274182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2da8c8-e2cc-4d28-911d-7e6e308edff4 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:41:01.274960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2da8c8-e2cc-4d28-911d-7e6e308edff4 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:41:01.276259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2da8c8-e2cc-4d28-911d-7e6e308edff4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:41:01.281970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-db2da8c8-e2cc-4d28-911d-7e6e308edff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:01.306104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2da8c8-e2cc-4d28-911d-7e6e308edff4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:41:01.309335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2da8c8-e2cc-4d28-911d-7e6e308edff4 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:41:01.326291 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4074/8206] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:41:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:41:06.648519 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=14 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:07.925091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df6173-1350-4ba7-80d7-b1d98a667642 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:41:07.945149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df6173-1350-4ba7-80d7-b1d98a667642 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:41:07.956369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfc845-a237-4d11-acaf-3869871be7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:41:07.957084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfc845-a237-4d11-acaf-3869871be7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:41:07.957367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfc845-a237-4d11-acaf-3869871be7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:41:07.957643 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfc845-a237-4d11-acaf-3869871be7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:41:07.959447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-52bfc845-a237-4d11-acaf-3869871be7a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:08.045577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfc845-a237-4d11-acaf-3869871be7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:41:08.047856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfc845-a237-4d11-acaf-3869871be7a1 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:41:08.063282 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4133/8207] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:41:09.348022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2da8c8-e2cc-4d28-911d-7e6e308edff4 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:41:09.350268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-db2da8c8-e2cc-4d28-911d-7e6e308edff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:09.358474 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:09.413332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfc845-a237-4d11-acaf-3869871be7a1 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:41:09.416270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-52bfc845-a237-4d11-acaf-3869871be7a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:09.445970 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfc845-a237-4d11-acaf-3869871be7a1 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:41:09.457813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:41:09.460792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:41:09.462079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:41:09.462599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] PATH_INFO: `/v3/users/4bdb352285134f4b93ab4879db31c8c1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:41:09.471493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bdb352285134f4b93ab4879db31c8c1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:41:09.480122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:41:09.581555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2da8c8-e2cc-4d28-911d-7e6e308edff4 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:41:09.594433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f347989-7839-40a0-891e-09ed6c6e7da5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:41:09.600503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f347989-7839-40a0-891e-09ed6c6e7da5 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:41:09.601458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f347989-7839-40a0-891e-09ed6c6e7da5 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:41:09.601753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f347989-7839-40a0-891e-09ed6c6e7da5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:41:09.607543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5f347989-7839-40a0-891e-09ed6c6e7da5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:09.618078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bdb352285134f4b93ab4879db31c8c1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:41:09.622801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bdb352285134f4b93ab4879db31c8c1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:41:09.663282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bdb352285134f4b93ab4879db31c8c1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:41:09.675915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bdb352285134f4b93ab4879db31c8c1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:41:09.679395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bdb352285134f4b93ab4879db31c8c1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:41:09.699850 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4134/8208] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:41:09 2022] DELETE /identity/v3/users/4bdb352285134f4b93ab4879db31c8c1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:41:09.735959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f347989-7839-40a0-891e-09ed6c6e7da5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:41:09.739932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f347989-7839-40a0-891e-09ed6c6e7da5 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:41:09.760394 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4075/8209] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:41:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:41:10.298741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:41:10.300266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:10.485427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd3eab-4d2e-4ae6-b551-73a87ff35554 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:41:10.494514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:41:10.495401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:41:10.495765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:41:10.496476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] PATH_INFO: `/v3/projects/18778c9e91d14fed9e49afc254aa81fd` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:41:10.497584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18778c9e91d14fed9e49afc254aa81fd)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:41:10.500070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:41:10.520064 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:10.619158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18778c9e91d14fed9e49afc254aa81fd', 'request_id': 'req-9a1d4c03-7b52-477c-8dac-a881c7899ab6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:41:10.643356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18778c9e91d14fed9e49afc254aa81fd', 'request_id': 'req-9a1d4c03-7b52-477c-8dac-a881c7899ab6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:41:10.663414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18778c9e91d14fed9e49afc254aa81fd', 'request_id': 'req-9a1d4c03-7b52-477c-8dac-a881c7899ab6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:41:10.679200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] The token cache is being invalidate because project 18778c9e91d14fed9e49afc254aa81fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:41:10.679733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:41:10.682240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:41:10.692370 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4135/8210] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:41:10 2022] DELETE /identity/v3/projects/18778c9e91d14fed9e49afc254aa81fd => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:41:16.210520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f347989-7839-40a0-891e-09ed6c6e7da5 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:41:16.231915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f347989-7839-40a0-891e-09ed6c6e7da5 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:41:16.335373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e7e6e-868f-4c36-bbb2-ced37e2e265c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:41:16.336046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e7e6e-868f-4c36-bbb2-ced37e2e265c service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:41:16.336335 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e7e6e-868f-4c36-bbb2-ced37e2e265c service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:41:16.336613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e7e6e-868f-4c36-bbb2-ced37e2e265c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:41:16.338720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f07e7e6e-868f-4c36-bbb2-ced37e2e265c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:16.361189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e7e6e-868f-4c36-bbb2-ced37e2e265c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:41:16.363058 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e7e6e-868f-4c36-bbb2-ced37e2e265c service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:41:16.381168 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4076/8211] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:41:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:41:16.596477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:41:16.598200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:16.710344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d4c03-7b52-477c-8dac-a881c7899ab6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:41:16.716918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1db097-91af-40b5-9380-309de898605f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:41:16.718780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1db097-91af-40b5-9380-309de898605f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:41:16.719098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1db097-91af-40b5-9380-309de898605f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:41:16.719371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1db097-91af-40b5-9380-309de898605f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:41:16.721191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0f1db097-91af-40b5-9380-309de898605f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:16.738704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1db097-91af-40b5-9380-309de898605f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:41:16.740315 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1db097-91af-40b5-9380-309de898605f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:41:16.754129 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4136/8212] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:41:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:41:16.900320 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e7e6e-868f-4c36-bbb2-ced37e2e265c service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:41:16.901755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f07e7e6e-868f-4c36-bbb2-ced37e2e265c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:16.923581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e7e6e-868f-4c36-bbb2-ced37e2e265c service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:41:16.929392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39fe5f-44ae-410a-8668-d9b9ccc9ed9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:41:16.930018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39fe5f-44ae-410a-8668-d9b9ccc9ed9a service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:41:16.932785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39fe5f-44ae-410a-8668-d9b9ccc9ed9a service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:41:16.933124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39fe5f-44ae-410a-8668-d9b9ccc9ed9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:41:16.936090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2d39fe5f-44ae-410a-8668-d9b9ccc9ed9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:16.954420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39fe5f-44ae-410a-8668-d9b9ccc9ed9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:41:16.956345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39fe5f-44ae-410a-8668-d9b9ccc9ed9a service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:41:16.978565 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4077/8213] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:41:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:41:17.245532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1db097-91af-40b5-9380-309de898605f service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:41:17.262980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1db097-91af-40b5-9380-309de898605f service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:41:17.267876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6f47b-856c-4e50-ae13-f7a4a09b4598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:41:17.268909 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6f47b-856c-4e50-ae13-f7a4a09b4598 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:41:17.269305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6f47b-856c-4e50-ae13-f7a4a09b4598 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:41:17.269771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6f47b-856c-4e50-ae13-f7a4a09b4598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:41:17.273138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79d6f47b-856c-4e50-ae13-f7a4a09b4598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:17.430130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6f47b-856c-4e50-ae13-f7a4a09b4598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:41:17.431920 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6f47b-856c-4e50-ae13-f7a4a09b4598 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:41:17.465826 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4137/8214] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:41:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:41:26.967022 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:27.440688 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:30.110523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39fe5f-44ae-410a-8668-d9b9ccc9ed9a service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:41:30.117338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2d39fe5f-44ae-410a-8668-d9b9ccc9ed9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:30.154251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39fe5f-44ae-410a-8668-d9b9ccc9ed9a service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:41:30.163768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0333-f209-4031-a563-7f40f899f18e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:41:30.164752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0333-f209-4031-a563-7f40f899f18e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:41:30.166425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0333-f209-4031-a563-7f40f899f18e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:41:30.166861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0333-f209-4031-a563-7f40f899f18e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:41:30.170889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8a9e0333-f209-4031-a563-7f40f899f18e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:30.223611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e0333-f209-4031-a563-7f40f899f18e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:41:30.225609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e0333-f209-4031-a563-7f40f899f18e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:41:30.267305 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4078/8215] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:41:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:41:32.304677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c44db8-513b-4a11-bfc0-0bb59c022e0c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:41:32.305227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c44db8-513b-4a11-bfc0-0bb59c022e0c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:41:32.305227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c44db8-513b-4a11-bfc0-0bb59c022e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:41:32.337791 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-11c44db8-513b-4a11-bfc0-0bb59c022e0c None None] MFA Rules not processed for user `2eabe99e40ef44a09c3f7dc1c78d7608`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:41:32.341979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-11c44db8-513b-4a11-bfc0-0bb59c022e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:32.433218 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4138/8216] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:41:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:41:40.266872 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:42.425359 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=25 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:48.248579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0333-f209-4031-a563-7f40f899f18e service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:41:48.251178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8a9e0333-f209-4031-a563-7f40f899f18e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:48.279923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0333-f209-4031-a563-7f40f899f18e service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:41:48.286530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441a050-6d6d-44d3-b3ca-1a7d256143e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:41:48.287255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441a050-6d6d-44d3-b3ca-1a7d256143e6 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:41:48.287895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441a050-6d6d-44d3-b3ca-1a7d256143e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:41:48.288484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441a050-6d6d-44d3-b3ca-1a7d256143e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:41:48.294883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d441a050-6d6d-44d3-b3ca-1a7d256143e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:41:48.319811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441a050-6d6d-44d3-b3ca-1a7d256143e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:41:48.321522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441a050-6d6d-44d3-b3ca-1a7d256143e6 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:41:48.352830 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4079/8217] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:41:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:41:58.330050 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:02.692536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c44db8-513b-4a11-bfc0-0bb59c022e0c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:02.694211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-11c44db8-513b-4a11-bfc0-0bb59c022e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:02.768174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c44db8-513b-4a11-bfc0-0bb59c022e0c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:02.772792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:02.773435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:02.773718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:02.773992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] PATH_INFO: `/v3/users/a8a04761e0fa48b9a48e64b6fd672657` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:02.775307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a04761e0fa48b9a48e64b6fd672657)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:02.777344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:02.842877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a04761e0fa48b9a48e64b6fd672657'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:02.844255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a04761e0fa48b9a48e64b6fd672657'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:02.858624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a04761e0fa48b9a48e64b6fd672657'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:02.876030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a04761e0fa48b9a48e64b6fd672657'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:02.876759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a04761e0fa48b9a48e64b6fd672657'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:02.899073 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4139/8218] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:42:02 2022] DELETE /identity/v3/users/a8a04761e0fa48b9a48e64b6fd672657 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:02.904407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d8a91-f684-4b5f-a41d-003ee8767cee None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:02.905457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d8a91-f684-4b5f-a41d-003ee8767cee None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:02.905885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d8a91-f684-4b5f-a41d-003ee8767cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:02.927801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5f2d8a91-f684-4b5f-a41d-003ee8767cee None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:02.929251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5f2d8a91-f684-4b5f-a41d-003ee8767cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:03.000483 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4080/8219] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:03.010191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:03.011737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:03.073292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d69cdb-ee11-4efb-ad7c-90a29fb75a76 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:03.077850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46651b-ae99-4d24-918d-f0a72c225992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:03.078461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46651b-ae99-4d24-918d-f0a72c225992 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:03.078760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46651b-ae99-4d24-918d-f0a72c225992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:03.079090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46651b-ae99-4d24-918d-f0a72c225992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:03.088800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46651b-ae99-4d24-918d-f0a72c225992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:03.090829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46651b-ae99-4d24-918d-f0a72c225992 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:03.100468 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4140/8220] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:03.281479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d8a91-f684-4b5f-a41d-003ee8767cee None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:03.283039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5f2d8a91-f684-4b5f-a41d-003ee8767cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:03.312958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d8a91-f684-4b5f-a41d-003ee8767cee None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:03.320054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fd97f-924b-433d-9b72-b3687863ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:03.320700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fd97f-924b-433d-9b72-b3687863ac5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:03.321347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fd97f-924b-433d-9b72-b3687863ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:03.321622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fd97f-924b-433d-9b72-b3687863ac5e admin admin] PATH_INFO: `/v3/projects/27cd8cdf358a4a429fb75f525f799fb3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:03.322721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fd97f-924b-433d-9b72-b3687863ac5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=27cd8cdf358a4a429fb75f525f799fb3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:03.325563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fd97f-924b-433d-9b72-b3687863ac5e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:03.375772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e8fd97f-924b-433d-9b72-b3687863ac5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27cd8cdf358a4a429fb75f525f799fb3', 'request_id': 'req-9e8fd97f-924b-433d-9b72-b3687863ac5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:03.382380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e8fd97f-924b-433d-9b72-b3687863ac5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27cd8cdf358a4a429fb75f525f799fb3', 'request_id': 'req-9e8fd97f-924b-433d-9b72-b3687863ac5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:03.391392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e8fd97f-924b-433d-9b72-b3687863ac5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27cd8cdf358a4a429fb75f525f799fb3', 'request_id': 'req-9e8fd97f-924b-433d-9b72-b3687863ac5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:03.403390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e8fd97f-924b-433d-9b72-b3687863ac5e admin admin] The token cache is being invalidate because project 27cd8cdf358a4a429fb75f525f799fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:42:03.403685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e8fd97f-924b-433d-9b72-b3687863ac5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:03.404393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e8fd97f-924b-433d-9b72-b3687863ac5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:03.405954 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4081/8221] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:42:03 2022] DELETE /identity/v3/projects/27cd8cdf358a4a429fb75f525f799fb3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:03.410859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1a8f-8912-45f5-bfe8-f8b6da8b2785 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:03.411285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1a8f-8912-45f5-bfe8-f8b6da8b2785 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:03.411615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1a8f-8912-45f5-bfe8-f8b6da8b2785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:03.432919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-831f1a8f-8912-45f5-bfe8-f8b6da8b2785 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:03.434160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-831f1a8f-8912-45f5-bfe8-f8b6da8b2785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:03.453523 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:03.504271 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4141/8222] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:03.513133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667af1b1-3e69-4524-8d42-b92331cf4653 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:03.513424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667af1b1-3e69-4524-8d42-b92331cf4653 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:03.513698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667af1b1-3e69-4524-8d42-b92331cf4653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:03.534535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-667af1b1-3e69-4524-8d42-b92331cf4653 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:03.535759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-667af1b1-3e69-4524-8d42-b92331cf4653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:03.544116 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4082/8223] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:03.548783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f1a8f-8912-45f5-bfe8-f8b6da8b2785 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:03.564721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f1a8f-8912-45f5-bfe8-f8b6da8b2785 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:03.569593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ffee5-2a01-44ce-809f-d37f859baf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:03.570203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ffee5-2a01-44ce-809f-d37f859baf2c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:03.570597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ffee5-2a01-44ce-809f-d37f859baf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:03.570870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ffee5-2a01-44ce-809f-d37f859baf2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:03.571550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ffee5-2a01-44ce-809f-d37f859baf2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:42:03.571854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ffee5-2a01-44ce-809f-d37f859baf2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:03.573441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ffee5-2a01-44ce-809f-d37f859baf2c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:03.587073 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4142/8224] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:42:03.591847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667af1b1-3e69-4524-8d42-b92331cf4653 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:03.601365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667af1b1-3e69-4524-8d42-b92331cf4653 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:03.607876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e0b19-fc12-4a8b-8576-6fef74a791bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:03.608769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e0b19-fc12-4a8b-8576-6fef74a791bc admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:03.608977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e0b19-fc12-4a8b-8576-6fef74a791bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:03.609229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e0b19-fc12-4a8b-8576-6fef74a791bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:03.609910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e0b19-fc12-4a8b-8576-6fef74a791bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:03.611876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e0b19-fc12-4a8b-8576-6fef74a791bc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:03.647490 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4083/8225] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:42:03 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:42:03.651555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ffee5-2a01-44ce-809f-d37f859baf2c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:03.662202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ffee5-2a01-44ce-809f-d37f859baf2c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:03.723833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837a599-2ae6-4a16-8b17-5598d18ce7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:03.724532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837a599-2ae6-4a16-8b17-5598d18ce7df admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:03.724837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837a599-2ae6-4a16-8b17-5598d18ce7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:03.725184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837a599-2ae6-4a16-8b17-5598d18ce7df admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:03.725880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837a599-2ae6-4a16-8b17-5598d18ce7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:03.728016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837a599-2ae6-4a16-8b17-5598d18ce7df admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:03.755089 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4143/8226] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:42:03 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:42:03.758767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e0b19-fc12-4a8b-8576-6fef74a791bc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:03.770726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e0b19-fc12-4a8b-8576-6fef74a791bc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:03.776528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c59ea-3683-4bf5-b393-11babf72b556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:03.777060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c59ea-3683-4bf5-b393-11babf72b556 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:03.777465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c59ea-3683-4bf5-b393-11babf72b556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:03.777837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c59ea-3683-4bf5-b393-11babf72b556 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:03.778611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c59ea-3683-4bf5-b393-11babf72b556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:03.780341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c59ea-3683-4bf5-b393-11babf72b556 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:03.791827 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4084/8227] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:42:03.795945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837a599-2ae6-4a16-8b17-5598d18ce7df admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:03.806556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837a599-2ae6-4a16-8b17-5598d18ce7df admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:03.812134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784883e0-3984-4eda-87a4-55b16e41f4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:03.812954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784883e0-3984-4eda-87a4-55b16e41f4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:03.813335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784883e0-3984-4eda-87a4-55b16e41f4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:03.813709 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784883e0-3984-4eda-87a4-55b16e41f4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:03.814511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784883e0-3984-4eda-87a4-55b16e41f4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:03.816268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784883e0-3984-4eda-87a4-55b16e41f4b8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:03.829998 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4144/8228] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:42:03.833944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c59ea-3683-4bf5-b393-11babf72b556 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:03.847312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c59ea-3683-4bf5-b393-11babf72b556 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:03.853098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c038e-cc4b-4a25-9f81-ecb6c648f99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:03.853319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c038e-cc4b-4a25-9f81-ecb6c648f99d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:03.853604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c038e-cc4b-4a25-9f81-ecb6c648f99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:03.853876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c038e-cc4b-4a25-9f81-ecb6c648f99d admin admin] PATH_INFO: `/v3/projects/7760732ba988435c947b78615ca05ac6/users/4fbca58715584df2b5e24d6dce93f0a9/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:03.878951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c038e-cc4b-4a25-9f81-ecb6c648f99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7760732ba988435c947b78615ca05ac6, user_id=4fbca58715584df2b5e24d6dce93f0a9, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:03.883337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c038e-cc4b-4a25-9f81-ecb6c648f99d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:03.907010 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4085/8229] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:42:03 2022] PUT /identity/v3/projects/7760732ba988435c947b78615ca05ac6/users/4fbca58715584df2b5e24d6dce93f0a9/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:04.026284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c06c39-fc71-4f4b-9a03-b99ac29668d4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:04.026678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c06c39-fc71-4f4b-9a03-b99ac29668d4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:04.027697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c06c39-fc71-4f4b-9a03-b99ac29668d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:04.066831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-76c06c39-fc71-4f4b-9a03-b99ac29668d4 None None] MFA Rules not processed for user `4fbca58715584df2b5e24d6dce93f0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:04.069681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-76c06c39-fc71-4f4b-9a03-b99ac29668d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:04.159197 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4145/8230] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:04.170285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c038e-cc4b-4a25-9f81-ecb6c648f99d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:04.173034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-634c038e-cc4b-4a25-9f81-ecb6c648f99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:04.199762 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:04.251080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c038e-cc4b-4a25-9f81-ecb6c648f99d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:04.255877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be63e7c-8336-47f8-84a7-eb1dd60dd678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:04.257399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be63e7c-8336-47f8-84a7-eb1dd60dd678 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:04.257399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be63e7c-8336-47f8-84a7-eb1dd60dd678 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:04.257875 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be63e7c-8336-47f8-84a7-eb1dd60dd678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:04.270717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be63e7c-8336-47f8-84a7-eb1dd60dd678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:04.272227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be63e7c-8336-47f8-84a7-eb1dd60dd678 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:04.287385 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4086/8231] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:06.215221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c06c39-fc71-4f4b-9a03-b99ac29668d4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:06.230764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c06c39-fc71-4f4b-9a03-b99ac29668d4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:06.235033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c71f5-0375-4c4a-ae20-8b4145a240f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:06.235914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c71f5-0375-4c4a-ae20-8b4145a240f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:06.236686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c71f5-0375-4c4a-ae20-8b4145a240f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:06.236981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c71f5-0375-4c4a-ae20-8b4145a240f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:06.239652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f83c71f5-0375-4c4a-ae20-8b4145a240f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:06.255829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c71f5-0375-4c4a-ae20-8b4145a240f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:06.257634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c71f5-0375-4c4a-ae20-8b4145a240f8 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:06.270103 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4146/8232] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:10.952574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be63e7c-8336-47f8-84a7-eb1dd60dd678 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:10.954167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8be63e7c-8336-47f8-84a7-eb1dd60dd678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:11.082478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be63e7c-8336-47f8-84a7-eb1dd60dd678 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:11.088895 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf15729-a6c5-4d7e-9531-00afe3459156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:11.089660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf15729-a6c5-4d7e-9531-00afe3459156 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:11.090004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf15729-a6c5-4d7e-9531-00afe3459156 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:11.090397 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf15729-a6c5-4d7e-9531-00afe3459156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:11.092714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aaf15729-a6c5-4d7e-9531-00afe3459156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:11.113678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf15729-a6c5-4d7e-9531-00afe3459156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:11.115422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf15729-a6c5-4d7e-9531-00afe3459156 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:11.148226 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4087/8233] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:12.004649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c71f5-0375-4c4a-ae20-8b4145a240f8 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:12.010326 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:12.076953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c71f5-0375-4c4a-ae20-8b4145a240f8 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:12.081491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:12.082120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:12.082400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:12.082676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] PATH_INFO: `/v3/users/4fbca58715584df2b5e24d6dce93f0a9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:12.083862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fbca58715584df2b5e24d6dce93f0a9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:12.085771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:12.133418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fbca58715584df2b5e24d6dce93f0a9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:12.134080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fbca58715584df2b5e24d6dce93f0a9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:12.146743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fbca58715584df2b5e24d6dce93f0a9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:12.154588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fbca58715584df2b5e24d6dce93f0a9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:12.155242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fbca58715584df2b5e24d6dce93f0a9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:12.167867 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4147/8234] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:42:12 2022] DELETE /identity/v3/users/4fbca58715584df2b5e24d6dce93f0a9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:12.172478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952f136-a249-4533-a4b2-068791248f19 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:12.172991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952f136-a249-4533-a4b2-068791248f19 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:12.173114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952f136-a249-4533-a4b2-068791248f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:12.192677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e952f136-a249-4533-a4b2-068791248f19 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:12.193857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e952f136-a249-4533-a4b2-068791248f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:12.254258 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4088/8235] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:12.264587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:12.266060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:12.334994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32450ee6-5cc5-4f07-92b1-74c220ab66b4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:12.338633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90a503-0737-4fe4-b94d-24c011aa7db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:12.339403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90a503-0737-4fe4-b94d-24c011aa7db4 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:12.339677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90a503-0737-4fe4-b94d-24c011aa7db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:12.339950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90a503-0737-4fe4-b94d-24c011aa7db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:12.349424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90a503-0737-4fe4-b94d-24c011aa7db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:12.350861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90a503-0737-4fe4-b94d-24c011aa7db4 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:12.361208 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4148/8236] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:12.543146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952f136-a249-4533-a4b2-068791248f19 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:12.544725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e952f136-a249-4533-a4b2-068791248f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:12.559557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952f136-a249-4533-a4b2-068791248f19 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:12.566879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:12.568266 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:12.577253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:12.577970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee admin admin] PATH_INFO: `/v3/projects/7760732ba988435c947b78615ca05ac6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:12.580267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7760732ba988435c947b78615ca05ac6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:12.583465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:12.641470 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:12.646828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7760732ba988435c947b78615ca05ac6', 'request_id': 'req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:12.654600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7760732ba988435c947b78615ca05ac6', 'request_id': 'req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:12.663245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7760732ba988435c947b78615ca05ac6', 'request_id': 'req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:12.676679 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee admin admin] The token cache is being invalidate because project 7760732ba988435c947b78615ca05ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:42:12.676966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:12.677611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5f7cc81a-3efb-4e9e-a46b-3f191a17dfee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:12.679470 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4089/8237] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:42:12 2022] DELETE /identity/v3/projects/7760732ba988435c947b78615ca05ac6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:12.687048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7925130-ec85-478f-9b89-3e970efb9216 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:12.687362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7925130-ec85-478f-9b89-3e970efb9216 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:12.687718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7925130-ec85-478f-9b89-3e970efb9216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:12.708385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e7925130-ec85-478f-9b89-3e970efb9216 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:12.709611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e7925130-ec85-478f-9b89-3e970efb9216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:12.734525 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:12.779822 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4149/8238] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:12.787921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca2114-23df-46e3-88ca-8ece9b178847 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:12.788206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca2114-23df-46e3-88ca-8ece9b178847 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:12.788554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca2114-23df-46e3-88ca-8ece9b178847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:12.809957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-10ca2114-23df-46e3-88ca-8ece9b178847 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:12.811435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-10ca2114-23df-46e3-88ca-8ece9b178847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:12.819744 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4090/8239] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:12.824131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7925130-ec85-478f-9b89-3e970efb9216 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:12.834984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7925130-ec85-478f-9b89-3e970efb9216 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:12.840231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99335cd7-4ddf-4383-87dc-fdbe31f4225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:12.841135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99335cd7-4ddf-4383-87dc-fdbe31f4225e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:12.841371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99335cd7-4ddf-4383-87dc-fdbe31f4225e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:12.841648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99335cd7-4ddf-4383-87dc-fdbe31f4225e admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:12.842327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99335cd7-4ddf-4383-87dc-fdbe31f4225e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:42:12.842635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99335cd7-4ddf-4383-87dc-fdbe31f4225e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:12.844272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99335cd7-4ddf-4383-87dc-fdbe31f4225e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:12.860587 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4150/8240] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:42:12.861654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca2114-23df-46e3-88ca-8ece9b178847 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:12.871168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca2114-23df-46e3-88ca-8ece9b178847 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:12.876032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde93a7-eb46-4768-8f80-95fb33439914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:12.876554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde93a7-eb46-4768-8f80-95fb33439914 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:12.876808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde93a7-eb46-4768-8f80-95fb33439914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:12.877088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde93a7-eb46-4768-8f80-95fb33439914 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:12.877781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde93a7-eb46-4768-8f80-95fb33439914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:12.880807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde93a7-eb46-4768-8f80-95fb33439914 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:12.909717 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4091/8241] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:42:12 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:42:12.914192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99335cd7-4ddf-4383-87dc-fdbe31f4225e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:12.925240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99335cd7-4ddf-4383-87dc-fdbe31f4225e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:12.982748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552befda-868b-4e3e-ac29-ebd9d3807cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:12.983483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552befda-868b-4e3e-ac29-ebd9d3807cce admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:12.983768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552befda-868b-4e3e-ac29-ebd9d3807cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:12.984038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552befda-868b-4e3e-ac29-ebd9d3807cce admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:12.984667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552befda-868b-4e3e-ac29-ebd9d3807cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:12.986648 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552befda-868b-4e3e-ac29-ebd9d3807cce admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:13.010121 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4151/8242] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:42:12 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:42:13.012819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde93a7-eb46-4768-8f80-95fb33439914 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:13.023350 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde93a7-eb46-4768-8f80-95fb33439914 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:13.028692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5c919-6efc-481c-a444-34a04ec3e0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:13.029281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5c919-6efc-481c-a444-34a04ec3e0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:13.029559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5c919-6efc-481c-a444-34a04ec3e0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:13.029846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5c919-6efc-481c-a444-34a04ec3e0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:13.030457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5c919-6efc-481c-a444-34a04ec3e0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:13.032088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5c919-6efc-481c-a444-34a04ec3e0d4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:13.045594 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4092/8243] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:42:13.046790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552befda-868b-4e3e-ac29-ebd9d3807cce admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:13.056948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552befda-868b-4e3e-ac29-ebd9d3807cce admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:13.061693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae58b9-55f6-4071-aefe-4ce9d0556da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:13.062290 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae58b9-55f6-4071-aefe-4ce9d0556da1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:13.062570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae58b9-55f6-4071-aefe-4ce9d0556da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:13.062841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae58b9-55f6-4071-aefe-4ce9d0556da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:13.063508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae58b9-55f6-4071-aefe-4ce9d0556da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:13.065223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae58b9-55f6-4071-aefe-4ce9d0556da1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:13.077912 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4152/8244] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:42:13.082358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5c919-6efc-481c-a444-34a04ec3e0d4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:13.093686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5c919-6efc-481c-a444-34a04ec3e0d4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:13.098223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbae0b-dd9f-4016-8612-dee973dd251c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:13.098869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbae0b-dd9f-4016-8612-dee973dd251c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:13.099178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbae0b-dd9f-4016-8612-dee973dd251c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:13.099447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbae0b-dd9f-4016-8612-dee973dd251c admin admin] PATH_INFO: `/v3/projects/2302f137213849e78229915f609de53d/users/d91e1dfab69d49e09dbe631af3b85caf/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:13.116560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbae0b-dd9f-4016-8612-dee973dd251c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2302f137213849e78229915f609de53d, user_id=d91e1dfab69d49e09dbe631af3b85caf, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:13.119230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbae0b-dd9f-4016-8612-dee973dd251c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:13.133433 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4093/8245] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:42:13 2022] PUT /identity/v3/projects/2302f137213849e78229915f609de53d/users/d91e1dfab69d49e09dbe631af3b85caf/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:42:13.144957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89141b5-31c6-4b1c-8ea9-eb2326994720 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:13.145307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89141b5-31c6-4b1c-8ea9-eb2326994720 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:13.145649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89141b5-31c6-4b1c-8ea9-eb2326994720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:13.175912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c89141b5-31c6-4b1c-8ea9-eb2326994720 None None] MFA Rules not processed for user `d91e1dfab69d49e09dbe631af3b85caf`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:13.177108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c89141b5-31c6-4b1c-8ea9-eb2326994720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:13.244844 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4153/8246] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:13.249343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbae0b-dd9f-4016-8612-dee973dd251c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:13.312814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbae0b-dd9f-4016-8612-dee973dd251c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:13.317514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d925f33-97b2-4382-b97d-d89e648cde3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:13.318113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d925f33-97b2-4382-b97d-d89e648cde3e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:13.318387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d925f33-97b2-4382-b97d-d89e648cde3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:13.318654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d925f33-97b2-4382-b97d-d89e648cde3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:13.319303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d925f33-97b2-4382-b97d-d89e648cde3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:13.321240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d925f33-97b2-4382-b97d-d89e648cde3e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:13.356821 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4094/8247] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:42:13 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:42:13.358210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89141b5-31c6-4b1c-8ea9-eb2326994720 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:13.369471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89141b5-31c6-4b1c-8ea9-eb2326994720 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:13.389940 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:13.430377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691d59a-4221-446c-af45-807757400696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:13.431029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691d59a-4221-446c-af45-807757400696 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:13.431294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691d59a-4221-446c-af45-807757400696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:13.431564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691d59a-4221-446c-af45-807757400696 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:13.432186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691d59a-4221-446c-af45-807757400696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:13.435181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691d59a-4221-446c-af45-807757400696 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:13.457810 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4154/8248] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:42:13 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:42:13.461989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d925f33-97b2-4382-b97d-d89e648cde3e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:13.473738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d925f33-97b2-4382-b97d-d89e648cde3e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:13.478509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73e0f-a349-451f-aab4-a32cac1f4ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:13.479164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73e0f-a349-451f-aab4-a32cac1f4ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:13.479464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73e0f-a349-451f-aab4-a32cac1f4ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:13.479975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73e0f-a349-451f-aab4-a32cac1f4ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:13.480642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f73e0f-a349-451f-aab4-a32cac1f4ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:13.482244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f73e0f-a349-451f-aab4-a32cac1f4ed4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:13.493486 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4095/8249] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:42:13.498437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691d59a-4221-446c-af45-807757400696 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:13.509016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691d59a-4221-446c-af45-807757400696 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:13.514673 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49349b61-d289-4c93-95df-ebae9913c198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:13.515409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49349b61-d289-4c93-95df-ebae9913c198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:13.515689 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49349b61-d289-4c93-95df-ebae9913c198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:13.515963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49349b61-d289-4c93-95df-ebae9913c198 admin admin] PATH_INFO: `/v3/projects/df7d220661a7463cb100555021c3cf5e/users/ec674d677afa4331b9a353db2450e3a7/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:13.534025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49349b61-d289-4c93-95df-ebae9913c198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7d220661a7463cb100555021c3cf5e, user_id=ec674d677afa4331b9a353db2450e3a7, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:13.536748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49349b61-d289-4c93-95df-ebae9913c198 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:13.551798 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4155/8250] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:42:13 2022] PUT /identity/v3/projects/df7d220661a7463cb100555021c3cf5e/users/ec674d677afa4331b9a353db2450e3a7/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:13.556122 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73e0f-a349-451f-aab4-a32cac1f4ed4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:13.570064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73e0f-a349-451f-aab4-a32cac1f4ed4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:13.612397 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:13.633522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711e028-f1bc-46e6-8045-4990ced2fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:13.634139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711e028-f1bc-46e6-8045-4990ced2fd6f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:13.634517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711e028-f1bc-46e6-8045-4990ced2fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:13.634666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711e028-f1bc-46e6-8045-4990ced2fd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:13.635409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711e028-f1bc-46e6-8045-4990ced2fd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:13.638117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711e028-f1bc-46e6-8045-4990ced2fd6f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:13.652031 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4096/8251] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:42:13.653743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49349b61-d289-4c93-95df-ebae9913c198 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:13.664292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49349b61-d289-4c93-95df-ebae9913c198 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:13.670038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2c5d1-dcd0-4c14-b1aa-bcf93d18a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:13.670764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c5d1-dcd0-4c14-b1aa-bcf93d18a66b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:13.671164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c5d1-dcd0-4c14-b1aa-bcf93d18a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:13.671503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c5d1-dcd0-4c14-b1aa-bcf93d18a66b admin admin] PATH_INFO: `/v3/projects/df7d220661a7463cb100555021c3cf5e/users/ec674d677afa4331b9a353db2450e3a7/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:13.673527 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2c5d1-dcd0-4c14-b1aa-bcf93d18a66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7d220661a7463cb100555021c3cf5e, user_id=ec674d677afa4331b9a353db2450e3a7, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:13.676425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2c5d1-dcd0-4c14-b1aa-bcf93d18a66b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:13.690558 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4156/8252] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:42:13 2022] PUT /identity/v3/projects/df7d220661a7463cb100555021c3cf5e/users/ec674d677afa4331b9a353db2450e3a7/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:13.703117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787003c-2a49-4b59-9ce4-59e574f13928 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:13.703399 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787003c-2a49-4b59-9ce4-59e574f13928 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:13.703661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787003c-2a49-4b59-9ce4-59e574f13928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:13.738542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6787003c-2a49-4b59-9ce4-59e574f13928 None None] MFA Rules not processed for user `ec674d677afa4331b9a353db2450e3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:13.740097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6787003c-2a49-4b59-9ce4-59e574f13928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:13.812280 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4097/8253] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:13.823624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2c5d1-dcd0-4c14-b1aa-bcf93d18a66b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:13.825363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-53a2c5d1-dcd0-4c14-b1aa-bcf93d18a66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:13.909570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2c5d1-dcd0-4c14-b1aa-bcf93d18a66b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:13.913278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018dbf8-a51f-480c-8476-bcf078574277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:13.913880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018dbf8-a51f-480c-8476-bcf078574277 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:13.914159 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018dbf8-a51f-480c-8476-bcf078574277 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:13.914431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018dbf8-a51f-480c-8476-bcf078574277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:13.924392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018dbf8-a51f-480c-8476-bcf078574277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:13.925812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018dbf8-a51f-480c-8476-bcf078574277 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:13.935909 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4157/8254] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:14.003511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787003c-2a49-4b59-9ce4-59e574f13928 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:14.068568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787003c-2a49-4b59-9ce4-59e574f13928 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:14.073171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:14.074328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:14.074608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:14.074886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] PATH_INFO: `/v3/users/d91e1dfab69d49e09dbe631af3b85caf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:14.076402 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91e1dfab69d49e09dbe631af3b85caf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:14.078330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:14.127702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91e1dfab69d49e09dbe631af3b85caf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.128356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91e1dfab69d49e09dbe631af3b85caf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.141180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91e1dfab69d49e09dbe631af3b85caf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.142818 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:14.150828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91e1dfab69d49e09dbe631af3b85caf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.151646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91e1dfab69d49e09dbe631af3b85caf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.164676 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4098/8255] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:42:14 2022] DELETE /identity/v3/users/d91e1dfab69d49e09dbe631af3b85caf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:14.169316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c99577-af9c-4113-8ee8-1c6b4233e834 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:14.169864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c99577-af9c-4113-8ee8-1c6b4233e834 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:14.169864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c99577-af9c-4113-8ee8-1c6b4233e834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:14.189656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-24c99577-af9c-4113-8ee8-1c6b4233e834 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:14.190860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-24c99577-af9c-4113-8ee8-1c6b4233e834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:14.242379 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:14.253732 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4158/8256] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:14.265298 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:14.266706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:14.328208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cae202-30ae-480e-8b24-b9c7c46ff2b4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:14.332033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a06ea-6a1b-4bc7-97e3-a0e6feb51d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:14.332654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a06ea-6a1b-4bc7-97e3-a0e6feb51d41 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:14.332933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a06ea-6a1b-4bc7-97e3-a0e6feb51d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:14.333205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a06ea-6a1b-4bc7-97e3-a0e6feb51d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:14.343379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a06ea-6a1b-4bc7-97e3-a0e6feb51d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:14.345010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a06ea-6a1b-4bc7-97e3-a0e6feb51d41 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:14.356128 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4099/8257] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:14.639878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c99577-af9c-4113-8ee8-1c6b4233e834 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:14.641558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-24c99577-af9c-4113-8ee8-1c6b4233e834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:14.670225 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c99577-af9c-4113-8ee8-1c6b4233e834 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:14.675117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:14.675755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:14.676030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:14.676302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] PATH_INFO: `/v3/projects/2302f137213849e78229915f609de53d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:14.677416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2302f137213849e78229915f609de53d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:14.679363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:14.730168 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2302f137213849e78229915f609de53d', 'request_id': 'req-2a7fca27-a813-4233-a447-3f47ca01c576'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.739710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2302f137213849e78229915f609de53d', 'request_id': 'req-2a7fca27-a813-4233-a447-3f47ca01c576'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.748251 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2302f137213849e78229915f609de53d', 'request_id': 'req-2a7fca27-a813-4233-a447-3f47ca01c576'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.764111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] The token cache is being invalidate because project 2302f137213849e78229915f609de53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:42:14.764502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.765089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.767163 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4159/8258] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:42:14 2022] DELETE /identity/v3/projects/2302f137213849e78229915f609de53d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:14.771033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a06ea-6a1b-4bc7-97e3-a0e6feb51d41 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:14.782225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a06ea-6a1b-4bc7-97e3-a0e6feb51d41 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:14.849368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9686b3-f160-45f7-9574-dd03b327ef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:14.850008 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9686b3-f160-45f7-9574-dd03b327ef79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:14.850289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9686b3-f160-45f7-9574-dd03b327ef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:14.850562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9686b3-f160-45f7-9574-dd03b327ef79 admin admin] PATH_INFO: `/v3/users/ec674d677afa4331b9a353db2450e3a7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:14.851735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9686b3-f160-45f7-9574-dd03b327ef79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec674d677afa4331b9a353db2450e3a7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:14.853807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9686b3-f160-45f7-9574-dd03b327ef79 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:14.902737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0d9686b3-f160-45f7-9574-dd03b327ef79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec674d677afa4331b9a353db2450e3a7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.903447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0d9686b3-f160-45f7-9574-dd03b327ef79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec674d677afa4331b9a353db2450e3a7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.915418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0d9686b3-f160-45f7-9574-dd03b327ef79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec674d677afa4331b9a353db2450e3a7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.923837 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0d9686b3-f160-45f7-9574-dd03b327ef79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec674d677afa4331b9a353db2450e3a7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.924439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0d9686b3-f160-45f7-9574-dd03b327ef79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec674d677afa4331b9a353db2450e3a7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:14.938415 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4100/8259] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:42:14 2022] DELETE /identity/v3/users/ec674d677afa4331b9a353db2450e3a7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:15.232699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:15.234347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:15.259877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fca27-a813-4233-a447-3f47ca01c576 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:15.333943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1264f-4bd1-400b-b376-ee548506c2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:15.334654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1264f-4bd1-400b-b376-ee548506c2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:15.335076 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1264f-4bd1-400b-b376-ee548506c2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:15.335411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1264f-4bd1-400b-b376-ee548506c2c8 admin admin] PATH_INFO: `/v3/projects/df7d220661a7463cb100555021c3cf5e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:15.336579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1264f-4bd1-400b-b376-ee548506c2c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7d220661a7463cb100555021c3cf5e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:15.338561 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1264f-4bd1-400b-b376-ee548506c2c8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:15.397790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-45c1264f-4bd1-400b-b376-ee548506c2c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7d220661a7463cb100555021c3cf5e', 'request_id': 'req-45c1264f-4bd1-400b-b376-ee548506c2c8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:15.406186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-45c1264f-4bd1-400b-b376-ee548506c2c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7d220661a7463cb100555021c3cf5e', 'request_id': 'req-45c1264f-4bd1-400b-b376-ee548506c2c8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:15.419135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-45c1264f-4bd1-400b-b376-ee548506c2c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7d220661a7463cb100555021c3cf5e', 'request_id': 'req-45c1264f-4bd1-400b-b376-ee548506c2c8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:15.438525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-45c1264f-4bd1-400b-b376-ee548506c2c8 admin admin] The token cache is being invalidate because project df7d220661a7463cb100555021c3cf5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:42:15.438722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-45c1264f-4bd1-400b-b376-ee548506c2c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:15.439426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-45c1264f-4bd1-400b-b376-ee548506c2c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:15.441223 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4160/8260] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:42:15 2022] DELETE /identity/v3/projects/df7d220661a7463cb100555021c3cf5e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:15.445871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212daf8-6999-4ba0-84a8-0dc0e9e05fe4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:15.446321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212daf8-6999-4ba0-84a8-0dc0e9e05fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:15.446548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212daf8-6999-4ba0-84a8-0dc0e9e05fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:15.457913 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:15.473483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4212daf8-6999-4ba0-84a8-0dc0e9e05fe4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:15.475455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4212daf8-6999-4ba0-84a8-0dc0e9e05fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:15.571282 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4101/8261] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:42:15.579993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3625b8f-3234-4948-b4fe-84f8c16084f1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:15.580280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3625b8f-3234-4948-b4fe-84f8c16084f1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:15.580558 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3625b8f-3234-4948-b4fe-84f8c16084f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:15.604398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c3625b8f-3234-4948-b4fe-84f8c16084f1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:15.606954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c3625b8f-3234-4948-b4fe-84f8c16084f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:15.640169 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4161/8262] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:15.644278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212daf8-6999-4ba0-84a8-0dc0e9e05fe4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:15.655120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212daf8-6999-4ba0-84a8-0dc0e9e05fe4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:15.664313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dcf4a-b3e8-403e-8647-55cd1f694920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:15.665119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dcf4a-b3e8-403e-8647-55cd1f694920 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:15.665503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dcf4a-b3e8-403e-8647-55cd1f694920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:15.666305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dcf4a-b3e8-403e-8647-55cd1f694920 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:15.669516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dcf4a-b3e8-403e-8647-55cd1f694920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:42:15.669992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dcf4a-b3e8-403e-8647-55cd1f694920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:15.671760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dcf4a-b3e8-403e-8647-55cd1f694920 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:15.692992 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4102/8263] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:42:15.694344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3625b8f-3234-4948-b4fe-84f8c16084f1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:15.704238 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:15.708714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3625b8f-3234-4948-b4fe-84f8c16084f1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:15.717007 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137688f-2a76-49ef-9172-2b7cdf143a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:15.717737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137688f-2a76-49ef-9172-2b7cdf143a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:15.718445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137688f-2a76-49ef-9172-2b7cdf143a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:15.719084 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137688f-2a76-49ef-9172-2b7cdf143a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:15.720079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137688f-2a76-49ef-9172-2b7cdf143a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:15.722117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137688f-2a76-49ef-9172-2b7cdf143a00 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:15.756939 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4162/8264] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:42:15 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:42:15.761210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dcf4a-b3e8-403e-8647-55cd1f694920 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:15.774024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dcf4a-b3e8-403e-8647-55cd1f694920 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:15.846627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43089bf-b451-4619-b31f-a9bf6b56c5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:15.847582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43089bf-b451-4619-b31f-a9bf6b56c5bd admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:15.847971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43089bf-b451-4619-b31f-a9bf6b56c5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:15.848343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43089bf-b451-4619-b31f-a9bf6b56c5bd admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:15.849107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43089bf-b451-4619-b31f-a9bf6b56c5bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:15.851210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43089bf-b451-4619-b31f-a9bf6b56c5bd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:15.881163 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4103/8265] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:42:15 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:42:15.885417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137688f-2a76-49ef-9172-2b7cdf143a00 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:15.905507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137688f-2a76-49ef-9172-2b7cdf143a00 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:15.912812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7fa7e-1cce-41ae-ad84-ecf9b5c7e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:15.914618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7fa7e-1cce-41ae-ad84-ecf9b5c7e052 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:15.915535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7fa7e-1cce-41ae-ad84-ecf9b5c7e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:15.916195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7fa7e-1cce-41ae-ad84-ecf9b5c7e052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:15.917471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7fa7e-1cce-41ae-ad84-ecf9b5c7e052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:15.919462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7fa7e-1cce-41ae-ad84-ecf9b5c7e052 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:15.933655 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4163/8266] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:42:15.936966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43089bf-b451-4619-b31f-a9bf6b56c5bd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:15.949392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43089bf-b451-4619-b31f-a9bf6b56c5bd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:15.955065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcba96-19e4-4d3d-abc1-5638c989d7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:15.955992 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcba96-19e4-4d3d-abc1-5638c989d7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:15.956381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcba96-19e4-4d3d-abc1-5638c989d7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:15.956932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcba96-19e4-4d3d-abc1-5638c989d7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:15.957687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcba96-19e4-4d3d-abc1-5638c989d7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:15.959697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcba96-19e4-4d3d-abc1-5638c989d7e4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:15.977227 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4104/8267] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:42:15.978470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7fa7e-1cce-41ae-ad84-ecf9b5c7e052 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:15.990751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7fa7e-1cce-41ae-ad84-ecf9b5c7e052 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:15.998253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec4124-cbd1-454b-b7cf-36db8585faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:15.999110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4124-cbd1-454b-b7cf-36db8585faa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:15.999586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4124-cbd1-454b-b7cf-36db8585faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:16.000047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4124-cbd1-454b-b7cf-36db8585faa2 admin admin] PATH_INFO: `/v3/projects/4ddfb386996f4c5a9c1c79f1e62dab8b/users/dd9e91b6481d466eb95ed4f0ad1e5bfb/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:16.027806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec4124-cbd1-454b-b7cf-36db8585faa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ddfb386996f4c5a9c1c79f1e62dab8b, user_id=dd9e91b6481d466eb95ed4f0ad1e5bfb, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:16.031917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec4124-cbd1-454b-b7cf-36db8585faa2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:16.048132 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4164/8268] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:42:15 2022] PUT /identity/v3/projects/4ddfb386996f4c5a9c1c79f1e62dab8b/users/dd9e91b6481d466eb95ed4f0ad1e5bfb/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:16.059685 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65340817-2508-49bc-8a3d-e53892419cb2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:16.060090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65340817-2508-49bc-8a3d-e53892419cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:16.060470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65340817-2508-49bc-8a3d-e53892419cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:16.099758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-65340817-2508-49bc-8a3d-e53892419cb2 None None] MFA Rules not processed for user `dd9e91b6481d466eb95ed4f0ad1e5bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:16.101258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-65340817-2508-49bc-8a3d-e53892419cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:16.205297 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:16.220758 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4105/8269] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:16.222102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec4124-cbd1-454b-b7cf-36db8585faa2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:16.295933 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec4124-cbd1-454b-b7cf-36db8585faa2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:16.300801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec6b7b-a1e4-4b09-97a7-a55cdc1e2393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:16.302038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec6b7b-a1e4-4b09-97a7-a55cdc1e2393 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:16.302326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec6b7b-a1e4-4b09-97a7-a55cdc1e2393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:16.302600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec6b7b-a1e4-4b09-97a7-a55cdc1e2393 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:16.303271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec6b7b-a1e4-4b09-97a7-a55cdc1e2393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:16.305645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec6b7b-a1e4-4b09-97a7-a55cdc1e2393 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:16.338368 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4165/8270] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:42:16 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:42:16.340708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65340817-2508-49bc-8a3d-e53892419cb2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:16.362854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65340817-2508-49bc-8a3d-e53892419cb2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:16.428885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb83eb-ba9a-4bce-83d7-7028bb38dec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:16.429591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb83eb-ba9a-4bce-83d7-7028bb38dec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:16.429941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb83eb-ba9a-4bce-83d7-7028bb38dec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:16.430283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb83eb-ba9a-4bce-83d7-7028bb38dec8 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:16.431025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb83eb-ba9a-4bce-83d7-7028bb38dec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:16.433188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb83eb-ba9a-4bce-83d7-7028bb38dec8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:16.468862 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4106/8271] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:42:16 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:42:16.473028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec6b7b-a1e4-4b09-97a7-a55cdc1e2393 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:16.485259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec6b7b-a1e4-4b09-97a7-a55cdc1e2393 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:16.490852 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af082a7-0000-45cf-b824-5a5b154a9bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:16.491617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af082a7-0000-45cf-b824-5a5b154a9bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:16.491996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af082a7-0000-45cf-b824-5a5b154a9bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:16.492369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af082a7-0000-45cf-b824-5a5b154a9bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:16.493123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af082a7-0000-45cf-b824-5a5b154a9bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:16.494809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af082a7-0000-45cf-b824-5a5b154a9bf6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:16.511804 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4166/8272] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:42:16.513119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb83eb-ba9a-4bce-83d7-7028bb38dec8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:16.527960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb83eb-ba9a-4bce-83d7-7028bb38dec8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:16.533408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1641a85-d2a8-4493-b8a2-5f9d2c01e67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:16.534044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1641a85-d2a8-4493-b8a2-5f9d2c01e67f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:16.534324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1641a85-d2a8-4493-b8a2-5f9d2c01e67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:16.534594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1641a85-d2a8-4493-b8a2-5f9d2c01e67f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:16.535420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1641a85-d2a8-4493-b8a2-5f9d2c01e67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:16.537339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1641a85-d2a8-4493-b8a2-5f9d2c01e67f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:16.553216 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4107/8273] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:42:16.555215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af082a7-0000-45cf-b824-5a5b154a9bf6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:16.566526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af082a7-0000-45cf-b824-5a5b154a9bf6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:16.571678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602295e0-11e1-490a-aff5-802787e99b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:16.572341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602295e0-11e1-490a-aff5-802787e99b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:16.572627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602295e0-11e1-490a-aff5-802787e99b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:16.572899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602295e0-11e1-490a-aff5-802787e99b7d admin admin] PATH_INFO: `/v3/projects/f822c2bfe24c4d8a8bec1cc4ab6a2414/users/936903b31cfa4976b263dbe70a729025/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:16.593701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602295e0-11e1-490a-aff5-802787e99b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f822c2bfe24c4d8a8bec1cc4ab6a2414, user_id=936903b31cfa4976b263dbe70a729025, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:16.596927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602295e0-11e1-490a-aff5-802787e99b7d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:16.614241 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4167/8274] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:42:16 2022] PUT /identity/v3/projects/f822c2bfe24c4d8a8bec1cc4ab6a2414/users/936903b31cfa4976b263dbe70a729025/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:16.626004 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b884695-c61d-414a-bb59-168f33b7d4e5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:16.626378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b884695-c61d-414a-bb59-168f33b7d4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:16.626755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b884695-c61d-414a-bb59-168f33b7d4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:16.657054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9b884695-c61d-414a-bb59-168f33b7d4e5 None None] MFA Rules not processed for user `936903b31cfa4976b263dbe70a729025`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:16.658471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9b884695-c61d-414a-bb59-168f33b7d4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:16.732435 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4108/8275] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:16.736714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602295e0-11e1-490a-aff5-802787e99b7d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:16.814655 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:16.818434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602295e0-11e1-490a-aff5-802787e99b7d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:16.826271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf39f33-5300-4c5f-b4b6-7bcdfcbc5348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:16.827275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf39f33-5300-4c5f-b4b6-7bcdfcbc5348 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:16.827657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf39f33-5300-4c5f-b4b6-7bcdfcbc5348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:16.828295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf39f33-5300-4c5f-b4b6-7bcdfcbc5348 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:16.829021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf39f33-5300-4c5f-b4b6-7bcdfcbc5348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:16.831301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf39f33-5300-4c5f-b4b6-7bcdfcbc5348 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:16.864899 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4168/8276] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:42:16 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:42:16.867749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b884695-c61d-414a-bb59-168f33b7d4e5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:16.894849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b884695-c61d-414a-bb59-168f33b7d4e5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:16.999578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f09a4-788a-4198-b3d4-5588e1c38da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:17.000521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f09a4-788a-4198-b3d4-5588e1c38da8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:17.000962 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f09a4-788a-4198-b3d4-5588e1c38da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:17.001540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f09a4-788a-4198-b3d4-5588e1c38da8 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:17.002369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f09a4-788a-4198-b3d4-5588e1c38da8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:17.005729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f09a4-788a-4198-b3d4-5588e1c38da8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:17.030132 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:17.043842 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4109/8277] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:42:16 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:42:17.046362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf39f33-5300-4c5f-b4b6-7bcdfcbc5348 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:17.060860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf39f33-5300-4c5f-b4b6-7bcdfcbc5348 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:17.079864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd03a5c-12ac-4a45-aea5-13c968acacc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:17.080500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd03a5c-12ac-4a45-aea5-13c968acacc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:17.081811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd03a5c-12ac-4a45-aea5-13c968acacc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:17.082096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd03a5c-12ac-4a45-aea5-13c968acacc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:17.082858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd03a5c-12ac-4a45-aea5-13c968acacc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:17.085253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd03a5c-12ac-4a45-aea5-13c968acacc7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:17.130627 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4169/8278] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:42:17.132539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f09a4-788a-4198-b3d4-5588e1c38da8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:17.145917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f09a4-788a-4198-b3d4-5588e1c38da8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:17.153521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05cc03-6fc7-4fa5-80fd-754182afeb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:17.154370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05cc03-6fc7-4fa5-80fd-754182afeb76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:17.154714 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05cc03-6fc7-4fa5-80fd-754182afeb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:17.155080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05cc03-6fc7-4fa5-80fd-754182afeb76 admin admin] PATH_INFO: `/v3/projects/1bdfa743c44147dd8dabde8503fe8f01/users/389cd16e87134e918a23f7dabeec24c5/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:17.181484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05cc03-6fc7-4fa5-80fd-754182afeb76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdfa743c44147dd8dabde8503fe8f01, user_id=389cd16e87134e918a23f7dabeec24c5, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:17.184702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05cc03-6fc7-4fa5-80fd-754182afeb76 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:17.210489 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4110/8279] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:42:17 2022] PUT /identity/v3/projects/1bdfa743c44147dd8dabde8503fe8f01/users/389cd16e87134e918a23f7dabeec24c5/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:17.211725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd03a5c-12ac-4a45-aea5-13c968acacc7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:17.222774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd03a5c-12ac-4a45-aea5-13c968acacc7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:17.297735 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c5256-c72b-4c32-8b15-15f8c13f698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:17.298498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c5256-c72b-4c32-8b15-15f8c13f698d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:17.299086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c5256-c72b-4c32-8b15-15f8c13f698d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:17.299435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c5256-c72b-4c32-8b15-15f8c13f698d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:17.300154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c5256-c72b-4c32-8b15-15f8c13f698d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:17.302091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c5256-c72b-4c32-8b15-15f8c13f698d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:17.315379 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4170/8280] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:42:17.319216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05cc03-6fc7-4fa5-80fd-754182afeb76 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:17.333636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05cc03-6fc7-4fa5-80fd-754182afeb76 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:17.338729 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8868f0-2c79-4195-a290-c3c516aad356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:17.339545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8868f0-2c79-4195-a290-c3c516aad356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:17.339823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8868f0-2c79-4195-a290-c3c516aad356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:17.340092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8868f0-2c79-4195-a290-c3c516aad356 admin admin] PATH_INFO: `/v3/projects/1bdfa743c44147dd8dabde8503fe8f01/users/389cd16e87134e918a23f7dabeec24c5/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:17.342366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8868f0-2c79-4195-a290-c3c516aad356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdfa743c44147dd8dabde8503fe8f01, user_id=389cd16e87134e918a23f7dabeec24c5, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:17.345052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8868f0-2c79-4195-a290-c3c516aad356 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:17.358967 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4111/8281] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:42:17 2022] PUT /identity/v3/projects/1bdfa743c44147dd8dabde8503fe8f01/users/389cd16e87134e918a23f7dabeec24c5/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:17.367958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fafa27-350e-46b8-b04b-47327ad22226 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:17.368585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fafa27-350e-46b8-b04b-47327ad22226 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:17.369178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fafa27-350e-46b8-b04b-47327ad22226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:17.402999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-04fafa27-350e-46b8-b04b-47327ad22226 None None] MFA Rules not processed for user `389cd16e87134e918a23f7dabeec24c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:17.404228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-04fafa27-350e-46b8-b04b-47327ad22226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:17.483669 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4171/8282] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:42:17.502149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8868f0-2c79-4195-a290-c3c516aad356 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:17.504191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eb8868f0-2c79-4195-a290-c3c516aad356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:17.574680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8868f0-2c79-4195-a290-c3c516aad356 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:17.580190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d705-e8ea-4340-bfd3-3a07b8010386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:17.580808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d705-e8ea-4340-bfd3-3a07b8010386 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:17.581205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d705-e8ea-4340-bfd3-3a07b8010386 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:17.581667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d705-e8ea-4340-bfd3-3a07b8010386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:17.593348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3d705-e8ea-4340-bfd3-3a07b8010386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:17.594889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3d705-e8ea-4340-bfd3-3a07b8010386 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:17.606680 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4112/8283] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:17.657841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fafa27-350e-46b8-b04b-47327ad22226 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:17.659323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-04fafa27-350e-46b8-b04b-47327ad22226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:17.676401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fafa27-350e-46b8-b04b-47327ad22226 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:17.680169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6725d-73b4-4835-be12-38c829a5194b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:17.680819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6725d-73b4-4835-be12-38c829a5194b service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:17.681108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6725d-73b4-4835-be12-38c829a5194b service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:17.681382 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6725d-73b4-4835-be12-38c829a5194b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:17.740954 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:17.753445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6725d-73b4-4835-be12-38c829a5194b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:17.755464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6725d-73b4-4835-be12-38c829a5194b service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:17.765650 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4172/8284] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:23.238898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d705-e8ea-4340-bfd3-3a07b8010386 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:23.406555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d705-e8ea-4340-bfd3-3a07b8010386 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:23.420016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:23.420693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:23.421250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:23.421527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] PATH_INFO: `/v3/users/dd9e91b6481d466eb95ed4f0ad1e5bfb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:23.424214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9e91b6481d466eb95ed4f0ad1e5bfb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:23.425665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:23.810780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9e91b6481d466eb95ed4f0ad1e5bfb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:23.810780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9e91b6481d466eb95ed4f0ad1e5bfb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:23.810780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9e91b6481d466eb95ed4f0ad1e5bfb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:23.810780 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:23.810780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9e91b6481d466eb95ed4f0ad1e5bfb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:23.813746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9e91b6481d466eb95ed4f0ad1e5bfb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:23.813746 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4113/8285] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:42:23 2022] DELETE /identity/v3/users/dd9e91b6481d466eb95ed4f0ad1e5bfb => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:23.815030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7967b61-4281-44ed-8cc6-ca061f6a5602 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:23.815030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7967b61-4281-44ed-8cc6-ca061f6a5602 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:23.815030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7967b61-4281-44ed-8cc6-ca061f6a5602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:23.815030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e7967b61-4281-44ed-8cc6-ca061f6a5602 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:23.815030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e7967b61-4281-44ed-8cc6-ca061f6a5602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:24.030890 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4173/8286] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:24.041107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:24.044217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:24.199945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cc7f7-e112-409c-b26a-d260d71c97bd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:24.204877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37699f-1466-464d-98fd-988b01edaaa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:24.205562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37699f-1466-464d-98fd-988b01edaaa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:24.205844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37699f-1466-464d-98fd-988b01edaaa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:24.206129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37699f-1466-464d-98fd-988b01edaaa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:24.219032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37699f-1466-464d-98fd-988b01edaaa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:24.224038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37699f-1466-464d-98fd-988b01edaaa6 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:24.249365 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4114/8287] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:24.819980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7967b61-4281-44ed-8cc6-ca061f6a5602 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:24.821986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e7967b61-4281-44ed-8cc6-ca061f6a5602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:24.845058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7967b61-4281-44ed-8cc6-ca061f6a5602 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:24.855924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:24.857049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:24.857678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:24.858785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] PATH_INFO: `/v3/projects/4ddfb386996f4c5a9c1c79f1e62dab8b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:24.860275 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ddfb386996f4c5a9c1c79f1e62dab8b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:24.863004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:24.944692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ddfb386996f4c5a9c1c79f1e62dab8b', 'request_id': 'req-08200cc8-b515-492e-a699-4232692dedba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:24.957093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ddfb386996f4c5a9c1c79f1e62dab8b', 'request_id': 'req-08200cc8-b515-492e-a699-4232692dedba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:24.971678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ddfb386996f4c5a9c1c79f1e62dab8b', 'request_id': 'req-08200cc8-b515-492e-a699-4232692dedba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:24.999600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] The token cache is being invalidate because project 4ddfb386996f4c5a9c1c79f1e62dab8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:42:25.001432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:25.003280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:25.007046 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4174/8288] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:42:24 2022] DELETE /identity/v3/projects/4ddfb386996f4c5a9c1c79f1e62dab8b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:25.011331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37699f-1466-464d-98fd-988b01edaaa6 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:25.025906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37699f-1466-464d-98fd-988b01edaaa6 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:25.208203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:25.208853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:25.209529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:25.209918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] PATH_INFO: `/v3/users/936903b31cfa4976b263dbe70a729025` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:25.211290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=936903b31cfa4976b263dbe70a729025)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:25.213445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:25.344723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936903b31cfa4976b263dbe70a729025'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:25.345624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936903b31cfa4976b263dbe70a729025'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:25.381285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936903b31cfa4976b263dbe70a729025'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:25.396841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936903b31cfa4976b263dbe70a729025'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:25.398360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936903b31cfa4976b263dbe70a729025'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:25.449717 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4115/8289] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:42:25 2022] DELETE /identity/v3/users/936903b31cfa4976b263dbe70a729025 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:42:26.097919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:26.099400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:26.121651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08200cc8-b515-492e-a699-4232692dedba admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:26.273798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:26.274442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:26.274725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:26.275019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] PATH_INFO: `/v3/projects/f822c2bfe24c4d8a8bec1cc4ab6a2414` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:26.280659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f822c2bfe24c4d8a8bec1cc4ab6a2414)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:26.283157 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:26.323487 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:26.408133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f822c2bfe24c4d8a8bec1cc4ab6a2414', 'request_id': 'req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:26.416339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f822c2bfe24c4d8a8bec1cc4ab6a2414', 'request_id': 'req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:26.429837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f822c2bfe24c4d8a8bec1cc4ab6a2414', 'request_id': 'req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:26.447360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] The token cache is being invalidate because project f822c2bfe24c4d8a8bec1cc4ab6a2414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:42:26.449749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:26.451320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:26.457500 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4175/8290] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:42:26 2022] DELETE /identity/v3/projects/f822c2bfe24c4d8a8bec1cc4ab6a2414 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:26.458523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:26.460428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:26.471985 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:26.477301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab365e-fe9b-427c-b33d-6e85653df176 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:26.632752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b5779-a926-4f0d-981f-22bf200f1f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:26.633707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b5779-a926-4f0d-981f-22bf200f1f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:26.634316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b5779-a926-4f0d-981f-22bf200f1f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:26.635022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b5779-a926-4f0d-981f-22bf200f1f6f admin admin] PATH_INFO: `/v3/users/389cd16e87134e918a23f7dabeec24c5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:26.636736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b5779-a926-4f0d-981f-22bf200f1f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=389cd16e87134e918a23f7dabeec24c5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:26.640429 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b5779-a926-4f0d-981f-22bf200f1f6f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:26.764272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c06b5779-a926-4f0d-981f-22bf200f1f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389cd16e87134e918a23f7dabeec24c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:26.764972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c06b5779-a926-4f0d-981f-22bf200f1f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389cd16e87134e918a23f7dabeec24c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:26.783100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c06b5779-a926-4f0d-981f-22bf200f1f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389cd16e87134e918a23f7dabeec24c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:26.804054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c06b5779-a926-4f0d-981f-22bf200f1f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389cd16e87134e918a23f7dabeec24c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:26.804960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c06b5779-a926-4f0d-981f-22bf200f1f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389cd16e87134e918a23f7dabeec24c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:26.827098 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4116/8291] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:42:26 2022] DELETE /identity/v3/users/389cd16e87134e918a23f7dabeec24c5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:42:27.353895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:27.355910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:27.369636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d4e3c-f9d0-4039-90f7-af5fc7879c2d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:27.503041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b55362-f2a2-4cc0-9970-716e48cdd61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:27.504618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b55362-f2a2-4cc0-9970-716e48cdd61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:27.504912 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b55362-f2a2-4cc0-9970-716e48cdd61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:27.505257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b55362-f2a2-4cc0-9970-716e48cdd61f admin admin] PATH_INFO: `/v3/projects/1bdfa743c44147dd8dabde8503fe8f01` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:27.506477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b55362-f2a2-4cc0-9970-716e48cdd61f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bdfa743c44147dd8dabde8503fe8f01)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:27.508810 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b55362-f2a2-4cc0-9970-716e48cdd61f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:27.616121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-40b55362-f2a2-4cc0-9970-716e48cdd61f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bdfa743c44147dd8dabde8503fe8f01', 'request_id': 'req-40b55362-f2a2-4cc0-9970-716e48cdd61f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:27.625006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-40b55362-f2a2-4cc0-9970-716e48cdd61f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bdfa743c44147dd8dabde8503fe8f01', 'request_id': 'req-40b55362-f2a2-4cc0-9970-716e48cdd61f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:27.638361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-40b55362-f2a2-4cc0-9970-716e48cdd61f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bdfa743c44147dd8dabde8503fe8f01', 'request_id': 'req-40b55362-f2a2-4cc0-9970-716e48cdd61f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:27.662901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-40b55362-f2a2-4cc0-9970-716e48cdd61f admin admin] The token cache is being invalidate because project 1bdfa743c44147dd8dabde8503fe8f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:42:27.663230 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-40b55362-f2a2-4cc0-9970-716e48cdd61f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:27.663956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-40b55362-f2a2-4cc0-9970-716e48cdd61f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:42:27.665587 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4176/8292] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:42:27 2022] DELETE /identity/v3/projects/1bdfa743c44147dd8dabde8503fe8f01 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:27.672676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ee1a4-9e54-4be8-bd25-5b6495fa4580 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:27.673178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ee1a4-9e54-4be8-bd25-5b6495fa4580 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:27.673483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ee1a4-9e54-4be8-bd25-5b6495fa4580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:27.702941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f91ee1a4-9e54-4be8-bd25-5b6495fa4580 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:27.704292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f91ee1a4-9e54-4be8-bd25-5b6495fa4580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:27.805417 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4117/8293] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:27.814397 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611ccc1-12ed-4769-8b74-9394a9f44c6d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:27.814948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611ccc1-12ed-4769-8b74-9394a9f44c6d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:27.817185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611ccc1-12ed-4769-8b74-9394a9f44c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:27.858829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d611ccc1-12ed-4769-8b74-9394a9f44c6d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:27.860160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d611ccc1-12ed-4769-8b74-9394a9f44c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:27.894658 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4177/8294] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:27.896706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ee1a4-9e54-4be8-bd25-5b6495fa4580 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:27.911664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ee1a4-9e54-4be8-bd25-5b6495fa4580 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:27.926790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74edcd2-2361-4eba-8f04-93e6f8ec1429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:27.927526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74edcd2-2361-4eba-8f04-93e6f8ec1429 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:27.927909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74edcd2-2361-4eba-8f04-93e6f8ec1429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:27.928289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74edcd2-2361-4eba-8f04-93e6f8ec1429 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:27.929093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74edcd2-2361-4eba-8f04-93e6f8ec1429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:42:27.929655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74edcd2-2361-4eba-8f04-93e6f8ec1429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:27.931342 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74edcd2-2361-4eba-8f04-93e6f8ec1429 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:27.954332 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4118/8295] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:42:27.960499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611ccc1-12ed-4769-8b74-9394a9f44c6d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:27.977042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611ccc1-12ed-4769-8b74-9394a9f44c6d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:27.988604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf32ab-72ac-45bd-853f-615213a26bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:27.989650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf32ab-72ac-45bd-853f-615213a26bff admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:27.990271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf32ab-72ac-45bd-853f-615213a26bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:27.991539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf32ab-72ac-45bd-853f-615213a26bff admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:27.992425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf32ab-72ac-45bd-853f-615213a26bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:27.994778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf32ab-72ac-45bd-853f-615213a26bff admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:28.027432 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4178/8296] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:42:27 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:42:28.032024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74edcd2-2361-4eba-8f04-93e6f8ec1429 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:28.049735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74edcd2-2361-4eba-8f04-93e6f8ec1429 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:28.065179 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:28.147141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb80fd7-fa65-4f76-8ef5-46914319692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:28.148006 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb80fd7-fa65-4f76-8ef5-46914319692a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:28.148284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb80fd7-fa65-4f76-8ef5-46914319692a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:28.148550 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb80fd7-fa65-4f76-8ef5-46914319692a admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:28.149227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb80fd7-fa65-4f76-8ef5-46914319692a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:28.151286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb80fd7-fa65-4f76-8ef5-46914319692a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:28.180284 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4119/8297] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:42:28 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:42:28.184239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf32ab-72ac-45bd-853f-615213a26bff admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:28.199325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf32ab-72ac-45bd-853f-615213a26bff admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:28.206364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e16ce-f6cc-44ee-8570-d36181f1a08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:28.206629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e16ce-f6cc-44ee-8570-d36181f1a08f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:28.206802 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e16ce-f6cc-44ee-8570-d36181f1a08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:28.207282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e16ce-f6cc-44ee-8570-d36181f1a08f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:28.208283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e16ce-f6cc-44ee-8570-d36181f1a08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:28.210473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e16ce-f6cc-44ee-8570-d36181f1a08f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:28.217309 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:28.223734 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4179/8298] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:42:28.228394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb80fd7-fa65-4f76-8ef5-46914319692a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:28.243609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb80fd7-fa65-4f76-8ef5-46914319692a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:28.251095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96814c-d48c-4c17-98ee-f9f35b962d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:28.251826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96814c-d48c-4c17-98ee-f9f35b962d30 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:28.252180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96814c-d48c-4c17-98ee-f9f35b962d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:28.252579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96814c-d48c-4c17-98ee-f9f35b962d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:28.253481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96814c-d48c-4c17-98ee-f9f35b962d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:28.256498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96814c-d48c-4c17-98ee-f9f35b962d30 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:28.273574 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4120/8299] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:42:28.275021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e16ce-f6cc-44ee-8570-d36181f1a08f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:28.288335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e16ce-f6cc-44ee-8570-d36181f1a08f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:28.295738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f516e-a4f4-405d-b6cd-eff9abc3c4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:28.296468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f516e-a4f4-405d-b6cd-eff9abc3c4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:28.296751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f516e-a4f4-405d-b6cd-eff9abc3c4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:28.297030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f516e-a4f4-405d-b6cd-eff9abc3c4cc admin admin] PATH_INFO: `/v3/projects/c2a3cffe53f546dab8d2d49e4fa923e8/users/006dce5da5944dfdb48ec8da4b41fd37/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:28.320314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f516e-a4f4-405d-b6cd-eff9abc3c4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a3cffe53f546dab8d2d49e4fa923e8, user_id=006dce5da5944dfdb48ec8da4b41fd37, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:28.326814 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f516e-a4f4-405d-b6cd-eff9abc3c4cc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:28.347265 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4180/8300] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:42:28 2022] PUT /identity/v3/projects/c2a3cffe53f546dab8d2d49e4fa923e8/users/006dce5da5944dfdb48ec8da4b41fd37/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:42:28.360630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2077ed-6f4a-4c95-bbe2-63c636e1519b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:28.360943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2077ed-6f4a-4c95-bbe2-63c636e1519b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:28.361253 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2077ed-6f4a-4c95-bbe2-63c636e1519b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:28.407437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3d2077ed-6f4a-4c95-bbe2-63c636e1519b None None] MFA Rules not processed for user `006dce5da5944dfdb48ec8da4b41fd37`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:28.408829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3d2077ed-6f4a-4c95-bbe2-63c636e1519b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:28.596788 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4121/8301] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:28.610458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f516e-a4f4-405d-b6cd-eff9abc3c4cc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:28.612752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a61f516e-a4f4-405d-b6cd-eff9abc3c4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:28.713352 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f516e-a4f4-405d-b6cd-eff9abc3c4cc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:28.718243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25a5ed-424b-4866-a09a-c1dee175d443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:28.719140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25a5ed-424b-4866-a09a-c1dee175d443 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:28.719692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25a5ed-424b-4866-a09a-c1dee175d443 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:28.720206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25a5ed-424b-4866-a09a-c1dee175d443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:28.732683 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25a5ed-424b-4866-a09a-c1dee175d443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:28.735033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25a5ed-424b-4866-a09a-c1dee175d443 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:28.765177 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4181/8302] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:36.439179 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb841071-6353-4078-b2c6-e036022995af None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:36.439755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb841071-6353-4078-b2c6-e036022995af None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:36.439755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb841071-6353-4078-b2c6-e036022995af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:36.479128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cb841071-6353-4078-b2c6-e036022995af None None] MFA Rules not processed for user `83bbcff8a1f64cfa936f13f3cb3955b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:36.480903 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cb841071-6353-4078-b2c6-e036022995af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:36.667807 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4122/8303] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:42:37.439475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25a5ed-424b-4866-a09a-c1dee175d443 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:37.442328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d25a5ed-424b-4866-a09a-c1dee175d443 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:37.622946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25a5ed-424b-4866-a09a-c1dee175d443 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:37.628734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fc1b5-7d3f-428f-800d-c5eaeea0a929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:37.629427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fc1b5-7d3f-428f-800d-c5eaeea0a929 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:37.631967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fc1b5-7d3f-428f-800d-c5eaeea0a929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:37.632271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fc1b5-7d3f-428f-800d-c5eaeea0a929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:37.634475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b53fc1b5-7d3f-428f-800d-c5eaeea0a929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:37.673341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fc1b5-7d3f-428f-800d-c5eaeea0a929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:37.677699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fc1b5-7d3f-428f-800d-c5eaeea0a929 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:37.715948 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4182/8304] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:38.474824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb841071-6353-4078-b2c6-e036022995af None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:38.479226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cb841071-6353-4078-b2c6-e036022995af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:38.588804 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:38.724479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb841071-6353-4078-b2c6-e036022995af None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:38.734545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6ea4c-f267-4b0a-8381-a803753941c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:38.735137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6ea4c-f267-4b0a-8381-a803753941c5 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:38.735416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6ea4c-f267-4b0a-8381-a803753941c5 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:38.735689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6ea4c-f267-4b0a-8381-a803753941c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:38.749075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b4a6ea4c-f267-4b0a-8381-a803753941c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:38.786941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6ea4c-f267-4b0a-8381-a803753941c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:38.788687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6ea4c-f267-4b0a-8381-a803753941c5 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:38.818505 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4123/8305] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:47.689471 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:48.798967 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=21 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:53.299260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fc1b5-7d3f-428f-800d-c5eaeea0a929 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:42:53.301173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b53fc1b5-7d3f-428f-800d-c5eaeea0a929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:53.540421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fc1b5-7d3f-428f-800d-c5eaeea0a929 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:42:53.555052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda6579-0d46-437f-ae77-551fbcb762cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:42:53.556129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda6579-0d46-437f-ae77-551fbcb762cc service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:53.556500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda6579-0d46-437f-ae77-551fbcb762cc service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:53.557180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda6579-0d46-437f-ae77-551fbcb762cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:53.562944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bcda6579-0d46-437f-ae77-551fbcb762cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:53.595862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda6579-0d46-437f-ae77-551fbcb762cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:42:53.597781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda6579-0d46-437f-ae77-551fbcb762cc service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:42:53.635417 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4183/8306] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:42:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:42:57.257029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ea5bb-11cd-4896-91c6-19ea3380aac0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:42:57.257533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ea5bb-11cd-4896-91c6-19ea3380aac0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:42:57.257724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ea5bb-11cd-4896-91c6-19ea3380aac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:42:57.280937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d96ea5bb-11cd-4896-91c6-19ea3380aac0 None None] MFA Rules not processed for user `2eabe99e40ef44a09c3f7dc1c78d7608`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:42:57.282452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d96ea5bb-11cd-4896-91c6-19ea3380aac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:42:57.363440 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4124/8307] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:42:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:43:03.612718 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=34 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:07.300308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda6579-0d46-437f-ae77-551fbcb762cc service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:07.301825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bcda6579-0d46-437f-ae77-551fbcb762cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:07.354793 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=25 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:07.377327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda6579-0d46-437f-ae77-551fbcb762cc service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:07.381872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:07.382502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:07.382784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:07.383094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] PATH_INFO: `/v3/users/94aefc3d45e24a2a90c1e4eac92b2697` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:07.384217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94aefc3d45e24a2a90c1e4eac92b2697)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:07.386813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:07.435313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94aefc3d45e24a2a90c1e4eac92b2697'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:07.435978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94aefc3d45e24a2a90c1e4eac92b2697'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:07.450707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94aefc3d45e24a2a90c1e4eac92b2697'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:07.461042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94aefc3d45e24a2a90c1e4eac92b2697'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:07.461942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94aefc3d45e24a2a90c1e4eac92b2697'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:07.480685 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4184/8308] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:43:07 2022] DELETE /identity/v3/users/94aefc3d45e24a2a90c1e4eac92b2697 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:43:07.483428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934896ab-9383-4a77-b82f-53fdd2999613 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:07.483823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934896ab-9383-4a77-b82f-53fdd2999613 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:07.484354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934896ab-9383-4a77-b82f-53fdd2999613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:07.506988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-934896ab-9383-4a77-b82f-53fdd2999613 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:43:07.508136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-934896ab-9383-4a77-b82f-53fdd2999613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:07.594390 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4125/8309] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:43:07.602243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:07.603708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:07.679262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c57df0-820f-44b9-b4ff-794224ffd1d0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:07.683748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad93f8-5b1c-46db-becb-505b352ba51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:07.684491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad93f8-5b1c-46db-becb-505b352ba51c service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:07.684774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad93f8-5b1c-46db-becb-505b352ba51c service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:07.685048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad93f8-5b1c-46db-becb-505b352ba51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:07.695048 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad93f8-5b1c-46db-becb-505b352ba51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:07.696541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad93f8-5b1c-46db-becb-505b352ba51c service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:07.707828 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4185/8310] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:43:07.917369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934896ab-9383-4a77-b82f-53fdd2999613 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:07.919656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-934896ab-9383-4a77-b82f-53fdd2999613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:07.941185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934896ab-9383-4a77-b82f-53fdd2999613 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:07.949184 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c7714-4a69-4b6c-981d-3cfb69da720d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:07.950304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c7714-4a69-4b6c-981d-3cfb69da720d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:07.950874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c7714-4a69-4b6c-981d-3cfb69da720d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:07.951430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c7714-4a69-4b6c-981d-3cfb69da720d admin admin] PATH_INFO: `/v3/projects/59856008e5d1474a916e494267001984` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:07.953243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c7714-4a69-4b6c-981d-3cfb69da720d admin admin] RBAC: Authorizing `identity:delete_project(project_id=59856008e5d1474a916e494267001984)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:07.955506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c7714-4a69-4b6c-981d-3cfb69da720d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:08.021576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a94c7714-4a69-4b6c-981d-3cfb69da720d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59856008e5d1474a916e494267001984', 'request_id': 'req-a94c7714-4a69-4b6c-981d-3cfb69da720d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:08.029197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a94c7714-4a69-4b6c-981d-3cfb69da720d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59856008e5d1474a916e494267001984', 'request_id': 'req-a94c7714-4a69-4b6c-981d-3cfb69da720d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:08.040430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a94c7714-4a69-4b6c-981d-3cfb69da720d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59856008e5d1474a916e494267001984', 'request_id': 'req-a94c7714-4a69-4b6c-981d-3cfb69da720d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:08.053410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a94c7714-4a69-4b6c-981d-3cfb69da720d admin admin] The token cache is being invalidate because project 59856008e5d1474a916e494267001984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:43:08.053764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a94c7714-4a69-4b6c-981d-3cfb69da720d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:08.054381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a94c7714-4a69-4b6c-981d-3cfb69da720d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:08.056192 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4126/8311] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:43:07 2022] DELETE /identity/v3/projects/59856008e5d1474a916e494267001984 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:43:08.061854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969f29-7f93-4afb-a4a3-7f141601adbd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:08.062264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969f29-7f93-4afb-a4a3-7f141601adbd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:08.062614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969f29-7f93-4afb-a4a3-7f141601adbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:08.086082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ee969f29-7f93-4afb-a4a3-7f141601adbd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:43:08.087546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ee969f29-7f93-4afb-a4a3-7f141601adbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:08.108800 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:08.174818 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4186/8312] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:43:08.175811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937c38-63d9-4517-ab83-3e78cf081cc8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:08.176097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937c38-63d9-4517-ab83-3e78cf081cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:08.176370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937c38-63d9-4517-ab83-3e78cf081cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:08.200751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b3937c38-63d9-4517-ab83-3e78cf081cc8 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:43:08.202288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b3937c38-63d9-4517-ab83-3e78cf081cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:08.212190 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4127/8313] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:43:08.217415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee969f29-7f93-4afb-a4a3-7f141601adbd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:08.233879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee969f29-7f93-4afb-a4a3-7f141601adbd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:08.241433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39709c6-3528-4a9a-af22-4898b31b8d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:08.241609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39709c6-3528-4a9a-af22-4898b31b8d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:08.241890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39709c6-3528-4a9a-af22-4898b31b8d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:08.242199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39709c6-3528-4a9a-af22-4898b31b8d56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:08.246605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39709c6-3528-4a9a-af22-4898b31b8d56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:43:08.247031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39709c6-3528-4a9a-af22-4898b31b8d56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:08.248800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39709c6-3528-4a9a-af22-4898b31b8d56 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:08.262170 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4187/8314] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:43:08.266601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3937c38-63d9-4517-ab83-3e78cf081cc8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:08.275935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3937c38-63d9-4517-ab83-3e78cf081cc8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:08.283467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa5c77-7d7a-4f08-ac43-be94fab4acad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:08.284088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa5c77-7d7a-4f08-ac43-be94fab4acad admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:08.284367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa5c77-7d7a-4f08-ac43-be94fab4acad admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:08.284641 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa5c77-7d7a-4f08-ac43-be94fab4acad admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:08.285284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa5c77-7d7a-4f08-ac43-be94fab4acad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:08.287205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa5c77-7d7a-4f08-ac43-be94fab4acad admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:08.325001 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4128/8315] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:43:08 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:43:08.329732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39709c6-3528-4a9a-af22-4898b31b8d56 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:08.340600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39709c6-3528-4a9a-af22-4898b31b8d56 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:08.398699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c969797-ced7-421f-ba62-8acd03999a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:08.399337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c969797-ced7-421f-ba62-8acd03999a97 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:08.399617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c969797-ced7-421f-ba62-8acd03999a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:08.399890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c969797-ced7-421f-ba62-8acd03999a97 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:08.400550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c969797-ced7-421f-ba62-8acd03999a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:08.403008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c969797-ced7-421f-ba62-8acd03999a97 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:08.425365 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4188/8316] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:43:08 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:43:08.429593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa5c77-7d7a-4f08-ac43-be94fab4acad admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:08.440339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa5c77-7d7a-4f08-ac43-be94fab4acad admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:08.445060 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f444326-07b3-47b0-9ff1-04e780a544f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:08.445649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f444326-07b3-47b0-9ff1-04e780a544f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:08.445924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f444326-07b3-47b0-9ff1-04e780a544f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:08.446198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f444326-07b3-47b0-9ff1-04e780a544f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:08.446829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f444326-07b3-47b0-9ff1-04e780a544f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:08.448841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f444326-07b3-47b0-9ff1-04e780a544f7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:08.459819 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4129/8317] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:43:08.464609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c969797-ced7-421f-ba62-8acd03999a97 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:08.474961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c969797-ced7-421f-ba62-8acd03999a97 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:08.480471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa0f59-7113-43c8-bd74-706b67860f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:08.481079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa0f59-7113-43c8-bd74-706b67860f7e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:08.481356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa0f59-7113-43c8-bd74-706b67860f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:08.481629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa0f59-7113-43c8-bd74-706b67860f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:08.482286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa0f59-7113-43c8-bd74-706b67860f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:08.483939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa0f59-7113-43c8-bd74-706b67860f7e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:08.494756 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4189/8318] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:43:08.499119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f444326-07b3-47b0-9ff1-04e780a544f7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:08.509322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f444326-07b3-47b0-9ff1-04e780a544f7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:08.515030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070f07d-a786-47d3-a940-f029e9066ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:08.515689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070f07d-a786-47d3-a940-f029e9066ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:08.516169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070f07d-a786-47d3-a940-f029e9066ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:08.516451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070f07d-a786-47d3-a940-f029e9066ac1 admin admin] PATH_INFO: `/v3/projects/ae34b440996e4aefa88f4d5c43735ac2/users/dc72c32e3a6f4cd588eb8122fc9d15ce/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:08.532343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070f07d-a786-47d3-a940-f029e9066ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae34b440996e4aefa88f4d5c43735ac2, user_id=dc72c32e3a6f4cd588eb8122fc9d15ce, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:08.535034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070f07d-a786-47d3-a940-f029e9066ac1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:08.549483 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4130/8319] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:43:08 2022] PUT /identity/v3/projects/ae34b440996e4aefa88f4d5c43735ac2/users/dc72c32e3a6f4cd588eb8122fc9d15ce/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:43:08.559878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1542d23-6391-41b3-8832-af6632bb2194 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:08.560170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1542d23-6391-41b3-8832-af6632bb2194 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:08.560442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1542d23-6391-41b3-8832-af6632bb2194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:08.589939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e1542d23-6391-41b3-8832-af6632bb2194 None None] MFA Rules not processed for user `dc72c32e3a6f4cd588eb8122fc9d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:43:08.591176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e1542d23-6391-41b3-8832-af6632bb2194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:08.659017 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4190/8320] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:43:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:43:08.671498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070f07d-a786-47d3-a940-f029e9066ac1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:08.673338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f070f07d-a786-47d3-a940-f029e9066ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:08.696601 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:08.740540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070f07d-a786-47d3-a940-f029e9066ac1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:08.744263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa9a90-c981-42b0-b44e-6c8499e8946c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:08.744921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa9a90-c981-42b0-b44e-6c8499e8946c service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:08.745795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa9a90-c981-42b0-b44e-6c8499e8946c service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:08.746071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa9a90-c981-42b0-b44e-6c8499e8946c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:08.755295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa9a90-c981-42b0-b44e-6c8499e8946c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:08.756752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa9a90-c981-42b0-b44e-6c8499e8946c service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:08.766841 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4131/8321] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:43:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:43:18.655993 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:18.762230 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=17 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:23.653983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542bc67-9dbe-4056-913b-6e1f28f58aa2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:23.654530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542bc67-9dbe-4056-913b-6e1f28f58aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:23.655770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542bc67-9dbe-4056-913b-6e1f28f58aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:23.675027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d542bc67-9dbe-4056-913b-6e1f28f58aa2 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:43:23.676235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d542bc67-9dbe-4056-913b-6e1f28f58aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:23.736806 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4191/8322] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:43:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:43:23.785313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa9a90-c981-42b0-b44e-6c8499e8946c service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:23.786807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-87aa9a90-c981-42b0-b44e-6c8499e8946c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:23.881911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa9a90-c981-42b0-b44e-6c8499e8946c service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:23.887840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e93d57-b08e-4f42-b52f-ec73c9b9c821 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:23.888451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e93d57-b08e-4f42-b52f-ec73c9b9c821 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:23.888727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e93d57-b08e-4f42-b52f-ec73c9b9c821 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:23.888996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e93d57-b08e-4f42-b52f-ec73c9b9c821 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:23.898537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e93d57-b08e-4f42-b52f-ec73c9b9c821 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:23.900238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e93d57-b08e-4f42-b52f-ec73c9b9c821 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:23.915106 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4132/8323] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:43:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:43:24.336115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98324ea-281e-4f59-b08f-351f84f90688 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:24.336398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98324ea-281e-4f59-b08f-351f84f90688 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:24.336665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98324ea-281e-4f59-b08f-351f84f90688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:24.358342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f98324ea-281e-4f59-b08f-351f84f90688 None None] MFA Rules not processed for user `2eabe99e40ef44a09c3f7dc1c78d7608`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:43:24.359595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f98324ea-281e-4f59-b08f-351f84f90688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:24.417253 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4192/8324] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:43:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:43:28.274506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e93d57-b08e-4f42-b52f-ec73c9b9c821 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:28.277496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c4e93d57-b08e-4f42-b52f-ec73c9b9c821 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:28.424413 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e93d57-b08e-4f42-b52f-ec73c9b9c821 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:28.433270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7509b-2001-4453-a673-f293fd9d53ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:28.434128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7509b-2001-4453-a673-f293fd9d53ea service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:28.434417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7509b-2001-4453-a673-f293fd9d53ea service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:28.434699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7509b-2001-4453-a673-f293fd9d53ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:28.437343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-afe7509b-2001-4453-a673-f293fd9d53ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:28.478514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7509b-2001-4453-a673-f293fd9d53ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:28.481831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7509b-2001-4453-a673-f293fd9d53ea service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:28.508756 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4133/8325] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:43:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:43:28.895720 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98324ea-281e-4f59-b08f-351f84f90688 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:28.897173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f98324ea-281e-4f59-b08f-351f84f90688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:29.037691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98324ea-281e-4f59-b08f-351f84f90688 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:29.052832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d449c91-bcf7-4bea-8d2a-c8a530d081dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:29.053481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d449c91-bcf7-4bea-8d2a-c8a530d081dd service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:29.053762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d449c91-bcf7-4bea-8d2a-c8a530d081dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:29.059741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d449c91-bcf7-4bea-8d2a-c8a530d081dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:29.064543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d449c91-bcf7-4bea-8d2a-c8a530d081dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:29.113333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d449c91-bcf7-4bea-8d2a-c8a530d081dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:29.115906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d449c91-bcf7-4bea-8d2a-c8a530d081dd service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:29.162959 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4193/8326] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:43:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:43:29.764889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7509b-2001-4453-a673-f293fd9d53ea service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:29.766547 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-afe7509b-2001-4453-a673-f293fd9d53ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:29.793490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7509b-2001-4453-a673-f293fd9d53ea service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:29.799791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449afb1-ad01-4282-aef1-09825458a3a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:29.802819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449afb1-ad01-4282-aef1-09825458a3a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:29.803548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449afb1-ad01-4282-aef1-09825458a3a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:29.803831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449afb1-ad01-4282-aef1-09825458a3a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:29.808204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e449afb1-ad01-4282-aef1-09825458a3a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:29.986669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449afb1-ad01-4282-aef1-09825458a3a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:29.988643 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449afb1-ad01-4282-aef1-09825458a3a9 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:30.022610 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4134/8327] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:43:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:43:39.148816 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=76 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:40.002815 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:43.906973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d449c91-bcf7-4bea-8d2a-c8a530d081dd service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:43.930700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d449c91-bcf7-4bea-8d2a-c8a530d081dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:43.950556 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d449c91-bcf7-4bea-8d2a-c8a530d081dd service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:43.958625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182903a6-7e93-4035-be4f-db2f268082fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:43.959385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182903a6-7e93-4035-be4f-db2f268082fd service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:43.959737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182903a6-7e93-4035-be4f-db2f268082fd service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:43.960080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182903a6-7e93-4035-be4f-db2f268082fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:43.962255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-182903a6-7e93-4035-be4f-db2f268082fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:43.981247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182903a6-7e93-4035-be4f-db2f268082fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:43.983941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182903a6-7e93-4035-be4f-db2f268082fd service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:44.001784 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4194/8328] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:43:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:43:46.238520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449afb1-ad01-4282-aef1-09825458a3a9 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:46.240532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e449afb1-ad01-4282-aef1-09825458a3a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:46.313171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449afb1-ad01-4282-aef1-09825458a3a9 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:46.317675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:46.318308 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:46.318584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:46.318856 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] PATH_INFO: `/v3/users/006dce5da5944dfdb48ec8da4b41fd37` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:46.320031 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=006dce5da5944dfdb48ec8da4b41fd37)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:46.321932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:46.379680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006dce5da5944dfdb48ec8da4b41fd37'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:46.380414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006dce5da5944dfdb48ec8da4b41fd37'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:46.393839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006dce5da5944dfdb48ec8da4b41fd37'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:46.402372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006dce5da5944dfdb48ec8da4b41fd37'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:46.403022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006dce5da5944dfdb48ec8da4b41fd37'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:46.416210 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4135/8329] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:43:46 2022] DELETE /identity/v3/users/006dce5da5944dfdb48ec8da4b41fd37 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:43:46.420740 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e137c0-ca3b-488b-be2b-26c0beac03a2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:46.421208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e137c0-ca3b-488b-be2b-26c0beac03a2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:46.421416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e137c0-ca3b-488b-be2b-26c0beac03a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:46.441252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-10e137c0-ca3b-488b-be2b-26c0beac03a2 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:43:46.442453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-10e137c0-ca3b-488b-be2b-26c0beac03a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:46.507048 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4195/8330] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:43:46.517830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:46.519417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:46.582195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5bf2d-29af-451a-9905-a0fdf74ef4b6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:46.586114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a25e8-5376-40e4-9d69-e89d2500e5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:46.586773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a25e8-5376-40e4-9d69-e89d2500e5be service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:46.587083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a25e8-5376-40e4-9d69-e89d2500e5be service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:46.587354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a25e8-5376-40e4-9d69-e89d2500e5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:46.598423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a25e8-5376-40e4-9d69-e89d2500e5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:46.599946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a25e8-5376-40e4-9d69-e89d2500e5be service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:46.611551 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4136/8331] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:43:47.080200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e137c0-ca3b-488b-be2b-26c0beac03a2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:47.081812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-10e137c0-ca3b-488b-be2b-26c0beac03a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:47.101080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e137c0-ca3b-488b-be2b-26c0beac03a2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:47.122901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe858c7e-916a-40e3-a09d-c611b1c9708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:47.123629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe858c7e-916a-40e3-a09d-c611b1c9708d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:47.124371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe858c7e-916a-40e3-a09d-c611b1c9708d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:47.124506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe858c7e-916a-40e3-a09d-c611b1c9708d admin admin] PATH_INFO: `/v3/projects/c2a3cffe53f546dab8d2d49e4fa923e8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:47.126506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe858c7e-916a-40e3-a09d-c611b1c9708d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2a3cffe53f546dab8d2d49e4fa923e8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:47.128724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe858c7e-916a-40e3-a09d-c611b1c9708d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:47.191460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fe858c7e-916a-40e3-a09d-c611b1c9708d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a3cffe53f546dab8d2d49e4fa923e8', 'request_id': 'req-fe858c7e-916a-40e3-a09d-c611b1c9708d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:47.199267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fe858c7e-916a-40e3-a09d-c611b1c9708d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a3cffe53f546dab8d2d49e4fa923e8', 'request_id': 'req-fe858c7e-916a-40e3-a09d-c611b1c9708d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:47.208961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fe858c7e-916a-40e3-a09d-c611b1c9708d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a3cffe53f546dab8d2d49e4fa923e8', 'request_id': 'req-fe858c7e-916a-40e3-a09d-c611b1c9708d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:47.221890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fe858c7e-916a-40e3-a09d-c611b1c9708d admin admin] The token cache is being invalidate because project c2a3cffe53f546dab8d2d49e4fa923e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:43:47.222295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fe858c7e-916a-40e3-a09d-c611b1c9708d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:47.223131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fe858c7e-916a-40e3-a09d-c611b1c9708d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:47.224838 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4196/8332] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:43:47 2022] DELETE /identity/v3/projects/c2a3cffe53f546dab8d2d49e4fa923e8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:43:47.231293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c06b0-d0c4-4147-b616-15f20181246c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:47.231616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c06b0-d0c4-4147-b616-15f20181246c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:47.231915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c06b0-d0c4-4147-b616-15f20181246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:47.254395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e38c06b0-d0c4-4147-b616-15f20181246c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:43:47.255703 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e38c06b0-d0c4-4147-b616-15f20181246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:47.276316 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:47.332053 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4137/8333] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:43:47.341831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a521f5-935c-4fe8-b0ef-e30d7e73d120 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:47.342307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a521f5-935c-4fe8-b0ef-e30d7e73d120 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:47.342436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a521f5-935c-4fe8-b0ef-e30d7e73d120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:47.366737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-71a521f5-935c-4fe8-b0ef-e30d7e73d120 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:43:47.368319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-71a521f5-935c-4fe8-b0ef-e30d7e73d120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:47.397021 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4197/8334] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:43:47.412311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c06b0-d0c4-4147-b616-15f20181246c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:47.423804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c06b0-d0c4-4147-b616-15f20181246c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:47.429598 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba8861-7b2a-45fb-8ed9-44cb2991e192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:47.430421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba8861-7b2a-45fb-8ed9-44cb2991e192 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:47.431026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba8861-7b2a-45fb-8ed9-44cb2991e192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:47.431323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba8861-7b2a-45fb-8ed9-44cb2991e192 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:47.433329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba8861-7b2a-45fb-8ed9-44cb2991e192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:43:47.433656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba8861-7b2a-45fb-8ed9-44cb2991e192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:47.435934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba8861-7b2a-45fb-8ed9-44cb2991e192 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:47.449650 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4138/8335] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:43:47.454903 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a521f5-935c-4fe8-b0ef-e30d7e73d120 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:47.469281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a521f5-935c-4fe8-b0ef-e30d7e73d120 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:47.477258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae6efa-c957-41c3-b053-fc967ae5c623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:47.478722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae6efa-c957-41c3-b053-fc967ae5c623 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:47.479411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae6efa-c957-41c3-b053-fc967ae5c623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:47.479411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae6efa-c957-41c3-b053-fc967ae5c623 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:47.480245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae6efa-c957-41c3-b053-fc967ae5c623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:47.482361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae6efa-c957-41c3-b053-fc967ae5c623 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:47.519367 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4198/8336] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:43:47 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:43:47.524252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba8861-7b2a-45fb-8ed9-44cb2991e192 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:47.538767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba8861-7b2a-45fb-8ed9-44cb2991e192 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:47.620434 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc57f9-cd5e-4759-af43-74a2d3c94a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:47.621074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc57f9-cd5e-4759-af43-74a2d3c94a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:47.621361 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc57f9-cd5e-4759-af43-74a2d3c94a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:47.621756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc57f9-cd5e-4759-af43-74a2d3c94a00 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:47.622539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc57f9-cd5e-4759-af43-74a2d3c94a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:47.625273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc57f9-cd5e-4759-af43-74a2d3c94a00 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:47.655759 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4139/8337] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:43:47 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:43:47.659319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae6efa-c957-41c3-b053-fc967ae5c623 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:47.673661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae6efa-c957-41c3-b053-fc967ae5c623 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:47.680078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1a447-4cee-4fbd-8c44-72e70959dd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:47.680887 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1a447-4cee-4fbd-8c44-72e70959dd20 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:47.681201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1a447-4cee-4fbd-8c44-72e70959dd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:47.682143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1a447-4cee-4fbd-8c44-72e70959dd20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:47.682816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1a447-4cee-4fbd-8c44-72e70959dd20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:47.685009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1a447-4cee-4fbd-8c44-72e70959dd20 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:47.702276 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4199/8338] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:43:47.703691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc57f9-cd5e-4759-af43-74a2d3c94a00 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:47.718323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc57f9-cd5e-4759-af43-74a2d3c94a00 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:47.723297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e37cb-68b1-461d-8aea-d843126e8bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:47.723929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e37cb-68b1-461d-8aea-d843126e8bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:47.724198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e37cb-68b1-461d-8aea-d843126e8bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:47.724517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e37cb-68b1-461d-8aea-d843126e8bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:47.725248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e37cb-68b1-461d-8aea-d843126e8bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:47.726857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e37cb-68b1-461d-8aea-d843126e8bcb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:47.739755 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4140/8339] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:43:47.744327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1a447-4cee-4fbd-8c44-72e70959dd20 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:47.755600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1a447-4cee-4fbd-8c44-72e70959dd20 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:47.761324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc310c-1093-4dd3-9b05-009aabb02044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:47.761969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc310c-1093-4dd3-9b05-009aabb02044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:47.762245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc310c-1093-4dd3-9b05-009aabb02044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:47.762514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc310c-1093-4dd3-9b05-009aabb02044 admin admin] PATH_INFO: `/v3/projects/df5e0a86c01449ed8a195480a9384cca/users/e2338814a5874ecc9809c0a9b1cee41a/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:47.778845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc310c-1093-4dd3-9b05-009aabb02044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5e0a86c01449ed8a195480a9384cca, user_id=e2338814a5874ecc9809c0a9b1cee41a, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:47.782064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc310c-1093-4dd3-9b05-009aabb02044 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:47.796089 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4200/8340] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:43:47 2022] PUT /identity/v3/projects/df5e0a86c01449ed8a195480a9384cca/users/e2338814a5874ecc9809c0a9b1cee41a/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:43:47.808150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa9c73-4e02-4685-a929-1c9f75b05e90 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:47.808474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa9c73-4e02-4685-a929-1c9f75b05e90 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:47.808876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa9c73-4e02-4685-a929-1c9f75b05e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:47.842686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c4aa9c73-4e02-4685-a929-1c9f75b05e90 None None] MFA Rules not processed for user `e2338814a5874ecc9809c0a9b1cee41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:43:47.844097 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c4aa9c73-4e02-4685-a929-1c9f75b05e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:47.949639 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4141/8341] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:43:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:43:47.961060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc310c-1093-4dd3-9b05-009aabb02044 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:47.962847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d7dc310c-1093-4dd3-9b05-009aabb02044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:47.973596 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:48.034328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc310c-1093-4dd3-9b05-009aabb02044 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:48.038983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72dcaa-02c6-4f84-b011-8c53822d75c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:48.039628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72dcaa-02c6-4f84-b011-8c53822d75c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:48.039977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72dcaa-02c6-4f84-b011-8c53822d75c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:48.040310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72dcaa-02c6-4f84-b011-8c53822d75c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:48.052761 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72dcaa-02c6-4f84-b011-8c53822d75c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:48.054427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72dcaa-02c6-4f84-b011-8c53822d75c0 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:48.064553 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4201/8342] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:43:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:43:52.316167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa9c73-4e02-4685-a929-1c9f75b05e90 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:52.318862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c4aa9c73-4e02-4685-a929-1c9f75b05e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:52.353810 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:52.460832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa9c73-4e02-4685-a929-1c9f75b05e90 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:52.472497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:52.473674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:52.476891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:52.477160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] PATH_INFO: `/v3/users/dc72c32e3a6f4cd588eb8122fc9d15ce` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:52.480028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc72c32e3a6f4cd588eb8122fc9d15ce)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:52.485766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:52.563631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc72c32e3a6f4cd588eb8122fc9d15ce'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:52.564591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc72c32e3a6f4cd588eb8122fc9d15ce'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:52.581092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc72c32e3a6f4cd588eb8122fc9d15ce'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:52.590524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc72c32e3a6f4cd588eb8122fc9d15ce'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:52.591192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc72c32e3a6f4cd588eb8122fc9d15ce'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:52.606715 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4142/8343] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:43:52 2022] DELETE /identity/v3/users/dc72c32e3a6f4cd588eb8122fc9d15ce => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:43:52.611008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b52c3-9431-41a6-b6d8-c863d1ae4445 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:52.611615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b52c3-9431-41a6-b6d8-c863d1ae4445 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:52.611615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b52c3-9431-41a6-b6d8-c863d1ae4445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:52.633143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c08b52c3-9431-41a6-b6d8-c863d1ae4445 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:43:52.634885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c08b52c3-9431-41a6-b6d8-c863d1ae4445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:52.704535 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4202/8344] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:43:52.711439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:52.714208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:52.801165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c880ed-9cbe-423b-b536-e0cbaedc0daf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:52.804386 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb64a5d-9c6c-431c-9452-5327b0c88c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:52.805087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb64a5d-9c6c-431c-9452-5327b0c88c39 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:52.805369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb64a5d-9c6c-431c-9452-5327b0c88c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:52.805660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb64a5d-9c6c-431c-9452-5327b0c88c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:52.823707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb64a5d-9c6c-431c-9452-5327b0c88c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:52.825392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb64a5d-9c6c-431c-9452-5327b0c88c39 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:52.839308 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4143/8345] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:43:53.343975 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b52c3-9431-41a6-b6d8-c863d1ae4445 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:53.345638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c08b52c3-9431-41a6-b6d8-c863d1ae4445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:53.372526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b52c3-9431-41a6-b6d8-c863d1ae4445 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:53.388880 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:53.389953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:53.390235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:53.390507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] PATH_INFO: `/v3/projects/ae34b440996e4aefa88f4d5c43735ac2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:53.392144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae34b440996e4aefa88f4d5c43735ac2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:53.394600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:53.448231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae34b440996e4aefa88f4d5c43735ac2', 'request_id': 'req-d3ff4000-702c-4f11-802c-73618f3db7ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:53.459334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae34b440996e4aefa88f4d5c43735ac2', 'request_id': 'req-d3ff4000-702c-4f11-802c-73618f3db7ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:53.471619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae34b440996e4aefa88f4d5c43735ac2', 'request_id': 'req-d3ff4000-702c-4f11-802c-73618f3db7ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:53.485056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] The token cache is being invalidate because project ae34b440996e4aefa88f4d5c43735ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:43:53.485384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:53.486003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:43:53.488165 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4203/8346] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:43:53 2022] DELETE /identity/v3/projects/ae34b440996e4aefa88f4d5c43735ac2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:43:55.571204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb64a5d-9c6c-431c-9452-5327b0c88c39 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:43:55.574356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4fb64a5d-9c6c-431c-9452-5327b0c88c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:55.628885 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:55.675592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb64a5d-9c6c-431c-9452-5327b0c88c39 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:43:55.747356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d7ea2-f1df-482d-81ad-586477f2a2df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:43:55.748105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d7ea2-f1df-482d-81ad-586477f2a2df service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:43:55.748488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d7ea2-f1df-482d-81ad-586477f2a2df service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:43:55.748857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d7ea2-f1df-482d-81ad-586477f2a2df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:43:55.750829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bc3d7ea2-f1df-482d-81ad-586477f2a2df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:43:55.825174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d7ea2-f1df-482d-81ad-586477f2a2df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:43:55.827200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d7ea2-f1df-482d-81ad-586477f2a2df service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:43:55.841321 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4144/8347] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:43:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:44:03.481417 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:05.835302 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=66 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:06.464705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:06.466374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:06.552515 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff4000-702c-4f11-802c-73618f3db7ea admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:06.566777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:06.566777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:06.566777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:06.566777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] PATH_INFO: `/v3/users/e2338814a5874ecc9809c0a9b1cee41a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:06.570005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2338814a5874ecc9809c0a9b1cee41a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:06.572359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:06.632450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2338814a5874ecc9809c0a9b1cee41a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:06.633785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2338814a5874ecc9809c0a9b1cee41a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:06.657634 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2338814a5874ecc9809c0a9b1cee41a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:06.666809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2338814a5874ecc9809c0a9b1cee41a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:06.667487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2338814a5874ecc9809c0a9b1cee41a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:06.685584 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4204/8348] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:44:06 2022] DELETE /identity/v3/users/e2338814a5874ecc9809c0a9b1cee41a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:06.690195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bef2b-00ad-47e9-b2cf-24aeee6a2f0e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:06.690445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bef2b-00ad-47e9-b2cf-24aeee6a2f0e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:06.690743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bef2b-00ad-47e9-b2cf-24aeee6a2f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:06.710964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-414bef2b-00ad-47e9-b2cf-24aeee6a2f0e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:06.712206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-414bef2b-00ad-47e9-b2cf-24aeee6a2f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:06.795972 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4145/8349] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:06.807660 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:06.809212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:06.875081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f8718-d717-453e-bb6f-d1c02526d2d8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:06.878738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98f957-e0c7-4e40-bf5a-0aeb21022cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:06.879410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98f957-e0c7-4e40-bf5a-0aeb21022cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:06.879719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98f957-e0c7-4e40-bf5a-0aeb21022cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:06.879993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98f957-e0c7-4e40-bf5a-0aeb21022cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:06.890635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98f957-e0c7-4e40-bf5a-0aeb21022cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:06.892101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98f957-e0c7-4e40-bf5a-0aeb21022cf4 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:06.903314 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4205/8350] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:44:07.189408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bef2b-00ad-47e9-b2cf-24aeee6a2f0e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:07.190995 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-414bef2b-00ad-47e9-b2cf-24aeee6a2f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:07.207905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bef2b-00ad-47e9-b2cf-24aeee6a2f0e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:07.213778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15343f-43f2-4559-8572-1bdb02d17cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:07.214430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15343f-43f2-4559-8572-1bdb02d17cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:07.214818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15343f-43f2-4559-8572-1bdb02d17cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:07.215034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15343f-43f2-4559-8572-1bdb02d17cf0 admin admin] PATH_INFO: `/v3/projects/df5e0a86c01449ed8a195480a9384cca` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:07.216126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15343f-43f2-4559-8572-1bdb02d17cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5e0a86c01449ed8a195480a9384cca)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:07.219121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15343f-43f2-4559-8572-1bdb02d17cf0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:07.271460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a15343f-43f2-4559-8572-1bdb02d17cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5e0a86c01449ed8a195480a9384cca', 'request_id': 'req-7a15343f-43f2-4559-8572-1bdb02d17cf0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:07.278307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a15343f-43f2-4559-8572-1bdb02d17cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5e0a86c01449ed8a195480a9384cca', 'request_id': 'req-7a15343f-43f2-4559-8572-1bdb02d17cf0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:07.287324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a15343f-43f2-4559-8572-1bdb02d17cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5e0a86c01449ed8a195480a9384cca', 'request_id': 'req-7a15343f-43f2-4559-8572-1bdb02d17cf0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:07.300900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a15343f-43f2-4559-8572-1bdb02d17cf0 admin admin] The token cache is being invalidate because project df5e0a86c01449ed8a195480a9384cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:44:07.301268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a15343f-43f2-4559-8572-1bdb02d17cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:07.301956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a15343f-43f2-4559-8572-1bdb02d17cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:07.303649 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4146/8351] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:44:07 2022] DELETE /identity/v3/projects/df5e0a86c01449ed8a195480a9384cca => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:07.309453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bae9d-9ebe-4690-a5be-995eff829147 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:07.309902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bae9d-9ebe-4690-a5be-995eff829147 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:07.310317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bae9d-9ebe-4690-a5be-995eff829147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:07.332356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0c3bae9d-9ebe-4690-a5be-995eff829147 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:07.333590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0c3bae9d-9ebe-4690-a5be-995eff829147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:07.354864 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:07.410242 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4206/8352] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:07.419889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186163e-f561-4164-8e84-8de22bedebaf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:07.420174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186163e-f561-4164-8e84-8de22bedebaf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:07.420451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186163e-f561-4164-8e84-8de22bedebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:07.443067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4186163e-f561-4164-8e84-8de22bedebaf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:07.444336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4186163e-f561-4164-8e84-8de22bedebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:07.460673 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4147/8353] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:07.468811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bae9d-9ebe-4690-a5be-995eff829147 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:07.479327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bae9d-9ebe-4690-a5be-995eff829147 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:07.484344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a82a71-7608-46b5-a288-63d72e291895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:07.484983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82a71-7608-46b5-a288-63d72e291895 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:07.485263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82a71-7608-46b5-a288-63d72e291895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:07.485562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82a71-7608-46b5-a288-63d72e291895 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:07.486215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a82a71-7608-46b5-a288-63d72e291895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:44:07.486517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a82a71-7608-46b5-a288-63d72e291895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:07.488198 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a82a71-7608-46b5-a288-63d72e291895 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:07.500431 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4207/8354] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:44:07.504532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186163e-f561-4164-8e84-8de22bedebaf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:07.514217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186163e-f561-4164-8e84-8de22bedebaf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:07.518869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14af1d6-3b19-435f-94e8-8bd974ada902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:07.519517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14af1d6-3b19-435f-94e8-8bd974ada902 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:07.519792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14af1d6-3b19-435f-94e8-8bd974ada902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:07.520059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14af1d6-3b19-435f-94e8-8bd974ada902 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:07.520681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14af1d6-3b19-435f-94e8-8bd974ada902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:07.522626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14af1d6-3b19-435f-94e8-8bd974ada902 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:07.553359 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4148/8355] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:44:07 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:44:07.558172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a82a71-7608-46b5-a288-63d72e291895 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:07.573516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a82a71-7608-46b5-a288-63d72e291895 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:07.642379 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e9eef-84b3-475c-8ec2-9ec5f1ecf974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:07.643026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e9eef-84b3-475c-8ec2-9ec5f1ecf974 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:07.643308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e9eef-84b3-475c-8ec2-9ec5f1ecf974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:07.643584 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e9eef-84b3-475c-8ec2-9ec5f1ecf974 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:07.644218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e9eef-84b3-475c-8ec2-9ec5f1ecf974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:07.646136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e9eef-84b3-475c-8ec2-9ec5f1ecf974 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:07.672795 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4208/8356] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:44:07 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:44:07.677125 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14af1d6-3b19-435f-94e8-8bd974ada902 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:07.689980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14af1d6-3b19-435f-94e8-8bd974ada902 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:07.694859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d56f1-14ed-40f1-8c9c-662768b60ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:07.695545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d56f1-14ed-40f1-8c9c-662768b60ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:07.696474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d56f1-14ed-40f1-8c9c-662768b60ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:07.696741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d56f1-14ed-40f1-8c9c-662768b60ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:07.697377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d56f1-14ed-40f1-8c9c-662768b60ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:07.699014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d56f1-14ed-40f1-8c9c-662768b60ab6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:07.713874 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4149/8357] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:44:07.715217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e9eef-84b3-475c-8ec2-9ec5f1ecf974 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:07.725919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e9eef-84b3-475c-8ec2-9ec5f1ecf974 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:07.731777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bad29-c31a-42c0-9a3b-fc4edc01bd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:07.732587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bad29-c31a-42c0-9a3b-fc4edc01bd7a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:07.732955 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bad29-c31a-42c0-9a3b-fc4edc01bd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:07.733329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bad29-c31a-42c0-9a3b-fc4edc01bd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:07.734089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bad29-c31a-42c0-9a3b-fc4edc01bd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:07.735863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bad29-c31a-42c0-9a3b-fc4edc01bd7a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:07.748733 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4209/8358] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:44:07.753301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d56f1-14ed-40f1-8c9c-662768b60ab6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:07.765311 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d56f1-14ed-40f1-8c9c-662768b60ab6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:07.770564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f9827-835c-4fee-866c-14283c521b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:07.771404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f9827-835c-4fee-866c-14283c521b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:07.772088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f9827-835c-4fee-866c-14283c521b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:07.772411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f9827-835c-4fee-866c-14283c521b5c admin admin] PATH_INFO: `/v3/projects/e8e01a55ddee461ea90f2cf0331870bc/users/e731041baf06433f9e93dce723fbe60e/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:07.791606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f9827-835c-4fee-866c-14283c521b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e01a55ddee461ea90f2cf0331870bc, user_id=e731041baf06433f9e93dce723fbe60e, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:07.794576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f9827-835c-4fee-866c-14283c521b5c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:07.809658 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4150/8359] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:44:07 2022] PUT /identity/v3/projects/e8e01a55ddee461ea90f2cf0331870bc/users/e731041baf06433f9e93dce723fbe60e/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:07.820175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3921ed-af7f-47eb-a1d6-49e7c81c1a1b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:07.820999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3921ed-af7f-47eb-a1d6-49e7c81c1a1b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:07.821277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3921ed-af7f-47eb-a1d6-49e7c81c1a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:07.849924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9e3921ed-af7f-47eb-a1d6-49e7c81c1a1b None None] MFA Rules not processed for user `e731041baf06433f9e93dce723fbe60e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:07.851193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9e3921ed-af7f-47eb-a1d6-49e7c81c1a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:07.920324 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4210/8360] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:07.932366 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f9827-835c-4fee-866c-14283c521b5c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:07.934074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-da0f9827-835c-4fee-866c-14283c521b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:07.956990 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:07.998480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f9827-835c-4fee-866c-14283c521b5c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:08.002176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f43132-3ac7-471f-96b4-2f37ef22db67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:08.002783 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f43132-3ac7-471f-96b4-2f37ef22db67 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:08.003142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f43132-3ac7-471f-96b4-2f37ef22db67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:08.003440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f43132-3ac7-471f-96b4-2f37ef22db67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:08.012508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f43132-3ac7-471f-96b4-2f37ef22db67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:08.013986 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f43132-3ac7-471f-96b4-2f37ef22db67 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:08.022876 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4151/8361] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:44:07 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:44:16.277244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3921ed-af7f-47eb-a1d6-49e7c81c1a1b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:16.298300 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:16.348250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3921ed-af7f-47eb-a1d6-49e7c81c1a1b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:16.353200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:16.353904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:16.354187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:16.354564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] PATH_INFO: `/v3/users/e731041baf06433f9e93dce723fbe60e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:16.355808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e731041baf06433f9e93dce723fbe60e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:16.357797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:16.411401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e731041baf06433f9e93dce723fbe60e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:16.412534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e731041baf06433f9e93dce723fbe60e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:16.426989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e731041baf06433f9e93dce723fbe60e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:16.437522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e731041baf06433f9e93dce723fbe60e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:16.438534 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e731041baf06433f9e93dce723fbe60e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:16.454364 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4211/8362] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:44:16 2022] DELETE /identity/v3/users/e731041baf06433f9e93dce723fbe60e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:16.458771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e51b9c-cc5a-4c64-b05f-3f3602ca893f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:16.460088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e51b9c-cc5a-4c64-b05f-3f3602ca893f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:16.460661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e51b9c-cc5a-4c64-b05f-3f3602ca893f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:16.485199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-05e51b9c-cc5a-4c64-b05f-3f3602ca893f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:16.487738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-05e51b9c-cc5a-4c64-b05f-3f3602ca893f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:16.574267 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4152/8363] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:16.588125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:16.589590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:16.651100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e19d3c-bb7f-4995-b198-b57e8fd58fa3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:16.655310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d9203-c13f-4aa2-af12-72902e313e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:16.655940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d9203-c13f-4aa2-af12-72902e313e18 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:16.656221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d9203-c13f-4aa2-af12-72902e313e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:16.656497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d9203-c13f-4aa2-af12-72902e313e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:16.667905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d9203-c13f-4aa2-af12-72902e313e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:16.669394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d9203-c13f-4aa2-af12-72902e313e18 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:16.681082 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4212/8364] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:44:16.983843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e51b9c-cc5a-4c64-b05f-3f3602ca893f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:16.985491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-05e51b9c-cc5a-4c64-b05f-3f3602ca893f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:17.000567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e51b9c-cc5a-4c64-b05f-3f3602ca893f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:17.006668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249e73c-1d8f-4884-8950-a5e0d50af6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:17.008153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e73c-1d8f-4884-8950-a5e0d50af6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:17.008610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e73c-1d8f-4884-8950-a5e0d50af6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:17.009047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e73c-1d8f-4884-8950-a5e0d50af6e2 admin admin] PATH_INFO: `/v3/projects/e8e01a55ddee461ea90f2cf0331870bc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:17.010749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249e73c-1d8f-4884-8950-a5e0d50af6e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e01a55ddee461ea90f2cf0331870bc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:17.013613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249e73c-1d8f-4884-8950-a5e0d50af6e2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:17.074098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7249e73c-1d8f-4884-8950-a5e0d50af6e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e01a55ddee461ea90f2cf0331870bc', 'request_id': 'req-7249e73c-1d8f-4884-8950-a5e0d50af6e2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:17.081955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7249e73c-1d8f-4884-8950-a5e0d50af6e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e01a55ddee461ea90f2cf0331870bc', 'request_id': 'req-7249e73c-1d8f-4884-8950-a5e0d50af6e2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:17.092025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7249e73c-1d8f-4884-8950-a5e0d50af6e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e01a55ddee461ea90f2cf0331870bc', 'request_id': 'req-7249e73c-1d8f-4884-8950-a5e0d50af6e2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:17.105622 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7249e73c-1d8f-4884-8950-a5e0d50af6e2 admin admin] The token cache is being invalidate because project e8e01a55ddee461ea90f2cf0331870bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:44:17.105915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7249e73c-1d8f-4884-8950-a5e0d50af6e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:17.106572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7249e73c-1d8f-4884-8950-a5e0d50af6e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:17.111776 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4153/8365] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:44:16 2022] DELETE /identity/v3/projects/e8e01a55ddee461ea90f2cf0331870bc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:44:17.113540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e2064-86a3-4ed6-85b2-5ffcff5f98e3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:17.113851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e2064-86a3-4ed6-85b2-5ffcff5f98e3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:17.114171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e2064-86a3-4ed6-85b2-5ffcff5f98e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:17.136891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-075e2064-86a3-4ed6-85b2-5ffcff5f98e3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:17.138158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-075e2064-86a3-4ed6-85b2-5ffcff5f98e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:17.177449 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:17.220073 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4213/8366] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:17.222084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae7d19-5f28-4085-85e4-a55bdd16457f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:17.222502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae7d19-5f28-4085-85e4-a55bdd16457f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:17.222781 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae7d19-5f28-4085-85e4-a55bdd16457f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:17.246538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-46ae7d19-5f28-4085-85e4-a55bdd16457f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:17.247776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-46ae7d19-5f28-4085-85e4-a55bdd16457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:17.256151 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4154/8367] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:44:17.260645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e2064-86a3-4ed6-85b2-5ffcff5f98e3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:17.270951 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e2064-86a3-4ed6-85b2-5ffcff5f98e3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:17.276142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce827d8-aca4-4044-9cf9-69643bf63cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:17.276745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce827d8-aca4-4044-9cf9-69643bf63cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:17.277025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce827d8-aca4-4044-9cf9-69643bf63cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:17.277299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce827d8-aca4-4044-9cf9-69643bf63cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:17.277943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce827d8-aca4-4044-9cf9-69643bf63cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:44:17.278250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce827d8-aca4-4044-9cf9-69643bf63cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:17.279891 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce827d8-aca4-4044-9cf9-69643bf63cc9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:17.294587 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4214/8368] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:44:17.298751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae7d19-5f28-4085-85e4-a55bdd16457f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:17.309555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae7d19-5f28-4085-85e4-a55bdd16457f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:17.314465 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c593b5-f3f6-43cd-8f81-2958cc785632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:17.315128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c593b5-f3f6-43cd-8f81-2958cc785632 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:17.315412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c593b5-f3f6-43cd-8f81-2958cc785632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:17.315684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c593b5-f3f6-43cd-8f81-2958cc785632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:17.316327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c593b5-f3f6-43cd-8f81-2958cc785632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:17.319119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c593b5-f3f6-43cd-8f81-2958cc785632 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:17.353228 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4155/8369] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:44:17 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:44:17.357537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce827d8-aca4-4044-9cf9-69643bf63cc9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:17.369902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce827d8-aca4-4044-9cf9-69643bf63cc9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:17.445864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2358780-a7f5-419b-be91-e40754ac8c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:17.446470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358780-a7f5-419b-be91-e40754ac8c45 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:17.446736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358780-a7f5-419b-be91-e40754ac8c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:17.447041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358780-a7f5-419b-be91-e40754ac8c45 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:17.447661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2358780-a7f5-419b-be91-e40754ac8c45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:17.449599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2358780-a7f5-419b-be91-e40754ac8c45 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:17.474697 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4215/8370] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:44:17 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:44:17.476354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c593b5-f3f6-43cd-8f81-2958cc785632 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:17.487169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c593b5-f3f6-43cd-8f81-2958cc785632 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:17.492773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a1f15-28f3-461f-8d46-fbeb40f3234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:17.493331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a1f15-28f3-461f-8d46-fbeb40f3234b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:17.493646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a1f15-28f3-461f-8d46-fbeb40f3234b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:17.493953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a1f15-28f3-461f-8d46-fbeb40f3234b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:17.494609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a1f15-28f3-461f-8d46-fbeb40f3234b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:17.496248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a1f15-28f3-461f-8d46-fbeb40f3234b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:17.506965 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4156/8371] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:44:17.512205 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2358780-a7f5-419b-be91-e40754ac8c45 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:17.526067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2358780-a7f5-419b-be91-e40754ac8c45 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:17.531269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7fbbd-d88d-4d04-8a0c-07889d1ae2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:17.531862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7fbbd-d88d-4d04-8a0c-07889d1ae2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:17.532138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7fbbd-d88d-4d04-8a0c-07889d1ae2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:17.532462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7fbbd-d88d-4d04-8a0c-07889d1ae2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:17.533176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7fbbd-d88d-4d04-8a0c-07889d1ae2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:17.534771 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7fbbd-d88d-4d04-8a0c-07889d1ae2a1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:17.553005 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4216/8372] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:44:17.555136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a1f15-28f3-461f-8d46-fbeb40f3234b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:17.566250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a1f15-28f3-461f-8d46-fbeb40f3234b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:17.581538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553632c2-d551-4c84-80b5-fb59e09db212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:17.582226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553632c2-d551-4c84-80b5-fb59e09db212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:17.582658 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553632c2-d551-4c84-80b5-fb59e09db212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:17.582971 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553632c2-d551-4c84-80b5-fb59e09db212 admin admin] PATH_INFO: `/v3/projects/37dd096208374a22a096c3db8b166408/users/c19baf30aa104896b075d6229b6395f5/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:17.585463 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:17.605901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553632c2-d551-4c84-80b5-fb59e09db212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dd096208374a22a096c3db8b166408, user_id=c19baf30aa104896b075d6229b6395f5, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:17.610562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553632c2-d551-4c84-80b5-fb59e09db212 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:17.631261 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4157/8373] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:44:17 2022] PUT /identity/v3/projects/37dd096208374a22a096c3db8b166408/users/c19baf30aa104896b075d6229b6395f5/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:44:17.639265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a022f0-076d-4dbe-a5ab-cc3c643ca8c7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:17.639605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a022f0-076d-4dbe-a5ab-cc3c643ca8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:17.639820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a022f0-076d-4dbe-a5ab-cc3c643ca8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:17.688513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-12a022f0-076d-4dbe-a5ab-cc3c643ca8c7 None None] MFA Rules not processed for user `c19baf30aa104896b075d6229b6395f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:17.690030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-12a022f0-076d-4dbe-a5ab-cc3c643ca8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:17.770473 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4217/8374] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:17.775360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553632c2-d551-4c84-80b5-fb59e09db212 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:17.840659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553632c2-d551-4c84-80b5-fb59e09db212 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:17.845527 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52065eb-d2f1-4ec0-898e-cc55aa9262f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:17.846142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52065eb-d2f1-4ec0-898e-cc55aa9262f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:17.846422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52065eb-d2f1-4ec0-898e-cc55aa9262f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:17.846696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52065eb-d2f1-4ec0-898e-cc55aa9262f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:17.847370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52065eb-d2f1-4ec0-898e-cc55aa9262f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:17.849263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52065eb-d2f1-4ec0-898e-cc55aa9262f2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:17.878381 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4158/8375] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:44:17 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:44:17.882537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a022f0-076d-4dbe-a5ab-cc3c643ca8c7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:17.893986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a022f0-076d-4dbe-a5ab-cc3c643ca8c7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:17.931525 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:17.959072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b510c-33b9-433e-ab49-dea5d682b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:17.959687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b510c-33b9-433e-ab49-dea5d682b227 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:17.959968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b510c-33b9-433e-ab49-dea5d682b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:17.960768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b510c-33b9-433e-ab49-dea5d682b227 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:17.961658 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b510c-33b9-433e-ab49-dea5d682b227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:17.963612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b510c-33b9-433e-ab49-dea5d682b227 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:17.989655 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4218/8376] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:44:17 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:44:17.990861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52065eb-d2f1-4ec0-898e-cc55aa9262f2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:18.001358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52065eb-d2f1-4ec0-898e-cc55aa9262f2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:18.006027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a045-43d9-4ee4-9273-e294e4193487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:18.006628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a045-43d9-4ee4-9273-e294e4193487 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:18.006904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a045-43d9-4ee4-9273-e294e4193487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:18.007232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a045-43d9-4ee4-9273-e294e4193487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:18.007891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1a045-43d9-4ee4-9273-e294e4193487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:18.009474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1a045-43d9-4ee4-9273-e294e4193487 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:18.023466 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4159/8377] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:44:18.024993 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b510c-33b9-433e-ab49-dea5d682b227 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:18.035361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b510c-33b9-433e-ab49-dea5d682b227 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:18.041156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf3708-71f9-4b37-a39d-402b9617d93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:18.041870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf3708-71f9-4b37-a39d-402b9617d93e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:18.042211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf3708-71f9-4b37-a39d-402b9617d93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:18.042550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf3708-71f9-4b37-a39d-402b9617d93e admin admin] PATH_INFO: `/v3/projects/a32ca5fb7b604a708277916d329dc6a5/users/aa07e778dbae4305b169baa822446755/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:18.058164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf3708-71f9-4b37-a39d-402b9617d93e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32ca5fb7b604a708277916d329dc6a5, user_id=aa07e778dbae4305b169baa822446755, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:18.060842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf3708-71f9-4b37-a39d-402b9617d93e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:18.075423 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4219/8378] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:44:18 2022] PUT /identity/v3/projects/a32ca5fb7b604a708277916d329dc6a5/users/aa07e778dbae4305b169baa822446755/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:18.086356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28162e81-caa4-4f25-bf8d-40bbc8546b89 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:18.086717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28162e81-caa4-4f25-bf8d-40bbc8546b89 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:18.087231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28162e81-caa4-4f25-bf8d-40bbc8546b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:18.118336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-28162e81-caa4-4f25-bf8d-40bbc8546b89 None None] MFA Rules not processed for user `aa07e778dbae4305b169baa822446755`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:18.119663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-28162e81-caa4-4f25-bf8d-40bbc8546b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:18.185401 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4160/8379] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:18 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:44:18.216243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf3708-71f9-4b37-a39d-402b9617d93e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:18.217979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d4cf3708-71f9-4b37-a39d-402b9617d93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:18.292148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf3708-71f9-4b37-a39d-402b9617d93e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:18.297314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397a7d6-53be-4b42-9e0d-a492d6600014 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:18.297919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397a7d6-53be-4b42-9e0d-a492d6600014 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:18.298199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397a7d6-53be-4b42-9e0d-a492d6600014 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:18.298469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397a7d6-53be-4b42-9e0d-a492d6600014 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:18.307045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397a7d6-53be-4b42-9e0d-a492d6600014 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:18.308621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397a7d6-53be-4b42-9e0d-a492d6600014 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:18.316820 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4220/8380] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:44:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:44:18.908492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28162e81-caa4-4f25-bf8d-40bbc8546b89 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:18.960002 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:18.975680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28162e81-caa4-4f25-bf8d-40bbc8546b89 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:18.980829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:18.981529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:18.981805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:18.982075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] PATH_INFO: `/v3/users/c19baf30aa104896b075d6229b6395f5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:18.983224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19baf30aa104896b075d6229b6395f5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:18.985131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:19.034457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19baf30aa104896b075d6229b6395f5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.035229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19baf30aa104896b075d6229b6395f5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.048440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19baf30aa104896b075d6229b6395f5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.057377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19baf30aa104896b075d6229b6395f5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.058624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19baf30aa104896b075d6229b6395f5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.073049 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4161/8381] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:44:18 2022] DELETE /identity/v3/users/c19baf30aa104896b075d6229b6395f5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:19.077732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad4a7-c8ac-4dfa-b3cc-de1a5fa5c194 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:19.078090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad4a7-c8ac-4dfa-b3cc-de1a5fa5c194 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:19.078470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad4a7-c8ac-4dfa-b3cc-de1a5fa5c194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:19.097940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-93cad4a7-c8ac-4dfa-b3cc-de1a5fa5c194 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:19.099195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-93cad4a7-c8ac-4dfa-b3cc-de1a5fa5c194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:19.160316 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4221/8382] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:19.170499 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:19.171930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:19.234768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30460c42-284b-4bbc-a8e4-fda4a854440f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:19.238776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a41b5-de97-4655-a1a2-98fcc9bd1e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:19.239424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a41b5-de97-4655-a1a2-98fcc9bd1e9e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:19.239704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a41b5-de97-4655-a1a2-98fcc9bd1e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:19.239976 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a41b5-de97-4655-a1a2-98fcc9bd1e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:19.250194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a41b5-de97-4655-a1a2-98fcc9bd1e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:19.252007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a41b5-de97-4655-a1a2-98fcc9bd1e9e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:19.262575 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4162/8383] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:44:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:44:19.564693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cad4a7-c8ac-4dfa-b3cc-de1a5fa5c194 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:19.566869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-93cad4a7-c8ac-4dfa-b3cc-de1a5fa5c194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:19.580624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cad4a7-c8ac-4dfa-b3cc-de1a5fa5c194 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:19.585799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:19.596646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:19.597011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:19.597295 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] PATH_INFO: `/v3/projects/37dd096208374a22a096c3db8b166408` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:19.599026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] RBAC: Authorizing `identity:delete_project(project_id=37dd096208374a22a096c3db8b166408)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:19.601879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:19.649443 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:19.670669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dd096208374a22a096c3db8b166408', 'request_id': 'req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.678189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dd096208374a22a096c3db8b166408', 'request_id': 'req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.688195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dd096208374a22a096c3db8b166408', 'request_id': 'req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.701921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] The token cache is being invalidate because project 37dd096208374a22a096c3db8b166408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:44:19.702210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.702936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.704421 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4222/8384] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:44:19 2022] DELETE /identity/v3/projects/37dd096208374a22a096c3db8b166408 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:19.708317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a41b5-de97-4655-a1a2-98fcc9bd1e9e service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:19.719449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a41b5-de97-4655-a1a2-98fcc9bd1e9e service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:19.778646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94892f-322f-4eb2-92b2-7a9fbfe4edf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:19.779236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94892f-322f-4eb2-92b2-7a9fbfe4edf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:19.779517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94892f-322f-4eb2-92b2-7a9fbfe4edf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:19.779793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94892f-322f-4eb2-92b2-7a9fbfe4edf5 admin admin] PATH_INFO: `/v3/users/aa07e778dbae4305b169baa822446755` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:19.780919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94892f-322f-4eb2-92b2-7a9fbfe4edf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa07e778dbae4305b169baa822446755)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:19.782844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94892f-322f-4eb2-92b2-7a9fbfe4edf5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:19.795257 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:19.834901 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2a94892f-322f-4eb2-92b2-7a9fbfe4edf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa07e778dbae4305b169baa822446755'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.836124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2a94892f-322f-4eb2-92b2-7a9fbfe4edf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa07e778dbae4305b169baa822446755'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.847886 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2a94892f-322f-4eb2-92b2-7a9fbfe4edf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa07e778dbae4305b169baa822446755'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.857470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2a94892f-322f-4eb2-92b2-7a9fbfe4edf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa07e778dbae4305b169baa822446755'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.858081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2a94892f-322f-4eb2-92b2-7a9fbfe4edf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa07e778dbae4305b169baa822446755'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:19.872823 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4163/8385] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:44:19 2022] DELETE /identity/v3/users/aa07e778dbae4305b169baa822446755 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:20.211075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:20.212619 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:20.227123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f5d7b-9318-4cb8-b5dc-9f53a0ad706a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:20.286546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:20.287365 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:20.287635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:20.287919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12 admin admin] PATH_INFO: `/v3/projects/a32ca5fb7b604a708277916d329dc6a5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:20.289255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32ca5fb7b604a708277916d329dc6a5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:20.291259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:20.341347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32ca5fb7b604a708277916d329dc6a5', 'request_id': 'req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:20.347982 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32ca5fb7b604a708277916d329dc6a5', 'request_id': 'req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:20.355908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32ca5fb7b604a708277916d329dc6a5', 'request_id': 'req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:20.367979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12 admin admin] The token cache is being invalidate because project a32ca5fb7b604a708277916d329dc6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:44:20.371184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:20.371929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-2ec945f4-12cb-4dc3-b486-9a6ae65aee12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:20.373537 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4223/8386] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:44:20 2022] DELETE /identity/v3/projects/a32ca5fb7b604a708277916d329dc6a5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:20.378556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee360dd-4db6-4166-9585-2a179bf4a741 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:20.379173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee360dd-4db6-4166-9585-2a179bf4a741 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:20.379325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee360dd-4db6-4166-9585-2a179bf4a741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:20.401061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7ee360dd-4db6-4166-9585-2a179bf4a741 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:20.402292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7ee360dd-4db6-4166-9585-2a179bf4a741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:20.465140 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4164/8387] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:44:20.473723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05638f3d-0144-44ea-bfe0-4243fb5efcc3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:20.474005 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05638f3d-0144-44ea-bfe0-4243fb5efcc3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:20.474280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05638f3d-0144-44ea-bfe0-4243fb5efcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:20.494908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-05638f3d-0144-44ea-bfe0-4243fb5efcc3 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:20.496119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05638f3d-0144-44ea-bfe0-4243fb5efcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:20.503973 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4224/8388] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:20.508806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee360dd-4db6-4166-9585-2a179bf4a741 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:20.518946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee360dd-4db6-4166-9585-2a179bf4a741 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:20.523915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33302669-4aa6-41f0-be35-61a945cf6b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:20.524596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302669-4aa6-41f0-be35-61a945cf6b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:20.524946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302669-4aa6-41f0-be35-61a945cf6b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:20.525288 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302669-4aa6-41f0-be35-61a945cf6b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:20.526065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33302669-4aa6-41f0-be35-61a945cf6b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:44:20.526418 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33302669-4aa6-41f0-be35-61a945cf6b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:20.528116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33302669-4aa6-41f0-be35-61a945cf6b2d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:20.543910 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4165/8389] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:44:20.550008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05638f3d-0144-44ea-bfe0-4243fb5efcc3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:20.561988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05638f3d-0144-44ea-bfe0-4243fb5efcc3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:20.566543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695103be-6b87-4628-a9bb-0b62164b6c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:20.567214 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695103be-6b87-4628-a9bb-0b62164b6c4b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:20.567498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695103be-6b87-4628-a9bb-0b62164b6c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:20.567775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695103be-6b87-4628-a9bb-0b62164b6c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:20.568420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695103be-6b87-4628-a9bb-0b62164b6c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:20.570402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695103be-6b87-4628-a9bb-0b62164b6c4b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:20.604453 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4225/8390] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:44:20 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:44:20.605852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33302669-4aa6-41f0-be35-61a945cf6b2d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:20.616047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33302669-4aa6-41f0-be35-61a945cf6b2d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:20.674371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2365ec-1c11-40f3-9be4-fd9dc00d4faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:20.675036 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2365ec-1c11-40f3-9be4-fd9dc00d4faa admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:20.675314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2365ec-1c11-40f3-9be4-fd9dc00d4faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:20.675580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2365ec-1c11-40f3-9be4-fd9dc00d4faa admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:20.676208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2365ec-1c11-40f3-9be4-fd9dc00d4faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:20.678108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2365ec-1c11-40f3-9be4-fd9dc00d4faa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:20.699436 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4166/8391] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:44:20 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:44:20.703649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695103be-6b87-4628-a9bb-0b62164b6c4b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:20.719041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695103be-6b87-4628-a9bb-0b62164b6c4b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:20.728971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d721-b3d7-4554-ae84-c3d80ff06433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:20.729787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d721-b3d7-4554-ae84-c3d80ff06433 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:20.730070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d721-b3d7-4554-ae84-c3d80ff06433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:20.730345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d721-b3d7-4554-ae84-c3d80ff06433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:20.731058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5d721-b3d7-4554-ae84-c3d80ff06433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:20.732666 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5d721-b3d7-4554-ae84-c3d80ff06433 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:20.748278 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4226/8392] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:44:20.749849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2365ec-1c11-40f3-9be4-fd9dc00d4faa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:20.757283 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:20.764273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2365ec-1c11-40f3-9be4-fd9dc00d4faa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:20.771091 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f9c28-d8c1-4f1a-be9c-e6ddcddc1737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:20.771858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f9c28-d8c1-4f1a-be9c-e6ddcddc1737 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:20.772306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f9c28-d8c1-4f1a-be9c-e6ddcddc1737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:20.772954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f9c28-d8c1-4f1a-be9c-e6ddcddc1737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:20.773730 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f9c28-d8c1-4f1a-be9c-e6ddcddc1737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:20.775640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f9c28-d8c1-4f1a-be9c-e6ddcddc1737 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:20.792750 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4167/8393] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:44:20.794787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d721-b3d7-4554-ae84-c3d80ff06433 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:20.801731 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:20.808828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d721-b3d7-4554-ae84-c3d80ff06433 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:20.815090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec594cb1-3196-48a1-887c-38c6725eb751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:20.815755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec594cb1-3196-48a1-887c-38c6725eb751 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:20.816032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec594cb1-3196-48a1-887c-38c6725eb751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:20.816306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec594cb1-3196-48a1-887c-38c6725eb751 admin admin] PATH_INFO: `/v3/projects/6430b7c382284580beb574867b665e05/users/fe5a503e64d94e7d840cc97d9fa03637/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:20.836117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec594cb1-3196-48a1-887c-38c6725eb751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6430b7c382284580beb574867b665e05, user_id=fe5a503e64d94e7d840cc97d9fa03637, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:20.839104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec594cb1-3196-48a1-887c-38c6725eb751 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:20.855862 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4227/8394] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:44:20 2022] PUT /identity/v3/projects/6430b7c382284580beb574867b665e05/users/fe5a503e64d94e7d840cc97d9fa03637/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:44:20.860838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aecbc6-da86-4a42-943f-eb56bb50ee1f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:20.861129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aecbc6-da86-4a42-943f-eb56bb50ee1f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:20.861425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aecbc6-da86-4a42-943f-eb56bb50ee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:20.885945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-94aecbc6-da86-4a42-943f-eb56bb50ee1f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:20.887221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-94aecbc6-da86-4a42-943f-eb56bb50ee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:20.947257 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4168/8395] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:20.957176 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec594cb1-3196-48a1-887c-38c6725eb751 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:20.958986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ec594cb1-3196-48a1-887c-38c6725eb751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:21.032949 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec594cb1-3196-48a1-887c-38c6725eb751 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:21.036799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a408e98-0bc8-4900-b2ee-3d566851ec87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:21.037430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a408e98-0bc8-4900-b2ee-3d566851ec87 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:21.037705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a408e98-0bc8-4900-b2ee-3d566851ec87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:21.037974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a408e98-0bc8-4900-b2ee-3d566851ec87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:21.053693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a408e98-0bc8-4900-b2ee-3d566851ec87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:21.053693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a408e98-0bc8-4900-b2ee-3d566851ec87 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:21.065658 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4228/8396] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:44:21.751540 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87c360-212a-4d23-ad8c-f0623d26b1a4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:21.752113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87c360-212a-4d23-ad8c-f0623d26b1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:21.752113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87c360-212a-4d23-ad8c-f0623d26b1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:21.783931 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2f87c360-212a-4d23-ad8c-f0623d26b1a4 None None] MFA Rules not processed for user `fe5a503e64d94e7d840cc97d9fa03637`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:21.785145 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2f87c360-212a-4d23-ad8c-f0623d26b1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:21.863084 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4169/8397] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:21.865022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a408e98-0bc8-4900-b2ee-3d566851ec87 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:21.875888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a408e98-0bc8-4900-b2ee-3d566851ec87 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:21.880607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c561b-458c-43c5-8119-3cae03944f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:21.881204 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c561b-458c-43c5-8119-3cae03944f72 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:21.881482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c561b-458c-43c5-8119-3cae03944f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:21.881754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c561b-458c-43c5-8119-3cae03944f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:21.882945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c561b-458c-43c5-8119-3cae03944f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:21.884877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c561b-458c-43c5-8119-3cae03944f72 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:21.919596 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4229/8398] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:44:21 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:44:21.920640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87c360-212a-4d23-ad8c-f0623d26b1a4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:21.933306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87c360-212a-4d23-ad8c-f0623d26b1a4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:21.994191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b8805-a25a-4163-8f0f-84caca7f2a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:21.995003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b8805-a25a-4163-8f0f-84caca7f2a6d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:21.995287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b8805-a25a-4163-8f0f-84caca7f2a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:21.995559 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b8805-a25a-4163-8f0f-84caca7f2a6d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:21.996188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b8805-a25a-4163-8f0f-84caca7f2a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:21.998134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b8805-a25a-4163-8f0f-84caca7f2a6d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:22.021340 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4170/8399] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:44:21 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:44:22.025463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c561b-458c-43c5-8119-3cae03944f72 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:22.036000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c561b-458c-43c5-8119-3cae03944f72 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:22.041330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cfdee-0d00-4dfc-be3e-3e09b828d001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:22.041932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cfdee-0d00-4dfc-be3e-3e09b828d001 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:22.042215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cfdee-0d00-4dfc-be3e-3e09b828d001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:22.042487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cfdee-0d00-4dfc-be3e-3e09b828d001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:22.043150 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cfdee-0d00-4dfc-be3e-3e09b828d001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:22.044729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cfdee-0d00-4dfc-be3e-3e09b828d001 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:22.056483 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4230/8400] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:44:22.060669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b8805-a25a-4163-8f0f-84caca7f2a6d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:22.070842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b8805-a25a-4163-8f0f-84caca7f2a6d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:22.076030 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf151b1-6c84-451d-8ad4-b753d265b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:22.076677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf151b1-6c84-451d-8ad4-b753d265b348 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:22.076955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf151b1-6c84-451d-8ad4-b753d265b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:22.077228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf151b1-6c84-451d-8ad4-b753d265b348 admin admin] PATH_INFO: `/v3/projects/280e9f476383420a8d6b98712bc14b70/users/050191760a9c439188ad6e2855a029bc/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:22.088893 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:22.094352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf151b1-6c84-451d-8ad4-b753d265b348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=280e9f476383420a8d6b98712bc14b70, user_id=050191760a9c439188ad6e2855a029bc, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:22.097545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf151b1-6c84-451d-8ad4-b753d265b348 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:22.112736 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4171/8401] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:44:22 2022] PUT /identity/v3/projects/280e9f476383420a8d6b98712bc14b70/users/050191760a9c439188ad6e2855a029bc/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:22.115929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cfdee-0d00-4dfc-be3e-3e09b828d001 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:22.128551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cfdee-0d00-4dfc-be3e-3e09b828d001 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:22.193317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f0a13-0263-4073-a157-32ff32075529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:22.193862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f0a13-0263-4073-a157-32ff32075529 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:22.194141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f0a13-0263-4073-a157-32ff32075529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:22.194567 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f0a13-0263-4073-a157-32ff32075529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:22.195409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f0a13-0263-4073-a157-32ff32075529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:22.197017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f0a13-0263-4073-a157-32ff32075529 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:22.207054 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4231/8402] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:44:22.211224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf151b1-6c84-451d-8ad4-b753d265b348 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:22.222347 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf151b1-6c84-451d-8ad4-b753d265b348 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:22.227811 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ca8ce-2faa-4d8d-8aa8-fe5dc152259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:22.228479 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ca8ce-2faa-4d8d-8aa8-fe5dc152259b admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:22.228760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ca8ce-2faa-4d8d-8aa8-fe5dc152259b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:22.229034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ca8ce-2faa-4d8d-8aa8-fe5dc152259b admin admin] PATH_INFO: `/v3/projects/280e9f476383420a8d6b98712bc14b70/users/050191760a9c439188ad6e2855a029bc/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:22.231056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ca8ce-2faa-4d8d-8aa8-fe5dc152259b admin admin] RBAC: Authorizing `identity:create_grant(project_id=280e9f476383420a8d6b98712bc14b70, user_id=050191760a9c439188ad6e2855a029bc, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:22.233943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ca8ce-2faa-4d8d-8aa8-fe5dc152259b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:22.244902 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4172/8403] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:44:22 2022] PUT /identity/v3/projects/280e9f476383420a8d6b98712bc14b70/users/050191760a9c439188ad6e2855a029bc/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:22.917939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85932bac-03b6-42e7-bf1c-835d0a3f0399 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:22.918960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85932bac-03b6-42e7-bf1c-835d0a3f0399 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:22.919428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85932bac-03b6-42e7-bf1c-835d0a3f0399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:22.956442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-85932bac-03b6-42e7-bf1c-835d0a3f0399 None None] MFA Rules not processed for user `050191760a9c439188ad6e2855a029bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:22.957694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-85932bac-03b6-42e7-bf1c-835d0a3f0399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:22.997066 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:23.034027 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4232/8404] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:23.046635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462d886-8d07-43a4-b1b3-538529e4160b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:23.047613 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462d886-8d07-43a4-b1b3-538529e4160b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:23.047897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462d886-8d07-43a4-b1b3-538529e4160b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:23.068715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4462d886-8d07-43a4-b1b3-538529e4160b None None] MFA Rules not processed for user `fe5a503e64d94e7d840cc97d9fa03637`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:23.070761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4462d886-8d07-43a4-b1b3-538529e4160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:23.137503 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4173/8405] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:23.149369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85932bac-03b6-42e7-bf1c-835d0a3f0399 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:23.150832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-85932bac-03b6-42e7-bf1c-835d0a3f0399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:23.243860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85932bac-03b6-42e7-bf1c-835d0a3f0399 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:23.250605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7c71d-48b1-49d4-a49c-fa35b4ae936a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:23.251390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c71d-48b1-49d4-a49c-fa35b4ae936a service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:23.251739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c71d-48b1-49d4-a49c-fa35b4ae936a service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:23.252081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c71d-48b1-49d4-a49c-fa35b4ae936a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:23.262498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7c71d-48b1-49d4-a49c-fa35b4ae936a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:23.264274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7c71d-48b1-49d4-a49c-fa35b4ae936a service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:23.275600 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4233/8406] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:44:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:44:23.379279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c3693-c371-47f8-8858-683f3992aca9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:23.379829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c3693-c371-47f8-8858-683f3992aca9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:23.380200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c3693-c371-47f8-8858-683f3992aca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:23.400609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7f4c3693-c371-47f8-8858-683f3992aca9 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:23.402256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7f4c3693-c371-47f8-8858-683f3992aca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:23.465743 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4174/8407] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 01:44:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:23.480842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7c71d-48b1-49d4-a49c-fa35b4ae936a service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:23.482390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-42b7c71d-48b1-49d4-a49c-fa35b4ae936a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:23.576158 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7c71d-48b1-49d4-a49c-fa35b4ae936a service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:23.581325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90da310-a018-4d0e-99d3-fbfb324f52b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:23.582025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90da310-a018-4d0e-99d3-fbfb324f52b3 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:23.582368 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90da310-a018-4d0e-99d3-fbfb324f52b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:23.582713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90da310-a018-4d0e-99d3-fbfb324f52b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:23.593166 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90da310-a018-4d0e-99d3-fbfb324f52b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:23.594857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90da310-a018-4d0e-99d3-fbfb324f52b3 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:23.604513 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4234/8408] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:44:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:44:33.457964 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=59,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:33.600559 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=79 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:41.382175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c3693-c371-47f8-8858-683f3992aca9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:41.383696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7f4c3693-c371-47f8-8858-683f3992aca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:41.462804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c3693-c371-47f8-8858-683f3992aca9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:41.468157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe13f0a-224a-4d39-b9a1-7aeeb4103ff4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:41.469063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe13f0a-224a-4d39-b9a1-7aeeb4103ff4 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:41.469509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe13f0a-224a-4d39-b9a1-7aeeb4103ff4 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:41.469944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe13f0a-224a-4d39-b9a1-7aeeb4103ff4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:41.472023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0fe13f0a-224a-4d39-b9a1-7aeeb4103ff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:41.492894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe13f0a-224a-4d39-b9a1-7aeeb4103ff4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:41.494500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe13f0a-224a-4d39-b9a1-7aeeb4103ff4 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:41.514197 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4175/8409] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:44:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:44:41.598472 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb523e04-d2d7-4808-9016-9d9b988796ba None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:41.599600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb523e04-d2d7-4808-9016-9d9b988796ba None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:41.599600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb523e04-d2d7-4808-9016-9d9b988796ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:41.625329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fb523e04-d2d7-4808-9016-9d9b988796ba None None] MFA Rules not processed for user `2eabe99e40ef44a09c3f7dc1c78d7608`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:41.627319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fb523e04-d2d7-4808-9016-9d9b988796ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:41.701195 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4235/8410] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:44:49.971911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe13f0a-224a-4d39-b9a1-7aeeb4103ff4 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:50.061787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe13f0a-224a-4d39-b9a1-7aeeb4103ff4 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:50.066414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:50.067819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:50.068124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:50.068505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] PATH_INFO: `/v3/users/fe5a503e64d94e7d840cc97d9fa03637` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:50.069868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5a503e64d94e7d840cc97d9fa03637)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:50.071839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:50.141844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5a503e64d94e7d840cc97d9fa03637'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.142542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5a503e64d94e7d840cc97d9fa03637'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.158081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5a503e64d94e7d840cc97d9fa03637'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.170480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5a503e64d94e7d840cc97d9fa03637'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.171219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5a503e64d94e7d840cc97d9fa03637'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.199784 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4176/8411] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:44:49 2022] DELETE /identity/v3/users/fe5a503e64d94e7d840cc97d9fa03637 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:50.502072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb523e04-d2d7-4808-9016-9d9b988796ba None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:50.522258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb523e04-d2d7-4808-9016-9d9b988796ba None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:50.595068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:50.595640 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:50.595917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:50.596436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] PATH_INFO: `/v3/projects/6430b7c382284580beb574867b665e05` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:50.597547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6430b7c382284580beb574867b665e05)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:50.600191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:50.650075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6430b7c382284580beb574867b665e05', 'request_id': 'req-84c069ad-3ae9-44c4-9da4-d87f28d6439e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.657675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6430b7c382284580beb574867b665e05', 'request_id': 'req-84c069ad-3ae9-44c4-9da4-d87f28d6439e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.667199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6430b7c382284580beb574867b665e05', 'request_id': 'req-84c069ad-3ae9-44c4-9da4-d87f28d6439e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.679052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] The token cache is being invalidate because project 6430b7c382284580beb574867b665e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:44:50.679339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.679971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.681460 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4236/8412] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:44:50 2022] DELETE /identity/v3/projects/6430b7c382284580beb574867b665e05 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:50.685478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:50.687054 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:50.700594 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cb38b-c25b-465a-81ff-7f50cfaf1e32 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:50.705804 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:50.763576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff2089-b598-4c84-a9c8-40b6fda69a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:50.764218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff2089-b598-4c84-a9c8-40b6fda69a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:50.764494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff2089-b598-4c84-a9c8-40b6fda69a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:50.764770 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff2089-b598-4c84-a9c8-40b6fda69a88 admin admin] PATH_INFO: `/v3/users/050191760a9c439188ad6e2855a029bc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:50.765906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff2089-b598-4c84-a9c8-40b6fda69a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=050191760a9c439188ad6e2855a029bc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:50.767961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff2089-b598-4c84-a9c8-40b6fda69a88 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:50.814847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-84ff2089-b598-4c84-a9c8-40b6fda69a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050191760a9c439188ad6e2855a029bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.815532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-84ff2089-b598-4c84-a9c8-40b6fda69a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050191760a9c439188ad6e2855a029bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.830899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-84ff2089-b598-4c84-a9c8-40b6fda69a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050191760a9c439188ad6e2855a029bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.838719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-84ff2089-b598-4c84-a9c8-40b6fda69a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050191760a9c439188ad6e2855a029bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.839825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-84ff2089-b598-4c84-a9c8-40b6fda69a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050191760a9c439188ad6e2855a029bc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:50.856096 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4177/8413] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:44:50 2022] DELETE /identity/v3/users/050191760a9c439188ad6e2855a029bc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:51.048957 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:51.050143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:51.064867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c069ad-3ae9-44c4-9da4-d87f28d6439e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:51.101408 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:51.130180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:51.130811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:51.131140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:51.131408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] PATH_INFO: `/v3/projects/280e9f476383420a8d6b98712bc14b70` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:51.132517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=280e9f476383420a8d6b98712bc14b70)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:51.134426 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:51.182195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280e9f476383420a8d6b98712bc14b70', 'request_id': 'req-120cbb47-5c85-43bc-920e-309ff0c09123'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:51.188963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280e9f476383420a8d6b98712bc14b70', 'request_id': 'req-120cbb47-5c85-43bc-920e-309ff0c09123'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:51.197385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280e9f476383420a8d6b98712bc14b70', 'request_id': 'req-120cbb47-5c85-43bc-920e-309ff0c09123'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:51.211624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] The token cache is being invalidate because project 280e9f476383420a8d6b98712bc14b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:44:51.211898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:51.212597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:44:51.214156 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4237/8414] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:44:51 2022] DELETE /identity/v3/projects/280e9f476383420a8d6b98712bc14b70 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:44:54.469637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62785615-2fad-45c7-9b2f-f932d271fa4b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:54.470232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62785615-2fad-45c7-9b2f-f932d271fa4b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:54.470232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62785615-2fad-45c7-9b2f-f932d271fa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:54.497324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-62785615-2fad-45c7-9b2f-f932d271fa4b None None] MFA Rules not processed for user `83bbcff8a1f64cfa936f13f3cb3955b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:44:54.499721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-62785615-2fad-45c7-9b2f-f932d271fa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:54.585317 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4178/8415] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:44:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:44:54.964508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:54.966054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:55.040671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cbb47-5c85-43bc-920e-309ff0c09123 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:55.044952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29debbe-745b-46b5-b546-1ac25aa01503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:55.045700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29debbe-745b-46b5-b546-1ac25aa01503 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:55.046051 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29debbe-745b-46b5-b546-1ac25aa01503 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:55.046498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29debbe-745b-46b5-b546-1ac25aa01503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:55.048451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b29debbe-745b-46b5-b546-1ac25aa01503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:55.061851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29debbe-745b-46b5-b546-1ac25aa01503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:55.063360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29debbe-745b-46b5-b546-1ac25aa01503 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:55.074376 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4238/8416] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:44:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:44:57.714832 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62785615-2fad-45c7-9b2f-f932d271fa4b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:44:57.720095 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-62785615-2fad-45c7-9b2f-f932d271fa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:57.778148 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:57.837331 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62785615-2fad-45c7-9b2f-f932d271fa4b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:44:57.843346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac037cd8-7031-43b9-aa66-be53bf19f1ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:44:57.844032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac037cd8-7031-43b9-aa66-be53bf19f1ea service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:44:57.844824 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac037cd8-7031-43b9-aa66-be53bf19f1ea service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:44:57.845103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac037cd8-7031-43b9-aa66-be53bf19f1ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:44:57.846845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ac037cd8-7031-43b9-aa66-be53bf19f1ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:44:57.858351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac037cd8-7031-43b9-aa66-be53bf19f1ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:44:57.859979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac037cd8-7031-43b9-aa66-be53bf19f1ea service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:44:57.869575 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4179/8417] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:44:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:45:03.990378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29debbe-745b-46b5-b546-1ac25aa01503 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:03.992009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b29debbe-745b-46b5-b546-1ac25aa01503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:04.006346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29debbe-745b-46b5-b546-1ac25aa01503 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:04.010578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a0b5d-7c8f-4685-86bc-09e81988c809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:04.012494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0b5d-7c8f-4685-86bc-09e81988c809 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:04.012494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0b5d-7c8f-4685-86bc-09e81988c809 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:04.012494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0b5d-7c8f-4685-86bc-09e81988c809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:04.013621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-209a0b5d-7c8f-4685-86bc-09e81988c809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:04.079659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a0b5d-7c8f-4685-86bc-09e81988c809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:04.081110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a0b5d-7c8f-4685-86bc-09e81988c809 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:04.091780 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4239/8418] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:45:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:45:07.865687 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=19 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:14.087474 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:35.391388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac037cd8-7031-43b9-aa66-be53bf19f1ea service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:35.405349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac037cd8-7031-43b9-aa66-be53bf19f1ea service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:35.411615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af613f9f-670a-45d3-b784-74ce2c5cb4f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:35.412301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af613f9f-670a-45d3-b784-74ce2c5cb4f6 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:35.412584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af613f9f-670a-45d3-b784-74ce2c5cb4f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:35.412855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af613f9f-670a-45d3-b784-74ce2c5cb4f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:35.414604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-af613f9f-670a-45d3-b784-74ce2c5cb4f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:35.474194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af613f9f-670a-45d3-b784-74ce2c5cb4f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:35.475823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af613f9f-670a-45d3-b784-74ce2c5cb4f6 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:35.485842 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4180/8419] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:45:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:45:36.851239 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a0b5d-7c8f-4685-86bc-09e81988c809 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:36.863177 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a0b5d-7c8f-4685-86bc-09e81988c809 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:36.866741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34470e6c-bd4b-4b73-a446-ba234cfa27af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:36.867363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34470e6c-bd4b-4b73-a446-ba234cfa27af service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:36.867637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34470e6c-bd4b-4b73-a446-ba234cfa27af service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:36.867927 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34470e6c-bd4b-4b73-a446-ba234cfa27af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:36.869678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-34470e6c-bd4b-4b73-a446-ba234cfa27af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:36.885690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34470e6c-bd4b-4b73-a446-ba234cfa27af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:36.887125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34470e6c-bd4b-4b73-a446-ba234cfa27af service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:36.900967 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4240/8420] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:45:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:45:40.278307 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af613f9f-670a-45d3-b784-74ce2c5cb4f6 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:40.291891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af613f9f-670a-45d3-b784-74ce2c5cb4f6 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:40.295694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2d25e-41d3-45d3-8d39-974dc1beb2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:40.296381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2d25e-41d3-45d3-8d39-974dc1beb2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:40.296659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2d25e-41d3-45d3-8d39-974dc1beb2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:40.296933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2d25e-41d3-45d3-8d39-974dc1beb2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:40.298733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9fd2d25e-41d3-45d3-8d39-974dc1beb2f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:40.363499 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34470e6c-bd4b-4b73-a446-ba234cfa27af service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:40.368849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2d25e-41d3-45d3-8d39-974dc1beb2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:40.370294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2d25e-41d3-45d3-8d39-974dc1beb2f0 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:40.380535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34470e6c-bd4b-4b73-a446-ba234cfa27af service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:40.381300 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4181/8421] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:45:40.386998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989369a-c6f4-460d-9b9c-ec23c7b787da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:40.387968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989369a-c6f4-460d-9b9c-ec23c7b787da service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:40.389808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989369a-c6f4-460d-9b9c-ec23c7b787da service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:40.390133 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989369a-c6f4-460d-9b9c-ec23c7b787da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:40.393665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c989369a-c6f4-460d-9b9c-ec23c7b787da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:40.432410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2d25e-41d3-45d3-8d39-974dc1beb2f0 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:40.447877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2d25e-41d3-45d3-8d39-974dc1beb2f0 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:40.452131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7bbf6-2ade-4e6d-aa4e-60cb329ce419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:40.453189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7bbf6-2ade-4e6d-aa4e-60cb329ce419 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:40.454456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7bbf6-2ade-4e6d-aa4e-60cb329ce419 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:40.455199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7bbf6-2ade-4e6d-aa4e-60cb329ce419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:40.457212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1de7bbf6-2ade-4e6d-aa4e-60cb329ce419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:40.473038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7bbf6-2ade-4e6d-aa4e-60cb329ce419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:40.474698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7bbf6-2ade-4e6d-aa4e-60cb329ce419 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:40.477240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989369a-c6f4-460d-9b9c-ec23c7b787da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:40.479088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989369a-c6f4-460d-9b9c-ec23c7b787da service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:40.489096 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4182/8422] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:45:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:45:40.494413 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4241/8423] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:45:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:45:43.963070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7bbf6-2ade-4e6d-aa4e-60cb329ce419 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:43.980185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7bbf6-2ade-4e6d-aa4e-60cb329ce419 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:43.987523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e082f60-8a56-4140-a41e-686ff8f017fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:43.988490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e082f60-8a56-4140-a41e-686ff8f017fa service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:43.988876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e082f60-8a56-4140-a41e-686ff8f017fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:43.989242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e082f60-8a56-4140-a41e-686ff8f017fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:43.991383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7e082f60-8a56-4140-a41e-686ff8f017fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:44.040564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e082f60-8a56-4140-a41e-686ff8f017fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:44.044257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e082f60-8a56-4140-a41e-686ff8f017fa service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:44.085093 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4183/8424] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:45:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:45:48.034281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989369a-c6f4-460d-9b9c-ec23c7b787da service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:48.035874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c989369a-c6f4-460d-9b9c-ec23c7b787da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:48.052201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989369a-c6f4-460d-9b9c-ec23c7b787da service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:48.057083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:48.057800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:48.058078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:48.058346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] PATH_INFO: `/v3/users/7f58f86160d54e0380ff27912f42417d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:48.059544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f58f86160d54e0380ff27912f42417d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:48.061798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:48.120546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f58f86160d54e0380ff27912f42417d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.121202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f58f86160d54e0380ff27912f42417d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.135381 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f58f86160d54e0380ff27912f42417d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.143215 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f58f86160d54e0380ff27912f42417d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.143939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f58f86160d54e0380ff27912f42417d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.157294 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4242/8425] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:45:48 2022] DELETE /identity/v3/users/7f58f86160d54e0380ff27912f42417d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:45:48.335555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e082f60-8a56-4140-a41e-686ff8f017fa service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:48.346654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e082f60-8a56-4140-a41e-686ff8f017fa service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:48.405171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:48.405823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:48.406104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:48.406487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] PATH_INFO: `/v3/projects/ec6724e74aa140e7826844a05b404a27` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:48.407669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec6724e74aa140e7826844a05b404a27)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:48.409579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:48.417649 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:48.457539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec6724e74aa140e7826844a05b404a27', 'request_id': 'req-750e9f92-9e77-4190-808e-ba9a2655d741'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.463569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec6724e74aa140e7826844a05b404a27', 'request_id': 'req-750e9f92-9e77-4190-808e-ba9a2655d741'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.471127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec6724e74aa140e7826844a05b404a27', 'request_id': 'req-750e9f92-9e77-4190-808e-ba9a2655d741'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.482635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] The token cache is being invalidate because project ec6724e74aa140e7826844a05b404a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:45:48.483182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.484230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.486022 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4184/8426] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:45:48 2022] DELETE /identity/v3/projects/ec6724e74aa140e7826844a05b404a27 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:45:48.490439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:48.492020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:48.506588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989a3b5-77b7-44dd-8639-1b48534f9abc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:48.556676 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:48.567399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233b656-15fe-4271-81a7-d4ece74dd784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:48.568036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233b656-15fe-4271-81a7-d4ece74dd784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:48.568319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233b656-15fe-4271-81a7-d4ece74dd784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:48.568595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233b656-15fe-4271-81a7-d4ece74dd784 admin admin] PATH_INFO: `/v3/users/dca89c1fe35840418ebefd193e58ca6d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:48.569734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233b656-15fe-4271-81a7-d4ece74dd784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca89c1fe35840418ebefd193e58ca6d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:48.571965 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233b656-15fe-4271-81a7-d4ece74dd784 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:48.618521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e233b656-15fe-4271-81a7-d4ece74dd784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca89c1fe35840418ebefd193e58ca6d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.619206 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e233b656-15fe-4271-81a7-d4ece74dd784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca89c1fe35840418ebefd193e58ca6d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.630882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e233b656-15fe-4271-81a7-d4ece74dd784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca89c1fe35840418ebefd193e58ca6d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.637997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e233b656-15fe-4271-81a7-d4ece74dd784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca89c1fe35840418ebefd193e58ca6d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.638636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e233b656-15fe-4271-81a7-d4ece74dd784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca89c1fe35840418ebefd193e58ca6d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.651307 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4243/8427] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:45:48 2022] DELETE /identity/v3/users/dca89c1fe35840418ebefd193e58ca6d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:45:48.831051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:48.832513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:48.849937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e9f92-9e77-4190-808e-ba9a2655d741 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:48.916059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:48.916772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:48.917050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:48.917317 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a admin admin] PATH_INFO: `/v3/projects/d30b3d7f56ff4f318f23798c64dda5d8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:48.918484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30b3d7f56ff4f318f23798c64dda5d8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:48.920504 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:48.968333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30b3d7f56ff4f318f23798c64dda5d8', 'request_id': 'req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.975267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30b3d7f56ff4f318f23798c64dda5d8', 'request_id': 'req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.985268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30b3d7f56ff4f318f23798c64dda5d8', 'request_id': 'req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.996525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a admin admin] The token cache is being invalidate because project d30b3d7f56ff4f318f23798c64dda5d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:45:48.996815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.997442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e46a7ab4-a332-4ee9-ba1d-d437bf31a22a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:45:48.998937 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4185/8428] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:45:48 2022] DELETE /identity/v3/projects/d30b3d7f56ff4f318f23798c64dda5d8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:45:49.005171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee158fb-e42a-4aa8-acaf-7b9f54f56cd7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:49.005498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee158fb-e42a-4aa8-acaf-7b9f54f56cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:49.005758 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee158fb-e42a-4aa8-acaf-7b9f54f56cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:49.026606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9ee158fb-e42a-4aa8-acaf-7b9f54f56cd7 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:45:49.027827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9ee158fb-e42a-4aa8-acaf-7b9f54f56cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:49.091144 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4244/8429] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:45:49.098967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268bed6-d5cf-4679-a4c0-21ddaa71ad5b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:49.099260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268bed6-d5cf-4679-a4c0-21ddaa71ad5b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:49.099536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268bed6-d5cf-4679-a4c0-21ddaa71ad5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:49.119966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e268bed6-d5cf-4679-a4c0-21ddaa71ad5b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:45:49.121174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e268bed6-d5cf-4679-a4c0-21ddaa71ad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:49.130716 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4186/8430] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:45:49.135196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee158fb-e42a-4aa8-acaf-7b9f54f56cd7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:49.146930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee158fb-e42a-4aa8-acaf-7b9f54f56cd7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:49.151715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287ebe9-dc93-4a3d-9016-05ce033b64d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:49.152455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287ebe9-dc93-4a3d-9016-05ce033b64d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:49.152611 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287ebe9-dc93-4a3d-9016-05ce033b64d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:49.152882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287ebe9-dc93-4a3d-9016-05ce033b64d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:49.153548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287ebe9-dc93-4a3d-9016-05ce033b64d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:45:49.153850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287ebe9-dc93-4a3d-9016-05ce033b64d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:49.155457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287ebe9-dc93-4a3d-9016-05ce033b64d1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:49.170801 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4245/8431] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:45:49.171952 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268bed6-d5cf-4679-a4c0-21ddaa71ad5b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:49.181629 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268bed6-d5cf-4679-a4c0-21ddaa71ad5b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:49.186297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e6eb2-4452-4715-b1e7-04b78dd5b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:49.186902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e6eb2-4452-4715-b1e7-04b78dd5b6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:49.187214 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e6eb2-4452-4715-b1e7-04b78dd5b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:49.188010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e6eb2-4452-4715-b1e7-04b78dd5b6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:49.188633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e6eb2-4452-4715-b1e7-04b78dd5b6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:49.190563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e6eb2-4452-4715-b1e7-04b78dd5b6a2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:49.212568 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:49.221572 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4187/8432] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:45:49 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:45:49.225769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287ebe9-dc93-4a3d-9016-05ce033b64d1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:49.236268 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287ebe9-dc93-4a3d-9016-05ce033b64d1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:49.297849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffae914-0dd5-4b31-96d9-a2f3e3a55857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:49.298492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffae914-0dd5-4b31-96d9-a2f3e3a55857 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:49.298772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffae914-0dd5-4b31-96d9-a2f3e3a55857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:49.299128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffae914-0dd5-4b31-96d9-a2f3e3a55857 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:49.299760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffae914-0dd5-4b31-96d9-a2f3e3a55857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:49.301690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffae914-0dd5-4b31-96d9-a2f3e3a55857 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:49.309788 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:49.325991 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4246/8433] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:45:49 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:45:49.330668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e6eb2-4452-4715-b1e7-04b78dd5b6a2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:49.341011 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e6eb2-4452-4715-b1e7-04b78dd5b6a2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:49.345709 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd62894-fade-4d02-8574-d96ea4a89568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:49.346300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd62894-fade-4d02-8574-d96ea4a89568 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:49.346580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd62894-fade-4d02-8574-d96ea4a89568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:49.346849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd62894-fade-4d02-8574-d96ea4a89568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:49.347525 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd62894-fade-4d02-8574-d96ea4a89568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:49.349112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd62894-fade-4d02-8574-d96ea4a89568 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:49.359289 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4188/8434] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:45:49.363311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffae914-0dd5-4b31-96d9-a2f3e3a55857 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:49.373180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffae914-0dd5-4b31-96d9-a2f3e3a55857 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:49.378491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5657f20-901b-4989-8fcc-1abf223bbc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:49.379122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5657f20-901b-4989-8fcc-1abf223bbc20 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:49.379401 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5657f20-901b-4989-8fcc-1abf223bbc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:49.379674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5657f20-901b-4989-8fcc-1abf223bbc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:49.380300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5657f20-901b-4989-8fcc-1abf223bbc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:49.381873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5657f20-901b-4989-8fcc-1abf223bbc20 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:49.394205 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4247/8435] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:45:49.398521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd62894-fade-4d02-8574-d96ea4a89568 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:49.408863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd62894-fade-4d02-8574-d96ea4a89568 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:49.413607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0cd65-6471-482a-a883-ca017165944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:49.414257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0cd65-6471-482a-a883-ca017165944a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:49.414539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0cd65-6471-482a-a883-ca017165944a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:49.414815 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0cd65-6471-482a-a883-ca017165944a admin admin] PATH_INFO: `/v3/projects/a3922018cb024e88a3bb28fb5fc66e66/users/3e325cdaac8b40b4ae75bf325163a943/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:49.430242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0cd65-6471-482a-a883-ca017165944a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3922018cb024e88a3bb28fb5fc66e66, user_id=3e325cdaac8b40b4ae75bf325163a943, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:49.432938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0cd65-6471-482a-a883-ca017165944a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:49.446476 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4189/8436] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:45:49 2022] PUT /identity/v3/projects/a3922018cb024e88a3bb28fb5fc66e66/users/3e325cdaac8b40b4ae75bf325163a943/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:45:49.453708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734b8e-073f-46bf-b5c8-f54f0110f004 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:49.454034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734b8e-073f-46bf-b5c8-f54f0110f004 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:49.454305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734b8e-073f-46bf-b5c8-f54f0110f004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:49.473480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-46734b8e-073f-46bf-b5c8-f54f0110f004 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:45:49.474690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-46734b8e-073f-46bf-b5c8-f54f0110f004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:49.534357 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4248/8437] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:45:49.545115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0cd65-6471-482a-a883-ca017165944a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:49.546800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6ee0cd65-6471-482a-a883-ca017165944a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:49.614836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0cd65-6471-482a-a883-ca017165944a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:49.618618 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a7172-3227-4048-9eb0-d5c1b932d33e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:49.619267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a7172-3227-4048-9eb0-d5c1b932d33e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:49.619543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a7172-3227-4048-9eb0-d5c1b932d33e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:49.619813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a7172-3227-4048-9eb0-d5c1b932d33e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:49.629249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a7172-3227-4048-9eb0-d5c1b932d33e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:49.630688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a7172-3227-4048-9eb0-d5c1b932d33e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:49.640225 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4190/8438] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:45:54.953627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255ad41-0e5c-41e2-a673-40448cfe2e17 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:54.954145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255ad41-0e5c-41e2-a673-40448cfe2e17 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:54.954145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255ad41-0e5c-41e2-a673-40448cfe2e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:55.001252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4255ad41-0e5c-41e2-a673-40448cfe2e17 None None] MFA Rules not processed for user `3e325cdaac8b40b4ae75bf325163a943`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:45:55.002751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4255ad41-0e5c-41e2-a673-40448cfe2e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:45:55.086587 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4249/8439] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:45:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:45:55.091215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a7172-3227-4048-9eb0-d5c1b932d33e service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:55.105728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a7172-3227-4048-9eb0-d5c1b932d33e service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:55.119232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a89d57-e45c-426d-b437-79f63eb8d722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:55.120219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89d57-e45c-426d-b437-79f63eb8d722 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:55.120725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89d57-e45c-426d-b437-79f63eb8d722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:55.121409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89d57-e45c-426d-b437-79f63eb8d722 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:55.122273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a89d57-e45c-426d-b437-79f63eb8d722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:55.126182 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a89d57-e45c-426d-b437-79f63eb8d722 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:55.191662 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4191/8440] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:45:55 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:45:55.196272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255ad41-0e5c-41e2-a673-40448cfe2e17 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:55.213255 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255ad41-0e5c-41e2-a673-40448cfe2e17 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:55.331398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df72ac-fead-4147-b4b3-447b35dff836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:55.332298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df72ac-fead-4147-b4b3-447b35dff836 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:55.332806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df72ac-fead-4147-b4b3-447b35dff836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:55.333082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df72ac-fead-4147-b4b3-447b35dff836 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:55.333730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df72ac-fead-4147-b4b3-447b35dff836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:55.335908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df72ac-fead-4147-b4b3-447b35dff836 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:55.363239 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:55.373245 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4250/8441] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:45:55 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:45:55.376717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a89d57-e45c-426d-b437-79f63eb8d722 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:55.389754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a89d57-e45c-426d-b437-79f63eb8d722 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:55.395751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba5373-ead2-432f-b419-3123133d457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:55.396325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5373-ead2-432f-b419-3123133d457e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:55.396628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5373-ead2-432f-b419-3123133d457e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:55.397042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5373-ead2-432f-b419-3123133d457e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:55.398061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba5373-ead2-432f-b419-3123133d457e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:55.399631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba5373-ead2-432f-b419-3123133d457e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:55.412908 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4192/8442] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:45:55.417052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df72ac-fead-4147-b4b3-447b35dff836 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:55.433923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df72ac-fead-4147-b4b3-447b35dff836 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:55.440170 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea772f1-8ec6-4774-a95b-99b446ee6f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:55.440937 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea772f1-8ec6-4774-a95b-99b446ee6f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:55.441287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea772f1-8ec6-4774-a95b-99b446ee6f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:55.441708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea772f1-8ec6-4774-a95b-99b446ee6f51 admin admin] PATH_INFO: `/v3/projects/1de5844a21bc4b3993432f39853dff68/users/cdc3520b0b4746b2866fa85e75f24b56/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:55.458801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea772f1-8ec6-4774-a95b-99b446ee6f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de5844a21bc4b3993432f39853dff68, user_id=cdc3520b0b4746b2866fa85e75f24b56, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:55.461550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea772f1-8ec6-4774-a95b-99b446ee6f51 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:55.477349 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4251/8443] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:45:55 2022] PUT /identity/v3/projects/1de5844a21bc4b3993432f39853dff68/users/cdc3520b0b4746b2866fa85e75f24b56/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:45:55.481112 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba5373-ead2-432f-b419-3123133d457e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:55.493461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba5373-ead2-432f-b419-3123133d457e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:55.565047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12633778-ffed-4d97-9f68-56833685ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:55.565707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12633778-ffed-4d97-9f68-56833685ac26 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:55.566381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12633778-ffed-4d97-9f68-56833685ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:55.566381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12633778-ffed-4d97-9f68-56833685ac26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:55.566846 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12633778-ffed-4d97-9f68-56833685ac26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:55.568481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12633778-ffed-4d97-9f68-56833685ac26 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:55.580857 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4193/8444] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:45:55.585058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea772f1-8ec6-4774-a95b-99b446ee6f51 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:45:55.597879 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea772f1-8ec6-4774-a95b-99b446ee6f51 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:45:55.604837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822f5a3-c87b-4ca3-92a6-660b508c9f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:45:55.605577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822f5a3-c87b-4ca3-92a6-660b508c9f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:45:55.606511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822f5a3-c87b-4ca3-92a6-660b508c9f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:45:55.606511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822f5a3-c87b-4ca3-92a6-660b508c9f69 admin admin] PATH_INFO: `/v3/projects/1de5844a21bc4b3993432f39853dff68/users/cdc3520b0b4746b2866fa85e75f24b56/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:45:55.608393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822f5a3-c87b-4ca3-92a6-660b508c9f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de5844a21bc4b3993432f39853dff68, user_id=cdc3520b0b4746b2866fa85e75f24b56, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:45:55.612284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822f5a3-c87b-4ca3-92a6-660b508c9f69 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:45:55.644254 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4252/8445] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:45:55 2022] PUT /identity/v3/projects/1de5844a21bc4b3993432f39853dff68/users/cdc3520b0b4746b2866fa85e75f24b56/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:46:01.471009 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc9021-c432-4df4-ac67-1e815479be34 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:46:01.471518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc9021-c432-4df4-ac67-1e815479be34 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:46:01.471619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc9021-c432-4df4-ac67-1e815479be34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:46:01.534056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-efcc9021-c432-4df4-ac67-1e815479be34 None None] MFA Rules not processed for user `cdc3520b0b4746b2866fa85e75f24b56`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:46:01.536604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-efcc9021-c432-4df4-ac67-1e815479be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:46:01.588058 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:01.682976 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4194/8446] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:46:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:46:01.697822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822f5a3-c87b-4ca3-92a6-660b508c9f69 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:46:01.701063 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1822f5a3-c87b-4ca3-92a6-660b508c9f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:46:01.830005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc9021-c432-4df4-ac67-1e815479be34 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:46:01.834314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-efcc9021-c432-4df4-ac67-1e815479be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:46:01.855703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822f5a3-c87b-4ca3-92a6-660b508c9f69 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:46:01.863130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791d344-843b-4062-88c3-bb3c7f6ca433 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:46:01.863902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791d344-843b-4062-88c3-bb3c7f6ca433 service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:46:01.864279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791d344-843b-4062-88c3-bb3c7f6ca433 service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:46:01.864650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791d344-843b-4062-88c3-bb3c7f6ca433 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:46:02.032422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc9021-c432-4df4-ac67-1e815479be34 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:46:02.041708 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22ed10-dd5a-489e-a57e-51ed4cfc2f94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:46:02.042354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22ed10-dd5a-489e-a57e-51ed4cfc2f94 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:46:02.044177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22ed10-dd5a-489e-a57e-51ed4cfc2f94 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:46:02.044458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22ed10-dd5a-489e-a57e-51ed4cfc2f94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:46:02.048275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1f22ed10-dd5a-489e-a57e-51ed4cfc2f94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:46:02.060308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791d344-843b-4062-88c3-bb3c7f6ca433 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:46:02.062187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791d344-843b-4062-88c3-bb3c7f6ca433 service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:46:02.083299 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22ed10-dd5a-489e-a57e-51ed4cfc2f94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:46:02.084974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22ed10-dd5a-489e-a57e-51ed4cfc2f94 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:46:02.097943 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4253/8447] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:46:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:46:02.123072 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4195/8448] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:46:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:46:09.469798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f7a0a-898e-481d-a379-4d4f93923e0a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:46:09.470308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f7a0a-898e-481d-a379-4d4f93923e0a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:46:09.470431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f7a0a-898e-481d-a379-4d4f93923e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:46:09.493415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9d1f7a0a-898e-481d-a379-4d4f93923e0a None None] MFA Rules not processed for user `83bbcff8a1f64cfa936f13f3cb3955b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:46:09.494770 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d1f7a0a-898e-481d-a379-4d4f93923e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:46:09.562830 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4254/8449] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:46:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:46:12.109920 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=53 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:19.554463 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:29.023767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22ed10-dd5a-489e-a57e-51ed4cfc2f94 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:46:29.025177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1f22ed10-dd5a-489e-a57e-51ed4cfc2f94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:46:29.109340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22ed10-dd5a-489e-a57e-51ed4cfc2f94 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:46:29.114257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef957c-82c6-454f-86c9-d4648ceabffd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:46:29.114854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef957c-82c6-454f-86c9-d4648ceabffd service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:46:29.115156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef957c-82c6-454f-86c9-d4648ceabffd service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:46:29.115424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef957c-82c6-454f-86c9-d4648ceabffd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:46:29.123228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef957c-82c6-454f-86c9-d4648ceabffd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:46:29.124858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef957c-82c6-454f-86c9-d4648ceabffd service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:46:29.132823 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4196/8450] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 01:46:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:46:39.129672 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=37 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:12.087012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b916437-b682-439a-81b6-3028108abf3d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:47:12.087524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b916437-b682-439a-81b6-3028108abf3d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:47:12.087630 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b916437-b682-439a-81b6-3028108abf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:47:12.110182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2b916437-b682-439a-81b6-3028108abf3d None None] MFA Rules not processed for user `2eabe99e40ef44a09c3f7dc1c78d7608`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:47:12.111436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2b916437-b682-439a-81b6-3028108abf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:47:12.173874 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4255/8451] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:47:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:47:15.890159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef957c-82c6-454f-86c9-d4648ceabffd service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:47:16.025040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef957c-82c6-454f-86c9-d4648ceabffd service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:47:16.038756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf5658-1e41-48f6-bdad-8330a7790d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:47:16.039937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf5658-1e41-48f6-bdad-8330a7790d1e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:47:16.040218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf5658-1e41-48f6-bdad-8330a7790d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:47:16.040489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf5658-1e41-48f6-bdad-8330a7790d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:47:16.047291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-54cf5658-1e41-48f6-bdad-8330a7790d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:47:16.073838 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf5658-1e41-48f6-bdad-8330a7790d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:47:16.075424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf5658-1e41-48f6-bdad-8330a7790d1e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:47:16.122223 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4197/8452] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:47:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:47:17.390969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b916437-b682-439a-81b6-3028108abf3d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:47:17.392491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2b916437-b682-439a-81b6-3028108abf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:47:17.553039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b916437-b682-439a-81b6-3028108abf3d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:47:17.558881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44302c-ddb5-48a3-9609-77ee7624c740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:47:17.559641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44302c-ddb5-48a3-9609-77ee7624c740 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:47:17.559902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44302c-ddb5-48a3-9609-77ee7624c740 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:47:17.560183 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44302c-ddb5-48a3-9609-77ee7624c740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:47:17.562072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-db44302c-ddb5-48a3-9609-77ee7624c740 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:47:17.581129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44302c-ddb5-48a3-9609-77ee7624c740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:47:17.582733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44302c-ddb5-48a3-9609-77ee7624c740 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:47:17.600500 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4256/8453] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:47:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:47:26.084262 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=30 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:27.594089 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=63 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:51.160601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf5658-1e41-48f6-bdad-8330a7790d1e service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:47:51.181697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf5658-1e41-48f6-bdad-8330a7790d1e service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:47:51.189206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f4b0a-fe0b-492f-8575-b9cfe6352010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:47:51.190032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f4b0a-fe0b-492f-8575-b9cfe6352010 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:47:51.190406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f4b0a-fe0b-492f-8575-b9cfe6352010 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:47:51.190823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f4b0a-fe0b-492f-8575-b9cfe6352010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:47:51.193914 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-906f4b0a-fe0b-492f-8575-b9cfe6352010 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:47:51.218954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f4b0a-fe0b-492f-8575-b9cfe6352010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:47:51.221183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f4b0a-fe0b-492f-8575-b9cfe6352010 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:47:51.245562 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4198/8454] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:47:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:47:56.165712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44302c-ddb5-48a3-9609-77ee7624c740 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:47:56.171347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-db44302c-ddb5-48a3-9609-77ee7624c740 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:47:56.210142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44302c-ddb5-48a3-9609-77ee7624c740 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:47:56.218210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e81708-1fec-4253-8ca7-b8171487d76a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:47:56.219110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e81708-1fec-4253-8ca7-b8171487d76a service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:47:56.219635 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e81708-1fec-4253-8ca7-b8171487d76a service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:47:56.220119 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e81708-1fec-4253-8ca7-b8171487d76a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:47:56.222182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d7e81708-1fec-4253-8ca7-b8171487d76a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:47:56.239765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e81708-1fec-4253-8ca7-b8171487d76a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:47:56.243200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e81708-1fec-4253-8ca7-b8171487d76a service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:47:56.275215 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4257/8455] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:47:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:47:56.551881 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f4b0a-fe0b-492f-8575-b9cfe6352010 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:47:56.553225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-906f4b0a-fe0b-492f-8575-b9cfe6352010 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:47:56.632283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f4b0a-fe0b-492f-8575-b9cfe6352010 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:47:56.637648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:47:56.638290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:47:56.638574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:47:56.638978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] PATH_INFO: `/v3/users/83bbcff8a1f64cfa936f13f3cb3955b6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:47:56.640226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bbcff8a1f64cfa936f13f3cb3955b6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:47:56.642290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:47:56.695481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bbcff8a1f64cfa936f13f3cb3955b6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:56.696126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bbcff8a1f64cfa936f13f3cb3955b6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:56.712929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bbcff8a1f64cfa936f13f3cb3955b6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:56.722326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bbcff8a1f64cfa936f13f3cb3955b6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:56.723180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bbcff8a1f64cfa936f13f3cb3955b6'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:56.751119 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4199/8456] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:47:56 2022] DELETE /identity/v3/users/83bbcff8a1f64cfa936f13f3cb3955b6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:47:56.752629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e2d77-c9ff-40a9-8315-9d6601623d24 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:47:56.752960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e2d77-c9ff-40a9-8315-9d6601623d24 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:47:56.753264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e2d77-c9ff-40a9-8315-9d6601623d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:47:56.772756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8c4e2d77-c9ff-40a9-8315-9d6601623d24 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:47:56.774557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8c4e2d77-c9ff-40a9-8315-9d6601623d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:47:56.841555 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4258/8457] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:47:56.854245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:47:56.855768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:47:56.922599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c43dd-4688-4710-9c09-1ff7857567bf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:47:56.926256 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d8fc2-c532-439a-ad27-be66c1a63d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:47:56.926990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d8fc2-c532-439a-ad27-be66c1a63d41 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:47:56.927285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d8fc2-c532-439a-ad27-be66c1a63d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:47:56.927584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d8fc2-c532-439a-ad27-be66c1a63d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:47:56.939261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d8fc2-c532-439a-ad27-be66c1a63d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:47:56.940453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d8fc2-c532-439a-ad27-be66c1a63d41 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:47:56.946187 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:56.954319 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4200/8458] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:47:57.135652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e2d77-c9ff-40a9-8315-9d6601623d24 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:47:57.137336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8c4e2d77-c9ff-40a9-8315-9d6601623d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:47:57.153043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e2d77-c9ff-40a9-8315-9d6601623d24 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:47:57.166642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:47:57.167323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:47:57.167603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:47:57.167875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] PATH_INFO: `/v3/projects/855792b0264144dd941200c8468ac26d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:47:57.169435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] RBAC: Authorizing `identity:delete_project(project_id=855792b0264144dd941200c8468ac26d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:47:57.171366 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:47:57.221188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855792b0264144dd941200c8468ac26d', 'request_id': 'req-ae75251c-131a-49c5-8040-3b960246261f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.228378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855792b0264144dd941200c8468ac26d', 'request_id': 'req-ae75251c-131a-49c5-8040-3b960246261f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.236583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855792b0264144dd941200c8468ac26d', 'request_id': 'req-ae75251c-131a-49c5-8040-3b960246261f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.249391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] The token cache is being invalidate because project 855792b0264144dd941200c8468ac26d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:47:57.249762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.250494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.252180 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4259/8459] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:47:57 2022] DELETE /identity/v3/projects/855792b0264144dd941200c8468ac26d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:47:57.256312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d8fc2-c532-439a-ad27-be66c1a63d41 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:47:57.267496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d8fc2-c532-439a-ad27-be66c1a63d41 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:47:57.331056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50fca6-d01e-4e53-8b89-debe17df4753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:47:57.331699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50fca6-d01e-4e53-8b89-debe17df4753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:47:57.331978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50fca6-d01e-4e53-8b89-debe17df4753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:47:57.332261 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50fca6-d01e-4e53-8b89-debe17df4753 admin admin] PATH_INFO: `/v3/users/358a87063f3f42db9eaf4c91eeed863a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:47:57.333582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50fca6-d01e-4e53-8b89-debe17df4753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358a87063f3f42db9eaf4c91eeed863a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:47:57.335684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50fca6-d01e-4e53-8b89-debe17df4753 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:47:57.384836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae50fca6-d01e-4e53-8b89-debe17df4753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358a87063f3f42db9eaf4c91eeed863a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.385464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae50fca6-d01e-4e53-8b89-debe17df4753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358a87063f3f42db9eaf4c91eeed863a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.397476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae50fca6-d01e-4e53-8b89-debe17df4753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358a87063f3f42db9eaf4c91eeed863a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.405689 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae50fca6-d01e-4e53-8b89-debe17df4753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358a87063f3f42db9eaf4c91eeed863a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.406436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae50fca6-d01e-4e53-8b89-debe17df4753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358a87063f3f42db9eaf4c91eeed863a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.419346 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4201/8460] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:47:57 2022] DELETE /identity/v3/users/358a87063f3f42db9eaf4c91eeed863a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:47:57.611897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:47:57.613422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:47:57.630012 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75251c-131a-49c5-8040-3b960246261f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:47:57.699684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:47:57.700458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:47:57.700781 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:47:57.701123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] PATH_INFO: `/v3/projects/0006d55fa66e4e34883f683f439fed71` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:47:57.702953 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0006d55fa66e4e34883f683f439fed71)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:47:57.704999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:47:57.707309 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:57.758033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0006d55fa66e4e34883f683f439fed71', 'request_id': 'req-933a8629-d00b-433e-96e4-2044ab86c425'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.764820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0006d55fa66e4e34883f683f439fed71', 'request_id': 'req-933a8629-d00b-433e-96e4-2044ab86c425'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.773516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0006d55fa66e4e34883f683f439fed71', 'request_id': 'req-933a8629-d00b-433e-96e4-2044ab86c425'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.784665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] The token cache is being invalidate because project 0006d55fa66e4e34883f683f439fed71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:47:57.785028 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.785760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:47:57.787370 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4260/8461] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:47:57 2022] DELETE /identity/v3/projects/0006d55fa66e4e34883f683f439fed71 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:47:59.123648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362e5a8-5a18-43e4-bf54-665c84d077ab None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:47:59.124197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362e5a8-5a18-43e4-bf54-665c84d077ab None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:47:59.124276 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362e5a8-5a18-43e4-bf54-665c84d077ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:47:59.145196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c362e5a8-5a18-43e4-bf54-665c84d077ab None None] MFA Rules not processed for user `3e325cdaac8b40b4ae75bf325163a943`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:47:59.146408 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c362e5a8-5a18-43e4-bf54-665c84d077ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:47:59.203145 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4202/8462] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:47:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:48:00.024144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:48:00.025693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:48:00.100465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a8629-d00b-433e-96e4-2044ab86c425 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:48:00.105474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465963d3-4d60-4c7f-8ac3-fbe993b45c88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:48:00.106080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465963d3-4d60-4c7f-8ac3-fbe993b45c88 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:48:00.106360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465963d3-4d60-4c7f-8ac3-fbe993b45c88 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:48:00.106633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465963d3-4d60-4c7f-8ac3-fbe993b45c88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:48:00.108405 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-465963d3-4d60-4c7f-8ac3-fbe993b45c88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:48:00.122233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465963d3-4d60-4c7f-8ac3-fbe993b45c88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:48:00.123832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465963d3-4d60-4c7f-8ac3-fbe993b45c88 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:48:00.136893 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4261/8463] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:48:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:48:09.195255 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:48:10.129724 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:48:17.941926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cbff6-cacb-499b-bcb2-a7c271a33184 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:48:17.942423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cbff6-cacb-499b-bcb2-a7c271a33184 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:48:17.942515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cbff6-cacb-499b-bcb2-a7c271a33184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:48:18.006850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f62cbff6-cacb-499b-bcb2-a7c271a33184 None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:48:18.008166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f62cbff6-cacb-499b-bcb2-a7c271a33184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:48:18.087754 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4203/8464] 10.222.0.39 () {58 vars in 1061 bytes} [Sun Oct 16 01:48:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:48:18.091917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465963d3-4d60-4c7f-8ac3-fbe993b45c88 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:48:18.113068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465963d3-4d60-4c7f-8ac3-fbe993b45c88 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:48:18.117027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e0802-c0fa-443f-b6e1-76393e9b3436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:48:18.117745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e0802-c0fa-443f-b6e1-76393e9b3436 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:48:18.118120 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e0802-c0fa-443f-b6e1-76393e9b3436 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:48:18.118443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e0802-c0fa-443f-b6e1-76393e9b3436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:48:18.120744 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-139e0802-c0fa-443f-b6e1-76393e9b3436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:48:18.212596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e0802-c0fa-443f-b6e1-76393e9b3436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:48:18.215090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e0802-c0fa-443f-b6e1-76393e9b3436 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:48:18.226866 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4262/8465] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:48:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:48:20.187260 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cbff6-cacb-499b-bcb2-a7c271a33184 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:48:20.188683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f62cbff6-cacb-499b-bcb2-a7c271a33184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:48:20.276576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cbff6-cacb-499b-bcb2-a7c271a33184 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:48:20.283605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9e9d9-6cde-4df2-8525-da96f1929249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:48:20.284241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9e9d9-6cde-4df2-8525-da96f1929249 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:48:20.284524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9e9d9-6cde-4df2-8525-da96f1929249 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:48:20.284799 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9e9d9-6cde-4df2-8525-da96f1929249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:48:20.286966 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bbf9e9d9-6cde-4df2-8525-da96f1929249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:48:20.303771 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9e9d9-6cde-4df2-8525-da96f1929249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:48:20.305759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9e9d9-6cde-4df2-8525-da96f1929249 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:48:20.323371 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4204/8466] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:48:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:48:28.221718 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=44 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:48:30.312550 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=80 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:48:48.720998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e0802-c0fa-443f-b6e1-76393e9b3436 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:48:48.736060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e0802-c0fa-443f-b6e1-76393e9b3436 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:48:48.741057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cad851-8a7d-45c5-bb6e-590820e9bc52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:48:48.741645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cad851-8a7d-45c5-bb6e-590820e9bc52 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:48:48.741922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cad851-8a7d-45c5-bb6e-590820e9bc52 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:48:48.742193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cad851-8a7d-45c5-bb6e-590820e9bc52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:48:48.744939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-54cad851-8a7d-45c5-bb6e-590820e9bc52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:48:48.772322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cad851-8a7d-45c5-bb6e-590820e9bc52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:48:48.773904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cad851-8a7d-45c5-bb6e-590820e9bc52 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:48:48.786284 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4263/8467] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:48:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:48:58.779588 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=11 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:12.284105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9e9d9-6cde-4df2-8525-da96f1929249 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:49:12.285885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bbf9e9d9-6cde-4df2-8525-da96f1929249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:49:12.376778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9e9d9-6cde-4df2-8525-da96f1929249 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:49:12.381157 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:49:12.381777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:49:12.382052 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:49:12.382322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] PATH_INFO: `/v3/users/3e325cdaac8b40b4ae75bf325163a943` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:49:12.383796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e325cdaac8b40b4ae75bf325163a943)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:49:12.385704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:49:12.430712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e325cdaac8b40b4ae75bf325163a943'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.431389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e325cdaac8b40b4ae75bf325163a943'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.443295 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e325cdaac8b40b4ae75bf325163a943'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.450586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e325cdaac8b40b4ae75bf325163a943'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.451203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e325cdaac8b40b4ae75bf325163a943'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.463695 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4205/8468] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:49:12 2022] DELETE /identity/v3/users/3e325cdaac8b40b4ae75bf325163a943 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:49:12.640089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cad851-8a7d-45c5-bb6e-590820e9bc52 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:49:12.652581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cad851-8a7d-45c5-bb6e-590820e9bc52 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:49:12.717062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:49:12.717694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:49:12.717973 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:49:12.718246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] PATH_INFO: `/v3/projects/a3922018cb024e88a3bb28fb5fc66e66` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:49:12.719390 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3922018cb024e88a3bb28fb5fc66e66)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:49:12.721286 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:49:12.766123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3922018cb024e88a3bb28fb5fc66e66', 'request_id': 'req-84159f58-d293-4a96-8e6a-0a208a758a44'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.772037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3922018cb024e88a3bb28fb5fc66e66', 'request_id': 'req-84159f58-d293-4a96-8e6a-0a208a758a44'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.779265 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3922018cb024e88a3bb28fb5fc66e66', 'request_id': 'req-84159f58-d293-4a96-8e6a-0a208a758a44'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.789737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] The token cache is being invalidate because project a3922018cb024e88a3bb28fb5fc66e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:49:12.790019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.790653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.792145 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4264/8469] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:49:12 2022] DELETE /identity/v3/projects/a3922018cb024e88a3bb28fb5fc66e66 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:49:12.796174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:49:12.797615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:49:12.810834 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a67043-c323-455c-9576-ad3826ee0429 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:49:12.868676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da560828-e869-413d-b921-795807fddecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:49:12.869302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da560828-e869-413d-b921-795807fddecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:49:12.869583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da560828-e869-413d-b921-795807fddecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:49:12.869855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da560828-e869-413d-b921-795807fddecc admin admin] PATH_INFO: `/v3/users/cdc3520b0b4746b2866fa85e75f24b56` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:49:12.871025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da560828-e869-413d-b921-795807fddecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc3520b0b4746b2866fa85e75f24b56)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:49:12.872944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da560828-e869-413d-b921-795807fddecc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:49:12.874394 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:12.922279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da560828-e869-413d-b921-795807fddecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc3520b0b4746b2866fa85e75f24b56'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.922855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da560828-e869-413d-b921-795807fddecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc3520b0b4746b2866fa85e75f24b56'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.936688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da560828-e869-413d-b921-795807fddecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc3520b0b4746b2866fa85e75f24b56'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.947845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da560828-e869-413d-b921-795807fddecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc3520b0b4746b2866fa85e75f24b56'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.948487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da560828-e869-413d-b921-795807fddecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc3520b0b4746b2866fa85e75f24b56'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:12.960400 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4206/8470] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:49:12 2022] DELETE /identity/v3/users/cdc3520b0b4746b2866fa85e75f24b56 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:49:13.135089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:49:13.136545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:49:13.149870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84159f58-d293-4a96-8e6a-0a208a758a44 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:49:13.209678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:49:13.210224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:49:13.210502 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:49:13.210773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f admin admin] PATH_INFO: `/v3/projects/1de5844a21bc4b3993432f39853dff68` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:49:13.211935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de5844a21bc4b3993432f39853dff68)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:49:13.213843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:49:13.247890 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:13.262178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de5844a21bc4b3993432f39853dff68', 'request_id': 'req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:13.268236 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de5844a21bc4b3993432f39853dff68', 'request_id': 'req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:13.275783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de5844a21bc4b3993432f39853dff68', 'request_id': 'req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:13.286526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f admin admin] The token cache is being invalidate because project 1de5844a21bc4b3993432f39853dff68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:49:13.286910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:13.287631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-695366dc-faa9-4e7e-ae10-9b5ea3972f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:49:13.289197 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4265/8471] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:49:13 2022] DELETE /identity/v3/projects/1de5844a21bc4b3993432f39853dff68 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:49:14.258999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da560828-e869-413d-b921-795807fddecc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:49:14.260580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-da560828-e869-413d-b921-795807fddecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:49:14.324244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da560828-e869-413d-b921-795807fddecc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:49:14.371840 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fed40-3887-417f-850e-856f3aca83d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:49:14.372443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fed40-3887-417f-850e-856f3aca83d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:49:14.372732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fed40-3887-417f-850e-856f3aca83d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:49:14.372989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fed40-3887-417f-850e-856f3aca83d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:49:14.374891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-956fed40-3887-417f-850e-856f3aca83d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:49:14.425788 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:14.459148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fed40-3887-417f-850e-856f3aca83d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:49:14.460578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fed40-3887-417f-850e-856f3aca83d9 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:49:14.479144 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4207/8472] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:49:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:49:23.283264 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:24.476198 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=18 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:25.651167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19728cd-6f10-4d84-b4ae-7bf22bbb4a98 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:49:25.651711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19728cd-6f10-4d84-b4ae-7bf22bbb4a98 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:49:25.651711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19728cd-6f10-4d84-b4ae-7bf22bbb4a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:49:25.679398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a19728cd-6f10-4d84-b4ae-7bf22bbb4a98 None None] MFA Rules not processed for user `2eabe99e40ef44a09c3f7dc1c78d7608`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:49:25.682111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a19728cd-6f10-4d84-b4ae-7bf22bbb4a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:49:25.689046 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4266/8473] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:49:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:49:26.022010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fed40-3887-417f-850e-856f3aca83d9 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:49:26.023562 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-956fed40-3887-417f-850e-856f3aca83d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:49:26.097363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fed40-3887-417f-850e-856f3aca83d9 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:49:26.100899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3710eb0-f231-4647-b643-fa125ea8e731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:49:26.101501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3710eb0-f231-4647-b643-fa125ea8e731 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:49:26.101777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3710eb0-f231-4647-b643-fa125ea8e731 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:49:26.102046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3710eb0-f231-4647-b643-fa125ea8e731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:49:26.103821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e3710eb0-f231-4647-b643-fa125ea8e731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:49:26.115941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3710eb0-f231-4647-b643-fa125ea8e731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:49:26.117367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3710eb0-f231-4647-b643-fa125ea8e731 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:49:26.130679 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4208/8474] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:49:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:49:26.577520 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58821e-e2cb-4089-9520-d69e90160ab9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:49:26.577830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58821e-e2cb-4089-9520-d69e90160ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:49:26.578110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58821e-e2cb-4089-9520-d69e90160ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:49:26.617823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9a58821e-e2cb-4089-9520-d69e90160ab9 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:49:26.619099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9a58821e-e2cb-4089-9520-d69e90160ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:49:26.681867 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4267/8475] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:49:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:49:26.693678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3710eb0-f231-4647-b643-fa125ea8e731 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:49:26.695116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e3710eb0-f231-4647-b643-fa125ea8e731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:49:26.712998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3710eb0-f231-4647-b643-fa125ea8e731 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:49:26.717916 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d85662-6236-4b03-b991-5aeac2118ff8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:49:26.718506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d85662-6236-4b03-b991-5aeac2118ff8 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:49:26.718785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d85662-6236-4b03-b991-5aeac2118ff8 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:49:26.719090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d85662-6236-4b03-b991-5aeac2118ff8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:49:26.727830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d85662-6236-4b03-b991-5aeac2118ff8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:49:26.729552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d85662-6236-4b03-b991-5aeac2118ff8 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:49:26.739123 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4209/8476] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:49:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:49:36.672990 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=41 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:36.735006 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=37 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:53.865651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58821e-e2cb-4089-9520-d69e90160ab9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:49:53.867367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9a58821e-e2cb-4089-9520-d69e90160ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:49:53.884322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58821e-e2cb-4089-9520-d69e90160ab9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:49:53.890411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d37e1-ae61-4e3b-aa4f-e0651a77cc61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:49:53.891115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d37e1-ae61-4e3b-aa4f-e0651a77cc61 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:49:53.891399 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d37e1-ae61-4e3b-aa4f-e0651a77cc61 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:49:53.891734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d37e1-ae61-4e3b-aa4f-e0651a77cc61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:49:53.893605 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-763d37e1-ae61-4e3b-aa4f-e0651a77cc61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:49:53.909560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d37e1-ae61-4e3b-aa4f-e0651a77cc61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:49:53.911169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d37e1-ae61-4e3b-aa4f-e0651a77cc61 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:49:53.925383 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4268/8477] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:49:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:50:03.918148 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:50:43.424453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ae439-9155-4c0a-a623-845b6436b9d6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:50:43.425077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ae439-9155-4c0a-a623-845b6436b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:50:43.425077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ae439-9155-4c0a-a623-845b6436b9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:50:43.454511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-eb3ae439-9155-4c0a-a623-845b6436b9d6 None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:50:43.455740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eb3ae439-9155-4c0a-a623-845b6436b9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:50:43.462708 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4210/8478] 10.222.0.39 () {58 vars in 1061 bytes} [Sun Oct 16 01:50:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:50:43.468657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d37e1-ae61-4e3b-aa4f-e0651a77cc61 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:50:43.480692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d37e1-ae61-4e3b-aa4f-e0651a77cc61 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:50:43.484341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52738eec-1108-4256-8a80-adc789ceead6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:50:43.484925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52738eec-1108-4256-8a80-adc789ceead6 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:50:43.485197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52738eec-1108-4256-8a80-adc789ceead6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:50:43.485461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52738eec-1108-4256-8a80-adc789ceead6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:50:43.487152 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-52738eec-1108-4256-8a80-adc789ceead6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:50:43.499249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52738eec-1108-4256-8a80-adc789ceead6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:50:43.500650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52738eec-1108-4256-8a80-adc789ceead6 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:50:43.511213 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4269/8479] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:50:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:50:53.449810 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:50:53.504995 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:51:18.481455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ae439-9155-4c0a-a623-845b6436b9d6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:51:18.496580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ae439-9155-4c0a-a623-845b6436b9d6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:51:18.500957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e81568-3fee-4398-8f86-7fded416f411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:51:18.501762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e81568-3fee-4398-8f86-7fded416f411 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:51:18.502204 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e81568-3fee-4398-8f86-7fded416f411 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:51:18.502636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e81568-3fee-4398-8f86-7fded416f411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:51:18.504849 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-61e81568-3fee-4398-8f86-7fded416f411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:51:18.612206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e81568-3fee-4398-8f86-7fded416f411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:51:18.613764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e81568-3fee-4398-8f86-7fded416f411 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:51:18.629097 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4211/8480] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:51:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:51:19.815629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52738eec-1108-4256-8a80-adc789ceead6 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:51:19.824244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52738eec-1108-4256-8a80-adc789ceead6 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:51:19.827974 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbabde-b0a4-404a-814e-4f88a034b050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:51:19.828565 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbabde-b0a4-404a-814e-4f88a034b050 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:51:19.828844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbabde-b0a4-404a-814e-4f88a034b050 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:51:19.829116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbabde-b0a4-404a-814e-4f88a034b050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:51:19.830831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fccbabde-b0a4-404a-814e-4f88a034b050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:51:19.847314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbabde-b0a4-404a-814e-4f88a034b050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:51:19.848727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbabde-b0a4-404a-814e-4f88a034b050 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:51:19.862640 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4270/8481] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:51:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:51:28.620850 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=42 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:51:29.855350 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:51:43.906132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e81568-3fee-4398-8f86-7fded416f411 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:51:43.915761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e81568-3fee-4398-8f86-7fded416f411 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:51:43.919359 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895b0f-f6e1-44bf-9564-fa8523faeb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:51:43.919950 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895b0f-f6e1-44bf-9564-fa8523faeb0f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:51:43.920226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895b0f-f6e1-44bf-9564-fa8523faeb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:51:43.920495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895b0f-f6e1-44bf-9564-fa8523faeb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:51:43.922262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b2895b0f-f6e1-44bf-9564-fa8523faeb0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:51:43.987394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2895b0f-f6e1-44bf-9564-fa8523faeb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:51:43.988845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2895b0f-f6e1-44bf-9564-fa8523faeb0f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:51:43.998843 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4212/8482] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:51:46.979526 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbabde-b0a4-404a-814e-4f88a034b050 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:51:46.997370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbabde-b0a4-404a-814e-4f88a034b050 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:51:47.002730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09369dcc-f238-4129-8f69-a2a0fd51eb8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:51:47.003371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09369dcc-f238-4129-8f69-a2a0fd51eb8a service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:51:47.003649 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09369dcc-f238-4129-8f69-a2a0fd51eb8a service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:51:47.003915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09369dcc-f238-4129-8f69-a2a0fd51eb8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:51:47.005636 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-09369dcc-f238-4129-8f69-a2a0fd51eb8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:51:47.021838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09369dcc-f238-4129-8f69-a2a0fd51eb8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:51:47.023492 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09369dcc-f238-4129-8f69-a2a0fd51eb8a service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:51:47.042572 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4271/8483] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:51:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:51:50.330507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895b0f-f6e1-44bf-9564-fa8523faeb0f service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:51:50.332059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b2895b0f-f6e1-44bf-9564-fa8523faeb0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:51:50.349521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895b0f-f6e1-44bf-9564-fa8523faeb0f service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:51:50.355228 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:51:50.355940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:51:50.356421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:51:50.356688 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] PATH_INFO: `/v3/users/2eabe99e40ef44a09c3f7dc1c78d7608` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:51:50.357809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eabe99e40ef44a09c3f7dc1c78d7608)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:51:50.359802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:51:50.413994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eabe99e40ef44a09c3f7dc1c78d7608'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.414672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eabe99e40ef44a09c3f7dc1c78d7608'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.429427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eabe99e40ef44a09c3f7dc1c78d7608'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.437082 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eabe99e40ef44a09c3f7dc1c78d7608'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.438521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eabe99e40ef44a09c3f7dc1c78d7608'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.451223 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4213/8484] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:51:50 2022] DELETE /identity/v3/users/2eabe99e40ef44a09c3f7dc1c78d7608 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:51:50.623753 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09369dcc-f238-4129-8f69-a2a0fd51eb8a service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:51:50.635420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09369dcc-f238-4129-8f69-a2a0fd51eb8a service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:51:50.694008 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:51:50.694627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:51:50.694899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:51:50.695196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] PATH_INFO: `/v3/projects/8eda337f3d1440489b32ada0eb50e9ea` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:51:50.696293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eda337f3d1440489b32ada0eb50e9ea)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:51:50.698178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:51:50.744318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eda337f3d1440489b32ada0eb50e9ea', 'request_id': 'req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.750195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eda337f3d1440489b32ada0eb50e9ea', 'request_id': 'req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.757554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eda337f3d1440489b32ada0eb50e9ea', 'request_id': 'req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.767805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] The token cache is being invalidate because project 8eda337f3d1440489b32ada0eb50e9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:51:50.768095 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.768789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.770358 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4272/8485] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:51:50 2022] DELETE /identity/v3/projects/8eda337f3d1440489b32ada0eb50e9ea => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:51:50.775154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:51:50.776552 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:51:50.790758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962c7ce-ab08-4d2c-827b-bd615e8adf4d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:51:50.846412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fdb92-b48f-4cb0-9822-6964708769f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:51:50.846997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fdb92-b48f-4cb0-9822-6964708769f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:51:50.847278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fdb92-b48f-4cb0-9822-6964708769f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:51:50.847549 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fdb92-b48f-4cb0-9822-6964708769f4 admin admin] PATH_INFO: `/v3/users/1817ed42d6bd476895afd6de5a8b21ff` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:51:50.857947 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:51:50.862028 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fdb92-b48f-4cb0-9822-6964708769f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1817ed42d6bd476895afd6de5a8b21ff)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:51:50.864285 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fdb92-b48f-4cb0-9822-6964708769f4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:51:50.910628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2f9fdb92-b48f-4cb0-9822-6964708769f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1817ed42d6bd476895afd6de5a8b21ff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.911667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2f9fdb92-b48f-4cb0-9822-6964708769f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1817ed42d6bd476895afd6de5a8b21ff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.925063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2f9fdb92-b48f-4cb0-9822-6964708769f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1817ed42d6bd476895afd6de5a8b21ff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.932663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2f9fdb92-b48f-4cb0-9822-6964708769f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1817ed42d6bd476895afd6de5a8b21ff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.933291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2f9fdb92-b48f-4cb0-9822-6964708769f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1817ed42d6bd476895afd6de5a8b21ff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:50.946693 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4214/8486] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:51:50 2022] DELETE /identity/v3/users/1817ed42d6bd476895afd6de5a8b21ff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:51:51.124277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:51:51.125726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:51:51.139553 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9b11f-3cd7-4f58-9af4-2123c14d051f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:51:51.198202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441c989-27b4-4c74-af01-ec7f1f0387e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:51:51.198832 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441c989-27b4-4c74-af01-ec7f1f0387e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:51:51.199138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441c989-27b4-4c74-af01-ec7f1f0387e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:51:51.199413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441c989-27b4-4c74-af01-ec7f1f0387e3 admin admin] PATH_INFO: `/v3/projects/c67631f6e2664762b3689c20f9ae7bf5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:51:51.209576 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441c989-27b4-4c74-af01-ec7f1f0387e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67631f6e2664762b3689c20f9ae7bf5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:51:51.211511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441c989-27b4-4c74-af01-ec7f1f0387e3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:51:51.221999 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:51:51.260125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f441c989-27b4-4c74-af01-ec7f1f0387e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67631f6e2664762b3689c20f9ae7bf5', 'request_id': 'req-f441c989-27b4-4c74-af01-ec7f1f0387e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:51.266547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f441c989-27b4-4c74-af01-ec7f1f0387e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67631f6e2664762b3689c20f9ae7bf5', 'request_id': 'req-f441c989-27b4-4c74-af01-ec7f1f0387e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:51.274530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f441c989-27b4-4c74-af01-ec7f1f0387e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67631f6e2664762b3689c20f9ae7bf5', 'request_id': 'req-f441c989-27b4-4c74-af01-ec7f1f0387e3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:51.285193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f441c989-27b4-4c74-af01-ec7f1f0387e3 admin admin] The token cache is being invalidate because project c67631f6e2664762b3689c20f9ae7bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:51:51.285501 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f441c989-27b4-4c74-af01-ec7f1f0387e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:51.286116 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f441c989-27b4-4c74-af01-ec7f1f0387e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:51:51.288270 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4273/8487] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:51:51 2022] DELETE /identity/v3/projects/c67631f6e2664762b3689c20f9ae7bf5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:52:00.785520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422b88a-e8ad-41f0-afc8-cbf2604f614c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:00.786093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422b88a-e8ad-41f0-afc8-cbf2604f614c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:00.786093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422b88a-e8ad-41f0-afc8-cbf2604f614c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:00.834033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a422b88a-e8ad-41f0-afc8-cbf2604f614c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:52:00.835239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a422b88a-e8ad-41f0-afc8-cbf2604f614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:00.893954 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4215/8488] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:52:00.905024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124380fd-f7f3-49ff-a5d3-c85bcabeaa8f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:00.905523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124380fd-f7f3-49ff-a5d3-c85bcabeaa8f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:00.905631 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124380fd-f7f3-49ff-a5d3-c85bcabeaa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:00.927178 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-124380fd-f7f3-49ff-a5d3-c85bcabeaa8f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:52:00.928883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-124380fd-f7f3-49ff-a5d3-c85bcabeaa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:00.936947 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4274/8489] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:52:00.942407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422b88a-e8ad-41f0-afc8-cbf2604f614c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:00.952972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422b88a-e8ad-41f0-afc8-cbf2604f614c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:00.957572 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77a19-430a-4ca3-932d-0fdbd98e1ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:00.958167 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77a19-430a-4ca3-932d-0fdbd98e1ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:00.958444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77a19-430a-4ca3-932d-0fdbd98e1ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:00.958716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77a19-430a-4ca3-932d-0fdbd98e1ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:00.959497 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77a19-430a-4ca3-932d-0fdbd98e1ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:52:00.959882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77a19-430a-4ca3-932d-0fdbd98e1ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:00.961483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77a19-430a-4ca3-932d-0fdbd98e1ab7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:00.972949 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4216/8490] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:52:00.983351 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124380fd-f7f3-49ff-a5d3-c85bcabeaa8f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:00.993493 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124380fd-f7f3-49ff-a5d3-c85bcabeaa8f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:00.998136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeacfd-487b-4f76-b317-340abaa2cd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:00.998724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeacfd-487b-4f76-b317-340abaa2cd87 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:00.999041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeacfd-487b-4f76-b317-340abaa2cd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:00.999317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeacfd-487b-4f76-b317-340abaa2cd87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:00.999935 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceeacfd-487b-4f76-b317-340abaa2cd87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:01.001859 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceeacfd-487b-4f76-b317-340abaa2cd87 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:01.039558 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4275/8491] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:52:00 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:52:01.043774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77a19-430a-4ca3-932d-0fdbd98e1ab7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:01.054595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77a19-430a-4ca3-932d-0fdbd98e1ab7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:01.092514 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:01.117217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14226545-1b0a-4137-833c-47c94f1191b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:01.117822 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14226545-1b0a-4137-833c-47c94f1191b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:01.118099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14226545-1b0a-4137-833c-47c94f1191b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:01.118372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14226545-1b0a-4137-833c-47c94f1191b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:01.119034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14226545-1b0a-4137-833c-47c94f1191b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:01.120943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14226545-1b0a-4137-833c-47c94f1191b9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:01.142393 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4217/8492] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:52:01 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:52:01.146645 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeacfd-487b-4f76-b317-340abaa2cd87 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:01.156919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeacfd-487b-4f76-b317-340abaa2cd87 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:01.161449 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fe23a-5b02-4118-93a4-6ab43caffea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:01.162032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fe23a-5b02-4118-93a4-6ab43caffea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:01.162939 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fe23a-5b02-4118-93a4-6ab43caffea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:01.163260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fe23a-5b02-4118-93a4-6ab43caffea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:01.163846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fe23a-5b02-4118-93a4-6ab43caffea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:01.165416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fe23a-5b02-4118-93a4-6ab43caffea7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:01.175198 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4276/8493] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:52:01.179997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14226545-1b0a-4137-833c-47c94f1191b9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:01.190940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14226545-1b0a-4137-833c-47c94f1191b9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:01.195718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e24271-8a23-4708-bfb5-ed49e586425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:01.196312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e24271-8a23-4708-bfb5-ed49e586425b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:01.196592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e24271-8a23-4708-bfb5-ed49e586425b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:01.196865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e24271-8a23-4708-bfb5-ed49e586425b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:01.197495 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e24271-8a23-4708-bfb5-ed49e586425b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:01.199113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e24271-8a23-4708-bfb5-ed49e586425b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:01.209296 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4218/8494] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:52:01.213834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fe23a-5b02-4118-93a4-6ab43caffea7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:01.223711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fe23a-5b02-4118-93a4-6ab43caffea7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:01.228999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b733fa-4651-4b3a-81ec-3170d29b022c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:01.229627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b733fa-4651-4b3a-81ec-3170d29b022c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:01.229900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b733fa-4651-4b3a-81ec-3170d29b022c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:01.230169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b733fa-4651-4b3a-81ec-3170d29b022c admin admin] PATH_INFO: `/v3/projects/9b527bb4b1034663ad0b86d62b5ec7dc/users/fda81b2e6ba44b9291b86ae6581a7813/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:01.245404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b733fa-4651-4b3a-81ec-3170d29b022c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b527bb4b1034663ad0b86d62b5ec7dc, user_id=fda81b2e6ba44b9291b86ae6581a7813, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:01.248079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b733fa-4651-4b3a-81ec-3170d29b022c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:01.261109 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4277/8495] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:52:01 2022] PUT /identity/v3/projects/9b527bb4b1034663ad0b86d62b5ec7dc/users/fda81b2e6ba44b9291b86ae6581a7813/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:52:01.272785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9407-afd8-4e2a-beb1-3da238c71f9d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:01.273076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9407-afd8-4e2a-beb1-3da238c71f9d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:01.273354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9407-afd8-4e2a-beb1-3da238c71f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:01.301769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-165b9407-afd8-4e2a-beb1-3da238c71f9d None None] MFA Rules not processed for user `fda81b2e6ba44b9291b86ae6581a7813`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:52:01.303753 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-165b9407-afd8-4e2a-beb1-3da238c71f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:01.367394 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4219/8496] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:52:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:52:01.371821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b733fa-4651-4b3a-81ec-3170d29b022c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:01.432884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b733fa-4651-4b3a-81ec-3170d29b022c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:01.437904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f311e73-8ed2-4a7f-8739-35c7ece4be75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:01.438504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f311e73-8ed2-4a7f-8739-35c7ece4be75 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:01.438782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f311e73-8ed2-4a7f-8739-35c7ece4be75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:01.439088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f311e73-8ed2-4a7f-8739-35c7ece4be75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:01.439711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f311e73-8ed2-4a7f-8739-35c7ece4be75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:01.441590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f311e73-8ed2-4a7f-8739-35c7ece4be75 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:01.468321 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4278/8497] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:52:01 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:52:01.472388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b9407-afd8-4e2a-beb1-3da238c71f9d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:01.483802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b9407-afd8-4e2a-beb1-3da238c71f9d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:01.538876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82206e17-e5c5-4fd1-9a71-b4f897e8a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:01.539511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82206e17-e5c5-4fd1-9a71-b4f897e8a035 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:01.539787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82206e17-e5c5-4fd1-9a71-b4f897e8a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:01.540057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82206e17-e5c5-4fd1-9a71-b4f897e8a035 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:01.540680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82206e17-e5c5-4fd1-9a71-b4f897e8a035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:01.542599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82206e17-e5c5-4fd1-9a71-b4f897e8a035 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:01.565125 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4220/8498] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:52:01 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:52:01.569094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f311e73-8ed2-4a7f-8739-35c7ece4be75 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:01.579763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f311e73-8ed2-4a7f-8739-35c7ece4be75 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:01.584441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce83125-c6f9-4917-8587-ce9dd170ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:01.585707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce83125-c6f9-4917-8587-ce9dd170ac7e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:01.585707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce83125-c6f9-4917-8587-ce9dd170ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:01.586231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce83125-c6f9-4917-8587-ce9dd170ac7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:01.586816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce83125-c6f9-4917-8587-ce9dd170ac7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:01.588428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce83125-c6f9-4917-8587-ce9dd170ac7e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:01.593762 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:01.600517 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4279/8499] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:52:01.604894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82206e17-e5c5-4fd1-9a71-b4f897e8a035 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:01.614935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82206e17-e5c5-4fd1-9a71-b4f897e8a035 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:01.619733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8afee1-3e2e-4d26-804e-a9c72c74d7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:01.620319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8afee1-3e2e-4d26-804e-a9c72c74d7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:01.620597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8afee1-3e2e-4d26-804e-a9c72c74d7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:01.620870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8afee1-3e2e-4d26-804e-a9c72c74d7e5 admin admin] PATH_INFO: `/v3/projects/62367f9e21c34dc8905188d0d896c228/users/cb9dfacb8b3f40d1b081ad000cd4fb31/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:01.635340 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8afee1-3e2e-4d26-804e-a9c72c74d7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62367f9e21c34dc8905188d0d896c228, user_id=cb9dfacb8b3f40d1b081ad000cd4fb31, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:01.637975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8afee1-3e2e-4d26-804e-a9c72c74d7e5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:01.651171 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4221/8500] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:52:01 2022] PUT /identity/v3/projects/62367f9e21c34dc8905188d0d896c228/users/cb9dfacb8b3f40d1b081ad000cd4fb31/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:52:01.655210 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce83125-c6f9-4917-8587-ce9dd170ac7e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:01.666302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce83125-c6f9-4917-8587-ce9dd170ac7e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:01.720754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9699c71-ff2b-40d5-a8f4-84f78a4bb6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:01.721347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699c71-ff2b-40d5-a8f4-84f78a4bb6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:01.721625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699c71-ff2b-40d5-a8f4-84f78a4bb6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:01.721895 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699c71-ff2b-40d5-a8f4-84f78a4bb6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:01.722517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9699c71-ff2b-40d5-a8f4-84f78a4bb6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:01.724130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9699c71-ff2b-40d5-a8f4-84f78a4bb6bf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:01.734760 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4280/8501] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:52:01.739032 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8afee1-3e2e-4d26-804e-a9c72c74d7e5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:01.749516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8afee1-3e2e-4d26-804e-a9c72c74d7e5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:01.754120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4990b2b-940b-4c0a-8ceb-3734ed48388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:01.754768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4990b2b-940b-4c0a-8ceb-3734ed48388d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:01.755090 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4990b2b-940b-4c0a-8ceb-3734ed48388d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:01.755368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4990b2b-940b-4c0a-8ceb-3734ed48388d admin admin] PATH_INFO: `/v3/projects/62367f9e21c34dc8905188d0d896c228/users/cb9dfacb8b3f40d1b081ad000cd4fb31/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:01.757810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4990b2b-940b-4c0a-8ceb-3734ed48388d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62367f9e21c34dc8905188d0d896c228, user_id=cb9dfacb8b3f40d1b081ad000cd4fb31, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:01.760493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4990b2b-940b-4c0a-8ceb-3734ed48388d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:01.766761 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:01.772226 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4222/8502] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:52:01 2022] PUT /identity/v3/projects/62367f9e21c34dc8905188d0d896c228/users/cb9dfacb8b3f40d1b081ad000cd4fb31/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:52:01.782856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170513f-72b0-4a72-a478-c6425af6a275 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:01.783185 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170513f-72b0-4a72-a478-c6425af6a275 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:01.783463 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170513f-72b0-4a72-a478-c6425af6a275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:01.812587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d170513f-72b0-4a72-a478-c6425af6a275 None None] MFA Rules not processed for user `cb9dfacb8b3f40d1b081ad000cd4fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:52:01.813865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d170513f-72b0-4a72-a478-c6425af6a275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:01.882331 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4281/8503] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:52:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:52:01.895704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac48fd-021e-49f0-bc89-825b4de2e6ee None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:01.896226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac48fd-021e-49f0-bc89-825b4de2e6ee None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:01.896325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac48fd-021e-49f0-bc89-825b4de2e6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:01.917362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-92ac48fd-021e-49f0-bc89-825b4de2e6ee None None] MFA Rules not processed for user `fda81b2e6ba44b9291b86ae6581a7813`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:52:01.918624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-92ac48fd-021e-49f0-bc89-825b4de2e6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:01.977981 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4223/8504] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:52:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:52:01.989145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170513f-72b0-4a72-a478-c6425af6a275 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:01.990672 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d170513f-72b0-4a72-a478-c6425af6a275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:02.067216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170513f-72b0-4a72-a478-c6425af6a275 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:02.073270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12184-e3de-4cd3-a7f5-222b026f8ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:02.073873 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12184-e3de-4cd3-a7f5-222b026f8ffd service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:02.074151 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12184-e3de-4cd3-a7f5-222b026f8ffd service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:02.074429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12184-e3de-4cd3-a7f5-222b026f8ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:02.082130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c12184-e3de-4cd3-a7f5-222b026f8ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:02.083738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c12184-e3de-4cd3-a7f5-222b026f8ffd service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:02.093301 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4282/8505] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:52:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:52:02.805633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a05029-dd00-4943-8648-e7641515f255 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:02.805919 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a05029-dd00-4943-8648-e7641515f255 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:02.806193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a05029-dd00-4943-8648-e7641515f255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:02.827810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-21a05029-dd00-4943-8648-e7641515f255 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:52:02.828923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-21a05029-dd00-4943-8648-e7641515f255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:02.894289 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4224/8506] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:52:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:52:02.906147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12184-e3de-4cd3-a7f5-222b026f8ffd service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:02.907545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-67c12184-e3de-4cd3-a7f5-222b026f8ffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:02.924483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12184-e3de-4cd3-a7f5-222b026f8ffd service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:02.930191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec54d4-f28c-4e7f-b722-c6fcef1e9502 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:02.930765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec54d4-f28c-4e7f-b722-c6fcef1e9502 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:02.931072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec54d4-f28c-4e7f-b722-c6fcef1e9502 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:02.931343 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec54d4-f28c-4e7f-b722-c6fcef1e9502 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:02.936390 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:02.941442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec54d4-f28c-4e7f-b722-c6fcef1e9502 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:02.943506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec54d4-f28c-4e7f-b722-c6fcef1e9502 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:02.954483 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4283/8507] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:52:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:52:12.243915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a05029-dd00-4943-8648-e7641515f255 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:12.259436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a05029-dd00-4943-8648-e7641515f255 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:12.264797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c47cb2-3e4a-4993-b0cd-78d7574432aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:12.265394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c47cb2-3e4a-4993-b0cd-78d7574432aa service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:12.265672 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c47cb2-3e4a-4993-b0cd-78d7574432aa service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:12.265944 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c47cb2-3e4a-4993-b0cd-78d7574432aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:12.274436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c47cb2-3e4a-4993-b0cd-78d7574432aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:12.276026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c47cb2-3e4a-4993-b0cd-78d7574432aa service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:12.285336 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4225/8508] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:52:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:52:12.301149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffebd6a-7f5c-4d32-89ce-8d64af6549a8 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:12.301545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffebd6a-7f5c-4d32-89ce-8d64af6549a8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:12.301680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffebd6a-7f5c-4d32-89ce-8d64af6549a8 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:12.303036 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4284/8509] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 01:52:12.308341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c47cb2-3e4a-4993-b0cd-78d7574432aa service nova] Authenticating service token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:52:12.322628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c47cb2-3e4a-4993-b0cd-78d7574432aa service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:12.330804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c47cb2-3e4a-4993-b0cd-78d7574432aa service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:12.335580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e279d-8a19-453c-9f96-6b93f753ea2b tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9dfacb8b3f40d1b081ad000cd4fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62367f9e21c34dc8905188d0d896c228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:12.336187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e279d-8a19-453c-9f96-6b93f753ea2b tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:12.336470 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e279d-8a19-453c-9f96-6b93f753ea2b tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:12.336746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e279d-8a19-453c-9f96-6b93f753ea2b tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] PATH_INFO: `/v3/projects/62367f9e21c34dc8905188d0d896c228` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:12.337883 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e279d-8a19-453c-9f96-6b93f753ea2b tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] RBAC: Authorizing `identity:get_project(project_id=62367f9e21c34dc8905188d0d896c228)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:12.339725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e279d-8a19-453c-9f96-6b93f753ea2b tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:12.341351 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4226/8510] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:52:12 2022] GET /identity/v3/projects/62367f9e21c34dc8905188d0d896c228 => generated 393 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:52:12.495385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffebd6a-7f5c-4d32-89ce-8d64af6549a8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:12.497062 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7ffebd6a-7f5c-4d32-89ce-8d64af6549a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:12.555617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffebd6a-7f5c-4d32-89ce-8d64af6549a8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:12.559167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a2ce8-bb48-47f0-a558-85502d8a6135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:12.559765 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a2ce8-bb48-47f0-a558-85502d8a6135 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:12.560043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a2ce8-bb48-47f0-a558-85502d8a6135 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:12.560337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a2ce8-bb48-47f0-a558-85502d8a6135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:12.562697 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0a8a2ce8-bb48-47f0-a558-85502d8a6135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:12.575155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a2ce8-bb48-47f0-a558-85502d8a6135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:12.576504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a2ce8-bb48-47f0-a558-85502d8a6135 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:12.587340 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4285/8511] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:52:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:52:12.755826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8040743-0c40-45e6-99f6-4a0233755e21 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:12.756118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8040743-0c40-45e6-99f6-4a0233755e21 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:12.756438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8040743-0c40-45e6-99f6-4a0233755e21 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:12.757794 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4227/8512] 10.222.0.39 () {54 vars in 912 bytes} [Sun Oct 16 01:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:52:12.762857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a2ce8-bb48-47f0-a558-85502d8a6135 service neutron] Authenticating service token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 16 01:52:12.764302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0a8a2ce8-bb48-47f0-a558-85502d8a6135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:12.785221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a2ce8-bb48-47f0-a558-85502d8a6135 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:12.796606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a2ce8-bb48-47f0-a558-85502d8a6135 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:12.802101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a20f1-cf13-4dc5-a1f6-95a1906979a0 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9dfacb8b3f40d1b081ad000cd4fb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62367f9e21c34dc8905188d0d896c228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:12.802746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a20f1-cf13-4dc5-a1f6-95a1906979a0 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:12.803068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a20f1-cf13-4dc5-a1f6-95a1906979a0 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:12.803470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a20f1-cf13-4dc5-a1f6-95a1906979a0 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] PATH_INFO: `/v3/projects/62367f9e21c34dc8905188d0d896c228` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:12.805201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a20f1-cf13-4dc5-a1f6-95a1906979a0 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] RBAC: Authorizing `identity:get_project(project_id=62367f9e21c34dc8905188d0d896c228)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:12.808309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a20f1-cf13-4dc5-a1f6-95a1906979a0 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:12.809994 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4286/8513] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Oct 16 01:52:12 2022] GET /identity/v3/projects/62367f9e21c34dc8905188d0d896c228 => generated 393 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:52:16.835001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8040743-0c40-45e6-99f6-4a0233755e21 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:16.901324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8040743-0c40-45e6-99f6-4a0233755e21 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:16.906407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:16.907150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:16.907427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:16.907692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] PATH_INFO: `/v3/users/fda81b2e6ba44b9291b86ae6581a7813` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:16.908806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda81b2e6ba44b9291b86ae6581a7813)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:16.910702 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:16.934879 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:16.961016 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda81b2e6ba44b9291b86ae6581a7813'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:16.961736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda81b2e6ba44b9291b86ae6581a7813'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:16.973728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda81b2e6ba44b9291b86ae6581a7813'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:16.982105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda81b2e6ba44b9291b86ae6581a7813'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:16.982893 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda81b2e6ba44b9291b86ae6581a7813'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:16.996526 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4228/8514] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:52:16 2022] DELETE /identity/v3/users/fda81b2e6ba44b9291b86ae6581a7813 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:52:17.000962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7c769-77b9-49de-bfdb-75d2d3ba67ad None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:17.001407 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7c769-77b9-49de-bfdb-75d2d3ba67ad None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:17.001535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7c769-77b9-49de-bfdb-75d2d3ba67ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:17.020217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-42d7c769-77b9-49de-bfdb-75d2d3ba67ad None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:52:17.021388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-42d7c769-77b9-49de-bfdb-75d2d3ba67ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:17.079429 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4287/8515] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:52:17.088878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:17.090278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:17.146655 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf07901-caf5-445d-a2a6-bbcdf05b824c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:17.150859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15b134-1121-4006-b547-23dea3200e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:17.151484 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15b134-1121-4006-b547-23dea3200e50 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:17.151761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15b134-1121-4006-b547-23dea3200e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:17.152035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15b134-1121-4006-b547-23dea3200e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:17.161017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15b134-1121-4006-b547-23dea3200e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:17.162441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15b134-1121-4006-b547-23dea3200e50 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:17.172398 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4229/8516] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:52:17.340123 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7c769-77b9-49de-bfdb-75d2d3ba67ad None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:17.341642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-42d7c769-77b9-49de-bfdb-75d2d3ba67ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:17.358446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7c769-77b9-49de-bfdb-75d2d3ba67ad None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:17.363277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:17.363911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:17.364193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:17.364578 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] PATH_INFO: `/v3/projects/9b527bb4b1034663ad0b86d62b5ec7dc` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:17.365599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b527bb4b1034663ad0b86d62b5ec7dc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:17.367639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:17.417971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b527bb4b1034663ad0b86d62b5ec7dc', 'request_id': 'req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:17.424333 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b527bb4b1034663ad0b86d62b5ec7dc', 'request_id': 'req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:17.431250 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b527bb4b1034663ad0b86d62b5ec7dc', 'request_id': 'req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:17.441801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] The token cache is being invalidate because project 9b527bb4b1034663ad0b86d62b5ec7dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:52:17.442087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:17.442704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:17.444517 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4288/8517] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:52:17 2022] DELETE /identity/v3/projects/9b527bb4b1034663ad0b86d62b5ec7dc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:52:17.448857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15b134-1121-4006-b547-23dea3200e50 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:17.458463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15b134-1121-4006-b547-23dea3200e50 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:17.514356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6cb00-c6e8-42b9-ba46-e260a6d7239a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:17.515013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6cb00-c6e8-42b9-ba46-e260a6d7239a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:17.515294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6cb00-c6e8-42b9-ba46-e260a6d7239a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:17.515569 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6cb00-c6e8-42b9-ba46-e260a6d7239a admin admin] PATH_INFO: `/v3/users/cb9dfacb8b3f40d1b081ad000cd4fb31` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:17.516695 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6cb00-c6e8-42b9-ba46-e260a6d7239a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9dfacb8b3f40d1b081ad000cd4fb31)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:17.518604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6cb00-c6e8-42b9-ba46-e260a6d7239a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:17.562848 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:17.565665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bad6cb00-c6e8-42b9-ba46-e260a6d7239a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9dfacb8b3f40d1b081ad000cd4fb31'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:17.566897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bad6cb00-c6e8-42b9-ba46-e260a6d7239a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9dfacb8b3f40d1b081ad000cd4fb31'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:17.580831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bad6cb00-c6e8-42b9-ba46-e260a6d7239a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9dfacb8b3f40d1b081ad000cd4fb31'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:17.588621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bad6cb00-c6e8-42b9-ba46-e260a6d7239a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9dfacb8b3f40d1b081ad000cd4fb31'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:17.589173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bad6cb00-c6e8-42b9-ba46-e260a6d7239a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9dfacb8b3f40d1b081ad000cd4fb31'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:17.601793 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4230/8518] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:52:17 2022] DELETE /identity/v3/users/cb9dfacb8b3f40d1b081ad000cd4fb31 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:52:17.888467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:17.889948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:17.905805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02871f-00fd-4511-90cf-9ce3a2b54e0d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:17.915392 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:17.967067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:17.967686 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:17.967978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:17.968227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc admin admin] PATH_INFO: `/v3/projects/62367f9e21c34dc8905188d0d896c228` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:17.969323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=62367f9e21c34dc8905188d0d896c228)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:17.971383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:18.017786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62367f9e21c34dc8905188d0d896c228', 'request_id': 'req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:18.025751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62367f9e21c34dc8905188d0d896c228', 'request_id': 'req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:18.033025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62367f9e21c34dc8905188d0d896c228', 'request_id': 'req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:18.044171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc admin admin] The token cache is being invalidate because project 62367f9e21c34dc8905188d0d896c228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:52:18.044453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:18.045066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37e6d9b8-4272-4e0c-88d2-a789bbe104fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:52:18.046522 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4289/8519] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:52:17 2022] DELETE /identity/v3/projects/62367f9e21c34dc8905188d0d896c228 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:52:18.052645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbd037-0ab7-4460-af8f-710e561b4495 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:18.053134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbd037-0ab7-4460-af8f-710e561b4495 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:18.053225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbd037-0ab7-4460-af8f-710e561b4495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:18.073721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ecfbd037-0ab7-4460-af8f-710e561b4495 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:52:18.074905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ecfbd037-0ab7-4460-af8f-710e561b4495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:18.134978 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4231/8520] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:52:18.143733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f560e41-f893-4bf7-b08d-63ec44adf46e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:18.144043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f560e41-f893-4bf7-b08d-63ec44adf46e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:18.144310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f560e41-f893-4bf7-b08d-63ec44adf46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:18.165662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3f560e41-f893-4bf7-b08d-63ec44adf46e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:52:18.166844 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3f560e41-f893-4bf7-b08d-63ec44adf46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:18.174702 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4290/8521] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:52:18.179079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbd037-0ab7-4460-af8f-710e561b4495 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:18.189208 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbd037-0ab7-4460-af8f-710e561b4495 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:18.193830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993a736-f33b-4f17-904d-09d490c97f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:18.194424 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993a736-f33b-4f17-904d-09d490c97f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:18.194705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993a736-f33b-4f17-904d-09d490c97f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:18.195007 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993a736-f33b-4f17-904d-09d490c97f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:18.195646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993a736-f33b-4f17-904d-09d490c97f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:52:18.195948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993a736-f33b-4f17-904d-09d490c97f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:18.197575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993a736-f33b-4f17-904d-09d490c97f91 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:18.208983 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4232/8522] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:52:18.214154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f560e41-f893-4bf7-b08d-63ec44adf46e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:18.223281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f560e41-f893-4bf7-b08d-63ec44adf46e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:18.229024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde5b8e-31e4-481c-aa67-91859597a6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:18.229603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde5b8e-31e4-481c-aa67-91859597a6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:18.229877 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde5b8e-31e4-481c-aa67-91859597a6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:18.230145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde5b8e-31e4-481c-aa67-91859597a6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:18.230759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde5b8e-31e4-481c-aa67-91859597a6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:18.232663 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde5b8e-31e4-481c-aa67-91859597a6b3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:18.260372 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4291/8523] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:52:18 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:52:18.264505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993a736-f33b-4f17-904d-09d490c97f91 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:18.275415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993a736-f33b-4f17-904d-09d490c97f91 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:18.333263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd70c7b-402d-42a7-88d9-db9b3e2ab477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:18.333869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd70c7b-402d-42a7-88d9-db9b3e2ab477 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:18.334152 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd70c7b-402d-42a7-88d9-db9b3e2ab477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:18.335092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd70c7b-402d-42a7-88d9-db9b3e2ab477 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:18.335732 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd70c7b-402d-42a7-88d9-db9b3e2ab477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:18.337646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd70c7b-402d-42a7-88d9-db9b3e2ab477 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:18.359277 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4233/8524] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:52:18 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:52:18.363434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde5b8e-31e4-481c-aa67-91859597a6b3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:18.373889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde5b8e-31e4-481c-aa67-91859597a6b3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:18.378616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f1edb-8643-4c7c-86b3-a8b72cf8f000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:18.379223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f1edb-8643-4c7c-86b3-a8b72cf8f000 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:18.379500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f1edb-8643-4c7c-86b3-a8b72cf8f000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:18.379768 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f1edb-8643-4c7c-86b3-a8b72cf8f000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:18.380497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f1edb-8643-4c7c-86b3-a8b72cf8f000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:18.382615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f1edb-8643-4c7c-86b3-a8b72cf8f000 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:18.392432 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4292/8525] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:52:18.396373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd70c7b-402d-42a7-88d9-db9b3e2ab477 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:18.407568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd70c7b-402d-42a7-88d9-db9b3e2ab477 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:18.412243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef92810-4cc0-45f0-b2d6-9f440c5d59f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:18.412953 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef92810-4cc0-45f0-b2d6-9f440c5d59f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:18.413227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef92810-4cc0-45f0-b2d6-9f440c5d59f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:18.413502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef92810-4cc0-45f0-b2d6-9f440c5d59f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:18.414138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef92810-4cc0-45f0-b2d6-9f440c5d59f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:18.415759 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef92810-4cc0-45f0-b2d6-9f440c5d59f7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:18.425667 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4234/8526] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:52:18.430121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f1edb-8643-4c7c-86b3-a8b72cf8f000 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:18.440446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f1edb-8643-4c7c-86b3-a8b72cf8f000 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:18.445925 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e942dba-9a58-4450-9aba-4675337cb09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:18.446595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e942dba-9a58-4450-9aba-4675337cb09e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:18.446876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e942dba-9a58-4450-9aba-4675337cb09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:18.447241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e942dba-9a58-4450-9aba-4675337cb09e admin admin] PATH_INFO: `/v3/projects/924af2c85e58409f98d3f36ed18a2c54/users/b7e66bc068b34d9d865a4cc9b73d28d2/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:18.462424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e942dba-9a58-4450-9aba-4675337cb09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=924af2c85e58409f98d3f36ed18a2c54, user_id=b7e66bc068b34d9d865a4cc9b73d28d2, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:18.465108 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e942dba-9a58-4450-9aba-4675337cb09e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:18.478206 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4293/8527] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:52:18 2022] PUT /identity/v3/projects/924af2c85e58409f98d3f36ed18a2c54/users/b7e66bc068b34d9d865a4cc9b73d28d2/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:52:18.483324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c69ba9-ea38-4c55-bfcb-11c1ffd9f56a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:18.483614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c69ba9-ea38-4c55-bfcb-11c1ffd9f56a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:18.483890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c69ba9-ea38-4c55-bfcb-11c1ffd9f56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:18.502615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e9c69ba9-ea38-4c55-bfcb-11c1ffd9f56a None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:52:18.503841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e9c69ba9-ea38-4c55-bfcb-11c1ffd9f56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:18.526122 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:18.567878 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4235/8528] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:52:18.578129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e942dba-9a58-4450-9aba-4675337cb09e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:18.579866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7e942dba-9a58-4450-9aba-4675337cb09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:18.622045 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:18.639330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e942dba-9a58-4450-9aba-4675337cb09e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:18.643129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b8fff-4994-4f11-a509-6d3bb6db338e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:18.643676 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b8fff-4994-4f11-a509-6d3bb6db338e service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:18.643956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b8fff-4994-4f11-a509-6d3bb6db338e service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:18.644228 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b8fff-4994-4f11-a509-6d3bb6db338e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:18.654162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b8fff-4994-4f11-a509-6d3bb6db338e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:18.655622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b8fff-4994-4f11-a509-6d3bb6db338e service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:18.665138 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4294/8529] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:52:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:52:22.742955 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67338310-8c45-4d79-a0a3-f0d40acaf408 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:22.743456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67338310-8c45-4d79-a0a3-f0d40acaf408 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:22.743543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67338310-8c45-4d79-a0a3-f0d40acaf408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:22.785820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-67338310-8c45-4d79-a0a3-f0d40acaf408 None None] MFA Rules not processed for user `b7e66bc068b34d9d865a4cc9b73d28d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:52:22.787047 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-67338310-8c45-4d79-a0a3-f0d40acaf408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:22.867737 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4236/8530] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:52:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:52:22.879336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbbcd-d44e-48cd-9e31-7abdee008d61 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:22.879845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbbcd-d44e-48cd-9e31-7abdee008d61 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:22.879948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbbcd-d44e-48cd-9e31-7abdee008d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:22.899647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-eb6bbbcd-d44e-48cd-9e31-7abdee008d61 None None] MFA Rules not processed for user `b7e66bc068b34d9d865a4cc9b73d28d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:52:22.900883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eb6bbbcd-d44e-48cd-9e31-7abdee008d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:22.908080 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4295/8531] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:52:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:52:22.923483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67338310-8c45-4d79-a0a3-f0d40acaf408 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:22.925109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-67338310-8c45-4d79-a0a3-f0d40acaf408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:23.008279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67338310-8c45-4d79-a0a3-f0d40acaf408 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:23.014223 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cc0ec-eee5-4eac-829b-b3012820547b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:23.014854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cc0ec-eee5-4eac-829b-b3012820547b service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:23.015170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cc0ec-eee5-4eac-829b-b3012820547b service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:23.015443 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cc0ec-eee5-4eac-829b-b3012820547b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:23.024635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29cc0ec-eee5-4eac-829b-b3012820547b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:23.026241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29cc0ec-eee5-4eac-829b-b3012820547b service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:23.036056 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4237/8532] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:52:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:52:30.692983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbbcd-d44e-48cd-9e31-7abdee008d61 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:30.697237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eb6bbbcd-d44e-48cd-9e31-7abdee008d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:30.721074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbbcd-d44e-48cd-9e31-7abdee008d61 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:30.733331 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e356a31-b016-49f7-929f-72e8e0e7b379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:30.734192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e356a31-b016-49f7-929f-72e8e0e7b379 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:30.734652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e356a31-b016-49f7-929f-72e8e0e7b379 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:30.735193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e356a31-b016-49f7-929f-72e8e0e7b379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:30.737257 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3e356a31-b016-49f7-929f-72e8e0e7b379 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:30.754038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e356a31-b016-49f7-929f-72e8e0e7b379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:30.756292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e356a31-b016-49f7-929f-72e8e0e7b379 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:30.770533 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4296/8533] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:52:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:52:33.032094 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:33.369422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cc0ec-eee5-4eac-829b-b3012820547b service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:33.378939 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cc0ec-eee5-4eac-829b-b3012820547b service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:33.382606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f874c-0e0a-43d7-9411-4d3a2fff0d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:33.383243 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f874c-0e0a-43d7-9411-4d3a2fff0d69 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:33.383519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f874c-0e0a-43d7-9411-4d3a2fff0d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:33.383786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f874c-0e0a-43d7-9411-4d3a2fff0d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:33.385871 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-640f874c-0e0a-43d7-9411-4d3a2fff0d69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:33.399081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f874c-0e0a-43d7-9411-4d3a2fff0d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:33.400515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f874c-0e0a-43d7-9411-4d3a2fff0d69 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:33.411558 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4238/8534] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:52:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:52:33.504334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01c3cb-684d-4069-a6c0-39a3f0134b03 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:33.504829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01c3cb-684d-4069-a6c0-39a3f0134b03 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:33.505053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01c3cb-684d-4069-a6c0-39a3f0134b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:33.525287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cc01c3cb-684d-4069-a6c0-39a3f0134b03 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:52:33.526474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc01c3cb-684d-4069-a6c0-39a3f0134b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:33.589561 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4297/8535] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:52:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:52:33.601059 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f874c-0e0a-43d7-9411-4d3a2fff0d69 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:33.602459 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-640f874c-0e0a-43d7-9411-4d3a2fff0d69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:33.619873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f874c-0e0a-43d7-9411-4d3a2fff0d69 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:33.624750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e2641-6d7e-4dbf-a828-7d6079fc8e50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:33.625762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e2641-6d7e-4dbf-a828-7d6079fc8e50 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:33.626041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e2641-6d7e-4dbf-a828-7d6079fc8e50 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:33.626314 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e2641-6d7e-4dbf-a828-7d6079fc8e50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:33.635113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e2641-6d7e-4dbf-a828-7d6079fc8e50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:33.636670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e2641-6d7e-4dbf-a828-7d6079fc8e50 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:33.646538 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4239/8536] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:52:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:52:33.825439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01c3cb-684d-4069-a6c0-39a3f0134b03 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:52:33.826994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc01c3cb-684d-4069-a6c0-39a3f0134b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:33.838392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01c3cb-684d-4069-a6c0-39a3f0134b03 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:52:33.842050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82740bc-1ad7-4e5a-b495-aad434f00ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:52:33.842590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82740bc-1ad7-4e5a-b495-aad434f00ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:52:33.842870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82740bc-1ad7-4e5a-b495-aad434f00ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:52:33.843187 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82740bc-1ad7-4e5a-b495-aad434f00ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:52:33.844863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d82740bc-1ad7-4e5a-b495-aad434f00ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:52:33.861193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82740bc-1ad7-4e5a-b495-aad434f00ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:52:33.862624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82740bc-1ad7-4e5a-b495-aad434f00ea4 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:52:33.877152 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4298/8537] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:52:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:52:43.642189 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=12 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:43.869456 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=53 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:07.677517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e2641-6d7e-4dbf-a828-7d6079fc8e50 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:07.687505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e2641-6d7e-4dbf-a828-7d6079fc8e50 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:07.691103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca22e2-7bb5-4d72-8416-5e405e229d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:07.691691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca22e2-7bb5-4d72-8416-5e405e229d45 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:07.691967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca22e2-7bb5-4d72-8416-5e405e229d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:07.692236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca22e2-7bb5-4d72-8416-5e405e229d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:07.693936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bfca22e2-7bb5-4d72-8416-5e405e229d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:53:07.706805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca22e2-7bb5-4d72-8416-5e405e229d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:07.708242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca22e2-7bb5-4d72-8416-5e405e229d45 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:07.721273 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4240/8538] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:53:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:53:08.177317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82740bc-1ad7-4e5a-b495-aad434f00ea4 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:08.193452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82740bc-1ad7-4e5a-b495-aad434f00ea4 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:08.201086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f7a88-4752-4af0-9f73-cd1e97c9fe92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:08.201695 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f7a88-4752-4af0-9f73-cd1e97c9fe92 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:08.201972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f7a88-4752-4af0-9f73-cd1e97c9fe92 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:08.202273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f7a88-4752-4af0-9f73-cd1e97c9fe92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:08.204069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-868f7a88-4752-4af0-9f73-cd1e97c9fe92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:53:08.221142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f7a88-4752-4af0-9f73-cd1e97c9fe92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:08.222835 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f7a88-4752-4af0-9f73-cd1e97c9fe92 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:08.237103 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4299/8539] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:53:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:53:17.722693 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:18.230056 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:19.544972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca22e2-7bb5-4d72-8416-5e405e229d45 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:19.569133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca22e2-7bb5-4d72-8416-5e405e229d45 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:19.574455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804328e6-7cbf-4203-bd5f-36e30b6d9b27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:19.575103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804328e6-7cbf-4203-bd5f-36e30b6d9b27 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:19.575387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804328e6-7cbf-4203-bd5f-36e30b6d9b27 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:19.575659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804328e6-7cbf-4203-bd5f-36e30b6d9b27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:19.577385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-804328e6-7cbf-4203-bd5f-36e30b6d9b27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:53:19.592232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804328e6-7cbf-4203-bd5f-36e30b6d9b27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:19.594143 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804328e6-7cbf-4203-bd5f-36e30b6d9b27 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:19.610228 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4241/8540] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:53:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:53:19.612642 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f7a88-4752-4af0-9f73-cd1e97c9fe92 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:19.632529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f7a88-4752-4af0-9f73-cd1e97c9fe92 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:19.638790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc097c-4a8a-467e-a0dd-e77c4bea67d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:19.639458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc097c-4a8a-467e-a0dd-e77c4bea67d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:19.639739 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc097c-4a8a-467e-a0dd-e77c4bea67d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:19.640016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc097c-4a8a-467e-a0dd-e77c4bea67d2 admin admin] PATH_INFO: `/v3/users/b7e66bc068b34d9d865a4cc9b73d28d2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:19.641180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc097c-4a8a-467e-a0dd-e77c4bea67d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e66bc068b34d9d865a4cc9b73d28d2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:19.643141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc097c-4a8a-467e-a0dd-e77c4bea67d2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:19.690246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aadc097c-4a8a-467e-a0dd-e77c4bea67d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e66bc068b34d9d865a4cc9b73d28d2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:53:19.690819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aadc097c-4a8a-467e-a0dd-e77c4bea67d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e66bc068b34d9d865a4cc9b73d28d2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:53:19.703319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aadc097c-4a8a-467e-a0dd-e77c4bea67d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e66bc068b34d9d865a4cc9b73d28d2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:53:19.710488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aadc097c-4a8a-467e-a0dd-e77c4bea67d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e66bc068b34d9d865a4cc9b73d28d2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:53:19.711126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aadc097c-4a8a-467e-a0dd-e77c4bea67d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e66bc068b34d9d865a4cc9b73d28d2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:53:19.723850 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4300/8541] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:53:19 2022] DELETE /identity/v3/users/b7e66bc068b34d9d865a4cc9b73d28d2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:53:19.901628 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804328e6-7cbf-4203-bd5f-36e30b6d9b27 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:19.915654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804328e6-7cbf-4203-bd5f-36e30b6d9b27 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:19.973546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:19.974108 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:19.974389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:19.974693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9 admin admin] PATH_INFO: `/v3/projects/924af2c85e58409f98d3f36ed18a2c54` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:19.975844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=924af2c85e58409f98d3f36ed18a2c54)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:19.977779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:20.023105 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924af2c85e58409f98d3f36ed18a2c54', 'request_id': 'req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:53:20.029778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924af2c85e58409f98d3f36ed18a2c54', 'request_id': 'req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:53:20.037135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924af2c85e58409f98d3f36ed18a2c54', 'request_id': 'req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:53:20.047948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9 admin admin] The token cache is being invalidate because project 924af2c85e58409f98d3f36ed18a2c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:53:20.048341 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:53:20.048978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3d8d0eb3-860c-4a17-97b6-453ee0da72b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:53:20.050481 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4242/8542] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:53:19 2022] DELETE /identity/v3/projects/924af2c85e58409f98d3f36ed18a2c54 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:53:20.055566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd072c8f-03ca-4a47-b480-cea1e88c3ef4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:20.055857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd072c8f-03ca-4a47-b480-cea1e88c3ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:20.056136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd072c8f-03ca-4a47-b480-cea1e88c3ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:20.076627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bd072c8f-03ca-4a47-b480-cea1e88c3ef4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:53:20.077839 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bd072c8f-03ca-4a47-b480-cea1e88c3ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:53:20.137101 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4301/8543] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:53:20.145842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e3a60-24b0-423f-bb1b-248a9d3b0a01 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:20.146128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e3a60-24b0-423f-bb1b-248a9d3b0a01 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:20.146404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e3a60-24b0-423f-bb1b-248a9d3b0a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:20.166660 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-921e3a60-24b0-423f-bb1b-248a9d3b0a01 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:53:20.167890 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-921e3a60-24b0-423f-bb1b-248a9d3b0a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:53:20.176145 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4243/8544] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:53:20.180138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd072c8f-03ca-4a47-b480-cea1e88c3ef4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:20.190266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd072c8f-03ca-4a47-b480-cea1e88c3ef4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:20.194815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af930-65c7-4255-8707-91d1e06a3512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:20.195437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af930-65c7-4255-8707-91d1e06a3512 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:20.195715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af930-65c7-4255-8707-91d1e06a3512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:20.195986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af930-65c7-4255-8707-91d1e06a3512 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:20.196617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6af930-65c7-4255-8707-91d1e06a3512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:53:20.196918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6af930-65c7-4255-8707-91d1e06a3512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:20.199047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6af930-65c7-4255-8707-91d1e06a3512 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:20.210293 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4302/8545] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:53:20.215690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e3a60-24b0-423f-bb1b-248a9d3b0a01 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:20.225035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e3a60-24b0-423f-bb1b-248a9d3b0a01 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:20.229593 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d79f7-44c6-4f23-a65f-a1a79e18a3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:20.230171 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d79f7-44c6-4f23-a65f-a1a79e18a3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:20.230449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d79f7-44c6-4f23-a65f-a1a79e18a3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:20.230720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d79f7-44c6-4f23-a65f-a1a79e18a3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:20.231384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d79f7-44c6-4f23-a65f-a1a79e18a3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:20.233264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d79f7-44c6-4f23-a65f-a1a79e18a3d7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:20.261753 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4244/8546] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:53:20 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:53:20.265806 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af930-65c7-4255-8707-91d1e06a3512 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:20.277074 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af930-65c7-4255-8707-91d1e06a3512 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:20.334497 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55411e40-d56d-4678-99ab-fe5c05422224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:20.335167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55411e40-d56d-4678-99ab-fe5c05422224 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:20.335446 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55411e40-d56d-4678-99ab-fe5c05422224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:20.335713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55411e40-d56d-4678-99ab-fe5c05422224 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:20.336336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55411e40-d56d-4678-99ab-fe5c05422224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:20.339833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55411e40-d56d-4678-99ab-fe5c05422224 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:20.348014 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:20.363950 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4303/8547] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:53:20 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:53:20.368064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d79f7-44c6-4f23-a65f-a1a79e18a3d7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:20.380067 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d79f7-44c6-4f23-a65f-a1a79e18a3d7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:20.384693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64beffa-6678-4150-87a2-1c0499a1a15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:20.386092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64beffa-6678-4150-87a2-1c0499a1a15b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:20.386400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64beffa-6678-4150-87a2-1c0499a1a15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:20.386675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64beffa-6678-4150-87a2-1c0499a1a15b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:20.387334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64beffa-6678-4150-87a2-1c0499a1a15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:20.388949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64beffa-6678-4150-87a2-1c0499a1a15b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:20.400143 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4245/8548] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:53:20.404805 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55411e40-d56d-4678-99ab-fe5c05422224 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:20.415030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55411e40-d56d-4678-99ab-fe5c05422224 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:20.419981 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c8ced-a093-4fd3-a890-b5abf8ab3280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:20.420569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8ced-a093-4fd3-a890-b5abf8ab3280 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:20.420874 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8ced-a093-4fd3-a890-b5abf8ab3280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:20.421141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8ced-a093-4fd3-a890-b5abf8ab3280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:20.421792 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c8ced-a093-4fd3-a890-b5abf8ab3280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:20.423412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c8ced-a093-4fd3-a890-b5abf8ab3280 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:20.434826 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4304/8549] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:53:20.439496 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64beffa-6678-4150-87a2-1c0499a1a15b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:20.450073 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64beffa-6678-4150-87a2-1c0499a1a15b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:20.454845 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9b197-e87a-4dea-936d-3fa541ca58a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:20.455535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9b197-e87a-4dea-936d-3fa541ca58a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:20.455814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9b197-e87a-4dea-936d-3fa541ca58a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:20.456085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9b197-e87a-4dea-936d-3fa541ca58a7 admin admin] PATH_INFO: `/v3/projects/59d41904861f49f18d0fd1011bba8ba5/users/ca43706de46f42efa2a0883aff54aab8/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:20.470587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9b197-e87a-4dea-936d-3fa541ca58a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d41904861f49f18d0fd1011bba8ba5, user_id=ca43706de46f42efa2a0883aff54aab8, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:20.473272 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9b197-e87a-4dea-936d-3fa541ca58a7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:20.486604 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4246/8550] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:53:20 2022] PUT /identity/v3/projects/59d41904861f49f18d0fd1011bba8ba5/users/ca43706de46f42efa2a0883aff54aab8/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:53:20.491762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6603ad6-6c73-400f-a99a-9bf9c10d95cf None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:20.492049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6603ad6-6c73-400f-a99a-9bf9c10d95cf None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:20.492322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6603ad6-6c73-400f-a99a-9bf9c10d95cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:20.512727 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f6603ad6-6c73-400f-a99a-9bf9c10d95cf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:53:20.513994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f6603ad6-6c73-400f-a99a-9bf9c10d95cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:53:20.576895 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4305/8551] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:53:20.586797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9b197-e87a-4dea-936d-3fa541ca58a7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:20.588687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b2c9b197-e87a-4dea-936d-3fa541ca58a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:53:20.602963 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:20.648316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9b197-e87a-4dea-936d-3fa541ca58a7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:20.652018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a999b4-331a-485f-bd7b-afdcc5ab12a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:20.652621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a999b4-331a-485f-bd7b-afdcc5ab12a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:20.652925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a999b4-331a-485f-bd7b-afdcc5ab12a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:20.653195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a999b4-331a-485f-bd7b-afdcc5ab12a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:20.662287 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a999b4-331a-485f-bd7b-afdcc5ab12a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:20.663746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a999b4-331a-485f-bd7b-afdcc5ab12a1 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:20.673119 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4247/8552] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:53:24.780732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24f7f1-8ebf-4246-acbe-72f69014ddd4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:24.781227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24f7f1-8ebf-4246-acbe-72f69014ddd4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:24.781335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24f7f1-8ebf-4246-acbe-72f69014ddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:24.814539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6f24f7f1-8ebf-4246-acbe-72f69014ddd4 None None] MFA Rules not processed for user `ca43706de46f42efa2a0883aff54aab8`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:53:24.815784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6f24f7f1-8ebf-4246-acbe-72f69014ddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:53:24.899112 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4306/8553] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:53:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:53:24.909991 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc726-4560-4b95-b66a-00c5e4ff8d20 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:24.910506 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc726-4560-4b95-b66a-00c5e4ff8d20 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:24.910599 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc726-4560-4b95-b66a-00c5e4ff8d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:24.932956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c71dc726-4560-4b95-b66a-00c5e4ff8d20 None None] MFA Rules not processed for user `ca43706de46f42efa2a0883aff54aab8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:53:24.934172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c71dc726-4560-4b95-b66a-00c5e4ff8d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:53:24.941563 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4248/8554] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:53:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:53:24.955464 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24f7f1-8ebf-4246-acbe-72f69014ddd4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:24.956945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6f24f7f1-8ebf-4246-acbe-72f69014ddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:53:25.046078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24f7f1-8ebf-4246-acbe-72f69014ddd4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:25.052154 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb342f-bf09-47d0-a477-9991833d6d0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:25.052778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb342f-bf09-47d0-a477-9991833d6d0f service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:25.053060 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb342f-bf09-47d0-a477-9991833d6d0f service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:25.053332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb342f-bf09-47d0-a477-9991833d6d0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:25.059478 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:25.064287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb342f-bf09-47d0-a477-9991833d6d0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:25.066505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb342f-bf09-47d0-a477-9991833d6d0f service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:25.087257 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4307/8555] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:53:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:53:34.925735 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=23 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:35.076865 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:54.736580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc726-4560-4b95-b66a-00c5e4ff8d20 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:53:54.737996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c71dc726-4560-4b95-b66a-00c5e4ff8d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:53:54.812474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc726-4560-4b95-b66a-00c5e4ff8d20 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:53:54.817313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894949-20bf-45db-a929-08ffb9abb19f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:53:54.817920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894949-20bf-45db-a929-08ffb9abb19f service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:53:54.818200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894949-20bf-45db-a929-08ffb9abb19f service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:53:54.818518 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894949-20bf-45db-a929-08ffb9abb19f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:53:54.820271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-11894949-20bf-45db-a929-08ffb9abb19f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:53:54.835491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11894949-20bf-45db-a929-08ffb9abb19f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:53:54.837101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11894949-20bf-45db-a929-08ffb9abb19f service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:53:54.850658 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4249/8556] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:53:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:54:04.843820 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=32 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:54:16.073881 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded718b-c579-4a3e-b102-cbcac51504ee None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:54:16.074422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded718b-c579-4a3e-b102-cbcac51504ee None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:54:16.074422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded718b-c579-4a3e-b102-cbcac51504ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:54:16.093484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bded718b-c579-4a3e-b102-cbcac51504ee None None] MFA Rules not processed for user `ca43706de46f42efa2a0883aff54aab8`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:54:16.094681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bded718b-c579-4a3e-b102-cbcac51504ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:54:16.101596 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4308/8557] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:54:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:54:26.088178 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:54:55.548670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894949-20bf-45db-a929-08ffb9abb19f service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:54:55.550128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-11894949-20bf-45db-a929-08ffb9abb19f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:54:55.567203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894949-20bf-45db-a929-08ffb9abb19f service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:54:55.572251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff62f48-2435-4e82-b15b-3d108072b506 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:54:55.572854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff62f48-2435-4e82-b15b-3d108072b506 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:54:55.573134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff62f48-2435-4e82-b15b-3d108072b506 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:54:55.573406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff62f48-2435-4e82-b15b-3d108072b506 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:54:55.575126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0ff62f48-2435-4e82-b15b-3d108072b506 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:54:55.589777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff62f48-2435-4e82-b15b-3d108072b506 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:54:55.591404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff62f48-2435-4e82-b15b-3d108072b506 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:54:55.604267 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4250/8558] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:54:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:55:05.597487 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:55:08.481652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded718b-c579-4a3e-b102-cbcac51504ee None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:08.492638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded718b-c579-4a3e-b102-cbcac51504ee None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:08.498148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8d31f-7059-4862-8f17-d843203d730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:08.498900 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8d31f-7059-4862-8f17-d843203d730e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:08.499212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8d31f-7059-4862-8f17-d843203d730e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:08.499482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8d31f-7059-4862-8f17-d843203d730e admin admin] PATH_INFO: `/v3/users/ca43706de46f42efa2a0883aff54aab8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:08.500598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8d31f-7059-4862-8f17-d843203d730e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca43706de46f42efa2a0883aff54aab8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:08.502508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8d31f-7059-4862-8f17-d843203d730e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:08.553129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5a8d31f-7059-4862-8f17-d843203d730e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca43706de46f42efa2a0883aff54aab8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:55:08.553772 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5a8d31f-7059-4862-8f17-d843203d730e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca43706de46f42efa2a0883aff54aab8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:55:08.571800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5a8d31f-7059-4862-8f17-d843203d730e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca43706de46f42efa2a0883aff54aab8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:55:08.579878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5a8d31f-7059-4862-8f17-d843203d730e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca43706de46f42efa2a0883aff54aab8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:55:08.580718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b5a8d31f-7059-4862-8f17-d843203d730e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca43706de46f42efa2a0883aff54aab8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:55:08.593910 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4309/8559] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:55:08 2022] DELETE /identity/v3/users/ca43706de46f42efa2a0883aff54aab8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:55:08.776177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff62f48-2435-4e82-b15b-3d108072b506 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:08.789691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff62f48-2435-4e82-b15b-3d108072b506 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:08.847426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:08.847977 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:08.848257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:08.848528 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02 admin admin] PATH_INFO: `/v3/projects/59d41904861f49f18d0fd1011bba8ba5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:08.849627 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d41904861f49f18d0fd1011bba8ba5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:08.851575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:08.897749 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d41904861f49f18d0fd1011bba8ba5', 'request_id': 'req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:55:08.903920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d41904861f49f18d0fd1011bba8ba5', 'request_id': 'req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:55:08.911250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d41904861f49f18d0fd1011bba8ba5', 'request_id': 'req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:55:08.922195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02 admin admin] The token cache is being invalidate because project 59d41904861f49f18d0fd1011bba8ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:55:08.922487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:55:08.923147 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9d5a4ac7-947d-4985-a261-1bfe34ef8c02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:55:08.924620 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4251/8560] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:55:08 2022] DELETE /identity/v3/projects/59d41904861f49f18d0fd1011bba8ba5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:55:08.929757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cb0ea-cab9-4904-a8ce-1065c3b8373f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:08.930050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cb0ea-cab9-4904-a8ce-1065c3b8373f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:08.930329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cb0ea-cab9-4904-a8ce-1065c3b8373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:08.950885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e38cb0ea-cab9-4904-a8ce-1065c3b8373f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:55:08.952112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e38cb0ea-cab9-4904-a8ce-1065c3b8373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:55:09.011845 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4310/8561] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:55:09.020640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d07f7-0621-46d7-9427-cfafedc8e813 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:09.020932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d07f7-0621-46d7-9427-cfafedc8e813 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:09.021211 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d07f7-0621-46d7-9427-cfafedc8e813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:09.042046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6b4d07f7-0621-46d7-9427-cfafedc8e813 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:55:09.043278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6b4d07f7-0621-46d7-9427-cfafedc8e813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:55:09.051753 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4252/8562] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:55:09.055932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cb0ea-cab9-4904-a8ce-1065c3b8373f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:09.066173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cb0ea-cab9-4904-a8ce-1065c3b8373f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:09.070851 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a08022-971f-447a-bb9b-b2c3fc0d8068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:09.071485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a08022-971f-447a-bb9b-b2c3fc0d8068 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:09.071763 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a08022-971f-447a-bb9b-b2c3fc0d8068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:09.072036 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a08022-971f-447a-bb9b-b2c3fc0d8068 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:09.072704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a08022-971f-447a-bb9b-b2c3fc0d8068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:55:09.073009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a08022-971f-447a-bb9b-b2c3fc0d8068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:09.074647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a08022-971f-447a-bb9b-b2c3fc0d8068 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:09.086248 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4311/8563] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 01:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:55:09.090481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d07f7-0621-46d7-9427-cfafedc8e813 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:09.100460 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d07f7-0621-46d7-9427-cfafedc8e813 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:09.105048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064b9a2-81b7-455a-a5f8-2099c7962a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:09.105637 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064b9a2-81b7-455a-a5f8-2099c7962a4d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:09.105917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064b9a2-81b7-455a-a5f8-2099c7962a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:09.106189 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064b9a2-81b7-455a-a5f8-2099c7962a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:09.107417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064b9a2-81b7-455a-a5f8-2099c7962a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:09.109498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064b9a2-81b7-455a-a5f8-2099c7962a4d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:09.135908 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4253/8564] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 01:55:09 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:55:09.140128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a08022-971f-447a-bb9b-b2c3fc0d8068 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:09.150082 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a08022-971f-447a-bb9b-b2c3fc0d8068 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:09.207312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609743f-2eeb-4fde-82ee-8f899f422eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:09.207911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609743f-2eeb-4fde-82ee-8f899f422eed admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:09.208191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609743f-2eeb-4fde-82ee-8f899f422eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:09.208471 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609743f-2eeb-4fde-82ee-8f899f422eed admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:09.209089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609743f-2eeb-4fde-82ee-8f899f422eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:09.211017 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609743f-2eeb-4fde-82ee-8f899f422eed admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:09.219454 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:55:09.234853 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4312/8565] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 01:55:09 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:55:09.239051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064b9a2-81b7-455a-a5f8-2099c7962a4d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:09.249617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064b9a2-81b7-455a-a5f8-2099c7962a4d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:09.254114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d4b11-557e-4363-8184-0a5ff970a62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:09.254694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d4b11-557e-4363-8184-0a5ff970a62a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:09.254996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d4b11-557e-4363-8184-0a5ff970a62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:09.255268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d4b11-557e-4363-8184-0a5ff970a62a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:09.255892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d4b11-557e-4363-8184-0a5ff970a62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:09.257487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d4b11-557e-4363-8184-0a5ff970a62a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:09.268155 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4254/8566] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:55:09.272267 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609743f-2eeb-4fde-82ee-8f899f422eed admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:09.283318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609743f-2eeb-4fde-82ee-8f899f422eed admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:09.288023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebf2a0-fc23-4e52-8eec-96cb1bdc22d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:09.288607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebf2a0-fc23-4e52-8eec-96cb1bdc22d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:09.288888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebf2a0-fc23-4e52-8eec-96cb1bdc22d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:09.289161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebf2a0-fc23-4e52-8eec-96cb1bdc22d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:09.289794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebf2a0-fc23-4e52-8eec-96cb1bdc22d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:09.291439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebf2a0-fc23-4e52-8eec-96cb1bdc22d5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:09.302600 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4313/8567] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:55:09.306654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d4b11-557e-4363-8184-0a5ff970a62a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:09.316790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d4b11-557e-4363-8184-0a5ff970a62a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:09.321329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb49431-5872-4540-92f6-2a186f48db30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:09.321957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb49431-5872-4540-92f6-2a186f48db30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:09.322231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb49431-5872-4540-92f6-2a186f48db30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:09.322505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb49431-5872-4540-92f6-2a186f48db30 admin admin] PATH_INFO: `/v3/projects/f810218c158a4fb0baded3bbff983c71/users/b12139c2484c4e4fbbf9839ab577ee5c/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:09.337705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb49431-5872-4540-92f6-2a186f48db30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f810218c158a4fb0baded3bbff983c71, user_id=b12139c2484c4e4fbbf9839ab577ee5c, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:09.340377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb49431-5872-4540-92f6-2a186f48db30 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:09.353738 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4255/8568] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 01:55:09 2022] PUT /identity/v3/projects/f810218c158a4fb0baded3bbff983c71/users/b12139c2484c4e4fbbf9839ab577ee5c/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:55:09.359330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf501d0-7d8c-4b58-be6d-56bfdec77ce9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:09.359638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf501d0-7d8c-4b58-be6d-56bfdec77ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:09.359918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf501d0-7d8c-4b58-be6d-56bfdec77ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:09.378988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ccf501d0-7d8c-4b58-be6d-56bfdec77ce9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:55:09.380181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ccf501d0-7d8c-4b58-be6d-56bfdec77ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:55:09.439786 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4314/8569] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:55:09.449507 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb49431-5872-4540-92f6-2a186f48db30 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:09.452258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dbb49431-5872-4540-92f6-2a186f48db30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:55:09.483252 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:55:09.512421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb49431-5872-4540-92f6-2a186f48db30 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:09.516514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1770edb-57c8-4898-bcf3-cf17f2eb1363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:09.517110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1770edb-57c8-4898-bcf3-cf17f2eb1363 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:09.517385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1770edb-57c8-4898-bcf3-cf17f2eb1363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:09.517651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1770edb-57c8-4898-bcf3-cf17f2eb1363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:09.526523 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1770edb-57c8-4898-bcf3-cf17f2eb1363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:09.527972 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1770edb-57c8-4898-bcf3-cf17f2eb1363 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:09.537782 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4256/8570] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:55:13.620271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf3e45-3495-421e-9101-68e8dac301a5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:13.620787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf3e45-3495-421e-9101-68e8dac301a5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:13.620787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf3e45-3495-421e-9101-68e8dac301a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:13.654080 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ceaf3e45-3495-421e-9101-68e8dac301a5 None None] MFA Rules not processed for user `b12139c2484c4e4fbbf9839ab577ee5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:55:13.655356 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ceaf3e45-3495-421e-9101-68e8dac301a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:55:13.724993 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4315/8571] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:55:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:55:13.740699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1770edb-57c8-4898-bcf3-cf17f2eb1363 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:13.742192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a1770edb-57c8-4898-bcf3-cf17f2eb1363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:55:13.823296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1770edb-57c8-4898-bcf3-cf17f2eb1363 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:13.830773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3999a4-3e6f-4bc0-88f8-be138ca4763f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:13.831455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3999a4-3e6f-4bc0-88f8-be138ca4763f service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:13.831737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3999a4-3e6f-4bc0-88f8-be138ca4763f service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:13.832014 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3999a4-3e6f-4bc0-88f8-be138ca4763f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:13.840774 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3999a4-3e6f-4bc0-88f8-be138ca4763f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:13.843064 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3999a4-3e6f-4bc0-88f8-be138ca4763f service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:13.852946 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4257/8572] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:55:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:55:15.242620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061603e-3544-4a52-b54f-c47a78ea76d7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:15.243114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061603e-3544-4a52-b54f-c47a78ea76d7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:15.243209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061603e-3544-4a52-b54f-c47a78ea76d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:15.263043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6061603e-3544-4a52-b54f-c47a78ea76d7 None None] MFA Rules not processed for user `b12139c2484c4e4fbbf9839ab577ee5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:55:15.264337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6061603e-3544-4a52-b54f-c47a78ea76d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:55:15.271225 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4316/8573] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:55:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:55:15.592793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3999a4-3e6f-4bc0-88f8-be138ca4763f service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:15.602248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3999a4-3e6f-4bc0-88f8-be138ca4763f service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:15.605993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a75d6d-5a58-4aee-84ae-ed37c4baf2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:15.606621 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a75d6d-5a58-4aee-84ae-ed37c4baf2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:15.606905 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a75d6d-5a58-4aee-84ae-ed37c4baf2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:15.607205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a75d6d-5a58-4aee-84ae-ed37c4baf2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:15.609128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b0a75d6d-5a58-4aee-84ae-ed37c4baf2a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:55:15.621498 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a75d6d-5a58-4aee-84ae-ed37c4baf2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:15.622999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a75d6d-5a58-4aee-84ae-ed37c4baf2a7 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:15.633940 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4258/8574] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:55:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:55:15.977094 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061603e-3544-4a52-b54f-c47a78ea76d7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:15.978563 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6061603e-3544-4a52-b54f-c47a78ea76d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:55:16.054955 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:55:16.063537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061603e-3544-4a52-b54f-c47a78ea76d7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:16.069297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced59ef8-0da8-4b64-8bbe-5e2de8310b46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:16.069574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced59ef8-0da8-4b64-8bbe-5e2de8310b46 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:16.069849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced59ef8-0da8-4b64-8bbe-5e2de8310b46 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:16.070118 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced59ef8-0da8-4b64-8bbe-5e2de8310b46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:16.071861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ced59ef8-0da8-4b64-8bbe-5e2de8310b46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:55:16.084821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced59ef8-0da8-4b64-8bbe-5e2de8310b46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:16.086414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced59ef8-0da8-4b64-8bbe-5e2de8310b46 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:16.101831 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4317/8575] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:55:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:55:25.627747 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=54 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:55:26.092355 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:55:48.410110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a75d6d-5a58-4aee-84ae-ed37c4baf2a7 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:48.411645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b0a75d6d-5a58-4aee-84ae-ed37c4baf2a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:55:48.421876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a75d6d-5a58-4aee-84ae-ed37c4baf2a7 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:48.425989 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1ece6-5632-4055-9671-4977419cf68c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:48.426585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1ece6-5632-4055-9671-4977419cf68c service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:48.426869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1ece6-5632-4055-9671-4977419cf68c service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:48.427172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1ece6-5632-4055-9671-4977419cf68c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:48.428870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a0b1ece6-5632-4055-9671-4977419cf68c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:55:48.441722 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1ece6-5632-4055-9671-4977419cf68c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:48.443207 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1ece6-5632-4055-9671-4977419cf68c service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:48.453692 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4259/8576] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:55:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:55:56.721055 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bade83-1bbd-4b35-9bd7-c4cab16b4ee4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:56.721606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bade83-1bbd-4b35-9bd7-c4cab16b4ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:56.721606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bade83-1bbd-4b35-9bd7-c4cab16b4ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:56.741622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-83bade83-1bbd-4b35-9bd7-c4cab16b4ee4 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:55:56.742932 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-83bade83-1bbd-4b35-9bd7-c4cab16b4ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:55:56.751700 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4318/8577] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Oct 16 01:55:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:55:56.764785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1ece6-5632-4055-9671-4977419cf68c service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:55:56.780858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1ece6-5632-4055-9671-4977419cf68c service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:55:56.791632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574b422-0654-4509-ab39-f81bc40bec8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:55:56.792333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574b422-0654-4509-ab39-f81bc40bec8a service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:55:56.792678 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574b422-0654-4509-ab39-f81bc40bec8a service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:55:56.793010 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574b422-0654-4509-ab39-f81bc40bec8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:55:56.803439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574b422-0654-4509-ab39-f81bc40bec8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:55:56.805000 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574b422-0654-4509-ab39-f81bc40bec8a service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:55:56.816660 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4260/8578] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:55:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:56:06.735456 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:06.810766 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=12 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:20.149494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bade83-1bbd-4b35-9bd7-c4cab16b4ee4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:56:20.158748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bade83-1bbd-4b35-9bd7-c4cab16b4ee4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:56:20.164029 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae2969-01a7-41ce-b323-9337523f1742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:56:20.164819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae2969-01a7-41ce-b323-9337523f1742 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:56:20.165142 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae2969-01a7-41ce-b323-9337523f1742 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:56:20.165506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae2969-01a7-41ce-b323-9337523f1742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:56:20.167759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d9ae2969-01a7-41ce-b323-9337523f1742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:56:20.186027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae2969-01a7-41ce-b323-9337523f1742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:56:20.187760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae2969-01a7-41ce-b323-9337523f1742 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:56:20.203470 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4319/8579] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:56:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:56:21.815671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea4f9a-a61f-4cda-9c5a-695fb80a1205 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:56:21.816224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea4f9a-a61f-4cda-9c5a-695fb80a1205 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:56:21.816224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea4f9a-a61f-4cda-9c5a-695fb80a1205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:56:21.836134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-deea4f9a-a61f-4cda-9c5a-695fb80a1205 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:56:21.837319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-deea4f9a-a61f-4cda-9c5a-695fb80a1205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:56:21.845914 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4261/8580] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Oct 16 01:56:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:56:21.861431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc531a63-ce49-4ce3-ac8e-716332bc267f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:56:21.861919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc531a63-ce49-4ce3-ac8e-716332bc267f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:56:21.862027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc531a63-ce49-4ce3-ac8e-716332bc267f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:56:21.881568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cc531a63-ce49-4ce3-ac8e-716332bc267f None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:56:21.882742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc531a63-ce49-4ce3-ac8e-716332bc267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:56:21.891077 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4320/8581] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Oct 16 01:56:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:56:21.897745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea4f9a-a61f-4cda-9c5a-695fb80a1205 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:56:21.908063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea4f9a-a61f-4cda-9c5a-695fb80a1205 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:56:21.913625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ed885-84da-4b3c-a460-e73aef9136d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:56:21.914218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ed885-84da-4b3c-a460-e73aef9136d2 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:56:21.914494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ed885-84da-4b3c-a460-e73aef9136d2 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:56:21.914764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ed885-84da-4b3c-a460-e73aef9136d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:56:21.923456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ed885-84da-4b3c-a460-e73aef9136d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:56:21.925230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ed885-84da-4b3c-a460-e73aef9136d2 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:56:21.935009 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4262/8582] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:56:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:56:22.574826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc531a63-ce49-4ce3-ac8e-716332bc267f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:56:22.585155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc531a63-ce49-4ce3-ac8e-716332bc267f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:56:22.588708 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56692-33e8-4dc7-8b5b-27b73f8979c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:56:22.589297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56692-33e8-4dc7-8b5b-27b73f8979c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:56:22.589571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56692-33e8-4dc7-8b5b-27b73f8979c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:56:22.589843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56692-33e8-4dc7-8b5b-27b73f8979c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:56:22.591550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a1f56692-33e8-4dc7-8b5b-27b73f8979c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:56:22.607298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f56692-33e8-4dc7-8b5b-27b73f8979c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:56:22.608647 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f56692-33e8-4dc7-8b5b-27b73f8979c1 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:56:22.622260 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4321/8583] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:56:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:56:30.667139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1921c-ce1d-41e8-87e6-3427f72e3200 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:56:30.667630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1921c-ce1d-41e8-87e6-3427f72e3200 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:56:30.667743 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1921c-ce1d-41e8-87e6-3427f72e3200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:56:30.686720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-57e1921c-ce1d-41e8-87e6-3427f72e3200 None None] MFA Rules not processed for user `b12139c2484c4e4fbbf9839ab577ee5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:56:30.687998 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-57e1921c-ce1d-41e8-87e6-3427f72e3200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:56:30.695059 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4263/8584] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:56:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:56:32.615138 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=15 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:40.681652 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=12 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:43.233372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56692-33e8-4dc7-8b5b-27b73f8979c1 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:56:43.234782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a1f56692-33e8-4dc7-8b5b-27b73f8979c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:56:43.251538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56692-33e8-4dc7-8b5b-27b73f8979c1 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:56:43.258467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea995456-fa69-4bc3-93bd-f3099dfe6d49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:56:43.259180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea995456-fa69-4bc3-93bd-f3099dfe6d49 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:56:43.259533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea995456-fa69-4bc3-93bd-f3099dfe6d49 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:56:43.259875 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea995456-fa69-4bc3-93bd-f3099dfe6d49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:56:43.261693 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ea995456-fa69-4bc3-93bd-f3099dfe6d49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:56:43.277422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea995456-fa69-4bc3-93bd-f3099dfe6d49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:56:43.279066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea995456-fa69-4bc3-93bd-f3099dfe6d49 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:56:43.292682 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4322/8585] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:56:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:56:53.285578 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:57:33.036284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1921c-ce1d-41e8-87e6-3427f72e3200 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:57:33.055651 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1921c-ce1d-41e8-87e6-3427f72e3200 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:57:33.060863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804c78d-c6ae-462a-8008-a3a371f71b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:57:33.061476 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804c78d-c6ae-462a-8008-a3a371f71b2e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:57:33.061751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804c78d-c6ae-462a-8008-a3a371f71b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:57:33.062021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804c78d-c6ae-462a-8008-a3a371f71b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:57:33.065224 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0804c78d-c6ae-462a-8008-a3a371f71b2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:57:33.079623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804c78d-c6ae-462a-8008-a3a371f71b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:57:33.081061 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804c78d-c6ae-462a-8008-a3a371f71b2e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:57:33.092901 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4264/8586] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:57:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:57:33.185452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea995456-fa69-4bc3-93bd-f3099dfe6d49 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:57:33.199905 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea995456-fa69-4bc3-93bd-f3099dfe6d49 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:57:33.204994 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516d084-67df-4cd1-8fe7-0e14ac041487 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:57:33.205586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516d084-67df-4cd1-8fe7-0e14ac041487 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:57:33.205872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516d084-67df-4cd1-8fe7-0e14ac041487 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:57:33.206147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516d084-67df-4cd1-8fe7-0e14ac041487 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:57:33.207871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d516d084-67df-4cd1-8fe7-0e14ac041487 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:57:33.219314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516d084-67df-4cd1-8fe7-0e14ac041487 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:57:33.220911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516d084-67df-4cd1-8fe7-0e14ac041487 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:57:33.231201 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4323/8587] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:57:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:57:33.463785 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804c78d-c6ae-462a-8008-a3a371f71b2e service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:57:33.479227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804c78d-c6ae-462a-8008-a3a371f71b2e service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:57:33.484225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9626e4-6022-443d-a402-98e3c5d612eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:57:33.484814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9626e4-6022-443d-a402-98e3c5d612eb service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:57:33.485096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9626e4-6022-443d-a402-98e3c5d612eb service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:57:33.485369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9626e4-6022-443d-a402-98e3c5d612eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:57:33.487118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1e9626e4-6022-443d-a402-98e3c5d612eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:57:33.498417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9626e4-6022-443d-a402-98e3c5d612eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:57:33.500021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9626e4-6022-443d-a402-98e3c5d612eb service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:57:33.509761 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4265/8588] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:57:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:57:43.226462 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:57:43.505590 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=16 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:57:44.148009 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516d084-67df-4cd1-8fe7-0e14ac041487 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:57:44.182653 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516d084-67df-4cd1-8fe7-0e14ac041487 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:57:44.191291 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fa0c8-201d-4311-950d-db2f72cdcfd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:57:44.191906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fa0c8-201d-4311-950d-db2f72cdcfd4 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:57:44.192641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fa0c8-201d-4311-950d-db2f72cdcfd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:57:44.193110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fa0c8-201d-4311-950d-db2f72cdcfd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:57:44.195628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-423fa0c8-201d-4311-950d-db2f72cdcfd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:57:44.219072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fa0c8-201d-4311-950d-db2f72cdcfd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:57:44.220691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fa0c8-201d-4311-950d-db2f72cdcfd4 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:57:44.235737 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4324/8589] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:57:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:57:49.410605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61933-11b4-4ca2-ac21-28209da2c878 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:57:49.411114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61933-11b4-4ca2-ac21-28209da2c878 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:57:49.411212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61933-11b4-4ca2-ac21-28209da2c878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:57:49.431065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-aca61933-11b4-4ca2-ac21-28209da2c878 None None] MFA Rules not processed for user `b12139c2484c4e4fbbf9839ab577ee5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:57:49.432190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aca61933-11b4-4ca2-ac21-28209da2c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:57:49.439222 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4266/8590] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:57:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:57:54.227890 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:57:59.425996 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:58:32.630713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b985d-e64d-4d37-8c1c-5936d0e7d817 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:32.631347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b985d-e64d-4d37-8c1c-5936d0e7d817 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:32.631347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b985d-e64d-4d37-8c1c-5936d0e7d817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:32.691741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-162b985d-e64d-4d37-8c1c-5936d0e7d817 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:58:32.692946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-162b985d-e64d-4d37-8c1c-5936d0e7d817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:58:32.746619 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4325/8591] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Oct 16 01:58:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:58:32.752330 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5d0b4-0e38-4d85-b209-41c481d0db9f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:32.752810 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5d0b4-0e38-4d85-b209-41c481d0db9f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:32.752912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5d0b4-0e38-4d85-b209-41c481d0db9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:32.774716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-37b5d0b4-0e38-4d85-b209-41c481d0db9f None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:58:32.775974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-37b5d0b4-0e38-4d85-b209-41c481d0db9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:58:32.785154 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4267/8592] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:58:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:58:32.797175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b985d-e64d-4d37-8c1c-5936d0e7d817 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:58:32.806346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b985d-e64d-4d37-8c1c-5936d0e7d817 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:58:32.809940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41ed66-4d07-4de6-8077-69749b14648d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:58:32.810790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ed66-4d07-4de6-8077-69749b14648d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:32.811101 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ed66-4d07-4de6-8077-69749b14648d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:32.811374 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ed66-4d07-4de6-8077-69749b14648d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:32.826193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41ed66-4d07-4de6-8077-69749b14648d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:58:32.828551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41ed66-4d07-4de6-8077-69749b14648d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:58:32.841469 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4326/8593] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:58:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:58:32.859102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5d0b4-0e38-4d85-b209-41c481d0db9f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:58:32.868546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5d0b4-0e38-4d85-b209-41c481d0db9f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:58:32.872373 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213e9ef-9d5e-4210-8dc6-2776361811f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:58:32.872987 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213e9ef-9d5e-4210-8dc6-2776361811f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:32.873262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213e9ef-9d5e-4210-8dc6-2776361811f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:32.873532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213e9ef-9d5e-4210-8dc6-2776361811f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:32.875368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6213e9ef-9d5e-4210-8dc6-2776361811f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:58:32.892884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213e9ef-9d5e-4210-8dc6-2776361811f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:58:32.894327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213e9ef-9d5e-4210-8dc6-2776361811f0 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:58:32.909624 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4268/8594] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:58:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:58:34.020571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ad3b2-91d4-442d-a21d-dba67d77f6b2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:34.021129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ad3b2-91d4-442d-a21d-dba67d77f6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:34.021235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ad3b2-91d4-442d-a21d-dba67d77f6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:34.024259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e291-e0d1-48dc-a793-e8fd2e735f8c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:34.024663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e291-e0d1-48dc-a793-e8fd2e735f8c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:34.024844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e291-e0d1-48dc-a793-e8fd2e735f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:34.042548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e96ad3b2-91d4-442d-a21d-dba67d77f6b2 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:58:34.043869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e96ad3b2-91d4-442d-a21d-dba67d77f6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:58:34.053293 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4327/8595] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Oct 16 01:58:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:58:34.059384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5273683-d807-4b52-8951-5ec9c693e987 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:34.059670 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5273683-d807-4b52-8951-5ec9c693e987 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:34.059943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5273683-d807-4b52-8951-5ec9c693e987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:34.064468 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7689e291-e0d1-48dc-a793-e8fd2e735f8c None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:58:34.065765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7689e291-e0d1-48dc-a793-e8fd2e735f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:58:34.073183 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4269/8596] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Oct 16 01:58:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:58:34.080969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d5273683-d807-4b52-8951-5ec9c693e987 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:58:34.082163 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d5273683-d807-4b52-8951-5ec9c693e987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:58:34.084427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e291-e0d1-48dc-a793-e8fd2e735f8c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:58:34.093208 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4328/8597] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:58:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:58:34.094745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e291-e0d1-48dc-a793-e8fd2e735f8c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:58:34.098579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd642a-3e94-4d54-aee5-3e263e4d8139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:58:34.099217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd642a-3e94-4d54-aee5-3e263e4d8139 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:34.099502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd642a-3e94-4d54-aee5-3e263e4d8139 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:34.099777 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd642a-3e94-4d54-aee5-3e263e4d8139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:34.106431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5273683-d807-4b52-8951-5ec9c693e987 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:58:34.108900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd642a-3e94-4d54-aee5-3e263e4d8139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:58:34.111218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd642a-3e94-4d54-aee5-3e263e4d8139 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:58:34.116112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5273683-d807-4b52-8951-5ec9c693e987 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:58:34.119836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebfdef-10f9-4672-b83c-85c28084ce58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:58:34.120045 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4270/8598] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:58:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:58:34.120560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebfdef-10f9-4672-b83c-85c28084ce58 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:34.120919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebfdef-10f9-4672-b83c-85c28084ce58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:34.121319 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebfdef-10f9-4672-b83c-85c28084ce58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:34.131961 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebfdef-10f9-4672-b83c-85c28084ce58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:58:34.133388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebfdef-10f9-4672-b83c-85c28084ce58 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:58:34.145353 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4329/8599] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:58:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:58:44.116273 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=24 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:58:44.140164 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=53 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:58:46.773704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0995f-4ede-4d59-85e4-de989c693345 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:46.774278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0995f-4ede-4d59-85e4-de989c693345 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:46.774278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0995f-4ede-4d59-85e4-de989c693345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:46.795437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c3b0995f-4ede-4d59-85e4-de989c693345 None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:58:46.796617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c3b0995f-4ede-4d59-85e4-de989c693345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:58:46.803050 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4271/8600] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Oct 16 01:58:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:58:46.818943 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebfdef-10f9-4672-b83c-85c28084ce58 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:58:46.828249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebfdef-10f9-4672-b83c-85c28084ce58 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:58:46.831864 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73856279-50d8-4ea8-9d06-028b534ce450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:58:46.832448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73856279-50d8-4ea8-9d06-028b534ce450 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:46.832726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73856279-50d8-4ea8-9d06-028b534ce450 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:46.832997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73856279-50d8-4ea8-9d06-028b534ce450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:46.840444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73856279-50d8-4ea8-9d06-028b534ce450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:58:46.841850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73856279-50d8-4ea8-9d06-028b534ce450 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:58:46.849546 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4330/8601] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:58:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:58:47.265885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0995f-4ede-4d59-85e4-de989c693345 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:58:47.280202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0995f-4ede-4d59-85e4-de989c693345 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:58:47.286013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf162cb-8b12-4f76-90a0-b2753cf56c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:58:47.286681 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf162cb-8b12-4f76-90a0-b2753cf56c35 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:47.286904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf162cb-8b12-4f76-90a0-b2753cf56c35 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:47.287212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf162cb-8b12-4f76-90a0-b2753cf56c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:47.288967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-adf162cb-8b12-4f76-90a0-b2753cf56c35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:58:47.306087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf162cb-8b12-4f76-90a0-b2753cf56c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:58:47.306758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf162cb-8b12-4f76-90a0-b2753cf56c35 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:58:47.322082 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4272/8602] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:58:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:58:54.442767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec9b3-8f19-4fab-9d46-2a53de65cdda None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:54.443263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec9b3-8f19-4fab-9d46-2a53de65cdda None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:54.443431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec9b3-8f19-4fab-9d46-2a53de65cdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:54.463889 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-545ec9b3-8f19-4fab-9d46-2a53de65cdda None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:58:54.465131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-545ec9b3-8f19-4fab-9d46-2a53de65cdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:58:54.474520 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4331/8603] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:58:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:58:54.496686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf162cb-8b12-4f76-90a0-b2753cf56c35 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:58:54.508859 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf162cb-8b12-4f76-90a0-b2753cf56c35 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:58:54.516115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc359de-5ce6-472b-b21d-5affc4b3bec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:58:54.516757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc359de-5ce6-472b-b21d-5affc4b3bec3 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:54.517038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc359de-5ce6-472b-b21d-5affc4b3bec3 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:54.517318 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc359de-5ce6-472b-b21d-5affc4b3bec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:54.526414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc359de-5ce6-472b-b21d-5affc4b3bec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:58:54.528127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc359de-5ce6-472b-b21d-5affc4b3bec3 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:58:54.538402 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4273/8604] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:58:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:58:57.390220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e77d6-6e3b-4963-b931-007ee444271c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:57.391104 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e77d6-6e3b-4963-b931-007ee444271c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:57.391384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e77d6-6e3b-4963-b931-007ee444271c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:57.416504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4f4e77d6-6e3b-4963-b931-007ee444271c None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:58:57.416820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4f4e77d6-6e3b-4963-b931-007ee444271c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:58:57.429191 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4332/8605] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:58:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:58:57.442576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc359de-5ce6-472b-b21d-5affc4b3bec3 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:58:57.464933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc359de-5ce6-472b-b21d-5affc4b3bec3 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:58:57.472954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930626a6-e95a-40f4-9cc3-3bd2b7476e92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:58:57.473578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930626a6-e95a-40f4-9cc3-3bd2b7476e92 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:57.473863 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930626a6-e95a-40f4-9cc3-3bd2b7476e92 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:57.474165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930626a6-e95a-40f4-9cc3-3bd2b7476e92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:57.485736 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930626a6-e95a-40f4-9cc3-3bd2b7476e92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:58:57.487439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930626a6-e95a-40f4-9cc3-3bd2b7476e92 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:58:57.506683 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4274/8606] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:58:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:58:58.901079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550748b-2c6e-4a22-8daf-12040a5a3b7c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:58.901546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550748b-2c6e-4a22-8daf-12040a5a3b7c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:58.901641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550748b-2c6e-4a22-8daf-12040a5a3b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:58.922184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e550748b-2c6e-4a22-8daf-12040a5a3b7c None None] MFA Rules not processed for user `b12139c2484c4e4fbbf9839ab577ee5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:58:58.923408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e550748b-2c6e-4a22-8daf-12040a5a3b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:58:58.930083 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4333/8607] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 01:58:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:58:59.231513 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac72d0-54b1-4410-bbab-4c3f4b50ebef None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:59.232026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac72d0-54b1-4410-bbab-4c3f4b50ebef None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:59.232124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac72d0-54b1-4410-bbab-4c3f4b50ebef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:59.250936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d3ac72d0-54b1-4410-bbab-4c3f4b50ebef None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:58:59.252133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d3ac72d0-54b1-4410-bbab-4c3f4b50ebef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:58:59.258634 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4275/8608] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 01:58:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:58:59.270776 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550748b-2c6e-4a22-8daf-12040a5a3b7c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:58:59.280978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550748b-2c6e-4a22-8daf-12040a5a3b7c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:58:59.284504 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71d0a7-f2fb-427d-8e1d-1375379eafc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:58:59.285126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71d0a7-f2fb-427d-8e1d-1375379eafc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:58:59.285404 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71d0a7-f2fb-427d-8e1d-1375379eafc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:58:59.285675 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71d0a7-f2fb-427d-8e1d-1375379eafc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:58:59.292628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71d0a7-f2fb-427d-8e1d-1375379eafc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:58:59.294073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71d0a7-f2fb-427d-8e1d-1375379eafc4 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:58:59.301730 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4334/8609] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:58:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:59:09.246239 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=24 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:09.298306 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=21 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:11.285303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51651c-45a9-48a1-bcb6-86fc6648c45c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:59:11.285804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51651c-45a9-48a1-bcb6-86fc6648c45c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:59:11.285940 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51651c-45a9-48a1-bcb6-86fc6648c45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:59:11.306548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ef51651c-45a9-48a1-bcb6-86fc6648c45c None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:59:11.307787 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef51651c-45a9-48a1-bcb6-86fc6648c45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:59:11.318808 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4276/8610] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:59:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:59:11.331780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71d0a7-f2fb-427d-8e1d-1375379eafc4 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:59:11.345068 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71d0a7-f2fb-427d-8e1d-1375379eafc4 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:59:11.350898 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc801ee-7c40-4b4f-b8a7-eed4b421a6a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:59:11.351969 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc801ee-7c40-4b4f-b8a7-eed4b421a6a2 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:59:11.352249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc801ee-7c40-4b4f-b8a7-eed4b421a6a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:59:11.352521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc801ee-7c40-4b4f-b8a7-eed4b421a6a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:59:11.362834 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc801ee-7c40-4b4f-b8a7-eed4b421a6a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:59:11.364457 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc801ee-7c40-4b4f-b8a7-eed4b421a6a2 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:59:11.376224 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4335/8611] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:59:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:59:21.301716 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:21.371076 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:59.037592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb74978-0eff-4a65-ae1e-ac14f802d31d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:59:59.038203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb74978-0eff-4a65-ae1e-ac14f802d31d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:59:59.038203 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb74978-0eff-4a65-ae1e-ac14f802d31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:59:59.070790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3fb74978-0eff-4a65-ae1e-ac14f802d31d None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:59:59.072035 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3fb74978-0eff-4a65-ae1e-ac14f802d31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:59:59.078567 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4277/8612] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 01:59:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:59:59.093273 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc801ee-7c40-4b4f-b8a7-eed4b421a6a2 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:59:59.103514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc801ee-7c40-4b4f-b8a7-eed4b421a6a2 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:59:59.107284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11359bc5-5199-443f-9fef-841be174c359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:59:59.108011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11359bc5-5199-443f-9fef-841be174c359 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:59:59.108297 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11359bc5-5199-443f-9fef-841be174c359 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:59:59.108571 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11359bc5-5199-443f-9fef-841be174c359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:59:59.116234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11359bc5-5199-443f-9fef-841be174c359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:59:59.117657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11359bc5-5199-443f-9fef-841be174c359 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:59:59.126154 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4336/8613] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 01:59:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:00:09.065730 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:00:09.122367 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:00:14.333427 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb74978-0eff-4a65-ae1e-ac14f802d31d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:00:14.347089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb74978-0eff-4a65-ae1e-ac14f802d31d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:00:14.352614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435e483-efc8-4355-8e75-72395b95afc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:00:14.353212 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435e483-efc8-4355-8e75-72395b95afc3 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:00:14.353492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435e483-efc8-4355-8e75-72395b95afc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:00:14.353761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435e483-efc8-4355-8e75-72395b95afc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:00:14.361798 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435e483-efc8-4355-8e75-72395b95afc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:00:14.363412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435e483-efc8-4355-8e75-72395b95afc3 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:00:14.372184 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4278/8614] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:00:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:00:24.368289 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:03.699918 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11359bc5-5199-443f-9fef-841be174c359 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:03.723577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11359bc5-5199-443f-9fef-841be174c359 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:03.729690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d8833-0afb-4405-b74a-3c7a37a50c79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:03.730638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d8833-0afb-4405-b74a-3c7a37a50c79 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:03.731046 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d8833-0afb-4405-b74a-3c7a37a50c79 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:03.731411 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d8833-0afb-4405-b74a-3c7a37a50c79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:03.742809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d8833-0afb-4405-b74a-3c7a37a50c79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:03.744569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d8833-0afb-4405-b74a-3c7a37a50c79 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:03.755010 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4337/8615] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:01:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:01:13.023375 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435e483-efc8-4355-8e75-72395b95afc3 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:13.032865 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435e483-efc8-4355-8e75-72395b95afc3 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:13.036485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4c3a1-8918-43a1-9fea-c40a1f78a9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:13.037085 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4c3a1-8918-43a1-9fea-c40a1f78a9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:13.037395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4c3a1-8918-43a1-9fea-c40a1f78a9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:13.037669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4c3a1-8918-43a1-9fea-c40a1f78a9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:13.046861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4c3a1-8918-43a1-9fea-c40a1f78a9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:13.048344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4c3a1-8918-43a1-9fea-c40a1f78a9c5 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:13.076488 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4279/8616] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:01:13.750664 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:16.252681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc885ee-3097-4894-9948-e82d29b748ac None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:16.253305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc885ee-3097-4894-9948-e82d29b748ac None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:16.253305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc885ee-3097-4894-9948-e82d29b748ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:16.316226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bbc885ee-3097-4894-9948-e82d29b748ac None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:01:16.317546 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bbc885ee-3097-4894-9948-e82d29b748ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:16.324802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4c3a1-8918-43a1-9fea-c40a1f78a9c5 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:16.330477 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4338/8617] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 02:01:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:01:16.337716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4c3a1-8918-43a1-9fea-c40a1f78a9c5 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:16.342996 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6e707-6506-434e-b2ff-03952ed363d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:16.343684 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6e707-6506-434e-b2ff-03952ed363d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:16.343959 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6e707-6506-434e-b2ff-03952ed363d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:16.344244 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6e707-6506-434e-b2ff-03952ed363d1 admin admin] PATH_INFO: `/v3/users/b12139c2484c4e4fbbf9839ab577ee5c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:16.345526 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6e707-6506-434e-b2ff-03952ed363d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12139c2484c4e4fbbf9839ab577ee5c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:16.347352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6e707-6506-434e-b2ff-03952ed363d1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:16.350586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c766ba-6e8a-42fc-851c-4e5f80c394db None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:16.350586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c766ba-6e8a-42fc-851c-4e5f80c394db None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:16.350586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c766ba-6e8a-42fc-851c-4e5f80c394db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:16.370799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e6c766ba-6e8a-42fc-851c-4e5f80c394db None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:01:16.372043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e6c766ba-6e8a-42fc-851c-4e5f80c394db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:16.387362 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4339/8618] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Oct 16 02:01:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:01:16.390300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c766ba-6e8a-42fc-851c-4e5f80c394db None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:16.401562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c766ba-6e8a-42fc-851c-4e5f80c394db None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:16.404449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dfd6e707-6506-434e-b2ff-03952ed363d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12139c2484c4e4fbbf9839ab577ee5c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:01:16.405867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dfd6e707-6506-434e-b2ff-03952ed363d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12139c2484c4e4fbbf9839ab577ee5c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:01:16.406857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e0119-bb6c-4db5-9556-2398f060a740 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:16.407484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0119-bb6c-4db5-9556-2398f060a740 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:16.407754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0119-bb6c-4db5-9556-2398f060a740 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:16.408023 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0119-bb6c-4db5-9556-2398f060a740 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:16.409796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f48e0119-bb6c-4db5-9556-2398f060a740 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:16.420805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dfd6e707-6506-434e-b2ff-03952ed363d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12139c2484c4e4fbbf9839ab577ee5c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:01:16.421788 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e0119-bb6c-4db5-9556-2398f060a740 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:16.423396 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e0119-bb6c-4db5-9556-2398f060a740 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:16.429807 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dfd6e707-6506-434e-b2ff-03952ed363d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12139c2484c4e4fbbf9839ab577ee5c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:01:16.430430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dfd6e707-6506-434e-b2ff-03952ed363d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12139c2484c4e4fbbf9839ab577ee5c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:01:16.435409 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4340/8619] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:01:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 02:01:16.445170 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4280/8620] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:01:16 2022] DELETE /identity/v3/users/b12139c2484c4e4fbbf9839ab577ee5c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 02:01:16.636242 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e0119-bb6c-4db5-9556-2398f060a740 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:16.637893 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f48e0119-bb6c-4db5-9556-2398f060a740 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:16.665246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e0119-bb6c-4db5-9556-2398f060a740 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:16.722288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583704a-e62b-49fd-b687-80cdf7838df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:16.722926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583704a-e62b-49fd-b687-80cdf7838df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:16.723218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583704a-e62b-49fd-b687-80cdf7838df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:16.723491 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583704a-e62b-49fd-b687-80cdf7838df1 admin admin] PATH_INFO: `/v3/projects/f810218c158a4fb0baded3bbff983c71` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:16.724718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583704a-e62b-49fd-b687-80cdf7838df1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f810218c158a4fb0baded3bbff983c71)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:16.727207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583704a-e62b-49fd-b687-80cdf7838df1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:16.773888 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6583704a-e62b-49fd-b687-80cdf7838df1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f810218c158a4fb0baded3bbff983c71', 'request_id': 'req-6583704a-e62b-49fd-b687-80cdf7838df1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:01:16.780780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6583704a-e62b-49fd-b687-80cdf7838df1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f810218c158a4fb0baded3bbff983c71', 'request_id': 'req-6583704a-e62b-49fd-b687-80cdf7838df1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:01:16.788362 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6583704a-e62b-49fd-b687-80cdf7838df1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f810218c158a4fb0baded3bbff983c71', 'request_id': 'req-6583704a-e62b-49fd-b687-80cdf7838df1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:01:16.798794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6583704a-e62b-49fd-b687-80cdf7838df1 admin admin] The token cache is being invalidate because project f810218c158a4fb0baded3bbff983c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:01:16.799110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6583704a-e62b-49fd-b687-80cdf7838df1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:01:16.799717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6583704a-e62b-49fd-b687-80cdf7838df1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:01:16.801180 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4341/8621] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:01:16 2022] DELETE /identity/v3/projects/f810218c158a4fb0baded3bbff983c71 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:01:16.806665 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403964ba-d997-4522-949d-bd5ee3ab0cc1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:16.806983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403964ba-d997-4522-949d-bd5ee3ab0cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:16.807264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403964ba-d997-4522-949d-bd5ee3ab0cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:16.828049 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-403964ba-d997-4522-949d-bd5ee3ab0cc1 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:01:16.829279 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-403964ba-d997-4522-949d-bd5ee3ab0cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:16.888452 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4281/8622] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:01:16.896234 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b349e-a920-45af-a461-9ea294ef41bd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:16.896517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b349e-a920-45af-a461-9ea294ef41bd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:16.896785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b349e-a920-45af-a461-9ea294ef41bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:16.917954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6e9b349e-a920-45af-a461-9ea294ef41bd None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:01:16.919179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6e9b349e-a920-45af-a461-9ea294ef41bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:16.926957 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4342/8623] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:01:16.931746 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403964ba-d997-4522-949d-bd5ee3ab0cc1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:16.941904 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403964ba-d997-4522-949d-bd5ee3ab0cc1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:16.947649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2a86b-fca4-4b38-8594-898121eafc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:16.948249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2a86b-fca4-4b38-8594-898121eafc64 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:16.948530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2a86b-fca4-4b38-8594-898121eafc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:16.948805 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2a86b-fca4-4b38-8594-898121eafc64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:16.949447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2a86b-fca4-4b38-8594-898121eafc64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 02:01:16.949766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2a86b-fca4-4b38-8594-898121eafc64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:16.951385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2a86b-fca4-4b38-8594-898121eafc64 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:16.962735 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4282/8624] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 02:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 02:01:16.967072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b349e-a920-45af-a461-9ea294ef41bd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:16.976445 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b349e-a920-45af-a461-9ea294ef41bd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:16.981430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bae1c1-900c-4093-a622-734dd408d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:16.982283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bae1c1-900c-4093-a622-734dd408d83c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:16.982283 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bae1c1-900c-4093-a622-734dd408d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:16.982617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bae1c1-900c-4093-a622-734dd408d83c admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:16.983398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bae1c1-900c-4093-a622-734dd408d83c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:16.985529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bae1c1-900c-4093-a622-734dd408d83c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:16.997653 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:17.015493 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4343/8625] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 02:01:16 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:01:17.019517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2a86b-fca4-4b38-8594-898121eafc64 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:17.031584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2a86b-fca4-4b38-8594-898121eafc64 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:17.060437 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:17.091693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cb690-46a5-43a6-935c-a17870be2633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:17.092334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb690-46a5-43a6-935c-a17870be2633 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:17.092609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb690-46a5-43a6-935c-a17870be2633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:17.092879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb690-46a5-43a6-935c-a17870be2633 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:17.093502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cb690-46a5-43a6-935c-a17870be2633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:17.095445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cb690-46a5-43a6-935c-a17870be2633 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:17.116399 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4283/8626] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 02:01:17 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:01:17.121421 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bae1c1-900c-4093-a622-734dd408d83c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:17.132061 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bae1c1-900c-4093-a622-734dd408d83c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:17.137310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9911f7-46ad-48b9-b056-31e491241ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:17.137904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9911f7-46ad-48b9-b056-31e491241ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:17.138182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9911f7-46ad-48b9-b056-31e491241ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:17.138451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9911f7-46ad-48b9-b056-31e491241ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:17.139121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9911f7-46ad-48b9-b056-31e491241ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:17.141325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9911f7-46ad-48b9-b056-31e491241ed9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:17.151555 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4344/8627] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:01:17.155650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cb690-46a5-43a6-935c-a17870be2633 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:17.165792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cb690-46a5-43a6-935c-a17870be2633 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:17.170514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49c3a1-5356-4a29-8c50-3d8623c6c792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:17.171140 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49c3a1-5356-4a29-8c50-3d8623c6c792 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:17.171448 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49c3a1-5356-4a29-8c50-3d8623c6c792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:17.171718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49c3a1-5356-4a29-8c50-3d8623c6c792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:17.172352 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49c3a1-5356-4a29-8c50-3d8623c6c792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:17.173975 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49c3a1-5356-4a29-8c50-3d8623c6c792 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:17.184405 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4284/8628] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:01:17.188707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9911f7-46ad-48b9-b056-31e491241ed9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:17.199308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9911f7-46ad-48b9-b056-31e491241ed9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:17.204024 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41305aba-2dc1-4f1a-a657-d995c04ae596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:17.204668 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41305aba-2dc1-4f1a-a657-d995c04ae596 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:17.204948 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41305aba-2dc1-4f1a-a657-d995c04ae596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:17.205221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41305aba-2dc1-4f1a-a657-d995c04ae596 admin admin] PATH_INFO: `/v3/projects/b908aa65085943a49bd50c6d41e5caa7/users/c34a4956a1ed41f6b33789186cc35f14/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:17.219575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41305aba-2dc1-4f1a-a657-d995c04ae596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b908aa65085943a49bd50c6d41e5caa7, user_id=c34a4956a1ed41f6b33789186cc35f14, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:17.222217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41305aba-2dc1-4f1a-a657-d995c04ae596 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:17.235572 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4345/8629] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:01:17 2022] PUT /identity/v3/projects/b908aa65085943a49bd50c6d41e5caa7/users/c34a4956a1ed41f6b33789186cc35f14/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:01:17.240545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08e160-f211-46fa-a206-30f1ae5ec1bf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:17.240839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08e160-f211-46fa-a206-30f1ae5ec1bf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:17.241116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08e160-f211-46fa-a206-30f1ae5ec1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:17.261512 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7e08e160-f211-46fa-a206-30f1ae5ec1bf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:01:17.262721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7e08e160-f211-46fa-a206-30f1ae5ec1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:17.321367 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4285/8630] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:01:17.330987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41305aba-2dc1-4f1a-a657-d995c04ae596 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:17.332656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-41305aba-2dc1-4f1a-a657-d995c04ae596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:17.389671 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41305aba-2dc1-4f1a-a657-d995c04ae596 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:17.393327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d2d7a-9c15-4ae2-b54c-542a11986604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:17.393917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d2d7a-9c15-4ae2-b54c-542a11986604 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:17.394191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d2d7a-9c15-4ae2-b54c-542a11986604 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:17.394458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d2d7a-9c15-4ae2-b54c-542a11986604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:17.403659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d2d7a-9c15-4ae2-b54c-542a11986604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:17.405069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d2d7a-9c15-4ae2-b54c-542a11986604 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:17.414213 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4346/8631] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:01:21.637704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622dac4-70fc-4b64-be8b-577a08991111 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:21.638185 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622dac4-70fc-4b64-be8b-577a08991111 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:21.638282 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622dac4-70fc-4b64-be8b-577a08991111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:21.668664 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5622dac4-70fc-4b64-be8b-577a08991111 None None] MFA Rules not processed for user `c34a4956a1ed41f6b33789186cc35f14`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:01:21.669960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5622dac4-70fc-4b64-be8b-577a08991111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:21.748989 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4286/8632] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:01:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:01:21.760610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a245b7-c6f3-45cd-8901-56d0ff05f622 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:21.761172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a245b7-c6f3-45cd-8901-56d0ff05f622 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:21.761172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a245b7-c6f3-45cd-8901-56d0ff05f622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:21.781281 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e1a245b7-c6f3-45cd-8901-56d0ff05f622 None None] MFA Rules not processed for user `c34a4956a1ed41f6b33789186cc35f14`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:01:21.782498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e1a245b7-c6f3-45cd-8901-56d0ff05f622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:21.790148 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4347/8633] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:01:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:01:21.801381 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622dac4-70fc-4b64-be8b-577a08991111 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:21.802789 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5622dac4-70fc-4b64-be8b-577a08991111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:21.853829 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:21.908407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622dac4-70fc-4b64-be8b-577a08991111 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:21.914180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279c2d7-6aa9-426f-9a2d-86bae24c60de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:21.915100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279c2d7-6aa9-426f-9a2d-86bae24c60de service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:21.916351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279c2d7-6aa9-426f-9a2d-86bae24c60de service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:21.916631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279c2d7-6aa9-426f-9a2d-86bae24c60de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:21.925415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279c2d7-6aa9-426f-9a2d-86bae24c60de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:21.927043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279c2d7-6aa9-426f-9a2d-86bae24c60de service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:21.937152 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4287/8634] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:01:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:01:23.537922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a245b7-c6f3-45cd-8901-56d0ff05f622 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:23.539383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e1a245b7-c6f3-45cd-8901-56d0ff05f622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:23.619760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a245b7-c6f3-45cd-8901-56d0ff05f622 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:23.625701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b797a2-b538-49a2-9854-297d9641bdce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:23.626322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b797a2-b538-49a2-9854-297d9641bdce service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:23.626606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b797a2-b538-49a2-9854-297d9641bdce service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:23.627138 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b797a2-b538-49a2-9854-297d9641bdce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:23.628972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-95b797a2-b538-49a2-9854-297d9641bdce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:23.641344 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b797a2-b538-49a2-9854-297d9641bdce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:23.644000 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b797a2-b538-49a2-9854-297d9641bdce service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:23.657748 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4348/8635] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:01:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:01:31.932312 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=24 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:33.650823 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=79,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:37.539761 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5d6ee-b0d4-494c-b1d2-3b8a557b58d4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:37.540239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5d6ee-b0d4-494c-b1d2-3b8a557b58d4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:37.540333 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5d6ee-b0d4-494c-b1d2-3b8a557b58d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:37.561303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9fe5d6ee-b0d4-494c-b1d2-3b8a557b58d4 None None] MFA Rules not processed for user `c34a4956a1ed41f6b33789186cc35f14`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:01:37.562502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9fe5d6ee-b0d4-494c-b1d2-3b8a557b58d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:37.569367 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4288/8636] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:01:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:01:38.668025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b797a2-b538-49a2-9854-297d9641bdce service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:01:38.678448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b797a2-b538-49a2-9854-297d9641bdce service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:01:38.684077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3330f9-ffe4-4147-a8b9-c2fa9e7f5b24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:01:38.684669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3330f9-ffe4-4147-a8b9-c2fa9e7f5b24 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:01:38.684952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3330f9-ffe4-4147-a8b9-c2fa9e7f5b24 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:01:38.685226 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3330f9-ffe4-4147-a8b9-c2fa9e7f5b24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:01:38.687223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ab3330f9-ffe4-4147-a8b9-c2fa9e7f5b24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:01:38.698869 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3330f9-ffe4-4147-a8b9-c2fa9e7f5b24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:01:38.700473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3330f9-ffe4-4147-a8b9-c2fa9e7f5b24 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:01:38.710212 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4349/8637] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:01:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:01:47.555460 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:48.706155 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:01.580411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a681d-abd4-4c56-8cd5-df08db4fb3c1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:01.580956 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a681d-abd4-4c56-8cd5-df08db4fb3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:01.581087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a681d-abd4-4c56-8cd5-df08db4fb3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:01.602164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-782a681d-abd4-4c56-8cd5-df08db4fb3c1 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:01.603439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-782a681d-abd4-4c56-8cd5-df08db4fb3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:01.612369 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4289/8638] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 02:02:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:01.630071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3330f9-ffe4-4147-a8b9-c2fa9e7f5b24 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:01.642604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3330f9-ffe4-4147-a8b9-c2fa9e7f5b24 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:01.645997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a681d-abd4-4c56-8cd5-df08db4fb3c1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:01.648779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac5a9d-89d6-4a9e-a599-b8a96cb02d92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:01.649386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac5a9d-89d6-4a9e-a599-b8a96cb02d92 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:01.649665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac5a9d-89d6-4a9e-a599-b8a96cb02d92 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:01.649954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac5a9d-89d6-4a9e-a599-b8a96cb02d92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:01.659262 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a681d-abd4-4c56-8cd5-df08db4fb3c1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:01.659367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac5a9d-89d6-4a9e-a599-b8a96cb02d92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:01.660528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac5a9d-89d6-4a9e-a599-b8a96cb02d92 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:01.663974 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc702ea4-79fa-43c8-91dc-24e92035fba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:01.664604 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc702ea4-79fa-43c8-91dc-24e92035fba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:01.664888 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc702ea4-79fa-43c8-91dc-24e92035fba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:01.665181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc702ea4-79fa-43c8-91dc-24e92035fba9 admin admin] PATH_INFO: `/v3/users/c34a4956a1ed41f6b33789186cc35f14` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:01.666289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc702ea4-79fa-43c8-91dc-24e92035fba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34a4956a1ed41f6b33789186cc35f14)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:01.668233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc702ea4-79fa-43c8-91dc-24e92035fba9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:01.670820 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4350/8639] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:02:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 02:02:01.720376 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fc702ea4-79fa-43c8-91dc-24e92035fba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34a4956a1ed41f6b33789186cc35f14'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:01.720983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fc702ea4-79fa-43c8-91dc-24e92035fba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34a4956a1ed41f6b33789186cc35f14'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:01.733601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fc702ea4-79fa-43c8-91dc-24e92035fba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34a4956a1ed41f6b33789186cc35f14'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:01.741115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fc702ea4-79fa-43c8-91dc-24e92035fba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34a4956a1ed41f6b33789186cc35f14'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:01.741779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fc702ea4-79fa-43c8-91dc-24e92035fba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34a4956a1ed41f6b33789186cc35f14'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:01.753972 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4290/8640] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:02:01 2022] DELETE /identity/v3/users/c34a4956a1ed41f6b33789186cc35f14 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:02:01.933318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac5a9d-89d6-4a9e-a599-b8a96cb02d92 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:01.945518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac5a9d-89d6-4a9e-a599-b8a96cb02d92 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:02.005967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:02.006594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:02.006876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:02.007186 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc admin admin] PATH_INFO: `/v3/projects/b908aa65085943a49bd50c6d41e5caa7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:02.008299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b908aa65085943a49bd50c6d41e5caa7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:02.010201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:02.055659 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b908aa65085943a49bd50c6d41e5caa7', 'request_id': 'req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:02.062906 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b908aa65085943a49bd50c6d41e5caa7', 'request_id': 'req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:02.070436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b908aa65085943a49bd50c6d41e5caa7', 'request_id': 'req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:02.081173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc admin admin] The token cache is being invalidate because project b908aa65085943a49bd50c6d41e5caa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:02:02.081476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:02.082096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9fe31a36-3ba9-487a-92c5-7e4bb8ebf5cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:02.083616 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4351/8641] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:02:01 2022] DELETE /identity/v3/projects/b908aa65085943a49bd50c6d41e5caa7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:02:02.088566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb0735-7171-4ac4-b410-fdb82c1f2f6b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:02.088867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb0735-7171-4ac4-b410-fdb82c1f2f6b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:02.089149 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb0735-7171-4ac4-b410-fdb82c1f2f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:02.137488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c7eb0735-7171-4ac4-b410-fdb82c1f2f6b None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:02.139830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c7eb0735-7171-4ac4-b410-fdb82c1f2f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:02.198315 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4291/8642] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:02.207917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824dbe4-b847-4d95-8796-9231aa5fd304 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:02.208231 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824dbe4-b847-4d95-8796-9231aa5fd304 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:02.208505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824dbe4-b847-4d95-8796-9231aa5fd304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:02.228729 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f824dbe4-b847-4d95-8796-9231aa5fd304 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:02.229840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f824dbe4-b847-4d95-8796-9231aa5fd304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:02.238311 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4352/8643] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:02.242502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb0735-7171-4ac4-b410-fdb82c1f2f6b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:02.253075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb0735-7171-4ac4-b410-fdb82c1f2f6b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:02.257574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8e9d0-92b4-49bd-a4e4-531d8372bc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:02.258164 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8e9d0-92b4-49bd-a4e4-531d8372bc61 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:02.258438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8e9d0-92b4-49bd-a4e4-531d8372bc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:02.258704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8e9d0-92b4-49bd-a4e4-531d8372bc61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:02.259369 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8e9d0-92b4-49bd-a4e4-531d8372bc61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 02:02:02.259669 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8e9d0-92b4-49bd-a4e4-531d8372bc61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:02.261230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8e9d0-92b4-49bd-a4e4-531d8372bc61 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:02.273428 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4292/8644] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 02:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 02:02:02.277774 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824dbe4-b847-4d95-8796-9231aa5fd304 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:02.287027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824dbe4-b847-4d95-8796-9231aa5fd304 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:02.291612 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79514e1-dd4d-4ec6-964d-ea5cc2875874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:02.292200 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79514e1-dd4d-4ec6-964d-ea5cc2875874 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:02.292477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79514e1-dd4d-4ec6-964d-ea5cc2875874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:02.292750 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79514e1-dd4d-4ec6-964d-ea5cc2875874 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:02.293372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79514e1-dd4d-4ec6-964d-ea5cc2875874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:02.295470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79514e1-dd4d-4ec6-964d-ea5cc2875874 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:02.332643 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4353/8645] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 02:02:02 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:02:02.336821 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8e9d0-92b4-49bd-a4e4-531d8372bc61 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:02.347119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8e9d0-92b4-49bd-a4e4-531d8372bc61 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:02.377815 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:02.408535 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b318b-83b5-4dbf-83c1-b8b260f79d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:02.409142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b318b-83b5-4dbf-83c1-b8b260f79d58 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:02.409420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b318b-83b5-4dbf-83c1-b8b260f79d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:02.409687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b318b-83b5-4dbf-83c1-b8b260f79d58 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:02.410316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b318b-83b5-4dbf-83c1-b8b260f79d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:02.412394 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b318b-83b5-4dbf-83c1-b8b260f79d58 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:02.433563 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4293/8646] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 02:02:02 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:02:02.438476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79514e1-dd4d-4ec6-964d-ea5cc2875874 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:02.448850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79514e1-dd4d-4ec6-964d-ea5cc2875874 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:02.454246 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67caf4-18b5-4421-9f2c-48390f4e6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:02.454836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67caf4-18b5-4421-9f2c-48390f4e6292 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:02.455145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67caf4-18b5-4421-9f2c-48390f4e6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:02.455416 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67caf4-18b5-4421-9f2c-48390f4e6292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:02.456045 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67caf4-18b5-4421-9f2c-48390f4e6292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:02.457629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67caf4-18b5-4421-9f2c-48390f4e6292 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:02.467359 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4354/8647] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:02:02.471255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b318b-83b5-4dbf-83c1-b8b260f79d58 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:02.482283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b318b-83b5-4dbf-83c1-b8b260f79d58 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:02.486907 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d1018-30ef-4051-90d8-3b66b26abf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:02.487530 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d1018-30ef-4051-90d8-3b66b26abf60 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:02.487809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d1018-30ef-4051-90d8-3b66b26abf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:02.488076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d1018-30ef-4051-90d8-3b66b26abf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:02.488698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d1018-30ef-4051-90d8-3b66b26abf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:02.490281 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d1018-30ef-4051-90d8-3b66b26abf60 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:02.501587 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4294/8648] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:02:02.505848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67caf4-18b5-4421-9f2c-48390f4e6292 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:02.516375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67caf4-18b5-4421-9f2c-48390f4e6292 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:02.521156 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28121297-0df9-4f71-a7ee-20e2e3806250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:02.521801 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28121297-0df9-4f71-a7ee-20e2e3806250 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:02.522083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28121297-0df9-4f71-a7ee-20e2e3806250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:02.522360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28121297-0df9-4f71-a7ee-20e2e3806250 admin admin] PATH_INFO: `/v3/projects/89e95405984344ec914a8bc98df85b6d/users/cdfee82e5e7c45bc8bcfa56316a11516/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:02.537878 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28121297-0df9-4f71-a7ee-20e2e3806250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e95405984344ec914a8bc98df85b6d, user_id=cdfee82e5e7c45bc8bcfa56316a11516, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:02.540651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28121297-0df9-4f71-a7ee-20e2e3806250 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:02.564833 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4355/8649] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:02:02 2022] PUT /identity/v3/projects/89e95405984344ec914a8bc98df85b6d/users/cdfee82e5e7c45bc8bcfa56316a11516/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:02:02.566587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc219a8-6ee9-48c6-bbbd-7fd7a532db35 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:02.566868 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc219a8-6ee9-48c6-bbbd-7fd7a532db35 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:02.567195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc219a8-6ee9-48c6-bbbd-7fd7a532db35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:02.602969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8cc219a8-6ee9-48c6-bbbd-7fd7a532db35 None None] MFA Rules not processed for user `cdfee82e5e7c45bc8bcfa56316a11516`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:02.604134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8cc219a8-6ee9-48c6-bbbd-7fd7a532db35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:02.670020 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4295/8650] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:02.680252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28121297-0df9-4f71-a7ee-20e2e3806250 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:02.681940 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-28121297-0df9-4f71-a7ee-20e2e3806250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:02.689698 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:02.742415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28121297-0df9-4f71-a7ee-20e2e3806250 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:02.745968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce84e82-a5db-40da-a9fb-b128bae9c6f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:02.746564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce84e82-a5db-40da-a9fb-b128bae9c6f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:02.746872 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce84e82-a5db-40da-a9fb-b128bae9c6f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:02.747721 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce84e82-a5db-40da-a9fb-b128bae9c6f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:02.756054 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce84e82-a5db-40da-a9fb-b128bae9c6f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:02.757478 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce84e82-a5db-40da-a9fb-b128bae9c6f0 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:02.766245 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4356/8651] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:02:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:02:12.666687 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=52,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:12.762214 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=24 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:13.296247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc219a8-6ee9-48c6-bbbd-7fd7a532db35 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:13.360558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc219a8-6ee9-48c6-bbbd-7fd7a532db35 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:13.365089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:13.365661 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:13.365945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:13.366217 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] PATH_INFO: `/v3/users/cdfee82e5e7c45bc8bcfa56316a11516` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:13.367379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdfee82e5e7c45bc8bcfa56316a11516)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:13.369290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:13.415038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdfee82e5e7c45bc8bcfa56316a11516'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:13.415617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdfee82e5e7c45bc8bcfa56316a11516'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:13.428126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdfee82e5e7c45bc8bcfa56316a11516'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:13.436560 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdfee82e5e7c45bc8bcfa56316a11516'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:13.437168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdfee82e5e7c45bc8bcfa56316a11516'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:13.449541 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4296/8652] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:02:13 2022] DELETE /identity/v3/users/cdfee82e5e7c45bc8bcfa56316a11516 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:02:13.454701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c1b11-a661-463c-999e-3aa9b6f4f70f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:13.455014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c1b11-a661-463c-999e-3aa9b6f4f70f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:13.455292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c1b11-a661-463c-999e-3aa9b6f4f70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:13.475388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d52c1b11-a661-463c-999e-3aa9b6f4f70f None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:13.476582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d52c1b11-a661-463c-999e-3aa9b6f4f70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:13.534017 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4357/8653] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 02:02:13.544898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:13.546169 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:13.611697 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a78610-c87f-4ba7-bd26-7c7deac8241f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:13.615364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53226ea-916c-4703-9eff-4feccbe90257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:13.615969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53226ea-916c-4703-9eff-4feccbe90257 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:13.616247 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53226ea-916c-4703-9eff-4feccbe90257 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:13.616514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53226ea-916c-4703-9eff-4feccbe90257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:13.625440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53226ea-916c-4703-9eff-4feccbe90257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:13.626864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53226ea-916c-4703-9eff-4feccbe90257 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:13.636277 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4297/8654] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:02:13.802833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c1b11-a661-463c-999e-3aa9b6f4f70f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:13.804369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d52c1b11-a661-463c-999e-3aa9b6f4f70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:13.817454 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c1b11-a661-463c-999e-3aa9b6f4f70f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:13.822085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e87a1-3ed8-4d7c-884b-f7a0c386858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:13.822725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e87a1-3ed8-4d7c-884b-f7a0c386858c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:13.823042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e87a1-3ed8-4d7c-884b-f7a0c386858c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:13.823314 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e87a1-3ed8-4d7c-884b-f7a0c386858c admin admin] PATH_INFO: `/v3/projects/89e95405984344ec914a8bc98df85b6d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:13.824428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e87a1-3ed8-4d7c-884b-f7a0c386858c admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e95405984344ec914a8bc98df85b6d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:13.827121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e87a1-3ed8-4d7c-884b-f7a0c386858c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:13.873677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-763e87a1-3ed8-4d7c-884b-f7a0c386858c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e95405984344ec914a8bc98df85b6d', 'request_id': 'req-763e87a1-3ed8-4d7c-884b-f7a0c386858c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:13.880033 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-763e87a1-3ed8-4d7c-884b-f7a0c386858c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e95405984344ec914a8bc98df85b6d', 'request_id': 'req-763e87a1-3ed8-4d7c-884b-f7a0c386858c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:13.886904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-763e87a1-3ed8-4d7c-884b-f7a0c386858c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e95405984344ec914a8bc98df85b6d', 'request_id': 'req-763e87a1-3ed8-4d7c-884b-f7a0c386858c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:13.898470 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-763e87a1-3ed8-4d7c-884b-f7a0c386858c admin admin] The token cache is being invalidate because project 89e95405984344ec914a8bc98df85b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:02:13.898762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-763e87a1-3ed8-4d7c-884b-f7a0c386858c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:13.899425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-763e87a1-3ed8-4d7c-884b-f7a0c386858c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:13.900947 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4358/8655] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:02:13 2022] DELETE /identity/v3/projects/89e95405984344ec914a8bc98df85b6d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:02:13.907015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e4f55-c7ce-4c1e-bb10-411787c188cf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:13.907488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e4f55-c7ce-4c1e-bb10-411787c188cf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:13.907589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e4f55-c7ce-4c1e-bb10-411787c188cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:13.926747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fa4e4f55-c7ce-4c1e-bb10-411787c188cf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:13.928034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fa4e4f55-c7ce-4c1e-bb10-411787c188cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:13.944505 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:13.988393 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4298/8656] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:13.997181 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f34b-37fe-40b1-8d2e-6ff7c2d06ebf None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:13.997842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f34b-37fe-40b1-8d2e-6ff7c2d06ebf None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:13.997842 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f34b-37fe-40b1-8d2e-6ff7c2d06ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:14.018327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c668f34b-37fe-40b1-8d2e-6ff7c2d06ebf None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:14.019564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c668f34b-37fe-40b1-8d2e-6ff7c2d06ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:14.027684 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4359/8657] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:14.031923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e4f55-c7ce-4c1e-bb10-411787c188cf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:14.041435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e4f55-c7ce-4c1e-bb10-411787c188cf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:14.046818 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf65ee-fb7a-4aa0-964e-4c6e0daedbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:14.047436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf65ee-fb7a-4aa0-964e-4c6e0daedbae admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:14.047710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf65ee-fb7a-4aa0-964e-4c6e0daedbae admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:14.047980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf65ee-fb7a-4aa0-964e-4c6e0daedbae admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:14.048609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf65ee-fb7a-4aa0-964e-4c6e0daedbae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 02:02:14.048910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf65ee-fb7a-4aa0-964e-4c6e0daedbae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:14.050483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf65ee-fb7a-4aa0-964e-4c6e0daedbae admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:14.063685 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4299/8658] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 02:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 02:02:14.067896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668f34b-37fe-40b1-8d2e-6ff7c2d06ebf None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:14.077837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668f34b-37fe-40b1-8d2e-6ff7c2d06ebf None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:14.082617 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dca678-c028-4c65-b901-fa2e3d04eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:14.083237 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dca678-c028-4c65-b901-fa2e3d04eeef admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:14.083512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dca678-c028-4c65-b901-fa2e3d04eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:14.083777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dca678-c028-4c65-b901-fa2e3d04eeef admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:14.084394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dca678-c028-4c65-b901-fa2e3d04eeef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:14.086269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dca678-c028-4c65-b901-fa2e3d04eeef admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:14.114315 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4360/8659] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 02:02:14 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:02:14.118456 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf65ee-fb7a-4aa0-964e-4c6e0daedbae admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:14.129430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf65ee-fb7a-4aa0-964e-4c6e0daedbae admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:14.185587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a8e06-58a2-42ec-8ba2-da8903c212ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:14.186356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a8e06-58a2-42ec-8ba2-da8903c212ba admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:14.186633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a8e06-58a2-42ec-8ba2-da8903c212ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:14.186900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a8e06-58a2-42ec-8ba2-da8903c212ba admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:14.187553 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a8e06-58a2-42ec-8ba2-da8903c212ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:14.189455 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a8e06-58a2-42ec-8ba2-da8903c212ba admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:14.210564 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4300/8660] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 02:02:14 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:02:14.214717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dca678-c028-4c65-b901-fa2e3d04eeef admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:14.224910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dca678-c028-4c65-b901-fa2e3d04eeef admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:14.229525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5749-0dcc-4d2c-9228-358c985e6dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:14.230221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5749-0dcc-4d2c-9228-358c985e6dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:14.230498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5749-0dcc-4d2c-9228-358c985e6dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:14.230767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5749-0dcc-4d2c-9228-358c985e6dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:14.231555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5749-0dcc-4d2c-9228-358c985e6dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:14.233136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5749-0dcc-4d2c-9228-358c985e6dd0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:14.243121 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4361/8661] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:02:14.247509 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a8e06-58a2-42ec-8ba2-da8903c212ba admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:14.257632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a8e06-58a2-42ec-8ba2-da8903c212ba admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:14.262869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21024dc3-8bbe-46b6-b2f7-4d9f3b3ab2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:14.263500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21024dc3-8bbe-46b6-b2f7-4d9f3b3ab2fd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:14.263780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21024dc3-8bbe-46b6-b2f7-4d9f3b3ab2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:14.264048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21024dc3-8bbe-46b6-b2f7-4d9f3b3ab2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:14.264671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21024dc3-8bbe-46b6-b2f7-4d9f3b3ab2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:14.266289 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21024dc3-8bbe-46b6-b2f7-4d9f3b3ab2fd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:14.276313 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4301/8662] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:02:14.281049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5749-0dcc-4d2c-9228-358c985e6dd0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:14.291016 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5749-0dcc-4d2c-9228-358c985e6dd0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:14.296199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11cdc2-9ded-401e-a930-11bff7761eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:14.296833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11cdc2-9ded-401e-a930-11bff7761eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:14.297110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11cdc2-9ded-401e-a930-11bff7761eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:14.297386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11cdc2-9ded-401e-a930-11bff7761eb5 admin admin] PATH_INFO: `/v3/projects/d2a95a1659384824a11352360ead08f7/users/335132c112ba43c097059bfc2ea7d760/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:14.312554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11cdc2-9ded-401e-a930-11bff7761eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a95a1659384824a11352360ead08f7, user_id=335132c112ba43c097059bfc2ea7d760, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:14.315244 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11cdc2-9ded-401e-a930-11bff7761eb5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:14.328719 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4362/8663] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:02:14 2022] PUT /identity/v3/projects/d2a95a1659384824a11352360ead08f7/users/335132c112ba43c097059bfc2ea7d760/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:02:14.339710 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c6fb1-da96-4425-b9b9-9754f19e1913 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:14.339997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c6fb1-da96-4425-b9b9-9754f19e1913 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:14.340310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c6fb1-da96-4425-b9b9-9754f19e1913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:14.367691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-672c6fb1-da96-4425-b9b9-9754f19e1913 None None] MFA Rules not processed for user `335132c112ba43c097059bfc2ea7d760`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:14.368900 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-672c6fb1-da96-4425-b9b9-9754f19e1913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:14.433944 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4302/8664] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:14.444581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11cdc2-9ded-401e-a930-11bff7761eb5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:14.446277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fc11cdc2-9ded-401e-a930-11bff7761eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:14.468548 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:14.505521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11cdc2-9ded-401e-a930-11bff7761eb5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:14.509172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e0f06-e0e3-451e-94e8-2fad34d4fc7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:14.509773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e0f06-e0e3-451e-94e8-2fad34d4fc7d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:14.510052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e0f06-e0e3-451e-94e8-2fad34d4fc7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:14.510323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e0f06-e0e3-451e-94e8-2fad34d4fc7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:14.519296 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e0f06-e0e3-451e-94e8-2fad34d4fc7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:14.520710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e0f06-e0e3-451e-94e8-2fad34d4fc7d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:14.530128 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4363/8665] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:02:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:02:18.825580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c6fb1-da96-4425-b9b9-9754f19e1913 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:18.844562 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:18.889106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c6fb1-da96-4425-b9b9-9754f19e1913 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:18.893555 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:18.894178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:18.894485 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:18.894757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] PATH_INFO: `/v3/users/335132c112ba43c097059bfc2ea7d760` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:18.895924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=335132c112ba43c097059bfc2ea7d760)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:18.897839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:18.942656 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335132c112ba43c097059bfc2ea7d760'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:18.943324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335132c112ba43c097059bfc2ea7d760'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:18.955990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335132c112ba43c097059bfc2ea7d760'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:18.963136 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335132c112ba43c097059bfc2ea7d760'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:18.963755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335132c112ba43c097059bfc2ea7d760'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:18.975902 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4303/8666] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:02:18 2022] DELETE /identity/v3/users/335132c112ba43c097059bfc2ea7d760 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:02:18.980413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d5cec-2779-44d6-89e2-2b1d7c96b544 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:18.981412 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d5cec-2779-44d6-89e2-2b1d7c96b544 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:18.981718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d5cec-2779-44d6-89e2-2b1d7c96b544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:19.002059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b46d5cec-2779-44d6-89e2-2b1d7c96b544 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:19.003293 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b46d5cec-2779-44d6-89e2-2b1d7c96b544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:19.061584 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4364/8667] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:19.071079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:19.072584 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:19.130315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5fa7f-43f4-492d-b540-81c52b420b08 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:19.133921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8abd2c-c085-4d36-99b3-cbe7e556a437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:19.134516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8abd2c-c085-4d36-99b3-cbe7e556a437 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:19.134791 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8abd2c-c085-4d36-99b3-cbe7e556a437 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:19.135089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8abd2c-c085-4d36-99b3-cbe7e556a437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:19.144446 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8abd2c-c085-4d36-99b3-cbe7e556a437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:19.145862 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8abd2c-c085-4d36-99b3-cbe7e556a437 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:19.156111 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4304/8668] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:02:19.328950 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d5cec-2779-44d6-89e2-2b1d7c96b544 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:19.330391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b46d5cec-2779-44d6-89e2-2b1d7c96b544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:19.345199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d5cec-2779-44d6-89e2-2b1d7c96b544 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:19.349769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e3ea3-b369-48f7-b7ca-cb95b823db64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:19.350392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3ea3-b369-48f7-b7ca-cb95b823db64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:19.351113 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3ea3-b369-48f7-b7ca-cb95b823db64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:19.351395 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3ea3-b369-48f7-b7ca-cb95b823db64 admin admin] PATH_INFO: `/v3/projects/d2a95a1659384824a11352360ead08f7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:19.352509 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e3ea3-b369-48f7-b7ca-cb95b823db64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a95a1659384824a11352360ead08f7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:19.354447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e3ea3-b369-48f7-b7ca-cb95b823db64 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:19.401826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-721e3ea3-b369-48f7-b7ca-cb95b823db64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a95a1659384824a11352360ead08f7', 'request_id': 'req-721e3ea3-b369-48f7-b7ca-cb95b823db64'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:19.408591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-721e3ea3-b369-48f7-b7ca-cb95b823db64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a95a1659384824a11352360ead08f7', 'request_id': 'req-721e3ea3-b369-48f7-b7ca-cb95b823db64'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:19.415637 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-721e3ea3-b369-48f7-b7ca-cb95b823db64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a95a1659384824a11352360ead08f7', 'request_id': 'req-721e3ea3-b369-48f7-b7ca-cb95b823db64'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:19.425976 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-721e3ea3-b369-48f7-b7ca-cb95b823db64 admin admin] The token cache is being invalidate because project d2a95a1659384824a11352360ead08f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:02:19.426269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-721e3ea3-b369-48f7-b7ca-cb95b823db64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:19.426902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-721e3ea3-b369-48f7-b7ca-cb95b823db64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:02:19.428464 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4365/8669] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:02:19 2022] DELETE /identity/v3/projects/d2a95a1659384824a11352360ead08f7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:02:19.433406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6a358-9204-40ea-9b7f-0b7c33e01382 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:19.433690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6a358-9204-40ea-9b7f-0b7c33e01382 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:19.434449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6a358-9204-40ea-9b7f-0b7c33e01382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:19.454673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-21a6a358-9204-40ea-9b7f-0b7c33e01382 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:19.455917 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-21a6a358-9204-40ea-9b7f-0b7c33e01382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:19.488586 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:19.516272 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4305/8670] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:19.524069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31780ff-6718-470b-b224-f3521740081d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:19.524355 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31780ff-6718-470b-b224-f3521740081d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:19.524629 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31780ff-6718-470b-b224-f3521740081d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:19.544725 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f31780ff-6718-470b-b224-f3521740081d None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:19.545919 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f31780ff-6718-470b-b224-f3521740081d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:19.553803 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4366/8671] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:19.558109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6a358-9204-40ea-9b7f-0b7c33e01382 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:19.572033 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6a358-9204-40ea-9b7f-0b7c33e01382 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:19.578946 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ff8e9-729d-4a85-9ec3-9635d5a14d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:19.579829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ff8e9-729d-4a85-9ec3-9635d5a14d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:19.580109 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ff8e9-729d-4a85-9ec3-9635d5a14d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:19.580383 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ff8e9-729d-4a85-9ec3-9635d5a14d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:19.581025 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ff8e9-729d-4a85-9ec3-9635d5a14d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 02:02:19.581323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ff8e9-729d-4a85-9ec3-9635d5a14d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:19.583070 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ff8e9-729d-4a85-9ec3-9635d5a14d57 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:19.596558 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4306/8672] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 02:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 02:02:19.601013 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31780ff-6718-470b-b224-f3521740081d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:19.610484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31780ff-6718-470b-b224-f3521740081d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:19.615194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1ad0f-2f59-4df1-b3dc-c7d201a576b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:19.615809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1ad0f-2f59-4df1-b3dc-c7d201a576b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:19.616089 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1ad0f-2f59-4df1-b3dc-c7d201a576b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:19.616359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1ad0f-2f59-4df1-b3dc-c7d201a576b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:19.616990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1ad0f-2f59-4df1-b3dc-c7d201a576b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:19.618883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1ad0f-2f59-4df1-b3dc-c7d201a576b4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:19.647017 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4367/8673] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 02:02:19 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:02:19.651286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ff8e9-729d-4a85-9ec3-9635d5a14d57 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:19.662206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ff8e9-729d-4a85-9ec3-9635d5a14d57 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:19.719148 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d516a3-1401-48af-8728-aac80a3c1bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:19.719744 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d516a3-1401-48af-8728-aac80a3c1bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:19.720044 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d516a3-1401-48af-8728-aac80a3c1bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:19.720312 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d516a3-1401-48af-8728-aac80a3c1bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:19.720930 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d516a3-1401-48af-8728-aac80a3c1bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:19.722820 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d516a3-1401-48af-8728-aac80a3c1bc7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:19.744399 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4307/8674] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 02:02:19 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:02:19.749083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1ad0f-2f59-4df1-b3dc-c7d201a576b4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:19.759393 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1ad0f-2f59-4df1-b3dc-c7d201a576b4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:19.764621 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bced99c-5b47-4c31-a77d-5171a0604fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:19.765207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bced99c-5b47-4c31-a77d-5171a0604fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:19.765488 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bced99c-5b47-4c31-a77d-5171a0604fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:19.765760 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bced99c-5b47-4c31-a77d-5171a0604fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:19.766386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bced99c-5b47-4c31-a77d-5171a0604fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:19.768015 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bced99c-5b47-4c31-a77d-5171a0604fd7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:19.778434 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4368/8675] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:02:19.782472 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d516a3-1401-48af-8728-aac80a3c1bc7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:19.792932 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d516a3-1401-48af-8728-aac80a3c1bc7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:19.797763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebcec4-0c02-4246-8755-bd94a2d89f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:19.798372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebcec4-0c02-4246-8755-bd94a2d89f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:19.798762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebcec4-0c02-4246-8755-bd94a2d89f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:19.799074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebcec4-0c02-4246-8755-bd94a2d89f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:19.799698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebcec4-0c02-4246-8755-bd94a2d89f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:19.801270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebcec4-0c02-4246-8755-bd94a2d89f58 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:19.812042 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4308/8676] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:02:19.816302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bced99c-5b47-4c31-a77d-5171a0604fd7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:19.826769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bced99c-5b47-4c31-a77d-5171a0604fd7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:19.831320 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fdfbd-2f35-4fd3-ac26-89f0bb72bd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:19.831959 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fdfbd-2f35-4fd3-ac26-89f0bb72bd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:19.832240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fdfbd-2f35-4fd3-ac26-89f0bb72bd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:19.832517 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fdfbd-2f35-4fd3-ac26-89f0bb72bd25 admin admin] PATH_INFO: `/v3/projects/8bf0ac8730fd471cb2ebb6168f341540/users/be072007df754e6ba88faf58d27f543e/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:19.834699 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:19.852044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fdfbd-2f35-4fd3-ac26-89f0bb72bd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf0ac8730fd471cb2ebb6168f341540, user_id=be072007df754e6ba88faf58d27f543e, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:19.854746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fdfbd-2f35-4fd3-ac26-89f0bb72bd25 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:19.868248 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4369/8677] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:02:19 2022] PUT /identity/v3/projects/8bf0ac8730fd471cb2ebb6168f341540/users/be072007df754e6ba88faf58d27f543e/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:02:19.873491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce202-cd4b-44a9-b153-8915431582d4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:19.873957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce202-cd4b-44a9-b153-8915431582d4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:19.874051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce202-cd4b-44a9-b153-8915431582d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:19.893800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f2dce202-cd4b-44a9-b153-8915431582d4 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:19.895021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f2dce202-cd4b-44a9-b153-8915431582d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:19.953504 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4309/8678] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 02:02:19.963098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fdfbd-2f35-4fd3-ac26-89f0bb72bd25 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:19.964785 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-682fdfbd-2f35-4fd3-ac26-89f0bb72bd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:20.022692 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fdfbd-2f35-4fd3-ac26-89f0bb72bd25 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:20.026419 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875e3e5-89a3-4dc8-b2d8-5e9048bfab45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:20.027053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875e3e5-89a3-4dc8-b2d8-5e9048bfab45 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:20.027335 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875e3e5-89a3-4dc8-b2d8-5e9048bfab45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:20.027609 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875e3e5-89a3-4dc8-b2d8-5e9048bfab45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:20.037503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875e3e5-89a3-4dc8-b2d8-5e9048bfab45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:20.038956 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875e3e5-89a3-4dc8-b2d8-5e9048bfab45 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:20.048768 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4370/8679] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:02:24.206378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c798a6-3d87-4412-a246-f2d9b1826244 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:24.206957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c798a6-3d87-4412-a246-f2d9b1826244 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:24.207094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c798a6-3d87-4412-a246-f2d9b1826244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:24.236172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-98c798a6-3d87-4412-a246-f2d9b1826244 None None] MFA Rules not processed for user `be072007df754e6ba88faf58d27f543e`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:24.237548 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-98c798a6-3d87-4412-a246-f2d9b1826244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:24.273416 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:24.321347 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4310/8680] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:24.326596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875e3e5-89a3-4dc8-b2d8-5e9048bfab45 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:24.336582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875e3e5-89a3-4dc8-b2d8-5e9048bfab45 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:24.341996 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb5ec2-28c2-4f2e-a402-e966c953ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:24.342581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5ec2-28c2-4f2e-a402-e966c953ab54 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:24.342861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5ec2-28c2-4f2e-a402-e966c953ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:24.345516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5ec2-28c2-4f2e-a402-e966c953ab54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:24.345516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb5ec2-28c2-4f2e-a402-e966c953ab54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:24.345968 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb5ec2-28c2-4f2e-a402-e966c953ab54 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:24.377052 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4371/8681] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 02:02:24 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:02:24.381258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c798a6-3d87-4412-a246-f2d9b1826244 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:24.393809 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c798a6-3d87-4412-a246-f2d9b1826244 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:24.457072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792f8e0-3e87-47ff-8825-79187a6e6e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:24.457610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792f8e0-3e87-47ff-8825-79187a6e6e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:24.458005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792f8e0-3e87-47ff-8825-79187a6e6e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:24.458142 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792f8e0-3e87-47ff-8825-79187a6e6e52 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:24.458767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792f8e0-3e87-47ff-8825-79187a6e6e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:24.460720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792f8e0-3e87-47ff-8825-79187a6e6e52 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:24.484012 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4311/8682] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 02:02:24 2022] POST /identity/v3/users => generated 301 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:02:24.488122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb5ec2-28c2-4f2e-a402-e966c953ab54 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:24.498865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb5ec2-28c2-4f2e-a402-e966c953ab54 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:24.503719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9ce35-641d-4a1b-8fe0-765d264f70fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:24.504328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9ce35-641d-4a1b-8fe0-765d264f70fc admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:24.504614 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9ce35-641d-4a1b-8fe0-765d264f70fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:24.504915 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9ce35-641d-4a1b-8fe0-765d264f70fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:24.505532 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9ce35-641d-4a1b-8fe0-765d264f70fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:24.507189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9ce35-641d-4a1b-8fe0-765d264f70fc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:24.519123 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4372/8683] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 02:02:24.523591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792f8e0-3e87-47ff-8825-79187a6e6e52 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:24.534667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792f8e0-3e87-47ff-8825-79187a6e6e52 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:24.539501 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c008485-298f-41c1-ac01-d1ed88e9dc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:24.540166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c008485-298f-41c1-ac01-d1ed88e9dc01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:24.540440 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c008485-298f-41c1-ac01-d1ed88e9dc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:24.540707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c008485-298f-41c1-ac01-d1ed88e9dc01 admin admin] PATH_INFO: `/v3/projects/f8564c0684b14535b4921731e22a9a72/users/7f5ae0639dbd4e469998a46c106cf6a2/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:24.562324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c008485-298f-41c1-ac01-d1ed88e9dc01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8564c0684b14535b4921731e22a9a72, user_id=7f5ae0639dbd4e469998a46c106cf6a2, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:24.565835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c008485-298f-41c1-ac01-d1ed88e9dc01 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:24.583692 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4312/8684] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:02:24 2022] PUT /identity/v3/projects/f8564c0684b14535b4921731e22a9a72/users/7f5ae0639dbd4e469998a46c106cf6a2/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 02:02:24.587734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9ce35-641d-4a1b-8fe0-765d264f70fc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:24.598862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9ce35-641d-4a1b-8fe0-765d264f70fc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:24.680280 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8db061-33ea-41de-b8b8-5944b25ece4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:24.681006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8db061-33ea-41de-b8b8-5944b25ece4b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:24.681451 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8db061-33ea-41de-b8b8-5944b25ece4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:24.681787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8db061-33ea-41de-b8b8-5944b25ece4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:24.682506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8db061-33ea-41de-b8b8-5944b25ece4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:24.685043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8db061-33ea-41de-b8b8-5944b25ece4b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:24.697503 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4373/8685] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 02:02:24.702436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c008485-298f-41c1-ac01-d1ed88e9dc01 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:24.713690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c008485-298f-41c1-ac01-d1ed88e9dc01 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:24.719505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8dddb-6e48-499c-9b12-c12068bcef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:24.720183 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8dddb-6e48-499c-9b12-c12068bcef8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:24.720898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8dddb-6e48-499c-9b12-c12068bcef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:24.720898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8dddb-6e48-499c-9b12-c12068bcef8a admin admin] PATH_INFO: `/v3/projects/f8564c0684b14535b4921731e22a9a72/users/7f5ae0639dbd4e469998a46c106cf6a2/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:24.722654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8dddb-6e48-499c-9b12-c12068bcef8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8564c0684b14535b4921731e22a9a72, user_id=7f5ae0639dbd4e469998a46c106cf6a2, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:24.725452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8dddb-6e48-499c-9b12-c12068bcef8a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:24.737592 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4313/8686] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:02:24 2022] PUT /identity/v3/projects/f8564c0684b14535b4921731e22a9a72/users/7f5ae0639dbd4e469998a46c106cf6a2/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:02:29.680884 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2210-0a6e-45b2-b360-ed8d55f8f703 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:29.681329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2210-0a6e-45b2-b360-ed8d55f8f703 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:29.681507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2210-0a6e-45b2-b360-ed8d55f8f703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:29.744960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-602f2210-0a6e-45b2-b360-ed8d55f8f703 None None] MFA Rules not processed for user `7f5ae0639dbd4e469998a46c106cf6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:29.746271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-602f2210-0a6e-45b2-b360-ed8d55f8f703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:29.795953 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:29.833874 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4374/8687] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:29.851442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8dddb-6e48-499c-9b12-c12068bcef8a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:29.854328 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5fe8dddb-6e48-499c-9b12-c12068bcef8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:29.952740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8dddb-6e48-499c-9b12-c12068bcef8a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:29.958474 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bdb66-02ec-47b2-b2f2-5791c0786b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:29.959123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bdb66-02ec-47b2-b2f2-5791c0786b23 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:29.959400 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bdb66-02ec-47b2-b2f2-5791c0786b23 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:29.959666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bdb66-02ec-47b2-b2f2-5791c0786b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:29.985910 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:30.020250 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bdb66-02ec-47b2-b2f2-5791c0786b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:30.021853 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bdb66-02ec-47b2-b2f2-5791c0786b23 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:30.031464 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4314/8688] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:02:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:02:30.108717 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16693b26-3362-461f-846c-837730610d47 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:30.109044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16693b26-3362-461f-846c-837730610d47 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:30.109284 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16693b26-3362-461f-846c-837730610d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:30.131715 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-16693b26-3362-461f-846c-837730610d47 None None] MFA Rules not processed for user `be072007df754e6ba88faf58d27f543e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:30.133122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-16693b26-3362-461f-846c-837730610d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:30.141158 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4375/8689] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:02:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:30.395885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27ea67-0be7-4293-8eac-b7c0b9f44551 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:30.396175 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27ea67-0be7-4293-8eac-b7c0b9f44551 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:30.396451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27ea67-0be7-4293-8eac-b7c0b9f44551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:30.415882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bc27ea67-0be7-4293-8eac-b7c0b9f44551 None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:30.417068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bc27ea67-0be7-4293-8eac-b7c0b9f44551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:30.468130 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4315/8690] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 02:02:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:30.479737 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16693b26-3362-461f-846c-837730610d47 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:30.481741 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-16693b26-3362-461f-846c-837730610d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:30.493403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16693b26-3362-461f-846c-837730610d47 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:30.497762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3441f09-1676-4d8a-aa3e-6c914ac59e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:30.498353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3441f09-1676-4d8a-aa3e-6c914ac59e26 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:30.498628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3441f09-1676-4d8a-aa3e-6c914ac59e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:30.498894 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3441f09-1676-4d8a-aa3e-6c914ac59e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:30.506193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3441f09-1676-4d8a-aa3e-6c914ac59e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:30.507745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3441f09-1676-4d8a-aa3e-6c914ac59e26 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:30.516065 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4376/8691] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:02:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:02:40.462215 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=39 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:40.512138 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=21 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:41.650532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418133d-5e06-4362-9420-a275cf65cc55 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:41.650999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418133d-5e06-4362-9420-a275cf65cc55 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:41.651101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418133d-5e06-4362-9420-a275cf65cc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:41.701836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d418133d-5e06-4362-9420-a275cf65cc55 None None] MFA Rules not processed for user `2536755baf5d4916bdc5942d5a1ace99`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:02:41.703038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d418133d-5e06-4362-9420-a275cf65cc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:02:41.762703 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4316/8692] 10.222.0.39 () {58 vars in 1060 bytes} [Sun Oct 16 02:02:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:02:41.768804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3441f09-1676-4d8a-aa3e-6c914ac59e26 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:02:41.777815 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3441f09-1676-4d8a-aa3e-6c914ac59e26 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:02:41.781377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ebbda-3593-45fc-b17c-0874348caab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:02:41.781958 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ebbda-3593-45fc-b17c-0874348caab9 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:02:41.782235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ebbda-3593-45fc-b17c-0874348caab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:02:41.782506 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ebbda-3593-45fc-b17c-0874348caab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:02:41.791182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ebbda-3593-45fc-b17c-0874348caab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:02:41.792591 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ebbda-3593-45fc-b17c-0874348caab9 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:02:41.802725 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4377/8693] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:02:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:02:51.759329 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=38 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:51.798473 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:03:07.213589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1df43-d0bd-4428-b054-2c02c39ff46d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:03:07.214104 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1df43-d0bd-4428-b054-2c02c39ff46d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:03:07.214210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1df43-d0bd-4428-b054-2c02c39ff46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:03:07.233519 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4ca1df43-d0bd-4428-b054-2c02c39ff46d None None] MFA Rules not processed for user `be072007df754e6ba88faf58d27f543e`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:03:07.234715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4ca1df43-d0bd-4428-b054-2c02c39ff46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:03:07.241576 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4317/8694] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:03:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:03:07.820575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ebbda-3593-45fc-b17c-0874348caab9 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:03:07.822018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fb3ebbda-3593-45fc-b17c-0874348caab9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:03:07.892424 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ebbda-3593-45fc-b17c-0874348caab9 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:03:07.897456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5776a-1c96-4f6d-b1cd-4812ab04a808 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:03:07.898070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5776a-1c96-4f6d-b1cd-4812ab04a808 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:03:07.898353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5776a-1c96-4f6d-b1cd-4812ab04a808 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:03:07.898616 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5776a-1c96-4f6d-b1cd-4812ab04a808 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:03:07.900341 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-28e5776a-1c96-4f6d-b1cd-4812ab04a808 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:03:07.912364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5776a-1c96-4f6d-b1cd-4812ab04a808 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:03:07.913930 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5776a-1c96-4f6d-b1cd-4812ab04a808 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:03:07.923768 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4378/8695] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:03:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:03:17.228212 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:03:17.919842 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=32 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:03:36.681334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebf2e7-4eee-43ce-a9fe-30cc32c07174 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:03:36.681748 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebf2e7-4eee-43ce-a9fe-30cc32c07174 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:03:36.681896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebf2e7-4eee-43ce-a9fe-30cc32c07174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:03:36.702578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-62ebf2e7-4eee-43ce-a9fe-30cc32c07174 None None] MFA Rules not processed for user `2536755baf5d4916bdc5942d5a1ace99`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:03:36.703800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-62ebf2e7-4eee-43ce-a9fe-30cc32c07174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:03:36.710349 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4318/8696] 10.222.0.39 () {58 vars in 1060 bytes} [Sun Oct 16 02:03:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:03:36.716277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5776a-1c96-4f6d-b1cd-4812ab04a808 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:03:36.725858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5776a-1c96-4f6d-b1cd-4812ab04a808 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:03:36.729440 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422fe7d-c388-4fe6-8d5d-0d2a9f39ec42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2536755baf5d4916bdc5942d5a1ace99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:03:36.730037 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422fe7d-c388-4fe6-8d5d-0d2a9f39ec42 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:03:36.730305 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422fe7d-c388-4fe6-8d5d-0d2a9f39ec42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:03:36.730579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422fe7d-c388-4fe6-8d5d-0d2a9f39ec42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:03:36.732308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b422fe7d-c388-4fe6-8d5d-0d2a9f39ec42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:03:36.745202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422fe7d-c388-4fe6-8d5d-0d2a9f39ec42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:03:36.746613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422fe7d-c388-4fe6-8d5d-0d2a9f39ec42 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:03:36.757778 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4379/8697] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:03:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:03:41.536442 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebf2e7-4eee-43ce-a9fe-30cc32c07174 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:03:41.545951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebf2e7-4eee-43ce-a9fe-30cc32c07174 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:03:41.549740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c8f7e-ed85-47d6-a721-52eec977832f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:03:41.550345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c8f7e-ed85-47d6-a721-52eec977832f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:03:41.550647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c8f7e-ed85-47d6-a721-52eec977832f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:03:41.550938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c8f7e-ed85-47d6-a721-52eec977832f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:03:41.552615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7e1c8f7e-ed85-47d6-a721-52eec977832f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:03:41.566715 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c8f7e-ed85-47d6-a721-52eec977832f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:03:41.568160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c8f7e-ed85-47d6-a721-52eec977832f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:03:41.579818 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4319/8698] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:03:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:03:43.970503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558fcc-e3ac-41ac-806f-5560c45ef393 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:03:43.971030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558fcc-e3ac-41ac-806f-5560c45ef393 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:03:43.971130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558fcc-e3ac-41ac-806f-5560c45ef393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:03:43.989818 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6d558fcc-e3ac-41ac-806f-5560c45ef393 None None] MFA Rules not processed for user `be072007df754e6ba88faf58d27f543e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:03:43.991041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6d558fcc-e3ac-41ac-806f-5560c45ef393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:03:43.998127 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4380/8699] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:03:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:03:46.354155 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c8f7e-ed85-47d6-a721-52eec977832f service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:03:46.364273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c8f7e-ed85-47d6-a721-52eec977832f service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:03:46.368119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33ccf4-fb98-404a-b88a-c063dc788bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:03:46.368757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33ccf4-fb98-404a-b88a-c063dc788bca service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:03:46.369063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33ccf4-fb98-404a-b88a-c063dc788bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:03:46.369337 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33ccf4-fb98-404a-b88a-c063dc788bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:03:46.371120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ae33ccf4-fb98-404a-b88a-c063dc788bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:03:46.381564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33ccf4-fb98-404a-b88a-c063dc788bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:03:46.383048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33ccf4-fb98-404a-b88a-c063dc788bca service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:03:46.392060 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4320/8700] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:03:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:03:53.984904 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=9 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:03:56.387995 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=15 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:17.892211 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d558fcc-e3ac-41ac-806f-5560c45ef393 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:17.894525 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6d558fcc-e3ac-41ac-806f-5560c45ef393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:17.914568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d558fcc-e3ac-41ac-806f-5560c45ef393 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:17.920728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4a292-bd31-4089-a63b-23cc97604bce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:17.921339 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4a292-bd31-4089-a63b-23cc97604bce service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:17.921620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4a292-bd31-4089-a63b-23cc97604bce service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:17.921892 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4a292-bd31-4089-a63b-23cc97604bce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:17.923626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-80d4a292-bd31-4089-a63b-23cc97604bce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:17.936423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4a292-bd31-4089-a63b-23cc97604bce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:17.938079 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4a292-bd31-4089-a63b-23cc97604bce service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:17.949364 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4381/8701] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:04:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:04:26.013309 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33ccf4-fb98-404a-b88a-c063dc788bca service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:26.104411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33ccf4-fb98-404a-b88a-c063dc788bca service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:26.108911 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:26.109585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:26.109813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:26.110080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] PATH_INFO: `/v3/users/be072007df754e6ba88faf58d27f543e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:26.111240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be072007df754e6ba88faf58d27f543e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:26.113170 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:26.160141 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be072007df754e6ba88faf58d27f543e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.160885 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be072007df754e6ba88faf58d27f543e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.174300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be072007df754e6ba88faf58d27f543e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.182960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be072007df754e6ba88faf58d27f543e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.183601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be072007df754e6ba88faf58d27f543e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.197972 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4321/8702] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:04:26 2022] DELETE /identity/v3/users/be072007df754e6ba88faf58d27f543e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:04:26.375966 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4a292-bd31-4089-a63b-23cc97604bce service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:26.387590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4a292-bd31-4089-a63b-23cc97604bce service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:26.446691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:26.447468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:26.447755 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:26.448027 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] PATH_INFO: `/v3/projects/8bf0ac8730fd471cb2ebb6168f341540` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:26.449148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf0ac8730fd471cb2ebb6168f341540)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:26.451110 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:26.495962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf0ac8730fd471cb2ebb6168f341540', 'request_id': 'req-6703824a-02e3-41bd-a378-b7ff6e5fa6da'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.501849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf0ac8730fd471cb2ebb6168f341540', 'request_id': 'req-6703824a-02e3-41bd-a378-b7ff6e5fa6da'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.509536 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf0ac8730fd471cb2ebb6168f341540', 'request_id': 'req-6703824a-02e3-41bd-a378-b7ff6e5fa6da'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.519786 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] The token cache is being invalidate because project 8bf0ac8730fd471cb2ebb6168f341540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:04:26.520077 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.520696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.522177 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4382/8703] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:04:26 2022] DELETE /identity/v3/projects/8bf0ac8730fd471cb2ebb6168f341540 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:04:26.526387 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:26.527819 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:26.541419 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e285236-5ed1-4a48-b225-ac59185326e5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:26.598623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228b976-2e36-4907-aa0a-d6438026a499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:26.599300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b976-2e36-4907-aa0a-d6438026a499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:26.599583 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b976-2e36-4907-aa0a-d6438026a499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:26.599857 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b976-2e36-4907-aa0a-d6438026a499 admin admin] PATH_INFO: `/v3/users/7f5ae0639dbd4e469998a46c106cf6a2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:26.600988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228b976-2e36-4907-aa0a-d6438026a499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f5ae0639dbd4e469998a46c106cf6a2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:26.602902 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228b976-2e36-4907-aa0a-d6438026a499 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:26.625310 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:26.655463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4228b976-2e36-4907-aa0a-d6438026a499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f5ae0639dbd4e469998a46c106cf6a2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.656123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4228b976-2e36-4907-aa0a-d6438026a499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f5ae0639dbd4e469998a46c106cf6a2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.669536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4228b976-2e36-4907-aa0a-d6438026a499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f5ae0639dbd4e469998a46c106cf6a2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.679225 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4228b976-2e36-4907-aa0a-d6438026a499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f5ae0639dbd4e469998a46c106cf6a2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.679947 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4228b976-2e36-4907-aa0a-d6438026a499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f5ae0639dbd4e469998a46c106cf6a2'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:26.693553 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4322/8704] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:04:26 2022] DELETE /identity/v3/users/7f5ae0639dbd4e469998a46c106cf6a2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:04:26.870011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:26.871487 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:26.884327 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703824a-02e3-41bd-a378-b7ff6e5fa6da admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:26.941731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04a78c-0a59-4f78-988c-4da9e1520a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:26.942388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04a78c-0a59-4f78-988c-4da9e1520a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:26.942665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04a78c-0a59-4f78-988c-4da9e1520a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:26.942964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04a78c-0a59-4f78-988c-4da9e1520a04 admin admin] PATH_INFO: `/v3/projects/f8564c0684b14535b4921731e22a9a72` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:26.944091 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04a78c-0a59-4f78-988c-4da9e1520a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8564c0684b14535b4921731e22a9a72)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:26.945980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04a78c-0a59-4f78-988c-4da9e1520a04 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:26.967687 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:26.994533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eb04a78c-0a59-4f78-988c-4da9e1520a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8564c0684b14535b4921731e22a9a72', 'request_id': 'req-eb04a78c-0a59-4f78-988c-4da9e1520a04'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:27.001218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eb04a78c-0a59-4f78-988c-4da9e1520a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8564c0684b14535b4921731e22a9a72', 'request_id': 'req-eb04a78c-0a59-4f78-988c-4da9e1520a04'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:27.009088 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eb04a78c-0a59-4f78-988c-4da9e1520a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8564c0684b14535b4921731e22a9a72', 'request_id': 'req-eb04a78c-0a59-4f78-988c-4da9e1520a04'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:27.020196 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eb04a78c-0a59-4f78-988c-4da9e1520a04 admin admin] The token cache is being invalidate because project f8564c0684b14535b4921731e22a9a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:04:27.020484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eb04a78c-0a59-4f78-988c-4da9e1520a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:27.021129 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-eb04a78c-0a59-4f78-988c-4da9e1520a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:04:27.022643 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4383/8705] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:04:26 2022] DELETE /identity/v3/projects/f8564c0684b14535b4921731e22a9a72 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:04:27.027762 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796c49-2f61-4505-be5a-476a75d78c8e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:27.028259 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796c49-2f61-4505-be5a-476a75d78c8e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:27.028365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796c49-2f61-4505-be5a-476a75d78c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:27.047924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-70796c49-2f61-4505-be5a-476a75d78c8e None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:04:27.049124 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-70796c49-2f61-4505-be5a-476a75d78c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:27.133395 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4323/8706] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:04:27.142624 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1d7c9-e943-40c5-b09d-92798e770a76 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:27.142929 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1d7c9-e943-40c5-b09d-92798e770a76 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:27.143277 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1d7c9-e943-40c5-b09d-92798e770a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:27.165423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8db1d7c9-e943-40c5-b09d-92798e770a76 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:04:27.166667 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8db1d7c9-e943-40c5-b09d-92798e770a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:27.181499 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4384/8707] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:04:27.188310 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70796c49-2f61-4505-be5a-476a75d78c8e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:27.206842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70796c49-2f61-4505-be5a-476a75d78c8e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:27.211823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafee71-e113-48ef-97fa-abecc128ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:27.212438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafee71-e113-48ef-97fa-abecc128ec38 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:27.212717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafee71-e113-48ef-97fa-abecc128ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:27.212990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafee71-e113-48ef-97fa-abecc128ec38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:27.213640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafee71-e113-48ef-97fa-abecc128ec38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 02:04:27.213943 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafee71-e113-48ef-97fa-abecc128ec38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:27.215591 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafee71-e113-48ef-97fa-abecc128ec38 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:27.227562 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4324/8708] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 02:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 02:04:27.232002 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1d7c9-e943-40c5-b09d-92798e770a76 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:27.241857 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1d7c9-e943-40c5-b09d-92798e770a76 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:27.246537 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813204-af93-4235-aea6-026d4f8c70f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:27.247160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813204-af93-4235-aea6-026d4f8c70f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:27.247438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813204-af93-4235-aea6-026d4f8c70f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:27.247710 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813204-af93-4235-aea6-026d4f8c70f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:27.248332 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813204-af93-4235-aea6-026d4f8c70f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:27.250245 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813204-af93-4235-aea6-026d4f8c70f7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:27.277992 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4385/8709] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 02:04:27 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:04:27.282291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafee71-e113-48ef-97fa-abecc128ec38 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:27.292245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafee71-e113-48ef-97fa-abecc128ec38 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:27.349325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6bf36-7ff2-4031-8ea0-929b0ea2158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:27.349934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6bf36-7ff2-4031-8ea0-929b0ea2158e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:27.350219 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6bf36-7ff2-4031-8ea0-929b0ea2158e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:27.350514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6bf36-7ff2-4031-8ea0-929b0ea2158e admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:27.351188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6bf36-7ff2-4031-8ea0-929b0ea2158e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:27.353133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6bf36-7ff2-4031-8ea0-929b0ea2158e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:27.374259 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4325/8710] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 02:04:27 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:04:27.378665 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813204-af93-4235-aea6-026d4f8c70f7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:27.389199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813204-af93-4235-aea6-026d4f8c70f7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:27.393897 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef811ee1-b968-4ddf-b0b1-592499e0fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:27.394486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef811ee1-b968-4ddf-b0b1-592499e0fc37 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:27.394766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef811ee1-b968-4ddf-b0b1-592499e0fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:27.395070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef811ee1-b968-4ddf-b0b1-592499e0fc37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:27.395705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef811ee1-b968-4ddf-b0b1-592499e0fc37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:27.397324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef811ee1-b968-4ddf-b0b1-592499e0fc37 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:27.407095 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4386/8711] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:04:27.411522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6bf36-7ff2-4031-8ea0-929b0ea2158e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:27.421765 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6bf36-7ff2-4031-8ea0-929b0ea2158e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:27.427195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e384cb-d7f2-49fd-b968-f773aa51dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:27.427780 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e384cb-d7f2-49fd-b968-f773aa51dd53 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:27.428063 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e384cb-d7f2-49fd-b968-f773aa51dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:27.428338 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e384cb-d7f2-49fd-b968-f773aa51dd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:27.428970 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e384cb-d7f2-49fd-b968-f773aa51dd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:27.430558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e384cb-d7f2-49fd-b968-f773aa51dd53 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:27.441450 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4326/8712] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:04:27.445749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef811ee1-b968-4ddf-b0b1-592499e0fc37 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:27.455858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef811ee1-b968-4ddf-b0b1-592499e0fc37 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:27.460535 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22881b05-99d6-4ab7-98e8-8eee59c4d4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:27.461173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22881b05-99d6-4ab7-98e8-8eee59c4d4f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:27.461476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22881b05-99d6-4ab7-98e8-8eee59c4d4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:27.461756 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22881b05-99d6-4ab7-98e8-8eee59c4d4f3 admin admin] PATH_INFO: `/v3/projects/32a38ba59a1e47b589ff171e62a00b13/users/e06c1f399bf04625baf6b8633cc8dd1b/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:27.476833 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22881b05-99d6-4ab7-98e8-8eee59c4d4f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a38ba59a1e47b589ff171e62a00b13, user_id=e06c1f399bf04625baf6b8633cc8dd1b, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:27.479574 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22881b05-99d6-4ab7-98e8-8eee59c4d4f3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:27.492676 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4387/8713] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:04:27 2022] PUT /identity/v3/projects/32a38ba59a1e47b589ff171e62a00b13/users/e06c1f399bf04625baf6b8633cc8dd1b/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:04:27.497766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4c04e-a830-4932-bcbf-eba8e7f1a589 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:27.498089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4c04e-a830-4932-bcbf-eba8e7f1a589 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:27.498426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4c04e-a830-4932-bcbf-eba8e7f1a589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:27.506654 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:27.518406 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-28f4c04e-a830-4932-bcbf-eba8e7f1a589 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:04:27.519735 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-28f4c04e-a830-4932-bcbf-eba8e7f1a589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:27.580185 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4327/8714] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:04:27.590285 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22881b05-99d6-4ab7-98e8-8eee59c4d4f3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:27.592039 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22881b05-99d6-4ab7-98e8-8eee59c4d4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:27.648550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22881b05-99d6-4ab7-98e8-8eee59c4d4f3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:27.652216 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9f17f-9537-49d1-a86c-845afb6629f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:27.652822 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9f17f-9537-49d1-a86c-845afb6629f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:27.653102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9f17f-9537-49d1-a86c-845afb6629f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:27.653377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9f17f-9537-49d1-a86c-845afb6629f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:27.663437 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9f17f-9537-49d1-a86c-845afb6629f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:27.664867 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9f17f-9537-49d1-a86c-845afb6629f6 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:27.674343 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4388/8715] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:04:31.731707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cd109-c610-4155-878b-5465218b465d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:31.732576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cd109-c610-4155-878b-5465218b465d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:31.733133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cd109-c610-4155-878b-5465218b465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:31.767132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-466cd109-c610-4155-878b-5465218b465d None None] MFA Rules not processed for user `e06c1f399bf04625baf6b8633cc8dd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:04:31.768545 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-466cd109-c610-4155-878b-5465218b465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:31.839171 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4328/8716] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:04:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:04:31.843681 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9f17f-9537-49d1-a86c-845afb6629f6 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:31.854461 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9f17f-9537-49d1-a86c-845afb6629f6 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:31.860032 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87460b64-b925-4f11-8960-2b135a888e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:31.860639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87460b64-b925-4f11-8960-2b135a888e46 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:31.860921 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87460b64-b925-4f11-8960-2b135a888e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:31.861194 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87460b64-b925-4f11-8960-2b135a888e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:31.861850 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87460b64-b925-4f11-8960-2b135a888e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:31.863813 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87460b64-b925-4f11-8960-2b135a888e46 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:31.899003 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4389/8717] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 02:04:31 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:04:31.900227 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cd109-c610-4155-878b-5465218b465d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:31.911909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cd109-c610-4155-878b-5465218b465d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:31.975363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8502da-f9dd-4222-9458-01afce3542ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:31.976111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8502da-f9dd-4222-9458-01afce3542ff admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:31.976490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8502da-f9dd-4222-9458-01afce3542ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:31.976861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8502da-f9dd-4222-9458-01afce3542ff admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:31.977566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8502da-f9dd-4222-9458-01afce3542ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:31.979538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8502da-f9dd-4222-9458-01afce3542ff admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:32.003615 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4329/8718] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 02:04:31 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:04:32.007762 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87460b64-b925-4f11-8960-2b135a888e46 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:32.018854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87460b64-b925-4f11-8960-2b135a888e46 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:32.023723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb902c72-9649-4a60-9e5c-92888a8819c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:32.024345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb902c72-9649-4a60-9e5c-92888a8819c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:32.024601 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb902c72-9649-4a60-9e5c-92888a8819c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:32.024870 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb902c72-9649-4a60-9e5c-92888a8819c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:32.025530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb902c72-9649-4a60-9e5c-92888a8819c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:32.027145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb902c72-9649-4a60-9e5c-92888a8819c7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:32.040573 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4390/8719] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 02:04:32.043937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8502da-f9dd-4222-9458-01afce3542ff admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:32.054792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8502da-f9dd-4222-9458-01afce3542ff admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:32.059652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f6821-9703-4245-b889-5e2ab3ec6b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:32.060327 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f6821-9703-4245-b889-5e2ab3ec6b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:32.060612 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f6821-9703-4245-b889-5e2ab3ec6b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:32.060882 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f6821-9703-4245-b889-5e2ab3ec6b64 admin admin] PATH_INFO: `/v3/projects/7fcd7bd7d1fa42c6a7e24d54aea2b92b/users/2e91ceb9d7d54751b3580d6cd3f4b47d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:32.079113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f6821-9703-4245-b889-5e2ab3ec6b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcd7bd7d1fa42c6a7e24d54aea2b92b, user_id=2e91ceb9d7d54751b3580d6cd3f4b47d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:32.082126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f6821-9703-4245-b889-5e2ab3ec6b64 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:32.092092 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:32.100498 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4330/8720] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:04:32 2022] PUT /identity/v3/projects/7fcd7bd7d1fa42c6a7e24d54aea2b92b/users/2e91ceb9d7d54751b3580d6cd3f4b47d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:04:32.104627 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb902c72-9649-4a60-9e5c-92888a8819c7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:32.114997 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb902c72-9649-4a60-9e5c-92888a8819c7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:32.125086 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:32.182557 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf1fe8-7ec7-44d6-9ee1-cd31c2bcaf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:32.183209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf1fe8-7ec7-44d6-9ee1-cd31c2bcaf76 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:32.183486 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf1fe8-7ec7-44d6-9ee1-cd31c2bcaf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:32.183759 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf1fe8-7ec7-44d6-9ee1-cd31c2bcaf76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:32.184400 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf1fe8-7ec7-44d6-9ee1-cd31c2bcaf76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:32.186035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf1fe8-7ec7-44d6-9ee1-cd31c2bcaf76 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:32.198087 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4391/8721] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:04:32.201908 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f6821-9703-4245-b889-5e2ab3ec6b64 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:32.213271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f6821-9703-4245-b889-5e2ab3ec6b64 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:32.218116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e8008-b12a-4db8-99b5-18258dc21a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:32.218776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e8008-b12a-4db8-99b5-18258dc21a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:32.219113 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e8008-b12a-4db8-99b5-18258dc21a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:32.219392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e8008-b12a-4db8-99b5-18258dc21a81 admin admin] PATH_INFO: `/v3/projects/7fcd7bd7d1fa42c6a7e24d54aea2b92b/users/2e91ceb9d7d54751b3580d6cd3f4b47d/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:32.221450 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e8008-b12a-4db8-99b5-18258dc21a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcd7bd7d1fa42c6a7e24d54aea2b92b, user_id=2e91ceb9d7d54751b3580d6cd3f4b47d, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:32.224235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e8008-b12a-4db8-99b5-18258dc21a81 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:32.234931 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4331/8722] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:04:32 2022] PUT /identity/v3/projects/7fcd7bd7d1fa42c6a7e24d54aea2b92b/users/2e91ceb9d7d54751b3580d6cd3f4b47d/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:04:36.728011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c13cb-a610-4c48-87e1-c63b94a17d40 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:36.728548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c13cb-a610-4c48-87e1-c63b94a17d40 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:36.728651 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c13cb-a610-4c48-87e1-c63b94a17d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:36.759302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e08c13cb-a610-4c48-87e1-c63b94a17d40 None None] MFA Rules not processed for user `2e91ceb9d7d54751b3580d6cd3f4b47d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:04:36.760606 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e08c13cb-a610-4c48-87e1-c63b94a17d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:36.833535 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4392/8723] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:04:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:04:36.876313 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd103e-0df5-482e-b047-fcd4d651814d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:36.876795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd103e-0df5-482e-b047-fcd4d651814d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:36.876880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd103e-0df5-482e-b047-fcd4d651814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:36.936605 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8fcd103e-0df5-482e-b047-fcd4d651814d None None] MFA Rules not processed for user `afb30ad752234d8c9f12302b0b69666b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:04:36.938691 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8fcd103e-0df5-482e-b047-fcd4d651814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:37.017321 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4332/8724] 10.222.0.39 () {58 vars in 1059 bytes} [Sun Oct 16 02:04:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:04:37.023991 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c13cb-a610-4c48-87e1-c63b94a17d40 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:37.035751 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c13cb-a610-4c48-87e1-c63b94a17d40 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:37.039530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da4e90-45b2-4943-b2e6-082e26574a1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:37.041064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da4e90-45b2-4943-b2e6-082e26574a1f service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:37.041353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da4e90-45b2-4943-b2e6-082e26574a1f service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:37.041773 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da4e90-45b2-4943-b2e6-082e26574a1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:37.129530 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da4e90-45b2-4943-b2e6-082e26574a1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:37.131070 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da4e90-45b2-4943-b2e6-082e26574a1f service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:37.141547 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4393/8725] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:04:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 02:04:37.310202 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df91c7-c5bd-4a84-bce2-65228ff8d416 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:37.310486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df91c7-c5bd-4a84-bce2-65228ff8d416 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:37.310757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df91c7-c5bd-4a84-bce2-65228ff8d416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:37.364615 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d7df91c7-c5bd-4a84-bce2-65228ff8d416 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:04:37.365878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d7df91c7-c5bd-4a84-bce2-65228ff8d416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:37.437738 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4333/8726] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 02:04:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:04:37.492847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87910e5e-040e-42cc-972a-d2fb9f213dc7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:37.493375 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87910e5e-040e-42cc-972a-d2fb9f213dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:37.493654 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87910e5e-040e-42cc-972a-d2fb9f213dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:37.553081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-87910e5e-040e-42cc-972a-d2fb9f213dc7 None None] MFA Rules not processed for user `ef8c6c33c3504949876d496a5213494d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:04:37.554406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-87910e5e-040e-42cc-972a-d2fb9f213dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:37.561158 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:37.649019 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4394/8727] 10.222.0.39 () {58 vars in 1040 bytes} [Sun Oct 16 02:04:37 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:04:37.655563 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df91c7-c5bd-4a84-bce2-65228ff8d416 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:37.668457 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df91c7-c5bd-4a84-bce2-65228ff8d416 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:37.673444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876881b-596d-44b3-965b-e2d9be428e9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:37.674072 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876881b-596d-44b3-965b-e2d9be428e9c service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:37.675043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876881b-596d-44b3-965b-e2d9be428e9c service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:37.675467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876881b-596d-44b3-965b-e2d9be428e9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:37.684268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876881b-596d-44b3-965b-e2d9be428e9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:37.685873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876881b-596d-44b3-965b-e2d9be428e9c service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:37.695062 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4334/8728] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:04:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:04:46.646836 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7d10-6ca9-4ffc-9fb2-1fab40740bd6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:46.647392 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7d10-6ca9-4ffc-9fb2-1fab40740bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:46.647500 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7d10-6ca9-4ffc-9fb2-1fab40740bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:46.667173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b91e7d10-6ca9-4ffc-9fb2-1fab40740bd6 None None] MFA Rules not processed for user `e06c1f399bf04625baf6b8633cc8dd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:04:46.668383 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b91e7d10-6ca9-4ffc-9fb2-1fab40740bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:46.675619 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4395/8729] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:04:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:04:46.951767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876881b-596d-44b3-965b-e2d9be428e9c service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:46.953209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9876881b-596d-44b3-965b-e2d9be428e9c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:46.980120 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:47.012110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876881b-596d-44b3-965b-e2d9be428e9c service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:47.015699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a8745-0d1c-4467-8e60-0fc50dd69060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:47.016302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a8745-0d1c-4467-8e60-0fc50dd69060 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:47.016589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a8745-0d1c-4467-8e60-0fc50dd69060 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:47.016861 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a8745-0d1c-4467-8e60-0fc50dd69060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:47.018597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2e5a8745-0d1c-4467-8e60-0fc50dd69060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:47.027847 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a8745-0d1c-4467-8e60-0fc50dd69060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:47.029264 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a8745-0d1c-4467-8e60-0fc50dd69060 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:47.037700 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4335/8730] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:04:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:04:48.687924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4feee-3722-4f31-ac4a-7e6052dd4291 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:48.688418 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4feee-3722-4f31-ac4a-7e6052dd4291 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:48.688508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4feee-3722-4f31-ac4a-7e6052dd4291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:48.709989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c9a4feee-3722-4f31-ac4a-7e6052dd4291 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:04:48.711221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c9a4feee-3722-4f31-ac4a-7e6052dd4291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:04:48.718446 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4396/8731] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 02:04:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:04:48.731608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a8745-0d1c-4467-8e60-0fc50dd69060 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:04:48.743985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a8745-0d1c-4467-8e60-0fc50dd69060 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:04:48.749040 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f288be-31be-4576-a3cc-c55258c8f54b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:04:48.749647 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f288be-31be-4576-a3cc-c55258c8f54b service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:04:48.749924 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f288be-31be-4576-a3cc-c55258c8f54b service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:04:48.750201 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f288be-31be-4576-a3cc-c55258c8f54b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:04:48.758830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f288be-31be-4576-a3cc-c55258c8f54b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:04:48.760454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f288be-31be-4576-a3cc-c55258c8f54b service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:04:48.769811 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4336/8732] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:04:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:04:58.705627 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=35 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:58.765393 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=22 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:05:02.633908 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4feee-3722-4f31-ac4a-7e6052dd4291 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:05:02.635455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c9a4feee-3722-4f31-ac4a-7e6052dd4291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:05:02.723483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4feee-3722-4f31-ac4a-7e6052dd4291 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:05:02.729072 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe31f88-808a-4fdb-bcfa-f9108fb7009f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:05:02.729736 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe31f88-808a-4fdb-bcfa-f9108fb7009f service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:05:02.730019 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe31f88-808a-4fdb-bcfa-f9108fb7009f service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:05:02.730322 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe31f88-808a-4fdb-bcfa-f9108fb7009f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:05:02.732086 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cbe31f88-808a-4fdb-bcfa-f9108fb7009f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:05:02.745353 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe31f88-808a-4fdb-bcfa-f9108fb7009f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:05:02.746944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe31f88-808a-4fdb-bcfa-f9108fb7009f service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:05:02.757500 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4397/8733] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:05:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:05:12.753011 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=34 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:05:20.651441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f288be-31be-4576-a3cc-c55258c8f54b service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:05:20.660631 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f288be-31be-4576-a3cc-c55258c8f54b service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:05:20.664252 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3df33-8be8-4a57-84d4-ea0728fdaa5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:05:20.664842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3df33-8be8-4a57-84d4-ea0728fdaa5d service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:05:20.665120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3df33-8be8-4a57-84d4-ea0728fdaa5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:05:20.665388 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3df33-8be8-4a57-84d4-ea0728fdaa5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:05:20.674116 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3df33-8be8-4a57-84d4-ea0728fdaa5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:05:20.675579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3df33-8be8-4a57-84d4-ea0728fdaa5d service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:05:20.684868 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4337/8734] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:05:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:05:22.667473 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe31f88-808a-4fdb-bcfa-f9108fb7009f service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:05:22.686155 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe31f88-808a-4fdb-bcfa-f9108fb7009f service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:05:22.697321 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0ea3-51a1-452d-9bcc-f1298f96f931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:05:22.698706 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0ea3-51a1-452d-9bcc-f1298f96f931 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:05:22.698854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0ea3-51a1-452d-9bcc-f1298f96f931 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:05:22.699092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0ea3-51a1-452d-9bcc-f1298f96f931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:05:22.701180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-812b0ea3-51a1-452d-9bcc-f1298f96f931 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:05:22.714548 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b0ea3-51a1-452d-9bcc-f1298f96f931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:05:22.716224 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b0ea3-51a1-452d-9bcc-f1298f96f931 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:05:22.728125 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4398/8735] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:05:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:05:30.680800 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:05:32.723850 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:06:08.644790 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3df33-8be8-4a57-84d4-ea0728fdaa5d service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:06:08.646793 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-53d3df33-8be8-4a57-84d4-ea0728fdaa5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:06:08.715196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3df33-8be8-4a57-84d4-ea0728fdaa5d service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:06:08.720096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89e18e-40d5-46f6-85dd-a0575db5f266 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:06:08.720696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89e18e-40d5-46f6-85dd-a0575db5f266 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:06:08.720969 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89e18e-40d5-46f6-85dd-a0575db5f266 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:06:08.721236 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89e18e-40d5-46f6-85dd-a0575db5f266 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:06:08.722941 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6b89e18e-40d5-46f6-85dd-a0575db5f266 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:06:08.734074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89e18e-40d5-46f6-85dd-a0575db5f266 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:06:08.735673 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89e18e-40d5-46f6-85dd-a0575db5f266 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:06:08.745741 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4338/8736] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:06:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:06:18.742112 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=32 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:07:11.803817 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0ea3-51a1-452d-9bcc-f1298f96f931 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:07:11.815202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0ea3-51a1-452d-9bcc-f1298f96f931 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:07:11.820042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45757f17-8f34-4e3e-999a-d2d7db81654b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:07:11.820625 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757f17-8f34-4e3e-999a-d2d7db81654b service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:07:11.820926 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757f17-8f34-4e3e-999a-d2d7db81654b service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:07:11.821456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757f17-8f34-4e3e-999a-d2d7db81654b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:07:11.822862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-45757f17-8f34-4e3e-999a-d2d7db81654b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:07:11.833838 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45757f17-8f34-4e3e-999a-d2d7db81654b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:07:11.835430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45757f17-8f34-4e3e-999a-d2d7db81654b service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:07:11.845723 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4399/8737] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:07:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:07:21.841506 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:08:31.421348 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa54769-b354-45d9-b70f-7efaf829cf91 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:08:31.421852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa54769-b354-45d9-b70f-7efaf829cf91 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:08:31.421960 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa54769-b354-45d9-b70f-7efaf829cf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:08:31.441802 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cfa54769-b354-45d9-b70f-7efaf829cf91 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:08:31.443037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cfa54769-b354-45d9-b70f-7efaf829cf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:08:31.450717 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4339/8738] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 02:08:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:08:31.489677 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45757f17-8f34-4e3e-999a-d2d7db81654b service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:08:31.501406 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45757f17-8f34-4e3e-999a-d2d7db81654b service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:08:31.506289 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f9a0e-109c-4cd1-a1dd-b32c70dd58fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:08:31.506868 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f9a0e-109c-4cd1-a1dd-b32c70dd58fd service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:08:31.507173 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f9a0e-109c-4cd1-a1dd-b32c70dd58fd service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:08:31.507442 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f9a0e-109c-4cd1-a1dd-b32c70dd58fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:08:31.515841 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f9a0e-109c-4cd1-a1dd-b32c70dd58fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:08:31.517391 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f9a0e-109c-4cd1-a1dd-b32c70dd58fd service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:08:31.525207 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4400/8739] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:08:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:08:32.002050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382a6bc-debc-4c29-8f78-7b1e052cec01 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:08:32.002344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382a6bc-debc-4c29-8f78-7b1e052cec01 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:08:32.002619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382a6bc-debc-4c29-8f78-7b1e052cec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:08:32.021589 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d382a6bc-debc-4c29-8f78-7b1e052cec01 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:08:32.022769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d382a6bc-debc-4c29-8f78-7b1e052cec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:08:32.030482 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4340/8740] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 02:08:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:08:32.042388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f9a0e-109c-4cd1-a1dd-b32c70dd58fd service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:08:32.052837 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f9a0e-109c-4cd1-a1dd-b32c70dd58fd service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:08:32.057757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46cb3f-8ad4-4b8b-aa61-e938252ed750 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:08:32.058330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46cb3f-8ad4-4b8b-aa61-e938252ed750 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:08:32.058604 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46cb3f-8ad4-4b8b-aa61-e938252ed750 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:08:32.058871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46cb3f-8ad4-4b8b-aa61-e938252ed750 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:08:32.067848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46cb3f-8ad4-4b8b-aa61-e938252ed750 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:08:32.069468 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46cb3f-8ad4-4b8b-aa61-e938252ed750 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:08:32.078314 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4401/8741] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:08:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:08:40.659696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956f2ed-5372-4a3a-91ed-13a815d173a5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:08:40.660349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956f2ed-5372-4a3a-91ed-13a815d173a5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:08:40.660349 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956f2ed-5372-4a3a-91ed-13a815d173a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:08:40.696428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c956f2ed-5372-4a3a-91ed-13a815d173a5 None None] MFA Rules not processed for user `e06c1f399bf04625baf6b8633cc8dd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:08:40.697642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c956f2ed-5372-4a3a-91ed-13a815d173a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:08:40.722026 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4341/8742] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:08:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:08:40.768316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1223ef-42b9-445a-99f5-3231dca8c209 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:08:40.768821 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1223ef-42b9-445a-99f5-3231dca8c209 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:08:40.768923 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1223ef-42b9-445a-99f5-3231dca8c209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:08:40.804328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6e1223ef-42b9-445a-99f5-3231dca8c209 None None] MFA Rules not processed for user `afb30ad752234d8c9f12302b0b69666b`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:08:40.805550 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6e1223ef-42b9-445a-99f5-3231dca8c209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:08:40.829972 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4402/8743] 10.222.0.39 () {58 vars in 1059 bytes} [Sun Oct 16 02:08:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:08:40.836257 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956f2ed-5372-4a3a-91ed-13a815d173a5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:08:40.846447 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956f2ed-5372-4a3a-91ed-13a815d173a5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:08:40.850230 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90338e-5729-48ab-b469-1d7efd55ddbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:08:40.850841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90338e-5729-48ab-b469-1d7efd55ddbc service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:08:40.851194 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90338e-5729-48ab-b469-1d7efd55ddbc service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:08:40.851511 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90338e-5729-48ab-b469-1d7efd55ddbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:08:40.853235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cb90338e-5729-48ab-b469-1d7efd55ddbc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:08:40.875404 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90338e-5729-48ab-b469-1d7efd55ddbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:08:40.876866 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90338e-5729-48ab-b469-1d7efd55ddbc service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:08:40.902808 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4342/8744] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:08:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:08:41.125199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1223ef-42b9-445a-99f5-3231dca8c209 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:08:41.144782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1223ef-42b9-445a-99f5-3231dca8c209 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:08:41.148326 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6d7fb-ba3b-43fe-bfba-c0b36e7eeb49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:08:41.148922 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6d7fb-ba3b-43fe-bfba-c0b36e7eeb49 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:08:41.149197 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6d7fb-ba3b-43fe-bfba-c0b36e7eeb49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:08:41.149467 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6d7fb-ba3b-43fe-bfba-c0b36e7eeb49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:08:41.151184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3df6d7fb-ba3b-43fe-bfba-c0b36e7eeb49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:08:41.160581 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6d7fb-ba3b-43fe-bfba-c0b36e7eeb49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:08:41.161995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6d7fb-ba3b-43fe-bfba-c0b36e7eeb49 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:08:41.169865 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4403/8745] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:08:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:08:42.785596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90338e-5729-48ab-b469-1d7efd55ddbc service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:08:42.795927 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90338e-5729-48ab-b469-1d7efd55ddbc service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:08:42.799738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c41de0-3253-4874-9101-9160757ed2d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:08:42.800630 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c41de0-3253-4874-9101-9160757ed2d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:08:42.800836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c41de0-3253-4874-9101-9160757ed2d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:08:42.801193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c41de0-3253-4874-9101-9160757ed2d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:08:42.803536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-42c41de0-3253-4874-9101-9160757ed2d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:08:42.820233 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c41de0-3253-4874-9101-9160757ed2d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:08:42.821635 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c41de0-3253-4874-9101-9160757ed2d1 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:08:42.833954 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4343/8746] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:08:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:08:43.786583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6d7fb-ba3b-43fe-bfba-c0b36e7eeb49 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:08:43.799282 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6d7fb-ba3b-43fe-bfba-c0b36e7eeb49 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:08:43.804125 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f90d80-6b3e-40bf-b8f1-d8c4e80ce999 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:08:43.804712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f90d80-6b3e-40bf-b8f1-d8c4e80ce999 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:08:43.804986 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f90d80-6b3e-40bf-b8f1-d8c4e80ce999 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:08:43.805253 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f90d80-6b3e-40bf-b8f1-d8c4e80ce999 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:08:43.806992 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-90f90d80-6b3e-40bf-b8f1-d8c4e80ce999 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:08:43.818829 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f90d80-6b3e-40bf-b8f1-d8c4e80ce999 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:08:43.820347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f90d80-6b3e-40bf-b8f1-d8c4e80ce999 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:08:43.830876 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4404/8747] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:08:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:08:48.303326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96e617-5405-4bfb-8f90-860d28934158 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:08:48.304193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96e617-5405-4bfb-8f90-860d28934158 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:08:48.304683 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96e617-5405-4bfb-8f90-860d28934158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:08:48.327487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4e96e617-5405-4bfb-8f90-860d28934158 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:08:48.329488 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4e96e617-5405-4bfb-8f90-860d28934158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:08:48.337592 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4344/8748] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 02:08:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:08:48.352734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f90d80-6b3e-40bf-b8f1-d8c4e80ce999 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:08:48.365646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f90d80-6b3e-40bf-b8f1-d8c4e80ce999 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:08:48.375085 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec46df-4416-4767-b5d5-d8cb0ec07cd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:08:48.375769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec46df-4416-4767-b5d5-d8cb0ec07cd7 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:08:48.376132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec46df-4416-4767-b5d5-d8cb0ec07cd7 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:08:48.376580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec46df-4416-4767-b5d5-d8cb0ec07cd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:08:48.385547 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec46df-4416-4767-b5d5-d8cb0ec07cd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:08:48.387364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec46df-4416-4767-b5d5-d8cb0ec07cd7 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:08:48.397354 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4405/8749] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:08:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:08:57.208567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96e617-5405-4bfb-8f90-860d28934158 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:08:57.218699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96e617-5405-4bfb-8f90-860d28934158 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:08:57.222293 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcad1c-a30b-4cbb-8713-a591f034124e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:08:57.222887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcad1c-a30b-4cbb-8713-a591f034124e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:08:57.223195 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcad1c-a30b-4cbb-8713-a591f034124e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:08:57.223475 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcad1c-a30b-4cbb-8713-a591f034124e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:08:57.225216 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-34dcad1c-a30b-4cbb-8713-a591f034124e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:08:57.235199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcad1c-a30b-4cbb-8713-a591f034124e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:08:57.236632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcad1c-a30b-4cbb-8713-a591f034124e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:08:57.244954 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4345/8750] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:08:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:08:58.393207 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=48 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:09:07.241095 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=49 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:09:44.194603 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec46df-4416-4767-b5d5-d8cb0ec07cd7 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:09:44.196790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ccec46df-4416-4767-b5d5-d8cb0ec07cd7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:09:44.212097 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec46df-4416-4767-b5d5-d8cb0ec07cd7 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:09:44.218143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce1d23-03d7-4b2c-ac1a-30b20249f87f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:09:44.218732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1d23-03d7-4b2c-ac1a-30b20249f87f service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:09:44.219052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1d23-03d7-4b2c-ac1a-30b20249f87f service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:09:44.219325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1d23-03d7-4b2c-ac1a-30b20249f87f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:09:44.226826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce1d23-03d7-4b2c-ac1a-30b20249f87f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:09:44.228427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce1d23-03d7-4b2c-ac1a-30b20249f87f service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:09:44.238629 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4406/8751] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:09:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:09:54.234699 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:10:34.207403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcad1c-a30b-4cbb-8713-a591f034124e service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:34.227808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcad1c-a30b-4cbb-8713-a591f034124e service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:34.237570 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be98c98-0b45-47de-b1b3-0f241e9820e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:34.238756 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be98c98-0b45-47de-b1b3-0f241e9820e6 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:34.239315 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be98c98-0b45-47de-b1b3-0f241e9820e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:34.239670 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be98c98-0b45-47de-b1b3-0f241e9820e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:34.251923 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be98c98-0b45-47de-b1b3-0f241e9820e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:34.253869 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be98c98-0b45-47de-b1b3-0f241e9820e6 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:34.277914 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4346/8752] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:10:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:10:44.263030 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:10:47.246252 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce1d23-03d7-4b2c-ac1a-30b20249f87f service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:47.258041 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce1d23-03d7-4b2c-ac1a-30b20249f87f service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:47.265279 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be10b07-0009-41fb-b48b-7f70f56f8eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:47.265998 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be10b07-0009-41fb-b48b-7f70f56f8eb3 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:47.266299 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be10b07-0009-41fb-b48b-7f70f56f8eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:47.266585 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be10b07-0009-41fb-b48b-7f70f56f8eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:47.268334 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3be10b07-0009-41fb-b48b-7f70f56f8eb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:10:47.281552 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be10b07-0009-41fb-b48b-7f70f56f8eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:47.283164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be10b07-0009-41fb-b48b-7f70f56f8eb3 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:47.293499 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4407/8753] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:10:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:10:48.175444 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd459-27ea-4b1c-bc8e-2b3f1ab554b3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:48.175913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd459-27ea-4b1c-bc8e-2b3f1ab554b3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:48.176021 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd459-27ea-4b1c-bc8e-2b3f1ab554b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:48.195278 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-439bd459-27ea-4b1c-bc8e-2b3f1ab554b3 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:10:48.196464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-439bd459-27ea-4b1c-bc8e-2b3f1ab554b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:10:48.204518 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4347/8754] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 02:10:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:10:48.245453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be10b07-0009-41fb-b48b-7f70f56f8eb3 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:48.256861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be10b07-0009-41fb-b48b-7f70f56f8eb3 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:48.261866 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd5814-c85e-467b-93a6-ca285277b0dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:48.262459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd5814-c85e-467b-93a6-ca285277b0dd service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:48.262738 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd5814-c85e-467b-93a6-ca285277b0dd service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:48.263043 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd5814-c85e-467b-93a6-ca285277b0dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:48.271830 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd5814-c85e-467b-93a6-ca285277b0dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:48.273413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd5814-c85e-467b-93a6-ca285277b0dd service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:48.281705 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4408/8755] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:10:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:10:48.630286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd459-27ea-4b1c-bc8e-2b3f1ab554b3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:48.640588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd459-27ea-4b1c-bc8e-2b3f1ab554b3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:48.643983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9837df9-b0bd-4179-9386-9eea19acc28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:48.644579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9837df9-b0bd-4179-9386-9eea19acc28c service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:48.644855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9837df9-b0bd-4179-9386-9eea19acc28c service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:48.645126 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9837df9-b0bd-4179-9386-9eea19acc28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:48.704508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9837df9-b0bd-4179-9386-9eea19acc28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:48.705938 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9837df9-b0bd-4179-9386-9eea19acc28c service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:48.715388 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4348/8756] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:10:51.909524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd5814-c85e-467b-93a6-ca285277b0dd service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:51.911207 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bcfd5814-c85e-467b-93a6-ca285277b0dd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:10:51.926566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd5814-c85e-467b-93a6-ca285277b0dd service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:51.932229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0316-6e5e-4739-96cb-4dbd56724689 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:51.932360 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0316-6e5e-4739-96cb-4dbd56724689 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:51.932539 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0316-6e5e-4739-96cb-4dbd56724689 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:51.932988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0316-6e5e-4739-96cb-4dbd56724689 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:51.934947 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d5ae0316-6e5e-4739-96cb-4dbd56724689 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:10:51.952370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae0316-6e5e-4739-96cb-4dbd56724689 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:51.954524 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae0316-6e5e-4739-96cb-4dbd56724689 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:51.969553 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4409/8757] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:10:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:10:54.915850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9837df9-b0bd-4179-9386-9eea19acc28c service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:54.929301 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9837df9-b0bd-4179-9386-9eea19acc28c service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:54.934642 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26c7e7-ff27-4143-9268-de233db8a4c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:54.935423 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26c7e7-ff27-4143-9268-de233db8a4c1 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:54.935804 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26c7e7-ff27-4143-9268-de233db8a4c1 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:54.936172 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26c7e7-ff27-4143-9268-de233db8a4c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:54.938616 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ee26c7e7-ff27-4143-9268-de233db8a4c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:10:54.951286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26c7e7-ff27-4143-9268-de233db8a4c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:54.954351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26c7e7-ff27-4143-9268-de233db8a4c1 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:54.967092 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4349/8758] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:10:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:10:54.982059 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0316-6e5e-4739-96cb-4dbd56724689 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:54.993370 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0316-6e5e-4739-96cb-4dbd56724689 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:54.998538 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:54.999575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:55.000099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:55.000469 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] PATH_INFO: `/v3/users/e06c1f399bf04625baf6b8633cc8dd1b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:55.001707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06c1f399bf04625baf6b8633cc8dd1b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:55.003856 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:55.051489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06c1f399bf04625baf6b8633cc8dd1b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.052137 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06c1f399bf04625baf6b8633cc8dd1b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.063610 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06c1f399bf04625baf6b8633cc8dd1b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.071132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06c1f399bf04625baf6b8633cc8dd1b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.071789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06c1f399bf04625baf6b8633cc8dd1b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.084694 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4410/8759] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:10:54 2022] DELETE /identity/v3/users/e06c1f399bf04625baf6b8633cc8dd1b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:10:55.265421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26c7e7-ff27-4143-9268-de233db8a4c1 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:55.277269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26c7e7-ff27-4143-9268-de233db8a4c1 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:55.339490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:55.340154 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:55.340458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:55.340704 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] PATH_INFO: `/v3/projects/32a38ba59a1e47b589ff171e62a00b13` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:55.342076 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a38ba59a1e47b589ff171e62a00b13)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:55.344929 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:55.398454 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a38ba59a1e47b589ff171e62a00b13', 'request_id': 'req-97832e0d-6828-4530-b47f-9164e87275e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.406421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a38ba59a1e47b589ff171e62a00b13', 'request_id': 'req-97832e0d-6828-4530-b47f-9164e87275e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.415980 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a38ba59a1e47b589ff171e62a00b13', 'request_id': 'req-97832e0d-6828-4530-b47f-9164e87275e0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.428544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] The token cache is being invalidate because project 32a38ba59a1e47b589ff171e62a00b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:10:55.428739 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.430074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.431626 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4350/8760] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:10:55 2022] DELETE /identity/v3/projects/32a38ba59a1e47b589ff171e62a00b13 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:10:55.435661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:55.437415 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:10:55.450828 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22cf8f-4a2e-4d69-a2a7-182d89945c50 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:55.510511 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904b5f3-6e56-4675-b613-591dca219cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:55.511172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904b5f3-6e56-4675-b613-591dca219cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:55.511447 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904b5f3-6e56-4675-b613-591dca219cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:55.511732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904b5f3-6e56-4675-b613-591dca219cf8 admin admin] PATH_INFO: `/v3/users/2e91ceb9d7d54751b3580d6cd3f4b47d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:55.512811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904b5f3-6e56-4675-b613-591dca219cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e91ceb9d7d54751b3580d6cd3f4b47d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:55.515783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904b5f3-6e56-4675-b613-591dca219cf8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:55.553362 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:10:55.564448 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0904b5f3-6e56-4675-b613-591dca219cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e91ceb9d7d54751b3580d6cd3f4b47d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.565349 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0904b5f3-6e56-4675-b613-591dca219cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e91ceb9d7d54751b3580d6cd3f4b47d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.578436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0904b5f3-6e56-4675-b613-591dca219cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e91ceb9d7d54751b3580d6cd3f4b47d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.585594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0904b5f3-6e56-4675-b613-591dca219cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e91ceb9d7d54751b3580d6cd3f4b47d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.586232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0904b5f3-6e56-4675-b613-591dca219cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e91ceb9d7d54751b3580d6cd3f4b47d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.598626 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4411/8761] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:10:55 2022] DELETE /identity/v3/users/2e91ceb9d7d54751b3580d6cd3f4b47d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:10:55.772779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:55.774321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:10:55.785165 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:10:55.789304 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97832e0d-6828-4530-b47f-9164e87275e0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:55.848205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2301f-78ee-4813-863e-0c43fb626787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:55.848839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2301f-78ee-4813-863e-0c43fb626787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:55.849118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2301f-78ee-4813-863e-0c43fb626787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:55.849390 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2301f-78ee-4813-863e-0c43fb626787 admin admin] PATH_INFO: `/v3/projects/7fcd7bd7d1fa42c6a7e24d54aea2b92b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:55.850493 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2301f-78ee-4813-863e-0c43fb626787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcd7bd7d1fa42c6a7e24d54aea2b92b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:55.852436 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2301f-78ee-4813-863e-0c43fb626787 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:55.899050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f2c2301f-78ee-4813-863e-0c43fb626787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcd7bd7d1fa42c6a7e24d54aea2b92b', 'request_id': 'req-f2c2301f-78ee-4813-863e-0c43fb626787'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.905231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f2c2301f-78ee-4813-863e-0c43fb626787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcd7bd7d1fa42c6a7e24d54aea2b92b', 'request_id': 'req-f2c2301f-78ee-4813-863e-0c43fb626787'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.913013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f2c2301f-78ee-4813-863e-0c43fb626787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcd7bd7d1fa42c6a7e24d54aea2b92b', 'request_id': 'req-f2c2301f-78ee-4813-863e-0c43fb626787'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.923339 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f2c2301f-78ee-4813-863e-0c43fb626787 admin admin] The token cache is being invalidate because project 7fcd7bd7d1fa42c6a7e24d54aea2b92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:10:55.923921 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f2c2301f-78ee-4813-863e-0c43fb626787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.924258 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f2c2301f-78ee-4813-863e-0c43fb626787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:10:55.925774 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4351/8762] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:10:55 2022] DELETE /identity/v3/projects/7fcd7bd7d1fa42c6a7e24d54aea2b92b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:10:55.930934 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ded7f-99f6-4c60-877e-fc0e07926d36 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:55.931243 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ded7f-99f6-4c60-877e-fc0e07926d36 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:55.931521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ded7f-99f6-4c60-877e-fc0e07926d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:55.952963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-185ded7f-99f6-4c60-877e-fc0e07926d36 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:10:55.953766 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-185ded7f-99f6-4c60-877e-fc0e07926d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:10:56.015199 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4412/8763] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:10:56.023531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a600fe-76ea-4ad0-9963-1cb034e4b1da None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.023817 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a600fe-76ea-4ad0-9963-1cb034e4b1da None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.024087 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a600fe-76ea-4ad0-9963-1cb034e4b1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.043982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-26a600fe-76ea-4ad0-9963-1cb034e4b1da None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:10:56.045162 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-26a600fe-76ea-4ad0-9963-1cb034e4b1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:10:56.053504 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4352/8764] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:10:56.057669 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ded7f-99f6-4c60-877e-fc0e07926d36 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:56.068436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ded7f-99f6-4c60-877e-fc0e07926d36 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:56.073067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbed09e-634c-45fe-a608-f940e9a82220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:56.073662 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbed09e-634c-45fe-a608-f940e9a82220 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.073944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbed09e-634c-45fe-a608-f940e9a82220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.074219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbed09e-634c-45fe-a608-f940e9a82220 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.074861 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbed09e-634c-45fe-a608-f940e9a82220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 02:10:56.075201 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbed09e-634c-45fe-a608-f940e9a82220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:56.076795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbed09e-634c-45fe-a608-f940e9a82220 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:56.088915 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4413/8765] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 02:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 02:10:56.093843 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a600fe-76ea-4ad0-9963-1cb034e4b1da None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:56.103110 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a600fe-76ea-4ad0-9963-1cb034e4b1da None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:56.107721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1259be6-7a4f-417f-93c5-b120d0861305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:56.108414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1259be6-7a4f-417f-93c5-b120d0861305 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.108806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1259be6-7a4f-417f-93c5-b120d0861305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.109094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1259be6-7a4f-417f-93c5-b120d0861305 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.109727 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1259be6-7a4f-417f-93c5-b120d0861305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:56.111663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1259be6-7a4f-417f-93c5-b120d0861305 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:56.139209 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4353/8766] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 02:10:56 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:10:56.144240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbed09e-634c-45fe-a608-f940e9a82220 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:56.154249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbed09e-634c-45fe-a608-f940e9a82220 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:56.211114 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956987a-cd7b-487b-956a-f77042625951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:56.211628 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956987a-cd7b-487b-956a-f77042625951 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.211911 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956987a-cd7b-487b-956a-f77042625951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.212184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956987a-cd7b-487b-956a-f77042625951 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.212807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956987a-cd7b-487b-956a-f77042625951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:56.214726 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956987a-cd7b-487b-956a-f77042625951 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:56.235443 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4414/8767] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 02:10:56 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:10:56.239792 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1259be6-7a4f-417f-93c5-b120d0861305 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:56.250581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1259be6-7a4f-417f-93c5-b120d0861305 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:56.255345 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe33e8-02d1-4bcb-8ad8-17eb33cdbe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:56.255945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe33e8-02d1-4bcb-8ad8-17eb33cdbe7a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.256222 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe33e8-02d1-4bcb-8ad8-17eb33cdbe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.256494 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe33e8-02d1-4bcb-8ad8-17eb33cdbe7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.257127 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe33e8-02d1-4bcb-8ad8-17eb33cdbe7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:56.258718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe33e8-02d1-4bcb-8ad8-17eb33cdbe7a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:56.268977 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4354/8768] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:10:56.273069 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956987a-cd7b-487b-956a-f77042625951 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:56.283038 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956987a-cd7b-487b-956a-f77042625951 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:56.287664 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b56efe-e0a4-4ce4-9922-43cffd33cc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:56.288249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56efe-e0a4-4ce4-9922-43cffd33cc93 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.288529 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56efe-e0a4-4ce4-9922-43cffd33cc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.288798 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56efe-e0a4-4ce4-9922-43cffd33cc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.289427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b56efe-e0a4-4ce4-9922-43cffd33cc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:56.291042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b56efe-e0a4-4ce4-9922-43cffd33cc93 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:56.302983 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4415/8769] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:10:56.307291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe33e8-02d1-4bcb-8ad8-17eb33cdbe7a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:56.317757 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe33e8-02d1-4bcb-8ad8-17eb33cdbe7a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:56.322826 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023cf4e-b090-41ff-b3de-6c9767c00513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:56.323517 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023cf4e-b090-41ff-b3de-6c9767c00513 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.323800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023cf4e-b090-41ff-b3de-6c9767c00513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.324071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023cf4e-b090-41ff-b3de-6c9767c00513 admin admin] PATH_INFO: `/v3/projects/78214f1cbf1f4856b3f2ce094a2a111a/users/1a52bdeacefc48c496206b4e4f5ee78f/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.339417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023cf4e-b090-41ff-b3de-6c9767c00513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78214f1cbf1f4856b3f2ce094a2a111a, user_id=1a52bdeacefc48c496206b4e4f5ee78f, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:56.342056 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023cf4e-b090-41ff-b3de-6c9767c00513 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:56.355023 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4355/8770] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:10:56 2022] PUT /identity/v3/projects/78214f1cbf1f4856b3f2ce094a2a111a/users/1a52bdeacefc48c496206b4e4f5ee78f/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:10:56.365597 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3ead2-11b7-429c-aad0-8c9feab2d57b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.365914 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3ead2-11b7-429c-aad0-8c9feab2d57b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.366212 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3ead2-11b7-429c-aad0-8c9feab2d57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.393723 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-47e3ead2-11b7-429c-aad0-8c9feab2d57b None None] MFA Rules not processed for user `1a52bdeacefc48c496206b4e4f5ee78f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:10:56.394936 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47e3ead2-11b7-429c-aad0-8c9feab2d57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:10:56.399902 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:10:56.462628 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4416/8771] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:10:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:10:56.467071 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023cf4e-b090-41ff-b3de-6c9767c00513 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:56.501559 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:10:56.532177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023cf4e-b090-41ff-b3de-6c9767c00513 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:56.536841 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434a3d1-206d-45c4-9aa2-a11c66b6fd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:56.537441 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434a3d1-206d-45c4-9aa2-a11c66b6fd22 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.537747 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434a3d1-206d-45c4-9aa2-a11c66b6fd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.538019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434a3d1-206d-45c4-9aa2-a11c66b6fd22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.538648 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434a3d1-206d-45c4-9aa2-a11c66b6fd22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:56.540578 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434a3d1-206d-45c4-9aa2-a11c66b6fd22 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:56.567543 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4356/8772] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 02:10:56 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:10:56.571462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3ead2-11b7-429c-aad0-8c9feab2d57b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:56.582549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3ead2-11b7-429c-aad0-8c9feab2d57b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:56.637742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603c30a-a0d1-4ccf-a5f2-c38d251bf02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:56.638363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603c30a-a0d1-4ccf-a5f2-c38d251bf02e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.638620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603c30a-a0d1-4ccf-a5f2-c38d251bf02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.638890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603c30a-a0d1-4ccf-a5f2-c38d251bf02e admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.639783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603c30a-a0d1-4ccf-a5f2-c38d251bf02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:56.641685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603c30a-a0d1-4ccf-a5f2-c38d251bf02e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:56.661903 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4417/8773] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 02:10:56 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:10:56.666034 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434a3d1-206d-45c4-9aa2-a11c66b6fd22 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:56.676529 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434a3d1-206d-45c4-9aa2-a11c66b6fd22 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:56.681102 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016931e-4fab-4018-bcb9-bba6aff37b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:56.681690 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016931e-4fab-4018-bcb9-bba6aff37b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.681967 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016931e-4fab-4018-bcb9-bba6aff37b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.682234 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016931e-4fab-4018-bcb9-bba6aff37b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.682851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016931e-4fab-4018-bcb9-bba6aff37b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:56.684464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016931e-4fab-4018-bcb9-bba6aff37b34 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:56.695638 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4357/8774] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:10:56.699799 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603c30a-a0d1-4ccf-a5f2-c38d251bf02e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:56.710560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603c30a-a0d1-4ccf-a5f2-c38d251bf02e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:56.715300 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f7a08-4cb1-4d95-9d87-967a9143bfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:56.716004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f7a08-4cb1-4d95-9d87-967a9143bfc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.716324 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f7a08-4cb1-4d95-9d87-967a9143bfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.716607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f7a08-4cb1-4d95-9d87-967a9143bfc8 admin admin] PATH_INFO: `/v3/projects/7331579346e14b23acaf0f522ad4bcc2/users/9082ae1af1fd4aa8be048de3bea5ed4a/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.731495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f7a08-4cb1-4d95-9d87-967a9143bfc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7331579346e14b23acaf0f522ad4bcc2, user_id=9082ae1af1fd4aa8be048de3bea5ed4a, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:56.734318 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f7a08-4cb1-4d95-9d87-967a9143bfc8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:56.747179 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4418/8775] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:10:56 2022] PUT /identity/v3/projects/7331579346e14b23acaf0f522ad4bcc2/users/9082ae1af1fd4aa8be048de3bea5ed4a/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:10:56.752275 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016931e-4fab-4018-bcb9-bba6aff37b34 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:56.762469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016931e-4fab-4018-bcb9-bba6aff37b34 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:56.818371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0b400-49fc-4960-9f3e-f7bae02433b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:56.819003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0b400-49fc-4960-9f3e-f7bae02433b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.819291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0b400-49fc-4960-9f3e-f7bae02433b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.819567 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0b400-49fc-4960-9f3e-f7bae02433b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.820191 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0b400-49fc-4960-9f3e-f7bae02433b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:56.821776 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0b400-49fc-4960-9f3e-f7bae02433b2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:56.832167 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4358/8776] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:10:56.836235 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f7a08-4cb1-4d95-9d87-967a9143bfc8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:56.846573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f7a08-4cb1-4d95-9d87-967a9143bfc8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:56.851190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d095a-6de6-4e01-bf5e-3f37b0eb97ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:56.851826 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d095a-6de6-4e01-bf5e-3f37b0eb97ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.852112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d095a-6de6-4e01-bf5e-3f37b0eb97ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.852388 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d095a-6de6-4e01-bf5e-3f37b0eb97ce admin admin] PATH_INFO: `/v3/projects/7331579346e14b23acaf0f522ad4bcc2/users/9082ae1af1fd4aa8be048de3bea5ed4a/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.854309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d095a-6de6-4e01-bf5e-3f37b0eb97ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7331579346e14b23acaf0f522ad4bcc2, user_id=9082ae1af1fd4aa8be048de3bea5ed4a, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:56.856960 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d095a-6de6-4e01-bf5e-3f37b0eb97ce admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:56.867051 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4419/8777] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:10:56 2022] PUT /identity/v3/projects/7331579346e14b23acaf0f522ad4bcc2/users/9082ae1af1fd4aa8be048de3bea5ed4a/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:10:56.878909 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b18279-3b8b-4719-9bc0-e2dcecb6ae24 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:56.879229 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b18279-3b8b-4719-9bc0-e2dcecb6ae24 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:56.879510 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b18279-3b8b-4719-9bc0-e2dcecb6ae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:56.907536 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-90b18279-3b8b-4719-9bc0-e2dcecb6ae24 None None] MFA Rules not processed for user `9082ae1af1fd4aa8be048de3bea5ed4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:10:56.908740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-90b18279-3b8b-4719-9bc0-e2dcecb6ae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:10:56.976632 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4359/8778] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:10:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:10:56.991099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d095a-6de6-4e01-bf5e-3f37b0eb97ce admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:10:56.992946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-554d095a-6de6-4e01-bf5e-3f37b0eb97ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:10:57.051755 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:10:57.069564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d095a-6de6-4e01-bf5e-3f37b0eb97ce admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:10:57.075258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f3430-64fe-4207-acf3-b39b834514f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:10:57.075896 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f3430-64fe-4207-acf3-b39b834514f5 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:10:57.076175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f3430-64fe-4207-acf3-b39b834514f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:10:57.076453 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f3430-64fe-4207-acf3-b39b834514f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:10:57.131618 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f3430-64fe-4207-acf3-b39b834514f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:10:57.133208 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f3430-64fe-4207-acf3-b39b834514f5 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:10:57.142065 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4420/8779] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:10:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:11:00.150948 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b18279-3b8b-4719-9bc0-e2dcecb6ae24 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:11:00.152421 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-90b18279-3b8b-4719-9bc0-e2dcecb6ae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:11:00.183195 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:00.225624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b18279-3b8b-4719-9bc0-e2dcecb6ae24 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:11:00.229196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdda26-d102-45fc-8f77-4d8d79f70d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:11:00.229813 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdda26-d102-45fc-8f77-4d8d79f70d45 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:11:00.230092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdda26-d102-45fc-8f77-4d8d79f70d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:11:00.230362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdda26-d102-45fc-8f77-4d8d79f70d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:11:00.240265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdda26-d102-45fc-8f77-4d8d79f70d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:11:00.241734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdda26-d102-45fc-8f77-4d8d79f70d45 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:11:00.252198 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4360/8780] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:11:00 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 02:11:02.860507 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca2772-d0d5-4d1f-b3f7-66d900ae602e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:11:02.861103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca2772-d0d5-4d1f-b3f7-66d900ae602e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:11:02.861103 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca2772-d0d5-4d1f-b3f7-66d900ae602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:11:02.881172 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8dca2772-d0d5-4d1f-b3f7-66d900ae602e None None] MFA Rules not processed for user `1a52bdeacefc48c496206b4e4f5ee78f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:11:02.882387 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8dca2772-d0d5-4d1f-b3f7-66d900ae602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:11:02.890314 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4421/8781] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:11:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:11:03.232439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdda26-d102-45fc-8f77-4d8d79f70d45 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:11:03.242114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdda26-d102-45fc-8f77-4d8d79f70d45 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:11:03.246745 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1795cd-9011-40b5-a8c0-7c76f98cedd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:11:03.247728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1795cd-9011-40b5-a8c0-7c76f98cedd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:11:03.248784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1795cd-9011-40b5-a8c0-7c76f98cedd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:11:03.249407 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1795cd-9011-40b5-a8c0-7c76f98cedd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:11:03.251464 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6b1795cd-9011-40b5-a8c0-7c76f98cedd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:11:03.262564 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1795cd-9011-40b5-a8c0-7c76f98cedd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:11:03.264111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1795cd-9011-40b5-a8c0-7c76f98cedd5 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:11:03.274880 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4361/8782] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:11:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:11:03.684270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca2772-d0d5-4d1f-b3f7-66d900ae602e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:11:03.685688 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8dca2772-d0d5-4d1f-b3f7-66d900ae602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:11:03.805777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca2772-d0d5-4d1f-b3f7-66d900ae602e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:11:03.813232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc1026-edc9-4ba6-8131-919613da95fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:11:03.813984 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc1026-edc9-4ba6-8131-919613da95fb service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:11:03.814369 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc1026-edc9-4ba6-8131-919613da95fb service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:11:03.814742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc1026-edc9-4ba6-8131-919613da95fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:11:03.817503 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bfdc1026-edc9-4ba6-8131-919613da95fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:11:03.838655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc1026-edc9-4ba6-8131-919613da95fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:11:03.841328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc1026-edc9-4ba6-8131-919613da95fb service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:11:03.864559 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4422/8783] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:11:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:11:06.204677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1795cd-9011-40b5-a8c0-7c76f98cedd5 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:11:06.206461 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6b1795cd-9011-40b5-a8c0-7c76f98cedd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:11:06.227077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1795cd-9011-40b5-a8c0-7c76f98cedd5 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:11:06.232363 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b791-e3af-4b72-97b3-de4d0095b989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:11:06.233653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b791-e3af-4b72-97b3-de4d0095b989 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:11:06.234051 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b791-e3af-4b72-97b3-de4d0095b989 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:11:06.234409 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b791-e3af-4b72-97b3-de4d0095b989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:11:06.236546 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1694b791-e3af-4b72-97b3-de4d0095b989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:11:06.247935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694b791-e3af-4b72-97b3-de4d0095b989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:11:06.250237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694b791-e3af-4b72-97b3-de4d0095b989 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:11:06.259181 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4362/8784] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:11:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:11:12.314613 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc1026-edc9-4ba6-8131-919613da95fb service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:11:12.316378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bfdc1026-edc9-4ba6-8131-919613da95fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:11:12.336885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc1026-edc9-4ba6-8131-919613da95fb service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:11:12.344845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ca8c9-e3d6-4abb-aabd-ee6688714bad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:11:12.345456 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ca8c9-e3d6-4abb-aabd-ee6688714bad service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:11:12.346148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ca8c9-e3d6-4abb-aabd-ee6688714bad service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:11:12.346148 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ca8c9-e3d6-4abb-aabd-ee6688714bad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:11:12.348413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bd5ca8c9-e3d6-4abb-aabd-ee6688714bad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:11:12.361622 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ca8c9-e3d6-4abb-aabd-ee6688714bad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:11:12.363336 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ca8c9-e3d6-4abb-aabd-ee6688714bad service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:11:12.373954 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4423/8785] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:11:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:11:14.620636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b791-e3af-4b72-97b3-de4d0095b989 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:11:14.622192 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1694b791-e3af-4b72-97b3-de4d0095b989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:11:14.638165 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b791-e3af-4b72-97b3-de4d0095b989 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:11:14.643949 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124d89e-0d0d-44c8-9040-0ed99d953978 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:11:14.644554 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d89e-0d0d-44c8-9040-0ed99d953978 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:11:14.644836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d89e-0d0d-44c8-9040-0ed99d953978 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:11:14.645111 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d89e-0d0d-44c8-9040-0ed99d953978 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:11:14.646836 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6124d89e-0d0d-44c8-9040-0ed99d953978 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:11:14.660300 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124d89e-0d0d-44c8-9040-0ed99d953978 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:11:14.662083 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124d89e-0d0d-44c8-9040-0ed99d953978 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:11:14.673209 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4363/8786] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:11:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:11:22.369518 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=74 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:24.668686 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=37 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:05.423632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0053fe6-6e45-4a3c-9943-44564a43096c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:12:05.424241 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0053fe6-6e45-4a3c-9943-44564a43096c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:12:05.424346 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0053fe6-6e45-4a3c-9943-44564a43096c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:12:05.454704 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c0053fe6-6e45-4a3c-9943-44564a43096c None None] MFA Rules not processed for user `1a52bdeacefc48c496206b4e4f5ee78f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:12:05.456899 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c0053fe6-6e45-4a3c-9943-44564a43096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:12:05.464999 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4424/8787] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:12:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:12:15.442147 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:16.833935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124d89e-0d0d-44c8-9040-0ed99d953978 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:12:16.844607 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124d89e-0d0d-44c8-9040-0ed99d953978 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:12:16.850385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c36db3-da70-4a67-9c83-01349d2903a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:12:16.851013 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c36db3-da70-4a67-9c83-01349d2903a5 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:12:16.851294 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c36db3-da70-4a67-9c83-01349d2903a5 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:12:16.851566 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c36db3-da70-4a67-9c83-01349d2903a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:12:16.853251 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-82c36db3-da70-4a67-9c83-01349d2903a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:12:16.877118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c36db3-da70-4a67-9c83-01349d2903a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:12:16.878760 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c36db3-da70-4a67-9c83-01349d2903a5 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:12:16.889833 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4364/8788] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:12:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:12:26.885255 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=11 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:13:41.706049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0053fe6-6e45-4a3c-9943-44564a43096c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:13:41.716579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0053fe6-6e45-4a3c-9943-44564a43096c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:13:41.720256 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be5660-05dc-468b-bc56-7f0a64d1e71a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:13:41.720862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be5660-05dc-468b-bc56-7f0a64d1e71a service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:13:41.721141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be5660-05dc-468b-bc56-7f0a64d1e71a service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:13:41.721414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be5660-05dc-468b-bc56-7f0a64d1e71a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:13:41.723342 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d0be5660-05dc-468b-bc56-7f0a64d1e71a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:13:41.757684 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be5660-05dc-468b-bc56-7f0a64d1e71a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:13:41.759278 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be5660-05dc-468b-bc56-7f0a64d1e71a service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:13:41.770153 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4425/8789] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:13:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:13:51.765431 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=14 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:13:52.530854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd994b4-b715-4cb7-bb4c-fb3eabaa841a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:13:52.531378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd994b4-b715-4cb7-bb4c-fb3eabaa841a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:13:52.531489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd994b4-b715-4cb7-bb4c-fb3eabaa841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:13:52.551432 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6bd994b4-b715-4cb7-bb4c-fb3eabaa841a None None] MFA Rules not processed for user `1a52bdeacefc48c496206b4e4f5ee78f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:13:52.553828 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6bd994b4-b715-4cb7-bb4c-fb3eabaa841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:13:52.562363 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4365/8790] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:13:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:13:52.911615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be5660-05dc-468b-bc56-7f0a64d1e71a service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:13:52.921845 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be5660-05dc-468b-bc56-7f0a64d1e71a service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:13:52.926687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a28f02-0754-4277-aaf8-33205f82eac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:13:52.926825 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a28f02-0754-4277-aaf8-33205f82eac8 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:13:52.927132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a28f02-0754-4277-aaf8-33205f82eac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:13:52.927408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a28f02-0754-4277-aaf8-33205f82eac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:13:52.929180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-00a28f02-0754-4277-aaf8-33205f82eac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:13:52.939769 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a28f02-0754-4277-aaf8-33205f82eac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:13:52.941271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a28f02-0754-4277-aaf8-33205f82eac8 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:13:52.950410 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4426/8791] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:13:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:13:53.372445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd994b4-b715-4cb7-bb4c-fb3eabaa841a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:13:53.392990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd994b4-b715-4cb7-bb4c-fb3eabaa841a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:13:53.397645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b1e7-dbed-4d2e-a614-7f084537d06f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:13:53.398699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b1e7-dbed-4d2e-a614-7f084537d06f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:13:53.399323 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b1e7-dbed-4d2e-a614-7f084537d06f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:13:53.399755 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b1e7-dbed-4d2e-a614-7f084537d06f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:13:53.402417 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5f14b1e7-dbed-4d2e-a614-7f084537d06f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:13:53.445238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14b1e7-dbed-4d2e-a614-7f084537d06f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:13:53.447831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14b1e7-dbed-4d2e-a614-7f084537d06f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:13:53.470715 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4366/8792] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:13:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:14:02.950432 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:03.462977 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:37.726871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d08179-fdbe-4eaf-a557-7398d4d8e1c5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:14:37.728014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d08179-fdbe-4eaf-a557-7398d4d8e1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:14:37.728014 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d08179-fdbe-4eaf-a557-7398d4d8e1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:14:37.781191 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c8d08179-fdbe-4eaf-a557-7398d4d8e1c5 None None] MFA Rules not processed for user `e0d6b7f81a7f4ba3a299acca4b7d4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:14:37.782417 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c8d08179-fdbe-4eaf-a557-7398d4d8e1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:14:37.789013 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4427/8793] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 02:14:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:14:37.801733 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b1e7-dbed-4d2e-a614-7f084537d06f service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:14:37.810624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b1e7-dbed-4d2e-a614-7f084537d06f service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:14:37.814346 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978510e-1b97-45cd-af13-ebeb732ef72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:14:37.814983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978510e-1b97-45cd-af13-ebeb732ef72d service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:14:37.815263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978510e-1b97-45cd-af13-ebeb732ef72d service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:14:37.815533 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978510e-1b97-45cd-af13-ebeb732ef72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:14:37.824196 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978510e-1b97-45cd-af13-ebeb732ef72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:14:37.825634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978510e-1b97-45cd-af13-ebeb732ef72d service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:14:37.833752 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4367/8794] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:14:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:14:37.914425 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8d86a-30aa-4d0b-928f-acc6e941cec4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:14:37.914743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8d86a-30aa-4d0b-928f-acc6e941cec4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:14:37.915594 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8d86a-30aa-4d0b-928f-acc6e941cec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:14:37.953175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-afc8d86a-30aa-4d0b-928f-acc6e941cec4 None None] MFA Rules not processed for user `2bd64951d9864572a117f9433aeaef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:14:37.954361 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-afc8d86a-30aa-4d0b-928f-acc6e941cec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:14:37.963467 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4428/8795] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 02:14:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:14:37.974654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978510e-1b97-45cd-af13-ebeb732ef72d service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:14:37.987197 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978510e-1b97-45cd-af13-ebeb732ef72d service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:14:37.992181 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101664e6-06d1-4794-92b5-83d65c313020 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:14:37.992768 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101664e6-06d1-4794-92b5-83d65c313020 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:14:37.993092 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101664e6-06d1-4794-92b5-83d65c313020 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:14:37.993364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101664e6-06d1-4794-92b5-83d65c313020 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:14:38.001568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101664e6-06d1-4794-92b5-83d65c313020 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:14:38.003166 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101664e6-06d1-4794-92b5-83d65c313020 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:14:38.012771 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4368/8796] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:14:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:14:38.190161 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d63cd-0400-47aa-99d7-885255df60a0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:14:38.190477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d63cd-0400-47aa-99d7-885255df60a0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:14:38.190754 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d63cd-0400-47aa-99d7-885255df60a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:14:38.228827 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d53d63cd-0400-47aa-99d7-885255df60a0 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:14:38.230274 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d53d63cd-0400-47aa-99d7-885255df60a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:14:38.239712 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4429/8797] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 02:14:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:14:38.250466 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101664e6-06d1-4794-92b5-83d65c313020 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:14:38.259666 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101664e6-06d1-4794-92b5-83d65c313020 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:14:38.263500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfc7eb-d430-4eec-80a8-bb065d2f5960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:14:38.264094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfc7eb-d430-4eec-80a8-bb065d2f5960 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:14:38.264403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfc7eb-d430-4eec-80a8-bb065d2f5960 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:14:38.264680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfc7eb-d430-4eec-80a8-bb065d2f5960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:14:38.275653 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfc7eb-d430-4eec-80a8-bb065d2f5960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:14:38.277080 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfc7eb-d430-4eec-80a8-bb065d2f5960 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:14:38.287808 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4369/8798] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:14:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:14:38.349149 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d63cd-0400-47aa-99d7-885255df60a0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:14:38.360652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d63cd-0400-47aa-99d7-885255df60a0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:14:38.365731 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fe0a7-6cb4-4a17-9e15-ec40680d226e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:14:38.366330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fe0a7-6cb4-4a17-9e15-ec40680d226e service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:14:38.366632 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fe0a7-6cb4-4a17-9e15-ec40680d226e service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:14:38.366904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fe0a7-6cb4-4a17-9e15-ec40680d226e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:14:38.368800 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-229fe0a7-6cb4-4a17-9e15-ec40680d226e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:14:38.380126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fe0a7-6cb4-4a17-9e15-ec40680d226e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:14:38.381694 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fe0a7-6cb4-4a17-9e15-ec40680d226e service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:14:38.392612 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4430/8799] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:14:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:14:48.283169 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=18 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:48.387969 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=37 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:57.035541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfc7eb-d430-4eec-80a8-bb065d2f5960 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:14:57.044516 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfc7eb-d430-4eec-80a8-bb065d2f5960 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:14:57.048403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628874f-9075-42f2-93ab-979ad46c6695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:14:57.048997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628874f-9075-42f2-93ab-979ad46c6695 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:14:57.049273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628874f-9075-42f2-93ab-979ad46c6695 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:14:57.049576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628874f-9075-42f2-93ab-979ad46c6695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:14:57.051392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3628874f-9075-42f2-93ab-979ad46c6695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:14:57.061899 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628874f-9075-42f2-93ab-979ad46c6695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:14:57.063367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628874f-9075-42f2-93ab-979ad46c6695 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:14:57.071453 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4370/8800] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:14:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:15:07.067970 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:15:34.884522 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fe0a7-6cb4-4a17-9e15-ec40680d226e service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:15:34.900780 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fe0a7-6cb4-4a17-9e15-ec40680d226e service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:15:34.907430 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4dd7d-422f-441f-a2a8-a53ea0c157bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:15:34.908034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4dd7d-422f-441f-a2a8-a53ea0c157bf service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:15:34.908316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4dd7d-422f-441f-a2a8-a53ea0c157bf service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:15:34.908588 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4dd7d-422f-441f-a2a8-a53ea0c157bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:15:34.910596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b5b4dd7d-422f-441f-a2a8-a53ea0c157bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:15:34.923978 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4dd7d-422f-441f-a2a8-a53ea0c157bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:15:34.925846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4dd7d-422f-441f-a2a8-a53ea0c157bf service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:15:34.939340 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4431/8801] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:15:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 02:15:44.933522 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:15:47.442585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1187e34-de3f-4188-bada-40ad502cb7c6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:15:47.443385 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1187e34-de3f-4188-bada-40ad502cb7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:15:47.443609 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1187e34-de3f-4188-bada-40ad502cb7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:15:47.472649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d1187e34-de3f-4188-bada-40ad502cb7c6 None None] MFA Rules not processed for user `1a52bdeacefc48c496206b4e4f5ee78f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:15:47.473874 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d1187e34-de3f-4188-bada-40ad502cb7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:15:47.481238 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4371/8802] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:15:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 02:15:51.123190 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4dd7d-422f-441f-a2a8-a53ea0c157bf service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:15:51.135983 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4dd7d-422f-441f-a2a8-a53ea0c157bf service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:15:51.143623 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565901d-55b2-4038-bf03-693093da13d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:15:51.144238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565901d-55b2-4038-bf03-693093da13d7 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:15:51.144513 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565901d-55b2-4038-bf03-693093da13d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:15:51.144782 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565901d-55b2-4038-bf03-693093da13d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:15:51.147560 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3565901d-55b2-4038-bf03-693093da13d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:15:51.161441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565901d-55b2-4038-bf03-693093da13d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:15:51.163053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565901d-55b2-4038-bf03-693093da13d7 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:15:51.175651 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4432/8803] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:15:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:15:55.460200 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1187e34-de3f-4188-bada-40ad502cb7c6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:15:55.470043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1187e34-de3f-4188-bada-40ad502cb7c6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:15:55.473524 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca3aa6-ccaa-49c7-a9de-23b9f267df4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:15:55.474115 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca3aa6-ccaa-49c7-a9de-23b9f267df4c service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:15:55.474391 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca3aa6-ccaa-49c7-a9de-23b9f267df4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:15:55.474663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca3aa6-ccaa-49c7-a9de-23b9f267df4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:15:55.483415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca3aa6-ccaa-49c7-a9de-23b9f267df4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:15:55.484825 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca3aa6-ccaa-49c7-a9de-23b9f267df4c service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:15:55.493421 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4372/8804] 10.222.0.39 () {60 vars in 1396 bytes} [Sun Oct 16 02:15:55 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3270 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:16:01.171157 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:16:05.489463 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:16:17.643690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565901d-55b2-4038-bf03-693093da13d7 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:16:17.654652 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565901d-55b2-4038-bf03-693093da13d7 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:16:17.660144 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5dd8f-0cd7-48ba-9d92-5aca85bbe803 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:16:17.660767 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5dd8f-0cd7-48ba-9d92-5aca85bbe803 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:16:17.661044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5dd8f-0cd7-48ba-9d92-5aca85bbe803 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:16:17.661312 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5dd8f-0cd7-48ba-9d92-5aca85bbe803 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:16:17.669650 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5dd8f-0cd7-48ba-9d92-5aca85bbe803 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:16:17.671219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5dd8f-0cd7-48ba-9d92-5aca85bbe803 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:16:17.682557 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4433/8805] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:16:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:16:27.677846 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:16:50.451994 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca3aa6-ccaa-49c7-a9de-23b9f267df4c service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:16:50.461505 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca3aa6-ccaa-49c7-a9de-23b9f267df4c service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:16:50.465199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29c835-46f1-4b0b-a2d3-a7a67fa4a1b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:16:50.465800 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29c835-46f1-4b0b-a2d3-a7a67fa4a1b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:16:50.466079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29c835-46f1-4b0b-a2d3-a7a67fa4a1b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:16:50.466354 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29c835-46f1-4b0b-a2d3-a7a67fa4a1b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:16:50.473674 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29c835-46f1-4b0b-a2d3-a7a67fa4a1b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:16:50.475297 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29c835-46f1-4b0b-a2d3-a7a67fa4a1b3 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:16:50.483461 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4373/8806] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:16:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:17:00.479740 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:17:22.829913 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5dd8f-0cd7-48ba-9d92-5aca85bbe803 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:17:22.845876 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5dd8f-0cd7-48ba-9d92-5aca85bbe803 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:17:22.851058 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e1bfa-915e-4fb7-8c9e-34ff8020285b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:17:22.851748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e1bfa-915e-4fb7-8c9e-34ff8020285b service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:17:22.852096 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e1bfa-915e-4fb7-8c9e-34ff8020285b service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:17:22.852433 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e1bfa-915e-4fb7-8c9e-34ff8020285b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:17:22.862199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e1bfa-915e-4fb7-8c9e-34ff8020285b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:17:22.864022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e1bfa-915e-4fb7-8c9e-34ff8020285b service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:17:22.874312 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4434/8807] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:17:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:17:30.025393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29c835-46f1-4b0b-a2d3-a7a67fa4a1b3 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:17:30.038286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29c835-46f1-4b0b-a2d3-a7a67fa4a1b3 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:17:30.044128 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb2730-195a-4311-8bdf-0c2dd3d1a3b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:17:30.044720 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb2730-195a-4311-8bdf-0c2dd3d1a3b1 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:17:30.044999 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb2730-195a-4311-8bdf-0c2dd3d1a3b1 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:17:30.045271 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb2730-195a-4311-8bdf-0c2dd3d1a3b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:17:30.047038 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0fbb2730-195a-4311-8bdf-0c2dd3d1a3b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:17:30.059001 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb2730-195a-4311-8bdf-0c2dd3d1a3b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:17:30.060601 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb2730-195a-4311-8bdf-0c2dd3d1a3b1 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:17:30.073569 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4374/8808] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:17:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:17:32.869942 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:17:33.271066 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e1bfa-915e-4fb7-8c9e-34ff8020285b service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:17:33.280890 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e1bfa-915e-4fb7-8c9e-34ff8020285b service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:17:33.284823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47910dd-a6c8-42c7-be47-3fe1519f8486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:17:33.285713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47910dd-a6c8-42c7-be47-3fe1519f8486 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:17:33.286067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47910dd-a6c8-42c7-be47-3fe1519f8486 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:17:33.286410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47910dd-a6c8-42c7-be47-3fe1519f8486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:17:33.296132 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47910dd-a6c8-42c7-be47-3fe1519f8486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:17:33.297784 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47910dd-a6c8-42c7-be47-3fe1519f8486 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:17:33.309158 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4435/8809] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:17:33 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:17:36.211634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25cd6f-52b8-4cda-b15f-e0a6ab39416f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:17:36.212158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25cd6f-52b8-4cda-b15f-e0a6ab39416f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:17:36.212573 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25cd6f-52b8-4cda-b15f-e0a6ab39416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:17:36.234150 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3e25cd6f-52b8-4cda-b15f-e0a6ab39416f None None] MFA Rules not processed for user `1a52bdeacefc48c496206b4e4f5ee78f`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:17:36.235752 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3e25cd6f-52b8-4cda-b15f-e0a6ab39416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:17:36.243181 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4375/8810] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:17:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:17:36.600122 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47910dd-a6c8-42c7-be47-3fe1519f8486 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:17:36.613135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47910dd-a6c8-42c7-be47-3fe1519f8486 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:17:36.620633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4787bb0-f50c-4e8f-ac3f-51e2b81d13c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:17:36.621270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787bb0-f50c-4e8f-ac3f-51e2b81d13c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:17:36.621542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787bb0-f50c-4e8f-ac3f-51e2b81d13c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:17:36.623854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787bb0-f50c-4e8f-ac3f-51e2b81d13c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:17:36.637090 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4787bb0-f50c-4e8f-ac3f-51e2b81d13c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:17:36.638600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4787bb0-f50c-4e8f-ac3f-51e2b81d13c3 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:17:36.647636 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4436/8811] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:17:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 02:17:44.239458 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25cd6f-52b8-4cda-b15f-e0a6ab39416f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:17:44.254283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25cd6f-52b8-4cda-b15f-e0a6ab39416f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:17:44.260483 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131b28b-8193-4c2b-b254-72d0b3d84710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:17:44.261934 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131b28b-8193-4c2b-b254-72d0b3d84710 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:17:44.262471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131b28b-8193-4c2b-b254-72d0b3d84710 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:17:44.263057 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131b28b-8193-4c2b-b254-72d0b3d84710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:17:44.273178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131b28b-8193-4c2b-b254-72d0b3d84710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:17:44.275020 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131b28b-8193-4c2b-b254-72d0b3d84710 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:17:44.287619 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4376/8812] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:17:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:17:46.643633 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=12 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:17:54.282724 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=15 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:34.091883 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4787bb0-f50c-4e8f-ac3f-51e2b81d13c3 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:34.179549 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4787bb0-f50c-4e8f-ac3f-51e2b81d13c3 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:34.184180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:34.186021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:34.186298 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:34.186570 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] PATH_INFO: `/v3/users/1a52bdeacefc48c496206b4e4f5ee78f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:34.187742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a52bdeacefc48c496206b4e4f5ee78f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:34.189641 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:34.236589 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a52bdeacefc48c496206b4e4f5ee78f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.237247 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a52bdeacefc48c496206b4e4f5ee78f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.249964 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a52bdeacefc48c496206b4e4f5ee78f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.257422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a52bdeacefc48c496206b4e4f5ee78f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.258035 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a52bdeacefc48c496206b4e4f5ee78f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.271477 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4437/8813] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:18:34 2022] DELETE /identity/v3/users/1a52bdeacefc48c496206b4e4f5ee78f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:18:34.276084 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106538c-105f-404b-af8c-dbc7eeb0aee9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:34.276603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106538c-105f-404b-af8c-dbc7eeb0aee9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:34.276603 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106538c-105f-404b-af8c-dbc7eeb0aee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:34.317120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a106538c-105f-404b-af8c-dbc7eeb0aee9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:18:34.318246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a106538c-105f-404b-af8c-dbc7eeb0aee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:34.379396 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4377/8814] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:18:34.390004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:34.391450 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:34.449795 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19490dd5-d110-4954-91bd-f937762f0a2b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:34.453846 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f6ab7-f34c-4dfe-a262-acf51c55d809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:34.454443 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f6ab7-f34c-4dfe-a262-acf51c55d809 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:34.454719 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f6ab7-f34c-4dfe-a262-acf51c55d809 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:34.455022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f6ab7-f34c-4dfe-a262-acf51c55d809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:34.463811 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f6ab7-f34c-4dfe-a262-acf51c55d809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:34.465221 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f6ab7-f34c-4dfe-a262-acf51c55d809 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:34.475078 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4438/8815] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:18:34.645190 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106538c-105f-404b-af8c-dbc7eeb0aee9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:34.646623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a106538c-105f-404b-af8c-dbc7eeb0aee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:34.659433 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106538c-105f-404b-af8c-dbc7eeb0aee9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:34.664273 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:34.664920 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:34.665198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:34.665471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] PATH_INFO: `/v3/projects/78214f1cbf1f4856b3f2ce094a2a111a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:34.666582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] RBAC: Authorizing `identity:delete_project(project_id=78214f1cbf1f4856b3f2ce094a2a111a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:34.668600 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:34.716306 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78214f1cbf1f4856b3f2ce094a2a111a', 'request_id': 'req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.722270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78214f1cbf1f4856b3f2ce094a2a111a', 'request_id': 'req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.729420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78214f1cbf1f4856b3f2ce094a2a111a', 'request_id': 'req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.740502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] The token cache is being invalidate because project 78214f1cbf1f4856b3f2ce094a2a111a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:18:34.740796 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.741580 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.743084 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4378/8816] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:18:34 2022] DELETE /identity/v3/projects/78214f1cbf1f4856b3f2ce094a2a111a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:18:34.747783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f6ab7-f34c-4dfe-a262-acf51c55d809 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:34.753852 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:34.758325 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f6ab7-f34c-4dfe-a262-acf51c55d809 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:34.816167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1a56d-95f8-48b2-8a05-195157466685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:34.816819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1a56d-95f8-48b2-8a05-195157466685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:34.817099 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1a56d-95f8-48b2-8a05-195157466685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:34.817372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1a56d-95f8-48b2-8a05-195157466685 admin admin] PATH_INFO: `/v3/users/9082ae1af1fd4aa8be048de3bea5ed4a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:34.818484 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1a56d-95f8-48b2-8a05-195157466685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9082ae1af1fd4aa8be048de3bea5ed4a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:34.820679 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1a56d-95f8-48b2-8a05-195157466685 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:34.866075 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-88f1a56d-95f8-48b2-8a05-195157466685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9082ae1af1fd4aa8be048de3bea5ed4a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.866712 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-88f1a56d-95f8-48b2-8a05-195157466685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9082ae1af1fd4aa8be048de3bea5ed4a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.878796 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-88f1a56d-95f8-48b2-8a05-195157466685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9082ae1af1fd4aa8be048de3bea5ed4a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.886081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-88f1a56d-95f8-48b2-8a05-195157466685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9082ae1af1fd4aa8be048de3bea5ed4a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.886734 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-88f1a56d-95f8-48b2-8a05-195157466685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9082ae1af1fd4aa8be048de3bea5ed4a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:34.902453 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4439/8817] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:18:34 2022] DELETE /identity/v3/users/9082ae1af1fd4aa8be048de3bea5ed4a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:18:35.174412 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:35.175912 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:35.194797 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4c44-ccb3-46bf-a72f-1f9078f2f53f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:35.251068 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ae2ac-df14-4980-8c02-afc7ad2adff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:35.251634 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ae2ac-df14-4980-8c02-afc7ad2adff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:35.251913 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ae2ac-df14-4980-8c02-afc7ad2adff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:35.252187 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ae2ac-df14-4980-8c02-afc7ad2adff3 admin admin] PATH_INFO: `/v3/projects/7331579346e14b23acaf0f522ad4bcc2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:35.253291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ae2ac-df14-4980-8c02-afc7ad2adff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7331579346e14b23acaf0f522ad4bcc2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:35.255522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ae2ac-df14-4980-8c02-afc7ad2adff3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:35.263981 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:35.304042 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-379ae2ac-df14-4980-8c02-afc7ad2adff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7331579346e14b23acaf0f522ad4bcc2', 'request_id': 'req-379ae2ac-df14-4980-8c02-afc7ad2adff3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:35.310123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-379ae2ac-df14-4980-8c02-afc7ad2adff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7331579346e14b23acaf0f522ad4bcc2', 'request_id': 'req-379ae2ac-df14-4980-8c02-afc7ad2adff3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:35.317577 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-379ae2ac-df14-4980-8c02-afc7ad2adff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7331579346e14b23acaf0f522ad4bcc2', 'request_id': 'req-379ae2ac-df14-4980-8c02-afc7ad2adff3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:35.328855 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-379ae2ac-df14-4980-8c02-afc7ad2adff3 admin admin] The token cache is being invalidate because project 7331579346e14b23acaf0f522ad4bcc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:18:35.329138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-379ae2ac-df14-4980-8c02-afc7ad2adff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:35.329767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-379ae2ac-df14-4980-8c02-afc7ad2adff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:18:35.331304 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4379/8818] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:18:35 2022] DELETE /identity/v3/projects/7331579346e14b23acaf0f522ad4bcc2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:18:35.336711 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce542a-fc22-40b1-8e2e-daf3c42979d9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:35.337167 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce542a-fc22-40b1-8e2e-daf3c42979d9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:35.337269 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce542a-fc22-40b1-8e2e-daf3c42979d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:35.376047 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d6ce542a-fc22-40b1-8e2e-daf3c42979d9 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:18:35.377240 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d6ce542a-fc22-40b1-8e2e-daf3c42979d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:35.444038 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4440/8819] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:18:35.453854 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e6ba5-c353-47a4-ab60-5772f5bad89c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:35.454133 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e6ba5-c353-47a4-ab60-5772f5bad89c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:35.454401 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e6ba5-c353-47a4-ab60-5772f5bad89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:35.475897 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fd5e6ba5-c353-47a4-ab60-5772f5bad89c None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:18:35.477077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fd5e6ba5-c353-47a4-ab60-5772f5bad89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:35.485285 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4380/8820] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:18:35.489540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce542a-fc22-40b1-8e2e-daf3c42979d9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:35.499455 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce542a-fc22-40b1-8e2e-daf3c42979d9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:35.504434 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b59beb-830e-4fd7-b2d4-2373677f9dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:35.505057 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b59beb-830e-4fd7-b2d4-2373677f9dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:35.505358 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b59beb-830e-4fd7-b2d4-2373677f9dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:35.505626 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b59beb-830e-4fd7-b2d4-2373677f9dc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:35.506264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b59beb-830e-4fd7-b2d4-2373677f9dc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 02:18:35.506562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b59beb-830e-4fd7-b2d4-2373677f9dc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:35.508203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b59beb-830e-4fd7-b2d4-2373677f9dc7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:35.510562 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:35.522029 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4441/8821] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 02:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 02:18:35.526062 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e6ba5-c353-47a4-ab60-5772f5bad89c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:35.536074 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e6ba5-c353-47a4-ab60-5772f5bad89c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:35.540676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eac192-83af-4be0-b1a3-2ac13adfcc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:35.541265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eac192-83af-4be0-b1a3-2ac13adfcc58 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:35.541541 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eac192-83af-4be0-b1a3-2ac13adfcc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:35.541806 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eac192-83af-4be0-b1a3-2ac13adfcc58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:35.542438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eac192-83af-4be0-b1a3-2ac13adfcc58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:35.544435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eac192-83af-4be0-b1a3-2ac13adfcc58 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:35.582092 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4381/8822] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 02:18:35 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 02:18:35.586528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b59beb-830e-4fd7-b2d4-2373677f9dc7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:35.596807 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b59beb-830e-4fd7-b2d4-2373677f9dc7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:35.657590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09868a96-a8a1-4fcf-807a-f4dea6c8c9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:35.658195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868a96-a8a1-4fcf-807a-f4dea6c8c9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:35.658474 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868a96-a8a1-4fcf-807a-f4dea6c8c9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:35.658746 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868a96-a8a1-4fcf-807a-f4dea6c8c9f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:35.659410 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09868a96-a8a1-4fcf-807a-f4dea6c8c9f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:35.661309 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09868a96-a8a1-4fcf-807a-f4dea6c8c9f9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:35.681742 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4442/8823] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 02:18:35 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:18:35.686173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eac192-83af-4be0-b1a3-2ac13adfcc58 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:35.696906 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eac192-83af-4be0-b1a3-2ac13adfcc58 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:35.701867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbfbc4-258c-4109-a14e-03f3a42cee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:35.702486 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbfbc4-258c-4109-a14e-03f3a42cee33 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:35.702764 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbfbc4-258c-4109-a14e-03f3a42cee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:35.703077 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbfbc4-258c-4109-a14e-03f3a42cee33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:35.703707 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbfbc4-258c-4109-a14e-03f3a42cee33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:35.705290 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbfbc4-258c-4109-a14e-03f3a42cee33 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:35.715121 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4382/8824] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 02:18:35.719748 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09868a96-a8a1-4fcf-807a-f4dea6c8c9f9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:35.730102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09868a96-a8a1-4fcf-807a-f4dea6c8c9f9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:35.735489 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d8b16-1c20-4ad1-be17-302f3585c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:35.736081 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d8b16-1c20-4ad1-be17-302f3585c5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:35.736359 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d8b16-1c20-4ad1-be17-302f3585c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:35.736655 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d8b16-1c20-4ad1-be17-302f3585c5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:35.737263 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d8b16-1c20-4ad1-be17-302f3585c5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:35.738843 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d8b16-1c20-4ad1-be17-302f3585c5c0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:35.751226 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4443/8825] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:18:35.755588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbfbc4-258c-4109-a14e-03f3a42cee33 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:35.767265 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbfbc4-258c-4109-a14e-03f3a42cee33 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:35.772221 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca3f27-03c9-480a-aea5-abb1f97cf078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:35.772877 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca3f27-03c9-480a-aea5-abb1f97cf078 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:35.773160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca3f27-03c9-480a-aea5-abb1f97cf078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:35.773437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca3f27-03c9-480a-aea5-abb1f97cf078 admin admin] PATH_INFO: `/v3/projects/6e75b1540be246fb9be6572513050082/users/111c47d7a44f48559e9e22d25677d6dd/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:35.788286 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca3f27-03c9-480a-aea5-abb1f97cf078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e75b1540be246fb9be6572513050082, user_id=111c47d7a44f48559e9e22d25677d6dd, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:35.790957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca3f27-03c9-480a-aea5-abb1f97cf078 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:35.803970 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4383/8826] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:18:35 2022] PUT /identity/v3/projects/6e75b1540be246fb9be6572513050082/users/111c47d7a44f48559e9e22d25677d6dd/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:18:35.809261 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39249c-afbf-4729-ad87-950af9cbc1c0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:35.810044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39249c-afbf-4729-ad87-950af9cbc1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:35.810317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39249c-afbf-4729-ad87-950af9cbc1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:35.830840 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ef39249c-afbf-4729-ad87-950af9cbc1c0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:18:35.832093 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ef39249c-afbf-4729-ad87-950af9cbc1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:35.890652 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4444/8827] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:18:35.900291 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca3f27-03c9-480a-aea5-abb1f97cf078 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:35.901982 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e3ca3f27-03c9-480a-aea5-abb1f97cf078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:35.958878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca3f27-03c9-480a-aea5-abb1f97cf078 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:35.962576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c3413-30b4-445e-bf45-c7c4c009061d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:35.963210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c3413-30b4-445e-bf45-c7c4c009061d service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:35.963491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c3413-30b4-445e-bf45-c7c4c009061d service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:35.963766 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c3413-30b4-445e-bf45-c7c4c009061d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:35.973096 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c3413-30b4-445e-bf45-c7c4c009061d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:35.974514 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c3413-30b4-445e-bf45-c7c4c009061d service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:35.984626 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4384/8828] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:18:40.166687 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce433d8-80c3-460f-907a-2d2780522fd7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:40.167306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce433d8-80c3-460f-907a-2d2780522fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:40.167306 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce433d8-80c3-460f-907a-2d2780522fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:40.198329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6ce433d8-80c3-460f-907a-2d2780522fd7 None None] MFA Rules not processed for user `111c47d7a44f48559e9e22d25677d6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:18:40.199582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6ce433d8-80c3-460f-907a-2d2780522fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:40.275468 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4445/8829] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:18:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:18:40.280778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c3413-30b4-445e-bf45-c7c4c009061d service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:40.290894 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c3413-30b4-445e-bf45-c7c4c009061d service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:40.297700 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfc9b1-8598-4c9d-af58-3664069a9ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:40.298336 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfc9b1-8598-4c9d-af58-3664069a9ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:40.298626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfc9b1-8598-4c9d-af58-3664069a9ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:40.298898 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfc9b1-8598-4c9d-af58-3664069a9ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:40.299576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfc9b1-8598-4c9d-af58-3664069a9ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:40.301500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfc9b1-8598-4c9d-af58-3664069a9ba5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:40.330827 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4385/8830] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 02:18:40 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 02:18:40.335021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce433d8-80c3-460f-907a-2d2780522fd7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:40.342782 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:40.347229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce433d8-80c3-460f-907a-2d2780522fd7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:40.405988 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268cc4f-18c0-4965-a4a0-381d2fb17f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:40.406590 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268cc4f-18c0-4965-a4a0-381d2fb17f05 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:40.406865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268cc4f-18c0-4965-a4a0-381d2fb17f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:40.407171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268cc4f-18c0-4965-a4a0-381d2fb17f05 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:40.407831 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268cc4f-18c0-4965-a4a0-381d2fb17f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:40.409733 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268cc4f-18c0-4965-a4a0-381d2fb17f05 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:40.433995 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4446/8831] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 02:18:40 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:18:40.435480 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfc9b1-8598-4c9d-af58-3664069a9ba5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:40.442003 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:40.446463 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfc9b1-8598-4c9d-af58-3664069a9ba5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:40.453587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ee898-e19e-4912-a629-3856491599d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:40.454374 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ee898-e19e-4912-a629-3856491599d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:40.454892 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ee898-e19e-4912-a629-3856491599d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:40.455395 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ee898-e19e-4912-a629-3856491599d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:40.456039 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ee898-e19e-4912-a629-3856491599d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:40.457624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ee898-e19e-4912-a629-3856491599d0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:40.468976 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4386/8832] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 02:18:40.473691 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268cc4f-18c0-4965-a4a0-381d2fb17f05 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:40.484680 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268cc4f-18c0-4965-a4a0-381d2fb17f05 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:40.489423 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fd83e-eecd-4555-a394-7874336cd70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:40.490050 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd83e-eecd-4555-a394-7874336cd70e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:40.490323 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd83e-eecd-4555-a394-7874336cd70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:40.490596 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd83e-eecd-4555-a394-7874336cd70e admin admin] PATH_INFO: `/v3/projects/daa91bc600244a82b5faab773ef373cf/users/c0821003a8804069a9321022d4623ec7/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:40.506495 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fd83e-eecd-4555-a394-7874336cd70e admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa91bc600244a82b5faab773ef373cf, user_id=c0821003a8804069a9321022d4623ec7, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:40.509202 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fd83e-eecd-4555-a394-7874336cd70e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:40.522777 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4447/8833] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:18:40 2022] PUT /identity/v3/projects/daa91bc600244a82b5faab773ef373cf/users/c0821003a8804069a9321022d4623ec7/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 02:18:40.526772 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ee898-e19e-4912-a629-3856491599d0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:40.537750 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ee898-e19e-4912-a629-3856491599d0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:40.595239 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478eef8-3048-4d20-b277-59a03ed3476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:40.595844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478eef8-3048-4d20-b277-59a03ed3476b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:40.596120 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478eef8-3048-4d20-b277-59a03ed3476b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:40.596411 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478eef8-3048-4d20-b277-59a03ed3476b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:40.597024 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478eef8-3048-4d20-b277-59a03ed3476b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:40.598606 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478eef8-3048-4d20-b277-59a03ed3476b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:40.608247 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4387/8834] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:18:40.612646 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fd83e-eecd-4555-a394-7874336cd70e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:40.623189 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fd83e-eecd-4555-a394-7874336cd70e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:40.627775 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41d7b-792e-444f-8c17-4b2686eefd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:40.628420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41d7b-792e-444f-8c17-4b2686eefd20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:40.628696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41d7b-792e-444f-8c17-4b2686eefd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:40.628954 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41d7b-792e-444f-8c17-4b2686eefd20 admin admin] PATH_INFO: `/v3/projects/daa91bc600244a82b5faab773ef373cf/users/c0821003a8804069a9321022d4623ec7/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:40.630858 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a41d7b-792e-444f-8c17-4b2686eefd20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa91bc600244a82b5faab773ef373cf, user_id=c0821003a8804069a9321022d4623ec7, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:40.633508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a41d7b-792e-444f-8c17-4b2686eefd20 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:40.644963 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4448/8835] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:18:40 2022] PUT /identity/v3/projects/daa91bc600244a82b5faab773ef373cf/users/c0821003a8804069a9321022d4623ec7/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:18:45.039005 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62d985-e877-4155-ad05-0b19461fb46d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:45.039492 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62d985-e877-4155-ad05-0b19461fb46d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:45.039667 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62d985-e877-4155-ad05-0b19461fb46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:45.102586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-be62d985-e877-4155-ad05-0b19461fb46d None None] MFA Rules not processed for user `c0821003a8804069a9321022d4623ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:18:45.104235 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-be62d985-e877-4155-ad05-0b19461fb46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:45.230243 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4388/8836] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:18:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:18:45.241789 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41d7b-792e-444f-8c17-4b2686eefd20 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:45.243952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-44a41d7b-792e-444f-8c17-4b2686eefd20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:45.410153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41d7b-792e-444f-8c17-4b2686eefd20 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:45.416946 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68459bd7-8a95-4532-81bb-bad38f82de69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:45.417854 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68459bd7-8a95-4532-81bb-bad38f82de69 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:45.418238 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68459bd7-8a95-4532-81bb-bad38f82de69 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:45.419475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68459bd7-8a95-4532-81bb-bad38f82de69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:45.427402 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:45.497020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68459bd7-8a95-4532-81bb-bad38f82de69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:45.499317 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68459bd7-8a95-4532-81bb-bad38f82de69 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:45.519117 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4449/8837] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:18:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:18:46.540118 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061363c1-f1cc-4269-b96d-7c30bd8ba8a6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:46.540633 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061363c1-f1cc-4269-b96d-7c30bd8ba8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:46.540767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061363c1-f1cc-4269-b96d-7c30bd8ba8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:46.567712 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-061363c1-f1cc-4269-b96d-7c30bd8ba8a6 None None] MFA Rules not processed for user `111c47d7a44f48559e9e22d25677d6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:18:46.569365 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-061363c1-f1cc-4269-b96d-7c30bd8ba8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:46.576832 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4389/8838] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:18:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:18:46.624182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68459bd7-8a95-4532-81bb-bad38f82de69 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:46.625724 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-68459bd7-8a95-4532-81bb-bad38f82de69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:46.707459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68459bd7-8a95-4532-81bb-bad38f82de69 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:46.711330 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b8240-a9c4-4d6a-bac9-0bbb47817540 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:46.711944 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b8240-a9c4-4d6a-bac9-0bbb47817540 service glance] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:46.712232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b8240-a9c4-4d6a-bac9-0bbb47817540 service glance] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:46.712508 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b8240-a9c4-4d6a-bac9-0bbb47817540 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:46.714260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e45b8240-a9c4-4d6a-bac9-0bbb47817540 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:46.728078 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b8240-a9c4-4d6a-bac9-0bbb47817540 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:46.729505 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b8240-a9c4-4d6a-bac9-0bbb47817540 service glance] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:46.741032 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4450/8839] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:18:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:18:48.366581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061363c1-f1cc-4269-b96d-7c30bd8ba8a6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:48.368134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-061363c1-f1cc-4269-b96d-7c30bd8ba8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:48.428519 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:48.463738 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061363c1-f1cc-4269-b96d-7c30bd8ba8a6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:48.469889 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4273-a898-4d95-8a4f-a40aa8d87aad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:48.470515 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4273-a898-4d95-8a4f-a40aa8d87aad service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:48.470795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4273-a898-4d95-8a4f-a40aa8d87aad service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:48.471240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4273-a898-4d95-8a4f-a40aa8d87aad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:48.472983 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-267c4273-a898-4d95-8a4f-a40aa8d87aad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:48.485870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c4273-a898-4d95-8a4f-a40aa8d87aad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:48.487611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c4273-a898-4d95-8a4f-a40aa8d87aad service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:48.499249 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4390/8840] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:18:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:18:54.151126 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b8240-a9c4-4d6a-bac9-0bbb47817540 service glance] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:54.152568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e45b8240-a9c4-4d6a-bac9-0bbb47817540 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:54.219233 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b8240-a9c4-4d6a-bac9-0bbb47817540 service glance] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:54.223135 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d616e5-98bd-4528-928c-ececf750ec6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:54.223742 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d616e5-98bd-4528-928c-ececf750ec6b service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:54.224025 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d616e5-98bd-4528-928c-ececf750ec6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:54.224329 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d616e5-98bd-4528-928c-ececf750ec6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:54.226064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-26d616e5-98bd-4528-928c-ececf750ec6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:18:54.240136 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d616e5-98bd-4528-928c-ececf750ec6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:54.241551 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d616e5-98bd-4528-928c-ececf750ec6b service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:54.253853 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4451/8841] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:18:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:18:58.135958 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4273-a898-4d95-8a4f-a40aa8d87aad service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:18:58.145978 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4273-a898-4d95-8a4f-a40aa8d87aad service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:18:58.149614 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd65e5-aa58-4acc-963b-f6fdb1b0ad09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:18:58.150188 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd65e5-aa58-4acc-963b-f6fdb1b0ad09 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:18:58.150469 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd65e5-aa58-4acc-963b-f6fdb1b0ad09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:18:58.150742 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd65e5-aa58-4acc-963b-f6fdb1b0ad09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:18:58.159823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd65e5-aa58-4acc-963b-f6fdb1b0ad09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:18:58.161242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd65e5-aa58-4acc-963b-f6fdb1b0ad09 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:18:58.170754 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4391/8842] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:18:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:19:04.248256 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:19:08.166854 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=22 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:21:08.100555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44027e07-78dc-4fe3-9017-960bfbfdd77c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:21:08.100555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44027e07-78dc-4fe3-9017-960bfbfdd77c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:21:08.100555 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44027e07-78dc-4fe3-9017-960bfbfdd77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:21:08.149271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-44027e07-78dc-4fe3-9017-960bfbfdd77c None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:21:08.150476 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-44027e07-78dc-4fe3-9017-960bfbfdd77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:21:08.213406 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4452/8843] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 02:21:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:21:08.260123 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd65e5-aa58-4acc-963b-f6fdb1b0ad09 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:21:08.261543 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5efd65e5-aa58-4acc-963b-f6fdb1b0ad09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:21:08.352588 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd65e5-aa58-4acc-963b-f6fdb1b0ad09 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:21:08.357961 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ca1c6-2a3d-422a-8e0d-4f350c620a1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:21:08.358551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ca1c6-2a3d-422a-8e0d-4f350c620a1b service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:21:08.358823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ca1c6-2a3d-422a-8e0d-4f350c620a1b service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:21:08.359121 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ca1c6-2a3d-422a-8e0d-4f350c620a1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:21:08.367088 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ca1c6-2a3d-422a-8e0d-4f350c620a1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:21:08.368652 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ca1c6-2a3d-422a-8e0d-4f350c620a1b service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:21:08.377542 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4392/8844] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:21:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:21:18.210740 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=40 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:21:18.374311 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=41 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:21:20.010907 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44027e07-78dc-4fe3-9017-960bfbfdd77c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:21:20.012402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-44027e07-78dc-4fe3-9017-960bfbfdd77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:21:20.036917 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44027e07-78dc-4fe3-9017-960bfbfdd77c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:21:20.041942 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ab3e3-c473-4694-8058-ff66f9706f04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:21:20.042542 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ab3e3-c473-4694-8058-ff66f9706f04 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:21:20.042823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ab3e3-c473-4694-8058-ff66f9706f04 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:21:20.043131 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ab3e3-c473-4694-8058-ff66f9706f04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:21:20.045372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6d7ab3e3-c473-4694-8058-ff66f9706f04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:21:20.056452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ab3e3-c473-4694-8058-ff66f9706f04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:21:20.058026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ab3e3-c473-4694-8058-ff66f9706f04 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:21:20.067989 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4453/8845] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:21:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:21:20.620779 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ca1c6-2a3d-422a-8e0d-4f350c620a1b service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:21:20.631249 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ca1c6-2a3d-422a-8e0d-4f350c620a1b service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:21:20.634814 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f459a-4bc3-47ce-a0aa-00e6ee4ef926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:21:20.635437 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f459a-4bc3-47ce-a0aa-00e6ee4ef926 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:21:20.635716 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f459a-4bc3-47ce-a0aa-00e6ee4ef926 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:21:20.635984 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f459a-4bc3-47ce-a0aa-00e6ee4ef926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:21:20.637675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-962f459a-4bc3-47ce-a0aa-00e6ee4ef926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:21:20.659617 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f459a-4bc3-47ce-a0aa-00e6ee4ef926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:21:20.661037 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f459a-4bc3-47ce-a0aa-00e6ee4ef926 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:21:20.668858 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4393/8846] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:21:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:21:20.784732 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719db3ff-f992-4b25-9b88-8b198b3e5624 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:21:20.784941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719db3ff-f992-4b25-9b88-8b198b3e5624 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:21:20.785262 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719db3ff-f992-4b25-9b88-8b198b3e5624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:21:20.815092 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-719db3ff-f992-4b25-9b88-8b198b3e5624 None None] MFA Rules not processed for user `a065cd54fd8745ca99f35405c711ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:21:20.816313 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-719db3ff-f992-4b25-9b88-8b198b3e5624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:21:20.826470 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4454/8847] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Oct 16 02:21:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:21:20.838693 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f459a-4bc3-47ce-a0aa-00e6ee4ef926 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:21:20.848325 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f459a-4bc3-47ce-a0aa-00e6ee4ef926 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:21:20.854990 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7471f58-78a5-4f34-b25b-88dfcb600b20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:21:20.855699 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7471f58-78a5-4f34-b25b-88dfcb600b20 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:21:20.856015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7471f58-78a5-4f34-b25b-88dfcb600b20 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:21:20.856292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7471f58-78a5-4f34-b25b-88dfcb600b20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:21:20.867725 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7471f58-78a5-4f34-b25b-88dfcb600b20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:21:20.869161 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7471f58-78a5-4f34-b25b-88dfcb600b20 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:21:20.880951 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4394/8848] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:21:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:21:20.947718 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719db3ff-f992-4b25-9b88-8b198b3e5624 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:21:20.957661 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719db3ff-f992-4b25-9b88-8b198b3e5624 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:21:20.961203 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31769-0db1-4fdf-b5f3-61117960d015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:21:20.961794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31769-0db1-4fdf-b5f3-61117960d015 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:21:20.962073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31769-0db1-4fdf-b5f3-61117960d015 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:21:20.962345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31769-0db1-4fdf-b5f3-61117960d015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:21:20.964169 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-13f31769-0db1-4fdf-b5f3-61117960d015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:21:20.973980 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f31769-0db1-4fdf-b5f3-61117960d015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:21:20.975435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f31769-0db1-4fdf-b5f3-61117960d015 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:21:20.983915 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4455/8849] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:21:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:21:21.059481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7471f58-78a5-4f34-b25b-88dfcb600b20 service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:21:21.069701 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7471f58-78a5-4f34-b25b-88dfcb600b20 service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:21:21.073489 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2f744-e695-4dd8-b865-5a0871c80d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:21:21.074075 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2f744-e695-4dd8-b865-5a0871c80d94 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:21:21.074358 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2f744-e695-4dd8-b865-5a0871c80d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:21:21.074654 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2f744-e695-4dd8-b865-5a0871c80d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:21:21.076453 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-71e2f744-e695-4dd8-b865-5a0871c80d94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:21:21.090079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2f744-e695-4dd8-b865-5a0871c80d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:21:21.091551 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2f744-e695-4dd8-b865-5a0871c80d94 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:21:21.103148 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4395/8850] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:21:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:21:21.171777 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31769-0db1-4fdf-b5f3-61117960d015 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:21:21.184582 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31769-0db1-4fdf-b5f3-61117960d015 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:21:21.190690 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8af04-4957-481f-975f-3c7db39c48c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:21:21.191432 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8af04-4957-481f-975f-3c7db39c48c4 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:21:21.191778 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8af04-4957-481f-975f-3c7db39c48c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:21:21.192112 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8af04-4957-481f-975f-3c7db39c48c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:21:21.194147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-adb8af04-4957-481f-975f-3c7db39c48c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:21:21.206523 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8af04-4957-481f-975f-3c7db39c48c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:21:21.208266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8af04-4957-481f-975f-3c7db39c48c4 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:21:21.220540 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4456/8851] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:21:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:21:22.800544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae7b0-dfeb-4a7f-a724-104d9f6ad32c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:21:22.801023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae7b0-dfeb-4a7f-a724-104d9f6ad32c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:21:22.801135 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae7b0-dfeb-4a7f-a724-104d9f6ad32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:21:22.821138 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bc2ae7b0-dfeb-4a7f-a724-104d9f6ad32c None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:21:22.822329 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bc2ae7b0-dfeb-4a7f-a724-104d9f6ad32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:21:22.829599 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4396/8852] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 02:21:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:21:22.842195 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8af04-4957-481f-975f-3c7db39c48c4 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:21:22.853031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8af04-4957-481f-975f-3c7db39c48c4 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:21:22.859004 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a89c9-e64b-4b04-a1ca-448d566b9317 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:21:22.859586 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a89c9-e64b-4b04-a1ca-448d566b9317 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:21:22.859860 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a89c9-e64b-4b04-a1ca-448d566b9317 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:21:22.860128 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a89c9-e64b-4b04-a1ca-448d566b9317 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:21:22.867979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a89c9-e64b-4b04-a1ca-448d566b9317 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:21:22.869540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a89c9-e64b-4b04-a1ca-448d566b9317 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:21:22.877898 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4457/8853] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:21:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:21:32.816152 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=26 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:21:32.874708 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=35 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:21:36.574728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0088048-997e-49d0-8cb9-7c6e34a82234 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:21:36.576379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0088048-997e-49d0-8cb9-7c6e34a82234 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:21:36.576769 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0088048-997e-49d0-8cb9-7c6e34a82234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:21:36.596368 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a0088048-997e-49d0-8cb9-7c6e34a82234 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:21:36.597574 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a0088048-997e-49d0-8cb9-7c6e34a82234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:21:36.604775 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4397/8854] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 02:21:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:21:36.617171 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a89c9-e64b-4b04-a1ca-448d566b9317 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:21:36.628465 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a89c9-e64b-4b04-a1ca-448d566b9317 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:21:36.633444 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad9044-f3c3-45a7-b278-4dc7247ba89d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:21:36.634030 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad9044-f3c3-45a7-b278-4dc7247ba89d service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:21:36.634308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad9044-f3c3-45a7-b278-4dc7247ba89d service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:21:36.634580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad9044-f3c3-45a7-b278-4dc7247ba89d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:21:36.643402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad9044-f3c3-45a7-b278-4dc7247ba89d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:21:36.644972 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad9044-f3c3-45a7-b278-4dc7247ba89d service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:21:36.653045 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4458/8855] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:21:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:21:46.591679 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:21:46.649678 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:22:08.378490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0088048-997e-49d0-8cb9-7c6e34a82234 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:22:08.388521 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0088048-997e-49d0-8cb9-7c6e34a82234 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:22:08.392081 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be719b3-579b-4e91-850d-2c16ecdc9536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:22:08.392671 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be719b3-579b-4e91-850d-2c16ecdc9536 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:22:08.392945 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be719b3-579b-4e91-850d-2c16ecdc9536 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:22:08.393210 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be719b3-579b-4e91-850d-2c16ecdc9536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:22:08.395046 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0be719b3-579b-4e91-850d-2c16ecdc9536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:22:08.404754 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be719b3-579b-4e91-850d-2c16ecdc9536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:22:08.406168 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be719b3-579b-4e91-850d-2c16ecdc9536 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:22:08.413900 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4398/8856] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:22:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:22:18.410455 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:22:27.834398 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad9044-f3c3-45a7-b278-4dc7247ba89d service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:22:27.846223 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad9044-f3c3-45a7-b278-4dc7247ba89d service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:22:27.851232 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ecd11-bb8a-42c7-9f38-974ae01a2e59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:22:27.851820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ecd11-bb8a-42c7-9f38-974ae01a2e59 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:22:27.852098 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ecd11-bb8a-42c7-9f38-974ae01a2e59 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:22:27.852385 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ecd11-bb8a-42c7-9f38-974ae01a2e59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:22:27.854087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6d2ecd11-bb8a-42c7-9f38-974ae01a2e59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:22:27.877164 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ecd11-bb8a-42c7-9f38-974ae01a2e59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:22:27.878730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ecd11-bb8a-42c7-9f38-974ae01a2e59 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:22:27.888906 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4459/8857] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:22:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:22:37.884302 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=11 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:22:48.181445 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be719b3-579b-4e91-850d-2c16ecdc9536 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:22:48.196608 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be719b3-579b-4e91-850d-2c16ecdc9536 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:22:48.203027 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c7461-3f37-4052-a054-006fc816293f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:22:48.203649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c7461-3f37-4052-a054-006fc816293f service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:22:48.203988 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c7461-3f37-4052-a054-006fc816293f service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:22:48.204268 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c7461-3f37-4052-a054-006fc816293f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:22:48.206079 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-034c7461-3f37-4052-a054-006fc816293f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:22:48.218858 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c7461-3f37-4052-a054-006fc816293f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:22:48.220487 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c7461-3f37-4052-a054-006fc816293f service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:22:48.232209 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4399/8858] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:22:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:22:50.199812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ecd11-bb8a-42c7-9f38-974ae01a2e59 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:22:50.213882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ecd11-bb8a-42c7-9f38-974ae01a2e59 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:22:50.220304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c31c09-61a9-4be1-b411-ec86d9e5ff30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:22:50.220990 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c31c09-61a9-4be1-b411-ec86d9e5ff30 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:22:50.221427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c31c09-61a9-4be1-b411-ec86d9e5ff30 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:22:50.221580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c31c09-61a9-4be1-b411-ec86d9e5ff30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:22:50.223583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-01c31c09-61a9-4be1-b411-ec86d9e5ff30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:22:50.236512 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c31c09-61a9-4be1-b411-ec86d9e5ff30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:22:50.238087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c31c09-61a9-4be1-b411-ec86d9e5ff30 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:22:50.248781 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4460/8859] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:22:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:22:53.004292 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62910a4-6f19-44e9-9302-628be5d3116a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:22:53.004808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62910a4-6f19-44e9-9302-628be5d3116a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:22:53.004925 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62910a4-6f19-44e9-9302-628be5d3116a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:22:53.024384 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d62910a4-6f19-44e9-9302-628be5d3116a None None] MFA Rules not processed for user `111c47d7a44f48559e9e22d25677d6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:22:53.025582 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d62910a4-6f19-44e9-9302-628be5d3116a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:22:53.032588 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4400/8860] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:22:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:23:00.244286 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:23:03.019488 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=9 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:23:11.023562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c31c09-61a9-4be1-b411-ec86d9e5ff30 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:23:11.034987 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c31c09-61a9-4be1-b411-ec86d9e5ff30 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:23:11.039064 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb1cb9-fea3-4676-bcdc-70cfb8fe0375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:23:11.039701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb1cb9-fea3-4676-bcdc-70cfb8fe0375 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:23:11.039985 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb1cb9-fea3-4676-bcdc-70cfb8fe0375 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:23:11.040264 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb1cb9-fea3-4676-bcdc-70cfb8fe0375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:23:11.042554 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-afdb1cb9-fea3-4676-bcdc-70cfb8fe0375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:23:11.057184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb1cb9-fea3-4676-bcdc-70cfb8fe0375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:23:11.059308 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb1cb9-fea3-4676-bcdc-70cfb8fe0375 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:23:11.068948 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4461/8861] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:23:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:23:21.064424 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:23:26.974362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62910a4-6f19-44e9-9302-628be5d3116a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:23:26.989705 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62910a4-6f19-44e9-9302-628be5d3116a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:23:26.995985 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d3609-42d2-4705-9932-67ed0f04a64b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:23:26.996711 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3609-42d2-4705-9932-67ed0f04a64b service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:23:26.996997 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3609-42d2-4705-9932-67ed0f04a64b service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:23:26.997269 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3609-42d2-4705-9932-67ed0f04a64b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:23:26.999022 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b30d3609-42d2-4705-9932-67ed0f04a64b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:23:27.011557 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d3609-42d2-4705-9932-67ed0f04a64b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:23:27.013160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d3609-42d2-4705-9932-67ed0f04a64b service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:23:27.025396 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4401/8862] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:23:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:23:37.020326 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:25:28.503130 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb1cb9-fea3-4676-bcdc-70cfb8fe0375 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:25:28.524540 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb1cb9-fea3-4676-bcdc-70cfb8fe0375 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:25:28.531127 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bddab-911f-4dfc-9a1b-4aa078de19dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:25:28.531757 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bddab-911f-4dfc-9a1b-4aa078de19dd service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:25:28.532040 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bddab-911f-4dfc-9a1b-4aa078de19dd service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:25:28.532311 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bddab-911f-4dfc-9a1b-4aa078de19dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:25:28.540271 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bddab-911f-4dfc-9a1b-4aa078de19dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:25:28.541885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bddab-911f-4dfc-9a1b-4aa078de19dd service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:25:28.552290 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4462/8863] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:25:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:25:28.740158 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d3609-42d2-4705-9932-67ed0f04a64b service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:25:28.750019 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d3609-42d2-4705-9932-67ed0f04a64b service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:25:28.754717 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed91fb9-e8a7-4bec-8b93-ddbcdbae4cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:25:28.755377 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed91fb9-e8a7-4bec-8b93-ddbcdbae4cdc service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:25:28.755668 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed91fb9-e8a7-4bec-8b93-ddbcdbae4cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:25:28.756430 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed91fb9-e8a7-4bec-8b93-ddbcdbae4cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:25:28.771132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed91fb9-e8a7-4bec-8b93-ddbcdbae4cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:25:28.772696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed91fb9-e8a7-4bec-8b93-ddbcdbae4cdc service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:25:28.788509 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4402/8864] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:25:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:25:29.991743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bddab-911f-4dfc-9a1b-4aa078de19dd service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:25:30.001728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bddab-911f-4dfc-9a1b-4aa078de19dd service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:25:30.005378 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2480-9d1d-4b7a-ae83-db218d98c4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:25:30.005967 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2480-9d1d-4b7a-ae83-db218d98c4fa service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:25:30.006249 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2480-9d1d-4b7a-ae83-db218d98c4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:25:30.006521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2480-9d1d-4b7a-ae83-db218d98c4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:25:30.016657 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc2480-9d1d-4b7a-ae83-db218d98c4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:25:30.018073 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc2480-9d1d-4b7a-ae83-db218d98c4fa service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:25:30.028972 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4463/8865] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:25:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:25:38.782506 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:25:40.024108 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=15 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:26:30.621740 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed91fb9-e8a7-4bec-8b93-ddbcdbae4cdc service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:26:30.633012 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed91fb9-e8a7-4bec-8b93-ddbcdbae4cdc service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:26:30.639237 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a3af0-0746-4230-9638-7c0583a5fa2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:26:30.639823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a3af0-0746-4230-9638-7c0583a5fa2b service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:26:30.640098 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a3af0-0746-4230-9638-7c0583a5fa2b service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:26:30.640367 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a3af0-0746-4230-9638-7c0583a5fa2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:26:30.648937 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a3af0-0746-4230-9638-7c0583a5fa2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:26:30.650502 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a3af0-0746-4230-9638-7c0583a5fa2b service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:26:30.661063 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4403/8866] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:26:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:26:40.657323 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:15.147307 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2480-9d1d-4b7a-ae83-db218d98c4fa service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:15.155804 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2480-9d1d-4b7a-ae83-db218d98c4fa service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:15.160583 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e02650-90e9-41de-a98d-4c42317010d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:15.161402 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e02650-90e9-41de-a98d-4c42317010d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:15.161705 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e02650-90e9-41de-a98d-4c42317010d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:15.161979 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e02650-90e9-41de-a98d-4c42317010d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:15.169145 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e02650-90e9-41de-a98d-4c42317010d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:15.170566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e02650-90e9-41de-a98d-4c42317010d4 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:15.178798 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4464/8867] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:27:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:27:25.175454 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:27.531305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a3af0-0746-4230-9638-7c0583a5fa2b service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:27.544520 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a3af0-0746-4230-9638-7c0583a5fa2b service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:27.548723 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d56fd5-566b-4026-9f63-7243daadbc18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:27.549414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d56fd5-566b-4026-9f63-7243daadbc18 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:27.549763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d56fd5-566b-4026-9f63-7243daadbc18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:27.550101 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d56fd5-566b-4026-9f63-7243daadbc18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:27.614576 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d56fd5-566b-4026-9f63-7243daadbc18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:27.616041 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d56fd5-566b-4026-9f63-7243daadbc18 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:27.625705 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4404/8868] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:27:29.829599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e02650-90e9-41de-a98d-4c42317010d4 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:29.848615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e02650-90e9-41de-a98d-4c42317010d4 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:29.854600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d87806-5e99-4168-add2-37c6c53ca2e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:29.855533 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d87806-5e99-4168-add2-37c6c53ca2e7 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:29.856003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d87806-5e99-4168-add2-37c6c53ca2e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:29.856482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d87806-5e99-4168-add2-37c6c53ca2e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:29.869134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d87806-5e99-4168-add2-37c6c53ca2e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:29.871087 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d87806-5e99-4168-add2-37c6c53ca2e7 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:29.886275 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4465/8869] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:27:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:27:31.126106 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d56fd5-566b-4026-9f63-7243daadbc18 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:31.139343 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d56fd5-566b-4026-9f63-7243daadbc18 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:31.145808 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fbfd6-a819-4410-9466-003ade1673cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:31.146538 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fbfd6-a819-4410-9466-003ade1673cc service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:31.146965 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fbfd6-a819-4410-9466-003ade1673cc service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:31.147449 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fbfd6-a819-4410-9466-003ade1673cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:31.149334 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6b9fbfd6-a819-4410-9466-003ade1673cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:31.167180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fbfd6-a819-4410-9466-003ade1673cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:31.169065 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fbfd6-a819-4410-9466-003ade1673cc service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:31.183631 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4405/8870] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:27:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:27:34.196644 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d87806-5e99-4168-add2-37c6c53ca2e7 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:34.211034 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d87806-5e99-4168-add2-37c6c53ca2e7 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:34.224518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:34.225160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:34.225439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:34.225714 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] PATH_INFO: `/v3/users/111c47d7a44f48559e9e22d25677d6dd` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:34.226871 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] RBAC: Authorizing `identity:delete_user(user_id=111c47d7a44f48559e9e22d25677d6dd)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:34.228819 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:34.280044 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111c47d7a44f48559e9e22d25677d6dd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:34.282049 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111c47d7a44f48559e9e22d25677d6dd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:34.298977 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111c47d7a44f48559e9e22d25677d6dd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:34.307105 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111c47d7a44f48559e9e22d25677d6dd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:34.307713 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111c47d7a44f48559e9e22d25677d6dd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:34.320368 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4466/8871] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:27:34 2022] DELETE /identity/v3/users/111c47d7a44f48559e9e22d25677d6dd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:27:34.787231 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fbfd6-a819-4410-9466-003ade1673cc service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:34.800344 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fbfd6-a819-4410-9466-003ade1673cc service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:34.859132 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:34.859880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:34.860193 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:34.860491 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] PATH_INFO: `/v3/projects/6e75b1540be246fb9be6572513050082` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:34.861610 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e75b1540be246fb9be6572513050082)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:34.863556 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:34.909360 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e75b1540be246fb9be6572513050082', 'request_id': 'req-670d9526-73a3-44ce-a995-1323d41dfe19'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:34.915378 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e75b1540be246fb9be6572513050082', 'request_id': 'req-670d9526-73a3-44ce-a995-1323d41dfe19'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:34.922403 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e75b1540be246fb9be6572513050082', 'request_id': 'req-670d9526-73a3-44ce-a995-1323d41dfe19'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:34.932537 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] The token cache is being invalidate because project 6e75b1540be246fb9be6572513050082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:27:34.932823 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:34.933451 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:34.934949 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4406/8872] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:27:34 2022] DELETE /identity/v3/projects/6e75b1540be246fb9be6572513050082 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:27:34.939521 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:34.940910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:34.954882 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a42ac8-3f8a-4516-ab29-a4d076ba486d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:35.011302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f9bb4-2778-412c-8748-b575144ddb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:35.011941 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f9bb4-2778-412c-8748-b575144ddb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:35.012222 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f9bb4-2778-412c-8748-b575144ddb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:35.012498 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f9bb4-2778-412c-8748-b575144ddb44 admin admin] PATH_INFO: `/v3/users/c0821003a8804069a9321022d4623ec7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:35.013638 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f9bb4-2778-412c-8748-b575144ddb44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0821003a8804069a9321022d4623ec7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:35.015600 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f9bb4-2778-412c-8748-b575144ddb44 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:35.062564 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-812f9bb4-2778-412c-8748-b575144ddb44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0821003a8804069a9321022d4623ec7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:35.063270 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-812f9bb4-2778-412c-8748-b575144ddb44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0821003a8804069a9321022d4623ec7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:35.074211 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:35.076848 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-812f9bb4-2778-412c-8748-b575144ddb44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0821003a8804069a9321022d4623ec7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:35.085199 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-812f9bb4-2778-412c-8748-b575144ddb44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0821003a8804069a9321022d4623ec7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:35.086109 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-812f9bb4-2778-412c-8748-b575144ddb44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0821003a8804069a9321022d4623ec7'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:35.099504 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4467/8873] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:27:34 2022] DELETE /identity/v3/users/c0821003a8804069a9321022d4623ec7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:27:35.273205 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:35.274831 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:35.295089 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d9526-73a3-44ce-a995-1323d41dfe19 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:35.303815 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:35.355620 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78241e-7735-4499-a4f0-65ec5ac053dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:35.356174 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78241e-7735-4499-a4f0-65ec5ac053dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:35.356452 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78241e-7735-4499-a4f0-65ec5ac053dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:35.356721 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78241e-7735-4499-a4f0-65ec5ac053dd admin admin] PATH_INFO: `/v3/projects/daa91bc600244a82b5faab773ef373cf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:35.358100 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78241e-7735-4499-a4f0-65ec5ac053dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa91bc600244a82b5faab773ef373cf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:35.360180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78241e-7735-4499-a4f0-65ec5ac053dd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:35.405659 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e78241e-7735-4499-a4f0-65ec5ac053dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa91bc600244a82b5faab773ef373cf', 'request_id': 'req-9e78241e-7735-4499-a4f0-65ec5ac053dd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:35.412542 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e78241e-7735-4499-a4f0-65ec5ac053dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa91bc600244a82b5faab773ef373cf', 'request_id': 'req-9e78241e-7735-4499-a4f0-65ec5ac053dd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:35.419438 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e78241e-7735-4499-a4f0-65ec5ac053dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa91bc600244a82b5faab773ef373cf', 'request_id': 'req-9e78241e-7735-4499-a4f0-65ec5ac053dd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:35.430416 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e78241e-7735-4499-a4f0-65ec5ac053dd admin admin] The token cache is being invalidate because project daa91bc600244a82b5faab773ef373cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:27:35.430706 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e78241e-7735-4499-a4f0-65ec5ac053dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:35.431364 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9e78241e-7735-4499-a4f0-65ec5ac053dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:27:35.432837 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4407/8874] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:27:35 2022] DELETE /identity/v3/projects/daa91bc600244a82b5faab773ef373cf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:27:35.437963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11832f7e-1f0f-4c4d-9343-c9bbe6487744 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:35.438562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11832f7e-1f0f-4c4d-9343-c9bbe6487744 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:35.438562 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11832f7e-1f0f-4c4d-9343-c9bbe6487744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:35.458783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-11832f7e-1f0f-4c4d-9343-c9bbe6487744 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:27:35.460067 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-11832f7e-1f0f-4c4d-9343-c9bbe6487744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:35.522775 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4468/8875] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:27:35.531844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95fcc4-fc4c-4991-a15d-5ab1df36abd0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:35.531844 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95fcc4-fc4c-4991-a15d-5ab1df36abd0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:35.532153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95fcc4-fc4c-4991-a15d-5ab1df36abd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:35.552389 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1f95fcc4-fc4c-4991-a15d-5ab1df36abd0 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:27:35.553587 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1f95fcc4-fc4c-4991-a15d-5ab1df36abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:35.562200 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4408/8876] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:27:35.567462 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11832f7e-1f0f-4c4d-9343-c9bbe6487744 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:35.577384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11832f7e-1f0f-4c4d-9343-c9bbe6487744 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:35.582111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86ee5f-c474-4fc8-bfe3-4db4d9632ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:35.582699 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86ee5f-c474-4fc8-bfe3-4db4d9632ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:35.583011 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86ee5f-c474-4fc8-bfe3-4db4d9632ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:35.583287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86ee5f-c474-4fc8-bfe3-4db4d9632ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:35.583924 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86ee5f-c474-4fc8-bfe3-4db4d9632ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 02:27:35.584229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86ee5f-c474-4fc8-bfe3-4db4d9632ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:35.585812 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86ee5f-c474-4fc8-bfe3-4db4d9632ae3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:35.597386 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4469/8877] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Oct 16 02:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 02:27:35.601687 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95fcc4-fc4c-4991-a15d-5ab1df36abd0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:35.611611 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95fcc4-fc4c-4991-a15d-5ab1df36abd0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:35.616420 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd254d0-0274-480e-96ae-ff99ba106a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:35.617050 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd254d0-0274-480e-96ae-ff99ba106a52 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:35.617326 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd254d0-0274-480e-96ae-ff99ba106a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:35.617595 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd254d0-0274-480e-96ae-ff99ba106a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:35.618218 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd254d0-0274-480e-96ae-ff99ba106a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:35.620137 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd254d0-0274-480e-96ae-ff99ba106a52 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:35.649436 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4409/8878] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 02:27:35 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:27:35.653674 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86ee5f-c474-4fc8-bfe3-4db4d9632ae3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:35.664276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86ee5f-c474-4fc8-bfe3-4db4d9632ae3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:35.722182 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2b843-71b0-4f89-851b-8e61d0621c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:35.722790 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2b843-71b0-4f89-851b-8e61d0621c2e admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:35.723217 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2b843-71b0-4f89-851b-8e61d0621c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:35.723494 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2b843-71b0-4f89-851b-8e61d0621c2e admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:35.724134 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2b843-71b0-4f89-851b-8e61d0621c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:35.726042 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2b843-71b0-4f89-851b-8e61d0621c2e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:35.746749 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4470/8879] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 02:27:35 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:27:35.751585 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd254d0-0274-480e-96ae-ff99ba106a52 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:35.761910 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd254d0-0274-480e-96ae-ff99ba106a52 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:35.767422 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e4e25-6580-445a-b213-af93a88af8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:35.768017 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e4e25-6580-445a-b213-af93a88af8dd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:35.768296 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e4e25-6580-445a-b213-af93a88af8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:35.768568 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e4e25-6580-445a-b213-af93a88af8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:35.769199 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e4e25-6580-445a-b213-af93a88af8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:35.770784 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e4e25-6580-445a-b213-af93a88af8dd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:35.780894 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4410/8880] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:27:35.784794 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2b843-71b0-4f89-851b-8e61d0621c2e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:35.795053 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2b843-71b0-4f89-851b-8e61d0621c2e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:35.799816 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bb93f-7cd4-4bc4-b70e-a0d1473a1925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:35.800403 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bb93f-7cd4-4bc4-b70e-a0d1473a1925 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:35.800685 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bb93f-7cd4-4bc4-b70e-a0d1473a1925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:35.800962 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bb93f-7cd4-4bc4-b70e-a0d1473a1925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:35.801593 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bb93f-7cd4-4bc4-b70e-a0d1473a1925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:35.803229 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bb93f-7cd4-4bc4-b70e-a0d1473a1925 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:35.815674 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4471/8881] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:27:35.819964 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e4e25-6580-445a-b213-af93a88af8dd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:35.831099 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e4e25-6580-445a-b213-af93a88af8dd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:35.835680 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0bbf2-c325-46a2-888f-6512d5c746a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:35.836319 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0bbf2-c325-46a2-888f-6512d5c746a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:35.836596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0bbf2-c325-46a2-888f-6512d5c746a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:35.836867 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0bbf2-c325-46a2-888f-6512d5c746a5 admin admin] PATH_INFO: `/v3/projects/7a6d6fcb1d6e4c27ad3094f19f63947a/users/a5fafb3514414163a106f10d800bacfb/roles/b432183c244e40e0be2fdb9f5c438e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:35.852018 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0bbf2-c325-46a2-888f-6512d5c746a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6d6fcb1d6e4c27ad3094f19f63947a, user_id=a5fafb3514414163a106f10d800bacfb, role_id=b432183c244e40e0be2fdb9f5c438e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:35.854686 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0bbf2-c325-46a2-888f-6512d5c746a5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:35.869237 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4411/8882] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:27:35 2022] PUT /identity/v3/projects/7a6d6fcb1d6e4c27ad3094f19f63947a/users/a5fafb3514414163a106f10d800bacfb/roles/b432183c244e40e0be2fdb9f5c438e77 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:27:35.874823 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d184cd5-9601-43c0-aa79-cb4be982e586 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:35.875304 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d184cd5-9601-43c0-aa79-cb4be982e586 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:35.875599 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d184cd5-9601-43c0-aa79-cb4be982e586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:35.894989 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0d184cd5-9601-43c0-aa79-cb4be982e586 None None] MFA Rules not processed for user `1fe17027043247a5ba6d4296eb07bb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:27:35.896192 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0d184cd5-9601-43c0-aa79-cb4be982e586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:35.936534 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:35.957846 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4472/8883] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:27:35.967676 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0bbf2-c325-46a2-888f-6512d5c746a5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:35.969954 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fcf0bbf2-c325-46a2-888f-6512d5c746a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:36.012539 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:36.029887 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0bbf2-c325-46a2-888f-6512d5c746a5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:36.034241 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf912cc-8f62-4729-83f3-7ff4756df7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:36.034842 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf912cc-8f62-4729-83f3-7ff4756df7bf service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:36.035144 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf912cc-8f62-4729-83f3-7ff4756df7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:36.035414 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf912cc-8f62-4729-83f3-7ff4756df7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:36.044544 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf912cc-8f62-4729-83f3-7ff4756df7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:36.045957 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf912cc-8f62-4729-83f3-7ff4756df7bf service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:36.055766 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4412/8884] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:27:40.029427 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3677b0-c1e3-4ee4-9bfb-90d69b9913c5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:40.030026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3677b0-c1e3-4ee4-9bfb-90d69b9913c5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:40.030026 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3677b0-c1e3-4ee4-9bfb-90d69b9913c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:40.062409 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8e3677b0-c1e3-4ee4-9bfb-90d69b9913c5 None None] MFA Rules not processed for user `a5fafb3514414163a106f10d800bacfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:27:40.063745 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8e3677b0-c1e3-4ee4-9bfb-90d69b9913c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:40.135816 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4473/8885] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:27:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:27:40.141119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf912cc-8f62-4729-83f3-7ff4756df7bf service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:40.151178 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf912cc-8f62-4729-83f3-7ff4756df7bf service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:40.157356 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d3a8e-bd9c-4dca-ab2f-a5c949b5c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:40.157979 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d3a8e-bd9c-4dca-ab2f-a5c949b5c199 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:40.158263 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d3a8e-bd9c-4dca-ab2f-a5c949b5c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:40.158539 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d3a8e-bd9c-4dca-ab2f-a5c949b5c199 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:40.159206 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d3a8e-bd9c-4dca-ab2f-a5c949b5c199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:40.161139 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d3a8e-bd9c-4dca-ab2f-a5c949b5c199 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:40.190707 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4413/8886] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Oct 16 02:27:40 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:27:40.195111 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3677b0-c1e3-4ee4-9bfb-90d69b9913c5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:40.209220 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3677b0-c1e3-4ee4-9bfb-90d69b9913c5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:40.269528 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9071e-a9cb-4a79-a829-063034dc15f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:40.270146 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9071e-a9cb-4a79-a829-063034dc15f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:40.270428 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9071e-a9cb-4a79-a829-063034dc15f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:40.270707 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9071e-a9cb-4a79-a829-063034dc15f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:40.272022 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9071e-a9cb-4a79-a829-063034dc15f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:40.274003 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9071e-a9cb-4a79-a829-063034dc15f2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:40.299678 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4474/8887] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Oct 16 02:27:40 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 02:27:40.300879 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d3a8e-bd9c-4dca-ab2f-a5c949b5c199 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:40.311737 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d3a8e-bd9c-4dca-ab2f-a5c949b5c199 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:40.318026 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f57c7c-1a5f-4008-834f-145f75289114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:40.318646 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f57c7c-1a5f-4008-834f-145f75289114 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:40.318951 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f57c7c-1a5f-4008-834f-145f75289114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:40.319248 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f57c7c-1a5f-4008-834f-145f75289114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:40.319891 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f57c7c-1a5f-4008-834f-145f75289114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:40.321500 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f57c7c-1a5f-4008-834f-145f75289114 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:40.333912 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4414/8888] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:27:40.337749 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9071e-a9cb-4a79-a829-063034dc15f2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:40.348865 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9071e-a9cb-4a79-a829-063034dc15f2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:40.353639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506233be-b5b7-4cc7-8eb3-10c7fe65576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:40.354302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506233be-b5b7-4cc7-8eb3-10c7fe65576d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:40.354587 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506233be-b5b7-4cc7-8eb3-10c7fe65576d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:40.354862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506233be-b5b7-4cc7-8eb3-10c7fe65576d admin admin] PATH_INFO: `/v3/projects/070043e8968b4321be4c05af70286d5e/users/9d15a9ea45b943cebd016137e114d0db/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:40.370764 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506233be-b5b7-4cc7-8eb3-10c7fe65576d admin admin] RBAC: Authorizing `identity:create_grant(project_id=070043e8968b4321be4c05af70286d5e, user_id=9d15a9ea45b943cebd016137e114d0db, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:40.373459 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506233be-b5b7-4cc7-8eb3-10c7fe65576d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:40.388010 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4475/8889] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:27:40 2022] PUT /identity/v3/projects/070043e8968b4321be4c05af70286d5e/users/9d15a9ea45b943cebd016137e114d0db/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 02:27:40.392532 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f57c7c-1a5f-4008-834f-145f75289114 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:40.403117 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f57c7c-1a5f-4008-834f-145f75289114 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:40.463696 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092c618-89e6-4e1b-8edd-26b51a7d6cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:40.464316 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092c618-89e6-4e1b-8edd-26b51a7d6cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:40.464596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092c618-89e6-4e1b-8edd-26b51a7d6cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:40.464870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092c618-89e6-4e1b-8edd-26b51a7d6cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:40.465534 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092c618-89e6-4e1b-8edd-26b51a7d6cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:40.467180 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092c618-89e6-4e1b-8edd-26b51a7d6cdb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:40.478356 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4415/8890] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 02:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 02:27:40.482566 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506233be-b5b7-4cc7-8eb3-10c7fe65576d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:40.493901 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506233be-b5b7-4cc7-8eb3-10c7fe65576d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:40.498598 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089dbc2-2a7d-4f7c-815f-e10644538c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:40.499301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089dbc2-2a7d-4f7c-815f-e10644538c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:40.499579 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089dbc2-2a7d-4f7c-815f-e10644538c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:40.499855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089dbc2-2a7d-4f7c-815f-e10644538c86 admin admin] PATH_INFO: `/v3/projects/070043e8968b4321be4c05af70286d5e/users/9d15a9ea45b943cebd016137e114d0db/roles/3b2c8c93a1c54611871c4299008b2abf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:40.502259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089dbc2-2a7d-4f7c-815f-e10644538c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070043e8968b4321be4c05af70286d5e, user_id=9d15a9ea45b943cebd016137e114d0db, role_id=3b2c8c93a1c54611871c4299008b2abf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:40.504971 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089dbc2-2a7d-4f7c-815f-e10644538c86 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:40.516427 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4476/8891] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Oct 16 02:27:40 2022] PUT /identity/v3/projects/070043e8968b4321be4c05af70286d5e/users/9d15a9ea45b943cebd016137e114d0db/roles/3b2c8c93a1c54611871c4299008b2abf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:27:45.576767 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc50493-06a1-4b8d-b739-3fdcf11b15c2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:45.577267 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc50493-06a1-4b8d-b739-3fdcf11b15c2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:45.577382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc50493-06a1-4b8d-b739-3fdcf11b15c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:45.612624 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0bc50493-06a1-4b8d-b739-3fdcf11b15c2 None None] MFA Rules not processed for user `9d15a9ea45b943cebd016137e114d0db`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:27:45.613864 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0bc50493-06a1-4b8d-b739-3fdcf11b15c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:45.695744 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4416/8892] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:27:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:27:45.717633 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089dbc2-2a7d-4f7c-815f-e10644538c86 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:45.720481 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8089dbc2-2a7d-4f7c-815f-e10644538c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:45.778262 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:45.862162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089dbc2-2a7d-4f7c-815f-e10644538c86 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:45.872408 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c79487-4cf8-41b9-90b5-1ddd26c11464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:45.873292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c79487-4cf8-41b9-90b5-1ddd26c11464 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:45.873438 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c79487-4cf8-41b9-90b5-1ddd26c11464 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:45.873656 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c79487-4cf8-41b9-90b5-1ddd26c11464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:45.933904 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c79487-4cf8-41b9-90b5-1ddd26c11464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:45.935722 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c79487-4cf8-41b9-90b5-1ddd26c11464 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:45.946661 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4477/8893] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:27:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:27:46.952045 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f81692-f862-4919-b35b-1b70bc52fe31 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:46.953508 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f81692-f862-4919-b35b-1b70bc52fe31 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:46.954093 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f81692-f862-4919-b35b-1b70bc52fe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:46.976682 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a7f81692-f862-4919-b35b-1b70bc52fe31 None None] MFA Rules not processed for user `a5fafb3514414163a106f10d800bacfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:27:46.978131 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a7f81692-f862-4919-b35b-1b70bc52fe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:46.986366 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4417/8894] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:27:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:27:47.315779 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c79487-4cf8-41b9-90b5-1ddd26c11464 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:47.317480 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-44c79487-4cf8-41b9-90b5-1ddd26c11464 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:47.379367 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c79487-4cf8-41b9-90b5-1ddd26c11464 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:47.382963 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd94733-74b4-4860-8378-40f714ef920c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:47.383573 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd94733-74b4-4860-8378-40f714ef920c service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:47.383847 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd94733-74b4-4860-8378-40f714ef920c service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:47.384115 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd94733-74b4-4860-8378-40f714ef920c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:47.385820 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bfd94733-74b4-4860-8378-40f714ef920c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:47.396266 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd94733-74b4-4860-8378-40f714ef920c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:47.398124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd94733-74b4-4860-8378-40f714ef920c service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:47.407065 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4478/8895] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:27:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:27:47.771801 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f81692-f862-4919-b35b-1b70bc52fe31 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:47.773226 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a7f81692-f862-4919-b35b-1b70bc52fe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:47.806456 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:47.877692 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f81692-f862-4919-b35b-1b70bc52fe31 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:47.882649 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc05630-05ab-449a-9cd1-ac41e0262b32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:47.883302 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc05630-05ab-449a-9cd1-ac41e0262b32 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:47.883581 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc05630-05ab-449a-9cd1-ac41e0262b32 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:47.883852 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc05630-05ab-449a-9cd1-ac41e0262b32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:47.885926 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3cc05630-05ab-449a-9cd1-ac41e0262b32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:47.898043 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc05630-05ab-449a-9cd1-ac41e0262b32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:47.899663 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc05630-05ab-449a-9cd1-ac41e0262b32 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:47.910198 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4418/8896] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:27:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:27:50.509139 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd94733-74b4-4860-8378-40f714ef920c service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:50.511345 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bfd94733-74b4-4860-8378-40f714ef920c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:50.533147 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd94733-74b4-4860-8378-40f714ef920c service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:50.540124 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32668e29-89e8-4636-b38d-b0f45e55e239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:50.540855 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32668e29-89e8-4636-b38d-b0f45e55e239 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:50.541377 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32668e29-89e8-4636-b38d-b0f45e55e239 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:50.545180 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32668e29-89e8-4636-b38d-b0f45e55e239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:50.550577 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-32668e29-89e8-4636-b38d-b0f45e55e239 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:27:50.565143 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32668e29-89e8-4636-b38d-b0f45e55e239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:50.567287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32668e29-89e8-4636-b38d-b0f45e55e239 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:50.578720 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4479/8897] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:27:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:27:57.905397 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=22 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:59.806993 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc05630-05ab-449a-9cd1-ac41e0262b32 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:27:59.817490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc05630-05ab-449a-9cd1-ac41e0262b32 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:27:59.821119 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4095f4-3fd9-4b2a-a026-6c089ec5433a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:27:59.821728 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4095f4-3fd9-4b2a-a026-6c089ec5433a service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:27:59.822003 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4095f4-3fd9-4b2a-a026-6c089ec5433a service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:27:59.822270 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4095f4-3fd9-4b2a-a026-6c089ec5433a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:27:59.832177 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4095f4-3fd9-4b2a-a026-6c089ec5433a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:27:59.833586 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4095f4-3fd9-4b2a-a026-6c089ec5433a service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:27:59.842787 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4419/8898] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:27:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:28:00.573677 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:28:09.838752 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:30:00.100752 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5b1ba-7ab6-4790-82c5-7894cdbbdd3f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:30:00.101337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5b1ba-7ab6-4790-82c5-7894cdbbdd3f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:30:00.101337 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5b1ba-7ab6-4790-82c5-7894cdbbdd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:30:00.140219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0ec5b1ba-7ab6-4790-82c5-7894cdbbdd3f None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:30:00.141420 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0ec5b1ba-7ab6-4790-82c5-7894cdbbdd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:30:00.216314 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4480/8899] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 02:30:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:30:00.263481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4095f4-3fd9-4b2a-a026-6c089ec5433a service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:30:00.264878 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0a4095f4-3fd9-4b2a-a026-6c089ec5433a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:30:00.363741 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4095f4-3fd9-4b2a-a026-6c089ec5433a service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:30:00.368758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4cd11-b272-49b1-8867-0c1ef07453bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:30:00.369351 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4cd11-b272-49b1-8867-0c1ef07453bb service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:30:00.369626 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4cd11-b272-49b1-8867-0c1ef07453bb service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:30:00.369896 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4cd11-b272-49b1-8867-0c1ef07453bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:30:00.378795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4cd11-b272-49b1-8867-0c1ef07453bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:30:00.380393 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4cd11-b272-49b1-8867-0c1ef07453bb service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:30:00.388192 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4420/8900] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:30:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:30:01.740910 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5b1ba-7ab6-4790-82c5-7894cdbbdd3f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:30:01.772436 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5b1ba-7ab6-4790-82c5-7894cdbbdd3f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:30:01.779364 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69007589-a43f-4f34-a724-5a76b2a1f3a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:30:01.781006 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007589-a43f-4f34-a724-5a76b2a1f3a0 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:30:01.781516 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007589-a43f-4f34-a724-5a76b2a1f3a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:30:01.782021 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007589-a43f-4f34-a724-5a76b2a1f3a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:30:01.785575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-69007589-a43f-4f34-a724-5a76b2a1f3a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:30:01.816386 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69007589-a43f-4f34-a724-5a76b2a1f3a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:30:01.819140 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69007589-a43f-4f34-a724-5a76b2a1f3a0 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:30:01.832295 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4481/8901] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:30:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:30:09.695209 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475009f6-baca-467c-8a00-fe4bd89a812f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:30:09.695724 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475009f6-baca-467c-8a00-fe4bd89a812f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:30:09.695850 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475009f6-baca-467c-8a00-fe4bd89a812f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:30:09.715146 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-475009f6-baca-467c-8a00-fe4bd89a812f None None] MFA Rules not processed for user `a5fafb3514414163a106f10d800bacfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:30:09.716321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-475009f6-baca-467c-8a00-fe4bd89a812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:30:09.723845 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4421/8902] 10.222.0.39 () {58 vars in 958 bytes} [Sun Oct 16 02:30:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:30:10.043102 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69007589-a43f-4f34-a724-5a76b2a1f3a0 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:30:10.062607 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69007589-a43f-4f34-a724-5a76b2a1f3a0 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:30:10.067100 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c8c04-2309-48ef-874e-3f8c27448b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:30:10.067945 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c8c04-2309-48ef-874e-3f8c27448b67 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:30:10.068219 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c8c04-2309-48ef-874e-3f8c27448b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:30:10.068485 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c8c04-2309-48ef-874e-3f8c27448b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:30:10.070193 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-564c8c04-2309-48ef-874e-3f8c27448b67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:30:10.079310 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c8c04-2309-48ef-874e-3f8c27448b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:30:10.081863 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c8c04-2309-48ef-874e-3f8c27448b67 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:30:10.089639 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4482/8903] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:30:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:30:10.424023 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475009f6-baca-467c-8a00-fe4bd89a812f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:30:10.427597 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-475009f6-baca-467c-8a00-fe4bd89a812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:30:10.443835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475009f6-baca-467c-8a00-fe4bd89a812f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:30:10.449305 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768575e5-9b18-4e22-af70-4f04ff656828 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:30:10.449918 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768575e5-9b18-4e22-af70-4f04ff656828 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:30:10.450198 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768575e5-9b18-4e22-af70-4f04ff656828 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:30:10.450471 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768575e5-9b18-4e22-af70-4f04ff656828 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:30:10.452232 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-768575e5-9b18-4e22-af70-4f04ff656828 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:30:10.464159 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768575e5-9b18-4e22-af70-4f04ff656828 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:30:10.465763 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768575e5-9b18-4e22-af70-4f04ff656828 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:30:10.476094 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4422/8904] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:30:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:30:11.973797 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107955b-5d0c-455e-ad26-d1a89323b775 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:30:11.975117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107955b-5d0c-455e-ad26-d1a89323b775 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:30:11.975602 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107955b-5d0c-455e-ad26-d1a89323b775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:30:12.000439 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a107955b-5d0c-455e-ad26-d1a89323b775 None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:30:12.001995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a107955b-5d0c-455e-ad26-d1a89323b775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:30:12.011209 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4483/8905] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 02:30:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:30:12.024425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768575e5-9b18-4e22-af70-4f04ff656828 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:30:12.037114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768575e5-9b18-4e22-af70-4f04ff656828 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:30:12.047623 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52c82b-df9e-4932-af63-9e86c158789c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:30:12.048246 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c82b-df9e-4932-af63-9e86c158789c service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:30:12.048596 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c82b-df9e-4932-af63-9e86c158789c service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:30:12.048884 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c82b-df9e-4932-af63-9e86c158789c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:30:12.058778 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52c82b-df9e-4932-af63-9e86c158789c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:30:12.060428 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52c82b-df9e-4932-af63-9e86c158789c service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:30:12.069516 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4423/8906] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:30:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:30:20.070435 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107955b-5d0c-455e-ad26-d1a89323b775 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:30:20.080580 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107955b-5d0c-455e-ad26-d1a89323b775 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:30:20.084188 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5febed7-4178-4fa4-9030-f3334a5b7076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:30:20.084999 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5febed7-4178-4fa4-9030-f3334a5b7076 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:30:20.085179 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5febed7-4178-4fa4-9030-f3334a5b7076 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:30:20.085414 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5febed7-4178-4fa4-9030-f3334a5b7076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:30:20.087174 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c5febed7-4178-4fa4-9030-f3334a5b7076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:30:20.097702 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5febed7-4178-4fa4-9030-f3334a5b7076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:30:20.099258 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5febed7-4178-4fa4-9030-f3334a5b7076 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:30:20.107145 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4484/8907] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:30:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:30:20.757015 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52c82b-df9e-4932-af63-9e86c158789c service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:30:20.771933 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52c82b-df9e-4932-af63-9e86c158789c service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:30:20.777625 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda3173-99c2-4360-827e-20a9bcefef5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a065cd54fd8745ca99f35405c711ffac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:30:20.778303 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda3173-99c2-4360-827e-20a9bcefef5b service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:30:20.778650 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda3173-99c2-4360-827e-20a9bcefef5b service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:30:20.779094 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda3173-99c2-4360-827e-20a9bcefef5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:30:20.780873 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-acda3173-99c2-4360-827e-20a9bcefef5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:30:20.794694 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda3173-99c2-4360-827e-20a9bcefef5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:30:20.801522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda3173-99c2-4360-827e-20a9bcefef5b service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:30:20.813748 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4424/8908] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:30:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:30:30.103661 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=71 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:30:30.809475 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=67 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:31:36.594018 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5febed7-4178-4fa4-9030-f3334a5b7076 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:31:36.615541 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5febed7-4178-4fa4-9030-f3334a5b7076 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:31:36.620569 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb967cda-3d36-4911-86b2-9d85eff3f138 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:31:36.621153 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb967cda-3d36-4911-86b2-9d85eff3f138 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:31:36.621429 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb967cda-3d36-4911-86b2-9d85eff3f138 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:31:36.621700 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb967cda-3d36-4911-86b2-9d85eff3f138 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:31:36.623460 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bb967cda-3d36-4911-86b2-9d85eff3f138 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:31:36.635787 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb967cda-3d36-4911-86b2-9d85eff3f138 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:31:36.637357 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb967cda-3d36-4911-86b2-9d85eff3f138 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:31:36.647172 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4485/8909] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:31:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:31:46.642904 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=10 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:31:59.561392 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda3173-99c2-4360-827e-20a9bcefef5b service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:31:59.562786 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-acda3173-99c2-4360-827e-20a9bcefef5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:31:59.639467 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda3173-99c2-4360-827e-20a9bcefef5b service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:31:59.643078 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fe8eb-9be9-458a-8969-2358d2ac41f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb30ad752234d8c9f12302b0b69666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:31:59.643675 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe8eb-9be9-458a-8969-2358d2ac41f9 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:31:59.644558 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe8eb-9be9-458a-8969-2358d2ac41f9 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:31:59.644915 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe8eb-9be9-458a-8969-2358d2ac41f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:31:59.646619 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-728fe8eb-9be9-458a-8969-2358d2ac41f9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:31:59.659830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fe8eb-9be9-458a-8969-2358d2ac41f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:31:59.661240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fe8eb-9be9-458a-8969-2358d2ac41f9 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:31:59.672095 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4425/8910] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:31:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:32:03.357209 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86c90d-c8f8-4aaa-b7e9-f4bf4d0b9bea None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:03.357696 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86c90d-c8f8-4aaa-b7e9-f4bf4d0b9bea None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:03.357862 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86c90d-c8f8-4aaa-b7e9-f4bf4d0b9bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:03.414031 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-da86c90d-c8f8-4aaa-b7e9-f4bf4d0b9bea None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:32:03.415260 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-da86c90d-c8f8-4aaa-b7e9-f4bf4d0b9bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:32:03.431560 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4486/8911] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Oct 16 02:32:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:32:03.471936 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fe8eb-9be9-458a-8969-2358d2ac41f9 service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:32:03.492880 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fe8eb-9be9-458a-8969-2358d2ac41f9 service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:32:03.498134 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bcc93-eac8-4598-914d-eb4686b5c53b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:32:03.498734 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bcc93-eac8-4598-914d-eb4686b5c53b service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:03.499048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bcc93-eac8-4598-914d-eb4686b5c53b service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:03.499324 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bcc93-eac8-4598-914d-eb4686b5c53b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:03.508371 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bcc93-eac8-4598-914d-eb4686b5c53b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:32:03.510048 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bcc93-eac8-4598-914d-eb4686b5c53b service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:32:03.518473 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4426/8912] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:32:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:32:13.248452 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87521d8-3921-48cc-b15b-818a1a2f190c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:13.249052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87521d8-3921-48cc-b15b-818a1a2f190c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:13.249052 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87521d8-3921-48cc-b15b-818a1a2f190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:13.268316 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d87521d8-3921-48cc-b15b-818a1a2f190c None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:32:13.270301 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d87521d8-3921-48cc-b15b-818a1a2f190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:32:13.277541 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4487/8913] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 02:32:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:32:13.289788 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bcc93-eac8-4598-914d-eb4686b5c53b service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:32:13.300726 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bcc93-eac8-4598-914d-eb4686b5c53b service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:32:13.305773 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef1574-9e08-490f-acba-11b69a173146 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:32:13.306362 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef1574-9e08-490f-acba-11b69a173146 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:13.306640 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef1574-9e08-490f-acba-11b69a173146 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:13.306935 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef1574-9e08-490f-acba-11b69a173146 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:13.314851 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef1574-9e08-490f-acba-11b69a173146 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:32:13.317242 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef1574-9e08-490f-acba-11b69a173146 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:32:13.325487 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4427/8914] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:32:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:32:14.681121 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87521d8-3921-48cc-b15b-818a1a2f190c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:32:14.691885 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87521d8-3921-48cc-b15b-818a1a2f190c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:32:14.695902 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b03fb-14c3-43cd-bd9a-cf8a0a853e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:32:14.696728 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b03fb-14c3-43cd-bd9a-cf8a0a853e33 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:14.697184 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b03fb-14c3-43cd-bd9a-cf8a0a853e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:14.697620 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b03fb-14c3-43cd-bd9a-cf8a0a853e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:14.699575 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bc4b03fb-14c3-43cd-bd9a-cf8a0a853e33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:32:14.714678 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b03fb-14c3-43cd-bd9a-cf8a0a853e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:32:14.716413 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b03fb-14c3-43cd-bd9a-cf8a0a853e33 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:32:14.729926 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4488/8915] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:32:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:32:18.234129 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532931a-e3b2-409a-b14f-8f3cf848289b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:18.234632 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532931a-e3b2-409a-b14f-8f3cf848289b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:18.234751 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532931a-e3b2-409a-b14f-8f3cf848289b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:18.254238 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1532931a-e3b2-409a-b14f-8f3cf848289b None None] MFA Rules not processed for user `3c8b1dd3162b4d05a253780a140042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 02:32:18.255481 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1532931a-e3b2-409a-b14f-8f3cf848289b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:32:18.263984 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4428/8916] 10.222.0.39 () {58 vars in 967 bytes} [Sun Oct 16 02:32:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 02:32:18.276544 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b03fb-14c3-43cd-bd9a-cf8a0a853e33 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:32:18.288477 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b03fb-14c3-43cd-bd9a-cf8a0a853e33 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:32:18.293568 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eb30d-2e72-4bf6-b4e4-705678249cc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8c6c33c3504949876d496a5213494d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:32:18.294175 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eb30d-2e72-4bf6-b4e4-705678249cc5 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:18.294458 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eb30d-2e72-4bf6-b4e4-705678249cc5 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:18.294730 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eb30d-2e72-4bf6-b4e4-705678249cc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:18.303703 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021eb30d-2e72-4bf6-b4e4-705678249cc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:32:18.305287 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021eb30d-2e72-4bf6-b4e4-705678249cc5 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:32:18.313715 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4489/8917] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Oct 16 02:32:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 02:32:18.321245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532931a-e3b2-409a-b14f-8f3cf848289b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:32:18.330719 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532931a-e3b2-409a-b14f-8f3cf848289b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:32:18.335321 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef018b-9194-4d44-95bd-0539b2980ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d6b7f81a7f4ba3a299acca4b7d4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:32:18.336029 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef018b-9194-4d44-95bd-0539b2980ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:18.336410 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef018b-9194-4d44-95bd-0539b2980ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:18.336718 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef018b-9194-4d44-95bd-0539b2980ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:18.338531 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-acef018b-9194-4d44-95bd-0539b2980ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:32:18.363795 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef018b-9194-4d44-95bd-0539b2980ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:32:18.365370 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef018b-9194-4d44-95bd-0539b2980ce4 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:32:18.373681 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4429/8918] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:32:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:32:26.813394 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eb30d-2e72-4bf6-b4e4-705678249cc5 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:32:26.820157 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=34 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:32:26.826809 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eb30d-2e72-4bf6-b4e4-705678249cc5 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:32:26.832518 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf538966-ddc8-46d7-8724-7c1597fe1e4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:32:26.833141 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf538966-ddc8-46d7-8724-7c1597fe1e4c service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:26.833422 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf538966-ddc8-46d7-8724-7c1597fe1e4c service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:26.833701 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf538966-ddc8-46d7-8724-7c1597fe1e4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:26.835441 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bf538966-ddc8-46d7-8724-7c1597fe1e4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:32:26.847595 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf538966-ddc8-46d7-8724-7c1597fe1e4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:32:26.849162 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf538966-ddc8-46d7-8724-7c1597fe1e4c service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:32:26.859136 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4490/8919] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:32:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:32:28.369950 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=65 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:32:29.872677 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef018b-9194-4d44-95bd-0539b2980ce4 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:32:29.962283 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef018b-9194-4d44-95bd-0539b2980ce4 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:32:29.969645 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:32:29.970332 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:29.970602 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:29.970876 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] PATH_INFO: `/v3/users/a5fafb3514414163a106f10d800bacfb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:29.972372 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fafb3514414163a106f10d800bacfb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:32:29.974426 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:32:30.031575 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fafb3514414163a106f10d800bacfb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.032255 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fafb3514414163a106f10d800bacfb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.044439 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fafb3514414163a106f10d800bacfb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.060435 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fafb3514414163a106f10d800bacfb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.061160 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fafb3514414163a106f10d800bacfb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.076080 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4430/8920] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:32:29 2022] DELETE /identity/v3/users/a5fafb3514414163a106f10d800bacfb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:32:30.251482 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf538966-ddc8-46d7-8724-7c1597fe1e4c service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:32:30.262952 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf538966-ddc8-46d7-8724-7c1597fe1e4c service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:32:30.324117 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:32:30.324743 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:30.325020 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:30.325288 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] PATH_INFO: `/v3/projects/7a6d6fcb1d6e4c27ad3094f19f63947a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:30.326372 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6d6fcb1d6e4c27ad3094f19f63947a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:32:30.328294 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:32:30.375276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'request_id': 'req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.381363 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'request_id': 'req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.388431 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'request_id': 'req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.411259 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] The token cache is being invalidate because project 7a6d6fcb1d6e4c27ad3094f19f63947a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:32:30.411543 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.412160 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.413634 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4491/8921] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:32:30 2022] DELETE /identity/v3/projects/7a6d6fcb1d6e4c27ad3094f19f63947a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:32:30.417835 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:32:30.419284 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:32:30.433522 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba46431-6c2e-4c4f-bf3f-4b32f37c8b3a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:32:30.491213 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:32:30.491839 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:30.492114 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:30.492380 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] PATH_INFO: `/v3/users/9d15a9ea45b943cebd016137e114d0db` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:30.493490 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d15a9ea45b943cebd016137e114d0db)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:32:30.495425 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:32:30.497659 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:32:30.546478 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d15a9ea45b943cebd016137e114d0db'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.547156 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d15a9ea45b943cebd016137e114d0db'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.559698 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d15a9ea45b943cebd016137e114d0db'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.567579 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d15a9ea45b943cebd016137e114d0db'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.568503 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d15a9ea45b943cebd016137e114d0db'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.580704 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4431/8922] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 02:32:30 2022] DELETE /identity/v3/users/9d15a9ea45b943cebd016137e114d0db => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 02:32:30.754056 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:32:30.755639 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:32:30.771218 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db00be-dfe3-4bda-90d1-db5dfb1b099c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:32:30.830475 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe17027043247a5ba6d4296eb07bb32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660cf62d7ad1499c81cc23908b4bdde4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:32:30.831716 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:30.831995 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:30.832276 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] PATH_INFO: `/v3/projects/070043e8968b4321be4c05af70286d5e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:30.833384 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070043e8968b4321be4c05af70286d5e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:32:30.835328 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:32:30.845424 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:32:30.884272 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070043e8968b4321be4c05af70286d5e', 'request_id': 'req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.890371 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070043e8968b4321be4c05af70286d5e', 'request_id': 'req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.898514 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070043e8968b4321be4c05af70286d5e', 'request_id': 'req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.908793 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] The token cache is being invalidate because project 070043e8968b4321be4c05af70286d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 02:32:30.909083 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.910783 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 02:32:30.912282 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4492/8923] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 02:32:30 2022] DELETE /identity/v3/projects/070043e8968b4321be4c05af70286d5e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 02:32:33.769830 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:32:33.771758 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:32:33.852103 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34355d3-e056-4084-b615-1a4f851e45e1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:32:33.911245 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9160e-0097-4a0d-911b-a0818a70dda6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:32:33.911870 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9160e-0097-4a0d-911b-a0818a70dda6 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:32:33.912153 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9160e-0097-4a0d-911b-a0818a70dda6 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:32:33.912415 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9160e-0097-4a0d-911b-a0818a70dda6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:32:33.914176 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-46b9160e-0097-4a0d-911b-a0818a70dda6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:32:33.926571 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9160e-0097-4a0d-911b-a0818a70dda6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:32:33.928173 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9160e-0097-4a0d-911b-a0818a70dda6 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:32:33.938030 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4432/8924] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:32:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:32:40.905843 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:32:43.933875 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:36:43.567808 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:36:43.569227 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:36:43.584545 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd41f0e-bb79-49d5-8ee3-14c23a91c2d5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:36:43.589483 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8d5a1-d267-410c-b14f-49d660a6ccee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:36:43.590071 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8d5a1-d267-410c-b14f-49d660a6ccee service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:36:43.590347 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8d5a1-d267-410c-b14f-49d660a6ccee service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:36:43.590615 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8d5a1-d267-410c-b14f-49d660a6ccee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:36:43.592302 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3ac8d5a1-d267-410c-b14f-49d660a6ccee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:36:43.603292 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8d5a1-d267-410c-b14f-49d660a6ccee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:36:43.604849 n-d-master-1 devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8d5a1-d267-410c-b14f-49d660a6ccee service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:36:43.614430 n-d-master-1 devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4493/8925] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:36:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:36:53.610297 n-d-master-1 devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:37:40.757240 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9160e-0097-4a0d-911b-a0818a70dda6 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 02:37:40.758636 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-46b9160e-0097-4a0d-911b-a0818a70dda6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 02:37:40.771322 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9160e-0097-4a0d-911b-a0818a70dda6 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 02:37:40.777215 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca5e61-95d5-4a37-b0e0-a57a2679e55c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd64951d9864572a117f9433aeaef63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2efc56617bd54471a648f03215b3bfb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 02:37:40.777829 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca5e61-95d5-4a37-b0e0-a57a2679e55c service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 02:37:40.778107 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca5e61-95d5-4a37-b0e0-a57a2679e55c service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 02:37:40.778379 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca5e61-95d5-4a37-b0e0-a57a2679e55c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 02:37:40.786592 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca5e61-95d5-4a37-b0e0-a57a2679e55c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 02:37:40.788382 n-d-master-1 devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca5e61-95d5-4a37-b0e0-a57a2679e55c service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 02:37:40.798027 n-d-master-1 devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4433/8926] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Oct 16 02:37:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 02:37:50.793933 n-d-master-1 devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}